2023-05-17T14:38:47.007 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-17T14:38:47.008 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695 --owner scheduled_yuriw@teuthology --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/orig.config.yaml 2023-05-17T14:38:47.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-17T14:38:47.143 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695 branch: wip-yuri2-testing-2023-05-15-0810-pacific_2 description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7276695' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri2-testing-2023-05-15-0810-pacific_2 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 20531b61f434caac5e29cea07411fac6911e8e91 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 20531b61f434caac5e29cea07411fac6911e8e91 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2023-05-15-0810-pacific_2 sha1: 20531b61f434caac5e29cea07411fac6911e8e91 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6166 sha1: 20531b61f434caac5e29cea07411fac6911e8e91 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri2-testing-2023-05-15-0810-pacific_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_20531b61f434caac5e29cea07411fac6911e8e91/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 20531b61f434caac5e29cea07411fac6911e8e91 targets: smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0tAqdKL6Wfx3pAYpzzDfQvjo9ohcyjoizmIK3bWRG+SdJilcHa7Yr3ggmMRvSnk78lgfTOgPRWluy1i+ShrLlgymGZxyXA70+iJQLWycrYtKuTF+YsP/zRTk0ENQ7whwgG5gn8ykqjVmIertNi/KXQf+vsIAEt8HA6tHcALYA4bVnTjNOpaf02WkYxoPrdUbUZ+2MI0JyCDYw1YaqpxPiGFGd7ERukBIxEFRELItzbOIn+77ilfTV2+QNNtEeXo7gWaQ6f6MluI0Vm+V9SVaXLKOTU0qYR8JRFinN90e76TMiFgt25YBVwZ58iYK585ABg4IDLMYbHHxmz2LRt1LV2hrzAq3zQoh4xJUGVWJAhWvUOWhMtWyq3bQZkNmsu3UM4cXwliRshSLAdSezx6x/hBEEIseygeNTzCdU7CJKzd9xen67UQ//VFA1T0lQZVNcQnZgTSSAG5wdTbZO3khcOypavRPNb/YONv68Zv7sc/JHAKlbxNarfY1RV9K2ZKc= smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIT6pm1GwEydSKlMy0dpeZlbS/axNoEY8ugWQRCpIjOMricwmwmD8UY9KHYVLjjOCdBjgbBJTmCcjPrXkxeNQlsZsNiDTjD/tHPJutz6f5MQTCus8tYQ4HSkInoMZkbF+//9MZS6dtLgr5boq8MJQPu9gwKErT4RbXXvYa4+Iz7ERI2216tWftcqb1+97lkvxX+vRU65p2c9CwBB5JdVSOI8ZNodEIOaI9ny6EsccOsYT+/gvEnV6vvANh6Pn92GlZBxB459BxbhshzTs4VRoiV4trIRwzhdM2tXthEvVtwqQWZ3Ckp6LHkGyIsmR0oOm1MnBsDp4o4we+PDsOQjvtv1CrH/e/A/rMoPvWeCVh9NxXG6RS9OrxZBjNEPMOdUU7EZDEhZd2wAUCm6UxTcqgV7hQ3wYLMkl1hRCPcUHgqst9etXO9ne7/t8HsMukBjAU1WZHzIkIrl3YOakHGGQc6O8L4BoPdCVoPFpfmgiPZwZbFHCBL3ujtba8bXQkw0k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-17_14:20:33 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-17T14:38:47.144 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_20531b61f434caac5e29cea07411fac6911e8e91/qa; will attempt to use it 2023-05-17T14:38:47.145 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_20531b61f434caac5e29cea07411fac6911e8e91/qa/tasks 2023-05-17T14:38:47.145 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-17T14:38:47.146 INFO:teuthology.task.internal:Checking packages... 2023-05-17T14:38:47.174 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '20531b61f434caac5e29cea07411fac6911e8e91' 2023-05-17T14:38:47.174 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-17T14:38:47.174 INFO:teuthology.packaging:ref: None 2023-05-17T14:38:47.175 INFO:teuthology.packaging:tag: None 2023-05-17T14:38:47.175 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-05-15-0810-pacific_2 2023-05-17T14:38:47.175 INFO:teuthology.packaging:sha1: 20531b61f434caac5e29cea07411fac6911e8e91 2023-05-17T14:38:47.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-05-15-0810-pacific_2 2023-05-17T14:38:47.313 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-145.g20531b61 2023-05-17T14:38:47.313 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-17T14:38:47.321 INFO:teuthology.task.internal:no buildpackages task found 2023-05-17T14:38:47.321 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-17T14:38:47.389 INFO:teuthology.task.internal:Saving configuration 2023-05-17T14:38:47.405 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-17T14:38:47.412 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-17T14:38:47.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 14:32:57.572157', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFeHygBHLC8fQp/p5dgAI65bB4a1rfWcemDxNYsZBhOs1QH6Z46cZjbB2rdec5Iyzz+lYP9SDCRBa6yE6G7a/Ls='} 2023-05-17T14:38:47.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 14:32:57.574043', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSy+LGDV/zkSwHODhGv7y6Y3HPYvzDkBZ3W3wx1Uc3bNE5fPEsWQp2Y7xnQjR6057sf9Y8OqsFht5TrYe7gTiM='} 2023-05-17T14:38:47.468 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-17T14:38:47.474 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-17T14:38:47.474 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-17T14:38:47.475 INFO:teuthology.run_tasks:Running task console_log... 2023-05-17T14:38:47.557 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8580423ee0>, signals=[15]) 2023-05-17T14:38:47.558 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-17T14:38:47.565 INFO:teuthology.task.internal:Opening connections... 2023-05-17T14:38:47.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:38:47.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T14:38:47.636 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:38:47.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T14:38:47.706 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-17T14:38:47.713 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-05-17T14:38:47.731 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-05-17T14:38:47.732 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-05-17T14:38:47.788 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-05-17T14:38:47.788 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.4 (Ootpa)" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.4" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-05-17T14:38:47.789 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-05-17T14:38:47.790 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-17T14:38:47.791 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-05-17T14:38:47.791 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-05-17T14:38:47.818 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-05-17T14:38:47.837 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-05-17T14:38:47.837 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-05-17T14:38:47.894 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2023-05-17T14:38:47.894 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.4 (Ootpa)" 2023-05-17T14:38:47.894 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.4" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-05-17T14:38:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2023-05-17T14:38:47.896 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-17T14:38:47.896 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-17T14:38:47.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:38:47.896 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-17T14:38:47.896 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-05-17T14:38:47.896 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-17T14:38:47.897 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-05-17T14:38:47.897 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-05-17T14:38:47.917 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-17T14:38:47.927 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-17T14:38:47.932 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-17T14:38:47.933 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2023-05-17T14:38:47.935 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-05-17T14:38:47.951 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-17T14:38:47.957 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-17T14:38:47.958 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2023-05-17T14:38:47.991 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-05-17T14:38:48.006 INFO:teuthology.orchestra.run.smithi027.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-05-17T14:38:48.007 INFO:teuthology.orchestra.run.smithi040.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-05-17T14:38:48.008 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-17T14:38:48.068 INFO:teuthology.run_tasks:Running task kernel... 2023-05-17T14:38:48.088 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-05-17T14:38:48.089 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-05-17T14:38:48.090 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-05-17T14:38:48.090 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-17T14:38:48.092 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-17T14:38:48.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:38:48.108 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-05-17T14:38:48.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:38:48.109 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-05-17T14:38:48.164 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-05-17T14:38:48.165 INFO:teuthology.task.kernel:Running kernel on smithi040: 4.18.0-305.25.1.el8_4.x86_64 2023-05-17T14:38:48.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2023-05-17T14:38:48.167 INFO:teuthology.orchestra.run.smithi027.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-05-17T14:38:48.167 INFO:teuthology.task.kernel:Running kernel on smithi027: 4.18.0-305.25.1.el8_4.x86_64 2023-05-17T14:38:48.167 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum install -y kernel 2023-05-17T14:38:49.578 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-05-17T14:38:49.579 INFO:teuthology.orchestra.run.smithi027.stdout:Unable to read consumer identity 2023-05-17T14:38:49.729 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-05-17T14:38:49.730 INFO:teuthology.orchestra.run.smithi040.stdout:Unable to read consumer identity 2023-05-17T14:38:53.477 INFO:teuthology.orchestra.run.smithi027.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-17T14:38:53.665 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-17T14:38:54.489 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:00 2023-05-17T14:38:54.588 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 16 MB/s | 14 MB 00:00 2023-05-17T14:38:57.553 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-05-17T14:38:57.688 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-05-17T14:38:58.246 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-05-17T14:38:58.246 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-05-17T14:38:58.247 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-05-17T14:38:58.389 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-05-17T14:38:58.390 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-05-17T14:38:58.391 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-05-17T14:38:58.471 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-05-17T14:38:58.471 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-05-17T14:38:58.472 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-05-17T14:38:58.521 DEBUG:teuthology.orchestra.run.smithi027:> echo no | sudo yum reinstall kernel || true 2023-05-17T14:38:58.611 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-05-17T14:38:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2023-05-17T14:38:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-05-17T14:38:58.735 DEBUG:teuthology.orchestra.run.smithi040:> echo no | sudo yum reinstall kernel || true 2023-05-17T14:38:58.928 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-05-17T14:38:58.929 INFO:teuthology.orchestra.run.smithi027.stdout:Unable to read consumer identity 2023-05-17T14:38:59.102 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-05-17T14:38:59.102 INFO:teuthology.orchestra.run.smithi040.stdout:Unable to read consumer identity 2023-05-17T14:38:59.223 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:02 ago on Wed 17 May 2023 02:38:57 PM UTC. 2023-05-17T14:38:59.358 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-17T14:38:59.358 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:38:59.358 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:38:59.376 INFO:teuthology.orchestra.run.smithi027.stderr:Error: No packages marked for reinstall. 2023-05-17T14:38:59.407 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:02 ago on Wed 17 May 2023 02:38:57 PM UTC. 2023-05-17T14:38:59.426 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum reinstall -y kernel || true 2023-05-17T14:38:59.557 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-17T14:38:59.557 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:38:59.557 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:38:59.582 INFO:teuthology.orchestra.run.smithi040.stderr:Error: No packages marked for reinstall. 2023-05-17T14:38:59.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum reinstall -y kernel || true 2023-05-17T14:38:59.792 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-05-17T14:38:59.792 INFO:teuthology.orchestra.run.smithi027.stdout:Unable to read consumer identity 2023-05-17T14:38:59.997 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-05-17T14:38:59.998 INFO:teuthology.orchestra.run.smithi040.stdout:Unable to read consumer identity 2023-05-17T14:39:00.078 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:03 ago on Wed 17 May 2023 02:38:57 PM UTC. 2023-05-17T14:39:00.216 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-17T14:39:00.216 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:39:00.216 INFO:teuthology.orchestra.run.smithi027.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:39:00.225 INFO:teuthology.orchestra.run.smithi027.stderr:Error: No packages marked for reinstall. 2023-05-17T14:39:00.275 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel --last | head -n 1 2023-05-17T14:39:00.285 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:03 ago on Wed 17 May 2023 02:38:57 PM UTC. 2023-05-17T14:39:00.403 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-4.18.0-305.25.1.el8_4.x86_64 Wed 21 Dec 2022 01:05:24 PM UTC 2023-05-17T14:39:00.404 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.25.1.el8_4.x86_64 2023-05-17T14:39:00.405 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-17T14:39:00.405 DEBUG:teuthology.parallel:result is None 2023-05-17T14:39:00.414 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-17T14:39:00.414 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:39:00.415 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-17T14:39:00.428 INFO:teuthology.orchestra.run.smithi040.stderr:Error: No packages marked for reinstall. 2023-05-17T14:39:00.478 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel --last | head -n 1 2023-05-17T14:39:00.608 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-4.18.0-305.25.1.el8_4.x86_64 Wed 21 Dec 2022 01:05:24 PM UTC 2023-05-17T14:39:00.609 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.25.1.el8_4.x86_64 2023-05-17T14:39:00.610 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-17T14:39:00.610 DEBUG:teuthology.parallel:result is None 2023-05-17T14:39:00.610 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-17T14:39:00.618 INFO:teuthology.task.internal:Creating test directory... 2023-05-17T14:39:00.618 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-17T14:39:00.620 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-17T14:39:00.635 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-17T14:39:00.641 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-17T14:39:00.694 INFO:teuthology.task.internal:Creating archive directory... 2023-05-17T14:39:00.695 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-17T14:39:00.697 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-17T14:39:00.728 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-17T14:39:00.735 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-17T14:39:00.735 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-17T14:39:00.757 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-17T14:39:00.787 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T14:39:00.792 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T14:39:00.806 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T14:39:00.808 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T14:39:00.809 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-17T14:39:00.816 INFO:teuthology.task.internal:Configuring sudo... 2023-05-17T14:39:00.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-17T14:39:00.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-17T14:39:00.876 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-17T14:39:00.886 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-17T14:39:00.886 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-17T14:39:00.916 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-17T14:39:00.931 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T14:39:01.012 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T14:39:01.057 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T14:39:01.141 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T14:39:01.177 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:39:01.178 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-17T14:39:01.242 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T14:39:01.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T14:39:01.325 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T14:39:01.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T14:39:01.447 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:39:01.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-17T14:39:01.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2023-05-17T14:39:01.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-05-17T14:39:01.561 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-17T14:39:01.604 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-17T14:39:01.948 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-17T14:39:01.961 INFO:teuthology.task.internal:Starting timer... 2023-05-17T14:39:01.962 INFO:teuthology.run_tasks:Running task pcp... 2023-05-17T14:39:01.977 INFO:teuthology.run_tasks:Running task selinux... 2023-05-17T14:39:02.032 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-05-17T14:39:02.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2023-05-17T14:39:02.087 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: [ OK ] 2023-05-17T14:39:02.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-05-17T14:39:02.170 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: [ OK ] 2023-05-17T14:39:02.171 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-17T14:39:02.172 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2023-05-17T14:39:02.195 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2023-05-17T14:39:02.195 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-05-17T14:39:02.215 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-05-17T14:39:02.216 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi040.front.sepia.ceph.com': 'permissive'} 2023-05-17T14:39:02.216 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-17T14:39:02.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:39:02.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-17T14:39:02.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:39:02.286 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-17T14:39:02.287 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2023-05-17T14:39:02.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-05-17T14:39:02.355 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-17T14:39:02.364 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-05-17T14:39:02.365 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-17T14:39:02.386 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-17T14:39:02.387 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-17T14:50:50.953 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi040.front.sepia.ceph.com')] 2023-05-17T14:50:50.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-05-17T14:50:50.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T14:50:51.025 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-05-17T14:50:51.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-17T14:50:51.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T14:50:51.114 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-05-17T14:50:51.180 INFO:teuthology.run_tasks:Running task clock... 2023-05-17T14:50:51.193 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-17T14:50:51.194 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-17T14:50:51.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T14:50:51.199 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-17T14:50:51.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T14:50:51.225 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-17T14:50:51.240 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-17T14:50:51.249 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-17T14:50:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-17T14:50:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2023-05-17T14:50:51.284 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2023-05-17T14:50:51.298 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-17T14:50:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-05-17T14:50:51.312 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-17T14:50:51.314 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-05-17T14:50:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-17T14:50:51.342 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-17T14:50:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:bash: ntpq: command not found 2023-05-17T14:50:51.380 INFO:teuthology.orchestra.run.smithi027.stdout:210 Number of sources = 4 2023-05-17T14:50:51.381 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-17T14:50:51.381 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-05-17T14:50:51.381 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.381 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.382 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.382 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-05-17T14:50:51.416 INFO:teuthology.orchestra.run.smithi040.stdout:210 Number of sources = 4 2023-05-17T14:50:51.417 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-17T14:50:51.417 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-05-17T14:50:51.417 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.417 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.417 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.417 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T14:50:51.418 INFO:teuthology.run_tasks:Running task install... 2023-05-17T14:50:51.426 DEBUG:teuthology.task.install:project ceph 2023-05-17T14:50:51.427 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91'}} 2023-05-17T14:50:51.427 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91'} 2023-05-17T14:50:51.428 INFO:teuthology.task.install:Using flavor: default 2023-05-17T14:50:51.433 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-17T14:50:51.434 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-17T14:50:51.434 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91', 'tag': None, 'wait_for_package': False} 2023-05-17T14:50:51.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=20531b61f434caac5e29cea07411fac6911e8e91 2023-05-17T14:50:51.437 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91', 'tag': None, 'wait_for_package': False} 2023-05-17T14:50:51.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=20531b61f434caac5e29cea07411fac6911e8e91 2023-05-17T14:50:51.582 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/ 2023-05-17T14:50:51.583 INFO:teuthology.task.install.rpm:Package version is 16.2.13-145.g20531b61 2023-05-17T14:50:51.599 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/ 2023-05-17T14:50:51.600 INFO:teuthology.task.install.rpm:Package version is 16.2.13-145.g20531b61 2023-05-17T14:50:51.704 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-17T14:50:51.704 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:50:51.705 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-17T14:50:51.707 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-05-15-0810-pacific_2/20531b61f434caac5e29cea07411fac6911e8e91/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-17T14:50:51.707 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:50:51.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-17T14:50:51.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-05-17T14:50:51.733 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/20531b61f434caac5e29cea07411fac6911e8e91/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-17T14:50:51.734 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-05-17T14:50:51.735 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/20531b61f434caac5e29cea07411fac6911e8e91/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-17T14:50:51.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-17T14:50:51.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-17T14:50:51.873 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-17T14:50:51.878 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-17T14:50:51.937 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2023-05-17T14:50:51.938 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2023-05-17T14:50:51.942 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-05-17T14:50:51.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-05-17T14:50:52.342 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-05-17T14:50:52.349 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-05-17T14:50:52.672 INFO:teuthology.orchestra.run.smithi027.stdout:44 files removed 2023-05-17T14:50:52.688 INFO:teuthology.orchestra.run.smithi040.stdout:44 files removed 2023-05-17T14:50:52.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-05-17T14:50:52.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-05-17T14:50:53.086 INFO:teuthology.orchestra.run.smithi027.stdout:Updating Subscription Management repositories. 2023-05-17T14:50:53.106 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-05-17T14:50:53.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 347 kB/s | 76 kB 00:00 2023-05-17T14:50:53.784 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 336 kB/s | 76 kB 00:00 2023-05-17T14:50:54.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2023-05-17T14:50:54.015 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2023-05-17T14:50:54.233 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 7.7 kB/s | 1.4 kB 00:00 2023-05-17T14:50:54.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2023-05-17T14:50:56.879 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-17T14:50:56.903 INFO:teuthology.orchestra.run.smithi027.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-17T14:50:57.715 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 18 MB/s | 14 MB 00:00 2023-05-17T14:51:00.729 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-05-17T14:51:01.160 INFO:teuthology.orchestra.run.smithi027.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 MB/s | 33 MB 00:00 2023-05-17T14:51:03.738 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 2.0 MB/s | 14 MB 00:06 2023-05-17T14:51:06.739 INFO:teuthology.orchestra.run.smithi027.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 110 MB/s | 38 MB 00:00 2023-05-17T14:51:06.835 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-05-17T14:51:07.247 INFO:teuthology.orchestra.run.smithi040.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 117 MB/s | 38 MB 00:00 2023-05-17T14:51:13.074 INFO:teuthology.orchestra.run.smithi040.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 110 MB/s | 33 MB 00:00 2023-05-17T14:51:15.510 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T14:51:15.510 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T14:51:15.522 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-05-17T14:51:15.523 INFO:teuthology.orchestra.run.smithi027.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-05-17T14:51:15.524 INFO:teuthology.orchestra.run.smithi027.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-05-17T14:51:15.524 INFO:teuthology.orchestra.run.smithi027.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-17T14:51:15.526 INFO:teuthology.orchestra.run.smithi027.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-17T14:51:15.529 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-05-17T14:51:15.530 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-05-17T14:51:16.036 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-05-17T14:51:16.048 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================================================== 2023-05-17T14:51:16.048 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-05-17T14:51:16.048 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================================================== 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:16.2.13-145.g20531b61.el8 ceph 6.4 k 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:16.2.13-145.g20531b61.el8 ceph 6.1 M 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:16.2.13-145.g20531b61.el8 ceph 908 k 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-145.g20531b61.el8 ceph 161 k 2023-05-17T14:51:16.049 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:16.2.13-145.g20531b61.el8 ceph 1.6 M 2023-05-17T14:51:16.050 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 116 k 2023-05-17T14:51:16.050 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 3.1 M 2023-05-17T14:51:16.050 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 8.6 M 2023-05-17T14:51:16.050 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 27 k 2023-05-17T14:51:16.050 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:16.2.13-145.g20531b61.el8 ceph 12 M 2023-05-17T14:51:16.050 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:16.2.13-145.g20531b61.el8 ceph 51 M 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 84 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror x86_64 2:16.2.13-145.g20531b61.el8 ceph 256 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 18 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:16.2.13-145.g20531b61.el8 ceph 25 k 2023-05-17T14:51:16.051 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:16.2.13-145.g20531b61.el8 ceph 822 k 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:16.2.13-145.g20531b61.el8 ceph 131 k 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:16.2.13-145.g20531b61.el8 ceph 215 k 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:16.2.13-145.g20531b61.el8 ceph 389 k 2023-05-17T14:51:16.052 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:16.2.13-145.g20531b61.el8 ceph 368 k 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:16.2.13-145.g20531b61.el8 ceph 114 k 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:16.2.13-145.g20531b61.el8 ceph 88 k 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:16.2.13-145.g20531b61.el8 ceph 3.7 M 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:16.2.13-145.g20531b61.el8 ceph 173 k 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2023-05-17T14:51:16.053 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:16.2.13-145.g20531b61.el8 ceph 3.7 M 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:16.2.13-145.g20531b61.el8 ceph 4.2 M 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:16.2.13-145.g20531b61.el8 ceph 24 M 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 24 k 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:16.2.13-145.g20531b61.el8 ceph 2.4 M 2023-05-17T14:51:16.054 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 244 k 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:16.2.13-145.g20531b61.el8 ceph 5.0 M 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:16.2.13-145.g20531b61.el8 ceph 18 M 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 15 k 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:16.2.13-145.g20531b61.el8 ceph 26 k 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-17T14:51:16.055 INFO:teuthology.orchestra.run.smithi027.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:16.2.13-145.g20531b61.el8 ceph 174 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-17T14:51:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:16.2.13-145.g20531b61.el8 ceph 493 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:16.2.13-145.g20531b61.el8 ceph 3.8 M 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-17T14:51:16.057 INFO:teuthology.orchestra.run.smithi027.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-17T14:51:16.058 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:16.2.13-145.g20531b61.el8 ceph 45 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:16.2.13-145.g20531b61.el8 ceph 97 k 2023-05-17T14:51:16.059 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-17T14:51:16.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-17T14:51:16.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-17T14:51:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-05-17T14:51:16.063 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-17T14:51:16.064 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:51:16.065 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-05-17T14:51:16.066 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================================================== 2023-05-17T14:51:16.066 INFO:teuthology.orchestra.run.smithi027.stdout:Install 118 Packages 2023-05-17T14:51:16.066 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 2 Packages 2023-05-17T14:51:16.066 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:51:16.066 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 200 M 2023-05-17T14:51:16.067 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-05-17T14:51:16.257 INFO:teuthology.orchestra.run.smithi027.stdout:(1/120): ceph-16.2.13-145.g20531b61.el8.x86_64. 72 kB/s | 6.4 kB 00:00 2023-05-17T14:51:16.442 INFO:teuthology.orchestra.run.smithi027.stdout:(2/120): ceph-fuse-16.2.13-145.g20531b61.el8.x8 4.8 MB/s | 908 kB 00:00 2023-05-17T14:51:16.506 INFO:teuthology.orchestra.run.smithi027.stdout:(3/120): ceph-immutable-object-cache-16.2.13-14 2.5 MB/s | 161 kB 00:00 2023-05-17T14:51:16.807 INFO:teuthology.orchestra.run.smithi027.stdout:(4/120): ceph-base-16.2.13-145.g20531b61.el8.x8 9.5 MB/s | 6.1 MB 00:00 2023-05-17T14:51:16.829 INFO:teuthology.orchestra.run.smithi027.stdout:(5/120): ceph-mds-16.2.13-145.g20531b61.el8.x86 7.5 MB/s | 2.4 MB 00:00 2023-05-17T14:51:16.978 INFO:teuthology.orchestra.run.smithi027.stdout:(6/120): ceph-mgr-16.2.13-145.g20531b61.el8.x86 9.4 MB/s | 1.6 MB 00:00 2023-05-17T14:51:17.422 INFO:teuthology.orchestra.run.smithi027.stdout:(7/120): ceph-mon-16.2.13-145.g20531b61.el8.x86 8.5 MB/s | 5.0 MB 00:00 2023-05-17T14:51:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:(8/120): ceph-osd-16.2.13-145.g20531b61.el8.x86 10 MB/s | 18 MB 00:01 2023-05-17T14:51:18.876 INFO:teuthology.orchestra.run.smithi027.stdout:(9/120): ceph-common-16.2.13-145.g20531b61.el8. 8.9 MB/s | 24 MB 00:02 2023-05-17T14:51:18.943 INFO:teuthology.orchestra.run.smithi027.stdout:(10/120): ceph-selinux-16.2.13-145.g20531b61.el 128 kB/s | 26 kB 00:00 2023-05-17T14:51:18.977 INFO:teuthology.orchestra.run.smithi027.stdout:(11/120): ceph-radosgw-16.2.13-145.g20531b61.el 7.4 MB/s | 12 MB 00:01 2023-05-17T14:51:19.053 INFO:teuthology.orchestra.run.smithi027.stdout:(12/120): cephfs-mirror-16.2.13-145.g20531b61.e 2.3 MB/s | 256 kB 00:00 2023-05-17T14:51:19.054 INFO:teuthology.orchestra.run.smithi027.stdout:(13/120): libcephfs-devel-16.2.13-145.g20531b61 331 kB/s | 25 kB 00:00 2023-05-17T14:51:19.119 INFO:teuthology.orchestra.run.smithi027.stdout:(14/120): libcephfs2-16.2.13-145.g20531b61.el8. 12 MB/s | 822 kB 00:00 2023-05-17T14:51:19.124 INFO:teuthology.orchestra.run.smithi027.stdout:(15/120): libcephsqlite-16.2.13-145.g20531b61.e 2.4 MB/s | 174 kB 00:00 2023-05-17T14:51:19.154 INFO:teuthology.orchestra.run.smithi027.stdout:(16/120): librados-devel-16.2.13-145.g20531b61. 3.7 MB/s | 131 kB 00:00 2023-05-17T14:51:19.173 INFO:teuthology.orchestra.run.smithi027.stdout:(17/120): libradosstriper1-16.2.13-145.g20531b6 9.8 MB/s | 493 kB 00:00 2023-05-17T14:51:19.230 INFO:teuthology.orchestra.run.smithi027.stdout:(18/120): python3-ceph-argparse-16.2.13-145.g20 785 kB/s | 45 kB 00:00 2023-05-17T14:51:19.291 INFO:teuthology.orchestra.run.smithi027.stdout:(19/120): python3-ceph-common-16.2.13-145.g2053 1.6 MB/s | 97 kB 00:00 2023-05-17T14:51:19.355 INFO:teuthology.orchestra.run.smithi027.stdout:(20/120): python3-cephfs-16.2.13-145.g20531b61. 3.3 MB/s | 215 kB 00:00 2023-05-17T14:51:19.427 INFO:teuthology.orchestra.run.smithi027.stdout:(21/120): python3-rados-16.2.13-145.g20531b61.e 5.3 MB/s | 389 kB 00:00 2023-05-17T14:51:19.466 INFO:teuthology.orchestra.run.smithi027.stdout:(22/120): librgw2-16.2.13-145.g20531b61.el8.x86 12 MB/s | 3.8 MB 00:00 2023-05-17T14:51:19.476 INFO:teuthology.orchestra.run.smithi027.stdout:(23/120): python3-rbd-16.2.13-145.g20531b61.el8 7.4 MB/s | 368 kB 00:00 2023-05-17T14:51:19.505 INFO:teuthology.orchestra.run.smithi027.stdout:(24/120): python3-rgw-16.2.13-145.g20531b61.el8 2.9 MB/s | 114 kB 00:00 2023-05-17T14:51:19.510 INFO:teuthology.orchestra.run.smithi027.stdout:(25/120): rbd-fuse-16.2.13-145.g20531b61.el8.x8 2.6 MB/s | 88 kB 00:00 2023-05-17T14:51:19.575 INFO:teuthology.orchestra.run.smithi027.stdout:(26/120): rbd-nbd-16.2.13-145.g20531b61.el8.x86 2.6 MB/s | 173 kB 00:00 2023-05-17T14:51:19.633 INFO:teuthology.orchestra.run.smithi027.stdout:(27/120): ceph-grafana-dashboards-16.2.13-145.g 422 kB/s | 24 kB 00:00 2023-05-17T14:51:19.696 INFO:teuthology.orchestra.run.smithi027.stdout:(28/120): ceph-mgr-cephadm-16.2.13-145.g20531b6 1.8 MB/s | 116 kB 00:00 2023-05-17T14:51:19.809 INFO:teuthology.orchestra.run.smithi027.stdout:(29/120): rbd-mirror-16.2.13-145.g20531b61.el8. 12 MB/s | 3.7 MB 00:00 2023-05-17T14:51:20.103 INFO:teuthology.orchestra.run.smithi027.stdout:(30/120): ceph-mgr-dashboard-16.2.13-145.g20531 7.7 MB/s | 3.1 MB 00:00 2023-05-17T14:51:20.166 INFO:teuthology.orchestra.run.smithi027.stdout:(31/120): ceph-mgr-modules-core-16.2.13-145.g20 3.8 MB/s | 244 kB 00:00 2023-05-17T14:51:20.218 INFO:teuthology.orchestra.run.smithi027.stdout:(32/120): ceph-mgr-rook-16.2.13-145.g20531b61.e 527 kB/s | 27 kB 00:00 2023-05-17T14:51:20.270 INFO:teuthology.orchestra.run.smithi027.stdout:(33/120): ceph-prometheus-alerts-16.2.13-145.g2 288 kB/s | 15 kB 00:00 2023-05-17T14:51:20.325 INFO:teuthology.orchestra.run.smithi027.stdout:(34/120): cephadm-16.2.13-145.g20531b61.el8.noa 1.5 MB/s | 84 kB 00:00 2023-05-17T14:51:20.402 INFO:teuthology.orchestra.run.smithi027.stdout:(35/120): cephfs-top-16.2.13-145.g20531b61.el8. 340 kB/s | 18 kB 00:00 2023-05-17T14:51:20.416 INFO:teuthology.orchestra.run.smithi027.stdout:(36/120): ceph-mgr-diskprediction-local-16.2.13 14 MB/s | 8.6 MB 00:00 2023-05-17T14:51:20.603 INFO:teuthology.orchestra.run.smithi027.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-05-17T14:51:20.604 INFO:teuthology.orchestra.run.smithi027.stdout:(38/120): leveldb-1.22-1.el8.x86_64.rpm 966 kB/s | 181 kB 00:00 2023-05-17T14:51:20.640 INFO:teuthology.orchestra.run.smithi027.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 1.5 MB/s | 59 kB 00:00 2023-05-17T14:51:20.642 INFO:teuthology.orchestra.run.smithi027.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.9 MB/s | 75 kB 00:00 2023-05-17T14:51:20.678 INFO:teuthology.orchestra.run.smithi027.stdout:(41/120): python3-apipkg-1.5-6.el8.noarch.rpm 563 kB/s | 21 kB 00:00 2023-05-17T14:51:20.679 INFO:teuthology.orchestra.run.smithi027.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.1 MB/s | 44 kB 00:00 2023-05-17T14:51:20.718 INFO:teuthology.orchestra.run.smithi027.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.6 MB/s | 185 kB 00:00 2023-05-17T14:51:20.718 INFO:teuthology.orchestra.run.smithi027.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 859 kB/s | 33 kB 00:00 2023-05-17T14:51:20.755 INFO:teuthology.orchestra.run.smithi027.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 440 kB/s | 16 kB 00:00 2023-05-17T14:51:20.757 INFO:teuthology.orchestra.run.smithi027.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.3 MB/s | 173 kB 00:00 2023-05-17T14:51:20.832 INFO:teuthology.orchestra.run.smithi027.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.9 MB/s | 384 kB 00:00 2023-05-17T14:51:20.835 INFO:teuthology.orchestra.run.smithi027.stdout:(48/120): python3-execnet-1.7.1-1.el8.noarch.rp 4.5 MB/s | 355 kB 00:00 2023-05-17T14:51:20.871 INFO:teuthology.orchestra.run.smithi027.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 2.0 MB/s | 81 kB 00:00 2023-05-17T14:51:20.873 INFO:teuthology.orchestra.run.smithi027.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 292 kB/s | 11 kB 00:00 2023-05-17T14:51:20.908 INFO:teuthology.orchestra.run.smithi027.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 474 kB/s | 18 kB 00:00 2023-05-17T14:51:20.947 INFO:teuthology.orchestra.run.smithi027.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2023-05-17T14:51:20.986 INFO:teuthology.orchestra.run.smithi027.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.5 MB/s | 59 kB 00:00 2023-05-17T14:51:21.030 INFO:teuthology.orchestra.run.smithi027.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 7.4 MB/s | 1.2 MB 00:00 2023-05-17T14:51:21.031 INFO:teuthology.orchestra.run.smithi027.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.2 MB/s | 283 kB 00:00 2023-05-17T14:51:21.067 INFO:teuthology.orchestra.run.smithi027.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 420 kB/s | 16 kB 00:00 2023-05-17T14:51:21.069 INFO:teuthology.orchestra.run.smithi027.stdout:(57/120): python3-remoto-1.2.1-1.el8.noarch.rpm 1.3 MB/s | 49 kB 00:00 2023-05-17T14:51:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 900 kB/s | 34 kB 00:00 2023-05-17T14:51:21.108 INFO:teuthology.orchestra.run.smithi027.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 4.9 MB/s | 196 kB 00:00 2023-05-17T14:51:21.143 INFO:teuthology.orchestra.run.smithi027.stdout:(60/120): python3-rsa-4.8-1.el8.noarch.rpm 1.6 MB/s | 61 kB 00:00 2023-05-17T14:51:21.145 INFO:teuthology.orchestra.run.smithi027.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 505 kB/s | 19 kB 00:00 2023-05-17T14:51:21.180 INFO:teuthology.orchestra.run.smithi027.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 642 kB/s | 24 kB 00:00 2023-05-17T14:51:21.183 INFO:teuthology.orchestra.run.smithi027.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 779 kB/s | 29 kB 00:00 2023-05-17T14:51:21.218 INFO:teuthology.orchestra.run.smithi027.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 735 kB/s | 27 kB 00:00 2023-05-17T14:51:21.223 INFO:teuthology.orchestra.run.smithi027.stdout:(65/120): python3-waitress-1.2.1-2.el8.1.noarch 5.9 MB/s | 241 kB 00:00 2023-05-17T14:51:21.259 INFO:teuthology.orchestra.run.smithi027.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 6.0 MB/s | 251 kB 00:00 2023-05-17T14:51:21.261 INFO:teuthology.orchestra.run.smithi027.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.6 MB/s | 61 kB 00:00 2023-05-17T14:51:21.297 INFO:teuthology.orchestra.run.smithi027.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 2.2 MB/s | 85 kB 00:00 2023-05-17T14:51:21.298 INFO:teuthology.orchestra.run.smithi027.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 612 kB/s | 23 kB 00:00 2023-05-17T14:51:21.301 INFO:teuthology.orchestra.run.smithi027.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-05-17T14:51:21.359 INFO:teuthology.orchestra.run.smithi027.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 765 kB/s | 44 kB 00:00 2023-05-17T14:51:21.385 INFO:teuthology.orchestra.run.smithi027.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-05-17T14:51:21.412 INFO:teuthology.orchestra.run.smithi027.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 5.9 MB/s | 161 kB 00:00 2023-05-17T14:51:21.441 INFO:teuthology.orchestra.run.smithi027.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2023-05-17T14:51:21.471 INFO:teuthology.orchestra.run.smithi027.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 15 MB/s | 457 kB 00:00 2023-05-17T14:51:21.510 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T14:51:21.511 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T14:51:21.522 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-05-17T14:51:21.523 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-05-17T14:51:21.524 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-05-17T14:51:21.525 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-17T14:51:21.527 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-17T14:51:21.529 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-05-17T14:51:21.530 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-05-17T14:51:21.615 INFO:teuthology.orchestra.run.smithi027.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 46 MB/s | 15 MB 00:00 2023-05-17T14:51:22.023 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-05-17T14:51:22.035 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================================================== 2023-05-17T14:51:22.035 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-05-17T14:51:22.035 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================================================== 2023-05-17T14:51:22.035 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:16.2.13-145.g20531b61.el8 ceph 6.4 k 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:16.2.13-145.g20531b61.el8 ceph 6.1 M 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:16.2.13-145.g20531b61.el8 ceph 908 k 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-145.g20531b61.el8 ceph 161 k 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:16.2.13-145.g20531b61.el8 ceph 1.6 M 2023-05-17T14:51:22.036 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 116 k 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 3.1 M 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 8.6 M 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 27 k 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:16.2.13-145.g20531b61.el8 ceph 12 M 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:16.2.13-145.g20531b61.el8 ceph 51 M 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 84 k 2023-05-17T14:51:22.037 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:16.2.13-145.g20531b61.el8 ceph 256 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 18 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:16.2.13-145.g20531b61.el8 ceph 25 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:16.2.13-145.g20531b61.el8 ceph 822 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:16.2.13-145.g20531b61.el8 ceph 131 k 2023-05-17T14:51:22.038 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:16.2.13-145.g20531b61.el8 ceph 215 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:16.2.13-145.g20531b61.el8 ceph 389 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:16.2.13-145.g20531b61.el8 ceph 368 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:16.2.13-145.g20531b61.el8 ceph 114 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:16.2.13-145.g20531b61.el8 ceph 88 k 2023-05-17T14:51:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:16.2.13-145.g20531b61.el8 ceph 3.7 M 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:16.2.13-145.g20531b61.el8 ceph 173 k 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:16.2.13-145.g20531b61.el8 ceph 3.7 M 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:16.2.13-145.g20531b61.el8 ceph 4.2 M 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-05-17T14:51:22.040 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:16.2.13-145.g20531b61.el8 ceph 24 M 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 24 k 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:16.2.13-145.g20531b61.el8 ceph 2.4 M 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 244 k 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:16.2.13-145.g20531b61.el8 ceph 5.0 M 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:16.2.13-145.g20531b61.el8 ceph 18 M 2023-05-17T14:51:22.041 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:16.2.13-145.g20531b61.el8 ceph-noarch 15 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:16.2.13-145.g20531b61.el8 ceph 26 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-05-17T14:51:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:16.2.13-145.g20531b61.el8 ceph 174 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:16.2.13-145.g20531b61.el8 ceph 493 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-05-17T14:51:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:16.2.13-145.g20531b61.el8 ceph 3.8 M 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-17T14:51:22.044 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-17T14:51:22.045 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:16.2.13-145.g20531b61.el8 ceph 45 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:16.2.13-145.g20531b61.el8 ceph 97 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-05-17T14:51:22.046 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-17T14:51:22.047 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-17T14:51:22.048 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-17T14:51:22.049 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-17T14:51:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-05-17T14:51:22.051 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================================================== 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout:Install 118 Packages 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 2 Packages 2023-05-17T14:51:22.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:51:22.053 INFO:teuthology.orchestra.run.smithi027.stdout:(77/120): ceph-test-16.2.13-145.g20531b61.el8.x 16 MB/s | 51 MB 00:03 2023-05-17T14:51:22.053 INFO:teuthology.orchestra.run.smithi027.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 89 kB/s | 39 kB 00:00 2023-05-17T14:51:22.054 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 200 M 2023-05-17T14:51:22.054 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-05-17T14:51:22.081 INFO:teuthology.orchestra.run.smithi027.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.1 MB/s | 259 kB 00:00 2023-05-17T14:51:22.114 INFO:teuthology.orchestra.run.smithi027.stdout:(80/120): python3-babel-2.5.1-5.el8.noarch.rpm 7.5 MB/s | 4.8 MB 00:00 2023-05-17T14:51:22.118 INFO:teuthology.orchestra.run.smithi027.stdout:(81/120): bison-3.0.4-10.el8.x86_64.rpm 9.5 MB/s | 688 kB 00:00 2023-05-17T14:51:22.120 INFO:teuthology.orchestra.run.smithi027.stdout:(82/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 5.7 MB/s | 225 kB 00:00 2023-05-17T14:51:22.145 INFO:teuthology.orchestra.run.smithi027.stdout:(83/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.0 MB/s | 126 kB 00:00 2023-05-17T14:51:22.148 INFO:teuthology.orchestra.run.smithi027.stdout:(84/120): oniguruma-6.8.2-2.el8.x86_64.rpm 6.7 MB/s | 187 kB 00:00 2023-05-17T14:51:22.178 INFO:teuthology.orchestra.run.smithi027.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 9.8 MB/s | 302 kB 00:00 2023-05-17T14:51:22.180 INFO:teuthology.orchestra.run.smithi027.stdout:(86/120): python3-jinja2-2.10.1-2.el8_0.noarch. 15 MB/s | 538 kB 00:00 2023-05-17T14:51:22.200 INFO:teuthology.orchestra.run.smithi040.stdout:(1/120): ceph-16.2.13-145.g20531b61.el8.x86_64. 73 kB/s | 6.4 kB 00:00 2023-05-17T14:51:22.204 INFO:teuthology.orchestra.run.smithi027.stdout:(87/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 44 MB/s | 3.7 MB 00:00 2023-05-17T14:51:22.206 INFO:teuthology.orchestra.run.smithi027.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 4.2 MB/s | 110 kB 00:00 2023-05-17T14:51:22.207 INFO:teuthology.orchestra.run.smithi027.stdout:(89/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.3 MB/s | 157 kB 00:00 2023-05-17T14:51:22.233 INFO:teuthology.orchestra.run.smithi027.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2023-05-17T14:51:22.233 INFO:teuthology.orchestra.run.smithi027.stdout:(91/120): python3-jsonpointer-1.10-11.el8.noarc 735 kB/s | 20 kB 00:00 2023-05-17T14:51:22.241 INFO:teuthology.orchestra.run.smithi027.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2023-05-17T14:51:22.270 INFO:teuthology.orchestra.run.smithi027.stdout:(93/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.4 MB/s | 54 kB 00:00 2023-05-17T14:51:22.308 INFO:teuthology.orchestra.run.smithi027.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2023-05-17T14:51:22.328 INFO:teuthology.orchestra.run.smithi027.stdout:(95/120): openblas-threads-0.3.12-1.el8.x86_64. 50 MB/s | 4.7 MB 00:00 2023-05-17T14:51:22.330 INFO:teuthology.orchestra.run.smithi027.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 825 kB/s | 19 kB 00:00 2023-05-17T14:51:22.361 INFO:teuthology.orchestra.run.smithi027.stdout:(97/120): openblas-0.3.12-1.el8.x86_64.rpm 38 MB/s | 4.6 MB 00:00 2023-05-17T14:51:22.362 INFO:teuthology.orchestra.run.smithi027.stdout:(98/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-05-17T14:51:22.364 INFO:teuthology.orchestra.run.smithi027.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 4.6 MB/s | 155 kB 00:00 2023-05-17T14:51:22.389 INFO:teuthology.orchestra.run.smithi027.stdout:(100/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.7 MB/s | 220 kB 00:00 2023-05-17T14:51:22.390 INFO:teuthology.orchestra.run.smithi027.stdout:(101/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.7 MB/s | 48 kB 00:00 2023-05-17T14:51:22.392 INFO:teuthology.orchestra.run.smithi027.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.8 MB/s | 229 kB 00:00 2023-05-17T14:51:22.395 INFO:teuthology.orchestra.run.smithi040.stdout:(2/120): ceph-fuse-16.2.13-145.g20531b61.el8.x8 4.6 MB/s | 908 kB 00:00 2023-05-17T14:51:22.418 INFO:teuthology.orchestra.run.smithi027.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 705 kB/s | 18 kB 00:00 2023-05-17T14:51:22.419 INFO:teuthology.orchestra.run.smithi027.stdout:(104/120): python3-requests-oauthlib-1.0.0-1.el 1.4 MB/s | 43 kB 00:00 2023-05-17T14:51:22.447 INFO:teuthology.orchestra.run.smithi027.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 41 MB/s | 2.3 MB 00:00 2023-05-17T14:51:22.449 INFO:teuthology.orchestra.run.smithi027.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 83 kB 00:00 2023-05-17T14:51:22.456 INFO:teuthology.orchestra.run.smithi027.stdout:(107/120): pcre2-devel-10.32-2.el8.x86_64.rpm 16 MB/s | 605 kB 00:00 2023-05-17T14:51:22.458 INFO:teuthology.orchestra.run.smithi040.stdout:(3/120): ceph-immutable-object-cache-16.2.13-14 2.5 MB/s | 161 kB 00:00 2023-05-17T14:51:22.475 INFO:teuthology.orchestra.run.smithi027.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 6.6 MB/s | 169 kB 00:00 2023-05-17T14:51:22.476 INFO:teuthology.orchestra.run.smithi027.stdout:(109/120): elfutils-libelf-devel-0.182-3.el8.x8 2.1 MB/s | 59 kB 00:00 2023-05-17T14:51:22.485 INFO:teuthology.orchestra.run.smithi027.stdout:(110/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.3 MB/s | 38 kB 00:00 2023-05-17T14:51:22.506 INFO:teuthology.orchestra.run.smithi027.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.9 MB/s | 58 kB 00:00 2023-05-17T14:51:22.507 INFO:teuthology.orchestra.run.smithi027.stdout:(112/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.6 MB/s | 86 kB 00:00 2023-05-17T14:51:22.511 INFO:teuthology.orchestra.run.smithi027.stdout:(113/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.7 MB/s | 47 kB 00:00 2023-05-17T14:51:22.538 INFO:teuthology.orchestra.run.smithi027.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 20 MB/s | 639 kB 00:00 2023-05-17T14:51:22.547 INFO:teuthology.orchestra.run.smithi027.stdout:(115/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 13 MB/s | 559 kB 00:00 2023-05-17T14:51:22.550 INFO:teuthology.orchestra.run.smithi027.stdout:(116/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 1.8 MB/s | 70 kB 00:00 2023-05-17T14:51:22.573 INFO:teuthology.orchestra.run.smithi027.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 5.5 MB/s | 200 kB 00:00 2023-05-17T14:51:22.580 INFO:teuthology.orchestra.run.smithi027.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 2.9 MB/s | 97 kB 00:00 2023-05-17T14:51:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:(4/120): ceph-base-16.2.13-145.g20531b61.el8.x8 9.2 MB/s | 6.1 MB 00:00 2023-05-17T14:51:22.849 INFO:teuthology.orchestra.run.smithi040.stdout:(5/120): ceph-mds-16.2.13-145.g20531b61.el8.x86 6.2 MB/s | 2.4 MB 00:00 2023-05-17T14:51:22.964 INFO:teuthology.orchestra.run.smithi040.stdout:(6/120): ceph-mgr-16.2.13-145.g20531b61.el8.x86 8.2 MB/s | 1.6 MB 00:00 2023-05-17T14:51:23.487 INFO:teuthology.orchestra.run.smithi027.stdout:(119/120): librados2-16.2.13-145.g20531b61.el8. 4.0 MB/s | 3.7 MB 00:00 2023-05-17T14:51:23.563 INFO:teuthology.orchestra.run.smithi027.stdout:(120/120): librbd1-16.2.13-145.g20531b61.el8.x8 4.2 MB/s | 4.2 MB 00:00 2023-05-17T14:51:23.566 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-05-17T14:51:23.567 INFO:teuthology.orchestra.run.smithi027.stdout:Total 27 MB/s | 200 MB 00:07 2023-05-17T14:51:23.619 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-05-17T14:51:23.743 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-05-17T14:51:23.743 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-05-17T14:51:23.830 INFO:teuthology.orchestra.run.smithi040.stdout:(7/120): ceph-mon-16.2.13-145.g20531b61.el8.x86 5.1 MB/s | 5.0 MB 00:00 2023-05-17T14:51:24.852 INFO:teuthology.orchestra.run.smithi040.stdout:(8/120): ceph-osd-16.2.13-145.g20531b61.el8.x86 9.7 MB/s | 18 MB 00:01 2023-05-17T14:51:25.019 INFO:teuthology.orchestra.run.smithi040.stdout:(9/120): ceph-common-16.2.13-145.g20531b61.el8. 8.3 MB/s | 24 MB 00:02 2023-05-17T14:51:25.085 INFO:teuthology.orchestra.run.smithi040.stdout:(10/120): ceph-selinux-16.2.13-145.g20531b61.el 110 kB/s | 26 kB 00:00 2023-05-17T14:51:25.129 INFO:teuthology.orchestra.run.smithi040.stdout:(11/120): cephfs-mirror-16.2.13-145.g20531b61.e 5.7 MB/s | 256 kB 00:00 2023-05-17T14:51:25.159 INFO:teuthology.orchestra.run.smithi040.stdout:(12/120): libcephfs-devel-16.2.13-145.g20531b61 853 kB/s | 25 kB 00:00 2023-05-17T14:51:25.247 INFO:teuthology.orchestra.run.smithi040.stdout:(13/120): libcephfs2-16.2.13-145.g20531b61.el8. 9.1 MB/s | 822 kB 00:00 2023-05-17T14:51:25.284 INFO:teuthology.orchestra.run.smithi040.stdout:(14/120): libcephsqlite-16.2.13-145.g20531b61.e 4.7 MB/s | 174 kB 00:00 2023-05-17T14:51:25.318 INFO:teuthology.orchestra.run.smithi040.stdout:(15/120): librados-devel-16.2.13-145.g20531b61. 3.7 MB/s | 131 kB 00:00 2023-05-17T14:51:25.367 INFO:teuthology.orchestra.run.smithi040.stdout:(16/120): libradosstriper1-16.2.13-145.g20531b6 10 MB/s | 493 kB 00:00 2023-05-17T14:51:25.420 INFO:teuthology.orchestra.run.smithi040.stdout:(17/120): ceph-radosgw-16.2.13-145.g20531b61.el 7.3 MB/s | 12 MB 00:01 2023-05-17T14:51:25.452 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-05-17T14:51:25.457 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-05-17T14:51:25.465 INFO:teuthology.orchestra.run.smithi040.stdout:(18/120): python3-ceph-argparse-16.2.13-145.g20 1.0 MB/s | 45 kB 00:00 2023-05-17T14:51:25.505 INFO:teuthology.orchestra.run.smithi040.stdout:(19/120): python3-ceph-common-16.2.13-145.g2053 2.3 MB/s | 97 kB 00:00 2023-05-17T14:51:25.551 INFO:teuthology.orchestra.run.smithi040.stdout:(20/120): python3-cephfs-16.2.13-145.g20531b61. 4.6 MB/s | 215 kB 00:00 2023-05-17T14:51:25.640 INFO:teuthology.orchestra.run.smithi040.stdout:(21/120): python3-rados-16.2.13-145.g20531b61.e 4.3 MB/s | 389 kB 00:00 2023-05-17T14:51:25.673 INFO:teuthology.orchestra.run.smithi040.stdout:(22/120): librgw2-16.2.13-145.g20531b61.el8.x86 12 MB/s | 3.8 MB 00:00 2023-05-17T14:51:25.698 INFO:teuthology.orchestra.run.smithi040.stdout:(23/120): python3-rbd-16.2.13-145.g20531b61.el8 6.2 MB/s | 368 kB 00:00 2023-05-17T14:51:25.701 INFO:teuthology.orchestra.run.smithi040.stdout:(24/120): python3-rgw-16.2.13-145.g20531b61.el8 4.0 MB/s | 114 kB 00:00 2023-05-17T14:51:25.721 INFO:teuthology.orchestra.run.smithi040.stdout:(25/120): rbd-fuse-16.2.13-145.g20531b61.el8.x8 3.8 MB/s | 88 kB 00:00 2023-05-17T14:51:25.764 INFO:teuthology.orchestra.run.smithi040.stdout:(26/120): rbd-nbd-16.2.13-145.g20531b61.el8.x86 3.9 MB/s | 173 kB 00:00 2023-05-17T14:51:25.802 INFO:teuthology.orchestra.run.smithi040.stdout:(27/120): ceph-grafana-dashboards-16.2.13-145.g 637 kB/s | 24 kB 00:00 2023-05-17T14:51:25.844 INFO:teuthology.orchestra.run.smithi040.stdout:(28/120): ceph-mgr-cephadm-16.2.13-145.g20531b6 2.7 MB/s | 116 kB 00:00 2023-05-17T14:51:26.008 INFO:teuthology.orchestra.run.smithi040.stdout:(29/120): rbd-mirror-16.2.13-145.g20531b61.el8. 12 MB/s | 3.7 MB 00:00 2023-05-17T14:51:26.282 INFO:teuthology.orchestra.run.smithi040.stdout:(30/120): ceph-mgr-dashboard-16.2.13-145.g20531 7.1 MB/s | 3.1 MB 00:00 2023-05-17T14:51:26.330 INFO:teuthology.orchestra.run.smithi040.stdout:(31/120): ceph-mgr-modules-core-16.2.13-145.g20 5.0 MB/s | 244 kB 00:00 2023-05-17T14:51:26.369 INFO:teuthology.orchestra.run.smithi040.stdout:(32/120): ceph-mgr-rook-16.2.13-145.g20531b61.e 703 kB/s | 27 kB 00:00 2023-05-17T14:51:26.408 INFO:teuthology.orchestra.run.smithi040.stdout:(33/120): ceph-prometheus-alerts-16.2.13-145.g2 388 kB/s | 15 kB 00:00 2023-05-17T14:51:26.449 INFO:teuthology.orchestra.run.smithi040.stdout:(34/120): cephadm-16.2.13-145.g20531b61.el8.noa 2.0 MB/s | 84 kB 00:00 2023-05-17T14:51:26.487 INFO:teuthology.orchestra.run.smithi040.stdout:(35/120): cephfs-top-16.2.13-145.g20531b61.el8. 464 kB/s | 18 kB 00:00 2023-05-17T14:51:26.671 INFO:teuthology.orchestra.run.smithi040.stdout:(36/120): ceph-mgr-diskprediction-local-16.2.13 13 MB/s | 8.6 MB 00:00 2023-05-17T14:51:26.752 INFO:teuthology.orchestra.run.smithi040.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-05-17T14:51:26.791 INFO:teuthology.orchestra.run.smithi040.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.5 MB/s | 59 kB 00:00 2023-05-17T14:51:26.828 INFO:teuthology.orchestra.run.smithi040.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.0 MB/s | 75 kB 00:00 2023-05-17T14:51:26.866 INFO:teuthology.orchestra.run.smithi040.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 577 kB/s | 21 kB 00:00 2023-05-17T14:51:26.902 INFO:teuthology.orchestra.run.smithi040.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.2 MB/s | 44 kB 00:00 2023-05-17T14:51:26.919 INFO:teuthology.orchestra.run.smithi040.stdout:(42/120): leveldb-1.22-1.el8.x86_64.rpm 729 kB/s | 181 kB 00:00 2023-05-17T14:51:26.942 INFO:teuthology.orchestra.run.smithi040.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.5 MB/s | 185 kB 00:00 2023-05-17T14:51:26.958 INFO:teuthology.orchestra.run.smithi040.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 842 kB/s | 33 kB 00:00 2023-05-17T14:51:26.980 INFO:teuthology.orchestra.run.smithi040.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 446 kB/s | 16 kB 00:00 2023-05-17T14:51:27.000 INFO:teuthology.orchestra.run.smithi040.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2023-05-17T14:51:27.053 INFO:teuthology.orchestra.run.smithi040.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.1 MB/s | 384 kB 00:00 2023-05-17T14:51:27.079 INFO:teuthology.orchestra.run.smithi040.stdout:(48/120): python3-execnet-1.7.1-1.el8.noarch.rp 4.4 MB/s | 355 kB 00:00 2023-05-17T14:51:27.090 INFO:teuthology.orchestra.run.smithi040.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 2.1 MB/s | 81 kB 00:00 2023-05-17T14:51:27.117 INFO:teuthology.orchestra.run.smithi040.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 286 kB/s | 11 kB 00:00 2023-05-17T14:51:27.127 INFO:teuthology.orchestra.run.smithi040.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 482 kB/s | 18 kB 00:00 2023-05-17T14:51:27.164 INFO:teuthology.orchestra.run.smithi040.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.3 MB/s | 49 kB 00:00 2023-05-17T14:51:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-05-17T14:51:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:(54/120): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-05-17T14:51:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 429 kB/s | 16 kB 00:00 2023-05-17T14:51:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.5 MB/s | 283 kB 00:00 2023-05-17T14:51:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:(57/120): python3-remoto-1.2.1-1.el8.noarch.rpm 1.3 MB/s | 49 kB 00:00 2023-05-17T14:51:27.285 INFO:teuthology.orchestra.run.smithi040.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 861 kB/s | 34 kB 00:00 2023-05-17T14:51:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 5.0 MB/s | 196 kB 00:00 2023-05-17T14:51:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:(60/120): python3-rsa-4.8-1.el8.noarch.rpm 1.5 MB/s | 61 kB 00:00 2023-05-17T14:51:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 507 kB/s | 19 kB 00:00 2023-05-17T14:51:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 589 kB/s | 24 kB 00:00 2023-05-17T14:51:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 802 kB/s | 29 kB 00:00 2023-05-17T14:51:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 702 kB/s | 27 kB 00:00 2023-05-17T14:51:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:(65/120): python3-waitress-1.2.1-2.el8.1.noarch 6.0 MB/s | 241 kB 00:00 2023-05-17T14:51:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.8 MB/s | 251 kB 00:00 2023-05-17T14:51:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.6 MB/s | 61 kB 00:00 2023-05-17T14:51:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 2.1 MB/s | 85 kB 00:00 2023-05-17T14:51:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-05-17T14:51:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 538 kB/s | 23 kB 00:00 2023-05-17T14:51:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 540 kB/s | 19 kB 00:00 2023-05-17T14:51:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-05-17T14:51:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.2 MB/s | 155 kB 00:00 2023-05-17T14:51:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-05-17T14:51:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2023-05-17T14:51:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 2.9 MB/s | 43 kB 00:00 2023-05-17T14:51:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 13 MB/s | 229 kB 00:00 2023-05-17T14:51:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-05-17T14:51:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 27 MB/s | 605 kB 00:00 2023-05-17T14:51:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 50 MB/s | 2.3 MB 00:00 2023-05-17T14:51:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 6.0 MB/s | 83 kB 00:00 2023-05-17T14:51:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.2 MB/s | 59 kB 00:00 2023-05-17T14:51:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-05-17T14:51:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.8 MB/s | 38 kB 00:00 2023-05-17T14:51:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.0 MB/s | 86 kB 00:00 2023-05-17T14:51:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.1 MB/s | 58 kB 00:00 2023-05-17T14:51:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.5 MB/s | 47 kB 00:00 2023-05-17T14:51:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 26 MB/s | 559 kB 00:00 2023-05-17T14:51:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 24 MB/s | 639 kB 00:00 2023-05-17T14:51:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.1 MB/s | 70 kB 00:00 2023-05-17T14:51:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2023-05-17T14:51:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.0 MB/s | 97 kB 00:00 2023-05-17T14:51:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.2 MB/s | 44 kB 00:00 2023-05-17T14:51:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-05-17T14:51:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-05-17T14:51:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-05-17T14:51:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 22 MB/s | 457 kB 00:00 2023-05-17T14:51:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 56 MB/s | 4.8 MB 00:00 2023-05-17T14:51:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-05-17T14:51:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 46 MB/s | 15 MB 00:00 2023-05-17T14:51:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:(101/120): ceph-test-16.2.13-145.g20531b61.el8. 15 MB/s | 51 MB 00:03 2023-05-17T14:51:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 667 kB/s | 259 kB 00:00 2023-05-17T14:51:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:(103/120): bison-3.0.4-10.el8.x86_64.rpm 1.3 MB/s | 688 kB 00:00 2023-05-17T14:51:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.5 MB/s | 126 kB 00:00 2023-05-17T14:51:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:(105/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 6.0 MB/s | 225 kB 00:00 2023-05-17T14:51:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 7.1 MB/s | 187 kB 00:00 2023-05-17T14:51:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 22 MB/s | 538 kB 00:00 2023-05-17T14:51:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 15 MB/s | 302 kB 00:00 2023-05-17T14:51:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.5 MB/s | 157 kB 00:00 2023-05-17T14:51:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.1 MB/s | 110 kB 00:00 2023-05-17T14:51:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:(111/120): python3-numpy-1.14.3-9.el8.x86_64.rp 47 MB/s | 3.7 MB 00:00 2023-05-17T14:51:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.4 MB/s | 20 kB 00:00 2023-05-17T14:51:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 14 MB/s | 353 kB 00:00 2023-05-17T14:51:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.5 MB/s | 54 kB 00:00 2023-05-17T14:51:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-05-17T14:51:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-05-17T14:51:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 51 MB/s | 4.7 MB 00:00 2023-05-17T14:51:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 46 MB/s | 4.6 MB 00:00 2023-05-17T14:51:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:(119/120): librbd1-16.2.13-145.g20531b61.el8.x8 12 MB/s | 4.2 MB 00:00 2023-05-17T14:51:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:(120/120): librados2-16.2.13-145.g20531b61.el8. 9.4 MB/s | 3.7 MB 00:00 2023-05-17T14:51:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-05-17T14:51:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:Total 29 MB/s | 200 MB 00:06 2023-05-17T14:51:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-05-17T14:51:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-05-17T14:51:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-05-17T14:51:30.303 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-05-17T14:51:30.499 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-05-17T14:51:30.669 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-05-17T14:51:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-05-17T14:51:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-05-17T14:51:30.898 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/122 2023-05-17T14:51:31.071 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/122 2023-05-17T14:51:31.169 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/122 2023-05-17T14:51:31.946 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-05-17T14:51:32.358 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-05-17T14:51:32.579 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:16.2.13-145.g20531b61.el8.x86_64 6/122 2023-05-17T14:51:33.027 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.13-145.g20531b61.el8.x86_64 6/122 2023-05-17T14:51:33.238 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:16.2.13-145.g20531b61.el8.x86_64 7/122 2023-05-17T14:51:33.351 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.13-145.g20531b61.el8.x86_64 7/122 2023-05-17T14:51:33.580 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 8/122 2023-05-17T14:51:33.679 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 8/122 2023-05-17T14:51:34.220 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:16.2.13-145.g20531b61.el8.x86_64 9/122 2023-05-17T14:51:34.404 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:16.2.13-145.g20531b61.el8.x86_64 10/122 2023-05-17T14:51:34.503 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:16.2.13-145.g20531b61.el8.x86_64 10/122 2023-05-17T14:51:34.776 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-05-17T14:51:34.945 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-05-17T14:51:35.112 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 13/122 2023-05-17T14:51:35.258 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 13/122 2023-05-17T14:51:35.552 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:16.2.13-145.g20531b61.el8.x86 14/122 2023-05-17T14:51:35.638 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:16.2.13-145.g20531b61.el8.x86 14/122 2023-05-17T14:51:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-05-17T14:51:35.929 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-05-17T14:51:36.048 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-05-17T14:51:36.080 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-05-17T14:51:36.246 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-05-17T14:51:36.367 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-05-17T14:51:36.606 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-05-17T14:51:36.823 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-05-17T14:51:36.826 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-05-17T14:51:36.948 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-05-17T14:51:37.173 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-05-17T14:51:37.504 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-05-17T14:51:37.588 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-05-17T14:51:37.831 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:16.2.13-145.g20531b61.el8.x86_64 5/122 2023-05-17T14:51:38.059 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-05-17T14:51:38.277 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.13-145.g20531b61.el8.x86_64 5/122 2023-05-17T14:51:38.278 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-05-17T14:51:38.447 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:16.2.13-145.g20531b61.el8.x86_64 6/122 2023-05-17T14:51:38.614 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.13-145.g20531b61.el8.x86_64 6/122 2023-05-17T14:51:38.839 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 7/122 2023-05-17T14:51:38.927 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 7/122 2023-05-17T14:51:39.045 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-05-17T14:51:39.147 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:16.2.13-145.g20531b61.el8.x86_64 8/122 2023-05-17T14:51:39.300 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-05-17T14:51:39.478 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-05-17T14:51:39.638 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-05-17T14:51:39.667 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-05-17T14:51:39.906 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-05-17T14:51:39.972 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:16.2.13-145.g20531b61.el8.x86_64 10/122 2023-05-17T14:51:40.084 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:16.2.13-145.g20531b61.el8.x86_64 10/122 2023-05-17T14:51:40.209 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-05-17T14:51:40.343 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-05-17T14:51:40.479 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-05-17T14:51:40.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-05-17T14:51:40.635 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:16.2.13-145.g20531b61.el8. 26/122 2023-05-17T14:51:40.722 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 13/122 2023-05-17T14:51:40.776 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:16.2.13-145.g20531b61.el 27/122 2023-05-17T14:51:40.856 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 13/122 2023-05-17T14:51:41.018 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:16.2.13-145.g20531b61.el8.x86 14/122 2023-05-17T14:51:41.047 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:16.2.13-145.g20531b61.el8.x86_6 28/122 2023-05-17T14:51:41.116 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:16.2.13-145.g20531b61.el8.x86 14/122 2023-05-17T14:51:41.986 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-05-17T14:51:42.105 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-05-17T14:51:42.285 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-05-17T14:51:42.466 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-05-17T14:51:42.530 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-05-17T14:51:42.683 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-05-17T14:51:42.847 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-05-17T14:51:42.978 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-05-17T14:51:43.000 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-05-17T14:51:43.172 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-05-17T14:51:43.256 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-05-17T14:51:43.541 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-05-17T14:51:43.753 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-05-17T14:51:43.795 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-05-17T14:51:43.963 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-05-17T14:51:44.525 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-05-17T14:51:44.730 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-05-17T14:51:45.479 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-05-17T14:51:45.759 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-05-17T14:51:45.985 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-05-17T14:51:46.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-05-17T14:51:46.318 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-05-17T14:51:46.337 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-05-17T14:51:46.545 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:16.2.13-145.g20531b61.el8. 26/122 2023-05-17T14:51:46.545 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/122 2023-05-17T14:51:46.745 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:16.2.13-145.g20531b61.el 27/122 2023-05-17T14:51:46.765 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-05-17T14:51:46.965 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:16.2.13-145.g20531b61.el8.x86_64 38/122 2023-05-17T14:51:47.004 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:16.2.13-145.g20531b61.el8.x86_6 28/122 2023-05-17T14:51:47.201 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:16.2.13-145.g20531b61.el8.x86_64 39/122 2023-05-17T14:51:47.247 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-05-17T14:51:47.394 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:16.2.13-145.g20531b61.el8.x86_6 40/122 2023-05-17T14:51:47.605 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-05-17T14:51:47.775 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-05-17T14:51:47.973 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-05-17T14:51:48.139 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-05-17T14:51:48.202 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-05-17T14:51:48.309 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-05-17T14:51:48.438 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-05-17T14:51:48.522 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-05-17T14:51:48.691 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-05-17T14:51:49.015 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-05-17T14:51:49.271 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-05-17T14:51:49.544 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-05-17T14:51:49.949 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-05-17T14:51:50.185 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-05-17T14:51:50.352 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-05-17T14:51:50.546 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-05-17T14:51:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-05-17T14:51:50.750 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-05-17T14:51:50.946 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-05-17T14:51:51.053 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-05-17T14:51:51.125 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-05-17T14:51:51.287 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-05-17T14:51:51.511 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-05-17T14:51:51.681 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-05-17T14:51:51.872 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-05-17T14:51:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-05-17T14:51:52.169 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-05-17T14:51:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-05-17T14:51:52.412 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 62/122 2023-05-17T14:51:52.605 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-05-17T14:51:52.634 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-05-17T14:51:52.784 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-05-17T14:51:52.895 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/122 2023-05-17T14:51:52.942 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-05-17T14:51:53.125 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-05-17T14:51:53.128 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-05-17T14:51:53.315 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:16.2.13-145.g20531b61.el8.x86_64 38/122 2023-05-17T14:51:53.496 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-05-17T14:51:53.555 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:16.2.13-145.g20531b61.el8.x86_64 39/122 2023-05-17T14:51:53.860 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:16.2.13-145.g20531b61.el8.x86_6 40/122 2023-05-17T14:51:53.914 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-05-17T14:51:54.085 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-05-17T14:51:54.111 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-05-17T14:51:54.321 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-05-17T14:51:54.335 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-05-17T14:51:54.541 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-05-17T14:51:54.554 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-05-17T14:51:54.726 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-05-17T14:51:54.768 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-05-17T14:51:54.920 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-05-17T14:51:55.003 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-05-17T14:51:55.057 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-05-17T14:51:55.190 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-05-17T14:51:55.319 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-05-17T14:51:55.376 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-05-17T14:51:55.538 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-05-17T14:51:55.568 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-05-17T14:51:55.759 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-05-17T14:51:55.770 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-05-17T14:51:55.932 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-05-17T14:51:56.115 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-05-17T14:51:56.243 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-05-17T14:51:56.473 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-05-17T14:51:56.660 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-05-17T14:51:57.003 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-05-17T14:51:57.013 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-05-17T14:51:57.279 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-05-17T14:51:57.319 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-05-17T14:51:57.530 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-05-17T14:51:57.633 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-05-17T14:51:57.891 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-05-17T14:51:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-05-17T14:51:58.122 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-05-17T14:51:58.153 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-05-17T14:51:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-05-17T14:51:58.342 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-05-17T14:51:58.571 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-05-17T14:51:58.583 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-05-17T14:51:58.780 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 62/122 2023-05-17T14:51:58.834 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-05-17T14:51:58.998 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-05-17T14:51:59.070 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-05-17T14:51:59.184 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-05-17T14:51:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-05-17T14:51:59.342 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-05-17T14:51:59.477 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-05-17T14:51:59.578 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-05-17T14:51:59.828 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-05-17T14:52:00.091 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-05-17T14:52:00.311 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-05-17T14:52:00.560 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-05-17T14:52:00.776 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-05-17T14:52:01.002 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-05-17T14:52:01.331 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-05-17T14:52:01.595 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-05-17T14:52:01.840 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-05-17T14:52:02.120 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-05-17T14:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-05-17T14:52:03.644 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-05-17T14:52:03.931 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-05-17T14:52:04.265 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-05-17T14:52:04.466 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 88/122 2023-05-17T14:52:04.581 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-05-17T14:52:04.768 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 88/122 2023-05-17T14:52:04.793 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-05-17T14:52:05.074 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-05-17T14:52:05.361 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-05-17T14:52:05.519 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 88/122 2023-05-17T14:52:05.588 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-05-17T14:52:05.789 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-05-17T14:52:05.805 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 89/122 2023-05-17T14:52:05.896 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 89/122 2023-05-17T14:52:05.994 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-05-17T14:52:06.042 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 90/122 2023-05-17T14:52:11.526 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 88/122 2023-05-17T14:52:11.760 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 88/122 2023-05-17T14:52:12.516 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 88/122 2023-05-17T14:52:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 89/122 2023-05-17T14:52:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 89/122 2023-05-17T14:52:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 90/122 2023-05-17T14:52:24.243 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 90/122 2023-05-17T14:52:24.244 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2023-05-17T14:52:24.244 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2023-05-17T14:52:24.244 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /dev 2023-05-17T14:52:24.244 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /run 2023-05-17T14:52:24.244 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2023-05-17T14:52:24.244 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2023-05-17T14:52:24.245 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2023-05-17T14:52:24.245 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2023-05-17T14:52:24.245 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /dev 2023-05-17T14:52:24.245 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:52:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 91/122 2023-05-17T14:52:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 91/122 2023-05-17T14:52:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 92/122 2023-05-17T14:52:26.849 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 92/122 2023-05-17T14:52:27.015 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 93/122 2023-05-17T14:52:27.036 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 93/122 2023-05-17T14:52:29.976 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:16.2.13-145.g20531b61.el8.noarch 94/122 2023-05-17T14:52:30.097 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:16.2.13-145.g20531b61.el8.noarch 94/122 2023-05-17T14:52:30.341 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-145.g20531b61.e 95/122 2023-05-17T14:52:30.510 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-145.g20531b61. 96/122 2023-05-17T14:52:30.655 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noa 97/122 2023-05-17T14:52:31.249 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 90/122 2023-05-17T14:52:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-05-17T14:52:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /run 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-05-17T14:52:31.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:52:31.616 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 91/122 2023-05-17T14:52:31.660 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noa 97/122 2023-05-17T14:52:31.901 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.n 98/122 2023-05-17T14:52:32.078 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 91/122 2023-05-17T14:52:32.265 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 92/122 2023-05-17T14:52:33.006 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.n 98/122 2023-05-17T14:52:33.172 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-145.g205 99/122 2023-05-17T14:52:33.271 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-145.g205 99/122 2023-05-17T14:52:33.628 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-145.g20531b61.el 100/122 2023-05-17T14:52:33.827 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 101/122 2023-05-17T14:52:33.854 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 101/122 2023-05-17T14:52:33.866 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 92/122 2023-05-17T14:52:34.082 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 93/122 2023-05-17T14:52:34.104 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 93/122 2023-05-17T14:52:34.113 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 102/122 2023-05-17T14:52:34.125 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 102/122 2023-05-17T14:52:35.264 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:16.2.13-145.g20531b61.el8.x86_64 103/122 2023-05-17T14:52:35.443 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 104/122 2023-05-17T14:52:35.552 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 104/122 2023-05-17T14:52:35.689 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-145.g20531 105/122 2023-05-17T14:52:35.731 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-145.g20531 105/122 2023-05-17T14:52:35.864 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 106/122 2023-05-17T14:52:36.228 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 106/122 2023-05-17T14:52:36.430 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 107/122 2023-05-17T14:52:36.926 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:16.2.13-145.g20531b61.el8.noarch 94/122 2023-05-17T14:52:37.145 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:16.2.13-145.g20531b61.el8.noarch 94/122 2023-05-17T14:52:37.300 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-145.g20531b61.e 95/122 2023-05-17T14:52:37.485 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-145.g20531b61. 96/122 2023-05-17T14:52:37.673 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noa 97/122 2023-05-17T14:52:38.667 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noa 97/122 2023-05-17T14:52:38.934 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.n 98/122 2023-05-17T14:52:40.041 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.n 98/122 2023-05-17T14:52:40.239 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-145.g205 99/122 2023-05-17T14:52:40.338 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-145.g205 99/122 2023-05-17T14:52:40.743 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-145.g20531b61.el 100/122 2023-05-17T14:52:40.984 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 101/122 2023-05-17T14:52:41.012 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 101/122 2023-05-17T14:52:41.180 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 102/122 2023-05-17T14:52:41.192 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 102/122 2023-05-17T14:52:41.209 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 107/122 2023-05-17T14:52:41.504 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:16.2.13-145.g20531b61.el8.x86_64 108/122 2023-05-17T14:52:41.687 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-05-17T14:52:42.299 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:16.2.13-145.g20531b61.el8.x86_64 103/122 2023-05-17T14:52:42.430 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-05-17T14:52:42.559 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 104/122 2023-05-17T14:52:42.654 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 104/122 2023-05-17T14:52:42.759 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-05-17T14:52:42.839 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-145.g20531 105/122 2023-05-17T14:52:42.883 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-145.g20531 105/122 2023-05-17T14:52:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:16.2.13-145.g20531b61.el8.x86_64 111/122 2023-05-17T14:52:43.047 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 106/122 2023-05-17T14:52:43.116 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-05-17T14:52:43.309 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:16.2.13-145.g20531b61.el8.x86_ 113/122 2023-05-17T14:52:43.414 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 106/122 2023-05-17T14:52:43.459 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-05-17T14:52:43.590 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 107/122 2023-05-17T14:52:43.754 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-top-2:16.2.13-145.g20531b61.el8.noarch 115/122 2023-05-17T14:52:43.921 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:16.2.13-145.g20531b61.el8.x86_64 116/122 2023-05-17T14:52:44.064 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:16.2.13-145.g20531b61.el8.x86_64 117/122 2023-05-17T14:52:44.313 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-05-17T14:52:44.495 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-05-17T14:52:44.559 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-05-17T14:52:44.762 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-05-17T14:52:44.772 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-05-17T14:52:44.773 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-17T14:52:44.974 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-17T14:52:44.974 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-17T14:52:45.552 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-17T14:52:45.552 INFO:teuthology.orchestra.run.smithi027.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-17T14:52:45.552 INFO:teuthology.orchestra.run.smithi027.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-17T14:52:45.552 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:52:45.895 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:16.2.13-145.g20531b61.el8.x86_64 1/122 2023-05-17T14:52:45.895 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 2/122 2023-05-17T14:52:45.895 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 3/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:16.2.13-145.g20531b61.el8.x86_64 4/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-145.g20531 5/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 6/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 7/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 8/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 9/122 2023-05-17T14:52:45.896 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 10/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 11/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.2.13-145.g20531b61.el8.x86_64 12/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 13/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:16.2.13-145.g20531b61.el8.x86_ 14/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 15/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 16/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:16.2.13-145.g20531b61.el8.x86_6 17/122 2023-05-17T14:52:45.897 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:16.2.13-145.g20531b61.el8.x86 18/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:16.2.13-145.g20531b61.el8.x86_64 19/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:16.2.13-145.g20531b61.el 20/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:16.2.13-145.g20531b61.el8. 21/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:16.2.13-145.g20531b61.el8.x86_6 22/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:16.2.13-145.g20531b61.el8.x86_64 23/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:16.2.13-145.g20531b61.el8.x86_64 24/122 2023-05-17T14:52:45.898 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:16.2.13-145.g20531b61.el8.x86_64 25/122 2023-05-17T14:52:45.904 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:16.2.13-145.g20531b61.el8.x86_64 26/122 2023-05-17T14:52:45.905 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 27/122 2023-05-17T14:52:45.905 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:16.2.13-145.g20531b61.el8.x86_64 28/122 2023-05-17T14:52:45.905 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-145.g20531b61. 29/122 2023-05-17T14:52:45.905 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noa 30/122 2023-05-17T14:52:45.905 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.n 31/122 2023-05-17T14:52:45.905 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-145.g205 32/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-145.g20531b61.el 33/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 34/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-145.g20531b61.e 35/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:16.2.13-145.g20531b61.el8.noarch 36/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-top-2:16.2.13-145.g20531b61.el8.noarch 37/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-05-17T14:52:45.906 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-05-17T14:52:45.907 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-05-17T14:52:45.908 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-05-17T14:52:45.909 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-05-17T14:52:45.910 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-05-17T14:52:45.911 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-05-17T14:52:45.912 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-05-17T14:52:45.913 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-05-17T14:52:45.914 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-05-17T14:52:45.915 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-05-17T14:52:45.916 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-05-17T14:52:45.917 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.13-145.g20531b61.el8.x86_64 119/122 2023-05-17T14:52:45.917 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-05-17T14:52:45.917 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.13-145.g20531b61.el8.x86_64 121/122 2023-05-17T14:52:48.202 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-05-17T14:52:48.202 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:42 ago on Wed 17 May 2023 02:51:06 PM UTC. 2023-05-17T14:52:48.365 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 107/122 2023-05-17T14:52:49.391 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:16.2.13-145.g20531b61.el8.x86_64 108/122 2023-05-17T14:52:49.751 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-05-17T14:52:49.959 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:16.2.13-145.g20531b61.el8.x86_64 110/122 2023-05-17T14:52:50.226 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-05-17T14:52:50.399 INFO:teuthology.orchestra.run.smithi027.stdout:Installed products updated. 2023-05-17T14:52:50.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-05-17T14:52:50.441 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-05-17T14:52:50.567 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:52:50.568 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2023-05-17T14:52:50.568 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.568 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.568 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: automake-1.16.1-7.el8.noarch 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: bison-3.0.4-10.el8.x86_64 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.569 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.570 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.571 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: flex-2.6.1-9.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: fuse-2.9.7-12.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: jq-1.5-12.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-05-17T14:52:50.572 INFO:teuthology.orchestra.run.smithi027.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: leveldb-1.22-1.el8.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-05-17T14:52:50.573 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.574 INFO:teuthology.orchestra.run.smithi027.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-17T14:52:50.575 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.12-1.el8.x86_64 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: python3-apipkg-1.5-6.el8.noarch 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.5.1-5.el8.noarch 2023-05-17T14:52:50.576 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-17T14:52:50.577 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-17T14:52:50.578 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-17T14:52:50.578 INFO:teuthology.orchestra.run.smithi027.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-05-17T14:52:50.578 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-17T14:52:50.578 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-17T14:52:50.578 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-17T14:52:50.579 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-05-17T14:52:50.579 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-17T14:52:50.579 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-17T14:52:50.579 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-17T14:52:50.579 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-17T14:52:50.580 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-17T14:52:50.580 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-17T14:52:50.580 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-17T14:52:50.580 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-17T14:52:50.580 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-05-17T14:52:50.581 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-05-17T14:52:50.581 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-17T14:52:50.581 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-17T14:52:50.581 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-2.6-1.el8.noarch 2023-05-17T14:52:50.581 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-17T14:52:50.581 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-17T14:52:50.582 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-17T14:52:50.582 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-17T14:52:50.582 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.582 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.582 INFO:teuthology.orchestra.run.smithi027.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-05-17T14:52:50.583 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-17T14:52:50.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.3.3-2.el8.x86_64 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-05-17T14:52:50.585 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-17T14:52:50.586 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-05-17T14:52:50.586 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:52:50.586 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-05-17T14:52:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:16.2.13-145.g20531b61.el8.x86_ 113/122 2023-05-17T14:52:50.785 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-05-17T14:52:50.827 DEBUG:teuthology.parallel:result is None 2023-05-17T14:52:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:16.2.13-145.g20531b61.el8.noarch 115/122 2023-05-17T14:52:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:16.2.13-145.g20531b61.el8.x86_64 116/122 2023-05-17T14:52:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:16.2.13-145.g20531b61.el8.x86_64 117/122 2023-05-17T14:52:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-05-17T14:52:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-05-17T14:52:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-05-17T14:52:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-05-17T14:52:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-05-17T14:52:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-17T14:52:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-17T14:52:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-17T14:52:52.979 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-17T14:52:52.979 INFO:teuthology.orchestra.run.smithi040.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-17T14:52:52.979 INFO:teuthology.orchestra.run.smithi040.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-17T14:52:52.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:52:53.321 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:16.2.13-145.g20531b61.el8.x86_64 1/122 2023-05-17T14:52:53.321 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 2/122 2023-05-17T14:52:53.321 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 3/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:16.2.13-145.g20531b61.el8.x86_64 4/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-145.g20531 5/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 6/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 7/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 8/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 9/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 10/122 2023-05-17T14:52:53.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 11/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:16.2.13-145.g20531b61.el8.x86_64 12/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 13/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:16.2.13-145.g20531b61.el8.x86_ 14/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 15/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 16/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:16.2.13-145.g20531b61.el8.x86_6 17/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:16.2.13-145.g20531b61.el8.x86 18/122 2023-05-17T14:52:53.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:16.2.13-145.g20531b61.el8.x86_64 19/122 2023-05-17T14:52:53.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:16.2.13-145.g20531b61.el 20/122 2023-05-17T14:52:53.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:16.2.13-145.g20531b61.el8. 21/122 2023-05-17T14:52:53.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:16.2.13-145.g20531b61.el8.x86_6 22/122 2023-05-17T14:52:53.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:16.2.13-145.g20531b61.el8.x86_64 23/122 2023-05-17T14:52:53.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:16.2.13-145.g20531b61.el8.x86_64 24/122 2023-05-17T14:52:53.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:16.2.13-145.g20531b61.el8.x86_64 25/122 2023-05-17T14:52:53.330 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:16.2.13-145.g20531b61.el8.x86_64 26/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 27/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:16.2.13-145.g20531b61.el8.x86_64 28/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-145.g20531b61. 29/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noa 30/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.n 31/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-145.g205 32/122 2023-05-17T14:52:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-145.g20531b61.el 33/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 34/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-145.g20531b61.e 35/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:16.2.13-145.g20531b61.el8.noarch 36/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:16.2.13-145.g20531b61.el8.noarch 37/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-05-17T14:52:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-05-17T14:52:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-05-17T14:52:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-05-17T14:52:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-05-17T14:52:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-05-17T14:52:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-05-17T14:52:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-05-17T14:52:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-05-17T14:52:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-05-17T14:52:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-05-17T14:52:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.13-145.g20531b61.el8.x86_64 119/122 2023-05-17T14:52:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-05-17T14:52:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.13-145.g20531b61.el8.x86_64 121/122 2023-05-17T14:52:55.748 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-05-17T14:52:55.748 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:43 ago on Wed 17 May 2023 02:51:12 PM UTC. 2023-05-17T14:52:57.976 INFO:teuthology.orchestra.run.smithi040.stdout:Installed products updated. 2023-05-17T14:52:58.144 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:52:58.145 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-05-17T14:52:58.145 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.145 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.145 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-05-17T14:52:58.145 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.1-7.el8.noarch 2023-05-17T14:52:58.145 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.0.4-10.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.146 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.147 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.148 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:16.2.13-145.g20531b61.el8.noarch 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.1-9.el8.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.7-12.el8.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.5-12.el8.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-05-17T14:52:58.149 INFO:teuthology.orchestra.run.smithi040.stdout: leveldb-1.22-1.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-17T14:52:58.150 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-05-17T14:52:58.151 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.12-1.el8.x86_64 2023-05-17T14:52:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: python3-apipkg-1.5-6.el8.noarch 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.5.1-5.el8.noarch 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-17T14:52:58.153 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-17T14:52:58.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-17T14:52:58.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-05-17T14:52:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-2.6-1.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-05-17T14:52:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-17T14:52:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:16.2.13-145.g20531b61.el8.x86_64 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.3.3-2.el8.x86_64 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-05-17T14:52:58.160 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-17T14:52:58.161 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-05-17T14:52:58.161 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:52:58.161 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-05-17T14:52:58.358 DEBUG:teuthology.parallel:result is None 2023-05-17T14:52:58.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=20531b61f434caac5e29cea07411fac6911e8e91 2023-05-17T14:52:58.498 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-17T14:52:58.523 INFO:teuthology.orchestra.run.smithi027.stdout:16.2.13-145.g20531b61.el8 2023-05-17T14:52:58.524 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-145.g20531b61.el8 2023-05-17T14:52:58.524 INFO:teuthology.task.install:The correct ceph version 16.2.13-145.g20531b61 is installed. 2023-05-17T14:52:58.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=20531b61f434caac5e29cea07411fac6911e8e91 2023-05-17T14:52:58.657 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-17T14:52:58.677 INFO:teuthology.orchestra.run.smithi040.stdout:16.2.13-145.g20531b61.el8 2023-05-17T14:52:58.678 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-145.g20531b61.el8 2023-05-17T14:52:58.678 INFO:teuthology.task.install:The correct ceph version 16.2.13-145.g20531b61 is installed. 2023-05-17T14:52:58.678 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-17T14:52:58.679 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:52:58.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-17T14:52:58.725 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:52:58.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-17T14:52:58.766 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-17T14:52:58.767 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:52:58.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2023-05-17T14:52:58.795 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-17T14:52:58.861 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:52:58.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-05-17T14:52:58.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-17T14:52:58.952 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-17T14:52:58.952 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:52:58.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-17T14:52:58.979 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-17T14:52:59.045 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:52:59.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-17T14:52:59.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-17T14:52:59.133 INFO:teuthology.run_tasks:Running task ceph... 2023-05-17T14:52:59.203 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-17T14:52:59.204 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2023-05-17T14:52:59.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-05-17T14:52:59.233 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-17T14:52:59.233 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-17T14:52:59.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-17T14:52:59.302 INFO:tasks.ceph:Creating extra log directories... 2023-05-17T14:52:59.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-17T14:52:59.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-17T14:52:59.390 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-17T14:52:59.391 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-17T14:52:59.391 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-17T14:52:59.391 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:52:59.392 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-17T14:52:59.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:59.555 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:59.580 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:52:59.580 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-17T14:52:59.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:59.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:59.740 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-17T14:52:59.740 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-17T14:52:59.741 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695', 'branch': 'wip-yuri2-testing-2023-05-15-0810-pacific_2', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7276695', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-05-15-0810-pacific_2'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2023-05-15-0810-pacific_2', 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6166, 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri2-testing-2023-05-15-0810-pacific_2', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_20531b61f434caac5e29cea07411fac6911e8e91/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '20531b61f434caac5e29cea07411fac6911e8e91', 'targets': {'smithi027.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0tAqdKL6Wfx3pAYpzzDfQvjo9ohcyjoizmIK3bWRG+SdJilcHa7Yr3ggmMRvSnk78lgfTOgPRWluy1i+ShrLlgymGZxyXA70+iJQLWycrYtKuTF+YsP/zRTk0ENQ7whwgG5gn8ykqjVmIertNi/KXQf+vsIAEt8HA6tHcALYA4bVnTjNOpaf02WkYxoPrdUbUZ+2MI0JyCDYw1YaqpxPiGFGd7ERukBIxEFRELItzbOIn+77ilfTV2+QNNtEeXo7gWaQ6f6MluI0Vm+V9SVaXLKOTU0qYR8JRFinN90e76TMiFgt25YBVwZ58iYK585ABg4IDLMYbHHxmz2LRt1LV2hrzAq3zQoh4xJUGVWJAhWvUOWhMtWyq3bQZkNmsu3UM4cXwliRshSLAdSezx6x/hBEEIseygeNTzCdU7CJKzd9xen67UQ//VFA1T0lQZVNcQnZgTSSAG5wdTbZO3khcOypavRPNb/YONv68Zv7sc/JHAKlbxNarfY1RV9K2ZKc=', 'smithi040.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIT6pm1GwEydSKlMy0dpeZlbS/axNoEY8ugWQRCpIjOMricwmwmD8UY9KHYVLjjOCdBjgbBJTmCcjPrXkxeNQlsZsNiDTjD/tHPJutz6f5MQTCus8tYQ4HSkInoMZkbF+//9MZS6dtLgr5boq8MJQPu9gwKErT4RbXXvYa4+Iz7ERI2216tWftcqb1+97lkvxX+vRU65p2c9CwBB5JdVSOI8ZNodEIOaI9ny6EsccOsYT+/gvEnV6vvANh6Pn92GlZBxB459BxbhshzTs4VRoiV4trIRwzhdM2tXthEvVtwqQWZ3Ckp6LHkGyIsmR0oOm1MnBsDp4o4we+PDsOQjvtv1CrH/e/A/rMoPvWeCVh9NxXG6RS9OrxZBjNEPMOdUU7EZDEhZd2wAUCm6UxTcqgV7hQ3wYLMkl1hRCPcUHgqst9etXO9ne7/t8HsMukBjAU1WZHzIkIrl3YOakHGGQc6O8L4BoPdCVoPFpfmgiPZwZbFHCBL3ujtba8bXQkw0k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '20531b61f434caac5e29cea07411fac6911e8e91'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-17_14:20:33', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-17T14:52:59.742 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-17T14:52:59.744 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-17T14:52:59.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2023-05-17T14:52:59.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-05-17T14:52:59.855 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:52:59.855 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2023-05-17T14:52:59.877 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-17T14:52:59.877 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2023-05-17T14:52:59.933 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-17T14:52:59.933 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:52:59.933 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 209129 Links: 1 2023-05-17T14:52:59.933 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:52:59.933 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:52:59.934 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-05-17 14:52:45.463557536 +0000 2023-05-17T14:52:59.934 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-05-17 14:50:21.421619269 +0000 2023-05-17T14:52:59.934 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-05-17 14:50:21.421619269 +0000 2023-05-17T14:52:59.934 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-05-17T14:52:59.934 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-17T14:52:59.996 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-05-17T14:52:59.996 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-05-17T14:52:59.996 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000243355 s, 2.1 MB/s 2023-05-17T14:52:59.997 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-17T14:53:00.053 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2023-05-17T14:53:00.108 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-17T14:53:00.108 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:00.108 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 212112 Links: 1 2023-05-17T14:53:00.109 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:00.109 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:00.109 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-05-17 14:52:45.463557536 +0000 2023-05-17T14:53:00.109 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-05-17 14:50:21.944605911 +0000 2023-05-17T14:53:00.109 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-05-17 14:50:21.944605911 +0000 2023-05-17T14:53:00.109 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-05-17T14:53:00.110 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-17T14:53:00.171 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-05-17T14:53:00.171 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-05-17T14:53:00.171 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000221602 s, 2.3 MB/s 2023-05-17T14:53:00.172 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-17T14:53:00.226 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2023-05-17T14:53:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-17T14:53:00.281 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:00.281 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 210356 Links: 1 2023-05-17T14:53:00.281 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:00.282 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:00.282 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-05-17 14:52:45.463557536 +0000 2023-05-17T14:53:00.282 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-05-17 14:50:22.437593319 +0000 2023-05-17T14:53:00.282 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-05-17 14:50:22.437593319 +0000 2023-05-17T14:53:00.282 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-05-17T14:53:00.282 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-17T14:53:00.344 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-05-17T14:53:00.345 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-05-17T14:53:00.345 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000209208 s, 2.4 MB/s 2023-05-17T14:53:00.346 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-17T14:53:00.401 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2023-05-17T14:53:00.455 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-17T14:53:00.455 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:00.456 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 212196 Links: 1 2023-05-17T14:53:00.456 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:00.456 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:00.456 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-05-17 14:52:45.463557536 +0000 2023-05-17T14:53:00.456 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-05-17 14:50:22.953580139 +0000 2023-05-17T14:53:00.457 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-05-17 14:50:22.953580139 +0000 2023-05-17T14:53:00.457 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2023-05-17T14:53:00.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-17T14:53:00.518 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-05-17T14:53:00.519 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-05-17T14:53:00.519 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000193704 s, 2.6 MB/s 2023-05-17T14:53:00.520 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-17T14:53:00.576 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:00.577 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:00.577 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-05-17T14:53:00.592 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-17T14:53:00.592 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-05-17T14:53:00.646 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-17T14:53:00.646 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 208596 Links: 1 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-17 14:52:52.889149240 +0000 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-17 14:48:23.504108678 +0000 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-17 14:48:23.504108678 +0000 2023-05-17T14:53:00.647 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-17T14:53:00.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-17T14:53:00.711 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-17T14:53:00.711 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-17T14:53:00.711 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000223995 s, 2.3 MB/s 2023-05-17T14:53:00.713 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-17T14:53:00.768 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-05-17T14:53:00.823 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-17T14:53:00.823 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:00.823 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 206687 Links: 1 2023-05-17T14:53:00.823 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:00.824 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:00.824 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-17 14:52:52.889149240 +0000 2023-05-17T14:53:00.824 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-17 14:48:24.022102239 +0000 2023-05-17T14:53:00.824 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-17 14:48:24.022102239 +0000 2023-05-17T14:53:00.824 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-17T14:53:00.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-17T14:53:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-17T14:53:00.887 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-17T14:53:00.887 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000209875 s, 2.4 MB/s 2023-05-17T14:53:00.888 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-17T14:53:00.942 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-05-17T14:53:00.997 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-17T14:53:00.997 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:00.997 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 210361 Links: 1 2023-05-17T14:53:00.997 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:00.997 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:00.998 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-17 14:52:52.889149240 +0000 2023-05-17T14:53:00.998 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-17 14:48:24.543095762 +0000 2023-05-17T14:53:00.998 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-17 14:48:24.543095762 +0000 2023-05-17T14:53:00.998 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-17T14:53:00.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-17T14:53:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-17T14:53:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-17T14:53:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000213209 s, 2.4 MB/s 2023-05-17T14:53:01.061 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-17T14:53:01.116 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-05-17T14:53:01.172 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-17T14:53:01.173 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T14:53:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 210476 Links: 1 2023-05-17T14:53:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T14:53:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T14:53:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-17 14:52:52.890149227 +0000 2023-05-17T14:53:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-17 14:48:25.054089409 +0000 2023-05-17T14:53:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-17 14:48:25.054089409 +0000 2023-05-17T14:53:01.174 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-05-17T14:53:01.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-17T14:53:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-17T14:53:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-17T14:53:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000185891 s, 2.8 MB/s 2023-05-17T14:53:01.237 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-17T14:53:01.294 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:01.295 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-17T14:53:01.295 INFO:tasks.ceph:Generating config... 2023-05-17T14:53:01.298 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-17T14:53:01.298 INFO:tasks.ceph:[client] debug client = 20 2023-05-17T14:53:01.299 INFO:tasks.ceph:[client] debug ms = 1 2023-05-17T14:53:01.299 INFO:tasks.ceph:[client] pid file = 2023-05-17T14:53:01.300 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-17T14:53:01.300 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-17T14:53:01.301 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-05-17T14:53:01.301 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-17T14:53:01.301 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-17T14:53:01.302 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-17T14:53:01.302 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-17T14:53:01.303 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-17T14:53:01.303 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-17T14:53:01.303 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-17T14:53:01.304 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-17T14:53:01.304 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-17T14:53:01.305 INFO:tasks.ceph:[mgr] debug client = 20 2023-05-17T14:53:01.305 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-05-17T14:53:01.306 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-17T14:53:01.306 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-17T14:53:01.307 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-17T14:53:01.307 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-17T14:53:01.307 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-17T14:53:01.308 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-17T14:53:01.308 INFO:tasks.ceph:[osd] bdev async discard = True 2023-05-17T14:53:01.309 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-05-17T14:53:01.309 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-05-17T14:53:01.310 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-17T14:53:01.310 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-17T14:53:01.310 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-17T14:53:01.311 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-17T14:53:01.311 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-17T14:53:01.312 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-17T14:53:01.312 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-17T14:53:01.313 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-17T14:53:01.313 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-17T14:53:01.313 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-17T14:53:01.314 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-17T14:53:01.314 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-17T14:53:01.315 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-17T14:53:01.315 INFO:tasks.ceph:Setting up mon.a... 2023-05-17T14:53:01.316 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-17T14:53:01.368 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.keyring 2023-05-17T14:53:01.370 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-17T14:53:01.411 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T14:53:01.477 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.27'), ('mon.b', '172.21.15.40'), ('mon.c', '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]')] 2023-05-17T14:53:01.478 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.27,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-17T14:53:01.479 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:01.479 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-17T14:53:01.532 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.27 --add b 172.21.15.40 --addv c '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:01.615 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:01.615 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: generated fsid 0a45f698-dd9a-4c4e-b210-088283caeba3 2023-05-17T14:53:01.615 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 0 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:fsid 0a45f698-dd9a-4c4e-b210-088283caeba3 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:last_changed 2023-05-17T14:53:01.612087+0000 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:created 2023-05-17T14:53:01.612087+0000 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:min_mon_release 0 (unknown) 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:election_strategy: 1 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2023-05-17T14:53:01.616 INFO:teuthology.orchestra.run.smithi027.stdout:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2023-05-17T14:53:01.617 INFO:teuthology.orchestra.run.smithi027.stdout:2: [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] mon.c 2023-05-17T14:53:01.617 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-17T14:53:01.618 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-17T14:53:01.672 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0a45f698-dd9a-4c4e-b210-088283caeba3... 2023-05-17T14:53:01.673 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-17T14:53:01.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-17T14:53:01.754 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2023-05-17T14:53:01.754 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2023-05-17T14:53:01.755 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-17T14:53:01.755 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2023-05-17T14:53:01.755 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.755 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2023-05-17T14:53:01.755 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.755 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2023-05-17T14:53:01.756 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.757 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2023-05-17T14:53:01.758 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2023-05-17T14:53:01.759 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2023-05-17T14:53:01.759 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-17T14:53:01.759 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-17T14:53:01.759 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2023-05-17T14:53:01.759 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.759 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-05-17T14:53:01.760 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.760 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2023-05-17T14:53:01.760 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.760 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2023-05-17T14:53:01.761 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.761 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2023-05-17T14:53:01.761 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2023-05-17T14:53:01.761 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2023-05-17T14:53:01.761 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.27,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]" 2023-05-17T14:53:01.762 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on skipped message = False 2023-05-17T14:53:01.762 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 0a45f698-dd9a-4c4e-b210-088283caeba3 2023-05-17T14:53:01.762 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.762 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2023-05-17T14:53:01.762 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2023-05-17T14:53:01.763 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.763 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2023-05-17T14:53:01.763 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2023-05-17T14:53:01.763 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.763 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2023-05-17T14:53:01.763 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2023-05-17T14:53:01.764 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.764 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2023-05-17T14:53:01.764 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2023-05-17T14:53:01.765 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2023-05-17T14:53:01.765 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.765 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2023-05-17T14:53:01.765 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2023-05-17T14:53:01.765 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.766 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2023-05-17T14:53:01.766 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.766 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2023-05-17T14:53:01.766 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.766 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2023-05-17T14:53:01.767 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.767 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2023-05-17T14:53:01.767 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2023-05-17T14:53:01.767 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.767 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2023-05-17T14:53:01.768 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2023-05-17T14:53:01.768 INFO:teuthology.orchestra.run.smithi027.stdout: bdev async discard = True 2023-05-17T14:53:01.768 INFO:teuthology.orchestra.run.smithi027.stdout: bdev enable discard = True 2023-05-17T14:53:01.768 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore allocator = bitmap 2023-05-17T14:53:01.769 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2023-05-17T14:53:01.769 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2023-05-17T14:53:01.769 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2023-05-17T14:53:01.769 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2023-05-17T14:53:01.769 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-05-17T14:53:01.770 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2023-05-17T14:53:01.770 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2023-05-17T14:53:01.770 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2023-05-17T14:53:01.770 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2023-05-17T14:53:01.771 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2023-05-17T14:53:01.771 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2023-05-17T14:53:01.771 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2023-05-17T14:53:01.771 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-05-17T14:53:01.771 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.771 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2023-05-17T14:53:01.772 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-05-17T14:53:01.772 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2023-05-17T14:53:01.772 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-05-17T14:53:01.772 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-05-17T14:53:01.772 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-05-17T14:53:01.773 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-05-17T14:53:01.773 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2023-05-17T14:53:01.773 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2023-05-17T14:53:01.773 INFO:teuthology.orchestra.run.smithi027.stdout: debug finisher = 20 2023-05-17T14:53:01.773 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.773 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2023-05-17T14:53:01.774 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2023-05-17T14:53:01.775 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2023-05-17T14:53:01.776 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-05-17T14:53:01.777 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = "" 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2023-05-17T14:53:01.778 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-05-17T14:53:01.779 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2023-05-17T14:53:01.779 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2023-05-17T14:53:01.779 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2023-05-17T14:53:01.779 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-05-17T14:53:01.779 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2023-05-17T14:53:01.779 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2023-05-17T14:53:01.780 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2023-05-17T14:53:01.780 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2023-05-17T14:53:01.780 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-05-17T14:53:01.780 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-05-17T14:53:01.780 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-05-17T14:53:01.781 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.782 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-05-17T14:53:01.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-17T14:53:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-05-17T14:53:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-05-17T14:53:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-17T14:53:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-05-17T14:53:01.785 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-05-17T14:53:01.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-05-17T14:53:01.787 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.27,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]" 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 0a45f698-dd9a-4c4e-b210-088283caeba3 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-05-17T14:53:01.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-05-17T14:53:01.789 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.790 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.791 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2023-05-17T14:53:01.792 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-05-17T14:53:01.793 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-05-17T14:53:01.794 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: debug finisher = 20 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-05-17T14:53:01.795 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-05-17T14:53:01.796 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-05-17T14:53:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-05-17T14:53:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-17T14:53:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-05-17T14:53:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-05-17T14:53:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-05-17T14:53:01.798 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-05-17T14:53:01.799 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-05-17T14:53:01.800 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-05-17T14:53:01.800 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-05-17T14:53:01.800 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-05-17T14:53:01.800 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-05-17T14:53:01.800 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-05-17T14:53:01.801 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-05-17T14:53:01.801 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-05-17T14:53:01.801 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-05-17T14:53:01.801 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-05-17T14:53:01.802 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-05-17T14:53:01.802 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-17T14:53:01.802 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-05-17T14:53:01.802 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-05-17T14:53:01.802 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-05-17T14:53:01.802 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-05-17T14:53:01.803 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-05-17T14:53:01.803 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-05-17T14:53:01.803 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-05-17T14:53:01.803 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-17T14:53:01.804 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-17T14:53:01.871 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-17T14:53:01.871 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:01.871 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-17T14:53:01.885 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:01.886 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-17T14:53:01.939 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:53:01.940 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:01.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-17T14:53:01.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T14:53:02.013 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:02.014 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:02.067 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:53:02.068 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:02.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-17T14:53:02.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T14:53:02.104 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:02.105 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:02.159 INFO:tasks.ceph:Setting up mon nodes... 2023-05-17T14:53:02.159 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-17T14:53:02.159 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-17T14:53:02.208 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-17T14:53:02.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-17T14:53:02.265 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-17T14:53:02.267 INFO:tasks.ceph:Setting up mds nodes... 2023-05-17T14:53:02.268 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-17T14:53:02.316 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-17T14:53:02.318 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-17T14:53:02.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-17T14:53:02.428 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-17T14:53:02.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-17T14:53:02.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-17T14:53:02.502 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-17T14:53:02.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-17T14:53:02.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-17T14:53:02.618 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-17T14:53:02.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-17T14:53:02.644 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-17T14:53:02.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-17T14:53:02.682 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-17T14:53:02.694 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-17T14:53:02.771 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-17T14:53:02.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-17T14:53:02.823 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-17T14:53:02.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-17T14:53:02.913 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-17T14:53:02.926 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-17T14:53:02.927 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-17T14:53:02.927 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-17T14:53:02.951 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:02.951 INFO:tasks.ceph:role: osd.0 2023-05-17T14:53:02.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:53:02.952 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-17T14:53:03.023 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:03.023 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:03.023 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:03.023 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-05-17T14:53:03.023 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:03.024 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:03.024 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:03.024 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:03.024 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:03.024 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:03.382 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-05-17T14:53:03.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-05-17T14:53:03.384 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-17T14:53:03.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-17T14:53:03.541 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-17T14:53:03.606 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:03.606 INFO:tasks.ceph:role: osd.1 2023-05-17T14:53:03.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:53:03.606 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-17T14:53:03.676 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:03.677 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:03.678 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:04.038 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-05-17T14:53:04.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-05-17T14:53:04.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-17T14:53:04.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-17T14:53:04.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-17T14:53:04.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:04.217 INFO:tasks.ceph:role: osd.2 2023-05-17T14:53:04.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:53:04.218 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-17T14:53:04.289 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:04.289 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:04.289 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:04.289 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-05-17T14:53:04.289 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:04.289 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:04.290 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:04.290 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:04.290 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:04.290 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:04.659 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-05-17T14:53:04.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-05-17T14:53:04.661 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-17T14:53:04.764 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-17T14:53:04.792 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-17T14:53:04.856 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:04.857 INFO:tasks.ceph:role: osd.3 2023-05-17T14:53:04.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:53:04.857 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-17T14:53:04.929 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:04.929 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:04.929 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:04.929 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 2023-05-17T14:53:04.929 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:04.930 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:04.930 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:04.930 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:04.930 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:04.930 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:05.302 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-05-17T14:53:05.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-05-17T14:53:05.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-17T14:53:05.401 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-17T14:53:05.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:05.516+0000 7f94a6233200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-17T14:53:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:05.519+0000 7f94a6233200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-17T14:53:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:05.519+0000 7f94a6233200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T14:53:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:05.519+0000 7f94a6233200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T14:53:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:05.519+0000 7f94a6233200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T14:53:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:05.521+0000 7f94a6233200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-17T14:53:08.384 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-17T14:53:08.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:08.494+0000 7f6555bcb200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-17T14:53:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:08.494+0000 7f6555bcb200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-17T14:53:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:08.494+0000 7f6555bcb200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T14:53:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:08.494+0000 7f6555bcb200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T14:53:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:08.494+0000 7f6555bcb200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T14:53:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:08.495+0000 7f6555bcb200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-17T14:53:11.352 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-17T14:53:11.383 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:11.463+0000 7f31dfbe0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-17T14:53:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:11.463+0000 7f31dfbe0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-17T14:53:11.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:11.463+0000 7f31dfbe0200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T14:53:11.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:11.463+0000 7f31dfbe0200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T14:53:11.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:11.463+0000 7f31dfbe0200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T14:53:11.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:11.464+0000 7f31dfbe0200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-17T14:53:14.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-17T14:53:14.356 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:14.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:14.438+0000 7fa689f61200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-17T14:53:14.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:14.438+0000 7fa689f61200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-17T14:53:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:14.439+0000 7fa689f61200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T14:53:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:14.439+0000 7fa689f61200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T14:53:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:14.439+0000 7fa689f61200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T14:53:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:14.439+0000 7fa689f61200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-17T14:53:17.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-17T14:53:17.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-17T14:53:17.355 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:17.355 INFO:tasks.ceph:role: osd.4 2023-05-17T14:53:17.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:53:17.356 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-17T14:53:17.429 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:17.429 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:17.429 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:17.429 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-05-17T14:53:17.429 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:17.430 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:17.430 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:17.430 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:17.430 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:17.430 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:17.793 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-17T14:53:17.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-17T14:53:17.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-17T14:53:17.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-17T14:53:17.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-17T14:53:18.012 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:18.013 INFO:tasks.ceph:role: osd.5 2023-05-17T14:53:18.013 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:53:18.013 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-17T14:53:18.084 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:18.084 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:18.084 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:18.085 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:18.447 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-17T14:53:18.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-17T14:53:18.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-17T14:53:18.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-17T14:53:18.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-17T14:53:18.633 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:18.633 INFO:tasks.ceph:role: osd.6 2023-05-17T14:53:18.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:53:18.634 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-17T14:53:18.704 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:18.705 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:18.705 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:18.705 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-05-17T14:53:18.705 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:18.705 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:18.705 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:18.706 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:18.706 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:19.069 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-17T14:53:19.070 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-17T14:53:19.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-17T14:53:19.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-17T14:53:19.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-17T14:53:19.282 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T14:53:19.283 INFO:tasks.ceph:role: osd.7 2023-05-17T14:53:19.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:53:19.283 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-17T14:53:19.355 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T14:53:19.356 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T14:53:19.356 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T14:53:19.356 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-05-17T14:53:19.356 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T14:53:19.356 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-17T14:53:19.357 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T14:53:19.357 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T14:53:19.357 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T14:53:19.357 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T14:53:19.726 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-17T14:53:19.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-17T14:53:19.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-17T14:53:19.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-17T14:53:19.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:19.957+0000 7f8ef7f12200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-17T14:53:19.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:19.962+0000 7f8ef7f12200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-17T14:53:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:19.962+0000 7f8ef7f12200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T14:53:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:19.962+0000 7f8ef7f12200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T14:53:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:19.962+0000 7f8ef7f12200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T14:53:19.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:19.963+0000 7f8ef7f12200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-17T14:53:22.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-17T14:53:22.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:23.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:23.000+0000 7f0ebe78d200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-17T14:53:23.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:23.000+0000 7f0ebe78d200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-17T14:53:23.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:23.000+0000 7f0ebe78d200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T14:53:23.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:23.000+0000 7f0ebe78d200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T14:53:23.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:23.000+0000 7f0ebe78d200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T14:53:23.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:23.001+0000 7f0ebe78d200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-17T14:53:25.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-17T14:53:25.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:26.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:26.015+0000 7f54585c2200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-17T14:53:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:26.015+0000 7f54585c2200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-17T14:53:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:26.015+0000 7f54585c2200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T14:53:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:26.016+0000 7f54585c2200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T14:53:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:26.016+0000 7f54585c2200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T14:53:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:26.016+0000 7f54585c2200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-17T14:53:28.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-17T14:53:28.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:28.998+0000 7fe795aca200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-17T14:53:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:28.998+0000 7fe795aca200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-17T14:53:29.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:28.998+0000 7fe795aca200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T14:53:29.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:28.998+0000 7fe795aca200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T14:53:29.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:28.998+0000 7fe795aca200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T14:53:29.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:28.999+0000 7fe795aca200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-17T14:53:29.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:29.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:31.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-17T14:53:31.886 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-17T14:53:31.886 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:31.886 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-17T14:53:31.916 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:31.916 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-17T14:53:31.983 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:31.984 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-17T14:53:32.051 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:32.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-17T14:53:32.118 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:32.118 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-17T14:53:32.183 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:32.183 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-17T14:53:32.248 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:32.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-17T14:53:32.313 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-17T14:53:32.343 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-17T14:53:32.410 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-17T14:53:32.476 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-17T14:53:32.542 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-17T14:53:32.608 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-17T14:53:32.672 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-17T14:53:32.737 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:32.737 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-17T14:53:32.753 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:32.754 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-17T14:53:32.809 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.810 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-17T14:53:32.824 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:32.825 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-17T14:53:32.879 INFO:tasks.ceph:Adding keys to all mons... 2023-05-17T14:53:32.879 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-17T14:53:32.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-17T14:53:32.921 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.y] 2023-05-17T14:53:32.921 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A== 2023-05-17T14:53:32.921 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-05-17T14:53:32.921 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA== 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ== 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q== 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw== 2023-05-17T14:53:32.922 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg== 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ== 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg== 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw== 2023-05-17T14:53:32.923 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q== 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.4] 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g== 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.5] 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA== 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.6] 2023-05-17T14:53:32.924 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw== 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.7] 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg== 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q== 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout:[client.2] 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw== 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout:[client.1] 2023-05-17T14:53:32.925 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ== 2023-05-17T14:53:32.926 INFO:teuthology.orchestra.run.smithi027.stdout:[client.3] 2023-05-17T14:53:32.926 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w== 2023-05-17T14:53:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-05-17T14:53:32.941 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A== 2023-05-17T14:53:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-05-17T14:53:32.941 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA== 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ== 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q== 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw== 2023-05-17T14:53:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg== 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ== 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg== 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-05-17T14:53:32.943 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw== 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q== 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g== 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA== 2023-05-17T14:53:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw== 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg== 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q== 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw== 2023-05-17T14:53:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-05-17T14:53:32.946 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ== 2023-05-17T14:53:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-05-17T14:53:32.946 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w== 2023-05-17T14:53:32.947 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T14:53:32.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T14:53:33.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.084 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.134 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.229 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.277 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T14:53:33.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T14:53:33.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.423 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T14:53:33.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.534 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T14:53:33.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.780 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T14:53:33.880 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-17T14:53:33.880 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-17T14:53:33.904 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T14:53:33.994 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-17T14:53:34.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-17T14:53:34.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T14:53:34.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-17T14:53:34.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-17T14:53:34.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T14:53:34.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-17T14:53:34.336 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:34.337 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-17T14:53:34.389 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-17T14:53:34.390 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-17T14:53:34.390 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-17T14:53:34.392 INFO:tasks.ceph.mon.a:Started 2023-05-17T14:53:34.392 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-17T14:53:34.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-17T14:53:34.431 INFO:tasks.ceph.mon.b:Started 2023-05-17T14:53:34.432 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-17T14:53:34.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-17T14:53:34.434 INFO:tasks.ceph.mon.c:Started 2023-05-17T14:53:34.434 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-17T14:53:34.434 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-17T14:53:34.434 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-17T14:53:34.436 INFO:tasks.ceph.mgr.y:Started 2023-05-17T14:53:34.437 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-17T14:53:34.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-17T14:53:34.438 INFO:tasks.ceph.mgr.x:Started 2023-05-17T14:53:34.439 INFO:tasks.ceph:Setting crush tunables to default 2023-05-17T14:53:34.439 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd crush tunables default 2023-05-17T14:53:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.551+0000 7f5247b72700 1 Processor -- start 2023-05-17T14:53:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.552+0000 7f5247b72700 1 -- start start 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.552+0000 7f5247b72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 0x7f5240154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.552+0000 7f5247b72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f52400cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.552+0000 7f5247b72700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52400c5a50 con 0x7f5240068f00 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.552+0000 7f5247b72700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5240069fa0 con 0x7f5240154090 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.552+0000 7f5247b72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c04e0 con 0x7f52400cb450 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524610f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5240068f00 0x7f5240157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60946/0 (socket says 172.21.15.27:60946) 2023-05-17T14:53:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524610f700 1 -- 172.21.15.27:0/1674149492 learned_addr learned my addr 172.21.15.27:0/1674149492 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524590e700 1 --2- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 0x7f5240154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524510d700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f52400cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524590e700 1 -- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 msgr2=0x7f5240154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524590e700 1 -- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 msgr2=0x7f5240154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524510d700 1 -- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 msgr2=0x7f52400cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524510d700 1 -- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 msgr2=0x7f52400cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-17T14:53:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524590e700 1 --2- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 0x7f5240154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-17T14:53:34.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524510d700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f52400cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-17T14:53:34.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524590e700 1 --2- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 0x7f5240154470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T14:53:34.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.553+0000 7f524510d700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f52400cb8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T14:53:34.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122451194 0 0) 0x7f52400c5a50 con 0x7f5240068f00 2023-05-17T14:53:34.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52280033f0 con 0x7f5240068f00 2023-05-17T14:53:34.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4181552892 0 0) 0x7f52280033f0 con 0x7f5240068f00 2023-05-17T14:53:34.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 msgr2=0x7f52400cb8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T14:53:34.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f52400cb8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 msgr2=0x7f5240154470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 --2- 172.21.15.27:0/1674149492 >> v2:172.21.15.40:3300/0 conn(0x7f5240154090 0x7f5240154470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400c0760 con 0x7f5240068f00 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5230001470 con 0x7f5240068f00 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 >> v1:172.21.15.27:6789/0 conn(0x7f5240068f00 legacy=0x7f5240157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280038e0 0x7f5228003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f5228004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5228004b80 0x7f5228005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240069fa0 con 0x7f5228004b80 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c04e0 con 0x7f52280038e0 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522800b930 con 0x7f52400cb450 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524610f700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5228004b80 0x7f5228005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524510d700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f5228004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.711+0000 7f524590e700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280038e0 0x7f5228003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524610f700 1 -- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 msgr2=0x7f5228004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:34.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524610f700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52400cb450 0x7f5228004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524610f700 1 -- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280038e0 msgr2=0x7f5228003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524610f700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280038e0 0x7f5228003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524610f700 1 -- 172.21.15.27:0/1674149492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280033f0 con 0x7f5228004b80 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524590e700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280038e0 0x7f5228003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524610f700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5228004b80 0x7f5228005000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f523000c160 tx=0x7f52400c0650).ready entity=mon.0 client_cookie=bf3b131b01dd2826 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000ca90 con 0x7f5228004b80 2023-05-17T14:53:34.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000cbf0 con 0x7f5228004b80 2023-05-17T14:53:34.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.712+0000 7f524490c700 1 -- 172.21.15.27:0/1674149492 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300070d0 con 0x7f5228004b80 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f5247b72700 1 -- 172.21.15.27:0/1674149492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5228004b80 msgr2=0x7f5228005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f5247b72700 1 --2- 172.21.15.27:0/1674149492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5228004b80 0x7f5228005000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f523000c160 tx=0x7f52400c0650).stop 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f524610f700 1 -- 172.21.15.27:0/1674149492 reap_dead start 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f5247b72700 1 -- 172.21.15.27:0/1674149492 shutdown_connections 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f5247b72700 1 -- 172.21.15.27:0/1674149492 >> 172.21.15.27:0/1674149492 conn(0x7f524005e7e0 msgr2=0x7f52400cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f5247b72700 1 -- 172.21.15.27:0/1674149492 shutdown_connections 2023-05-17T14:53:34.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.713+0000 7f5247b72700 1 -- 172.21.15.27:0/1674149492 wait complete. 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.714+0000 7f5247b72700 1 Processor -- start 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.714+0000 7f5247b72700 1 -- start start 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f5247b72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5228004b80 0x7f52400c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f5247b72700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 0x7f5240156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f5247b72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5240156960 0x7f524014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f5247b72700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c4cc0 con 0x7f52400c1de0 2023-05-17T14:53:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f5247b72700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c2260 con 0x7f5240156960 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f5247b72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c24f0 con 0x7f5228004b80 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f524510d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 0x7f5240156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f524590e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5228004b80 0x7f52400c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f524510d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 0x7f5240156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33186/0 (socket says 172.21.15.27:33186) 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f524510d700 1 -- 172.21.15.27:0/3852801612 learned_addr learned my addr 172.21.15.27:0/3852801612 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.715+0000 7f524610f700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5240156960 0x7f524014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524510d700 1 -- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5228004b80 msgr2=0x7f52400c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524510d700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5228004b80 0x7f52400c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524510d700 1 -- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5240156960 msgr2=0x7f524014e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524510d700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5240156960 0x7f524014e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524510d700 1 -- 172.21.15.27:0/3852801612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400c27d0 con 0x7f52400c1de0 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524610f700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5240156960 0x7f524014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f524510d700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 0x7f5240156470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f523400bfd0 tx=0x7f5234008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:34.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400e720 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523400e880 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52400c2ab0 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400ec00 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f5234005ae0 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52400ae6d0 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.716+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f5234006750 con 0x7f52400c1de0 2023-05-17T14:53:34.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.717+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52400aebe0 con 0x7f52400c1de0 2023-05-17T14:53:34.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.720+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f5234014470 con 0x7f52400c1de0 2023-05-17T14:53:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.793+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f52400c0a40 con 0x7f52400c1de0 2023-05-17T14:53:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.797+0000 7f523dffb700 1 -- 172.21.15.27:0/3852801612 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5234014610 con 0x7f52400c1de0 2023-05-17T14:53:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 msgr2=0x7f5240156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 0x7f5240156470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f523400bfd0 tx=0x7f5234008040).stop 2023-05-17T14:53:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 shutdown_connections 2023-05-17T14:53:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5240156960 0x7f524014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5228004b80 0x7f52400c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 --2- 172.21.15.27:0/3852801612 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52400c1de0 0x7f5240156470 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 >> 172.21.15.27:0/3852801612 conn(0x7f524005e7e0 msgr2=0x7f5240069330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 shutdown_connections 2023-05-17T14:53:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:34.798+0000 7f5247b72700 1 -- 172.21.15.27:0/3852801612 wait complete. 2023-05-17T14:53:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2023-05-17T14:53:34.813 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-17T14:53:34.813 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:34.814 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-17T14:53:34.837 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:34.838 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-17T14:53:34.850 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:34.847+0000 7f41c886c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T14:53:34.860 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:34.856+0000 7fbf7149e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T14:53:34.883 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:34.883 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-17T14:53:34.922 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:34.918+0000 7f41c886c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T14:53:34.933 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:34.930+0000 7fbf7149e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T14:53:34.947 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-05-17T14:53:34.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-17T14:53:35.011 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:35.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-17T14:53:35.036 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:35.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-17T14:53:35.100 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:35.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-17T14:53:35.165 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-17T14:53:35.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-17T14:53:35.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new a73ff312-9ee8-41f2-91d5-a05aaa14077c 0 2023-05-17T14:53:35.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.380+0000 7fb9213fb700 1 Processor -- start 2023-05-17T14:53:35.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.380+0000 7fb9213fb700 1 -- start start 2023-05-17T14:53:35.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb9213fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 0x7fb91c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb9213fb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 0x7fb91c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb9213fb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c0c60d0 con 0x7fb91c0cac00 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb9213fb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c1588b0 con 0x7fb91c157980 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb9213fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c157e10 con 0x7fb91c153ef0 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb920bfa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 0x7fb91c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 0x7fb91c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb920bfa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 0x7fb91c0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52462/0 (socket says 172.21.15.40:52462) 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 0x7fb91c0cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39604/0 (socket says 172.21.15.40:39604) 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb920bfa700 1 -- 172.21.15.40:0/2227159045 learned_addr learned my addr 172.21.15.40:0/2227159045 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 -- 172.21.15.40:0/2227159045 >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 msgr2=0x7fb91c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 --2- 172.21.15.40:0/2227159045 >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 0x7fb91c0c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 -- 172.21.15.40:0/2227159045 >> v1:172.21.15.27:6789/0 conn(0x7fb91c0cac00 legacy=0x7fb91c1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 -- 172.21.15.40:0/2227159045 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c158010 con 0x7fb91c153ef0 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb920bfa700 1 --2- 172.21.15.40:0/2227159045 >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 0x7fb91c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.381+0000 7fb91b7fe700 1 --2- 172.21.15.40:0/2227159045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 0x7fb91c0cafe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb90c009790 tx=0x7fb90c009060).ready entity=mon.2 client_cookie=9a1d2c897a3ba5df server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb91affd700 1 -- 172.21.15.40:0/2227159045 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00f510 con 0x7fb91c153ef0 2023-05-17T14:53:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb91affd700 1 -- 172.21.15.40:0/2227159045 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c00f670 con 0x7fb91c153ef0 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb91affd700 1 -- 172.21.15.40:0/2227159045 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00f9f0 con 0x7fb91c153ef0 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 -- 172.21.15.40:0/2227159045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 msgr2=0x7fb91c0cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 --2- 172.21.15.40:0/2227159045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 0x7fb91c0cafe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb90c009790 tx=0x7fb90c009060).stop 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 -- 172.21.15.40:0/2227159045 shutdown_connections 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 --2- 172.21.15.40:0/2227159045 >> v2:172.21.15.40:3300/0 conn(0x7fb91c157980 0x7fb91c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 --2- 172.21.15.40:0/2227159045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c153ef0 0x7fb91c0cafe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 -- 172.21.15.40:0/2227159045 >> 172.21.15.40:0/2227159045 conn(0x7fb91c05dd50 msgr2=0x7fb91c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:35.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 -- 172.21.15.40:0/2227159045 shutdown_connections 2023-05-17T14:53:35.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.382+0000 7fb9213fb700 1 -- 172.21.15.40:0/2227159045 wait complete. 2023-05-17T14:53:35.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.383+0000 7fb9213fb700 1 Processor -- start 2023-05-17T14:53:35.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 -- start start 2023-05-17T14:53:35.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 0x7fb91c156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb91c153ef0 0x7fb91c14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 0x7fb91c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c154480 con 0x7fb91c153ef0 2023-05-17T14:53:35.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c1515b0 con 0x7fb91c157980 2023-05-17T14:53:35.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb9213fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c151890 con 0x7fb91c0cac00 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb920bfa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 0x7fb91c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 0x7fb91c156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.384+0000 7fb920bfa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 0x7fb91c14f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52468/0 (socket says 172.21.15.40:52468) 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb920bfa700 1 -- 172.21.15.40:0/3146383446 learned_addr learned my addr 172.21.15.40:0/3146383446 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 0x7fb91c156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39608/0 (socket says 172.21.15.40:39608) 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91b7fe700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb91c153ef0 0x7fb91c14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 -- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 msgr2=0x7fb91c14f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 0x7fb91c14f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 -- 172.21.15.40:0/3146383446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb91c153ef0 msgr2=0x7fb91c14d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb91c153ef0 0x7fb91c14d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 -- 172.21.15.40:0/3146383446 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914009ae0 con 0x7fb91c0cac00 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb920bfa700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 0x7fb91c14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb91bfff700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 0x7fb91c156aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb91000c440 tx=0x7fb910007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000ce40 con 0x7fb91c0cac00 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb910007020 con 0x7fb91c0cac00 2023-05-17T14:53:35.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100073c0 con 0x7fb91c0cac00 2023-05-17T14:53:35.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c0092a0 con 0x7fb91c0cac00 2023-05-17T14:53:35.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.385+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c1549b0 con 0x7fb91c0cac00 2023-05-17T14:53:35.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.386+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fb910010070 con 0x7fb91c0cac00 2023-05-17T14:53:35.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.386+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb91000f830 con 0x7fb91c0cac00 2023-05-17T14:53:35.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.386+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c047150 con 0x7fb91c0cac00 2023-05-17T14:53:35.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.389+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb910006d40 con 0x7fb91c0cac00 2023-05-17T14:53:35.420 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:35.416+0000 7f41c886c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T14:53:35.422 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:35.418+0000 7fbf7149e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T14:53:35.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.470+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a73ff312-9ee8-41f2-91d5-a05aaa14077c", "id": 0} v 0) v1 -- 0x7fb91c0c63b0 con 0x7fb91c0cac00 2023-05-17T14:53:35.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.475+0000 7fb903fff700 1 -- 172.21.15.40:0/3146383446 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a73ff312-9ee8-41f2-91d5-a05aaa14077c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb91000fa70 con 0x7fb91c0cac00 2023-05-17T14:53:35.479 INFO:teuthology.orchestra.run.smithi040.stdout:0 2023-05-17T14:53:35.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 msgr2=0x7fb91c156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 0x7fb91c156aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb91000c440 tx=0x7fb910007d40).stop 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 shutdown_connections 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c157980 0x7fb91c14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c0cac00 0x7fb91c156aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 --2- 172.21.15.40:0/3146383446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb91c153ef0 0x7fb91c14d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.476+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 >> 172.21.15.40:0/3146383446 conn(0x7fb91c05dd50 msgr2=0x7fb91c152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.477+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 shutdown_connections 2023-05-17T14:53:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.477+0000 7fb9213fb700 1 -- 172.21.15.40:0/3146383446 wait complete. 2023-05-17T14:53:35.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new b7108df1-1da0-4140-a5e0-310084574d4f 1 2023-05-17T14:53:35.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.604+0000 7faa7145c700 1 Processor -- start 2023-05-17T14:53:35.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.604+0000 7faa7145c700 1 -- start start 2023-05-17T14:53:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa7145c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa7145c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa6c157980 0x7faa6c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa7145c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c0c60d0 con 0x7faa6c1537e0 2023-05-17T14:53:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa7145c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c1588b0 con 0x7faa6c157980 2023-05-17T14:53:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa7145c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c157e00 con 0x7faa6c0cac00 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa6c157980 0x7faa6c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa6c157980 0x7faa6c0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52474/0 (socket says 172.21.15.40:52474) 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c0cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39614/0 (socket says 172.21.15.40:39614) 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 -- 172.21.15.40:0/665447257 learned_addr learned my addr 172.21.15.40:0/665447257 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 -- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 msgr2=0x7faa6c0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 --2- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 -- 172.21.15.40:0/665447257 >> v1:172.21.15.27:6789/0 conn(0x7faa6c1537e0 legacy=0x7faa6c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 -- 172.21.15.40:0/665447257 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c158010 con 0x7faa6c157980 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6bfff700 1 --2- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.605+0000 7faa6b7fe700 1 --2- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c5be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7faa60009830 tx=0x7faa600090f0).ready entity=mon.1 client_cookie=713780f1a10896af server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa6affd700 1 -- 172.21.15.40:0/665447257 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000b580 con 0x7faa6c157980 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa6affd700 1 -- 172.21.15.40:0/665447257 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000b6e0 con 0x7faa6c157980 2023-05-17T14:53:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa6affd700 1 -- 172.21.15.40:0/665447257 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000ba60 con 0x7faa6c157980 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 -- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 msgr2=0x7faa6c0c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 --2- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c5be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7faa60009830 tx=0x7faa600090f0).stop 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 -- 172.21.15.40:0/665447257 shutdown_connections 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 --2- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 --2- 172.21.15.40:0/665447257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c5be0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 -- 172.21.15.40:0/665447257 >> 172.21.15.40:0/665447257 conn(0x7faa6c05dd50 msgr2=0x7faa6c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 -- 172.21.15.40:0/665447257 shutdown_connections 2023-05-17T14:53:35.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.606+0000 7faa7145c700 1 -- 172.21.15.40:0/665447257 wait complete. 2023-05-17T14:53:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.607+0000 7faa7145c700 1 Processor -- start 2023-05-17T14:53:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.607+0000 7faa7145c700 1 -- start start 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa7145c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa7145c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6c1537e0 0x7faa6c0c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa7145c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa7145c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c156e20 con 0x7faa6c1537e0 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa7145c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c0d40 con 0x7faa6c157980 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa7145c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c2dd0 con 0x7faa6c0cac00 2023-05-17T14:53:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c1442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39620/0 (socket says 172.21.15.40:39620) 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa6bfff700 1 -- 172.21.15.40:0/3115594126 learned_addr learned my addr 172.21.15.40:0/3115594126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa70c5b700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.608+0000 7faa6b7fe700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6c1537e0 0x7faa6c0c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa6bfff700 1 -- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 msgr2=0x7faa6c0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa6bfff700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa6bfff700 1 -- 172.21.15.40:0/3115594126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6c1537e0 msgr2=0x7faa6c0c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa6bfff700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6c1537e0 0x7faa6c0c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa6bfff700 1 -- 172.21.15.40:0/3115594126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c0092a0 con 0x7faa6c0cac00 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa6bfff700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c1442f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7faa5c00ea20 tx=0x7faa5c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ee60 con 0x7faa6c0cac00 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00c850 con 0x7faa6c0cac00 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa60009370 con 0x7faa6c0cac00 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00cbd0 con 0x7faa6c0cac00 2023-05-17T14:53:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c0c2780 con 0x7faa6c0cac00 2023-05-17T14:53:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7faa5c022070 con 0x7faa6c0cac00 2023-05-17T14:53:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.609+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7faa5c0123f0 con 0x7faa6c0cac00 2023-05-17T14:53:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.610+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c0c25f0 con 0x7faa6c0cac00 2023-05-17T14:53:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.612+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7faa5c03ae50 con 0x7faa6c0cac00 2023-05-17T14:53:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.705+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b7108df1-1da0-4140-a5e0-310084574d4f", "id": 1} v 0) v1 -- 0x7faa6c0c30b0 con 0x7faa6c0cac00 2023-05-17T14:53:35.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.715+0000 7faa53fff700 1 -- 172.21.15.40:0/3115594126 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7108df1-1da0-4140-a5e0-310084574d4f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa5c029030 con 0x7faa6c0cac00 2023-05-17T14:53:35.718 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-17T14:53:35.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 msgr2=0x7faa6c1442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c1442f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7faa5c00ea20 tx=0x7faa5c009060).stop 2023-05-17T14:53:35.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 shutdown_connections 2023-05-17T14:53:35.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c157980 0x7faa6c0c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa6c0cac00 0x7faa6c1442f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 --2- 172.21.15.40:0/3115594126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6c1537e0 0x7faa6c0c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 >> 172.21.15.40:0/3115594126 conn(0x7faa6c05dd50 msgr2=0x7faa6c150740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:35.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 shutdown_connections 2023-05-17T14:53:35.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.716+0000 7faa7145c700 1 -- 172.21.15.40:0/3115594126 wait complete. 2023-05-17T14:53:35.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new c8205f3c-f822-4e55-ad59-48c45ab8b4ec 2 2023-05-17T14:53:35.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 Processor -- start 2023-05-17T14:53:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 -- start start 2023-05-17T14:53:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 0x7f7a0c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a0c0c5fd0 0x7f7a0c0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0c155310 con 0x7f7a0c154e90 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0c157de0 con 0x7f7a0c0c5fd0 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.843+0000 7f7a10803700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c1580c0 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 0x7f7a0c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0b59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a0c0c5fd0 0x7f7a0c0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 0x7f7a0c0ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39626/0 (socket says 172.21.15.40:39626) 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/3185963572 learned_addr learned my addr 172.21.15.40:0/3185963572 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0a59c700 1 --1- 172.21.15.40:0/3185963572 >> v1:172.21.15.40:6789/0 conn(0x7f7a0c154e90 0x7f7a0c0c58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54076/0 (socket says 172.21.15.40:54076) 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/3185963572 >> v2:172.21.15.40:3300/0 conn(0x7f7a0c0c5fd0 msgr2=0x7f7a0c0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 --2- 172.21.15.40:0/3185963572 >> v2:172.21.15.40:3300/0 conn(0x7f7a0c0c5fd0 0x7f7a0c0a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/3185963572 >> v1:172.21.15.40:6789/0 conn(0x7f7a0c154e90 legacy=0x7f7a0c0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a09d9b700 1 -- 172.21.15.40:0/3185963572 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059228453 0 0) 0x7f7a0c155310 con 0x7f7a0c154e90 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/3185963572 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c1583a0 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0b59e700 1 --2- 172.21.15.40:0/3185963572 >> v2:172.21.15.40:3300/0 conn(0x7f7a0c0c5fd0 0x7f7a0c0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a0ad9d700 1 --2- 172.21.15.40:0/3185963572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 0x7f7a0c0ad190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f79fc006fd0 tx=0x7f79fc0090f0).ready entity=mon.2 client_cookie=91b4e85d313522e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a09d9b700 1 -- 172.21.15.40:0/3185963572 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00b580 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a09d9b700 1 -- 172.21.15.40:0/3185963572 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00b6e0 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.844+0000 7f7a09d9b700 1 -- 172.21.15.40:0/3185963572 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00ba60 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 -- 172.21.15.40:0/3185963572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 msgr2=0x7f7a0c0ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 --2- 172.21.15.40:0/3185963572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 0x7f7a0c0ad190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f79fc006fd0 tx=0x7f79fc0090f0).stop 2023-05-17T14:53:35.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 -- 172.21.15.40:0/3185963572 shutdown_connections 2023-05-17T14:53:35.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 --2- 172.21.15.40:0/3185963572 >> v2:172.21.15.40:3300/0 conn(0x7f7a0c0c5fd0 0x7f7a0c0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 --2- 172.21.15.40:0/3185963572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c0acdb0 0x7f7a0c0ad190 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 -- 172.21.15.40:0/3185963572 >> 172.21.15.40:0/3185963572 conn(0x7f7a0c05dd50 msgr2=0x7f7a0c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:35.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 -- 172.21.15.40:0/3185963572 shutdown_connections 2023-05-17T14:53:35.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.845+0000 7f7a10803700 1 -- 172.21.15.40:0/3185963572 wait complete. 2023-05-17T14:53:35.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.846+0000 7f7a10803700 1 Processor -- start 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.846+0000 7f7a10803700 1 -- start start 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a10803700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 0x7f7a0c149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a10803700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a0c0c5fd0 0x7f7a0c0c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a10803700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c154e90 0x7f7a0c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a10803700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c149e00 con 0x7f7a0c0c5fd0 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a10803700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0c3430 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a10803700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0c3710 con 0x7f7a0c154e90 2023-05-17T14:53:35.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 0x7f7a0c149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c154e90 0x7f7a0c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 0x7f7a0c149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52486/0 (socket says 172.21.15.40:52486) 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/2219342080 learned_addr learned my addr 172.21.15.40:0/2219342080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0a59c700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a0c0c5fd0 0x7f7a0c0c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c154e90 msgr2=0x7f7a0c0aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c154e90 0x7f7a0c0aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/2219342080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a0c0c5fd0 msgr2=0x7f7a0c0c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a0c0c5fd0 0x7f7a0c0c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 -- 172.21.15.40:0/2219342080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009a20 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0b59e700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c154e90 0x7f7a0c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.847+0000 7f7a0ad9d700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 0x7f7a0c149910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f79fc009130 tx=0x7f79fc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00b850 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00b9b0 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc009370 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc01c670 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c0c3cd0 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f79fc02c070 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.848+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f79fc01ccc0 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.849+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c047150 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.853+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f79fc02a060 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.934+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c8205f3c-f822-4e55-ad59-48c45ab8b4ec", "id": 2} v 0) v1 -- 0x7f7a0c158680 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.945+0000 7f79f2ffd700 1 -- 172.21.15.40:0/2219342080 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8205f3c-f822-4e55-ad59-48c45ab8b4ec", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f79fc020070 con 0x7f7a0c0acdb0 2023-05-17T14:53:35.949 INFO:teuthology.orchestra.run.smithi040.stdout:2 2023-05-17T14:53:35.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 msgr2=0x7f7a0c149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:35.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 0x7f7a0c149910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f79fc009130 tx=0x7f79fc017000).stop 2023-05-17T14:53:35.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 shutdown_connections 2023-05-17T14:53:35.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a0c154e90 0x7f7a0c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0c0acdb0 0x7f7a0c149910 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 --2- 172.21.15.40:0/2219342080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a0c0c5fd0 0x7f7a0c0c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:35.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 >> 172.21.15.40:0/2219342080 conn(0x7f7a0c05dd50 msgr2=0x7f7a0c157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:35.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 shutdown_connections 2023-05-17T14:53:35.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:35.946+0000 7f7a10803700 1 -- 172.21.15.40:0/2219342080 wait complete. 2023-05-17T14:53:35.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 15915cf4-29a7-4ead-9cda-27c32f712e8c 3 2023-05-17T14:53:36.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.073+0000 7f7c644b3700 1 Processor -- start 2023-05-17T14:53:36.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.074+0000 7f7c644b3700 1 -- start start 2023-05-17T14:53:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c644b3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 0x7f7c5c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c644b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c644b3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c0c0c90 con 0x7f7c5c0691f0 2023-05-17T14:53:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c644b3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c1c50 con 0x7f7c5c1543d0 2023-05-17T14:53:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c644b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c158790 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c61a4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c6224f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 0x7f7c5c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c6224f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 0x7f7c5c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52492/0 (socket says 172.21.15.40:52492) 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c61a4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39636/0 (socket says 172.21.15.40:39636) 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.075+0000 7f7c6224f700 1 -- 172.21.15.40:0/1238443546 learned_addr learned my addr 172.21.15.40:0/1238443546 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c61a4e700 1 -- 172.21.15.40:0/1238443546 >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 msgr2=0x7f7c5c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c61a4e700 1 --2- 172.21.15.40:0/1238443546 >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 0x7f7c5c0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c61a4e700 1 -- 172.21.15.40:0/1238443546 >> v1:172.21.15.27:6789/0 conn(0x7f7c5c0691f0 legacy=0x7f7c5c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c61a4e700 1 -- 172.21.15.40:0/1238443546 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0c6570 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c6224f700 1 --2- 172.21.15.40:0/1238443546 >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 0x7f7c5c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c61a4e700 1 --2- 172.21.15.40:0/1238443546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c068d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7c50009760 tx=0x7f7c50009060).ready entity=mon.2 client_cookie=b7cf30fd27f8ab83 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c6124d700 1 -- 172.21.15.40:0/1238443546 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000f510 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c6124d700 1 -- 172.21.15.40:0/1238443546 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000f670 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.076+0000 7f7c6124d700 1 -- 172.21.15.40:0/1238443546 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000f9f0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 -- 172.21.15.40:0/1238443546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 msgr2=0x7f7c5c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 --2- 172.21.15.40:0/1238443546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c068d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7c50009760 tx=0x7f7c50009060).stop 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 -- 172.21.15.40:0/1238443546 shutdown_connections 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 --2- 172.21.15.40:0/1238443546 >> v2:172.21.15.40:3300/0 conn(0x7f7c5c1543d0 0x7f7c5c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 --2- 172.21.15.40:0/1238443546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c068d00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 -- 172.21.15.40:0/1238443546 >> 172.21.15.40:0/1238443546 conn(0x7f7c5c0cb7f0 msgr2=0x7f7c5c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 -- 172.21.15.40:0/1238443546 shutdown_connections 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.077+0000 7f7c644b3700 1 -- 172.21.15.40:0/1238443546 wait complete. 2023-05-17T14:53:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.079+0000 7f7c644b3700 1 Processor -- start 2023-05-17T14:53:36.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.079+0000 7f7c644b3700 1 -- start start 2023-05-17T14:53:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c644b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0691f0 0x7f7c5c147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c644b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c644b3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c5c1543d0 0x7f7c5c0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c644b3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c148210 con 0x7f7c5c1543d0 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c644b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0aee50 con 0x7f7c5c0691f0 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c644b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0ae240 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c61a4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c6224f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0691f0 0x7f7c5c147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c61a4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c0ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39644/0 (socket says 172.21.15.40:39644) 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c61a4e700 1 -- 172.21.15.40:0/2805584742 learned_addr learned my addr 172.21.15.40:0/2805584742 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c6224f700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0691f0 0x7f7c5c147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52498/0 (socket says 172.21.15.40:52498) 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.080+0000 7f7c62a50700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c5c1543d0 0x7f7c5c0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c61a4e700 1 -- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0691f0 msgr2=0x7f7c5c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c61a4e700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0691f0 0x7f7c5c147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c61a4e700 1 -- 172.21.15.40:0/2805584742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c5c1543d0 msgr2=0x7f7c5c0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c61a4e700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c5c1543d0 0x7f7c5c0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c61a4e700 1 -- 172.21.15.40:0/2805584742 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009370 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c61a4e700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c0ca310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7c50009e00 tx=0x7f7c50017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5001a6e0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5001a860 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c500092a0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5001ac20 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c0ae800 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f7c5000f070 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.081+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f7c500118c0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.082+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c06bdf0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.084+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f7c500227c0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.187 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:36.183+0000 7fbf7149e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T14:53:36.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.212+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15915cf4-29a7-4ead-9cda-27c32f712e8c", "id": 3} v 0) v1 -- 0x7f7c5c157e60 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.220 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:36.217+0000 7f41c886c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T14:53:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.219+0000 7f7c4e7fc700 1 -- 172.21.15.40:0/2805584742 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15915cf4-29a7-4ead-9cda-27c32f712e8c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c50011ba0 con 0x7f7c5c0c60f0 2023-05-17T14:53:36.223 INFO:teuthology.orchestra.run.smithi040.stdout:3 2023-05-17T14:53:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 msgr2=0x7f7c5c0ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c0ca310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7c50009e00 tx=0x7f7c50017000).stop 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 shutdown_connections 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c5c1543d0 0x7f7c5c0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0691f0 0x7f7c5c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 --2- 172.21.15.40:0/2805584742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c5c0c60f0 0x7f7c5c0ca310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.220+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 >> 172.21.15.40:0/2805584742 conn(0x7f7c5c0cb7f0 msgr2=0x7f7c5c0c1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.221+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 shutdown_connections 2023-05-17T14:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.221+0000 7f7c644b3700 1 -- 172.21.15.40:0/2805584742 wait complete. 2023-05-17T14:53:36.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new e1a17304-7ade-4f10-a09b-b13d0f180398 4 2023-05-17T14:53:36.256 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:36.252+0000 7fbf7149e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T14:53:36.293 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:36.289+0000 7f41c886c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T14:53:36.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.347+0000 7f726523c700 1 Processor -- start 2023-05-17T14:53:36.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.347+0000 7f726523c700 1 -- start start 2023-05-17T14:53:36.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.348+0000 7f726523c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72601543d0 0x7f72600c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.348+0000 7f726523c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7260158790 con 0x7f72600c60f0 2023-05-17T14:53:36.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.348+0000 7f726523c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72600c6570 con 0x7f7260069410 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.348+0000 7f726523c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72600c1c50 con 0x7f72601543d0 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.348+0000 7f725f59e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7260069410 0x7f72600bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54102/0 (socket says 172.21.15.40:54102) 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.348+0000 7f725f59e700 1 -- 172.21.15.40:0/2478956408 learned_addr learned my addr 172.21.15.40:0/2478956408 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725ed9d700 1 --2- 172.21.15.40:0/2478956408 >> v2:172.21.15.27:3300/0 conn(0x7f72601543d0 0x7f72600c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905834859 0 0) 0x7f72600c6570 con 0x7f7260069410 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72480033f0 con 0x7f7260069410 2023-05-17T14:53:36.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56931357 0 0) 0x7f7260158790 con 0x7f72600c60f0 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72600c6570 con 0x7f72600c60f0 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725ed9d700 1 -- 172.21.15.40:0/2478956408 >> v1:172.21.15.40:6789/0 conn(0x7f7260069410 legacy=0x7f72600bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725ed9d700 1 -- 172.21.15.40:0/2478956408 >> v1:172.21.15.27:6789/0 conn(0x7f72600c60f0 legacy=0x7f7260068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725ed9d700 1 -- 172.21.15.40:0/2478956408 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260157e60 con 0x7f72601543d0 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725ed9d700 1 --2- 172.21.15.40:0/2478956408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72601543d0 0x7f72600c5c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7254009760 tx=0x7f7254009060).ready entity=mon.0 client_cookie=e047e5c69f60b712 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400d4a0 con 0x7f72601543d0 2023-05-17T14:53:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725400d600 con 0x7f72601543d0 2023-05-17T14:53:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.349+0000 7f725dd9b700 1 -- 172.21.15.40:0/2478956408 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400d980 con 0x7f72601543d0 2023-05-17T14:53:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 -- 172.21.15.40:0/2478956408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72601543d0 msgr2=0x7f72600c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 --2- 172.21.15.40:0/2478956408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72601543d0 0x7f72600c5c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7254009760 tx=0x7f7254009060).stop 2023-05-17T14:53:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 -- 172.21.15.40:0/2478956408 shutdown_connections 2023-05-17T14:53:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 --2- 172.21.15.40:0/2478956408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72601543d0 0x7f72600c5c00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 -- 172.21.15.40:0/2478956408 >> 172.21.15.40:0/2478956408 conn(0x7f72600cb7f0 msgr2=0x7f72600c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 -- 172.21.15.40:0/2478956408 shutdown_connections 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.350+0000 7f726523c700 1 -- 172.21.15.40:0/2478956408 wait complete. 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.351+0000 7f726523c700 1 Processor -- start 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.351+0000 7f726523c700 1 -- start start 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f726523c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 0x7f72600c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f726523c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600c60f0 0x7f72600b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f726523c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72601543d0 0x7f72600c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f726523c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c2790 con 0x7f72600c60f0 2023-05-17T14:53:36.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f726523c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c4b20 con 0x7f72601543d0 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f726523c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c1e60 con 0x7f7260069410 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 0x7f72600c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72601543d0 0x7f72600c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 0x7f72600c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39654/0 (socket says 172.21.15.40:39654) 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 -- 172.21.15.40:0/3343744820 learned_addr learned my addr 172.21.15.40:0/3343744820 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725e59c700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600c60f0 0x7f72600b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 -- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72601543d0 msgr2=0x7f72600c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72601543d0 0x7f72600c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 -- 172.21.15.40:0/3343744820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600c60f0 msgr2=0x7f72600b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600c60f0 0x7f72600b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.352+0000 7f725ed9d700 1 -- 172.21.15.40:0/3343744820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540092a0 con 0x7f7260069410 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f725f59e700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72601543d0 0x7f72600c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f725e59c700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600c60f0 0x7f72600b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f725ed9d700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 0x7f72600c4530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f7254009d50 tx=0x7f7254016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400dcf0 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725400de50 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725401d430 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72600c2140 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.353+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72600b0d80 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.354+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f725400f070 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.354+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f7254027460 con 0x7f7260069410 2023-05-17T14:53:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.354+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72600c2a70 con 0x7f7260069410 2023-05-17T14:53:36.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.356+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f7254016070 con 0x7f7260069410 2023-05-17T14:53:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.437+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1a17304-7ade-4f10-a09b-b13d0f180398", "id": 4} v 0) v1 -- 0x7f726006bdf0 con 0x7f7260069410 2023-05-17T14:53:36.449 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:36.445+0000 7fbf7149e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T14:53:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.447+0000 7f7246ffd700 1 -- 172.21.15.40:0/3343744820 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1a17304-7ade-4f10-a09b-b13d0f180398", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f725401dac0 con 0x7f7260069410 2023-05-17T14:53:36.451 INFO:teuthology.orchestra.run.smithi040.stdout:4 2023-05-17T14:53:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 msgr2=0x7f72600c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 0x7f72600c4530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f7254009d50 tx=0x7f7254016000).stop 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 shutdown_connections 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72601543d0 0x7f72600c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7260069410 0x7f72600c4530 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 --2- 172.21.15.40:0/3343744820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72600c60f0 0x7f72600b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 >> 172.21.15.40:0/3343744820 conn(0x7f72600cb7f0 msgr2=0x7f72600c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 shutdown_connections 2023-05-17T14:53:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.448+0000 7f726523c700 1 -- 172.21.15.40:0/3343744820 wait complete. 2023-05-17T14:53:36.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 0ab596f6-0383-48d5-a80a-a1bc8a2d1a98 5 2023-05-17T14:53:36.492 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:36.489+0000 7f41c886c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T14:53:36.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.574+0000 7fa25359e700 1 Processor -- start 2023-05-17T14:53:36.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.574+0000 7fa25359e700 1 -- start start 2023-05-17T14:53:36.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2540cac00 0x7fa2540cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540c60d0 con 0x7fa2541537e0 2023-05-17T14:53:36.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2541588b0 con 0x7fa2540cac00 2023-05-17T14:53:36.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa254157e00 con 0x7fa254157980 2023-05-17T14:53:36.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2540cac00 0x7fa2540cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa251d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa252d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa2541537e0 0x7fa254153c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54112/0 (socket says 172.21.15.40:54112) 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa252d9d700 1 -- 172.21.15.40:0/3223282039 learned_addr learned my addr 172.21.15.40:0/3223282039 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25259c700 1 -- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 msgr2=0x7fa2540c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25259c700 1 --2- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25259c700 1 -- 172.21.15.40:0/3223282039 >> v1:172.21.15.40:6789/0 conn(0x7fa2541537e0 legacy=0x7fa254153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25159a700 1 -- 172.21.15.40:0/3223282039 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562165786 0 0) 0x7fa2540c60d0 con 0x7fa2541537e0 2023-05-17T14:53:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25259c700 1 -- 172.21.15.40:0/3223282039 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254158010 con 0x7fa2540cac00 2023-05-17T14:53:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa251d9b700 1 --2- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.575+0000 7fa25259c700 1 --2- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2540cac00 0x7fa2540cafe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa23c009790 tx=0x7fa23c009060).ready entity=mon.1 client_cookie=b1e2b2286cb4fcdd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.576+0000 7fa25159a700 1 -- 172.21.15.40:0/3223282039 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00f510 con 0x7fa2540cac00 2023-05-17T14:53:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.576+0000 7fa25159a700 1 -- 172.21.15.40:0/3223282039 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00f670 con 0x7fa2540cac00 2023-05-17T14:53:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.576+0000 7fa25159a700 1 -- 172.21.15.40:0/3223282039 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00f9f0 con 0x7fa2540cac00 2023-05-17T14:53:36.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.576+0000 7fa25359e700 1 -- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2540cac00 msgr2=0x7fa2540cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.576+0000 7fa25359e700 1 --2- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2540cac00 0x7fa2540cafe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa23c009790 tx=0x7fa23c009060).stop 2023-05-17T14:53:36.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.577+0000 7fa25359e700 1 -- 172.21.15.40:0/3223282039 shutdown_connections 2023-05-17T14:53:36.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.577+0000 7fa25359e700 1 --2- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2540cac00 0x7fa2540cafe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.577+0000 7fa25359e700 1 --2- 172.21.15.40:0/3223282039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.577+0000 7fa25359e700 1 -- 172.21.15.40:0/3223282039 >> 172.21.15.40:0/3223282039 conn(0x7fa25405dd50 msgr2=0x7fa25405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.577+0000 7fa25359e700 1 -- 172.21.15.40:0/3223282039 shutdown_connections 2023-05-17T14:53:36.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.577+0000 7fa25359e700 1 -- 172.21.15.40:0/3223282039 wait complete. 2023-05-17T14:53:36.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.578+0000 7fa25359e700 1 Processor -- start 2023-05-17T14:53:36.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.579+0000 7fa25359e700 1 -- start start 2023-05-17T14:53:36.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2540cac00 0x7fa2541436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 0x7fa25414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa254150260 con 0x7fa2540cac00 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541643b0 con 0x7fa2541537e0 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa254164690 con 0x7fa254157980 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 0x7fa25414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 0x7fa25414fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52522/0 (socket says 172.21.15.40:52522) 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa252d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 -- 172.21.15.40:0/3252092336 learned_addr learned my addr 172.21.15.40:0/3252092336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25259c700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2540cac00 0x7fa2541436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 -- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 msgr2=0x7fa2540c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 -- 172.21.15.40:0/3252092336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2540cac00 msgr2=0x7fa2541436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2540cac00 0x7fa2541436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 -- 172.21.15.40:0/3252092336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440092a0 con 0x7fa2541537e0 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa25259c700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2540cac00 0x7fa2541436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa251d9b700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 0x7fa25414fd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa24400e980 tx=0x7fa244009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.580+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400ee70 con 0x7fa2541537e0 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.581+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244009560 con 0x7fa2541537e0 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.581+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400ca60 con 0x7fa2541537e0 2023-05-17T14:53:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.581+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c0092a0 con 0x7fa2541537e0 2023-05-17T14:53:36.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.581+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254164c50 con 0x7fa2541537e0 2023-05-17T14:53:36.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.581+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fa244022070 con 0x7fa2541537e0 2023-05-17T14:53:36.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.581+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fa24400ce10 con 0x7fa2541537e0 2023-05-17T14:53:36.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.582+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254167760 con 0x7fa2541537e0 2023-05-17T14:53:36.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.584+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa24403ae50 con 0x7fa2541537e0 2023-05-17T14:53:36.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.666+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0ab596f6-0383-48d5-a80a-a1bc8a2d1a98", "id": 5} v 0) v1 -- 0x7fa254047150 con 0x7fa2541537e0 2023-05-17T14:53:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.674+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3252092336 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ab596f6-0383-48d5-a80a-a1bc8a2d1a98", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa244029070 con 0x7fa2541537e0 2023-05-17T14:53:36.678 INFO:teuthology.orchestra.run.smithi040.stdout:5 2023-05-17T14:53:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 msgr2=0x7fa25414fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 0x7fa25414fd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa24400e980 tx=0x7fa244009060).stop 2023-05-17T14:53:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 shutdown_connections 2023-05-17T14:53:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa254157980 0x7fa2540c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2540cac00 0x7fa2541436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 --2- 172.21.15.40:0/3252092336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2541537e0 0x7fa25414fd70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 >> 172.21.15.40:0/3252092336 conn(0x7fa25405dd50 msgr2=0x7fa25414f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 shutdown_connections 2023-05-17T14:53:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.675+0000 7fa25359e700 1 -- 172.21.15.40:0/3252092336 wait complete. 2023-05-17T14:53:36.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 390d8e98-9315-42f1-9ab4-2cf8157d2b97 6 2023-05-17T14:53:36.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.841+0000 7f9baf64c700 1 Processor -- start 2023-05-17T14:53:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.842+0000 7f9baf64c700 1 -- start start 2023-05-17T14:53:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9baf64c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ba81543d0 0x7f9ba80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9baf64c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba8158790 con 0x7f9ba80c60f0 2023-05-17T14:53:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9baf64c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba80c6570 con 0x7f9ba8069410 2023-05-17T14:53:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9baf64c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba80c1c50 con 0x7f9ba81543d0 2023-05-17T14:53:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9bad3e8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ba81543d0 0x7f9ba80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9badbe9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9ba8069410 0x7f9ba80bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54124/0 (socket says 172.21.15.40:54124) 2023-05-17T14:53:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9badbe9700 1 -- 172.21.15.40:0/3804397527 learned_addr learned my addr 172.21.15.40:0/3804397527 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-17T14:53:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9bad3e8700 1 -- 172.21.15.40:0/3804397527 >> v1:172.21.15.40:6789/0 conn(0x7f9ba8069410 legacy=0x7f9ba80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9bad3e8700 1 -- 172.21.15.40:0/3804397527 >> v1:172.21.15.27:6789/0 conn(0x7f9ba80c60f0 legacy=0x7f9ba8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9b9bfff700 1 -- 172.21.15.40:0/3804397527 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244269282 0 0) 0x7f9ba80c6570 con 0x7f9ba8069410 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9bad3e8700 1 -- 172.21.15.40:0/3804397527 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8157e60 con 0x7f9ba81543d0 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9bad3e8700 1 --2- 172.21.15.40:0/3804397527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c5c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f9ba4009760 tx=0x7f9ba4009060).ready entity=mon.1 client_cookie=5825877a2f2e39ed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.843+0000 7f9b9bfff700 1 -- 172.21.15.40:0/3804397527 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400f510 con 0x7f9ba81543d0 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9b9bfff700 1 -- 172.21.15.40:0/3804397527 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400f670 con 0x7f9ba81543d0 2023-05-17T14:53:36.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9b9bfff700 1 -- 172.21.15.40:0/3804397527 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400f9f0 con 0x7f9ba81543d0 2023-05-17T14:53:36.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 -- 172.21.15.40:0/3804397527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 msgr2=0x7f9ba80c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 --2- 172.21.15.40:0/3804397527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c5c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f9ba4009760 tx=0x7f9ba4009060).stop 2023-05-17T14:53:36.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 -- 172.21.15.40:0/3804397527 shutdown_connections 2023-05-17T14:53:36.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 --2- 172.21.15.40:0/3804397527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c5c00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 -- 172.21.15.40:0/3804397527 >> 172.21.15.40:0/3804397527 conn(0x7f9ba80cb7f0 msgr2=0x7f9ba80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 -- 172.21.15.40:0/3804397527 shutdown_connections 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.844+0000 7f9baf64c700 1 -- 172.21.15.40:0/3804397527 wait complete. 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.845+0000 7f9baf64c700 1 Processor -- start 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.845+0000 7f9baf64c700 1 -- start start 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9baf64c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ba8069410 0x7f9ba80adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9baf64c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 0x7f9ba81683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9baf64c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9baf64c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba81688d0 con 0x7f9ba8069410 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9baf64c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8165030 con 0x7f9ba81543d0 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9baf64c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80c4be0 con 0x7f9ba80c60f0 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9bacbe7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 0x7f9ba81683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9badbe9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9bacbe7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 0x7f9ba81683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39678/0 (socket says 172.21.15.40:39678) 2023-05-17T14:53:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9badbe9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52536/0 (socket says 172.21.15.40:52536) 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9bacbe7700 1 -- 172.21.15.40:0/2270185432 learned_addr learned my addr 172.21.15.40:0/2270185432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.846+0000 7f9bad3e8700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ba8069410 0x7f9ba80adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9bacbe7700 1 -- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 msgr2=0x7f9ba80c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9bacbe7700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9bacbe7700 1 -- 172.21.15.40:0/2270185432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ba8069410 msgr2=0x7f9ba80adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9bacbe7700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ba8069410 0x7f9ba80adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9bacbe7700 1 -- 172.21.15.40:0/2270185432 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40092a0 con 0x7f9ba80c60f0 2023-05-17T14:53:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9bacbe7700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 0x7f9ba81683e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9b9c00c840 tx=0x7f9b9c007db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00f470 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c00f5d0 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba8164440 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00f950 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba81649e0 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f9b9c010070 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.847+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f9b9c0123f0 con 0x7f9ba80c60f0 2023-05-17T14:53:36.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.848+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba806bdf0 con 0x7f9ba80c60f0 2023-05-17T14:53:36.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.850+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9b9c020060 con 0x7f9ba80c60f0 2023-05-17T14:53:36.902 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:36.899+0000 7fbf7149e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T14:53:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.932+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "390d8e98-9315-42f1-9ab4-2cf8157d2b97", "id": 6} v 0) v1 -- 0x7f9ba8158140 con 0x7f9ba80c60f0 2023-05-17T14:53:36.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.940+0000 7f9b997fa700 1 -- 172.21.15.40:0/2270185432 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "390d8e98-9315-42f1-9ab4-2cf8157d2b97", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b9c01b500 con 0x7f9ba80c60f0 2023-05-17T14:53:36.944 INFO:teuthology.orchestra.run.smithi040.stdout:6 2023-05-17T14:53:36.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 msgr2=0x7f9ba81683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 0x7f9ba81683e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9b9c00c840 tx=0x7f9b9c007db0).stop 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 shutdown_connections 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba81543d0 0x7f9ba80c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ba8069410 0x7f9ba80adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 --2- 172.21.15.40:0/2270185432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ba80c60f0 0x7f9ba81683e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 >> 172.21.15.40:0/2270185432 conn(0x7f9ba80cb7f0 msgr2=0x7f9ba8155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 shutdown_connections 2023-05-17T14:53:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:36.941+0000 7f9baf64c700 1 -- 172.21.15.40:0/2270185432 wait complete. 2023-05-17T14:53:36.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 5eabc50d-2b84-4513-add1-55bd86a3b98e 7 2023-05-17T14:53:36.960 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:36.956+0000 7f41c886c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T14:53:37.008 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:37.005+0000 7fbf7149e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:53:37.069 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:37.066+0000 7f41c886c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:53:37.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.067+0000 7fd175732700 1 Processor -- start 2023-05-17T14:53:37.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.067+0000 7fd175732700 1 -- start start 2023-05-17T14:53:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd175732700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 0x7fd1700cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd175732700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 0x7fd1700c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd175732700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700c60d0 con 0x7fd1701537e0 2023-05-17T14:53:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd175732700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1701588b0 con 0x7fd1700cac00 2023-05-17T14:53:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd175732700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd170157e00 con 0x7fd170157980 2023-05-17T14:53:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 0x7fd1700c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 0x7fd1700cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 0x7fd1700c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39682/0 (socket says 172.21.15.40:39682) 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 0x7fd1700cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52538/0 (socket says 172.21.15.40:52538) 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 -- 172.21.15.40:0/3931785 learned_addr learned my addr 172.21.15.40:0/3931785 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 -- 172.21.15.40:0/3931785 >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 msgr2=0x7fd1700cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 --2- 172.21.15.40:0/3931785 >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 0x7fd1700cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 -- 172.21.15.40:0/3931785 >> v1:172.21.15.27:6789/0 conn(0x7fd1701537e0 legacy=0x7fd170153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16f7fe700 1 -- 172.21.15.40:0/3931785 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170158010 con 0x7fd170157980 2023-05-17T14:53:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.068+0000 7fd16ffff700 1 --2- 172.21.15.40:0/3931785 >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 0x7fd1700cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd16f7fe700 1 --2- 172.21.15.40:0/3931785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 0x7fd1700c5be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd160009830 tx=0x7fd1600090f0).ready entity=mon.2 client_cookie=905099b4f5f66ce5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd16effd700 1 -- 172.21.15.40:0/3931785 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000b580 con 0x7fd170157980 2023-05-17T14:53:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd16effd700 1 -- 172.21.15.40:0/3931785 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000b6e0 con 0x7fd170157980 2023-05-17T14:53:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd16effd700 1 -- 172.21.15.40:0/3931785 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ba60 con 0x7fd170157980 2023-05-17T14:53:37.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 -- 172.21.15.40:0/3931785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 msgr2=0x7fd1700c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 --2- 172.21.15.40:0/3931785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 0x7fd1700c5be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd160009830 tx=0x7fd1600090f0).stop 2023-05-17T14:53:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 -- 172.21.15.40:0/3931785 shutdown_connections 2023-05-17T14:53:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 --2- 172.21.15.40:0/3931785 >> v2:172.21.15.40:3300/0 conn(0x7fd1700cac00 0x7fd1700cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 --2- 172.21.15.40:0/3931785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd170157980 0x7fd1700c5be0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 -- 172.21.15.40:0/3931785 >> 172.21.15.40:0/3931785 conn(0x7fd17005dd50 msgr2=0x7fd17005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 -- 172.21.15.40:0/3931785 shutdown_connections 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.069+0000 7fd175732700 1 -- 172.21.15.40:0/3931785 wait complete. 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.070+0000 7fd175732700 1 Processor -- start 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 -- start start 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 0x7fd170168750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 0x7fd1700c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd170157980 0x7fd17014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd170168c40 con 0x7fd170157980 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700c32d0 con 0x7fd1700cac00 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd175732700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700c35b0 con 0x7fd1701537e0 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd16ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 0x7fd170168750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd16f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 0x7fd1700c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd16f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 0x7fd1700c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39688/0 (socket says 172.21.15.40:39688) 2023-05-17T14:53:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16f7fe700 1 -- 172.21.15.40:0/3650252708 learned_addr learned my addr 172.21.15.40:0/3650252708 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.071+0000 7fd16ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 0x7fd170168750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52542/0 (socket says 172.21.15.40:52542) 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd174f31700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd170157980 0x7fd17014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16ffff700 1 -- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 msgr2=0x7fd1700c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16ffff700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 0x7fd1700c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16ffff700 1 -- 172.21.15.40:0/3650252708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd170157980 msgr2=0x7fd17014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16ffff700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd170157980 0x7fd17014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16ffff700 1 -- 172.21.15.40:0/3650252708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640092a0 con 0x7fd1700cac00 2023-05-17T14:53:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16f7fe700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 0x7fd1700c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd16ffff700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 0x7fd170168750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd16400e980 tx=0x7fd164009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164012600 con 0x7fd1700cac00 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164012760 con 0x7fd1700cac00 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160009370 con 0x7fd1700cac00 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164012ae0 con 0x7fd1700cac00 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1700c3b70 con 0x7fd1700cac00 2023-05-17T14:53:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fd164022070 con 0x7fd1700cac00 2023-05-17T14:53:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.072+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fd16401b9d0 con 0x7fd1700cac00 2023-05-17T14:53:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.073+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1700c5150 con 0x7fd1700cac00 2023-05-17T14:53:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.075+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd16403ae50 con 0x7fd1700cac00 2023-05-17T14:53:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.158+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5eabc50d-2b84-4513-add1-55bd86a3b98e", "id": 7} v 0) v1 -- 0x7fd1701582f0 con 0x7fd1700cac00 2023-05-17T14:53:37.166 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:37.163+0000 7fbf7149e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T14:53:37.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.165+0000 7fd157fff700 1 -- 172.21.15.40:0/3650252708 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5eabc50d-2b84-4513-add1-55bd86a3b98e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd164029070 con 0x7fd1700cac00 2023-05-17T14:53:37.169 INFO:teuthology.orchestra.run.smithi040.stdout:7 2023-05-17T14:53:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 msgr2=0x7fd170168750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 0x7fd170168750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd16400e980 tx=0x7fd164009060).stop 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 shutdown_connections 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd170157980 0x7fd17014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1700cac00 0x7fd170168750 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 --2- 172.21.15.40:0/3650252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1701537e0 0x7fd1700c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 >> 172.21.15.40:0/3650252708 conn(0x7fd17005dd50 msgr2=0x7fd1700c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.166+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 shutdown_connections 2023-05-17T14:53:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:53:37.167+0000 7fd175732700 1 -- 172.21.15.40:0/3650252708 wait complete. 2023-05-17T14:53:37.182 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-17T14:53:37.183 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-17T14:53:37.185 INFO:tasks.ceph.osd.0:Started 2023-05-17T14:53:37.185 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-17T14:53:37.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-17T14:53:37.187 INFO:tasks.ceph.osd.1:Started 2023-05-17T14:53:37.187 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-17T14:53:37.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-17T14:53:37.190 INFO:tasks.ceph.osd.2:Started 2023-05-17T14:53:37.190 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-17T14:53:37.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-17T14:53:37.192 INFO:tasks.ceph.osd.3:Started 2023-05-17T14:53:37.192 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-17T14:53:37.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-17T14:53:37.224 INFO:tasks.ceph.osd.4:Started 2023-05-17T14:53:37.225 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-17T14:53:37.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-17T14:53:37.226 INFO:tasks.ceph.osd.5:Started 2023-05-17T14:53:37.227 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-17T14:53:37.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-17T14:53:37.229 INFO:tasks.ceph.osd.6:Started 2023-05-17T14:53:37.229 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-17T14:53:37.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-17T14:53:37.231 INFO:tasks.ceph.osd.7:Started 2023-05-17T14:53:37.232 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:37.232 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:37.228+0000 7f41c886c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T14:53:37.264 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:37.260+0000 7fbf7149e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T14:53:37.347 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:37.343+0000 7f41c886c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T14:53:37.350 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:37.346+0000 7fbf7149e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T14:53:37.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.365+0000 7facc89fb700 1 Processor -- start 2023-05-17T14:53:37.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.365+0000 7facc89fb700 1 -- start start 2023-05-17T14:53:37.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.366+0000 7facc89fb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7facc4151ca0 0x7facc4152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.366+0000 7facc89fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc40c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.366+0000 7facc89fb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7facc4065350 0x7facc4065800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.366+0000 7facc89fb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc4065cf0 con 0x7facc4065350 2023-05-17T14:53:37.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.366+0000 7facc89fb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc40c4430 con 0x7facc4151ca0 2023-05-17T14:53:37.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.366+0000 7facc89fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc40c3e70 con 0x7facc40663a0 2023-05-17T14:53:37.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7facc4065350 0x7facc4065800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7facc4065350 0x7facc4065800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33218/0 (socket says 172.21.15.27:33218) 2023-05-17T14:53:37.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 -- 172.21.15.27:0/1275921039 learned_addr learned my addr 172.21.15.27:0/1275921039 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:37.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc1d9b700 1 --2- 172.21.15.27:0/1275921039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc40c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc259c700 1 --2- 172.21.15.27:0/1275921039 >> v2:172.21.15.40:3300/0 conn(0x7facc4151ca0 0x7facc4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 -- 172.21.15.27:0/1275921039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 msgr2=0x7facc40c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 --2- 172.21.15.27:0/1275921039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc40c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 -- 172.21.15.27:0/1275921039 >> v2:172.21.15.40:3300/0 conn(0x7facc4151ca0 msgr2=0x7facc4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 --2- 172.21.15.27:0/1275921039 >> v2:172.21.15.40:3300/0 conn(0x7facc4151ca0 0x7facc4152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 -- 172.21.15.27:0/1275921039 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40c4150 con 0x7facc4065350 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc2d9d700 1 --2- 172.21.15.27:0/1275921039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc4065800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7facc40c8950 tx=0x7facbc009840).ready entity=mon.0 client_cookie=5345e2a6d530554a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc159a700 1 -- 172.21.15.27:0/1275921039 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00e070 con 0x7facc4065350 2023-05-17T14:53:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc159a700 1 -- 172.21.15.27:0/1275921039 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc00b970 con 0x7facc4065350 2023-05-17T14:53:37.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.367+0000 7facc159a700 1 -- 172.21.15.27:0/1275921039 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00bcf0 con 0x7facc4065350 2023-05-17T14:53:37.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 -- 172.21.15.27:0/1275921039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 msgr2=0x7facc4065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 --2- 172.21.15.27:0/1275921039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc4065800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7facc40c8950 tx=0x7facbc009840).stop 2023-05-17T14:53:37.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 -- 172.21.15.27:0/1275921039 shutdown_connections 2023-05-17T14:53:37.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 --2- 172.21.15.27:0/1275921039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc4065800 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 --2- 172.21.15.27:0/1275921039 >> v2:172.21.15.40:3300/0 conn(0x7facc4151ca0 0x7facc4152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 --2- 172.21.15.27:0/1275921039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc40c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 -- 172.21.15.27:0/1275921039 >> 172.21.15.27:0/1275921039 conn(0x7facc40c94d0 msgr2=0x7facc40c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:37.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 -- 172.21.15.27:0/1275921039 shutdown_connections 2023-05-17T14:53:37.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.368+0000 7facc89fb700 1 -- 172.21.15.27:0/1275921039 wait complete. 2023-05-17T14:53:37.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.369+0000 7facc89fb700 1 Processor -- start 2023-05-17T14:53:37.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.369+0000 7facc89fb700 1 -- start start 2023-05-17T14:53:37.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.369+0000 7facc89fb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc40ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.369+0000 7facc89fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc4148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.369+0000 7facc89fb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc4151ca0 0x7facc40ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc89fb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40c2370 con 0x7facc4065350 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc89fb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40abee0 con 0x7facc4151ca0 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc89fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc4148810 con 0x7facc40663a0 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc40ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc40ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33220/0 (socket says 172.21.15.27:33220) 2023-05-17T14:53:37.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 -- 172.21.15.27:0/4227469012 learned_addr learned my addr 172.21.15.27:0/4227469012 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc2d9d700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc4151ca0 0x7facc40ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc1d9b700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc4148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 -- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 msgr2=0x7facc4148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc4148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 -- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc4151ca0 msgr2=0x7facc40ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc4151ca0 0x7facc40ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 -- 172.21.15.27:0/4227469012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc009ae0 con 0x7facc4065350 2023-05-17T14:53:37.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc259c700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc40ab9f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7facb400e930 tx=0x7facb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4012600 con 0x7facc4065350 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4012760 con 0x7facc4065350 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc40c1480 con 0x7facc4065350 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4012ae0 con 0x7facc4065350 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc40c1a40 con 0x7facc4065350 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7facb4022070 con 0x7facc4065350 2023-05-17T14:53:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.370+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7facb400cae0 con 0x7facc4065350 2023-05-17T14:53:37.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.371+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc406bdf0 con 0x7facc4065350 2023-05-17T14:53:37.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.373+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7facb4016020 con 0x7facc4065350 2023-05-17T14:53:37.420 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:37.416+0000 7f41c886c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T14:53:37.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.441+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facc40bdad0 con 0x7facc4065350 2023-05-17T14:53:37.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.442+0000 7facb27fc700 1 -- 172.21.15.27:0/4227469012 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7facb402a090 con 0x7facc4065350 2023-05-17T14:53:37.446 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:37.446 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:37.159842+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:37.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 msgr2=0x7facc40ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:37.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc40ab9f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7facb400e930 tx=0x7facb4009060).stop 2023-05-17T14:53:37.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 shutdown_connections 2023-05-17T14:53:37.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc4151ca0 0x7facc40ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc4065350 0x7facc40ab9f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 --2- 172.21.15.27:0/4227469012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facc40663a0 0x7facc4148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:37.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 >> 172.21.15.27:0/4227469012 conn(0x7facc40c94d0 msgr2=0x7facc40aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:37.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 shutdown_connections 2023-05-17T14:53:37.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:37.443+0000 7facc89fb700 1 -- 172.21.15.27:0/4227469012 wait complete. 2023-05-17T14:53:37.461 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-17T14:53:37.461 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-17T14:53:37.628 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:37.624+0000 7fbf7149e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T14:53:37.696 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:37.693+0000 7f41c886c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T14:53:37.790 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-05-17T14:53:37.786+0000 7f5161c4f200 -1 Falling back to public interface 2023-05-17T14:53:37.798 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-05-17T14:53:37.794+0000 7fa12fb03200 -1 Falling back to public interface 2023-05-17T14:53:37.803 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-05-17T14:53:37.799+0000 7f4c73203200 -1 Falling back to public interface 2023-05-17T14:53:37.821 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-05-17T14:53:37.817+0000 7fae586bf200 -1 Falling back to public interface 2023-05-17T14:53:37.830 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-05-17T14:53:37.826+0000 7f80ba7a9200 -1 Falling back to public interface 2023-05-17T14:53:37.833 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:37.829+0000 7fbf7149e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T14:53:37.834 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-05-17T14:53:37.830+0000 7f880364f200 -1 Falling back to public interface 2023-05-17T14:53:37.841 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-05-17T14:53:37.837+0000 7f10f7d66200 -1 Falling back to public interface 2023-05-17T14:53:37.850 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-05-17T14:53:37.847+0000 7fd494a07200 -1 Falling back to public interface 2023-05-17T14:53:37.901 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:37.898+0000 7f41c886c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T14:53:38.266 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:38.375 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.371+0000 7f3fe52e5700 1 Processor -- start 2023-05-17T14:53:38.375 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.371+0000 7f3fe52e5700 1 -- start start 2023-05-17T14:53:38.377 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fe52e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fe00c13f0 0x7f3fe0154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:38.377 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fe52e5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3fe00a9a30 0x7f3fe00a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:38.377 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fe52e5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe00c7580 con 0x7f3fe01579f0 2023-05-17T14:53:38.377 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fe52e5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00c8b30 con 0x7f3fe00a9a30 2023-05-17T14:53:38.377 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fe52e5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0155350 con 0x7f3fe00c13f0 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fdf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3fe00a9a30 0x7f3fe00a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fdf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3fe00a9a30 0x7f3fe00a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33230/0 (socket says 172.21.15.27:33230) 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fdf7fe700 1 -- 172.21.15.27:0/1932436018 learned_addr learned my addr 172.21.15.27:0/1932436018 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.372+0000 7f3fde7fc700 1 --2- 172.21.15.27:0/1932436018 >> v2:172.21.15.40:3300/0 conn(0x7f3fe00c13f0 0x7f3fe0154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fdf7fe700 1 -- 172.21.15.27:0/1932436018 >> v2:172.21.15.40:3300/0 conn(0x7f3fe00c13f0 msgr2=0x7f3fe0154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fdf7fe700 1 --2- 172.21.15.27:0/1932436018 >> v2:172.21.15.40:3300/0 conn(0x7f3fe00c13f0 0x7f3fe0154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.378 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fddffb700 1 -- 172.21.15.27:0/1932436018 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817738108 0 0) 0x7f3fe00c7580 con 0x7f3fe01579f0 2023-05-17T14:53:38.379 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fdf7fe700 1 -- 172.21.15.27:0/1932436018 >> v1:172.21.15.40:6789/0 conn(0x7f3fe01579f0 legacy=0x7f3fe0157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:38.379 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fdf7fe700 1 -- 172.21.15.27:0/1932436018 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00c1920 con 0x7f3fe00a9a30 2023-05-17T14:53:38.379 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fdf7fe700 1 --2- 172.21.15.27:0/1932436018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe00a9a30 0x7f3fe00a9ec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3fd8009f20 tx=0x7f3fd8009840).ready entity=mon.0 client_cookie=933a60b7ee607fc0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:38.379 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fddffb700 1 -- 172.21.15.27:0/1932436018 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800e070 con 0x7f3fe00a9a30 2023-05-17T14:53:38.379 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fddffb700 1 -- 172.21.15.27:0/1932436018 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800b990 con 0x7f3fe00a9a30 2023-05-17T14:53:38.379 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fddffb700 1 -- 172.21.15.27:0/1932436018 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800bd10 con 0x7f3fe00a9a30 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.373+0000 7f3fe52e5700 1 -- 172.21.15.27:0/1932436018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe00a9a30 msgr2=0x7f3fe00a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/1932436018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe00a9a30 0x7f3fe00a9ec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3fd8009f20 tx=0x7f3fd8009840).stop 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 -- 172.21.15.27:0/1932436018 shutdown_connections 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/1932436018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe00a9a30 0x7f3fe00a9ec0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/1932436018 >> v2:172.21.15.40:3300/0 conn(0x7f3fe00c13f0 0x7f3fe0154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 -- 172.21.15.27:0/1932436018 >> 172.21.15.27:0/1932436018 conn(0x7f3fe006a450 msgr2=0x7f3fe0081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:38.382 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 -- 172.21.15.27:0/1932436018 shutdown_connections 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.374+0000 7f3fe52e5700 1 -- 172.21.15.27:0/1932436018 wait complete. 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.375+0000 7f3fe52e5700 1 Processor -- start 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.375+0000 7f3fe52e5700 1 -- start start 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fe52e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe00a9a30 0x7f3fe00ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fe52e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe00c13f0 0x7f3fe0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fe52e5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 0x7f3fe0146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:38.383 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fe52e5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe014ef20 con 0x7f3fe01579f0 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fe52e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0156940 con 0x7f3fe00c13f0 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fe52e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe014eb80 con 0x7f3fe00a9a30 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fdf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 0x7f3fe0146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe00c13f0 0x7f3fe0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fdf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 0x7f3fe0146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33236/0 (socket says 172.21.15.27:33236) 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fdf7fe700 1 -- 172.21.15.27:0/3105527242 learned_addr learned my addr 172.21.15.27:0/3105527242 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fdeffd700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe00a9a30 0x7f3fe00ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:38.384 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 -- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe00a9a30 msgr2=0x7f3fe00ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe00a9a30 0x7f3fe00ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 -- 172.21.15.27:0/3105527242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 msgr2=0x7f3fe0146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 0x7f3fe0146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 -- 172.21.15.27:0/3105527242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8009ae0 con 0x7f3fe00c13f0 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fdf7fe700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 0x7f3fe0146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fdeffd700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe00a9a30 0x7f3fe00ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:38.385 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fde7fc700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe00c13f0 0x7f3fe0155ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3fc800e900 tx=0x7f3fc8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.376+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8009450 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc8012600 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe0156380 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8012980 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe0156090 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f3fc8022070 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f3fc801b400 con 0x7f3fe00c13f0 2023-05-17T14:53:38.386 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.377+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe014f060 con 0x7f3fe00c13f0 2023-05-17T14:53:38.387 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.380+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3fe014f060 con 0x7f3fe00c13f0 2023-05-17T14:53:38.452 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.448+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fe0064240 con 0x7f3fe00c13f0 2023-05-17T14:53:38.452 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.449+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/3105527242 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f3fc8016020 con 0x7f3fe00c13f0 2023-05-17T14:53:38.453 INFO:teuthology.misc.health.smithi027.stdout: 2023-05-17T14:53:38.453 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":10,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:37.159842+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:38.454 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe00c13f0 msgr2=0x7f3fe0155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:38.454 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe00c13f0 0x7f3fe0155ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3fc800e900 tx=0x7f3fc8009060).stop 2023-05-17T14:53:38.454 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 shutdown_connections 2023-05-17T14:53:38.454 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fe01579f0 0x7f3fe0146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.454 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe00a9a30 0x7f3fe00ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.455 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 --2- 172.21.15.27:0/3105527242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe00c13f0 0x7f3fe0155ba0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:38.455 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 >> 172.21.15.27:0/3105527242 conn(0x7f3fe006a450 msgr2=0x7f3fe00aadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:38.455 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 shutdown_connections 2023-05-17T14:53:38.455 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:38.450+0000 7f3fe52e5700 1 -- 172.21.15.27:0/3105527242 wait complete. 2023-05-17T14:53:38.464 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-17T14:53:38.526 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:38.522+0000 7fbf7149e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T14:53:38.597 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:38.593+0000 7fbf7149e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T14:53:38.598 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:38.593+0000 7f41c886c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T14:53:38.668 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:38.665+0000 7f41c886c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T14:53:38.678 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:38.674+0000 7fbf7149e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T14:53:38.750 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:38.747+0000 7f41c886c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T14:53:38.831 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:38.827+0000 7fbf7149e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T14:53:38.904 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:38.900+0000 7fbf7149e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T14:53:38.904 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:38.900+0000 7f41c886c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T14:53:38.978 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:38.974+0000 7f41c886c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T14:53:39.024 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:39.021+0000 7fbf7149e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T14:53:39.100 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:39.096+0000 7f41c886c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T14:53:39.137 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:39.133+0000 7fbf7149e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:53:39.212 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:39.208+0000 7f41c886c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:53:39.468 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:39.464+0000 7fbf7149e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T14:53:39.542 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:39.538+0000 7fbf7149e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T14:53:39.546 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:39.543+0000 7f41c886c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T14:53:39.621 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:53:39.618+0000 7f41c886c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T14:53:40.569 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:40.565+0000 7fbf276ea700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-17T14:53:40.570 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:53:40.566+0000 7fbf276ea700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-17T14:53:41.257 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-05-17T14:53:41.253+0000 7f5161c4f200 -1 osd.2 0 log_to_monitors {default=true} 2023-05-17T14:53:41.307 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-05-17T14:53:41.303+0000 7f4c73203200 -1 osd.0 0 log_to_monitors {default=true} 2023-05-17T14:53:41.314 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-05-17T14:53:41.310+0000 7fa12fb03200 -1 osd.1 0 log_to_monitors {default=true} 2023-05-17T14:53:41.318 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-05-17T14:53:41.315+0000 7fae586bf200 -1 osd.4 0 log_to_monitors {default=true} 2023-05-17T14:53:41.338 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-05-17T14:53:41.335+0000 7f10f7d66200 -1 osd.3 0 log_to_monitors {default=true} 2023-05-17T14:53:41.371 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-05-17T14:53:41.367+0000 7f80ba7a9200 -1 osd.5 0 log_to_monitors {default=true} 2023-05-17T14:53:41.375 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-05-17T14:53:41.372+0000 7f880364f200 -1 osd.6 0 log_to_monitors {default=true} 2023-05-17T14:53:41.377 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-05-17T14:53:41.373+0000 7fd494a07200 -1 osd.7 0 log_to_monitors {default=true} 2023-05-17T14:53:42.573 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-05-17T14:53:42.569+0000 7f80b1167700 -1 osd.5 0 waiting for initial osdmap 2023-05-17T14:53:42.573 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-05-17T14:53:42.569+0000 7fd48b3c5700 -1 osd.7 0 waiting for initial osdmap 2023-05-17T14:53:42.574 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-05-17T14:53:42.570+0000 7f515860d700 -1 osd.2 0 waiting for initial osdmap 2023-05-17T14:53:42.575 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-05-17T14:53:42.571+0000 7f4c69bc1700 -1 osd.0 0 waiting for initial osdmap 2023-05-17T14:53:42.576 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-05-17T14:53:42.571+0000 7fa1264c1700 -1 osd.1 0 waiting for initial osdmap 2023-05-17T14:53:42.577 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-05-17T14:53:42.572+0000 7f10ee724700 -1 osd.3 0 waiting for initial osdmap 2023-05-17T14:53:42.578 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-05-17T14:53:42.571+0000 7f87fa00d700 -1 osd.6 0 waiting for initial osdmap 2023-05-17T14:53:42.579 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-05-17T14:53:42.575+0000 7fae4f07d700 -1 osd.4 0 waiting for initial osdmap 2023-05-17T14:53:42.580 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-05-17T14:53:42.576+0000 7fd487b42700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.581 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-05-17T14:53:42.577+0000 7f80ad8e4700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.584 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-05-17T14:53:42.580+0000 7fae4b7fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.585 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-05-17T14:53:42.582+0000 7f87f678a700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.587 INFO:tasks.ceph.osd.0.smithi027.stderr:2023-05-17T14:53:42.583+0000 7f4c6633e700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.587 INFO:tasks.ceph.osd.1.smithi027.stderr:2023-05-17T14:53:42.583+0000 7fa122c3e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.588 INFO:tasks.ceph.osd.3.smithi027.stderr:2023-05-17T14:53:42.584+0000 7f10eaea1700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:42.588 INFO:tasks.ceph.osd.2.smithi027.stderr:2023-05-17T14:53:42.584+0000 7f5154d8a700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T14:53:45.269 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:45.390 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.386+0000 7fbaa9969700 1 Processor -- start 2023-05-17T14:53:45.390 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.386+0000 7fbaa9969700 1 -- start start 2023-05-17T14:53:45.392 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa9969700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbaa40c7600 0x7fbaa40644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa9969700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbaa40c1400 0x7fbaa40c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa9969700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40c1880 con 0x7fbaa40c0a70 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa9969700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40649d0 con 0x7fbaa40c1400 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa9969700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40bfcb0 con 0x7fbaa40c7600 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbaa40c1400 0x7fbaa40c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbaa40c1400 0x7fbaa40c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33426/0 (socket says 172.21.15.27:33426) 2023-05-17T14:53:45.393 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbaa40c0a70 0x7fbaa40c51d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:32988/0 (socket says 172.21.15.27:32988) 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa27fc700 1 -- 172.21.15.27:0/3050149039 learned_addr learned my addr 172.21.15.27:0/3050149039 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.387+0000 7fbaa2ffd700 1 --2- 172.21.15.27:0/3050149039 >> v2:172.21.15.40:3300/0 conn(0x7fbaa40c7600 0x7fbaa40644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa27fc700 1 -- 172.21.15.27:0/3050149039 >> v2:172.21.15.40:3300/0 conn(0x7fbaa40c7600 msgr2=0x7fbaa40644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa27fc700 1 --2- 172.21.15.27:0/3050149039 >> v2:172.21.15.40:3300/0 conn(0x7fbaa40c7600 0x7fbaa40644e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa27fc700 1 -- 172.21.15.27:0/3050149039 >> v1:172.21.15.27:6789/0 conn(0x7fbaa40c0a70 legacy=0x7fbaa40c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa27fc700 1 -- 172.21.15.27:0/3050149039 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40bff90 con 0x7fbaa40c1400 2023-05-17T14:53:45.394 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa1ffb700 1 -- 172.21.15.27:0/3050149039 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629632593 0 0) 0x7fbaa40c1880 con 0x7fbaa40c0a70 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa27fc700 1 --2- 172.21.15.27:0/3050149039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa40c79e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbaa4062380 tx=0x7fba8c0090f0).ready entity=mon.0 client_cookie=1fd2a651fe17c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa1ffb700 1 -- 172.21.15.27:0/3050149039 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00b520 con 0x7fbaa40c1400 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa1ffb700 1 -- 172.21.15.27:0/3050149039 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00b680 con 0x7fbaa40c1400 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa1ffb700 1 -- 172.21.15.27:0/3050149039 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00ba00 con 0x7fbaa40c1400 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa9969700 1 -- 172.21.15.27:0/3050149039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 msgr2=0x7fbaa40c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa9969700 1 --2- 172.21.15.27:0/3050149039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa40c79e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbaa4062380 tx=0x7fba8c0090f0).stop 2023-05-17T14:53:45.395 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa9969700 1 -- 172.21.15.27:0/3050149039 shutdown_connections 2023-05-17T14:53:45.396 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa9969700 1 --2- 172.21.15.27:0/3050149039 >> v2:172.21.15.40:3300/0 conn(0x7fbaa40c7600 0x7fbaa40644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.396 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa9969700 1 --2- 172.21.15.27:0/3050149039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa40c79e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.396 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.388+0000 7fbaa9969700 1 -- 172.21.15.27:0/3050149039 >> 172.21.15.27:0/3050149039 conn(0x7fbaa4081fd0 msgr2=0x7fbaa40823b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:45.396 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.389+0000 7fbaa9969700 1 -- 172.21.15.27:0/3050149039 shutdown_connections 2023-05-17T14:53:45.396 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.389+0000 7fbaa9969700 1 -- 172.21.15.27:0/3050149039 wait complete. 2023-05-17T14:53:45.398 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.390+0000 7fbaa9969700 1 Processor -- start 2023-05-17T14:53:45.398 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.390+0000 7fbaa9969700 1 -- start start 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaa40c0a70 0x7fbaa4164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa4154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaa40c7600 0x7fbaa41636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4156090 con 0x7fbaa40c1400 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4155480 con 0x7fbaa40c0a70 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4155760 con 0x7fbaa40c7600 2023-05-17T14:53:45.399 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa4154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa4154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33432/0 (socket says 172.21.15.27:33432) 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 -- 172.21.15.27:0/96223216 learned_addr learned my addr 172.21.15.27:0/96223216 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa2ffd700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaa40c0a70 0x7fbaa4164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa37fe700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaa40c7600 0x7fbaa41636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 -- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaa40c7600 msgr2=0x7fbaa41636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaa40c7600 0x7fbaa41636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.400 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 -- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaa40c0a70 msgr2=0x7fbaa4164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaa40c0a70 0x7fbaa4164a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 -- 172.21.15.27:0/96223216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c009370 con 0x7fbaa40c1400 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa27fc700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa4154c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fba8c009130 tx=0x7fba8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c000bc0 con 0x7fbaa40c1400 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00b7f0 con 0x7fbaa40c1400 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4155a40 con 0x7fbaa40c1400 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c000d20 con 0x7fbaa40c1400 2023-05-17T14:53:45.401 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.391+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa4155160 con 0x7fbaa40c1400 2023-05-17T14:53:45.402 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.392+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa4083370 con 0x7fbaa40c1400 2023-05-17T14:53:45.402 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.393+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fba8c02c070 con 0x7fbaa40c1400 2023-05-17T14:53:45.402 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.393+0000 7fba9affd700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba8405ed90 0x7fba84061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.402 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.393+0000 7fbaa2ffd700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba8405ed90 0x7fba84061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.402 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.393+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7fba8c07b260 con 0x7fbaa40c1400 2023-05-17T14:53:45.402 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.394+0000 7fbaa2ffd700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba8405ed90 0x7fba84061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fbaa40aa090 tx=0x7fba9c009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:45.403 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.398+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba8c04ccd0 con 0x7fbaa40c1400 2023-05-17T14:53:45.579 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.575+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa41561d0 con 0x7fbaa40c1400 2023-05-17T14:53:45.580 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.576+0000 7fba9affd700 1 -- 172.21.15.27:0/96223216 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12180 (secure 0 0 0) 0x7fba8c02a020 con 0x7fbaa40c1400 2023-05-17T14:53:45.580 INFO:teuthology.misc.health.smithi027.stdout: 2023-05-17T14:53:45.580 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":14,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:44.587209+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:45.582 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba8405ed90 msgr2=0x7fba84061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.582 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba8405ed90 0x7fba84061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fbaa40aa090 tx=0x7fba9c009060).stop 2023-05-17T14:53:45.582 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 msgr2=0x7fbaa4154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.582 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa4154c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fba8c009130 tx=0x7fba8c017000).stop 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 shutdown_connections 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba8405ed90 0x7fba84061250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaa40c7600 0x7fbaa41636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaa40c0a70 0x7fbaa4164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 --2- 172.21.15.27:0/96223216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbaa40c1400 0x7fbaa4154c70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 >> 172.21.15.27:0/96223216 conn(0x7fbaa4081fd0 msgr2=0x7fbaa40afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:45.583 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 shutdown_connections 2023-05-17T14:53:45.584 INFO:teuthology.misc.health.smithi027.stderr:2023-05-17T14:53:45.578+0000 7fbaa9969700 1 -- 172.21.15.27:0/96223216 wait complete. 2023-05-17T14:53:45.593 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-17T14:53:45.593 INFO:tasks.ceph:Creating RBD pool 2023-05-17T14:53:45.593 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-17T14:53:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.705+0000 7feaf5421700 1 Processor -- start 2023-05-17T14:53:45.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.705+0000 7feaf5421700 1 -- start start 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaf5421700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf01543d0 0x7feaf00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaf5421700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feaf00c60f0 0x7feaf0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaf5421700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00c0c90 con 0x7feaf00691f0 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaf5421700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00c1c50 con 0x7feaf00c60f0 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaf5421700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0158790 con 0x7feaf01543d0 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaee7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feaf00c60f0 0x7feaf0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaee7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feaf00c60f0 0x7feaf0068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33440/0 (socket says 172.21.15.27:33440) 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaee7fc700 1 -- 172.21.15.27:0/3994239086 learned_addr learned my addr 172.21.15.27:0/3994239086 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaeeffd700 1 --2- 172.21.15.27:0/3994239086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf01543d0 0x7feaf00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaee7fc700 1 -- 172.21.15.27:0/3994239086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf01543d0 msgr2=0x7feaf00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaee7fc700 1 --2- 172.21.15.27:0/3994239086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf01543d0 0x7feaf00c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.706+0000 7feaee7fc700 1 -- 172.21.15.27:0/3994239086 >> v1:172.21.15.40:6789/0 conn(0x7feaf00691f0 legacy=0x7feaf01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaee7fc700 1 -- 172.21.15.27:0/3994239086 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00c6570 con 0x7feaf00c60f0 2023-05-17T14:53:45.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaee7fc700 1 --2- 172.21.15.27:0/3994239086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf00c60f0 0x7feaf0068d00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fead8006fd0 tx=0x7fead80090f0).ready entity=mon.0 client_cookie=a69d09e405774000 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:45.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaedffb700 1 -- 172.21.15.27:0/3994239086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800b600 con 0x7feaf00c60f0 2023-05-17T14:53:45.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaedffb700 1 -- 172.21.15.27:0/3994239086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead800b760 con 0x7feaf00c60f0 2023-05-17T14:53:45.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaedffb700 1 -- 172.21.15.27:0/3994239086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800bae0 con 0x7feaf00c60f0 2023-05-17T14:53:45.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 -- 172.21.15.27:0/3994239086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf00c60f0 msgr2=0x7feaf0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 --2- 172.21.15.27:0/3994239086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf00c60f0 0x7feaf0068d00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fead8006fd0 tx=0x7fead80090f0).stop 2023-05-17T14:53:45.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 -- 172.21.15.27:0/3994239086 shutdown_connections 2023-05-17T14:53:45.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 --2- 172.21.15.27:0/3994239086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf01543d0 0x7feaf00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 --2- 172.21.15.27:0/3994239086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf00c60f0 0x7feaf0068d00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 -- 172.21.15.27:0/3994239086 >> 172.21.15.27:0/3994239086 conn(0x7feaf00cb7f0 msgr2=0x7feaf00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 -- 172.21.15.27:0/3994239086 shutdown_connections 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.707+0000 7feaf5421700 1 -- 172.21.15.27:0/3994239086 wait complete. 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 Processor -- start 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 -- start start 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf00691f0 0x7feaf00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf00c60f0 0x7feaf00a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 0x7feaf0142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00af210 con 0x7feaf01543d0 2023-05-17T14:53:45.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00ae600 con 0x7feaf00691f0 2023-05-17T14:53:45.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaf5421700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00ae8e0 con 0x7feaf00c60f0 2023-05-17T14:53:45.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaef7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 0x7feaf0142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaef7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 0x7feaf0142640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33446/0 (socket says 172.21.15.27:33446) 2023-05-17T14:53:45.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.709+0000 7feaef7fe700 1 -- 172.21.15.27:0/3030829318 learned_addr learned my addr 172.21.15.27:0/3030829318 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaee7fc700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf00c60f0 0x7feaf00a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaeeffd700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf00691f0 0x7feaf00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaef7fe700 1 -- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf00c60f0 msgr2=0x7feaf00a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaef7fe700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf00c60f0 0x7feaf00a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaef7fe700 1 -- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf00691f0 msgr2=0x7feaf00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaef7fe700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf00691f0 0x7feaf00adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaef7fe700 1 -- 172.21.15.27:0/3030829318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009370 con 0x7feaf01543d0 2023-05-17T14:53:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaef7fe700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 0x7feaf0142640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7feae0002230 tx=0x7feae00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0010510 con 0x7feaf01543d0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae0010670 con 0x7feaf01543d0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf00aebc0 con 0x7feaf01543d0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00109f0 con 0x7feaf01543d0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.710+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf00ae1c0 con 0x7feaf01543d0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.711+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf006bdf0 con 0x7feaf01543d0 2023-05-17T14:53:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.711+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feae0010070 con 0x7feaf01543d0 2023-05-17T14:53:45.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.712+0000 7feae6ffd700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fead005ed90 0x7fead0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:45.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.712+0000 7feaeeffd700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fead005ed90 0x7fead0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:45.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.712+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7feae0079420 con 0x7feaf01543d0 2023-05-17T14:53:45.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.712+0000 7feaeeffd700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fead005ed90 0x7fead0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7feae8006fd0 tx=0x7feae8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:45.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.716+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feae004ae70 con 0x7feaf01543d0 2023-05-17T14:53:45.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:45.889+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7feaf0157e60 con 0x7feaf01543d0 2023-05-17T14:53:46.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.602+0000 7feae6ffd700 1 -- 172.21.15.27:0/3030829318 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7feae004e490 con 0x7feaf01543d0 2023-05-17T14:53:46.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fead005ed90 msgr2=0x7fead0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fead005ed90 0x7fead0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7feae8006fd0 tx=0x7feae8008040).stop 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 msgr2=0x7feaf0142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 0x7feaf0142640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7feae0002230 tx=0x7feae00015e0).stop 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 shutdown_connections 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fead005ed90 0x7fead0061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaf01543d0 0x7feaf0142640 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf00691f0 0x7feaf00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 --2- 172.21.15.27:0/3030829318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf00c60f0 0x7feaf00a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.605+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 >> 172.21.15.27:0/3030829318 conn(0x7feaf00cb7f0 msgr2=0x7feaf00c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:46.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.606+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 shutdown_connections 2023-05-17T14:53:46.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.606+0000 7feaf5421700 1 -- 172.21.15.27:0/3030829318 wait complete. 2023-05-17T14:53:46.611 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'rbd' created 2023-05-17T14:53:46.624 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-17T14:53:46.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.743+0000 7fb94ef39700 1 Processor -- start 2023-05-17T14:53:46.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.743+0000 7fb94ef39700 1 -- start start 2023-05-17T14:53:46.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb94ef39700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb948152070 0x7fb948154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb94ef39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9480c0520 0x7fb948081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb94ef39700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb948158010 con 0x7fb948151c90 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb94ef39700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb948154f60 con 0x7fb948152070 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb94ef39700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb948155240 con 0x7fb9480c0520 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb948152070 0x7fb948154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb948152070 0x7fb948154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33456/0 (socket says 172.21.15.27:33456) 2023-05-17T14:53:46.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 -- 172.21.15.27:0/3585417285 learned_addr learned my addr 172.21.15.27:0/3585417285 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb94d4d6700 1 --2- 172.21.15.27:0/3585417285 >> v2:172.21.15.40:3300/0 conn(0x7fb9480c0520 0x7fb948081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 -- 172.21.15.27:0/3585417285 >> v2:172.21.15.40:3300/0 conn(0x7fb9480c0520 msgr2=0x7fb948081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 --2- 172.21.15.27:0/3585417285 >> v2:172.21.15.40:3300/0 conn(0x7fb9480c0520 0x7fb948081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 -- 172.21.15.27:0/3585417285 >> v1:172.21.15.40:6789/0 conn(0x7fb948151c90 legacy=0x7fb9480c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 -- 172.21.15.27:0/3585417285 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948155520 con 0x7fb948152070 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.744+0000 7fb947fff700 1 --2- 172.21.15.27:0/3585417285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb948154980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb948154e70 tx=0x7fb9340090f0).ready entity=mon.0 client_cookie=cdf9c4b6d9dfe5ab server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:46.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb9477fe700 1 -- 172.21.15.27:0/3585417285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400b5a0 con 0x7fb948152070 2023-05-17T14:53:46.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb9477fe700 1 -- 172.21.15.27:0/3585417285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400b700 con 0x7fb948152070 2023-05-17T14:53:46.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb9477fe700 1 -- 172.21.15.27:0/3585417285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400ba80 con 0x7fb948152070 2023-05-17T14:53:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 -- 172.21.15.27:0/3585417285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 msgr2=0x7fb948154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 --2- 172.21.15.27:0/3585417285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb948154980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb948154e70 tx=0x7fb9340090f0).stop 2023-05-17T14:53:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 -- 172.21.15.27:0/3585417285 shutdown_connections 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 --2- 172.21.15.27:0/3585417285 >> v2:172.21.15.40:3300/0 conn(0x7fb9480c0520 0x7fb948081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 --2- 172.21.15.27:0/3585417285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb948154980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 -- 172.21.15.27:0/3585417285 >> 172.21.15.27:0/3585417285 conn(0x7fb9480cae10 msgr2=0x7fb9480cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 -- 172.21.15.27:0/3585417285 shutdown_connections 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.745+0000 7fb94ef39700 1 -- 172.21.15.27:0/3585417285 wait complete. 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.746+0000 7fb94ef39700 1 Processor -- start 2023-05-17T14:53:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.746+0000 7fb94ef39700 1 -- start start 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ef39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9480c0520 0x7fb9480b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ef39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb948151c90 0x7fb9481502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ef39700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb9480c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ef39700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c3f10 con 0x7fb948152070 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ef39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c3300 con 0x7fb948151c90 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ef39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c35e0 con 0x7fb9480c0520 2023-05-17T14:53:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94d4d6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb9480c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94d4d6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb9480c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33464/0 (socket says 172.21.15.27:33464) 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94d4d6700 1 -- 172.21.15.27:0/1650990609 learned_addr learned my addr 172.21.15.27:0/1650990609 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb947fff700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb948151c90 0x7fb9481502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.747+0000 7fb94ccd5700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9480c0520 0x7fb9480b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94d4d6700 1 -- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9480c0520 msgr2=0x7fb9480b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94d4d6700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9480c0520 0x7fb9480b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94d4d6700 1 -- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb948151c90 msgr2=0x7fb9481502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94d4d6700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb948151c90 0x7fb9481502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94d4d6700 1 -- 172.21.15.27:0/1650990609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934009370 con 0x7fb948152070 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94d4d6700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb9480c43a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb940009fa0 tx=0x7fb940009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000ebc0 con 0x7fb948152070 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000ed20 con 0x7fb948152070 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480c38c0 con 0x7fb948152070 2023-05-17T14:53:46.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940014610 con 0x7fb948152070 2023-05-17T14:53:46.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.748+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480b0bb0 con 0x7fb948152070 2023-05-17T14:53:46.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.749+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94806bdf0 con 0x7fb948152070 2023-05-17T14:53:46.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.749+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb94001b030 con 0x7fb948152070 2023-05-17T14:53:46.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.750+0000 7fb944ff9700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb92c05ed90 0x7fb92c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:46.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.750+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7fb940079b10 con 0x7fb948152070 2023-05-17T14:53:46.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.750+0000 7fb94ccd5700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb92c05ed90 0x7fb92c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:46.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.750+0000 7fb94ccd5700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb92c05ed90 0x7fb92c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb93c0038b0 tx=0x7fb93c007d20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:46.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.754+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb94004b3b0 con 0x7fb948152070 2023-05-17T14:53:46.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:46.930+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb948155800 con 0x7fb948152070 2023-05-17T14:53:47.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.608+0000 7fb944ff9700 1 -- 172.21.15.27:0/1650990609 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb94004e9d0 con 0x7fb948152070 2023-05-17T14:53:47.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb92c05ed90 msgr2=0x7fb92c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb92c05ed90 0x7fb92c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb93c0038b0 tx=0x7fb93c007d20).stop 2023-05-17T14:53:47.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 msgr2=0x7fb9480c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb9480c43a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb940009fa0 tx=0x7fb940009900).stop 2023-05-17T14:53:47.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 shutdown_connections 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb92c05ed90 0x7fb92c061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb948152070 0x7fb9480c43a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9480c0520 0x7fb9480b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 --2- 172.21.15.27:0/1650990609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb948151c90 0x7fb9481502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 >> 172.21.15.27:0/1650990609 conn(0x7fb9480cae10 msgr2=0x7fb948069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 shutdown_connections 2023-05-17T14:53:47.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.612+0000 7fb94ef39700 1 -- 172.21.15.27:0/1650990609 wait complete. 2023-05-17T14:53:47.619 INFO:teuthology.orchestra.run.smithi027.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-17T14:53:47.634 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-17T14:53:47.634 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T14:53:47.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T14:53:47.637 INFO:tasks.ceph.mds.a:Started 2023-05-17T14:53:47.637 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T14:53:47.637 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T14:53:47.639 INFO:tasks.ceph.mds.c:Started 2023-05-17T14:53:47.639 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T14:53:47.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T14:53:47.642 INFO:tasks.ceph.mds.b:Started 2023-05-17T14:53:47.642 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T14:53:47.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T14:53:47.644 INFO:tasks.ceph.mds.d:Started 2023-05-17T14:53:47.645 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-17T14:53:47.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:47.716 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T14:53:47.718 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T14:53:47.725 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T14:53:47.726 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T14:53:47.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.768+0000 7f68eabf8700 1 Processor -- start 2023-05-17T14:53:47.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.768+0000 7f68eabf8700 1 -- start start 2023-05-17T14:53:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68eabf8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68e4153f80 0x7f68e4154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68eabf8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f68e4066a60 0x7f68e40c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68eabf8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40bd5a0 con 0x7f68e40bd120 2023-05-17T14:53:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68eabf8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40c2430 con 0x7f68e4066a60 2023-05-17T14:53:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68eabf8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40c36c0 con 0x7f68e4153f80 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68e9195700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f68e4066a60 0x7f68e40c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68e9195700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f68e4066a60 0x7f68e40c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33540/0 (socket says 172.21.15.27:33540) 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.769+0000 7f68e9195700 1 -- 172.21.15.27:0/3419152940 learned_addr learned my addr 172.21.15.27:0/3419152940 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e8994700 1 --2- 172.21.15.27:0/3419152940 >> v2:172.21.15.40:3300/0 conn(0x7f68e4153f80 0x7f68e4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e9195700 1 -- 172.21.15.27:0/3419152940 >> v2:172.21.15.40:3300/0 conn(0x7f68e4153f80 msgr2=0x7f68e4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e9195700 1 --2- 172.21.15.27:0/3419152940 >> v2:172.21.15.40:3300/0 conn(0x7f68e4153f80 0x7f68e4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e9195700 1 -- 172.21.15.27:0/3419152940 >> v1:172.21.15.40:6789/0 conn(0x7f68e40bd120 legacy=0x7f68e4066350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e9195700 1 -- 172.21.15.27:0/3419152940 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e40c3230 con 0x7f68e4066a60 2023-05-17T14:53:47.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e9195700 1 --2- 172.21.15.27:0/3419152940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e4066a60 0x7f68e40c1f40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f68e4062ae0 tx=0x7f68cc0090f0).ready entity=mon.0 client_cookie=40d61ebf4fa1e950 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:47.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e37fe700 1 -- 172.21.15.27:0/3419152940 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00b600 con 0x7f68e4066a60 2023-05-17T14:53:47.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e37fe700 1 -- 172.21.15.27:0/3419152940 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00b760 con 0x7f68e4066a60 2023-05-17T14:53:47.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68e37fe700 1 -- 172.21.15.27:0/3419152940 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00bae0 con 0x7f68e4066a60 2023-05-17T14:53:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68eabf8700 1 -- 172.21.15.27:0/3419152940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e4066a60 msgr2=0x7f68e40c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.770+0000 7f68eabf8700 1 --2- 172.21.15.27:0/3419152940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e4066a60 0x7f68e40c1f40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f68e4062ae0 tx=0x7f68cc0090f0).stop 2023-05-17T14:53:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.771+0000 7f68eabf8700 1 -- 172.21.15.27:0/3419152940 shutdown_connections 2023-05-17T14:53:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.771+0000 7f68eabf8700 1 --2- 172.21.15.27:0/3419152940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e4066a60 0x7f68e40c1f40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.771+0000 7f68eabf8700 1 --2- 172.21.15.27:0/3419152940 >> v2:172.21.15.40:3300/0 conn(0x7f68e4153f80 0x7f68e4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.771+0000 7f68eabf8700 1 -- 172.21.15.27:0/3419152940 >> 172.21.15.27:0/3419152940 conn(0x7f68e4068750 msgr2=0x7f68e40c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.771+0000 7f68eabf8700 1 -- 172.21.15.27:0/3419152940 shutdown_connections 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.771+0000 7f68eabf8700 1 -- 172.21.15.27:0/3419152940 wait complete. 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.772+0000 7f68eabf8700 1 Processor -- start 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.772+0000 7f68eabf8700 1 -- start start 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68e4066a60 0x7f68e40ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 0x7f68e4157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e4153f80 0x7f68e4147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4156f80 con 0x7f68e40bd120 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4156370 con 0x7f68e4153f80 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4156650 con 0x7f68e4066a60 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 0x7f68e4157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 0x7f68e4157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33546/0 (socket says 172.21.15.27:33546) 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e9195700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e4153f80 0x7f68e4147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 -- 172.21.15.27:0/1135407418 learned_addr learned my addr 172.21.15.27:0/1135407418 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e8994700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68e4066a60 0x7f68e40ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 -- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68e4066a60 msgr2=0x7f68e40ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68e4066a60 0x7f68e40ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 -- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e4153f80 msgr2=0x7f68e4147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e4153f80 0x7f68e4147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 -- 172.21.15.27:0/1135407418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc009370 con 0x7f68e40bd120 2023-05-17T14:53:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e9195700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e4153f80 0x7f68e4147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e3fff700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 0x7f68e4157410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f68d400c840 tx=0x7f68d4001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4006a20 con 0x7f68e40bd120 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4006b80 con 0x7f68e40bd120 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e4156930 con 0x7f68e40bd120 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4007020 con 0x7f68e40bd120 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.773+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e4148430 con 0x7f68e40bd120 2023-05-17T14:53:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.774+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e41570f0 con 0x7f68e40bd120 2023-05-17T14:53:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.775+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f68d4010070 con 0x7f68e40bd120 2023-05-17T14:53:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.775+0000 7f68e0ff9700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68c405ed90 0x7f68c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.775+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f68d4078cf0 con 0x7f68e40bd120 2023-05-17T14:53:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.775+0000 7f68e8994700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68c405ed90 0x7f68c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:47.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.775+0000 7f68e8994700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68c405ed90 0x7f68c4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f68dc00bb10 tx=0x7f68dc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:47.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.779+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f68d40478f0 con 0x7f68e40bd120 2023-05-17T14:53:47.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.952+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68e40bd5a0 con 0x7f68e40bd120 2023-05-17T14:53:47.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.952+0000 7f68e0ff9700 1 -- 172.21.15.27:0/1135407418 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13722 (secure 0 0 0) 0x7f68e40bd5a0 con 0x7f68e40bd120 2023-05-17T14:53:47.958 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:47.958 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:47.601300+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:47.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68c405ed90 msgr2=0x7f68c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68c405ed90 0x7f68c4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f68dc00bb10 tx=0x7f68dc008040).stop 2023-05-17T14:53:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 msgr2=0x7f68e4157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 0x7f68e4157410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f68d400c840 tx=0x7f68d4001660).stop 2023-05-17T14:53:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 shutdown_connections 2023-05-17T14:53:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68c405ed90 0x7f68c4061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e4153f80 0x7f68e4147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68e4066a60 0x7f68e40ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 --2- 172.21.15.27:0/1135407418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68e40bd120 0x7f68e4157410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:47.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 >> 172.21.15.27:0/1135407418 conn(0x7f68e4068750 msgr2=0x7f68e4151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:47.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 shutdown_connections 2023-05-17T14:53:47.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:47.954+0000 7f68eabf8700 1 -- 172.21.15.27:0/1135407418 wait complete. 2023-05-17T14:53:47.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T14:53:47.972 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:53:48.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.085+0000 7ff46f59e700 1 Processor -- start 2023-05-17T14:53:48.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.085+0000 7ff46f59e700 1 -- start start 2023-05-17T14:53:48.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff470151dd0 0x7ff4700bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46f59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4701521b0 0x7ff470064280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff470063df0 con 0x7ff4700a6cf0 2023-05-17T14:53:48.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46f59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700bcbc0 con 0x7ff470151dd0 2023-05-17T14:53:48.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46f59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700634c0 con 0x7ff4701521b0 2023-05-17T14:53:48.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46e59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff470151dd0 0x7ff4700bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46ed9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff4700a6cf0 0x7ff4700c4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33114/0 (socket says 172.21.15.27:33114) 2023-05-17T14:53:48.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46ed9d700 1 -- 172.21.15.27:0/2443205990 learned_addr learned my addr 172.21.15.27:0/2443205990 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:48.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46dd9b700 1 --2- 172.21.15.27:0/2443205990 >> v2:172.21.15.40:3300/0 conn(0x7ff4701521b0 0x7ff470064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46e59c700 1 -- 172.21.15.27:0/2443205990 >> v2:172.21.15.40:3300/0 conn(0x7ff4701521b0 msgr2=0x7ff470064280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46e59c700 1 --2- 172.21.15.27:0/2443205990 >> v2:172.21.15.40:3300/0 conn(0x7ff4701521b0 0x7ff470064280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46d59a700 1 -- 172.21.15.27:0/2443205990 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967455657 0 0) 0x7ff470063df0 con 0x7ff4700a6cf0 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46e59c700 1 -- 172.21.15.27:0/2443205990 >> v1:172.21.15.27:6789/0 conn(0x7ff4700a6cf0 legacy=0x7ff4700c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46e59c700 1 -- 172.21.15.27:0/2443205990 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700637a0 con 0x7ff470151dd0 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.086+0000 7ff46dd9b700 1 --2- 172.21.15.27:0/2443205990 >> v2:172.21.15.40:3300/0 conn(0x7ff4701521b0 0x7ff470064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:48.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46e59c700 1 --2- 172.21.15.27:0/2443205990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff470151dd0 0x7ff4700bc6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff47006ab00 tx=0x7ff468009060).ready entity=mon.0 client_cookie=3a8612ba865798bd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46d59a700 1 -- 172.21.15.27:0/2443205990 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800b580 con 0x7ff470151dd0 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46d59a700 1 -- 172.21.15.27:0/2443205990 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800b6e0 con 0x7ff470151dd0 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46d59a700 1 -- 172.21.15.27:0/2443205990 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800ba60 con 0x7ff470151dd0 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 -- 172.21.15.27:0/2443205990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff470151dd0 msgr2=0x7ff4700bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 --2- 172.21.15.27:0/2443205990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff470151dd0 0x7ff4700bc6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff47006ab00 tx=0x7ff468009060).stop 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 -- 172.21.15.27:0/2443205990 shutdown_connections 2023-05-17T14:53:48.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 --2- 172.21.15.27:0/2443205990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff470151dd0 0x7ff4700bc6d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 --2- 172.21.15.27:0/2443205990 >> v2:172.21.15.40:3300/0 conn(0x7ff4701521b0 0x7ff470064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 -- 172.21.15.27:0/2443205990 >> 172.21.15.27:0/2443205990 conn(0x7ff470067cb0 msgr2=0x7ff4700680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 -- 172.21.15.27:0/2443205990 shutdown_connections 2023-05-17T14:53:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.087+0000 7ff46f59e700 1 -- 172.21.15.27:0/2443205990 wait complete. 2023-05-17T14:53:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.088+0000 7ff46f59e700 1 Processor -- start 2023-05-17T14:53:48.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.088+0000 7ff46f59e700 1 -- start start 2023-05-17T14:53:48.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4700a6cf0 0x7ff47014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff470151dd0 0x7ff4700ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 0x7ff47014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47014e800 con 0x7ff4701521b0 2023-05-17T14:53:48.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47014dbf0 con 0x7ff470151dd0 2023-05-17T14:53:48.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47014ded0 con 0x7ff4700a6cf0 2023-05-17T14:53:48.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 0x7ff47014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 0x7ff47014d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33560/0 (socket says 172.21.15.27:33560) 2023-05-17T14:53:48.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.089+0000 7ff46ed9d700 1 -- 172.21.15.27:0/1994379443 learned_addr learned my addr 172.21.15.27:0/1994379443 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:48.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46ed9d700 1 -- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4700a6cf0 msgr2=0x7ff47014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46dd9b700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff470151dd0 0x7ff4700ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46e59c700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4700a6cf0 0x7ff47014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46ed9d700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4700a6cf0 0x7ff47014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46ed9d700 1 -- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff470151dd0 msgr2=0x7ff4700ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46ed9d700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff470151dd0 0x7ff4700ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46ed9d700 1 -- 172.21.15.27:0/1994379443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680092a0 con 0x7ff4701521b0 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46dd9b700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff470151dd0 0x7ff4700ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46e59c700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4700a6cf0 0x7ff47014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46ed9d700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 0x7ff47014d3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff46000c7e0 tx=0x7ff460007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460005d30 con 0x7ff4701521b0 2023-05-17T14:53:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460005e90 con 0x7ff4701521b0 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47014e1b0 con 0x7ff4701521b0 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460007320 con 0x7ff4701521b0 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.090+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47014d890 con 0x7ff4701521b0 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.091+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47014e9b0 con 0x7ff4701521b0 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.091+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff460010030 con 0x7ff4701521b0 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.091+0000 7ff45e7fc700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff45005ed90 0x7ff450061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.092+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff460079770 con 0x7ff4701521b0 2023-05-17T14:53:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.092+0000 7ff46e59c700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff45005ed90 0x7ff450061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.092+0000 7ff46e59c700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff45005ed90 0x7ff450061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff46800b340 tx=0x7ff468017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.096+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff47014e9b0 con 0x7ff4701521b0 2023-05-17T14:53:48.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.267+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff47014e940 con 0x7ff4701521b0 2023-05-17T14:53:48.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.267+0000 7ff45e7fc700 1 -- 172.21.15.27:0/1994379443 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff46004b060 con 0x7ff4701521b0 2023-05-17T14:53:48.273 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:53:48.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.269+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff45005ed90 msgr2=0x7ff450061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.269+0000 7ff46f59e700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff45005ed90 0x7ff450061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff46800b340 tx=0x7ff468017000).stop 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.269+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 msgr2=0x7ff47014d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.269+0000 7ff46f59e700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 0x7ff47014d3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff46000c7e0 tx=0x7ff460007f90).stop 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 shutdown_connections 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff45005ed90 0x7ff450061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4701521b0 0x7ff47014d3a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4700a6cf0 0x7ff47014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 --2- 172.21.15.27:0/1994379443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff470151dd0 0x7ff4700ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 >> 172.21.15.27:0/1994379443 conn(0x7ff470067cb0 msgr2=0x7ff470151020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 shutdown_connections 2023-05-17T14:53:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.270+0000 7ff46f59e700 1 -- 172.21.15.27:0/1994379443 wait complete. 2023-05-17T14:53:48.286 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:53:48.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.400+0000 7f53909c7700 1 Processor -- start 2023-05-17T14:53:48.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.400+0000 7f53909c7700 1 -- start start 2023-05-17T14:53:48.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f53909c7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f538c1543d0 0x7f538c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f53909c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f538c0c60f0 0x7f538c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f53909c7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c0c0c90 con 0x7f538c0691f0 2023-05-17T14:53:48.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f53909c7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c0c1c50 con 0x7f538c1543d0 2023-05-17T14:53:48.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f53909c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c158790 con 0x7f538c0c60f0 2023-05-17T14:53:48.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f538c1543d0 0x7f538c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f538c1543d0 0x7f538c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33564/0 (socket says 172.21.15.27:33564) 2023-05-17T14:53:48.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 -- 172.21.15.27:0/4283681813 learned_addr learned my addr 172.21.15.27:0/4283681813 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:48.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f5389d9b700 1 --2- 172.21.15.27:0/4283681813 >> v2:172.21.15.40:3300/0 conn(0x7f538c0c60f0 0x7f538c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 -- 172.21.15.27:0/4283681813 >> v2:172.21.15.40:3300/0 conn(0x7f538c0c60f0 msgr2=0x7f538c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 --2- 172.21.15.27:0/4283681813 >> v2:172.21.15.40:3300/0 conn(0x7f538c0c60f0 0x7f538c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 -- 172.21.15.27:0/4283681813 >> v1:172.21.15.40:6789/0 conn(0x7f538c0691f0 legacy=0x7f538c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 -- 172.21.15.27:0/4283681813 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0c6570 con 0x7f538c1543d0 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f5389d9b700 1 --2- 172.21.15.27:0/4283681813 >> v2:172.21.15.40:3300/0 conn(0x7f538c0c60f0 0x7f538c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538a59c700 1 --2- 172.21.15.27:0/4283681813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0c5c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f538c0c5620 tx=0x7f53840090f0).ready entity=mon.0 client_cookie=f4700f170020ee84 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538959a700 1 -- 172.21.15.27:0/4283681813 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400b600 con 0x7f538c1543d0 2023-05-17T14:53:48.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538959a700 1 -- 172.21.15.27:0/4283681813 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538400b760 con 0x7f538c1543d0 2023-05-17T14:53:48.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.401+0000 7f538959a700 1 -- 172.21.15.27:0/4283681813 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400bae0 con 0x7f538c1543d0 2023-05-17T14:53:48.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 -- 172.21.15.27:0/4283681813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 msgr2=0x7f538c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 --2- 172.21.15.27:0/4283681813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0c5c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f538c0c5620 tx=0x7f53840090f0).stop 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 -- 172.21.15.27:0/4283681813 shutdown_connections 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 --2- 172.21.15.27:0/4283681813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0c5c00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 --2- 172.21.15.27:0/4283681813 >> v2:172.21.15.40:3300/0 conn(0x7f538c0c60f0 0x7f538c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 -- 172.21.15.27:0/4283681813 >> 172.21.15.27:0/4283681813 conn(0x7f538c0cb7f0 msgr2=0x7f538c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 -- 172.21.15.27:0/4283681813 shutdown_connections 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.402+0000 7f53909c7700 1 -- 172.21.15.27:0/4283681813 wait complete. 2023-05-17T14:53:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.403+0000 7f53909c7700 1 Processor -- start 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.403+0000 7f53909c7700 1 -- start start 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f53909c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538c0691f0 0x7f538c152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f53909c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c0c60f0 0x7f538c1652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f53909c7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f53909c7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c1657b0 con 0x7f538c1543d0 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f53909c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0ae220 con 0x7f538c0c60f0 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f53909c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0ae500 con 0x7f538c0691f0 2023-05-17T14:53:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33574/0 (socket says 172.21.15.27:33574) 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 -- 172.21.15.27:0/1016305044 learned_addr learned my addr 172.21.15.27:0/1016305044 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f5389d9b700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c0c60f0 0x7f538c1652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538a59c700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538c0691f0 0x7f538c152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 -- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538c0691f0 msgr2=0x7f538c152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538c0691f0 0x7f538c152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 -- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c0c60f0 msgr2=0x7f538c1652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c0c60f0 0x7f538c1652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 -- 172.21.15.27:0/1016305044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009370 con 0x7f538c1543d0 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f5389d9b700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c0c60f0 0x7f538c1652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.404+0000 7f538ad9d700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0af2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f537c00c440 tx=0x7f537c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.405+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00f470 con 0x7f538c1543d0 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.405+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c001e90 con 0x7f538c1543d0 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.405+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c0ae7e0 con 0x7f538c1543d0 2023-05-17T14:53:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.405+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00f7e0 con 0x7f538c1543d0 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.405+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c0aeda0 con 0x7f538c1543d0 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.405+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c0aefc0 con 0x7f538c1543d0 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.406+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f537c010070 con 0x7f538c1543d0 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.406+0000 7f53827fc700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f536c05ed90 0x7f536c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.406+0000 7f538a59c700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f536c05ed90 0x7f536c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.406+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f537c078b30 con 0x7f538c1543d0 2023-05-17T14:53:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.407+0000 7f538a59c700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f536c05ed90 0x7f536c061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f538c0b0f80 tx=0x7f5384017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.410+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f537c0478f0 con 0x7f538c1543d0 2023-05-17T14:53:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.584+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f538c157e60 con 0x7f538c1543d0 2023-05-17T14:53:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.584+0000 7f53827fc700 1 -- 172.21.15.27:0/1016305044 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f537c04a420 con 0x7f538c1543d0 2023-05-17T14:53:48.590 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:53:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f536c05ed90 msgr2=0x7f536c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f536c05ed90 0x7f536c061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f538c0b0f80 tx=0x7f5384017000).stop 2023-05-17T14:53:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 msgr2=0x7f538c0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0af2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f537c00c440 tx=0x7f537c007d70).stop 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 shutdown_connections 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f536c05ed90 0x7f536c061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f538c1543d0 0x7f538c0af2c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538c0691f0 0x7f538c152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 --2- 172.21.15.27:0/1016305044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c0c60f0 0x7f538c1652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 >> 172.21.15.27:0/1016305044 conn(0x7f538c0cb7f0 msgr2=0x7f538c0c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:48.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 shutdown_connections 2023-05-17T14:53:48.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.586+0000 7f53909c7700 1 -- 172.21.15.27:0/1016305044 wait complete. 2023-05-17T14:53:48.603 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:53:48.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.714+0000 7fe20ece8700 1 Processor -- start 2023-05-17T14:53:48.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.714+0000 7fe20ece8700 1 -- start start 2023-05-17T14:53:48.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ece8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2080c5f30 0x7fe2080c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ece8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe208158880 0x7fe208153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ece8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2081541c0 0x7fe2080c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ece8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080bfcd0 con 0x7fe2080c5f30 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ece8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080c0290 con 0x7fe208158880 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ece8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080aa1a0 con 0x7fe2081541c0 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2080c5f30 0x7fe2080c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2080c5f30 0x7fe2080c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33578/0 (socket says 172.21.15.27:33578) 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 -- 172.21.15.27:0/1059137726 learned_addr learned my addr 172.21.15.27:0/1059137726 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe207fff700 1 --2- 172.21.15.27:0/1059137726 >> v2:172.21.15.40:3300/0 conn(0x7fe208158880 0x7fe208153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20d285700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2081541c0 0x7fe2080c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 -- 172.21.15.27:0/1059137726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2081541c0 msgr2=0x7fe2080c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2081541c0 0x7fe2080c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 -- 172.21.15.27:0/1059137726 >> v2:172.21.15.40:3300/0 conn(0x7fe208158880 msgr2=0x7fe208153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 --2- 172.21.15.27:0/1059137726 >> v2:172.21.15.40:3300/0 conn(0x7fe208158880 0x7fe208153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20ca84700 1 -- 172.21.15.27:0/1059137726 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080aa480 con 0x7fe2080c5f30 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.715+0000 7fe20d285700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2081541c0 0x7fe2080c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ca84700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2080c6310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe2080c57b0 tx=0x7fe2000090f0).ready entity=mon.0 client_cookie=2362fced620b0b1a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe2077fe700 1 -- 172.21.15.27:0/1059137726 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000b600 con 0x7fe2080c5f30 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe2077fe700 1 -- 172.21.15.27:0/1059137726 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000b760 con 0x7fe2080c5f30 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe2077fe700 1 -- 172.21.15.27:0/1059137726 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000bae0 con 0x7fe2080c5f30 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 -- 172.21.15.27:0/1059137726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 msgr2=0x7fe2080c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2080c6310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe2080c57b0 tx=0x7fe2000090f0).stop 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 -- 172.21.15.27:0/1059137726 shutdown_connections 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2080c6310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 --2- 172.21.15.27:0/1059137726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2081541c0 0x7fe2080c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 --2- 172.21.15.27:0/1059137726 >> v2:172.21.15.40:3300/0 conn(0x7fe208158880 0x7fe208153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 -- 172.21.15.27:0/1059137726 >> 172.21.15.27:0/1059137726 conn(0x7fe208069e70 msgr2=0x7fe20805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:48.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 -- 172.21.15.27:0/1059137726 shutdown_connections 2023-05-17T14:53:48.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.716+0000 7fe20ece8700 1 -- 172.21.15.27:0/1059137726 wait complete. 2023-05-17T14:53:48.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.717+0000 7fe20ece8700 1 Processor -- start 2023-05-17T14:53:48.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.717+0000 7fe20ece8700 1 -- start start 2023-05-17T14:53:48.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ece8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2081525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ece8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2081541c0 0x7fe208156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ece8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe208158880 0x7fe208154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ece8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe208157be0 con 0x7fe2080c5f30 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ece8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe208156fd0 con 0x7fe2081541c0 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ece8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2081572b0 con 0x7fe208158880 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ca84700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2081525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ca84700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2081525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33584/0 (socket says 172.21.15.27:33584) 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20ca84700 1 -- 172.21.15.27:0/2988194040 learned_addr learned my addr 172.21.15.27:0/2988194040 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:48.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe207fff700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2081541c0 0x7fe208156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.718+0000 7fe20d285700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe208158880 0x7fe208154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ca84700 1 -- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe208158880 msgr2=0x7fe208154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ca84700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe208158880 0x7fe208154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ca84700 1 -- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2081541c0 msgr2=0x7fe208156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ca84700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2081541c0 0x7fe208156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ca84700 1 -- 172.21.15.27:0/2988194040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200009370 con 0x7fe2080c5f30 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ca84700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2081525f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe200009130 tx=0x7fe200017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000bea0 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000b8d0 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20001c650 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe208157590 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.719+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe208152ae0 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.720+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe208152d00 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.720+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe20002c070 con 0x7fe2080c5f30 2023-05-17T14:53:48.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.720+0000 7fe204ff9700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe1e805ed90 0x7fe1e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:48.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.721+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe20007b240 con 0x7fe2080c5f30 2023-05-17T14:53:48.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.721+0000 7fe207fff700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe1e805ed90 0x7fe1e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:48.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.721+0000 7fe207fff700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe1e805ed90 0x7fe1e8061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe2080cb790 tx=0x7fe1f80097e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:48.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.725+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe200050560 con 0x7fe2080c5f30 2023-05-17T14:53:48.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.944+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe208157ec0 con 0x7fe2080c5f30 2023-05-17T14:53:48.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.944+0000 7fe204ff9700 1 -- 172.21.15.27:0/2988194040 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7fe20002a090 con 0x7fe2080c5f30 2023-05-17T14:53:48.949 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:48.950 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-17T14:53:48.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe1e805ed90 msgr2=0x7fe1e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe1e805ed90 0x7fe1e8061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe2080cb790 tx=0x7fe1f80097e0).stop 2023-05-17T14:53:48.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 msgr2=0x7fe2081525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:48.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2081525f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe200009130 tx=0x7fe200017000).stop 2023-05-17T14:53:48.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 shutdown_connections 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe1e805ed90 0x7fe1e8061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe208158880 0x7fe208154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2080c5f30 0x7fe2081525f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 --2- 172.21.15.27:0/2988194040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2081541c0 0x7fe208156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 >> 172.21.15.27:0/2988194040 conn(0x7fe208069e70 msgr2=0x7fe2080afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 shutdown_connections 2023-05-17T14:53:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:48.946+0000 7fe20ece8700 1 -- 172.21.15.27:0/2988194040 wait complete. 2023-05-17T14:53:48.953 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2023-05-17T14:53:48.963 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:49.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.073+0000 7f7f2d879700 1 Processor -- start 2023-05-17T14:53:49.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.073+0000 7f7f2d879700 1 -- start start 2023-05-17T14:53:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f2d879700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f280c0880 0x7f7f281544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f2d879700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f28151ee0 con 0x7f7f280c1700 2023-05-17T14:53:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f2d879700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280c8070 con 0x7f7f280c1320 2023-05-17T14:53:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f2d879700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f281554b0 con 0x7f7f280c0880 2023-05-17T14:53:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f267fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7f280c1700 0x7f7f280c0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33158/0 (socket says 172.21.15.27:33158) 2023-05-17T14:53:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f267fc700 1 -- 172.21.15.27:0/3387145855 learned_addr learned my addr 172.21.15.27:0/3387145855 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f277fe700 1 --2- 172.21.15.27:0/3387145855 >> v2:172.21.15.40:3300/0 conn(0x7f7f280c0880 0x7f7f281544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045697855 0 0) 0x7f7f28151ee0 con 0x7f7f280c1700 2023-05-17T14:53:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f140033f0 con 0x7f7f280c1700 2023-05-17T14:53:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 638579677 0 0) 0x7f7f140033f0 con 0x7f7f280c1700 2023-05-17T14:53:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 >> v2:172.21.15.40:3300/0 conn(0x7f7f280c0880 msgr2=0x7f7f281544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f25ffb700 1 --2- 172.21.15.27:0/3387145855 >> v2:172.21.15.40:3300/0 conn(0x7f7f280c0880 0x7f7f281544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.074+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 >> v1:172.21.15.40:6789/0 conn(0x7f7f280c1320 legacy=0x7f7f28158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f28157ce0 con 0x7f7f280c1700 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f7f10001470 con 0x7f7f280c1700 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 >> v1:172.21.15.27:6789/0 conn(0x7f7f280c1700 legacy=0x7f7f280c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f140038e0 0x7f7f14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f14004690 0x7f7f14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f14005000 0x7f7f1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281554b0 con 0x7f7f14004690 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1400beb0 con 0x7f7f14005000 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1400c070 con 0x7f7f140038e0 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f14004690 0x7f7f14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f26ffd700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f140038e0 0x7f7f14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f277fe700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f14005000 0x7f7f1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 -- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f140038e0 msgr2=0x7f7f14003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:49.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f140038e0 0x7f7f14003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 -- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f14005000 msgr2=0x7f7f1400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f14005000 0x7f7f1400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f277fe700 1 -- 172.21.15.27:0/3387145855 reap_dead start 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 -- 172.21.15.27:0/3387145855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140033f0 con 0x7f7f14004690 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f267fc700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f14004690 0x7f7f14004b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7f1000c160 tx=0x7f7f280c6ce0).ready entity=mon.0 client_cookie=4be6a81df8b54720 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000ca10 con 0x7f7f14004690 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000cb70 con 0x7f7f14004690 2023-05-17T14:53:49.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.075+0000 7f7f25ffb700 1 -- 172.21.15.27:0/3387145855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100070d0 con 0x7f7f14004690 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 -- 172.21.15.27:0/3387145855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f14004690 msgr2=0x7f7f14004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f14004690 0x7f7f14004b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7f1000c160 tx=0x7f7f280c6ce0).stop 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 -- 172.21.15.27:0/3387145855 shutdown_connections 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 --2- 172.21.15.27:0/3387145855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f14004690 0x7f7f14004b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 -- 172.21.15.27:0/3387145855 >> 172.21.15.27:0/3387145855 conn(0x7f7f2805dd50 msgr2=0x7f7f2805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 -- 172.21.15.27:0/3387145855 shutdown_connections 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.076+0000 7f7f2d879700 1 -- 172.21.15.27:0/3387145855 wait complete. 2023-05-17T14:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.077+0000 7f7f2d879700 1 Processor -- start 2023-05-17T14:53:49.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.077+0000 7f7f2d879700 1 -- start start 2023-05-17T14:53:49.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f2d879700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f14004690 0x7f7f280a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f2d879700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 0x7f7f280a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f2d879700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f280af9f0 0x7f7f280afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f2d879700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280b0a40 con 0x7f7f280a9a50 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f2d879700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c2d70 con 0x7f7f280af9f0 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f2d879700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280aa3c0 con 0x7f7f14004690 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 0x7f7f280a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 0x7f7f280a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33608/0 (socket says 172.21.15.27:33608) 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 -- 172.21.15.27:0/605865687 learned_addr learned my addr 172.21.15.27:0/605865687 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f26ffd700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f14004690 0x7f7f280a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f277fe700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f280af9f0 0x7f7f280afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 -- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f14004690 msgr2=0x7f7f280a8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f14004690 0x7f7f280a8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 -- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f280af9f0 msgr2=0x7f7f280afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f280af9f0 0x7f7f280afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 -- 172.21.15.27:0/605865687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280a94c0 con 0x7f7f280a9a50 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f277fe700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f280af9f0 0x7f7f280afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f267fc700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 0x7f7f280a9ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7f10007150 tx=0x7f7f10015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.078+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10001750 con 0x7f7f280a9a50 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.079+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000cce0 con 0x7f7f280a9a50 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.079+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280b0760 con 0x7f7f280a9a50 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.079+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100048c0 con 0x7f7f280a9a50 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.079+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280c2a00 con 0x7f7f280a9a50 2023-05-17T14:53:49.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.079+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f280689d0 con 0x7f7f280a9a50 2023-05-17T14:53:49.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.080+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7f10026070 con 0x7f7f280a9a50 2023-05-17T14:53:49.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.080+0000 7f7f1effd700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f0805ed90 0x7f7f08061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.080+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7f10079ba0 con 0x7f7f280a9a50 2023-05-17T14:53:49.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.080+0000 7f7f26ffd700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f0805ed90 0x7f7f08061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.081+0000 7f7f26ffd700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f0805ed90 0x7f7f08061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7f20007fd0 tx=0x7f7f20007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.085+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f1004b490 con 0x7f7f280a9a50 2023-05-17T14:53:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.258+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f280c2f00 con 0x7f7f280a9a50 2023-05-17T14:53:49.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.259+0000 7f7f1effd700 1 -- 172.21.15.27:0/605865687 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13709 (secure 0 0 0) 0x7f7f10024030 con 0x7f7f280a9a50 2023-05-17T14:53:49.264 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:49.264 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":18,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:48.608344+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f0805ed90 msgr2=0x7f7f08061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f0805ed90 0x7f7f08061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7f20007fd0 tx=0x7f7f20007bb0).stop 2023-05-17T14:53:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 msgr2=0x7f7f280a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 0x7f7f280a9ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7f10007150 tx=0x7f7f10015000).stop 2023-05-17T14:53:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 shutdown_connections 2023-05-17T14:53:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f0805ed90 0x7f7f08061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f280af9f0 0x7f7f280afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f14004690 0x7f7f280a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 --2- 172.21.15.27:0/605865687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f280a9a50 0x7f7f280a9ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 >> 172.21.15.27:0/605865687 conn(0x7f7f2805dd50 msgr2=0x7f7f28151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:49.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 shutdown_connections 2023-05-17T14:53:49.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.261+0000 7f7f2d879700 1 -- 172.21.15.27:0/605865687 wait complete. 2023-05-17T14:53:49.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T14:53:49.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:53:49.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.392+0000 7f6ffd426700 1 Processor -- start 2023-05-17T14:53:49.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.392+0000 7f6ffd426700 1 -- start start 2023-05-17T14:53:49.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ffd426700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80c6310 0x7f6ff8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ffd426700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff8158790 con 0x7f6ff81543d0 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ffd426700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff8157e60 con 0x7f6ff80691f0 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ffd426700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80c1c50 con 0x7f6ff80c6310 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff6ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6ff81543d0 0x7f6ff80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33176/0 (socket says 172.21.15.27:33176) 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff6ffd700 1 -- 172.21.15.27:0/4010520386 learned_addr learned my addr 172.21.15.27:0/4010520386 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6feffff700 1 --2- 172.21.15.27:0/4010520386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80c6310 0x7f6ff8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933828064 0 0) 0x7f6ff8158790 con 0x7f6ff81543d0 2023-05-17T14:53:49.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe40033f0 con 0x7f6ff81543d0 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534576915 0 0) 0x7f6ff8157e60 con 0x7f6ff80691f0 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff8158790 con 0x7f6ff80691f0 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471983875 0 0) 0x7f6fe40033f0 con 0x7f6ff81543d0 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6feffff700 1 -- 172.21.15.27:0/4010520386 >> v1:172.21.15.40:6789/0 conn(0x7f6ff80691f0 legacy=0x7f6ff80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6feffff700 1 -- 172.21.15.27:0/4010520386 >> v1:172.21.15.27:6789/0 conn(0x7f6ff81543d0 legacy=0x7f6ff80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6feffff700 1 -- 172.21.15.27:0/4010520386 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8158140 con 0x7f6ff80c6310 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.393+0000 7f6feffff700 1 --2- 172.21.15.27:0/4010520386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80c6310 0x7f6ff8068d00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6fe0009790 tx=0x7f6fe0009060).ready entity=mon.2 client_cookie=3715824bede549c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8001470 con 0x7f6ff80c6310 2023-05-17T14:53:49.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0011400 con 0x7f6ff80c6310 2023-05-17T14:53:49.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ff67fc700 1 -- 172.21.15.27:0/4010520386 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0011780 con 0x7f6ff80c6310 2023-05-17T14:53:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 -- 172.21.15.27:0/4010520386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80c6310 msgr2=0x7f6ff8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 --2- 172.21.15.27:0/4010520386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80c6310 0x7f6ff8068d00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6fe0009790 tx=0x7f6fe0009060).stop 2023-05-17T14:53:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 -- 172.21.15.27:0/4010520386 shutdown_connections 2023-05-17T14:53:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 --2- 172.21.15.27:0/4010520386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80c6310 0x7f6ff8068d00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 -- 172.21.15.27:0/4010520386 >> 172.21.15.27:0/4010520386 conn(0x7f6ff80cb7f0 msgr2=0x7f6ff80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 -- 172.21.15.27:0/4010520386 shutdown_connections 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.394+0000 7f6ffd426700 1 -- 172.21.15.27:0/4010520386 wait complete. 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.395+0000 7f6ffd426700 1 Processor -- start 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.395+0000 7f6ffd426700 1 -- start start 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ffd426700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80691f0 0x7f6ff8147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ffd426700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff80c6310 0x7f6ff80afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ffd426700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 0x7f6ff80b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ffd426700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80b05b0 con 0x7f6ff81543d0 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ffd426700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80c3ab0 con 0x7f6ff80c6310 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ffd426700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80c2ea0 con 0x7f6ff80691f0 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 0x7f6ff80b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 0x7f6ff80b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33624/0 (socket says 172.21.15.27:33624) 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 -- 172.21.15.27:0/882310286 learned_addr learned my addr 172.21.15.27:0/882310286 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6feffff700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff80c6310 0x7f6ff80afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 -- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80691f0 msgr2=0x7f6ff8147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff6ffd700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80691f0 0x7f6ff8147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80691f0 0x7f6ff8147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 -- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff80c6310 msgr2=0x7f6ff80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.396+0000 7f6ff77fe700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff80c6310 0x7f6ff80afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6ff77fe700 1 -- 172.21.15.27:0/882310286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00092a0 con 0x7f6ff81543d0 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6feffff700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff80c6310 0x7f6ff80afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6ff6ffd700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80691f0 0x7f6ff8147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6ff77fe700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 0x7f6ff80b00c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6ff000c710 tx=0x7f6ff000cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0010510 con 0x7f6ff81543d0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0010670 con 0x7f6ff81543d0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00109f0 con 0x7f6ff81543d0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff80c3180 con 0x7f6ff81543d0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.397+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff80c3740 con 0x7f6ff81543d0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.398+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff80c3c20 con 0x7f6ff81543d0 2023-05-17T14:53:49.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.398+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6ff0010070 con 0x7f6ff81543d0 2023-05-17T14:53:49.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.398+0000 7f6feeffd700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6fd805ed90 0x7f6fd8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.398+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6ff0079580 con 0x7f6ff81543d0 2023-05-17T14:53:49.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.398+0000 7f6ff6ffd700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6fd805ed90 0x7f6fd8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.399+0000 7f6ff6ffd700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6fd805ed90 0x7f6fd8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6fe8000c00 tx=0x7f6fe8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.403+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ff004ae70 con 0x7f6ff81543d0 2023-05-17T14:53:49.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.577+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6ff806bdf0 con 0x7f6ff81543d0 2023-05-17T14:53:49.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.577+0000 7f6feeffd700 1 -- 172.21.15.27:0/882310286 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6ff004e490 con 0x7f6ff81543d0 2023-05-17T14:53:49.582 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:53:49.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6fd805ed90 msgr2=0x7f6fd8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6fd805ed90 0x7f6fd8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6fe8000c00 tx=0x7f6fe8009040).stop 2023-05-17T14:53:49.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 msgr2=0x7f6ff80b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 0x7f6ff80b00c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6ff000c710 tx=0x7f6ff000cad0).stop 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 shutdown_connections 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6fd805ed90 0x7f6fd8061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ff81543d0 0x7f6ff80b00c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ff80691f0 0x7f6ff8147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 --2- 172.21.15.27:0/882310286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff80c6310 0x7f6ff80afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 >> 172.21.15.27:0/882310286 conn(0x7f6ff80cb7f0 msgr2=0x7f6ff80accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 shutdown_connections 2023-05-17T14:53:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.579+0000 7f6ffd426700 1 -- 172.21.15.27:0/882310286 wait complete. 2023-05-17T14:53:49.596 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:53:49.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.710+0000 7f05880fd700 1 Processor -- start 2023-05-17T14:53:49.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.710+0000 7f05880fd700 1 -- start start 2023-05-17T14:53:49.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f05880fd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05801543d0 0x7f05800c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f05880fd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05800c60f0 0x7f0580068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f05880fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05800691f0 0x7f05801547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f05880fd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05800c1c50 con 0x7f05800c60f0 2023-05-17T14:53:49.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f05880fd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0580158790 con 0x7f05801543d0 2023-05-17T14:53:49.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f05880fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c6570 con 0x7f05800691f0 2023-05-17T14:53:49.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05800c60f0 0x7f0580068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05800c60f0 0x7f0580068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33630/0 (socket says 172.21.15.27:33630) 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 -- 172.21.15.27:0/456814007 learned_addr learned my addr 172.21.15.27:0/456814007 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585e99700 1 --2- 172.21.15.27:0/456814007 >> v2:172.21.15.40:3300/0 conn(0x7f05801543d0 0x7f05800c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f058669a700 1 --2- 172.21.15.27:0/456814007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05800691f0 0x7f05801547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 -- 172.21.15.27:0/456814007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05800691f0 msgr2=0x7f05801547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 --2- 172.21.15.27:0/456814007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05800691f0 0x7f05801547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 -- 172.21.15.27:0/456814007 >> v2:172.21.15.40:3300/0 conn(0x7f05801543d0 msgr2=0x7f05800c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:49.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 --2- 172.21.15.27:0/456814007 >> v2:172.21.15.40:3300/0 conn(0x7f05801543d0 0x7f05800c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 -- 172.21.15.27:0/456814007 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580157e60 con 0x7f05800c60f0 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585e99700 1 --2- 172.21.15.27:0/456814007 >> v2:172.21.15.40:3300/0 conn(0x7f05801543d0 0x7f05800c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0585698700 1 --2- 172.21.15.27:0/456814007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800c60f0 0x7f0580068d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0580155970 tx=0x7f05740090f0).ready entity=mon.0 client_cookie=a324400835414ed8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0584e97700 1 -- 172.21.15.27:0/456814007 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400b600 con 0x7f05800c60f0 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0584e97700 1 -- 172.21.15.27:0/456814007 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400b760 con 0x7f05800c60f0 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.711+0000 7f0584e97700 1 -- 172.21.15.27:0/456814007 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400bae0 con 0x7f05800c60f0 2023-05-17T14:53:49.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 -- 172.21.15.27:0/456814007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800c60f0 msgr2=0x7f0580068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 --2- 172.21.15.27:0/456814007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800c60f0 0x7f0580068d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0580155970 tx=0x7f05740090f0).stop 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 -- 172.21.15.27:0/456814007 shutdown_connections 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 --2- 172.21.15.27:0/456814007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05800691f0 0x7f05801547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 --2- 172.21.15.27:0/456814007 >> v2:172.21.15.40:3300/0 conn(0x7f05801543d0 0x7f05800c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 --2- 172.21.15.27:0/456814007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800c60f0 0x7f0580068d00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 -- 172.21.15.27:0/456814007 >> 172.21.15.27:0/456814007 conn(0x7f05800cb7f0 msgr2=0x7f05800c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 -- 172.21.15.27:0/456814007 shutdown_connections 2023-05-17T14:53:49.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.712+0000 7f05880fd700 1 -- 172.21.15.27:0/456814007 wait complete. 2023-05-17T14:53:49.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.713+0000 7f05880fd700 1 Processor -- start 2023-05-17T14:53:49.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.713+0000 7f05880fd700 1 -- start start 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 0x7f05800a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05800c60f0 0x7f05800c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05801543d0 0x7f0580152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c2d40 con 0x7f05800691f0 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c3020 con 0x7f05800c60f0 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c3300 con 0x7f05801543d0 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 0x7f05800a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 0x7f05800a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33634/0 (socket says 172.21.15.27:33634) 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 -- 172.21.15.27:0/877906852 learned_addr learned my addr 172.21.15.27:0/877906852 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585698700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05800c60f0 0x7f05800c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f058669a700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05801543d0 0x7f0580152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 -- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05801543d0 msgr2=0x7f0580152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05801543d0 0x7f0580152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 -- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05800c60f0 msgr2=0x7f05800c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05800c60f0 0x7f05800c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 -- 172.21.15.27:0/877906852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574009370 con 0x7f05800691f0 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585698700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05800c60f0 0x7f05800c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f0585e99700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 0x7f05800a92f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f057800d180 tx=0x7f05780099f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800de20 con 0x7f05800691f0 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057800f040 con 0x7f05800691f0 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578013600 con 0x7f05800691f0 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.714+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05800c35e0 con 0x7f05800691f0 2023-05-17T14:53:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.715+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05800c42d0 con 0x7f05800691f0 2023-05-17T14:53:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.715+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05800adf00 con 0x7f05800691f0 2023-05-17T14:53:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.716+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f05780139f0 con 0x7f05800691f0 2023-05-17T14:53:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.716+0000 7f057dffb700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f056c05ed90 0x7f056c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.716+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f057807a040 con 0x7f05800691f0 2023-05-17T14:53:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.716+0000 7f0585698700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f056c05ed90 0x7f056c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:49.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.716+0000 7f0585698700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f056c05ed90 0x7f056c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f05800ca830 tx=0x7f0574017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.720+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f057804b930 con 0x7f05800691f0 2023-05-17T14:53:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.892+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05800c4550 con 0x7f05800691f0 2023-05-17T14:53:49.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.892+0000 7f057dffb700 1 -- 172.21.15.27:0/877906852 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f057804ef50 con 0x7f05800691f0 2023-05-17T14:53:49.897 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:53:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f056c05ed90 msgr2=0x7f056c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f056c05ed90 0x7f056c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f05800ca830 tx=0x7f0574017000).stop 2023-05-17T14:53:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 msgr2=0x7f05800a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 0x7f05800a92f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f057800d180 tx=0x7f05780099f0).stop 2023-05-17T14:53:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 shutdown_connections 2023-05-17T14:53:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f056c05ed90 0x7f056c061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05801543d0 0x7f0580152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05800691f0 0x7f05800a92f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 --2- 172.21.15.27:0/877906852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05800c60f0 0x7f05800c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 >> 172.21.15.27:0/877906852 conn(0x7f05800cb7f0 msgr2=0x7f05801547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 shutdown_connections 2023-05-17T14:53:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:49.894+0000 7f05880fd700 1 -- 172.21.15.27:0/877906852 wait complete. 2023-05-17T14:53:49.910 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T14:53:50.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.021+0000 7fe9e979e700 1 Processor -- start 2023-05-17T14:53:50.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.021+0000 7fe9e979e700 1 -- start start 2023-05-17T14:53:50.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e979e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9e40c1180 0x7fe9e40c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e979e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 0x7fe9e40c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e979e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e40c07e0 con 0x7fe9e41544f0 2023-05-17T14:53:50.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e979e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e41549b0 con 0x7fe9e40c1180 2023-05-17T14:53:50.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e979e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4154c90 con 0x7fe9e40c1560 2023-05-17T14:53:50.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe9e41544f0 0x7fe9e40a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33206/0 (socket says 172.21.15.27:33206) 2023-05-17T14:53:50.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e37fe700 1 -- 172.21.15.27:0/1018706922 learned_addr learned my addr 172.21.15.27:0/1018706922 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e3fff700 1 --2- 172.21.15.27:0/1018706922 >> v2:172.21.15.40:3300/0 conn(0x7fe9e40c1180 0x7fe9e40c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 0x7fe9e40c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048376685 0 0) 0x7fe9e40c07e0 con 0x7fe9e41544f0 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9cc0033f0 con 0x7fe9e41544f0 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837758807 0 0) 0x7fe9cc0033f0 con 0x7fe9e41544f0 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 msgr2=0x7fe9e40c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 0x7fe9e40c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 >> v2:172.21.15.40:3300/0 conn(0x7fe9e40c1180 msgr2=0x7fe9e40c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.022+0000 7fe9e2ffd700 1 --2- 172.21.15.27:0/1018706922 >> v2:172.21.15.40:3300/0 conn(0x7fe9e40c1180 0x7fe9e40c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4154f70 con 0x7fe9e41544f0 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fe9d8001470 con 0x7fe9e41544f0 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 >> v1:172.21.15.27:6789/0 conn(0x7fe9e41544f0 legacy=0x7fe9e40a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 0x7fe9cc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc003e10 0x7fe9cc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9cc004b80 0x7fe9cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41549b0 con 0x7fe9cc004b80 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4154c90 con 0x7fe9cc003e10 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc00b8e0 con 0x7fe9e40c1560 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9cc004b80 0x7fe9cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e3fff700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 0x7fe9cc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e37fe700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc003e10 0x7fe9cc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 msgr2=0x7fe9cc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e40c1560 0x7fe9cc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc003e10 msgr2=0x7fe9cc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc003e10 0x7fe9cc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/1018706922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0033f0 con 0x7fe9cc004b80 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9cc004b80 0x7fe9cc005000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe9dc00e210 tx=0x7fe9dc00b040).ready entity=mon.0 client_cookie=5f46a2f22fce99ed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc009ac0 con 0x7fe9cc004b80 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc00f040 con 0x7fe9cc004b80 2023-05-17T14:53:50.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.023+0000 7fe9e2ffd700 1 -- 172.21.15.27:0/1018706922 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00ecd0 con 0x7fe9cc004b80 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e979e700 1 -- 172.21.15.27:0/1018706922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9cc004b80 msgr2=0x7fe9cc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e979e700 1 --2- 172.21.15.27:0/1018706922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9cc004b80 0x7fe9cc005000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe9dc00e210 tx=0x7fe9dc00b040).stop 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/1018706922 reap_dead start 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e979e700 1 -- 172.21.15.27:0/1018706922 shutdown_connections 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e979e700 1 -- 172.21.15.27:0/1018706922 >> 172.21.15.27:0/1018706922 conn(0x7fe9e405dd50 msgr2=0x7fe9e405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e979e700 1 -- 172.21.15.27:0/1018706922 shutdown_connections 2023-05-17T14:53:50.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.024+0000 7fe9e979e700 1 -- 172.21.15.27:0/1018706922 wait complete. 2023-05-17T14:53:50.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.025+0000 7fe9e979e700 1 Processor -- start 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.025+0000 7fe9e979e700 1 -- start start 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e979e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e414fb80 0x7fe9e4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e979e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e4158270 0x7fe9e40ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e979e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 0x7fe9e40cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e979e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4159350 con 0x7fe9e40cacc0 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e979e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40cb630 con 0x7fe9e414fb80 2023-05-17T14:53:50.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e979e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4158740 con 0x7fe9e4158270 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 0x7fe9e40cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 0x7fe9e40cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33658/0 (socket says 172.21.15.27:33658) 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/948427731 learned_addr learned my addr 172.21.15.27:0/948427731 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e3fff700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e414fb80 0x7fe9e4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e37fe700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e4158270 0x7fe9e40ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e4158270 msgr2=0x7fe9e40ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e4158270 0x7fe9e40ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e414fb80 msgr2=0x7fe9e4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e414fb80 0x7fe9e4157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 -- 172.21.15.27:0/948427731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4158a20 con 0x7fe9e40cacc0 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9e8f9d700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 0x7fe9e40cb140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe9dc014000 tx=0x7fe9dc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.026+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc021030 con 0x7fe9e40cacc0 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.027+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc009ac0 con 0x7fe9e40cacc0 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.027+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e4158d00 con 0x7fe9e40cacc0 2023-05-17T14:53:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.027+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc013cf0 con 0x7fe9e40cacc0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.027+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e40c89a0 con 0x7fe9e40cacc0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.027+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e41596e0 con 0x7fe9e40cacc0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.028+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe9dc01d610 con 0x7fe9e40cacc0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.029+0000 7fe9cbfff700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe9d005ed90 0x7fe9d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.029+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe9dc022070 con 0x7fe9e40cacc0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.029+0000 7fe9e3fff700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe9d005ed90 0x7fe9d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.029+0000 7fe9e3fff700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe9d005ed90 0x7fe9d0061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe9d4006d80 tx=0x7fe9d4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:50.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.032+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe9dc04d540 con 0x7fe9e40cacc0 2023-05-17T14:53:50.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.208+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe9e41596e0 con 0x7fe9e40cacc0 2023-05-17T14:53:50.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.208+0000 7fe9cbfff700 1 -- 172.21.15.27:0/948427731 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe9e41596e0 con 0x7fe9e40cacc0 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:53:50.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:53:50.215 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T14:53:50.215 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T14:53:50.215 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:53:50.215 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T14:53:50.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe9d005ed90 msgr2=0x7fe9d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe9d005ed90 0x7fe9d0061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe9d4006d80 tx=0x7fe9d4009060).stop 2023-05-17T14:53:50.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 msgr2=0x7fe9e40cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 0x7fe9e40cb140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe9dc014000 tx=0x7fe9dc01a000).stop 2023-05-17T14:53:50.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 shutdown_connections 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe9d005ed90 0x7fe9d0061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9e40cacc0 0x7fe9e40cb140 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e414fb80 0x7fe9e4157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 --2- 172.21.15.27:0/948427731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e4158270 0x7fe9e40ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 >> 172.21.15.27:0/948427731 conn(0x7fe9e405dd50 msgr2=0x7fe9e4152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 shutdown_connections 2023-05-17T14:53:50.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.210+0000 7fe9e979e700 1 -- 172.21.15.27:0/948427731 wait complete. 2023-05-17T14:53:50.227 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T14:53:50.227 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T14:53:50.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.342+0000 7f77cbbdb700 1 Processor -- start 2023-05-17T14:53:50.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.343+0000 7f77cbbdb700 1 -- start start 2023-05-17T14:53:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.343+0000 7f77cbbdb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c4151c90 0x7f77c4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77cbbdb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77c4154980 0x7f77c40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77cbbdb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f77c40c0520 0x7f77c4081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77cbbdb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c4158010 con 0x7f77c40c0520 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77cbbdb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c4154f60 con 0x7f77c4154980 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77cbbdb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4155240 con 0x7f77c4151c90 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f77c40c0520 0x7f77c4081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f77c40c0520 0x7f77c4081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33664/0 (socket says 172.21.15.27:33664) 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 -- 172.21.15.27:0/2247557177 learned_addr learned my addr 172.21.15.27:0/2247557177 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77c9977700 1 --2- 172.21.15.27:0/2247557177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c4151c90 0x7f77c4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77c9176700 1 --2- 172.21.15.27:0/2247557177 >> v2:172.21.15.40:3300/0 conn(0x7f77c4154980 0x7f77c40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 -- 172.21.15.27:0/2247557177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c4151c90 msgr2=0x7f77c4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 --2- 172.21.15.27:0/2247557177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c4151c90 0x7f77c4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 -- 172.21.15.27:0/2247557177 >> v2:172.21.15.40:3300/0 conn(0x7f77c4154980 msgr2=0x7f77c40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 --2- 172.21.15.27:0/2247557177 >> v2:172.21.15.40:3300/0 conn(0x7f77c4154980 0x7f77c40c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 -- 172.21.15.27:0/2247557177 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4155520 con 0x7f77c40c0520 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77ca178700 1 --2- 172.21.15.27:0/2247557177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40c0520 0x7f77c4081fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f77c4084180 tx=0x7f77b4009840).ready entity=mon.0 client_cookie=ddd686f8e717e304 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:50.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77c8975700 1 -- 172.21.15.27:0/2247557177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b400e070 con 0x7f77c40c0520 2023-05-17T14:53:50.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77c8975700 1 -- 172.21.15.27:0/2247557177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b400ba50 con 0x7f77c40c0520 2023-05-17T14:53:50.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.344+0000 7f77c8975700 1 -- 172.21.15.27:0/2247557177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b400bdd0 con 0x7f77c40c0520 2023-05-17T14:53:50.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 -- 172.21.15.27:0/2247557177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40c0520 msgr2=0x7f77c4081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/2247557177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40c0520 0x7f77c4081fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f77c4084180 tx=0x7f77b4009840).stop 2023-05-17T14:53:50.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 -- 172.21.15.27:0/2247557177 shutdown_connections 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/2247557177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40c0520 0x7f77c4081fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/2247557177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c4151c90 0x7f77c4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/2247557177 >> v2:172.21.15.40:3300/0 conn(0x7f77c4154980 0x7f77c40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 -- 172.21.15.27:0/2247557177 >> 172.21.15.27:0/2247557177 conn(0x7f77c40cae10 msgr2=0x7f77c40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 -- 172.21.15.27:0/2247557177 shutdown_connections 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.345+0000 7f77cbbdb700 1 -- 172.21.15.27:0/2247557177 wait complete. 2023-05-17T14:53:50.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.346+0000 7f77cbbdb700 1 Processor -- start 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.346+0000 7f77cbbdb700 1 -- start start 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77cbbdb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c40c0520 0x7f77c4163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77cbbdb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 0x7f77c40ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77cbbdb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c4154980 0x7f77c40addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77cbbdb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c44d0 con 0x7f77c4151c90 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77cbbdb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40af030 con 0x7f77c4154980 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77cbbdb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40aed50 con 0x7f77c40c0520 2023-05-17T14:53:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 0x7f77c40ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 0x7f77c40ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33668/0 (socket says 172.21.15.27:33668) 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 -- 172.21.15.27:0/789487316 learned_addr learned my addr 172.21.15.27:0/789487316 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77ca178700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c4154980 0x7f77c40addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9977700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c40c0520 0x7f77c4163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 -- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c40c0520 msgr2=0x7f77c4163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c40c0520 0x7f77c4163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 -- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c4154980 msgr2=0x7f77c40addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:50.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c4154980 0x7f77c40addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 -- 172.21.15.27:0/789487316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b4009ae0 con 0x7f77c4151c90 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c9176700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 0x7f77c40ae790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f77b800d890 tx=0x7f77b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.347+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800f520 con 0x7f77c4151c90 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.348+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800f680 con 0x7f77c4151c90 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.348+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c40c3e70 con 0x7f77c4151c90 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.348+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800fa00 con 0x7f77c4151c90 2023-05-17T14:53:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.348+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40c2bb0 con 0x7f77c4151c90 2023-05-17T14:53:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.349+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c406bdf0 con 0x7f77c4151c90 2023-05-17T14:53:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.349+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f77b801a030 con 0x7f77c4151c90 2023-05-17T14:53:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.349+0000 7f77c1ffb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f77b005ed90 0x7f77b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.349+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f77b8079230 con 0x7f77c4151c90 2023-05-17T14:53:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.349+0000 7f77c9977700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f77b005ed90 0x7f77b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.350+0000 7f77c9977700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f77b005ed90 0x7f77b0061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f77bc00bba0 tx=0x7f77bc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:50.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.353+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77b804aac0 con 0x7f77c4151c90 2023-05-17T14:53:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:50.531+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f77c4155800 con 0x7f77c4151c90 2023-05-17T14:53:51.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.478+0000 7f77c1ffb700 1 -- 172.21.15.27:0/789487316 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f77b804e0e0 con 0x7f77c4151c90 2023-05-17T14:53:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.481+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f77b005ed90 msgr2=0x7f77b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.481+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f77b005ed90 0x7f77b0061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f77bc00bba0 tx=0x7f77bc008040).stop 2023-05-17T14:53:51.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.481+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 msgr2=0x7f77c40ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.481+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 0x7f77c40ae790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f77b800d890 tx=0x7f77b8008040).stop 2023-05-17T14:53:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.482+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 shutdown_connections 2023-05-17T14:53:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.482+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f77b005ed90 0x7f77b0061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.482+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c4154980 0x7f77c40addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.482+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77c40c0520 0x7f77c4163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.482+0000 7f77cbbdb700 1 --2- 172.21.15.27:0/789487316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c4151c90 0x7f77c40ae790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.482+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 >> 172.21.15.27:0/789487316 conn(0x7f77c40cae10 msgr2=0x7f77c40c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.483+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 shutdown_connections 2023-05-17T14:53:51.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.483+0000 7f77cbbdb700 1 -- 172.21.15.27:0/789487316 wait complete. 2023-05-17T14:53:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T14:53:51.506 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T14:53:51.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.629+0000 7f96a6011700 1 Processor -- start 2023-05-17T14:53:51.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.629+0000 7f96a6011700 1 -- start start 2023-05-17T14:53:51.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f96a6011700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96a01543d0 0x7f96a00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:51.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f96a6011700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96a00c60f0 0x7f96a0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:51.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f96a6011700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00c0c90 con 0x7f96a00691f0 2023-05-17T14:53:51.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f96a6011700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00c1c50 con 0x7f96a01543d0 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f96a6011700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a0158790 con 0x7f96a00c60f0 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96a01543d0 0x7f96a00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96a01543d0 0x7f96a00c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33674/0 (socket says 172.21.15.27:33674) 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f96a00691f0 0x7f96a01547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33238/0 (socket says 172.21.15.27:33238) 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 -- 172.21.15.27:0/2233809583 learned_addr learned my addr 172.21.15.27:0/2233809583 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969effd700 1 --2- 172.21.15.27:0/2233809583 >> v2:172.21.15.40:3300/0 conn(0x7f96a00c60f0 0x7f96a0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 -- 172.21.15.27:0/2233809583 >> v2:172.21.15.40:3300/0 conn(0x7f96a00c60f0 msgr2=0x7f96a0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:51.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 --2- 172.21.15.27:0/2233809583 >> v2:172.21.15.40:3300/0 conn(0x7f96a00c60f0 0x7f96a0068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 -- 172.21.15.27:0/2233809583 >> v1:172.21.15.27:6789/0 conn(0x7f96a00691f0 legacy=0x7f96a01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969f7fe700 1 -- 172.21.15.27:0/2233809583 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a00c6570 con 0x7f96a01543d0 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.630+0000 7f969e7fc700 1 -- 172.21.15.27:0/2233809583 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449842624 0 0) 0x7f96a00c0c90 con 0x7f96a00691f0 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f969f7fe700 1 --2- 172.21.15.27:0/2233809583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a01543d0 0x7f96a00c5c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f96a00c5620 tx=0x7f96900090f0).ready entity=mon.0 client_cookie=e7730365c1ffab62 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f969e7fc700 1 -- 172.21.15.27:0/2233809583 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000b600 con 0x7f96a01543d0 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f969e7fc700 1 -- 172.21.15.27:0/2233809583 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000b760 con 0x7f96a01543d0 2023-05-17T14:53:51.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f969e7fc700 1 -- 172.21.15.27:0/2233809583 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000bae0 con 0x7f96a01543d0 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 -- 172.21.15.27:0/2233809583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a01543d0 msgr2=0x7f96a00c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 --2- 172.21.15.27:0/2233809583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a01543d0 0x7f96a00c5c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f96a00c5620 tx=0x7f96900090f0).stop 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 -- 172.21.15.27:0/2233809583 shutdown_connections 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 --2- 172.21.15.27:0/2233809583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a01543d0 0x7f96a00c5c00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 --2- 172.21.15.27:0/2233809583 >> v2:172.21.15.40:3300/0 conn(0x7f96a00c60f0 0x7f96a0068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 -- 172.21.15.27:0/2233809583 >> 172.21.15.27:0/2233809583 conn(0x7f96a00cb7f0 msgr2=0x7f96a00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 -- 172.21.15.27:0/2233809583 shutdown_connections 2023-05-17T14:53:51.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.631+0000 7f96a6011700 1 -- 172.21.15.27:0/2233809583 wait complete. 2023-05-17T14:53:51.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.632+0000 7f96a6011700 1 Processor -- start 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.632+0000 7f96a6011700 1 -- start start 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f96a6011700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 0x7f96a01488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f96a6011700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00c60f0 0x7f96a00a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f96a6011700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96a01543d0 0x7f96a00aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f96a6011700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0142550 con 0x7f96a00691f0 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f96a6011700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00a9ba0 con 0x7f96a00c60f0 2023-05-17T14:53:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f96a6011700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00b0100 con 0x7f96a01543d0 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f969f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 0x7f96a01488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f969f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 0x7f96a01488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33680/0 (socket says 172.21.15.27:33680) 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.633+0000 7f969f7fe700 1 -- 172.21.15.27:0/753740961 learned_addr learned my addr 172.21.15.27:0/753740961 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969effd700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00c60f0 0x7f96a00a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969ffff700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96a01543d0 0x7f96a00aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969f7fe700 1 -- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96a01543d0 msgr2=0x7f96a00aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969f7fe700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96a01543d0 0x7f96a00aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969f7fe700 1 -- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00c60f0 msgr2=0x7f96a00a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969f7fe700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00c60f0 0x7f96a00a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969f7fe700 1 -- 172.21.15.27:0/753740961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009370 con 0x7f96a00691f0 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969effd700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00c60f0 0x7f96a00a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f969f7fe700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 0x7f96a01488d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f96a0083d00 tx=0x7f9690017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000b8d0 con 0x7f96a00691f0 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000ba30 con 0x7f96a00691f0 2023-05-17T14:53:51.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a00b0590 con 0x7f96a00691f0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969001b640 con 0x7f96a00691f0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.634+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a00af7d0 con 0x7f96a00691f0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.635+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a00b03e0 con 0x7f96a00691f0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.635+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f969000f070 con 0x7f96a00691f0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.636+0000 7f96877fe700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f968c05ed90 0x7f968c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.636+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f969007b170 con 0x7f96a00691f0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.636+0000 7f969effd700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f968c05ed90 0x7f968c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.636+0000 7f969effd700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f968c05ed90 0x7f968c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f96a0165d80 tx=0x7f9694008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:51.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.640+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f969004c8f0 con 0x7f96a00691f0 2023-05-17T14:53:51.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:51.817+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f96a00697d0 con 0x7f96a00691f0 2023-05-17T14:53:52.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.486+0000 7f96877fe700 1 -- 172.21.15.27:0/753740961 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f969004ff10 con 0x7f96a00691f0 2023-05-17T14:53:52.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f968c05ed90 msgr2=0x7f968c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f968c05ed90 0x7f968c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f96a0165d80 tx=0x7f9694008040).stop 2023-05-17T14:53:52.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 msgr2=0x7f96a01488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 0x7f96a01488d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f96a0083d00 tx=0x7f9690017000).stop 2023-05-17T14:53:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 shutdown_connections 2023-05-17T14:53:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f968c05ed90 0x7f968c061250 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0x7f96a0165d80 tx=0x7f9694008040).stop 2023-05-17T14:53:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96a01543d0 0x7f96a00aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96a00691f0 0x7f96a01488d0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0x7f96a0083d00 tx=0x7f9690017000).stop 2023-05-17T14:53:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 --2- 172.21.15.27:0/753740961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00c60f0 0x7f96a00a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.490+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 >> 172.21.15.27:0/753740961 conn(0x7f96a00cb7f0 msgr2=0x7f96a0157030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:52.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.495+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 shutdown_connections 2023-05-17T14:53:52.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.496+0000 7f96a6011700 1 -- 172.21.15.27:0/753740961 wait complete. 2023-05-17T14:53:52.508 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T14:53:52.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T14:53:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.647+0000 7fa897b56700 1 Processor -- start 2023-05-17T14:53:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.647+0000 7fa897b56700 1 -- start start 2023-05-17T14:53:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa897b56700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8901543d0 0x7fa8900c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa897b56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8900c60f0 0x7fa890068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa897b56700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa8900691f0 0x7fa8901547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa897b56700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900c1c50 con 0x7fa8900691f0 2023-05-17T14:53:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa897b56700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890158790 con 0x7fa8901543d0 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa897b56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c6570 con 0x7fa8900c60f0 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa8900691f0 0x7fa8901547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa8900691f0 0x7fa8901547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33692/0 (socket says 172.21.15.27:33692) 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 -- 172.21.15.27:0/2114154213 learned_addr learned my addr 172.21.15.27:0/2114154213 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8958f2700 1 --2- 172.21.15.27:0/2114154213 >> v2:172.21.15.40:3300/0 conn(0x7fa8901543d0 0x7fa8900c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8950f1700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8900c60f0 0x7fa890068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 -- 172.21.15.27:0/2114154213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8900c60f0 msgr2=0x7fa890068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8900c60f0 0x7fa890068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 -- 172.21.15.27:0/2114154213 >> v2:172.21.15.40:3300/0 conn(0x7fa8901543d0 msgr2=0x7fa8900c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 --2- 172.21.15.27:0/2114154213 >> v2:172.21.15.40:3300/0 conn(0x7fa8901543d0 0x7fa8900c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 -- 172.21.15.27:0/2114154213 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890157e60 con 0x7fa8900691f0 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8950f1700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8900c60f0 0x7fa890068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8960f3700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900691f0 0x7fa8901547b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa890155970 tx=0x7fa8800090f0).ready entity=mon.0 client_cookie=b50da677d2244d98 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8948f0700 1 -- 172.21.15.27:0/2114154213 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000b520 con 0x7fa8900691f0 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8948f0700 1 -- 172.21.15.27:0/2114154213 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000b680 con 0x7fa8900691f0 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.648+0000 7fa8948f0700 1 -- 172.21.15.27:0/2114154213 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000ba00 con 0x7fa8900691f0 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 -- 172.21.15.27:0/2114154213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900691f0 msgr2=0x7fa8901547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900691f0 0x7fa8901547b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa890155970 tx=0x7fa8800090f0).stop 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 -- 172.21.15.27:0/2114154213 shutdown_connections 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900691f0 0x7fa8901547b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 --2- 172.21.15.27:0/2114154213 >> v2:172.21.15.40:3300/0 conn(0x7fa8901543d0 0x7fa8900c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 --2- 172.21.15.27:0/2114154213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8900c60f0 0x7fa890068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 -- 172.21.15.27:0/2114154213 >> 172.21.15.27:0/2114154213 conn(0x7fa8900cb7f0 msgr2=0x7fa8900c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:52.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 -- 172.21.15.27:0/2114154213 shutdown_connections 2023-05-17T14:53:52.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.649+0000 7fa897b56700 1 -- 172.21.15.27:0/2114154213 wait complete. 2023-05-17T14:53:52.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.650+0000 7fa897b56700 1 Processor -- start 2023-05-17T14:53:52.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.650+0000 7fa897b56700 1 -- start start 2023-05-17T14:53:52.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900691f0 0x7fa8900c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 0x7fa8900b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8901543d0 0x7fa8900c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900b0e00 con 0x7fa8900c60f0 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c3040 con 0x7fa8900691f0 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c39c0 con 0x7fa8901543d0 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 0x7fa8900b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 0x7fa8900b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33696/0 (socket says 172.21.15.27:33696) 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 -- 172.21.15.27:0/1611085128 learned_addr learned my addr 172.21.15.27:0/1611085128 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:52.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8958f2700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900691f0 0x7fa8900c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8960f3700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8901543d0 0x7fa8900c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 -- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8901543d0 msgr2=0x7fa8900c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8901543d0 0x7fa8900c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 -- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900691f0 msgr2=0x7fa8900c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900691f0 0x7fa8900c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 -- 172.21.15.27:0/1611085128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880009370 con 0x7fa8900c60f0 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa8950f1700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 0x7fa8900b0910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa88400d890 tx=0x7fa884008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:52.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884011590 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840116f0 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900c2430 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.651+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884011a70 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.652+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900c29f0 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.652+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8900c31b0 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.653+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa88401c460 con 0x7fa8900c60f0 2023-05-17T14:53:52.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.653+0000 7fa88dffb700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa87c05ed90 0x7fa87c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:52.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.653+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fa8840799b0 con 0x7fa8900c60f0 2023-05-17T14:53:52.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.653+0000 7fa8958f2700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa87c05ed90 0x7fa87c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:52.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.653+0000 7fa8958f2700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa87c05ed90 0x7fa87c061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa888009fd0 tx=0x7fa88800b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:52.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.657+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa88404af50 con 0x7fa8900c60f0 2023-05-17T14:53:52.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.872+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa890158140 con 0x7fa8900c60f0 2023-05-17T14:53:52.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.880+0000 7fa88dffb700 1 -- 172.21.15.27:0/1611085128 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa88404e570 con 0x7fa8900c60f0 2023-05-17T14:53:52.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.883+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa87c05ed90 msgr2=0x7fa87c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.883+0000 7fa897b56700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa87c05ed90 0x7fa87c061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa888009fd0 tx=0x7fa88800b040).stop 2023-05-17T14:53:52.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.883+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 msgr2=0x7fa8900b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:52.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.883+0000 7fa897b56700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 0x7fa8900b0910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa88400d890 tx=0x7fa884008040).stop 2023-05-17T14:53:52.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 shutdown_connections 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa87c05ed90 0x7fa87c061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8901543d0 0x7fa8900c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900691f0 0x7fa8900c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 --2- 172.21.15.27:0/1611085128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8900c60f0 0x7fa8900b0910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 >> 172.21.15.27:0/1611085128 conn(0x7fa8900cb7f0 msgr2=0x7fa8900accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 shutdown_connections 2023-05-17T14:53:52.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:52.886+0000 7fa897b56700 1 -- 172.21.15.27:0/1611085128 wait complete. 2023-05-17T14:53:52.892 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 3 and data pool 4 2023-05-17T14:53:52.913 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:53.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.023+0000 7f39ae838700 1 Processor -- start 2023-05-17T14:53:53.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.023+0000 7f39ae838700 1 -- start start 2023-05-17T14:53:53.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39ae838700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39a80c6310 0x7f39a8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39ae838700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39ae838700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a80bfcd0 con 0x7f39a80c5f30 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39ae838700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80c0290 con 0x7f39a80c6310 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39ae838700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80aa1a0 con 0x7f39a81541c0 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39acdd5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39a77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39a80c6310 0x7f39a8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39a7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f39a80c5f30 0x7f39a8158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:39278/0 (socket says 172.21.15.27:39278) 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39a77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39a80c6310 0x7f39a8153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:51648/0 (socket says 172.21.15.27:51648) 2023-05-17T14:53:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.024+0000 7f39a7fff700 1 -- 172.21.15.27:0/3685668802 learned_addr learned my addr 172.21.15.27:0/3685668802 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a6ffd700 1 -- 172.21.15.27:0/3685668802 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600792857 0 0) 0x7f39a80bfcd0 con 0x7f39a80c5f30 2023-05-17T14:53:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a6ffd700 1 -- 172.21.15.27:0/3685668802 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39940033f0 con 0x7f39a80c5f30 2023-05-17T14:53:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a77fe700 1 -- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 msgr2=0x7f39a80c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a77fe700 1 --2- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a77fe700 1 -- 172.21.15.27:0/3685668802 >> v1:172.21.15.40:6789/0 conn(0x7f39a80c5f30 legacy=0x7f39a8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a77fe700 1 -- 172.21.15.27:0/3685668802 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80aa480 con 0x7f39a80c6310 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39acdd5700 1 --2- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a77fe700 1 --2- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c6310 0x7f39a8153cd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3998009760 tx=0x7f3998009060).ready entity=mon.1 client_cookie=e05231ac673117f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a6ffd700 1 -- 172.21.15.27:0/3685668802 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800d4a0 con 0x7f39a80c6310 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a6ffd700 1 -- 172.21.15.27:0/3685668802 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800d600 con 0x7f39a80c6310 2023-05-17T14:53:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.025+0000 7f39a6ffd700 1 -- 172.21.15.27:0/3685668802 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800d980 con 0x7f39a80c6310 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 -- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c6310 msgr2=0x7f39a8153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 --2- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c6310 0x7f39a8153cd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3998009760 tx=0x7f3998009060).stop 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 -- 172.21.15.27:0/3685668802 shutdown_connections 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 --2- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 --2- 172.21.15.27:0/3685668802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c6310 0x7f39a8153cd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 -- 172.21.15.27:0/3685668802 >> 172.21.15.27:0/3685668802 conn(0x7f39a8069e70 msgr2=0x7f39a805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 -- 172.21.15.27:0/3685668802 shutdown_connections 2023-05-17T14:53:53.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.026+0000 7f39ae838700 1 -- 172.21.15.27:0/3685668802 wait complete. 2023-05-17T14:53:53.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.027+0000 7f39ae838700 1 Processor -- start 2023-05-17T14:53:53.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.027+0000 7f39ae838700 1 -- start start 2023-05-17T14:53:53.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c5f30 0x7f39a8150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 0x7f39a8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8153740 con 0x7f39a80c6310 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a81509d0 con 0x7f39a80c5f30 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80ac1c0 con 0x7f39a81541c0 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 0x7f39a8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 0x7f39a8153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33722/0 (socket says 172.21.15.27:33722) 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 -- 172.21.15.27:0/1228636094 learned_addr learned my addr 172.21.15.27:0/1228636094 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:53.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a7fff700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c5f30 0x7f39a8150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39acdd5700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 -- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 msgr2=0x7f39a80b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 -- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c5f30 msgr2=0x7f39a8150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c5f30 0x7f39a8150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 -- 172.21.15.27:0/1228636094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a0009a20 con 0x7f39a80c6310 2023-05-17T14:53:53.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39acdd5700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39a77fe700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 0x7f39a8153250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3998009d50 tx=0x7f3998016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998000c90 con 0x7f39a80c6310 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800d770 con 0x7f39a80c6310 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39980092a0 con 0x7f39a80c6310 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.028+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399801d430 con 0x7f39a80c6310 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.029+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80ac780 con 0x7f39a80c6310 2023-05-17T14:53:53.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.029+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a805f4a0 con 0x7f39a80c6310 2023-05-17T14:53:53.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.030+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f399800f070 con 0x7f39a80c6310 2023-05-17T14:53:53.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.030+0000 7f399ffff700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f398805ed60 0x7f3988061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.030+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f399807b3e0 con 0x7f39a80c6310 2023-05-17T14:53:53.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.030+0000 7f39a7fff700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f398805ed60 0x7f3988061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.031+0000 7f39a7fff700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f398805ed60 0x7f3988061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3990007fd0 tx=0x7f3990009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.034+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f399804c870 con 0x7f39a80c6310 2023-05-17T14:53:53.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.210+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39a806bdf0 con 0x7f39a80c6310 2023-05-17T14:53:53.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.211+0000 7f399ffff700 1 -- 172.21.15.27:0/1228636094 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f399804fe90 con 0x7f39a80c6310 2023-05-17T14:53:53.216 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:53.217 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":21,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:52.874627+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:53.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f398805ed60 msgr2=0x7f3988061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f398805ed60 0x7f3988061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3990007fd0 tx=0x7f3990009040).stop 2023-05-17T14:53:53.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 msgr2=0x7f39a8153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 0x7f39a8153250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3998009d50 tx=0x7f3998016000).stop 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 shutdown_connections 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f398805ed60 0x7f3988061220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39a81541c0 0x7f39a80b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a80c5f30 0x7f39a8150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 --2- 172.21.15.27:0/1228636094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39a80c6310 0x7f39a8153250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 >> 172.21.15.27:0/1228636094 conn(0x7f39a8069e70 msgr2=0x7f39a80cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 shutdown_connections 2023-05-17T14:53:53.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.213+0000 7f39ae838700 1 -- 172.21.15.27:0/1228636094 wait complete. 2023-05-17T14:53:53.230 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.341+0000 7fc1d59ba700 1 Processor -- start 2023-05-17T14:53:53.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.341+0000 7fc1d59ba700 1 -- start start 2023-05-17T14:53:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1d59ba700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1d00cb470 0x7fc1d00c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1d59ba700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00c05f0 con 0x7fc1d0153bf0 2023-05-17T14:53:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1d59ba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00aa510 con 0x7fc1d00c5ef0 2023-05-17T14:53:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1d59ba700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00bfcc0 con 0x7fc1d00cb470 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1ce7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1d00cb470 0x7fc1d00c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1cf7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc1d0153bf0 0x7fc1d0154080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33290/0 (socket says 172.21.15.27:33290) 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1cf7fe700 1 -- 172.21.15.27:0/4152585888 learned_addr learned my addr 172.21.15.27:0/4152585888 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/4152585888 >> v1:172.21.15.40:6789/0 conn(0x7fc1d00c5ef0 legacy=0x7fc1d00a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/4152585888 >> v1:172.21.15.27:6789/0 conn(0x7fc1d0153bf0 legacy=0x7fc1d0154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/4152585888 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00bffa0 con 0x7fc1d00cb470 2023-05-17T14:53:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1cdffb700 1 -- 172.21.15.27:0/4152585888 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301770610 0 0) 0x7fc1d00c05f0 con 0x7fc1d0153bf0 2023-05-17T14:53:53.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1ce7fc700 1 --2- 172.21.15.27:0/4152585888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d00c62d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc1b8009760 tx=0x7fc1b8009060).ready entity=mon.0 client_cookie=1874e234618a9b6a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1cdffb700 1 -- 172.21.15.27:0/4152585888 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800b520 con 0x7fc1d00cb470 2023-05-17T14:53:53.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1cdffb700 1 -- 172.21.15.27:0/4152585888 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800b680 con 0x7fc1d00cb470 2023-05-17T14:53:53.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.342+0000 7fc1cdffb700 1 -- 172.21.15.27:0/4152585888 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800ba00 con 0x7fc1d00cb470 2023-05-17T14:53:53.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 -- 172.21.15.27:0/4152585888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 msgr2=0x7fc1d00c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/4152585888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d00c62d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc1b8009760 tx=0x7fc1b8009060).stop 2023-05-17T14:53:53.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 -- 172.21.15.27:0/4152585888 shutdown_connections 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/4152585888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d00c62d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 -- 172.21.15.27:0/4152585888 >> 172.21.15.27:0/4152585888 conn(0x7fc1d005e810 msgr2=0x7fc1d00cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 -- 172.21.15.27:0/4152585888 shutdown_connections 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.343+0000 7fc1d59ba700 1 -- 172.21.15.27:0/4152585888 wait complete. 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.344+0000 7fc1d59ba700 1 Processor -- start 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.344+0000 7fc1d59ba700 1 -- start start 2023-05-17T14:53:53.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1d59ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1d00c5ef0 0x7fc1d0165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1d59ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d01685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1d59ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1d0153bf0 0x7fc1d00aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1d59ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0154310 con 0x7fc1d00cb470 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1d59ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0164ce0 con 0x7fc1d00c5ef0 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1d59ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0168a90 con 0x7fc1d0153bf0 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d01685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d01685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33734/0 (socket says 172.21.15.27:33734) 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/2863835924 learned_addr learned my addr 172.21.15.27:0/2863835924 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1cf7fe700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1d0153bf0 0x7fc1d00aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ceffd700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1d00c5ef0 0x7fc1d0165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1d0153bf0 msgr2=0x7fc1d00aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1d0153bf0 0x7fc1d00aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1d00c5ef0 msgr2=0x7fc1d0165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1d00c5ef0 0x7fc1d0165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/2863835924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80092a0 con 0x7fc1d00cb470 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ceffd700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1d00c5ef0 0x7fc1d0165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1ce7fc700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d01685a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc1d0083d40 tx=0x7fc1b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800b7f0 con 0x7fc1d00cb470 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.345+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800b950 con 0x7fc1d00cb470 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.346+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b801b660 con 0x7fc1d00cb470 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.346+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0155b60 con 0x7fc1d00cb470 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.346+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d0164970 con 0x7fc1d00cb470 2023-05-17T14:53:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.346+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d005f4a0 con 0x7fc1d00cb470 2023-05-17T14:53:53.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.347+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc1b802b070 con 0x7fc1d00cb470 2023-05-17T14:53:53.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.347+0000 7fc1c6ffd700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1b005ed90 0x7fc1b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.347+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc1b807b5d0 con 0x7fc1d00cb470 2023-05-17T14:53:53.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.347+0000 7fc1ceffd700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1b005ed90 0x7fc1b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.347+0000 7fc1ceffd700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1b005ed90 0x7fc1b0061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc1c8007fd0 tx=0x7fc1c8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.351+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1b804cb70 con 0x7fc1d00cb470 2023-05-17T14:53:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.527+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1d0164b30 con 0x7fc1d00cb470 2023-05-17T14:53:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.528+0000 7fc1c6ffd700 1 -- 172.21.15.27:0/2863835924 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fc1b801f090 con 0x7fc1d00cb470 2023-05-17T14:53:53.533 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:53.533 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":21,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:52.874627+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1b005ed90 msgr2=0x7fc1b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1b005ed90 0x7fc1b0061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc1c8007fd0 tx=0x7fc1c8009040).stop 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 msgr2=0x7fc1d01685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d01685a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc1d0083d40 tx=0x7fc1b8017000).stop 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 shutdown_connections 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1b005ed90 0x7fc1b0061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1d0153bf0 0x7fc1d00aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1d00c5ef0 0x7fc1d0165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 --2- 172.21.15.27:0/2863835924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00cb470 0x7fc1d01685a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 >> 172.21.15.27:0/2863835924 conn(0x7fc1d005e810 msgr2=0x7fc1d014e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 shutdown_connections 2023-05-17T14:53:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.530+0000 7fc1d59ba700 1 -- 172.21.15.27:0/2863835924 wait complete. 2023-05-17T14:53:53.547 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T14:53:53.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.661+0000 7f1a52831700 1 Processor -- start 2023-05-17T14:53:53.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.661+0000 7f1a52831700 1 -- start start 2023-05-17T14:53:53.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a52831700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1a4c1543d0 0x7f1a4c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a52831700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0c60f0 0x7f1a4c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a52831700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0c0c90 con 0x7f1a4c0691f0 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a52831700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0c1c50 con 0x7f1a4c1543d0 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a52831700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c158790 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1a4c1543d0 0x7f1a4c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1a4c1543d0 0x7f1a4c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33740/0 (socket says 172.21.15.27:33740) 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 -- 172.21.15.27:0/2618901446 learned_addr learned my addr 172.21.15.27:0/2618901446 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a50dce700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1a4c0691f0 0x7f1a4c1547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33306/0 (socket says 172.21.15.27:33306) 2023-05-17T14:53:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4b7fe700 1 --2- 172.21.15.27:0/2618901446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0c60f0 0x7f1a4c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 -- 172.21.15.27:0/2618901446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0c60f0 msgr2=0x7f1a4c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 --2- 172.21.15.27:0/2618901446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0c60f0 0x7f1a4c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 -- 172.21.15.27:0/2618901446 >> v1:172.21.15.27:6789/0 conn(0x7f1a4c0691f0 legacy=0x7f1a4c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4affd700 1 -- 172.21.15.27:0/2618901446 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194616035 0 0) 0x7f1a4c0c0c90 con 0x7f1a4c0691f0 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.662+0000 7f1a4bfff700 1 -- 172.21.15.27:0/2618901446 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0c6570 con 0x7f1a4c1543d0 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a4bfff700 1 --2- 172.21.15.27:0/2618901446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c0c5c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1a3c006fd0 tx=0x7f1a3c0090f0).ready entity=mon.0 client_cookie=6a89b38342aba264 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a4affd700 1 -- 172.21.15.27:0/2618901446 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00b600 con 0x7f1a4c1543d0 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a4affd700 1 -- 172.21.15.27:0/2618901446 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c00b760 con 0x7f1a4c1543d0 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a4affd700 1 -- 172.21.15.27:0/2618901446 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00bae0 con 0x7f1a4c1543d0 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 -- 172.21.15.27:0/2618901446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c1543d0 msgr2=0x7f1a4c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 --2- 172.21.15.27:0/2618901446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c0c5c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1a3c006fd0 tx=0x7f1a3c0090f0).stop 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 -- 172.21.15.27:0/2618901446 shutdown_connections 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 --2- 172.21.15.27:0/2618901446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c0c5c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 --2- 172.21.15.27:0/2618901446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0c60f0 0x7f1a4c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 -- 172.21.15.27:0/2618901446 >> 172.21.15.27:0/2618901446 conn(0x7f1a4c0cb7f0 msgr2=0x7f1a4c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 -- 172.21.15.27:0/2618901446 shutdown_connections 2023-05-17T14:53:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.663+0000 7f1a52831700 1 -- 172.21.15.27:0/2618901446 wait complete. 2023-05-17T14:53:53.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.664+0000 7f1a52831700 1 Processor -- start 2023-05-17T14:53:53.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 -- start start 2023-05-17T14:53:53.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0691f0 0x7f1a4c149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 0x7f1a4c1683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0c2c60 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c155460 con 0x7f1a4c1543d0 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a52831700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c154850 con 0x7f1a4c0691f0 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a4b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 0x7f1a4c1683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a4b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 0x7f1a4c1683f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33748/0 (socket says 172.21.15.27:33748) 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a4b7fe700 1 -- 172.21.15.27:0/1315615405 learned_addr learned my addr 172.21.15.27:0/1315615405 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a4bfff700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0691f0 0x7f1a4c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.665+0000 7f1a50dce700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a4b7fe700 1 -- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0691f0 msgr2=0x7f1a4c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a4b7fe700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0691f0 0x7f1a4c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a4b7fe700 1 -- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a4c1543d0 msgr2=0x7f1a4c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a4b7fe700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a4b7fe700 1 -- 172.21.15.27:0/1315615405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009370 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a50dce700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a4b7fe700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 0x7f1a4c1683f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1a3400d890 tx=0x7f1a34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340125f0 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34012750 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c154b30 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34012ad0 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.666+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c1550f0 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.667+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c06bdf0 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.667+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1a34013480 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.668+0000 7f1a43fff700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1a2c05ed90 0x7f1a2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.668+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1a34079dc0 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.668+0000 7f1a4bfff700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1a2c05ed90 0x7f1a2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.668+0000 7f1a4bfff700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1a2c05ed90 0x7f1a2c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1a3c009130 tx=0x7f1a3c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.672+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1a3404b300 con 0x7f1a4c0c60f0 2023-05-17T14:53:53.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:53.894+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1a4c157e60 con 0x7f1a4c0c60f0 2023-05-17T14:53:54.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.886+0000 7f1a43fff700 1 -- 172.21.15.27:0/1315615405 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a3404e920 con 0x7f1a4c0c60f0 2023-05-17T14:53:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1a2c05ed90 msgr2=0x7f1a2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1a2c05ed90 0x7f1a2c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1a3c009130 tx=0x7f1a3c017000).stop 2023-05-17T14:53:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 msgr2=0x7f1a4c1683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 0x7f1a4c1683f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1a3400d890 tx=0x7f1a34008040).stop 2023-05-17T14:53:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 shutdown_connections 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1a2c05ed90 0x7f1a2c061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a4c1543d0 0x7f1a4c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a4c0691f0 0x7f1a4c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 --2- 172.21.15.27:0/1315615405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a4c0c60f0 0x7f1a4c1683f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 >> 172.21.15.27:0/1315615405 conn(0x7f1a4c0cb7f0 msgr2=0x7f1a4c152e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 shutdown_connections 2023-05-17T14:53:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:54.889+0000 7f1a52831700 1 -- 172.21.15.27:0/1315615405 wait complete. 2023-05-17T14:53:54.907 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T14:53:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.029+0000 7fa7c645f700 1 Processor -- start 2023-05-17T14:53:55.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.029+0000 7fa7c645f700 1 -- start start 2023-05-17T14:53:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.029+0000 7fa7c645f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c01543d0 0x7fa7c00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.029+0000 7fa7c645f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7c0069410 0x7fa7c00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c645f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c0158790 con 0x7fa7c00c60f0 2023-05-17T14:53:55.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c645f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c00c1c50 con 0x7fa7c0069410 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c645f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00c6570 con 0x7fa7c01543d0 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7c0069410 0x7fa7c00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7c0069410 0x7fa7c00bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33756/0 (socket says 172.21.15.27:33756) 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 -- 172.21.15.27:0/4139211953 learned_addr learned my addr 172.21.15.27:0/4139211953 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 -- 172.21.15.27:0/4139211953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c01543d0 msgr2=0x7fa7c00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7bffff700 1 --2- 172.21.15.27:0/4139211953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c01543d0 0x7fa7c00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 --2- 172.21.15.27:0/4139211953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c01543d0 0x7fa7c00c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 -- 172.21.15.27:0/4139211953 >> v1:172.21.15.40:6789/0 conn(0x7fa7c00c60f0 legacy=0x7fa7c0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:55.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 -- 172.21.15.27:0/4139211953 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0157e60 con 0x7fa7c0069410 2023-05-17T14:53:55.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7c49fc700 1 --2- 172.21.15.27:0/4139211953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c0069410 0x7fa7c00bfc80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa7b8009f20 tx=0x7fa7b8009840).ready entity=mon.0 client_cookie=520d66cd937c3aaa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:55.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7beffd700 1 -- 172.21.15.27:0/4139211953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800e070 con 0x7fa7c0069410 2023-05-17T14:53:55.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7beffd700 1 -- 172.21.15.27:0/4139211953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b800ba40 con 0x7fa7c0069410 2023-05-17T14:53:55.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.030+0000 7fa7beffd700 1 -- 172.21.15.27:0/4139211953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800bdc0 con 0x7fa7c0069410 2023-05-17T14:53:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 -- 172.21.15.27:0/4139211953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c0069410 msgr2=0x7fa7c00bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 --2- 172.21.15.27:0/4139211953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c0069410 0x7fa7c00bfc80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa7b8009f20 tx=0x7fa7b8009840).stop 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 -- 172.21.15.27:0/4139211953 shutdown_connections 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 --2- 172.21.15.27:0/4139211953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c0069410 0x7fa7c00bfc80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 --2- 172.21.15.27:0/4139211953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c01543d0 0x7fa7c00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 -- 172.21.15.27:0/4139211953 >> 172.21.15.27:0/4139211953 conn(0x7fa7c00cb7f0 msgr2=0x7fa7c00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 -- 172.21.15.27:0/4139211953 shutdown_connections 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.031+0000 7fa7c645f700 1 -- 172.21.15.27:0/4139211953 wait complete. 2023-05-17T14:53:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.032+0000 7fa7c645f700 1 Processor -- start 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.032+0000 7fa7c645f700 1 -- start start 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c645f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c0069410 0x7fa7c0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c645f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c00c60f0 0x7fa7c00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c645f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 0x7fa7c00b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c645f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b0ba0 con 0x7fa7c01543d0 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c645f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b0df0 con 0x7fa7c00c60f0 2023-05-17T14:53:55.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c645f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c01643c0 con 0x7fa7c0069410 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 0x7fa7c00b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 0x7fa7c00b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33762/0 (socket says 172.21.15.27:33762) 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 -- 172.21.15.27:0/2915587961 learned_addr learned my addr 172.21.15.27:0/2915587961 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7bffff700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c0069410 0x7fa7c0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7bf7fe700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c00c60f0 0x7fa7c00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 -- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c0069410 msgr2=0x7fa7c0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c0069410 0x7fa7c0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 -- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c00c60f0 msgr2=0x7fa7c00b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c00c60f0 0x7fa7c00b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 -- 172.21.15.27:0/2915587961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8009ae0 con 0x7fa7c01543d0 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7bf7fe700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c00c60f0 0x7fa7c00b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.033+0000 7fa7c49fc700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 0x7fa7c00b06b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa7c0083d00 tx=0x7fa7b8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.034+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b80092e0 con 0x7fa7c01543d0 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.034+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b801d410 con 0x7fa7c01543d0 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.034+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0165140 con 0x7fa7c01543d0 2023-05-17T14:53:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.034+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b801d7d0 con 0x7fa7c01543d0 2023-05-17T14:53:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.034+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c0164940 con 0x7fa7c01543d0 2023-05-17T14:53:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.034+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c006bdf0 con 0x7fa7c01543d0 2023-05-17T14:53:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.035+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa7b801b040 con 0x7fa7c01543d0 2023-05-17T14:53:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.035+0000 7fa7a7fff700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7ac05ed90 0x7fa7ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.035+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa7b807b760 con 0x7fa7c01543d0 2023-05-17T14:53:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.035+0000 7fa7bffff700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7ac05ed90 0x7fa7ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.036+0000 7fa7bffff700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7ac05ed90 0x7fa7ac061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa7b000ab00 tx=0x7fa7b0006f90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.039+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7b804cd00 con 0x7fa7c01543d0 2023-05-17T14:53:55.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.259+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa7c006bdf0 con 0x7fa7c01543d0 2023-05-17T14:53:55.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.893+0000 7fa7a7fff700 1 -- 172.21.15.27:0/2915587961 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7b8050320 con 0x7fa7c01543d0 2023-05-17T14:53:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7ac05ed90 msgr2=0x7fa7ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7ac05ed90 0x7fa7ac061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa7b000ab00 tx=0x7fa7b0006f90).stop 2023-05-17T14:53:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 msgr2=0x7fa7c00b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 0x7fa7c00b06b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa7c0083d00 tx=0x7fa7b8009840).stop 2023-05-17T14:53:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 shutdown_connections 2023-05-17T14:53:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7ac05ed90 0x7fa7ac061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7c01543d0 0x7fa7c00b06b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c0069410 0x7fa7c0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 --2- 172.21.15.27:0/2915587961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c00c60f0 0x7fa7c00b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:55.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 >> 172.21.15.27:0/2915587961 conn(0x7fa7c00cb7f0 msgr2=0x7fa7c0153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:55.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 shutdown_connections 2023-05-17T14:53:55.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:55.896+0000 7fa7c645f700 1 -- 172.21.15.27:0/2915587961 wait complete. 2023-05-17T14:53:55.914 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:53:56.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 Processor -- start 2023-05-17T14:53:56.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 -- start start 2023-05-17T14:53:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe62814f850 0x7fe628152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe62814fc30 0x7fe6280c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe628152b60 con 0x7fe6280c5040 2023-05-17T14:53:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280a6e70 con 0x7fe62814f850 2023-05-17T14:53:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.032+0000 7fe62e087700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280a7150 con 0x7fe62814fc30 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe62814f850 0x7fe628152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe627fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe6280c5040 0x7fe6280bd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33330/0 (socket says 172.21.15.27:33330) 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe627fff700 1 -- 172.21.15.27:0/1650236428 learned_addr learned my addr 172.21.15.27:0/1650236428 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe626ffd700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe62814fc30 0x7fe6280c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6277fe700 1 -- 172.21.15.27:0/1650236428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe62814fc30 msgr2=0x7fe6280c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6277fe700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe62814fc30 0x7fe6280c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6277fe700 1 -- 172.21.15.27:0/1650236428 >> v1:172.21.15.27:6789/0 conn(0x7fe6280c5040 legacy=0x7fe6280bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6277fe700 1 -- 172.21.15.27:0/1650236428 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628152510 con 0x7fe62814f850 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6267fc700 1 -- 172.21.15.27:0/1650236428 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840150931 0 0) 0x7fe628152b60 con 0x7fe6280c5040 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe626ffd700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe62814fc30 0x7fe6280c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6277fe700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814f850 0x7fe628152ff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe618009760 tx=0x7fe618009060).ready entity=mon.0 client_cookie=2619ce48b80564d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6267fc700 1 -- 172.21.15.27:0/1650236428 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800b580 con 0x7fe62814f850 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6267fc700 1 -- 172.21.15.27:0/1650236428 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61800b6e0 con 0x7fe62814f850 2023-05-17T14:53:56.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.033+0000 7fe6267fc700 1 -- 172.21.15.27:0/1650236428 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800ba60 con 0x7fe62814f850 2023-05-17T14:53:56.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 -- 172.21.15.27:0/1650236428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814f850 msgr2=0x7fe628152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814f850 0x7fe628152ff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe618009760 tx=0x7fe618009060).stop 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 -- 172.21.15.27:0/1650236428 shutdown_connections 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814f850 0x7fe628152ff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 --2- 172.21.15.27:0/1650236428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe62814fc30 0x7fe6280c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 -- 172.21.15.27:0/1650236428 >> 172.21.15.27:0/1650236428 conn(0x7fe6280c8400 msgr2=0x7fe6280c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 -- 172.21.15.27:0/1650236428 shutdown_connections 2023-05-17T14:53:56.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.034+0000 7fe62e087700 1 -- 172.21.15.27:0/1650236428 wait complete. 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.035+0000 7fe62e087700 1 Processor -- start 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.035+0000 7fe62e087700 1 -- start start 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6280c5040 0x7fe62814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe62814f850 0x7fe6280bd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 0x7fe6280bd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280bdc40 con 0x7fe62814fc30 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628150010 con 0x7fe62814f850 2023-05-17T14:53:56.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c2f00 con 0x7fe6280c5040 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 0x7fe6280bd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 0x7fe6280bd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33772/0 (socket says 172.21.15.27:33772) 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 -- 172.21.15.27:0/3457673712 learned_addr learned my addr 172.21.15.27:0/3457673712 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 -- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6280c5040 msgr2=0x7fe62814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6280c5040 0x7fe62814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe626ffd700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe62814f850 0x7fe6280bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 -- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe62814f850 msgr2=0x7fe6280bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe62814f850 0x7fe6280bd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 -- 172.21.15.27:0/3457673712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180092a0 con 0x7fe62814fc30 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe627fff700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 0x7fe6280bd750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe62000c7e0 tx=0x7fe620007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620005d30 con 0x7fe62814fc30 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe620005e90 con 0x7fe62814fc30 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe628157730 con 0x7fe62814fc30 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.036+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620007320 con 0x7fe62814fc30 2023-05-17T14:53:56.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.037+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe628148b00 con 0x7fe62814fc30 2023-05-17T14:53:56.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.038+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe628148d80 con 0x7fe62814fc30 2023-05-17T14:53:56.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.038+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe620010030 con 0x7fe62814fc30 2023-05-17T14:53:56.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.038+0000 7fe60f7fe700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe61405ed90 0x7fe614061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.038+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe620079a20 con 0x7fe62814fc30 2023-05-17T14:53:56.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.038+0000 7fe6277fe700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe61405ed90 0x7fe614061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.039+0000 7fe6277fe700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe61405ed90 0x7fe614061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe61800b340 tx=0x7fe618017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.042+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe62004afc0 con 0x7fe62814fc30 2023-05-17T14:53:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.257+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6280aa4b0 con 0x7fe62814fc30 2023-05-17T14:53:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.258+0000 7fe60f7fe700 1 -- 172.21.15.27:0/3457673712 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7fe62004e5e0 con 0x7fe62814fc30 2023-05-17T14:53:56.262 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:56.262 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:53:56.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe61405ed90 msgr2=0x7fe614061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe61405ed90 0x7fe614061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe61800b340 tx=0x7fe618017000).stop 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 msgr2=0x7fe6280bd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 0x7fe6280bd750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe62000c7e0 tx=0x7fe620007f90).stop 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 shutdown_connections 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe61405ed90 0x7fe614061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe62814fc30 0x7fe6280bd750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6280c5040 0x7fe62814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:53:56.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 --2- 172.21.15.27:0/3457673712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe62814f850 0x7fe6280bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 >> 172.21.15.27:0/3457673712 conn(0x7fe6280c8400 msgr2=0x7fe6280c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:56.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 shutdown_connections 2023-05-17T14:53:56.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.259+0000 7fe62e087700 1 -- 172.21.15.27:0/3457673712 wait complete. 2023-05-17T14:53:56.265 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:53:56.275 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:56.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.387+0000 7ff445552700 1 Processor -- start 2023-05-17T14:53:56.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.387+0000 7ff445552700 1 -- start start 2023-05-17T14:53:56.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff445552700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4400c5f30 0x7ff4400c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff445552700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4401543e0 0x7ff4400c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff445552700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4400bfcd0 con 0x7ff440158880 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff445552700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400c0290 con 0x7ff4400c5f30 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff445552700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400aa1a0 con 0x7ff4401543e0 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4400c5f30 0x7ff4400c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43e7fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff440158880 0x7ff440153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33340/0 (socket says 172.21.15.27:33340) 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43e7fc700 1 -- 172.21.15.27:0/3798333444 learned_addr learned my addr 172.21.15.27:0/3798333444 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43f7fe700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4401543e0 0x7ff4400c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43effd700 1 -- 172.21.15.27:0/3798333444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4401543e0 msgr2=0x7ff4400c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43effd700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4401543e0 0x7ff4400c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43effd700 1 -- 172.21.15.27:0/3798333444 >> v1:172.21.15.27:6789/0 conn(0x7ff440158880 legacy=0x7ff440153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43effd700 1 -- 172.21.15.27:0/3798333444 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400aa480 con 0x7ff4400c5f30 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43dffb700 1 -- 172.21.15.27:0/3798333444 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541287034 0 0) 0x7ff4400bfcd0 con 0x7ff440158880 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43f7fe700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4401543e0 0x7ff4400c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43effd700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4400c5f30 0x7ff4400c6310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff438009e60 tx=0x7ff438009780).ready entity=mon.0 client_cookie=75bdf5a2bd9d2b23 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43dffb700 1 -- 172.21.15.27:0/3798333444 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800e070 con 0x7ff4400c5f30 2023-05-17T14:53:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43dffb700 1 -- 172.21.15.27:0/3798333444 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800bc30 con 0x7ff4400c5f30 2023-05-17T14:53:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.388+0000 7ff43dffb700 1 -- 172.21.15.27:0/3798333444 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438012410 con 0x7ff4400c5f30 2023-05-17T14:53:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 -- 172.21.15.27:0/3798333444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4400c5f30 msgr2=0x7ff4400c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4400c5f30 0x7ff4400c6310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff438009e60 tx=0x7ff438009780).stop 2023-05-17T14:53:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 -- 172.21.15.27:0/3798333444 shutdown_connections 2023-05-17T14:53:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4401543e0 0x7ff4400c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 --2- 172.21.15.27:0/3798333444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4400c5f30 0x7ff4400c6310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 -- 172.21.15.27:0/3798333444 >> 172.21.15.27:0/3798333444 conn(0x7ff440069e70 msgr2=0x7ff44005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 -- 172.21.15.27:0/3798333444 shutdown_connections 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.389+0000 7ff445552700 1 -- 172.21.15.27:0/3798333444 wait complete. 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.390+0000 7ff445552700 1 Processor -- start 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.390+0000 7ff445552700 1 -- start start 2023-05-17T14:53:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff445552700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4400c5f30 0x7ff4400c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff445552700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 0x7ff4400c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff445552700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff440158880 0x7ff4400c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff445552700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c9070 con 0x7ff4401543e0 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff445552700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c1e10 con 0x7ff440158880 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff445552700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff440164cf0 con 0x7ff4400c5f30 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 0x7ff4400c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 0x7ff4400c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33786/0 (socket says 172.21.15.27:33786) 2023-05-17T14:53:56.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 -- 172.21.15.27:0/1482894006 learned_addr learned my addr 172.21.15.27:0/1482894006 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43f7fe700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff440158880 0x7ff4400c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43effd700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4400c5f30 0x7ff4400c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 -- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4400c5f30 msgr2=0x7ff4400c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4400c5f30 0x7ff4400c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 -- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff440158880 msgr2=0x7ff4400c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff440158880 0x7ff4400c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 -- 172.21.15.27:0/1482894006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009a20 con 0x7ff4401543e0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43f7fe700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff440158880 0x7ff4400c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.391+0000 7ff43e7fc700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 0x7ff4400c3c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff428001eb0 tx=0x7ff428007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.392+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280072e0 con 0x7ff4401543e0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.392+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428007440 con 0x7ff4401543e0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.392+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff440164fd0 con 0x7ff4401543e0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.392+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280057a0 con 0x7ff4401543e0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.392+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff440165590 con 0x7ff4401543e0 2023-05-17T14:53:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.393+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4400c1fa0 con 0x7ff4401543e0 2023-05-17T14:53:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.393+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff42801a060 con 0x7ff4401543e0 2023-05-17T14:53:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.393+0000 7ff436ffd700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff42005ed90 0x7ff420061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.393+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff4280792c0 con 0x7ff4401543e0 2023-05-17T14:53:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.393+0000 7ff43effd700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff42005ed90 0x7ff420061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.394+0000 7ff43effd700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff42005ed90 0x7ff420061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff4400c0e60 tx=0x7ff438009780).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.397+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff42804a860 con 0x7ff4401543e0 2023-05-17T14:53:56.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.571+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff44005f4a0 con 0x7ff4401543e0 2023-05-17T14:53:56.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.572+0000 7ff436ffd700 1 -- 172.21.15.27:0/1482894006 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7ff428018020 con 0x7ff4401543e0 2023-05-17T14:53:56.576 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:56.577 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:56.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff42005ed90 msgr2=0x7ff420061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff42005ed90 0x7ff420061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff4400c0e60 tx=0x7ff438009780).stop 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 msgr2=0x7ff4400c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 0x7ff4400c3c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff428001eb0 tx=0x7ff428007e90).stop 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 shutdown_connections 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff42005ed90 0x7ff420061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff440158880 0x7ff4400c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4400c5f30 0x7ff4400c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 --2- 172.21.15.27:0/1482894006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4401543e0 0x7ff4400c3c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 >> 172.21.15.27:0/1482894006 conn(0x7ff440069e70 msgr2=0x7ff4401530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:56.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 shutdown_connections 2023-05-17T14:53:56.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.574+0000 7ff445552700 1 -- 172.21.15.27:0/1482894006 wait complete. 2023-05-17T14:53:56.590 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T14:53:56.590 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T14:53:56.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.702+0000 7f0f018a9700 1 Processor -- start 2023-05-17T14:53:56.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.702+0000 7f0f018a9700 1 -- start start 2023-05-17T14:53:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0f018a9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0efc153cf0 0x7f0efc063d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0f018a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0efc05e460 0x7f0efc0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0f018a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc0bd6a0 con 0x7f0efc1540d0 2023-05-17T14:53:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0f018a9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0c31b0 con 0x7f0efc153cf0 2023-05-17T14:53:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0f018a9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0c3490 con 0x7f0efc05e460 2023-05-17T14:53:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0efaffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0efc153cf0 0x7f0efc063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0efaffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0efc153cf0 0x7f0efc063d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33792/0 (socket says 172.21.15.27:33792) 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0efaffd700 1 -- 172.21.15.27:0/3433620107 learned_addr learned my addr 172.21.15.27:0/3433620107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.703+0000 7f0efb7fe700 1 --2- 172.21.15.27:0/3433620107 >> v2:172.21.15.40:3300/0 conn(0x7f0efc05e460 0x7f0efc0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0efaffd700 1 -- 172.21.15.27:0/3433620107 >> v2:172.21.15.40:3300/0 conn(0x7f0efc05e460 msgr2=0x7f0efc0c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0efaffd700 1 --2- 172.21.15.27:0/3433620107 >> v2:172.21.15.40:3300/0 conn(0x7f0efc05e460 0x7f0efc0c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0efaffd700 1 -- 172.21.15.27:0/3433620107 >> v1:172.21.15.40:6789/0 conn(0x7f0efc1540d0 legacy=0x7f0efc05dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0efaffd700 1 -- 172.21.15.27:0/3433620107 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0c3770 con 0x7f0efc153cf0 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0efaffd700 1 --2- 172.21.15.27:0/3433620107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc153cf0 0x7f0efc063d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0efc0658d0 tx=0x7f0ef4009840).ready entity=mon.0 client_cookie=56815fcc356cb5f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0ef9ffb700 1 -- 172.21.15.27:0/3433620107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef400e070 con 0x7f0efc153cf0 2023-05-17T14:53:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0ef9ffb700 1 -- 172.21.15.27:0/3433620107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef400ba20 con 0x7f0efc153cf0 2023-05-17T14:53:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0ef9ffb700 1 -- 172.21.15.27:0/3433620107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef400bda0 con 0x7f0efc153cf0 2023-05-17T14:53:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 -- 172.21.15.27:0/3433620107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc153cf0 msgr2=0x7f0efc063d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 --2- 172.21.15.27:0/3433620107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc153cf0 0x7f0efc063d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0efc0658d0 tx=0x7f0ef4009840).stop 2023-05-17T14:53:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 -- 172.21.15.27:0/3433620107 shutdown_connections 2023-05-17T14:53:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 --2- 172.21.15.27:0/3433620107 >> v2:172.21.15.40:3300/0 conn(0x7f0efc05e460 0x7f0efc0c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 --2- 172.21.15.27:0/3433620107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc153cf0 0x7f0efc063d20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 -- 172.21.15.27:0/3433620107 >> 172.21.15.27:0/3433620107 conn(0x7f0efc0c7920 msgr2=0x7f0efc0c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 -- 172.21.15.27:0/3433620107 shutdown_connections 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.704+0000 7f0f018a9700 1 -- 172.21.15.27:0/3433620107 wait complete. 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 Processor -- start 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 -- start start 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0efc05e460 0x7f0efc0aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0efc153cf0 0x7f0efc164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 0x7f0efc0a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0a57d0 con 0x7f0efc1540d0 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc165240 con 0x7f0efc153cf0 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0f018a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0a4ec0 con 0x7f0efc05e460 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0efb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 0x7f0efc0a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0efb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 0x7f0efc0a3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33802/0 (socket says 172.21.15.27:33802) 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.706+0000 7f0efb7fe700 1 -- 172.21.15.27:0/381856099 learned_addr learned my addr 172.21.15.27:0/381856099 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efa7fc700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0efc153cf0 0x7f0efc164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efaffd700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0efc05e460 0x7f0efc0aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efb7fe700 1 -- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0efc05e460 msgr2=0x7f0efc0aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efb7fe700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0efc05e460 0x7f0efc0aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efb7fe700 1 -- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0efc153cf0 msgr2=0x7f0efc164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efb7fe700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0efc153cf0 0x7f0efc164d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efb7fe700 1 -- 172.21.15.27:0/381856099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009ae0 con 0x7f0efc1540d0 2023-05-17T14:53:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0efb7fe700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 0x7f0efc0a3a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0eec00e8d0 tx=0x7f0eec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec012600 con 0x7f0efc1540d0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec012760 con 0x7f0efc1540d0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc0ad080 con 0x7f0efc1540d0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec012ae0 con 0x7f0efc1540d0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.707+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc0a5460 con 0x7f0efc1540d0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.708+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc06bdf0 con 0x7f0efc1540d0 2023-05-17T14:53:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.708+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0eec022070 con 0x7f0efc1540d0 2023-05-17T14:53:56.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.709+0000 7f0ef2ffd700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0edc05ed60 0x7f0edc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:56.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.709+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0eec079e40 con 0x7f0efc1540d0 2023-05-17T14:53:56.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.709+0000 7f0efaffd700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0edc05ed60 0x7f0edc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:56.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.709+0000 7f0efaffd700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0edc05ed60 0x7f0edc061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0efc0687e0 tx=0x7f0ef4009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:56.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.713+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0eec04b3e0 con 0x7f0efc1540d0 2023-05-17T14:53:56.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.883+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0efc068e80 con 0x7f0edc05ed60 2023-05-17T14:53:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.893+0000 7f0ef2ffd700 1 -- 172.21.15.27:0/381856099 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336397 (secure 0 0 0) 0x7f0efc068e80 con 0x7f0edc05ed60 2023-05-17T14:53:56.900 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0edc05ed60 msgr2=0x7f0edc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0edc05ed60 0x7f0edc061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0efc0687e0 tx=0x7f0ef4009840).stop 2023-05-17T14:53:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 msgr2=0x7f0efc0a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 0x7f0efc0a3a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0eec00e8d0 tx=0x7f0eec009060).stop 2023-05-17T14:53:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 shutdown_connections 2023-05-17T14:53:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0edc05ed60 0x7f0edc061220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0efc1540d0 0x7f0efc0a3a70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0efc05e460 0x7f0efc0aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 --2- 172.21.15.27:0/381856099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0efc153cf0 0x7f0efc164d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 >> 172.21.15.27:0/381856099 conn(0x7f0efc0c7920 msgr2=0x7f0efc067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 shutdown_connections 2023-05-17T14:53:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:56.896+0000 7f0f018a9700 1 -- 172.21.15.27:0/381856099 wait complete. 2023-05-17T14:53:56.903 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T14:53:56.912 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T14:53:55.561216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41564,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":39680,"kb_avail":754933156,"statfs":{"total":773094113280,"available":773051551744,"internally_reserved":0,"allocated":1863680,"data_stored":667196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40632320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897717+0000","last_change":"2023-05-17T14:53:52.897717+0000","last_active":"2023-05-17T14:53:52.897717+0000","last_peered":"2023-05-17T14:53:52.897717+0000","last_clean":"2023-05-17T14:53:52.897717+0000","last_became_active":"2023-05-17T14:53:52.897401+0000","last_became_peered":"2023-05-17T14:53:52.897401+0000","last_unstale":"2023-05-17T14:53:52.897717+0000","last_undegraded":"2023-05-17T14:53:52.897717+0000","last_fullsized":"2023-05-17T14:53:52.897717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892623+0000","last_change":"2023-05-17T14:53:52.497633+0000","last_active":"2023-05-17T14:53:52.892623+0000","last_peered":"2023-05-17T14:53:52.892623+0000","last_clean":"2023-05-17T14:53:52.892623+0000","last_became_active":"2023-05-17T14:53:52.497319+0000","last_became_peered":"2023-05-17T14:53:52.497319+0000","last_unstale":"2023-05-17T14:53:52.892623+0000","last_undegraded":"2023-05-17T14:53:52.892623+0000","last_fullsized":"2023-05-17T14:53:52.892623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905474+0000","last_change":"2023-05-17T14:53:52.903639+0000","last_active":"2023-05-17T14:53:52.905474+0000","last_peered":"2023-05-17T14:53:52.905474+0000","last_clean":"2023-05-17T14:53:52.905474+0000","last_became_active":"2023-05-17T14:53:52.903343+0000","last_became_peered":"2023-05-17T14:53:52.903343+0000","last_unstale":"2023-05-17T14:53:52.905474+0000","last_undegraded":"2023-05-17T14:53:52.905474+0000","last_fullsized":"2023-05-17T14:53:52.905474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.515373+0000","last_change":"2023-05-17T14:53:52.513391+0000","last_active":"2023-05-17T14:53:52.515373+0000","last_peered":"2023-05-17T14:53:52.515373+0000","last_clean":"2023-05-17T14:53:52.515373+0000","last_became_active":"2023-05-17T14:53:52.513085+0000","last_became_peered":"2023-05-17T14:53:52.513085+0000","last_unstale":"2023-05-17T14:53:52.515373+0000","last_undegraded":"2023-05-17T14:53:52.515373+0000","last_fullsized":"2023-05-17T14:53:52.515373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901401+0000","last_change":"2023-05-17T14:53:52.898454+0000","last_active":"2023-05-17T14:53:52.901401+0000","last_peered":"2023-05-17T14:53:52.901401+0000","last_clean":"2023-05-17T14:53:52.901401+0000","last_became_active":"2023-05-17T14:53:52.898174+0000","last_became_peered":"2023-05-17T14:53:52.898174+0000","last_unstale":"2023-05-17T14:53:52.901401+0000","last_undegraded":"2023-05-17T14:53:52.901401+0000","last_fullsized":"2023-05-17T14:53:52.901401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.510476+0000","last_change":"2023-05-17T14:53:52.504777+0000","last_active":"2023-05-17T14:53:52.510476+0000","last_peered":"2023-05-17T14:53:52.510476+0000","last_clean":"2023-05-17T14:53:52.510476+0000","last_became_active":"2023-05-17T14:53:52.504452+0000","last_became_peered":"2023-05-17T14:53:52.504452+0000","last_unstale":"2023-05-17T14:53:52.510476+0000","last_undegraded":"2023-05-17T14:53:52.510476+0000","last_fullsized":"2023-05-17T14:53:52.510476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891991+0000","last_change":"2023-05-17T14:53:52.891991+0000","last_active":"2023-05-17T14:53:52.891991+0000","last_peered":"2023-05-17T14:53:52.891991+0000","last_clean":"2023-05-17T14:53:52.891991+0000","last_became_active":"2023-05-17T14:53:52.891701+0000","last_became_peered":"2023-05-17T14:53:52.891701+0000","last_unstale":"2023-05-17T14:53:52.891991+0000","last_undegraded":"2023-05-17T14:53:52.891991+0000","last_fullsized":"2023-05-17T14:53:52.891991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889899+0000","last_change":"2023-05-17T14:53:52.510727+0000","last_active":"2023-05-17T14:53:52.889899+0000","last_peered":"2023-05-17T14:53:52.889899+0000","last_clean":"2023-05-17T14:53:52.889899+0000","last_became_active":"2023-05-17T14:53:52.510427+0000","last_became_peered":"2023-05-17T14:53:52.510427+0000","last_unstale":"2023-05-17T14:53:52.889899+0000","last_undegraded":"2023-05-17T14:53:52.889899+0000","last_fullsized":"2023-05-17T14:53:52.889899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897836+0000","last_change":"2023-05-17T14:53:52.897836+0000","last_active":"2023-05-17T14:53:52.897836+0000","last_peered":"2023-05-17T14:53:52.897836+0000","last_clean":"2023-05-17T14:53:52.897836+0000","last_became_active":"2023-05-17T14:53:52.897537+0000","last_became_peered":"2023-05-17T14:53:52.897537+0000","last_unstale":"2023-05-17T14:53:52.897836+0000","last_undegraded":"2023-05-17T14:53:52.897836+0000","last_fullsized":"2023-05-17T14:53:52.897836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892163+0000","last_change":"2023-05-17T14:53:52.506710+0000","last_active":"2023-05-17T14:53:52.892163+0000","last_peered":"2023-05-17T14:53:52.892163+0000","last_clean":"2023-05-17T14:53:52.892163+0000","last_became_active":"2023-05-17T14:53:52.506388+0000","last_became_peered":"2023-05-17T14:53:52.506388+0000","last_unstale":"2023-05-17T14:53:52.892163+0000","last_undegraded":"2023-05-17T14:53:52.892163+0000","last_fullsized":"2023-05-17T14:53:52.892163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897342+0000","last_change":"2023-05-17T14:53:52.897342+0000","last_active":"2023-05-17T14:53:52.897342+0000","last_peered":"2023-05-17T14:53:52.897342+0000","last_clean":"2023-05-17T14:53:52.897342+0000","last_became_active":"2023-05-17T14:53:52.897001+0000","last_became_peered":"2023-05-17T14:53:52.897001+0000","last_unstale":"2023-05-17T14:53:52.897342+0000","last_undegraded":"2023-05-17T14:53:52.897342+0000","last_fullsized":"2023-05-17T14:53:52.897342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907466+0000","last_change":"2023-05-17T14:53:52.512698+0000","last_active":"2023-05-17T14:53:52.907466+0000","last_peered":"2023-05-17T14:53:52.907466+0000","last_clean":"2023-05-17T14:53:52.907466+0000","last_became_active":"2023-05-17T14:53:52.512388+0000","last_became_peered":"2023-05-17T14:53:52.512388+0000","last_unstale":"2023-05-17T14:53:52.907466+0000","last_undegraded":"2023-05-17T14:53:52.907466+0000","last_fullsized":"2023-05-17T14:53:52.907466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907123+0000","last_change":"2023-05-17T14:53:52.902935+0000","last_active":"2023-05-17T14:53:52.907123+0000","last_peered":"2023-05-17T14:53:52.907123+0000","last_clean":"2023-05-17T14:53:52.907123+0000","last_became_active":"2023-05-17T14:53:52.902576+0000","last_became_peered":"2023-05-17T14:53:52.902576+0000","last_unstale":"2023-05-17T14:53:52.907123+0000","last_undegraded":"2023-05-17T14:53:52.907123+0000","last_fullsized":"2023-05-17T14:53:52.907123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904663+0000","last_change":"2023-05-17T14:53:52.505380+0000","last_active":"2023-05-17T14:53:52.904663+0000","last_peered":"2023-05-17T14:53:52.904663+0000","last_clean":"2023-05-17T14:53:52.904663+0000","last_became_active":"2023-05-17T14:53:52.505079+0000","last_became_peered":"2023-05-17T14:53:52.505079+0000","last_unstale":"2023-05-17T14:53:52.904663+0000","last_undegraded":"2023-05-17T14:53:52.904663+0000","last_fullsized":"2023-05-17T14:53:52.904663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899688+0000","last_change":"2023-05-17T14:53:52.899688+0000","last_active":"2023-05-17T14:53:52.899688+0000","last_peered":"2023-05-17T14:53:52.899688+0000","last_clean":"2023-05-17T14:53:52.899688+0000","last_became_active":"2023-05-17T14:53:52.899370+0000","last_became_peered":"2023-05-17T14:53:52.899370+0000","last_unstale":"2023-05-17T14:53:52.899688+0000","last_undegraded":"2023-05-17T14:53:52.899688+0000","last_fullsized":"2023-05-17T14:53:52.899688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901968+0000","last_change":"2023-05-17T14:53:52.511747+0000","last_active":"2023-05-17T14:53:52.901968+0000","last_peered":"2023-05-17T14:53:52.901968+0000","last_clean":"2023-05-17T14:53:52.901968+0000","last_became_active":"2023-05-17T14:53:52.511252+0000","last_became_peered":"2023-05-17T14:53:52.511252+0000","last_unstale":"2023-05-17T14:53:52.901968+0000","last_undegraded":"2023-05-17T14:53:52.901968+0000","last_fullsized":"2023-05-17T14:53:52.901968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905393+0000","last_change":"2023-05-17T14:53:52.897006+0000","last_active":"2023-05-17T14:53:52.905393+0000","last_peered":"2023-05-17T14:53:52.905393+0000","last_clean":"2023-05-17T14:53:52.905393+0000","last_became_active":"2023-05-17T14:53:52.896750+0000","last_became_peered":"2023-05-17T14:53:52.896750+0000","last_unstale":"2023-05-17T14:53:52.905393+0000","last_undegraded":"2023-05-17T14:53:52.905393+0000","last_fullsized":"2023-05-17T14:53:52.905393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885046+0000","last_change":"2023-05-17T14:53:52.509606+0000","last_active":"2023-05-17T14:53:52.885046+0000","last_peered":"2023-05-17T14:53:52.885046+0000","last_clean":"2023-05-17T14:53:52.885046+0000","last_became_active":"2023-05-17T14:53:52.509314+0000","last_became_peered":"2023-05-17T14:53:52.509314+0000","last_unstale":"2023-05-17T14:53:52.885046+0000","last_undegraded":"2023-05-17T14:53:52.885046+0000","last_fullsized":"2023-05-17T14:53:52.885046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910146+0000","last_change":"2023-05-17T14:53:52.906844+0000","last_active":"2023-05-17T14:53:52.910146+0000","last_peered":"2023-05-17T14:53:52.910146+0000","last_clean":"2023-05-17T14:53:52.910146+0000","last_became_active":"2023-05-17T14:53:52.906538+0000","last_became_peered":"2023-05-17T14:53:52.906538+0000","last_unstale":"2023-05-17T14:53:52.910146+0000","last_undegraded":"2023-05-17T14:53:52.910146+0000","last_fullsized":"2023-05-17T14:53:52.910146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882654+0000","last_change":"2023-05-17T14:53:52.510353+0000","last_active":"2023-05-17T14:53:52.882654+0000","last_peered":"2023-05-17T14:53:52.882654+0000","last_clean":"2023-05-17T14:53:52.882654+0000","last_became_active":"2023-05-17T14:53:52.509900+0000","last_became_peered":"2023-05-17T14:53:52.509900+0000","last_unstale":"2023-05-17T14:53:52.882654+0000","last_undegraded":"2023-05-17T14:53:52.882654+0000","last_fullsized":"2023-05-17T14:53:52.882654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902457+0000","last_change":"2023-05-17T14:53:52.902457+0000","last_active":"2023-05-17T14:53:52.902457+0000","last_peered":"2023-05-17T14:53:52.902457+0000","last_clean":"2023-05-17T14:53:52.902457+0000","last_became_active":"2023-05-17T14:53:52.899322+0000","last_became_peered":"2023-05-17T14:53:52.899322+0000","last_unstale":"2023-05-17T14:53:52.902457+0000","last_undegraded":"2023-05-17T14:53:52.902457+0000","last_fullsized":"2023-05-17T14:53:52.902457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906085+0000","last_change":"2023-05-17T14:53:52.509899+0000","last_active":"2023-05-17T14:53:52.906085+0000","last_peered":"2023-05-17T14:53:52.906085+0000","last_clean":"2023-05-17T14:53:52.906085+0000","last_became_active":"2023-05-17T14:53:52.509603+0000","last_became_peered":"2023-05-17T14:53:52.509603+0000","last_unstale":"2023-05-17T14:53:52.906085+0000","last_undegraded":"2023-05-17T14:53:52.906085+0000","last_fullsized":"2023-05-17T14:53:52.906085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905607+0000","last_change":"2023-05-17T14:53:52.897908+0000","last_active":"2023-05-17T14:53:52.905607+0000","last_peered":"2023-05-17T14:53:52.905607+0000","last_clean":"2023-05-17T14:53:52.905607+0000","last_became_active":"2023-05-17T14:53:52.896815+0000","last_became_peered":"2023-05-17T14:53:52.896815+0000","last_unstale":"2023-05-17T14:53:52.905607+0000","last_undegraded":"2023-05-17T14:53:52.905607+0000","last_fullsized":"2023-05-17T14:53:52.905607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902172+0000","last_change":"2023-05-17T14:53:52.511011+0000","last_active":"2023-05-17T14:53:52.902172+0000","last_peered":"2023-05-17T14:53:52.902172+0000","last_clean":"2023-05-17T14:53:52.902172+0000","last_became_active":"2023-05-17T14:53:52.510709+0000","last_became_peered":"2023-05-17T14:53:52.510709+0000","last_unstale":"2023-05-17T14:53:52.902172+0000","last_undegraded":"2023-05-17T14:53:52.902172+0000","last_fullsized":"2023-05-17T14:53:52.902172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908989+0000","last_change":"2023-05-17T14:53:52.904488+0000","last_active":"2023-05-17T14:53:52.908989+0000","last_peered":"2023-05-17T14:53:52.908989+0000","last_clean":"2023-05-17T14:53:52.908989+0000","last_became_active":"2023-05-17T14:53:52.904167+0000","last_became_peered":"2023-05-17T14:53:52.904167+0000","last_unstale":"2023-05-17T14:53:52.908989+0000","last_undegraded":"2023-05-17T14:53:52.908989+0000","last_fullsized":"2023-05-17T14:53:52.908989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902101+0000","last_change":"2023-05-17T14:53:52.509220+0000","last_active":"2023-05-17T14:53:52.902101+0000","last_peered":"2023-05-17T14:53:52.902101+0000","last_clean":"2023-05-17T14:53:52.902101+0000","last_became_active":"2023-05-17T14:53:52.508840+0000","last_became_peered":"2023-05-17T14:53:52.508840+0000","last_unstale":"2023-05-17T14:53:52.902101+0000","last_undegraded":"2023-05-17T14:53:52.902101+0000","last_fullsized":"2023-05-17T14:53:52.902101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909059+0000","last_change":"2023-05-17T14:53:52.904802+0000","last_active":"2023-05-17T14:53:52.909059+0000","last_peered":"2023-05-17T14:53:52.909059+0000","last_clean":"2023-05-17T14:53:52.909059+0000","last_became_active":"2023-05-17T14:53:52.904586+0000","last_became_peered":"2023-05-17T14:53:52.904586+0000","last_unstale":"2023-05-17T14:53:52.909059+0000","last_undegraded":"2023-05-17T14:53:52.909059+0000","last_fullsized":"2023-05-17T14:53:52.909059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883458+0000","last_change":"2023-05-17T14:53:52.503482+0000","last_active":"2023-05-17T14:53:52.883458+0000","last_peered":"2023-05-17T14:53:52.883458+0000","last_clean":"2023-05-17T14:53:52.883458+0000","last_became_active":"2023-05-17T14:53:52.503210+0000","last_became_peered":"2023-05-17T14:53:52.503210+0000","last_unstale":"2023-05-17T14:53:52.883458+0000","last_undegraded":"2023-05-17T14:53:52.883458+0000","last_fullsized":"2023-05-17T14:53:52.883458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905302+0000","last_change":"2023-05-17T14:53:52.902058+0000","last_active":"2023-05-17T14:53:52.905302+0000","last_peered":"2023-05-17T14:53:52.905302+0000","last_clean":"2023-05-17T14:53:52.905302+0000","last_became_active":"2023-05-17T14:53:52.896933+0000","last_became_peered":"2023-05-17T14:53:52.896933+0000","last_unstale":"2023-05-17T14:53:52.905302+0000","last_undegraded":"2023-05-17T14:53:52.905302+0000","last_fullsized":"2023-05-17T14:53:52.905302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886188+0000","last_change":"2023-05-17T14:53:52.511969+0000","last_active":"2023-05-17T14:53:52.886188+0000","last_peered":"2023-05-17T14:53:52.886188+0000","last_clean":"2023-05-17T14:53:52.886188+0000","last_became_active":"2023-05-17T14:53:52.511242+0000","last_became_peered":"2023-05-17T14:53:52.511242+0000","last_unstale":"2023-05-17T14:53:52.886188+0000","last_undegraded":"2023-05-17T14:53:52.886188+0000","last_fullsized":"2023-05-17T14:53:52.886188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909577+0000","last_change":"2023-05-17T14:53:52.907876+0000","last_active":"2023-05-17T14:53:52.909577+0000","last_peered":"2023-05-17T14:53:52.909577+0000","last_clean":"2023-05-17T14:53:52.909577+0000","last_became_active":"2023-05-17T14:53:52.907296+0000","last_became_peered":"2023-05-17T14:53:52.907296+0000","last_unstale":"2023-05-17T14:53:52.909577+0000","last_undegraded":"2023-05-17T14:53:52.909577+0000","last_fullsized":"2023-05-17T14:53:52.909577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879821+0000","last_change":"2023-05-17T14:53:52.511043+0000","last_active":"2023-05-17T14:53:52.879821+0000","last_peered":"2023-05-17T14:53:52.879821+0000","last_clean":"2023-05-17T14:53:52.879821+0000","last_became_active":"2023-05-17T14:53:52.510747+0000","last_became_peered":"2023-05-17T14:53:52.510747+0000","last_unstale":"2023-05-17T14:53:52.879821+0000","last_undegraded":"2023-05-17T14:53:52.879821+0000","last_fullsized":"2023-05-17T14:53:52.879821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909470+0000","last_change":"2023-05-17T14:53:52.906776+0000","last_active":"2023-05-17T14:53:52.909470+0000","last_peered":"2023-05-17T14:53:52.909470+0000","last_clean":"2023-05-17T14:53:52.909470+0000","last_became_active":"2023-05-17T14:53:52.906469+0000","last_became_peered":"2023-05-17T14:53:52.906469+0000","last_unstale":"2023-05-17T14:53:52.909470+0000","last_undegraded":"2023-05-17T14:53:52.909470+0000","last_fullsized":"2023-05-17T14:53:52.909470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888445+0000","last_change":"2023-05-17T14:53:52.499620+0000","last_active":"2023-05-17T14:53:52.888445+0000","last_peered":"2023-05-17T14:53:52.888445+0000","last_clean":"2023-05-17T14:53:52.888445+0000","last_became_active":"2023-05-17T14:53:52.498310+0000","last_became_peered":"2023-05-17T14:53:52.498310+0000","last_unstale":"2023-05-17T14:53:52.888445+0000","last_undegraded":"2023-05-17T14:53:52.888445+0000","last_fullsized":"2023-05-17T14:53:52.888445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908983+0000","last_change":"2023-05-17T14:53:52.903907+0000","last_active":"2023-05-17T14:53:52.908983+0000","last_peered":"2023-05-17T14:53:52.908983+0000","last_clean":"2023-05-17T14:53:52.908983+0000","last_became_active":"2023-05-17T14:53:52.903272+0000","last_became_peered":"2023-05-17T14:53:52.903272+0000","last_unstale":"2023-05-17T14:53:52.908983+0000","last_undegraded":"2023-05-17T14:53:52.908983+0000","last_fullsized":"2023-05-17T14:53:52.908983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896150+0000","last_change":"2023-05-17T14:53:52.496758+0000","last_active":"2023-05-17T14:53:52.896150+0000","last_peered":"2023-05-17T14:53:52.896150+0000","last_clean":"2023-05-17T14:53:52.896150+0000","last_became_active":"2023-05-17T14:53:52.496374+0000","last_became_peered":"2023-05-17T14:53:52.496374+0000","last_unstale":"2023-05-17T14:53:52.896150+0000","last_undegraded":"2023-05-17T14:53:52.896150+0000","last_fullsized":"2023-05-17T14:53:52.896150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893066+0000","last_change":"2023-05-17T14:53:52.893066+0000","last_active":"2023-05-17T14:53:52.893066+0000","last_peered":"2023-05-17T14:53:52.893066+0000","last_clean":"2023-05-17T14:53:52.893066+0000","last_became_active":"2023-05-17T14:53:52.892743+0000","last_became_peered":"2023-05-17T14:53:52.892743+0000","last_unstale":"2023-05-17T14:53:52.893066+0000","last_undegraded":"2023-05-17T14:53:52.893066+0000","last_fullsized":"2023-05-17T14:53:52.893066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.519285+0000","last_change":"2023-05-17T14:53:52.515582+0000","last_active":"2023-05-17T14:53:52.519285+0000","last_peered":"2023-05-17T14:53:52.519285+0000","last_clean":"2023-05-17T14:53:52.519285+0000","last_became_active":"2023-05-17T14:53:52.514941+0000","last_became_peered":"2023-05-17T14:53:52.514941+0000","last_unstale":"2023-05-17T14:53:52.519285+0000","last_undegraded":"2023-05-17T14:53:52.519285+0000","last_fullsized":"2023-05-17T14:53:52.519285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.487277+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T14:53:52.487277+0000","last_peered":"2023-05-17T14:53:52.487277+0000","last_clean":"2023-05-17T14:53:52.487277+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T14:53:52.487277+0000","last_undegraded":"2023-05-17T14:53:52.487277+0000","last_fullsized":"2023-05-17T14:53:52.487277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890966+0000","last_change":"2023-05-17T14:53:52.514000+0000","last_active":"2023-05-17T14:53:52.890966+0000","last_peered":"2023-05-17T14:53:52.890966+0000","last_clean":"2023-05-17T14:53:52.890966+0000","last_became_active":"2023-05-17T14:53:52.512785+0000","last_became_peered":"2023-05-17T14:53:52.512785+0000","last_unstale":"2023-05-17T14:53:52.890966+0000","last_undegraded":"2023-05-17T14:53:52.890966+0000","last_fullsized":"2023-05-17T14:53:52.890966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.898360+0000","last_change":"2023-05-17T14:53:52.898360+0000","last_active":"2023-05-17T14:53:52.898360+0000","last_peered":"2023-05-17T14:53:52.898360+0000","last_clean":"2023-05-17T14:53:52.898360+0000","last_became_active":"2023-05-17T14:53:52.898085+0000","last_became_peered":"2023-05-17T14:53:52.898085+0000","last_unstale":"2023-05-17T14:53:52.898360+0000","last_undegraded":"2023-05-17T14:53:52.898360+0000","last_fullsized":"2023-05-17T14:53:52.898360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886393+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T14:53:52.886393+0000","last_peered":"2023-05-17T14:53:52.886393+0000","last_clean":"2023-05-17T14:53:52.886393+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T14:53:52.886393+0000","last_undegraded":"2023-05-17T14:53:52.886393+0000","last_fullsized":"2023-05-17T14:53:52.886393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894570+0000","last_change":"2023-05-17T14:53:52.504726+0000","last_active":"2023-05-17T14:53:52.894570+0000","last_peered":"2023-05-17T14:53:52.894570+0000","last_clean":"2023-05-17T14:53:52.894570+0000","last_became_active":"2023-05-17T14:53:52.504248+0000","last_became_peered":"2023-05-17T14:53:52.504248+0000","last_unstale":"2023-05-17T14:53:52.894570+0000","last_undegraded":"2023-05-17T14:53:52.894570+0000","last_fullsized":"2023-05-17T14:53:52.894570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894491+0000","last_change":"2023-05-17T14:53:52.894491+0000","last_active":"2023-05-17T14:53:52.894491+0000","last_peered":"2023-05-17T14:53:52.894491+0000","last_clean":"2023-05-17T14:53:52.894491+0000","last_became_active":"2023-05-17T14:53:52.894207+0000","last_became_peered":"2023-05-17T14:53:52.894207+0000","last_unstale":"2023-05-17T14:53:52.894491+0000","last_undegraded":"2023-05-17T14:53:52.894491+0000","last_fullsized":"2023-05-17T14:53:52.894491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900499+0000","last_change":"2023-05-17T14:53:52.900499+0000","last_active":"2023-05-17T14:53:52.900499+0000","last_peered":"2023-05-17T14:53:52.900499+0000","last_clean":"2023-05-17T14:53:52.900499+0000","last_became_active":"2023-05-17T14:53:52.900219+0000","last_became_peered":"2023-05-17T14:53:52.900219+0000","last_unstale":"2023-05-17T14:53:52.900499+0000","last_undegraded":"2023-05-17T14:53:52.900499+0000","last_fullsized":"2023-05-17T14:53:52.900499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885427+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T14:53:52.885427+0000","last_peered":"2023-05-17T14:53:52.885427+0000","last_clean":"2023-05-17T14:53:52.885427+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T14:53:52.885427+0000","last_undegraded":"2023-05-17T14:53:52.885427+0000","last_fullsized":"2023-05-17T14:53:52.885427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.498120+0000","last_change":"2023-05-17T14:53:52.495004+0000","last_active":"2023-05-17T14:53:52.498120+0000","last_peered":"2023-05-17T14:53:52.498120+0000","last_clean":"2023-05-17T14:53:52.498120+0000","last_became_active":"2023-05-17T14:53:52.494690+0000","last_became_peered":"2023-05-17T14:53:52.494690+0000","last_unstale":"2023-05-17T14:53:52.498120+0000","last_undegraded":"2023-05-17T14:53:52.498120+0000","last_fullsized":"2023-05-17T14:53:52.498120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904891+0000","last_change":"2023-05-17T14:53:52.901552+0000","last_active":"2023-05-17T14:53:52.904891+0000","last_peered":"2023-05-17T14:53:52.904891+0000","last_clean":"2023-05-17T14:53:52.904891+0000","last_became_active":"2023-05-17T14:53:52.901241+0000","last_became_peered":"2023-05-17T14:53:52.901241+0000","last_unstale":"2023-05-17T14:53:52.904891+0000","last_undegraded":"2023-05-17T14:53:52.904891+0000","last_fullsized":"2023-05-17T14:53:52.904891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890070+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T14:53:52.890070+0000","last_peered":"2023-05-17T14:53:52.890070+0000","last_clean":"2023-05-17T14:53:52.890070+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T14:53:52.890070+0000","last_undegraded":"2023-05-17T14:53:52.890070+0000","last_fullsized":"2023-05-17T14:53:52.890070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882188+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T14:53:52.882188+0000","last_peered":"2023-05-17T14:53:52.882188+0000","last_clean":"2023-05-17T14:53:52.882188+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T14:53:52.882188+0000","last_undegraded":"2023-05-17T14:53:52.882188+0000","last_fullsized":"2023-05-17T14:53:52.882188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.511579+0000","last_change":"2023-05-17T14:53:52.509749+0000","last_active":"2023-05-17T14:53:52.511579+0000","last_peered":"2023-05-17T14:53:52.511579+0000","last_clean":"2023-05-17T14:53:52.511579+0000","last_became_active":"2023-05-17T14:53:52.509447+0000","last_became_peered":"2023-05-17T14:53:52.509447+0000","last_unstale":"2023-05-17T14:53:52.511579+0000","last_undegraded":"2023-05-17T14:53:52.511579+0000","last_fullsized":"2023-05-17T14:53:52.511579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905144+0000","last_change":"2023-05-17T14:53:52.897391+0000","last_active":"2023-05-17T14:53:52.905144+0000","last_peered":"2023-05-17T14:53:52.905144+0000","last_clean":"2023-05-17T14:53:52.905144+0000","last_became_active":"2023-05-17T14:53:52.897101+0000","last_became_peered":"2023-05-17T14:53:52.897101+0000","last_unstale":"2023-05-17T14:53:52.905144+0000","last_undegraded":"2023-05-17T14:53:52.905144+0000","last_fullsized":"2023-05-17T14:53:52.905144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882503+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T14:53:52.882503+0000","last_peered":"2023-05-17T14:53:52.882503+0000","last_clean":"2023-05-17T14:53:52.882503+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T14:53:52.882503+0000","last_undegraded":"2023-05-17T14:53:52.882503+0000","last_fullsized":"2023-05-17T14:53:52.882503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886662+0000","last_change":"2023-05-17T14:53:52.509023+0000","last_active":"2023-05-17T14:53:52.886662+0000","last_peered":"2023-05-17T14:53:52.886662+0000","last_clean":"2023-05-17T14:53:52.886662+0000","last_became_active":"2023-05-17T14:53:52.508648+0000","last_became_peered":"2023-05-17T14:53:52.508648+0000","last_unstale":"2023-05-17T14:53:52.886662+0000","last_undegraded":"2023-05-17T14:53:52.886662+0000","last_fullsized":"2023-05-17T14:53:52.886662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883453+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T14:53:52.883453+0000","last_peered":"2023-05-17T14:53:52.883453+0000","last_clean":"2023-05-17T14:53:52.883453+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T14:53:52.883453+0000","last_undegraded":"2023-05-17T14:53:52.883453+0000","last_fullsized":"2023-05-17T14:53:52.883453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.500866+0000","last_change":"2023-05-17T14:53:52.496859+0000","last_active":"2023-05-17T14:53:52.500866+0000","last_peered":"2023-05-17T14:53:52.500866+0000","last_clean":"2023-05-17T14:53:52.500866+0000","last_became_active":"2023-05-17T14:53:52.496451+0000","last_became_peered":"2023-05-17T14:53:52.496451+0000","last_unstale":"2023-05-17T14:53:52.500866+0000","last_undegraded":"2023-05-17T14:53:52.500866+0000","last_fullsized":"2023-05-17T14:53:52.500866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905245+0000","last_change":"2023-05-17T14:53:52.901622+0000","last_active":"2023-05-17T14:53:52.905245+0000","last_peered":"2023-05-17T14:53:52.905245+0000","last_clean":"2023-05-17T14:53:52.905245+0000","last_became_active":"2023-05-17T14:53:52.901357+0000","last_became_peered":"2023-05-17T14:53:52.901357+0000","last_unstale":"2023-05-17T14:53:52.905245+0000","last_undegraded":"2023-05-17T14:53:52.905245+0000","last_fullsized":"2023-05-17T14:53:52.905245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902610+0000","last_change":"2023-05-17T14:53:52.512750+0000","last_active":"2023-05-17T14:53:52.902610+0000","last_peered":"2023-05-17T14:53:52.902610+0000","last_clean":"2023-05-17T14:53:52.902610+0000","last_became_active":"2023-05-17T14:53:52.512415+0000","last_became_peered":"2023-05-17T14:53:52.512415+0000","last_unstale":"2023-05-17T14:53:52.902610+0000","last_undegraded":"2023-05-17T14:53:52.902610+0000","last_fullsized":"2023-05-17T14:53:52.902610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.487396+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T14:53:52.487396+0000","last_peered":"2023-05-17T14:53:52.487396+0000","last_clean":"2023-05-17T14:53:52.487396+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T14:53:52.487396+0000","last_undegraded":"2023-05-17T14:53:52.487396+0000","last_fullsized":"2023-05-17T14:53:52.487396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899029+0000","last_change":"2023-05-17T14:53:52.899029+0000","last_active":"2023-05-17T14:53:52.899029+0000","last_peered":"2023-05-17T14:53:52.899029+0000","last_clean":"2023-05-17T14:53:52.899029+0000","last_became_active":"2023-05-17T14:53:52.898737+0000","last_became_peered":"2023-05-17T14:53:52.898737+0000","last_unstale":"2023-05-17T14:53:52.899029+0000","last_undegraded":"2023-05-17T14:53:52.899029+0000","last_fullsized":"2023-05-17T14:53:52.899029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894067+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T14:53:52.894067+0000","last_peered":"2023-05-17T14:53:52.894067+0000","last_clean":"2023-05-17T14:53:52.894067+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T14:53:52.894067+0000","last_undegraded":"2023-05-17T14:53:52.894067+0000","last_fullsized":"2023-05-17T14:53:52.894067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890359+0000","last_change":"2023-05-17T14:53:52.510050+0000","last_active":"2023-05-17T14:53:52.890359+0000","last_peered":"2023-05-17T14:53:52.890359+0000","last_clean":"2023-05-17T14:53:52.890359+0000","last_became_active":"2023-05-17T14:53:52.509746+0000","last_became_peered":"2023-05-17T14:53:52.509746+0000","last_unstale":"2023-05-17T14:53:52.890359+0000","last_undegraded":"2023-05-17T14:53:52.890359+0000","last_fullsized":"2023-05-17T14:53:52.890359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907584+0000","last_change":"2023-05-17T14:53:52.902447+0000","last_active":"2023-05-17T14:53:52.907584+0000","last_peered":"2023-05-17T14:53:52.907584+0000","last_clean":"2023-05-17T14:53:52.907584+0000","last_became_active":"2023-05-17T14:53:52.902177+0000","last_became_peered":"2023-05-17T14:53:52.902177+0000","last_unstale":"2023-05-17T14:53:52.907584+0000","last_undegraded":"2023-05-17T14:53:52.907584+0000","last_fullsized":"2023-05-17T14:53:52.907584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906251+0000","last_change":"2023-05-17T14:53:52.900925+0000","last_active":"2023-05-17T14:53:52.906251+0000","last_peered":"2023-05-17T14:53:52.906251+0000","last_clean":"2023-05-17T14:53:52.906251+0000","last_became_active":"2023-05-17T14:53:52.900643+0000","last_became_peered":"2023-05-17T14:53:52.900643+0000","last_unstale":"2023-05-17T14:53:52.906251+0000","last_undegraded":"2023-05-17T14:53:52.906251+0000","last_fullsized":"2023-05-17T14:53:52.906251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891905+0000","last_change":"2023-05-17T14:53:52.509026+0000","last_active":"2023-05-17T14:53:52.891905+0000","last_peered":"2023-05-17T14:53:52.891905+0000","last_clean":"2023-05-17T14:53:52.891905+0000","last_became_active":"2023-05-17T14:53:52.508652+0000","last_became_peered":"2023-05-17T14:53:52.508652+0000","last_unstale":"2023-05-17T14:53:52.891905+0000","last_undegraded":"2023-05-17T14:53:52.891905+0000","last_fullsized":"2023-05-17T14:53:52.891905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907099+0000","last_change":"2023-05-17T14:53:52.902271+0000","last_active":"2023-05-17T14:53:52.907099+0000","last_peered":"2023-05-17T14:53:52.907099+0000","last_clean":"2023-05-17T14:53:52.907099+0000","last_became_active":"2023-05-17T14:53:52.901952+0000","last_became_peered":"2023-05-17T14:53:52.901952+0000","last_unstale":"2023-05-17T14:53:52.907099+0000","last_undegraded":"2023-05-17T14:53:52.907099+0000","last_fullsized":"2023-05-17T14:53:52.907099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886300+0000","last_change":"2023-05-17T14:53:52.497235+0000","last_active":"2023-05-17T14:53:52.886300+0000","last_peered":"2023-05-17T14:53:52.886300+0000","last_clean":"2023-05-17T14:53:52.886300+0000","last_became_active":"2023-05-17T14:53:52.496955+0000","last_became_peered":"2023-05-17T14:53:52.496955+0000","last_unstale":"2023-05-17T14:53:52.886300+0000","last_undegraded":"2023-05-17T14:53:52.886300+0000","last_fullsized":"2023-05-17T14:53:52.886300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909526+0000","last_change":"2023-05-17T14:53:52.907098+0000","last_active":"2023-05-17T14:53:52.909526+0000","last_peered":"2023-05-17T14:53:52.909526+0000","last_clean":"2023-05-17T14:53:52.909526+0000","last_became_active":"2023-05-17T14:53:52.906769+0000","last_became_peered":"2023-05-17T14:53:52.906769+0000","last_unstale":"2023-05-17T14:53:52.909526+0000","last_undegraded":"2023-05-17T14:53:52.909526+0000","last_fullsized":"2023-05-17T14:53:52.909526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900754+0000","last_change":"2023-05-17T14:53:52.498922+0000","last_active":"2023-05-17T14:53:52.900754+0000","last_peered":"2023-05-17T14:53:52.900754+0000","last_clean":"2023-05-17T14:53:52.900754+0000","last_became_active":"2023-05-17T14:53:52.498588+0000","last_became_peered":"2023-05-17T14:53:52.498588+0000","last_unstale":"2023-05-17T14:53:52.900754+0000","last_undegraded":"2023-05-17T14:53:52.900754+0000","last_fullsized":"2023-05-17T14:53:52.900754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894285+0000","last_change":"2023-05-17T14:53:52.894285+0000","last_active":"2023-05-17T14:53:52.894285+0000","last_peered":"2023-05-17T14:53:52.894285+0000","last_clean":"2023-05-17T14:53:52.894285+0000","last_became_active":"2023-05-17T14:53:52.894001+0000","last_became_peered":"2023-05-17T14:53:52.894001+0000","last_unstale":"2023-05-17T14:53:52.894285+0000","last_undegraded":"2023-05-17T14:53:52.894285+0000","last_fullsized":"2023-05-17T14:53:52.894285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.880042+0000","last_change":"2023-05-17T14:53:52.509439+0000","last_active":"2023-05-17T14:53:52.880042+0000","last_peered":"2023-05-17T14:53:52.880042+0000","last_clean":"2023-05-17T14:53:52.880042+0000","last_became_active":"2023-05-17T14:53:52.509043+0000","last_became_peered":"2023-05-17T14:53:52.509043+0000","last_unstale":"2023-05-17T14:53:52.880042+0000","last_undegraded":"2023-05-17T14:53:52.880042+0000","last_fullsized":"2023-05-17T14:53:52.880042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909041+0000","last_change":"2023-05-17T14:53:52.904168+0000","last_active":"2023-05-17T14:53:52.909041+0000","last_peered":"2023-05-17T14:53:52.909041+0000","last_clean":"2023-05-17T14:53:52.909041+0000","last_became_active":"2023-05-17T14:53:52.903277+0000","last_became_peered":"2023-05-17T14:53:52.903277+0000","last_unstale":"2023-05-17T14:53:52.909041+0000","last_undegraded":"2023-05-17T14:53:52.909041+0000","last_fullsized":"2023-05-17T14:53:52.909041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900967+0000","last_change":"2023-05-17T14:53:52.501619+0000","last_active":"2023-05-17T14:53:52.900967+0000","last_peered":"2023-05-17T14:53:52.900967+0000","last_clean":"2023-05-17T14:53:52.900967+0000","last_became_active":"2023-05-17T14:53:52.501429+0000","last_became_peered":"2023-05-17T14:53:52.501429+0000","last_unstale":"2023-05-17T14:53:52.900967+0000","last_undegraded":"2023-05-17T14:53:52.900967+0000","last_fullsized":"2023-05-17T14:53:52.900967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901698+0000","last_change":"2023-05-17T14:53:52.901698+0000","last_active":"2023-05-17T14:53:52.901698+0000","last_peered":"2023-05-17T14:53:52.901698+0000","last_clean":"2023-05-17T14:53:52.901698+0000","last_became_active":"2023-05-17T14:53:52.901287+0000","last_became_peered":"2023-05-17T14:53:52.901287+0000","last_unstale":"2023-05-17T14:53:52.901698+0000","last_undegraded":"2023-05-17T14:53:52.901698+0000","last_fullsized":"2023-05-17T14:53:52.901698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889720+0000","last_change":"2023-05-17T14:53:52.509971+0000","last_active":"2023-05-17T14:53:52.889720+0000","last_peered":"2023-05-17T14:53:52.889720+0000","last_clean":"2023-05-17T14:53:52.889720+0000","last_became_active":"2023-05-17T14:53:52.509661+0000","last_became_peered":"2023-05-17T14:53:52.509661+0000","last_unstale":"2023-05-17T14:53:52.889720+0000","last_undegraded":"2023-05-17T14:53:52.889720+0000","last_fullsized":"2023-05-17T14:53:52.889720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894638+0000","last_change":"2023-05-17T14:53:52.894638+0000","last_active":"2023-05-17T14:53:52.894638+0000","last_peered":"2023-05-17T14:53:52.894638+0000","last_clean":"2023-05-17T14:53:52.894638+0000","last_became_active":"2023-05-17T14:53:52.894342+0000","last_became_peered":"2023-05-17T14:53:52.894342+0000","last_unstale":"2023-05-17T14:53:52.894638+0000","last_undegraded":"2023-05-17T14:53:52.894638+0000","last_fullsized":"2023-05-17T14:53:52.894638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885492+0000","last_change":"2023-05-17T14:53:52.505043+0000","last_active":"2023-05-17T14:53:52.885492+0000","last_peered":"2023-05-17T14:53:52.885492+0000","last_clean":"2023-05-17T14:53:52.885492+0000","last_became_active":"2023-05-17T14:53:52.504736+0000","last_became_peered":"2023-05-17T14:53:52.504736+0000","last_unstale":"2023-05-17T14:53:52.885492+0000","last_undegraded":"2023-05-17T14:53:52.885492+0000","last_fullsized":"2023-05-17T14:53:52.885492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905425+0000","last_change":"2023-05-17T14:53:52.897228+0000","last_active":"2023-05-17T14:53:52.905425+0000","last_peered":"2023-05-17T14:53:52.905425+0000","last_clean":"2023-05-17T14:53:52.905425+0000","last_became_active":"2023-05-17T14:53:52.896713+0000","last_became_peered":"2023-05-17T14:53:52.896713+0000","last_unstale":"2023-05-17T14:53:52.905425+0000","last_undegraded":"2023-05-17T14:53:52.905425+0000","last_fullsized":"2023-05-17T14:53:52.905425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886282+0000","last_change":"2023-05-17T14:53:52.511403+0000","last_active":"2023-05-17T14:53:52.886282+0000","last_peered":"2023-05-17T14:53:52.886282+0000","last_clean":"2023-05-17T14:53:52.886282+0000","last_became_active":"2023-05-17T14:53:52.510928+0000","last_became_peered":"2023-05-17T14:53:52.510928+0000","last_unstale":"2023-05-17T14:53:52.886282+0000","last_undegraded":"2023-05-17T14:53:52.886282+0000","last_fullsized":"2023-05-17T14:53:52.886282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893358+0000","last_change":"2023-05-17T14:53:52.893358+0000","last_active":"2023-05-17T14:53:52.893358+0000","last_peered":"2023-05-17T14:53:52.893358+0000","last_clean":"2023-05-17T14:53:52.893358+0000","last_became_active":"2023-05-17T14:53:52.893025+0000","last_became_peered":"2023-05-17T14:53:52.893025+0000","last_unstale":"2023-05-17T14:53:52.893358+0000","last_undegraded":"2023-05-17T14:53:52.893358+0000","last_fullsized":"2023-05-17T14:53:52.893358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891615+0000","last_change":"2023-05-17T14:53:52.512447+0000","last_active":"2023-05-17T14:53:52.891615+0000","last_peered":"2023-05-17T14:53:52.891615+0000","last_clean":"2023-05-17T14:53:52.891615+0000","last_became_active":"2023-05-17T14:53:52.511951+0000","last_became_peered":"2023-05-17T14:53:52.511951+0000","last_unstale":"2023-05-17T14:53:52.891615+0000","last_undegraded":"2023-05-17T14:53:52.891615+0000","last_fullsized":"2023-05-17T14:53:52.891615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899902+0000","last_change":"2023-05-17T14:53:52.899902+0000","last_active":"2023-05-17T14:53:52.899902+0000","last_peered":"2023-05-17T14:53:52.899902+0000","last_clean":"2023-05-17T14:53:52.899902+0000","last_became_active":"2023-05-17T14:53:52.899381+0000","last_became_peered":"2023-05-17T14:53:52.899381+0000","last_unstale":"2023-05-17T14:53:52.899902+0000","last_undegraded":"2023-05-17T14:53:52.899902+0000","last_fullsized":"2023-05-17T14:53:52.899902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.519265+0000","last_change":"2023-05-17T14:53:52.515232+0000","last_active":"2023-05-17T14:53:52.519265+0000","last_peered":"2023-05-17T14:53:52.519265+0000","last_clean":"2023-05-17T14:53:52.519265+0000","last_became_active":"2023-05-17T14:53:52.514555+0000","last_became_peered":"2023-05-17T14:53:52.514555+0000","last_unstale":"2023-05-17T14:53:52.519265+0000","last_undegraded":"2023-05-17T14:53:52.519265+0000","last_fullsized":"2023-05-17T14:53:52.519265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906744+0000","last_change":"2023-05-17T14:53:52.903058+0000","last_active":"2023-05-17T14:53:52.906744+0000","last_peered":"2023-05-17T14:53:52.906744+0000","last_clean":"2023-05-17T14:53:52.906744+0000","last_became_active":"2023-05-17T14:53:52.902615+0000","last_became_peered":"2023-05-17T14:53:52.902615+0000","last_unstale":"2023-05-17T14:53:52.906744+0000","last_undegraded":"2023-05-17T14:53:52.906744+0000","last_fullsized":"2023-05-17T14:53:52.906744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.515340+0000","last_change":"2023-05-17T14:53:52.513421+0000","last_active":"2023-05-17T14:53:52.515340+0000","last_peered":"2023-05-17T14:53:52.515340+0000","last_clean":"2023-05-17T14:53:52.515340+0000","last_became_active":"2023-05-17T14:53:52.513120+0000","last_became_peered":"2023-05-17T14:53:52.513120+0000","last_unstale":"2023-05-17T14:53:52.515340+0000","last_undegraded":"2023-05-17T14:53:52.515340+0000","last_fullsized":"2023-05-17T14:53:52.515340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899077+0000","last_change":"2023-05-17T14:53:52.899077+0000","last_active":"2023-05-17T14:53:52.899077+0000","last_peered":"2023-05-17T14:53:52.899077+0000","last_clean":"2023-05-17T14:53:52.899077+0000","last_became_active":"2023-05-17T14:53:52.898767+0000","last_became_peered":"2023-05-17T14:53:52.898767+0000","last_unstale":"2023-05-17T14:53:52.899077+0000","last_undegraded":"2023-05-17T14:53:52.899077+0000","last_fullsized":"2023-05-17T14:53:52.899077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887616+0000","last_change":"2023-05-17T14:53:52.502548+0000","last_active":"2023-05-17T14:53:52.887616+0000","last_peered":"2023-05-17T14:53:52.887616+0000","last_clean":"2023-05-17T14:53:52.887616+0000","last_became_active":"2023-05-17T14:53:52.501702+0000","last_became_peered":"2023-05-17T14:53:52.501702+0000","last_unstale":"2023-05-17T14:53:52.887616+0000","last_undegraded":"2023-05-17T14:53:52.887616+0000","last_fullsized":"2023-05-17T14:53:52.887616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901668+0000","last_change":"2023-05-17T14:53:52.897118+0000","last_active":"2023-05-17T14:53:52.901668+0000","last_peered":"2023-05-17T14:53:52.901668+0000","last_clean":"2023-05-17T14:53:52.901668+0000","last_became_active":"2023-05-17T14:53:52.896806+0000","last_became_peered":"2023-05-17T14:53:52.896806+0000","last_unstale":"2023-05-17T14:53:52.901668+0000","last_undegraded":"2023-05-17T14:53:52.901668+0000","last_fullsized":"2023-05-17T14:53:52.901668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.511494+0000","last_change":"2023-05-17T14:53:52.507358+0000","last_active":"2023-05-17T14:53:52.511494+0000","last_peered":"2023-05-17T14:53:52.511494+0000","last_clean":"2023-05-17T14:53:52.511494+0000","last_became_active":"2023-05-17T14:53:52.507091+0000","last_became_peered":"2023-05-17T14:53:52.507091+0000","last_unstale":"2023-05-17T14:53:52.511494+0000","last_undegraded":"2023-05-17T14:53:52.511494+0000","last_fullsized":"2023-05-17T14:53:52.511494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910197+0000","last_change":"2023-05-17T14:53:52.908557+0000","last_active":"2023-05-17T14:53:52.910197+0000","last_peered":"2023-05-17T14:53:52.910197+0000","last_clean":"2023-05-17T14:53:52.910197+0000","last_became_active":"2023-05-17T14:53:52.908298+0000","last_became_peered":"2023-05-17T14:53:52.908298+0000","last_unstale":"2023-05-17T14:53:52.910197+0000","last_undegraded":"2023-05-17T14:53:52.910197+0000","last_fullsized":"2023-05-17T14:53:52.910197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885994+0000","last_change":"2023-05-17T14:53:52.512296+0000","last_active":"2023-05-17T14:53:52.885994+0000","last_peered":"2023-05-17T14:53:52.885994+0000","last_clean":"2023-05-17T14:53:52.885994+0000","last_became_active":"2023-05-17T14:53:52.512018+0000","last_became_peered":"2023-05-17T14:53:52.512018+0000","last_unstale":"2023-05-17T14:53:52.885994+0000","last_undegraded":"2023-05-17T14:53:52.885994+0000","last_fullsized":"2023-05-17T14:53:52.885994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909007+0000","last_change":"2023-05-17T14:53:52.904120+0000","last_active":"2023-05-17T14:53:52.909007+0000","last_peered":"2023-05-17T14:53:52.909007+0000","last_clean":"2023-05-17T14:53:52.909007+0000","last_became_active":"2023-05-17T14:53:52.903622+0000","last_became_peered":"2023-05-17T14:53:52.903622+0000","last_unstale":"2023-05-17T14:53:52.909007+0000","last_undegraded":"2023-05-17T14:53:52.909007+0000","last_fullsized":"2023-05-17T14:53:52.909007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.517045+0000","last_change":"2023-05-17T14:53:52.514693+0000","last_active":"2023-05-17T14:53:52.517045+0000","last_peered":"2023-05-17T14:53:52.517045+0000","last_clean":"2023-05-17T14:53:52.517045+0000","last_became_active":"2023-05-17T14:53:52.514371+0000","last_became_peered":"2023-05-17T14:53:52.514371+0000","last_unstale":"2023-05-17T14:53:52.517045+0000","last_undegraded":"2023-05-17T14:53:52.517045+0000","last_fullsized":"2023-05-17T14:53:52.517045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907461+0000","last_change":"2023-05-17T14:53:52.905496+0000","last_active":"2023-05-17T14:53:52.907461+0000","last_peered":"2023-05-17T14:53:52.907461+0000","last_clean":"2023-05-17T14:53:52.907461+0000","last_became_active":"2023-05-17T14:53:52.902849+0000","last_became_peered":"2023-05-17T14:53:52.902849+0000","last_unstale":"2023-05-17T14:53:52.907461+0000","last_undegraded":"2023-05-17T14:53:52.907461+0000","last_fullsized":"2023-05-17T14:53:52.907461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886660+0000","last_change":"2023-05-17T14:53:52.507074+0000","last_active":"2023-05-17T14:53:52.886660+0000","last_peered":"2023-05-17T14:53:52.886660+0000","last_clean":"2023-05-17T14:53:52.886660+0000","last_became_active":"2023-05-17T14:53:52.506648+0000","last_became_peered":"2023-05-17T14:53:52.506648+0000","last_unstale":"2023-05-17T14:53:52.886660+0000","last_undegraded":"2023-05-17T14:53:52.886660+0000","last_fullsized":"2023-05-17T14:53:52.886660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909075+0000","last_change":"2023-05-17T14:53:52.905035+0000","last_active":"2023-05-17T14:53:52.909075+0000","last_peered":"2023-05-17T14:53:52.909075+0000","last_clean":"2023-05-17T14:53:52.909075+0000","last_became_active":"2023-05-17T14:53:52.903028+0000","last_became_peered":"2023-05-17T14:53:52.903028+0000","last_unstale":"2023-05-17T14:53:52.909075+0000","last_undegraded":"2023-05-17T14:53:52.909075+0000","last_fullsized":"2023-05-17T14:53:52.909075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896399+0000","last_change":"2023-05-17T14:53:52.510568+0000","last_active":"2023-05-17T14:53:52.896399+0000","last_peered":"2023-05-17T14:53:52.896399+0000","last_clean":"2023-05-17T14:53:52.896399+0000","last_became_active":"2023-05-17T14:53:52.510243+0000","last_became_peered":"2023-05-17T14:53:52.510243+0000","last_unstale":"2023-05-17T14:53:52.896399+0000","last_undegraded":"2023-05-17T14:53:52.896399+0000","last_fullsized":"2023-05-17T14:53:52.896399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900510+0000","last_change":"2023-05-17T14:53:52.899184+0000","last_active":"2023-05-17T14:53:52.900510+0000","last_peered":"2023-05-17T14:53:52.900510+0000","last_clean":"2023-05-17T14:53:52.900510+0000","last_became_active":"2023-05-17T14:53:52.898867+0000","last_became_peered":"2023-05-17T14:53:52.898867+0000","last_unstale":"2023-05-17T14:53:52.900510+0000","last_undegraded":"2023-05-17T14:53:52.900510+0000","last_fullsized":"2023-05-17T14:53:52.900510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889663+0000","last_change":"2023-05-17T14:53:52.499276+0000","last_active":"2023-05-17T14:53:52.889663+0000","last_peered":"2023-05-17T14:53:52.889663+0000","last_clean":"2023-05-17T14:53:52.889663+0000","last_became_active":"2023-05-17T14:53:52.498250+0000","last_became_peered":"2023-05-17T14:53:52.498250+0000","last_unstale":"2023-05-17T14:53:52.889663+0000","last_undegraded":"2023-05-17T14:53:52.889663+0000","last_fullsized":"2023-05-17T14:53:52.889663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905444+0000","last_change":"2023-05-17T14:53:52.903548+0000","last_active":"2023-05-17T14:53:52.905444+0000","last_peered":"2023-05-17T14:53:52.905444+0000","last_clean":"2023-05-17T14:53:52.905444+0000","last_became_active":"2023-05-17T14:53:52.903278+0000","last_became_peered":"2023-05-17T14:53:52.903278+0000","last_unstale":"2023-05-17T14:53:52.905444+0000","last_undegraded":"2023-05-17T14:53:52.905444+0000","last_fullsized":"2023-05-17T14:53:52.905444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896027+0000","last_change":"2023-05-17T14:53:52.504834+0000","last_active":"2023-05-17T14:53:52.896027+0000","last_peered":"2023-05-17T14:53:52.896027+0000","last_clean":"2023-05-17T14:53:52.896027+0000","last_became_active":"2023-05-17T14:53:52.504516+0000","last_became_peered":"2023-05-17T14:53:52.504516+0000","last_unstale":"2023-05-17T14:53:52.896027+0000","last_undegraded":"2023-05-17T14:53:52.896027+0000","last_fullsized":"2023-05-17T14:53:52.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899616+0000","last_change":"2023-05-17T14:53:52.899616+0000","last_active":"2023-05-17T14:53:52.899616+0000","last_peered":"2023-05-17T14:53:52.899616+0000","last_clean":"2023-05-17T14:53:52.899616+0000","last_became_active":"2023-05-17T14:53:52.899304+0000","last_became_peered":"2023-05-17T14:53:52.899304+0000","last_unstale":"2023-05-17T14:53:52.899616+0000","last_undegraded":"2023-05-17T14:53:52.899616+0000","last_fullsized":"2023-05-17T14:53:52.899616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883276+0000","last_change":"2023-05-17T14:53:52.498387+0000","last_active":"2023-05-17T14:53:52.883276+0000","last_peered":"2023-05-17T14:53:52.883276+0000","last_clean":"2023-05-17T14:53:52.883276+0000","last_became_active":"2023-05-17T14:53:52.498124+0000","last_became_peered":"2023-05-17T14:53:52.498124+0000","last_unstale":"2023-05-17T14:53:52.883276+0000","last_undegraded":"2023-05-17T14:53:52.883276+0000","last_fullsized":"2023-05-17T14:53:52.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907377+0000","last_change":"2023-05-17T14:53:52.900446+0000","last_active":"2023-05-17T14:53:52.907377+0000","last_peered":"2023-05-17T14:53:52.907377+0000","last_clean":"2023-05-17T14:53:52.907377+0000","last_became_active":"2023-05-17T14:53:52.899252+0000","last_became_peered":"2023-05-17T14:53:52.899252+0000","last_unstale":"2023-05-17T14:53:52.907377+0000","last_undegraded":"2023-05-17T14:53:52.907377+0000","last_fullsized":"2023-05-17T14:53:52.907377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886699+0000","last_change":"2023-05-17T14:53:52.507558+0000","last_active":"2023-05-17T14:53:52.886699+0000","last_peered":"2023-05-17T14:53:52.886699+0000","last_clean":"2023-05-17T14:53:52.886699+0000","last_became_active":"2023-05-17T14:53:52.507272+0000","last_became_peered":"2023-05-17T14:53:52.507272+0000","last_unstale":"2023-05-17T14:53:52.886699+0000","last_undegraded":"2023-05-17T14:53:52.886699+0000","last_fullsized":"2023-05-17T14:53:52.886699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910217+0000","last_change":"2023-05-17T14:53:52.908565+0000","last_active":"2023-05-17T14:53:52.910217+0000","last_peered":"2023-05-17T14:53:52.910217+0000","last_clean":"2023-05-17T14:53:52.910217+0000","last_became_active":"2023-05-17T14:53:52.908327+0000","last_became_peered":"2023-05-17T14:53:52.908327+0000","last_unstale":"2023-05-17T14:53:52.910217+0000","last_undegraded":"2023-05-17T14:53:52.910217+0000","last_fullsized":"2023-05-17T14:53:52.910217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905977+0000","last_change":"2023-05-17T14:53:52.507620+0000","last_active":"2023-05-17T14:53:52.905977+0000","last_peered":"2023-05-17T14:53:52.905977+0000","last_clean":"2023-05-17T14:53:52.905977+0000","last_became_active":"2023-05-17T14:53:52.505456+0000","last_became_peered":"2023-05-17T14:53:52.505456+0000","last_unstale":"2023-05-17T14:53:52.905977+0000","last_undegraded":"2023-05-17T14:53:52.905977+0000","last_fullsized":"2023-05-17T14:53:52.905977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905309+0000","last_change":"2023-05-17T14:53:52.898134+0000","last_active":"2023-05-17T14:53:52.905309+0000","last_peered":"2023-05-17T14:53:52.905309+0000","last_clean":"2023-05-17T14:53:52.905309+0000","last_became_active":"2023-05-17T14:53:52.897754+0000","last_became_peered":"2023-05-17T14:53:52.897754+0000","last_unstale":"2023-05-17T14:53:52.905309+0000","last_undegraded":"2023-05-17T14:53:52.905309+0000","last_fullsized":"2023-05-17T14:53:52.905309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.503284+0000","last_change":"2023-05-17T14:53:52.498029+0000","last_active":"2023-05-17T14:53:52.503284+0000","last_peered":"2023-05-17T14:53:52.503284+0000","last_clean":"2023-05-17T14:53:52.503284+0000","last_became_active":"2023-05-17T14:53:52.497667+0000","last_became_peered":"2023-05-17T14:53:52.497667+0000","last_unstale":"2023-05-17T14:53:52.503284+0000","last_undegraded":"2023-05-17T14:53:52.503284+0000","last_fullsized":"2023-05-17T14:53:52.503284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908878+0000","last_change":"2023-05-17T14:53:52.903794+0000","last_active":"2023-05-17T14:53:52.908878+0000","last_peered":"2023-05-17T14:53:52.908878+0000","last_clean":"2023-05-17T14:53:52.908878+0000","last_became_active":"2023-05-17T14:53:52.903482+0000","last_became_peered":"2023-05-17T14:53:52.903482+0000","last_unstale":"2023-05-17T14:53:52.908878+0000","last_undegraded":"2023-05-17T14:53:52.908878+0000","last_fullsized":"2023-05-17T14:53:52.908878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885250+0000","last_change":"2023-05-17T14:53:52.501031+0000","last_active":"2023-05-17T14:53:52.885250+0000","last_peered":"2023-05-17T14:53:52.885250+0000","last_clean":"2023-05-17T14:53:52.885250+0000","last_became_active":"2023-05-17T14:53:52.500624+0000","last_became_peered":"2023-05-17T14:53:52.500624+0000","last_unstale":"2023-05-17T14:53:52.885250+0000","last_undegraded":"2023-05-17T14:53:52.885250+0000","last_fullsized":"2023-05-17T14:53:52.885250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907527+0000","last_change":"2023-05-17T14:53:52.904355+0000","last_active":"2023-05-17T14:53:52.907527+0000","last_peered":"2023-05-17T14:53:52.907527+0000","last_clean":"2023-05-17T14:53:52.907527+0000","last_became_active":"2023-05-17T14:53:52.901353+0000","last_became_peered":"2023-05-17T14:53:52.901353+0000","last_unstale":"2023-05-17T14:53:52.907527+0000","last_undegraded":"2023-05-17T14:53:52.907527+0000","last_fullsized":"2023-05-17T14:53:52.907527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882918+0000","last_change":"2023-05-17T14:53:52.509583+0000","last_active":"2023-05-17T14:53:52.882918+0000","last_peered":"2023-05-17T14:53:52.882918+0000","last_clean":"2023-05-17T14:53:52.882918+0000","last_became_active":"2023-05-17T14:53:52.509033+0000","last_became_peered":"2023-05-17T14:53:52.509033+0000","last_unstale":"2023-05-17T14:53:52.882918+0000","last_undegraded":"2023-05-17T14:53:52.882918+0000","last_fullsized":"2023-05-17T14:53:52.882918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896099+0000","last_change":"2023-05-17T14:53:52.894065+0000","last_active":"2023-05-17T14:53:52.896099+0000","last_peered":"2023-05-17T14:53:52.896099+0000","last_clean":"2023-05-17T14:53:52.896099+0000","last_became_active":"2023-05-17T14:53:52.893755+0000","last_became_peered":"2023-05-17T14:53:52.893755+0000","last_unstale":"2023-05-17T14:53:52.896099+0000","last_undegraded":"2023-05-17T14:53:52.896099+0000","last_fullsized":"2023-05-17T14:53:52.896099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909266+0000","last_change":"2023-05-17T14:53:52.507353+0000","last_active":"2023-05-17T14:53:52.909266+0000","last_peered":"2023-05-17T14:53:52.909266+0000","last_clean":"2023-05-17T14:53:52.909266+0000","last_became_active":"2023-05-17T14:53:52.506014+0000","last_became_peered":"2023-05-17T14:53:52.506014+0000","last_unstale":"2023-05-17T14:53:52.909266+0000","last_undegraded":"2023-05-17T14:53:52.909266+0000","last_fullsized":"2023-05-17T14:53:52.909266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905670+0000","last_change":"2023-05-17T14:53:52.897660+0000","last_active":"2023-05-17T14:53:52.905670+0000","last_peered":"2023-05-17T14:53:52.905670+0000","last_clean":"2023-05-17T14:53:52.905670+0000","last_became_active":"2023-05-17T14:53:52.897344+0000","last_became_peered":"2023-05-17T14:53:52.897344+0000","last_unstale":"2023-05-17T14:53:52.905670+0000","last_undegraded":"2023-05-17T14:53:52.905670+0000","last_fullsized":"2023-05-17T14:53:52.905670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893946+0000","last_change":"2023-05-17T14:53:52.504680+0000","last_active":"2023-05-17T14:53:52.893946+0000","last_peered":"2023-05-17T14:53:52.893946+0000","last_clean":"2023-05-17T14:53:52.893946+0000","last_became_active":"2023-05-17T14:53:52.504385+0000","last_became_peered":"2023-05-17T14:53:52.504385+0000","last_unstale":"2023-05-17T14:53:52.893946+0000","last_undegraded":"2023-05-17T14:53:52.893946+0000","last_fullsized":"2023-05-17T14:53:52.893946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906580+0000","last_change":"2023-05-17T14:53:52.899592+0000","last_active":"2023-05-17T14:53:52.906580+0000","last_peered":"2023-05-17T14:53:52.906580+0000","last_clean":"2023-05-17T14:53:52.906580+0000","last_became_active":"2023-05-17T14:53:52.899272+0000","last_became_peered":"2023-05-17T14:53:52.899272+0000","last_unstale":"2023-05-17T14:53:52.906580+0000","last_undegraded":"2023-05-17T14:53:52.906580+0000","last_fullsized":"2023-05-17T14:53:52.906580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887745+0000","last_change":"2023-05-17T14:53:52.502007+0000","last_active":"2023-05-17T14:53:52.887745+0000","last_peered":"2023-05-17T14:53:52.887745+0000","last_clean":"2023-05-17T14:53:52.887745+0000","last_became_active":"2023-05-17T14:53:52.501336+0000","last_became_peered":"2023-05-17T14:53:52.501336+0000","last_unstale":"2023-05-17T14:53:52.887745+0000","last_undegraded":"2023-05-17T14:53:52.887745+0000","last_fullsized":"2023-05-17T14:53:52.887745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909028+0000","last_change":"2023-05-17T14:53:52.904025+0000","last_active":"2023-05-17T14:53:52.909028+0000","last_peered":"2023-05-17T14:53:52.909028+0000","last_clean":"2023-05-17T14:53:52.909028+0000","last_became_active":"2023-05-17T14:53:52.903652+0000","last_became_peered":"2023-05-17T14:53:52.903652+0000","last_unstale":"2023-05-17T14:53:52.909028+0000","last_undegraded":"2023-05-17T14:53:52.909028+0000","last_fullsized":"2023-05-17T14:53:52.909028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883073+0000","last_change":"2023-05-17T14:53:52.502927+0000","last_active":"2023-05-17T14:53:52.883073+0000","last_peered":"2023-05-17T14:53:52.883073+0000","last_clean":"2023-05-17T14:53:52.883073+0000","last_became_active":"2023-05-17T14:53:52.502633+0000","last_became_peered":"2023-05-17T14:53:52.502633+0000","last_unstale":"2023-05-17T14:53:52.883073+0000","last_undegraded":"2023-05-17T14:53:52.883073+0000","last_fullsized":"2023-05-17T14:53:52.883073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895093+0000","last_change":"2023-05-17T14:53:52.892437+0000","last_active":"2023-05-17T14:53:52.895093+0000","last_peered":"2023-05-17T14:53:52.895093+0000","last_clean":"2023-05-17T14:53:52.895093+0000","last_became_active":"2023-05-17T14:53:52.892121+0000","last_became_peered":"2023-05-17T14:53:52.892121+0000","last_unstale":"2023-05-17T14:53:52.895093+0000","last_undegraded":"2023-05-17T14:53:52.895093+0000","last_fullsized":"2023-05-17T14:53:52.895093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.512154+0000","last_change":"2023-05-17T14:53:52.511006+0000","last_active":"2023-05-17T14:53:52.512154+0000","last_peered":"2023-05-17T14:53:52.512154+0000","last_clean":"2023-05-17T14:53:52.512154+0000","last_became_active":"2023-05-17T14:53:52.510651+0000","last_became_peered":"2023-05-17T14:53:52.510651+0000","last_unstale":"2023-05-17T14:53:52.512154+0000","last_undegraded":"2023-05-17T14:53:52.512154+0000","last_fullsized":"2023-05-17T14:53:52.512154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905331+0000","last_change":"2023-05-17T14:53:52.898513+0000","last_active":"2023-05-17T14:53:52.905331+0000","last_peered":"2023-05-17T14:53:52.905331+0000","last_clean":"2023-05-17T14:53:52.905331+0000","last_became_active":"2023-05-17T14:53:52.898159+0000","last_became_peered":"2023-05-17T14:53:52.898159+0000","last_unstale":"2023-05-17T14:53:52.905331+0000","last_undegraded":"2023-05-17T14:53:52.905331+0000","last_fullsized":"2023-05-17T14:53:52.905331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882773+0000","last_change":"2023-05-17T14:53:52.512519+0000","last_active":"2023-05-17T14:53:52.882773+0000","last_peered":"2023-05-17T14:53:52.882773+0000","last_clean":"2023-05-17T14:53:52.882773+0000","last_became_active":"2023-05-17T14:53:52.512220+0000","last_became_peered":"2023-05-17T14:53:52.512220+0000","last_unstale":"2023-05-17T14:53:52.882773+0000","last_undegraded":"2023-05-17T14:53:52.882773+0000","last_fullsized":"2023-05-17T14:53:52.882773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909559+0000","last_change":"2023-05-17T14:53:52.907268+0000","last_active":"2023-05-17T14:53:52.909559+0000","last_peered":"2023-05-17T14:53:52.909559+0000","last_clean":"2023-05-17T14:53:52.909559+0000","last_became_active":"2023-05-17T14:53:52.906591+0000","last_became_peered":"2023-05-17T14:53:52.906591+0000","last_unstale":"2023-05-17T14:53:52.909559+0000","last_undegraded":"2023-05-17T14:53:52.909559+0000","last_fullsized":"2023-05-17T14:53:52.909559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897695+0000","last_change":"2023-05-17T14:53:52.506059+0000","last_active":"2023-05-17T14:53:52.897695+0000","last_peered":"2023-05-17T14:53:52.897695+0000","last_clean":"2023-05-17T14:53:52.897695+0000","last_became_active":"2023-05-17T14:53:52.505710+0000","last_became_peered":"2023-05-17T14:53:52.505710+0000","last_unstale":"2023-05-17T14:53:52.897695+0000","last_undegraded":"2023-05-17T14:53:52.897695+0000","last_fullsized":"2023-05-17T14:53:52.897695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901344+0000","last_change":"2023-05-17T14:53:52.897282+0000","last_active":"2023-05-17T14:53:52.901344+0000","last_peered":"2023-05-17T14:53:52.901344+0000","last_clean":"2023-05-17T14:53:52.901344+0000","last_became_active":"2023-05-17T14:53:52.896992+0000","last_became_peered":"2023-05-17T14:53:52.896992+0000","last_unstale":"2023-05-17T14:53:52.901344+0000","last_undegraded":"2023-05-17T14:53:52.901344+0000","last_fullsized":"2023-05-17T14:53:52.901344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895784+0000","last_change":"2023-05-17T14:53:52.511809+0000","last_active":"2023-05-17T14:53:52.895784+0000","last_peered":"2023-05-17T14:53:52.895784+0000","last_clean":"2023-05-17T14:53:52.895784+0000","last_became_active":"2023-05-17T14:53:52.511486+0000","last_became_peered":"2023-05-17T14:53:52.511486+0000","last_unstale":"2023-05-17T14:53:52.895784+0000","last_undegraded":"2023-05-17T14:53:52.895784+0000","last_fullsized":"2023-05-17T14:53:52.895784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910222+0000","last_change":"2023-05-17T14:53:52.909184+0000","last_active":"2023-05-17T14:53:52.910222+0000","last_peered":"2023-05-17T14:53:52.910222+0000","last_clean":"2023-05-17T14:53:52.910222+0000","last_became_active":"2023-05-17T14:53:52.908851+0000","last_became_peered":"2023-05-17T14:53:52.908851+0000","last_unstale":"2023-05-17T14:53:52.910222+0000","last_undegraded":"2023-05-17T14:53:52.910222+0000","last_fullsized":"2023-05-17T14:53:52.910222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895604+0000","last_change":"2023-05-17T14:53:52.512162+0000","last_active":"2023-05-17T14:53:52.895604+0000","last_peered":"2023-05-17T14:53:52.895604+0000","last_clean":"2023-05-17T14:53:52.895604+0000","last_became_active":"2023-05-17T14:53:52.511653+0000","last_became_peered":"2023-05-17T14:53:52.511653+0000","last_unstale":"2023-05-17T14:53:52.895604+0000","last_undegraded":"2023-05-17T14:53:52.895604+0000","last_fullsized":"2023-05-17T14:53:52.895604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906723+0000","last_change":"2023-05-17T14:53:52.900703+0000","last_active":"2023-05-17T14:53:52.906723+0000","last_peered":"2023-05-17T14:53:52.906723+0000","last_clean":"2023-05-17T14:53:52.906723+0000","last_became_active":"2023-05-17T14:53:52.900419+0000","last_became_peered":"2023-05-17T14:53:52.900419+0000","last_unstale":"2023-05-17T14:53:52.906723+0000","last_undegraded":"2023-05-17T14:53:52.906723+0000","last_fullsized":"2023-05-17T14:53:52.906723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888598+0000","last_change":"2023-05-17T14:53:52.509848+0000","last_active":"2023-05-17T14:53:52.888598+0000","last_peered":"2023-05-17T14:53:52.888598+0000","last_clean":"2023-05-17T14:53:52.888598+0000","last_became_active":"2023-05-17T14:53:52.509559+0000","last_became_peered":"2023-05-17T14:53:52.509559+0000","last_unstale":"2023-05-17T14:53:52.888598+0000","last_undegraded":"2023-05-17T14:53:52.888598+0000","last_fullsized":"2023-05-17T14:53:52.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900610+0000","last_change":"2023-05-17T14:53:52.897408+0000","last_active":"2023-05-17T14:53:52.900610+0000","last_peered":"2023-05-17T14:53:52.900610+0000","last_clean":"2023-05-17T14:53:52.900610+0000","last_became_active":"2023-05-17T14:53:52.897133+0000","last_became_peered":"2023-05-17T14:53:52.897133+0000","last_unstale":"2023-05-17T14:53:52.900610+0000","last_undegraded":"2023-05-17T14:53:52.900610+0000","last_fullsized":"2023-05-17T14:53:52.900610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.511223+0000","last_change":"2023-05-17T14:53:52.505784+0000","last_active":"2023-05-17T14:53:52.511223+0000","last_peered":"2023-05-17T14:53:52.511223+0000","last_clean":"2023-05-17T14:53:52.511223+0000","last_became_active":"2023-05-17T14:53:52.505481+0000","last_became_peered":"2023-05-17T14:53:52.505481+0000","last_unstale":"2023-05-17T14:53:52.511223+0000","last_undegraded":"2023-05-17T14:53:52.511223+0000","last_fullsized":"2023-05-17T14:53:52.511223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908743+0000","last_change":"2023-05-17T14:53:52.905997+0000","last_active":"2023-05-17T14:53:52.908743+0000","last_peered":"2023-05-17T14:53:52.908743+0000","last_clean":"2023-05-17T14:53:52.908743+0000","last_became_active":"2023-05-17T14:53:52.905547+0000","last_became_peered":"2023-05-17T14:53:52.905547+0000","last_unstale":"2023-05-17T14:53:52.908743+0000","last_undegraded":"2023-05-17T14:53:52.908743+0000","last_fullsized":"2023-05-17T14:53:52.908743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901796+0000","last_change":"2023-05-17T14:53:52.503841+0000","last_active":"2023-05-17T14:53:52.901796+0000","last_peered":"2023-05-17T14:53:52.901796+0000","last_clean":"2023-05-17T14:53:52.901796+0000","last_became_active":"2023-05-17T14:53:52.502924+0000","last_became_peered":"2023-05-17T14:53:52.502924+0000","last_unstale":"2023-05-17T14:53:52.901796+0000","last_undegraded":"2023-05-17T14:53:52.901796+0000","last_fullsized":"2023-05-17T14:53:52.901796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":245760,"data_stored":80047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":86783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5100,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366740,"statfs":{"total":96636764160,"available":96631541760,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5216,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366624,"statfs":{"total":96636764160,"available":96631422976,"internally_reserved":0,"allocated":221184,"data_stored":78723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T14:53:56.920 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T14:53:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.062+0000 7f0fd0154700 1 Processor -- start 2023-05-17T14:53:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.063+0000 7f0fd0154700 1 -- start start 2023-05-17T14:53:57.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.063+0000 7f0fd0154700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fc8153fa0 0x7f0fc80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.063+0000 7f0fd0154700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc80aae70 0x7f0fc80c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.063+0000 7f0fd0154700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc80c07a0 con 0x7f0fc8069060 2023-05-17T14:53:57.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.063+0000 7f0fd0154700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc8069d70 con 0x7f0fc8153fa0 2023-05-17T14:53:57.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.063+0000 7f0fd0154700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80c6760 con 0x7f0fc80aae70 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fc8153fa0 0x7f0fc80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fc8153fa0 0x7f0fc80c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33806/0 (socket says 172.21.15.27:33806) 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 -- 172.21.15.27:0/1169082072 learned_addr learned my addr 172.21.15.27:0/1169082072 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcd6ef700 1 --2- 172.21.15.27:0/1169082072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc80aae70 0x7f0fc80c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 -- 172.21.15.27:0/1169082072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc80aae70 msgr2=0x7f0fc80c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 --2- 172.21.15.27:0/1169082072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc80aae70 0x7f0fc80c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 -- 172.21.15.27:0/1169082072 >> v1:172.21.15.40:6789/0 conn(0x7f0fc8069060 legacy=0x7f0fc8069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 -- 172.21.15.27:0/1169082072 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80c1c40 con 0x7f0fc8153fa0 2023-05-17T14:53:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcdef0700 1 --2- 172.21.15.27:0/1169082072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc8153fa0 0x7f0fc80c5d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0fc0009f20 tx=0x7f0fc0009840).ready entity=mon.0 client_cookie=cc1ce0dc476cf573 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcceee700 1 -- 172.21.15.27:0/1169082072 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000e070 con 0x7f0fc8153fa0 2023-05-17T14:53:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcceee700 1 -- 172.21.15.27:0/1169082072 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000ba80 con 0x7f0fc8153fa0 2023-05-17T14:53:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.064+0000 7f0fcceee700 1 -- 172.21.15.27:0/1169082072 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000be00 con 0x7f0fc8153fa0 2023-05-17T14:53:57.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 -- 172.21.15.27:0/1169082072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc8153fa0 msgr2=0x7f0fc80c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 --2- 172.21.15.27:0/1169082072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc8153fa0 0x7f0fc80c5d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0fc0009f20 tx=0x7f0fc0009840).stop 2023-05-17T14:53:57.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 -- 172.21.15.27:0/1169082072 shutdown_connections 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 --2- 172.21.15.27:0/1169082072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc8153fa0 0x7f0fc80c5d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 --2- 172.21.15.27:0/1169082072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc80aae70 0x7f0fc80c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 -- 172.21.15.27:0/1169082072 >> 172.21.15.27:0/1169082072 conn(0x7f0fc80cb810 msgr2=0x7f0fc80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 -- 172.21.15.27:0/1169082072 shutdown_connections 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.065+0000 7f0fd0154700 1 -- 172.21.15.27:0/1169082072 wait complete. 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.066+0000 7f0fd0154700 1 Processor -- start 2023-05-17T14:53:57.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.066+0000 7f0fd0154700 1 -- start start 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc8069060 0x7f0fc8145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 0x7f0fc80a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc8153fa0 0x7f0fc80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80a5750 con 0x7f0fc80aae70 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80b0660 con 0x7f0fc8069060 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80a3730 con 0x7f0fc8153fa0 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 0x7f0fc80a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 0x7f0fc80a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33814/0 (socket says 172.21.15.27:33814) 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 -- 172.21.15.27:0/2474685218 learned_addr learned my addr 172.21.15.27:0/2474685218 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcdef0700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc8069060 0x7f0fc8145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fce6f1700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc8153fa0 0x7f0fc80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 -- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc8153fa0 msgr2=0x7f0fc80a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc8153fa0 0x7f0fc80a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 -- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc8069060 msgr2=0x7f0fc8145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc8069060 0x7f0fc8145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 -- 172.21.15.27:0/2474685218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0009ae0 con 0x7f0fc80aae70 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fcd6ef700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 0x7f0fc80a4d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0fbc006d20 tx=0x7f0fbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc011590 con 0x7f0fc80aae70 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0116f0 con 0x7f0fc80aae70 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc80a2e00 con 0x7f0fc80aae70 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.067+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc011a90 con 0x7f0fc80aae70 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.068+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc80a33c0 con 0x7f0fc80aae70 2023-05-17T14:53:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.068+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc80a38e0 con 0x7f0fc80aae70 2023-05-17T14:53:57.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.069+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0fbc01c460 con 0x7f0fc80aae70 2023-05-17T14:53:57.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.069+0000 7f0fc5ffb700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fb405ed90 0x7f0fb4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.069+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0fbc079d20 con 0x7f0fc80aae70 2023-05-17T14:53:57.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.069+0000 7f0fcdef0700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fb405ed90 0x7f0fb4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.070+0000 7f0fcdef0700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fb405ed90 0x7f0fb4061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0fc0009880 tx=0x7f0fc80c8510).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.073+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fc80a38e0 con 0x7f0fc80aae70 2023-05-17T14:53:57.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.242+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fc80a38a0 con 0x7f0fb405ed90 2023-05-17T14:53:57.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.251+0000 7f0fc5ffb700 1 -- 172.21.15.27:0/2474685218 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336397 (secure 0 0 0) 0x7f0fc80a38a0 con 0x7f0fb405ed90 2023-05-17T14:53:57.258 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:57.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fb405ed90 msgr2=0x7f0fb4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fb405ed90 0x7f0fb4061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0fc0009880 tx=0x7f0fc80c8510).stop 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 msgr2=0x7f0fc80a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 0x7f0fc80a4d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0fbc006d20 tx=0x7f0fbc008040).stop 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 shutdown_connections 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fb405ed90 0x7f0fb4061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc8153fa0 0x7f0fc80a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc8069060 0x7f0fc8145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 --2- 172.21.15.27:0/2474685218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc80aae70 0x7f0fc80a4d70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 >> 172.21.15.27:0/2474685218 conn(0x7f0fc80cb810 msgr2=0x7f0fc80c0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:57.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 shutdown_connections 2023-05-17T14:53:57.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.255+0000 7f0fd0154700 1 -- 172.21.15.27:0/2474685218 wait complete. 2023-05-17T14:53:57.262 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T14:53:57.270 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T14:53:55.561216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41564,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":39680,"kb_avail":754933156,"statfs":{"total":773094113280,"available":773051551744,"internally_reserved":0,"allocated":1863680,"data_stored":667196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40632320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897717+0000","last_change":"2023-05-17T14:53:52.897717+0000","last_active":"2023-05-17T14:53:52.897717+0000","last_peered":"2023-05-17T14:53:52.897717+0000","last_clean":"2023-05-17T14:53:52.897717+0000","last_became_active":"2023-05-17T14:53:52.897401+0000","last_became_peered":"2023-05-17T14:53:52.897401+0000","last_unstale":"2023-05-17T14:53:52.897717+0000","last_undegraded":"2023-05-17T14:53:52.897717+0000","last_fullsized":"2023-05-17T14:53:52.897717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892623+0000","last_change":"2023-05-17T14:53:52.497633+0000","last_active":"2023-05-17T14:53:52.892623+0000","last_peered":"2023-05-17T14:53:52.892623+0000","last_clean":"2023-05-17T14:53:52.892623+0000","last_became_active":"2023-05-17T14:53:52.497319+0000","last_became_peered":"2023-05-17T14:53:52.497319+0000","last_unstale":"2023-05-17T14:53:52.892623+0000","last_undegraded":"2023-05-17T14:53:52.892623+0000","last_fullsized":"2023-05-17T14:53:52.892623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905474+0000","last_change":"2023-05-17T14:53:52.903639+0000","last_active":"2023-05-17T14:53:52.905474+0000","last_peered":"2023-05-17T14:53:52.905474+0000","last_clean":"2023-05-17T14:53:52.905474+0000","last_became_active":"2023-05-17T14:53:52.903343+0000","last_became_peered":"2023-05-17T14:53:52.903343+0000","last_unstale":"2023-05-17T14:53:52.905474+0000","last_undegraded":"2023-05-17T14:53:52.905474+0000","last_fullsized":"2023-05-17T14:53:52.905474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.515373+0000","last_change":"2023-05-17T14:53:52.513391+0000","last_active":"2023-05-17T14:53:52.515373+0000","last_peered":"2023-05-17T14:53:52.515373+0000","last_clean":"2023-05-17T14:53:52.515373+0000","last_became_active":"2023-05-17T14:53:52.513085+0000","last_became_peered":"2023-05-17T14:53:52.513085+0000","last_unstale":"2023-05-17T14:53:52.515373+0000","last_undegraded":"2023-05-17T14:53:52.515373+0000","last_fullsized":"2023-05-17T14:53:52.515373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901401+0000","last_change":"2023-05-17T14:53:52.898454+0000","last_active":"2023-05-17T14:53:52.901401+0000","last_peered":"2023-05-17T14:53:52.901401+0000","last_clean":"2023-05-17T14:53:52.901401+0000","last_became_active":"2023-05-17T14:53:52.898174+0000","last_became_peered":"2023-05-17T14:53:52.898174+0000","last_unstale":"2023-05-17T14:53:52.901401+0000","last_undegraded":"2023-05-17T14:53:52.901401+0000","last_fullsized":"2023-05-17T14:53:52.901401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.510476+0000","last_change":"2023-05-17T14:53:52.504777+0000","last_active":"2023-05-17T14:53:52.510476+0000","last_peered":"2023-05-17T14:53:52.510476+0000","last_clean":"2023-05-17T14:53:52.510476+0000","last_became_active":"2023-05-17T14:53:52.504452+0000","last_became_peered":"2023-05-17T14:53:52.504452+0000","last_unstale":"2023-05-17T14:53:52.510476+0000","last_undegraded":"2023-05-17T14:53:52.510476+0000","last_fullsized":"2023-05-17T14:53:52.510476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891991+0000","last_change":"2023-05-17T14:53:52.891991+0000","last_active":"2023-05-17T14:53:52.891991+0000","last_peered":"2023-05-17T14:53:52.891991+0000","last_clean":"2023-05-17T14:53:52.891991+0000","last_became_active":"2023-05-17T14:53:52.891701+0000","last_became_peered":"2023-05-17T14:53:52.891701+0000","last_unstale":"2023-05-17T14:53:52.891991+0000","last_undegraded":"2023-05-17T14:53:52.891991+0000","last_fullsized":"2023-05-17T14:53:52.891991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889899+0000","last_change":"2023-05-17T14:53:52.510727+0000","last_active":"2023-05-17T14:53:52.889899+0000","last_peered":"2023-05-17T14:53:52.889899+0000","last_clean":"2023-05-17T14:53:52.889899+0000","last_became_active":"2023-05-17T14:53:52.510427+0000","last_became_peered":"2023-05-17T14:53:52.510427+0000","last_unstale":"2023-05-17T14:53:52.889899+0000","last_undegraded":"2023-05-17T14:53:52.889899+0000","last_fullsized":"2023-05-17T14:53:52.889899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897836+0000","last_change":"2023-05-17T14:53:52.897836+0000","last_active":"2023-05-17T14:53:52.897836+0000","last_peered":"2023-05-17T14:53:52.897836+0000","last_clean":"2023-05-17T14:53:52.897836+0000","last_became_active":"2023-05-17T14:53:52.897537+0000","last_became_peered":"2023-05-17T14:53:52.897537+0000","last_unstale":"2023-05-17T14:53:52.897836+0000","last_undegraded":"2023-05-17T14:53:52.897836+0000","last_fullsized":"2023-05-17T14:53:52.897836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892163+0000","last_change":"2023-05-17T14:53:52.506710+0000","last_active":"2023-05-17T14:53:52.892163+0000","last_peered":"2023-05-17T14:53:52.892163+0000","last_clean":"2023-05-17T14:53:52.892163+0000","last_became_active":"2023-05-17T14:53:52.506388+0000","last_became_peered":"2023-05-17T14:53:52.506388+0000","last_unstale":"2023-05-17T14:53:52.892163+0000","last_undegraded":"2023-05-17T14:53:52.892163+0000","last_fullsized":"2023-05-17T14:53:52.892163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897342+0000","last_change":"2023-05-17T14:53:52.897342+0000","last_active":"2023-05-17T14:53:52.897342+0000","last_peered":"2023-05-17T14:53:52.897342+0000","last_clean":"2023-05-17T14:53:52.897342+0000","last_became_active":"2023-05-17T14:53:52.897001+0000","last_became_peered":"2023-05-17T14:53:52.897001+0000","last_unstale":"2023-05-17T14:53:52.897342+0000","last_undegraded":"2023-05-17T14:53:52.897342+0000","last_fullsized":"2023-05-17T14:53:52.897342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907466+0000","last_change":"2023-05-17T14:53:52.512698+0000","last_active":"2023-05-17T14:53:52.907466+0000","last_peered":"2023-05-17T14:53:52.907466+0000","last_clean":"2023-05-17T14:53:52.907466+0000","last_became_active":"2023-05-17T14:53:52.512388+0000","last_became_peered":"2023-05-17T14:53:52.512388+0000","last_unstale":"2023-05-17T14:53:52.907466+0000","last_undegraded":"2023-05-17T14:53:52.907466+0000","last_fullsized":"2023-05-17T14:53:52.907466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907123+0000","last_change":"2023-05-17T14:53:52.902935+0000","last_active":"2023-05-17T14:53:52.907123+0000","last_peered":"2023-05-17T14:53:52.907123+0000","last_clean":"2023-05-17T14:53:52.907123+0000","last_became_active":"2023-05-17T14:53:52.902576+0000","last_became_peered":"2023-05-17T14:53:52.902576+0000","last_unstale":"2023-05-17T14:53:52.907123+0000","last_undegraded":"2023-05-17T14:53:52.907123+0000","last_fullsized":"2023-05-17T14:53:52.907123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904663+0000","last_change":"2023-05-17T14:53:52.505380+0000","last_active":"2023-05-17T14:53:52.904663+0000","last_peered":"2023-05-17T14:53:52.904663+0000","last_clean":"2023-05-17T14:53:52.904663+0000","last_became_active":"2023-05-17T14:53:52.505079+0000","last_became_peered":"2023-05-17T14:53:52.505079+0000","last_unstale":"2023-05-17T14:53:52.904663+0000","last_undegraded":"2023-05-17T14:53:52.904663+0000","last_fullsized":"2023-05-17T14:53:52.904663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899688+0000","last_change":"2023-05-17T14:53:52.899688+0000","last_active":"2023-05-17T14:53:52.899688+0000","last_peered":"2023-05-17T14:53:52.899688+0000","last_clean":"2023-05-17T14:53:52.899688+0000","last_became_active":"2023-05-17T14:53:52.899370+0000","last_became_peered":"2023-05-17T14:53:52.899370+0000","last_unstale":"2023-05-17T14:53:52.899688+0000","last_undegraded":"2023-05-17T14:53:52.899688+0000","last_fullsized":"2023-05-17T14:53:52.899688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901968+0000","last_change":"2023-05-17T14:53:52.511747+0000","last_active":"2023-05-17T14:53:52.901968+0000","last_peered":"2023-05-17T14:53:52.901968+0000","last_clean":"2023-05-17T14:53:52.901968+0000","last_became_active":"2023-05-17T14:53:52.511252+0000","last_became_peered":"2023-05-17T14:53:52.511252+0000","last_unstale":"2023-05-17T14:53:52.901968+0000","last_undegraded":"2023-05-17T14:53:52.901968+0000","last_fullsized":"2023-05-17T14:53:52.901968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905393+0000","last_change":"2023-05-17T14:53:52.897006+0000","last_active":"2023-05-17T14:53:52.905393+0000","last_peered":"2023-05-17T14:53:52.905393+0000","last_clean":"2023-05-17T14:53:52.905393+0000","last_became_active":"2023-05-17T14:53:52.896750+0000","last_became_peered":"2023-05-17T14:53:52.896750+0000","last_unstale":"2023-05-17T14:53:52.905393+0000","last_undegraded":"2023-05-17T14:53:52.905393+0000","last_fullsized":"2023-05-17T14:53:52.905393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885046+0000","last_change":"2023-05-17T14:53:52.509606+0000","last_active":"2023-05-17T14:53:52.885046+0000","last_peered":"2023-05-17T14:53:52.885046+0000","last_clean":"2023-05-17T14:53:52.885046+0000","last_became_active":"2023-05-17T14:53:52.509314+0000","last_became_peered":"2023-05-17T14:53:52.509314+0000","last_unstale":"2023-05-17T14:53:52.885046+0000","last_undegraded":"2023-05-17T14:53:52.885046+0000","last_fullsized":"2023-05-17T14:53:52.885046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910146+0000","last_change":"2023-05-17T14:53:52.906844+0000","last_active":"2023-05-17T14:53:52.910146+0000","last_peered":"2023-05-17T14:53:52.910146+0000","last_clean":"2023-05-17T14:53:52.910146+0000","last_became_active":"2023-05-17T14:53:52.906538+0000","last_became_peered":"2023-05-17T14:53:52.906538+0000","last_unstale":"2023-05-17T14:53:52.910146+0000","last_undegraded":"2023-05-17T14:53:52.910146+0000","last_fullsized":"2023-05-17T14:53:52.910146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882654+0000","last_change":"2023-05-17T14:53:52.510353+0000","last_active":"2023-05-17T14:53:52.882654+0000","last_peered":"2023-05-17T14:53:52.882654+0000","last_clean":"2023-05-17T14:53:52.882654+0000","last_became_active":"2023-05-17T14:53:52.509900+0000","last_became_peered":"2023-05-17T14:53:52.509900+0000","last_unstale":"2023-05-17T14:53:52.882654+0000","last_undegraded":"2023-05-17T14:53:52.882654+0000","last_fullsized":"2023-05-17T14:53:52.882654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902457+0000","last_change":"2023-05-17T14:53:52.902457+0000","last_active":"2023-05-17T14:53:52.902457+0000","last_peered":"2023-05-17T14:53:52.902457+0000","last_clean":"2023-05-17T14:53:52.902457+0000","last_became_active":"2023-05-17T14:53:52.899322+0000","last_became_peered":"2023-05-17T14:53:52.899322+0000","last_unstale":"2023-05-17T14:53:52.902457+0000","last_undegraded":"2023-05-17T14:53:52.902457+0000","last_fullsized":"2023-05-17T14:53:52.902457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906085+0000","last_change":"2023-05-17T14:53:52.509899+0000","last_active":"2023-05-17T14:53:52.906085+0000","last_peered":"2023-05-17T14:53:52.906085+0000","last_clean":"2023-05-17T14:53:52.906085+0000","last_became_active":"2023-05-17T14:53:52.509603+0000","last_became_peered":"2023-05-17T14:53:52.509603+0000","last_unstale":"2023-05-17T14:53:52.906085+0000","last_undegraded":"2023-05-17T14:53:52.906085+0000","last_fullsized":"2023-05-17T14:53:52.906085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905607+0000","last_change":"2023-05-17T14:53:52.897908+0000","last_active":"2023-05-17T14:53:52.905607+0000","last_peered":"2023-05-17T14:53:52.905607+0000","last_clean":"2023-05-17T14:53:52.905607+0000","last_became_active":"2023-05-17T14:53:52.896815+0000","last_became_peered":"2023-05-17T14:53:52.896815+0000","last_unstale":"2023-05-17T14:53:52.905607+0000","last_undegraded":"2023-05-17T14:53:52.905607+0000","last_fullsized":"2023-05-17T14:53:52.905607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902172+0000","last_change":"2023-05-17T14:53:52.511011+0000","last_active":"2023-05-17T14:53:52.902172+0000","last_peered":"2023-05-17T14:53:52.902172+0000","last_clean":"2023-05-17T14:53:52.902172+0000","last_became_active":"2023-05-17T14:53:52.510709+0000","last_became_peered":"2023-05-17T14:53:52.510709+0000","last_unstale":"2023-05-17T14:53:52.902172+0000","last_undegraded":"2023-05-17T14:53:52.902172+0000","last_fullsized":"2023-05-17T14:53:52.902172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908989+0000","last_change":"2023-05-17T14:53:52.904488+0000","last_active":"2023-05-17T14:53:52.908989+0000","last_peered":"2023-05-17T14:53:52.908989+0000","last_clean":"2023-05-17T14:53:52.908989+0000","last_became_active":"2023-05-17T14:53:52.904167+0000","last_became_peered":"2023-05-17T14:53:52.904167+0000","last_unstale":"2023-05-17T14:53:52.908989+0000","last_undegraded":"2023-05-17T14:53:52.908989+0000","last_fullsized":"2023-05-17T14:53:52.908989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902101+0000","last_change":"2023-05-17T14:53:52.509220+0000","last_active":"2023-05-17T14:53:52.902101+0000","last_peered":"2023-05-17T14:53:52.902101+0000","last_clean":"2023-05-17T14:53:52.902101+0000","last_became_active":"2023-05-17T14:53:52.508840+0000","last_became_peered":"2023-05-17T14:53:52.508840+0000","last_unstale":"2023-05-17T14:53:52.902101+0000","last_undegraded":"2023-05-17T14:53:52.902101+0000","last_fullsized":"2023-05-17T14:53:52.902101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909059+0000","last_change":"2023-05-17T14:53:52.904802+0000","last_active":"2023-05-17T14:53:52.909059+0000","last_peered":"2023-05-17T14:53:52.909059+0000","last_clean":"2023-05-17T14:53:52.909059+0000","last_became_active":"2023-05-17T14:53:52.904586+0000","last_became_peered":"2023-05-17T14:53:52.904586+0000","last_unstale":"2023-05-17T14:53:52.909059+0000","last_undegraded":"2023-05-17T14:53:52.909059+0000","last_fullsized":"2023-05-17T14:53:52.909059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883458+0000","last_change":"2023-05-17T14:53:52.503482+0000","last_active":"2023-05-17T14:53:52.883458+0000","last_peered":"2023-05-17T14:53:52.883458+0000","last_clean":"2023-05-17T14:53:52.883458+0000","last_became_active":"2023-05-17T14:53:52.503210+0000","last_became_peered":"2023-05-17T14:53:52.503210+0000","last_unstale":"2023-05-17T14:53:52.883458+0000","last_undegraded":"2023-05-17T14:53:52.883458+0000","last_fullsized":"2023-05-17T14:53:52.883458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905302+0000","last_change":"2023-05-17T14:53:52.902058+0000","last_active":"2023-05-17T14:53:52.905302+0000","last_peered":"2023-05-17T14:53:52.905302+0000","last_clean":"2023-05-17T14:53:52.905302+0000","last_became_active":"2023-05-17T14:53:52.896933+0000","last_became_peered":"2023-05-17T14:53:52.896933+0000","last_unstale":"2023-05-17T14:53:52.905302+0000","last_undegraded":"2023-05-17T14:53:52.905302+0000","last_fullsized":"2023-05-17T14:53:52.905302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886188+0000","last_change":"2023-05-17T14:53:52.511969+0000","last_active":"2023-05-17T14:53:52.886188+0000","last_peered":"2023-05-17T14:53:52.886188+0000","last_clean":"2023-05-17T14:53:52.886188+0000","last_became_active":"2023-05-17T14:53:52.511242+0000","last_became_peered":"2023-05-17T14:53:52.511242+0000","last_unstale":"2023-05-17T14:53:52.886188+0000","last_undegraded":"2023-05-17T14:53:52.886188+0000","last_fullsized":"2023-05-17T14:53:52.886188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909577+0000","last_change":"2023-05-17T14:53:52.907876+0000","last_active":"2023-05-17T14:53:52.909577+0000","last_peered":"2023-05-17T14:53:52.909577+0000","last_clean":"2023-05-17T14:53:52.909577+0000","last_became_active":"2023-05-17T14:53:52.907296+0000","last_became_peered":"2023-05-17T14:53:52.907296+0000","last_unstale":"2023-05-17T14:53:52.909577+0000","last_undegraded":"2023-05-17T14:53:52.909577+0000","last_fullsized":"2023-05-17T14:53:52.909577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879821+0000","last_change":"2023-05-17T14:53:52.511043+0000","last_active":"2023-05-17T14:53:52.879821+0000","last_peered":"2023-05-17T14:53:52.879821+0000","last_clean":"2023-05-17T14:53:52.879821+0000","last_became_active":"2023-05-17T14:53:52.510747+0000","last_became_peered":"2023-05-17T14:53:52.510747+0000","last_unstale":"2023-05-17T14:53:52.879821+0000","last_undegraded":"2023-05-17T14:53:52.879821+0000","last_fullsized":"2023-05-17T14:53:52.879821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909470+0000","last_change":"2023-05-17T14:53:52.906776+0000","last_active":"2023-05-17T14:53:52.909470+0000","last_peered":"2023-05-17T14:53:52.909470+0000","last_clean":"2023-05-17T14:53:52.909470+0000","last_became_active":"2023-05-17T14:53:52.906469+0000","last_became_peered":"2023-05-17T14:53:52.906469+0000","last_unstale":"2023-05-17T14:53:52.909470+0000","last_undegraded":"2023-05-17T14:53:52.909470+0000","last_fullsized":"2023-05-17T14:53:52.909470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888445+0000","last_change":"2023-05-17T14:53:52.499620+0000","last_active":"2023-05-17T14:53:52.888445+0000","last_peered":"2023-05-17T14:53:52.888445+0000","last_clean":"2023-05-17T14:53:52.888445+0000","last_became_active":"2023-05-17T14:53:52.498310+0000","last_became_peered":"2023-05-17T14:53:52.498310+0000","last_unstale":"2023-05-17T14:53:52.888445+0000","last_undegraded":"2023-05-17T14:53:52.888445+0000","last_fullsized":"2023-05-17T14:53:52.888445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908983+0000","last_change":"2023-05-17T14:53:52.903907+0000","last_active":"2023-05-17T14:53:52.908983+0000","last_peered":"2023-05-17T14:53:52.908983+0000","last_clean":"2023-05-17T14:53:52.908983+0000","last_became_active":"2023-05-17T14:53:52.903272+0000","last_became_peered":"2023-05-17T14:53:52.903272+0000","last_unstale":"2023-05-17T14:53:52.908983+0000","last_undegraded":"2023-05-17T14:53:52.908983+0000","last_fullsized":"2023-05-17T14:53:52.908983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896150+0000","last_change":"2023-05-17T14:53:52.496758+0000","last_active":"2023-05-17T14:53:52.896150+0000","last_peered":"2023-05-17T14:53:52.896150+0000","last_clean":"2023-05-17T14:53:52.896150+0000","last_became_active":"2023-05-17T14:53:52.496374+0000","last_became_peered":"2023-05-17T14:53:52.496374+0000","last_unstale":"2023-05-17T14:53:52.896150+0000","last_undegraded":"2023-05-17T14:53:52.896150+0000","last_fullsized":"2023-05-17T14:53:52.896150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893066+0000","last_change":"2023-05-17T14:53:52.893066+0000","last_active":"2023-05-17T14:53:52.893066+0000","last_peered":"2023-05-17T14:53:52.893066+0000","last_clean":"2023-05-17T14:53:52.893066+0000","last_became_active":"2023-05-17T14:53:52.892743+0000","last_became_peered":"2023-05-17T14:53:52.892743+0000","last_unstale":"2023-05-17T14:53:52.893066+0000","last_undegraded":"2023-05-17T14:53:52.893066+0000","last_fullsized":"2023-05-17T14:53:52.893066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.519285+0000","last_change":"2023-05-17T14:53:52.515582+0000","last_active":"2023-05-17T14:53:52.519285+0000","last_peered":"2023-05-17T14:53:52.519285+0000","last_clean":"2023-05-17T14:53:52.519285+0000","last_became_active":"2023-05-17T14:53:52.514941+0000","last_became_peered":"2023-05-17T14:53:52.514941+0000","last_unstale":"2023-05-17T14:53:52.519285+0000","last_undegraded":"2023-05-17T14:53:52.519285+0000","last_fullsized":"2023-05-17T14:53:52.519285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.487277+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T14:53:52.487277+0000","last_peered":"2023-05-17T14:53:52.487277+0000","last_clean":"2023-05-17T14:53:52.487277+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T14:53:52.487277+0000","last_undegraded":"2023-05-17T14:53:52.487277+0000","last_fullsized":"2023-05-17T14:53:52.487277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890966+0000","last_change":"2023-05-17T14:53:52.514000+0000","last_active":"2023-05-17T14:53:52.890966+0000","last_peered":"2023-05-17T14:53:52.890966+0000","last_clean":"2023-05-17T14:53:52.890966+0000","last_became_active":"2023-05-17T14:53:52.512785+0000","last_became_peered":"2023-05-17T14:53:52.512785+0000","last_unstale":"2023-05-17T14:53:52.890966+0000","last_undegraded":"2023-05-17T14:53:52.890966+0000","last_fullsized":"2023-05-17T14:53:52.890966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.898360+0000","last_change":"2023-05-17T14:53:52.898360+0000","last_active":"2023-05-17T14:53:52.898360+0000","last_peered":"2023-05-17T14:53:52.898360+0000","last_clean":"2023-05-17T14:53:52.898360+0000","last_became_active":"2023-05-17T14:53:52.898085+0000","last_became_peered":"2023-05-17T14:53:52.898085+0000","last_unstale":"2023-05-17T14:53:52.898360+0000","last_undegraded":"2023-05-17T14:53:52.898360+0000","last_fullsized":"2023-05-17T14:53:52.898360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886393+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T14:53:52.886393+0000","last_peered":"2023-05-17T14:53:52.886393+0000","last_clean":"2023-05-17T14:53:52.886393+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T14:53:52.886393+0000","last_undegraded":"2023-05-17T14:53:52.886393+0000","last_fullsized":"2023-05-17T14:53:52.886393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894570+0000","last_change":"2023-05-17T14:53:52.504726+0000","last_active":"2023-05-17T14:53:52.894570+0000","last_peered":"2023-05-17T14:53:52.894570+0000","last_clean":"2023-05-17T14:53:52.894570+0000","last_became_active":"2023-05-17T14:53:52.504248+0000","last_became_peered":"2023-05-17T14:53:52.504248+0000","last_unstale":"2023-05-17T14:53:52.894570+0000","last_undegraded":"2023-05-17T14:53:52.894570+0000","last_fullsized":"2023-05-17T14:53:52.894570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894491+0000","last_change":"2023-05-17T14:53:52.894491+0000","last_active":"2023-05-17T14:53:52.894491+0000","last_peered":"2023-05-17T14:53:52.894491+0000","last_clean":"2023-05-17T14:53:52.894491+0000","last_became_active":"2023-05-17T14:53:52.894207+0000","last_became_peered":"2023-05-17T14:53:52.894207+0000","last_unstale":"2023-05-17T14:53:52.894491+0000","last_undegraded":"2023-05-17T14:53:52.894491+0000","last_fullsized":"2023-05-17T14:53:52.894491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900499+0000","last_change":"2023-05-17T14:53:52.900499+0000","last_active":"2023-05-17T14:53:52.900499+0000","last_peered":"2023-05-17T14:53:52.900499+0000","last_clean":"2023-05-17T14:53:52.900499+0000","last_became_active":"2023-05-17T14:53:52.900219+0000","last_became_peered":"2023-05-17T14:53:52.900219+0000","last_unstale":"2023-05-17T14:53:52.900499+0000","last_undegraded":"2023-05-17T14:53:52.900499+0000","last_fullsized":"2023-05-17T14:53:52.900499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885427+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T14:53:52.885427+0000","last_peered":"2023-05-17T14:53:52.885427+0000","last_clean":"2023-05-17T14:53:52.885427+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T14:53:52.885427+0000","last_undegraded":"2023-05-17T14:53:52.885427+0000","last_fullsized":"2023-05-17T14:53:52.885427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.498120+0000","last_change":"2023-05-17T14:53:52.495004+0000","last_active":"2023-05-17T14:53:52.498120+0000","last_peered":"2023-05-17T14:53:52.498120+0000","last_clean":"2023-05-17T14:53:52.498120+0000","last_became_active":"2023-05-17T14:53:52.494690+0000","last_became_peered":"2023-05-17T14:53:52.494690+0000","last_unstale":"2023-05-17T14:53:52.498120+0000","last_undegraded":"2023-05-17T14:53:52.498120+0000","last_fullsized":"2023-05-17T14:53:52.498120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904891+0000","last_change":"2023-05-17T14:53:52.901552+0000","last_active":"2023-05-17T14:53:52.904891+0000","last_peered":"2023-05-17T14:53:52.904891+0000","last_clean":"2023-05-17T14:53:52.904891+0000","last_became_active":"2023-05-17T14:53:52.901241+0000","last_became_peered":"2023-05-17T14:53:52.901241+0000","last_unstale":"2023-05-17T14:53:52.904891+0000","last_undegraded":"2023-05-17T14:53:52.904891+0000","last_fullsized":"2023-05-17T14:53:52.904891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890070+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T14:53:52.890070+0000","last_peered":"2023-05-17T14:53:52.890070+0000","last_clean":"2023-05-17T14:53:52.890070+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T14:53:52.890070+0000","last_undegraded":"2023-05-17T14:53:52.890070+0000","last_fullsized":"2023-05-17T14:53:52.890070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882188+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T14:53:52.882188+0000","last_peered":"2023-05-17T14:53:52.882188+0000","last_clean":"2023-05-17T14:53:52.882188+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T14:53:52.882188+0000","last_undegraded":"2023-05-17T14:53:52.882188+0000","last_fullsized":"2023-05-17T14:53:52.882188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.511579+0000","last_change":"2023-05-17T14:53:52.509749+0000","last_active":"2023-05-17T14:53:52.511579+0000","last_peered":"2023-05-17T14:53:52.511579+0000","last_clean":"2023-05-17T14:53:52.511579+0000","last_became_active":"2023-05-17T14:53:52.509447+0000","last_became_peered":"2023-05-17T14:53:52.509447+0000","last_unstale":"2023-05-17T14:53:52.511579+0000","last_undegraded":"2023-05-17T14:53:52.511579+0000","last_fullsized":"2023-05-17T14:53:52.511579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905144+0000","last_change":"2023-05-17T14:53:52.897391+0000","last_active":"2023-05-17T14:53:52.905144+0000","last_peered":"2023-05-17T14:53:52.905144+0000","last_clean":"2023-05-17T14:53:52.905144+0000","last_became_active":"2023-05-17T14:53:52.897101+0000","last_became_peered":"2023-05-17T14:53:52.897101+0000","last_unstale":"2023-05-17T14:53:52.905144+0000","last_undegraded":"2023-05-17T14:53:52.905144+0000","last_fullsized":"2023-05-17T14:53:52.905144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882503+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T14:53:52.882503+0000","last_peered":"2023-05-17T14:53:52.882503+0000","last_clean":"2023-05-17T14:53:52.882503+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T14:53:52.882503+0000","last_undegraded":"2023-05-17T14:53:52.882503+0000","last_fullsized":"2023-05-17T14:53:52.882503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886662+0000","last_change":"2023-05-17T14:53:52.509023+0000","last_active":"2023-05-17T14:53:52.886662+0000","last_peered":"2023-05-17T14:53:52.886662+0000","last_clean":"2023-05-17T14:53:52.886662+0000","last_became_active":"2023-05-17T14:53:52.508648+0000","last_became_peered":"2023-05-17T14:53:52.508648+0000","last_unstale":"2023-05-17T14:53:52.886662+0000","last_undegraded":"2023-05-17T14:53:52.886662+0000","last_fullsized":"2023-05-17T14:53:52.886662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883453+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T14:53:52.883453+0000","last_peered":"2023-05-17T14:53:52.883453+0000","last_clean":"2023-05-17T14:53:52.883453+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T14:53:52.883453+0000","last_undegraded":"2023-05-17T14:53:52.883453+0000","last_fullsized":"2023-05-17T14:53:52.883453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.500866+0000","last_change":"2023-05-17T14:53:52.496859+0000","last_active":"2023-05-17T14:53:52.500866+0000","last_peered":"2023-05-17T14:53:52.500866+0000","last_clean":"2023-05-17T14:53:52.500866+0000","last_became_active":"2023-05-17T14:53:52.496451+0000","last_became_peered":"2023-05-17T14:53:52.496451+0000","last_unstale":"2023-05-17T14:53:52.500866+0000","last_undegraded":"2023-05-17T14:53:52.500866+0000","last_fullsized":"2023-05-17T14:53:52.500866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905245+0000","last_change":"2023-05-17T14:53:52.901622+0000","last_active":"2023-05-17T14:53:52.905245+0000","last_peered":"2023-05-17T14:53:52.905245+0000","last_clean":"2023-05-17T14:53:52.905245+0000","last_became_active":"2023-05-17T14:53:52.901357+0000","last_became_peered":"2023-05-17T14:53:52.901357+0000","last_unstale":"2023-05-17T14:53:52.905245+0000","last_undegraded":"2023-05-17T14:53:52.905245+0000","last_fullsized":"2023-05-17T14:53:52.905245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902610+0000","last_change":"2023-05-17T14:53:52.512750+0000","last_active":"2023-05-17T14:53:52.902610+0000","last_peered":"2023-05-17T14:53:52.902610+0000","last_clean":"2023-05-17T14:53:52.902610+0000","last_became_active":"2023-05-17T14:53:52.512415+0000","last_became_peered":"2023-05-17T14:53:52.512415+0000","last_unstale":"2023-05-17T14:53:52.902610+0000","last_undegraded":"2023-05-17T14:53:52.902610+0000","last_fullsized":"2023-05-17T14:53:52.902610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.487396+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T14:53:52.487396+0000","last_peered":"2023-05-17T14:53:52.487396+0000","last_clean":"2023-05-17T14:53:52.487396+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T14:53:52.487396+0000","last_undegraded":"2023-05-17T14:53:52.487396+0000","last_fullsized":"2023-05-17T14:53:52.487396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899029+0000","last_change":"2023-05-17T14:53:52.899029+0000","last_active":"2023-05-17T14:53:52.899029+0000","last_peered":"2023-05-17T14:53:52.899029+0000","last_clean":"2023-05-17T14:53:52.899029+0000","last_became_active":"2023-05-17T14:53:52.898737+0000","last_became_peered":"2023-05-17T14:53:52.898737+0000","last_unstale":"2023-05-17T14:53:52.899029+0000","last_undegraded":"2023-05-17T14:53:52.899029+0000","last_fullsized":"2023-05-17T14:53:52.899029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894067+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T14:53:52.894067+0000","last_peered":"2023-05-17T14:53:52.894067+0000","last_clean":"2023-05-17T14:53:52.894067+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T14:53:52.894067+0000","last_undegraded":"2023-05-17T14:53:52.894067+0000","last_fullsized":"2023-05-17T14:53:52.894067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890359+0000","last_change":"2023-05-17T14:53:52.510050+0000","last_active":"2023-05-17T14:53:52.890359+0000","last_peered":"2023-05-17T14:53:52.890359+0000","last_clean":"2023-05-17T14:53:52.890359+0000","last_became_active":"2023-05-17T14:53:52.509746+0000","last_became_peered":"2023-05-17T14:53:52.509746+0000","last_unstale":"2023-05-17T14:53:52.890359+0000","last_undegraded":"2023-05-17T14:53:52.890359+0000","last_fullsized":"2023-05-17T14:53:52.890359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907584+0000","last_change":"2023-05-17T14:53:52.902447+0000","last_active":"2023-05-17T14:53:52.907584+0000","last_peered":"2023-05-17T14:53:52.907584+0000","last_clean":"2023-05-17T14:53:52.907584+0000","last_became_active":"2023-05-17T14:53:52.902177+0000","last_became_peered":"2023-05-17T14:53:52.902177+0000","last_unstale":"2023-05-17T14:53:52.907584+0000","last_undegraded":"2023-05-17T14:53:52.907584+0000","last_fullsized":"2023-05-17T14:53:52.907584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906251+0000","last_change":"2023-05-17T14:53:52.900925+0000","last_active":"2023-05-17T14:53:52.906251+0000","last_peered":"2023-05-17T14:53:52.906251+0000","last_clean":"2023-05-17T14:53:52.906251+0000","last_became_active":"2023-05-17T14:53:52.900643+0000","last_became_peered":"2023-05-17T14:53:52.900643+0000","last_unstale":"2023-05-17T14:53:52.906251+0000","last_undegraded":"2023-05-17T14:53:52.906251+0000","last_fullsized":"2023-05-17T14:53:52.906251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891905+0000","last_change":"2023-05-17T14:53:52.509026+0000","last_active":"2023-05-17T14:53:52.891905+0000","last_peered":"2023-05-17T14:53:52.891905+0000","last_clean":"2023-05-17T14:53:52.891905+0000","last_became_active":"2023-05-17T14:53:52.508652+0000","last_became_peered":"2023-05-17T14:53:52.508652+0000","last_unstale":"2023-05-17T14:53:52.891905+0000","last_undegraded":"2023-05-17T14:53:52.891905+0000","last_fullsized":"2023-05-17T14:53:52.891905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907099+0000","last_change":"2023-05-17T14:53:52.902271+0000","last_active":"2023-05-17T14:53:52.907099+0000","last_peered":"2023-05-17T14:53:52.907099+0000","last_clean":"2023-05-17T14:53:52.907099+0000","last_became_active":"2023-05-17T14:53:52.901952+0000","last_became_peered":"2023-05-17T14:53:52.901952+0000","last_unstale":"2023-05-17T14:53:52.907099+0000","last_undegraded":"2023-05-17T14:53:52.907099+0000","last_fullsized":"2023-05-17T14:53:52.907099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886300+0000","last_change":"2023-05-17T14:53:52.497235+0000","last_active":"2023-05-17T14:53:52.886300+0000","last_peered":"2023-05-17T14:53:52.886300+0000","last_clean":"2023-05-17T14:53:52.886300+0000","last_became_active":"2023-05-17T14:53:52.496955+0000","last_became_peered":"2023-05-17T14:53:52.496955+0000","last_unstale":"2023-05-17T14:53:52.886300+0000","last_undegraded":"2023-05-17T14:53:52.886300+0000","last_fullsized":"2023-05-17T14:53:52.886300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909526+0000","last_change":"2023-05-17T14:53:52.907098+0000","last_active":"2023-05-17T14:53:52.909526+0000","last_peered":"2023-05-17T14:53:52.909526+0000","last_clean":"2023-05-17T14:53:52.909526+0000","last_became_active":"2023-05-17T14:53:52.906769+0000","last_became_peered":"2023-05-17T14:53:52.906769+0000","last_unstale":"2023-05-17T14:53:52.909526+0000","last_undegraded":"2023-05-17T14:53:52.909526+0000","last_fullsized":"2023-05-17T14:53:52.909526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900754+0000","last_change":"2023-05-17T14:53:52.498922+0000","last_active":"2023-05-17T14:53:52.900754+0000","last_peered":"2023-05-17T14:53:52.900754+0000","last_clean":"2023-05-17T14:53:52.900754+0000","last_became_active":"2023-05-17T14:53:52.498588+0000","last_became_peered":"2023-05-17T14:53:52.498588+0000","last_unstale":"2023-05-17T14:53:52.900754+0000","last_undegraded":"2023-05-17T14:53:52.900754+0000","last_fullsized":"2023-05-17T14:53:52.900754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894285+0000","last_change":"2023-05-17T14:53:52.894285+0000","last_active":"2023-05-17T14:53:52.894285+0000","last_peered":"2023-05-17T14:53:52.894285+0000","last_clean":"2023-05-17T14:53:52.894285+0000","last_became_active":"2023-05-17T14:53:52.894001+0000","last_became_peered":"2023-05-17T14:53:52.894001+0000","last_unstale":"2023-05-17T14:53:52.894285+0000","last_undegraded":"2023-05-17T14:53:52.894285+0000","last_fullsized":"2023-05-17T14:53:52.894285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.880042+0000","last_change":"2023-05-17T14:53:52.509439+0000","last_active":"2023-05-17T14:53:52.880042+0000","last_peered":"2023-05-17T14:53:52.880042+0000","last_clean":"2023-05-17T14:53:52.880042+0000","last_became_active":"2023-05-17T14:53:52.509043+0000","last_became_peered":"2023-05-17T14:53:52.509043+0000","last_unstale":"2023-05-17T14:53:52.880042+0000","last_undegraded":"2023-05-17T14:53:52.880042+0000","last_fullsized":"2023-05-17T14:53:52.880042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909041+0000","last_change":"2023-05-17T14:53:52.904168+0000","last_active":"2023-05-17T14:53:52.909041+0000","last_peered":"2023-05-17T14:53:52.909041+0000","last_clean":"2023-05-17T14:53:52.909041+0000","last_became_active":"2023-05-17T14:53:52.903277+0000","last_became_peered":"2023-05-17T14:53:52.903277+0000","last_unstale":"2023-05-17T14:53:52.909041+0000","last_undegraded":"2023-05-17T14:53:52.909041+0000","last_fullsized":"2023-05-17T14:53:52.909041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900967+0000","last_change":"2023-05-17T14:53:52.501619+0000","last_active":"2023-05-17T14:53:52.900967+0000","last_peered":"2023-05-17T14:53:52.900967+0000","last_clean":"2023-05-17T14:53:52.900967+0000","last_became_active":"2023-05-17T14:53:52.501429+0000","last_became_peered":"2023-05-17T14:53:52.501429+0000","last_unstale":"2023-05-17T14:53:52.900967+0000","last_undegraded":"2023-05-17T14:53:52.900967+0000","last_fullsized":"2023-05-17T14:53:52.900967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901698+0000","last_change":"2023-05-17T14:53:52.901698+0000","last_active":"2023-05-17T14:53:52.901698+0000","last_peered":"2023-05-17T14:53:52.901698+0000","last_clean":"2023-05-17T14:53:52.901698+0000","last_became_active":"2023-05-17T14:53:52.901287+0000","last_became_peered":"2023-05-17T14:53:52.901287+0000","last_unstale":"2023-05-17T14:53:52.901698+0000","last_undegraded":"2023-05-17T14:53:52.901698+0000","last_fullsized":"2023-05-17T14:53:52.901698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889720+0000","last_change":"2023-05-17T14:53:52.509971+0000","last_active":"2023-05-17T14:53:52.889720+0000","last_peered":"2023-05-17T14:53:52.889720+0000","last_clean":"2023-05-17T14:53:52.889720+0000","last_became_active":"2023-05-17T14:53:52.509661+0000","last_became_peered":"2023-05-17T14:53:52.509661+0000","last_unstale":"2023-05-17T14:53:52.889720+0000","last_undegraded":"2023-05-17T14:53:52.889720+0000","last_fullsized":"2023-05-17T14:53:52.889720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894638+0000","last_change":"2023-05-17T14:53:52.894638+0000","last_active":"2023-05-17T14:53:52.894638+0000","last_peered":"2023-05-17T14:53:52.894638+0000","last_clean":"2023-05-17T14:53:52.894638+0000","last_became_active":"2023-05-17T14:53:52.894342+0000","last_became_peered":"2023-05-17T14:53:52.894342+0000","last_unstale":"2023-05-17T14:53:52.894638+0000","last_undegraded":"2023-05-17T14:53:52.894638+0000","last_fullsized":"2023-05-17T14:53:52.894638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885492+0000","last_change":"2023-05-17T14:53:52.505043+0000","last_active":"2023-05-17T14:53:52.885492+0000","last_peered":"2023-05-17T14:53:52.885492+0000","last_clean":"2023-05-17T14:53:52.885492+0000","last_became_active":"2023-05-17T14:53:52.504736+0000","last_became_peered":"2023-05-17T14:53:52.504736+0000","last_unstale":"2023-05-17T14:53:52.885492+0000","last_undegraded":"2023-05-17T14:53:52.885492+0000","last_fullsized":"2023-05-17T14:53:52.885492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905425+0000","last_change":"2023-05-17T14:53:52.897228+0000","last_active":"2023-05-17T14:53:52.905425+0000","last_peered":"2023-05-17T14:53:52.905425+0000","last_clean":"2023-05-17T14:53:52.905425+0000","last_became_active":"2023-05-17T14:53:52.896713+0000","last_became_peered":"2023-05-17T14:53:52.896713+0000","last_unstale":"2023-05-17T14:53:52.905425+0000","last_undegraded":"2023-05-17T14:53:52.905425+0000","last_fullsized":"2023-05-17T14:53:52.905425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886282+0000","last_change":"2023-05-17T14:53:52.511403+0000","last_active":"2023-05-17T14:53:52.886282+0000","last_peered":"2023-05-17T14:53:52.886282+0000","last_clean":"2023-05-17T14:53:52.886282+0000","last_became_active":"2023-05-17T14:53:52.510928+0000","last_became_peered":"2023-05-17T14:53:52.510928+0000","last_unstale":"2023-05-17T14:53:52.886282+0000","last_undegraded":"2023-05-17T14:53:52.886282+0000","last_fullsized":"2023-05-17T14:53:52.886282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893358+0000","last_change":"2023-05-17T14:53:52.893358+0000","last_active":"2023-05-17T14:53:52.893358+0000","last_peered":"2023-05-17T14:53:52.893358+0000","last_clean":"2023-05-17T14:53:52.893358+0000","last_became_active":"2023-05-17T14:53:52.893025+0000","last_became_peered":"2023-05-17T14:53:52.893025+0000","last_unstale":"2023-05-17T14:53:52.893358+0000","last_undegraded":"2023-05-17T14:53:52.893358+0000","last_fullsized":"2023-05-17T14:53:52.893358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891615+0000","last_change":"2023-05-17T14:53:52.512447+0000","last_active":"2023-05-17T14:53:52.891615+0000","last_peered":"2023-05-17T14:53:52.891615+0000","last_clean":"2023-05-17T14:53:52.891615+0000","last_became_active":"2023-05-17T14:53:52.511951+0000","last_became_peered":"2023-05-17T14:53:52.511951+0000","last_unstale":"2023-05-17T14:53:52.891615+0000","last_undegraded":"2023-05-17T14:53:52.891615+0000","last_fullsized":"2023-05-17T14:53:52.891615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899902+0000","last_change":"2023-05-17T14:53:52.899902+0000","last_active":"2023-05-17T14:53:52.899902+0000","last_peered":"2023-05-17T14:53:52.899902+0000","last_clean":"2023-05-17T14:53:52.899902+0000","last_became_active":"2023-05-17T14:53:52.899381+0000","last_became_peered":"2023-05-17T14:53:52.899381+0000","last_unstale":"2023-05-17T14:53:52.899902+0000","last_undegraded":"2023-05-17T14:53:52.899902+0000","last_fullsized":"2023-05-17T14:53:52.899902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.519265+0000","last_change":"2023-05-17T14:53:52.515232+0000","last_active":"2023-05-17T14:53:52.519265+0000","last_peered":"2023-05-17T14:53:52.519265+0000","last_clean":"2023-05-17T14:53:52.519265+0000","last_became_active":"2023-05-17T14:53:52.514555+0000","last_became_peered":"2023-05-17T14:53:52.514555+0000","last_unstale":"2023-05-17T14:53:52.519265+0000","last_undegraded":"2023-05-17T14:53:52.519265+0000","last_fullsized":"2023-05-17T14:53:52.519265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906744+0000","last_change":"2023-05-17T14:53:52.903058+0000","last_active":"2023-05-17T14:53:52.906744+0000","last_peered":"2023-05-17T14:53:52.906744+0000","last_clean":"2023-05-17T14:53:52.906744+0000","last_became_active":"2023-05-17T14:53:52.902615+0000","last_became_peered":"2023-05-17T14:53:52.902615+0000","last_unstale":"2023-05-17T14:53:52.906744+0000","last_undegraded":"2023-05-17T14:53:52.906744+0000","last_fullsized":"2023-05-17T14:53:52.906744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.515340+0000","last_change":"2023-05-17T14:53:52.513421+0000","last_active":"2023-05-17T14:53:52.515340+0000","last_peered":"2023-05-17T14:53:52.515340+0000","last_clean":"2023-05-17T14:53:52.515340+0000","last_became_active":"2023-05-17T14:53:52.513120+0000","last_became_peered":"2023-05-17T14:53:52.513120+0000","last_unstale":"2023-05-17T14:53:52.515340+0000","last_undegraded":"2023-05-17T14:53:52.515340+0000","last_fullsized":"2023-05-17T14:53:52.515340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899077+0000","last_change":"2023-05-17T14:53:52.899077+0000","last_active":"2023-05-17T14:53:52.899077+0000","last_peered":"2023-05-17T14:53:52.899077+0000","last_clean":"2023-05-17T14:53:52.899077+0000","last_became_active":"2023-05-17T14:53:52.898767+0000","last_became_peered":"2023-05-17T14:53:52.898767+0000","last_unstale":"2023-05-17T14:53:52.899077+0000","last_undegraded":"2023-05-17T14:53:52.899077+0000","last_fullsized":"2023-05-17T14:53:52.899077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887616+0000","last_change":"2023-05-17T14:53:52.502548+0000","last_active":"2023-05-17T14:53:52.887616+0000","last_peered":"2023-05-17T14:53:52.887616+0000","last_clean":"2023-05-17T14:53:52.887616+0000","last_became_active":"2023-05-17T14:53:52.501702+0000","last_became_peered":"2023-05-17T14:53:52.501702+0000","last_unstale":"2023-05-17T14:53:52.887616+0000","last_undegraded":"2023-05-17T14:53:52.887616+0000","last_fullsized":"2023-05-17T14:53:52.887616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901668+0000","last_change":"2023-05-17T14:53:52.897118+0000","last_active":"2023-05-17T14:53:52.901668+0000","last_peered":"2023-05-17T14:53:52.901668+0000","last_clean":"2023-05-17T14:53:52.901668+0000","last_became_active":"2023-05-17T14:53:52.896806+0000","last_became_peered":"2023-05-17T14:53:52.896806+0000","last_unstale":"2023-05-17T14:53:52.901668+0000","last_undegraded":"2023-05-17T14:53:52.901668+0000","last_fullsized":"2023-05-17T14:53:52.901668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.511494+0000","last_change":"2023-05-17T14:53:52.507358+0000","last_active":"2023-05-17T14:53:52.511494+0000","last_peered":"2023-05-17T14:53:52.511494+0000","last_clean":"2023-05-17T14:53:52.511494+0000","last_became_active":"2023-05-17T14:53:52.507091+0000","last_became_peered":"2023-05-17T14:53:52.507091+0000","last_unstale":"2023-05-17T14:53:52.511494+0000","last_undegraded":"2023-05-17T14:53:52.511494+0000","last_fullsized":"2023-05-17T14:53:52.511494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910197+0000","last_change":"2023-05-17T14:53:52.908557+0000","last_active":"2023-05-17T14:53:52.910197+0000","last_peered":"2023-05-17T14:53:52.910197+0000","last_clean":"2023-05-17T14:53:52.910197+0000","last_became_active":"2023-05-17T14:53:52.908298+0000","last_became_peered":"2023-05-17T14:53:52.908298+0000","last_unstale":"2023-05-17T14:53:52.910197+0000","last_undegraded":"2023-05-17T14:53:52.910197+0000","last_fullsized":"2023-05-17T14:53:52.910197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885994+0000","last_change":"2023-05-17T14:53:52.512296+0000","last_active":"2023-05-17T14:53:52.885994+0000","last_peered":"2023-05-17T14:53:52.885994+0000","last_clean":"2023-05-17T14:53:52.885994+0000","last_became_active":"2023-05-17T14:53:52.512018+0000","last_became_peered":"2023-05-17T14:53:52.512018+0000","last_unstale":"2023-05-17T14:53:52.885994+0000","last_undegraded":"2023-05-17T14:53:52.885994+0000","last_fullsized":"2023-05-17T14:53:52.885994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909007+0000","last_change":"2023-05-17T14:53:52.904120+0000","last_active":"2023-05-17T14:53:52.909007+0000","last_peered":"2023-05-17T14:53:52.909007+0000","last_clean":"2023-05-17T14:53:52.909007+0000","last_became_active":"2023-05-17T14:53:52.903622+0000","last_became_peered":"2023-05-17T14:53:52.903622+0000","last_unstale":"2023-05-17T14:53:52.909007+0000","last_undegraded":"2023-05-17T14:53:52.909007+0000","last_fullsized":"2023-05-17T14:53:52.909007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.517045+0000","last_change":"2023-05-17T14:53:52.514693+0000","last_active":"2023-05-17T14:53:52.517045+0000","last_peered":"2023-05-17T14:53:52.517045+0000","last_clean":"2023-05-17T14:53:52.517045+0000","last_became_active":"2023-05-17T14:53:52.514371+0000","last_became_peered":"2023-05-17T14:53:52.514371+0000","last_unstale":"2023-05-17T14:53:52.517045+0000","last_undegraded":"2023-05-17T14:53:52.517045+0000","last_fullsized":"2023-05-17T14:53:52.517045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907461+0000","last_change":"2023-05-17T14:53:52.905496+0000","last_active":"2023-05-17T14:53:52.907461+0000","last_peered":"2023-05-17T14:53:52.907461+0000","last_clean":"2023-05-17T14:53:52.907461+0000","last_became_active":"2023-05-17T14:53:52.902849+0000","last_became_peered":"2023-05-17T14:53:52.902849+0000","last_unstale":"2023-05-17T14:53:52.907461+0000","last_undegraded":"2023-05-17T14:53:52.907461+0000","last_fullsized":"2023-05-17T14:53:52.907461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886660+0000","last_change":"2023-05-17T14:53:52.507074+0000","last_active":"2023-05-17T14:53:52.886660+0000","last_peered":"2023-05-17T14:53:52.886660+0000","last_clean":"2023-05-17T14:53:52.886660+0000","last_became_active":"2023-05-17T14:53:52.506648+0000","last_became_peered":"2023-05-17T14:53:52.506648+0000","last_unstale":"2023-05-17T14:53:52.886660+0000","last_undegraded":"2023-05-17T14:53:52.886660+0000","last_fullsized":"2023-05-17T14:53:52.886660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909075+0000","last_change":"2023-05-17T14:53:52.905035+0000","last_active":"2023-05-17T14:53:52.909075+0000","last_peered":"2023-05-17T14:53:52.909075+0000","last_clean":"2023-05-17T14:53:52.909075+0000","last_became_active":"2023-05-17T14:53:52.903028+0000","last_became_peered":"2023-05-17T14:53:52.903028+0000","last_unstale":"2023-05-17T14:53:52.909075+0000","last_undegraded":"2023-05-17T14:53:52.909075+0000","last_fullsized":"2023-05-17T14:53:52.909075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896399+0000","last_change":"2023-05-17T14:53:52.510568+0000","last_active":"2023-05-17T14:53:52.896399+0000","last_peered":"2023-05-17T14:53:52.896399+0000","last_clean":"2023-05-17T14:53:52.896399+0000","last_became_active":"2023-05-17T14:53:52.510243+0000","last_became_peered":"2023-05-17T14:53:52.510243+0000","last_unstale":"2023-05-17T14:53:52.896399+0000","last_undegraded":"2023-05-17T14:53:52.896399+0000","last_fullsized":"2023-05-17T14:53:52.896399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900510+0000","last_change":"2023-05-17T14:53:52.899184+0000","last_active":"2023-05-17T14:53:52.900510+0000","last_peered":"2023-05-17T14:53:52.900510+0000","last_clean":"2023-05-17T14:53:52.900510+0000","last_became_active":"2023-05-17T14:53:52.898867+0000","last_became_peered":"2023-05-17T14:53:52.898867+0000","last_unstale":"2023-05-17T14:53:52.900510+0000","last_undegraded":"2023-05-17T14:53:52.900510+0000","last_fullsized":"2023-05-17T14:53:52.900510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889663+0000","last_change":"2023-05-17T14:53:52.499276+0000","last_active":"2023-05-17T14:53:52.889663+0000","last_peered":"2023-05-17T14:53:52.889663+0000","last_clean":"2023-05-17T14:53:52.889663+0000","last_became_active":"2023-05-17T14:53:52.498250+0000","last_became_peered":"2023-05-17T14:53:52.498250+0000","last_unstale":"2023-05-17T14:53:52.889663+0000","last_undegraded":"2023-05-17T14:53:52.889663+0000","last_fullsized":"2023-05-17T14:53:52.889663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905444+0000","last_change":"2023-05-17T14:53:52.903548+0000","last_active":"2023-05-17T14:53:52.905444+0000","last_peered":"2023-05-17T14:53:52.905444+0000","last_clean":"2023-05-17T14:53:52.905444+0000","last_became_active":"2023-05-17T14:53:52.903278+0000","last_became_peered":"2023-05-17T14:53:52.903278+0000","last_unstale":"2023-05-17T14:53:52.905444+0000","last_undegraded":"2023-05-17T14:53:52.905444+0000","last_fullsized":"2023-05-17T14:53:52.905444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896027+0000","last_change":"2023-05-17T14:53:52.504834+0000","last_active":"2023-05-17T14:53:52.896027+0000","last_peered":"2023-05-17T14:53:52.896027+0000","last_clean":"2023-05-17T14:53:52.896027+0000","last_became_active":"2023-05-17T14:53:52.504516+0000","last_became_peered":"2023-05-17T14:53:52.504516+0000","last_unstale":"2023-05-17T14:53:52.896027+0000","last_undegraded":"2023-05-17T14:53:52.896027+0000","last_fullsized":"2023-05-17T14:53:52.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899616+0000","last_change":"2023-05-17T14:53:52.899616+0000","last_active":"2023-05-17T14:53:52.899616+0000","last_peered":"2023-05-17T14:53:52.899616+0000","last_clean":"2023-05-17T14:53:52.899616+0000","last_became_active":"2023-05-17T14:53:52.899304+0000","last_became_peered":"2023-05-17T14:53:52.899304+0000","last_unstale":"2023-05-17T14:53:52.899616+0000","last_undegraded":"2023-05-17T14:53:52.899616+0000","last_fullsized":"2023-05-17T14:53:52.899616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883276+0000","last_change":"2023-05-17T14:53:52.498387+0000","last_active":"2023-05-17T14:53:52.883276+0000","last_peered":"2023-05-17T14:53:52.883276+0000","last_clean":"2023-05-17T14:53:52.883276+0000","last_became_active":"2023-05-17T14:53:52.498124+0000","last_became_peered":"2023-05-17T14:53:52.498124+0000","last_unstale":"2023-05-17T14:53:52.883276+0000","last_undegraded":"2023-05-17T14:53:52.883276+0000","last_fullsized":"2023-05-17T14:53:52.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907377+0000","last_change":"2023-05-17T14:53:52.900446+0000","last_active":"2023-05-17T14:53:52.907377+0000","last_peered":"2023-05-17T14:53:52.907377+0000","last_clean":"2023-05-17T14:53:52.907377+0000","last_became_active":"2023-05-17T14:53:52.899252+0000","last_became_peered":"2023-05-17T14:53:52.899252+0000","last_unstale":"2023-05-17T14:53:52.907377+0000","last_undegraded":"2023-05-17T14:53:52.907377+0000","last_fullsized":"2023-05-17T14:53:52.907377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886699+0000","last_change":"2023-05-17T14:53:52.507558+0000","last_active":"2023-05-17T14:53:52.886699+0000","last_peered":"2023-05-17T14:53:52.886699+0000","last_clean":"2023-05-17T14:53:52.886699+0000","last_became_active":"2023-05-17T14:53:52.507272+0000","last_became_peered":"2023-05-17T14:53:52.507272+0000","last_unstale":"2023-05-17T14:53:52.886699+0000","last_undegraded":"2023-05-17T14:53:52.886699+0000","last_fullsized":"2023-05-17T14:53:52.886699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910217+0000","last_change":"2023-05-17T14:53:52.908565+0000","last_active":"2023-05-17T14:53:52.910217+0000","last_peered":"2023-05-17T14:53:52.910217+0000","last_clean":"2023-05-17T14:53:52.910217+0000","last_became_active":"2023-05-17T14:53:52.908327+0000","last_became_peered":"2023-05-17T14:53:52.908327+0000","last_unstale":"2023-05-17T14:53:52.910217+0000","last_undegraded":"2023-05-17T14:53:52.910217+0000","last_fullsized":"2023-05-17T14:53:52.910217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905977+0000","last_change":"2023-05-17T14:53:52.507620+0000","last_active":"2023-05-17T14:53:52.905977+0000","last_peered":"2023-05-17T14:53:52.905977+0000","last_clean":"2023-05-17T14:53:52.905977+0000","last_became_active":"2023-05-17T14:53:52.505456+0000","last_became_peered":"2023-05-17T14:53:52.505456+0000","last_unstale":"2023-05-17T14:53:52.905977+0000","last_undegraded":"2023-05-17T14:53:52.905977+0000","last_fullsized":"2023-05-17T14:53:52.905977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905309+0000","last_change":"2023-05-17T14:53:52.898134+0000","last_active":"2023-05-17T14:53:52.905309+0000","last_peered":"2023-05-17T14:53:52.905309+0000","last_clean":"2023-05-17T14:53:52.905309+0000","last_became_active":"2023-05-17T14:53:52.897754+0000","last_became_peered":"2023-05-17T14:53:52.897754+0000","last_unstale":"2023-05-17T14:53:52.905309+0000","last_undegraded":"2023-05-17T14:53:52.905309+0000","last_fullsized":"2023-05-17T14:53:52.905309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.503284+0000","last_change":"2023-05-17T14:53:52.498029+0000","last_active":"2023-05-17T14:53:52.503284+0000","last_peered":"2023-05-17T14:53:52.503284+0000","last_clean":"2023-05-17T14:53:52.503284+0000","last_became_active":"2023-05-17T14:53:52.497667+0000","last_became_peered":"2023-05-17T14:53:52.497667+0000","last_unstale":"2023-05-17T14:53:52.503284+0000","last_undegraded":"2023-05-17T14:53:52.503284+0000","last_fullsized":"2023-05-17T14:53:52.503284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908878+0000","last_change":"2023-05-17T14:53:52.903794+0000","last_active":"2023-05-17T14:53:52.908878+0000","last_peered":"2023-05-17T14:53:52.908878+0000","last_clean":"2023-05-17T14:53:52.908878+0000","last_became_active":"2023-05-17T14:53:52.903482+0000","last_became_peered":"2023-05-17T14:53:52.903482+0000","last_unstale":"2023-05-17T14:53:52.908878+0000","last_undegraded":"2023-05-17T14:53:52.908878+0000","last_fullsized":"2023-05-17T14:53:52.908878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885250+0000","last_change":"2023-05-17T14:53:52.501031+0000","last_active":"2023-05-17T14:53:52.885250+0000","last_peered":"2023-05-17T14:53:52.885250+0000","last_clean":"2023-05-17T14:53:52.885250+0000","last_became_active":"2023-05-17T14:53:52.500624+0000","last_became_peered":"2023-05-17T14:53:52.500624+0000","last_unstale":"2023-05-17T14:53:52.885250+0000","last_undegraded":"2023-05-17T14:53:52.885250+0000","last_fullsized":"2023-05-17T14:53:52.885250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907527+0000","last_change":"2023-05-17T14:53:52.904355+0000","last_active":"2023-05-17T14:53:52.907527+0000","last_peered":"2023-05-17T14:53:52.907527+0000","last_clean":"2023-05-17T14:53:52.907527+0000","last_became_active":"2023-05-17T14:53:52.901353+0000","last_became_peered":"2023-05-17T14:53:52.901353+0000","last_unstale":"2023-05-17T14:53:52.907527+0000","last_undegraded":"2023-05-17T14:53:52.907527+0000","last_fullsized":"2023-05-17T14:53:52.907527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882918+0000","last_change":"2023-05-17T14:53:52.509583+0000","last_active":"2023-05-17T14:53:52.882918+0000","last_peered":"2023-05-17T14:53:52.882918+0000","last_clean":"2023-05-17T14:53:52.882918+0000","last_became_active":"2023-05-17T14:53:52.509033+0000","last_became_peered":"2023-05-17T14:53:52.509033+0000","last_unstale":"2023-05-17T14:53:52.882918+0000","last_undegraded":"2023-05-17T14:53:52.882918+0000","last_fullsized":"2023-05-17T14:53:52.882918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896099+0000","last_change":"2023-05-17T14:53:52.894065+0000","last_active":"2023-05-17T14:53:52.896099+0000","last_peered":"2023-05-17T14:53:52.896099+0000","last_clean":"2023-05-17T14:53:52.896099+0000","last_became_active":"2023-05-17T14:53:52.893755+0000","last_became_peered":"2023-05-17T14:53:52.893755+0000","last_unstale":"2023-05-17T14:53:52.896099+0000","last_undegraded":"2023-05-17T14:53:52.896099+0000","last_fullsized":"2023-05-17T14:53:52.896099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909266+0000","last_change":"2023-05-17T14:53:52.507353+0000","last_active":"2023-05-17T14:53:52.909266+0000","last_peered":"2023-05-17T14:53:52.909266+0000","last_clean":"2023-05-17T14:53:52.909266+0000","last_became_active":"2023-05-17T14:53:52.506014+0000","last_became_peered":"2023-05-17T14:53:52.506014+0000","last_unstale":"2023-05-17T14:53:52.909266+0000","last_undegraded":"2023-05-17T14:53:52.909266+0000","last_fullsized":"2023-05-17T14:53:52.909266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905670+0000","last_change":"2023-05-17T14:53:52.897660+0000","last_active":"2023-05-17T14:53:52.905670+0000","last_peered":"2023-05-17T14:53:52.905670+0000","last_clean":"2023-05-17T14:53:52.905670+0000","last_became_active":"2023-05-17T14:53:52.897344+0000","last_became_peered":"2023-05-17T14:53:52.897344+0000","last_unstale":"2023-05-17T14:53:52.905670+0000","last_undegraded":"2023-05-17T14:53:52.905670+0000","last_fullsized":"2023-05-17T14:53:52.905670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893946+0000","last_change":"2023-05-17T14:53:52.504680+0000","last_active":"2023-05-17T14:53:52.893946+0000","last_peered":"2023-05-17T14:53:52.893946+0000","last_clean":"2023-05-17T14:53:52.893946+0000","last_became_active":"2023-05-17T14:53:52.504385+0000","last_became_peered":"2023-05-17T14:53:52.504385+0000","last_unstale":"2023-05-17T14:53:52.893946+0000","last_undegraded":"2023-05-17T14:53:52.893946+0000","last_fullsized":"2023-05-17T14:53:52.893946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906580+0000","last_change":"2023-05-17T14:53:52.899592+0000","last_active":"2023-05-17T14:53:52.906580+0000","last_peered":"2023-05-17T14:53:52.906580+0000","last_clean":"2023-05-17T14:53:52.906580+0000","last_became_active":"2023-05-17T14:53:52.899272+0000","last_became_peered":"2023-05-17T14:53:52.899272+0000","last_unstale":"2023-05-17T14:53:52.906580+0000","last_undegraded":"2023-05-17T14:53:52.906580+0000","last_fullsized":"2023-05-17T14:53:52.906580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887745+0000","last_change":"2023-05-17T14:53:52.502007+0000","last_active":"2023-05-17T14:53:52.887745+0000","last_peered":"2023-05-17T14:53:52.887745+0000","last_clean":"2023-05-17T14:53:52.887745+0000","last_became_active":"2023-05-17T14:53:52.501336+0000","last_became_peered":"2023-05-17T14:53:52.501336+0000","last_unstale":"2023-05-17T14:53:52.887745+0000","last_undegraded":"2023-05-17T14:53:52.887745+0000","last_fullsized":"2023-05-17T14:53:52.887745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909028+0000","last_change":"2023-05-17T14:53:52.904025+0000","last_active":"2023-05-17T14:53:52.909028+0000","last_peered":"2023-05-17T14:53:52.909028+0000","last_clean":"2023-05-17T14:53:52.909028+0000","last_became_active":"2023-05-17T14:53:52.903652+0000","last_became_peered":"2023-05-17T14:53:52.903652+0000","last_unstale":"2023-05-17T14:53:52.909028+0000","last_undegraded":"2023-05-17T14:53:52.909028+0000","last_fullsized":"2023-05-17T14:53:52.909028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883073+0000","last_change":"2023-05-17T14:53:52.502927+0000","last_active":"2023-05-17T14:53:52.883073+0000","last_peered":"2023-05-17T14:53:52.883073+0000","last_clean":"2023-05-17T14:53:52.883073+0000","last_became_active":"2023-05-17T14:53:52.502633+0000","last_became_peered":"2023-05-17T14:53:52.502633+0000","last_unstale":"2023-05-17T14:53:52.883073+0000","last_undegraded":"2023-05-17T14:53:52.883073+0000","last_fullsized":"2023-05-17T14:53:52.883073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895093+0000","last_change":"2023-05-17T14:53:52.892437+0000","last_active":"2023-05-17T14:53:52.895093+0000","last_peered":"2023-05-17T14:53:52.895093+0000","last_clean":"2023-05-17T14:53:52.895093+0000","last_became_active":"2023-05-17T14:53:52.892121+0000","last_became_peered":"2023-05-17T14:53:52.892121+0000","last_unstale":"2023-05-17T14:53:52.895093+0000","last_undegraded":"2023-05-17T14:53:52.895093+0000","last_fullsized":"2023-05-17T14:53:52.895093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.512154+0000","last_change":"2023-05-17T14:53:52.511006+0000","last_active":"2023-05-17T14:53:52.512154+0000","last_peered":"2023-05-17T14:53:52.512154+0000","last_clean":"2023-05-17T14:53:52.512154+0000","last_became_active":"2023-05-17T14:53:52.510651+0000","last_became_peered":"2023-05-17T14:53:52.510651+0000","last_unstale":"2023-05-17T14:53:52.512154+0000","last_undegraded":"2023-05-17T14:53:52.512154+0000","last_fullsized":"2023-05-17T14:53:52.512154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905331+0000","last_change":"2023-05-17T14:53:52.898513+0000","last_active":"2023-05-17T14:53:52.905331+0000","last_peered":"2023-05-17T14:53:52.905331+0000","last_clean":"2023-05-17T14:53:52.905331+0000","last_became_active":"2023-05-17T14:53:52.898159+0000","last_became_peered":"2023-05-17T14:53:52.898159+0000","last_unstale":"2023-05-17T14:53:52.905331+0000","last_undegraded":"2023-05-17T14:53:52.905331+0000","last_fullsized":"2023-05-17T14:53:52.905331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882773+0000","last_change":"2023-05-17T14:53:52.512519+0000","last_active":"2023-05-17T14:53:52.882773+0000","last_peered":"2023-05-17T14:53:52.882773+0000","last_clean":"2023-05-17T14:53:52.882773+0000","last_became_active":"2023-05-17T14:53:52.512220+0000","last_became_peered":"2023-05-17T14:53:52.512220+0000","last_unstale":"2023-05-17T14:53:52.882773+0000","last_undegraded":"2023-05-17T14:53:52.882773+0000","last_fullsized":"2023-05-17T14:53:52.882773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909559+0000","last_change":"2023-05-17T14:53:52.907268+0000","last_active":"2023-05-17T14:53:52.909559+0000","last_peered":"2023-05-17T14:53:52.909559+0000","last_clean":"2023-05-17T14:53:52.909559+0000","last_became_active":"2023-05-17T14:53:52.906591+0000","last_became_peered":"2023-05-17T14:53:52.906591+0000","last_unstale":"2023-05-17T14:53:52.909559+0000","last_undegraded":"2023-05-17T14:53:52.909559+0000","last_fullsized":"2023-05-17T14:53:52.909559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897695+0000","last_change":"2023-05-17T14:53:52.506059+0000","last_active":"2023-05-17T14:53:52.897695+0000","last_peered":"2023-05-17T14:53:52.897695+0000","last_clean":"2023-05-17T14:53:52.897695+0000","last_became_active":"2023-05-17T14:53:52.505710+0000","last_became_peered":"2023-05-17T14:53:52.505710+0000","last_unstale":"2023-05-17T14:53:52.897695+0000","last_undegraded":"2023-05-17T14:53:52.897695+0000","last_fullsized":"2023-05-17T14:53:52.897695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901344+0000","last_change":"2023-05-17T14:53:52.897282+0000","last_active":"2023-05-17T14:53:52.901344+0000","last_peered":"2023-05-17T14:53:52.901344+0000","last_clean":"2023-05-17T14:53:52.901344+0000","last_became_active":"2023-05-17T14:53:52.896992+0000","last_became_peered":"2023-05-17T14:53:52.896992+0000","last_unstale":"2023-05-17T14:53:52.901344+0000","last_undegraded":"2023-05-17T14:53:52.901344+0000","last_fullsized":"2023-05-17T14:53:52.901344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895784+0000","last_change":"2023-05-17T14:53:52.511809+0000","last_active":"2023-05-17T14:53:52.895784+0000","last_peered":"2023-05-17T14:53:52.895784+0000","last_clean":"2023-05-17T14:53:52.895784+0000","last_became_active":"2023-05-17T14:53:52.511486+0000","last_became_peered":"2023-05-17T14:53:52.511486+0000","last_unstale":"2023-05-17T14:53:52.895784+0000","last_undegraded":"2023-05-17T14:53:52.895784+0000","last_fullsized":"2023-05-17T14:53:52.895784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910222+0000","last_change":"2023-05-17T14:53:52.909184+0000","last_active":"2023-05-17T14:53:52.910222+0000","last_peered":"2023-05-17T14:53:52.910222+0000","last_clean":"2023-05-17T14:53:52.910222+0000","last_became_active":"2023-05-17T14:53:52.908851+0000","last_became_peered":"2023-05-17T14:53:52.908851+0000","last_unstale":"2023-05-17T14:53:52.910222+0000","last_undegraded":"2023-05-17T14:53:52.910222+0000","last_fullsized":"2023-05-17T14:53:52.910222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895604+0000","last_change":"2023-05-17T14:53:52.512162+0000","last_active":"2023-05-17T14:53:52.895604+0000","last_peered":"2023-05-17T14:53:52.895604+0000","last_clean":"2023-05-17T14:53:52.895604+0000","last_became_active":"2023-05-17T14:53:52.511653+0000","last_became_peered":"2023-05-17T14:53:52.511653+0000","last_unstale":"2023-05-17T14:53:52.895604+0000","last_undegraded":"2023-05-17T14:53:52.895604+0000","last_fullsized":"2023-05-17T14:53:52.895604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906723+0000","last_change":"2023-05-17T14:53:52.900703+0000","last_active":"2023-05-17T14:53:52.906723+0000","last_peered":"2023-05-17T14:53:52.906723+0000","last_clean":"2023-05-17T14:53:52.906723+0000","last_became_active":"2023-05-17T14:53:52.900419+0000","last_became_peered":"2023-05-17T14:53:52.900419+0000","last_unstale":"2023-05-17T14:53:52.906723+0000","last_undegraded":"2023-05-17T14:53:52.906723+0000","last_fullsized":"2023-05-17T14:53:52.906723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888598+0000","last_change":"2023-05-17T14:53:52.509848+0000","last_active":"2023-05-17T14:53:52.888598+0000","last_peered":"2023-05-17T14:53:52.888598+0000","last_clean":"2023-05-17T14:53:52.888598+0000","last_became_active":"2023-05-17T14:53:52.509559+0000","last_became_peered":"2023-05-17T14:53:52.509559+0000","last_unstale":"2023-05-17T14:53:52.888598+0000","last_undegraded":"2023-05-17T14:53:52.888598+0000","last_fullsized":"2023-05-17T14:53:52.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900610+0000","last_change":"2023-05-17T14:53:52.897408+0000","last_active":"2023-05-17T14:53:52.900610+0000","last_peered":"2023-05-17T14:53:52.900610+0000","last_clean":"2023-05-17T14:53:52.900610+0000","last_became_active":"2023-05-17T14:53:52.897133+0000","last_became_peered":"2023-05-17T14:53:52.897133+0000","last_unstale":"2023-05-17T14:53:52.900610+0000","last_undegraded":"2023-05-17T14:53:52.900610+0000","last_fullsized":"2023-05-17T14:53:52.900610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.511223+0000","last_change":"2023-05-17T14:53:52.505784+0000","last_active":"2023-05-17T14:53:52.511223+0000","last_peered":"2023-05-17T14:53:52.511223+0000","last_clean":"2023-05-17T14:53:52.511223+0000","last_became_active":"2023-05-17T14:53:52.505481+0000","last_became_peered":"2023-05-17T14:53:52.505481+0000","last_unstale":"2023-05-17T14:53:52.511223+0000","last_undegraded":"2023-05-17T14:53:52.511223+0000","last_fullsized":"2023-05-17T14:53:52.511223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908743+0000","last_change":"2023-05-17T14:53:52.905997+0000","last_active":"2023-05-17T14:53:52.908743+0000","last_peered":"2023-05-17T14:53:52.908743+0000","last_clean":"2023-05-17T14:53:52.908743+0000","last_became_active":"2023-05-17T14:53:52.905547+0000","last_became_peered":"2023-05-17T14:53:52.905547+0000","last_unstale":"2023-05-17T14:53:52.908743+0000","last_undegraded":"2023-05-17T14:53:52.908743+0000","last_fullsized":"2023-05-17T14:53:52.908743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901796+0000","last_change":"2023-05-17T14:53:52.503841+0000","last_active":"2023-05-17T14:53:52.901796+0000","last_peered":"2023-05-17T14:53:52.901796+0000","last_clean":"2023-05-17T14:53:52.901796+0000","last_became_active":"2023-05-17T14:53:52.502924+0000","last_became_peered":"2023-05-17T14:53:52.502924+0000","last_unstale":"2023-05-17T14:53:52.901796+0000","last_undegraded":"2023-05-17T14:53:52.901796+0000","last_fullsized":"2023-05-17T14:53:52.901796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":245760,"data_stored":80047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":86783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5100,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366740,"statfs":{"total":96636764160,"available":96631541760,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5216,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366624,"statfs":{"total":96636764160,"available":96631422976,"internally_reserved":0,"allocated":221184,"data_stored":78723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T14:53:57.278 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T14:53:57.279 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-17T14:53:57.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-17T14:53:57.279 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-17T14:53:57.280 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-17T14:53:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.422+0000 7f2a2b11c700 1 Processor -- start 2023-05-17T14:53:57.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.422+0000 7f2a2b11c700 1 -- start start 2023-05-17T14:53:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a2b11c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240c60c0 0x7f2a240c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a2b11c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a240aa3b0 0x7f2a240c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a2b11c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2405e7e0 con 0x7f2a240a9f70 2023-05-17T14:53:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a2b11c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2405eac0 con 0x7f2a240aa3b0 2023-05-17T14:53:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a2b11c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240bfd70 con 0x7f2a240c60c0 2023-05-17T14:53:57.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a296b9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a240aa3b0 0x7f2a240c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a23fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2a240a9f70 0x7f2a24153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33384/0 (socket says 172.21.15.27:33384) 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a23fff700 1 -- 172.21.15.27:0/2525323865 learned_addr learned my addr 172.21.15.27:0/2525323865 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.423+0000 7f2a296b9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a240aa3b0 0x7f2a240c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33824/0 (socket says 172.21.15.27:33824) 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a28eb8700 1 --2- 172.21.15.27:0/2525323865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240c60c0 0x7f2a240c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a296b9700 1 -- 172.21.15.27:0/2525323865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240c60c0 msgr2=0x7f2a240c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a296b9700 1 --2- 172.21.15.27:0/2525323865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240c60c0 0x7f2a240c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a296b9700 1 -- 172.21.15.27:0/2525323865 >> v1:172.21.15.27:6789/0 conn(0x7f2a240a9f70 legacy=0x7f2a24153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a296b9700 1 -- 172.21.15.27:0/2525323865 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240c0050 con 0x7f2a240aa3b0 2023-05-17T14:53:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a237fe700 1 -- 172.21.15.27:0/2525323865 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286226665 0 0) 0x7f2a2405e7e0 con 0x7f2a240a9f70 2023-05-17T14:53:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a296b9700 1 --2- 172.21.15.27:0/2525323865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240aa3b0 0x7f2a240c0850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2a14009760 tx=0x7f2a14009060).ready entity=mon.0 client_cookie=d2965beb50837d13 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a237fe700 1 -- 172.21.15.27:0/2525323865 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400b580 con 0x7f2a240aa3b0 2023-05-17T14:53:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a237fe700 1 -- 172.21.15.27:0/2525323865 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400b6e0 con 0x7f2a240aa3b0 2023-05-17T14:53:57.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a237fe700 1 -- 172.21.15.27:0/2525323865 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400ba60 con 0x7f2a240aa3b0 2023-05-17T14:53:57.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 -- 172.21.15.27:0/2525323865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240aa3b0 msgr2=0x7f2a240c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/2525323865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240aa3b0 0x7f2a240c0850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2a14009760 tx=0x7f2a14009060).stop 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 -- 172.21.15.27:0/2525323865 shutdown_connections 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/2525323865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240aa3b0 0x7f2a240c0850 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/2525323865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240c60c0 0x7f2a240c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 -- 172.21.15.27:0/2525323865 >> 172.21.15.27:0/2525323865 conn(0x7f2a24069e70 msgr2=0x7f2a2405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 -- 172.21.15.27:0/2525323865 shutdown_connections 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.424+0000 7f2a2b11c700 1 -- 172.21.15.27:0/2525323865 wait complete. 2023-05-17T14:53:57.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 Processor -- start 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 -- start start 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 0x7f2a2414cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240aa3b0 0x7f2a240cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a240c60c0 0x7f2a24167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240ae9b0 con 0x7f2a240a9f70 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240addc0 con 0x7f2a240c60c0 2023-05-17T14:53:57.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a2b11c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240ae080 con 0x7f2a240aa3b0 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.426+0000 7f2a28eb8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 0x7f2a2414cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 0x7f2a2414cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33826/0 (socket says 172.21.15.27:33826) 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 -- 172.21.15.27:0/271655961 learned_addr learned my addr 172.21.15.27:0/271655961 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a23fff700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240aa3b0 0x7f2a240cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a296b9700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a240c60c0 0x7f2a24167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 -- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240aa3b0 msgr2=0x7f2a240cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240aa3b0 0x7f2a240cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 -- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a240c60c0 msgr2=0x7f2a24167b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a240c60c0 0x7f2a24167b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 -- 172.21.15.27:0/271655961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140092a0 con 0x7f2a240a9f70 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a296b9700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a240c60c0 0x7f2a24167b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a28eb8700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 0x7f2a2414cd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2a1c007f60 tx=0x7f2a1c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ec40 con 0x7f2a240a9f70 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00eda0 con 0x7f2a240a9f70 2023-05-17T14:53:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240ae360 con 0x7f2a240a9f70 2023-05-17T14:53:57.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c014610 con 0x7f2a240a9f70 2023-05-17T14:53:57.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.427+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a24168860 con 0x7f2a240a9f70 2023-05-17T14:53:57.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.428+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2405f4a0 con 0x7f2a240a9f70 2023-05-17T14:53:57.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.428+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2a1c01b030 con 0x7f2a240a9f70 2023-05-17T14:53:57.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.429+0000 7f2a20ff9700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a1005ed90 0x7f2a10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.429+0000 7f2a23fff700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a1005ed90 0x7f2a10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.429+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2a1c079ec0 con 0x7f2a240a9f70 2023-05-17T14:53:57.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.429+0000 7f2a23fff700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a1005ed90 0x7f2a10061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2a24167ac0 tx=0x7f2a18007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.433+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a1c04b400 con 0x7f2a240a9f70 2023-05-17T14:53:57.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.651+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2a2406bdf0 con 0x7f2a240a9f70 2023-05-17T14:53:57.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.653+0000 7f2a20ff9700 1 -- 172.21.15.27:0/271655961 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148518 (secure 0 0 0) 0x7f2a1c019030 con 0x7f2a240a9f70 2023-05-17T14:53:57.659 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a1005ed90 msgr2=0x7f2a10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a1005ed90 0x7f2a10061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2a24167ac0 tx=0x7f2a18007bb0).stop 2023-05-17T14:53:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 msgr2=0x7f2a2414cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 0x7f2a2414cd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2a1c007f60 tx=0x7f2a1c009860).stop 2023-05-17T14:53:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 shutdown_connections 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a1005ed90 0x7f2a10061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a240c60c0 0x7f2a24167b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a240a9f70 0x7f2a2414cd50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 --2- 172.21.15.27:0/271655961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a240aa3b0 0x7f2a240cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 >> 172.21.15.27:0/271655961 conn(0x7f2a24069e70 msgr2=0x7f2a2414d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 shutdown_connections 2023-05-17T14:53:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.656+0000 7f2a2b11c700 1 -- 172.21.15.27:0/271655961 wait complete. 2023-05-17T14:53:57.671 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":86332},{"type":"v1","addr":"172.21.15.27:6833","nonce":86332}]},"active_addr":"172.21.15.27:6833/86332","active_change":"2023-05-17T14:53:39.551854+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":1880994171}]},{"addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3516131969}]}]} 2023-05-17T14:53:57.675 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-17T14:53:57.676 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-17T14:53:57.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:57.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.788+0000 7feb7a627700 1 Processor -- start 2023-05-17T14:53:57.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.788+0000 7feb7a627700 1 -- start start 2023-05-17T14:53:57.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb7a627700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74066510 0x7feb740668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb7a627700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb74063340 0x7feb740672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb7a627700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb740643e0 con 0x7feb74064870 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb7a627700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74067790 con 0x7feb74063340 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb7a627700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb740637d0 con 0x7feb74066510 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb737fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb74063340 0x7feb740672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb737fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb74063340 0x7feb740672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33836/0 (socket says 172.21.15.27:33836) 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb737fe700 1 -- 172.21.15.27:0/2689685774 learned_addr learned my addr 172.21.15.27:0/2689685774 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.789+0000 7feb73fff700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74066510 0x7feb740668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb737fe700 1 -- 172.21.15.27:0/2689685774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74066510 msgr2=0x7feb740668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb737fe700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74066510 0x7feb740668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb737fe700 1 -- 172.21.15.27:0/2689685774 >> v1:172.21.15.40:6789/0 conn(0x7feb74064870 legacy=0x7feb74151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb737fe700 1 -- 172.21.15.27:0/2689685774 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74063ab0 con 0x7feb74063340 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb73fff700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74066510 0x7feb740668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb737fe700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74063340 0x7feb740672a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7feb68006fd0 tx=0x7feb680090f0).ready entity=mon.0 client_cookie=8b5427fc56cc1ef3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb72ffd700 1 -- 172.21.15.27:0/2689685774 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800b600 con 0x7feb74063340 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb72ffd700 1 -- 172.21.15.27:0/2689685774 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6800b760 con 0x7feb74063340 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb72ffd700 1 -- 172.21.15.27:0/2689685774 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800bae0 con 0x7feb74063340 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 -- 172.21.15.27:0/2689685774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74063340 msgr2=0x7feb740672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74063340 0x7feb740672a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7feb68006fd0 tx=0x7feb680090f0).stop 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 -- 172.21.15.27:0/2689685774 shutdown_connections 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74066510 0x7feb740668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 --2- 172.21.15.27:0/2689685774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74063340 0x7feb740672a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 -- 172.21.15.27:0/2689685774 >> 172.21.15.27:0/2689685774 conn(0x7feb74068750 msgr2=0x7feb740c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.790+0000 7feb7a627700 1 -- 172.21.15.27:0/2689685774 shutdown_connections 2023-05-17T14:53:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.791+0000 7feb7a627700 1 -- 172.21.15.27:0/2689685774 wait complete. 2023-05-17T14:53:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 Processor -- start 2023-05-17T14:53:57.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 -- start start 2023-05-17T14:53:57.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 0x7feb741572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb74066510 0x7feb74146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74155cd0 0x7feb7414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74147430 con 0x7feb74064870 2023-05-17T14:53:57.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.792+0000 7feb7a627700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74156e30 con 0x7feb74066510 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb7a627700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb74156220 con 0x7feb74155cd0 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 0x7feb741572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 0x7feb741572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33840/0 (socket says 172.21.15.27:33840) 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 -- 172.21.15.27:0/3435654640 learned_addr learned my addr 172.21.15.27:0/3435654640 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb737fe700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb74066510 0x7feb74146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb78bc4700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74155cd0 0x7feb7414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 -- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74155cd0 msgr2=0x7feb7414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74155cd0 0x7feb7414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 -- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb74066510 msgr2=0x7feb74146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb74066510 0x7feb74146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 -- 172.21.15.27:0/3435654640 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68009370 con 0x7feb74064870 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb73fff700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 0x7feb741572c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7feb64009b70 tx=0x7feb64008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64014070 con 0x7feb74064870 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64009e80 con 0x7feb74064870 2023-05-17T14:53:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb74156500 con 0x7feb74064870 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64011960 con 0x7feb74064870 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.793+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb74156ac0 con 0x7feb74064870 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.794+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb74157110 con 0x7feb74064870 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.795+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feb64020030 con 0x7feb74064870 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.795+0000 7feb5bfff700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7feb6005ed60 0x7feb60061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.795+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feb6407d470 con 0x7feb74064870 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.795+0000 7feb737fe700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7feb6005ed60 0x7feb60061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.795+0000 7feb737fe700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7feb6005ed60 0x7feb60061220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7feb740623e0 tx=0x7feb68017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.799+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb6404ea60 con 0x7feb74064870 2023-05-17T14:53:57.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.972+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb74151750 con 0x7feb74064870 2023-05-17T14:53:57.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.973+0000 7feb5bfff700 1 -- 172.21.15.27:0/3435654640 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7feb64052080 con 0x7feb74064870 2023-05-17T14:53:57.977 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:57.977 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:57.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.974+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7feb6005ed60 msgr2=0x7feb60061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.974+0000 7feb7a627700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7feb6005ed60 0x7feb60061220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7feb740623e0 tx=0x7feb68017000).stop 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.974+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 msgr2=0x7feb741572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.974+0000 7feb7a627700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 0x7feb741572c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7feb64009b70 tx=0x7feb64008040).stop 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 shutdown_connections 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7feb6005ed60 0x7feb60061220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb74155cd0 0x7feb7414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb74064870 0x7feb741572c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 --2- 172.21.15.27:0/3435654640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb74066510 0x7feb74146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 >> 172.21.15.27:0/3435654640 conn(0x7feb74068750 msgr2=0x7feb740a8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 shutdown_connections 2023-05-17T14:53:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:57.975+0000 7feb7a627700 1 -- 172.21.15.27:0/3435654640 wait complete. 2023-05-17T14:53:57.990 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-17T14:53:57.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:53:58.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.102+0000 7f06de0ea700 1 Processor -- start 2023-05-17T14:53:58.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.102+0000 7f06de0ea700 1 -- start start 2023-05-17T14:53:58.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06de0ea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06d80c5f30 0x7f06d80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06de0ea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06d8158880 0x7f06d8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06de0ea700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80bfcd0 con 0x7f06d81541c0 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06de0ea700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80c0290 con 0x7f06d80c5f30 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06de0ea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80aa1a0 con 0x7f06d8158880 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06d80c5f30 0x7f06d80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f06d81541c0 0x7f06d80c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33412/0 (socket says 172.21.15.27:33412) 2023-05-17T14:53:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d7fff700 1 -- 172.21.15.27:0/3550483124 learned_addr learned my addr 172.21.15.27:0/3550483124 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d6ffd700 1 --2- 172.21.15.27:0/3550483124 >> v2:172.21.15.40:3300/0 conn(0x7f06d8158880 0x7f06d8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d77fe700 1 -- 172.21.15.27:0/3550483124 >> v2:172.21.15.40:3300/0 conn(0x7f06d8158880 msgr2=0x7f06d8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d77fe700 1 --2- 172.21.15.27:0/3550483124 >> v2:172.21.15.40:3300/0 conn(0x7f06d8158880 0x7f06d8153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d77fe700 1 -- 172.21.15.27:0/3550483124 >> v1:172.21.15.27:6789/0 conn(0x7f06d81541c0 legacy=0x7f06d80c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d77fe700 1 -- 172.21.15.27:0/3550483124 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80aa480 con 0x7f06d80c5f30 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.103+0000 7f06d67fc700 1 -- 172.21.15.27:0/3550483124 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847800189 0 0) 0x7f06d80bfcd0 con 0x7f06d81541c0 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06d77fe700 1 --2- 172.21.15.27:0/3550483124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d80c6310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f06d80c57b0 tx=0x7f06c8009060).ready entity=mon.0 client_cookie=737f6a90965e7dfc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06d67fc700 1 -- 172.21.15.27:0/3550483124 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800b580 con 0x7f06d80c5f30 2023-05-17T14:53:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06d67fc700 1 -- 172.21.15.27:0/3550483124 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c800b6e0 con 0x7f06d80c5f30 2023-05-17T14:53:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06d67fc700 1 -- 172.21.15.27:0/3550483124 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800ba60 con 0x7f06d80c5f30 2023-05-17T14:53:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 -- 172.21.15.27:0/3550483124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 msgr2=0x7f06d80c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 --2- 172.21.15.27:0/3550483124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d80c6310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f06d80c57b0 tx=0x7f06c8009060).stop 2023-05-17T14:53:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 -- 172.21.15.27:0/3550483124 shutdown_connections 2023-05-17T14:53:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 --2- 172.21.15.27:0/3550483124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d80c6310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 --2- 172.21.15.27:0/3550483124 >> v2:172.21.15.40:3300/0 conn(0x7f06d8158880 0x7f06d8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 -- 172.21.15.27:0/3550483124 >> 172.21.15.27:0/3550483124 conn(0x7f06d8069e70 msgr2=0x7f06d805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 -- 172.21.15.27:0/3550483124 shutdown_connections 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.104+0000 7f06de0ea700 1 -- 172.21.15.27:0/3550483124 wait complete. 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 Processor -- start 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 -- start start 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d8141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d81541c0 0x7f06d8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d8158880 0x7f06d8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8157b40 con 0x7f06d80c5f30 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8155c40 con 0x7f06d8158880 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06de0ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8155030 con 0x7f06d81541c0 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d8141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d8141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33854/0 (socket says 172.21.15.27:33854) 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.106+0000 7f06d77fe700 1 -- 172.21.15.27:0/1269661372 learned_addr learned my addr 172.21.15.27:0/1269661372 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d77fe700 1 -- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d81541c0 msgr2=0x7f06d8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d77fe700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d81541c0 0x7f06d8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d77fe700 1 -- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d8158880 msgr2=0x7f06d8157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d7fff700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d8158880 0x7f06d8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d77fe700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d8158880 0x7f06d8157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d77fe700 1 -- 172.21.15.27:0/1269661372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80092a0 con 0x7f06d80c5f30 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06d77fe700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d8141310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f06c8009e80 tx=0x7f06c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800b850 con 0x7f06d80c5f30 2023-05-17T14:53:58.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c800b9b0 con 0x7f06d80c5f30 2023-05-17T14:53:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d8155310 con 0x7f06d80c5f30 2023-05-17T14:53:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c801b690 con 0x7f06d80c5f30 2023-05-17T14:53:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.107+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d81558d0 con 0x7f06d80c5f30 2023-05-17T14:53:58.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.108+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d805f4a0 con 0x7f06d80c5f30 2023-05-17T14:53:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.109+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f06c800f070 con 0x7f06d80c5f30 2023-05-17T14:53:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.109+0000 7f06bf7fe700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f06c405ed60 0x7f06c4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.109+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f06c807be00 con 0x7f06d80c5f30 2023-05-17T14:53:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.109+0000 7f06d6ffd700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f06c405ed60 0x7f06c4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.109+0000 7f06d6ffd700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f06c405ed60 0x7f06c4061220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f06d8168ea0 tx=0x7f06cc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.113+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06c804d420 con 0x7f06d80c5f30 2023-05-17T14:53:58.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.284+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d806bdf0 con 0x7f06d80c5f30 2023-05-17T14:53:58.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.285+0000 7f06bf7fe700 1 -- 172.21.15.27:0/1269661372 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f06c8050a40 con 0x7f06d80c5f30 2023-05-17T14:53:58.289 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:53:58.290 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:53:58.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f06c405ed60 msgr2=0x7f06c4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f06c405ed60 0x7f06c4061220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f06d8168ea0 tx=0x7f06cc008040).stop 2023-05-17T14:53:58.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 msgr2=0x7f06d8141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d8141310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f06c8009e80 tx=0x7f06c8017000).stop 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 shutdown_connections 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f06c405ed60 0x7f06c4061220 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d8158880 0x7f06d8157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80c5f30 0x7f06d8141310 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 --2- 172.21.15.27:0/1269661372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d81541c0 0x7f06d8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 >> 172.21.15.27:0/1269661372 conn(0x7f06d8069e70 msgr2=0x7f06d80aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 shutdown_connections 2023-05-17T14:53:58.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.287+0000 7f06de0ea700 1 -- 172.21.15.27:0/1269661372 wait complete. 2023-05-17T14:53:58.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-17T14:53:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.416+0000 7f219ce90700 1 Processor -- start 2023-05-17T14:53:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.416+0000 7f219ce90700 1 -- start start 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f219ce90700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f2198067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f219ce90700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2198066c10 0x7f21980bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f219ce90700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21980c1bf0 con 0x7f21980c1790 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f219ce90700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980678e0 con 0x7f2198066c10 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f219ce90700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c3300 con 0x7f2198150c20 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f2196d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2198066c10 0x7f21980bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f2196d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2198066c10 0x7f21980bd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33866/0 (socket says 172.21.15.27:33866) 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.417+0000 7f2196d9d700 1 -- 172.21.15.27:0/3920373561 learned_addr learned my addr 172.21.15.27:0/3920373561 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219659c700 1 --2- 172.21.15.27:0/3920373561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f2198067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f2196d9d700 1 -- 172.21.15.27:0/3920373561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 msgr2=0x7f2198067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f2196d9d700 1 --2- 172.21.15.27:0/3920373561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f2198067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f2196d9d700 1 -- 172.21.15.27:0/3920373561 >> v1:172.21.15.40:6789/0 conn(0x7f21980c1790 legacy=0x7f2198066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f2196d9d700 1 -- 172.21.15.27:0/3920373561 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980c35e0 con 0x7f2198066c10 2023-05-17T14:53:58.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f2196d9d700 1 --2- 172.21.15.27:0/3920373561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f21980bd020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2188006fd0 tx=0x7f21880090f0).ready entity=mon.0 client_cookie=f4d9ef0bcc560ac3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219559a700 1 -- 172.21.15.27:0/3920373561 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800b600 con 0x7f2198066c10 2023-05-17T14:53:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219559a700 1 -- 172.21.15.27:0/3920373561 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800b760 con 0x7f2198066c10 2023-05-17T14:53:58.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219559a700 1 -- 172.21.15.27:0/3920373561 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800bae0 con 0x7f2198066c10 2023-05-17T14:53:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 -- 172.21.15.27:0/3920373561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 msgr2=0x7f21980bd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 --2- 172.21.15.27:0/3920373561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f21980bd020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2188006fd0 tx=0x7f21880090f0).stop 2023-05-17T14:53:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 -- 172.21.15.27:0/3920373561 shutdown_connections 2023-05-17T14:53:58.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 --2- 172.21.15.27:0/3920373561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f21980bd020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 --2- 172.21.15.27:0/3920373561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f2198067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 -- 172.21.15.27:0/3920373561 >> 172.21.15.27:0/3920373561 conn(0x7f2198063dd0 msgr2=0x7f2198067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.418+0000 7f219ce90700 1 -- 172.21.15.27:0/3920373561 shutdown_connections 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.419+0000 7f219ce90700 1 -- 172.21.15.27:0/3920373561 wait complete. 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 Processor -- start 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 -- start start 2023-05-17T14:53:58.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f2198149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21980c1790 0x7f21980bd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f21980bd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980bf1c0 con 0x7f2198066c10 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980ab520 con 0x7f21980c1790 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219ce90700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980bdd00 con 0x7f2198150c20 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f2198149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f2198149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33868/0 (socket says 172.21.15.27:33868) 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.420+0000 7f219659c700 1 -- 172.21.15.27:0/2947713820 learned_addr learned my addr 172.21.15.27:0/2947713820 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f2196d9d700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f21980bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f2195d9b700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21980c1790 0x7f21980bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219659c700 1 -- 172.21.15.27:0/2947713820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 msgr2=0x7f21980bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219659c700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2198150c20 0x7f21980bd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219659c700 1 -- 172.21.15.27:0/2947713820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21980c1790 msgr2=0x7f21980bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219659c700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21980c1790 0x7f21980bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219659c700 1 -- 172.21.15.27:0/2947713820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188009370 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219659c700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f2198149ca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f219000ce10 tx=0x7f2190007810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000aa10 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219000ab70 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21980ab240 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000f400 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.421+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21980bda00 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.422+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2198065180 con 0x7f2198066c10 2023-05-17T14:53:58.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.422+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f219001f070 con 0x7f2198066c10 2023-05-17T14:53:58.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f21867fc700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f217805ed90 0x7f2178061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2190079e10 con 0x7f2198066c10 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f2195d9b700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f217805ed90 0x7f2178061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f21867fc700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7f2178068130 0x7f217806a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 --> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f217806ac10 con 0x7f2178068130 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f219007c370 con 0x7f2198066c10 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f2196d9d700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7f2178068130 0x7f217806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f2195d9b700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f217805ed90 0x7f2178061250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f21980c5850 tx=0x7f218c007d20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.423+0000 7f2196d9d700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7f2178068130 0x7f217806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.424+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== osd.0 v2:172.21.15.27:6816/86564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f217806ac10 con 0x7f2178068130 2023-05-17T14:53:58.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.438+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 --> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21980bcb00 con 0x7f2178068130 2023-05-17T14:53:58.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f21867fc700 1 -- 172.21.15.27:0/2947713820 <== osd.0 v2:172.21.15.27:6816/86564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21980bcb00 con 0x7f2178068130 2023-05-17T14:53:58.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7f2178068130 msgr2=0x7f217806a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7f2178068130 0x7f217806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f217805ed90 msgr2=0x7f2178061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f217805ed90 0x7f2178061250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f21980c5850 tx=0x7f218c007d20).stop 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 msgr2=0x7f2198149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 --2- 172.21.15.27:0/2947713820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2198066c10 0x7f2198149ca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f219000ce10 tx=0x7f2190007810).stop 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f2196d9d700 1 -- 172.21.15.27:0/2947713820 reap_dead start 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 shutdown_connections 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 >> 172.21.15.27:0/2947713820 conn(0x7f2198063dd0 msgr2=0x7f21980ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 shutdown_connections 2023-05-17T14:53:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.439+0000 7f219ce90700 1 -- 172.21.15.27:0/2947713820 wait complete. 2023-05-17T14:53:58.454 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:53:58.454 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-17T14:53:58.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.567+0000 7fe707986700 1 Processor -- start 2023-05-17T14:53:58.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.567+0000 7fe707986700 1 -- start start 2023-05-17T14:53:58.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe707986700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe700154090 0x7fe700154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe707986700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7000cb450 0x7fe7000cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe707986700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe700068f00 0x7fe7000693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe707986700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe700069fa0 con 0x7fe700068f00 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe707986700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7000698a0 con 0x7fe7000cb450 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe707986700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000c5a50 con 0x7fe700154090 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe700068f00 0x7fe7000693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe700068f00 0x7fe7000693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33882/0 (socket says 172.21.15.27:33882) 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 -- 172.21.15.27:0/3501364689 learned_addr learned my addr 172.21.15.27:0/3501364689 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe704f21700 1 --2- 172.21.15.27:0/3501364689 >> v2:172.21.15.40:3300/0 conn(0x7fe7000cb450 0x7fe7000cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705722700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe700154090 0x7fe700154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 -- 172.21.15.27:0/3501364689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe700154090 msgr2=0x7fe700154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe700154090 0x7fe700154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 -- 172.21.15.27:0/3501364689 >> v2:172.21.15.40:3300/0 conn(0x7fe7000cb450 msgr2=0x7fe7000cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 --2- 172.21.15.27:0/3501364689 >> v2:172.21.15.40:3300/0 conn(0x7fe7000cb450 0x7fe7000cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 -- 172.21.15.27:0/3501364689 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000c04e0 con 0x7fe700068f00 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705722700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe700154090 0x7fe700154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe705f23700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700068f00 0x7fe7000693b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe6f0009f20 tx=0x7fe6f0009840).ready entity=mon.0 client_cookie=9bcee431e895f7d1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe6fffff700 1 -- 172.21.15.27:0/3501364689 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000e070 con 0x7fe700068f00 2023-05-17T14:53:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe6fffff700 1 -- 172.21.15.27:0/3501364689 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000b990 con 0x7fe700068f00 2023-05-17T14:53:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.568+0000 7fe6fffff700 1 -- 172.21.15.27:0/3501364689 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000bd10 con 0x7fe700068f00 2023-05-17T14:53:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 -- 172.21.15.27:0/3501364689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700068f00 msgr2=0x7fe7000693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700068f00 0x7fe7000693b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe6f0009f20 tx=0x7fe6f0009840).stop 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 -- 172.21.15.27:0/3501364689 shutdown_connections 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700068f00 0x7fe7000693b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 --2- 172.21.15.27:0/3501364689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe700154090 0x7fe700154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 --2- 172.21.15.27:0/3501364689 >> v2:172.21.15.40:3300/0 conn(0x7fe7000cb450 0x7fe7000cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 -- 172.21.15.27:0/3501364689 >> 172.21.15.27:0/3501364689 conn(0x7fe70005e7e0 msgr2=0x7fe7000cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 -- 172.21.15.27:0/3501364689 shutdown_connections 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.569+0000 7fe707986700 1 -- 172.21.15.27:0/3501364689 wait complete. 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.570+0000 7fe707986700 1 Processor -- start 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.570+0000 7fe707986700 1 -- start start 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe707986700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe700068f00 0x7fe70014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe707986700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7000cb450 0x7fe7000ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe707986700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700154090 0x7fe7000acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe707986700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe700154be0 con 0x7fe700154090 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe707986700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000af0c0 con 0x7fe700068f00 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe707986700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000af3a0 con 0x7fe7000cb450 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700154090 0x7fe7000acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700154090 0x7fe7000acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33888/0 (socket says 172.21.15.27:33888) 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 -- 172.21.15.27:0/951220741 learned_addr learned my addr 172.21.15.27:0/951220741 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe704f21700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7000cb450 0x7fe7000ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705722700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe700068f00 0x7fe70014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 -- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7000cb450 msgr2=0x7fe7000ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7000cb450 0x7fe7000ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 -- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe700068f00 msgr2=0x7fe70014ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe700068f00 0x7fe70014ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 -- 172.21.15.27:0/951220741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009ae0 con 0x7fe700154090 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe704f21700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7000cb450 0x7fe7000ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705722700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe700068f00 0x7fe70014ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.571+0000 7fe705f23700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700154090 0x7fe7000acf00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe700067f70 tx=0x7fe7000c5b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.572+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00032f0 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.572+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f00092e0 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.572+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000af680 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.572+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f001e6a0 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.572+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe700152120 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.572+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe700154990 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.573+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe6f0025030 con 0x7fe700154090 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.573+0000 7fe6fd7fa700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe6ec05ed60 0x7fe6ec061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.573+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe6f007b140 con 0x7fe700154090 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.573+0000 7fe705722700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe6ec05ed60 0x7fe6ec061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.574+0000 7fe6fd7fa700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7fe6ec068100 0x7fe6ec06a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.574+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 --> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6ec06abe0 con 0x7fe6ec068100 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.574+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6f007d7b0 con 0x7fe700154090 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.574+0000 7fe704f21700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7fe6ec068100 0x7fe6ec06a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.574+0000 7fe705722700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe6ec05ed60 0x7fe6ec061220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe6f8006d80 tx=0x7fe6f8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.574+0000 7fe704f21700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7fe6ec068100 0x7fe6ec06a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.575+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== osd.1 v2:172.21.15.27:6808/86561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe6ec06abe0 con 0x7fe6ec068100 2023-05-17T14:53:58.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.589+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 --> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7000c0760 con 0x7fe6ec068100 2023-05-17T14:53:58.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.589+0000 7fe6fd7fa700 1 -- 172.21.15.27:0/951220741 <== osd.1 v2:172.21.15.27:6808/86561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7000c0760 con 0x7fe6ec068100 2023-05-17T14:53:58.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.589+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7fe6ec068100 msgr2=0x7fe6ec06a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.589+0000 7fe707986700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7fe6ec068100 0x7fe6ec06a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe6ec05ed60 msgr2=0x7fe6ec061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe6ec05ed60 0x7fe6ec061220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe6f8006d80 tx=0x7fe6f8008040).stop 2023-05-17T14:53:58.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700154090 msgr2=0x7fe7000acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 --2- 172.21.15.27:0/951220741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe700154090 0x7fe7000acf00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe700067f70 tx=0x7fe7000c5b90).stop 2023-05-17T14:53:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe705f23700 1 -- 172.21.15.27:0/951220741 reap_dead start 2023-05-17T14:53:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 shutdown_connections 2023-05-17T14:53:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 >> 172.21.15.27:0/951220741 conn(0x7fe70005e7e0 msgr2=0x7fe7000ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 shutdown_connections 2023-05-17T14:53:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.590+0000 7fe707986700 1 -- 172.21.15.27:0/951220741 wait complete. 2023-05-17T14:53:58.605 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:53:58.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-17T14:53:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.718+0000 7fcfe2fc9700 1 Processor -- start 2023-05-17T14:53:58.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.718+0000 7fcfe2fc9700 1 -- start start 2023-05-17T14:53:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.718+0000 7fcfe2fc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc069610 0x7fcfdc15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.718+0000 7fcfe2fc9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc0c5a50 con 0x7fcfdc154470 2023-05-17T14:53:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.718+0000 7fcfe2fc9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc0c04e0 con 0x7fcfdc154090 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.718+0000 7fcfe2fc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc069fa0 con 0x7fcfdc069610 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdbfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcfdc154470 0x7fcfdc068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33458/0 (socket says 172.21.15.27:33458) 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdbfff700 1 -- 172.21.15.27:0/3595735630 learned_addr learned my addr 172.21.15.27:0/3595735630 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfe1566700 1 --2- 172.21.15.27:0/3595735630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc069610 0x7fcfdc15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390817472 0 0) 0x7fcfdc0c5a50 con 0x7fcfdc154470 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc0033f0 con 0x7fcfdc154470 2023-05-17T14:53:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846212172 0 0) 0x7fcfdc0c04e0 con 0x7fcfdc154090 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc0c5a50 con 0x7fcfdc154090 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfe1566700 1 -- 172.21.15.27:0/3595735630 >> v1:172.21.15.40:6789/0 conn(0x7fcfdc154090 legacy=0x7fcfdc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfe1566700 1 -- 172.21.15.27:0/3595735630 >> v1:172.21.15.27:6789/0 conn(0x7fcfdc154470 legacy=0x7fcfdc068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfe1566700 1 -- 172.21.15.27:0/3595735630 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0c0760 con 0x7fcfdc069610 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfe1566700 1 --2- 172.21.15.27:0/3595735630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc069610 0x7fcfdc15ef60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcfd4009e90 tx=0x7fcfd4009780).ready entity=mon.2 client_cookie=126cd3bc83cefe8a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400e070 con 0x7fcfdc069610 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd400bab0 con 0x7fcfdc069610 2023-05-17T14:53:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.719+0000 7fcfdb7fe700 1 -- 172.21.15.27:0/3595735630 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400be30 con 0x7fcfdc069610 2023-05-17T14:53:58.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/3595735630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc069610 msgr2=0x7fcfdc15ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 --2- 172.21.15.27:0/3595735630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc069610 0x7fcfdc15ef60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcfd4009e90 tx=0x7fcfd4009780).stop 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/3595735630 shutdown_connections 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 --2- 172.21.15.27:0/3595735630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc069610 0x7fcfdc15ef60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/3595735630 >> 172.21.15.27:0/3595735630 conn(0x7fcfdc05e7e0 msgr2=0x7fcfdc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/3595735630 shutdown_connections 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.720+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/3595735630 wait complete. 2023-05-17T14:53:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.721+0000 7fcfe2fc9700 1 Processor -- start 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.721+0000 7fcfe2fc9700 1 -- start start 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe2fc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfdc069610 0x7fcfdc167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe2fc9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfdc154090 0x7fcfdc164450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe2fc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc154470 0x7fcfdc0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe2fc9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc154aa0 con 0x7fcfdc154090 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe2fc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc168190 con 0x7fcfdc069610 2023-05-17T14:53:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe2fc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc168470 con 0x7fcfdc154470 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfdc154090 0x7fcfdc164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfdc154090 0x7fcfdc164450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33902/0 (socket says 172.21.15.27:33902) 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 -- 172.21.15.27:0/427706279 learned_addr learned my addr 172.21.15.27:0/427706279 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe1566700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc154470 0x7fcfdc0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfe0d65700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfdc069610 0x7fcfdc167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 -- 172.21.15.27:0/427706279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc154470 msgr2=0x7fcfdc0c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfdc154470 0x7fcfdc0c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 -- 172.21.15.27:0/427706279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfdc069610 msgr2=0x7fcfdc167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfdc069610 0x7fcfdc167960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 -- 172.21.15.27:0/427706279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009a20 con 0x7fcfdc154090 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.722+0000 7fcfdbfff700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfdc154090 0x7fcfdc164450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fcfc800c560 tx=0x7fcfc8007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.723+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800ce70 con 0x7fcfdc154090 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.723+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80072e0 con 0x7fcfdc154090 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.723+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc154d10 con 0x7fcfdc154090 2023-05-17T14:53:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.723+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8007660 con 0x7fcfdc154090 2023-05-17T14:53:58.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.723+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc168750 con 0x7fcfdc154090 2023-05-17T14:53:58.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.723+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfdc1548f0 con 0x7fcfdc154090 2023-05-17T14:53:58.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.724+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcfc8010070 con 0x7fcfdc154090 2023-05-17T14:53:58.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.724+0000 7fcfd8ff9700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfc005ed90 0x7fcfc0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.724+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcfc80799a0 con 0x7fcfdc154090 2023-05-17T14:53:58.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.724+0000 7fcfe0d65700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfc005ed90 0x7fcfc0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.725+0000 7fcfd8ff9700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fcfc0068130 0x7fcfc006a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.725+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 --> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfc006ac10 con 0x7fcfc0068130 2023-05-17T14:53:58.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.725+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8079c90 con 0x7fcfdc154090 2023-05-17T14:53:58.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.725+0000 7fcfe1566700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fcfc0068130 0x7fcfc006a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.725+0000 7fcfe0d65700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfc005ed90 0x7fcfc0061250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fcfd0003920 tx=0x7fcfd0007b90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.725+0000 7fcfe1566700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fcfc0068130 0x7fcfc006a590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.726+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== osd.2 v2:172.21.15.27:6800/86562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fcfc006ac10 con 0x7fcfc0068130 2023-05-17T14:53:58.736 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T14:53:58.733+0000 7f8dbbec0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T14:53:58.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.740+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 --> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfdc06c350 con 0x7fcfc0068130 2023-05-17T14:53:58.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.740+0000 7fcfd8ff9700 1 -- 172.21.15.27:0/427706279 <== osd.2 v2:172.21.15.27:6800/86562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfdc06c350 con 0x7fcfc0068130 2023-05-17T14:53:58.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.740+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fcfc0068130 msgr2=0x7fcfc006a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.740+0000 7fcfe2fc9700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fcfc0068130 0x7fcfc006a590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfc005ed90 msgr2=0x7fcfc0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfc005ed90 0x7fcfc0061250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fcfd0003920 tx=0x7fcfd0007b90).stop 2023-05-17T14:53:58.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfdc154090 msgr2=0x7fcfdc164450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 --2- 172.21.15.27:0/427706279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfdc154090 0x7fcfdc164450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fcfc800c560 tx=0x7fcfc8007d20).stop 2023-05-17T14:53:58.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe1566700 1 -- 172.21.15.27:0/427706279 reap_dead start 2023-05-17T14:53:58.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 shutdown_connections 2023-05-17T14:53:58.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 >> 172.21.15.27:0/427706279 conn(0x7fcfdc05e7e0 msgr2=0x7fcfdc0c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 shutdown_connections 2023-05-17T14:53:58.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.741+0000 7fcfe2fc9700 1 -- 172.21.15.27:0/427706279 wait complete. 2023-05-17T14:53:58.756 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:53:58.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-17T14:53:58.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.869+0000 7f5872ceb700 1 Processor -- start 2023-05-17T14:53:58.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.869+0000 7f5872ceb700 1 -- start start 2023-05-17T14:53:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5872ceb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f586c0cac00 0x7f586c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5872ceb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c157980 0x7f586c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5872ceb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f586c1537e0 0x7f586c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5872ceb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c1588b0 con 0x7f586c0cac00 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5872ceb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c157e00 con 0x7f586c1537e0 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5872ceb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0c60d0 con 0x7f586c157980 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f586c0cac00 0x7f586c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f586c0cac00 0x7f586c0cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33910/0 (socket says 172.21.15.27:33910) 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 -- 172.21.15.27:0/2280541879 learned_addr learned my addr 172.21.15.27:0/2280541879 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f58714e8700 1 --2- 172.21.15.27:0/2280541879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c157980 0x7f586c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f58724ea700 1 --2- 172.21.15.27:0/2280541879 >> v2:172.21.15.40:3300/0 conn(0x7f586c1537e0 0x7f586c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 -- 172.21.15.27:0/2280541879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c157980 msgr2=0x7f586c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 --2- 172.21.15.27:0/2280541879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c157980 0x7f586c0c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 -- 172.21.15.27:0/2280541879 >> v2:172.21.15.40:3300/0 conn(0x7f586c1537e0 msgr2=0x7f586c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 --2- 172.21.15.27:0/2280541879 >> v2:172.21.15.40:3300/0 conn(0x7f586c1537e0 0x7f586c153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 -- 172.21.15.27:0/2280541879 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c158010 con 0x7f586c0cac00 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5871ce9700 1 --2- 172.21.15.27:0/2280541879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c0cafe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5864009f20 tx=0x7f5864009840).ready entity=mon.0 client_cookie=b1bbcf6e7b7244f1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5870ce7700 1 -- 172.21.15.27:0/2280541879 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400e070 con 0x7f586c0cac00 2023-05-17T14:53:58.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5870ce7700 1 -- 172.21.15.27:0/2280541879 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586400b930 con 0x7f586c0cac00 2023-05-17T14:53:58.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.870+0000 7f5870ce7700 1 -- 172.21.15.27:0/2280541879 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400bcb0 con 0x7f586c0cac00 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 -- 172.21.15.27:0/2280541879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 msgr2=0x7f586c0cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2280541879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c0cafe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5864009f20 tx=0x7f5864009840).stop 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 -- 172.21.15.27:0/2280541879 shutdown_connections 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2280541879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c0cafe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2280541879 >> v2:172.21.15.40:3300/0 conn(0x7f586c1537e0 0x7f586c153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2280541879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c157980 0x7f586c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 -- 172.21.15.27:0/2280541879 >> 172.21.15.27:0/2280541879 conn(0x7f586c05dd50 msgr2=0x7f586c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 -- 172.21.15.27:0/2280541879 shutdown_connections 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.871+0000 7f5872ceb700 1 -- 172.21.15.27:0/2280541879 wait complete. 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.872+0000 7f5872ceb700 1 Processor -- start 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.872+0000 7f5872ceb700 1 -- start start 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5872ceb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5872ceb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c1537e0 0x7f586c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5872ceb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c157980 0x7f586c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5872ceb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1572e0 con 0x7f586c0cac00 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5872ceb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1521e0 con 0x7f586c157980 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5872ceb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1515d0 con 0x7f586c1537e0 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33914/0 (socket says 172.21.15.27:33914) 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 -- 172.21.15.27:0/2038827287 learned_addr learned my addr 172.21.15.27:0/2038827287 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 -- 172.21.15.27:0/2038827287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c1537e0 msgr2=0x7f586c156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f586c1537e0 0x7f586c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 -- 172.21.15.27:0/2038827287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c157980 msgr2=0x7f586c150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f58724ea700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c157980 0x7f586c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c157980 0x7f586c150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 -- 172.21.15.27:0/2038827287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864009ae0 con 0x7f586c0cac00 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f58724ea700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c157980 0x7f586c150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5871ce9700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c152670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f586400b610 tx=0x7f5864009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.873+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640092e0 con 0x7f586c0cac00 2023-05-17T14:53:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.874+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864013c80 con 0x7f586c0cac00 2023-05-17T14:53:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.874+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586401e470 con 0x7f586c0cac00 2023-05-17T14:53:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.874+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c1518b0 con 0x7f586c0cac00 2023-05-17T14:53:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.874+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c151e70 con 0x7f586c0cac00 2023-05-17T14:53:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.874+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f586c047150 con 0x7f586c0cac00 2023-05-17T14:53:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5864025030 con 0x7f586c0cac00 2023-05-17T14:53:58.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f5869ffb700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f585805ed90 0x7f5858061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f586407b060 con 0x7f586c0cac00 2023-05-17T14:53:58.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f58714e8700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f585805ed90 0x7f5858061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f5869ffb700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f5858068130 0x7f585806a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 --> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f585806ac10 con 0x7f5858068130 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.875+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f586407d6d0 con 0x7f586c0cac00 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.876+0000 7f58724ea700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f5858068130 0x7f585806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.876+0000 7f58714e8700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f585805ed90 0x7f5858061250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f586c1533f0 tx=0x7f5860009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.876+0000 7f58724ea700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f5858068130 0x7f585806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.876+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== osd.3 v2:172.21.15.27:6824/86590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f585806ac10 con 0x7f5858068130 2023-05-17T14:53:58.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.891+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 --> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f586c1582f0 con 0x7f5858068130 2023-05-17T14:53:58.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5869ffb700 1 -- 172.21.15.27:0/2038827287 <== osd.3 v2:172.21.15.27:6824/86590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f586c1582f0 con 0x7f5858068130 2023-05-17T14:53:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f5858068130 msgr2=0x7f585806a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f5858068130 0x7f585806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f585805ed90 msgr2=0x7f5858061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f585805ed90 0x7f5858061250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f586c1533f0 tx=0x7f5860009060).stop 2023-05-17T14:53:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 msgr2=0x7f586c152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 --2- 172.21.15.27:0/2038827287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f586c0cac00 0x7f586c152670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f586400b610 tx=0x7f5864009840).stop 2023-05-17T14:53:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f58724ea700 1 -- 172.21.15.27:0/2038827287 reap_dead start 2023-05-17T14:53:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 shutdown_connections 2023-05-17T14:53:58.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 >> 172.21.15.27:0/2038827287 conn(0x7f586c05dd50 msgr2=0x7f586c0b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:58.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 shutdown_connections 2023-05-17T14:53:58.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:58.892+0000 7f5872ceb700 1 -- 172.21.15.27:0/2038827287 wait complete. 2023-05-17T14:53:58.907 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:53:58.908 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-17T14:53:59.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.020+0000 7facbb785700 1 Processor -- start 2023-05-17T14:53:59.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.020+0000 7facbb785700 1 -- start start 2023-05-17T14:53:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facbb785700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7facb405e2f0 0x7facb41517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facbb785700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb40a7bf0 con 0x7facb4151ca0 2023-05-17T14:53:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facbb785700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb4155970 con 0x7facb405df10 2023-05-17T14:53:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facbb785700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb405e750 con 0x7facb405e2f0 2023-05-17T14:53:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facb8d20700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7facb405e2f0 0x7facb41517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facb9d22700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7facb4151ca0 0x7facb40bd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33490/0 (socket says 172.21.15.27:33490) 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.021+0000 7facb9d22700 1 -- 172.21.15.27:0/1015701804 learned_addr learned my addr 172.21.15.27:0/1015701804 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb8d20700 1 -- 172.21.15.27:0/1015701804 >> v1:172.21.15.40:6789/0 conn(0x7facb405df10 legacy=0x7facb4064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb8d20700 1 -- 172.21.15.27:0/1015701804 >> v1:172.21.15.27:6789/0 conn(0x7facb4151ca0 legacy=0x7facb40bd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb3fff700 1 -- 172.21.15.27:0/1015701804 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132879382 0 0) 0x7facb40a7bf0 con 0x7facb4151ca0 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb8d20700 1 -- 172.21.15.27:0/1015701804 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4155c30 con 0x7facb405e2f0 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb8d20700 1 --2- 172.21.15.27:0/1015701804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405e2f0 0x7facb41517b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7faca8009760 tx=0x7faca8009060).ready entity=mon.0 client_cookie=5a0adca4160d165d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb3fff700 1 -- 172.21.15.27:0/1015701804 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800b580 con 0x7facb405e2f0 2023-05-17T14:53:59.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb3fff700 1 -- 172.21.15.27:0/1015701804 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800b6e0 con 0x7facb405e2f0 2023-05-17T14:53:59.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facb3fff700 1 -- 172.21.15.27:0/1015701804 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800ba60 con 0x7facb405e2f0 2023-05-17T14:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facbb785700 1 -- 172.21.15.27:0/1015701804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405e2f0 msgr2=0x7facb41517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facbb785700 1 --2- 172.21.15.27:0/1015701804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405e2f0 0x7facb41517b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7faca8009760 tx=0x7faca8009060).stop 2023-05-17T14:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.022+0000 7facbb785700 1 -- 172.21.15.27:0/1015701804 shutdown_connections 2023-05-17T14:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.023+0000 7facbb785700 1 --2- 172.21.15.27:0/1015701804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405e2f0 0x7facb41517b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.023+0000 7facbb785700 1 -- 172.21.15.27:0/1015701804 >> 172.21.15.27:0/1015701804 conn(0x7facb40c7910 msgr2=0x7facb40c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.023+0000 7facbb785700 1 -- 172.21.15.27:0/1015701804 shutdown_connections 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.023+0000 7facbb785700 1 -- 172.21.15.27:0/1015701804 wait complete. 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.024+0000 7facbb785700 1 Processor -- start 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.024+0000 7facbb785700 1 -- start start 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405df10 0x7facb4142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb405e2f0 0x7facb40c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facb4151ca0 0x7facb4153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb4152110 con 0x7facb405df10 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb4152f70 con 0x7facb405e2f0 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb4142a20 con 0x7facb4151ca0 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405df10 0x7facb4142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405df10 0x7facb4142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33930/0 (socket says 172.21.15.27:33930) 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 -- 172.21.15.27:0/3433140294 learned_addr learned my addr 172.21.15.27:0/3433140294 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb8d20700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb405e2f0 0x7facb40c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9d22700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facb4151ca0 0x7facb4153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 -- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facb4151ca0 msgr2=0x7facb4153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facb4151ca0 0x7facb4153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 -- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb405e2f0 msgr2=0x7facb40c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb405e2f0 0x7facb40c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 -- 172.21.15.27:0/3433140294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80092a0 con 0x7facb405df10 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb9521700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405df10 0x7facb4142530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7facac00c4c0 tx=0x7facac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac00ce70 con 0x7facb405df10 2023-05-17T14:53:59.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac001e90 con 0x7facb405df10 2023-05-17T14:53:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb4152360 con 0x7facb405df10 2023-05-17T14:53:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac007250 con 0x7facb405df10 2023-05-17T14:53:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.025+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb4152920 con 0x7facb405df10 2023-05-17T14:53:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.026+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facb40661f0 con 0x7facb405df10 2023-05-17T14:53:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.026+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7facac010070 con 0x7facb405df10 2023-05-17T14:53:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb17fa700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faca005ed90 0x7faca0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facac079360 con 0x7facb405df10 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb8d20700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faca005ed90 0x7faca0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb17fa700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7faca00681b0 0x7faca006a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 --> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faca006ac90 con 0x7faca00681b0 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7facac07b840 con 0x7facb405df10 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb8d20700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faca005ed90 0x7faca0061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7faca800b340 tx=0x7faca8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.027+0000 7facb9d22700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7faca00681b0 0x7faca006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.028+0000 7facb9d22700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7faca00681b0 0x7faca006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.028+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== osd.4 v2:172.21.15.40:6800/116762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7faca006ac90 con 0x7faca00681b0 2023-05-17T14:53:59.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.043+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 --> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facb4153250 con 0x7faca00681b0 2023-05-17T14:53:59.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facb17fa700 1 -- 172.21.15.27:0/3433140294 <== osd.4 v2:172.21.15.40:6800/116762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facb4153250 con 0x7faca00681b0 2023-05-17T14:53:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7faca00681b0 msgr2=0x7faca006a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7faca00681b0 0x7faca006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faca005ed90 msgr2=0x7faca0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faca005ed90 0x7faca0061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7faca800b340 tx=0x7faca8017000).stop 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405df10 msgr2=0x7facb4142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 --2- 172.21.15.27:0/3433140294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facb405df10 0x7facb4142530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7facac00c4c0 tx=0x7facac007e00).stop 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facb9d22700 1 -- 172.21.15.27:0/3433140294 reap_dead start 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 shutdown_connections 2023-05-17T14:53:59.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 >> 172.21.15.27:0/3433140294 conn(0x7facb40c7910 msgr2=0x7facb40a9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 shutdown_connections 2023-05-17T14:53:59.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.044+0000 7facbb785700 1 -- 172.21.15.27:0/3433140294 wait complete. 2023-05-17T14:53:59.059 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:53:59.060 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-17T14:53:59.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.173+0000 7f086e9b6700 1 Processor -- start 2023-05-17T14:53:59.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.173+0000 7f086e9b6700 1 -- start start 2023-05-17T14:53:59.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086e9b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f08680c58c0 0x7f08680c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086e9b6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08681588b0 con 0x7f08680a9b80 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086e9b6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0868157ca0 con 0x7f0868153ec0 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086e9b6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0868157f80 con 0x7f08680c58c0 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086d1b3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f08680a9b80 0x7f08681537b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33506/0 (socket says 172.21.15.27:33506) 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086d1b3700 1 -- 172.21.15.27:0/1822117618 learned_addr learned my addr 172.21.15.27:0/1822117618 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086d9b4700 1 --2- 172.21.15.27:0/1822117618 >> v2:172.21.15.40:3300/0 conn(0x7f08680c58c0 0x7f08680c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158673199 0 0) 0x7f08681588b0 con 0x7f08680a9b80 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08540033f0 con 0x7f08680a9b80 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927765101 0 0) 0x7f0868157ca0 con 0x7f0868153ec0 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08681588b0 con 0x7f0868153ec0 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086d9b4700 1 -- 172.21.15.27:0/1822117618 >> v1:172.21.15.40:6789/0 conn(0x7f0868153ec0 legacy=0x7f08680c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.174+0000 7f086d9b4700 1 -- 172.21.15.27:0/1822117618 >> v1:172.21.15.27:6789/0 conn(0x7f08680a9b80 legacy=0x7f08681537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086d9b4700 1 -- 172.21.15.27:0/1822117618 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868158260 con 0x7f08680c58c0 2023-05-17T14:53:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086d9b4700 1 --2- 172.21.15.27:0/1822117618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 0x7f08680c5ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0860009760 tx=0x7f0860009060).ready entity=mon.1 client_cookie=b44dd2ff717a827e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000d4a0 con 0x7f08680c58c0 2023-05-17T14:53:59.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086000d600 con 0x7f08680c58c0 2023-05-17T14:53:59.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086c9b2700 1 -- 172.21.15.27:0/1822117618 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000d980 con 0x7f08680c58c0 2023-05-17T14:53:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 -- 172.21.15.27:0/1822117618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 msgr2=0x7f08680c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 --2- 172.21.15.27:0/1822117618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 0x7f08680c5ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0860009760 tx=0x7f0860009060).stop 2023-05-17T14:53:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 -- 172.21.15.27:0/1822117618 shutdown_connections 2023-05-17T14:53:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 --2- 172.21.15.27:0/1822117618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 0x7f08680c5ca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 -- 172.21.15.27:0/1822117618 >> 172.21.15.27:0/1822117618 conn(0x7f086805dd50 msgr2=0x7f086805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 -- 172.21.15.27:0/1822117618 shutdown_connections 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.175+0000 7f086e9b6700 1 -- 172.21.15.27:0/1822117618 wait complete. 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.176+0000 7f086e9b6700 1 Processor -- start 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 -- start start 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08680a9b80 0x7f0868144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 0x7f08680c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0868153ec0 0x7f08680ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680ca900 con 0x7f08680a9b80 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08681549f0 con 0x7f08680c58c0 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086e9b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08680c95c0 con 0x7f0868153ec0 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086d9b4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08680a9b80 0x7f0868144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086d9b4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08680a9b80 0x7f0868144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33948/0 (socket says 172.21.15.27:33948) 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.177+0000 7f086d9b4700 1 -- 172.21.15.27:0/1108891385 learned_addr learned my addr 172.21.15.27:0/1108891385 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d1b3700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 0x7f08680c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d9b4700 1 -- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0868153ec0 msgr2=0x7f08680ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d9b4700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0868153ec0 0x7f08680ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d9b4700 1 -- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 msgr2=0x7f08680c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d9b4700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08680c58c0 0x7f08680c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d9b4700 1 -- 172.21.15.27:0/1108891385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600092a0 con 0x7f08680a9b80 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086d9b4700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08680a9b80 0x7f0868144820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0868067e70 tx=0x7f0860016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000d770 con 0x7f08680a9b80 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086000d8d0 con 0x7f08680a9b80 2023-05-17T14:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08680c98a0 con 0x7f08680a9b80 2023-05-17T14:53:59.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086001d660 con 0x7f08680a9b80 2023-05-17T14:53:59.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.178+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0868154680 con 0x7f08680a9b80 2023-05-17T14:53:59.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.179+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0868047150 con 0x7f08680a9b80 2023-05-17T14:53:59.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.179+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f086000f070 con 0x7f08680a9b80 2023-05-17T14:53:59.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f085dffb700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f084c05ed90 0x7f084c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f086007bbb0 con 0x7f08680a9b80 2023-05-17T14:53:59.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f086d1b3700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f084c05ed90 0x7f084c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f085dffb700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f084c068130 0x7f084c06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 --> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f084c06ac10 con 0x7f084c068130 2023-05-17T14:53:59.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f086007bfb0 con 0x7f08680a9b80 2023-05-17T14:53:59.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f086e1b5700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f084c068130 0x7f084c06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.180+0000 7f086d1b3700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f084c05ed90 0x7f084c061250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0858005750 tx=0x7f0858009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.181+0000 7f086e1b5700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f084c068130 0x7f084c06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.181+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== osd.5 v2:172.21.15.40:6808/116763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f084c06ac10 con 0x7f084c068130 2023-05-17T14:53:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.196+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 --> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0868158540 con 0x7f084c068130 2023-05-17T14:53:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.196+0000 7f085dffb700 1 -- 172.21.15.27:0/1108891385 <== osd.5 v2:172.21.15.40:6808/116763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0868158540 con 0x7f084c068130 2023-05-17T14:53:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.196+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f084c068130 msgr2=0x7f084c06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.196+0000 7f086e9b6700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f084c068130 0x7f084c06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f084c05ed90 msgr2=0x7f084c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f084c05ed90 0x7f084c061250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0858005750 tx=0x7f0858009040).stop 2023-05-17T14:53:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08680a9b80 msgr2=0x7f0868144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 --2- 172.21.15.27:0/1108891385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08680a9b80 0x7f0868144820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0868067e70 tx=0x7f0860016000).stop 2023-05-17T14:53:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e1b5700 1 -- 172.21.15.27:0/1108891385 reap_dead start 2023-05-17T14:53:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 shutdown_connections 2023-05-17T14:53:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 >> 172.21.15.27:0/1108891385 conn(0x7f086805dd50 msgr2=0x7f086814e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 shutdown_connections 2023-05-17T14:53:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.197+0000 7f086e9b6700 1 -- 172.21.15.27:0/1108891385 wait complete. 2023-05-17T14:53:59.212 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:53:59.212 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-17T14:53:59.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.325+0000 7f388340a700 1 Processor -- start 2023-05-17T14:53:59.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.325+0000 7f388340a700 1 -- start start 2023-05-17T14:53:59.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f388340a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f387c065400 0x7f387c0bd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f388340a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f387c0657e0 0x7f387c065c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f388340a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0c3870 con 0x7f387c067fa0 2023-05-17T14:53:59.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f388340a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c069290 con 0x7f387c0657e0 2023-05-17T14:53:59.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f388340a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c1556f0 con 0x7f387c065400 2023-05-17T14:53:59.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f38819a7700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f387c067fa0 0x7f387c068410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33522/0 (socket says 172.21.15.27:33522) 2023-05-17T14:53:59.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f38809a5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f387c0657e0 0x7f387c065c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f38819a7700 1 -- 172.21.15.27:0/1935202437 learned_addr learned my addr 172.21.15.27:0/1935202437 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.326+0000 7f38811a6700 1 --2- 172.21.15.27:0/1935202437 >> v2:172.21.15.40:3300/0 conn(0x7f387c065400 0x7f387c0bd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f38809a5700 1 -- 172.21.15.27:0/1935202437 >> v2:172.21.15.40:3300/0 conn(0x7f387c065400 msgr2=0x7f387c0bd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f38809a5700 1 --2- 172.21.15.27:0/1935202437 >> v2:172.21.15.40:3300/0 conn(0x7f387c065400 0x7f387c0bd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f38809a5700 1 -- 172.21.15.27:0/1935202437 >> v1:172.21.15.27:6789/0 conn(0x7f387c067fa0 legacy=0x7f387c068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f38809a5700 1 -- 172.21.15.27:0/1935202437 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c068cd0 con 0x7f387c0657e0 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f387bfff700 1 -- 172.21.15.27:0/1935202437 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307092041 0 0) 0x7f387c0c3870 con 0x7f387c067fa0 2023-05-17T14:53:59.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f38809a5700 1 --2- 172.21.15.27:0/1935202437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c065c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f387c0638a0 tx=0x7f3870009060).ready entity=mon.0 client_cookie=19e64a37548c36c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f387bfff700 1 -- 172.21.15.27:0/1935202437 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000b580 con 0x7f387c0657e0 2023-05-17T14:53:59.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f387bfff700 1 -- 172.21.15.27:0/1935202437 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000b6e0 con 0x7f387c0657e0 2023-05-17T14:53:59.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f387bfff700 1 -- 172.21.15.27:0/1935202437 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000ba60 con 0x7f387c0657e0 2023-05-17T14:53:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 -- 172.21.15.27:0/1935202437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 msgr2=0x7f387c065c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 --2- 172.21.15.27:0/1935202437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c065c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f387c0638a0 tx=0x7f3870009060).stop 2023-05-17T14:53:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 -- 172.21.15.27:0/1935202437 shutdown_connections 2023-05-17T14:53:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 --2- 172.21.15.27:0/1935202437 >> v2:172.21.15.40:3300/0 conn(0x7f387c065400 0x7f387c0bd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 --2- 172.21.15.27:0/1935202437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c065c90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 -- 172.21.15.27:0/1935202437 >> 172.21.15.27:0/1935202437 conn(0x7f387c0c94e0 msgr2=0x7f387c0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 -- 172.21.15.27:0/1935202437 shutdown_connections 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.327+0000 7f388340a700 1 -- 172.21.15.27:0/1935202437 wait complete. 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.328+0000 7f388340a700 1 Processor -- start 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 -- start start 2023-05-17T14:53:59.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f387c065400 0x7f387c0a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387c067fa0 0x7f387c14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0a8730 con 0x7f387c0657e0 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0a8a10 con 0x7f387c065400 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.329+0000 7f388340a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0a8cf0 con 0x7f387c067fa0 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33962/0 (socket says 172.21.15.27:33962) 2023-05-17T14:53:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 -- 172.21.15.27:0/1723210976 learned_addr learned my addr 172.21.15.27:0/1723210976 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38811a6700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f387c065400 0x7f387c0a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38819a7700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387c067fa0 0x7f387c14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 -- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387c067fa0 msgr2=0x7f387c14cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387c067fa0 0x7f387c14cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 -- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f387c065400 msgr2=0x7f387c0a8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f387c065400 0x7f387c0a8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 -- 172.21.15.27:0/1723210976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700092a0 con 0x7f387c0657e0 2023-05-17T14:53:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38811a6700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f387c065400 0x7f387c0a8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38809a5700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c165070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3870009e80 tx=0x7f3870017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000b850 con 0x7f387c0657e0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000b9b0 con 0x7f387c0657e0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c0a8fd0 con 0x7f387c0657e0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387001b690 con 0x7f387c0657e0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.330+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c165560 con 0x7f387c0657e0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.331+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f387c063970 con 0x7f387c0657e0 2023-05-17T14:53:59.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.331+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f387000f070 con 0x7f387c0657e0 2023-05-17T14:53:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38797fa700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f386805ed60 0x7f3868061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f387007b2f0 con 0x7f387c0657e0 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38811a6700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f386805ed60 0x7f3868061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38797fa700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f3868068100 0x7f386806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 --> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f386806abe0 con 0x7f3868068100 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f387007d960 con 0x7f387c0657e0 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38819a7700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f3868068100 0x7f386806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.332+0000 7f38811a6700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f386805ed60 0x7f3868061220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3874006fd0 tx=0x7f3874008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.333+0000 7f38819a7700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f3868068100 0x7f386806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.333+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== osd.6 v2:172.21.15.40:6816/116764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f386806abe0 con 0x7f3868068100 2023-05-17T14:53:59.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 --> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f387c066d90 con 0x7f3868068100 2023-05-17T14:53:59.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f38797fa700 1 -- 172.21.15.27:0/1723210976 <== osd.6 v2:172.21.15.40:6816/116764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f387c066d90 con 0x7f3868068100 2023-05-17T14:53:59.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f3868068100 msgr2=0x7f386806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f3868068100 0x7f386806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f386805ed60 msgr2=0x7f3868061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f386805ed60 0x7f3868061220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3874006fd0 tx=0x7f3874008040).stop 2023-05-17T14:53:59.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 msgr2=0x7f387c165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f388340a700 1 --2- 172.21.15.27:0/1723210976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387c0657e0 0x7f387c165070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3870009e80 tx=0x7f3870017000).stop 2023-05-17T14:53:59.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.348+0000 7f38819a7700 1 -- 172.21.15.27:0/1723210976 reap_dead start 2023-05-17T14:53:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.349+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 shutdown_connections 2023-05-17T14:53:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.349+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 >> 172.21.15.27:0/1723210976 conn(0x7f387c0c94e0 msgr2=0x7f387c156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.349+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 shutdown_connections 2023-05-17T14:53:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.349+0000 7f388340a700 1 -- 172.21.15.27:0/1723210976 wait complete. 2023-05-17T14:53:59.364 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:53:59.364 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-17T14:53:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.477+0000 7f95dbc61700 1 Processor -- start 2023-05-17T14:53:59.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.477+0000 7f95dbc61700 1 -- start start 2023-05-17T14:53:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95dbc61700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95d40666c0 0x7f95d4066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95dbc61700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95d40bdd40 0x7f95d40bca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95dbc61700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d40c3990 con 0x7f95d4068790 2023-05-17T14:53:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95dbc61700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d4067420 con 0x7f95d40bdd40 2023-05-17T14:53:59.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95dbc61700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d4067700 con 0x7f95d40666c0 2023-05-17T14:53:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95da1fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f95d4068790 0x7f95d40c3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33536/0 (socket says 172.21.15.27:33536) 2023-05-17T14:53:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95da1fe700 1 -- 172.21.15.27:0/3754196673 learned_addr learned my addr 172.21.15.27:0/3754196673 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d91fc700 1 --2- 172.21.15.27:0/3754196673 >> v2:172.21.15.27:3300/0 conn(0x7f95d40bdd40 0x7f95d40bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d99fd700 1 --2- 172.21.15.27:0/3754196673 >> v2:172.21.15.40:3300/0 conn(0x7f95d40666c0 0x7f95d4066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d89fb700 1 -- 172.21.15.27:0/3754196673 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770453939 0 0) 0x7f95cc001490 con 0x7f95d4068790 2023-05-17T14:53:59.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d89fb700 1 -- 172.21.15.27:0/3754196673 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c00033f0 con 0x7f95d4068790 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d99fd700 1 -- 172.21.15.27:0/3754196673 >> v2:172.21.15.27:3300/0 conn(0x7f95d40bdd40 msgr2=0x7f95d40bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d99fd700 1 --2- 172.21.15.27:0/3754196673 >> v2:172.21.15.27:3300/0 conn(0x7f95d40bdd40 0x7f95d40bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d89fb700 1 -- 172.21.15.27:0/3754196673 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464774305 0 0) 0x7f95c00033f0 con 0x7f95d4068790 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.478+0000 7f95d99fd700 1 -- 172.21.15.27:0/3754196673 >> v1:172.21.15.27:6789/0 conn(0x7f95d4068790 legacy=0x7f95d40c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95d99fd700 1 -- 172.21.15.27:0/3754196673 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40c1790 con 0x7f95d40666c0 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95d91fc700 1 --2- 172.21.15.27:0/3754196673 >> v2:172.21.15.27:3300/0 conn(0x7f95d40bdd40 0x7f95d40bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:53:59.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95d99fd700 1 --2- 172.21.15.27:0/3754196673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40666c0 0x7f95d4066aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f95d0009760 tx=0x7f95d0009060).ready entity=mon.1 client_cookie=e80c5cd267164c82 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95d89fb700 1 -- 172.21.15.27:0/3754196673 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc001980 con 0x7f95d40666c0 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95d89fb700 1 -- 172.21.15.27:0/3754196673 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d00090d0 con 0x7f95d40666c0 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95d89fb700 1 -- 172.21.15.27:0/3754196673 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d0011610 con 0x7f95d40666c0 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95dbc61700 1 -- 172.21.15.27:0/3754196673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40666c0 msgr2=0x7f95d4066aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95dbc61700 1 --2- 172.21.15.27:0/3754196673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40666c0 0x7f95d4066aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f95d0009760 tx=0x7f95d0009060).stop 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95dbc61700 1 -- 172.21.15.27:0/3754196673 shutdown_connections 2023-05-17T14:53:59.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95dbc61700 1 --2- 172.21.15.27:0/3754196673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40666c0 0x7f95d4066aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95dbc61700 1 --2- 172.21.15.27:0/3754196673 >> v2:172.21.15.27:3300/0 conn(0x7f95d40bdd40 0x7f95d40bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.479+0000 7f95dbc61700 1 -- 172.21.15.27:0/3754196673 >> 172.21.15.27:0/3754196673 conn(0x7f95d4063dd0 msgr2=0x7f95d4067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.480+0000 7f95dbc61700 1 -- 172.21.15.27:0/3754196673 shutdown_connections 2023-05-17T14:53:59.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.480+0000 7f95dbc61700 1 -- 172.21.15.27:0/3754196673 wait complete. 2023-05-17T14:53:59.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 Processor -- start 2023-05-17T14:53:59.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 -- start start 2023-05-17T14:53:59.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95d40666c0 0x7f95d40ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95d4068790 0x7f95d4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40bdd40 0x7f95d4151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4135150 con 0x7f95d40666c0 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4135430 con 0x7f95d40bdd40 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95dbc61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4135710 con 0x7f95d4068790 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95d99fd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95d40666c0 0x7f95d40ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95d99fd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95d40666c0 0x7f95d40ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33978/0 (socket says 172.21.15.27:33978) 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.481+0000 7f95d99fd700 1 -- 172.21.15.27:0/2902553867 learned_addr learned my addr 172.21.15.27:0/2902553867 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95da1fe700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40bdd40 0x7f95d4151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d91fc700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95d4068790 0x7f95d4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d99fd700 1 -- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95d4068790 msgr2=0x7f95d4151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d99fd700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95d4068790 0x7f95d4151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d99fd700 1 -- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40bdd40 msgr2=0x7f95d4151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d99fd700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40bdd40 0x7f95d4151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d99fd700 1 -- 172.21.15.27:0/2902553867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40092a0 con 0x7f95d40666c0 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95da1fe700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95d40bdd40 0x7f95d4151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95d99fd700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95d40666c0 0x7f95d40ac3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f95d0006d30 tx=0x7f95d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00107c0 con 0x7f95d40666c0 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d0010920 con 0x7f95d40666c0 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d0010cc0 con 0x7f95d40666c0 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d00092a0 con 0x7f95d40666c0 2023-05-17T14:53:59.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.482+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d4135cd0 con 0x7f95d40666c0 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.483+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95d4065180 con 0x7f95d40666c0 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.483+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f95d000f070 con 0x7f95d40666c0 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95c9ffb700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95b805ed90 0x7f95b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f95d007ae50 con 0x7f95d40666c0 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95d91fc700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95b805ed90 0x7f95b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95c9ffb700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7f95b8068130 0x7f95b806a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 --> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b806ac10 con 0x7f95b8068130 2023-05-17T14:53:59.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95d007d4c0 con 0x7f95d40666c0 2023-05-17T14:53:59.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95da1fe700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7f95b8068130 0x7f95b806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95d91fc700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95b805ed90 0x7f95b8061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f95c4006d80 tx=0x7f95c4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.484+0000 7f95da1fe700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7f95b8068130 0x7f95b806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.485+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== osd.7 v2:172.21.15.40:6824/116807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f95b806ac10 con 0x7f95b8068130 2023-05-17T14:53:59.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.499+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 --> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95d406c350 con 0x7f95b8068130 2023-05-17T14:53:59.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95c9ffb700 1 -- 172.21.15.27:0/2902553867 <== osd.7 v2:172.21.15.40:6824/116807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95d406c350 con 0x7f95b8068130 2023-05-17T14:53:59.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7f95b8068130 msgr2=0x7f95b806a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95dbc61700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7f95b8068130 0x7f95b806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95b805ed90 msgr2=0x7f95b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95dbc61700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95b805ed90 0x7f95b8061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f95c4006d80 tx=0x7f95c4008040).stop 2023-05-17T14:53:59.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95d40666c0 msgr2=0x7f95d40ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95dbc61700 1 --2- 172.21.15.27:0/2902553867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95d40666c0 0x7f95d40ac3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f95d0006d30 tx=0x7f95d0016000).stop 2023-05-17T14:53:59.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.500+0000 7f95da1fe700 1 -- 172.21.15.27:0/2902553867 reap_dead start 2023-05-17T14:53:59.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.501+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 shutdown_connections 2023-05-17T14:53:59.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.501+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 >> 172.21.15.27:0/2902553867 conn(0x7f95d4063dd0 msgr2=0x7f95d40c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.501+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 shutdown_connections 2023-05-17T14:53:59.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.501+0000 7f95dbc61700 1 -- 172.21.15.27:0/2902553867 wait complete. 2023-05-17T14:53:59.516 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:53:59.516 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-17T14:53:59.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.630+0000 7fbab69c3700 1 Processor -- start 2023-05-17T14:53:59.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.630+0000 7fbab69c3700 1 -- start start 2023-05-17T14:53:59.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.630+0000 7fbab69c3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbab0069610 0x7fbab015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.630+0000 7fbab69c3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab00c5a50 con 0x7fbab0154470 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.630+0000 7fbab69c3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab00c04e0 con 0x7fbab0154090 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.630+0000 7fbab69c3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab0069fa0 con 0x7fbab0069610 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaa7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbab0154470 0x7fbab0068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33552/0 (socket says 172.21.15.27:33552) 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaa7fff700 1 -- 172.21.15.27:0/2946065275 learned_addr learned my addr 172.21.15.27:0/2946065275 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbab4f60700 1 --2- 172.21.15.27:0/2946065275 >> v2:172.21.15.40:3300/0 conn(0x7fbab0069610 0x7fbab015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639219573 0 0) 0x7fbab00c5a50 con 0x7fbab0154470 2023-05-17T14:53:59.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba9c0033f0 con 0x7fbab0154470 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061872677 0 0) 0x7fba9c0033f0 con 0x7fbab0154470 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 >> v2:172.21.15.40:3300/0 conn(0x7fbab0069610 msgr2=0x7fbab015ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 --2- 172.21.15.27:0/2946065275 >> v2:172.21.15.40:3300/0 conn(0x7fbab0069610 0x7fbab015ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 >> v1:172.21.15.40:6789/0 conn(0x7fbab0154090 legacy=0x7fbab00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab00c0760 con 0x7fbab0154470 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fba98001470 con 0x7fbab0154470 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 >> v1:172.21.15.27:6789/0 conn(0x7fbab0154470 legacy=0x7fbab0068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0038e0 0x7fba9c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c004690 0x7fba9c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c005000 0x7fba9c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab0069fa0 con 0x7fba9c004690 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c00be00 con 0x7fba9c005000 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c00bfc0 con 0x7fba9c0038e0 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaa7fff700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c004690 0x7fba9c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbab4f60700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c005000 0x7fba9c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.631+0000 7fbaaffff700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0038e0 0x7fba9c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaa7fff700 1 -- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0038e0 msgr2=0x7fba9c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaa7fff700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0038e0 0x7fba9c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaa7fff700 1 -- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c005000 msgr2=0x7fba9c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaa7fff700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c005000 0x7fba9c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaa7fff700 1 -- 172.21.15.27:0/2946065275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0033f0 con 0x7fba9c004690 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab4f60700 1 -- 172.21.15.27:0/2946065275 reap_dead start 2023-05-17T14:53:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaaffff700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0038e0 0x7fba9c003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaa7fff700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c004690 0x7fba9c004b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fba9800c1e0 tx=0x7fbab00c1030).ready entity=mon.0 client_cookie=404a3b1211b091bf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98007a60 con 0x7fba9c004690 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800ca30 con 0x7fba9c004690 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbaaf7fe700 1 -- 172.21.15.27:0/2946065275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800cdd0 con 0x7fba9c004690 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 -- 172.21.15.27:0/2946065275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c004690 msgr2=0x7fba9c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c004690 0x7fba9c004b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fba9800c1e0 tx=0x7fbab00c1030).stop 2023-05-17T14:53:59.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 -- 172.21.15.27:0/2946065275 shutdown_connections 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 --2- 172.21.15.27:0/2946065275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c004690 0x7fba9c004b10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 -- 172.21.15.27:0/2946065275 >> 172.21.15.27:0/2946065275 conn(0x7fbab005e7e0 msgr2=0x7fbab00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 -- 172.21.15.27:0/2946065275 shutdown_connections 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.632+0000 7fbab69c3700 1 -- 172.21.15.27:0/2946065275 wait complete. 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.633+0000 7fbab69c3700 1 Processor -- start 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 -- start start 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c004690 0x7fbab00c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbab01507a0 0x7fbab00ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 0x7fbab00accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00ad1a0 con 0x7fbab0150c20 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab0163d60 con 0x7fba9c004690 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab69c3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab0164bb0 con 0x7fbab01507a0 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab4f60700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 0x7fbab00accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab4f60700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 0x7fbab00accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34004/0 (socket says 172.21.15.27:34004) 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbab4f60700 1 -- 172.21.15.27:0/1290786234 learned_addr learned my addr 172.21.15.27:0/1290786234 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:53:59.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbaa7fff700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbab01507a0 0x7fbab00ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.634+0000 7fbaaffff700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c004690 0x7fbab00c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab4f60700 1 -- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbab01507a0 msgr2=0x7fbab00ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab4f60700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbab01507a0 0x7fbab00ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab4f60700 1 -- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c004690 msgr2=0x7fbab00c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab4f60700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c004690 0x7fbab00c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab4f60700 1 -- 172.21.15.27:0/1290786234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab0163fa0 con 0x7fbab0150c20 2023-05-17T14:53:59.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbaaffff700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c004690 0x7fbab00c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab4f60700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 0x7fbab00accb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbab00842a0 tx=0x7fbaa800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800e040 con 0x7fbab0150c20 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa800f040 con 0x7fbab0150c20 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab0164280 con 0x7fbab0150c20 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800fe20 con 0x7fbab0150c20 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.635+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab0164840 con 0x7fbab0150c20 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.636+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab0164cf0 con 0x7fbab0150c20 2023-05-17T14:53:59.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.636+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbaa8015660 con 0x7fbab0150c20 2023-05-17T14:53:59.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.637+0000 7fbaacff9700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba9005ed90 0x7fba90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:53:59.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.637+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbaa807a820 con 0x7fbab0150c20 2023-05-17T14:53:59.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.637+0000 7fbaaffff700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba9005ed90 0x7fba90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:53:59.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.637+0000 7fbaaffff700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba9005ed90 0x7fba90061250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbab00475a0 tx=0x7fbaa0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:53:59.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.641+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbaa804bd60 con 0x7fbab0150c20 2023-05-17T14:53:59.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.815+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbab0068ae0 con 0x7fbab0150c20 2023-05-17T14:53:59.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.815+0000 7fbaacff9700 1 -- 172.21.15.27:0/1290786234 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbaa804f380 con 0x7fbab0150c20 2023-05-17T14:53:59.819 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:53:59.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba9005ed90 msgr2=0x7fba90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba9005ed90 0x7fba90061250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbab00475a0 tx=0x7fbaa0009040).stop 2023-05-17T14:53:59.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 msgr2=0x7fbab00accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:53:59.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 0x7fbab00accb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbab00842a0 tx=0x7fbaa800b040).stop 2023-05-17T14:53:59.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 shutdown_connections 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba9005ed90 0x7fba90061250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbab0150c20 0x7fbab00accb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c004690 0x7fbab00c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 --2- 172.21.15.27:0/1290786234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbab01507a0 0x7fbab00ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 >> 172.21.15.27:0/1290786234 conn(0x7fbab005e7e0 msgr2=0x7fbab00c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 shutdown_connections 2023-05-17T14:53:59.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:53:59.817+0000 7fbab69c3700 1 -- 172.21.15.27:0/1290786234 wait complete. 2023-05-17T14:53:59.829 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:59.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:59.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-05-17T14:54:00.833 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-17T14:54:00.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.962+0000 7f5ee4de0700 1 Processor -- start 2023-05-17T14:54:00.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.962+0000 7f5ee4de0700 1 -- start start 2023-05-17T14:54:00.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.963+0000 7f5ee4de0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5ee0154090 0x7f5ee0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.963+0000 7f5ee4de0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00c5a50 con 0x7f5ee00cb450 2023-05-17T14:54:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.963+0000 7f5ee4de0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00c04e0 con 0x7f5ee0069610 2023-05-17T14:54:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.963+0000 7f5ee4de0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee0069fa0 con 0x7f5ee0154090 2023-05-17T14:54:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5ede59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5ee0154090 0x7f5ee0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5eddd9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5ee00cb450 0x7f5ee0068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33572/0 (socket says 172.21.15.27:33572) 2023-05-17T14:54:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5eddd9b700 1 -- 172.21.15.27:0/63991583 learned_addr learned my addr 172.21.15.27:0/63991583 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:00.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5ede59c700 1 -- 172.21.15.27:0/63991583 >> v1:172.21.15.40:6789/0 conn(0x7f5ee0069610 legacy=0x7f5ee00c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:00.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5ede59c700 1 -- 172.21.15.27:0/63991583 >> v1:172.21.15.27:6789/0 conn(0x7f5ee00cb450 legacy=0x7f5ee0068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:00.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5edd59a700 1 -- 172.21.15.27:0/63991583 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598312983 0 0) 0x7f5ee00c5a50 con 0x7f5ee00cb450 2023-05-17T14:54:00.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5ede59c700 1 -- 172.21.15.27:0/63991583 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00c0760 con 0x7f5ee0154090 2023-05-17T14:54:00.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5ede59c700 1 --2- 172.21.15.27:0/63991583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee0154090 0x7f5ee0154470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5ed8009760 tx=0x7f5ed8009060).ready entity=mon.0 client_cookie=d323dd15e283936d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:00.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5edd59a700 1 -- 172.21.15.27:0/63991583 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800b520 con 0x7f5ee0154090 2023-05-17T14:54:00.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5edd59a700 1 -- 172.21.15.27:0/63991583 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800b680 con 0x7f5ee0154090 2023-05-17T14:54:00.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.964+0000 7f5edd59a700 1 -- 172.21.15.27:0/63991583 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800ba00 con 0x7f5ee0154090 2023-05-17T14:54:00.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 -- 172.21.15.27:0/63991583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee0154090 msgr2=0x7f5ee0154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/63991583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee0154090 0x7f5ee0154470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5ed8009760 tx=0x7f5ed8009060).stop 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 -- 172.21.15.27:0/63991583 shutdown_connections 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/63991583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee0154090 0x7f5ee0154470 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 -- 172.21.15.27:0/63991583 >> 172.21.15.27:0/63991583 conn(0x7f5ee005e7e0 msgr2=0x7f5ee00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 -- 172.21.15.27:0/63991583 shutdown_connections 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.965+0000 7f5ee4de0700 1 -- 172.21.15.27:0/63991583 wait complete. 2023-05-17T14:54:00.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.966+0000 7f5ee4de0700 1 Processor -- start 2023-05-17T14:54:00.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.966+0000 7f5ee4de0700 1 -- start start 2023-05-17T14:54:00.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ee0069610 0x7f5ee0158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 0x7f5ee0143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ee0154090 0x7f5ee0143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0144030 con 0x7f5ee00cb450 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00aedc0 con 0x7f5ee0069610 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0155420 con 0x7f5ee0154090 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 0x7f5ee0143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:00.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 0x7f5ee0143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34016/0 (socket says 172.21.15.27:34016) 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 -- 172.21.15.27:0/336839859 learned_addr learned my addr 172.21.15.27:0/336839859 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ede59c700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ee0069610 0x7f5ee0158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eded9d700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ee0154090 0x7f5ee0143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 -- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ee0154090 msgr2=0x7f5ee0143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ee0154090 0x7f5ee0143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 -- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ee0069610 msgr2=0x7f5ee0158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:00.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ee0069610 0x7f5ee0158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 -- 172.21.15.27:0/336839859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80092a0 con 0x7f5ee00cb450 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eded9d700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ee0154090 0x7f5ee0143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5eddd9b700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 0x7f5ee0143650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5ec800c510 tx=0x7f5ec8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80072e0 con 0x7f5ee00cb450 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec8007440 con 0x7f5ee00cb450 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80057a0 con 0x7f5ee00cb450 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee0154af0 con 0x7f5ee00cb450 2023-05-17T14:54:00.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.967+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee0155130 con 0x7f5ee00cb450 2023-05-17T14:54:00.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.968+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee0155560 con 0x7f5ee00cb450 2023-05-17T14:54:00.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.969+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5ec8010070 con 0x7f5ee00cb450 2023-05-17T14:54:00.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.969+0000 7f5ed67fc700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5ec005ed90 0x7f5ec0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:00.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.969+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ec80790f0 con 0x7f5ee00cb450 2023-05-17T14:54:00.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.969+0000 7f5ede59c700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5ec005ed90 0x7f5ec0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:00.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.969+0000 7f5ede59c700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5ec005ed90 0x7f5ec0061250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5ed8009760 tx=0x7f5ed8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:00.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:00.973+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ec804a690 con 0x7f5ee00cb450 2023-05-17T14:54:01.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.146+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ee006c350 con 0x7f5ee00cb450 2023-05-17T14:54:01.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.146+0000 7f5ed67fc700 1 -- 172.21.15.27:0/336839859 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ec804dcb0 con 0x7f5ee00cb450 2023-05-17T14:54:01.150 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:54:01.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5ec005ed90 msgr2=0x7f5ec0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5ec005ed90 0x7f5ec0061250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5ed8009760 tx=0x7f5ed8017000).stop 2023-05-17T14:54:01.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 msgr2=0x7f5ee0143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 0x7f5ee0143650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5ec800c510 tx=0x7f5ec8007c70).stop 2023-05-17T14:54:01.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 shutdown_connections 2023-05-17T14:54:01.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5ec005ed90 0x7f5ec0061250 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ee0154090 0x7f5ee0143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ee0069610 0x7f5ee0158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 --2- 172.21.15.27:0/336839859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ee00cb450 0x7f5ee0143650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 >> 172.21.15.27:0/336839859 conn(0x7f5ee005e7e0 msgr2=0x7f5ee014f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:01.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 shutdown_connections 2023-05-17T14:54:01.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.148+0000 7f5ee4de0700 1 -- 172.21.15.27:0/336839859 wait complete. 2023-05-17T14:54:01.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-05-17T14:54:01.164 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-17T14:54:01.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.277+0000 7f7423704700 1 Processor -- start 2023-05-17T14:54:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.277+0000 7f7423704700 1 -- start start 2023-05-17T14:54:01.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7423704700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f741c154470 0x7f741c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7423704700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7423704700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0c5a50 con 0x7f741c154090 2023-05-17T14:54:01.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7423704700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c069fa0 con 0x7f741c154470 2023-05-17T14:54:01.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7423704700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c04e0 con 0x7f741c0693f0 2023-05-17T14:54:01.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7421ca1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7420c9f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f741c154470 0x7f741c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f74214a0700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f741c154090 0x7f741c0cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:39586/0 (socket says 172.21.15.27:39586) 2023-05-17T14:54:01.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f74214a0700 1 -- 172.21.15.27:0/1653774442 learned_addr learned my addr 172.21.15.27:0/1653774442 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:01.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7420c9f700 1 -- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 msgr2=0x7f741c0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:01.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7420c9f700 1 --2- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c0c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7420c9f700 1 -- 172.21.15.27:0/1653774442 >> v1:172.21.15.40:6789/0 conn(0x7f741c154090 legacy=0x7f741c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7420c9f700 1 -- 172.21.15.27:0/1653774442 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c069840 con 0x7f741c154470 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.278+0000 7f7420c9f700 1 --2- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c068f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7410009760 tx=0x7f7410009060).ready entity=mon.1 client_cookie=e5d9ed6b7580617b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f741bfff700 1 -- 172.21.15.27:0/1653774442 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000f510 con 0x7f741c154470 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f741bfff700 1 -- 172.21.15.27:0/1653774442 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741000f670 con 0x7f741c154470 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f741bfff700 1 -- 172.21.15.27:0/1653774442 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000f9f0 con 0x7f741c154470 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 -- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 msgr2=0x7f741c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 --2- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c068f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7410009760 tx=0x7f7410009060).stop 2023-05-17T14:54:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 -- 172.21.15.27:0/1653774442 shutdown_connections 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 --2- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 --2- 172.21.15.27:0/1653774442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c068f00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 -- 172.21.15.27:0/1653774442 >> 172.21.15.27:0/1653774442 conn(0x7f741c05e7e0 msgr2=0x7f741c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 -- 172.21.15.27:0/1653774442 shutdown_connections 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.279+0000 7f7423704700 1 -- 172.21.15.27:0/1653774442 wait complete. 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.280+0000 7f7423704700 1 Processor -- start 2023-05-17T14:54:01.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.280+0000 7f7423704700 1 -- start start 2023-05-17T14:54:01.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7423704700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7423704700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 0x7f741c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7423704700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7423704700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c151420 con 0x7f741c154090 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7423704700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c167fb0 con 0x7f741c154470 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7423704700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1566a0 con 0x7f741c0693f0 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7420c9f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 0x7f741c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7420c9f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 0x7f741c1561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34030/0 (socket says 172.21.15.27:34030) 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.281+0000 7f7420c9f700 1 -- 172.21.15.27:0/1613278752 learned_addr learned my addr 172.21.15.27:0/1613278752 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f74214a0700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7421ca1700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7420c9f700 1 -- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 msgr2=0x7f741c1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7420c9f700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c1505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7420c9f700 1 -- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 msgr2=0x7f741c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7420c9f700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c14edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7420c9f700 1 -- 172.21.15.27:0/1613278752 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100092a0 con 0x7f741c154090 2023-05-17T14:54:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f74214a0700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7421ca1700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7420c9f700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 0x7f741c1561b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f741000f630 tx=0x7f7410017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000f7e0 con 0x7f741c154090 2023-05-17T14:54:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741000f940 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c150b80 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741001b660 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.282+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c151140 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.283+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c168140 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.283+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f741002b070 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.284+0000 7f74197fa700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f740805ed90 0x7f7408061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.284+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f741007b490 con 0x7f741c154090 2023-05-17T14:54:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.284+0000 7f74214a0700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f740805ed90 0x7f7408061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.284+0000 7f74214a0700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f740805ed90 0x7f7408061250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f7414007fd0 tx=0x7f7414009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.288+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f741004c920 con 0x7f741c154090 2023-05-17T14:54:01.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.462+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f741c06c350 con 0x7f741c154090 2023-05-17T14:54:01.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.462+0000 7f74197fa700 1 -- 172.21.15.27:0/1613278752 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f741001f090 con 0x7f741c154090 2023-05-17T14:54:01.466 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:54:01.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f740805ed90 msgr2=0x7f7408061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f740805ed90 0x7f7408061250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f7414007fd0 tx=0x7f7414009040).stop 2023-05-17T14:54:01.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 msgr2=0x7f741c1561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 0x7f741c1561b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f741000f630 tx=0x7f7410017000).stop 2023-05-17T14:54:01.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 shutdown_connections 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f740805ed90 0x7f7408061250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c154470 0x7f741c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c0693f0 0x7f741c1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 --2- 172.21.15.27:0/1613278752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c154090 0x7f741c1561b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 >> 172.21.15.27:0/1613278752 conn(0x7f741c05e7e0 msgr2=0x7f741c14fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 shutdown_connections 2023-05-17T14:54:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.464+0000 7f7423704700 1 -- 172.21.15.27:0/1613278752 wait complete. 2023-05-17T14:54:01.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-05-17T14:54:01.480 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-17T14:54:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.592+0000 7f78f121c700 1 Processor -- start 2023-05-17T14:54:01.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.592+0000 7f78f121c700 1 -- start start 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f121c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78ec0cac00 0x7f78ec0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f121c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f78ec153ef0 0x7f78ec0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f121c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0c60d0 con 0x7f78ec157980 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f121c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec1588b0 con 0x7f78ec153ef0 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f121c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec157e00 con 0x7f78ec0cac00 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f78ec153ef0 0x7f78ec0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f78ec153ef0 0x7f78ec0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34036/0 (socket says 172.21.15.27:34036) 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 -- 172.21.15.27:0/3428235027 learned_addr learned my addr 172.21.15.27:0/3428235027 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78ebfff700 1 --2- 172.21.15.27:0/3428235027 >> v2:172.21.15.40:3300/0 conn(0x7f78ec0cac00 0x7f78ec0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 -- 172.21.15.27:0/3428235027 >> v2:172.21.15.40:3300/0 conn(0x7f78ec0cac00 msgr2=0x7f78ec0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 --2- 172.21.15.27:0/3428235027 >> v2:172.21.15.40:3300/0 conn(0x7f78ec0cac00 0x7f78ec0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 -- 172.21.15.27:0/3428235027 >> v1:172.21.15.40:6789/0 conn(0x7f78ec157980 legacy=0x7f78ec1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78f0a1b700 1 -- 172.21.15.27:0/3428235027 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec158010 con 0x7f78ec153ef0 2023-05-17T14:54:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.593+0000 7f78ebfff700 1 --2- 172.21.15.27:0/3428235027 >> v2:172.21.15.40:3300/0 conn(0x7f78ec0cac00 0x7f78ec0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:01.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f0a1b700 1 --2- 172.21.15.27:0/3428235027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec0c5be0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f78ec069f80 tx=0x7f78e4009840).ready entity=mon.0 client_cookie=b0b8498e62ebf127 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78eaffd700 1 -- 172.21.15.27:0/3428235027 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e400e070 con 0x7f78ec153ef0 2023-05-17T14:54:01.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78eaffd700 1 -- 172.21.15.27:0/3428235027 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e400ba50 con 0x7f78ec153ef0 2023-05-17T14:54:01.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78eaffd700 1 -- 172.21.15.27:0/3428235027 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e400bdd0 con 0x7f78ec153ef0 2023-05-17T14:54:01.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 -- 172.21.15.27:0/3428235027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 msgr2=0x7f78ec0c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 --2- 172.21.15.27:0/3428235027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec0c5be0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f78ec069f80 tx=0x7f78e4009840).stop 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 -- 172.21.15.27:0/3428235027 shutdown_connections 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 --2- 172.21.15.27:0/3428235027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec0c5be0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 --2- 172.21.15.27:0/3428235027 >> v2:172.21.15.40:3300/0 conn(0x7f78ec0cac00 0x7f78ec0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 -- 172.21.15.27:0/3428235027 >> 172.21.15.27:0/3428235027 conn(0x7f78ec05dd50 msgr2=0x7f78ec05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 -- 172.21.15.27:0/3428235027 shutdown_connections 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.594+0000 7f78f121c700 1 -- 172.21.15.27:0/3428235027 wait complete. 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.595+0000 7f78f121c700 1 Processor -- start 2023-05-17T14:54:01.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 -- start start 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78ec0cac00 0x7f78ec1459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ec157980 0x7f78ec0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec14efa0 con 0x7f78ec153ef0 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec145ea0 con 0x7f78ec157980 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78f121c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0afd20 con 0x7f78ec0cac00 2023-05-17T14:54:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec1546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34042/0 (socket says 172.21.15.27:34042) 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.596+0000 7f78eb7fe700 1 -- 172.21.15.27:0/148970020 learned_addr learned my addr 172.21.15.27:0/148970020 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78f0a1b700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ec157980 0x7f78ec0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78ebfff700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78ec0cac00 0x7f78ec1459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78eb7fe700 1 -- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78ec0cac00 msgr2=0x7f78ec1459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78eb7fe700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78ec0cac00 0x7f78ec1459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78eb7fe700 1 -- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ec157980 msgr2=0x7f78ec0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78eb7fe700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ec157980 0x7f78ec0c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78eb7fe700 1 -- 172.21.15.27:0/148970020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e4009ae0 con 0x7f78ec153ef0 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78eb7fe700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec1546e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f78dc00c470 tx=0x7f78dc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc007020 con 0x7f78ec153ef0 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc007180 con 0x7f78ec153ef0 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0af490 con 0x7f78ec153ef0 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc007520 con 0x7f78ec153ef0 2023-05-17T14:54:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.597+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec0af9b0 con 0x7f78ec153ef0 2023-05-17T14:54:01.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.598+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec0afe90 con 0x7f78ec153ef0 2023-05-17T14:54:01.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.598+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78dc010070 con 0x7f78ec153ef0 2023-05-17T14:54:01.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.599+0000 7f78e3fff700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78cc05ed90 0x7f78cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.599+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78dc078a30 con 0x7f78ec153ef0 2023-05-17T14:54:01.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.599+0000 7f78ebfff700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78cc05ed90 0x7f78cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.599+0000 7f78ebfff700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78cc05ed90 0x7f78cc061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f78d4006d80 tx=0x7f78d4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.603+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78dc0478f0 con 0x7f78ec153ef0 2023-05-17T14:54:01.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.776+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78ec0af430 con 0x7f78ec153ef0 2023-05-17T14:54:01.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.776+0000 7f78e3fff700 1 -- 172.21.15.27:0/148970020 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78dc049fd0 con 0x7f78ec153ef0 2023-05-17T14:54:01.780 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:54:01.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78cc05ed90 msgr2=0x7f78cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78cc05ed90 0x7f78cc061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f78d4006d80 tx=0x7f78d4008040).stop 2023-05-17T14:54:01.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 msgr2=0x7f78ec1546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec1546e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f78dc00c470 tx=0x7f78dc007e00).stop 2023-05-17T14:54:01.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 shutdown_connections 2023-05-17T14:54:01.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78cc05ed90 0x7f78cc061250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ec157980 0x7f78ec0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78ec0cac00 0x7f78ec1459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 --2- 172.21.15.27:0/148970020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78ec153ef0 0x7f78ec1546e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 >> 172.21.15.27:0/148970020 conn(0x7f78ec05dd50 msgr2=0x7f78ec0c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:01.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 shutdown_connections 2023-05-17T14:54:01.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.778+0000 7f78f121c700 1 -- 172.21.15.27:0/148970020 wait complete. 2023-05-17T14:54:01.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-05-17T14:54:01.794 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-17T14:54:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.906+0000 7fd52bd6d700 1 Processor -- start 2023-05-17T14:54:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.907+0000 7fd52bd6d700 1 -- start start 2023-05-17T14:54:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.907+0000 7fd52bd6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd524150b60 0x7fd524064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd52bd6d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240c28e0 con 0x7fd5240683c0 2023-05-17T14:54:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd52bd6d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524065390 con 0x7fd524150f40 2023-05-17T14:54:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd52bd6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c2d70 con 0x7fd524150b60 2023-05-17T14:54:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd52a30a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd5240683c0 0x7fd5241548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33610/0 (socket says 172.21.15.27:33610) 2023-05-17T14:54:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd52a30a700 1 -- 172.21.15.27:0/1986285719 learned_addr learned my addr 172.21.15.27:0/1986285719 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd529b09700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd524150b60 0x7fd524064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437378949 0 0) 0x7fd5240c28e0 con 0x7fd5240683c0 2023-05-17T14:54:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5100033f0 con 0x7fd5240683c0 2023-05-17T14:54:01.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009202921 0 0) 0x7fd524065390 con 0x7fd524150f40 2023-05-17T14:54:01.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240c28e0 con 0x7fd524150f40 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809230514 0 0) 0x7fd5100033f0 con 0x7fd5240683c0 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd524150b60 msgr2=0x7fd524064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd524150b60 0x7fd524064ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 >> v1:172.21.15.40:6789/0 conn(0x7fd524150f40 legacy=0x7fd524067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524065610 con 0x7fd5240683c0 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fd5200017f0 con 0x7fd5240683c0 2023-05-17T14:54:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 >> v1:172.21.15.27:6789/0 conn(0x7fd5240683c0 legacy=0x7fd5241548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd510003aa0 0x7fd510003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd510004690 0x7fd510004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd510005000 0x7fd51000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c2d70 con 0x7fd510005000 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000be30 con 0x7fd510003aa0 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000bff0 con 0x7fd510004690 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd529b09700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd524150b60 0x7fd524064ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.908+0000 7fd52a30a700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd510005000 0x7fd51000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd529308700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd510004690 0x7fd510004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd529b09700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd510003aa0 0x7fd510003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 -- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd510004690 msgr2=0x7fd510004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd510004690 0x7fd510004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 -- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd510003aa0 msgr2=0x7fd510003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd510003aa0 0x7fd510003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 -- 172.21.15.27:0/1986285719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100033f0 con 0x7fd510005000 2023-05-17T14:54:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd529b09700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd510003aa0 0x7fd510003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd510005000 0x7fd51000b8e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd5240687c0 tx=0x7fd520007f40).ready entity=mon.0 client_cookie=5166758bf5c5f890 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000cd10 con 0x7fd510005000 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52000ce70 con 0x7fd510005000 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd528b07700 1 -- 172.21.15.27:0/1986285719 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520005d50 con 0x7fd510005000 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52bd6d700 1 -- 172.21.15.27:0/1986285719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd510005000 msgr2=0x7fd51000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/1986285719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd510005000 0x7fd51000b8e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd5240687c0 tx=0x7fd520007f40).stop 2023-05-17T14:54:01.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.909+0000 7fd52a30a700 1 -- 172.21.15.27:0/1986285719 reap_dead start 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.910+0000 7fd52bd6d700 1 -- 172.21.15.27:0/1986285719 shutdown_connections 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.910+0000 7fd52bd6d700 1 -- 172.21.15.27:0/1986285719 >> 172.21.15.27:0/1986285719 conn(0x7fd5240c7910 msgr2=0x7fd5240c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.910+0000 7fd52bd6d700 1 -- 172.21.15.27:0/1986285719 shutdown_connections 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.910+0000 7fd52bd6d700 1 -- 172.21.15.27:0/1986285719 wait complete. 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.911+0000 7fd52bd6d700 1 Processor -- start 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.911+0000 7fd52bd6d700 1 -- start start 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 0x7fd5240acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5240ad0b0 0x7fd5240bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240bef30 0x7fd52405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd524168ec0 con 0x7fd52413c3e0 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240ad530 con 0x7fd5240bef30 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd524165d30 con 0x7fd5240ad0b0 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 0x7fd5240acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 0x7fd5240acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34056/0 (socket says 172.21.15.27:34056) 2023-05-17T14:54:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 -- 172.21.15.27:0/2930734698 learned_addr learned my addr 172.21.15.27:0/2930734698 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52a30a700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240bef30 0x7fd52405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529308700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5240ad0b0 0x7fd5240bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 -- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5240ad0b0 msgr2=0x7fd5240bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5240ad0b0 0x7fd5240bea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 -- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240bef30 msgr2=0x7fd52405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240bef30 0x7fd52405dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 -- 172.21.15.27:0/2930734698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5241682b0 con 0x7fd52413c3e0 2023-05-17T14:54:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd529b09700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 0x7fd5240acbc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd51c011970 tx=0x7fd51c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00f6d0 con 0x7fd52413c3e0 2023-05-17T14:54:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c00f830 con 0x7fd52413c3e0 2023-05-17T14:54:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd524168590 con 0x7fd52413c3e0 2023-05-17T14:54:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00fbb0 con 0x7fd52413c3e0 2023-05-17T14:54:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.912+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd524168b50 con 0x7fd52413c3e0 2023-05-17T14:54:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.913+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5240661f0 con 0x7fd52413c3e0 2023-05-17T14:54:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.914+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd51c012040 con 0x7fd52413c3e0 2023-05-17T14:54:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.914+0000 7fd519ffb700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd50805ed90 0x7fd508061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.914+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd51c079d60 con 0x7fd52413c3e0 2023-05-17T14:54:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.914+0000 7fd529308700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd50805ed90 0x7fd508061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.915+0000 7fd529308700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd50805ed90 0x7fd508061250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd5140078e0 tx=0x7fd514009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:01.918+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd51c04b300 con 0x7fd52413c3e0 2023-05-17T14:54:02.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.092+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5240c1fb0 con 0x7fd52413c3e0 2023-05-17T14:54:02.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.092+0000 7fd519ffb700 1 -- 172.21.15.27:0/2930734698 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd51c04e920 con 0x7fd52413c3e0 2023-05-17T14:54:02.097 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:54:02.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd50805ed90 msgr2=0x7fd508061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd50805ed90 0x7fd508061250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd5140078e0 tx=0x7fd514009040).stop 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 msgr2=0x7fd5240acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 0x7fd5240acbc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd51c011970 tx=0x7fd51c008040).stop 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 shutdown_connections 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd50805ed90 0x7fd508061250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240bef30 0x7fd52405dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52413c3e0 0x7fd5240acbc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 --2- 172.21.15.27:0/2930734698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5240ad0b0 0x7fd5240bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 >> 172.21.15.27:0/2930734698 conn(0x7fd5240c7910 msgr2=0x7fd5240c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:02.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 shutdown_connections 2023-05-17T14:54:02.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.094+0000 7fd52bd6d700 1 -- 172.21.15.27:0/2930734698 wait complete. 2023-05-17T14:54:02.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-05-17T14:54:02.110 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-17T14:54:02.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.222+0000 7fc8708a6700 1 Processor -- start 2023-05-17T14:54:02.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.223+0000 7fc8708a6700 1 -- start start 2023-05-17T14:54:02.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.223+0000 7fc8708a6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc86c0c60d0 0x7fc86c157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.223+0000 7fc8708a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c1541a0 0x7fc86c0a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc8708a6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0c94b0 con 0x7fc86c153dc0 2023-05-17T14:54:02.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc8708a6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c158040 con 0x7fc86c0c60d0 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc8708a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0aa470 con 0x7fc86c1541a0 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc86c0c60d0 0x7fc86c157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc86c0c60d0 0x7fc86c157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34064/0 (socket says 172.21.15.27:34064) 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 -- 172.21.15.27:0/42165723 learned_addr learned my addr 172.21.15.27:0/42165723 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/42165723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c1541a0 0x7fc86c0a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 -- 172.21.15.27:0/42165723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c1541a0 msgr2=0x7fc86c0a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:02.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 --2- 172.21.15.27:0/42165723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c1541a0 0x7fc86c0a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 -- 172.21.15.27:0/42165723 >> v1:172.21.15.40:6789/0 conn(0x7fc86c153dc0 legacy=0x7fc86c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 -- 172.21.15.27:0/42165723 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0ca950 con 0x7fc86c0c60d0 2023-05-17T14:54:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc869d9b700 1 --2- 172.21.15.27:0/42165723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c0c60d0 0x7fc86c157b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc854006fd0 tx=0x7fc8540090f0).ready entity=mon.0 client_cookie=77d82824c1084cdf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc86959a700 1 -- 172.21.15.27:0/42165723 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400b580 con 0x7fc86c0c60d0 2023-05-17T14:54:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc86959a700 1 -- 172.21.15.27:0/42165723 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b6e0 con 0x7fc86c0c60d0 2023-05-17T14:54:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.224+0000 7fc86959a700 1 -- 172.21.15.27:0/42165723 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400ba60 con 0x7fc86c0c60d0 2023-05-17T14:54:02.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 -- 172.21.15.27:0/42165723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c0c60d0 msgr2=0x7fc86c157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 --2- 172.21.15.27:0/42165723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c0c60d0 0x7fc86c157b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc854006fd0 tx=0x7fc8540090f0).stop 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 -- 172.21.15.27:0/42165723 shutdown_connections 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 --2- 172.21.15.27:0/42165723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c1541a0 0x7fc86c0a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 --2- 172.21.15.27:0/42165723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c0c60d0 0x7fc86c157b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 -- 172.21.15.27:0/42165723 >> 172.21.15.27:0/42165723 conn(0x7fc86c05dd50 msgr2=0x7fc86c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 -- 172.21.15.27:0/42165723 shutdown_connections 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.225+0000 7fc8708a6700 1 -- 172.21.15.27:0/42165723 wait complete. 2023-05-17T14:54:02.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.226+0000 7fc8708a6700 1 Processor -- start 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.226+0000 7fc8708a6700 1 -- start start 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c0c60d0 0x7fc86c152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c153dc0 0x7fc86c1678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 0x7fc86c167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c1682b0 con 0x7fc86c1541a0 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c4a00 con 0x7fc86c153dc0 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c3df0 con 0x7fc86c0c60d0 2023-05-17T14:54:02.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 0x7fc86c167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 0x7fc86c167dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34074/0 (socket says 172.21.15.27:34074) 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4059028287 learned_addr learned my addr 172.21.15.27:0/4059028287 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc869d9b700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c153dc0 0x7fc86c1678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86a59c700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c0c60d0 0x7fc86c152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c0c60d0 msgr2=0x7fc86c152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c0c60d0 0x7fc86c152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c153dc0 msgr2=0x7fc86c1678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c153dc0 0x7fc86c1678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4059028287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009370 con 0x7fc86c1541a0 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 0x7fc86c167dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc85c00e900 tx=0x7fc85c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c012600 con 0x7fc86c1541a0 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c012760 con 0x7fc86c1541a0 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c012ae0 con 0x7fc86c1541a0 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.227+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c0c40d0 con 0x7fc86c1541a0 2023-05-17T14:54:02.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.228+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c0c4690 con 0x7fc86c1541a0 2023-05-17T14:54:02.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.228+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c153620 con 0x7fc86c1541a0 2023-05-17T14:54:02.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.229+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc85c022070 con 0x7fc86c1541a0 2023-05-17T14:54:02.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.229+0000 7fc8627fc700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc84c05ed90 0x7fc84c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.229+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc85c079c20 con 0x7fc86c1541a0 2023-05-17T14:54:02.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.229+0000 7fc86a59c700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc84c05ed90 0x7fc84c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.230+0000 7fc86a59c700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc84c05ed90 0x7fc84c061250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc864004290 tx=0x7fc864001560).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.234+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc85c04b1c0 con 0x7fc86c1541a0 2023-05-17T14:54:02.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.410+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc86c06bdf0 con 0x7fc86c1541a0 2023-05-17T14:54:02.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.410+0000 7fc8627fc700 1 -- 172.21.15.27:0/4059028287 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc85c016070 con 0x7fc86c1541a0 2023-05-17T14:54:02.414 INFO:teuthology.orchestra.run.smithi027.stdout:55834574852 2023-05-17T14:54:02.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc84c05ed90 msgr2=0x7fc84c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc84c05ed90 0x7fc84c061250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc864004290 tx=0x7fc864001560).stop 2023-05-17T14:54:02.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 msgr2=0x7fc86c167dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 0x7fc86c167dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc85c00e900 tx=0x7fc85c009060).stop 2023-05-17T14:54:02.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 shutdown_connections 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc84c05ed90 0x7fc84c061250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c1541a0 0x7fc86c167dc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c0c60d0 0x7fc86c152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 --2- 172.21.15.27:0/4059028287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c153dc0 0x7fc86c1678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 >> 172.21.15.27:0/4059028287 conn(0x7fc86c05dd50 msgr2=0x7fc86c0c7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 shutdown_connections 2023-05-17T14:54:02.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.412+0000 7fc8708a6700 1 -- 172.21.15.27:0/4059028287 wait complete. 2023-05-17T14:54:02.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-05-17T14:54:02.428 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-17T14:54:02.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.540+0000 7fa0fe8ba700 1 Processor -- start 2023-05-17T14:54:02.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.540+0000 7fa0fe8ba700 1 -- start start 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fe8ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0f8154090 0x7fa0f8154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fe8ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f80cb450 0x7fa0f80cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fe8ba700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0f8068f00 0x7fa0f80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fe8ba700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f8069fa0 con 0x7fa0f8068f00 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fe8ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80698a0 con 0x7fa0f8154090 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fe8ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c5a50 con 0x7fa0f80cb450 2023-05-17T14:54:02.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fce57700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0f8068f00 0x7fa0f80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fce57700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0f8068f00 0x7fa0f80693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34082/0 (socket says 172.21.15.27:34082) 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0fce57700 1 -- 172.21.15.27:0/482464091 learned_addr learned my addr 172.21.15.27:0/482464091 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0f7fff700 1 --2- 172.21.15.27:0/482464091 >> v2:172.21.15.40:3300/0 conn(0x7fa0f8154090 0x7fa0f8154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.541+0000 7fa0f77fe700 1 --2- 172.21.15.27:0/482464091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f80cb450 0x7fa0f80cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fce57700 1 -- 172.21.15.27:0/482464091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f80cb450 msgr2=0x7fa0f80cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fce57700 1 --2- 172.21.15.27:0/482464091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f80cb450 0x7fa0f80cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fce57700 1 -- 172.21.15.27:0/482464091 >> v2:172.21.15.40:3300/0 conn(0x7fa0f8154090 msgr2=0x7fa0f8154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:02.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fce57700 1 --2- 172.21.15.27:0/482464091 >> v2:172.21.15.40:3300/0 conn(0x7fa0f8154090 0x7fa0f8154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fce57700 1 -- 172.21.15.27:0/482464091 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80c04e0 con 0x7fa0f8068f00 2023-05-17T14:54:02.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fce57700 1 --2- 172.21.15.27:0/482464091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f8068f00 0x7fa0f80693b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa0f0009f20 tx=0x7fa0f0009840).ready entity=mon.0 client_cookie=40c4610f36739b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0f6ffd700 1 -- 172.21.15.27:0/482464091 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000e070 con 0x7fa0f8068f00 2023-05-17T14:54:02.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0f6ffd700 1 -- 172.21.15.27:0/482464091 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000ba40 con 0x7fa0f8068f00 2023-05-17T14:54:02.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0f6ffd700 1 -- 172.21.15.27:0/482464091 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000bdc0 con 0x7fa0f8068f00 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/482464091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f8068f00 msgr2=0x7fa0f80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/482464091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f8068f00 0x7fa0f80693b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa0f0009f20 tx=0x7fa0f0009840).stop 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/482464091 shutdown_connections 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/482464091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f8068f00 0x7fa0f80693b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/482464091 >> v2:172.21.15.40:3300/0 conn(0x7fa0f8154090 0x7fa0f8154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/482464091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f80cb450 0x7fa0f80cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/482464091 >> 172.21.15.27:0/482464091 conn(0x7fa0f805e7e0 msgr2=0x7fa0f80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/482464091 shutdown_connections 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.542+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/482464091 wait complete. 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.543+0000 7fa0fe8ba700 1 Processor -- start 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 -- start start 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f8068f00 0x7fa0f80b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 0x7fa0f80c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f8154090 0x7fa0f80c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c27c0 con 0x7fa0f80cb450 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80b0160 con 0x7fa0f8068f00 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0fe8ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80af550 con 0x7fa0f8154090 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0f77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 0x7fa0f80c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0f77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 0x7fa0f80c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34088/0 (socket says 172.21.15.27:34088) 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0f77fe700 1 -- 172.21.15.27:0/3966636255 learned_addr learned my addr 172.21.15.27:0/3966636255 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.544+0000 7fa0f7fff700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f8068f00 0x7fa0f80b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0fce57700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f8154090 0x7fa0f80c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0f77fe700 1 -- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f8154090 msgr2=0x7fa0f80c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0f77fe700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f8154090 0x7fa0f80c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0f77fe700 1 -- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f8068f00 msgr2=0x7fa0f80b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0f77fe700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f8068f00 0x7fa0f80b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0f77fe700 1 -- 172.21.15.27:0/3966636255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009ae0 con 0x7fa0f80cb450 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0f77fe700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 0x7fa0f80c1de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa0ec00d890 tx=0x7fa0ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec011590 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec0116f0 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80af830 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec011a70 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.545+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80afdf0 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.546+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa0ec01c460 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.546+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8157c60 con 0x7fa0f80cb450 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.547+0000 7fa0dffff700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa0e405ed90 0x7fa0e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.547+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa0ec079930 con 0x7fa0f80cb450 2023-05-17T14:54:02.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.547+0000 7fa0f7fff700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa0e405ed90 0x7fa0e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.547+0000 7fa0f7fff700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa0e405ed90 0x7fa0e4061250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa0e800bb10 tx=0x7fa0e8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.551+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0ec04ae70 con 0x7fa0f80cb450 2023-05-17T14:54:02.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.725+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa0f80c0760 con 0x7fa0f80cb450 2023-05-17T14:54:02.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.725+0000 7fa0dffff700 1 -- 172.21.15.27:0/3966636255 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0ec011e60 con 0x7fa0f80cb450 2023-05-17T14:54:02.729 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:54:02.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa0e405ed90 msgr2=0x7fa0e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa0e405ed90 0x7fa0e4061250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa0e800bb10 tx=0x7fa0e8008040).stop 2023-05-17T14:54:02.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 msgr2=0x7fa0f80c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 0x7fa0f80c1de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa0ec00d890 tx=0x7fa0ec008040).stop 2023-05-17T14:54:02.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 shutdown_connections 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa0e405ed90 0x7fa0e4061250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0f8154090 0x7fa0f80c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f8068f00 0x7fa0f80b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 --2- 172.21.15.27:0/3966636255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0f80cb450 0x7fa0f80c1de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 >> 172.21.15.27:0/3966636255 conn(0x7fa0f805e7e0 msgr2=0x7fa0f814e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 shutdown_connections 2023-05-17T14:54:02.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.727+0000 7fa0fe8ba700 1 -- 172.21.15.27:0/3966636255 wait complete. 2023-05-17T14:54:02.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2023-05-17T14:54:02.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-17T14:54:02.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.856+0000 7f5dd083d700 1 Processor -- start 2023-05-17T14:54:02.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.856+0000 7f5dd083d700 1 -- start start 2023-05-17T14:54:02.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dd083d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc0a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dd083d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc157b00 con 0x7f5dcc1545b0 2023-05-17T14:54:02.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dd083d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc0aa380 con 0x7f5dcc154130 2023-05-17T14:54:02.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dd083d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc155310 con 0x7f5dcc153d50 2023-05-17T14:54:02.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcb59e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5dcc1545b0 0x7f5dcc157f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33656/0 (socket says 172.21.15.27:33656) 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcb59e700 1 -- 172.21.15.27:0/344041722 learned_addr learned my addr 172.21.15.27:0/344041722 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcad9d700 1 --2- 172.21.15.27:0/344041722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc0a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703486928 0 0) 0x7f5dcc157b00 con 0x7f5dcc1545b0 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db80033f0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073712020 0 0) 0x7f5dcc0aa380 con 0x7f5dcc154130 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc157b00 con 0x7f5dcc154130 2023-05-17T14:54:02.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948761839 0 0) 0x7f5db80033f0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcad9d700 1 -- 172.21.15.27:0/344041722 >> v1:172.21.15.40:6789/0 conn(0x7f5dcc154130 legacy=0x7f5dcc0bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcad9d700 1 -- 172.21.15.27:0/344041722 >> v1:172.21.15.27:6789/0 conn(0x7f5dcc1545b0 legacy=0x7f5dcc157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcad9d700 1 -- 172.21.15.27:0/344041722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc154a70 con 0x7f5dcc153d50 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.857+0000 7f5dcad9d700 1 --2- 172.21.15.27:0/344041722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc0a9e90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5dc4009e90 tx=0x7f5dc4009780).ready entity=mon.2 client_cookie=7c812975958f2611 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400e070 con 0x7f5dcc153d50 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc400b7a0 con 0x7f5dcc153d50 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dc9d9b700 1 -- 172.21.15.27:0/344041722 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc001470 con 0x7f5dcc153d50 2023-05-17T14:54:02.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 -- 172.21.15.27:0/344041722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 msgr2=0x7f5dcc0a9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 --2- 172.21.15.27:0/344041722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc0a9e90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5dc4009e90 tx=0x7f5dc4009780).stop 2023-05-17T14:54:02.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 -- 172.21.15.27:0/344041722 shutdown_connections 2023-05-17T14:54:02.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 --2- 172.21.15.27:0/344041722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc0a9e90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 -- 172.21.15.27:0/344041722 >> 172.21.15.27:0/344041722 conn(0x7f5dcc05dd50 msgr2=0x7f5dcc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:02.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 -- 172.21.15.27:0/344041722 shutdown_connections 2023-05-17T14:54:02.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.858+0000 7f5dd083d700 1 -- 172.21.15.27:0/344041722 wait complete. 2023-05-17T14:54:02.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.859+0000 7f5dd083d700 1 Processor -- start 2023-05-17T14:54:02.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.859+0000 7f5dd083d700 1 -- start start 2023-05-17T14:54:02.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dd083d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dd083d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dcc154130 0x7f5dcc150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dd083d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 0x7f5dcc0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dd083d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0ac7f0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dd083d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc145b30 con 0x7f5dcc154130 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dd083d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0abc00 con 0x7f5dcc153d50 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dcb59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 0x7f5dcc0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dcb59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 0x7f5dcc0acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34102/0 (socket says 172.21.15.27:34102) 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dcb59e700 1 -- 172.21.15.27:0/1383604023 learned_addr learned my addr 172.21.15.27:0/1383604023 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dca59c700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dcc154130 0x7f5dcc150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.860+0000 7f5dcad9d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcb59e700 1 -- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 msgr2=0x7f5dcc145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcb59e700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcb59e700 1 -- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dcc154130 msgr2=0x7f5dcc150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:02.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcb59e700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dcc154130 0x7f5dcc150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcb59e700 1 -- 172.21.15.27:0/1383604023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4009a20 con 0x7f5dcc1545b0 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcad9d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dcb59e700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 0x7f5dcc0acc80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5dbc00c830 tx=0x7f5dbc001a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc007170 con 0x7f5dcc1545b0 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0072d0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0048c0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc0abec0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.861+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc0ac480 con 0x7f5dcc1545b0 2023-05-17T14:54:02.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.862+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc0ac9a0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.862+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5dbc004cb0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.863+0000 7f5dc2ffd700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5dac05ed90 0x7f5dac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:02.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.863+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5dbc0796e0 con 0x7f5dcc1545b0 2023-05-17T14:54:02.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.863+0000 7f5dcad9d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5dac05ed90 0x7f5dac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:02.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.863+0000 7f5dcad9d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5dac05ed90 0x7f5dac061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5dc40097c0 tx=0x7f5dcc157a70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:02.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:02.867+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5dcc0ac9a0 con 0x7f5dcc1545b0 2023-05-17T14:54:03.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.039+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5dcc0ac9a0 con 0x7f5dcc1545b0 2023-05-17T14:54:03.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.039+0000 7f5dc2ffd700 1 -- 172.21.15.27:0/1383604023 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dcc0ac9a0 con 0x7f5dcc1545b0 2023-05-17T14:54:03.043 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2023-05-17T14:54:03.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.040+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5dac05ed90 msgr2=0x7f5dac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.040+0000 7f5dd083d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5dac05ed90 0x7f5dac061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5dc40097c0 tx=0x7f5dcc157a70).stop 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.040+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 msgr2=0x7f5dcc0acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.040+0000 7f5dd083d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 0x7f5dcc0acc80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5dbc00c830 tx=0x7f5dbc001a30).stop 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 shutdown_connections 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5dac05ed90 0x7f5dac061250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dcc1545b0 0x7f5dcc0acc80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5dcc153d50 0x7f5dcc145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 --2- 172.21.15.27:0/1383604023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dcc154130 0x7f5dcc150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 >> 172.21.15.27:0/1383604023 conn(0x7f5dcc05dd50 msgr2=0x7f5dcc0c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 shutdown_connections 2023-05-17T14:54:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.041+0000 7f5dd083d700 1 -- 172.21.15.27:0/1383604023 wait complete. 2023-05-17T14:54:03.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-05-17T14:54:03.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-17T14:54:03.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.168+0000 7f827fc69700 1 Processor -- start 2023-05-17T14:54:03.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.169+0000 7f827fc69700 1 -- start start 2023-05-17T14:54:03.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.169+0000 7f827fc69700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8278069610 0x7f827815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.169+0000 7f827fc69700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780c5a50 con 0x7f8278154470 2023-05-17T14:54:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.169+0000 7f827fc69700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780c04e0 con 0x7f8278154090 2023-05-17T14:54:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.169+0000 7f827fc69700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8278069fa0 con 0x7f8278069610 2023-05-17T14:54:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827d204700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8278154470 0x7f8278068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33670/0 (socket says 172.21.15.27:33670) 2023-05-17T14:54:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827d204700 1 -- 172.21.15.27:0/3536603792 learned_addr learned my addr 172.21.15.27:0/3536603792 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827e206700 1 --2- 172.21.15.27:0/3536603792 >> v2:172.21.15.40:3300/0 conn(0x7f8278069610 0x7f827815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827ca03700 1 -- 172.21.15.27:0/3536603792 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534492975 0 0) 0x7f82780c5a50 con 0x7f8278154470 2023-05-17T14:54:03.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827ca03700 1 -- 172.21.15.27:0/3536603792 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82600033f0 con 0x7f8278154470 2023-05-17T14:54:03.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827e206700 1 -- 172.21.15.27:0/3536603792 >> v1:172.21.15.40:6789/0 conn(0x7f8278154090 legacy=0x7f82780cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827e206700 1 -- 172.21.15.27:0/3536603792 >> v1:172.21.15.27:6789/0 conn(0x7f8278154470 legacy=0x7f8278068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827e206700 1 -- 172.21.15.27:0/3536603792 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780c0760 con 0x7f8278069610 2023-05-17T14:54:03.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827e206700 1 --2- 172.21.15.27:0/3536603792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278069610 0x7f827815ef60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8268009e60 tx=0x7f8268009780).ready entity=mon.1 client_cookie=c7c92b733165c5a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827ca03700 1 -- 172.21.15.27:0/3536603792 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800e070 con 0x7f8278069610 2023-05-17T14:54:03.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827ca03700 1 -- 172.21.15.27:0/3536603792 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826800bb60 con 0x7f8278069610 2023-05-17T14:54:03.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.170+0000 7f827ca03700 1 -- 172.21.15.27:0/3536603792 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268012410 con 0x7f8278069610 2023-05-17T14:54:03.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 -- 172.21.15.27:0/3536603792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278069610 msgr2=0x7f827815ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 --2- 172.21.15.27:0/3536603792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278069610 0x7f827815ef60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8268009e60 tx=0x7f8268009780).stop 2023-05-17T14:54:03.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 -- 172.21.15.27:0/3536603792 shutdown_connections 2023-05-17T14:54:03.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 --2- 172.21.15.27:0/3536603792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278069610 0x7f827815ef60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 -- 172.21.15.27:0/3536603792 >> 172.21.15.27:0/3536603792 conn(0x7f827805e7e0 msgr2=0x7f82780cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:03.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 -- 172.21.15.27:0/3536603792 shutdown_connections 2023-05-17T14:54:03.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.171+0000 7f827fc69700 1 -- 172.21.15.27:0/3536603792 wait complete. 2023-05-17T14:54:03.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.172+0000 7f827fc69700 1 Processor -- start 2023-05-17T14:54:03.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.172+0000 7f827fc69700 1 -- start start 2023-05-17T14:54:03.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827fc69700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 0x7f8278157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827fc69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278154090 0x7f82780afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827fc69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8278154470 0x7f82780b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827fc69700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780b0810 con 0x7f8278069610 2023-05-17T14:54:03.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827fc69700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278155910 con 0x7f8278154090 2023-05-17T14:54:03.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827fc69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278157c60 con 0x7f8278154470 2023-05-17T14:54:03.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 0x7f8278157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 0x7f8278157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34112/0 (socket says 172.21.15.27:34112) 2023-05-17T14:54:03.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 -- 172.21.15.27:0/2630242966 learned_addr learned my addr 172.21.15.27:0/2630242966 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:03.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827d204700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278154090 0x7f82780afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827e206700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8278154470 0x7f82780b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 -- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8278154470 msgr2=0x7f82780b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8278154470 0x7f82780b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 -- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278154090 msgr2=0x7f82780afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278154090 0x7f82780afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.173+0000 7f827da05700 1 -- 172.21.15.27:0/2630242966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268009a20 con 0x7f8278069610 2023-05-17T14:54:03.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.174+0000 7f827da05700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 0x7f8278157770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f827000c440 tx=0x7f8270007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.174+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270012400 con 0x7f8278069610 2023-05-17T14:54:03.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.174+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270012560 con 0x7f8278069610 2023-05-17T14:54:03.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.174+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780c48d0 con 0x7f8278069610 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.174+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270012900 con 0x7f8278069610 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.174+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780c4030 con 0x7f8278069610 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.175+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8278069b10 con 0x7f8278069610 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.175+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8270019030 con 0x7f8278069610 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.176+0000 7f8275ffb700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f826405ed90 0x7f8264061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.176+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8270079140 con 0x7f8278069610 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.176+0000 7f827d204700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f826405ed90 0x7f8264061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.176+0000 7f827d204700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f826405ed90 0x7f8264061250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f826c007fd0 tx=0x7f826c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.180+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f827004a6e0 con 0x7f8278069610 2023-05-17T14:54:03.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.355+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f82780c9e00 con 0x7f8278069610 2023-05-17T14:54:03.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.356+0000 7f8275ffb700 1 -- 172.21.15.27:0/2630242966 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8270017090 con 0x7f8278069610 2023-05-17T14:54:03.360 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2023-05-17T14:54:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f826405ed90 msgr2=0x7f8264061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f826405ed90 0x7f8264061250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f826c007fd0 tx=0x7f826c009040).stop 2023-05-17T14:54:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 msgr2=0x7f8278157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 0x7f8278157770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f827000c440 tx=0x7f8270007dc0).stop 2023-05-17T14:54:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 shutdown_connections 2023-05-17T14:54:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f826405ed90 0x7f8264061250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8278154470 0x7f82780b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8278069610 0x7f8278157770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 --2- 172.21.15.27:0/2630242966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8278154090 0x7f82780afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 >> 172.21.15.27:0/2630242966 conn(0x7f827805e7e0 msgr2=0x7f827814fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 shutdown_connections 2023-05-17T14:54:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.358+0000 7f827fc69700 1 -- 172.21.15.27:0/2630242966 wait complete. 2023-05-17T14:54:03.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.7 2023-05-17T14:54:03.374 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-17T14:54:03.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T14:54:03.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.486+0000 7fb628f91700 1 Processor -- start 2023-05-17T14:54:03.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.486+0000 7fb628f91700 1 -- start start 2023-05-17T14:54:03.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb628f91700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6240c1180 0x7fb6240c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb628f91700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb6240c1560 0x7fb6240c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb628f91700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240c07e0 con 0x7fb6241544f0 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb628f91700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6241549b0 con 0x7fb6240c1560 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb628f91700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb624154c90 con 0x7fb6240c1180 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb623fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb6240c1560 0x7fb6240c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb622ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb6241544f0 0x7fb6240a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33684/0 (socket says 172.21.15.27:33684) 2023-05-17T14:54:03.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb622ffd700 1 -- 172.21.15.27:0/4229769598 learned_addr learned my addr 172.21.15.27:0/4229769598 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.487+0000 7fb6237fe700 1 --2- 172.21.15.27:0/4229769598 >> v2:172.21.15.40:3300/0 conn(0x7fb6240c1180 0x7fb6240c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.488+0000 7fb623fff700 1 -- 172.21.15.27:0/4229769598 >> v2:172.21.15.40:3300/0 conn(0x7fb6240c1180 msgr2=0x7fb6240c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.488+0000 7fb623fff700 1 --2- 172.21.15.27:0/4229769598 >> v2:172.21.15.40:3300/0 conn(0x7fb6240c1180 0x7fb6240c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.488+0000 7fb623fff700 1 -- 172.21.15.27:0/4229769598 >> v1:172.21.15.27:6789/0 conn(0x7fb6241544f0 legacy=0x7fb6240a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.488+0000 7fb6227fc700 1 -- 172.21.15.27:0/4229769598 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499458659 0 0) 0x7fb6240c07e0 con 0x7fb6241544f0 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.488+0000 7fb623fff700 1 -- 172.21.15.27:0/4229769598 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624154f70 con 0x7fb6240c1560 2023-05-17T14:54:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.488+0000 7fb623fff700 1 --2- 172.21.15.27:0/4229769598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240c74a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb624062c80 tx=0x7fb61c009780).ready entity=mon.0 client_cookie=eb1976e37d368b8d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.489+0000 7fb6227fc700 1 -- 172.21.15.27:0/4229769598 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00e070 con 0x7fb6240c1560 2023-05-17T14:54:03.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb6227fc700 1 -- 172.21.15.27:0/4229769598 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c00bb60 con 0x7fb6240c1560 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb6227fc700 1 -- 172.21.15.27:0/4229769598 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c012410 con 0x7fb6240c1560 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 -- 172.21.15.27:0/4229769598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 msgr2=0x7fb6240c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 --2- 172.21.15.27:0/4229769598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240c74a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb624062c80 tx=0x7fb61c009780).stop 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 -- 172.21.15.27:0/4229769598 shutdown_connections 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 --2- 172.21.15.27:0/4229769598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240c74a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 --2- 172.21.15.27:0/4229769598 >> v2:172.21.15.40:3300/0 conn(0x7fb6240c1180 0x7fb6240c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 -- 172.21.15.27:0/4229769598 >> 172.21.15.27:0/4229769598 conn(0x7fb62405dd50 msgr2=0x7fb62405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:03.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 -- 172.21.15.27:0/4229769598 shutdown_connections 2023-05-17T14:54:03.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.490+0000 7fb628f91700 1 -- 172.21.15.27:0/4229769598 wait complete. 2023-05-17T14:54:03.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.491+0000 7fb628f91700 1 Processor -- start 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.491+0000 7fb628f91700 1 -- start start 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb628f91700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6240c1180 0x7fb6240adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb628f91700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb628f91700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6241544f0 0x7fb6240afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb628f91700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624158d50 con 0x7fb6240c1560 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb628f91700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241595f0 con 0x7fb6241544f0 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb628f91700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240ca670 con 0x7fb6240c1180 2023-05-17T14:54:03.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb622ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb622ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34128/0 (socket says 172.21.15.27:34128) 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb622ffd700 1 -- 172.21.15.27:0/3903826820 learned_addr learned my addr 172.21.15.27:0/3903826820 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb6237fe700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6240c1180 0x7fb6240adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.492+0000 7fb623fff700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6241544f0 0x7fb6240afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb622ffd700 1 -- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6240c1180 msgr2=0x7fb6240adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb622ffd700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6240c1180 0x7fb6240adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb622ffd700 1 -- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6241544f0 msgr2=0x7fb6240afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb622ffd700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6241544f0 0x7fb6240afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb622ffd700 1 -- 172.21.15.27:0/3903826820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c009a20 con 0x7fb6240c1560 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb622ffd700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240af620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb61800c4e0 tx=0x7fb618007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61800ce90 con 0x7fb6240c1560 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6180072e0 con 0x7fb6240c1560 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624158fa0 con 0x7fb6240c1560 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618007660 con 0x7fb6240c1560 2023-05-17T14:54:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.493+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240b0000 con 0x7fb6240c1560 2023-05-17T14:54:03.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.494+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6241577b0 con 0x7fb6240c1560 2023-05-17T14:54:03.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.494+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb61801a060 con 0x7fb6240c1560 2023-05-17T14:54:03.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.494+0000 7fb60b7fe700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb61005ed60 0x7fb610061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.494+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb618079200 con 0x7fb6240c1560 2023-05-17T14:54:03.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.495+0000 7fb6237fe700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb61005ed60 0x7fb610061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.495+0000 7fb6237fe700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb61005ed60 0x7fb610061220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb614009b90 tx=0x7fb614009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.499+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb61804a7a0 con 0x7fb6240c1560 2023-05-17T14:54:03.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.665+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb624159760 con 0x7fb61005ed60 2023-05-17T14:54:03.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.675+0000 7fb60b7fe700 1 -- 172.21.15.27:0/3903826820 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336287 (secure 0 0 0) 0x7fb624159760 con 0x7fb61005ed60 2023-05-17T14:54:03.682 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:03.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb61005ed60 msgr2=0x7fb610061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb61005ed60 0x7fb610061220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb614009b90 tx=0x7fb614009060).stop 2023-05-17T14:54:03.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 msgr2=0x7fb6240af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240af620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb61800c4e0 tx=0x7fb618007c70).stop 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 shutdown_connections 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb61005ed60 0x7fb610061220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6241544f0 0x7fb6240afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6240c1180 0x7fb6240adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 --2- 172.21.15.27:0/3903826820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6240c1560 0x7fb6240af620 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 >> 172.21.15.27:0/3903826820 conn(0x7fb62405dd50 msgr2=0x7fb6240ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 shutdown_connections 2023-05-17T14:54:03.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.678+0000 7fb628f91700 1 -- 172.21.15.27:0/3903826820 wait complete. 2023-05-17T14:54:03.686 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T14:54:03.694 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-17T14:54:03.563197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41600,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":39680,"kb_avail":754933120,"statfs":{"total":773094113280,"available":773051514880,"internally_reserved":0,"allocated":1900544,"data_stored":687308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40632320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001980"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906043+0000","last_change":"2023-05-17T14:53:52.897717+0000","last_active":"2023-05-17T14:53:52.906043+0000","last_peered":"2023-05-17T14:53:52.906043+0000","last_clean":"2023-05-17T14:53:52.906043+0000","last_became_active":"2023-05-17T14:53:52.897401+0000","last_became_peered":"2023-05-17T14:53:52.897401+0000","last_unstale":"2023-05-17T14:53:52.906043+0000","last_undegraded":"2023-05-17T14:53:52.906043+0000","last_fullsized":"2023-05-17T14:53:52.906043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892623+0000","last_change":"2023-05-17T14:53:52.497633+0000","last_active":"2023-05-17T14:53:52.892623+0000","last_peered":"2023-05-17T14:53:52.892623+0000","last_clean":"2023-05-17T14:53:52.892623+0000","last_became_active":"2023-05-17T14:53:52.497319+0000","last_became_peered":"2023-05-17T14:53:52.497319+0000","last_unstale":"2023-05-17T14:53:52.892623+0000","last_undegraded":"2023-05-17T14:53:52.892623+0000","last_fullsized":"2023-05-17T14:53:52.892623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905474+0000","last_change":"2023-05-17T14:53:52.903639+0000","last_active":"2023-05-17T14:53:52.905474+0000","last_peered":"2023-05-17T14:53:52.905474+0000","last_clean":"2023-05-17T14:53:52.905474+0000","last_became_active":"2023-05-17T14:53:52.903343+0000","last_became_peered":"2023-05-17T14:53:52.903343+0000","last_unstale":"2023-05-17T14:53:52.905474+0000","last_undegraded":"2023-05-17T14:53:52.905474+0000","last_fullsized":"2023-05-17T14:53:52.905474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887305+0000","last_change":"2023-05-17T14:53:52.513391+0000","last_active":"2023-05-17T14:53:52.887305+0000","last_peered":"2023-05-17T14:53:52.887305+0000","last_clean":"2023-05-17T14:53:52.887305+0000","last_became_active":"2023-05-17T14:53:52.513085+0000","last_became_peered":"2023-05-17T14:53:52.513085+0000","last_unstale":"2023-05-17T14:53:52.887305+0000","last_undegraded":"2023-05-17T14:53:52.887305+0000","last_fullsized":"2023-05-17T14:53:52.887305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901401+0000","last_change":"2023-05-17T14:53:52.898454+0000","last_active":"2023-05-17T14:53:52.901401+0000","last_peered":"2023-05-17T14:53:52.901401+0000","last_clean":"2023-05-17T14:53:52.901401+0000","last_became_active":"2023-05-17T14:53:52.898174+0000","last_became_peered":"2023-05-17T14:53:52.898174+0000","last_unstale":"2023-05-17T14:53:52.901401+0000","last_undegraded":"2023-05-17T14:53:52.901401+0000","last_fullsized":"2023-05-17T14:53:52.901401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.878802+0000","last_change":"2023-05-17T14:53:52.504777+0000","last_active":"2023-05-17T14:53:52.878802+0000","last_peered":"2023-05-17T14:53:52.878802+0000","last_clean":"2023-05-17T14:53:52.878802+0000","last_became_active":"2023-05-17T14:53:52.504452+0000","last_became_peered":"2023-05-17T14:53:52.504452+0000","last_unstale":"2023-05-17T14:53:52.878802+0000","last_undegraded":"2023-05-17T14:53:52.878802+0000","last_fullsized":"2023-05-17T14:53:52.878802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894731+0000","last_change":"2023-05-17T14:53:52.891991+0000","last_active":"2023-05-17T14:53:52.894731+0000","last_peered":"2023-05-17T14:53:52.894731+0000","last_clean":"2023-05-17T14:53:52.894731+0000","last_became_active":"2023-05-17T14:53:52.891701+0000","last_became_peered":"2023-05-17T14:53:52.891701+0000","last_unstale":"2023-05-17T14:53:52.894731+0000","last_undegraded":"2023-05-17T14:53:52.894731+0000","last_fullsized":"2023-05-17T14:53:52.894731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889899+0000","last_change":"2023-05-17T14:53:52.510727+0000","last_active":"2023-05-17T14:53:52.889899+0000","last_peered":"2023-05-17T14:53:52.889899+0000","last_clean":"2023-05-17T14:53:52.889899+0000","last_became_active":"2023-05-17T14:53:52.510427+0000","last_became_peered":"2023-05-17T14:53:52.510427+0000","last_unstale":"2023-05-17T14:53:52.889899+0000","last_undegraded":"2023-05-17T14:53:52.889899+0000","last_fullsized":"2023-05-17T14:53:52.889899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906022+0000","last_change":"2023-05-17T14:53:52.897836+0000","last_active":"2023-05-17T14:53:52.906022+0000","last_peered":"2023-05-17T14:53:52.906022+0000","last_clean":"2023-05-17T14:53:52.906022+0000","last_became_active":"2023-05-17T14:53:52.897537+0000","last_became_peered":"2023-05-17T14:53:52.897537+0000","last_unstale":"2023-05-17T14:53:52.906022+0000","last_undegraded":"2023-05-17T14:53:52.906022+0000","last_fullsized":"2023-05-17T14:53:52.906022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892163+0000","last_change":"2023-05-17T14:53:52.506710+0000","last_active":"2023-05-17T14:53:52.892163+0000","last_peered":"2023-05-17T14:53:52.892163+0000","last_clean":"2023-05-17T14:53:52.892163+0000","last_became_active":"2023-05-17T14:53:52.506388+0000","last_became_peered":"2023-05-17T14:53:52.506388+0000","last_unstale":"2023-05-17T14:53:52.892163+0000","last_undegraded":"2023-05-17T14:53:52.892163+0000","last_fullsized":"2023-05-17T14:53:52.892163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902492+0000","last_change":"2023-05-17T14:53:52.897342+0000","last_active":"2023-05-17T14:53:52.902492+0000","last_peered":"2023-05-17T14:53:52.902492+0000","last_clean":"2023-05-17T14:53:52.902492+0000","last_became_active":"2023-05-17T14:53:52.897001+0000","last_became_peered":"2023-05-17T14:53:52.897001+0000","last_unstale":"2023-05-17T14:53:52.902492+0000","last_undegraded":"2023-05-17T14:53:52.902492+0000","last_fullsized":"2023-05-17T14:53:52.902492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907466+0000","last_change":"2023-05-17T14:53:52.512698+0000","last_active":"2023-05-17T14:53:52.907466+0000","last_peered":"2023-05-17T14:53:52.907466+0000","last_clean":"2023-05-17T14:53:52.907466+0000","last_became_active":"2023-05-17T14:53:52.512388+0000","last_became_peered":"2023-05-17T14:53:52.512388+0000","last_unstale":"2023-05-17T14:53:52.907466+0000","last_undegraded":"2023-05-17T14:53:52.907466+0000","last_fullsized":"2023-05-17T14:53:52.907466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907123+0000","last_change":"2023-05-17T14:53:52.902935+0000","last_active":"2023-05-17T14:53:52.907123+0000","last_peered":"2023-05-17T14:53:52.907123+0000","last_clean":"2023-05-17T14:53:52.907123+0000","last_became_active":"2023-05-17T14:53:52.902576+0000","last_became_peered":"2023-05-17T14:53:52.902576+0000","last_unstale":"2023-05-17T14:53:52.907123+0000","last_undegraded":"2023-05-17T14:53:52.907123+0000","last_fullsized":"2023-05-17T14:53:52.907123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904663+0000","last_change":"2023-05-17T14:53:52.505380+0000","last_active":"2023-05-17T14:53:52.904663+0000","last_peered":"2023-05-17T14:53:52.904663+0000","last_clean":"2023-05-17T14:53:52.904663+0000","last_became_active":"2023-05-17T14:53:52.505079+0000","last_became_peered":"2023-05-17T14:53:52.505079+0000","last_unstale":"2023-05-17T14:53:52.904663+0000","last_undegraded":"2023-05-17T14:53:52.904663+0000","last_fullsized":"2023-05-17T14:53:52.904663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906602+0000","last_change":"2023-05-17T14:53:52.899688+0000","last_active":"2023-05-17T14:53:52.906602+0000","last_peered":"2023-05-17T14:53:52.906602+0000","last_clean":"2023-05-17T14:53:52.906602+0000","last_became_active":"2023-05-17T14:53:52.899370+0000","last_became_peered":"2023-05-17T14:53:52.899370+0000","last_unstale":"2023-05-17T14:53:52.906602+0000","last_undegraded":"2023-05-17T14:53:52.906602+0000","last_fullsized":"2023-05-17T14:53:52.906602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901968+0000","last_change":"2023-05-17T14:53:52.511747+0000","last_active":"2023-05-17T14:53:52.901968+0000","last_peered":"2023-05-17T14:53:52.901968+0000","last_clean":"2023-05-17T14:53:52.901968+0000","last_became_active":"2023-05-17T14:53:52.511252+0000","last_became_peered":"2023-05-17T14:53:52.511252+0000","last_unstale":"2023-05-17T14:53:52.901968+0000","last_undegraded":"2023-05-17T14:53:52.901968+0000","last_fullsized":"2023-05-17T14:53:52.901968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905393+0000","last_change":"2023-05-17T14:53:52.897006+0000","last_active":"2023-05-17T14:53:52.905393+0000","last_peered":"2023-05-17T14:53:52.905393+0000","last_clean":"2023-05-17T14:53:52.905393+0000","last_became_active":"2023-05-17T14:53:52.896750+0000","last_became_peered":"2023-05-17T14:53:52.896750+0000","last_unstale":"2023-05-17T14:53:52.905393+0000","last_undegraded":"2023-05-17T14:53:52.905393+0000","last_fullsized":"2023-05-17T14:53:52.905393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885046+0000","last_change":"2023-05-17T14:53:52.509606+0000","last_active":"2023-05-17T14:53:52.885046+0000","last_peered":"2023-05-17T14:53:52.885046+0000","last_clean":"2023-05-17T14:53:52.885046+0000","last_became_active":"2023-05-17T14:53:52.509314+0000","last_became_peered":"2023-05-17T14:53:52.509314+0000","last_unstale":"2023-05-17T14:53:52.885046+0000","last_undegraded":"2023-05-17T14:53:52.885046+0000","last_fullsized":"2023-05-17T14:53:52.885046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910146+0000","last_change":"2023-05-17T14:53:52.906844+0000","last_active":"2023-05-17T14:53:52.910146+0000","last_peered":"2023-05-17T14:53:52.910146+0000","last_clean":"2023-05-17T14:53:52.910146+0000","last_became_active":"2023-05-17T14:53:52.906538+0000","last_became_peered":"2023-05-17T14:53:52.906538+0000","last_unstale":"2023-05-17T14:53:52.910146+0000","last_undegraded":"2023-05-17T14:53:52.910146+0000","last_fullsized":"2023-05-17T14:53:52.910146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882654+0000","last_change":"2023-05-17T14:53:52.510353+0000","last_active":"2023-05-17T14:53:52.882654+0000","last_peered":"2023-05-17T14:53:52.882654+0000","last_clean":"2023-05-17T14:53:52.882654+0000","last_became_active":"2023-05-17T14:53:52.509900+0000","last_became_peered":"2023-05-17T14:53:52.509900+0000","last_unstale":"2023-05-17T14:53:52.882654+0000","last_undegraded":"2023-05-17T14:53:52.882654+0000","last_fullsized":"2023-05-17T14:53:52.882654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906905+0000","last_change":"2023-05-17T14:53:52.902457+0000","last_active":"2023-05-17T14:53:52.906905+0000","last_peered":"2023-05-17T14:53:52.906905+0000","last_clean":"2023-05-17T14:53:52.906905+0000","last_became_active":"2023-05-17T14:53:52.899322+0000","last_became_peered":"2023-05-17T14:53:52.899322+0000","last_unstale":"2023-05-17T14:53:52.906905+0000","last_undegraded":"2023-05-17T14:53:52.906905+0000","last_fullsized":"2023-05-17T14:53:52.906905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906085+0000","last_change":"2023-05-17T14:53:52.509899+0000","last_active":"2023-05-17T14:53:52.906085+0000","last_peered":"2023-05-17T14:53:52.906085+0000","last_clean":"2023-05-17T14:53:52.906085+0000","last_became_active":"2023-05-17T14:53:52.509603+0000","last_became_peered":"2023-05-17T14:53:52.509603+0000","last_unstale":"2023-05-17T14:53:52.906085+0000","last_undegraded":"2023-05-17T14:53:52.906085+0000","last_fullsized":"2023-05-17T14:53:52.906085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905607+0000","last_change":"2023-05-17T14:53:52.897908+0000","last_active":"2023-05-17T14:53:52.905607+0000","last_peered":"2023-05-17T14:53:52.905607+0000","last_clean":"2023-05-17T14:53:52.905607+0000","last_became_active":"2023-05-17T14:53:52.896815+0000","last_became_peered":"2023-05-17T14:53:52.896815+0000","last_unstale":"2023-05-17T14:53:52.905607+0000","last_undegraded":"2023-05-17T14:53:52.905607+0000","last_fullsized":"2023-05-17T14:53:52.905607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902172+0000","last_change":"2023-05-17T14:53:52.511011+0000","last_active":"2023-05-17T14:53:52.902172+0000","last_peered":"2023-05-17T14:53:52.902172+0000","last_clean":"2023-05-17T14:53:52.902172+0000","last_became_active":"2023-05-17T14:53:52.510709+0000","last_became_peered":"2023-05-17T14:53:52.510709+0000","last_unstale":"2023-05-17T14:53:52.902172+0000","last_undegraded":"2023-05-17T14:53:52.902172+0000","last_fullsized":"2023-05-17T14:53:52.902172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908989+0000","last_change":"2023-05-17T14:53:52.904488+0000","last_active":"2023-05-17T14:53:52.908989+0000","last_peered":"2023-05-17T14:53:52.908989+0000","last_clean":"2023-05-17T14:53:52.908989+0000","last_became_active":"2023-05-17T14:53:52.904167+0000","last_became_peered":"2023-05-17T14:53:52.904167+0000","last_unstale":"2023-05-17T14:53:52.908989+0000","last_undegraded":"2023-05-17T14:53:52.908989+0000","last_fullsized":"2023-05-17T14:53:52.908989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902101+0000","last_change":"2023-05-17T14:53:52.509220+0000","last_active":"2023-05-17T14:53:52.902101+0000","last_peered":"2023-05-17T14:53:52.902101+0000","last_clean":"2023-05-17T14:53:52.902101+0000","last_became_active":"2023-05-17T14:53:52.508840+0000","last_became_peered":"2023-05-17T14:53:52.508840+0000","last_unstale":"2023-05-17T14:53:52.902101+0000","last_undegraded":"2023-05-17T14:53:52.902101+0000","last_fullsized":"2023-05-17T14:53:52.902101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909059+0000","last_change":"2023-05-17T14:53:52.904802+0000","last_active":"2023-05-17T14:53:52.909059+0000","last_peered":"2023-05-17T14:53:52.909059+0000","last_clean":"2023-05-17T14:53:52.909059+0000","last_became_active":"2023-05-17T14:53:52.904586+0000","last_became_peered":"2023-05-17T14:53:52.904586+0000","last_unstale":"2023-05-17T14:53:52.909059+0000","last_undegraded":"2023-05-17T14:53:52.909059+0000","last_fullsized":"2023-05-17T14:53:52.909059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883458+0000","last_change":"2023-05-17T14:53:52.503482+0000","last_active":"2023-05-17T14:53:52.883458+0000","last_peered":"2023-05-17T14:53:52.883458+0000","last_clean":"2023-05-17T14:53:52.883458+0000","last_became_active":"2023-05-17T14:53:52.503210+0000","last_became_peered":"2023-05-17T14:53:52.503210+0000","last_unstale":"2023-05-17T14:53:52.883458+0000","last_undegraded":"2023-05-17T14:53:52.883458+0000","last_fullsized":"2023-05-17T14:53:52.883458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905302+0000","last_change":"2023-05-17T14:53:52.902058+0000","last_active":"2023-05-17T14:53:52.905302+0000","last_peered":"2023-05-17T14:53:52.905302+0000","last_clean":"2023-05-17T14:53:52.905302+0000","last_became_active":"2023-05-17T14:53:52.896933+0000","last_became_peered":"2023-05-17T14:53:52.896933+0000","last_unstale":"2023-05-17T14:53:52.905302+0000","last_undegraded":"2023-05-17T14:53:52.905302+0000","last_fullsized":"2023-05-17T14:53:52.905302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886188+0000","last_change":"2023-05-17T14:53:52.511969+0000","last_active":"2023-05-17T14:53:52.886188+0000","last_peered":"2023-05-17T14:53:52.886188+0000","last_clean":"2023-05-17T14:53:52.886188+0000","last_became_active":"2023-05-17T14:53:52.511242+0000","last_became_peered":"2023-05-17T14:53:52.511242+0000","last_unstale":"2023-05-17T14:53:52.886188+0000","last_undegraded":"2023-05-17T14:53:52.886188+0000","last_fullsized":"2023-05-17T14:53:52.886188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909577+0000","last_change":"2023-05-17T14:53:52.907876+0000","last_active":"2023-05-17T14:53:52.909577+0000","last_peered":"2023-05-17T14:53:52.909577+0000","last_clean":"2023-05-17T14:53:52.909577+0000","last_became_active":"2023-05-17T14:53:52.907296+0000","last_became_peered":"2023-05-17T14:53:52.907296+0000","last_unstale":"2023-05-17T14:53:52.909577+0000","last_undegraded":"2023-05-17T14:53:52.909577+0000","last_fullsized":"2023-05-17T14:53:52.909577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905775+0000","last_change":"2023-05-17T14:53:52.511043+0000","last_active":"2023-05-17T14:53:52.905775+0000","last_peered":"2023-05-17T14:53:52.905775+0000","last_clean":"2023-05-17T14:53:52.905775+0000","last_became_active":"2023-05-17T14:53:52.510747+0000","last_became_peered":"2023-05-17T14:53:52.510747+0000","last_unstale":"2023-05-17T14:53:52.905775+0000","last_undegraded":"2023-05-17T14:53:52.905775+0000","last_fullsized":"2023-05-17T14:53:52.905775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909470+0000","last_change":"2023-05-17T14:53:52.906776+0000","last_active":"2023-05-17T14:53:52.909470+0000","last_peered":"2023-05-17T14:53:52.909470+0000","last_clean":"2023-05-17T14:53:52.909470+0000","last_became_active":"2023-05-17T14:53:52.906469+0000","last_became_peered":"2023-05-17T14:53:52.906469+0000","last_unstale":"2023-05-17T14:53:52.909470+0000","last_undegraded":"2023-05-17T14:53:52.909470+0000","last_fullsized":"2023-05-17T14:53:52.909470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888445+0000","last_change":"2023-05-17T14:53:52.499620+0000","last_active":"2023-05-17T14:53:52.888445+0000","last_peered":"2023-05-17T14:53:52.888445+0000","last_clean":"2023-05-17T14:53:52.888445+0000","last_became_active":"2023-05-17T14:53:52.498310+0000","last_became_peered":"2023-05-17T14:53:52.498310+0000","last_unstale":"2023-05-17T14:53:52.888445+0000","last_undegraded":"2023-05-17T14:53:52.888445+0000","last_fullsized":"2023-05-17T14:53:52.888445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908983+0000","last_change":"2023-05-17T14:53:52.903907+0000","last_active":"2023-05-17T14:53:52.908983+0000","last_peered":"2023-05-17T14:53:52.908983+0000","last_clean":"2023-05-17T14:53:52.908983+0000","last_became_active":"2023-05-17T14:53:52.903272+0000","last_became_peered":"2023-05-17T14:53:52.903272+0000","last_unstale":"2023-05-17T14:53:52.908983+0000","last_undegraded":"2023-05-17T14:53:52.908983+0000","last_fullsized":"2023-05-17T14:53:52.908983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896150+0000","last_change":"2023-05-17T14:53:52.496758+0000","last_active":"2023-05-17T14:53:52.896150+0000","last_peered":"2023-05-17T14:53:52.896150+0000","last_clean":"2023-05-17T14:53:52.896150+0000","last_became_active":"2023-05-17T14:53:52.496374+0000","last_became_peered":"2023-05-17T14:53:52.496374+0000","last_unstale":"2023-05-17T14:53:52.896150+0000","last_undegraded":"2023-05-17T14:53:52.896150+0000","last_fullsized":"2023-05-17T14:53:52.896150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899052+0000","last_change":"2023-05-17T14:53:52.893066+0000","last_active":"2023-05-17T14:53:52.899052+0000","last_peered":"2023-05-17T14:53:52.899052+0000","last_clean":"2023-05-17T14:53:52.899052+0000","last_became_active":"2023-05-17T14:53:52.892743+0000","last_became_peered":"2023-05-17T14:53:52.892743+0000","last_unstale":"2023-05-17T14:53:52.899052+0000","last_undegraded":"2023-05-17T14:53:52.899052+0000","last_fullsized":"2023-05-17T14:53:52.899052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879301+0000","last_change":"2023-05-17T14:53:52.515582+0000","last_active":"2023-05-17T14:53:52.879301+0000","last_peered":"2023-05-17T14:53:52.879301+0000","last_clean":"2023-05-17T14:53:52.879301+0000","last_became_active":"2023-05-17T14:53:52.514941+0000","last_became_peered":"2023-05-17T14:53:52.514941+0000","last_unstale":"2023-05-17T14:53:52.879301+0000","last_undegraded":"2023-05-17T14:53:52.879301+0000","last_fullsized":"2023-05-17T14:53:52.879301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887546+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T14:53:52.887546+0000","last_peered":"2023-05-17T14:53:52.887546+0000","last_clean":"2023-05-17T14:53:52.887546+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T14:53:52.887546+0000","last_undegraded":"2023-05-17T14:53:52.887546+0000","last_fullsized":"2023-05-17T14:53:52.887546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890966+0000","last_change":"2023-05-17T14:53:52.514000+0000","last_active":"2023-05-17T14:53:52.890966+0000","last_peered":"2023-05-17T14:53:52.890966+0000","last_clean":"2023-05-17T14:53:52.890966+0000","last_became_active":"2023-05-17T14:53:52.512785+0000","last_became_peered":"2023-05-17T14:53:52.512785+0000","last_unstale":"2023-05-17T14:53:52.890966+0000","last_undegraded":"2023-05-17T14:53:52.890966+0000","last_fullsized":"2023-05-17T14:53:52.890966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902502+0000","last_change":"2023-05-17T14:53:52.898360+0000","last_active":"2023-05-17T14:53:52.902502+0000","last_peered":"2023-05-17T14:53:52.902502+0000","last_clean":"2023-05-17T14:53:52.902502+0000","last_became_active":"2023-05-17T14:53:52.898085+0000","last_became_peered":"2023-05-17T14:53:52.898085+0000","last_unstale":"2023-05-17T14:53:52.902502+0000","last_undegraded":"2023-05-17T14:53:52.902502+0000","last_fullsized":"2023-05-17T14:53:52.902502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886393+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T14:53:52.886393+0000","last_peered":"2023-05-17T14:53:52.886393+0000","last_clean":"2023-05-17T14:53:52.886393+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T14:53:52.886393+0000","last_undegraded":"2023-05-17T14:53:52.886393+0000","last_fullsized":"2023-05-17T14:53:52.886393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894570+0000","last_change":"2023-05-17T14:53:52.504726+0000","last_active":"2023-05-17T14:53:52.894570+0000","last_peered":"2023-05-17T14:53:52.894570+0000","last_clean":"2023-05-17T14:53:52.894570+0000","last_became_active":"2023-05-17T14:53:52.504248+0000","last_became_peered":"2023-05-17T14:53:52.504248+0000","last_unstale":"2023-05-17T14:53:52.894570+0000","last_undegraded":"2023-05-17T14:53:52.894570+0000","last_fullsized":"2023-05-17T14:53:52.894570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902594+0000","last_change":"2023-05-17T14:53:52.894491+0000","last_active":"2023-05-17T14:53:52.902594+0000","last_peered":"2023-05-17T14:53:52.902594+0000","last_clean":"2023-05-17T14:53:52.902594+0000","last_became_active":"2023-05-17T14:53:52.894207+0000","last_became_peered":"2023-05-17T14:53:52.894207+0000","last_unstale":"2023-05-17T14:53:52.902594+0000","last_undegraded":"2023-05-17T14:53:52.902594+0000","last_fullsized":"2023-05-17T14:53:52.902594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905214+0000","last_change":"2023-05-17T14:53:52.900499+0000","last_active":"2023-05-17T14:53:52.905214+0000","last_peered":"2023-05-17T14:53:52.905214+0000","last_clean":"2023-05-17T14:53:52.905214+0000","last_became_active":"2023-05-17T14:53:52.900219+0000","last_became_peered":"2023-05-17T14:53:52.900219+0000","last_unstale":"2023-05-17T14:53:52.905214+0000","last_undegraded":"2023-05-17T14:53:52.905214+0000","last_fullsized":"2023-05-17T14:53:52.905214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885427+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T14:53:52.885427+0000","last_peered":"2023-05-17T14:53:52.885427+0000","last_clean":"2023-05-17T14:53:52.885427+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T14:53:52.885427+0000","last_undegraded":"2023-05-17T14:53:52.885427+0000","last_fullsized":"2023-05-17T14:53:52.885427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886784+0000","last_change":"2023-05-17T14:53:52.495004+0000","last_active":"2023-05-17T14:53:52.886784+0000","last_peered":"2023-05-17T14:53:52.886784+0000","last_clean":"2023-05-17T14:53:52.886784+0000","last_became_active":"2023-05-17T14:53:52.494690+0000","last_became_peered":"2023-05-17T14:53:52.494690+0000","last_unstale":"2023-05-17T14:53:52.886784+0000","last_undegraded":"2023-05-17T14:53:52.886784+0000","last_fullsized":"2023-05-17T14:53:52.886784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904891+0000","last_change":"2023-05-17T14:53:52.901552+0000","last_active":"2023-05-17T14:53:52.904891+0000","last_peered":"2023-05-17T14:53:52.904891+0000","last_clean":"2023-05-17T14:53:52.904891+0000","last_became_active":"2023-05-17T14:53:52.901241+0000","last_became_peered":"2023-05-17T14:53:52.901241+0000","last_unstale":"2023-05-17T14:53:52.904891+0000","last_undegraded":"2023-05-17T14:53:52.904891+0000","last_fullsized":"2023-05-17T14:53:52.904891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890070+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T14:53:52.890070+0000","last_peered":"2023-05-17T14:53:52.890070+0000","last_clean":"2023-05-17T14:53:52.890070+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T14:53:52.890070+0000","last_undegraded":"2023-05-17T14:53:52.890070+0000","last_fullsized":"2023-05-17T14:53:52.890070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882188+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T14:53:52.882188+0000","last_peered":"2023-05-17T14:53:52.882188+0000","last_clean":"2023-05-17T14:53:52.882188+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T14:53:52.882188+0000","last_undegraded":"2023-05-17T14:53:52.882188+0000","last_fullsized":"2023-05-17T14:53:52.882188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879145+0000","last_change":"2023-05-17T14:53:52.509749+0000","last_active":"2023-05-17T14:53:52.879145+0000","last_peered":"2023-05-17T14:53:52.879145+0000","last_clean":"2023-05-17T14:53:52.879145+0000","last_became_active":"2023-05-17T14:53:52.509447+0000","last_became_peered":"2023-05-17T14:53:52.509447+0000","last_unstale":"2023-05-17T14:53:52.879145+0000","last_undegraded":"2023-05-17T14:53:52.879145+0000","last_fullsized":"2023-05-17T14:53:52.879145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905144+0000","last_change":"2023-05-17T14:53:52.897391+0000","last_active":"2023-05-17T14:53:52.905144+0000","last_peered":"2023-05-17T14:53:52.905144+0000","last_clean":"2023-05-17T14:53:52.905144+0000","last_became_active":"2023-05-17T14:53:52.897101+0000","last_became_peered":"2023-05-17T14:53:52.897101+0000","last_unstale":"2023-05-17T14:53:52.905144+0000","last_undegraded":"2023-05-17T14:53:52.905144+0000","last_fullsized":"2023-05-17T14:53:52.905144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882503+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T14:53:52.882503+0000","last_peered":"2023-05-17T14:53:52.882503+0000","last_clean":"2023-05-17T14:53:52.882503+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T14:53:52.882503+0000","last_undegraded":"2023-05-17T14:53:52.882503+0000","last_fullsized":"2023-05-17T14:53:52.882503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886662+0000","last_change":"2023-05-17T14:53:52.509023+0000","last_active":"2023-05-17T14:53:52.886662+0000","last_peered":"2023-05-17T14:53:52.886662+0000","last_clean":"2023-05-17T14:53:52.886662+0000","last_became_active":"2023-05-17T14:53:52.508648+0000","last_became_peered":"2023-05-17T14:53:52.508648+0000","last_unstale":"2023-05-17T14:53:52.886662+0000","last_undegraded":"2023-05-17T14:53:52.886662+0000","last_fullsized":"2023-05-17T14:53:52.886662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883453+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T14:53:52.883453+0000","last_peered":"2023-05-17T14:53:52.883453+0000","last_clean":"2023-05-17T14:53:52.883453+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T14:53:52.883453+0000","last_undegraded":"2023-05-17T14:53:52.883453+0000","last_fullsized":"2023-05-17T14:53:52.883453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887636+0000","last_change":"2023-05-17T14:53:52.496859+0000","last_active":"2023-05-17T14:53:52.887636+0000","last_peered":"2023-05-17T14:53:52.887636+0000","last_clean":"2023-05-17T14:53:52.887636+0000","last_became_active":"2023-05-17T14:53:52.496451+0000","last_became_peered":"2023-05-17T14:53:52.496451+0000","last_unstale":"2023-05-17T14:53:52.887636+0000","last_undegraded":"2023-05-17T14:53:52.887636+0000","last_fullsized":"2023-05-17T14:53:52.887636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905245+0000","last_change":"2023-05-17T14:53:52.901622+0000","last_active":"2023-05-17T14:53:52.905245+0000","last_peered":"2023-05-17T14:53:52.905245+0000","last_clean":"2023-05-17T14:53:52.905245+0000","last_became_active":"2023-05-17T14:53:52.901357+0000","last_became_peered":"2023-05-17T14:53:52.901357+0000","last_unstale":"2023-05-17T14:53:52.905245+0000","last_undegraded":"2023-05-17T14:53:52.905245+0000","last_fullsized":"2023-05-17T14:53:52.905245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902729+0000","last_change":"2023-05-17T14:53:52.512750+0000","last_active":"2023-05-17T14:53:52.902729+0000","last_peered":"2023-05-17T14:53:52.902729+0000","last_clean":"2023-05-17T14:53:52.902729+0000","last_became_active":"2023-05-17T14:53:52.512415+0000","last_became_peered":"2023-05-17T14:53:52.512415+0000","last_unstale":"2023-05-17T14:53:52.902729+0000","last_undegraded":"2023-05-17T14:53:52.902729+0000","last_fullsized":"2023-05-17T14:53:52.902729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887773+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T14:53:52.887773+0000","last_peered":"2023-05-17T14:53:52.887773+0000","last_clean":"2023-05-17T14:53:52.887773+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T14:53:52.887773+0000","last_undegraded":"2023-05-17T14:53:52.887773+0000","last_fullsized":"2023-05-17T14:53:52.887773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906281+0000","last_change":"2023-05-17T14:53:52.899029+0000","last_active":"2023-05-17T14:53:52.906281+0000","last_peered":"2023-05-17T14:53:52.906281+0000","last_clean":"2023-05-17T14:53:52.906281+0000","last_became_active":"2023-05-17T14:53:52.898737+0000","last_became_peered":"2023-05-17T14:53:52.898737+0000","last_unstale":"2023-05-17T14:53:52.906281+0000","last_undegraded":"2023-05-17T14:53:52.906281+0000","last_fullsized":"2023-05-17T14:53:52.906281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894067+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T14:53:52.894067+0000","last_peered":"2023-05-17T14:53:52.894067+0000","last_clean":"2023-05-17T14:53:52.894067+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T14:53:52.894067+0000","last_undegraded":"2023-05-17T14:53:52.894067+0000","last_fullsized":"2023-05-17T14:53:52.894067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890359+0000","last_change":"2023-05-17T14:53:52.510050+0000","last_active":"2023-05-17T14:53:52.890359+0000","last_peered":"2023-05-17T14:53:52.890359+0000","last_clean":"2023-05-17T14:53:52.890359+0000","last_became_active":"2023-05-17T14:53:52.509746+0000","last_became_peered":"2023-05-17T14:53:52.509746+0000","last_unstale":"2023-05-17T14:53:52.890359+0000","last_undegraded":"2023-05-17T14:53:52.890359+0000","last_fullsized":"2023-05-17T14:53:52.890359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907584+0000","last_change":"2023-05-17T14:53:52.902447+0000","last_active":"2023-05-17T14:53:52.907584+0000","last_peered":"2023-05-17T14:53:52.907584+0000","last_clean":"2023-05-17T14:53:52.907584+0000","last_became_active":"2023-05-17T14:53:52.902177+0000","last_became_peered":"2023-05-17T14:53:52.902177+0000","last_unstale":"2023-05-17T14:53:52.907584+0000","last_undegraded":"2023-05-17T14:53:52.907584+0000","last_fullsized":"2023-05-17T14:53:52.907584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906251+0000","last_change":"2023-05-17T14:53:52.900925+0000","last_active":"2023-05-17T14:53:52.906251+0000","last_peered":"2023-05-17T14:53:52.906251+0000","last_clean":"2023-05-17T14:53:52.906251+0000","last_became_active":"2023-05-17T14:53:52.900643+0000","last_became_peered":"2023-05-17T14:53:52.900643+0000","last_unstale":"2023-05-17T14:53:52.906251+0000","last_undegraded":"2023-05-17T14:53:52.906251+0000","last_fullsized":"2023-05-17T14:53:52.906251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891905+0000","last_change":"2023-05-17T14:53:52.509026+0000","last_active":"2023-05-17T14:53:52.891905+0000","last_peered":"2023-05-17T14:53:52.891905+0000","last_clean":"2023-05-17T14:53:52.891905+0000","last_became_active":"2023-05-17T14:53:52.508652+0000","last_became_peered":"2023-05-17T14:53:52.508652+0000","last_unstale":"2023-05-17T14:53:52.891905+0000","last_undegraded":"2023-05-17T14:53:52.891905+0000","last_fullsized":"2023-05-17T14:53:52.891905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907099+0000","last_change":"2023-05-17T14:53:52.902271+0000","last_active":"2023-05-17T14:53:52.907099+0000","last_peered":"2023-05-17T14:53:52.907099+0000","last_clean":"2023-05-17T14:53:52.907099+0000","last_became_active":"2023-05-17T14:53:52.901952+0000","last_became_peered":"2023-05-17T14:53:52.901952+0000","last_unstale":"2023-05-17T14:53:52.907099+0000","last_undegraded":"2023-05-17T14:53:52.907099+0000","last_fullsized":"2023-05-17T14:53:52.907099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886300+0000","last_change":"2023-05-17T14:53:52.497235+0000","last_active":"2023-05-17T14:53:52.886300+0000","last_peered":"2023-05-17T14:53:52.886300+0000","last_clean":"2023-05-17T14:53:52.886300+0000","last_became_active":"2023-05-17T14:53:52.496955+0000","last_became_peered":"2023-05-17T14:53:52.496955+0000","last_unstale":"2023-05-17T14:53:52.886300+0000","last_undegraded":"2023-05-17T14:53:52.886300+0000","last_fullsized":"2023-05-17T14:53:52.886300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909526+0000","last_change":"2023-05-17T14:53:52.907098+0000","last_active":"2023-05-17T14:53:52.909526+0000","last_peered":"2023-05-17T14:53:52.909526+0000","last_clean":"2023-05-17T14:53:52.909526+0000","last_became_active":"2023-05-17T14:53:52.906769+0000","last_became_peered":"2023-05-17T14:53:52.906769+0000","last_unstale":"2023-05-17T14:53:52.909526+0000","last_undegraded":"2023-05-17T14:53:52.909526+0000","last_fullsized":"2023-05-17T14:53:52.909526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900754+0000","last_change":"2023-05-17T14:53:52.498922+0000","last_active":"2023-05-17T14:53:52.900754+0000","last_peered":"2023-05-17T14:53:52.900754+0000","last_clean":"2023-05-17T14:53:52.900754+0000","last_became_active":"2023-05-17T14:53:52.498588+0000","last_became_peered":"2023-05-17T14:53:52.498588+0000","last_unstale":"2023-05-17T14:53:52.900754+0000","last_undegraded":"2023-05-17T14:53:52.900754+0000","last_fullsized":"2023-05-17T14:53:52.900754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897438+0000","last_change":"2023-05-17T14:53:52.894285+0000","last_active":"2023-05-17T14:53:52.897438+0000","last_peered":"2023-05-17T14:53:52.897438+0000","last_clean":"2023-05-17T14:53:52.897438+0000","last_became_active":"2023-05-17T14:53:52.894001+0000","last_became_peered":"2023-05-17T14:53:52.894001+0000","last_unstale":"2023-05-17T14:53:52.897438+0000","last_undegraded":"2023-05-17T14:53:52.897438+0000","last_fullsized":"2023-05-17T14:53:52.897438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887643+0000","last_change":"2023-05-17T14:53:52.509439+0000","last_active":"2023-05-17T14:53:52.887643+0000","last_peered":"2023-05-17T14:53:52.887643+0000","last_clean":"2023-05-17T14:53:52.887643+0000","last_became_active":"2023-05-17T14:53:52.509043+0000","last_became_peered":"2023-05-17T14:53:52.509043+0000","last_unstale":"2023-05-17T14:53:52.887643+0000","last_undegraded":"2023-05-17T14:53:52.887643+0000","last_fullsized":"2023-05-17T14:53:52.887643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909041+0000","last_change":"2023-05-17T14:53:52.904168+0000","last_active":"2023-05-17T14:53:52.909041+0000","last_peered":"2023-05-17T14:53:52.909041+0000","last_clean":"2023-05-17T14:53:52.909041+0000","last_became_active":"2023-05-17T14:53:52.903277+0000","last_became_peered":"2023-05-17T14:53:52.903277+0000","last_unstale":"2023-05-17T14:53:52.909041+0000","last_undegraded":"2023-05-17T14:53:52.909041+0000","last_fullsized":"2023-05-17T14:53:52.909041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900967+0000","last_change":"2023-05-17T14:53:52.501619+0000","last_active":"2023-05-17T14:53:52.900967+0000","last_peered":"2023-05-17T14:53:52.900967+0000","last_clean":"2023-05-17T14:53:52.900967+0000","last_became_active":"2023-05-17T14:53:52.501429+0000","last_became_peered":"2023-05-17T14:53:52.501429+0000","last_unstale":"2023-05-17T14:53:52.900967+0000","last_undegraded":"2023-05-17T14:53:52.900967+0000","last_fullsized":"2023-05-17T14:53:52.900967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905234+0000","last_change":"2023-05-17T14:53:52.901698+0000","last_active":"2023-05-17T14:53:52.905234+0000","last_peered":"2023-05-17T14:53:52.905234+0000","last_clean":"2023-05-17T14:53:52.905234+0000","last_became_active":"2023-05-17T14:53:52.901287+0000","last_became_peered":"2023-05-17T14:53:52.901287+0000","last_unstale":"2023-05-17T14:53:52.905234+0000","last_undegraded":"2023-05-17T14:53:52.905234+0000","last_fullsized":"2023-05-17T14:53:52.905234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889720+0000","last_change":"2023-05-17T14:53:52.509971+0000","last_active":"2023-05-17T14:53:52.889720+0000","last_peered":"2023-05-17T14:53:52.889720+0000","last_clean":"2023-05-17T14:53:52.889720+0000","last_became_active":"2023-05-17T14:53:52.509661+0000","last_became_peered":"2023-05-17T14:53:52.509661+0000","last_unstale":"2023-05-17T14:53:52.889720+0000","last_undegraded":"2023-05-17T14:53:52.889720+0000","last_fullsized":"2023-05-17T14:53:52.889720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902342+0000","last_change":"2023-05-17T14:53:52.894638+0000","last_active":"2023-05-17T14:53:52.902342+0000","last_peered":"2023-05-17T14:53:52.902342+0000","last_clean":"2023-05-17T14:53:52.902342+0000","last_became_active":"2023-05-17T14:53:52.894342+0000","last_became_peered":"2023-05-17T14:53:52.894342+0000","last_unstale":"2023-05-17T14:53:52.902342+0000","last_undegraded":"2023-05-17T14:53:52.902342+0000","last_fullsized":"2023-05-17T14:53:52.902342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885492+0000","last_change":"2023-05-17T14:53:52.505043+0000","last_active":"2023-05-17T14:53:52.885492+0000","last_peered":"2023-05-17T14:53:52.885492+0000","last_clean":"2023-05-17T14:53:52.885492+0000","last_became_active":"2023-05-17T14:53:52.504736+0000","last_became_peered":"2023-05-17T14:53:52.504736+0000","last_unstale":"2023-05-17T14:53:52.885492+0000","last_undegraded":"2023-05-17T14:53:52.885492+0000","last_fullsized":"2023-05-17T14:53:52.885492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905425+0000","last_change":"2023-05-17T14:53:52.897228+0000","last_active":"2023-05-17T14:53:52.905425+0000","last_peered":"2023-05-17T14:53:52.905425+0000","last_clean":"2023-05-17T14:53:52.905425+0000","last_became_active":"2023-05-17T14:53:52.896713+0000","last_became_peered":"2023-05-17T14:53:52.896713+0000","last_unstale":"2023-05-17T14:53:52.905425+0000","last_undegraded":"2023-05-17T14:53:52.905425+0000","last_fullsized":"2023-05-17T14:53:52.905425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886282+0000","last_change":"2023-05-17T14:53:52.511403+0000","last_active":"2023-05-17T14:53:52.886282+0000","last_peered":"2023-05-17T14:53:52.886282+0000","last_clean":"2023-05-17T14:53:52.886282+0000","last_became_active":"2023-05-17T14:53:52.510928+0000","last_became_peered":"2023-05-17T14:53:52.510928+0000","last_unstale":"2023-05-17T14:53:52.886282+0000","last_undegraded":"2023-05-17T14:53:52.886282+0000","last_fullsized":"2023-05-17T14:53:52.886282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899143+0000","last_change":"2023-05-17T14:53:52.893358+0000","last_active":"2023-05-17T14:53:52.899143+0000","last_peered":"2023-05-17T14:53:52.899143+0000","last_clean":"2023-05-17T14:53:52.899143+0000","last_became_active":"2023-05-17T14:53:52.893025+0000","last_became_peered":"2023-05-17T14:53:52.893025+0000","last_unstale":"2023-05-17T14:53:52.899143+0000","last_undegraded":"2023-05-17T14:53:52.899143+0000","last_fullsized":"2023-05-17T14:53:52.899143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891615+0000","last_change":"2023-05-17T14:53:52.512447+0000","last_active":"2023-05-17T14:53:52.891615+0000","last_peered":"2023-05-17T14:53:52.891615+0000","last_clean":"2023-05-17T14:53:52.891615+0000","last_became_active":"2023-05-17T14:53:52.511951+0000","last_became_peered":"2023-05-17T14:53:52.511951+0000","last_unstale":"2023-05-17T14:53:52.891615+0000","last_undegraded":"2023-05-17T14:53:52.891615+0000","last_fullsized":"2023-05-17T14:53:52.891615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906636+0000","last_change":"2023-05-17T14:53:52.899902+0000","last_active":"2023-05-17T14:53:52.906636+0000","last_peered":"2023-05-17T14:53:52.906636+0000","last_clean":"2023-05-17T14:53:52.906636+0000","last_became_active":"2023-05-17T14:53:52.899381+0000","last_became_peered":"2023-05-17T14:53:52.899381+0000","last_unstale":"2023-05-17T14:53:52.906636+0000","last_undegraded":"2023-05-17T14:53:52.906636+0000","last_fullsized":"2023-05-17T14:53:52.906636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879769+0000","last_change":"2023-05-17T14:53:52.515232+0000","last_active":"2023-05-17T14:53:52.879769+0000","last_peered":"2023-05-17T14:53:52.879769+0000","last_clean":"2023-05-17T14:53:52.879769+0000","last_became_active":"2023-05-17T14:53:52.514555+0000","last_became_peered":"2023-05-17T14:53:52.514555+0000","last_unstale":"2023-05-17T14:53:52.879769+0000","last_undegraded":"2023-05-17T14:53:52.879769+0000","last_fullsized":"2023-05-17T14:53:52.879769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906744+0000","last_change":"2023-05-17T14:53:52.903058+0000","last_active":"2023-05-17T14:53:52.906744+0000","last_peered":"2023-05-17T14:53:52.906744+0000","last_clean":"2023-05-17T14:53:52.906744+0000","last_became_active":"2023-05-17T14:53:52.902615+0000","last_became_peered":"2023-05-17T14:53:52.902615+0000","last_unstale":"2023-05-17T14:53:52.906744+0000","last_undegraded":"2023-05-17T14:53:52.906744+0000","last_fullsized":"2023-05-17T14:53:52.906744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887739+0000","last_change":"2023-05-17T14:53:52.513421+0000","last_active":"2023-05-17T14:53:52.887739+0000","last_peered":"2023-05-17T14:53:52.887739+0000","last_clean":"2023-05-17T14:53:52.887739+0000","last_became_active":"2023-05-17T14:53:52.513120+0000","last_became_peered":"2023-05-17T14:53:52.513120+0000","last_unstale":"2023-05-17T14:53:52.887739+0000","last_undegraded":"2023-05-17T14:53:52.887739+0000","last_fullsized":"2023-05-17T14:53:52.887739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906476+0000","last_change":"2023-05-17T14:53:52.899077+0000","last_active":"2023-05-17T14:53:52.906476+0000","last_peered":"2023-05-17T14:53:52.906476+0000","last_clean":"2023-05-17T14:53:52.906476+0000","last_became_active":"2023-05-17T14:53:52.898767+0000","last_became_peered":"2023-05-17T14:53:52.898767+0000","last_unstale":"2023-05-17T14:53:52.906476+0000","last_undegraded":"2023-05-17T14:53:52.906476+0000","last_fullsized":"2023-05-17T14:53:52.906476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T14:53:54.178241+0000","last_change":"2023-05-17T14:53:52.502548+0000","last_active":"2023-05-17T14:53:54.178241+0000","last_peered":"2023-05-17T14:53:54.178241+0000","last_clean":"2023-05-17T14:53:54.178241+0000","last_became_active":"2023-05-17T14:53:52.501702+0000","last_became_peered":"2023-05-17T14:53:52.501702+0000","last_unstale":"2023-05-17T14:53:54.178241+0000","last_undegraded":"2023-05-17T14:53:54.178241+0000","last_fullsized":"2023-05-17T14:53:54.178241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901668+0000","last_change":"2023-05-17T14:53:52.897118+0000","last_active":"2023-05-17T14:53:52.901668+0000","last_peered":"2023-05-17T14:53:52.901668+0000","last_clean":"2023-05-17T14:53:52.901668+0000","last_became_active":"2023-05-17T14:53:52.896806+0000","last_became_peered":"2023-05-17T14:53:52.896806+0000","last_unstale":"2023-05-17T14:53:52.901668+0000","last_undegraded":"2023-05-17T14:53:52.901668+0000","last_fullsized":"2023-05-17T14:53:52.901668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.880255+0000","last_change":"2023-05-17T14:53:52.507358+0000","last_active":"2023-05-17T14:53:52.880255+0000","last_peered":"2023-05-17T14:53:52.880255+0000","last_clean":"2023-05-17T14:53:52.880255+0000","last_became_active":"2023-05-17T14:53:52.507091+0000","last_became_peered":"2023-05-17T14:53:52.507091+0000","last_unstale":"2023-05-17T14:53:52.880255+0000","last_undegraded":"2023-05-17T14:53:52.880255+0000","last_fullsized":"2023-05-17T14:53:52.880255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910197+0000","last_change":"2023-05-17T14:53:52.908557+0000","last_active":"2023-05-17T14:53:52.910197+0000","last_peered":"2023-05-17T14:53:52.910197+0000","last_clean":"2023-05-17T14:53:52.910197+0000","last_became_active":"2023-05-17T14:53:52.908298+0000","last_became_peered":"2023-05-17T14:53:52.908298+0000","last_unstale":"2023-05-17T14:53:52.910197+0000","last_undegraded":"2023-05-17T14:53:52.910197+0000","last_fullsized":"2023-05-17T14:53:52.910197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885994+0000","last_change":"2023-05-17T14:53:52.512296+0000","last_active":"2023-05-17T14:53:52.885994+0000","last_peered":"2023-05-17T14:53:52.885994+0000","last_clean":"2023-05-17T14:53:52.885994+0000","last_became_active":"2023-05-17T14:53:52.512018+0000","last_became_peered":"2023-05-17T14:53:52.512018+0000","last_unstale":"2023-05-17T14:53:52.885994+0000","last_undegraded":"2023-05-17T14:53:52.885994+0000","last_fullsized":"2023-05-17T14:53:52.885994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909007+0000","last_change":"2023-05-17T14:53:52.904120+0000","last_active":"2023-05-17T14:53:52.909007+0000","last_peered":"2023-05-17T14:53:52.909007+0000","last_clean":"2023-05-17T14:53:52.909007+0000","last_became_active":"2023-05-17T14:53:52.903622+0000","last_became_peered":"2023-05-17T14:53:52.903622+0000","last_unstale":"2023-05-17T14:53:52.909007+0000","last_undegraded":"2023-05-17T14:53:52.909007+0000","last_fullsized":"2023-05-17T14:53:52.909007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879391+0000","last_change":"2023-05-17T14:53:52.514693+0000","last_active":"2023-05-17T14:53:52.879391+0000","last_peered":"2023-05-17T14:53:52.879391+0000","last_clean":"2023-05-17T14:53:52.879391+0000","last_became_active":"2023-05-17T14:53:52.514371+0000","last_became_peered":"2023-05-17T14:53:52.514371+0000","last_unstale":"2023-05-17T14:53:52.879391+0000","last_undegraded":"2023-05-17T14:53:52.879391+0000","last_fullsized":"2023-05-17T14:53:52.879391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907461+0000","last_change":"2023-05-17T14:53:52.905496+0000","last_active":"2023-05-17T14:53:52.907461+0000","last_peered":"2023-05-17T14:53:52.907461+0000","last_clean":"2023-05-17T14:53:52.907461+0000","last_became_active":"2023-05-17T14:53:52.902849+0000","last_became_peered":"2023-05-17T14:53:52.902849+0000","last_unstale":"2023-05-17T14:53:52.907461+0000","last_undegraded":"2023-05-17T14:53:52.907461+0000","last_fullsized":"2023-05-17T14:53:52.907461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886660+0000","last_change":"2023-05-17T14:53:52.507074+0000","last_active":"2023-05-17T14:53:52.886660+0000","last_peered":"2023-05-17T14:53:52.886660+0000","last_clean":"2023-05-17T14:53:52.886660+0000","last_became_active":"2023-05-17T14:53:52.506648+0000","last_became_peered":"2023-05-17T14:53:52.506648+0000","last_unstale":"2023-05-17T14:53:52.886660+0000","last_undegraded":"2023-05-17T14:53:52.886660+0000","last_fullsized":"2023-05-17T14:53:52.886660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909075+0000","last_change":"2023-05-17T14:53:52.905035+0000","last_active":"2023-05-17T14:53:52.909075+0000","last_peered":"2023-05-17T14:53:52.909075+0000","last_clean":"2023-05-17T14:53:52.909075+0000","last_became_active":"2023-05-17T14:53:52.903028+0000","last_became_peered":"2023-05-17T14:53:52.903028+0000","last_unstale":"2023-05-17T14:53:52.909075+0000","last_undegraded":"2023-05-17T14:53:52.909075+0000","last_fullsized":"2023-05-17T14:53:52.909075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896399+0000","last_change":"2023-05-17T14:53:52.510568+0000","last_active":"2023-05-17T14:53:52.896399+0000","last_peered":"2023-05-17T14:53:52.896399+0000","last_clean":"2023-05-17T14:53:52.896399+0000","last_became_active":"2023-05-17T14:53:52.510243+0000","last_became_peered":"2023-05-17T14:53:52.510243+0000","last_unstale":"2023-05-17T14:53:52.896399+0000","last_undegraded":"2023-05-17T14:53:52.896399+0000","last_fullsized":"2023-05-17T14:53:52.896399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900510+0000","last_change":"2023-05-17T14:53:52.899184+0000","last_active":"2023-05-17T14:53:52.900510+0000","last_peered":"2023-05-17T14:53:52.900510+0000","last_clean":"2023-05-17T14:53:52.900510+0000","last_became_active":"2023-05-17T14:53:52.898867+0000","last_became_peered":"2023-05-17T14:53:52.898867+0000","last_unstale":"2023-05-17T14:53:52.900510+0000","last_undegraded":"2023-05-17T14:53:52.900510+0000","last_fullsized":"2023-05-17T14:53:52.900510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889663+0000","last_change":"2023-05-17T14:53:52.499276+0000","last_active":"2023-05-17T14:53:52.889663+0000","last_peered":"2023-05-17T14:53:52.889663+0000","last_clean":"2023-05-17T14:53:52.889663+0000","last_became_active":"2023-05-17T14:53:52.498250+0000","last_became_peered":"2023-05-17T14:53:52.498250+0000","last_unstale":"2023-05-17T14:53:52.889663+0000","last_undegraded":"2023-05-17T14:53:52.889663+0000","last_fullsized":"2023-05-17T14:53:52.889663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905444+0000","last_change":"2023-05-17T14:53:52.903548+0000","last_active":"2023-05-17T14:53:52.905444+0000","last_peered":"2023-05-17T14:53:52.905444+0000","last_clean":"2023-05-17T14:53:52.905444+0000","last_became_active":"2023-05-17T14:53:52.903278+0000","last_became_peered":"2023-05-17T14:53:52.903278+0000","last_unstale":"2023-05-17T14:53:52.905444+0000","last_undegraded":"2023-05-17T14:53:52.905444+0000","last_fullsized":"2023-05-17T14:53:52.905444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896027+0000","last_change":"2023-05-17T14:53:52.504834+0000","last_active":"2023-05-17T14:53:52.896027+0000","last_peered":"2023-05-17T14:53:52.896027+0000","last_clean":"2023-05-17T14:53:52.896027+0000","last_became_active":"2023-05-17T14:53:52.504516+0000","last_became_peered":"2023-05-17T14:53:52.504516+0000","last_unstale":"2023-05-17T14:53:52.896027+0000","last_undegraded":"2023-05-17T14:53:52.896027+0000","last_fullsized":"2023-05-17T14:53:52.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906617+0000","last_change":"2023-05-17T14:53:52.899616+0000","last_active":"2023-05-17T14:53:52.906617+0000","last_peered":"2023-05-17T14:53:52.906617+0000","last_clean":"2023-05-17T14:53:52.906617+0000","last_became_active":"2023-05-17T14:53:52.899304+0000","last_became_peered":"2023-05-17T14:53:52.899304+0000","last_unstale":"2023-05-17T14:53:52.906617+0000","last_undegraded":"2023-05-17T14:53:52.906617+0000","last_fullsized":"2023-05-17T14:53:52.906617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883276+0000","last_change":"2023-05-17T14:53:52.498387+0000","last_active":"2023-05-17T14:53:52.883276+0000","last_peered":"2023-05-17T14:53:52.883276+0000","last_clean":"2023-05-17T14:53:52.883276+0000","last_became_active":"2023-05-17T14:53:52.498124+0000","last_became_peered":"2023-05-17T14:53:52.498124+0000","last_unstale":"2023-05-17T14:53:52.883276+0000","last_undegraded":"2023-05-17T14:53:52.883276+0000","last_fullsized":"2023-05-17T14:53:52.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907377+0000","last_change":"2023-05-17T14:53:52.900446+0000","last_active":"2023-05-17T14:53:52.907377+0000","last_peered":"2023-05-17T14:53:52.907377+0000","last_clean":"2023-05-17T14:53:52.907377+0000","last_became_active":"2023-05-17T14:53:52.899252+0000","last_became_peered":"2023-05-17T14:53:52.899252+0000","last_unstale":"2023-05-17T14:53:52.907377+0000","last_undegraded":"2023-05-17T14:53:52.907377+0000","last_fullsized":"2023-05-17T14:53:52.907377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886699+0000","last_change":"2023-05-17T14:53:52.507558+0000","last_active":"2023-05-17T14:53:52.886699+0000","last_peered":"2023-05-17T14:53:52.886699+0000","last_clean":"2023-05-17T14:53:52.886699+0000","last_became_active":"2023-05-17T14:53:52.507272+0000","last_became_peered":"2023-05-17T14:53:52.507272+0000","last_unstale":"2023-05-17T14:53:52.886699+0000","last_undegraded":"2023-05-17T14:53:52.886699+0000","last_fullsized":"2023-05-17T14:53:52.886699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910217+0000","last_change":"2023-05-17T14:53:52.908565+0000","last_active":"2023-05-17T14:53:52.910217+0000","last_peered":"2023-05-17T14:53:52.910217+0000","last_clean":"2023-05-17T14:53:52.910217+0000","last_became_active":"2023-05-17T14:53:52.908327+0000","last_became_peered":"2023-05-17T14:53:52.908327+0000","last_unstale":"2023-05-17T14:53:52.910217+0000","last_undegraded":"2023-05-17T14:53:52.910217+0000","last_fullsized":"2023-05-17T14:53:52.910217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905977+0000","last_change":"2023-05-17T14:53:52.507620+0000","last_active":"2023-05-17T14:53:52.905977+0000","last_peered":"2023-05-17T14:53:52.905977+0000","last_clean":"2023-05-17T14:53:52.905977+0000","last_became_active":"2023-05-17T14:53:52.505456+0000","last_became_peered":"2023-05-17T14:53:52.505456+0000","last_unstale":"2023-05-17T14:53:52.905977+0000","last_undegraded":"2023-05-17T14:53:52.905977+0000","last_fullsized":"2023-05-17T14:53:52.905977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905309+0000","last_change":"2023-05-17T14:53:52.898134+0000","last_active":"2023-05-17T14:53:52.905309+0000","last_peered":"2023-05-17T14:53:52.905309+0000","last_clean":"2023-05-17T14:53:52.905309+0000","last_became_active":"2023-05-17T14:53:52.897754+0000","last_became_peered":"2023-05-17T14:53:52.897754+0000","last_unstale":"2023-05-17T14:53:52.905309+0000","last_undegraded":"2023-05-17T14:53:52.905309+0000","last_fullsized":"2023-05-17T14:53:52.905309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887367+0000","last_change":"2023-05-17T14:53:52.498029+0000","last_active":"2023-05-17T14:53:52.887367+0000","last_peered":"2023-05-17T14:53:52.887367+0000","last_clean":"2023-05-17T14:53:52.887367+0000","last_became_active":"2023-05-17T14:53:52.497667+0000","last_became_peered":"2023-05-17T14:53:52.497667+0000","last_unstale":"2023-05-17T14:53:52.887367+0000","last_undegraded":"2023-05-17T14:53:52.887367+0000","last_fullsized":"2023-05-17T14:53:52.887367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908878+0000","last_change":"2023-05-17T14:53:52.903794+0000","last_active":"2023-05-17T14:53:52.908878+0000","last_peered":"2023-05-17T14:53:52.908878+0000","last_clean":"2023-05-17T14:53:52.908878+0000","last_became_active":"2023-05-17T14:53:52.903482+0000","last_became_peered":"2023-05-17T14:53:52.903482+0000","last_unstale":"2023-05-17T14:53:52.908878+0000","last_undegraded":"2023-05-17T14:53:52.908878+0000","last_fullsized":"2023-05-17T14:53:52.908878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885250+0000","last_change":"2023-05-17T14:53:52.501031+0000","last_active":"2023-05-17T14:53:52.885250+0000","last_peered":"2023-05-17T14:53:52.885250+0000","last_clean":"2023-05-17T14:53:52.885250+0000","last_became_active":"2023-05-17T14:53:52.500624+0000","last_became_peered":"2023-05-17T14:53:52.500624+0000","last_unstale":"2023-05-17T14:53:52.885250+0000","last_undegraded":"2023-05-17T14:53:52.885250+0000","last_fullsized":"2023-05-17T14:53:52.885250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907527+0000","last_change":"2023-05-17T14:53:52.904355+0000","last_active":"2023-05-17T14:53:52.907527+0000","last_peered":"2023-05-17T14:53:52.907527+0000","last_clean":"2023-05-17T14:53:52.907527+0000","last_became_active":"2023-05-17T14:53:52.901353+0000","last_became_peered":"2023-05-17T14:53:52.901353+0000","last_unstale":"2023-05-17T14:53:52.907527+0000","last_undegraded":"2023-05-17T14:53:52.907527+0000","last_fullsized":"2023-05-17T14:53:52.907527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900169+0000","last_change":"2023-05-17T14:53:52.509583+0000","last_active":"2023-05-17T14:53:52.900169+0000","last_peered":"2023-05-17T14:53:52.900169+0000","last_clean":"2023-05-17T14:53:52.900169+0000","last_became_active":"2023-05-17T14:53:52.509033+0000","last_became_peered":"2023-05-17T14:53:52.509033+0000","last_unstale":"2023-05-17T14:53:52.900169+0000","last_undegraded":"2023-05-17T14:53:52.900169+0000","last_fullsized":"2023-05-17T14:53:52.900169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896099+0000","last_change":"2023-05-17T14:53:52.894065+0000","last_active":"2023-05-17T14:53:52.896099+0000","last_peered":"2023-05-17T14:53:52.896099+0000","last_clean":"2023-05-17T14:53:52.896099+0000","last_became_active":"2023-05-17T14:53:52.893755+0000","last_became_peered":"2023-05-17T14:53:52.893755+0000","last_unstale":"2023-05-17T14:53:52.896099+0000","last_undegraded":"2023-05-17T14:53:52.896099+0000","last_fullsized":"2023-05-17T14:53:52.896099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909266+0000","last_change":"2023-05-17T14:53:52.507353+0000","last_active":"2023-05-17T14:53:52.909266+0000","last_peered":"2023-05-17T14:53:52.909266+0000","last_clean":"2023-05-17T14:53:52.909266+0000","last_became_active":"2023-05-17T14:53:52.506014+0000","last_became_peered":"2023-05-17T14:53:52.506014+0000","last_unstale":"2023-05-17T14:53:52.909266+0000","last_undegraded":"2023-05-17T14:53:52.909266+0000","last_fullsized":"2023-05-17T14:53:52.909266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905670+0000","last_change":"2023-05-17T14:53:52.897660+0000","last_active":"2023-05-17T14:53:52.905670+0000","last_peered":"2023-05-17T14:53:52.905670+0000","last_clean":"2023-05-17T14:53:52.905670+0000","last_became_active":"2023-05-17T14:53:52.897344+0000","last_became_peered":"2023-05-17T14:53:52.897344+0000","last_unstale":"2023-05-17T14:53:52.905670+0000","last_undegraded":"2023-05-17T14:53:52.905670+0000","last_fullsized":"2023-05-17T14:53:52.905670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893946+0000","last_change":"2023-05-17T14:53:52.504680+0000","last_active":"2023-05-17T14:53:52.893946+0000","last_peered":"2023-05-17T14:53:52.893946+0000","last_clean":"2023-05-17T14:53:52.893946+0000","last_became_active":"2023-05-17T14:53:52.504385+0000","last_became_peered":"2023-05-17T14:53:52.504385+0000","last_unstale":"2023-05-17T14:53:52.893946+0000","last_undegraded":"2023-05-17T14:53:52.893946+0000","last_fullsized":"2023-05-17T14:53:52.893946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906580+0000","last_change":"2023-05-17T14:53:52.899592+0000","last_active":"2023-05-17T14:53:52.906580+0000","last_peered":"2023-05-17T14:53:52.906580+0000","last_clean":"2023-05-17T14:53:52.906580+0000","last_became_active":"2023-05-17T14:53:52.899272+0000","last_became_peered":"2023-05-17T14:53:52.899272+0000","last_unstale":"2023-05-17T14:53:52.906580+0000","last_undegraded":"2023-05-17T14:53:52.906580+0000","last_fullsized":"2023-05-17T14:53:52.906580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887745+0000","last_change":"2023-05-17T14:53:52.502007+0000","last_active":"2023-05-17T14:53:52.887745+0000","last_peered":"2023-05-17T14:53:52.887745+0000","last_clean":"2023-05-17T14:53:52.887745+0000","last_became_active":"2023-05-17T14:53:52.501336+0000","last_became_peered":"2023-05-17T14:53:52.501336+0000","last_unstale":"2023-05-17T14:53:52.887745+0000","last_undegraded":"2023-05-17T14:53:52.887745+0000","last_fullsized":"2023-05-17T14:53:52.887745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909028+0000","last_change":"2023-05-17T14:53:52.904025+0000","last_active":"2023-05-17T14:53:52.909028+0000","last_peered":"2023-05-17T14:53:52.909028+0000","last_clean":"2023-05-17T14:53:52.909028+0000","last_became_active":"2023-05-17T14:53:52.903652+0000","last_became_peered":"2023-05-17T14:53:52.903652+0000","last_unstale":"2023-05-17T14:53:52.909028+0000","last_undegraded":"2023-05-17T14:53:52.909028+0000","last_fullsized":"2023-05-17T14:53:52.909028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883073+0000","last_change":"2023-05-17T14:53:52.502927+0000","last_active":"2023-05-17T14:53:52.883073+0000","last_peered":"2023-05-17T14:53:52.883073+0000","last_clean":"2023-05-17T14:53:52.883073+0000","last_became_active":"2023-05-17T14:53:52.502633+0000","last_became_peered":"2023-05-17T14:53:52.502633+0000","last_unstale":"2023-05-17T14:53:52.883073+0000","last_undegraded":"2023-05-17T14:53:52.883073+0000","last_fullsized":"2023-05-17T14:53:52.883073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895093+0000","last_change":"2023-05-17T14:53:52.892437+0000","last_active":"2023-05-17T14:53:52.895093+0000","last_peered":"2023-05-17T14:53:52.895093+0000","last_clean":"2023-05-17T14:53:52.895093+0000","last_became_active":"2023-05-17T14:53:52.892121+0000","last_became_peered":"2023-05-17T14:53:52.892121+0000","last_unstale":"2023-05-17T14:53:52.895093+0000","last_undegraded":"2023-05-17T14:53:52.895093+0000","last_fullsized":"2023-05-17T14:53:52.895093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879753+0000","last_change":"2023-05-17T14:53:52.511006+0000","last_active":"2023-05-17T14:53:52.879753+0000","last_peered":"2023-05-17T14:53:52.879753+0000","last_clean":"2023-05-17T14:53:52.879753+0000","last_became_active":"2023-05-17T14:53:52.510651+0000","last_became_peered":"2023-05-17T14:53:52.510651+0000","last_unstale":"2023-05-17T14:53:52.879753+0000","last_undegraded":"2023-05-17T14:53:52.879753+0000","last_fullsized":"2023-05-17T14:53:52.879753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905331+0000","last_change":"2023-05-17T14:53:52.898513+0000","last_active":"2023-05-17T14:53:52.905331+0000","last_peered":"2023-05-17T14:53:52.905331+0000","last_clean":"2023-05-17T14:53:52.905331+0000","last_became_active":"2023-05-17T14:53:52.898159+0000","last_became_peered":"2023-05-17T14:53:52.898159+0000","last_unstale":"2023-05-17T14:53:52.905331+0000","last_undegraded":"2023-05-17T14:53:52.905331+0000","last_fullsized":"2023-05-17T14:53:52.905331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882773+0000","last_change":"2023-05-17T14:53:52.512519+0000","last_active":"2023-05-17T14:53:52.882773+0000","last_peered":"2023-05-17T14:53:52.882773+0000","last_clean":"2023-05-17T14:53:52.882773+0000","last_became_active":"2023-05-17T14:53:52.512220+0000","last_became_peered":"2023-05-17T14:53:52.512220+0000","last_unstale":"2023-05-17T14:53:52.882773+0000","last_undegraded":"2023-05-17T14:53:52.882773+0000","last_fullsized":"2023-05-17T14:53:52.882773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909559+0000","last_change":"2023-05-17T14:53:52.907268+0000","last_active":"2023-05-17T14:53:52.909559+0000","last_peered":"2023-05-17T14:53:52.909559+0000","last_clean":"2023-05-17T14:53:52.909559+0000","last_became_active":"2023-05-17T14:53:52.906591+0000","last_became_peered":"2023-05-17T14:53:52.906591+0000","last_unstale":"2023-05-17T14:53:52.909559+0000","last_undegraded":"2023-05-17T14:53:52.909559+0000","last_fullsized":"2023-05-17T14:53:52.909559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897695+0000","last_change":"2023-05-17T14:53:52.506059+0000","last_active":"2023-05-17T14:53:52.897695+0000","last_peered":"2023-05-17T14:53:52.897695+0000","last_clean":"2023-05-17T14:53:52.897695+0000","last_became_active":"2023-05-17T14:53:52.505710+0000","last_became_peered":"2023-05-17T14:53:52.505710+0000","last_unstale":"2023-05-17T14:53:52.897695+0000","last_undegraded":"2023-05-17T14:53:52.897695+0000","last_fullsized":"2023-05-17T14:53:52.897695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901344+0000","last_change":"2023-05-17T14:53:52.897282+0000","last_active":"2023-05-17T14:53:52.901344+0000","last_peered":"2023-05-17T14:53:52.901344+0000","last_clean":"2023-05-17T14:53:52.901344+0000","last_became_active":"2023-05-17T14:53:52.896992+0000","last_became_peered":"2023-05-17T14:53:52.896992+0000","last_unstale":"2023-05-17T14:53:52.901344+0000","last_undegraded":"2023-05-17T14:53:52.901344+0000","last_fullsized":"2023-05-17T14:53:52.901344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895784+0000","last_change":"2023-05-17T14:53:52.511809+0000","last_active":"2023-05-17T14:53:52.895784+0000","last_peered":"2023-05-17T14:53:52.895784+0000","last_clean":"2023-05-17T14:53:52.895784+0000","last_became_active":"2023-05-17T14:53:52.511486+0000","last_became_peered":"2023-05-17T14:53:52.511486+0000","last_unstale":"2023-05-17T14:53:52.895784+0000","last_undegraded":"2023-05-17T14:53:52.895784+0000","last_fullsized":"2023-05-17T14:53:52.895784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910222+0000","last_change":"2023-05-17T14:53:52.909184+0000","last_active":"2023-05-17T14:53:52.910222+0000","last_peered":"2023-05-17T14:53:52.910222+0000","last_clean":"2023-05-17T14:53:52.910222+0000","last_became_active":"2023-05-17T14:53:52.908851+0000","last_became_peered":"2023-05-17T14:53:52.908851+0000","last_unstale":"2023-05-17T14:53:52.910222+0000","last_undegraded":"2023-05-17T14:53:52.910222+0000","last_fullsized":"2023-05-17T14:53:52.910222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895604+0000","last_change":"2023-05-17T14:53:52.512162+0000","last_active":"2023-05-17T14:53:52.895604+0000","last_peered":"2023-05-17T14:53:52.895604+0000","last_clean":"2023-05-17T14:53:52.895604+0000","last_became_active":"2023-05-17T14:53:52.511653+0000","last_became_peered":"2023-05-17T14:53:52.511653+0000","last_unstale":"2023-05-17T14:53:52.895604+0000","last_undegraded":"2023-05-17T14:53:52.895604+0000","last_fullsized":"2023-05-17T14:53:52.895604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906723+0000","last_change":"2023-05-17T14:53:52.900703+0000","last_active":"2023-05-17T14:53:52.906723+0000","last_peered":"2023-05-17T14:53:52.906723+0000","last_clean":"2023-05-17T14:53:52.906723+0000","last_became_active":"2023-05-17T14:53:52.900419+0000","last_became_peered":"2023-05-17T14:53:52.900419+0000","last_unstale":"2023-05-17T14:53:52.906723+0000","last_undegraded":"2023-05-17T14:53:52.906723+0000","last_fullsized":"2023-05-17T14:53:52.906723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888598+0000","last_change":"2023-05-17T14:53:52.509848+0000","last_active":"2023-05-17T14:53:52.888598+0000","last_peered":"2023-05-17T14:53:52.888598+0000","last_clean":"2023-05-17T14:53:52.888598+0000","last_became_active":"2023-05-17T14:53:52.509559+0000","last_became_peered":"2023-05-17T14:53:52.509559+0000","last_unstale":"2023-05-17T14:53:52.888598+0000","last_undegraded":"2023-05-17T14:53:52.888598+0000","last_fullsized":"2023-05-17T14:53:52.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900610+0000","last_change":"2023-05-17T14:53:52.897408+0000","last_active":"2023-05-17T14:53:52.900610+0000","last_peered":"2023-05-17T14:53:52.900610+0000","last_clean":"2023-05-17T14:53:52.900610+0000","last_became_active":"2023-05-17T14:53:52.897133+0000","last_became_peered":"2023-05-17T14:53:52.897133+0000","last_unstale":"2023-05-17T14:53:52.900610+0000","last_undegraded":"2023-05-17T14:53:52.900610+0000","last_fullsized":"2023-05-17T14:53:52.900610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887886+0000","last_change":"2023-05-17T14:53:52.505784+0000","last_active":"2023-05-17T14:53:52.887886+0000","last_peered":"2023-05-17T14:53:52.887886+0000","last_clean":"2023-05-17T14:53:52.887886+0000","last_became_active":"2023-05-17T14:53:52.505481+0000","last_became_peered":"2023-05-17T14:53:52.505481+0000","last_unstale":"2023-05-17T14:53:52.887886+0000","last_undegraded":"2023-05-17T14:53:52.887886+0000","last_fullsized":"2023-05-17T14:53:52.887886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908743+0000","last_change":"2023-05-17T14:53:52.905997+0000","last_active":"2023-05-17T14:53:52.908743+0000","last_peered":"2023-05-17T14:53:52.908743+0000","last_clean":"2023-05-17T14:53:52.908743+0000","last_became_active":"2023-05-17T14:53:52.905547+0000","last_became_peered":"2023-05-17T14:53:52.905547+0000","last_unstale":"2023-05-17T14:53:52.908743+0000","last_undegraded":"2023-05-17T14:53:52.908743+0000","last_fullsized":"2023-05-17T14:53:52.908743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901796+0000","last_change":"2023-05-17T14:53:52.503841+0000","last_active":"2023-05-17T14:53:52.901796+0000","last_peered":"2023-05-17T14:53:52.901796+0000","last_clean":"2023-05-17T14:53:52.901796+0000","last_became_active":"2023-05-17T14:53:52.502924+0000","last_became_peered":"2023-05-17T14:53:52.502924+0000","last_unstale":"2023-05-17T14:53:52.901796+0000","last_undegraded":"2023-05-17T14:53:52.901796+0000","last_fullsized":"2023-05-17T14:53:52.901796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":86751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":86783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5100,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366740,"statfs":{"total":96636764160,"available":96631541760,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T14:54:03.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T14:54:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.846+0000 7fb268e8b700 1 Processor -- start 2023-05-17T14:54:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.846+0000 7fb268e8b700 1 -- start start 2023-05-17T14:54:03.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb268e8b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2640c6310 0x7fb264153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb268e8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2641541c0 0x7fb2640c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb268e8b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640bfcd0 con 0x7fb2640c5f30 2023-05-17T14:54:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb268e8b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2640c0290 con 0x7fb2640c6310 2023-05-17T14:54:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb268e8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640aa1a0 con 0x7fb2641541c0 2023-05-17T14:54:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2640c6310 0x7fb264153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb26259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb2640c5f30 0x7fb264158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33696/0 (socket says 172.21.15.27:33696) 2023-05-17T14:54:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2640c6310 0x7fb264153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34136/0 (socket says 172.21.15.27:34136) 2023-05-17T14:54:03.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb26259c700 1 -- 172.21.15.27:0/1700419589 learned_addr learned my addr 172.21.15.27:0/1700419589 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:03.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb262d9d700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2641541c0 0x7fb2640c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 -- 172.21.15.27:0/1700419589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2641541c0 msgr2=0x7fb2640c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:03.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2641541c0 0x7fb2640c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 -- 172.21.15.27:0/1700419589 >> v1:172.21.15.27:6789/0 conn(0x7fb2640c5f30 legacy=0x7fb264158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb26159a700 1 -- 172.21.15.27:0/1700419589 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048428435 0 0) 0x7fb2640bfcd0 con 0x7fb2640c5f30 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 -- 172.21.15.27:0/1700419589 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640aa480 con 0x7fb2640c6310 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb262d9d700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2641541c0 0x7fb2640c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.847+0000 7fb261d9b700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c6310 0x7fb264153cd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb24c009760 tx=0x7fb24c009060).ready entity=mon.0 client_cookie=e4f9819add75432a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb26159a700 1 -- 172.21.15.27:0/1700419589 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00b580 con 0x7fb2640c6310 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb26159a700 1 -- 172.21.15.27:0/1700419589 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c00b6e0 con 0x7fb2640c6310 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb26159a700 1 -- 172.21.15.27:0/1700419589 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00ba60 con 0x7fb2640c6310 2023-05-17T14:54:03.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 -- 172.21.15.27:0/1700419589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c6310 msgr2=0x7fb264153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c6310 0x7fb264153cd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb24c009760 tx=0x7fb24c009060).stop 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 -- 172.21.15.27:0/1700419589 shutdown_connections 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2641541c0 0x7fb2640c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 --2- 172.21.15.27:0/1700419589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c6310 0x7fb264153cd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 -- 172.21.15.27:0/1700419589 >> 172.21.15.27:0/1700419589 conn(0x7fb264069e70 msgr2=0x7fb26405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 -- 172.21.15.27:0/1700419589 shutdown_connections 2023-05-17T14:54:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.848+0000 7fb268e8b700 1 -- 172.21.15.27:0/1700419589 wait complete. 2023-05-17T14:54:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.849+0000 7fb268e8b700 1 Processor -- start 2023-05-17T14:54:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.849+0000 7fb268e8b700 1 -- start start 2023-05-17T14:54:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb268e8b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 0x7fb26413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb268e8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2640c6310 0x7fb264154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb268e8b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2641541c0 0x7fb2640aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb268e8b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264168ae0 con 0x7fb2640c5f30 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb268e8b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264167b10 con 0x7fb2641541c0 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb268e8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb264167ed0 con 0x7fb2640c6310 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 0x7fb26413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 0x7fb26413e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34138/0 (socket says 172.21.15.27:34138) 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 -- 172.21.15.27:0/3414975303 learned_addr learned my addr 172.21.15.27:0/3414975303 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 -- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2640c6310 msgr2=0x7fb264154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb261d9b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2640c6310 0x7fb264154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2640c6310 0x7fb264154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 -- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2641541c0 msgr2=0x7fb2640aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2641541c0 0x7fb2640aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 -- 172.21.15.27:0/3414975303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0092a0 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.850+0000 7fb26259c700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 0x7fb26413e2e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb25c00c4e0 tx=0x7fb25c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.851+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0072e0 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.851+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c007440 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.851+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2641681b0 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.851+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0057a0 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.851+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb264168770 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.852+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2640ad480 con 0x7fb2640c5f30 2023-05-17T14:54:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.852+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb25c01a060 con 0x7fb2640c5f30 2023-05-17T14:54:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.852+0000 7fb25a7fc700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb24405ed90 0x7fb244061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.852+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb25c079430 con 0x7fb2640c5f30 2023-05-17T14:54:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.852+0000 7fb261d9b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb24405ed90 0x7fb244061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.853+0000 7fb261d9b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb24405ed90 0x7fb244061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb264150460 tx=0x7fb24c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:03.856+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb25c04a9d0 con 0x7fb2640c5f30 2023-05-17T14:54:04.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.023+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb26405f4a0 con 0x7fb24405ed90 2023-05-17T14:54:04.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.032+0000 7fb25a7fc700 1 -- 172.21.15.27:0/3414975303 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336287 (secure 0 0 0) 0x7fb26405f4a0 con 0x7fb24405ed90 2023-05-17T14:54:04.039 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:04.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb24405ed90 msgr2=0x7fb244061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb24405ed90 0x7fb244061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb264150460 tx=0x7fb24c017000).stop 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 msgr2=0x7fb26413e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 0x7fb26413e2e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb25c00c4e0 tx=0x7fb25c007c70).stop 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 shutdown_connections 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb24405ed90 0x7fb244061250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2641541c0 0x7fb2640aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2640c5f30 0x7fb26413e2e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 --2- 172.21.15.27:0/3414975303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2640c6310 0x7fb264154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 >> 172.21.15.27:0/3414975303 conn(0x7fb264069e70 msgr2=0x7fb2640cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 shutdown_connections 2023-05-17T14:54:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.036+0000 7fb268e8b700 1 -- 172.21.15.27:0/3414975303 wait complete. 2023-05-17T14:54:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T14:54:04.051 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-17T14:54:03.563197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41600,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":39680,"kb_avail":754933120,"statfs":{"total":773094113280,"available":773051514880,"internally_reserved":0,"allocated":1900544,"data_stored":687308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40632320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001980"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906043+0000","last_change":"2023-05-17T14:53:52.897717+0000","last_active":"2023-05-17T14:53:52.906043+0000","last_peered":"2023-05-17T14:53:52.906043+0000","last_clean":"2023-05-17T14:53:52.906043+0000","last_became_active":"2023-05-17T14:53:52.897401+0000","last_became_peered":"2023-05-17T14:53:52.897401+0000","last_unstale":"2023-05-17T14:53:52.906043+0000","last_undegraded":"2023-05-17T14:53:52.906043+0000","last_fullsized":"2023-05-17T14:53:52.906043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892623+0000","last_change":"2023-05-17T14:53:52.497633+0000","last_active":"2023-05-17T14:53:52.892623+0000","last_peered":"2023-05-17T14:53:52.892623+0000","last_clean":"2023-05-17T14:53:52.892623+0000","last_became_active":"2023-05-17T14:53:52.497319+0000","last_became_peered":"2023-05-17T14:53:52.497319+0000","last_unstale":"2023-05-17T14:53:52.892623+0000","last_undegraded":"2023-05-17T14:53:52.892623+0000","last_fullsized":"2023-05-17T14:53:52.892623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905474+0000","last_change":"2023-05-17T14:53:52.903639+0000","last_active":"2023-05-17T14:53:52.905474+0000","last_peered":"2023-05-17T14:53:52.905474+0000","last_clean":"2023-05-17T14:53:52.905474+0000","last_became_active":"2023-05-17T14:53:52.903343+0000","last_became_peered":"2023-05-17T14:53:52.903343+0000","last_unstale":"2023-05-17T14:53:52.905474+0000","last_undegraded":"2023-05-17T14:53:52.905474+0000","last_fullsized":"2023-05-17T14:53:52.905474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887305+0000","last_change":"2023-05-17T14:53:52.513391+0000","last_active":"2023-05-17T14:53:52.887305+0000","last_peered":"2023-05-17T14:53:52.887305+0000","last_clean":"2023-05-17T14:53:52.887305+0000","last_became_active":"2023-05-17T14:53:52.513085+0000","last_became_peered":"2023-05-17T14:53:52.513085+0000","last_unstale":"2023-05-17T14:53:52.887305+0000","last_undegraded":"2023-05-17T14:53:52.887305+0000","last_fullsized":"2023-05-17T14:53:52.887305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901401+0000","last_change":"2023-05-17T14:53:52.898454+0000","last_active":"2023-05-17T14:53:52.901401+0000","last_peered":"2023-05-17T14:53:52.901401+0000","last_clean":"2023-05-17T14:53:52.901401+0000","last_became_active":"2023-05-17T14:53:52.898174+0000","last_became_peered":"2023-05-17T14:53:52.898174+0000","last_unstale":"2023-05-17T14:53:52.901401+0000","last_undegraded":"2023-05-17T14:53:52.901401+0000","last_fullsized":"2023-05-17T14:53:52.901401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.878802+0000","last_change":"2023-05-17T14:53:52.504777+0000","last_active":"2023-05-17T14:53:52.878802+0000","last_peered":"2023-05-17T14:53:52.878802+0000","last_clean":"2023-05-17T14:53:52.878802+0000","last_became_active":"2023-05-17T14:53:52.504452+0000","last_became_peered":"2023-05-17T14:53:52.504452+0000","last_unstale":"2023-05-17T14:53:52.878802+0000","last_undegraded":"2023-05-17T14:53:52.878802+0000","last_fullsized":"2023-05-17T14:53:52.878802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894731+0000","last_change":"2023-05-17T14:53:52.891991+0000","last_active":"2023-05-17T14:53:52.894731+0000","last_peered":"2023-05-17T14:53:52.894731+0000","last_clean":"2023-05-17T14:53:52.894731+0000","last_became_active":"2023-05-17T14:53:52.891701+0000","last_became_peered":"2023-05-17T14:53:52.891701+0000","last_unstale":"2023-05-17T14:53:52.894731+0000","last_undegraded":"2023-05-17T14:53:52.894731+0000","last_fullsized":"2023-05-17T14:53:52.894731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889899+0000","last_change":"2023-05-17T14:53:52.510727+0000","last_active":"2023-05-17T14:53:52.889899+0000","last_peered":"2023-05-17T14:53:52.889899+0000","last_clean":"2023-05-17T14:53:52.889899+0000","last_became_active":"2023-05-17T14:53:52.510427+0000","last_became_peered":"2023-05-17T14:53:52.510427+0000","last_unstale":"2023-05-17T14:53:52.889899+0000","last_undegraded":"2023-05-17T14:53:52.889899+0000","last_fullsized":"2023-05-17T14:53:52.889899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906022+0000","last_change":"2023-05-17T14:53:52.897836+0000","last_active":"2023-05-17T14:53:52.906022+0000","last_peered":"2023-05-17T14:53:52.906022+0000","last_clean":"2023-05-17T14:53:52.906022+0000","last_became_active":"2023-05-17T14:53:52.897537+0000","last_became_peered":"2023-05-17T14:53:52.897537+0000","last_unstale":"2023-05-17T14:53:52.906022+0000","last_undegraded":"2023-05-17T14:53:52.906022+0000","last_fullsized":"2023-05-17T14:53:52.906022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.892163+0000","last_change":"2023-05-17T14:53:52.506710+0000","last_active":"2023-05-17T14:53:52.892163+0000","last_peered":"2023-05-17T14:53:52.892163+0000","last_clean":"2023-05-17T14:53:52.892163+0000","last_became_active":"2023-05-17T14:53:52.506388+0000","last_became_peered":"2023-05-17T14:53:52.506388+0000","last_unstale":"2023-05-17T14:53:52.892163+0000","last_undegraded":"2023-05-17T14:53:52.892163+0000","last_fullsized":"2023-05-17T14:53:52.892163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902492+0000","last_change":"2023-05-17T14:53:52.897342+0000","last_active":"2023-05-17T14:53:52.902492+0000","last_peered":"2023-05-17T14:53:52.902492+0000","last_clean":"2023-05-17T14:53:52.902492+0000","last_became_active":"2023-05-17T14:53:52.897001+0000","last_became_peered":"2023-05-17T14:53:52.897001+0000","last_unstale":"2023-05-17T14:53:52.902492+0000","last_undegraded":"2023-05-17T14:53:52.902492+0000","last_fullsized":"2023-05-17T14:53:52.902492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907466+0000","last_change":"2023-05-17T14:53:52.512698+0000","last_active":"2023-05-17T14:53:52.907466+0000","last_peered":"2023-05-17T14:53:52.907466+0000","last_clean":"2023-05-17T14:53:52.907466+0000","last_became_active":"2023-05-17T14:53:52.512388+0000","last_became_peered":"2023-05-17T14:53:52.512388+0000","last_unstale":"2023-05-17T14:53:52.907466+0000","last_undegraded":"2023-05-17T14:53:52.907466+0000","last_fullsized":"2023-05-17T14:53:52.907466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907123+0000","last_change":"2023-05-17T14:53:52.902935+0000","last_active":"2023-05-17T14:53:52.907123+0000","last_peered":"2023-05-17T14:53:52.907123+0000","last_clean":"2023-05-17T14:53:52.907123+0000","last_became_active":"2023-05-17T14:53:52.902576+0000","last_became_peered":"2023-05-17T14:53:52.902576+0000","last_unstale":"2023-05-17T14:53:52.907123+0000","last_undegraded":"2023-05-17T14:53:52.907123+0000","last_fullsized":"2023-05-17T14:53:52.907123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904663+0000","last_change":"2023-05-17T14:53:52.505380+0000","last_active":"2023-05-17T14:53:52.904663+0000","last_peered":"2023-05-17T14:53:52.904663+0000","last_clean":"2023-05-17T14:53:52.904663+0000","last_became_active":"2023-05-17T14:53:52.505079+0000","last_became_peered":"2023-05-17T14:53:52.505079+0000","last_unstale":"2023-05-17T14:53:52.904663+0000","last_undegraded":"2023-05-17T14:53:52.904663+0000","last_fullsized":"2023-05-17T14:53:52.904663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906602+0000","last_change":"2023-05-17T14:53:52.899688+0000","last_active":"2023-05-17T14:53:52.906602+0000","last_peered":"2023-05-17T14:53:52.906602+0000","last_clean":"2023-05-17T14:53:52.906602+0000","last_became_active":"2023-05-17T14:53:52.899370+0000","last_became_peered":"2023-05-17T14:53:52.899370+0000","last_unstale":"2023-05-17T14:53:52.906602+0000","last_undegraded":"2023-05-17T14:53:52.906602+0000","last_fullsized":"2023-05-17T14:53:52.906602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901968+0000","last_change":"2023-05-17T14:53:52.511747+0000","last_active":"2023-05-17T14:53:52.901968+0000","last_peered":"2023-05-17T14:53:52.901968+0000","last_clean":"2023-05-17T14:53:52.901968+0000","last_became_active":"2023-05-17T14:53:52.511252+0000","last_became_peered":"2023-05-17T14:53:52.511252+0000","last_unstale":"2023-05-17T14:53:52.901968+0000","last_undegraded":"2023-05-17T14:53:52.901968+0000","last_fullsized":"2023-05-17T14:53:52.901968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905393+0000","last_change":"2023-05-17T14:53:52.897006+0000","last_active":"2023-05-17T14:53:52.905393+0000","last_peered":"2023-05-17T14:53:52.905393+0000","last_clean":"2023-05-17T14:53:52.905393+0000","last_became_active":"2023-05-17T14:53:52.896750+0000","last_became_peered":"2023-05-17T14:53:52.896750+0000","last_unstale":"2023-05-17T14:53:52.905393+0000","last_undegraded":"2023-05-17T14:53:52.905393+0000","last_fullsized":"2023-05-17T14:53:52.905393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885046+0000","last_change":"2023-05-17T14:53:52.509606+0000","last_active":"2023-05-17T14:53:52.885046+0000","last_peered":"2023-05-17T14:53:52.885046+0000","last_clean":"2023-05-17T14:53:52.885046+0000","last_became_active":"2023-05-17T14:53:52.509314+0000","last_became_peered":"2023-05-17T14:53:52.509314+0000","last_unstale":"2023-05-17T14:53:52.885046+0000","last_undegraded":"2023-05-17T14:53:52.885046+0000","last_fullsized":"2023-05-17T14:53:52.885046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910146+0000","last_change":"2023-05-17T14:53:52.906844+0000","last_active":"2023-05-17T14:53:52.910146+0000","last_peered":"2023-05-17T14:53:52.910146+0000","last_clean":"2023-05-17T14:53:52.910146+0000","last_became_active":"2023-05-17T14:53:52.906538+0000","last_became_peered":"2023-05-17T14:53:52.906538+0000","last_unstale":"2023-05-17T14:53:52.910146+0000","last_undegraded":"2023-05-17T14:53:52.910146+0000","last_fullsized":"2023-05-17T14:53:52.910146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882654+0000","last_change":"2023-05-17T14:53:52.510353+0000","last_active":"2023-05-17T14:53:52.882654+0000","last_peered":"2023-05-17T14:53:52.882654+0000","last_clean":"2023-05-17T14:53:52.882654+0000","last_became_active":"2023-05-17T14:53:52.509900+0000","last_became_peered":"2023-05-17T14:53:52.509900+0000","last_unstale":"2023-05-17T14:53:52.882654+0000","last_undegraded":"2023-05-17T14:53:52.882654+0000","last_fullsized":"2023-05-17T14:53:52.882654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906905+0000","last_change":"2023-05-17T14:53:52.902457+0000","last_active":"2023-05-17T14:53:52.906905+0000","last_peered":"2023-05-17T14:53:52.906905+0000","last_clean":"2023-05-17T14:53:52.906905+0000","last_became_active":"2023-05-17T14:53:52.899322+0000","last_became_peered":"2023-05-17T14:53:52.899322+0000","last_unstale":"2023-05-17T14:53:52.906905+0000","last_undegraded":"2023-05-17T14:53:52.906905+0000","last_fullsized":"2023-05-17T14:53:52.906905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906085+0000","last_change":"2023-05-17T14:53:52.509899+0000","last_active":"2023-05-17T14:53:52.906085+0000","last_peered":"2023-05-17T14:53:52.906085+0000","last_clean":"2023-05-17T14:53:52.906085+0000","last_became_active":"2023-05-17T14:53:52.509603+0000","last_became_peered":"2023-05-17T14:53:52.509603+0000","last_unstale":"2023-05-17T14:53:52.906085+0000","last_undegraded":"2023-05-17T14:53:52.906085+0000","last_fullsized":"2023-05-17T14:53:52.906085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905607+0000","last_change":"2023-05-17T14:53:52.897908+0000","last_active":"2023-05-17T14:53:52.905607+0000","last_peered":"2023-05-17T14:53:52.905607+0000","last_clean":"2023-05-17T14:53:52.905607+0000","last_became_active":"2023-05-17T14:53:52.896815+0000","last_became_peered":"2023-05-17T14:53:52.896815+0000","last_unstale":"2023-05-17T14:53:52.905607+0000","last_undegraded":"2023-05-17T14:53:52.905607+0000","last_fullsized":"2023-05-17T14:53:52.905607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902172+0000","last_change":"2023-05-17T14:53:52.511011+0000","last_active":"2023-05-17T14:53:52.902172+0000","last_peered":"2023-05-17T14:53:52.902172+0000","last_clean":"2023-05-17T14:53:52.902172+0000","last_became_active":"2023-05-17T14:53:52.510709+0000","last_became_peered":"2023-05-17T14:53:52.510709+0000","last_unstale":"2023-05-17T14:53:52.902172+0000","last_undegraded":"2023-05-17T14:53:52.902172+0000","last_fullsized":"2023-05-17T14:53:52.902172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908989+0000","last_change":"2023-05-17T14:53:52.904488+0000","last_active":"2023-05-17T14:53:52.908989+0000","last_peered":"2023-05-17T14:53:52.908989+0000","last_clean":"2023-05-17T14:53:52.908989+0000","last_became_active":"2023-05-17T14:53:52.904167+0000","last_became_peered":"2023-05-17T14:53:52.904167+0000","last_unstale":"2023-05-17T14:53:52.908989+0000","last_undegraded":"2023-05-17T14:53:52.908989+0000","last_fullsized":"2023-05-17T14:53:52.908989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902101+0000","last_change":"2023-05-17T14:53:52.509220+0000","last_active":"2023-05-17T14:53:52.902101+0000","last_peered":"2023-05-17T14:53:52.902101+0000","last_clean":"2023-05-17T14:53:52.902101+0000","last_became_active":"2023-05-17T14:53:52.508840+0000","last_became_peered":"2023-05-17T14:53:52.508840+0000","last_unstale":"2023-05-17T14:53:52.902101+0000","last_undegraded":"2023-05-17T14:53:52.902101+0000","last_fullsized":"2023-05-17T14:53:52.902101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909059+0000","last_change":"2023-05-17T14:53:52.904802+0000","last_active":"2023-05-17T14:53:52.909059+0000","last_peered":"2023-05-17T14:53:52.909059+0000","last_clean":"2023-05-17T14:53:52.909059+0000","last_became_active":"2023-05-17T14:53:52.904586+0000","last_became_peered":"2023-05-17T14:53:52.904586+0000","last_unstale":"2023-05-17T14:53:52.909059+0000","last_undegraded":"2023-05-17T14:53:52.909059+0000","last_fullsized":"2023-05-17T14:53:52.909059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883458+0000","last_change":"2023-05-17T14:53:52.503482+0000","last_active":"2023-05-17T14:53:52.883458+0000","last_peered":"2023-05-17T14:53:52.883458+0000","last_clean":"2023-05-17T14:53:52.883458+0000","last_became_active":"2023-05-17T14:53:52.503210+0000","last_became_peered":"2023-05-17T14:53:52.503210+0000","last_unstale":"2023-05-17T14:53:52.883458+0000","last_undegraded":"2023-05-17T14:53:52.883458+0000","last_fullsized":"2023-05-17T14:53:52.883458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905302+0000","last_change":"2023-05-17T14:53:52.902058+0000","last_active":"2023-05-17T14:53:52.905302+0000","last_peered":"2023-05-17T14:53:52.905302+0000","last_clean":"2023-05-17T14:53:52.905302+0000","last_became_active":"2023-05-17T14:53:52.896933+0000","last_became_peered":"2023-05-17T14:53:52.896933+0000","last_unstale":"2023-05-17T14:53:52.905302+0000","last_undegraded":"2023-05-17T14:53:52.905302+0000","last_fullsized":"2023-05-17T14:53:52.905302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886188+0000","last_change":"2023-05-17T14:53:52.511969+0000","last_active":"2023-05-17T14:53:52.886188+0000","last_peered":"2023-05-17T14:53:52.886188+0000","last_clean":"2023-05-17T14:53:52.886188+0000","last_became_active":"2023-05-17T14:53:52.511242+0000","last_became_peered":"2023-05-17T14:53:52.511242+0000","last_unstale":"2023-05-17T14:53:52.886188+0000","last_undegraded":"2023-05-17T14:53:52.886188+0000","last_fullsized":"2023-05-17T14:53:52.886188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909577+0000","last_change":"2023-05-17T14:53:52.907876+0000","last_active":"2023-05-17T14:53:52.909577+0000","last_peered":"2023-05-17T14:53:52.909577+0000","last_clean":"2023-05-17T14:53:52.909577+0000","last_became_active":"2023-05-17T14:53:52.907296+0000","last_became_peered":"2023-05-17T14:53:52.907296+0000","last_unstale":"2023-05-17T14:53:52.909577+0000","last_undegraded":"2023-05-17T14:53:52.909577+0000","last_fullsized":"2023-05-17T14:53:52.909577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905775+0000","last_change":"2023-05-17T14:53:52.511043+0000","last_active":"2023-05-17T14:53:52.905775+0000","last_peered":"2023-05-17T14:53:52.905775+0000","last_clean":"2023-05-17T14:53:52.905775+0000","last_became_active":"2023-05-17T14:53:52.510747+0000","last_became_peered":"2023-05-17T14:53:52.510747+0000","last_unstale":"2023-05-17T14:53:52.905775+0000","last_undegraded":"2023-05-17T14:53:52.905775+0000","last_fullsized":"2023-05-17T14:53:52.905775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909470+0000","last_change":"2023-05-17T14:53:52.906776+0000","last_active":"2023-05-17T14:53:52.909470+0000","last_peered":"2023-05-17T14:53:52.909470+0000","last_clean":"2023-05-17T14:53:52.909470+0000","last_became_active":"2023-05-17T14:53:52.906469+0000","last_became_peered":"2023-05-17T14:53:52.906469+0000","last_unstale":"2023-05-17T14:53:52.909470+0000","last_undegraded":"2023-05-17T14:53:52.909470+0000","last_fullsized":"2023-05-17T14:53:52.909470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888445+0000","last_change":"2023-05-17T14:53:52.499620+0000","last_active":"2023-05-17T14:53:52.888445+0000","last_peered":"2023-05-17T14:53:52.888445+0000","last_clean":"2023-05-17T14:53:52.888445+0000","last_became_active":"2023-05-17T14:53:52.498310+0000","last_became_peered":"2023-05-17T14:53:52.498310+0000","last_unstale":"2023-05-17T14:53:52.888445+0000","last_undegraded":"2023-05-17T14:53:52.888445+0000","last_fullsized":"2023-05-17T14:53:52.888445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908983+0000","last_change":"2023-05-17T14:53:52.903907+0000","last_active":"2023-05-17T14:53:52.908983+0000","last_peered":"2023-05-17T14:53:52.908983+0000","last_clean":"2023-05-17T14:53:52.908983+0000","last_became_active":"2023-05-17T14:53:52.903272+0000","last_became_peered":"2023-05-17T14:53:52.903272+0000","last_unstale":"2023-05-17T14:53:52.908983+0000","last_undegraded":"2023-05-17T14:53:52.908983+0000","last_fullsized":"2023-05-17T14:53:52.908983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896150+0000","last_change":"2023-05-17T14:53:52.496758+0000","last_active":"2023-05-17T14:53:52.896150+0000","last_peered":"2023-05-17T14:53:52.896150+0000","last_clean":"2023-05-17T14:53:52.896150+0000","last_became_active":"2023-05-17T14:53:52.496374+0000","last_became_peered":"2023-05-17T14:53:52.496374+0000","last_unstale":"2023-05-17T14:53:52.896150+0000","last_undegraded":"2023-05-17T14:53:52.896150+0000","last_fullsized":"2023-05-17T14:53:52.896150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899052+0000","last_change":"2023-05-17T14:53:52.893066+0000","last_active":"2023-05-17T14:53:52.899052+0000","last_peered":"2023-05-17T14:53:52.899052+0000","last_clean":"2023-05-17T14:53:52.899052+0000","last_became_active":"2023-05-17T14:53:52.892743+0000","last_became_peered":"2023-05-17T14:53:52.892743+0000","last_unstale":"2023-05-17T14:53:52.899052+0000","last_undegraded":"2023-05-17T14:53:52.899052+0000","last_fullsized":"2023-05-17T14:53:52.899052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879301+0000","last_change":"2023-05-17T14:53:52.515582+0000","last_active":"2023-05-17T14:53:52.879301+0000","last_peered":"2023-05-17T14:53:52.879301+0000","last_clean":"2023-05-17T14:53:52.879301+0000","last_became_active":"2023-05-17T14:53:52.514941+0000","last_became_peered":"2023-05-17T14:53:52.514941+0000","last_unstale":"2023-05-17T14:53:52.879301+0000","last_undegraded":"2023-05-17T14:53:52.879301+0000","last_fullsized":"2023-05-17T14:53:52.879301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887546+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T14:53:52.887546+0000","last_peered":"2023-05-17T14:53:52.887546+0000","last_clean":"2023-05-17T14:53:52.887546+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T14:53:52.887546+0000","last_undegraded":"2023-05-17T14:53:52.887546+0000","last_fullsized":"2023-05-17T14:53:52.887546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890966+0000","last_change":"2023-05-17T14:53:52.514000+0000","last_active":"2023-05-17T14:53:52.890966+0000","last_peered":"2023-05-17T14:53:52.890966+0000","last_clean":"2023-05-17T14:53:52.890966+0000","last_became_active":"2023-05-17T14:53:52.512785+0000","last_became_peered":"2023-05-17T14:53:52.512785+0000","last_unstale":"2023-05-17T14:53:52.890966+0000","last_undegraded":"2023-05-17T14:53:52.890966+0000","last_fullsized":"2023-05-17T14:53:52.890966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902502+0000","last_change":"2023-05-17T14:53:52.898360+0000","last_active":"2023-05-17T14:53:52.902502+0000","last_peered":"2023-05-17T14:53:52.902502+0000","last_clean":"2023-05-17T14:53:52.902502+0000","last_became_active":"2023-05-17T14:53:52.898085+0000","last_became_peered":"2023-05-17T14:53:52.898085+0000","last_unstale":"2023-05-17T14:53:52.902502+0000","last_undegraded":"2023-05-17T14:53:52.902502+0000","last_fullsized":"2023-05-17T14:53:52.902502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886393+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T14:53:52.886393+0000","last_peered":"2023-05-17T14:53:52.886393+0000","last_clean":"2023-05-17T14:53:52.886393+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T14:53:52.886393+0000","last_undegraded":"2023-05-17T14:53:52.886393+0000","last_fullsized":"2023-05-17T14:53:52.886393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894570+0000","last_change":"2023-05-17T14:53:52.504726+0000","last_active":"2023-05-17T14:53:52.894570+0000","last_peered":"2023-05-17T14:53:52.894570+0000","last_clean":"2023-05-17T14:53:52.894570+0000","last_became_active":"2023-05-17T14:53:52.504248+0000","last_became_peered":"2023-05-17T14:53:52.504248+0000","last_unstale":"2023-05-17T14:53:52.894570+0000","last_undegraded":"2023-05-17T14:53:52.894570+0000","last_fullsized":"2023-05-17T14:53:52.894570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902594+0000","last_change":"2023-05-17T14:53:52.894491+0000","last_active":"2023-05-17T14:53:52.902594+0000","last_peered":"2023-05-17T14:53:52.902594+0000","last_clean":"2023-05-17T14:53:52.902594+0000","last_became_active":"2023-05-17T14:53:52.894207+0000","last_became_peered":"2023-05-17T14:53:52.894207+0000","last_unstale":"2023-05-17T14:53:52.902594+0000","last_undegraded":"2023-05-17T14:53:52.902594+0000","last_fullsized":"2023-05-17T14:53:52.902594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905214+0000","last_change":"2023-05-17T14:53:52.900499+0000","last_active":"2023-05-17T14:53:52.905214+0000","last_peered":"2023-05-17T14:53:52.905214+0000","last_clean":"2023-05-17T14:53:52.905214+0000","last_became_active":"2023-05-17T14:53:52.900219+0000","last_became_peered":"2023-05-17T14:53:52.900219+0000","last_unstale":"2023-05-17T14:53:52.905214+0000","last_undegraded":"2023-05-17T14:53:52.905214+0000","last_fullsized":"2023-05-17T14:53:52.905214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885427+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T14:53:52.885427+0000","last_peered":"2023-05-17T14:53:52.885427+0000","last_clean":"2023-05-17T14:53:52.885427+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T14:53:52.885427+0000","last_undegraded":"2023-05-17T14:53:52.885427+0000","last_fullsized":"2023-05-17T14:53:52.885427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886784+0000","last_change":"2023-05-17T14:53:52.495004+0000","last_active":"2023-05-17T14:53:52.886784+0000","last_peered":"2023-05-17T14:53:52.886784+0000","last_clean":"2023-05-17T14:53:52.886784+0000","last_became_active":"2023-05-17T14:53:52.494690+0000","last_became_peered":"2023-05-17T14:53:52.494690+0000","last_unstale":"2023-05-17T14:53:52.886784+0000","last_undegraded":"2023-05-17T14:53:52.886784+0000","last_fullsized":"2023-05-17T14:53:52.886784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.904891+0000","last_change":"2023-05-17T14:53:52.901552+0000","last_active":"2023-05-17T14:53:52.904891+0000","last_peered":"2023-05-17T14:53:52.904891+0000","last_clean":"2023-05-17T14:53:52.904891+0000","last_became_active":"2023-05-17T14:53:52.901241+0000","last_became_peered":"2023-05-17T14:53:52.901241+0000","last_unstale":"2023-05-17T14:53:52.904891+0000","last_undegraded":"2023-05-17T14:53:52.904891+0000","last_fullsized":"2023-05-17T14:53:52.904891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890070+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T14:53:52.890070+0000","last_peered":"2023-05-17T14:53:52.890070+0000","last_clean":"2023-05-17T14:53:52.890070+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T14:53:52.890070+0000","last_undegraded":"2023-05-17T14:53:52.890070+0000","last_fullsized":"2023-05-17T14:53:52.890070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882188+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T14:53:52.882188+0000","last_peered":"2023-05-17T14:53:52.882188+0000","last_clean":"2023-05-17T14:53:52.882188+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T14:53:52.882188+0000","last_undegraded":"2023-05-17T14:53:52.882188+0000","last_fullsized":"2023-05-17T14:53:52.882188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879145+0000","last_change":"2023-05-17T14:53:52.509749+0000","last_active":"2023-05-17T14:53:52.879145+0000","last_peered":"2023-05-17T14:53:52.879145+0000","last_clean":"2023-05-17T14:53:52.879145+0000","last_became_active":"2023-05-17T14:53:52.509447+0000","last_became_peered":"2023-05-17T14:53:52.509447+0000","last_unstale":"2023-05-17T14:53:52.879145+0000","last_undegraded":"2023-05-17T14:53:52.879145+0000","last_fullsized":"2023-05-17T14:53:52.879145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905144+0000","last_change":"2023-05-17T14:53:52.897391+0000","last_active":"2023-05-17T14:53:52.905144+0000","last_peered":"2023-05-17T14:53:52.905144+0000","last_clean":"2023-05-17T14:53:52.905144+0000","last_became_active":"2023-05-17T14:53:52.897101+0000","last_became_peered":"2023-05-17T14:53:52.897101+0000","last_unstale":"2023-05-17T14:53:52.905144+0000","last_undegraded":"2023-05-17T14:53:52.905144+0000","last_fullsized":"2023-05-17T14:53:52.905144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882503+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T14:53:52.882503+0000","last_peered":"2023-05-17T14:53:52.882503+0000","last_clean":"2023-05-17T14:53:52.882503+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T14:53:52.882503+0000","last_undegraded":"2023-05-17T14:53:52.882503+0000","last_fullsized":"2023-05-17T14:53:52.882503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886662+0000","last_change":"2023-05-17T14:53:52.509023+0000","last_active":"2023-05-17T14:53:52.886662+0000","last_peered":"2023-05-17T14:53:52.886662+0000","last_clean":"2023-05-17T14:53:52.886662+0000","last_became_active":"2023-05-17T14:53:52.508648+0000","last_became_peered":"2023-05-17T14:53:52.508648+0000","last_unstale":"2023-05-17T14:53:52.886662+0000","last_undegraded":"2023-05-17T14:53:52.886662+0000","last_fullsized":"2023-05-17T14:53:52.886662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883453+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T14:53:52.883453+0000","last_peered":"2023-05-17T14:53:52.883453+0000","last_clean":"2023-05-17T14:53:52.883453+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T14:53:52.883453+0000","last_undegraded":"2023-05-17T14:53:52.883453+0000","last_fullsized":"2023-05-17T14:53:52.883453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887636+0000","last_change":"2023-05-17T14:53:52.496859+0000","last_active":"2023-05-17T14:53:52.887636+0000","last_peered":"2023-05-17T14:53:52.887636+0000","last_clean":"2023-05-17T14:53:52.887636+0000","last_became_active":"2023-05-17T14:53:52.496451+0000","last_became_peered":"2023-05-17T14:53:52.496451+0000","last_unstale":"2023-05-17T14:53:52.887636+0000","last_undegraded":"2023-05-17T14:53:52.887636+0000","last_fullsized":"2023-05-17T14:53:52.887636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905245+0000","last_change":"2023-05-17T14:53:52.901622+0000","last_active":"2023-05-17T14:53:52.905245+0000","last_peered":"2023-05-17T14:53:52.905245+0000","last_clean":"2023-05-17T14:53:52.905245+0000","last_became_active":"2023-05-17T14:53:52.901357+0000","last_became_peered":"2023-05-17T14:53:52.901357+0000","last_unstale":"2023-05-17T14:53:52.905245+0000","last_undegraded":"2023-05-17T14:53:52.905245+0000","last_fullsized":"2023-05-17T14:53:52.905245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902729+0000","last_change":"2023-05-17T14:53:52.512750+0000","last_active":"2023-05-17T14:53:52.902729+0000","last_peered":"2023-05-17T14:53:52.902729+0000","last_clean":"2023-05-17T14:53:52.902729+0000","last_became_active":"2023-05-17T14:53:52.512415+0000","last_became_peered":"2023-05-17T14:53:52.512415+0000","last_unstale":"2023-05-17T14:53:52.902729+0000","last_undegraded":"2023-05-17T14:53:52.902729+0000","last_fullsized":"2023-05-17T14:53:52.902729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887773+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T14:53:52.887773+0000","last_peered":"2023-05-17T14:53:52.887773+0000","last_clean":"2023-05-17T14:53:52.887773+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T14:53:52.887773+0000","last_undegraded":"2023-05-17T14:53:52.887773+0000","last_fullsized":"2023-05-17T14:53:52.887773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906281+0000","last_change":"2023-05-17T14:53:52.899029+0000","last_active":"2023-05-17T14:53:52.906281+0000","last_peered":"2023-05-17T14:53:52.906281+0000","last_clean":"2023-05-17T14:53:52.906281+0000","last_became_active":"2023-05-17T14:53:52.898737+0000","last_became_peered":"2023-05-17T14:53:52.898737+0000","last_unstale":"2023-05-17T14:53:52.906281+0000","last_undegraded":"2023-05-17T14:53:52.906281+0000","last_fullsized":"2023-05-17T14:53:52.906281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.894067+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T14:53:52.894067+0000","last_peered":"2023-05-17T14:53:52.894067+0000","last_clean":"2023-05-17T14:53:52.894067+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T14:53:52.894067+0000","last_undegraded":"2023-05-17T14:53:52.894067+0000","last_fullsized":"2023-05-17T14:53:52.894067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.890359+0000","last_change":"2023-05-17T14:53:52.510050+0000","last_active":"2023-05-17T14:53:52.890359+0000","last_peered":"2023-05-17T14:53:52.890359+0000","last_clean":"2023-05-17T14:53:52.890359+0000","last_became_active":"2023-05-17T14:53:52.509746+0000","last_became_peered":"2023-05-17T14:53:52.509746+0000","last_unstale":"2023-05-17T14:53:52.890359+0000","last_undegraded":"2023-05-17T14:53:52.890359+0000","last_fullsized":"2023-05-17T14:53:52.890359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907584+0000","last_change":"2023-05-17T14:53:52.902447+0000","last_active":"2023-05-17T14:53:52.907584+0000","last_peered":"2023-05-17T14:53:52.907584+0000","last_clean":"2023-05-17T14:53:52.907584+0000","last_became_active":"2023-05-17T14:53:52.902177+0000","last_became_peered":"2023-05-17T14:53:52.902177+0000","last_unstale":"2023-05-17T14:53:52.907584+0000","last_undegraded":"2023-05-17T14:53:52.907584+0000","last_fullsized":"2023-05-17T14:53:52.907584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906251+0000","last_change":"2023-05-17T14:53:52.900925+0000","last_active":"2023-05-17T14:53:52.906251+0000","last_peered":"2023-05-17T14:53:52.906251+0000","last_clean":"2023-05-17T14:53:52.906251+0000","last_became_active":"2023-05-17T14:53:52.900643+0000","last_became_peered":"2023-05-17T14:53:52.900643+0000","last_unstale":"2023-05-17T14:53:52.906251+0000","last_undegraded":"2023-05-17T14:53:52.906251+0000","last_fullsized":"2023-05-17T14:53:52.906251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891905+0000","last_change":"2023-05-17T14:53:52.509026+0000","last_active":"2023-05-17T14:53:52.891905+0000","last_peered":"2023-05-17T14:53:52.891905+0000","last_clean":"2023-05-17T14:53:52.891905+0000","last_became_active":"2023-05-17T14:53:52.508652+0000","last_became_peered":"2023-05-17T14:53:52.508652+0000","last_unstale":"2023-05-17T14:53:52.891905+0000","last_undegraded":"2023-05-17T14:53:52.891905+0000","last_fullsized":"2023-05-17T14:53:52.891905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907099+0000","last_change":"2023-05-17T14:53:52.902271+0000","last_active":"2023-05-17T14:53:52.907099+0000","last_peered":"2023-05-17T14:53:52.907099+0000","last_clean":"2023-05-17T14:53:52.907099+0000","last_became_active":"2023-05-17T14:53:52.901952+0000","last_became_peered":"2023-05-17T14:53:52.901952+0000","last_unstale":"2023-05-17T14:53:52.907099+0000","last_undegraded":"2023-05-17T14:53:52.907099+0000","last_fullsized":"2023-05-17T14:53:52.907099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886300+0000","last_change":"2023-05-17T14:53:52.497235+0000","last_active":"2023-05-17T14:53:52.886300+0000","last_peered":"2023-05-17T14:53:52.886300+0000","last_clean":"2023-05-17T14:53:52.886300+0000","last_became_active":"2023-05-17T14:53:52.496955+0000","last_became_peered":"2023-05-17T14:53:52.496955+0000","last_unstale":"2023-05-17T14:53:52.886300+0000","last_undegraded":"2023-05-17T14:53:52.886300+0000","last_fullsized":"2023-05-17T14:53:52.886300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909526+0000","last_change":"2023-05-17T14:53:52.907098+0000","last_active":"2023-05-17T14:53:52.909526+0000","last_peered":"2023-05-17T14:53:52.909526+0000","last_clean":"2023-05-17T14:53:52.909526+0000","last_became_active":"2023-05-17T14:53:52.906769+0000","last_became_peered":"2023-05-17T14:53:52.906769+0000","last_unstale":"2023-05-17T14:53:52.909526+0000","last_undegraded":"2023-05-17T14:53:52.909526+0000","last_fullsized":"2023-05-17T14:53:52.909526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900754+0000","last_change":"2023-05-17T14:53:52.498922+0000","last_active":"2023-05-17T14:53:52.900754+0000","last_peered":"2023-05-17T14:53:52.900754+0000","last_clean":"2023-05-17T14:53:52.900754+0000","last_became_active":"2023-05-17T14:53:52.498588+0000","last_became_peered":"2023-05-17T14:53:52.498588+0000","last_unstale":"2023-05-17T14:53:52.900754+0000","last_undegraded":"2023-05-17T14:53:52.900754+0000","last_fullsized":"2023-05-17T14:53:52.900754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897438+0000","last_change":"2023-05-17T14:53:52.894285+0000","last_active":"2023-05-17T14:53:52.897438+0000","last_peered":"2023-05-17T14:53:52.897438+0000","last_clean":"2023-05-17T14:53:52.897438+0000","last_became_active":"2023-05-17T14:53:52.894001+0000","last_became_peered":"2023-05-17T14:53:52.894001+0000","last_unstale":"2023-05-17T14:53:52.897438+0000","last_undegraded":"2023-05-17T14:53:52.897438+0000","last_fullsized":"2023-05-17T14:53:52.897438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887643+0000","last_change":"2023-05-17T14:53:52.509439+0000","last_active":"2023-05-17T14:53:52.887643+0000","last_peered":"2023-05-17T14:53:52.887643+0000","last_clean":"2023-05-17T14:53:52.887643+0000","last_became_active":"2023-05-17T14:53:52.509043+0000","last_became_peered":"2023-05-17T14:53:52.509043+0000","last_unstale":"2023-05-17T14:53:52.887643+0000","last_undegraded":"2023-05-17T14:53:52.887643+0000","last_fullsized":"2023-05-17T14:53:52.887643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909041+0000","last_change":"2023-05-17T14:53:52.904168+0000","last_active":"2023-05-17T14:53:52.909041+0000","last_peered":"2023-05-17T14:53:52.909041+0000","last_clean":"2023-05-17T14:53:52.909041+0000","last_became_active":"2023-05-17T14:53:52.903277+0000","last_became_peered":"2023-05-17T14:53:52.903277+0000","last_unstale":"2023-05-17T14:53:52.909041+0000","last_undegraded":"2023-05-17T14:53:52.909041+0000","last_fullsized":"2023-05-17T14:53:52.909041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900967+0000","last_change":"2023-05-17T14:53:52.501619+0000","last_active":"2023-05-17T14:53:52.900967+0000","last_peered":"2023-05-17T14:53:52.900967+0000","last_clean":"2023-05-17T14:53:52.900967+0000","last_became_active":"2023-05-17T14:53:52.501429+0000","last_became_peered":"2023-05-17T14:53:52.501429+0000","last_unstale":"2023-05-17T14:53:52.900967+0000","last_undegraded":"2023-05-17T14:53:52.900967+0000","last_fullsized":"2023-05-17T14:53:52.900967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905234+0000","last_change":"2023-05-17T14:53:52.901698+0000","last_active":"2023-05-17T14:53:52.905234+0000","last_peered":"2023-05-17T14:53:52.905234+0000","last_clean":"2023-05-17T14:53:52.905234+0000","last_became_active":"2023-05-17T14:53:52.901287+0000","last_became_peered":"2023-05-17T14:53:52.901287+0000","last_unstale":"2023-05-17T14:53:52.905234+0000","last_undegraded":"2023-05-17T14:53:52.905234+0000","last_fullsized":"2023-05-17T14:53:52.905234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889720+0000","last_change":"2023-05-17T14:53:52.509971+0000","last_active":"2023-05-17T14:53:52.889720+0000","last_peered":"2023-05-17T14:53:52.889720+0000","last_clean":"2023-05-17T14:53:52.889720+0000","last_became_active":"2023-05-17T14:53:52.509661+0000","last_became_peered":"2023-05-17T14:53:52.509661+0000","last_unstale":"2023-05-17T14:53:52.889720+0000","last_undegraded":"2023-05-17T14:53:52.889720+0000","last_fullsized":"2023-05-17T14:53:52.889720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.902342+0000","last_change":"2023-05-17T14:53:52.894638+0000","last_active":"2023-05-17T14:53:52.902342+0000","last_peered":"2023-05-17T14:53:52.902342+0000","last_clean":"2023-05-17T14:53:52.902342+0000","last_became_active":"2023-05-17T14:53:52.894342+0000","last_became_peered":"2023-05-17T14:53:52.894342+0000","last_unstale":"2023-05-17T14:53:52.902342+0000","last_undegraded":"2023-05-17T14:53:52.902342+0000","last_fullsized":"2023-05-17T14:53:52.902342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885492+0000","last_change":"2023-05-17T14:53:52.505043+0000","last_active":"2023-05-17T14:53:52.885492+0000","last_peered":"2023-05-17T14:53:52.885492+0000","last_clean":"2023-05-17T14:53:52.885492+0000","last_became_active":"2023-05-17T14:53:52.504736+0000","last_became_peered":"2023-05-17T14:53:52.504736+0000","last_unstale":"2023-05-17T14:53:52.885492+0000","last_undegraded":"2023-05-17T14:53:52.885492+0000","last_fullsized":"2023-05-17T14:53:52.885492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905425+0000","last_change":"2023-05-17T14:53:52.897228+0000","last_active":"2023-05-17T14:53:52.905425+0000","last_peered":"2023-05-17T14:53:52.905425+0000","last_clean":"2023-05-17T14:53:52.905425+0000","last_became_active":"2023-05-17T14:53:52.896713+0000","last_became_peered":"2023-05-17T14:53:52.896713+0000","last_unstale":"2023-05-17T14:53:52.905425+0000","last_undegraded":"2023-05-17T14:53:52.905425+0000","last_fullsized":"2023-05-17T14:53:52.905425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886282+0000","last_change":"2023-05-17T14:53:52.511403+0000","last_active":"2023-05-17T14:53:52.886282+0000","last_peered":"2023-05-17T14:53:52.886282+0000","last_clean":"2023-05-17T14:53:52.886282+0000","last_became_active":"2023-05-17T14:53:52.510928+0000","last_became_peered":"2023-05-17T14:53:52.510928+0000","last_unstale":"2023-05-17T14:53:52.886282+0000","last_undegraded":"2023-05-17T14:53:52.886282+0000","last_fullsized":"2023-05-17T14:53:52.886282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.899143+0000","last_change":"2023-05-17T14:53:52.893358+0000","last_active":"2023-05-17T14:53:52.899143+0000","last_peered":"2023-05-17T14:53:52.899143+0000","last_clean":"2023-05-17T14:53:52.899143+0000","last_became_active":"2023-05-17T14:53:52.893025+0000","last_became_peered":"2023-05-17T14:53:52.893025+0000","last_unstale":"2023-05-17T14:53:52.899143+0000","last_undegraded":"2023-05-17T14:53:52.899143+0000","last_fullsized":"2023-05-17T14:53:52.899143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.891615+0000","last_change":"2023-05-17T14:53:52.512447+0000","last_active":"2023-05-17T14:53:52.891615+0000","last_peered":"2023-05-17T14:53:52.891615+0000","last_clean":"2023-05-17T14:53:52.891615+0000","last_became_active":"2023-05-17T14:53:52.511951+0000","last_became_peered":"2023-05-17T14:53:52.511951+0000","last_unstale":"2023-05-17T14:53:52.891615+0000","last_undegraded":"2023-05-17T14:53:52.891615+0000","last_fullsized":"2023-05-17T14:53:52.891615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906636+0000","last_change":"2023-05-17T14:53:52.899902+0000","last_active":"2023-05-17T14:53:52.906636+0000","last_peered":"2023-05-17T14:53:52.906636+0000","last_clean":"2023-05-17T14:53:52.906636+0000","last_became_active":"2023-05-17T14:53:52.899381+0000","last_became_peered":"2023-05-17T14:53:52.899381+0000","last_unstale":"2023-05-17T14:53:52.906636+0000","last_undegraded":"2023-05-17T14:53:52.906636+0000","last_fullsized":"2023-05-17T14:53:52.906636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879769+0000","last_change":"2023-05-17T14:53:52.515232+0000","last_active":"2023-05-17T14:53:52.879769+0000","last_peered":"2023-05-17T14:53:52.879769+0000","last_clean":"2023-05-17T14:53:52.879769+0000","last_became_active":"2023-05-17T14:53:52.514555+0000","last_became_peered":"2023-05-17T14:53:52.514555+0000","last_unstale":"2023-05-17T14:53:52.879769+0000","last_undegraded":"2023-05-17T14:53:52.879769+0000","last_fullsized":"2023-05-17T14:53:52.879769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906744+0000","last_change":"2023-05-17T14:53:52.903058+0000","last_active":"2023-05-17T14:53:52.906744+0000","last_peered":"2023-05-17T14:53:52.906744+0000","last_clean":"2023-05-17T14:53:52.906744+0000","last_became_active":"2023-05-17T14:53:52.902615+0000","last_became_peered":"2023-05-17T14:53:52.902615+0000","last_unstale":"2023-05-17T14:53:52.906744+0000","last_undegraded":"2023-05-17T14:53:52.906744+0000","last_fullsized":"2023-05-17T14:53:52.906744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887739+0000","last_change":"2023-05-17T14:53:52.513421+0000","last_active":"2023-05-17T14:53:52.887739+0000","last_peered":"2023-05-17T14:53:52.887739+0000","last_clean":"2023-05-17T14:53:52.887739+0000","last_became_active":"2023-05-17T14:53:52.513120+0000","last_became_peered":"2023-05-17T14:53:52.513120+0000","last_unstale":"2023-05-17T14:53:52.887739+0000","last_undegraded":"2023-05-17T14:53:52.887739+0000","last_fullsized":"2023-05-17T14:53:52.887739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906476+0000","last_change":"2023-05-17T14:53:52.899077+0000","last_active":"2023-05-17T14:53:52.906476+0000","last_peered":"2023-05-17T14:53:52.906476+0000","last_clean":"2023-05-17T14:53:52.906476+0000","last_became_active":"2023-05-17T14:53:52.898767+0000","last_became_peered":"2023-05-17T14:53:52.898767+0000","last_unstale":"2023-05-17T14:53:52.906476+0000","last_undegraded":"2023-05-17T14:53:52.906476+0000","last_fullsized":"2023-05-17T14:53:52.906476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-17T14:53:54.178241+0000","last_change":"2023-05-17T14:53:52.502548+0000","last_active":"2023-05-17T14:53:54.178241+0000","last_peered":"2023-05-17T14:53:54.178241+0000","last_clean":"2023-05-17T14:53:54.178241+0000","last_became_active":"2023-05-17T14:53:52.501702+0000","last_became_peered":"2023-05-17T14:53:52.501702+0000","last_unstale":"2023-05-17T14:53:54.178241+0000","last_undegraded":"2023-05-17T14:53:54.178241+0000","last_fullsized":"2023-05-17T14:53:54.178241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901668+0000","last_change":"2023-05-17T14:53:52.897118+0000","last_active":"2023-05-17T14:53:52.901668+0000","last_peered":"2023-05-17T14:53:52.901668+0000","last_clean":"2023-05-17T14:53:52.901668+0000","last_became_active":"2023-05-17T14:53:52.896806+0000","last_became_peered":"2023-05-17T14:53:52.896806+0000","last_unstale":"2023-05-17T14:53:52.901668+0000","last_undegraded":"2023-05-17T14:53:52.901668+0000","last_fullsized":"2023-05-17T14:53:52.901668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.880255+0000","last_change":"2023-05-17T14:53:52.507358+0000","last_active":"2023-05-17T14:53:52.880255+0000","last_peered":"2023-05-17T14:53:52.880255+0000","last_clean":"2023-05-17T14:53:52.880255+0000","last_became_active":"2023-05-17T14:53:52.507091+0000","last_became_peered":"2023-05-17T14:53:52.507091+0000","last_unstale":"2023-05-17T14:53:52.880255+0000","last_undegraded":"2023-05-17T14:53:52.880255+0000","last_fullsized":"2023-05-17T14:53:52.880255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910197+0000","last_change":"2023-05-17T14:53:52.908557+0000","last_active":"2023-05-17T14:53:52.910197+0000","last_peered":"2023-05-17T14:53:52.910197+0000","last_clean":"2023-05-17T14:53:52.910197+0000","last_became_active":"2023-05-17T14:53:52.908298+0000","last_became_peered":"2023-05-17T14:53:52.908298+0000","last_unstale":"2023-05-17T14:53:52.910197+0000","last_undegraded":"2023-05-17T14:53:52.910197+0000","last_fullsized":"2023-05-17T14:53:52.910197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885994+0000","last_change":"2023-05-17T14:53:52.512296+0000","last_active":"2023-05-17T14:53:52.885994+0000","last_peered":"2023-05-17T14:53:52.885994+0000","last_clean":"2023-05-17T14:53:52.885994+0000","last_became_active":"2023-05-17T14:53:52.512018+0000","last_became_peered":"2023-05-17T14:53:52.512018+0000","last_unstale":"2023-05-17T14:53:52.885994+0000","last_undegraded":"2023-05-17T14:53:52.885994+0000","last_fullsized":"2023-05-17T14:53:52.885994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909007+0000","last_change":"2023-05-17T14:53:52.904120+0000","last_active":"2023-05-17T14:53:52.909007+0000","last_peered":"2023-05-17T14:53:52.909007+0000","last_clean":"2023-05-17T14:53:52.909007+0000","last_became_active":"2023-05-17T14:53:52.903622+0000","last_became_peered":"2023-05-17T14:53:52.903622+0000","last_unstale":"2023-05-17T14:53:52.909007+0000","last_undegraded":"2023-05-17T14:53:52.909007+0000","last_fullsized":"2023-05-17T14:53:52.909007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879391+0000","last_change":"2023-05-17T14:53:52.514693+0000","last_active":"2023-05-17T14:53:52.879391+0000","last_peered":"2023-05-17T14:53:52.879391+0000","last_clean":"2023-05-17T14:53:52.879391+0000","last_became_active":"2023-05-17T14:53:52.514371+0000","last_became_peered":"2023-05-17T14:53:52.514371+0000","last_unstale":"2023-05-17T14:53:52.879391+0000","last_undegraded":"2023-05-17T14:53:52.879391+0000","last_fullsized":"2023-05-17T14:53:52.879391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907461+0000","last_change":"2023-05-17T14:53:52.905496+0000","last_active":"2023-05-17T14:53:52.907461+0000","last_peered":"2023-05-17T14:53:52.907461+0000","last_clean":"2023-05-17T14:53:52.907461+0000","last_became_active":"2023-05-17T14:53:52.902849+0000","last_became_peered":"2023-05-17T14:53:52.902849+0000","last_unstale":"2023-05-17T14:53:52.907461+0000","last_undegraded":"2023-05-17T14:53:52.907461+0000","last_fullsized":"2023-05-17T14:53:52.907461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886660+0000","last_change":"2023-05-17T14:53:52.507074+0000","last_active":"2023-05-17T14:53:52.886660+0000","last_peered":"2023-05-17T14:53:52.886660+0000","last_clean":"2023-05-17T14:53:52.886660+0000","last_became_active":"2023-05-17T14:53:52.506648+0000","last_became_peered":"2023-05-17T14:53:52.506648+0000","last_unstale":"2023-05-17T14:53:52.886660+0000","last_undegraded":"2023-05-17T14:53:52.886660+0000","last_fullsized":"2023-05-17T14:53:52.886660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909075+0000","last_change":"2023-05-17T14:53:52.905035+0000","last_active":"2023-05-17T14:53:52.909075+0000","last_peered":"2023-05-17T14:53:52.909075+0000","last_clean":"2023-05-17T14:53:52.909075+0000","last_became_active":"2023-05-17T14:53:52.903028+0000","last_became_peered":"2023-05-17T14:53:52.903028+0000","last_unstale":"2023-05-17T14:53:52.909075+0000","last_undegraded":"2023-05-17T14:53:52.909075+0000","last_fullsized":"2023-05-17T14:53:52.909075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896399+0000","last_change":"2023-05-17T14:53:52.510568+0000","last_active":"2023-05-17T14:53:52.896399+0000","last_peered":"2023-05-17T14:53:52.896399+0000","last_clean":"2023-05-17T14:53:52.896399+0000","last_became_active":"2023-05-17T14:53:52.510243+0000","last_became_peered":"2023-05-17T14:53:52.510243+0000","last_unstale":"2023-05-17T14:53:52.896399+0000","last_undegraded":"2023-05-17T14:53:52.896399+0000","last_fullsized":"2023-05-17T14:53:52.896399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900510+0000","last_change":"2023-05-17T14:53:52.899184+0000","last_active":"2023-05-17T14:53:52.900510+0000","last_peered":"2023-05-17T14:53:52.900510+0000","last_clean":"2023-05-17T14:53:52.900510+0000","last_became_active":"2023-05-17T14:53:52.898867+0000","last_became_peered":"2023-05-17T14:53:52.898867+0000","last_unstale":"2023-05-17T14:53:52.900510+0000","last_undegraded":"2023-05-17T14:53:52.900510+0000","last_fullsized":"2023-05-17T14:53:52.900510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.889663+0000","last_change":"2023-05-17T14:53:52.499276+0000","last_active":"2023-05-17T14:53:52.889663+0000","last_peered":"2023-05-17T14:53:52.889663+0000","last_clean":"2023-05-17T14:53:52.889663+0000","last_became_active":"2023-05-17T14:53:52.498250+0000","last_became_peered":"2023-05-17T14:53:52.498250+0000","last_unstale":"2023-05-17T14:53:52.889663+0000","last_undegraded":"2023-05-17T14:53:52.889663+0000","last_fullsized":"2023-05-17T14:53:52.889663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905444+0000","last_change":"2023-05-17T14:53:52.903548+0000","last_active":"2023-05-17T14:53:52.905444+0000","last_peered":"2023-05-17T14:53:52.905444+0000","last_clean":"2023-05-17T14:53:52.905444+0000","last_became_active":"2023-05-17T14:53:52.903278+0000","last_became_peered":"2023-05-17T14:53:52.903278+0000","last_unstale":"2023-05-17T14:53:52.905444+0000","last_undegraded":"2023-05-17T14:53:52.905444+0000","last_fullsized":"2023-05-17T14:53:52.905444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896027+0000","last_change":"2023-05-17T14:53:52.504834+0000","last_active":"2023-05-17T14:53:52.896027+0000","last_peered":"2023-05-17T14:53:52.896027+0000","last_clean":"2023-05-17T14:53:52.896027+0000","last_became_active":"2023-05-17T14:53:52.504516+0000","last_became_peered":"2023-05-17T14:53:52.504516+0000","last_unstale":"2023-05-17T14:53:52.896027+0000","last_undegraded":"2023-05-17T14:53:52.896027+0000","last_fullsized":"2023-05-17T14:53:52.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906617+0000","last_change":"2023-05-17T14:53:52.899616+0000","last_active":"2023-05-17T14:53:52.906617+0000","last_peered":"2023-05-17T14:53:52.906617+0000","last_clean":"2023-05-17T14:53:52.906617+0000","last_became_active":"2023-05-17T14:53:52.899304+0000","last_became_peered":"2023-05-17T14:53:52.899304+0000","last_unstale":"2023-05-17T14:53:52.906617+0000","last_undegraded":"2023-05-17T14:53:52.906617+0000","last_fullsized":"2023-05-17T14:53:52.906617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883276+0000","last_change":"2023-05-17T14:53:52.498387+0000","last_active":"2023-05-17T14:53:52.883276+0000","last_peered":"2023-05-17T14:53:52.883276+0000","last_clean":"2023-05-17T14:53:52.883276+0000","last_became_active":"2023-05-17T14:53:52.498124+0000","last_became_peered":"2023-05-17T14:53:52.498124+0000","last_unstale":"2023-05-17T14:53:52.883276+0000","last_undegraded":"2023-05-17T14:53:52.883276+0000","last_fullsized":"2023-05-17T14:53:52.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907377+0000","last_change":"2023-05-17T14:53:52.900446+0000","last_active":"2023-05-17T14:53:52.907377+0000","last_peered":"2023-05-17T14:53:52.907377+0000","last_clean":"2023-05-17T14:53:52.907377+0000","last_became_active":"2023-05-17T14:53:52.899252+0000","last_became_peered":"2023-05-17T14:53:52.899252+0000","last_unstale":"2023-05-17T14:53:52.907377+0000","last_undegraded":"2023-05-17T14:53:52.907377+0000","last_fullsized":"2023-05-17T14:53:52.907377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.886699+0000","last_change":"2023-05-17T14:53:52.507558+0000","last_active":"2023-05-17T14:53:52.886699+0000","last_peered":"2023-05-17T14:53:52.886699+0000","last_clean":"2023-05-17T14:53:52.886699+0000","last_became_active":"2023-05-17T14:53:52.507272+0000","last_became_peered":"2023-05-17T14:53:52.507272+0000","last_unstale":"2023-05-17T14:53:52.886699+0000","last_undegraded":"2023-05-17T14:53:52.886699+0000","last_fullsized":"2023-05-17T14:53:52.886699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910217+0000","last_change":"2023-05-17T14:53:52.908565+0000","last_active":"2023-05-17T14:53:52.910217+0000","last_peered":"2023-05-17T14:53:52.910217+0000","last_clean":"2023-05-17T14:53:52.910217+0000","last_became_active":"2023-05-17T14:53:52.908327+0000","last_became_peered":"2023-05-17T14:53:52.908327+0000","last_unstale":"2023-05-17T14:53:52.910217+0000","last_undegraded":"2023-05-17T14:53:52.910217+0000","last_fullsized":"2023-05-17T14:53:52.910217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905977+0000","last_change":"2023-05-17T14:53:52.507620+0000","last_active":"2023-05-17T14:53:52.905977+0000","last_peered":"2023-05-17T14:53:52.905977+0000","last_clean":"2023-05-17T14:53:52.905977+0000","last_became_active":"2023-05-17T14:53:52.505456+0000","last_became_peered":"2023-05-17T14:53:52.505456+0000","last_unstale":"2023-05-17T14:53:52.905977+0000","last_undegraded":"2023-05-17T14:53:52.905977+0000","last_fullsized":"2023-05-17T14:53:52.905977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905309+0000","last_change":"2023-05-17T14:53:52.898134+0000","last_active":"2023-05-17T14:53:52.905309+0000","last_peered":"2023-05-17T14:53:52.905309+0000","last_clean":"2023-05-17T14:53:52.905309+0000","last_became_active":"2023-05-17T14:53:52.897754+0000","last_became_peered":"2023-05-17T14:53:52.897754+0000","last_unstale":"2023-05-17T14:53:52.905309+0000","last_undegraded":"2023-05-17T14:53:52.905309+0000","last_fullsized":"2023-05-17T14:53:52.905309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887367+0000","last_change":"2023-05-17T14:53:52.498029+0000","last_active":"2023-05-17T14:53:52.887367+0000","last_peered":"2023-05-17T14:53:52.887367+0000","last_clean":"2023-05-17T14:53:52.887367+0000","last_became_active":"2023-05-17T14:53:52.497667+0000","last_became_peered":"2023-05-17T14:53:52.497667+0000","last_unstale":"2023-05-17T14:53:52.887367+0000","last_undegraded":"2023-05-17T14:53:52.887367+0000","last_fullsized":"2023-05-17T14:53:52.887367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908878+0000","last_change":"2023-05-17T14:53:52.903794+0000","last_active":"2023-05-17T14:53:52.908878+0000","last_peered":"2023-05-17T14:53:52.908878+0000","last_clean":"2023-05-17T14:53:52.908878+0000","last_became_active":"2023-05-17T14:53:52.903482+0000","last_became_peered":"2023-05-17T14:53:52.903482+0000","last_unstale":"2023-05-17T14:53:52.908878+0000","last_undegraded":"2023-05-17T14:53:52.908878+0000","last_fullsized":"2023-05-17T14:53:52.908878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.885250+0000","last_change":"2023-05-17T14:53:52.501031+0000","last_active":"2023-05-17T14:53:52.885250+0000","last_peered":"2023-05-17T14:53:52.885250+0000","last_clean":"2023-05-17T14:53:52.885250+0000","last_became_active":"2023-05-17T14:53:52.500624+0000","last_became_peered":"2023-05-17T14:53:52.500624+0000","last_unstale":"2023-05-17T14:53:52.885250+0000","last_undegraded":"2023-05-17T14:53:52.885250+0000","last_fullsized":"2023-05-17T14:53:52.885250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.907527+0000","last_change":"2023-05-17T14:53:52.904355+0000","last_active":"2023-05-17T14:53:52.907527+0000","last_peered":"2023-05-17T14:53:52.907527+0000","last_clean":"2023-05-17T14:53:52.907527+0000","last_became_active":"2023-05-17T14:53:52.901353+0000","last_became_peered":"2023-05-17T14:53:52.901353+0000","last_unstale":"2023-05-17T14:53:52.907527+0000","last_undegraded":"2023-05-17T14:53:52.907527+0000","last_fullsized":"2023-05-17T14:53:52.907527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900169+0000","last_change":"2023-05-17T14:53:52.509583+0000","last_active":"2023-05-17T14:53:52.900169+0000","last_peered":"2023-05-17T14:53:52.900169+0000","last_clean":"2023-05-17T14:53:52.900169+0000","last_became_active":"2023-05-17T14:53:52.509033+0000","last_became_peered":"2023-05-17T14:53:52.509033+0000","last_unstale":"2023-05-17T14:53:52.900169+0000","last_undegraded":"2023-05-17T14:53:52.900169+0000","last_fullsized":"2023-05-17T14:53:52.900169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.896099+0000","last_change":"2023-05-17T14:53:52.894065+0000","last_active":"2023-05-17T14:53:52.896099+0000","last_peered":"2023-05-17T14:53:52.896099+0000","last_clean":"2023-05-17T14:53:52.896099+0000","last_became_active":"2023-05-17T14:53:52.893755+0000","last_became_peered":"2023-05-17T14:53:52.893755+0000","last_unstale":"2023-05-17T14:53:52.896099+0000","last_undegraded":"2023-05-17T14:53:52.896099+0000","last_fullsized":"2023-05-17T14:53:52.896099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909266+0000","last_change":"2023-05-17T14:53:52.507353+0000","last_active":"2023-05-17T14:53:52.909266+0000","last_peered":"2023-05-17T14:53:52.909266+0000","last_clean":"2023-05-17T14:53:52.909266+0000","last_became_active":"2023-05-17T14:53:52.506014+0000","last_became_peered":"2023-05-17T14:53:52.506014+0000","last_unstale":"2023-05-17T14:53:52.909266+0000","last_undegraded":"2023-05-17T14:53:52.909266+0000","last_fullsized":"2023-05-17T14:53:52.909266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905670+0000","last_change":"2023-05-17T14:53:52.897660+0000","last_active":"2023-05-17T14:53:52.905670+0000","last_peered":"2023-05-17T14:53:52.905670+0000","last_clean":"2023-05-17T14:53:52.905670+0000","last_became_active":"2023-05-17T14:53:52.897344+0000","last_became_peered":"2023-05-17T14:53:52.897344+0000","last_unstale":"2023-05-17T14:53:52.905670+0000","last_undegraded":"2023-05-17T14:53:52.905670+0000","last_fullsized":"2023-05-17T14:53:52.905670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.893946+0000","last_change":"2023-05-17T14:53:52.504680+0000","last_active":"2023-05-17T14:53:52.893946+0000","last_peered":"2023-05-17T14:53:52.893946+0000","last_clean":"2023-05-17T14:53:52.893946+0000","last_became_active":"2023-05-17T14:53:52.504385+0000","last_became_peered":"2023-05-17T14:53:52.504385+0000","last_unstale":"2023-05-17T14:53:52.893946+0000","last_undegraded":"2023-05-17T14:53:52.893946+0000","last_fullsized":"2023-05-17T14:53:52.893946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906580+0000","last_change":"2023-05-17T14:53:52.899592+0000","last_active":"2023-05-17T14:53:52.906580+0000","last_peered":"2023-05-17T14:53:52.906580+0000","last_clean":"2023-05-17T14:53:52.906580+0000","last_became_active":"2023-05-17T14:53:52.899272+0000","last_became_peered":"2023-05-17T14:53:52.899272+0000","last_unstale":"2023-05-17T14:53:52.906580+0000","last_undegraded":"2023-05-17T14:53:52.906580+0000","last_fullsized":"2023-05-17T14:53:52.906580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887745+0000","last_change":"2023-05-17T14:53:52.502007+0000","last_active":"2023-05-17T14:53:52.887745+0000","last_peered":"2023-05-17T14:53:52.887745+0000","last_clean":"2023-05-17T14:53:52.887745+0000","last_became_active":"2023-05-17T14:53:52.501336+0000","last_became_peered":"2023-05-17T14:53:52.501336+0000","last_unstale":"2023-05-17T14:53:52.887745+0000","last_undegraded":"2023-05-17T14:53:52.887745+0000","last_fullsized":"2023-05-17T14:53:52.887745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909028+0000","last_change":"2023-05-17T14:53:52.904025+0000","last_active":"2023-05-17T14:53:52.909028+0000","last_peered":"2023-05-17T14:53:52.909028+0000","last_clean":"2023-05-17T14:53:52.909028+0000","last_became_active":"2023-05-17T14:53:52.903652+0000","last_became_peered":"2023-05-17T14:53:52.903652+0000","last_unstale":"2023-05-17T14:53:52.909028+0000","last_undegraded":"2023-05-17T14:53:52.909028+0000","last_fullsized":"2023-05-17T14:53:52.909028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.883073+0000","last_change":"2023-05-17T14:53:52.502927+0000","last_active":"2023-05-17T14:53:52.883073+0000","last_peered":"2023-05-17T14:53:52.883073+0000","last_clean":"2023-05-17T14:53:52.883073+0000","last_became_active":"2023-05-17T14:53:52.502633+0000","last_became_peered":"2023-05-17T14:53:52.502633+0000","last_unstale":"2023-05-17T14:53:52.883073+0000","last_undegraded":"2023-05-17T14:53:52.883073+0000","last_fullsized":"2023-05-17T14:53:52.883073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895093+0000","last_change":"2023-05-17T14:53:52.892437+0000","last_active":"2023-05-17T14:53:52.895093+0000","last_peered":"2023-05-17T14:53:52.895093+0000","last_clean":"2023-05-17T14:53:52.895093+0000","last_became_active":"2023-05-17T14:53:52.892121+0000","last_became_peered":"2023-05-17T14:53:52.892121+0000","last_unstale":"2023-05-17T14:53:52.895093+0000","last_undegraded":"2023-05-17T14:53:52.895093+0000","last_fullsized":"2023-05-17T14:53:52.895093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.879753+0000","last_change":"2023-05-17T14:53:52.511006+0000","last_active":"2023-05-17T14:53:52.879753+0000","last_peered":"2023-05-17T14:53:52.879753+0000","last_clean":"2023-05-17T14:53:52.879753+0000","last_became_active":"2023-05-17T14:53:52.510651+0000","last_became_peered":"2023-05-17T14:53:52.510651+0000","last_unstale":"2023-05-17T14:53:52.879753+0000","last_undegraded":"2023-05-17T14:53:52.879753+0000","last_fullsized":"2023-05-17T14:53:52.879753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.905331+0000","last_change":"2023-05-17T14:53:52.898513+0000","last_active":"2023-05-17T14:53:52.905331+0000","last_peered":"2023-05-17T14:53:52.905331+0000","last_clean":"2023-05-17T14:53:52.905331+0000","last_became_active":"2023-05-17T14:53:52.898159+0000","last_became_peered":"2023-05-17T14:53:52.898159+0000","last_unstale":"2023-05-17T14:53:52.905331+0000","last_undegraded":"2023-05-17T14:53:52.905331+0000","last_fullsized":"2023-05-17T14:53:52.905331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.882773+0000","last_change":"2023-05-17T14:53:52.512519+0000","last_active":"2023-05-17T14:53:52.882773+0000","last_peered":"2023-05-17T14:53:52.882773+0000","last_clean":"2023-05-17T14:53:52.882773+0000","last_became_active":"2023-05-17T14:53:52.512220+0000","last_became_peered":"2023-05-17T14:53:52.512220+0000","last_unstale":"2023-05-17T14:53:52.882773+0000","last_undegraded":"2023-05-17T14:53:52.882773+0000","last_fullsized":"2023-05-17T14:53:52.882773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.909559+0000","last_change":"2023-05-17T14:53:52.907268+0000","last_active":"2023-05-17T14:53:52.909559+0000","last_peered":"2023-05-17T14:53:52.909559+0000","last_clean":"2023-05-17T14:53:52.909559+0000","last_became_active":"2023-05-17T14:53:52.906591+0000","last_became_peered":"2023-05-17T14:53:52.906591+0000","last_unstale":"2023-05-17T14:53:52.909559+0000","last_undegraded":"2023-05-17T14:53:52.909559+0000","last_fullsized":"2023-05-17T14:53:52.909559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.897695+0000","last_change":"2023-05-17T14:53:52.506059+0000","last_active":"2023-05-17T14:53:52.897695+0000","last_peered":"2023-05-17T14:53:52.897695+0000","last_clean":"2023-05-17T14:53:52.897695+0000","last_became_active":"2023-05-17T14:53:52.505710+0000","last_became_peered":"2023-05-17T14:53:52.505710+0000","last_unstale":"2023-05-17T14:53:52.897695+0000","last_undegraded":"2023-05-17T14:53:52.897695+0000","last_fullsized":"2023-05-17T14:53:52.897695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901344+0000","last_change":"2023-05-17T14:53:52.897282+0000","last_active":"2023-05-17T14:53:52.901344+0000","last_peered":"2023-05-17T14:53:52.901344+0000","last_clean":"2023-05-17T14:53:52.901344+0000","last_became_active":"2023-05-17T14:53:52.896992+0000","last_became_peered":"2023-05-17T14:53:52.896992+0000","last_unstale":"2023-05-17T14:53:52.901344+0000","last_undegraded":"2023-05-17T14:53:52.901344+0000","last_fullsized":"2023-05-17T14:53:52.901344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895784+0000","last_change":"2023-05-17T14:53:52.511809+0000","last_active":"2023-05-17T14:53:52.895784+0000","last_peered":"2023-05-17T14:53:52.895784+0000","last_clean":"2023-05-17T14:53:52.895784+0000","last_became_active":"2023-05-17T14:53:52.511486+0000","last_became_peered":"2023-05-17T14:53:52.511486+0000","last_unstale":"2023-05-17T14:53:52.895784+0000","last_undegraded":"2023-05-17T14:53:52.895784+0000","last_fullsized":"2023-05-17T14:53:52.895784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.910222+0000","last_change":"2023-05-17T14:53:52.909184+0000","last_active":"2023-05-17T14:53:52.910222+0000","last_peered":"2023-05-17T14:53:52.910222+0000","last_clean":"2023-05-17T14:53:52.910222+0000","last_became_active":"2023-05-17T14:53:52.908851+0000","last_became_peered":"2023-05-17T14:53:52.908851+0000","last_unstale":"2023-05-17T14:53:52.910222+0000","last_undegraded":"2023-05-17T14:53:52.910222+0000","last_fullsized":"2023-05-17T14:53:52.910222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.895604+0000","last_change":"2023-05-17T14:53:52.512162+0000","last_active":"2023-05-17T14:53:52.895604+0000","last_peered":"2023-05-17T14:53:52.895604+0000","last_clean":"2023-05-17T14:53:52.895604+0000","last_became_active":"2023-05-17T14:53:52.511653+0000","last_became_peered":"2023-05-17T14:53:52.511653+0000","last_unstale":"2023-05-17T14:53:52.895604+0000","last_undegraded":"2023-05-17T14:53:52.895604+0000","last_fullsized":"2023-05-17T14:53:52.895604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.906723+0000","last_change":"2023-05-17T14:53:52.900703+0000","last_active":"2023-05-17T14:53:52.906723+0000","last_peered":"2023-05-17T14:53:52.906723+0000","last_clean":"2023-05-17T14:53:52.906723+0000","last_became_active":"2023-05-17T14:53:52.900419+0000","last_became_peered":"2023-05-17T14:53:52.900419+0000","last_unstale":"2023-05-17T14:53:52.906723+0000","last_undegraded":"2023-05-17T14:53:52.906723+0000","last_fullsized":"2023-05-17T14:53:52.906723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.888598+0000","last_change":"2023-05-17T14:53:52.509848+0000","last_active":"2023-05-17T14:53:52.888598+0000","last_peered":"2023-05-17T14:53:52.888598+0000","last_clean":"2023-05-17T14:53:52.888598+0000","last_became_active":"2023-05-17T14:53:52.509559+0000","last_became_peered":"2023-05-17T14:53:52.509559+0000","last_unstale":"2023-05-17T14:53:52.888598+0000","last_undegraded":"2023-05-17T14:53:52.888598+0000","last_fullsized":"2023-05-17T14:53:52.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.900610+0000","last_change":"2023-05-17T14:53:52.897408+0000","last_active":"2023-05-17T14:53:52.900610+0000","last_peered":"2023-05-17T14:53:52.900610+0000","last_clean":"2023-05-17T14:53:52.900610+0000","last_became_active":"2023-05-17T14:53:52.897133+0000","last_became_peered":"2023-05-17T14:53:52.897133+0000","last_unstale":"2023-05-17T14:53:52.900610+0000","last_undegraded":"2023-05-17T14:53:52.900610+0000","last_fullsized":"2023-05-17T14:53:52.900610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.887886+0000","last_change":"2023-05-17T14:53:52.505784+0000","last_active":"2023-05-17T14:53:52.887886+0000","last_peered":"2023-05-17T14:53:52.887886+0000","last_clean":"2023-05-17T14:53:52.887886+0000","last_became_active":"2023-05-17T14:53:52.505481+0000","last_became_peered":"2023-05-17T14:53:52.505481+0000","last_unstale":"2023-05-17T14:53:52.887886+0000","last_undegraded":"2023-05-17T14:53:52.887886+0000","last_fullsized":"2023-05-17T14:53:52.887886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.908743+0000","last_change":"2023-05-17T14:53:52.905997+0000","last_active":"2023-05-17T14:53:52.908743+0000","last_peered":"2023-05-17T14:53:52.908743+0000","last_clean":"2023-05-17T14:53:52.908743+0000","last_became_active":"2023-05-17T14:53:52.905547+0000","last_became_peered":"2023-05-17T14:53:52.905547+0000","last_unstale":"2023-05-17T14:53:52.908743+0000","last_undegraded":"2023-05-17T14:53:52.908743+0000","last_fullsized":"2023-05-17T14:53:52.908743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:52.478115+0000","last_clean_scrub_stamp":"2023-05-17T14:53:52.478115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-17T14:53:52.901796+0000","last_change":"2023-05-17T14:53:52.503841+0000","last_active":"2023-05-17T14:53:52.901796+0000","last_peered":"2023-05-17T14:53:52.901796+0000","last_clean":"2023-05-17T14:53:52.901796+0000","last_became_active":"2023-05-17T14:53:52.502924+0000","last_became_peered":"2023-05-17T14:53:52.502924+0000","last_unstale":"2023-05-17T14:53:52.901796+0000","last_undegraded":"2023-05-17T14:53:52.901796+0000","last_fullsized":"2023-05-17T14:53:52.901796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:51.475688+0000","last_clean_scrub_stamp":"2023-05-17T14:53:51.475688+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":86751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":86783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5100,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366740,"statfs":{"total":96636764160,"available":96631541760,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T14:54:04.059 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-17T14:54:04.059 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-17T14:54:04.059 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-17T14:54:04.060 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-17T14:54:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.202+0000 7f4c49a2c700 1 Processor -- start 2023-05-17T14:54:04.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.202+0000 7f4c49a2c700 1 -- start start 2023-05-17T14:54:04.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.203+0000 7f4c49a2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c440c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.203+0000 7f4c49a2c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c44158880 0x7f4c44153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.203+0000 7f4c49a2c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c440bfcd0 con 0x7f4c441541c0 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.203+0000 7f4c49a2c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c440c0290 con 0x7f4c44158880 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.203+0000 7f4c49a2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440aa1a0 con 0x7f4c440c5f30 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c42ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c440c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c427fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c44158880 0x7f4c44153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c42ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c440c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35256/0 (socket says 172.21.15.27:35256) 2023-05-17T14:54:04.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c42ffd700 1 -- 172.21.15.27:0/853453617 learned_addr learned my addr 172.21.15.27:0/853453617 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c427fc700 1 -- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 msgr2=0x7f4c440c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c427fc700 1 --2- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c440c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c427fc700 1 -- 172.21.15.27:0/853453617 >> v1:172.21.15.40:6789/0 conn(0x7f4c441541c0 legacy=0x7f4c440c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c427fc700 1 -- 172.21.15.27:0/853453617 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440aa480 con 0x7f4c44158880 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c42ffd700 1 --2- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c440c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c427fc700 1 --2- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c44158880 0x7f4c44153cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4c38009760 tx=0x7f4c38009060).ready entity=mon.1 client_cookie=3e0acc52f5ae4bee server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c41ffb700 1 -- 172.21.15.27:0/853453617 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800f510 con 0x7f4c44158880 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c41ffb700 1 -- 172.21.15.27:0/853453617 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3800f670 con 0x7f4c44158880 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.204+0000 7f4c41ffb700 1 -- 172.21.15.27:0/853453617 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800f9f0 con 0x7f4c44158880 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 -- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c44158880 msgr2=0x7f4c44153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c44158880 0x7f4c44153cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4c38009760 tx=0x7f4c38009060).stop 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 -- 172.21.15.27:0/853453617 shutdown_connections 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c440c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/853453617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c44158880 0x7f4c44153cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 -- 172.21.15.27:0/853453617 >> 172.21.15.27:0/853453617 conn(0x7f4c44069e70 msgr2=0x7f4c4405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 -- 172.21.15.27:0/853453617 shutdown_connections 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.205+0000 7f4c49a2c700 1 -- 172.21.15.27:0/853453617 wait complete. 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.206+0000 7f4c49a2c700 1 Processor -- start 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.206+0000 7f4c49a2c700 1 -- start start 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c49a2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c4413e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c49a2c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c441541c0 0x7f4c441529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c49a2c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 0x7f4c44152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c49a2c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44153390 con 0x7f4c44158880 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c49a2c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44151420 con 0x7f4c441541c0 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c49a2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44150af0 con 0x7f4c440c5f30 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 0x7f4c44152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 0x7f4c44152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34156/0 (socket says 172.21.15.27:34156) 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c42ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c4413e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 -- 172.21.15.27:0/3418600946 learned_addr learned my addr 172.21.15.27:0/3418600946 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c427fc700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c441541c0 0x7f4c441529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 -- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 msgr2=0x7f4c4413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c4413e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 -- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c441541c0 msgr2=0x7f4c441529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c441541c0 0x7f4c441529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 -- 172.21.15.27:0/3418600946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009ae0 con 0x7f4c44158880 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c42ffd700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c4413e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.207+0000 7f4c437fe700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 0x7f4c44152ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f4c3400c440 tx=0x7f4c34007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.208+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c340123f0 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.208+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34001e90 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.208+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c380092a0 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.208+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34012760 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.208+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c441510b0 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.209+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4405f4a0 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.209+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4c34010070 con 0x7f4c44158880 2023-05-17T14:54:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.209+0000 7f4c2affd700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4c3005ed60 0x7f4c30061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.209+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c34078c90 con 0x7f4c44158880 2023-05-17T14:54:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.209+0000 7f4c42ffd700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4c3005ed60 0x7f4c30061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.210+0000 7f4c42ffd700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4c3005ed60 0x7f4c30061220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4c3c0072d0 tx=0x7f4c3c00b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.213+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c340478f0 con 0x7f4c44158880 2023-05-17T14:54:04.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.426+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c4406bdf0 con 0x7f4c44158880 2023-05-17T14:54:04.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.426+0000 7f4c2affd700 1 -- 172.21.15.27:0/3418600946 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f4c3404a230 con 0x7f4c44158880 2023-05-17T14:54:04.430 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:04.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4c3005ed60 msgr2=0x7f4c30061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4c3005ed60 0x7f4c30061220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4c3c0072d0 tx=0x7f4c3c00b040).stop 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 msgr2=0x7f4c44152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 0x7f4c44152ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f4c3400c440 tx=0x7f4c34007d70).stop 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 shutdown_connections 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4c3005ed60 0x7f4c30061220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c44158880 0x7f4c44152ea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c440c5f30 0x7f4c4413e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 --2- 172.21.15.27:0/3418600946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c441541c0 0x7f4c441529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 >> 172.21.15.27:0/3418600946 conn(0x7f4c44069e70 msgr2=0x7f4c440ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:04.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 shutdown_connections 2023-05-17T14:54:04.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.428+0000 7f4c49a2c700 1 -- 172.21.15.27:0/3418600946 wait complete. 2023-05-17T14:54:04.443 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-17T14:54:04.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-17T14:54:04.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:04.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.560+0000 7f3242afb700 1 Processor -- start 2023-05-17T14:54:04.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.560+0000 7f3242afb700 1 -- start start 2023-05-17T14:54:04.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3242afb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f323c0c5f30 0x7f323c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3242afb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c158880 0x7f323c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3242afb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c0bfcd0 con 0x7f323c1541c0 2023-05-17T14:54:04.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3242afb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c0c0290 con 0x7f323c0c5f30 2023-05-17T14:54:04.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3242afb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0aa1a0 con 0x7f323c158880 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f323c0c5f30 0x7f323c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f323c0c5f30 0x7f323c0c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34160/0 (socket says 172.21.15.27:34160) 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 -- 172.21.15.27:0/2741694666 learned_addr learned my addr 172.21.15.27:0/2741694666 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f323bfff700 1 --2- 172.21.15.27:0/2741694666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c158880 0x7f323c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 -- 172.21.15.27:0/2741694666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c158880 msgr2=0x7f323c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 --2- 172.21.15.27:0/2741694666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c158880 0x7f323c153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 -- 172.21.15.27:0/2741694666 >> v1:172.21.15.40:6789/0 conn(0x7f323c1541c0 legacy=0x7f323c0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 -- 172.21.15.27:0/2741694666 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0aa480 con 0x7f323c0c5f30 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f3240897700 1 --2- 172.21.15.27:0/2741694666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c0c5f30 0x7f323c0c6310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f3230006fd0 tx=0x7f32300090f0).ready entity=mon.0 client_cookie=211cf9d46638588b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f323b7fe700 1 -- 172.21.15.27:0/2741694666 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000b580 con 0x7f323c0c5f30 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f323b7fe700 1 -- 172.21.15.27:0/2741694666 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323000b6e0 con 0x7f323c0c5f30 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.561+0000 7f323b7fe700 1 -- 172.21.15.27:0/2741694666 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000ba60 con 0x7f323c0c5f30 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 -- 172.21.15.27:0/2741694666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c0c5f30 msgr2=0x7f323c0c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 --2- 172.21.15.27:0/2741694666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c0c5f30 0x7f323c0c6310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f3230006fd0 tx=0x7f32300090f0).stop 2023-05-17T14:54:04.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 -- 172.21.15.27:0/2741694666 shutdown_connections 2023-05-17T14:54:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 --2- 172.21.15.27:0/2741694666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c0c5f30 0x7f323c0c6310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 --2- 172.21.15.27:0/2741694666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c158880 0x7f323c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 -- 172.21.15.27:0/2741694666 >> 172.21.15.27:0/2741694666 conn(0x7f323c069e70 msgr2=0x7f323c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 -- 172.21.15.27:0/2741694666 shutdown_connections 2023-05-17T14:54:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.562+0000 7f3242afb700 1 -- 172.21.15.27:0/2741694666 wait complete. 2023-05-17T14:54:04.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.563+0000 7f3242afb700 1 Processor -- start 2023-05-17T14:54:04.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.563+0000 7f3242afb700 1 -- start start 2023-05-17T14:54:04.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3242afb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c0c5f30 0x7f323c145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3242afb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 0x7f323c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3242afb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f323c158880 0x7f323c0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3242afb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1558f0 con 0x7f323c1541c0 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3242afb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c157d50 con 0x7f323c158880 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3242afb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c168cd0 con 0x7f323c0c5f30 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 0x7f323c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 0x7f323c157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34168/0 (socket says 172.21.15.27:34168) 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 -- 172.21.15.27:0/3046187166 learned_addr learned my addr 172.21.15.27:0/3046187166 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3240897700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c0c5f30 0x7f323c145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3241098700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f323c158880 0x7f323c0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 -- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c0c5f30 msgr2=0x7f323c145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c0c5f30 0x7f323c145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 -- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f323c158880 msgr2=0x7f323c0b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f323c158880 0x7f323c0b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 -- 172.21.15.27:0/3046187166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009370 con 0x7f323c1541c0 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f3241098700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f323c158880 0x7f323c0b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.564+0000 7f323bfff700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 0x7f323c157860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f322800e930 tx=0x7f3228009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.565+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228009390 con 0x7f323c1541c0 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.565+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800c640 con 0x7f323c1541c0 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.565+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800c9c0 con 0x7f323c1541c0 2023-05-17T14:54:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.565+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c1689f0 con 0x7f323c1541c0 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.565+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c155580 con 0x7f323c1541c0 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.566+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c05f4a0 con 0x7f323c1541c0 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.566+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3228022070 con 0x7f323c1541c0 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.566+0000 7f3238ff9700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f322005ed90 0x7f3220061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.566+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3228079cf0 con 0x7f323c1541c0 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.566+0000 7f3240897700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f322005ed90 0x7f3220061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.567+0000 7f3240897700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f322005ed90 0x7f3220061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3230009fd0 tx=0x7f3230017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.571+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f322804b290 con 0x7f323c1541c0 2023-05-17T14:54:04.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.745+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323c06bdf0 con 0x7f323c1541c0 2023-05-17T14:54:04.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.746+0000 7f3238ff9700 1 -- 172.21.15.27:0/3046187166 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f322804e8b0 con 0x7f323c1541c0 2023-05-17T14:54:04.750 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:04.751 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:04.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f322005ed90 msgr2=0x7f3220061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f322005ed90 0x7f3220061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3230009fd0 tx=0x7f3230017000).stop 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 msgr2=0x7f323c157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 0x7f323c157860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f322800e930 tx=0x7f3228009060).stop 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 shutdown_connections 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f322005ed90 0x7f3220061250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f323c158880 0x7f323c0b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f323c0c5f30 0x7f323c145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 --2- 172.21.15.27:0/3046187166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f323c1541c0 0x7f323c157860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 >> 172.21.15.27:0/3046187166 conn(0x7f323c069e70 msgr2=0x7f323c0cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:04.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 shutdown_connections 2023-05-17T14:54:04.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.748+0000 7f3242afb700 1 -- 172.21.15.27:0/3046187166 wait complete. 2023-05-17T14:54:04.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:04.765 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.879+0000 7faece307700 1 Processor -- start 2023-05-17T14:54:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.879+0000 7faece307700 1 -- start start 2023-05-17T14:54:04.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faece307700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faec80c6310 0x7faec8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faece307700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 0x7faec80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faece307700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec8158790 con 0x7faec81543d0 2023-05-17T14:54:04.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faece307700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec80c1c50 con 0x7faec80c6310 2023-05-17T14:54:04.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faece307700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec8157e60 con 0x7faec80691f0 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faec7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faec81543d0 0x7faec80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33736/0 (socket says 172.21.15.27:33736) 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.880+0000 7faec7fff700 1 -- 172.21.15.27:0/648104929 learned_addr learned my addr 172.21.15.27:0/648104929 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562739366 0 0) 0x7faec8158790 con 0x7faec81543d0 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 0x7faec80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb40033f0 con 0x7faec81543d0 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faebffff700 1 --2- 172.21.15.27:0/648104929 >> v2:172.21.15.40:3300/0 conn(0x7faec80c6310 0x7faec8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3426655398 0 0) 0x7faeb40033f0 con 0x7faec81543d0 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 msgr2=0x7faec80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 0x7faec80bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 >> v2:172.21.15.40:3300/0 conn(0x7faec80c6310 msgr2=0x7faec8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 --2- 172.21.15.27:0/648104929 >> v2:172.21.15.40:3300/0 conn(0x7faec80c6310 0x7faec8068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8158140 con 0x7faec81543d0 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7faeb8001470 con 0x7faec81543d0 2023-05-17T14:54:04.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 >> v1:172.21.15.27:6789/0 conn(0x7faec81543d0 legacy=0x7faec80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 0x7faeb40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb4003e10 0x7faeb4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faeb4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8157e60 con 0x7faeb4004b80 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb400b8e0 con 0x7faeb4003e10 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb400ba20 con 0x7faec80691f0 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faeb4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faebffff700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb4003e10 0x7faeb4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faec7fff700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 0x7faeb40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 -- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 msgr2=0x7faeb40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80691f0 0x7faeb40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 -- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb4003e10 msgr2=0x7faeb4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb4003e10 0x7faeb4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 -- 172.21.15.27:0/648104929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40033f0 con 0x7faeb4004b80 2023-05-17T14:54:04.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.881+0000 7faecc8a4700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faeb4005000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7faec000e240 tx=0x7faec000b040).ready entity=mon.0 client_cookie=f8b41ba58e397f95 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0009ac0 con 0x7faeb4004b80 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000f040 con 0x7faeb4004b80 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faec77fe700 1 -- 172.21.15.27:0/648104929 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000ed00 con 0x7faeb4004b80 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faece307700 1 -- 172.21.15.27:0/648104929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 msgr2=0x7faeb4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faece307700 1 --2- 172.21.15.27:0/648104929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faeb4005000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7faec000e240 tx=0x7faec000b040).stop 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faecc8a4700 1 -- 172.21.15.27:0/648104929 reap_dead start 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faece307700 1 -- 172.21.15.27:0/648104929 shutdown_connections 2023-05-17T14:54:04.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faece307700 1 -- 172.21.15.27:0/648104929 >> 172.21.15.27:0/648104929 conn(0x7faec80cb7f0 msgr2=0x7faec80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faece307700 1 -- 172.21.15.27:0/648104929 shutdown_connections 2023-05-17T14:54:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.882+0000 7faece307700 1 -- 172.21.15.27:0/648104929 wait complete. 2023-05-17T14:54:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.883+0000 7faece307700 1 Processor -- start 2023-05-17T14:54:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.883+0000 7faece307700 1 -- start start 2023-05-17T14:54:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faece307700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faec80c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faece307700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faec80c4490 0x7faec8152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faece307700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80a9e60 0x7faec80aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faece307700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8163e80 con 0x7faeb4004b80 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faece307700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80aa7d0 con 0x7faec80c4490 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faece307700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c3450 con 0x7faec80a9e60 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faec80c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faec80c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34186/0 (socket says 172.21.15.27:34186) 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 -- 172.21.15.27:0/252970897 learned_addr learned my addr 172.21.15.27:0/252970897 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faecc8a4700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80a9e60 0x7faec80aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faebffff700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faec80c4490 0x7faec8152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 -- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80a9e60 msgr2=0x7faec80aa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80a9e60 0x7faec80aa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 -- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faec80c4490 msgr2=0x7faec8152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faec80c4490 0x7faec8152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.884+0000 7faec7fff700 1 -- 172.21.15.27:0/252970897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec80c3730 con 0x7faeb4004b80 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.885+0000 7faec7fff700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faec80c2d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7faeb8004990 tx=0x7faeb8001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.885+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8004e00 con 0x7faeb4004b80 2023-05-17T14:54:04.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.885+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb800f8d0 con 0x7faeb4004b80 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.885+0000 7faece307700 1 -- 172.21.15.27:0/252970897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec80c3a10 con 0x7faeb4004b80 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.885+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800fc70 con 0x7faeb4004b80 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.885+0000 7faece307700 1 -- 172.21.15.27:0/252970897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec80c4910 con 0x7faeb4004b80 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.886+0000 7faece307700 1 -- 172.21.15.27:0/252970897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec806bdf0 con 0x7faeb4004b80 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.886+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faeb801b030 con 0x7faeb4004b80 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.886+0000 7faec4ff9700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faea805ed90 0x7faea8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:04.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.887+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faeb8079470 con 0x7faeb4004b80 2023-05-17T14:54:04.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.887+0000 7faebffff700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faea805ed90 0x7faea8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:04.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.887+0000 7faebffff700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faea805ed90 0x7faea8061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7faec8157ad0 tx=0x7faeb0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:04.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:04.891+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faeb804aa10 con 0x7faeb4004b80 2023-05-17T14:54:05.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.065+0000 7faece307700 1 -- 172.21.15.27:0/252970897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7faec8068ac0 con 0x7faeb4004b80 2023-05-17T14:54:05.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.065+0000 7faec4ff9700 1 -- 172.21.15.27:0/252970897 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7faeb8019020 con 0x7faeb4004b80 2023-05-17T14:54:05.069 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:05.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 -- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faea805ed90 msgr2=0x7faea8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faea805ed90 0x7faea8061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7faec8157ad0 tx=0x7faeb0008040).stop 2023-05-17T14:54:05.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 -- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 msgr2=0x7faec80c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faec80c2d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7faeb8004990 tx=0x7faeb8001e90).stop 2023-05-17T14:54:05.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 -- 172.21.15.27:0/252970897 shutdown_connections 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faea805ed90 0x7faea8061250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faec80a9e60 0x7faec80aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeb4004b80 0x7faec80c2d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 --2- 172.21.15.27:0/252970897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faec80c4490 0x7faec8152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 -- 172.21.15.27:0/252970897 >> 172.21.15.27:0/252970897 conn(0x7faec80cb7f0 msgr2=0x7faec8153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 -- 172.21.15.27:0/252970897 shutdown_connections 2023-05-17T14:54:05.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.067+0000 7faece307700 1 -- 172.21.15.27:0/252970897 wait complete. 2023-05-17T14:54:05.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:05.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.197+0000 7fe67eb67700 1 Processor -- start 2023-05-17T14:54:05.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.197+0000 7fe67eb67700 1 -- start start 2023-05-17T14:54:05.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe67eb67700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe678065b30 0x7fe67814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe67eb67700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe678152ab0 con 0x7fe678066170 2023-05-17T14:54:05.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe67eb67700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6781524c0 con 0x7fe67814f700 2023-05-17T14:54:05.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe67eb67700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6780c4580 con 0x7fe678065b30 2023-05-17T14:54:05.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe677fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe678065b30 0x7fe67814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe67d104700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe678066170 0x7fe6780bd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33758/0 (socket says 172.21.15.27:33758) 2023-05-17T14:54:05.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe67d104700 1 -- 172.21.15.27:0/4020279177 learned_addr learned my addr 172.21.15.27:0/4020279177 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe677fff700 1 -- 172.21.15.27:0/4020279177 >> v1:172.21.15.40:6789/0 conn(0x7fe67814f700 legacy=0x7fe678065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe677fff700 1 -- 172.21.15.27:0/4020279177 >> v1:172.21.15.27:6789/0 conn(0x7fe678066170 legacy=0x7fe6780bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.198+0000 7fe677fff700 1 -- 172.21.15.27:0/4020279177 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780c3fc0 con 0x7fe678065b30 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe677fff700 1 --2- 172.21.15.27:0/4020279177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe678065b30 0x7fe67814fae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe668009e60 tx=0x7fe668009780).ready entity=mon.0 client_cookie=567a6749223d9567 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe6777fe700 1 -- 172.21.15.27:0/4020279177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800e070 con 0x7fe678065b30 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe6777fe700 1 -- 172.21.15.27:0/4020279177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800bc30 con 0x7fe678065b30 2023-05-17T14:54:05.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe6777fe700 1 -- 172.21.15.27:0/4020279177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668012410 con 0x7fe678065b30 2023-05-17T14:54:05.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 -- 172.21.15.27:0/4020279177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe678065b30 msgr2=0x7fe67814fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 --2- 172.21.15.27:0/4020279177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe678065b30 0x7fe67814fae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe668009e60 tx=0x7fe668009780).stop 2023-05-17T14:54:05.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 -- 172.21.15.27:0/4020279177 shutdown_connections 2023-05-17T14:54:05.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 --2- 172.21.15.27:0/4020279177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe678065b30 0x7fe67814fae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 -- 172.21.15.27:0/4020279177 >> 172.21.15.27:0/4020279177 conn(0x7fe6780c9470 msgr2=0x7fe6780c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:05.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 -- 172.21.15.27:0/4020279177 shutdown_connections 2023-05-17T14:54:05.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.199+0000 7fe67eb67700 1 -- 172.21.15.27:0/4020279177 wait complete. 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.200+0000 7fe67eb67700 1 Processor -- start 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 -- start start 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe678065b30 0x7fe678157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe678066170 0x7fe67814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 0x7fe678151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67814d7a0 con 0x7fe67814f700 2023-05-17T14:54:05.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c13a0 con 0x7fe678066170 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67eb67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c25d0 con 0x7fe678065b30 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67d104700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 0x7fe678151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67d104700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 0x7fe678151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34204/0 (socket says 172.21.15.27:34204) 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67d104700 1 -- 172.21.15.27:0/1206522374 learned_addr learned my addr 172.21.15.27:0/1206522374 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe677fff700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe678066170 0x7fe67814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.201+0000 7fe67c903700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe678065b30 0x7fe678157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67d104700 1 -- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe678065b30 msgr2=0x7fe678157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67d104700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe678065b30 0x7fe678157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67d104700 1 -- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe678066170 msgr2=0x7fe67814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67d104700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe678066170 0x7fe67814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67d104700 1 -- 172.21.15.27:0/1206522374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009a20 con 0x7fe67814f700 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67d104700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 0x7fe678151800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe66000c440 tx=0x7fe660007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600070d0 con 0x7fe67814f700 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660007230 con 0x7fe67814f700 2023-05-17T14:54:05.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe678157cf0 con 0x7fe67814f700 2023-05-17T14:54:05.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600075b0 con 0x7fe67814f700 2023-05-17T14:54:05.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.202+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6780c0d50 con 0x7fe67814f700 2023-05-17T14:54:05.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.203+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678064c70 con 0x7fe67814f700 2023-05-17T14:54:05.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.203+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe660010070 con 0x7fe67814f700 2023-05-17T14:54:05.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.204+0000 7fe674ff9700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe65805ed90 0x7fe658061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.204+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe660078eb0 con 0x7fe67814f700 2023-05-17T14:54:05.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.204+0000 7fe67c903700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe65805ed90 0x7fe658061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.204+0000 7fe67c903700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe65805ed90 0x7fe658061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe670003890 tx=0x7fe670007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.208+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe66004a450 con 0x7fe67814f700 2023-05-17T14:54:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.381+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe678063970 con 0x7fe67814f700 2023-05-17T14:54:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.381+0000 7fe674ff9700 1 -- 172.21.15.27:0/1206522374 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe66004da70 con 0x7fe67814f700 2023-05-17T14:54:05.386 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:05.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe65805ed90 msgr2=0x7fe658061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe65805ed90 0x7fe658061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe670003890 tx=0x7fe670007d40).stop 2023-05-17T14:54:05.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 msgr2=0x7fe678151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 0x7fe678151800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe66000c440 tx=0x7fe660007d40).stop 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 shutdown_connections 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe65805ed90 0x7fe658061250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe67814f700 0x7fe678151800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe678065b30 0x7fe678157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 --2- 172.21.15.27:0/1206522374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe678066170 0x7fe67814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 >> 172.21.15.27:0/1206522374 conn(0x7fe6780c9470 msgr2=0x7fe6780c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:05.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 shutdown_connections 2023-05-17T14:54:05.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.383+0000 7fe67eb67700 1 -- 172.21.15.27:0/1206522374 wait complete. 2023-05-17T14:54:05.399 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.514+0000 7f662f226700 1 Processor -- start 2023-05-17T14:54:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.514+0000 7f662f226700 1 -- start start 2023-05-17T14:54:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662f226700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66280cac00 0x7f66280cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662f226700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 0x7f66280c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662f226700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66280c60d0 con 0x7f6628157980 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662f226700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66281588b0 con 0x7f66280cac00 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662f226700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6628157e00 con 0x7f6628153ef0 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662da23700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6628157980 0x7f66281537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33772/0 (socket says 172.21.15.27:33772) 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662da23700 1 -- 172.21.15.27:0/939953265 learned_addr learned my addr 172.21.15.27:0/939953265 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662e224700 1 --2- 172.21.15.27:0/939953265 >> v2:172.21.15.40:3300/0 conn(0x7f66280cac00 0x7f66280cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662ea25700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 0x7f66280c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464271398 0 0) 0x7f66280c60d0 con 0x7f6628157980 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66140033f0 con 0x7f6628157980 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890484030 0 0) 0x7f66140033f0 con 0x7f6628157980 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 msgr2=0x7f66280c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 0x7f66280c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 >> v2:172.21.15.40:3300/0 conn(0x7f66280cac00 msgr2=0x7f66280cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 --2- 172.21.15.27:0/939953265 >> v2:172.21.15.40:3300/0 conn(0x7f66280cac00 0x7f66280cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628158010 con 0x7f6628157980 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f6618001470 con 0x7f6628157980 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 >> v1:172.21.15.27:6789/0 conn(0x7f6628157980 legacy=0x7f66281537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 0x7f66140038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6614003e10 0x7f6614004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6614004b80 0x7f6614005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66281588b0 con 0x7f6614004b80 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628157e00 con 0x7f6614003e10 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.515+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661400b8e0 con 0x7f6628153ef0 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6614004b80 0x7f6614005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662e224700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 0x7f66140038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662da23700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6614003e10 0x7f6614004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 -- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 msgr2=0x7f66140038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6628153ef0 0x7f66140038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 -- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6614003e10 msgr2=0x7f6614004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6614003e10 0x7f6614004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 -- 172.21.15.27:0/939953265 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66140033f0 con 0x7f6614004b80 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6614004b80 0x7f6614005000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f662000e240 tx=0x7f662000b040).ready entity=mon.0 client_cookie=42f899a6127da747 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620009ac0 con 0x7f6614004b80 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662000f040 con 0x7f6614004b80 2023-05-17T14:54:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662d222700 1 -- 172.21.15.27:0/939953265 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662000ed00 con 0x7f6614004b80 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662f226700 1 -- 172.21.15.27:0/939953265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6614004b80 msgr2=0x7f6614005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662f226700 1 --2- 172.21.15.27:0/939953265 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6614004b80 0x7f6614005000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f662000e240 tx=0x7f662000b040).stop 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.516+0000 7f662ea25700 1 -- 172.21.15.27:0/939953265 reap_dead start 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.517+0000 7f662f226700 1 -- 172.21.15.27:0/939953265 shutdown_connections 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.517+0000 7f662f226700 1 -- 172.21.15.27:0/939953265 >> 172.21.15.27:0/939953265 conn(0x7f662805dd50 msgr2=0x7f662805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.517+0000 7f662f226700 1 -- 172.21.15.27:0/939953265 shutdown_connections 2023-05-17T14:54:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.517+0000 7f662f226700 1 -- 172.21.15.27:0/939953265 wait complete. 2023-05-17T14:54:05.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 Processor -- start 2023-05-17T14:54:05.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 -- start start 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6614004b80 0x7f6628156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66280c74e0 0x7f66280c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 0x7f6628168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280aa110 con 0x7f6628167b80 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628164d00 con 0x7f66280c74e0 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.518+0000 7f662f226700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280c7e50 con 0x7f6614004b80 2023-05-17T14:54:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 0x7f6628168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 0x7f6628168000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34222/0 (socket says 172.21.15.27:34222) 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 -- 172.21.15.27:0/675423594 learned_addr learned my addr 172.21.15.27:0/675423594 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662e224700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6614004b80 0x7f6628156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662da23700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66280c74e0 0x7f66280c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 -- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6614004b80 msgr2=0x7f6628156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6614004b80 0x7f6628156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 -- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66280c74e0 msgr2=0x7f66280c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66280c74e0 0x7f66280c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 -- 172.21.15.27:0/675423594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628157350 con 0x7f6628167b80 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662ea25700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 0x7f6628168000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f66140045a0 tx=0x7f662001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200139f0 con 0x7f6628167b80 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620013b50 con 0x7f6628167b80 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66281646b0 con 0x7f6628167b80 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662001d400 con 0x7f6628167b80 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.519+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66281643c0 con 0x7f6628167b80 2023-05-17T14:54:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.520+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6628164eb0 con 0x7f6628167b80 2023-05-17T14:54:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.520+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f662001d770 con 0x7f6628167b80 2023-05-17T14:54:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.521+0000 7f661e7fc700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f660c05ed90 0x7f660c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.521+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f662007b450 con 0x7f6628167b80 2023-05-17T14:54:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.521+0000 7f662e224700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f660c05ed90 0x7f660c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.521+0000 7f662e224700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f660c05ed90 0x7f660c061250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f66280aa3e0 tx=0x7f6624009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.525+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6628164eb0 con 0x7f6628167b80 2023-05-17T14:54:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.700+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6628164e70 con 0x7f6628167b80 2023-05-17T14:54:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.700+0000 7f661e7fc700 1 -- 172.21.15.27:0/675423594 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f662004c9f0 con 0x7f6628167b80 2023-05-17T14:54:05.704 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f660c05ed90 msgr2=0x7f660c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f660c05ed90 0x7f660c061250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f66280aa3e0 tx=0x7f6624009060).stop 2023-05-17T14:54:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 msgr2=0x7f6628168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 0x7f6628168000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f66140045a0 tx=0x7f662001a000).stop 2023-05-17T14:54:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 shutdown_connections 2023-05-17T14:54:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f660c05ed90 0x7f660c061250 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6628167b80 0x7f6628168000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6614004b80 0x7f6628156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 --2- 172.21.15.27:0/675423594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66280c74e0 0x7f66280c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 >> 172.21.15.27:0/675423594 conn(0x7f662805dd50 msgr2=0x7f6628152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 shutdown_connections 2023-05-17T14:54:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.702+0000 7f662f226700 1 -- 172.21.15.27:0/675423594 wait complete. 2023-05-17T14:54:05.718 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.832+0000 7f743e4d2700 1 Processor -- start 2023-05-17T14:54:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.832+0000 7f743e4d2700 1 -- start start 2023-05-17T14:54:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f743e4d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7438069410 0x7f743815f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f743e4d2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380c0c90 con 0x7f74381543d0 2023-05-17T14:54:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f743e4d2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7438158790 con 0x7f74380c6310 2023-05-17T14:54:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f743e4d2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380c1c50 con 0x7f7438069410 2023-05-17T14:54:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f7437fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f74381543d0 0x7f74380c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33790/0 (socket says 172.21.15.27:33790) 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f7437fff700 1 -- 172.21.15.27:0/3030515918 learned_addr learned my addr 172.21.15.27:0/3030515918 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f743ca6f700 1 --2- 172.21.15.27:0/3030515918 >> v2:172.21.15.40:3300/0 conn(0x7f7438069410 0x7f743815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785071726 0 0) 0x7f74380c0c90 con 0x7f74381543d0 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.833+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74240033f0 con 0x7f74381543d0 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 841193427 0 0) 0x7f74240033f0 con 0x7f74381543d0 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 >> v2:172.21.15.40:3300/0 conn(0x7f7438069410 msgr2=0x7f743815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 --2- 172.21.15.27:0/3030515918 >> v2:172.21.15.40:3300/0 conn(0x7f7438069410 0x7f743815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 >> v1:172.21.15.40:6789/0 conn(0x7f74380c6310 legacy=0x7f7438068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438157e60 con 0x7f74381543d0 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f7428001470 con 0x7f74381543d0 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 >> v1:172.21.15.27:6789/0 conn(0x7f74381543d0 legacy=0x7f74380c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f7424003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7424004690 0x7f7424004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7424005000 0x7f742400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742400be80 con 0x7f74240038e0 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742400bff0 con 0x7f7424005000 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742400c1b0 con 0x7f7424004690 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f7424003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f743ca6f700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7424005000 0x7f742400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f742ffff700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7424004690 0x7f7424004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 -- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7424004690 msgr2=0x7f7424004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7424004690 0x7f7424004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 -- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7424005000 msgr2=0x7f742400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7424005000 0x7f742400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 -- 172.21.15.27:0/3030515918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240033f0 con 0x7f74240038e0 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f743ca6f700 1 -- 172.21.15.27:0/3030515918 reap_dead start 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f7437fff700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f7424003d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f742800c190 tx=0x7f7428001e50).ready entity=mon.0 client_cookie=bdc56ba561299e30 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428007a20 con 0x7f74240038e0 2023-05-17T14:54:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800ca40 con 0x7f74240038e0 2023-05-17T14:54:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.834+0000 7f74377fe700 1 -- 172.21.15.27:0/3030515918 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800cdc0 con 0x7f74240038e0 2023-05-17T14:54:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 -- 172.21.15.27:0/3030515918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 msgr2=0x7f7424003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f7424003d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f742800c190 tx=0x7f7428001e50).stop 2023-05-17T14:54:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 -- 172.21.15.27:0/3030515918 shutdown_connections 2023-05-17T14:54:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3030515918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f7424003d00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 -- 172.21.15.27:0/3030515918 >> 172.21.15.27:0/3030515918 conn(0x7f74380cb7f0 msgr2=0x7f74380c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:05.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 -- 172.21.15.27:0/3030515918 shutdown_connections 2023-05-17T14:54:05.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.835+0000 7f743e4d2700 1 -- 172.21.15.27:0/3030515918 wait complete. 2023-05-17T14:54:05.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.836+0000 7f743e4d2700 1 Processor -- start 2023-05-17T14:54:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.836+0000 7f743e4d2700 1 -- start start 2023-05-17T14:54:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f74380c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74380ae2a0 0x7f74380ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380aeed0 0x7f74380af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c4c50 con 0x7f74240038e0 2023-05-17T14:54:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380af800 con 0x7f74380aeed0 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c3da0 con 0x7f74380ae2a0 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f74380c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f74380c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34240/0 (socket says 172.21.15.27:34240) 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 -- 172.21.15.27:0/3324050729 learned_addr learned my addr 172.21.15.27:0/3324050729 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f742ffff700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74380ae2a0 0x7f74380ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743ca6f700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380aeed0 0x7f74380af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 -- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74380ae2a0 msgr2=0x7f74380ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74380ae2a0 0x7f74380ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 -- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380aeed0 msgr2=0x7f74380af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380aeed0 0x7f74380af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 -- 172.21.15.27:0/3324050729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380c4040 con 0x7f74240038e0 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7437fff700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f74380c38b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f742400bfc0 tx=0x7f7428015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280073b0 con 0x7f74240038e0 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428007510 con 0x7f74240038e0 2023-05-17T14:54:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280048e0 con 0x7f74240038e0 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.837+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74380c4320 con 0x7f74240038e0 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.838+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74380c48e0 con 0x7f74240038e0 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.839+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743806bdf0 con 0x7f74240038e0 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.839+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7428010070 con 0x7f74240038e0 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.839+0000 7f7434ff9700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f741805edc0 0x7f7418061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.839+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f742807a340 con 0x7f74240038e0 2023-05-17T14:54:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.839+0000 7f742ffff700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f741805edc0 0x7f7418061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:05.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.839+0000 7f742ffff700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f741805edc0 0x7f7418061280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f74380ad600 tx=0x7f7420009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:05.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:05.843+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f742804b8e0 con 0x7f74240038e0 2023-05-17T14:54:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.017+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7438158140 con 0x7f74240038e0 2023-05-17T14:54:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.017+0000 7f7434ff9700 1 -- 172.21.15.27:0/3324050729 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7428024070 con 0x7f74240038e0 2023-05-17T14:54:06.021 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f741805edc0 msgr2=0x7f7418061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f741805edc0 0x7f7418061280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f74380ad600 tx=0x7f7420009040).stop 2023-05-17T14:54:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 msgr2=0x7f74380c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f74380c38b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f742400bfc0 tx=0x7f7428015000).stop 2023-05-17T14:54:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 shutdown_connections 2023-05-17T14:54:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f741805edc0 0x7f7418061280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380aeed0 0x7f74380af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74240038e0 0x7f74380c38b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 --2- 172.21.15.27:0/3324050729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74380ae2a0 0x7f74380ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 >> 172.21.15.27:0/3324050729 conn(0x7f74380cb7f0 msgr2=0x7f7438157060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 shutdown_connections 2023-05-17T14:54:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.019+0000 7f743e4d2700 1 -- 172.21.15.27:0/3324050729 wait complete. 2023-05-17T14:54:06.035 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:06.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.146+0000 7f5fc12cd700 1 Processor -- start 2023-05-17T14:54:06.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.146+0000 7f5fc12cd700 1 -- start start 2023-05-17T14:54:06.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fc12cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0c5f30 0x7f5fbc0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fc12cd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5fbc158880 0x7f5fbc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fc12cd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc0bfcd0 con 0x7f5fbc1541c0 2023-05-17T14:54:06.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fc12cd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c0290 con 0x7f5fbc158880 2023-05-17T14:54:06.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fc12cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0aa1a0 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0c5f30 0x7f5fbc0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fba7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5fbc158880 0x7f5fbc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fbb7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5fbc1541c0 0x7f5fbc0c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:39814/0 (socket says 172.21.15.27:39814) 2023-05-17T14:54:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0c5f30 0x7f5fbc0c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35360/0 (socket says 172.21.15.27:35360) 2023-05-17T14:54:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fbb7fe700 1 -- 172.21.15.27:0/1783367938 learned_addr learned my addr 172.21.15.27:0/1783367938 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:06.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fba7fc700 1 -- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0c5f30 msgr2=0x7f5fbc0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:06.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fba7fc700 1 --2- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0c5f30 0x7f5fbc0c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fba7fc700 1 -- 172.21.15.27:0/1783367938 >> v1:172.21.15.40:6789/0 conn(0x7f5fbc1541c0 legacy=0x7f5fbc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fba7fc700 1 -- 172.21.15.27:0/1783367938 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0aa480 con 0x7f5fbc158880 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fb9ffb700 1 -- 172.21.15.27:0/1783367938 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309248001 0 0) 0x7f5fbc0bfcd0 con 0x7f5fbc1541c0 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.147+0000 7f5fba7fc700 1 --2- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc158880 0x7f5fbc153cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5fa4009e60 tx=0x7f5fa4009780).ready entity=mon.1 client_cookie=f8a80a65dde904ae server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fb9ffb700 1 -- 172.21.15.27:0/1783367938 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400e070 con 0x7f5fbc158880 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fb9ffb700 1 -- 172.21.15.27:0/1783367938 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400bb60 con 0x7f5fbc158880 2023-05-17T14:54:06.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fb9ffb700 1 -- 172.21.15.27:0/1783367938 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4012410 con 0x7f5fbc158880 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc158880 msgr2=0x7f5fbc153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc158880 0x7f5fbc153cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5fa4009e60 tx=0x7f5fa4009780).stop 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1783367938 shutdown_connections 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0c5f30 0x7f5fbc0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1783367938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc158880 0x7f5fbc153cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1783367938 >> 172.21.15.27:0/1783367938 conn(0x7f5fbc069e70 msgr2=0x7f5fbc05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1783367938 shutdown_connections 2023-05-17T14:54:06.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.148+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1783367938 wait complete. 2023-05-17T14:54:06.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.149+0000 7f5fc12cd700 1 Processor -- start 2023-05-17T14:54:06.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.149+0000 7f5fc12cd700 1 -- start start 2023-05-17T14:54:06.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fc12cd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 0x7f5fbc156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fc12cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc1541c0 0x7f5fbc0c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fc12cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc158880 0x7f5fbc156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fc12cd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c3390 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fc12cd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c2780 con 0x7f5fbc1541c0 2023-05-17T14:54:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fc12cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c2a60 con 0x7f5fbc158880 2023-05-17T14:54:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 0x7f5fbc156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 0x7f5fbc156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34252/0 (socket says 172.21.15.27:34252) 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fbaffd700 1 -- 172.21.15.27:0/1593397074 learned_addr learned my addr 172.21.15.27:0/1593397074 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fbb7fe700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc158880 0x7f5fbc156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.150+0000 7f5fba7fc700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc1541c0 0x7f5fbc0c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fbaffd700 1 -- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc158880 msgr2=0x7f5fbc156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fbaffd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc158880 0x7f5fbc156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fbaffd700 1 -- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc1541c0 msgr2=0x7f5fbc0c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fbaffd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc1541c0 0x7f5fbc0c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fbaffd700 1 -- 172.21.15.27:0/1593397074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009a20 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fbaffd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 0x7f5fbc156280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5fb400e930 tx=0x7f5fb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400eed0 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb400c850 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0c2d40 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400cbd0 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.151+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc156770 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.152+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc05f4a0 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.152+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5fb4022070 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.153+0000 7f5fb2ffd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5f9c05ed90 0x7f5f9c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.153+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5fb4079f90 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.153+0000 7f5fba7fc700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5f9c05ed90 0x7f5f9c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.153+0000 7f5fba7fc700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5f9c05ed90 0x7f5f9c061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5fa4009e60 tx=0x7f5fa4009780).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.157+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fb404b530 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.370+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fbc06bdf0 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.371+0000 7f5fb2ffd700 1 -- 172.21.15.27:0/1593397074 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f5fb404eb50 con 0x7f5fbc0c5f30 2023-05-17T14:54:06.375 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:06.375 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:06.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5f9c05ed90 msgr2=0x7f5f9c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5f9c05ed90 0x7f5f9c061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5fa4009e60 tx=0x7f5fa4009780).stop 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 msgr2=0x7f5fbc156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 0x7f5fbc156280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5fb400e930 tx=0x7f5fb4009060).stop 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 shutdown_connections 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5f9c05ed90 0x7f5f9c061250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc158880 0x7f5fbc156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0c5f30 0x7f5fbc156280 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 --2- 172.21.15.27:0/1593397074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc1541c0 0x7f5fbc0c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 >> 172.21.15.27:0/1593397074 conn(0x7f5fbc069e70 msgr2=0x7f5fbc153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:06.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.372+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 shutdown_connections 2023-05-17T14:54:06.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.373+0000 7f5fc12cd700 1 -- 172.21.15.27:0/1593397074 wait complete. 2023-05-17T14:54:06.378 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:06.388 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:06.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.500+0000 7fe89dfde700 1 Processor -- start 2023-05-17T14:54:06.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe89dfde700 1 -- start start 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe89dfde700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe898154000 0x7fe8980bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe89dfde700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980c4180 con 0x7fe898065350 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe89dfde700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980bde90 con 0x7fe8980664a0 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe89dfde700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe898068ef0 con 0x7fe898154000 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe897fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe898065350 0x7fe8980c4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33824/0 (socket says 172.21.15.27:33824) 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.501+0000 7fe897fff700 1 -- 172.21.15.27:0/3195639202 learned_addr learned my addr 172.21.15.27:0/3195639202 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:06.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8977fe700 1 --2- 172.21.15.27:0/3195639202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe898154000 0x7fe8980bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328187403 0 0) 0x7fe8980c4180 con 0x7fe898065350 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8840033f0 con 0x7fe898065350 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683537005 0 0) 0x7fe8980bde90 con 0x7fe8980664a0 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8980c4180 con 0x7fe8980664a0 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8977fe700 1 -- 172.21.15.27:0/3195639202 >> v1:172.21.15.40:6789/0 conn(0x7fe8980664a0 legacy=0x7fe898068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8977fe700 1 -- 172.21.15.27:0/3195639202 >> v1:172.21.15.27:6789/0 conn(0x7fe898065350 legacy=0x7fe8980c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8977fe700 1 -- 172.21.15.27:0/3195639202 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980c3b30 con 0x7fe898154000 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8977fe700 1 --2- 172.21.15.27:0/3195639202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe898154000 0x7fe8980bd9a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe888009790 tx=0x7fe888009060).ready entity=mon.2 client_cookie=da0845ccc21f8465 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800f510 con 0x7fe898154000 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800f670 con 0x7fe898154000 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.502+0000 7fe8967fc700 1 -- 172.21.15.27:0/3195639202 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800f9f0 con 0x7fe898154000 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 -- 172.21.15.27:0/3195639202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe898154000 msgr2=0x7fe8980bd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 --2- 172.21.15.27:0/3195639202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe898154000 0x7fe8980bd9a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe888009790 tx=0x7fe888009060).stop 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 -- 172.21.15.27:0/3195639202 shutdown_connections 2023-05-17T14:54:06.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 --2- 172.21.15.27:0/3195639202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe898154000 0x7fe8980bd9a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 -- 172.21.15.27:0/3195639202 >> 172.21.15.27:0/3195639202 conn(0x7fe8980c94d0 msgr2=0x7fe8980c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:06.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 -- 172.21.15.27:0/3195639202 shutdown_connections 2023-05-17T14:54:06.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.503+0000 7fe89dfde700 1 -- 172.21.15.27:0/3195639202 wait complete. 2023-05-17T14:54:06.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.504+0000 7fe89dfde700 1 Processor -- start 2023-05-17T14:54:06.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.504+0000 7fe89dfde700 1 -- start start 2023-05-17T14:54:06.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe89dfde700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 0x7fe898150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe89dfde700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8980664a0 0x7fe89814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe89dfde700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe898154000 0x7fe8980aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe89dfde700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980ab380 con 0x7fe898065350 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe89dfde700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980ac290 con 0x7fe898154000 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe89dfde700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980ab0a0 con 0x7fe8980664a0 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 0x7fe898150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 0x7fe898150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34264/0 (socket says 172.21.15.27:34264) 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 -- 172.21.15.27:0/671425673 learned_addr learned my addr 172.21.15.27:0/671425673 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:06.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe897fff700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe898154000 0x7fe8980aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe896ffd700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8980664a0 0x7fe89814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 -- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8980664a0 msgr2=0x7fe89814c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8980664a0 0x7fe89814c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 -- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe898154000 msgr2=0x7fe8980aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe898154000 0x7fe8980aa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 -- 172.21.15.27:0/671425673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880092a0 con 0x7fe898065350 2023-05-17T14:54:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe897fff700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe898154000 0x7fe8980aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe8977fe700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 0x7fe898150c10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe89805ea70 tx=0x7fe888017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.505+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800f7e0 con 0x7fe898065350 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.506+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800f940 con 0x7fe898065350 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.506+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8980abc40 con 0x7fe898065350 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.506+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888022610 con 0x7fe898065350 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.506+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8981686d0 con 0x7fe898065350 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.507+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8980ab4d0 con 0x7fe898065350 2023-05-17T14:54:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.507+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe88800f070 con 0x7fe898065350 2023-05-17T14:54:06.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.507+0000 7fe88f7fe700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe87805ed90 0x7fe878061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.507+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe88807aa90 con 0x7fe898065350 2023-05-17T14:54:06.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.507+0000 7fe896ffd700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe87805ed90 0x7fe878061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.507+0000 7fe896ffd700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe87805ed90 0x7fe878061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe8981588e0 tx=0x7fe880009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.511+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe88804c030 con 0x7fe898065350 2023-05-17T14:54:06.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.682+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe89806bdf0 con 0x7fe898065350 2023-05-17T14:54:06.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.683+0000 7fe88f7fe700 1 -- 172.21.15.27:0/671425673 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fe88804f650 con 0x7fe898065350 2023-05-17T14:54:06.687 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:06.688 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe87805ed90 msgr2=0x7fe878061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe87805ed90 0x7fe878061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe8981588e0 tx=0x7fe880009040).stop 2023-05-17T14:54:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 msgr2=0x7fe898150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 0x7fe898150c10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe89805ea70 tx=0x7fe888017000).stop 2023-05-17T14:54:06.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 shutdown_connections 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe87805ed90 0x7fe878061250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe898154000 0x7fe8980aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe898065350 0x7fe898150c10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 --2- 172.21.15.27:0/671425673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8980664a0 0x7fe89814c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 >> 172.21.15.27:0/671425673 conn(0x7fe8980c94d0 msgr2=0x7fe8980c7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 shutdown_connections 2023-05-17T14:54:06.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.685+0000 7fe89dfde700 1 -- 172.21.15.27:0/671425673 wait complete. 2023-05-17T14:54:06.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:06.701 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:06.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.816+0000 7f6415a4a700 1 Processor -- start 2023-05-17T14:54:06.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.816+0000 7f6415a4a700 1 -- start start 2023-05-17T14:54:06.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415a4a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64100cac00 0x7f64100cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415a4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6410157980 0x7f64100c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415a4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64101537e0 0x7f6410153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415a4a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64101588b0 con 0x7f64100cac00 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415a4a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6410157e00 con 0x7f64101537e0 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415a4a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64100c60d0 con 0x7f6410157980 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64100cac00 0x7f64100cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64100cac00 0x7f64100cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34272/0 (socket says 172.21.15.27:34272) 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 -- 172.21.15.27:0/108744280 learned_addr learned my addr 172.21.15.27:0/108744280 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f640ffff700 1 --2- 172.21.15.27:0/108744280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6410157980 0x7f64100c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 -- 172.21.15.27:0/108744280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6410157980 msgr2=0x7f64100c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6415249700 1 --2- 172.21.15.27:0/108744280 >> v2:172.21.15.40:3300/0 conn(0x7f64101537e0 0x7f6410153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 --2- 172.21.15.27:0/108744280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6410157980 0x7f64100c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 -- 172.21.15.27:0/108744280 >> v2:172.21.15.40:3300/0 conn(0x7f64101537e0 msgr2=0x7f6410153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 --2- 172.21.15.27:0/108744280 >> v2:172.21.15.40:3300/0 conn(0x7f64101537e0 0x7f6410153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 -- 172.21.15.27:0/108744280 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410158010 con 0x7f64100cac00 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f6414a48700 1 --2- 172.21.15.27:0/108744280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f64100cafe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6408006fd0 tx=0x7f64080090f0).ready entity=mon.0 client_cookie=e4f839ed3568c282 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f640f7fe700 1 -- 172.21.15.27:0/108744280 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800b600 con 0x7f64100cac00 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f640f7fe700 1 -- 172.21.15.27:0/108744280 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800b760 con 0x7f64100cac00 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.817+0000 7f640f7fe700 1 -- 172.21.15.27:0/108744280 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800bae0 con 0x7f64100cac00 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 -- 172.21.15.27:0/108744280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 msgr2=0x7f64100cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 --2- 172.21.15.27:0/108744280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f64100cafe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6408006fd0 tx=0x7f64080090f0).stop 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 -- 172.21.15.27:0/108744280 shutdown_connections 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 --2- 172.21.15.27:0/108744280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f64100cafe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 --2- 172.21.15.27:0/108744280 >> v2:172.21.15.40:3300/0 conn(0x7f64101537e0 0x7f6410153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 --2- 172.21.15.27:0/108744280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6410157980 0x7f64100c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 -- 172.21.15.27:0/108744280 >> 172.21.15.27:0/108744280 conn(0x7f641005dd50 msgr2=0x7f641005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 -- 172.21.15.27:0/108744280 shutdown_connections 2023-05-17T14:54:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.818+0000 7f6415a4a700 1 -- 172.21.15.27:0/108744280 wait complete. 2023-05-17T14:54:06.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.819+0000 7f6415a4a700 1 Processor -- start 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.819+0000 7f6415a4a700 1 -- start start 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415a4a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f6410140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415a4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64101537e0 0x7f64100aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415a4a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6410157980 0x7f64100ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415a4a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64100ab700 con 0x7f64100cac00 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415a4a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410144800 con 0x7f6410157980 2023-05-17T14:54:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415a4a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6410143bf0 con 0x7f64101537e0 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f6410140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f6410140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34278/0 (socket says 172.21.15.27:34278) 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 -- 172.21.15.27:0/2513014761 learned_addr learned my addr 172.21.15.27:0/2513014761 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f640ffff700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64101537e0 0x7f64100aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415249700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6410157980 0x7f64100ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 -- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64101537e0 msgr2=0x7f64100aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64101537e0 0x7f64100aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 -- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6410157980 msgr2=0x7f64100ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6410157980 0x7f64100ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 -- 172.21.15.27:0/2513014761 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009370 con 0x7f64100cac00 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f640ffff700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64101537e0 0x7f64100aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6415249700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6410157980 0x7f64100ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.820+0000 7f6414a48700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f6410140e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6408009f50 tx=0x7f6408017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.821+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800bae0 con 0x7f64100cac00 2023-05-17T14:54:06.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.821+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408000c90 con 0x7f64100cac00 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.821+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6410143ed0 con 0x7f64100cac00 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.821+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640801c650 con 0x7f64100cac00 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.821+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6410144490 con 0x7f64100cac00 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.821+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410047150 con 0x7f64100cac00 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.822+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f640802c070 con 0x7f64100cac00 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.822+0000 7f640cff9700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63f005ed90 0x7f63f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:06.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.822+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f640807b860 con 0x7f64100cac00 2023-05-17T14:54:06.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.822+0000 7f640ffff700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63f005ed90 0x7f63f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:06.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.823+0000 7f640ffff700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63f005ed90 0x7f63f0061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f6410164370 tx=0x7f6400007540).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:06.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.826+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f640804ce00 con 0x7f64100cac00 2023-05-17T14:54:07.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.998+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f64100c63b0 con 0x7f64100cac00 2023-05-17T14:54:07.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:06.999+0000 7f640cff9700 1 -- 172.21.15.27:0/2513014761 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f640802a020 con 0x7f64100cac00 2023-05-17T14:54:07.003 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:07.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63f005ed90 msgr2=0x7f63f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63f005ed90 0x7f63f0061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f6410164370 tx=0x7f6400007540).stop 2023-05-17T14:54:07.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 msgr2=0x7f6410140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f6410140e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6408009f50 tx=0x7f6408017000).stop 2023-05-17T14:54:07.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 shutdown_connections 2023-05-17T14:54:07.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63f005ed90 0x7f63f0061250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6410157980 0x7f64100ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64100cac00 0x7f6410140e90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 --2- 172.21.15.27:0/2513014761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64101537e0 0x7f64100aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 >> 172.21.15.27:0/2513014761 conn(0x7f641005dd50 msgr2=0x7f64100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 shutdown_connections 2023-05-17T14:54:07.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.001+0000 7f6415a4a700 1 -- 172.21.15.27:0/2513014761 wait complete. 2023-05-17T14:54:07.017 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:07.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.131+0000 7f1edaa4b700 1 Processor -- start 2023-05-17T14:54:07.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.131+0000 7f1edaa4b700 1 -- start start 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1edaa4b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ed4069410 0x7f1ed415f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1edaa4b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed40c0c90 con 0x7f1ed40c6310 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1edaa4b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed4158790 con 0x7f1ed41543d0 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1edaa4b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed40c1c50 con 0x7f1ed4069410 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ecbfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1ed40c6310 0x7f1ed4068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33850/0 (socket says 172.21.15.27:33850) 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ed8fe8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ed4069410 0x7f1ed415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ecbfff700 1 -- 172.21.15.27:0/2586347057 learned_addr learned my addr 172.21.15.27:0/2586347057 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2586347057 >> v1:172.21.15.40:6789/0 conn(0x7f1ed41543d0 legacy=0x7f1ed40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2586347057 >> v1:172.21.15.27:6789/0 conn(0x7f1ed40c6310 legacy=0x7f1ed4068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2586347057 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4157e60 con 0x7f1ed4069410 2023-05-17T14:54:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ed37fe700 1 -- 172.21.15.27:0/2586347057 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599350698 0 0) 0x7f1ed40c0c90 con 0x7f1ed40c6310 2023-05-17T14:54:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.132+0000 7f1ed8fe8700 1 --2- 172.21.15.27:0/2586347057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed4069410 0x7f1ed415f160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1ecc009e60 tx=0x7f1ecc009780).ready entity=mon.0 client_cookie=dec02ccc3a7d0d97 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1ed37fe700 1 -- 172.21.15.27:0/2586347057 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00e070 con 0x7f1ed4069410 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1ed37fe700 1 -- 172.21.15.27:0/2586347057 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00bc30 con 0x7f1ed4069410 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1ed37fe700 1 -- 172.21.15.27:0/2586347057 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc012410 con 0x7f1ed4069410 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2586347057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed4069410 msgr2=0x7f1ed415f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2586347057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed4069410 0x7f1ed415f160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f1ecc009e60 tx=0x7f1ecc009780).stop 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2586347057 shutdown_connections 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2586347057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed4069410 0x7f1ed415f160 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2586347057 >> 172.21.15.27:0/2586347057 conn(0x7f1ed40cb7f0 msgr2=0x7f1ed40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2586347057 shutdown_connections 2023-05-17T14:54:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.133+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2586347057 wait complete. 2023-05-17T14:54:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.134+0000 7f1edaa4b700 1 Processor -- start 2023-05-17T14:54:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.134+0000 7f1edaa4b700 1 -- start start 2023-05-17T14:54:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1edaa4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed4069410 0x7f1ed4153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1edaa4b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed40c6310 0x7f1ed40af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1edaa4b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 0x7f1ed4147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1edaa4b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40b0a30 con 0x7f1ed41543d0 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1edaa4b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40afb50 con 0x7f1ed40c6310 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1edaa4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40afe20 con 0x7f1ed4069410 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 0x7f1ed4147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 0x7f1ed4147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34292/0 (socket says 172.21.15.27:34292) 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2197785687 learned_addr learned my addr 172.21.15.27:0/2197785687 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed4069410 msgr2=0x7f1ed4153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed3fff700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed4069410 0x7f1ed4153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed4069410 0x7f1ed4153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ecbfff700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed40c6310 0x7f1ed40af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed40c6310 msgr2=0x7f1ed40af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed40c6310 0x7f1ed40af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.135+0000 7f1ed8fe8700 1 -- 172.21.15.27:0/2197785687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc009a20 con 0x7f1ed41543d0 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.136+0000 7f1ed8fe8700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 0x7f1ed4147b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1ecc00b6c0 tx=0x7f1ecc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.136+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0064d0 con 0x7f1ed41543d0 2023-05-17T14:54:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.136+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc006630 con 0x7f1ed41543d0 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.136+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed40b0100 con 0x7f1ed41543d0 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.136+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0069d0 con 0x7f1ed41543d0 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.136+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed40b06c0 con 0x7f1ed41543d0 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.137+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed406bdf0 con 0x7f1ed41543d0 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.137+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1ecc01d630 con 0x7f1ed41543d0 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.137+0000 7f1ed0ff9700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1eb405ed90 0x7f1eb4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.137+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ecc07c260 con 0x7f1ed41543d0 2023-05-17T14:54:07.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.137+0000 7f1ed3fff700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1eb405ed90 0x7f1eb4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.138+0000 7f1ed3fff700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1eb405ed90 0x7f1eb4061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1ec40015e0 tx=0x7f1ec4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.142+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ecc04d800 con 0x7f1ed41543d0 2023-05-17T14:54:07.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.313+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ed4158140 con 0x7f1ed41543d0 2023-05-17T14:54:07.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.313+0000 7f1ed0ff9700 1 -- 172.21.15.27:0/2197785687 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ecc050e20 con 0x7f1ed41543d0 2023-05-17T14:54:07.318 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:07.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1eb405ed90 msgr2=0x7f1eb4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1eb405ed90 0x7f1eb4061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1ec40015e0 tx=0x7f1ec4009040).stop 2023-05-17T14:54:07.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 msgr2=0x7f1ed4147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 0x7f1ed4147b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f1ecc00b6c0 tx=0x7f1ecc009780).stop 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 shutdown_connections 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1eb405ed90 0x7f1eb4061250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed41543d0 0x7f1ed4147b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed4069410 0x7f1ed4153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 --2- 172.21.15.27:0/2197785687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed40c6310 0x7f1ed40af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 >> 172.21.15.27:0/2197785687 conn(0x7f1ed40cb7f0 msgr2=0x7f1ed40a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 shutdown_connections 2023-05-17T14:54:07.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.315+0000 7f1edaa4b700 1 -- 172.21.15.27:0/2197785687 wait complete. 2023-05-17T14:54:07.331 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:07.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.445+0000 7f1e9229c700 1 Processor -- start 2023-05-17T14:54:07.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.445+0000 7f1e9229c700 1 -- start start 2023-05-17T14:54:07.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.446+0000 7f1e9229c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e8c1543d0 0x7f1e8c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.446+0000 7f1e9229c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.446+0000 7f1e9229c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c158790 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.446+0000 7f1e9229c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c1c50 con 0x7f1e8c1543d0 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.446+0000 7f1e9229c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c6570 con 0x7f1e8c069410 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.446+0000 7f1e8bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e8c1543d0 0x7f1e8c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e90839700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1e8c0c60f0 0x7f1e8c068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:39862/0 (socket says 172.21.15.27:39862) 2023-05-17T14:54:07.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e8c1543d0 0x7f1e8c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:52226/0 (socket says 172.21.15.27:52226) 2023-05-17T14:54:07.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8b7fe700 1 -- 172.21.15.27:0/605440140 learned_addr learned my addr 172.21.15.27:0/605440140 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:07.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8bfff700 1 -- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 msgr2=0x7f1e8c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:07.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8bfff700 1 --2- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8bfff700 1 -- 172.21.15.27:0/605440140 >> v1:172.21.15.40:6789/0 conn(0x7f1e8c0c60f0 legacy=0x7f1e8c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8bfff700 1 -- 172.21.15.27:0/605440140 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c157e60 con 0x7f1e8c1543d0 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8affd700 1 -- 172.21.15.27:0/605440140 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574153241 0 0) 0x7f1e8c158790 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e90839700 1 --2- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8bfff700 1 --2- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c0c5c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1e7c009760 tx=0x7f1e7c009060).ready entity=mon.1 client_cookie=fb59207b43666a28 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8affd700 1 -- 172.21.15.27:0/605440140 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00f510 con 0x7f1e8c1543d0 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8affd700 1 -- 172.21.15.27:0/605440140 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00f670 con 0x7f1e8c1543d0 2023-05-17T14:54:07.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.447+0000 7f1e8affd700 1 -- 172.21.15.27:0/605440140 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00f9f0 con 0x7f1e8c1543d0 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 -- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 msgr2=0x7f1e8c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 --2- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c0c5c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1e7c009760 tx=0x7f1e7c009060).stop 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 -- 172.21.15.27:0/605440140 shutdown_connections 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 --2- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 --2- 172.21.15.27:0/605440140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c0c5c00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 -- 172.21.15.27:0/605440140 >> 172.21.15.27:0/605440140 conn(0x7f1e8c0cb7f0 msgr2=0x7f1e8c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 -- 172.21.15.27:0/605440140 shutdown_connections 2023-05-17T14:54:07.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.448+0000 7f1e9229c700 1 -- 172.21.15.27:0/605440140 wait complete. 2023-05-17T14:54:07.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.449+0000 7f1e9229c700 1 Processor -- start 2023-05-17T14:54:07.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.449+0000 7f1e9229c700 1 -- start start 2023-05-17T14:54:07.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e9229c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e9229c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 0x7f1e8c167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e9229c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e9229c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0ae880 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e9229c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c168e30 con 0x7f1e8c1543d0 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e9229c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c168870 con 0x7f1e8c069410 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 0x7f1e8c167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 0x7f1e8c167f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34302/0 (socket says 172.21.15.27:34302) 2023-05-17T14:54:07.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 -- 172.21.15.27:0/1070419252 learned_addr learned my addr 172.21.15.27:0/1070419252 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e90839700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8bfff700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 -- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 msgr2=0x7f1e8c0a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 -- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 msgr2=0x7f1e8c164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 -- 172.21.15.27:0/1070419252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009a20 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e8b7fe700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 0x7f1e8c167f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f1e7400c4e0 tx=0x7f1e74007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.450+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740072e0 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.451+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74007440 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.451+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740057a0 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.451+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c0092a0 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.451+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c0ae510 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.452+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c0c50a0 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.452+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1e74010070 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.452+0000 7f1e83fff700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1e6c05ed90 0x7f1e6c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.452+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e74079200 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.452+0000 7f1e8bfff700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1e6c05ed90 0x7f1e6c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.453+0000 7f1e8bfff700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1e6c05ed90 0x7f1e6c061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1e7c009fd0 tx=0x7f1e7c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.456+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e7404a7a0 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.627+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e8c158140 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.627+0000 7f1e83fff700 1 -- 172.21.15.27:0/1070419252 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e7404ddc0 con 0x7f1e8c0c60f0 2023-05-17T14:54:07.632 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:07.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1e6c05ed90 msgr2=0x7f1e6c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1e6c05ed90 0x7f1e6c061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1e7c009fd0 tx=0x7f1e7c017000).stop 2023-05-17T14:54:07.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 msgr2=0x7f1e8c167f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 0x7f1e8c167f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f1e7400c4e0 tx=0x7f1e74007c70).stop 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 shutdown_connections 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1e6c05ed90 0x7f1e6c061250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e8c1543d0 0x7f1e8c164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e8c069410 0x7f1e8c0a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 --2- 172.21.15.27:0/1070419252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e8c0c60f0 0x7f1e8c167f90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 >> 172.21.15.27:0/1070419252 conn(0x7f1e8c0cb7f0 msgr2=0x7f1e8c156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 shutdown_connections 2023-05-17T14:54:07.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.629+0000 7f1e9229c700 1 -- 172.21.15.27:0/1070419252 wait complete. 2023-05-17T14:54:07.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:07.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.761+0000 7f3e43fff700 1 Processor -- start 2023-05-17T14:54:07.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.761+0000 7f3e43fff700 1 -- start start 2023-05-17T14:54:07.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e43fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e440cafe0 0x7f3e44157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e43fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e44158010 con 0x7f3e440cac00 2023-05-17T14:54:07.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e43fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e441582f0 con 0x7f3e44153ef0 2023-05-17T14:54:07.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e43fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e441588b0 con 0x7f3e440cafe0 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e42ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3e440cac00 0x7f3e441537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33872/0 (socket says 172.21.15.27:33872) 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e42ffd700 1 -- 172.21.15.27:0/1229655146 learned_addr learned my addr 172.21.15.27:0/1229655146 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e437fe700 1 --2- 172.21.15.27:0/1229655146 >> v2:172.21.15.40:3300/0 conn(0x7f3e440cafe0 0x7f3e44157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601554708 0 0) 0x7f3e44158010 con 0x7f3e440cac00 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e300033f0 con 0x7f3e440cac00 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3905889519 0 0) 0x7f3e300033f0 con 0x7f3e440cac00 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 >> v2:172.21.15.40:3300/0 conn(0x7f3e440cafe0 msgr2=0x7f3e44157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 --2- 172.21.15.27:0/1229655146 >> v2:172.21.15.40:3300/0 conn(0x7f3e440cafe0 0x7f3e44157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 >> v1:172.21.15.40:6789/0 conn(0x7f3e44153ef0 legacy=0x7f3e440c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e441585d0 con 0x7f3e440cac00 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f3e3c001470 con 0x7f3e440cac00 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 >> v1:172.21.15.27:6789/0 conn(0x7f3e440cac00 legacy=0x7f3e441537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e300038e0 0x7f3e30003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e30005000 0x7f3e3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441588b0 con 0x7f3e30004690 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000beb0 con 0x7f3e30005000 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.762+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000c070 con 0x7f3e300038e0 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e42ffd700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e300038e0 0x7f3e30003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e437fe700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e30005000 0x7f3e3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 -- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e300038e0 msgr2=0x7f3e30003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e300038e0 0x7f3e30003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 -- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e30005000 msgr2=0x7f3e3000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e30005000 0x7f3e3000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 -- 172.21.15.27:0/1229655146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300033f0 con 0x7f3e30004690 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e42ffd700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e300038e0 0x7f3e30003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e437fe700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e30005000 0x7f3e3000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e437fe700 1 -- 172.21.15.27:0/1229655146 reap_dead start 2023-05-17T14:54:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e427fc700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e30004b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3e2c001e30 tx=0x7f3e2c007f30).ready entity=mon.0 client_cookie=5106d6a5ebd257c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c006a20 con 0x7f3e30004690 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c006b80 con 0x7f3e30004690 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.763+0000 7f3e41ffb700 1 -- 172.21.15.27:0/1229655146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00c5d0 con 0x7f3e30004690 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 -- 172.21.15.27:0/1229655146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 msgr2=0x7f3e30004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e30004b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3e2c001e30 tx=0x7f3e2c007f30).stop 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 -- 172.21.15.27:0/1229655146 shutdown_connections 2023-05-17T14:54:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 --2- 172.21.15.27:0/1229655146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e30004b10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 -- 172.21.15.27:0/1229655146 >> 172.21.15.27:0/1229655146 conn(0x7f3e4405dd50 msgr2=0x7f3e4405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 -- 172.21.15.27:0/1229655146 shutdown_connections 2023-05-17T14:54:07.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.764+0000 7f3e43fff700 1 -- 172.21.15.27:0/1229655146 wait complete. 2023-05-17T14:54:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.765+0000 7f3e43fff700 1 Processor -- start 2023-05-17T14:54:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.765+0000 7f3e43fff700 1 -- start start 2023-05-17T14:54:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e4414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e440af410 0x7f3e441504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e441509c0 0x7f3e44154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44156690 con 0x7f3e30004690 2023-05-17T14:54:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44150e40 con 0x7f3e440af410 2023-05-17T14:54:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440af890 con 0x7f3e441509c0 2023-05-17T14:54:07.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e4414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e4414db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34322/0 (socket says 172.21.15.27:34322) 2023-05-17T14:54:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 -- 172.21.15.27:0/8770352 learned_addr learned my addr 172.21.15.27:0/8770352 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e427fc700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e440af410 0x7f3e441504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e437fe700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e441509c0 0x7f3e44154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 -- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e441509c0 msgr2=0x7f3e44154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e441509c0 0x7f3e44154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 -- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e440af410 msgr2=0x7f3e441504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e440af410 0x7f3e441504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 -- 172.21.15.27:0/8770352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44155a80 con 0x7f3e30004690 2023-05-17T14:54:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e427fc700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e440af410 0x7f3e441504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e42ffd700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e4414db90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3e3c00e830 tx=0x7f3e3c0014c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00c5a0 con 0x7f3e30004690 2023-05-17T14:54:07.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00c700 con 0x7f3e30004690 2023-05-17T14:54:07.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e44155d60 con 0x7f3e30004690 2023-05-17T14:54:07.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00ca80 con 0x7f3e30004690 2023-05-17T14:54:07.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.766+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44156320 con 0x7f3e30004690 2023-05-17T14:54:07.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.767+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e44156970 con 0x7f3e30004690 2023-05-17T14:54:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.768+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3e3c014430 con 0x7f3e30004690 2023-05-17T14:54:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.768+0000 7f3e3affd700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3e2405ed60 0x7f3e24061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.768+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3e3c079820 con 0x7f3e30004690 2023-05-17T14:54:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.768+0000 7f3e427fc700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3e2405ed60 0x7f3e24061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.768+0000 7f3e427fc700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3e2405ed60 0x7f3e24061220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3e44152110 tx=0x7f3e2c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.772+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e3c0498f0 con 0x7f3e30004690 2023-05-17T14:54:07.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.944+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e441564b0 con 0x7f3e30004690 2023-05-17T14:54:07.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.944+0000 7f3e3affd700 1 -- 172.21.15.27:0/8770352 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e3c04ad60 con 0x7f3e30004690 2023-05-17T14:54:07.949 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:07.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3e2405ed60 msgr2=0x7f3e24061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3e2405ed60 0x7f3e24061220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3e44152110 tx=0x7f3e2c016000).stop 2023-05-17T14:54:07.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 msgr2=0x7f3e4414db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:07.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e4414db90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3e3c00e830 tx=0x7f3e3c0014c0).stop 2023-05-17T14:54:07.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 shutdown_connections 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3e2405ed60 0x7f3e24061220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e441509c0 0x7f3e44154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e30004690 0x7f3e4414db90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 --2- 172.21.15.27:0/8770352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e440af410 0x7f3e441504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 >> 172.21.15.27:0/8770352 conn(0x7f3e4405dd50 msgr2=0x7f3e44152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 shutdown_connections 2023-05-17T14:54:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:07.946+0000 7f3e43fff700 1 -- 172.21.15.27:0/8770352 wait complete. 2023-05-17T14:54:07.962 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:08.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.073+0000 7f83ca5ae700 1 Processor -- start 2023-05-17T14:54:08.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.073+0000 7f83ca5ae700 1 -- start start 2023-05-17T14:54:08.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83ca5ae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83c4063dd0 0x7f83c40641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83ca5ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c40bd780 0x7f83c4068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83ca5ae700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f83c40bdc00 0x7f83c4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83ca5ae700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c4069160 con 0x7f83c40bdc00 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83ca5ae700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40c40d0 con 0x7f83c4063dd0 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83ca5ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40c3500 con 0x7f83c40bd780 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f83c40bdc00 0x7f83c4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f83c40bdc00 0x7f83c4068b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34334/0 (socket says 172.21.15.27:34334) 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 -- 172.21.15.27:0/3293555603 learned_addr learned my addr 172.21.15.27:0/3293555603 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c8dab700 1 --2- 172.21.15.27:0/3293555603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c40bd780 0x7f83c4068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c95ac700 1 --2- 172.21.15.27:0/3293555603 >> v2:172.21.15.40:3300/0 conn(0x7f83c4063dd0 0x7f83c40641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 -- 172.21.15.27:0/3293555603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c40bd780 msgr2=0x7f83c4068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 --2- 172.21.15.27:0/3293555603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c40bd780 0x7f83c4068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 -- 172.21.15.27:0/3293555603 >> v2:172.21.15.40:3300/0 conn(0x7f83c4063dd0 msgr2=0x7f83c40641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 --2- 172.21.15.27:0/3293555603 >> v2:172.21.15.40:3300/0 conn(0x7f83c4063dd0 0x7f83c40641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 -- 172.21.15.27:0/3293555603 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40c37a0 con 0x7f83c40bdc00 2023-05-17T14:54:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.074+0000 7f83c9dad700 1 --2- 172.21.15.27:0/3293555603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4068b70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f83c4061880 tx=0x7f83b40090f0).ready entity=mon.0 client_cookie=b18b318e8c9b01ff server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83c3fff700 1 -- 172.21.15.27:0/3293555603 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400b600 con 0x7f83c40bdc00 2023-05-17T14:54:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83c3fff700 1 -- 172.21.15.27:0/3293555603 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400b760 con 0x7f83c40bdc00 2023-05-17T14:54:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83c3fff700 1 -- 172.21.15.27:0/3293555603 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400bae0 con 0x7f83c40bdc00 2023-05-17T14:54:08.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 -- 172.21.15.27:0/3293555603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 msgr2=0x7f83c4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/3293555603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4068b70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f83c4061880 tx=0x7f83b40090f0).stop 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 -- 172.21.15.27:0/3293555603 shutdown_connections 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/3293555603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4068b70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/3293555603 >> v2:172.21.15.40:3300/0 conn(0x7f83c4063dd0 0x7f83c40641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/3293555603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c40bd780 0x7f83c4068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 -- 172.21.15.27:0/3293555603 >> 172.21.15.27:0/3293555603 conn(0x7f83c4062d50 msgr2=0x7f83c40c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:08.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 -- 172.21.15.27:0/3293555603 shutdown_connections 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.075+0000 7f83ca5ae700 1 -- 172.21.15.27:0/3293555603 wait complete. 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.076+0000 7f83ca5ae700 1 Processor -- start 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.076+0000 7f83ca5ae700 1 -- start start 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83ca5ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c4063dd0 0x7f83c414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83ca5ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c40bd780 0x7f83c40a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83ca5ae700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83ca5ae700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40aa390 con 0x7f83c40bdc00 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83ca5ae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40a8580 con 0x7f83c40bd780 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83ca5ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c414c990 con 0x7f83c4063dd0 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83c9dad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83c9dad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34340/0 (socket says 172.21.15.27:34340) 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.077+0000 7f83c9dad700 1 -- 172.21.15.27:0/2803015874 learned_addr learned my addr 172.21.15.27:0/2803015874 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c8dab700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c40bd780 0x7f83c40a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c95ac700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c4063dd0 0x7f83c414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c9dad700 1 -- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c4063dd0 msgr2=0x7f83c414c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c9dad700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c4063dd0 0x7f83c414c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c9dad700 1 -- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c40bd780 msgr2=0x7f83c40a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c9dad700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c40bd780 0x7f83c40a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c9dad700 1 -- 172.21.15.27:0/2803015874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009370 con 0x7f83c40bdc00 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c95ac700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c4063dd0 0x7f83c414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c9dad700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4149620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f83b4009130 tx=0x7f83b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400bae0 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400bea0 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c414c6b0 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b401b660 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.078+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c40aa020 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.079+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c40aa540 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.079+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f83b402b070 con 0x7f83c40bdc00 2023-05-17T14:54:08.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.080+0000 7f83c17fa700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f83b005ed90 0x7f83b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.080+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f83b407b4d0 con 0x7f83c40bdc00 2023-05-17T14:54:08.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.080+0000 7f83c95ac700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f83b005ed90 0x7f83b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.080+0000 7f83c95ac700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f83b005ed90 0x7f83b0061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f83bc0075e0 tx=0x7f83bc0097e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.084+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83c40aa540 con 0x7f83c40bdc00 2023-05-17T14:54:08.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.297+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83c406bdf0 con 0x7f83c40bdc00 2023-05-17T14:54:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.297+0000 7f83c17fa700 1 -- 172.21.15.27:0/2803015874 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f83b4029090 con 0x7f83c40bdc00 2023-05-17T14:54:08.302 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:08.302 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f83b005ed90 msgr2=0x7f83b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f83b005ed90 0x7f83b0061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f83bc0075e0 tx=0x7f83bc0097e0).stop 2023-05-17T14:54:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 msgr2=0x7f83c4149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4149620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f83b4009130 tx=0x7f83b4017000).stop 2023-05-17T14:54:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 shutdown_connections 2023-05-17T14:54:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f83b005ed90 0x7f83b0061250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83c40bdc00 0x7f83c4149620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83c4063dd0 0x7f83c414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 --2- 172.21.15.27:0/2803015874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c40bd780 0x7f83c40a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 >> 172.21.15.27:0/2803015874 conn(0x7f83c4062d50 msgr2=0x7f83c40c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 shutdown_connections 2023-05-17T14:54:08.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.299+0000 7f83ca5ae700 1 -- 172.21.15.27:0/2803015874 wait complete. 2023-05-17T14:54:08.305 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:08.315 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:08.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.427+0000 7f82273a6700 1 Processor -- start 2023-05-17T14:54:08.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.427+0000 7f82273a6700 1 -- start start 2023-05-17T14:54:08.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f82273a6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82200c5f30 0x7f82200c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f82273a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8220158880 0x7f8220153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f82273a6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82200bfcd0 con 0x7f82201541c0 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f82273a6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200c0290 con 0x7f82200c5f30 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f82273a6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200aa1a0 con 0x7f8220158880 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225142700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82200c5f30 0x7f82200c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225943700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f82201541c0 0x7f82200c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33910/0 (socket says 172.21.15.27:33910) 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225943700 1 -- 172.21.15.27:0/1465640045 learned_addr learned my addr 172.21.15.27:0/1465640045 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8224941700 1 --2- 172.21.15.27:0/1465640045 >> v2:172.21.15.40:3300/0 conn(0x7f8220158880 0x7f8220153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225142700 1 -- 172.21.15.27:0/1465640045 >> v2:172.21.15.40:3300/0 conn(0x7f8220158880 msgr2=0x7f8220153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225142700 1 --2- 172.21.15.27:0/1465640045 >> v2:172.21.15.40:3300/0 conn(0x7f8220158880 0x7f8220153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225142700 1 -- 172.21.15.27:0/1465640045 >> v1:172.21.15.27:6789/0 conn(0x7f82201541c0 legacy=0x7f82200c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f821ffff700 1 -- 172.21.15.27:0/1465640045 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743332149 0 0) 0x7f82200bfcd0 con 0x7f82201541c0 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.428+0000 7f8225142700 1 -- 172.21.15.27:0/1465640045 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200aa480 con 0x7f82200c5f30 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f8225142700 1 --2- 172.21.15.27:0/1465640045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82200c6310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f82200c57b0 tx=0x7f8218009780).ready entity=mon.0 client_cookie=8cc9b8a5ebceadf1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f821ffff700 1 -- 172.21.15.27:0/1465640045 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800e070 con 0x7f82200c5f30 2023-05-17T14:54:08.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f821ffff700 1 -- 172.21.15.27:0/1465640045 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800bc30 con 0x7f82200c5f30 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f821ffff700 1 -- 172.21.15.27:0/1465640045 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218012410 con 0x7f82200c5f30 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 -- 172.21.15.27:0/1465640045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 msgr2=0x7f82200c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 --2- 172.21.15.27:0/1465640045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82200c6310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f82200c57b0 tx=0x7f8218009780).stop 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 -- 172.21.15.27:0/1465640045 shutdown_connections 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 --2- 172.21.15.27:0/1465640045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82200c6310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 --2- 172.21.15.27:0/1465640045 >> v2:172.21.15.40:3300/0 conn(0x7f8220158880 0x7f8220153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 -- 172.21.15.27:0/1465640045 >> 172.21.15.27:0/1465640045 conn(0x7f8220069e70 msgr2=0x7f822005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:08.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 -- 172.21.15.27:0/1465640045 shutdown_connections 2023-05-17T14:54:08.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.429+0000 7f82273a6700 1 -- 172.21.15.27:0/1465640045 wait complete. 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.430+0000 7f82273a6700 1 Processor -- start 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.430+0000 7f82273a6700 1 -- start start 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f82273a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82201563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f82273a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82201541c0 0x7f8220165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f82273a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8220158880 0x7f82200ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f82273a6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201549b0 con 0x7f82200c5f30 2023-05-17T14:54:08.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f82273a6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8220157640 con 0x7f82201541c0 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f82273a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8220156a30 con 0x7f8220158880 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f8225142700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82201563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f8225142700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82201563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34350/0 (socket says 172.21.15.27:34350) 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f8225142700 1 -- 172.21.15.27:0/1816112945 learned_addr learned my addr 172.21.15.27:0/1816112945 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f8225943700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8220158880 0x7f82200ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.431+0000 7f8224941700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82201541c0 0x7f8220165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225142700 1 -- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8220158880 msgr2=0x7f82200ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225142700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8220158880 0x7f82200ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225142700 1 -- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82201541c0 msgr2=0x7f8220165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225142700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82201541c0 0x7f8220165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225142700 1 -- 172.21.15.27:0/1816112945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009a20 con 0x7f82200c5f30 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8224941700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82201541c0 0x7f8220165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225943700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8220158880 0x7f82200ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f8225142700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82201563e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f8220083770 tx=0x7f8218009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821801d630 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821801d790 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8220156d10 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821801db50 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.432+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82201572d0 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.433+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8220157920 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.433+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8218026410 con 0x7f82200c5f30 2023-05-17T14:54:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.434+0000 7f821d7fa700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f820c05ed90 0x7f820c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.434+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f821807be30 con 0x7f82200c5f30 2023-05-17T14:54:08.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.434+0000 7f8224941700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f820c05ed90 0x7f820c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.434+0000 7f8224941700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f820c05ed90 0x7f820c061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f82201561d0 tx=0x7f8214008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.438+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f821804d420 con 0x7f82200c5f30 2023-05-17T14:54:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.615+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f822005f4a0 con 0x7f82200c5f30 2023-05-17T14:54:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.616+0000 7f821d7fa700 1 -- 172.21.15.27:0/1816112945 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f8218050a40 con 0x7f82200c5f30 2023-05-17T14:54:08.620 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:08.620 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:08.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f820c05ed90 msgr2=0x7f820c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f820c05ed90 0x7f820c061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f82201561d0 tx=0x7f8214008040).stop 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 msgr2=0x7f82201563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82201563e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f8220083770 tx=0x7f8218009780).stop 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 shutdown_connections 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f820c05ed90 0x7f820c061250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8220158880 0x7f82200ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82200c5f30 0x7f82201563e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 --2- 172.21.15.27:0/1816112945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82201541c0 0x7f8220165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 >> 172.21.15.27:0/1816112945 conn(0x7f8220069e70 msgr2=0x7f82200ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:08.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 shutdown_connections 2023-05-17T14:54:08.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.618+0000 7f82273a6700 1 -- 172.21.15.27:0/1816112945 wait complete. 2023-05-17T14:54:08.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:08.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.746+0000 7f042851f700 1 Processor -- start 2023-05-17T14:54:08.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.746+0000 7f042851f700 1 -- start start 2023-05-17T14:54:08.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f042851f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04200c6310 0x7f0420153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f042851f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04201541c0 0x7f04200c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f042851f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200bfcd0 con 0x7f04200c5f30 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f042851f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200c0290 con 0x7f04201541c0 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f042851f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200aa1a0 con 0x7f04200c6310 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04201541c0 0x7f04200c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04201541c0 0x7f04200c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34360/0 (socket says 172.21.15.27:34360) 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 -- 172.21.15.27:0/3930228361 learned_addr learned my addr 172.21.15.27:0/3930228361 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0425aba700 1 --2- 172.21.15.27:0/3930228361 >> v2:172.21.15.40:3300/0 conn(0x7f04200c6310 0x7f0420153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 -- 172.21.15.27:0/3930228361 >> v2:172.21.15.40:3300/0 conn(0x7f04200c6310 msgr2=0x7f0420153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 --2- 172.21.15.27:0/3930228361 >> v2:172.21.15.40:3300/0 conn(0x7f04200c6310 0x7f0420153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 -- 172.21.15.27:0/3930228361 >> v1:172.21.15.40:6789/0 conn(0x7f04200c5f30 legacy=0x7f0420158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.747+0000 7f0426abc700 1 -- 172.21.15.27:0/3930228361 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200aa480 con 0x7f04201541c0 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f0425aba700 1 --2- 172.21.15.27:0/3930228361 >> v2:172.21.15.40:3300/0 conn(0x7f04200c6310 0x7f0420153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f0426abc700 1 --2- 172.21.15.27:0/3930228361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04201541c0 0x7f04200c0720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f04200c57b0 tx=0x7f0410009840).ready entity=mon.0 client_cookie=21ebf6a28d6b1891 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f04252b9700 1 -- 172.21.15.27:0/3930228361 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000e070 con 0x7f04201541c0 2023-05-17T14:54:08.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f04252b9700 1 -- 172.21.15.27:0/3930228361 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000ba10 con 0x7f04201541c0 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f04252b9700 1 -- 172.21.15.27:0/3930228361 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000bd90 con 0x7f04201541c0 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 -- 172.21.15.27:0/3930228361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04201541c0 msgr2=0x7f04200c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 --2- 172.21.15.27:0/3930228361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04201541c0 0x7f04200c0720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f04200c57b0 tx=0x7f0410009840).stop 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 -- 172.21.15.27:0/3930228361 shutdown_connections 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 --2- 172.21.15.27:0/3930228361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04201541c0 0x7f04200c0720 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 --2- 172.21.15.27:0/3930228361 >> v2:172.21.15.40:3300/0 conn(0x7f04200c6310 0x7f0420153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 -- 172.21.15.27:0/3930228361 >> 172.21.15.27:0/3930228361 conn(0x7f0420069e70 msgr2=0x7f042005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:08.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 -- 172.21.15.27:0/3930228361 shutdown_connections 2023-05-17T14:54:08.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.748+0000 7f042851f700 1 -- 172.21.15.27:0/3930228361 wait complete. 2023-05-17T14:54:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.749+0000 7f042851f700 1 Processor -- start 2023-05-17T14:54:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 -- start start 2023-05-17T14:54:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04200c5f30 0x7f04200ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 0x7f04200caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04201541c0 0x7f04200aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200ca8e0 con 0x7f04200c6310 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200cb3d0 con 0x7f04200c5f30 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f042851f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200caaf0 con 0x7f04201541c0 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f0425aba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 0x7f04200caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f0425aba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 0x7f04200caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34364/0 (socket says 172.21.15.27:34364) 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.750+0000 7f0425aba700 1 -- 172.21.15.27:0/1983796462 learned_addr learned my addr 172.21.15.27:0/1983796462 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0426abc700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04201541c0 0x7f04200aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f04262bb700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04200c5f30 0x7f04200ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0425aba700 1 -- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04201541c0 msgr2=0x7f04200aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0425aba700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04201541c0 0x7f04200aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0425aba700 1 -- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04200c5f30 msgr2=0x7f04200ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0425aba700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04200c5f30 0x7f04200ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0425aba700 1 -- 172.21.15.27:0/1983796462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410009ae0 con 0x7f04200c6310 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0426abc700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04201541c0 0x7f04200aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f04262bb700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04200c5f30 0x7f04200ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f0425aba700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 0x7f04200caee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f041400c8b0 tx=0x7f0414008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414010580 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04140106e0 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04200c2950 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414010a60 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.751+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04200c2f90 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.752+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042005f4a0 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.752+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f041401b460 con 0x7f04200c6310 2023-05-17T14:54:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.753+0000 7f041e7fc700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f040c05ed90 0x7f040c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:08.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.753+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0414079c70 con 0x7f04200c6310 2023-05-17T14:54:08.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.753+0000 7f04262bb700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f040c05ed90 0x7f040c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:08.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.753+0000 7f04262bb700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f040c05ed90 0x7f040c061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f04180026f0 tx=0x7f0418009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:08.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.757+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f041404b1b0 con 0x7f04200c6310 2023-05-17T14:54:08.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.974+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f042006bdf0 con 0x7f04200c6310 2023-05-17T14:54:08.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.974+0000 7f041e7fc700 1 -- 172.21.15.27:0/1983796462 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f041404e7d0 con 0x7f04200c6310 2023-05-17T14:54:08.979 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:08.979 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f040c05ed90 msgr2=0x7f040c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f040c05ed90 0x7f040c061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f04180026f0 tx=0x7f0418009040).stop 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 msgr2=0x7f04200caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 0x7f04200caee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f041400c8b0 tx=0x7f0414008040).stop 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 shutdown_connections 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f040c05ed90 0x7f040c061250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04201541c0 0x7f04200aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04200c5f30 0x7f04200ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 --2- 172.21.15.27:0/1983796462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200c6310 0x7f04200caee0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 >> 172.21.15.27:0/1983796462 conn(0x7f0420069e70 msgr2=0x7f042014f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 shutdown_connections 2023-05-17T14:54:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:08.976+0000 7f042851f700 1 -- 172.21.15.27:0/1983796462 wait complete. 2023-05-17T14:54:08.982 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:09.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T14:53:52.874961+0000', 'modified': '2023-05-17T14:53:55.885951+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4257': {'gid': 4257, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6837/2714336229', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6836', 'nonce': 2714336229}, {'type': 'v1', 'addr': '172.21.15.27:6837', 'nonce': 2714336229}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T14:54:09.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T14:54:09.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-17T14:54:09.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.512+0000 7f54b6b43700 1 Processor -- start 2023-05-17T14:54:09.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.512+0000 7f54b6b43700 1 -- start start 2023-05-17T14:54:09.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b6b43700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f54b00c5fd0 0x7f54b00ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b6b43700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54b0154e90 0x7f54b00a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b6b43700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0155340 con 0x7f54b00acdb0 2023-05-17T14:54:09.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b6b43700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b0157de0 con 0x7f54b00c5fd0 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b6b43700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b01580c0 con 0x7f54b0154e90 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5b41700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f54b00acdb0 0x7f54b00c58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33934/0 (socket says 172.21.15.27:33934) 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5b41700 1 -- 172.21.15.27:0/880997418 learned_addr learned my addr 172.21.15.27:0/880997418 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5340700 1 --2- 172.21.15.27:0/880997418 >> v2:172.21.15.27:3300/0 conn(0x7f54b00c5fd0 0x7f54b00ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b4b3f700 1 -- 172.21.15.27:0/880997418 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981507280 0 0) 0x7f54b0155340 con 0x7f54b00acdb0 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b4b3f700 1 -- 172.21.15.27:0/880997418 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54980033f0 con 0x7f54b00acdb0 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b6342700 1 --2- 172.21.15.27:0/880997418 >> v2:172.21.15.40:3300/0 conn(0x7f54b0154e90 0x7f54b00a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5340700 1 -- 172.21.15.27:0/880997418 >> v2:172.21.15.40:3300/0 conn(0x7f54b0154e90 msgr2=0x7f54b00a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5340700 1 --2- 172.21.15.27:0/880997418 >> v2:172.21.15.40:3300/0 conn(0x7f54b0154e90 0x7f54b00a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5340700 1 -- 172.21.15.27:0/880997418 >> v1:172.21.15.27:6789/0 conn(0x7f54b00acdb0 legacy=0x7f54b00c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5340700 1 -- 172.21.15.27:0/880997418 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b01583a0 con 0x7f54b00c5fd0 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.513+0000 7f54b5340700 1 --2- 172.21.15.27:0/880997418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00ad190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f54b006c500 tx=0x7f54a4009060).ready entity=mon.0 client_cookie=a1baee1967e3db4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b4b3f700 1 -- 172.21.15.27:0/880997418 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400f510 con 0x7f54b00c5fd0 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b4b3f700 1 -- 172.21.15.27:0/880997418 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400f670 con 0x7f54b00c5fd0 2023-05-17T14:54:09.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b4b3f700 1 -- 172.21.15.27:0/880997418 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400f9f0 con 0x7f54b00c5fd0 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 -- 172.21.15.27:0/880997418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 msgr2=0x7f54b00ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 --2- 172.21.15.27:0/880997418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00ad190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f54b006c500 tx=0x7f54a4009060).stop 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 -- 172.21.15.27:0/880997418 shutdown_connections 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 --2- 172.21.15.27:0/880997418 >> v2:172.21.15.40:3300/0 conn(0x7f54b0154e90 0x7f54b00a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 --2- 172.21.15.27:0/880997418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00ad190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 -- 172.21.15.27:0/880997418 >> 172.21.15.27:0/880997418 conn(0x7f54b005dd50 msgr2=0x7f54b005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 -- 172.21.15.27:0/880997418 shutdown_connections 2023-05-17T14:54:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.514+0000 7f54b6b43700 1 -- 172.21.15.27:0/880997418 wait complete. 2023-05-17T14:54:09.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.515+0000 7f54b6b43700 1 Processor -- start 2023-05-17T14:54:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.515+0000 7f54b6b43700 1 -- start start 2023-05-17T14:54:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6b43700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b00acdb0 0x7f54b0168500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6b43700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6b43700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b0154e90 0x7f54b00a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6b43700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00ad9b0 con 0x7f54b00c5fd0 2023-05-17T14:54:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6b43700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b013bf30 con 0x7f54b0154e90 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6b43700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b013c460 con 0x7f54b00acdb0 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b5340700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b5340700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34380/0 (socket says 172.21.15.27:34380) 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b5340700 1 -- 172.21.15.27:0/3498551518 learned_addr learned my addr 172.21.15.27:0/3498551518 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b5b41700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b00acdb0 0x7f54b0168500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.516+0000 7f54b6342700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b0154e90 0x7f54b00a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b5340700 1 -- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b00acdb0 msgr2=0x7f54b0168500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b5340700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b00acdb0 0x7f54b0168500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b5340700 1 -- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b0154e90 msgr2=0x7f54b00a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b5340700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b0154e90 0x7f54b00a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b5340700 1 -- 172.21.15.27:0/3498551518 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40092a0 con 0x7f54b00c5fd0 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b5340700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00c3ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f54b005f1e0 tx=0x7f54a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54adffb700 1 -- 172.21.15.27:0/3498551518 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400f7e0 con 0x7f54b00c5fd0 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54adffb700 1 -- 172.21.15.27:0/3498551518 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400f940 con 0x7f54b00c5fd0 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b00c4190 con 0x7f54b00c5fd0 2023-05-17T14:54:09.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54adffb700 1 -- 172.21.15.27:0/3498551518 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a401b660 con 0x7f54b00c5fd0 2023-05-17T14:54:09.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.517+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b00c4740 con 0x7f54b00c5fd0 2023-05-17T14:54:09.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.518+0000 7f54adffb700 1 -- 172.21.15.27:0/3498551518 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f54a402c070 con 0x7f54b00c5fd0 2023-05-17T14:54:09.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.519+0000 7f54adffb700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549c05ed90 0x7f549c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.519+0000 7f54adffb700 1 -- 172.21.15.27:0/3498551518 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f54a407b540 con 0x7f54b00c5fd0 2023-05-17T14:54:09.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.519+0000 7f54b5b41700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549c05ed90 0x7f549c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.519+0000 7f54b5b41700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549c05ed90 0x7f549c061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f54a0005ad0 tx=0x7f54a0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.521+0000 7f54c9737b80 1 Processor -- start 2023-05-17T14:54:09.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.521+0000 7f54c9737b80 1 -- start start 2023-05-17T14:54:09.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.521+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca4ea6b0 0x5557ca512a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.521+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 0x5557ca4eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.521+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca4e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.521+0000 7f54c9737b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca4b05e0 con 0x5557ca533350 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca4278a0 con 0x5557ca4ea6b0 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ca43c900 con 0x5557ca4e5660 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 0x5557ca4eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 0x5557ca4eaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34388/0 (socket says 172.21.15.27:34388) 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 -- 172.21.15.27:0/2679946487 learned_addr learned my addr 172.21.15.27:0/2679946487 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5b41700 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca4ea6b0 0x5557ca512a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b6342700 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca4e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 -- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 msgr2=0x5557ca4e5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca4e5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 -- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca4ea6b0 msgr2=0x5557ca512a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca4ea6b0 0x5557ca512a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 -- 172.21.15.27:0/2679946487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ca2df310 con 0x5557ca533350 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5b41700 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca4ea6b0 0x5557ca512a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f54b5340700 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 0x5557ca4eaa90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f54a4050470 tx=0x7f54a400e000).ready entity=mon.0 client_cookie=adbe10e9fb9b610c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f5496ffd700 1 -- 172.21.15.27:0/2679946487 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4079440 con 0x5557ca533350 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f5496ffd700 1 -- 172.21.15.27:0/2679946487 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40795a0 con 0x5557ca533350 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.522+0000 7f5496ffd700 1 -- 172.21.15.27:0/2679946487 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a404cf60 con 0x5557ca533350 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 -- 172.21.15.27:0/2679946487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 msgr2=0x5557ca4eaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 0x5557ca4eaa90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f54a4050470 tx=0x7f54a400e000).stop 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 -- 172.21.15.27:0/2679946487 shutdown_connections 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca4e5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca4ea6b0 0x5557ca512a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 --2- 172.21.15.27:0/2679946487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca533350 0x5557ca4eaa90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 -- 172.21.15.27:0/2679946487 >> 172.21.15.27:0/2679946487 conn(0x5557ca2a7e40 msgr2=0x5557ca5337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 -- 172.21.15.27:0/2679946487 shutdown_connections 2023-05-17T14:54:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 -- 172.21.15.27:0/2679946487 wait complete. 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 -- start start 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.523+0000 7f54c9737b80 1 Processor -- start 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca53eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca53f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca533350 0x5557ca4e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca403ed0 con 0x5557ca4e5660 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca5405b0 con 0x5557ca533350 2023-05-17T14:54:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ca53ff60 con 0x5557ca4ea6b0 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54c9737b80 10 client.0 ll_register_callbacks cb 0x5557ca4aa3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54b5b41700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca53eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54b5b41700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca53eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34392/0 (socket says 172.21.15.27:34392) 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.524+0000 7f54b5b41700 1 -- 172.21.15.27:0/422212285 learned_addr learned my addr 172.21.15.27:0/422212285 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5340700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca53f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b6342700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca533350 0x5557ca4e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5b41700 1 -- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 msgr2=0x5557ca53f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5b41700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca53f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5b41700 1 -- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca533350 msgr2=0x5557ca4e84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5b41700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca533350 0x5557ca4e84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5b41700 1 -- 172.21.15.27:0/422212285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b00c4740 con 0x5557ca4e5660 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f548ffff700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54b5b41700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca53eee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f54a0014b30 tx=0x7f54a0016040).ready entity=mon.0 client_cookie=e9f673f43e9722a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f548ffff700 1 -- 172.21.15.27:0/422212285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0001880 con 0x5557ca4e5660 2023-05-17T14:54:09.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f548ffff700 1 -- 172.21.15.27:0/422212285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f54a0022c90 con 0x5557ca4e5660 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557ca4e2a40 con 0x5557ca4e5660 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f548ffff700 1 -- 172.21.15.27:0/422212285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54a0022e50 con 0x5557ca4e5660 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 10 client.4653 fetch_fsmap learned FSMap version 8 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5557ca435880 con 0x5557ca4e5660 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f548ffff700 1 -- 172.21.15.27:0/422212285 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557ca4e2a40 con 0x5557ca4e5660 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f548ffff700 1 -- 172.21.15.27:0/422212285 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f54a0005030 con 0x5557ca4e5660 2023-05-17T14:54:09.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 10 client.4653 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 20 client.4653 populate_metadata read hostname 'smithi027' 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca52cb90 0x5557ca541450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 4 client.4653 mds_command: new command op to 4257 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.525+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 --> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557ca2a3ca0 con 0x5557ca52cb90 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.526+0000 7f54b5340700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca52cb90 0x5557ca541450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.526+0000 7f548ffff700 10 client.4653 ms_handle_connect on v2:172.21.15.27:6836/2714336229 2023-05-17T14:54:09.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.526+0000 7f54b5340700 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca52cb90 0x5557ca541450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=974c24abb2c90475 server_cookie=8bb781394a2de055 in_seq=0 out_seq=0 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.526+0000 7f548ffff700 1 -- 172.21.15.27:0/422212285 <== mds.0 v2:172.21.15.27:6836/2714336229 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5557ca2a3ca0 con 0x5557ca52cb90 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.526+0000 7f548ffff700 10 client.4653 handle_command_reply: tid=0 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.526+0000 7f54c9737b80 1 client.4653 shutdown 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 msgr2=0x5557ca53eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca53eee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f54a0014b30 tx=0x7f54a0016040).stop 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 shutdown_connections 2023-05-17T14:54:09.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca52cb90 0x5557ca541450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca533350 0x5557ca4e84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f548ffff700 0 client.4653 ms_handle_reset on v2:172.21.15.27:6836/2714336229 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca53eee0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 --2- 172.21.15.27:0/422212285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca53f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 >> 172.21.15.27:0/422212285 conn(0x5557ca2a7e40 msgr2=0x5557ca512790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 shutdown_connections 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 1 -- 172.21.15.27:0/422212285 wait complete. 2023-05-17T14:54:09.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.527+0000 7f54c9737b80 20 client.4653 trim_cache size 0 max 16384 2023-05-17T14:54:09.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.543+0000 7f54c9737b80 1 Processor -- start 2023-05-17T14:54:09.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 -- start start 2023-05-17T14:54:09.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca5413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca533b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca512630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca5137a0 con 0x5557ca4e5660 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca4ec780 con 0x5557ca52cb90 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ca4df210 con 0x5557ca4ea6b0 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54b5b41700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca5413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54b5b41700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca5413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34400/0 (socket says 172.21.15.27:34400) 2023-05-17T14:54:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.544+0000 7f54b5b41700 1 -- 172.21.15.27:0/281139008 learned_addr learned my addr 172.21.15.27:0/281139008 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b5b41700 1 -- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 msgr2=0x5557ca533b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b5b41700 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca533b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b5b41700 1 -- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 msgr2=0x5557ca512630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b6342700 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca512630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b5b41700 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca512630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b5b41700 1 -- 172.21.15.27:0/281139008 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ca431070 con 0x5557ca4e5660 2023-05-17T14:54:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54b5b41700 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca5413b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f54a0014a00 tx=0x7f54a0017000).ready entity=mon.0 client_cookie=dc6082b696cce071 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54977fe700 1 -- 172.21.15.27:0/281139008 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0030070 con 0x5557ca4e5660 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54977fe700 1 -- 172.21.15.27:0/281139008 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0001d00 con 0x5557ca4e5660 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54977fe700 1 -- 172.21.15.27:0/281139008 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00054f0 con 0x5557ca4e5660 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 -- 172.21.15.27:0/281139008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 msgr2=0x5557ca5413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca5413b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f54a0014a00 tx=0x7f54a0017000).stop 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 -- 172.21.15.27:0/281139008 shutdown_connections 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca512630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4e5660 0x5557ca5413b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 --2- 172.21.15.27:0/281139008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4ea6b0 0x5557ca533b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 -- 172.21.15.27:0/281139008 >> 172.21.15.27:0/281139008 conn(0x5557ca2a7e40 msgr2=0x5557ca4df3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 -- 172.21.15.27:0/281139008 shutdown_connections 2023-05-17T14:54:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.545+0000 7f54c9737b80 1 -- 172.21.15.27:0/281139008 wait complete. 2023-05-17T14:54:09.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.546+0000 7f54c9737b80 1 -- start start 2023-05-17T14:54:09.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.546+0000 7f54c9737b80 1 Processor -- start 2023-05-17T14:54:09.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca595350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 0x5557ca4eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca4eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca4eb6a0 con 0x5557ca4ea6b0 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ca595ff0 con 0x5557ca52cb90 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ca510e70 con 0x5557ca4e5660 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54c9737b80 10 client.0 ll_register_callbacks cb 0x5557ca4aa3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 0x5557ca4eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 0x5557ca4eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34406/0 (socket says 172.21.15.27:34406) 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 -- 172.21.15.27:0/1071719467 learned_addr learned my addr 172.21.15.27:0/1071719467 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5b41700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca595350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b6342700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca4eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 -- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 msgr2=0x5557ca595350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca595350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 -- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 msgr2=0x5557ca4eb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca4eb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 -- 172.21.15.27:0/1071719467 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557ca435880 con 0x5557ca4ea6b0 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f54b5340700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 0x5557ca4eacc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f54a4009130 tx=0x7f54a402f000).ready entity=mon.0 client_cookie=3789f44f25e609c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:09.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.547+0000 7f548ffff700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f548ffff700 1 -- 172.21.15.27:0/1071719467 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4036040 con 0x5557ca4ea6b0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f548ffff700 1 -- 172.21.15.27:0/1071719467 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f54a404ff50 con 0x5557ca4ea6b0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54a40795a0 con 0x5557ca4ea6b0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f548ffff700 1 -- 172.21.15.27:0/1071719467 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54a404cf60 con 0x5557ca4ea6b0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 10 client.4659 fetch_fsmap learned FSMap version 8 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5557ca430dc0 con 0x5557ca4ea6b0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f548ffff700 1 -- 172.21.15.27:0/1071719467 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40795a0 con 0x5557ca4ea6b0 2023-05-17T14:54:09.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f548ffff700 1 -- 172.21.15.27:0/1071719467 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f54a4039070 con 0x5557ca4ea6b0 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 10 client.4659 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 20 client.4659 populate_metadata read hostname 'smithi027' 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca533350 0x5557ca5152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 4 client.4659 mds_command: new command op to 4257 tid=0[{"prefix": "status"}] 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 --> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557ca2daca0 con 0x5557ca533350 2023-05-17T14:54:09.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f54b5b41700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca533350 0x5557ca5152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.548+0000 7f548ffff700 10 client.4659 ms_handle_connect on v2:172.21.15.27:6836/2714336229 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54b5b41700 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca533350 0x5557ca5152d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bbf8ae0896f3b79b server_cookie=b9962169f881b232 in_seq=0 out_seq=0 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f548ffff700 1 -- 172.21.15.27:0/1071719467 <== mds.0 v2:172.21.15.27:6836/2714336229 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5557ca2daca0 con 0x5557ca533350 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f548ffff700 10 client.4659 handle_command_reply: tid=0 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 client.4659 shutdown 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 msgr2=0x5557ca4eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 0x5557ca4eacc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f54a4009130 tx=0x7f54a402f000).stop 2023-05-17T14:54:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 shutdown_connections 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:6836/2714336229,v1:172.21.15.27:6837/2714336229] conn(0x5557ca533350 0x5557ca5152d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5557ca52cb90 0x5557ca4eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5557ca4e5660 0x5557ca595350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 --2- 172.21.15.27:0/1071719467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557ca4ea6b0 0x5557ca4eacc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 >> 172.21.15.27:0/1071719467 conn(0x5557ca2a7e40 msgr2=0x5557ca4e8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f548ffff700 0 client.4659 ms_handle_reset on v2:172.21.15.27:6836/2714336229 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 shutdown_connections 2023-05-17T14:54:09.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 1 -- 172.21.15.27:0/1071719467 wait complete. 2023-05-17T14:54:09.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.549+0000 7f54c9737b80 20 client.4659 trim_cache size 0 max 16384 2023-05-17T14:54:09.563 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T14:54:09.563 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T14:54:09.563 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T14:54:09.563 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4257, 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 16.673076115000001, 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 8, 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 22, 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 22, 2023-05-17T14:54:09.564 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 21.832088168999999 2023-05-17T14:54:09.565 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T14:54:09.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549c05ed90 msgr2=0x7f549c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549c05ed90 0x7f549c061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f54a0005ad0 tx=0x7f54a0009040).stop 2023-05-17T14:54:09.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 msgr2=0x7f54b00c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:09.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00c3ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f54b005f1e0 tx=0x7f54a4017000).stop 2023-05-17T14:54:09.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 shutdown_connections 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549c05ed90 0x7f549c061250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b0154e90 0x7f54b00a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b00acdb0 0x7f54b0168500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 --2- 172.21.15.27:0/3498551518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b00c5fd0 0x7f54b00c3ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 >> 172.21.15.27:0/3498551518 conn(0x7f54b005dd50 msgr2=0x7f54b0069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 shutdown_connections 2023-05-17T14:54:09.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:09.550+0000 7f54b6b43700 1 -- 172.21.15.27:0/3498551518 wait complete. 2023-05-17T14:54:09.568 INFO:teuthology.run_tasks:Running task kclient... 2023-05-17T14:54:09.590 INFO:tasks.kclient:Mounting kernel clients... 2023-05-17T14:54:09.591 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-17T14:54:09.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.592 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T14:54:09.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.607 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-05-17T14:54:09.673 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-05-17T14:54:09.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:54:09.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.675 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T14:54:09.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.731 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-05-17T14:54:09.795 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-05-17T14:54:09.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:54:09.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.797 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-17T14:54:09.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-05-17T14:54:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-05-17T14:54:09.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:54:09.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.890 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-17T14:54:09.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:09.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-05-17T14:54:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-05-17T14:54:10.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:54:10.017 INFO:tasks.kclient:client.0 config is {} 2023-05-17T14:54:10.017 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T14:54:10.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.117+0000 7f1961ad0700 1 Processor -- start 2023-05-17T14:54:10.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.117+0000 7f1961ad0700 1 -- start start 2023-05-17T14:54:10.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f1961ad0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 0x7f195c150b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f1961ad0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c06a270 con 0x7f195c069e00 2023-05-17T14:54:10.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f1961ad0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0c7c90 con 0x7f195c1547e0 2023-05-17T14:54:10.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f1961ad0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c155020 con 0x7f195c154bc0 2023-05-17T14:54:10.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f19612cf700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f195c069e00 0x7f195c0c4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33976/0 (socket says 172.21.15.27:33976) 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f19612cf700 1 -- 172.21.15.27:0/236722746 learned_addr learned my addr 172.21.15.27:0/236722746 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f195bfff700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 0x7f195c150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814910235 0 0) 0x7f195c06a270 con 0x7f195c069e00 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f194c0033f0 con 0x7f195c069e00 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107445916 0 0) 0x7f195c0c7c90 con 0x7f195c1547e0 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195c06a270 con 0x7f195c1547e0 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.118+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340223216 0 0) 0x7f194c0033f0 con 0x7f195c069e00 2023-05-17T14:54:10.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 msgr2=0x7f195c150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 0x7f195c150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 >> v1:172.21.15.40:6789/0 conn(0x7f195c1547e0 legacy=0x7f195c150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0c1f50 con 0x7f195c069e00 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f19540017f0 con 0x7f195c069e00 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 >> v1:172.21.15.27:6789/0 conn(0x7f195c069e00 legacy=0x7f195c0c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 0x7f194c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f194c004000 0x7f194c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194c004b80 0x7f194c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c155020 con 0x7f194c004000 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c00b9c0 con 0x7f194c004b80 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c00bb80 con 0x7f195c154bc0 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f194c004000 0x7f194c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f1960ace700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 0x7f194c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f19612cf700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194c004b80 0x7f194c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 -- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 msgr2=0x7f194c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c154bc0 0x7f194c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 -- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194c004b80 msgr2=0x7f194c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194c004b80 0x7f194c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 -- 172.21.15.27:0/236722746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0033f0 con 0x7f194c004000 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f19612cf700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194c004b80 0x7f194c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195bfff700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f194c004000 0x7f194c004690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f1948006d80 tx=0x7f1948009060).ready entity=mon.0 client_cookie=95f02d7d3eb6c41f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948009e90 con 0x7f194c004000 2023-05-17T14:54:10.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948009430 con 0x7f194c004000 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.119+0000 7f195b7fe700 1 -- 172.21.15.27:0/236722746 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800e850 con 0x7f194c004000 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f1961ad0700 1 -- 172.21.15.27:0/236722746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f194c004000 msgr2=0x7f194c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f1961ad0700 1 --2- 172.21.15.27:0/236722746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f194c004000 0x7f194c004690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f1948006d80 tx=0x7f1948009060).stop 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f19612cf700 1 -- 172.21.15.27:0/236722746 reap_dead start 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f1961ad0700 1 -- 172.21.15.27:0/236722746 shutdown_connections 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f1961ad0700 1 -- 172.21.15.27:0/236722746 >> 172.21.15.27:0/236722746 conn(0x7f195c064d80 msgr2=0x7f195c0c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:10.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f1961ad0700 1 -- 172.21.15.27:0/236722746 shutdown_connections 2023-05-17T14:54:10.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.120+0000 7f1961ad0700 1 -- 172.21.15.27:0/236722746 wait complete. 2023-05-17T14:54:10.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.121+0000 7f1961ad0700 1 Processor -- start 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.121+0000 7f1961ad0700 1 -- start start 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1961ad0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f194c004000 0x7f195c0a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1961ad0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195c0a0f30 0x7f195c162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1961ad0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 0x7f195c0622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1961ad0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c163210 con 0x7f195c162730 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1961ad0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c14e530 con 0x7f195c0a0f30 2023-05-17T14:54:10.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1961ad0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c165d50 con 0x7f194c004000 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 0x7f195c0622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 0x7f195c0622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34428/0 (socket says 172.21.15.27:34428) 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 -- 172.21.15.27:0/4212879986 learned_addr learned my addr 172.21.15.27:0/4212879986 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1960ace700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f194c004000 0x7f195c0a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f195bfff700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195c0a0f30 0x7f195c162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 -- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f194c004000 msgr2=0x7f195c0a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f194c004000 0x7f195c0a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 -- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195c0a0f30 msgr2=0x7f195c162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195c0a0f30 0x7f195c162240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 -- 172.21.15.27:0/4212879986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c162c50 con 0x7f195c162730 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f19612cf700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 0x7f195c0622d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f195c067d00 tx=0x7f1954007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.122+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954010450 con 0x7f195c162730 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.123+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540105b0 con 0x7f195c162730 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.123+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c162f30 con 0x7f195c162730 2023-05-17T14:54:10.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.123+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954010930 con 0x7f195c162730 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.123+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0627c0 con 0x7f195c162730 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.123+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c165840 con 0x7f195c162730 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.124+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f195401d070 con 0x7f195c162730 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.124+0000 7f1958ff9700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005edc0 0x7f1940061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.124+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1954079090 con 0x7f195c162730 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.124+0000 7f1960ace700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005edc0 0x7f1940061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:10.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.125+0000 7f1960ace700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005edc0 0x7f1940061280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1950007fd0 tx=0x7f1950009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:10.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.128+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f195c165840 con 0x7f195c162730 2023-05-17T14:54:10.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.342+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f195c165840 con 0x7f195c162730 2023-05-17T14:54:10.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.343+0000 7f1958ff9700 1 -- 172.21.15.27:0/4212879986 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f195c165840 con 0x7f195c162730 2023-05-17T14:54:10.347 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T14:54:10.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005edc0 msgr2=0x7f1940061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005edc0 0x7f1940061280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1950007fd0 tx=0x7f1950009040).stop 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 msgr2=0x7f195c0622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 0x7f195c0622d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f195c067d00 tx=0x7f1954007cb0).stop 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 shutdown_connections 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005edc0 0x7f1940061280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f195c162730 0x7f195c0622d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f194c004000 0x7f195c0a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 --2- 172.21.15.27:0/4212879986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195c0a0f30 0x7f195c162240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:10.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 >> 172.21.15.27:0/4212879986 conn(0x7f195c064d80 msgr2=0x7f195c0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:10.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 shutdown_connections 2023-05-17T14:54:10.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:10.344+0000 7f1961ad0700 1 -- 172.21.15.27:0/4212879986 wait complete. 2023-05-17T14:54:10.359 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T14:54:10.359 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T14:54:10.359 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T14:54:10.359 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T14:54:10.360 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T14:54:10.360 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T14:54:10.360 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T14:54:10.360 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T14:54:10.360 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T14:54:10.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.361 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T14:54:10.375 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:10.375 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:10.376 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:10.377 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:10.378 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:10.378 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T14:54:10.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.379 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:10.379 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:10.379 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2023-05-17T14:54:10.379 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2023-05-17T14:54:10.379 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2023-05-17T14:54:10.380 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T14:54:10.380 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:10.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.532 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T14:54:10.572 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T14:54:10.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.573 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T14:54:10.650 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T14:54:10.651 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T14:54:10.651 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T14:54:10.651 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T14:54:10.651 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T14:54:10.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.652 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:10.652 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:10.652 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T14:54:10.653 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T14:54:10.653 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T14:54:10.653 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:10.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.898 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T14:54:10.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.912 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-05-17T14:54:10.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:10.966 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:10.966 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:10.966 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T14:54:10.967 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-17T14:54:10.967 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:11.054 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-17T14:54:11.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:11.054 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:11.055 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:11.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-17T14:54:11.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T14:54:11.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-17T14:54:11.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-17T14:54:11.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-17T14:54:11.056 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:11.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:11.239 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:11.240 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:11.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T14:54:11.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T14:54:11.240 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:11.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:11.332 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T14:54:11.345 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T14:54:11.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:11.440 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:11.441 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T14:54:11.549 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:11.550 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T14:54:11.553 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T14:54:11.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:11.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T14:54:11.577 INFO:tasks.kclient:client.2 config is {} 2023-05-17T14:54:11.578 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T14:54:11.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.717+0000 7f3f38586700 1 Processor -- start 2023-05-17T14:54:11.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.717+0000 7f3f38586700 1 -- start start 2023-05-17T14:54:11.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f38586700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300697a0 0x7f3f30068c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:11.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f38586700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f300bc860 0x7f3f300bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:11.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f38586700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300c7440 con 0x7f3f30069b80 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f38586700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f301543d0 con 0x7f3f300bc860 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f38586700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30154690 con 0x7f3f300697a0 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35b21700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3f30069b80 0x7f3f300c5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34000/0 (socket says 172.21.15.27:34000) 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35b21700 1 -- 172.21.15.27:0/2076437070 learned_addr learned my addr 172.21.15.27:0/2076437070 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36b23700 1 --2- 172.21.15.27:0/2076437070 >> v2:172.21.15.27:3300/0 conn(0x7f3f300bc860 0x7f3f300bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35320700 1 -- 172.21.15.27:0/2076437070 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275957034 0 0) 0x7f3f300c7440 con 0x7f3f30069b80 2023-05-17T14:54:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36322700 1 --2- 172.21.15.27:0/2076437070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300697a0 0x7f3f30068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35320700 1 -- 172.21.15.27:0/2076437070 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f1c0033f0 con 0x7f3f30069b80 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36b23700 1 -- 172.21.15.27:0/2076437070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300697a0 msgr2=0x7f3f30068c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36b23700 1 --2- 172.21.15.27:0/2076437070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300697a0 0x7f3f30068c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36b23700 1 -- 172.21.15.27:0/2076437070 >> v1:172.21.15.27:6789/0 conn(0x7f3f30069b80 legacy=0x7f3f300c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36b23700 1 -- 172.21.15.27:0/2076437070 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30154970 con 0x7f3f300bc860 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f36b23700 1 --2- 172.21.15.27:0/2076437070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f300bc860 0x7f3f300bcc60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3f28009760 tx=0x7f3f28009060).ready entity=mon.0 client_cookie=975a25ff61832126 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:11.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35320700 1 -- 172.21.15.27:0/2076437070 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f280090d0 con 0x7f3f300bc860 2023-05-17T14:54:11.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35320700 1 -- 172.21.15.27:0/2076437070 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800f510 con 0x7f3f300bc860 2023-05-17T14:54:11.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.718+0000 7f3f35320700 1 -- 172.21.15.27:0/2076437070 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800f890 con 0x7f3f300bc860 2023-05-17T14:54:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 -- 172.21.15.27:0/2076437070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f300bc860 msgr2=0x7f3f300bcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 --2- 172.21.15.27:0/2076437070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f300bc860 0x7f3f300bcc60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3f28009760 tx=0x7f3f28009060).stop 2023-05-17T14:54:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 -- 172.21.15.27:0/2076437070 shutdown_connections 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 --2- 172.21.15.27:0/2076437070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f300bc860 0x7f3f300bcc60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 --2- 172.21.15.27:0/2076437070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300697a0 0x7f3f30068c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 -- 172.21.15.27:0/2076437070 >> 172.21.15.27:0/2076437070 conn(0x7f3f300c7900 msgr2=0x7f3f300c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 -- 172.21.15.27:0/2076437070 shutdown_connections 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.719+0000 7f3f38586700 1 -- 172.21.15.27:0/2076437070 wait complete. 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.720+0000 7f3f38586700 1 Processor -- start 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.720+0000 7f3f38586700 1 -- start start 2023-05-17T14:54:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f38586700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f300697a0 0x7f3f3014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f38586700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 0x7f3f30158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f38586700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300bc860 0x7f3f30158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f38586700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30159a60 con 0x7f3f30069b80 2023-05-17T14:54:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f38586700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300a7320 con 0x7f3f300697a0 2023-05-17T14:54:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f38586700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30158ee0 con 0x7f3f300bc860 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 0x7f3f30158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 0x7f3f30158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34446/0 (socket says 172.21.15.27:34446) 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 -- 172.21.15.27:0/4211174490 learned_addr learned my addr 172.21.15.27:0/4211174490 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f36322700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f300697a0 0x7f3f3014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 -- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300bc860 msgr2=0x7f3f30158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f36b23700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300bc860 0x7f3f30158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300bc860 0x7f3f30158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 -- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f300697a0 msgr2=0x7f3f3014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f300697a0 0x7f3f3014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 -- 172.21.15.27:0/4211174490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280092a0 con 0x7f3f30069b80 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f36322700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f300697a0 0x7f3f3014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.721+0000 7f3f35b21700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 0x7f3f30158420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f3f2000c590 tx=0x7f3f20007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.722+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20007e40 con 0x7f3f30069b80 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.722+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f200072e0 con 0x7f3f30069b80 2023-05-17T14:54:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.722+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f301591c0 con 0x7f3f30069b80 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.722+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200057a0 con 0x7f3f30069b80 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.722+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f30159780 con 0x7f3f30069b80 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.722+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f300a74e0 con 0x7f3f30069b80 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.723+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3f20010070 con 0x7f3f30069b80 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.723+0000 7f3f267fc700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3f1405ed60 0x7f3f14061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.723+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3f200792a0 con 0x7f3f30069b80 2023-05-17T14:54:11.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.723+0000 7f3f36322700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3f1405ed60 0x7f3f14061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:11.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.724+0000 7f3f36322700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3f1405ed60 0x7f3f14061220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3f2c007540 tx=0x7f3f2c00b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:11.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.727+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f2004a840 con 0x7f3f30069b80 2023-05-17T14:54:11.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.945+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f3005e6a0 con 0x7f3f30069b80 2023-05-17T14:54:11.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.945+0000 7f3f267fc700 1 -- 172.21.15.27:0/4211174490 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f2004de60 con 0x7f3f30069b80 2023-05-17T14:54:11.949 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T14:54:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3f1405ed60 msgr2=0x7f3f14061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3f1405ed60 0x7f3f14061220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3f2c007540 tx=0x7f3f2c00b040).stop 2023-05-17T14:54:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 msgr2=0x7f3f30158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 0x7f3f30158420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f3f2000c590 tx=0x7f3f20007c80).stop 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 shutdown_connections 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3f1405ed60 0x7f3f14061220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f300bc860 0x7f3f30158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f300697a0 0x7f3f3014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 --2- 172.21.15.27:0/4211174490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f30069b80 0x7f3f30158420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 >> 172.21.15.27:0/4211174490 conn(0x7f3f300c7900 msgr2=0x7f3f30155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:11.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 shutdown_connections 2023-05-17T14:54:11.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:11.947+0000 7f3f38586700 1 -- 172.21.15.27:0/4211174490 wait complete. 2023-05-17T14:54:11.961 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T14:54:11.962 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T14:54:11.962 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T14:54:11.962 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-17T14:54:11.962 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-17T14:54:11.962 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T14:54:11.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T14:54:11.963 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T14:54:11.963 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-17T14:54:11.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:11.964 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T14:54:11.978 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:11.978 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:11.978 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:11.979 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42261sec preferred_lft 42261sec 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:11.980 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link tentative 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T14:54:11.981 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T14:54:11.982 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link tentative 2023-05-17T14:54:11.982 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:11.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:11.982 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T14:54:12.042 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T14:54:12.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.043 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T14:54:12.099 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T14:54:12.099 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T14:54:12.099 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T14:54:12.099 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T14:54:12.100 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T14:54:12.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.100 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:12.100 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:12.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T14:54:12.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T14:54:12.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T14:54:12.101 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:12.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.199 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T14:54:12.213 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T14:54:12.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.214 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-05-17T14:54:12.267 INFO:teuthology.orchestra.run.smithi027.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-17T14:54:12.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.268 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:12.268 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:12.269 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T14:54:12.269 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-17T14:54:12.269 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:12.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.356 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-17T14:54:12.394 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T14:54:12.395 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 92:2a:20:ae:bb:64 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T14:54:12.396 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T14:54:12.396 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.396 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::902a:20ff:feae:bb64/64 scope link tentative 2023-05-17T14:54:12.396 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-17T14:54:12.481 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:12.482 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:12.482 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:12.482 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.482 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:12.482 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.482 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T14:54:12.483 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 92:2a:20:ae:bb:64 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T14:54:12.483 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T14:54:12.483 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.483 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::902a:20ff:feae:bb64/64 scope link tentative 2023-05-17T14:54:12.483 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:12.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-17T14:54:12.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.499 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:12.500 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:12.500 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-17T14:54:12.500 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-17T14:54:12.500 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-17T14:54:12.501 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-17T14:54:12.501 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-17T14:54:12.501 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:12.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.719 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:12.719 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:12.719 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.1 up 2023-05-17T14:54:12.719 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.1 master ceph-brx 2023-05-17T14:54:12.719 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:12.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.799 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-05-17T14:54:12.814 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T14:54:12.814 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:12.892 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:12.893 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=2,norbytes" will pass to kernel. 2023-05-17T14:54:12.934 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:12.935 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=2,norbytes" will pass to kernel. 2023-05-17T14:54:12.936 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T14:54:12.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:12.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-17T14:54:13.000 INFO:tasks.kclient:client.1 config is {} 2023-05-17T14:54:13.001 DEBUG:teuthology.orchestra.run.smithi040:> ceph fs ls 2023-05-17T14:54:13.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.113+0000 7fbe4e79d700 1 Processor -- start 2023-05-17T14:54:13.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.113+0000 7fbe4e79d700 1 -- start start 2023-05-17T14:54:13.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe4e79d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151f40 0x7fbe480c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:13.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe4e79d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe48068e40 con 0x7fbe480622d0 2023-05-17T14:54:13.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe4e79d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe48069120 con 0x7fbe48151b60 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe4e79d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c2710 con 0x7fbe48151f40 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe47fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbe48151b60 0x7fbe480c1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54412/0 (socket says 172.21.15.40:54412) 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe477fe700 1 --2- 172.21.15.40:0/447897806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151f40 0x7fbe480c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe47fff700 1 -- 172.21.15.40:0/447897806 learned_addr learned my addr 172.21.15.40:0/447897806 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe46ffd700 1 -- 172.21.15.40:0/447897806 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616328768 0 0) 0x7fbe48069120 con 0x7fbe48151b60 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe477fe700 1 -- 172.21.15.40:0/447897806 >> v1:172.21.15.40:6789/0 conn(0x7fbe48151b60 legacy=0x7fbe480c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe477fe700 1 -- 172.21.15.40:0/447897806 >> v1:172.21.15.27:6789/0 conn(0x7fbe480622d0 legacy=0x7fbe480bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe477fe700 1 -- 172.21.15.40:0/447897806 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48069400 con 0x7fbe48151f40 2023-05-17T14:54:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe477fe700 1 --2- 172.21.15.40:0/447897806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151f40 0x7fbe480c3b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fbe3c009790 tx=0x7fbe3c009060).ready entity=mon.2 client_cookie=5af276b75cd79b6e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.114+0000 7fbe46ffd700 1 -- 172.21.15.40:0/447897806 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00b5a0 con 0x7fbe48151f40 2023-05-17T14:54:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe46ffd700 1 -- 172.21.15.40:0/447897806 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00b700 con 0x7fbe48151f40 2023-05-17T14:54:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe46ffd700 1 -- 172.21.15.40:0/447897806 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00ba80 con 0x7fbe48151f40 2023-05-17T14:54:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 -- 172.21.15.40:0/447897806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151f40 msgr2=0x7fbe480c3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/447897806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151f40 0x7fbe480c3b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fbe3c009790 tx=0x7fbe3c009060).stop 2023-05-17T14:54:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 -- 172.21.15.40:0/447897806 shutdown_connections 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/447897806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151f40 0x7fbe480c3b00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 -- 172.21.15.40:0/447897806 >> 172.21.15.40:0/447897806 conn(0x7fbe480c7900 msgr2=0x7fbe480c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 -- 172.21.15.40:0/447897806 shutdown_connections 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.115+0000 7fbe4e79d700 1 -- 172.21.15.40:0/447897806 wait complete. 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.116+0000 7fbe4e79d700 1 Processor -- start 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.116+0000 7fbe4e79d700 1 -- start start 2023-05-17T14:54:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4e79d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 0x7fbe48148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4e79d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 0x7fbe48156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4e79d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48151f40 0x7fbe48153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4e79d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481491c0 con 0x7fbe48151f40 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4e79d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48149b60 con 0x7fbe480622d0 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4e79d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480abe90 con 0x7fbe48151b60 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe47fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 0x7fbe48148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 0x7fbe48156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe47fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 0x7fbe48148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52824/0 (socket says 172.21.15.40:52824) 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe47fff700 1 -- 172.21.15.40:0/2402224671 learned_addr learned my addr 172.21.15.40:0/2402224671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 0x7fbe48156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39970/0 (socket says 172.21.15.40:39970) 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.117+0000 7fbe4cd3a700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48151f40 0x7fbe48153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe47fff700 1 -- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 msgr2=0x7fbe48156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe47fff700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 0x7fbe48156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe47fff700 1 -- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48151f40 msgr2=0x7fbe48153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe47fff700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48151f40 0x7fbe48153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe47fff700 1 -- 172.21.15.40:0/2402224671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0092a0 con 0x7fbe480622d0 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe4cd3a700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48151f40 0x7fbe48153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe477fe700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 0x7fbe48156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe47fff700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 0x7fbe48148cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fbe3800c4c0 tx=0x7fbe38007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380072e0 con 0x7fbe480622d0 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38007440 con 0x7fbe480622d0 2023-05-17T14:54:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480ab8b0 con 0x7fbe480622d0 2023-05-17T14:54:13.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380057a0 con 0x7fbe480622d0 2023-05-17T14:54:13.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.118+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480abb20 con 0x7fbe480622d0 2023-05-17T14:54:13.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.119+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe480ab710 con 0x7fbe480622d0 2023-05-17T14:54:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.119+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbe38010070 con 0x7fbe480622d0 2023-05-17T14:54:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.120+0000 7fbe2ffff700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbe3405ed90 0x7fbe34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.120+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbe38079110 con 0x7fbe480622d0 2023-05-17T14:54:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.120+0000 7fbe477fe700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbe3405ed90 0x7fbe34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.120+0000 7fbe477fe700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbe3405ed90 0x7fbe34061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbe3c0096e0 tx=0x7fbe3c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.124+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe480ab710 con 0x7fbe480622d0 2023-05-17T14:54:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.339+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe480ab710 con 0x7fbe480622d0 2023-05-17T14:54:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.340+0000 7fbe2ffff700 1 -- 172.21.15.40:0/2402224671 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbe480ab710 con 0x7fbe480622d0 2023-05-17T14:54:13.344 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T14:54:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbe3405ed90 msgr2=0x7fbe34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbe3405ed90 0x7fbe34061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbe3c0096e0 tx=0x7fbe3c015000).stop 2023-05-17T14:54:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 msgr2=0x7fbe48148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 0x7fbe48148cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fbe3800c4c0 tx=0x7fbe38007c10).stop 2023-05-17T14:54:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 shutdown_connections 2023-05-17T14:54:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbe3405ed90 0x7fbe34061250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48151f40 0x7fbe48153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe480622d0 0x7fbe48148cd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 --2- 172.21.15.40:0/2402224671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe48151b60 0x7fbe48156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 >> 172.21.15.40:0/2402224671 conn(0x7fbe480c7900 msgr2=0x7fbe48066010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 shutdown_connections 2023-05-17T14:54:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:13.342+0000 7fbe4e79d700 1 -- 172.21.15.40:0/2402224671 wait complete. 2023-05-17T14:54:13.356 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T14:54:13.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T14:54:13.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-05-17T14:54:13.357 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-17T14:54:13.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-17T14:54:13.358 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T14:54:13.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T14:54:13.359 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T14:54:13.359 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-17T14:54:13.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.360 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-05-17T14:54:13.375 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T14:54:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T14:54:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42211sec preferred_lft 42211sec 2023-05-17T14:54:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-05-17T14:54:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:13.379 INFO:teuthology.orchestra.run.smithi040.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:13.380 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:13.380 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T14:54:13.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.381 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:13.382 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:13.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-05-17T14:54:13.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-05-17T14:54:13.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-05-17T14:54:13.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T14:54:13.384 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:13.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.529 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T14:54:13.570 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-17T14:54:13.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.572 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-05-17T14:54:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-05-17T14:54:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T14:54:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T14:54:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T14:54:13.643 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T14:54:13.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.643 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:13.643 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:13.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T14:54:13.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T14:54:13.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T14:54:13.644 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:13.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.873 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-17T14:54:13.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.888 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-05-17T14:54:13.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:13.942 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:13.942 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:13.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T14:54:13.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-17T14:54:13.943 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:14.031 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-17T14:54:14.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:14.032 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:14.032 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:14.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-17T14:54:14.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T14:54:14.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-17T14:54:14.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-17T14:54:14.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-17T14:54:14.033 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:14.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:14.245 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:14.246 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:14.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-05-17T14:54:14.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T14:54:14.246 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:14.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:14.338 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-05-17T14:54:14.352 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T14:54:14.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:14.446 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:14.446 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2023-05-17T14:54:14.555 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:14.556 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2023-05-17T14:54:14.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T14:54:14.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:14.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-17T14:54:14.582 INFO:tasks.kclient:client.3 config is {} 2023-05-17T14:54:14.583 DEBUG:teuthology.orchestra.run.smithi040:> ceph fs ls 2023-05-17T14:54:14.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.723+0000 7fb0a0342700 1 Processor -- start 2023-05-17T14:54:14.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.723+0000 7fb0a0342700 1 -- start start 2023-05-17T14:54:14.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb0a0342700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 0x7fb0980c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:14.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb0a0342700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 0x7fb098154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:14.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb0a0342700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980c95c0 con 0x7fb09806a5f0 2023-05-17T14:54:14.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb0a0342700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0980a8100 con 0x7fb098153c10 2023-05-17T14:54:14.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb0a0342700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980cbae0 con 0x7fb0980c5f60 2023-05-17T14:54:14.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e0de700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 0x7fb0980c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:14.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e8df700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 0x7fb098154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:14.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e8df700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 0x7fb098154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52840/0 (socket says 172.21.15.40:52840) 2023-05-17T14:54:14.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e0de700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 0x7fb0980c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39982/0 (socket says 172.21.15.40:39982) 2023-05-17T14:54:14.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e8df700 1 -- 172.21.15.40:0/2047036588 learned_addr learned my addr 172.21.15.40:0/2047036588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:54:14.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e0de700 1 -- 172.21.15.40:0/2047036588 >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 msgr2=0x7fb098154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e0de700 1 --2- 172.21.15.40:0/2047036588 >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 0x7fb098154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.724+0000 7fb09e0de700 1 -- 172.21.15.40:0/2047036588 >> v1:172.21.15.27:6789/0 conn(0x7fb09806a5f0 legacy=0x7fb0980a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb09e0de700 1 -- 172.21.15.40:0/2047036588 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980c0b90 con 0x7fb0980c5f60 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb09e8df700 1 --2- 172.21.15.40:0/2047036588 >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 0x7fb098154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb09e0de700 1 --2- 172.21.15.40:0/2047036588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 0x7fb0980c6340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb090006fd0 tx=0x7fb090006f40).ready entity=mon.2 client_cookie=4d9b63ebf30dfc6c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb09d0dc700 1 -- 172.21.15.40:0/2047036588 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090005880 con 0x7fb0980c5f60 2023-05-17T14:54:14.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb09d0dc700 1 -- 172.21.15.40:0/2047036588 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900059e0 con 0x7fb0980c5f60 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb09d0dc700 1 -- 172.21.15.40:0/2047036588 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090005d60 con 0x7fb0980c5f60 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 -- 172.21.15.40:0/2047036588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 msgr2=0x7fb0980c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 --2- 172.21.15.40:0/2047036588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 0x7fb0980c6340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb090006fd0 tx=0x7fb090006f40).stop 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 -- 172.21.15.40:0/2047036588 shutdown_connections 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 --2- 172.21.15.40:0/2047036588 >> v2:172.21.15.40:3300/0 conn(0x7fb098153c10 0x7fb098154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 --2- 172.21.15.40:0/2047036588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0980c5f60 0x7fb0980c6340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 -- 172.21.15.40:0/2047036588 >> 172.21.15.40:0/2047036588 conn(0x7fb09806a1e0 msgr2=0x7fb0980cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:14.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 -- 172.21.15.40:0/2047036588 shutdown_connections 2023-05-17T14:54:14.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.725+0000 7fb0a0342700 1 -- 172.21.15.40:0/2047036588 wait complete. 2023-05-17T14:54:14.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.727+0000 7fb0a0342700 1 Processor -- start 2023-05-17T14:54:14.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.727+0000 7fb0a0342700 1 -- start start 2023-05-17T14:54:14.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb0a0342700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb09806a5f0 0x7fb09814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:14.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb0a0342700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0980c5f60 0x7fb0980aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:14.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb0a0342700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 0x7fb0980ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:14.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb0a0342700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980ad580 con 0x7fb09806a5f0 2023-05-17T14:54:14.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb0a0342700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980acce0 con 0x7fb0980c5f60 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb0a0342700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980acfc0 con 0x7fb098153c10 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09d8dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0980c5f60 0x7fb0980aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 0x7fb0980ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 0x7fb0980ac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39992/0 (socket says 172.21.15.40:39992) 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 -- 172.21.15.40:0/615644175 learned_addr learned my addr 172.21.15.40:0/615644175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09d8dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0980c5f60 0x7fb0980aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52844/0 (socket says 172.21.15.40:52844) 2023-05-17T14:54:14.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e0de700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb09806a5f0 0x7fb09814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 -- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0980c5f60 msgr2=0x7fb0980aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0980c5f60 0x7fb0980aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 -- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb09806a5f0 msgr2=0x7fb09814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb09806a5f0 0x7fb09814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 -- 172.21.15.40:0/615644175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094009ae0 con 0x7fb098153c10 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.728+0000 7fb09e8df700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 0x7fb0980ac400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb094009f30 tx=0x7fb09400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.729+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940092e0 con 0x7fb098153c10 2023-05-17T14:54:14.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.729+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09400f040 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.729+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb090009250 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.729+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400cb70 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.729+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0980aa830 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.730+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09805e6a0 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.730+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb09401b030 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.730+0000 7fb08e7fc700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb07c05ed60 0x7fb07c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.730+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb094079850 con 0x7fb098153c10 2023-05-17T14:54:14.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.731+0000 7fb09e0de700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb07c05ed60 0x7fb07c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:14.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.731+0000 7fb09e0de700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb07c05ed60 0x7fb07c061220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb090006fa0 tx=0x7fb090016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:14.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.735+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb09404aea0 con 0x7fb098153c10 2023-05-17T14:54:14.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.952+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0980ad100 con 0x7fb098153c10 2023-05-17T14:54:14.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.953+0000 7fb08e7fc700 1 -- 172.21.15.40:0/615644175 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb0980ad100 con 0x7fb098153c10 2023-05-17T14:54:14.957 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T14:54:14.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb07c05ed60 msgr2=0x7fb07c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb07c05ed60 0x7fb07c061220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb090006fa0 tx=0x7fb090016000).stop 2023-05-17T14:54:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 msgr2=0x7fb0980ac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 0x7fb0980ac400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb094009f30 tx=0x7fb09400b040).stop 2023-05-17T14:54:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 shutdown_connections 2023-05-17T14:54:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb07c05ed60 0x7fb07c061220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb098153c10 0x7fb0980ac400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb09806a5f0 0x7fb09814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 --2- 172.21.15.40:0/615644175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0980c5f60 0x7fb0980aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 >> 172.21.15.40:0/615644175 conn(0x7fb09806a1e0 msgr2=0x7fb0980642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 shutdown_connections 2023-05-17T14:54:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-17T14:54:14.955+0000 7fb0a0342700 1 -- 172.21.15.40:0/615644175 wait complete. 2023-05-17T14:54:14.969 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T14:54:14.969 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T14:54:14.969 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-05-17T14:54:14.969 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-17T14:54:14.970 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-17T14:54:14.970 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T14:54:14.970 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T14:54:14.970 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T14:54:14.970 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-17T14:54:14.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:14.971 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-05-17T14:54:14.985 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:14.986 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42209sec preferred_lft 42209sec 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:14.987 INFO:teuthology.orchestra.run.smithi040.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether fe:9c:98:9d:8e:12 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::1020:68ff:fe0a:8709/64 scope link 2023-05-17T14:54:14.989 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:14.989 INFO:teuthology.orchestra.run.smithi040.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T14:54:14.989 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether fe:9c:98:9d:8e:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T14:54:14.989 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::fc9c:98ff:fe9d:8e12/64 scope link tentative 2023-05-17T14:54:14.989 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:14.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:14.990 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T14:54:15.048 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-17T14:54:15.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.050 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-05-17T14:54:15.105 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-05-17T14:54:15.105 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T14:54:15.106 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T14:54:15.106 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T14:54:15.106 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T14:54:15.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.107 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:15.107 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:15.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T14:54:15.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T14:54:15.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T14:54:15.108 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:15.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.206 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-17T14:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-17T14:54:15.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.221 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-05-17T14:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-17T14:54:15.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.275 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:15.275 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:15.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-17T14:54:15.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-17T14:54:15.276 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:15.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-17T14:54:15.396 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:15.396 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 7a:e6:a4:7e:96:4e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T14:54:15.397 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.398 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::78e6:a4ff:fe7e:964e/64 scope link tentative 2023-05-17T14:54:15.398 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-17T14:54:15.487 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:15.487 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:15.487 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 7a:e6:a4:7e:96:4e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T14:54:15.488 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.489 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::78e6:a4ff:fe7e:964e/64 scope link tentative 2023-05-17T14:54:15.489 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:15.495 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-17T14:54:15.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:15.496 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:15.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-17T14:54:15.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-17T14:54:15.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-17T14:54:15.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-17T14:54:15.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-17T14:54:15.498 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:15.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.705 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-17T14:54:15.705 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-17T14:54:15.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-05-17T14:54:15.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-05-17T14:54:15.706 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-17T14:54:15.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.786 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-05-17T14:54:15.800 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T14:54:15.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:15.878 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:15.878 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,name=3,norbytes" will pass to kernel. 2023-05-17T14:54:15.920 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:15.920 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,name=3,norbytes" will pass to kernel. 2023-05-17T14:54:15.922 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T14:54:15.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:15.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-17T14:54:15.985 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-17T14:54:16.003 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:16.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.130+0000 7faa6e062700 1 Processor -- start 2023-05-17T14:54:16.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.130+0000 7faa6e062700 1 -- start start 2023-05-17T14:54:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa6e062700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa68153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa6e062700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa68154260 0x7faa680c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa6e062700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680aa680 con 0x7faa680c60c0 2023-05-17T14:54:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa6e062700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680c68e0 con 0x7faa68154260 2023-05-17T14:54:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa6e062700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6805e7e0 con 0x7faa680c64a0 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa68154260 0x7faa680c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa68154260 0x7faa680c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34462/0 (socket says 172.21.15.27:34462) 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 -- 172.21.15.27:0/3350023716 learned_addr learned my addr 172.21.15.27:0/3350023716 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa66ffd700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa68153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 -- 172.21.15.27:0/3350023716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 msgr2=0x7faa68153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa68153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 -- 172.21.15.27:0/3350023716 >> v1:172.21.15.40:6789/0 conn(0x7faa680c60c0 legacy=0x7faa680a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 -- 172.21.15.27:0/3350023716 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6805eac0 con 0x7faa68154260 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa66ffd700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa68153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa67fff700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa680c0850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7faa60009f20 tx=0x7faa60009840).ready entity=mon.0 client_cookie=745742c1c86451a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa667fc700 1 -- 172.21.15.27:0/3350023716 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000e070 con 0x7faa68154260 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa667fc700 1 -- 172.21.15.27:0/3350023716 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000ba40 con 0x7faa68154260 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.131+0000 7faa667fc700 1 -- 172.21.15.27:0/3350023716 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000bdc0 con 0x7faa68154260 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 -- 172.21.15.27:0/3350023716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 msgr2=0x7faa680c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa680c0850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7faa60009f20 tx=0x7faa60009840).stop 2023-05-17T14:54:16.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 -- 172.21.15.27:0/3350023716 shutdown_connections 2023-05-17T14:54:16.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa680c0850 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 --2- 172.21.15.27:0/3350023716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa68153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 -- 172.21.15.27:0/3350023716 >> 172.21.15.27:0/3350023716 conn(0x7faa68069e70 msgr2=0x7faa6805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:16.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 -- 172.21.15.27:0/3350023716 shutdown_connections 2023-05-17T14:54:16.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.132+0000 7faa6e062700 1 -- 172.21.15.27:0/3350023716 wait complete. 2023-05-17T14:54:16.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.133+0000 7faa6e062700 1 Processor -- start 2023-05-17T14:54:16.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.133+0000 7faa6e062700 1 -- start start 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa6e062700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa680c60c0 0x7faa680a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa6e062700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa681557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa6e062700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa68155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa6e062700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6814bac0 con 0x7faa68154260 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa6e062700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680cb730 con 0x7faa680c60c0 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa6e062700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa68156ae0 con 0x7faa680c64a0 2023-05-17T14:54:16.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa68155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa68155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34468/0 (socket says 172.21.15.27:34468) 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa67fff700 1 -- 172.21.15.27:0/2099216692 learned_addr learned my addr 172.21.15.27:0/2099216692 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa677fe700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa680c60c0 0x7faa680a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.134+0000 7faa66ffd700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa681557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa67fff700 1 -- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 msgr2=0x7faa681557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa67fff700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa681557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa67fff700 1 -- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa680c60c0 msgr2=0x7faa680a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa67fff700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa680c60c0 0x7faa680a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa67fff700 1 -- 172.21.15.27:0/2099216692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009ae0 con 0x7faa68154260 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa67fff700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa68155ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7faa6000b6c0 tx=0x7faa60009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000bdc0 con 0x7faa68154260 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6001d460 con 0x7faa68154260 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6001d800 con 0x7faa68154260 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa68156dc0 con 0x7faa68154260 2023-05-17T14:54:16.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.135+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6814b750 con 0x7faa68154260 2023-05-17T14:54:16.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.136+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6814bc70 con 0x7faa68154260 2023-05-17T14:54:16.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.136+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faa60024030 con 0x7faa68154260 2023-05-17T14:54:16.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.137+0000 7faa5f7fe700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faa4805ed90 0x7faa48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.137+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa6007b2b0 con 0x7faa68154260 2023-05-17T14:54:16.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.137+0000 7faa677fe700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faa4805ed90 0x7faa48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.137+0000 7faa677fe700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faa4805ed90 0x7faa48061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7faa500036e0 tx=0x7faa50009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.141+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa6814bc70 con 0x7faa68154260 2023-05-17T14:54:16.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.315+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa6814bc70 con 0x7faa68154260 2023-05-17T14:54:16.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.316+0000 7faa5f7fe700 1 -- 172.21.15.27:0/2099216692 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7faa6814bc70 con 0x7faa68154260 2023-05-17T14:54:16.321 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:16.321 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:16.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faa4805ed90 msgr2=0x7faa48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faa4805ed90 0x7faa48061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7faa500036e0 tx=0x7faa50009040).stop 2023-05-17T14:54:16.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 msgr2=0x7faa68155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa68155ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7faa6000b6c0 tx=0x7faa60009840).stop 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 shutdown_connections 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faa4805ed90 0x7faa48061250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa68154260 0x7faa68155ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa680c60c0 0x7faa680a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 --2- 172.21.15.27:0/2099216692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa680c64a0 0x7faa681557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 >> 172.21.15.27:0/2099216692 conn(0x7faa68069e70 msgr2=0x7faa6814d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:16.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 shutdown_connections 2023-05-17T14:54:16.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.318+0000 7faa6e062700 1 -- 172.21.15.27:0/2099216692 wait complete. 2023-05-17T14:54:16.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:16.335 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:16.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.449+0000 7fc882ba2700 1 Processor -- start 2023-05-17T14:54:16.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.449+0000 7fc882ba2700 1 -- start start 2023-05-17T14:54:16.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc882ba2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc87c1543d0 0x7fc87c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc882ba2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc882ba2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc87c0691f0 0x7fc87c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc882ba2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c0c1c50 con 0x7fc87c0691f0 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc882ba2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c158790 con 0x7fc87c1543d0 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc882ba2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0c6570 con 0x7fc87c0c60f0 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc88113f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc87c0691f0 0x7fc87c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc88113f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc87c0691f0 0x7fc87c1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34476/0 (socket says 172.21.15.27:34476) 2023-05-17T14:54:16.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc88113f700 1 -- 172.21.15.27:0/914306143 learned_addr learned my addr 172.21.15.27:0/914306143 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc87bfff700 1 --2- 172.21.15.27:0/914306143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.450+0000 7fc88093e700 1 --2- 172.21.15.27:0/914306143 >> v2:172.21.15.40:3300/0 conn(0x7fc87c1543d0 0x7fc87c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88113f700 1 -- 172.21.15.27:0/914306143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 msgr2=0x7fc87c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88113f700 1 --2- 172.21.15.27:0/914306143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88113f700 1 -- 172.21.15.27:0/914306143 >> v2:172.21.15.40:3300/0 conn(0x7fc87c1543d0 msgr2=0x7fc87c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88113f700 1 --2- 172.21.15.27:0/914306143 >> v2:172.21.15.40:3300/0 conn(0x7fc87c1543d0 0x7fc87c0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88113f700 1 -- 172.21.15.27:0/914306143 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c157e60 con 0x7fc87c0691f0 2023-05-17T14:54:16.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88093e700 1 --2- 172.21.15.27:0/914306143 >> v2:172.21.15.40:3300/0 conn(0x7fc87c1543d0 0x7fc87c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc88113f700 1 --2- 172.21.15.27:0/914306143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c1547b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fc87c155970 tx=0x7fc86c009840).ready entity=mon.0 client_cookie=947868f7888761e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc87b7fe700 1 -- 172.21.15.27:0/914306143 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00e070 con 0x7fc87c0691f0 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc87b7fe700 1 -- 172.21.15.27:0/914306143 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00ba20 con 0x7fc87c0691f0 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc87b7fe700 1 -- 172.21.15.27:0/914306143 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00bda0 con 0x7fc87c0691f0 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 -- 172.21.15.27:0/914306143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 msgr2=0x7fc87c1547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 --2- 172.21.15.27:0/914306143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c1547b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fc87c155970 tx=0x7fc86c009840).stop 2023-05-17T14:54:16.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 -- 172.21.15.27:0/914306143 shutdown_connections 2023-05-17T14:54:16.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 --2- 172.21.15.27:0/914306143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c1547b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 --2- 172.21.15.27:0/914306143 >> v2:172.21.15.40:3300/0 conn(0x7fc87c1543d0 0x7fc87c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 --2- 172.21.15.27:0/914306143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 -- 172.21.15.27:0/914306143 >> 172.21.15.27:0/914306143 conn(0x7fc87c0cb7f0 msgr2=0x7fc87c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:16.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 -- 172.21.15.27:0/914306143 shutdown_connections 2023-05-17T14:54:16.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.451+0000 7fc882ba2700 1 -- 172.21.15.27:0/914306143 wait complete. 2023-05-17T14:54:16.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.452+0000 7fc882ba2700 1 Processor -- start 2023-05-17T14:54:16.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 -- start start 2023-05-17T14:54:16.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c0adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c0c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87c1543d0 0x7fc87c0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0aeea0 con 0x7fc87c0691f0 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0ae290 con 0x7fc87c1543d0 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc882ba2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0ae570 con 0x7fc87c0c60f0 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.453+0000 7fc88093e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c0adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c0adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34478/0 (socket says 172.21.15.27:34478) 2023-05-17T14:54:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 -- 172.21.15.27:0/3124061678 learned_addr learned my addr 172.21.15.27:0/3124061678 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc87bfff700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c0c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88113f700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87c1543d0 0x7fc87c0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 -- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 msgr2=0x7fc87c0c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c0c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 -- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87c1543d0 msgr2=0x7fc87c0afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87c1543d0 0x7fc87c0afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 -- 172.21.15.27:0/3124061678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c009ae0 con 0x7fc87c0691f0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc88093e700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c0adcd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc87400d890 tx=0x7fc874008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874011590 con 0x7fc87c0691f0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8740116f0 con 0x7fc87c0691f0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c0ae850 con 0x7fc87c0691f0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874011a70 con 0x7fc87c0691f0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.454+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c0c4b70 con 0x7fc87c0691f0 2023-05-17T14:54:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.455+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0af180 con 0x7fc87c0691f0 2023-05-17T14:54:16.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.456+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc874012420 con 0x7fc87c0691f0 2023-05-17T14:54:16.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.456+0000 7fc878ff9700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc85c05ed60 0x7fc85c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.456+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc8740795d0 con 0x7fc87c0691f0 2023-05-17T14:54:16.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.456+0000 7fc87bfff700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc85c05ed60 0x7fc85c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.456+0000 7fc87bfff700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc85c05ed60 0x7fc85c061220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc87c0ae1c0 tx=0x7fc864009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.460+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc87404ab10 con 0x7fc87c0691f0 2023-05-17T14:54:16.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.633+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc87c06bdf0 con 0x7fc87c0691f0 2023-05-17T14:54:16.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.634+0000 7fc878ff9700 1 -- 172.21.15.27:0/3124061678 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc87404e130 con 0x7fc87c0691f0 2023-05-17T14:54:16.638 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:16.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc85c05ed60 msgr2=0x7fc85c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc85c05ed60 0x7fc85c061220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc87c0ae1c0 tx=0x7fc864009060).stop 2023-05-17T14:54:16.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 msgr2=0x7fc87c0adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c0adcd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc87400d890 tx=0x7fc874008040).stop 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 shutdown_connections 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc85c05ed60 0x7fc85c061220 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87c1543d0 0x7fc87c0afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc87c0691f0 0x7fc87c0adcd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 --2- 172.21.15.27:0/3124061678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc87c0c60f0 0x7fc87c0c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 >> 172.21.15.27:0/3124061678 conn(0x7fc87c0cb7f0 msgr2=0x7fc87c155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:16.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 shutdown_connections 2023-05-17T14:54:16.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.636+0000 7fc882ba2700 1 -- 172.21.15.27:0/3124061678 wait complete. 2023-05-17T14:54:16.652 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.766+0000 7f057ac71700 1 Processor -- start 2023-05-17T14:54:16.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.766+0000 7f057ac71700 1 -- start start 2023-05-17T14:54:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.767+0000 7f057ac71700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05740c6310 0x7f0574068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.767+0000 7f057ac71700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0574158790 con 0x7f05740691f0 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.767+0000 7f057ac71700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0574157e60 con 0x7f05741543d0 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.767+0000 7f057ac71700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05740c1c50 con 0x7f05740c6310 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.767+0000 7f057920e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f05740691f0 0x7f05740bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34052/0 (socket says 172.21.15.27:34052) 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.767+0000 7f057920e700 1 -- 172.21.15.27:0/2736844951 learned_addr learned my addr 172.21.15.27:0/2736844951 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 --2- 172.21.15.27:0/2736844951 >> v2:172.21.15.40:3300/0 conn(0x7f05740c6310 0x7f0574068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580280058 0 0) 0x7f0574158790 con 0x7f05740691f0 2023-05-17T14:54:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05600033f0 con 0x7f05740691f0 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670270507 0 0) 0x7f05600033f0 con 0x7f05740691f0 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 >> v2:172.21.15.40:3300/0 conn(0x7f05740c6310 msgr2=0x7f0574068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 --2- 172.21.15.27:0/2736844951 >> v2:172.21.15.40:3300/0 conn(0x7f05740c6310 0x7f0574068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 >> v1:172.21.15.40:6789/0 conn(0x7f05741543d0 legacy=0x7f05740c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574158140 con 0x7f05740691f0 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f055c001470 con 0x7f05740691f0 2023-05-17T14:54:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 >> v1:172.21.15.27:6789/0 conn(0x7f05740691f0 legacy=0x7f05740bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600038e0 0x7f0560003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0560004690 0x7f0560004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0560005000 0x7f056000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056000be80 con 0x7f0560004690 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056000bff0 con 0x7f0560005000 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056000c1b0 con 0x7f05600038e0 2023-05-17T14:54:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0560004690 0x7f0560004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0578a0d700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600038e0 0x7f0560003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f057920e700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0560005000 0x7f056000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 -- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600038e0 msgr2=0x7f0560003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600038e0 0x7f0560003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 -- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0560005000 msgr2=0x7f056000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0560005000 0x7f056000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f0573fff700 1 -- 172.21.15.27:0/2736844951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600033f0 con 0x7f0560004690 2023-05-17T14:54:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f057920e700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0560005000 0x7f056000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.768+0000 7f057920e700 1 -- 172.21.15.27:0/2736844951 reap_dead start 2023-05-17T14:54:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f0573fff700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0560004690 0x7f0560004b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f05740c6710 tx=0x7f056400b040).ready entity=mon.0 client_cookie=79636d3a77a4472b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564009ac0 con 0x7f0560004690 2023-05-17T14:54:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400f040 con 0x7f0560004690 2023-05-17T14:54:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f05737fe700 1 -- 172.21.15.27:0/2736844951 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400eca0 con 0x7f0560004690 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 -- 172.21.15.27:0/2736844951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0560004690 msgr2=0x7f0560004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0560004690 0x7f0560004b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f05740c6710 tx=0x7f056400b040).stop 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 -- 172.21.15.27:0/2736844951 shutdown_connections 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 --2- 172.21.15.27:0/2736844951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0560004690 0x7f0560004b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 -- 172.21.15.27:0/2736844951 >> 172.21.15.27:0/2736844951 conn(0x7f05740cb7f0 msgr2=0x7f05740c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 -- 172.21.15.27:0/2736844951 shutdown_connections 2023-05-17T14:54:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.769+0000 7f057ac71700 1 -- 172.21.15.27:0/2736844951 wait complete. 2023-05-17T14:54:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.770+0000 7f057ac71700 1 Processor -- start 2023-05-17T14:54:16.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 -- start start 2023-05-17T14:54:16.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0560004690 0x7f05740c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574149f90 0x7f05740c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 0x7f05740c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0574167700 con 0x7f05740c3720 2023-05-17T14:54:16.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c22b0 con 0x7f0574149f90 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057ac71700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740adf40 con 0x7f0560004690 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057920e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 0x7f05740c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057920e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 0x7f05740c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34500/0 (socket says 172.21.15.27:34500) 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f057920e700 1 -- 172.21.15.27:0/3621830788 learned_addr learned my addr 172.21.15.27:0/3621830788 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f0573fff700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574149f90 0x7f05740c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.771+0000 7f0578a0d700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0560004690 0x7f05740c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057920e700 1 -- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0560004690 msgr2=0x7f05740c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057920e700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0560004690 0x7f05740c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057920e700 1 -- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574149f90 msgr2=0x7f05740c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057920e700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574149f90 0x7f05740c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057920e700 1 -- 172.21.15.27:0/3621830788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740ae220 con 0x7f05740c3720 2023-05-17T14:54:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057920e700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 0x7f05740c3ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f055c000c00 tx=0x7f055c001470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c010520 con 0x7f05740c3720 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c010680 con 0x7f05740c3720 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740ae500 con 0x7f05740c3720 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c010a40 con 0x7f05740c3720 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.772+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0574164ba0 con 0x7f05740c3720 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.773+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057406bdf0 con 0x7f05740c3720 2023-05-17T14:54:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.773+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f055c014430 con 0x7f05740c3720 2023-05-17T14:54:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.774+0000 7f0570ff9700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f055405ed90 0x7f0554061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.774+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f055c079530 con 0x7f05740c3720 2023-05-17T14:54:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.774+0000 7f0578a0d700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f055405ed90 0x7f0554061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.774+0000 7f0578a0d700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f055405ed90 0x7f0554061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0574155380 tx=0x7f056c007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.778+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f055c04ab20 con 0x7f05740c3720 2023-05-17T14:54:16.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.950+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0574158420 con 0x7f05740c3720 2023-05-17T14:54:16.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.950+0000 7f0570ff9700 1 -- 172.21.15.27:0/3621830788 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f055c010db0 con 0x7f05740c3720 2023-05-17T14:54:16.955 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:16.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f055405ed90 msgr2=0x7f0554061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f055405ed90 0x7f0554061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0574155380 tx=0x7f056c007bb0).stop 2023-05-17T14:54:16.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 msgr2=0x7f05740c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 0x7f05740c3ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f055c000c00 tx=0x7f055c001470).stop 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 shutdown_connections 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f055405ed90 0x7f0554061250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05740c3720 0x7f05740c3ba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0560004690 0x7f05740c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 --2- 172.21.15.27:0/3621830788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574149f90 0x7f05740c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:16.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 >> 172.21.15.27:0/3621830788 conn(0x7f05740cb7f0 msgr2=0x7f05740c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 shutdown_connections 2023-05-17T14:54:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:16.952+0000 7f057ac71700 1 -- 172.21.15.27:0/3621830788 wait complete. 2023-05-17T14:54:16.968 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:17.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.082+0000 7ff740dc9700 1 Processor -- start 2023-05-17T14:54:17.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.082+0000 7ff740dc9700 1 -- start start 2023-05-17T14:54:17.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff740dc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 0x7ff73c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff740dc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 0x7ff73c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff740dc9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c157de0 con 0x7ff73c0cac00 2023-05-17T14:54:17.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff740dc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c1588b0 con 0x7ff73c153ef0 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff740dc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0c60d0 con 0x7ff73c157980 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 0x7ff73c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff73affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 0x7ff73c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff73affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 0x7ff73c0cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:52440/0 (socket says 172.21.15.27:52440) 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 0x7ff73c0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35618/0 (socket says 172.21.15.27:35618) 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff73b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff73c0cac00 0x7ff73c1537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40070/0 (socket says 172.21.15.27:40070) 2023-05-17T14:54:17.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.083+0000 7ff73affd700 1 -- 172.21.15.27:0/2144280404 learned_addr learned my addr 172.21.15.27:0/2144280404 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73bfff700 1 -- 172.21.15.27:0/2144280404 >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 msgr2=0x7ff73c0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73bfff700 1 --2- 172.21.15.27:0/2144280404 >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 0x7ff73c0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73bfff700 1 -- 172.21.15.27:0/2144280404 >> v1:172.21.15.40:6789/0 conn(0x7ff73c0cac00 legacy=0x7ff73c1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73bfff700 1 -- 172.21.15.27:0/2144280404 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c158010 con 0x7ff73c157980 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73a7fc700 1 -- 172.21.15.27:0/2144280404 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838618844 0 0) 0x7ff73c157de0 con 0x7ff73c0cac00 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73affd700 1 --2- 172.21.15.27:0/2144280404 >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 0x7ff73c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73bfff700 1 --2- 172.21.15.27:0/2144280404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 0x7ff73c0c5be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff734009e60 tx=0x7ff734009780).ready entity=mon.2 client_cookie=1852a5785290d8ef server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73a7fc700 1 -- 172.21.15.27:0/2144280404 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400e070 con 0x7ff73c157980 2023-05-17T14:54:17.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73a7fc700 1 -- 172.21.15.27:0/2144280404 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73400bb60 con 0x7ff73c157980 2023-05-17T14:54:17.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.084+0000 7ff73a7fc700 1 -- 172.21.15.27:0/2144280404 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734012410 con 0x7ff73c157980 2023-05-17T14:54:17.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 -- 172.21.15.27:0/2144280404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 msgr2=0x7ff73c0c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 --2- 172.21.15.27:0/2144280404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 0x7ff73c0c5be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff734009e60 tx=0x7ff734009780).stop 2023-05-17T14:54:17.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 -- 172.21.15.27:0/2144280404 shutdown_connections 2023-05-17T14:54:17.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 --2- 172.21.15.27:0/2144280404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c157980 0x7ff73c0c5be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 --2- 172.21.15.27:0/2144280404 >> v2:172.21.15.40:3300/0 conn(0x7ff73c153ef0 0x7ff73c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 -- 172.21.15.27:0/2144280404 >> 172.21.15.27:0/2144280404 conn(0x7ff73c05dd50 msgr2=0x7ff73c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 -- 172.21.15.27:0/2144280404 shutdown_connections 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.085+0000 7ff740dc9700 1 -- 172.21.15.27:0/2144280404 wait complete. 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.086+0000 7ff740dc9700 1 Processor -- start 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.086+0000 7ff740dc9700 1 -- start start 2023-05-17T14:54:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff740dc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c0cac00 0x7ff73c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff740dc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c153ef0 0x7ff73c0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff740dc9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 0x7ff73c14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff740dc9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c156bb0 con 0x7ff73c157980 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff740dc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0adb90 con 0x7ff73c153ef0 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff740dc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0b0b00 con 0x7ff73c0cac00 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 0x7ff73c14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 0x7ff73c14e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34516/0 (socket says 172.21.15.27:34516) 2023-05-17T14:54:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 -- 172.21.15.27:0/4214311051 learned_addr learned my addr 172.21.15.27:0/4214311051 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73b7fe700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c0cac00 0x7ff73c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73affd700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c153ef0 0x7ff73c0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 -- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c0cac00 msgr2=0x7ff73c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c0cac00 0x7ff73c1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 -- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c153ef0 msgr2=0x7ff73c0b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c153ef0 0x7ff73c0b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 -- 172.21.15.27:0/4214311051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009370 con 0x7ff73c157980 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff73bfff700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 0x7ff73c14e8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7ff73400bfe0 tx=0x7ff734009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73401c660 con 0x7ff73c157980 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.087+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73401c7c0 con 0x7ff73c157980 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.088+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff734009a20 con 0x7ff73c157980 2023-05-17T14:54:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.088+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73401cb80 con 0x7ff73c157980 2023-05-17T14:54:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.088+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c156de0 con 0x7ff73c157980 2023-05-17T14:54:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.089+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c0add40 con 0x7ff73c157980 2023-05-17T14:54:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.089+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff73401d420 con 0x7ff73c157980 2023-05-17T14:54:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.089+0000 7ff7237fe700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff72805ed90 0x7ff728061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.089+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff73407c060 con 0x7ff73c157980 2023-05-17T14:54:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.089+0000 7ff73b7fe700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff72805ed90 0x7ff728061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.090+0000 7ff73b7fe700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff72805ed90 0x7ff728061250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ff72c007750 tx=0x7ff72c007c90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.093+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff73c0add40 con 0x7ff73c157980 2023-05-17T14:54:17.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.269+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff73c0add40 con 0x7ff73c157980 2023-05-17T14:54:17.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.269+0000 7ff7237fe700 1 -- 172.21.15.27:0/4214311051 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff73c0add40 con 0x7ff73c157980 2023-05-17T14:54:17.273 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:17.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff72805ed90 msgr2=0x7ff728061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff72805ed90 0x7ff728061250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ff72c007750 tx=0x7ff72c007c90).stop 2023-05-17T14:54:17.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 msgr2=0x7ff73c14e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 0x7ff73c14e8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7ff73400bfe0 tx=0x7ff734009780).stop 2023-05-17T14:54:17.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 shutdown_connections 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff72805ed90 0x7ff728061250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff73c157980 0x7ff73c14e8c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c0cac00 0x7ff73c1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 --2- 172.21.15.27:0/4214311051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c153ef0 0x7ff73c0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 >> 172.21.15.27:0/4214311051 conn(0x7ff73c05dd50 msgr2=0x7ff73c14f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 shutdown_connections 2023-05-17T14:54:17.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.271+0000 7ff740dc9700 1 -- 172.21.15.27:0/4214311051 wait complete. 2023-05-17T14:54:17.287 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:17.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.402+0000 7fd4dd0a4700 1 Processor -- start 2023-05-17T14:54:17.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.402+0000 7fd4dd0a4700 1 -- start start 2023-05-17T14:54:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4dd0a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4d80cac00 0x7fd4d80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4dd0a4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d8158010 con 0x7fd4d8153ef0 2023-05-17T14:54:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4dd0a4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d81582f0 con 0x7fd4d8157980 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4dd0a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d81588b0 con 0x7fd4d80cac00 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4dc8a3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd4d8153ef0 0x7fd4d80c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34082/0 (socket says 172.21.15.27:34082) 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/3452949771 learned_addr learned my addr 172.21.15.27:0/3452949771 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d7fff700 1 --2- 172.21.15.27:0/3452949771 >> v2:172.21.15.40:3300/0 conn(0x7fd4d80cac00 0x7fd4d80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984886886 0 0) 0x7fd4d8158010 con 0x7fd4d8153ef0 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c00033f0 con 0x7fd4d8153ef0 2023-05-17T14:54:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539844803 0 0) 0x7fd4c00033f0 con 0x7fd4d8153ef0 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 >> v2:172.21.15.40:3300/0 conn(0x7fd4d80cac00 msgr2=0x7fd4d80cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 --2- 172.21.15.27:0/3452949771 >> v2:172.21.15.40:3300/0 conn(0x7fd4d80cac00 0x7fd4d80cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 >> v1:172.21.15.40:6789/0 conn(0x7fd4d8157980 legacy=0x7fd4d81537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d81585d0 con 0x7fd4d8153ef0 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fd4d00017f0 con 0x7fd4d8153ef0 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 >> v1:172.21.15.27:6789/0 conn(0x7fd4d8153ef0 legacy=0x7fd4d80c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4c00038e0 0x7fd4c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0004690 0x7fd4c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4c0005000 0x7fd4c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81588b0 con 0x7fd4c0005000 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000beb0 con 0x7fd4c0004690 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.403+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000c070 con 0x7fd4c00038e0 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4c0005000 0x7fd4c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4d7fff700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4c00038e0 0x7fd4c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4d77fe700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0004690 0x7fd4c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4c00038e0 msgr2=0x7fd4c0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4c00038e0 0x7fd4c0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0004690 msgr2=0x7fd4c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0004690 0x7fd4c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/3452949771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00033f0 con 0x7fd4c0005000 2023-05-17T14:54:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/3452949771 reap_dead start 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4c0005000 0x7fd4c000b8e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fd4d000c480 tx=0x7fd4d000c790).ready entity=mon.0 client_cookie=8be29f8be7291d80 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0002030 con 0x7fd4c0005000 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d000ce20 con 0x7fd4c0005000 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4d6ffd700 1 -- 172.21.15.27:0/3452949771 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0005d30 con 0x7fd4c0005000 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/3452949771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4c0005000 msgr2=0x7fd4c000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.404+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4c0005000 0x7fd4c000b8e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fd4d000c480 tx=0x7fd4d000c790).stop 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.405+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/3452949771 shutdown_connections 2023-05-17T14:54:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.405+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/3452949771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4c0005000 0x7fd4c000b8e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.405+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/3452949771 >> 172.21.15.27:0/3452949771 conn(0x7fd4d805dd50 msgr2=0x7fd4d805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.405+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/3452949771 shutdown_connections 2023-05-17T14:54:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.405+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/3452949771 wait complete. 2023-05-17T14:54:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.406+0000 7fd4dd0a4700 1 Processor -- start 2023-05-17T14:54:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.406+0000 7fd4dd0a4700 1 -- start start 2023-05-17T14:54:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0005000 0x7fd4d8168300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d80c14b0 0x7fd4d814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 0x7fd4d80acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8151220 con 0x7fd4d814e580 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8150130 con 0x7fd4c0005000 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80c1930 con 0x7fd4d80c14b0 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 0x7fd4d80acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 0x7fd4d80acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34534/0 (socket says 172.21.15.27:34534) 2023-05-17T14:54:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/2565982307 learned_addr learned my addr 172.21.15.27:0/2565982307 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4d7fff700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0005000 0x7fd4d8168300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4d77fe700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d80c14b0 0x7fd4d814fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d80c14b0 msgr2=0x7fd4d814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d80c14b0 0x7fd4d814fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0005000 msgr2=0x7fd4d8168300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0005000 0x7fd4d8168300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 -- 172.21.15.27:0/2565982307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d81503b0 con 0x7fd4d814e580 2023-05-17T14:54:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dc8a3700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 0x7fd4d80acbc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd4d0000f80 tx=0x7fd4d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0002030 con 0x7fd4d814e580 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d00017b0 con 0x7fd4d814e580 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00138b0 con 0x7fd4d814e580 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d8150690 con 0x7fd4d814e580 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.407+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d814ea00 con 0x7fd4d814e580 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.408+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8157620 con 0x7fd4d814e580 2023-05-17T14:54:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.409+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd4d001d070 con 0x7fd4d814e580 2023-05-17T14:54:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.409+0000 7fd4bffff700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd4c405ed60 0x7fd4c4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.409+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd4d007aa90 con 0x7fd4d814e580 2023-05-17T14:54:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.409+0000 7fd4d7fff700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd4c405ed60 0x7fd4c4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.409+0000 7fd4d7fff700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd4c405ed60 0x7fd4c4061220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd4c8006d80 tx=0x7fd4c8009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.413+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4d004c030 con 0x7fd4d814e580 2023-05-17T14:54:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.588+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4d8047150 con 0x7fd4d814e580 2023-05-17T14:54:17.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.588+0000 7fd4bffff700 1 -- 172.21.15.27:0/2565982307 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4d001a070 con 0x7fd4d814e580 2023-05-17T14:54:17.593 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd4c405ed60 msgr2=0x7fd4c4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd4c405ed60 0x7fd4c4061220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd4c8006d80 tx=0x7fd4c8009060).stop 2023-05-17T14:54:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 msgr2=0x7fd4d80acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 0x7fd4d80acbc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd4d0000f80 tx=0x7fd4d0015000).stop 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 shutdown_connections 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd4c405ed60 0x7fd4c4061220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d814e580 0x7fd4d80acbc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c0005000 0x7fd4d8168300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 --2- 172.21.15.27:0/2565982307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d80c14b0 0x7fd4d814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 >> 172.21.15.27:0/2565982307 conn(0x7fd4d805dd50 msgr2=0x7fd4d80ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:17.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 shutdown_connections 2023-05-17T14:54:17.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.590+0000 7fd4dd0a4700 1 -- 172.21.15.27:0/2565982307 wait complete. 2023-05-17T14:54:17.606 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:17.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.718+0000 7fcb7b56e700 1 Processor -- start 2023-05-17T14:54:17.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.718+0000 7fcb7b56e700 1 -- start start 2023-05-17T14:54:17.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.719+0000 7fcb7b56e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb741540d0 0x7fcb74155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.719+0000 7fcb7b56e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb74069020 con 0x7fcb74065aa0 2023-05-17T14:54:17.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.719+0000 7fcb7b56e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb74155700 con 0x7fcb74067ec0 2023-05-17T14:54:17.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.719+0000 7fcb7b56e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740c3610 con 0x7fcb741540d0 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.719+0000 7fcb79b0b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcb74065aa0 0x7fcb740c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34104/0 (socket says 172.21.15.27:34104) 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.719+0000 7fcb79b0b700 1 -- 172.21.15.27:0/1084266279 learned_addr learned my addr 172.21.15.27:0/1084266279 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb7930a700 1 --2- 172.21.15.27:0/1084266279 >> v2:172.21.15.40:3300/0 conn(0x7fcb741540d0 0x7fcb74155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb6bfff700 1 -- 172.21.15.27:0/1084266279 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228924563 0 0) 0x7fcb74069020 con 0x7fcb74065aa0 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb6bfff700 1 -- 172.21.15.27:0/1084266279 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb600033f0 con 0x7fcb74065aa0 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb6bfff700 1 -- 172.21.15.27:0/1084266279 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1469687191 0 0) 0x7fcb600033f0 con 0x7fcb74065aa0 2023-05-17T14:54:17.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb7930a700 1 -- 172.21.15.27:0/1084266279 >> v1:172.21.15.40:6789/0 conn(0x7fcb74067ec0 legacy=0x7fcb74065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb7930a700 1 -- 172.21.15.27:0/1084266279 >> v1:172.21.15.27:6789/0 conn(0x7fcb74065aa0 legacy=0x7fcb740c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb7930a700 1 -- 172.21.15.27:0/1084266279 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74068410 con 0x7fcb741540d0 2023-05-17T14:54:17.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb7930a700 1 --2- 172.21.15.27:0/1084266279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb74155210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcb70009760 tx=0x7fcb70009060).ready entity=mon.1 client_cookie=bbe7471baa40b007 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb6bfff700 1 -- 172.21.15.27:0/1084266279 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c0017f0 con 0x7fcb741540d0 2023-05-17T14:54:17.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb6bfff700 1 -- 172.21.15.27:0/1084266279 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70011400 con 0x7fcb741540d0 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.720+0000 7fcb6bfff700 1 -- 172.21.15.27:0/1084266279 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70011780 con 0x7fcb741540d0 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 -- 172.21.15.27:0/1084266279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 msgr2=0x7fcb74155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/1084266279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb74155210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcb70009760 tx=0x7fcb70009060).stop 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 -- 172.21.15.27:0/1084266279 shutdown_connections 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/1084266279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb74155210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 -- 172.21.15.27:0/1084266279 >> 172.21.15.27:0/1084266279 conn(0x7fcb740c94a0 msgr2=0x7fcb740c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 -- 172.21.15.27:0/1084266279 shutdown_connections 2023-05-17T14:54:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.721+0000 7fcb7b56e700 1 -- 172.21.15.27:0/1084266279 wait complete. 2023-05-17T14:54:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.722+0000 7fcb7b56e700 1 Processor -- start 2023-05-17T14:54:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.722+0000 7fcb7b56e700 1 -- start start 2023-05-17T14:54:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7b56e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb74065aa0 0x7fcb74141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7b56e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 0x7fcb740a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7b56e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb740a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7b56e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740a9bb0 con 0x7fcb74067ec0 2023-05-17T14:54:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7b56e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741529d0 con 0x7fcb741540d0 2023-05-17T14:54:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7b56e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740a9db0 con 0x7fcb74065aa0 2023-05-17T14:54:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 0x7fcb740a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 0x7fcb740a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34546/0 (socket says 172.21.15.27:34546) 2023-05-17T14:54:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 -- 172.21.15.27:0/35364408 learned_addr learned my addr 172.21.15.27:0/35364408 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb79b0b700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb740a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb7930a700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb74065aa0 0x7fcb74141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 -- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb74065aa0 msgr2=0x7fcb74141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb74065aa0 0x7fcb74141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 -- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 msgr2=0x7fcb740a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb740a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.723+0000 7fcb78b09700 1 -- 172.21.15.27:0/35364408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700092a0 con 0x7fcb74067ec0 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.724+0000 7fcb78b09700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 0x7fcb740a91d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fcb6400c440 tx=0x7fcb64007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.724+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64007020 con 0x7fcb74067ec0 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.724+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64007180 con 0x7fcb74067ec0 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.724+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb740aa090 con 0x7fcb74067ec0 2023-05-17T14:54:17.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.724+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64007540 con 0x7fcb74067ec0 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.724+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb740aa650 con 0x7fcb74067ec0 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.725+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb74066370 con 0x7fcb74067ec0 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.725+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcb64010070 con 0x7fcb74067ec0 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.725+0000 7fcb697fa700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb5805ed90 0x7fcb58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.725+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcb64078b90 con 0x7fcb74067ec0 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.726+0000 7fcb7930a700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb5805ed90 0x7fcb58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:17.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.726+0000 7fcb7930a700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb5805ed90 0x7fcb58061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fcb70009760 tx=0x7fcb70014000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:17.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.729+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb640478f0 con 0x7fcb74067ec0 2023-05-17T14:54:17.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.907+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb74150130 con 0x7fcb74067ec0 2023-05-17T14:54:17.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.908+0000 7fcb697fa700 1 -- 172.21.15.27:0/35364408 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fcb6404a130 con 0x7fcb74067ec0 2023-05-17T14:54:17.912 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:17.912 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:17.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb5805ed90 msgr2=0x7fcb58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb5805ed90 0x7fcb58061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fcb70009760 tx=0x7fcb70014000).stop 2023-05-17T14:54:17.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 msgr2=0x7fcb740a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:17.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 0x7fcb740a91d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fcb6400c440 tx=0x7fcb64007e00).stop 2023-05-17T14:54:17.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 shutdown_connections 2023-05-17T14:54:17.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb5805ed90 0x7fcb58061250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb741540d0 0x7fcb740a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb74065aa0 0x7fcb74141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 --2- 172.21.15.27:0/35364408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb74067ec0 0x7fcb740a91d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:17.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 >> 172.21.15.27:0/35364408 conn(0x7fcb740c94a0 msgr2=0x7fcb740bd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:17.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 shutdown_connections 2023-05-17T14:54:17.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:17.910+0000 7fcb7b56e700 1 -- 172.21.15.27:0/35364408 wait complete. 2023-05-17T14:54:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:17.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:18.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.043+0000 7ff4f8307700 1 Processor -- start 2023-05-17T14:54:18.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.043+0000 7ff4f8307700 1 -- start start 2023-05-17T14:54:18.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.044+0000 7ff4f8307700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4f005e460 0x7ff4f00c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.044+0000 7ff4f8307700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00c2b80 con 0x7ff4f0153fb0 2023-05-17T14:54:18.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.044+0000 7ff4f8307700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00be580 con 0x7ff4f00644d0 2023-05-17T14:54:18.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.044+0000 7ff4f8307700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00c2530 con 0x7ff4f005e460 2023-05-17T14:54:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.044+0000 7ff4f60a3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff4f0153fb0 0x7ff4f0063dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34114/0 (socket says 172.21.15.27:34114) 2023-05-17T14:54:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.044+0000 7ff4f60a3700 1 -- 172.21.15.27:0/710294014 learned_addr learned my addr 172.21.15.27:0/710294014 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f68a4700 1 --2- 172.21.15.27:0/710294014 >> v2:172.21.15.40:3300/0 conn(0x7ff4f005e460 0x7ff4f00c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f50a1700 1 -- 172.21.15.27:0/710294014 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824554461 0 0) 0x7ff4f00c2b80 con 0x7ff4f0153fb0 2023-05-17T14:54:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f50a1700 1 -- 172.21.15.27:0/710294014 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d80033f0 con 0x7ff4f0153fb0 2023-05-17T14:54:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f68a4700 1 -- 172.21.15.27:0/710294014 >> v1:172.21.15.40:6789/0 conn(0x7ff4f00644d0 legacy=0x7ff4f005dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f50a1700 1 -- 172.21.15.27:0/710294014 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506583432 0 0) 0x7ff4f00be580 con 0x7ff4f00644d0 2023-05-17T14:54:18.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f68a4700 1 -- 172.21.15.27:0/710294014 >> v1:172.21.15.27:6789/0 conn(0x7ff4f0153fb0 legacy=0x7ff4f0063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f68a4700 1 -- 172.21.15.27:0/710294014 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00c2810 con 0x7ff4f005e460 2023-05-17T14:54:18.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f68a4700 1 --2- 172.21.15.27:0/710294014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f005e460 0x7ff4f00c3010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff4e0009760 tx=0x7ff4e0009060).ready entity=mon.1 client_cookie=651596cc4469aae6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f50a1700 1 -- 172.21.15.27:0/710294014 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000f510 con 0x7ff4f005e460 2023-05-17T14:54:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f50a1700 1 -- 172.21.15.27:0/710294014 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e000f670 con 0x7ff4f005e460 2023-05-17T14:54:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.045+0000 7ff4f50a1700 1 -- 172.21.15.27:0/710294014 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000f9f0 con 0x7ff4f005e460 2023-05-17T14:54:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 -- 172.21.15.27:0/710294014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f005e460 msgr2=0x7ff4f00c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 --2- 172.21.15.27:0/710294014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f005e460 0x7ff4f00c3010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff4e0009760 tx=0x7ff4e0009060).stop 2023-05-17T14:54:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 -- 172.21.15.27:0/710294014 shutdown_connections 2023-05-17T14:54:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 --2- 172.21.15.27:0/710294014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f005e460 0x7ff4f00c3010 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 -- 172.21.15.27:0/710294014 >> 172.21.15.27:0/710294014 conn(0x7ff4f00c7910 msgr2=0x7ff4f00c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 -- 172.21.15.27:0/710294014 shutdown_connections 2023-05-17T14:54:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.046+0000 7ff4f8307700 1 -- 172.21.15.27:0/710294014 wait complete. 2023-05-17T14:54:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.047+0000 7ff4f8307700 1 Processor -- start 2023-05-17T14:54:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.047+0000 7ff4f8307700 1 -- start start 2023-05-17T14:54:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f8307700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 0x7ff4f014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f8307700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f00644d0 0x7ff4f014b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f8307700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f0153fb0 0x7ff4f01645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f8307700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00ad640 con 0x7ff4f005e460 2023-05-17T14:54:18.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f8307700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f014cae0 con 0x7ff4f0153fb0 2023-05-17T14:54:18.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f8307700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f014bb50 con 0x7ff4f00644d0 2023-05-17T14:54:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 0x7ff4f014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 0x7ff4f014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34558/0 (socket says 172.21.15.27:34558) 2023-05-17T14:54:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 -- 172.21.15.27:0/3499221986 learned_addr learned my addr 172.21.15.27:0/3499221986 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f68a4700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f0153fb0 0x7ff4f01645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f58a2700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f00644d0 0x7ff4f014b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 -- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f00644d0 msgr2=0x7ff4f014b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f00644d0 0x7ff4f014b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 -- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f0153fb0 msgr2=0x7ff4f01645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f0153fb0 0x7ff4f01645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 -- 172.21.15.27:0/3499221986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00092a0 con 0x7ff4f005e460 2023-05-17T14:54:18.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4f60a3700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 0x7ff4f014c5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7ff4e8002250 tx=0x7ff4e80015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8005d30 con 0x7ff4f005e460 2023-05-17T14:54:18.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.048+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8005e90 con 0x7ff4f005e460 2023-05-17T14:54:18.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.049+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8007340 con 0x7ff4f005e460 2023-05-17T14:54:18.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.049+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f0165190 con 0x7ff4f005e460 2023-05-17T14:54:18.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.049+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f014c0d0 con 0x7ff4f005e460 2023-05-17T14:54:18.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.049+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f014c2f0 con 0x7ff4f005e460 2023-05-17T14:54:18.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.050+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff4e8010030 con 0x7ff4f005e460 2023-05-17T14:54:18.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.050+0000 7ff4ee7fc700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff4dc05ed90 0x7ff4dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.050+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff4e8079980 con 0x7ff4f005e460 2023-05-17T14:54:18.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.050+0000 7ff4f58a2700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff4dc05ed90 0x7ff4dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.051+0000 7ff4f58a2700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff4dc05ed90 0x7ff4dc061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff4e4007fd0 tx=0x7ff4e4007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.054+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4e804af20 con 0x7ff4f005e460 2023-05-17T14:54:18.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.228+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff4f0154390 con 0x7ff4f005e460 2023-05-17T14:54:18.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.228+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/3499221986 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff4e804e540 con 0x7ff4f005e460 2023-05-17T14:54:18.232 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:18.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff4dc05ed90 msgr2=0x7ff4dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff4dc05ed90 0x7ff4dc061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff4e4007fd0 tx=0x7ff4e4007bb0).stop 2023-05-17T14:54:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 msgr2=0x7ff4f014c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 0x7ff4f014c5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7ff4e8002250 tx=0x7ff4e80015b0).stop 2023-05-17T14:54:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 shutdown_connections 2023-05-17T14:54:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff4dc05ed90 0x7ff4dc061250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f0153fb0 0x7ff4f01645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f005e460 0x7ff4f014c5f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 --2- 172.21.15.27:0/3499221986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f00644d0 0x7ff4f014b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 >> 172.21.15.27:0/3499221986 conn(0x7ff4f00c7910 msgr2=0x7ff4f0159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 shutdown_connections 2023-05-17T14:54:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.230+0000 7ff4f8307700 1 -- 172.21.15.27:0/3499221986 wait complete. 2023-05-17T14:54:18.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:18.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.361+0000 7f8518fa7700 1 Processor -- start 2023-05-17T14:54:18.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.361+0000 7f8518fa7700 1 -- start start 2023-05-17T14:54:18.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8518fa7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85141543d0 0x7f85140c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8518fa7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 0x7f85140bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8518fa7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8514158790 con 0x7f85140c60f0 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8518fa7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85140c1c50 con 0x7f85141543d0 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8518fa7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c6570 con 0x7f8514069410 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 0x7f85140bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f851259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85141543d0 0x7f85140c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 0x7f85140bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35680/0 (socket says 172.21.15.27:35680) 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 -- 172.21.15.27:0/3512029627 learned_addr learned my addr 172.21.15.27:0/3512029627 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:18.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 -- 172.21.15.27:0/3512029627 >> v2:172.21.15.40:3300/0 conn(0x7f85141543d0 msgr2=0x7f85140c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 --2- 172.21.15.27:0/3512029627 >> v2:172.21.15.40:3300/0 conn(0x7f85141543d0 0x7f85140c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 -- 172.21.15.27:0/3512029627 >> v1:172.21.15.40:6789/0 conn(0x7f85140c60f0 legacy=0x7f8514068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f8512d9d700 1 -- 172.21.15.27:0/3512029627 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514157e60 con 0x7f8514069410 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.362+0000 7f851259c700 1 --2- 172.21.15.27:0/3512029627 >> v2:172.21.15.40:3300/0 conn(0x7f85141543d0 0x7f85140c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8512d9d700 1 --2- 172.21.15.27:0/3512029627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 0x7f85140bfc80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8504006fd0 tx=0x7f85040090f0).ready entity=mon.2 client_cookie=8c3ef49bc160a2d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f851159a700 1 -- 172.21.15.27:0/3512029627 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400b580 con 0x7f8514069410 2023-05-17T14:54:18.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f851159a700 1 -- 172.21.15.27:0/3512029627 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400b6e0 con 0x7f8514069410 2023-05-17T14:54:18.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f851159a700 1 -- 172.21.15.27:0/3512029627 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400ba60 con 0x7f8514069410 2023-05-17T14:54:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 -- 172.21.15.27:0/3512029627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 msgr2=0x7f85140bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3512029627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 0x7f85140bfc80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8504006fd0 tx=0x7f85040090f0).stop 2023-05-17T14:54:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 -- 172.21.15.27:0/3512029627 shutdown_connections 2023-05-17T14:54:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3512029627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8514069410 0x7f85140bfc80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3512029627 >> v2:172.21.15.40:3300/0 conn(0x7f85141543d0 0x7f85140c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 -- 172.21.15.27:0/3512029627 >> 172.21.15.27:0/3512029627 conn(0x7f85140cb7f0 msgr2=0x7f85140c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 -- 172.21.15.27:0/3512029627 shutdown_connections 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.363+0000 7f8518fa7700 1 -- 172.21.15.27:0/3512029627 wait complete. 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.364+0000 7f8518fa7700 1 Processor -- start 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.364+0000 7f8518fa7700 1 -- start start 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8518fa7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8514069410 0x7f85140b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8518fa7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 0x7f8514152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8518fa7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85141543d0 0x7f8514156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8518fa7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c2e00 con 0x7f85140c60f0 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8518fa7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140b0e20 con 0x7f8514069410 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8518fa7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514152fb0 con 0x7f85141543d0 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8511d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 0x7f8514152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8511d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 0x7f8514152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34576/0 (socket says 172.21.15.27:34576) 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8511d9b700 1 -- 172.21.15.27:0/3341868575 learned_addr learned my addr 172.21.15.27:0/3341868575 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f851259c700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8514069410 0x7f85140b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.365+0000 7f8512d9d700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85141543d0 0x7f8514156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8511d9b700 1 -- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85141543d0 msgr2=0x7f8514156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8511d9b700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85141543d0 0x7f8514156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8511d9b700 1 -- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8514069410 msgr2=0x7f85140b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8511d9b700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8514069410 0x7f85140b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8511d9b700 1 -- 172.21.15.27:0/3341868575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c0092a0 con 0x7f85140c60f0 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8511d9b700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 0x7f8514152ac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f84fc00c840 tx=0x7f84fc001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc006a20 con 0x7f85140c60f0 2023-05-17T14:54:18.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc006b80 con 0x7f85140c60f0 2023-05-17T14:54:18.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8504009370 con 0x7f85140c60f0 2023-05-17T14:54:18.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc007020 con 0x7f85140c60f0 2023-05-17T14:54:18.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.366+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85140c24d0 con 0x7f85140c60f0 2023-05-17T14:54:18.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.367+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8514164260 con 0x7f85140c60f0 2023-05-17T14:54:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.367+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f84fc010070 con 0x7f85140c60f0 2023-05-17T14:54:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.368+0000 7f850a7fc700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84f405ed90 0x7f84f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.368+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f84fc079230 con 0x7f85140c60f0 2023-05-17T14:54:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.368+0000 7f851259c700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84f405ed90 0x7f84f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.368+0000 7f851259c700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84f405ed90 0x7f84f4061250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f850c009d20 tx=0x7f850c009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.372+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84fc0478f0 con 0x7f85140c60f0 2023-05-17T14:54:18.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.543+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8514158140 con 0x7f85140c60f0 2023-05-17T14:54:18.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.543+0000 7f850a7fc700 1 -- 172.21.15.27:0/3341868575 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8514164260 con 0x7f85140c60f0 2023-05-17T14:54:18.548 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:18.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84f405ed90 msgr2=0x7f84f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84f405ed90 0x7f84f4061250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f850c009d20 tx=0x7f850c009060).stop 2023-05-17T14:54:18.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 msgr2=0x7f8514152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 0x7f8514152ac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f84fc00c840 tx=0x7f84fc001660).stop 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 shutdown_connections 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84f405ed90 0x7f84f4061250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85141543d0 0x7f8514156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8514069410 0x7f85140b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 --2- 172.21.15.27:0/3341868575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85140c60f0 0x7f8514152ac0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 >> 172.21.15.27:0/3341868575 conn(0x7f85140cb7f0 msgr2=0x7f8514153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:18.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 shutdown_connections 2023-05-17T14:54:18.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.545+0000 7f8518fa7700 1 -- 172.21.15.27:0/3341868575 wait complete. 2023-05-17T14:54:18.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:18.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.676+0000 7fc368906700 1 Processor -- start 2023-05-17T14:54:18.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.676+0000 7fc368906700 1 -- start start 2023-05-17T14:54:18.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc368906700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc364062790 0x7fc364158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc368906700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640c2280 con 0x7fc364158630 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc368906700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640c3430 con 0x7fc364157d60 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc368906700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc364158a80 con 0x7fc364062790 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc361d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc364062790 0x7fc364158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc362d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc364158630 0x7fc3640bc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34146/0 (socket says 172.21.15.27:34146) 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.677+0000 7fc362d9d700 1 -- 172.21.15.27:0/2719456206 learned_addr learned my addr 172.21.15.27:0/2719456206 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc361d9b700 1 -- 172.21.15.27:0/2719456206 >> v1:172.21.15.40:6789/0 conn(0x7fc364157d60 legacy=0x7fc3640c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:18.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc361d9b700 1 -- 172.21.15.27:0/2719456206 >> v1:172.21.15.27:6789/0 conn(0x7fc364158630 legacy=0x7fc3640bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc361d9b700 1 -- 172.21.15.27:0/2719456206 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640c4640 con 0x7fc364062790 2023-05-17T14:54:18.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc361d9b700 1 --2- 172.21.15.27:0/2719456206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364062790 0x7fc364158140 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fc34c009760 tx=0x7fc34c009060).ready entity=mon.0 client_cookie=3c770bcbe5738e4a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc36159a700 1 -- 172.21.15.27:0/2719456206 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0090d0 con 0x7fc364062790 2023-05-17T14:54:18.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc36159a700 1 -- 172.21.15.27:0/2719456206 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00f510 con 0x7fc364062790 2023-05-17T14:54:18.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc36159a700 1 -- 172.21.15.27:0/2719456206 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00f890 con 0x7fc364062790 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc368906700 1 -- 172.21.15.27:0/2719456206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364062790 msgr2=0x7fc364158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.678+0000 7fc368906700 1 --2- 172.21.15.27:0/2719456206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364062790 0x7fc364158140 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fc34c009760 tx=0x7fc34c009060).stop 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.679+0000 7fc368906700 1 -- 172.21.15.27:0/2719456206 shutdown_connections 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.679+0000 7fc368906700 1 --2- 172.21.15.27:0/2719456206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364062790 0x7fc364158140 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.679+0000 7fc368906700 1 -- 172.21.15.27:0/2719456206 >> 172.21.15.27:0/2719456206 conn(0x7fc364063dd0 msgr2=0x7fc364067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.679+0000 7fc368906700 1 -- 172.21.15.27:0/2719456206 shutdown_connections 2023-05-17T14:54:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.679+0000 7fc368906700 1 -- 172.21.15.27:0/2719456206 wait complete. 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 Processor -- start 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 -- start start 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc364062790 0x7fc3641679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 0x7fc3640c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc364158630 0x7fc364164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c7de0 con 0x7fc364157d60 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364168060 con 0x7fc364062790 2023-05-17T14:54:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.680+0000 7fc368906700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc364168340 con 0x7fc364158630 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 0x7fc3640c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 0x7fc3640c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34588/0 (socket says 172.21.15.27:34588) 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 -- 172.21.15.27:0/3903488074 learned_addr learned my addr 172.21.15.27:0/3903488074 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc36259c700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc364062790 0x7fc3641679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc362d9d700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc364158630 0x7fc364164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 -- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc364158630 msgr2=0x7fc364164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc364158630 0x7fc364164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 -- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc364062790 msgr2=0x7fc3641679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc364062790 0x7fc3641679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 -- 172.21.15.27:0/3903488074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0092a0 con 0x7fc364157d60 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc36259c700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc364062790 0x7fc3641679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc361d9b700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 0x7fc3640c78f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fc34c009eb0 tx=0x7fc34c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c006910 con 0x7fc364157d60 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00f680 con 0x7fc364157d60 2023-05-17T14:54:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364168620 con 0x7fc364157d60 2023-05-17T14:54:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c01b440 con 0x7fc364157d60 2023-05-17T14:54:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.681+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364165370 con 0x7fc364157d60 2023-05-17T14:54:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.682+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36406bdf0 con 0x7fc364157d60 2023-05-17T14:54:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.682+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc34c02a070 con 0x7fc364157d60 2023-05-17T14:54:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.683+0000 7fc35a7fc700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc34405ed60 0x7fc344061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.683+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc34c07b100 con 0x7fc364157d60 2023-05-17T14:54:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.683+0000 7fc36259c700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc34405ed60 0x7fc344061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.683+0000 7fc36259c700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc34405ed60 0x7fc344061220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc35c006fd0 tx=0x7fc35c001320).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.687+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc34c04c6a0 con 0x7fc364157d60 2023-05-17T14:54:18.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.860+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3640c2520 con 0x7fc364157d60 2023-05-17T14:54:18.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.861+0000 7fc35a7fc700 1 -- 172.21.15.27:0/3903488074 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc34c04fcc0 con 0x7fc364157d60 2023-05-17T14:54:18.865 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc34405ed60 msgr2=0x7fc344061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc34405ed60 0x7fc344061220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc35c006fd0 tx=0x7fc35c001320).stop 2023-05-17T14:54:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 msgr2=0x7fc3640c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 0x7fc3640c78f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fc34c009eb0 tx=0x7fc34c017000).stop 2023-05-17T14:54:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 shutdown_connections 2023-05-17T14:54:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc34405ed60 0x7fc344061220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc364158630 0x7fc364164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc364062790 0x7fc3641679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 --2- 172.21.15.27:0/3903488074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc364157d60 0x7fc3640c78f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:18.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 >> 172.21.15.27:0/3903488074 conn(0x7fc364063dd0 msgr2=0x7fc3640c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:18.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 shutdown_connections 2023-05-17T14:54:18.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.863+0000 7fc368906700 1 -- 172.21.15.27:0/3903488074 wait complete. 2023-05-17T14:54:18.878 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:18.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.993+0000 7f82a8d8f700 1 Processor -- start 2023-05-17T14:54:18.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.993+0000 7f82a8d8f700 1 -- start start 2023-05-17T14:54:18.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a8d8f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a8d8f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82a40c60f0 0x7f82a4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a8d8f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82a40691f0 0x7f82a41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:18.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a8d8f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a40c1c50 con 0x7f82a40c60f0 2023-05-17T14:54:18.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a8d8f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a4158790 con 0x7f82a40691f0 2023-05-17T14:54:18.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a8d8f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40c6570 con 0x7f82a41543d0 2023-05-17T14:54:18.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a1d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82a40c60f0 0x7f82a4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a1d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82a40c60f0 0x7f82a4068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34594/0 (socket says 172.21.15.27:34594) 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a1d9b700 1 -- 172.21.15.27:0/834117122 learned_addr learned my addr 172.21.15.27:0/834117122 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a2d9d700 1 --2- 172.21.15.27:0/834117122 >> v2:172.21.15.40:3300/0 conn(0x7f82a40691f0 0x7f82a41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.994+0000 7f82a259c700 1 --2- 172.21.15.27:0/834117122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a1d9b700 1 -- 172.21.15.27:0/834117122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 msgr2=0x7f82a40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a1d9b700 1 --2- 172.21.15.27:0/834117122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a40c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a1d9b700 1 -- 172.21.15.27:0/834117122 >> v2:172.21.15.40:3300/0 conn(0x7f82a40691f0 msgr2=0x7f82a41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a1d9b700 1 --2- 172.21.15.27:0/834117122 >> v2:172.21.15.40:3300/0 conn(0x7f82a40691f0 0x7f82a41547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a1d9b700 1 -- 172.21.15.27:0/834117122 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4157e60 con 0x7f82a40c60f0 2023-05-17T14:54:19.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a2d9d700 1 --2- 172.21.15.27:0/834117122 >> v2:172.21.15.40:3300/0 conn(0x7f82a40691f0 0x7f82a41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:19.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a1d9b700 1 --2- 172.21.15.27:0/834117122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a4068d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f82a40838e0 tx=0x7f828c0090f0).ready entity=mon.0 client_cookie=f30735d770a6a237 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a159a700 1 -- 172.21.15.27:0/834117122 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00b600 con 0x7f82a40c60f0 2023-05-17T14:54:19.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a159a700 1 -- 172.21.15.27:0/834117122 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00b760 con 0x7f82a40c60f0 2023-05-17T14:54:19.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a159a700 1 -- 172.21.15.27:0/834117122 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00bae0 con 0x7f82a40c60f0 2023-05-17T14:54:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 -- 172.21.15.27:0/834117122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 msgr2=0x7f82a4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/834117122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a4068d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f82a40838e0 tx=0x7f828c0090f0).stop 2023-05-17T14:54:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 -- 172.21.15.27:0/834117122 shutdown_connections 2023-05-17T14:54:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/834117122 >> v2:172.21.15.40:3300/0 conn(0x7f82a40691f0 0x7f82a41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/834117122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a40c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/834117122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a4068d00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.995+0000 7f82a8d8f700 1 -- 172.21.15.27:0/834117122 >> 172.21.15.27:0/834117122 conn(0x7f82a40cb7f0 msgr2=0x7f82a40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.996+0000 7f82a8d8f700 1 -- 172.21.15.27:0/834117122 shutdown_connections 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.996+0000 7f82a8d8f700 1 -- 172.21.15.27:0/834117122 wait complete. 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 Processor -- start 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 -- start start 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a40691f0 0x7f82a40aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a40c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40afd90 con 0x7f82a40c60f0 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40c1ff0 con 0x7f82a40691f0 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a8d8f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40af4f0 con 0x7f82a41543d0 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a1d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a40c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a1d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a40c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34600/0 (socket says 172.21.15.27:34600) 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.997+0000 7f82a1d9b700 1 -- 172.21.15.27:0/2445402619 learned_addr learned my addr 172.21.15.27:0/2445402619 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:19.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a259c700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a40691f0 0x7f82a40aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a2d9d700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a1d9b700 1 -- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 msgr2=0x7f82a41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a1d9b700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a41547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a1d9b700 1 -- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a40691f0 msgr2=0x7f82a40aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a1d9b700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a40691f0 0x7f82a40aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a1d9b700 1 -- 172.21.15.27:0/2445402619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009370 con 0x7f82a40c60f0 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a2d9d700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:19.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a1d9b700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a40c3f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f828c009130 tx=0x7f828c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00b8d0 con 0x7f82a40c60f0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00ba30 con 0x7f82a40c60f0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40af7d0 con 0x7f82a40c60f0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c01c670 con 0x7f82a40c60f0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.998+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40af190 con 0x7f82a40c60f0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.999+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40c1da0 con 0x7f82a40c60f0 2023-05-17T14:54:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:18.999+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f828c00f070 con 0x7f82a40c60f0 2023-05-17T14:54:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.000+0000 7f829a7fc700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f828405ed90 0x7f8284061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.000+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f828c07b200 con 0x7f82a40c60f0 2023-05-17T14:54:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.000+0000 7f82a259c700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f828405ed90 0x7f8284061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.000+0000 7f82a259c700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f828405ed90 0x7f8284061250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f829c00bb10 tx=0x7f829c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.004+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f828c04c7a0 con 0x7f82a40c60f0 2023-05-17T14:54:19.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.176+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82a406bdf0 con 0x7f82a40c60f0 2023-05-17T14:54:19.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.177+0000 7f829a7fc700 1 -- 172.21.15.27:0/2445402619 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f828c04fdc0 con 0x7f82a40c60f0 2023-05-17T14:54:19.181 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:19.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f828405ed90 msgr2=0x7f8284061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f828405ed90 0x7f8284061250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f829c00bb10 tx=0x7f829c008040).stop 2023-05-17T14:54:19.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 msgr2=0x7f82a40c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a40c3f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f828c009130 tx=0x7f828c017000).stop 2023-05-17T14:54:19.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 shutdown_connections 2023-05-17T14:54:19.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f828405ed90 0x7f8284061250 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a41543d0 0x7f82a41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a40691f0 0x7f82a40aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 --2- 172.21.15.27:0/2445402619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a40c60f0 0x7f82a40c3f50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 >> 172.21.15.27:0/2445402619 conn(0x7f82a40cb7f0 msgr2=0x7f82a4156330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 shutdown_connections 2023-05-17T14:54:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.179+0000 7f82a8d8f700 1 -- 172.21.15.27:0/2445402619 wait complete. 2023-05-17T14:54:19.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:19.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.307+0000 7ff7e1a5a700 1 Processor -- start 2023-05-17T14:54:19.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.307+0000 7ff7e1a5a700 1 -- start start 2023-05-17T14:54:19.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e1a5a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7dc157970 0x7ff7dc0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e1a5a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 0x7ff7dc0c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e1a5a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0c0120 con 0x7ff7dc1571b0 2023-05-17T14:54:19.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e1a5a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7dc0c6e20 con 0x7ff7dc157970 2023-05-17T14:54:19.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e1a5a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc157df0 con 0x7ff7dc0caf10 2023-05-17T14:54:19.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e0a58700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff7dc1571b0 0x7ff7dc0c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34168/0 (socket says 172.21.15.27:34168) 2023-05-17T14:54:19.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e0a58700 1 -- 172.21.15.27:0/1625370248 learned_addr learned my addr 172.21.15.27:0/1625370248 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:19.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7dbfff700 1 --2- 172.21.15.27:0/1625370248 >> v2:172.21.15.40:3300/0 conn(0x7ff7dc157970 0x7ff7dc0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364102661 0 0) 0x7ff7dc0c0120 con 0x7ff7dc1571b0 2023-05-17T14:54:19.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c80033f0 con 0x7ff7dc1571b0 2023-05-17T14:54:19.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7e1259700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 0x7ff7dc0c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187327466 0 0) 0x7ff7c80033f0 con 0x7ff7dc1571b0 2023-05-17T14:54:19.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 msgr2=0x7ff7dc0c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 0x7ff7dc0c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 >> v2:172.21.15.40:3300/0 conn(0x7ff7dc157970 msgr2=0x7ff7dc0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 --2- 172.21.15.27:0/1625370248 >> v2:172.21.15.40:3300/0 conn(0x7ff7dc157970 0x7ff7dc0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0cb3a0 con 0x7ff7dc1571b0 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7ff7d40017f0 con 0x7ff7dc1571b0 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.308+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 >> v1:172.21.15.27:6789/0 conn(0x7ff7dc1571b0 legacy=0x7ff7dc0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c80038e0 0x7ff7c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 0x7ff7c8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0c6e20 con 0x7ff7c8004b80 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800b8e0 con 0x7ff7c80038e0 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800ba20 con 0x7ff7dc0caf10 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e0a58700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c80038e0 0x7ff7c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7dbfff700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 0x7ff7c8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 -- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 msgr2=0x7ff7c8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0caf10 0x7ff7c8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 -- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c80038e0 msgr2=0x7ff7c8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c80038e0 0x7ff7c8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 -- 172.21.15.27:0/1625370248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80033f0 con 0x7ff7c8004b80 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7e1259700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7c8005000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7ff7c400ba00 tx=0x7ff7c4008040).ready entity=mon.0 client_cookie=f989af76969a2dda server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400b340 con 0x7ff7c8004b80 2023-05-17T14:54:19.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4013480 con 0x7ff7c8004b80 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.309+0000 7ff7db7fe700 1 -- 172.21.15.27:0/1625370248 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4013800 con 0x7ff7c8004b80 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/1625370248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 msgr2=0x7ff7c8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/1625370248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7c8005000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7ff7c400ba00 tx=0x7ff7c4008040).stop 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1259700 1 -- 172.21.15.27:0/1625370248 reap_dead start 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/1625370248 shutdown_connections 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/1625370248 >> 172.21.15.27:0/1625370248 conn(0x7ff7dc05dd50 msgr2=0x7ff7dc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/1625370248 shutdown_connections 2023-05-17T14:54:19.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.310+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/1625370248 wait complete. 2023-05-17T14:54:19.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.311+0000 7ff7e1a5a700 1 Processor -- start 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.311+0000 7ff7e1a5a700 1 -- start start 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7dc166f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0c38c0 0x7ff7dc0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7dc0c2760 0x7ff7dc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc167e80 con 0x7ff7c8004b80 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0c1de0 con 0x7ff7dc0c2760 2023-05-17T14:54:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc1675e0 con 0x7ff7dc0c38c0 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7dc166f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7dc166f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34618/0 (socket says 172.21.15.27:34618) 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 -- 172.21.15.27:0/3467332505 learned_addr learned my addr 172.21.15.27:0/3467332505 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1259700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7dc0c2760 0x7ff7dc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 -- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0c38c0 msgr2=0x7ff7dc0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0c38c0 0x7ff7dc0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 -- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7dc0c2760 msgr2=0x7ff7dc0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7dc0c2760 0x7ff7dc0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 -- 172.21.15.27:0/3467332505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc1678c0 con 0x7ff7c8004b80 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e0a58700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7dc166f50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff7d4007710 tx=0x7ff7d4002210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400f940 con 0x7ff7c8004b80 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d400faa0 con 0x7ff7c8004b80 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc167ba0 con 0x7ff7c8004b80 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.312+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400fe40 con 0x7ff7c8004b80 2023-05-17T14:54:19.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.313+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc0acd60 con 0x7ff7c8004b80 2023-05-17T14:54:19.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.314+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc0c20c0 con 0x7ff7c8004b80 2023-05-17T14:54:19.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.314+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff7d401b030 con 0x7ff7c8004b80 2023-05-17T14:54:19.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.314+0000 7ff7d8ff9700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff7bc05ed90 0x7ff7bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.314+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff7d40797e0 con 0x7ff7c8004b80 2023-05-17T14:54:19.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.314+0000 7ff7dbfff700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff7bc05ed90 0x7ff7bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.315+0000 7ff7dbfff700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff7bc05ed90 0x7ff7bc061250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff7cc006f70 tx=0x7ff7cc009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.318+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7d404ad80 con 0x7ff7c8004b80 2023-05-17T14:54:19.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.498+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7dc06bdf0 con 0x7ff7c8004b80 2023-05-17T14:54:19.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.499+0000 7ff7d8ff9700 1 -- 172.21.15.27:0/3467332505 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7ff7d4019020 con 0x7ff7c8004b80 2023-05-17T14:54:19.503 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:19.504 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff7bc05ed90 msgr2=0x7ff7bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff7bc05ed90 0x7ff7bc061250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff7cc006f70 tx=0x7ff7cc009060).stop 2023-05-17T14:54:19.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 msgr2=0x7ff7dc166f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7dc166f50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff7d4007710 tx=0x7ff7d4002210).stop 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 shutdown_connections 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff7bc05ed90 0x7ff7bc061250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7dc0c2760 0x7ff7dc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c8004b80 0x7ff7dc166f50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 --2- 172.21.15.27:0/3467332505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7dc0c38c0 0x7ff7dc0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:19.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 >> 172.21.15.27:0/3467332505 conn(0x7ff7dc05dd50 msgr2=0x7ff7dc0ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 shutdown_connections 2023-05-17T14:54:19.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.501+0000 7ff7e1a5a700 1 -- 172.21.15.27:0/3467332505 wait complete. 2023-05-17T14:54:19.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:19.518 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:19.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.633+0000 7f8ae3f6a700 1 Processor -- start 2023-05-17T14:54:19.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.633+0000 7f8ae3f6a700 1 -- start start 2023-05-17T14:54:19.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae3f6a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8adc0c6310 0x7f8adc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae3f6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 0x7f8adc0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae3f6a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc158790 con 0x7f8adc1543d0 2023-05-17T14:54:19.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae3f6a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc0c1c50 con 0x7f8adc0c6310 2023-05-17T14:54:19.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae3f6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc157e60 con 0x7f8adc0691f0 2023-05-17T14:54:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae1505700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8adc0c6310 0x7f8adc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae2507700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 0x7f8adc0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae1505700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8adc0c6310 0x7f8adc068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:52560/0 (socket says 172.21.15.27:52560) 2023-05-17T14:54:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae2507700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 0x7f8adc0bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35738/0 (socket says 172.21.15.27:35738) 2023-05-17T14:54:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae1505700 1 -- 172.21.15.27:0/474920902 learned_addr learned my addr 172.21.15.27:0/474920902 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.634+0000 7f8ae1d06700 1 --1- 172.21.15.27:0/474920902 >> v1:172.21.15.40:6789/0 conn(0x7f8adc1543d0 0x7f8adc0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40190/0 (socket says 172.21.15.27:40190) 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae1505700 1 -- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 msgr2=0x7f8adc0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae1505700 1 --2- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 0x7f8adc0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae1505700 1 -- 172.21.15.27:0/474920902 >> v1:172.21.15.40:6789/0 conn(0x7f8adc1543d0 legacy=0x7f8adc0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae0d04700 1 -- 172.21.15.27:0/474920902 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024522154 0 0) 0x7f8adc158790 con 0x7f8adc1543d0 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae1505700 1 -- 172.21.15.27:0/474920902 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc158140 con 0x7f8adc0c6310 2023-05-17T14:54:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae2507700 1 --2- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 0x7f8adc0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae1505700 1 --2- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc0c6310 0x7f8adc068d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f8ad0006fd0 tx=0x7f8ad00090f0).ready entity=mon.1 client_cookie=61593036c7757f5a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae0d04700 1 -- 172.21.15.27:0/474920902 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000b580 con 0x7f8adc0c6310 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae0d04700 1 -- 172.21.15.27:0/474920902 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000b6e0 con 0x7f8adc0c6310 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.635+0000 7f8ae0d04700 1 -- 172.21.15.27:0/474920902 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000ba60 con 0x7f8adc0c6310 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc0c6310 msgr2=0x7f8adc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc0c6310 0x7f8adc068d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f8ad0006fd0 tx=0x7f8ad00090f0).stop 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/474920902 shutdown_connections 2023-05-17T14:54:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0691f0 0x7f8adc0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/474920902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc0c6310 0x7f8adc068d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/474920902 >> 172.21.15.27:0/474920902 conn(0x7f8adc0cb7f0 msgr2=0x7f8adc0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/474920902 shutdown_connections 2023-05-17T14:54:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.636+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/474920902 wait complete. 2023-05-17T14:54:19.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.637+0000 7f8ae3f6a700 1 Processor -- start 2023-05-17T14:54:19.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.637+0000 7f8ae3f6a700 1 -- start start 2023-05-17T14:54:19.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae3f6a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 0x7f8adc1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae3f6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0c6310 0x7f8adc164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae3f6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc1543d0 0x7f8adc0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae3f6a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc146ed0 con 0x7f8adc0691f0 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae3f6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0aed20 con 0x7f8adc1543d0 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae3f6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0af000 con 0x7f8adc0c6310 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 0x7f8adc1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 0x7f8adc1469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34632/0 (socket says 172.21.15.27:34632) 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 -- 172.21.15.27:0/1324594928 learned_addr learned my addr 172.21.15.27:0/1324594928 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae2507700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc1543d0 0x7f8adc0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1505700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0c6310 0x7f8adc164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 -- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0c6310 msgr2=0x7f8adc164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0c6310 0x7f8adc164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 -- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc1543d0 msgr2=0x7f8adc0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc1543d0 0x7f8adc0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 -- 172.21.15.27:0/1324594928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc009a20 con 0x7f8adc0691f0 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ae1d06700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 0x7f8adc1469e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8ad400c440 tx=0x7f8ad4007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.638+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400cea0 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.639+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad40072e0 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.639+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad0009370 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.639+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40056e0 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.639+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc0af5c0 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.640+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc155600 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.640+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ad4010070 con 0x7f8adc0691f0 2023-05-17T14:54:19.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.640+0000 7f8ad9ffb700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ac805ed90 0x7f8ac8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.640+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ad4079080 con 0x7f8adc0691f0 2023-05-17T14:54:19.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.640+0000 7f8ae1505700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ac805ed90 0x7f8ac8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.641+0000 7f8ae1505700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ac805ed90 0x7f8ac8061250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8adc0c6710 tx=0x7f8ad0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.645+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ad404a620 con 0x7f8adc0691f0 2023-05-17T14:54:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.819+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8adc158420 con 0x7f8adc0691f0 2023-05-17T14:54:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.820+0000 7f8ad9ffb700 1 -- 172.21.15.27:0/1324594928 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8ad4018070 con 0x7f8adc0691f0 2023-05-17T14:54:19.824 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:19.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ac805ed90 msgr2=0x7f8ac8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ac805ed90 0x7f8ac8061250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8adc0c6710 tx=0x7f8ad0017000).stop 2023-05-17T14:54:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 msgr2=0x7f8adc1469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 0x7f8adc1469e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8ad400c440 tx=0x7f8ad4007e30).stop 2023-05-17T14:54:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 shutdown_connections 2023-05-17T14:54:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ac805ed90 0x7f8ac8061250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8adc1543d0 0x7f8adc0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8adc0691f0 0x7f8adc1469e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 --2- 172.21.15.27:0/1324594928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8adc0c6310 0x7f8adc164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 >> 172.21.15.27:0/1324594928 conn(0x7f8adc0cb7f0 msgr2=0x7f8adc1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 shutdown_connections 2023-05-17T14:54:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.822+0000 7f8ae3f6a700 1 -- 172.21.15.27:0/1324594928 wait complete. 2023-05-17T14:54:19.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:19.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.951+0000 7f8bb1428700 1 Processor -- start 2023-05-17T14:54:19.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.952+0000 7f8bb1428700 1 -- start start 2023-05-17T14:54:19.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.952+0000 7f8bb1428700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bac1543d0 0x7f8bac0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.952+0000 7f8bb1428700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac158790 con 0x7f8bac0c60f0 2023-05-17T14:54:19.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.952+0000 7f8bb1428700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac0c6570 con 0x7f8bac069410 2023-05-17T14:54:19.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.952+0000 7f8bb1428700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac0c1c50 con 0x7f8bac1543d0 2023-05-17T14:54:19.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8baa7fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8bac0c60f0 0x7f8bac068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34204/0 (socket says 172.21.15.27:34204) 2023-05-17T14:54:19.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8baa7fc700 1 -- 172.21.15.27:0/2484204188 learned_addr learned my addr 172.21.15.27:0/2484204188 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2484204188 >> v2:172.21.15.40:3300/0 conn(0x7f8bac1543d0 0x7f8bac0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769916759 0 0) 0x7f8bac158790 con 0x7f8bac0c60f0 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b980033f0 con 0x7f8bac0c60f0 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803377652 0 0) 0x7f8b980033f0 con 0x7f8bac0c60f0 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 >> v2:172.21.15.40:3300/0 conn(0x7f8bac1543d0 msgr2=0x7f8bac0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 --2- 172.21.15.27:0/2484204188 >> v2:172.21.15.40:3300/0 conn(0x7f8bac1543d0 0x7f8bac0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 >> v1:172.21.15.40:6789/0 conn(0x7f8bac069410 legacy=0x7f8bac0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac157e60 con 0x7f8bac0c60f0 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f8b94001470 con 0x7f8bac0c60f0 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 >> v1:172.21.15.27:6789/0 conn(0x7f8bac0c60f0 legacy=0x7f8bac068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800be80 con 0x7f8b980038e0 2023-05-17T14:54:19.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800bff0 con 0x7f8b98005000 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9800c1b0 con 0x7f8b98004690 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8baa7fc700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.953+0000 7f8bab7fe700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8baaffd700 1 -- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b98004690 msgr2=0x7f8b98004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b98004690 0x7f8b98004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8baaffd700 1 -- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b98005000 msgr2=0x7f8b9800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8baaffd700 1 -- 172.21.15.27:0/2484204188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980033f0 con 0x7f8b980038e0 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bab7fe700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b98005000 0x7f8b9800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bab7fe700 1 -- 172.21.15.27:0/2484204188 reap_dead start 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f8ba4009a60 tx=0x7f8ba4009060).ready entity=mon.0 client_cookie=4442ece97a95449d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4009ea0 con 0x7f8b980038e0 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba4009430 con 0x7f8b980038e0 2023-05-17T14:54:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8ba9ffb700 1 -- 172.21.15.27:0/2484204188 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400e870 con 0x7f8b980038e0 2023-05-17T14:54:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bb1428700 1 -- 172.21.15.27:0/2484204188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b980038e0 msgr2=0x7f8b98003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f8ba4009a60 tx=0x7f8ba4009060).stop 2023-05-17T14:54:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bb1428700 1 -- 172.21.15.27:0/2484204188 shutdown_connections 2023-05-17T14:54:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2484204188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b980038e0 0x7f8b98003d00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.954+0000 7f8bb1428700 1 -- 172.21.15.27:0/2484204188 >> 172.21.15.27:0/2484204188 conn(0x7f8bac0cb7f0 msgr2=0x7f8bac0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.955+0000 7f8bb1428700 1 -- 172.21.15.27:0/2484204188 shutdown_connections 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.955+0000 7f8bb1428700 1 -- 172.21.15.27:0/2484204188 wait complete. 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.956+0000 7f8bb1428700 1 Processor -- start 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.956+0000 7f8bb1428700 1 -- start start 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.956+0000 7f8bb1428700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b980038e0 0x7f8bac140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.956+0000 7f8bb1428700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 0x7f8bac15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bb1428700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bac15e190 0x7f8bac15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bb1428700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac140c80 con 0x7f8bac0b0640 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bb1428700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac140f60 con 0x7f8bac15e190 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bb1428700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac141240 con 0x7f8b980038e0 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 0x7f8bac15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 0x7f8bac15dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34654/0 (socket says 172.21.15.27:34654) 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 -- 172.21.15.27:0/2922253352 learned_addr learned my addr 172.21.15.27:0/2922253352 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bab7fe700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bac15e190 0x7f8bac15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b980038e0 0x7f8bac140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 -- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b980038e0 msgr2=0x7f8bac140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b980038e0 0x7f8bac140630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 -- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bac15e190 msgr2=0x7f8bac15e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bac15e190 0x7f8bac15e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 -- 172.21.15.27:0/2922253352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac141520 con 0x7f8bac0b0640 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8baa7fc700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 0x7f8bac15dca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f8b940015a0 tx=0x7f8b94001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94004e40 con 0x7f8bac0b0640 2023-05-17T14:54:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400f870 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac141800 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400fc10 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.957+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac0b0ac0 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.958+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac141a40 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.958+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8b9401b030 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.959+0000 7f8ba2ffd700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8b8c05ed90 0x7f8b8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.959+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b94079530 con 0x7f8bac0b0640 2023-05-17T14:54:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.959+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8b8c05ed90 0x7f8b8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:19.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.959+0000 7f8baaffd700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8b8c05ed90 0x7f8b8c061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8ba4006d50 tx=0x7f8ba401a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:19.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:19.963+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8bac141a40 con 0x7f8bac0b0640 2023-05-17T14:54:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.135+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8bac06bdf0 con 0x7f8bac0b0640 2023-05-17T14:54:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.135+0000 7f8ba2ffd700 1 -- 172.21.15.27:0/2922253352 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b94019020 con 0x7f8bac0b0640 2023-05-17T14:54:20.140 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8b8c05ed90 msgr2=0x7f8b8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8b8c05ed90 0x7f8b8c061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8ba4006d50 tx=0x7f8ba401a000).stop 2023-05-17T14:54:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 msgr2=0x7f8bac15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 0x7f8bac15dca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f8b940015a0 tx=0x7f8b94001e50).stop 2023-05-17T14:54:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 shutdown_connections 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8b8c05ed90 0x7f8b8c061250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bac15e190 0x7f8bac15e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b980038e0 0x7f8bac140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 --2- 172.21.15.27:0/2922253352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac0b0640 0x7f8bac15dca0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 >> 172.21.15.27:0/2922253352 conn(0x7f8bac0cb7f0 msgr2=0x7f8bac1559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 shutdown_connections 2023-05-17T14:54:20.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.137+0000 7f8bb1428700 1 -- 172.21.15.27:0/2922253352 wait complete. 2023-05-17T14:54:20.153 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:20.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.267+0000 7f17c6fbc700 1 Processor -- start 2023-05-17T14:54:20.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.267+0000 7f17c6fbc700 1 -- start start 2023-05-17T14:54:20.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c6fbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c01543d0 0x7f17c00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c6fbc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17c0069410 0x7f17c00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c6fbc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c0158790 con 0x7f17c00c60f0 2023-05-17T14:54:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c6fbc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c00c1c50 con 0x7f17c0069410 2023-05-17T14:54:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c6fbc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00c6570 con 0x7f17c01543d0 2023-05-17T14:54:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c5559700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f17c0069410 0x7f17c00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17bffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f17c00c60f0 0x7f17c0068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34222/0 (socket says 172.21.15.27:34222) 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17bffff700 1 -- 172.21.15.27:0/3615118770 learned_addr learned my addr 172.21.15.27:0/3615118770 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c4d58700 1 --2- 172.21.15.27:0/3615118770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c01543d0 0x7f17c00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17c5559700 1 -- 172.21.15.27:0/3615118770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c01543d0 msgr2=0x7f17c00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c5559700 1 --2- 172.21.15.27:0/3615118770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c01543d0 0x7f17c00c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.268+0000 7f17bf7fe700 1 -- 172.21.15.27:0/3615118770 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193684681 0 0) 0x7f17c0158790 con 0x7f17c00c60f0 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c5559700 1 -- 172.21.15.27:0/3615118770 >> v1:172.21.15.27:6789/0 conn(0x7f17c00c60f0 legacy=0x7f17c0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c5559700 1 -- 172.21.15.27:0/3615118770 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0157e60 con 0x7f17c0069410 2023-05-17T14:54:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c5559700 1 --2- 172.21.15.27:0/3615118770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c0069410 0x7f17c00bfc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f17a8009760 tx=0x7f17a8009060).ready entity=mon.0 client_cookie=be439278137ed0b0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17bf7fe700 1 -- 172.21.15.27:0/3615118770 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800f510 con 0x7f17c0069410 2023-05-17T14:54:20.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17bf7fe700 1 -- 172.21.15.27:0/3615118770 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a800f670 con 0x7f17c0069410 2023-05-17T14:54:20.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17bf7fe700 1 -- 172.21.15.27:0/3615118770 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800f9f0 con 0x7f17c0069410 2023-05-17T14:54:20.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3615118770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c0069410 msgr2=0x7f17c00bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3615118770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c0069410 0x7f17c00bfc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f17a8009760 tx=0x7f17a8009060).stop 2023-05-17T14:54:20.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3615118770 shutdown_connections 2023-05-17T14:54:20.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3615118770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c0069410 0x7f17c00bfc80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3615118770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c01543d0 0x7f17c00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3615118770 >> 172.21.15.27:0/3615118770 conn(0x7f17c00cb7f0 msgr2=0x7f17c00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3615118770 shutdown_connections 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.269+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3615118770 wait complete. 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.270+0000 7f17c6fbc700 1 Processor -- start 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 -- start start 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c0069410 0x7f17c00b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c60f0 0x7f17c00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 0x7f17c00ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01683a0 con 0x7f17c01543d0 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00ae770 con 0x7f17c00c60f0 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.271+0000 7f17c6fbc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00aea50 con 0x7f17c0069410 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 0x7f17c00ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 0x7f17c00ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34670/0 (socket says 172.21.15.27:34670) 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 -- 172.21.15.27:0/3580936887 learned_addr learned my addr 172.21.15.27:0/3580936887 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17bffff700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c60f0 0x7f17c00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c4d58700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c0069410 0x7f17c00b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 -- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c0069410 msgr2=0x7f17c00b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c0069410 0x7f17c00b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 -- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c60f0 msgr2=0x7f17c00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c60f0 0x7f17c00adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 -- 172.21.15.27:0/3580936887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a80092a0 con 0x7f17c01543d0 2023-05-17T14:54:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c5559700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 0x7f17c00ae1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f17c0083d00 tx=0x7f17a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80115d0 con 0x7f17c01543d0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a801e070 con 0x7f17c01543d0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c00aed30 con 0x7f17c01543d0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011980 con 0x7f17c01543d0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.272+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c00b05c0 con 0x7f17c01543d0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.273+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c006bdf0 con 0x7f17c01543d0 2023-05-17T14:54:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.273+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f17a800f070 con 0x7f17c01543d0 2023-05-17T14:54:20.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.274+0000 7f17bcff9700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f17a005ed90 0x7f17a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.274+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f17a807ae10 con 0x7f17c01543d0 2023-05-17T14:54:20.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.274+0000 7f17c4d58700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f17a005ed90 0x7f17a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.274+0000 7f17c4d58700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f17a005ed90 0x7f17a0061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f17c0155240 tx=0x7f17b8009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.278+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17a804c3b0 con 0x7f17c01543d0 2023-05-17T14:54:20.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.450+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17c0158140 con 0x7f17c01543d0 2023-05-17T14:54:20.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.451+0000 7f17bcff9700 1 -- 172.21.15.27:0/3580936887 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17a8006b30 con 0x7f17c01543d0 2023-05-17T14:54:20.455 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:20.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.452+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f17a005ed90 msgr2=0x7f17a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.452+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f17a005ed90 0x7f17a0061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f17c0155240 tx=0x7f17b8009060).stop 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.452+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 msgr2=0x7f17c00ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.452+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 0x7f17c00ae1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f17c0083d00 tx=0x7f17a8017000).stop 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 shutdown_connections 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f17a005ed90 0x7f17a0061250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17c01543d0 0x7f17c00ae1c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f17c0069410 0x7f17c00b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 --2- 172.21.15.27:0/3580936887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17c00c60f0 0x7f17c00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 >> 172.21.15.27:0/3580936887 conn(0x7f17c00cb7f0 msgr2=0x7f17c0153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:20.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 shutdown_connections 2023-05-17T14:54:20.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.453+0000 7f17c6fbc700 1 -- 172.21.15.27:0/3580936887 wait complete. 2023-05-17T14:54:20.468 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:20.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.583+0000 7f59bd4c4700 1 Processor -- start 2023-05-17T14:54:20.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.583+0000 7f59bd4c4700 1 -- start start 2023-05-17T14:54:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59bd4c4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59b80c6310 0x7f59b8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59bd4c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 0x7f59b80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59bd4c4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b8158790 con 0x7f59b81543d0 2023-05-17T14:54:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59bd4c4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b80c1c50 con 0x7f59b80c6310 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59bd4c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8157e60 con 0x7f59b80691f0 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59b6ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f59b81543d0 0x7f59b80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34236/0 (socket says 172.21.15.27:34236) 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59b6ffd700 1 -- 172.21.15.27:0/3104822562 learned_addr learned my addr 172.21.15.27:0/3104822562 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919772786 0 0) 0x7f59b8158790 con 0x7f59b81543d0 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59b67fc700 1 --2- 172.21.15.27:0/3104822562 >> v2:172.21.15.40:3300/0 conn(0x7f59b80c6310 0x7f59b8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59b77fe700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 0x7f59b80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.584+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a40033f0 con 0x7f59b81543d0 2023-05-17T14:54:20.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911824223 0 0) 0x7f59a40033f0 con 0x7f59b81543d0 2023-05-17T14:54:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 msgr2=0x7f59b80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 0x7f59b80bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 >> v2:172.21.15.40:3300/0 conn(0x7f59b80c6310 msgr2=0x7f59b8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 --2- 172.21.15.27:0/3104822562 >> v2:172.21.15.40:3300/0 conn(0x7f59b80c6310 0x7f59b8068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8158140 con 0x7f59b81543d0 2023-05-17T14:54:20.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f59b0001470 con 0x7f59b81543d0 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 >> v1:172.21.15.27:6789/0 conn(0x7f59b81543d0 legacy=0x7f59b80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59a40038e0 0x7f59a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 0x7f59a4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a4004b80 0x7f59a4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8157e60 con 0x7f59a40038e0 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40044c0 con 0x7f59a4004b80 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a400b930 con 0x7f59b80691f0 2023-05-17T14:54:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59a40038e0 0x7f59a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b67fc700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 0x7f59a4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b77fe700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a4004b80 0x7f59a4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 -- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 msgr2=0x7f59a4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b80691f0 0x7f59a4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 -- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a4004b80 msgr2=0x7f59a4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a4004b80 0x7f59a4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 -- 172.21.15.27:0/3104822562 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40033f0 con 0x7f59a40038e0 2023-05-17T14:54:20.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59a40038e0 0x7f59a4003d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f59b000c240 tx=0x7f59b0001e90).ready entity=mon.0 client_cookie=693fe3bd9e03817b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0007a60 con 0x7f59a40038e0 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000cad0 con 0x7f59a40038e0 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.585+0000 7f59b5ffb700 1 -- 172.21.15.27:0/3104822562 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000ce50 con 0x7f59a40038e0 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59bd4c4700 1 -- 172.21.15.27:0/3104822562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59a40038e0 msgr2=0x7f59a4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/3104822562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59a40038e0 0x7f59a4003d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f59b000c240 tx=0x7f59b0001e90).stop 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59b77fe700 1 -- 172.21.15.27:0/3104822562 reap_dead start 2023-05-17T14:54:20.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59bd4c4700 1 -- 172.21.15.27:0/3104822562 shutdown_connections 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59bd4c4700 1 -- 172.21.15.27:0/3104822562 >> 172.21.15.27:0/3104822562 conn(0x7f59b80cb7f0 msgr2=0x7f59b80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59bd4c4700 1 -- 172.21.15.27:0/3104822562 shutdown_connections 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.586+0000 7f59bd4c4700 1 -- 172.21.15.27:0/3104822562 wait complete. 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.587+0000 7f59bd4c4700 1 Processor -- start 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.587+0000 7f59bd4c4700 1 -- start start 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59bd4c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a40038e0 0x7f59b80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59bd4c4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b81448f0 0x7f59b81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59bd4c4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 0x7f59b80af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59bd4c4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8153050 con 0x7f59b8154ca0 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59bd4c4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80adcd0 con 0x7f59b81448f0 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59bd4c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8155120 con 0x7f59a40038e0 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 0x7f59b80af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 0x7f59b80af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34690/0 (socket says 172.21.15.27:34690) 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 -- 172.21.15.27:0/4261334914 learned_addr learned my addr 172.21.15.27:0/4261334914 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a40038e0 0x7f59b80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 -- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a40038e0 msgr2=0x7f59b80aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a40038e0 0x7f59b80aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b67fc700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b81448f0 0x7f59b81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 -- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b81448f0 msgr2=0x7f59b81547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b81448f0 0x7f59b81547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.588+0000 7f59b77fe700 1 -- 172.21.15.27:0/4261334914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80adf20 con 0x7f59b8154ca0 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.589+0000 7f59b77fe700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 0x7f59b80af7c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f59a80094d0 tx=0x7f59a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.589+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800e040 con 0x7f59b8154ca0 2023-05-17T14:54:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.589+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a800f040 con 0x7f59b8154ca0 2023-05-17T14:54:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.589+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80ae200 con 0x7f59b8154ca0 2023-05-17T14:54:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.589+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800fe50 con 0x7f59b8154ca0 2023-05-17T14:54:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.589+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b80ae7c0 con 0x7f59b8154ca0 2023-05-17T14:54:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.590+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80ae9b0 con 0x7f59b8154ca0 2023-05-17T14:54:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.590+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f59a8015660 con 0x7f59b8154ca0 2023-05-17T14:54:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.590+0000 7f59aeffd700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f599805ed90 0x7f5998061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.590+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f59a807a7c0 con 0x7f59b8154ca0 2023-05-17T14:54:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.590+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f599805ed90 0x7f5998061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.591+0000 7f59b6ffd700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f599805ed90 0x7f5998061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f59b000c1e0 tx=0x7f59b0015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.595+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59a804bd00 con 0x7f59b8154ca0 2023-05-17T14:54:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.767+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59b806bdf0 con 0x7f59b8154ca0 2023-05-17T14:54:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.768+0000 7f59aeffd700 1 -- 172.21.15.27:0/4261334914 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59a804f320 con 0x7f59b8154ca0 2023-05-17T14:54:20.772 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f599805ed90 msgr2=0x7f5998061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f599805ed90 0x7f5998061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f59b000c1e0 tx=0x7f59b0015000).stop 2023-05-17T14:54:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 msgr2=0x7f59b80af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 0x7f59b80af7c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f59a80094d0 tx=0x7f59a800b040).stop 2023-05-17T14:54:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 shutdown_connections 2023-05-17T14:54:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f599805ed90 0x7f5998061250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b8154ca0 0x7f59b80af7c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a40038e0 0x7f59b80aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 --2- 172.21.15.27:0/4261334914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b81448f0 0x7f59b81547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 >> 172.21.15.27:0/4261334914 conn(0x7f59b80cb7f0 msgr2=0x7f59b80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 shutdown_connections 2023-05-17T14:54:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.770+0000 7f59bd4c4700 1 -- 172.21.15.27:0/4261334914 wait complete. 2023-05-17T14:54:20.786 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:20.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.897+0000 7ff5a6436700 1 Processor -- start 2023-05-17T14:54:20.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.897+0000 7ff5a6436700 1 -- start start 2023-05-17T14:54:20.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.898+0000 7ff5a6436700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5a00c5f30 0x7ff5a00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.898+0000 7ff5a6436700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a0158880 0x7ff5a0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.898+0000 7ff5a6436700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00bfcd0 con 0x7ff5a01541c0 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.898+0000 7ff5a6436700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a00c0290 con 0x7ff5a00c5f30 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.898+0000 7ff5a6436700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00aa1a0 con 0x7ff5a0158880 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5a00c5f30 0x7ff5a00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a0158880 0x7ff5a0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5a00c5f30 0x7ff5a00c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:52624/0 (socket says 172.21.15.27:52624) 2023-05-17T14:54:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 -- 172.21.15.27:0/1841134868 learned_addr learned my addr 172.21.15.27:0/1841134868 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 -- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a0158880 msgr2=0x7ff5a0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 --2- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a0158880 0x7ff5a0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 -- 172.21.15.27:0/1841134868 >> v1:172.21.15.40:6789/0 conn(0x7ff5a01541c0 legacy=0x7ff5a00c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 -- 172.21.15.27:0/1841134868 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00aa480 con 0x7ff5a00c5f30 2023-05-17T14:54:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59effd700 1 -- 172.21.15.27:0/1841134868 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642808954 0 0) 0x7ff5a00bfcd0 con 0x7ff5a01541c0 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59ffff700 1 --2- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00c5f30 0x7ff5a00c6310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff590006fd0 tx=0x7ff5900090f0).ready entity=mon.1 client_cookie=410e3970158233b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59effd700 1 -- 172.21.15.27:0/1841134868 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000b580 con 0x7ff5a00c5f30 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59effd700 1 -- 172.21.15.27:0/1841134868 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000b6e0 con 0x7ff5a00c5f30 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.899+0000 7ff59effd700 1 -- 172.21.15.27:0/1841134868 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000ba60 con 0x7ff5a00c5f30 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 -- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00c5f30 msgr2=0x7ff5a00c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 --2- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00c5f30 0x7ff5a00c6310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff590006fd0 tx=0x7ff5900090f0).stop 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 -- 172.21.15.27:0/1841134868 shutdown_connections 2023-05-17T14:54:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 --2- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00c5f30 0x7ff5a00c6310 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 --2- 172.21.15.27:0/1841134868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a0158880 0x7ff5a0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 -- 172.21.15.27:0/1841134868 >> 172.21.15.27:0/1841134868 conn(0x7ff5a0069e70 msgr2=0x7ff5a005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 -- 172.21.15.27:0/1841134868 shutdown_connections 2023-05-17T14:54:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.900+0000 7ff5a6436700 1 -- 172.21.15.27:0/1841134868 wait complete. 2023-05-17T14:54:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.901+0000 7ff5a6436700 1 Processor -- start 2023-05-17T14:54:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.901+0000 7ff5a6436700 1 -- start start 2023-05-17T14:54:20.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a6436700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a00c5f30 0x7ff5a014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a6436700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 0x7ff5a00c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a6436700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a0158880 0x7ff5a01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a6436700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a014d130 con 0x7ff5a01541c0 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a6436700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0158420 con 0x7ff5a0158880 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a6436700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00c4b70 con 0x7ff5a00c5f30 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 0x7ff5a00c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 0x7ff5a00c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34700/0 (socket says 172.21.15.27:34700) 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 -- 172.21.15.27:0/3400748129 learned_addr learned my addr 172.21.15.27:0/3400748129 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59ffff700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a00c5f30 0x7ff5a014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff5a49d3700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a0158880 0x7ff5a01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 -- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a00c5f30 msgr2=0x7ff5a014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a00c5f30 0x7ff5a014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 -- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a0158880 msgr2=0x7ff5a01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a0158880 0x7ff5a01500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.902+0000 7ff59f7fe700 1 -- 172.21.15.27:0/3400748129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009370 con 0x7ff5a01541c0 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.903+0000 7ff59f7fe700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 0x7ff5a00c5000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7ff58800e900 tx=0x7ff588009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.903+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800c640 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.903+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58800c7a0 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.903+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0150c20 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.903+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800cb20 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.903+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a00c4800 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.904+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a00c4ce0 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.904+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff588022070 con 0x7ff5a01541c0 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.904+0000 7ff597fff700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff58005ed60 0x7ff580061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:20.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.905+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff588079ee0 con 0x7ff5a01541c0 2023-05-17T14:54:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.905+0000 7ff59ffff700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff58005ed60 0x7ff580061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.905+0000 7ff59ffff700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff58005ed60 0x7ff580061220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff590009fd0 tx=0x7ff590017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:20.909+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff58804b480 con 0x7ff5a01541c0 2023-05-17T14:54:21.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.086+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a01509c0 con 0x7ff5a01541c0 2023-05-17T14:54:21.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.087+0000 7ff597fff700 1 -- 172.21.15.27:0/3400748129 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7ff588016020 con 0x7ff5a01541c0 2023-05-17T14:54:21.091 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:21.091 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff58005ed60 msgr2=0x7ff580061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff58005ed60 0x7ff580061220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff590009fd0 tx=0x7ff590017000).stop 2023-05-17T14:54:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 msgr2=0x7ff5a00c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 0x7ff5a00c5000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7ff58800e900 tx=0x7ff588009060).stop 2023-05-17T14:54:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 shutdown_connections 2023-05-17T14:54:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff58005ed60 0x7ff580061220 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a0158880 0x7ff5a01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a00c5f30 0x7ff5a014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 --2- 172.21.15.27:0/3400748129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5a01541c0 0x7ff5a00c5000 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 >> 172.21.15.27:0/3400748129 conn(0x7ff5a0069e70 msgr2=0x7ff5a00af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:21.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 shutdown_connections 2023-05-17T14:54:21.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.089+0000 7ff5a6436700 1 -- 172.21.15.27:0/3400748129 wait complete. 2023-05-17T14:54:21.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:21.105 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.220+0000 7fde9eb31700 1 Processor -- start 2023-05-17T14:54:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.220+0000 7fde9eb31700 1 -- start start 2023-05-17T14:54:21.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9eb31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde981543d0 0x7fde980c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9eb31700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde98158790 con 0x7fde98069410 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9eb31700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980c6570 con 0x7fde980c60f0 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9eb31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c1c50 con 0x7fde981543d0 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9d0ce700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fde98069410 0x7fde980bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34272/0 (socket says 172.21.15.27:34272) 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9d0ce700 1 -- 172.21.15.27:0/2805733339 learned_addr learned my addr 172.21.15.27:0/2805733339 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9c8cd700 1 --2- 172.21.15.27:0/2805733339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde981543d0 0x7fde980c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537876645 0 0) 0x7fde98158790 con 0x7fde98069410 2023-05-17T14:54:21.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde880033f0 con 0x7fde98069410 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569192463 0 0) 0x7fde980c6570 con 0x7fde980c60f0 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde98158790 con 0x7fde980c60f0 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9c8cd700 1 -- 172.21.15.27:0/2805733339 >> v1:172.21.15.40:6789/0 conn(0x7fde980c60f0 legacy=0x7fde98068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9c8cd700 1 -- 172.21.15.27:0/2805733339 >> v1:172.21.15.27:6789/0 conn(0x7fde98069410 legacy=0x7fde980bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9c8cd700 1 -- 172.21.15.27:0/2805733339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98157e60 con 0x7fde981543d0 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.221+0000 7fde9c8cd700 1 --2- 172.21.15.27:0/2805733339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde981543d0 0x7fde980c5c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fde8c009790 tx=0x7fde8c009060).ready entity=mon.2 client_cookie=4d870a47034ca3a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00f510 con 0x7fde981543d0 2023-05-17T14:54:21.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c00f670 con 0x7fde981543d0 2023-05-17T14:54:21.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde977fe700 1 -- 172.21.15.27:0/2805733339 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00f9f0 con 0x7fde981543d0 2023-05-17T14:54:21.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 -- 172.21.15.27:0/2805733339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde981543d0 msgr2=0x7fde980c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 --2- 172.21.15.27:0/2805733339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde981543d0 0x7fde980c5c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fde8c009790 tx=0x7fde8c009060).stop 2023-05-17T14:54:21.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 -- 172.21.15.27:0/2805733339 shutdown_connections 2023-05-17T14:54:21.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 --2- 172.21.15.27:0/2805733339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde981543d0 0x7fde980c5c00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 -- 172.21.15.27:0/2805733339 >> 172.21.15.27:0/2805733339 conn(0x7fde980cb7f0 msgr2=0x7fde980c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:21.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 -- 172.21.15.27:0/2805733339 shutdown_connections 2023-05-17T14:54:21.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.222+0000 7fde9eb31700 1 -- 172.21.15.27:0/2805733339 wait complete. 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.223+0000 7fde9eb31700 1 Processor -- start 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 -- start start 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde98069410 0x7fde98147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 0x7fde980c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde981543d0 0x7fde980c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c42e0 con 0x7fde980c60f0 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980ae2e0 con 0x7fde981543d0 2023-05-17T14:54:21.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde9eb31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980adcd0 con 0x7fde98069410 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde97fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 0x7fde980c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde97fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 0x7fde980c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34714/0 (socket says 172.21.15.27:34714) 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.224+0000 7fde97fff700 1 -- 172.21.15.27:0/1210319227 learned_addr learned my addr 172.21.15.27:0/1210319227 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde9c8cd700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde98069410 0x7fde98147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde9d0ce700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde981543d0 0x7fde980c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde97fff700 1 -- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde98069410 msgr2=0x7fde98147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde97fff700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde98069410 0x7fde98147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde97fff700 1 -- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde981543d0 msgr2=0x7fde980c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde97fff700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde981543d0 0x7fde980c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde97fff700 1 -- 172.21.15.27:0/1210319227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0092a0 con 0x7fde980c60f0 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde97fff700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 0x7fde980c3900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fde8400c490 tx=0x7fde84007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400f470 con 0x7fde980c60f0 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400f5d0 con 0x7fde980c60f0 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980c2d90 con 0x7fde980c60f0 2023-05-17T14:54:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400f990 con 0x7fde980c60f0 2023-05-17T14:54:21.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.225+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde980adf70 con 0x7fde980c60f0 2023-05-17T14:54:21.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.226+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9806bdf0 con 0x7fde980c60f0 2023-05-17T14:54:21.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.226+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fde84019030 con 0x7fde980c60f0 2023-05-17T14:54:21.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.227+0000 7fde94ff9700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fde7c05ed90 0x7fde7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.227+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fde84079030 con 0x7fde980c60f0 2023-05-17T14:54:21.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.227+0000 7fde9c8cd700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fde7c05ed90 0x7fde7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.227+0000 7fde9c8cd700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fde7c05ed90 0x7fde7c061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fde8c009fd0 tx=0x7fde8c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.231+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde8404a5d0 con 0x7fde980c60f0 2023-05-17T14:54:21.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.402+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fde98158140 con 0x7fde980c60f0 2023-05-17T14:54:21.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.403+0000 7fde94ff9700 1 -- 172.21.15.27:0/1210319227 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fde84007d80 con 0x7fde980c60f0 2023-05-17T14:54:21.407 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:21.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.404+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fde7c05ed90 msgr2=0x7fde7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.404+0000 7fde9eb31700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fde7c05ed90 0x7fde7c061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fde8c009fd0 tx=0x7fde8c017000).stop 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.404+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 msgr2=0x7fde980c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.404+0000 7fde9eb31700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 0x7fde980c3900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fde8400c490 tx=0x7fde84007c60).stop 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 shutdown_connections 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fde7c05ed90 0x7fde7c061250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde981543d0 0x7fde980c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde98069410 0x7fde98147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 --2- 172.21.15.27:0/1210319227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde980c60f0 0x7fde980c3900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 >> 172.21.15.27:0/1210319227 conn(0x7fde980cb7f0 msgr2=0x7fde98068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:21.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 shutdown_connections 2023-05-17T14:54:21.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.405+0000 7fde9eb31700 1 -- 172.21.15.27:0/1210319227 wait complete. 2023-05-17T14:54:21.420 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:21.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.535+0000 7f4e47ac3700 1 Processor -- start 2023-05-17T14:54:21.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.535+0000 7f4e47ac3700 1 -- start start 2023-05-17T14:54:21.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e47ac3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e401543d0 0x7f4e400c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e47ac3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4e40069410 0x7f4e400bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e47ac3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e40158790 con 0x7f4e400c60f0 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e47ac3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e400c1c50 con 0x7f4e40069410 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e47ac3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e400c6570 con 0x7f4e401543d0 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4e40069410 0x7f4e400bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4e40069410 0x7f4e400bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34724/0 (socket says 172.21.15.27:34724) 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 -- 172.21.15.27:0/982976982 learned_addr learned my addr 172.21.15.27:0/982976982 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e4585f700 1 --2- 172.21.15.27:0/982976982 >> v2:172.21.15.40:3300/0 conn(0x7f4e401543d0 0x7f4e400c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 -- 172.21.15.27:0/982976982 >> v2:172.21.15.40:3300/0 conn(0x7f4e401543d0 msgr2=0x7f4e400c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 --2- 172.21.15.27:0/982976982 >> v2:172.21.15.40:3300/0 conn(0x7f4e401543d0 0x7f4e400c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 -- 172.21.15.27:0/982976982 >> v1:172.21.15.40:6789/0 conn(0x7f4e400c60f0 legacy=0x7f4e40068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 -- 172.21.15.27:0/982976982 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40157e60 con 0x7f4e40069410 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e4585f700 1 --2- 172.21.15.27:0/982976982 >> v2:172.21.15.40:3300/0 conn(0x7f4e401543d0 0x7f4e400c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.536+0000 7f4e46060700 1 --2- 172.21.15.27:0/982976982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e40069410 0x7f4e400bfc80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4e40155970 tx=0x7f4e300090f0).ready entity=mon.0 client_cookie=322240e8851e736e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e4485d700 1 -- 172.21.15.27:0/982976982 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000b600 con 0x7f4e40069410 2023-05-17T14:54:21.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e4485d700 1 -- 172.21.15.27:0/982976982 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000b760 con 0x7f4e40069410 2023-05-17T14:54:21.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e4485d700 1 -- 172.21.15.27:0/982976982 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000bae0 con 0x7f4e40069410 2023-05-17T14:54:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 -- 172.21.15.27:0/982976982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e40069410 msgr2=0x7f4e400bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/982976982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e40069410 0x7f4e400bfc80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4e40155970 tx=0x7f4e300090f0).stop 2023-05-17T14:54:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 -- 172.21.15.27:0/982976982 shutdown_connections 2023-05-17T14:54:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/982976982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e40069410 0x7f4e400bfc80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/982976982 >> v2:172.21.15.40:3300/0 conn(0x7f4e401543d0 0x7f4e400c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 -- 172.21.15.27:0/982976982 >> 172.21.15.27:0/982976982 conn(0x7f4e400cb7f0 msgr2=0x7f4e400c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 -- 172.21.15.27:0/982976982 shutdown_connections 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.537+0000 7f4e47ac3700 1 -- 172.21.15.27:0/982976982 wait complete. 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.538+0000 7f4e47ac3700 1 Processor -- start 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.538+0000 7f4e47ac3700 1 -- start start 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e47ac3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e40069410 0x7f4e400af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e47ac3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 0x7f4e400af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e47ac3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e401543d0 0x7f4e400c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e47ac3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c2090 con 0x7f4e400c60f0 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e47ac3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400adff0 con 0x7f4e40069410 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e47ac3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400ae2d0 con 0x7f4e401543d0 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e4505e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 0x7f4e400af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e4505e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 0x7f4e400af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34728/0 (socket says 172.21.15.27:34728) 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e4505e700 1 -- 172.21.15.27:0/2945364424 learned_addr learned my addr 172.21.15.27:0/2945364424 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:21.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e4585f700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e40069410 0x7f4e400af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.539+0000 7f4e46060700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e401543d0 0x7f4e400c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e4505e700 1 -- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e401543d0 msgr2=0x7f4e400c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e4505e700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e401543d0 0x7f4e400c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e4505e700 1 -- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e40069410 msgr2=0x7f4e400af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e4505e700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e40069410 0x7f4e400af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e4505e700 1 -- 172.21.15.27:0/2945364424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009370 con 0x7f4e400c60f0 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e46060700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e401543d0 0x7f4e400c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:21.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e4505e700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 0x7f4e400af580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4e3400c4c0 tx=0x7f4e34007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34007020 con 0x7f4e400c60f0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34001e90 con 0x7f4e400c60f0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e400ae5b0 con 0x7f4e400c60f0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340073b0 con 0x7f4e400c60f0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.540+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e400aeb70 con 0x7f4e400c60f0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.541+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e400aed60 con 0x7f4e400c60f0 2023-05-17T14:54:21.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.541+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4e34010070 con 0x7f4e400c60f0 2023-05-17T14:54:21.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.542+0000 7f4e3dffb700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4e2c05ed90 0x7f4e2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.542+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4e34079350 con 0x7f4e400c60f0 2023-05-17T14:54:21.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.542+0000 7f4e4585f700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4e2c05ed90 0x7f4e2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.542+0000 7f4e4585f700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4e2c05ed90 0x7f4e2c061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4e380076a0 tx=0x7f4e38009930).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.546+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e3404a8f0 con 0x7f4e400c60f0 2023-05-17T14:54:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.721+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4e4006bdf0 con 0x7f4e400c60f0 2023-05-17T14:54:21.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.721+0000 7f4e3dffb700 1 -- 172.21.15.27:0/2945364424 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4e3404df10 con 0x7f4e400c60f0 2023-05-17T14:54:21.726 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:21.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4e2c05ed90 msgr2=0x7f4e2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4e2c05ed90 0x7f4e2c061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4e380076a0 tx=0x7f4e38009930).stop 2023-05-17T14:54:21.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 msgr2=0x7f4e400af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 0x7f4e400af580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4e3400c4c0 tx=0x7f4e34007e00).stop 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 shutdown_connections 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4e2c05ed90 0x7f4e2c061250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e401543d0 0x7f4e400c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e40069410 0x7f4e400af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 --2- 172.21.15.27:0/2945364424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e400c60f0 0x7f4e400af580 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 >> 172.21.15.27:0/2945364424 conn(0x7f4e400cb7f0 msgr2=0x7f4e400accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:21.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 shutdown_connections 2023-05-17T14:54:21.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.723+0000 7f4e47ac3700 1 -- 172.21.15.27:0/2945364424 wait complete. 2023-05-17T14:54:21.739 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.853+0000 7f1159168700 1 Processor -- start 2023-05-17T14:54:21.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.853+0000 7f1159168700 1 -- start start 2023-05-17T14:54:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f1159168700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11541543d0 0x7f11540c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f1159168700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540c60f0 0x7f1154068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f1159168700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11540691f0 0x7f11541547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f1159168700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11540c1c50 con 0x7f11540691f0 2023-05-17T14:54:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f1159168700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154158790 con 0x7f11541543d0 2023-05-17T14:54:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f1159168700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c6570 con 0x7f11540c60f0 2023-05-17T14:54:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f115359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11540691f0 0x7f11541547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.854+0000 7f115359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11540691f0 0x7f11541547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34738/0 (socket says 172.21.15.27:34738) 2023-05-17T14:54:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 -- 172.21.15.27:0/1647730795 learned_addr learned my addr 172.21.15.27:0/1647730795 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1152d9d700 1 --2- 172.21.15.27:0/1647730795 >> v2:172.21.15.40:3300/0 conn(0x7f11541543d0 0x7f11540c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115259c700 1 --2- 172.21.15.27:0/1647730795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540c60f0 0x7f1154068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 -- 172.21.15.27:0/1647730795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540c60f0 msgr2=0x7f1154068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 --2- 172.21.15.27:0/1647730795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540c60f0 0x7f1154068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 -- 172.21.15.27:0/1647730795 >> v2:172.21.15.40:3300/0 conn(0x7f11541543d0 msgr2=0x7f11540c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 --2- 172.21.15.27:0/1647730795 >> v2:172.21.15.40:3300/0 conn(0x7f11541543d0 0x7f11540c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 -- 172.21.15.27:0/1647730795 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154157e60 con 0x7f11540691f0 2023-05-17T14:54:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1152d9d700 1 --2- 172.21.15.27:0/1647730795 >> v2:172.21.15.40:3300/0 conn(0x7f11541543d0 0x7f11540c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f115359e700 1 --2- 172.21.15.27:0/1647730795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540691f0 0x7f11541547b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f1154155970 tx=0x7f1144009840).ready entity=mon.0 client_cookie=ea1fa74edfc78c20 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1151d9b700 1 -- 172.21.15.27:0/1647730795 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400e070 con 0x7f11540691f0 2023-05-17T14:54:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1151d9b700 1 -- 172.21.15.27:0/1647730795 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400ba50 con 0x7f11540691f0 2023-05-17T14:54:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1151d9b700 1 -- 172.21.15.27:0/1647730795 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400bdd0 con 0x7f11540691f0 2023-05-17T14:54:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 -- 172.21.15.27:0/1647730795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540691f0 msgr2=0x7f11541547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 --2- 172.21.15.27:0/1647730795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540691f0 0x7f11541547b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f1154155970 tx=0x7f1144009840).stop 2023-05-17T14:54:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 -- 172.21.15.27:0/1647730795 shutdown_connections 2023-05-17T14:54:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 --2- 172.21.15.27:0/1647730795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540691f0 0x7f11541547b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 --2- 172.21.15.27:0/1647730795 >> v2:172.21.15.40:3300/0 conn(0x7f11541543d0 0x7f11540c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 --2- 172.21.15.27:0/1647730795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540c60f0 0x7f1154068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.855+0000 7f1159168700 1 -- 172.21.15.27:0/1647730795 >> 172.21.15.27:0/1647730795 conn(0x7f11540cb7f0 msgr2=0x7f11540c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.856+0000 7f1159168700 1 -- 172.21.15.27:0/1647730795 shutdown_connections 2023-05-17T14:54:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.856+0000 7f1159168700 1 -- 172.21.15.27:0/1647730795 wait complete. 2023-05-17T14:54:21.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.857+0000 7f1159168700 1 Processor -- start 2023-05-17T14:54:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.857+0000 7f1159168700 1 -- start start 2023-05-17T14:54:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.857+0000 7f1159168700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540691f0 0x7f1154163ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.857+0000 7f1159168700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 0x7f1154147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.857+0000 7f1159168700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11541543d0 0x7f11540affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.857+0000 7f1159168700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154147f80 con 0x7f11540c60f0 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f1159168700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154167710 con 0x7f11541543d0 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f1159168700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11541679f0 con 0x7f11540691f0 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 0x7f1154147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 0x7f1154147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34742/0 (socket says 172.21.15.27:34742) 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 -- 172.21.15.27:0/1531201621 learned_addr learned my addr 172.21.15.27:0/1531201621 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f1152d9d700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540691f0 0x7f1154163ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115359e700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11541543d0 0x7f11540affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 -- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540691f0 msgr2=0x7f1154163ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540691f0 0x7f1154163ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 -- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11541543d0 msgr2=0x7f11540affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11541543d0 0x7f11540affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 -- 172.21.15.27:0/1531201621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009ae0 con 0x7f11540c60f0 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115359e700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11541543d0 0x7f11540affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f1152d9d700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540691f0 0x7f1154163ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f115259c700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 0x7f1154147a90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f113c00c850 tx=0x7f113c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c010580 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c0106e0 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1154167cd0 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c010a60 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.858+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11540a9750 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.859+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1154168300 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.860+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f113c01b460 con 0x7f11540c60f0 2023-05-17T14:54:21.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.860+0000 7f114affd700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f113405ed60 0x7f1134061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.860+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f113c079bf0 con 0x7f11540c60f0 2023-05-17T14:54:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.860+0000 7f1152d9d700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f113405ed60 0x7f1134061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.860+0000 7f1152d9d700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f113405ed60 0x7f1134061220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f114c006fd0 tx=0x7f114c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:21.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:21.864+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f113c04b130 con 0x7f11540c60f0 2023-05-17T14:54:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.036+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f115406bdf0 con 0x7f11540c60f0 2023-05-17T14:54:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.037+0000 7f114affd700 1 -- 172.21.15.27:0/1531201621 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f113c04e750 con 0x7f11540c60f0 2023-05-17T14:54:22.041 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f113405ed60 msgr2=0x7f1134061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f113405ed60 0x7f1134061220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f114c006fd0 tx=0x7f114c008040).stop 2023-05-17T14:54:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 msgr2=0x7f1154147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 0x7f1154147a90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f113c00c850 tx=0x7f113c008040).stop 2023-05-17T14:54:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 shutdown_connections 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f113405ed60 0x7f1134061220 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11541543d0 0x7f11540affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11540691f0 0x7f1154163ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 --2- 172.21.15.27:0/1531201621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11540c60f0 0x7f1154147a90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 >> 172.21.15.27:0/1531201621 conn(0x7f11540cb7f0 msgr2=0x7f1154156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 shutdown_connections 2023-05-17T14:54:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.039+0000 7f1159168700 1 -- 172.21.15.27:0/1531201621 wait complete. 2023-05-17T14:54:22.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:22.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.170+0000 7f6f864d3700 1 Processor -- start 2023-05-17T14:54:22.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.170+0000 7f6f864d3700 1 -- start start 2023-05-17T14:54:22.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f864d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f801554b0 0x7f6f800c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f864d3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800bcd40 con 0x7f6f800c4290 2023-05-17T14:54:22.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f864d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800bd5e0 con 0x7f6f800bda70 2023-05-17T14:54:22.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f864d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800bdee0 con 0x7f6f801554b0 2023-05-17T14:54:22.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f854d1700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6f800c4290 0x7f6f80154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34310/0 (socket says 172.21.15.27:34310) 2023-05-17T14:54:22.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f854d1700 1 -- 172.21.15.27:0/1643180499 learned_addr learned my addr 172.21.15.27:0/1643180499 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:22.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/1643180499 >> v2:172.21.15.40:3300/0 conn(0x7f6f801554b0 0x7f6f800c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961702966 0 0) 0x7f6f800bcd40 con 0x7f6f800c4290 2023-05-17T14:54:22.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f680033f0 con 0x7f6f800c4290 2023-05-17T14:54:22.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691957678 0 0) 0x7f6f680033f0 con 0x7f6f800c4290 2023-05-17T14:54:22.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 >> v2:172.21.15.40:3300/0 conn(0x7f6f801554b0 msgr2=0x7f6f800c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 --2- 172.21.15.27:0/1643180499 >> v2:172.21.15.40:3300/0 conn(0x7f6f801554b0 0x7f6f800c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 >> v1:172.21.15.40:6789/0 conn(0x7f6f800bda70 legacy=0x7f6f80157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80158b00 con 0x7f6f800c4290 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f6f780017f0 con 0x7f6f800c4290 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 >> v1:172.21.15.27:6789/0 conn(0x7f6f800c4290 legacy=0x7f6f80154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f680038e0 0x7f6f68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f68005050 0x7f6f6800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800bdee0 con 0x7f6f68004690 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6800bfe0 con 0x7f6f68005050 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6800c1a0 con 0x7f6f680038e0 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.171+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f854d1700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f680038e0 0x7f6f68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f85cd2700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f68005050 0x7f6f6800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f84cd0700 1 -- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f680038e0 msgr2=0x7f6f68003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f680038e0 0x7f6f68003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f84cd0700 1 -- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f68005050 msgr2=0x7f6f6800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f68005050 0x7f6f6800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f84cd0700 1 -- 172.21.15.27:0/1643180499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680033f0 con 0x7f6f68004690 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f85cd2700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f68005050 0x7f6f6800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:22.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f85cd2700 1 -- 172.21.15.27:0/1643180499 reap_dead start 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f68004b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6f74006d80 tx=0x7f6f74009060).ready entity=mon.0 client_cookie=8a62ea1a1e655302 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74009e90 con 0x7f6f68004690 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7400e640 con 0x7f6f68004690 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f7ffff700 1 -- 172.21.15.27:0/1643180499 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400ea00 con 0x7f6f68004690 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f864d3700 1 -- 172.21.15.27:0/1643180499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 msgr2=0x7f6f68004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.172+0000 7f6f864d3700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f68004b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6f74006d80 tx=0x7f6f74009060).stop 2023-05-17T14:54:22.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.173+0000 7f6f864d3700 1 -- 172.21.15.27:0/1643180499 shutdown_connections 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.173+0000 7f6f864d3700 1 --2- 172.21.15.27:0/1643180499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f68004b10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.173+0000 7f6f864d3700 1 -- 172.21.15.27:0/1643180499 >> 172.21.15.27:0/1643180499 conn(0x7f6f80067cb0 msgr2=0x7f6f800680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.173+0000 7f6f864d3700 1 -- 172.21.15.27:0/1643180499 shutdown_connections 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.173+0000 7f6f864d3700 1 -- 172.21.15.27:0/1643180499 wait complete. 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.174+0000 7f6f864d3700 1 Processor -- start 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.174+0000 7f6f864d3700 1 -- start start 2023-05-17T14:54:22.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f800a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f80157d60 0x7f6f801581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f800a8f50 0x7f6f800a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800aa340 con 0x7f6f68004690 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f801586d0 con 0x7f6f80157d60 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800a66b0 con 0x7f6f800a8f50 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f800a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f800a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34760/0 (socket says 172.21.15.27:34760) 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 -- 172.21.15.27:0/3946771165 learned_addr learned my addr 172.21.15.27:0/3946771165 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f80157d60 0x7f6f801581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f85cd2700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f800a8f50 0x7f6f800a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 -- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f800a8f50 msgr2=0x7f6f800a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f800a8f50 0x7f6f800a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 -- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f80157d60 msgr2=0x7f6f801581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f80157d60 0x7f6f801581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 -- 172.21.15.27:0/3946771165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800a9d80 con 0x7f6f68004690 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f80157d60 0x7f6f801581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f85cd2700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f800a8f50 0x7f6f800a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f854d1700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f800a61c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6f78007740 tx=0x7f6f78002100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800f9d0 con 0x7f6f68004690 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800fb30 con 0x7f6f68004690 2023-05-17T14:54:22.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800aa060 con 0x7f6f68004690 2023-05-17T14:54:22.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800feb0 con 0x7f6f68004690 2023-05-17T14:54:22.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.175+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f800bec20 con 0x7f6f68004690 2023-05-17T14:54:22.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.176+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f800bee40 con 0x7f6f68004690 2023-05-17T14:54:22.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.177+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6f7801b030 con 0x7f6f68004690 2023-05-17T14:54:22.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.177+0000 7f6f7d7fa700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f6c05ed90 0x7f6f6c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.177+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6f78079720 con 0x7f6f68004690 2023-05-17T14:54:22.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.177+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f6c05ed90 0x7f6f6c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.177+0000 7f6f84cd0700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f6c05ed90 0x7f6f6c061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6f800c7c30 tx=0x7f6f7401a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:22.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.181+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f7804ad70 con 0x7f6f68004690 2023-05-17T14:54:22.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.355+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f800bcf90 con 0x7f6f68004690 2023-05-17T14:54:22.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.356+0000 7f6f7d7fa700 1 -- 172.21.15.27:0/3946771165 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f78019020 con 0x7f6f68004690 2023-05-17T14:54:22.360 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:22.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f6c05ed90 msgr2=0x7f6f6c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f6c05ed90 0x7f6f6c061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6f800c7c30 tx=0x7f6f7401a000).stop 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 msgr2=0x7f6f800a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f800a61c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6f78007740 tx=0x7f6f78002100).stop 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 shutdown_connections 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f6c05ed90 0x7f6f6c061250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f800a8f50 0x7f6f800a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f68004690 0x7f6f800a61c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 --2- 172.21.15.27:0/3946771165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f80157d60 0x7f6f801581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 >> 172.21.15.27:0/3946771165 conn(0x7f6f80067cb0 msgr2=0x7f6f8014d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.357+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 shutdown_connections 2023-05-17T14:54:22.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.358+0000 7f6f864d3700 1 -- 172.21.15.27:0/3946771165 wait complete. 2023-05-17T14:54:22.382 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-05-17T14:54:22.382 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T14:54:22.383 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-05-17T14:54:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.495+0000 7faf0a5ec700 1 Processor -- start 2023-05-17T14:54:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.495+0000 7faf0a5ec700 1 -- start start 2023-05-17T14:54:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf0a5ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 0x7faf041543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf0a5ec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040bfcd0 con 0x7faf040c5f30 2023-05-17T14:54:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf0a5ec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040c0290 con 0x7faf040c6310 2023-05-17T14:54:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf0a5ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040aa1a0 con 0x7faf040c1730 2023-05-17T14:54:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf03fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faf040c5f30 0x7faf04158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34330/0 (socket says 172.21.15.27:34330) 2023-05-17T14:54:22.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf03fff700 1 -- 172.21.15.27:0/77345909 learned_addr learned my addr 172.21.15.27:0/77345909 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf08b89700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 0x7faf041543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651244752 0 0) 0x7faf040bfcd0 con 0x7faf040c5f30 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef00033f0 con 0x7faf040c5f30 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2705690531 0 0) 0x7faef00033f0 con 0x7faf040c5f30 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 msgr2=0x7faf041543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 0x7faf041543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 >> v1:172.21.15.40:6789/0 conn(0x7faf040c6310 legacy=0x7faf04153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040aa480 con 0x7faf040c5f30 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7faeec001470 con 0x7faf040c5f30 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 >> v1:172.21.15.27:6789/0 conn(0x7faf040c5f30 legacy=0x7faf04158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 0x7faef0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faef0003e40 0x7faef0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faef0004b80 0x7faef0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040aa1a0 con 0x7faef0004b80 2023-05-17T14:54:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef000b990 con 0x7faef0003e40 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.496+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef000bb50 con 0x7faf040c1730 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faef0004b80 0x7faef0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf03fff700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 0x7faef0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf037fe700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faef0003e40 0x7faef0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 -- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 msgr2=0x7faef0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf040c1730 0x7faef0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 -- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faef0003e40 msgr2=0x7faef0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:22.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faef0003e40 0x7faef0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 -- 172.21.15.27:0/77345909 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef00033f0 con 0x7faef0004b80 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf08b89700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faef0004b80 0x7faef0005000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7faf040c1bc0 tx=0x7faefc00b040).ready entity=mon.0 client_cookie=b0870e51a3609a52 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc009ac0 con 0x7faef0004b80 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc00f040 con 0x7faef0004b80 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.497+0000 7faf02ffd700 1 -- 172.21.15.27:0/77345909 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00eca0 con 0x7faef0004b80 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf0a5ec700 1 -- 172.21.15.27:0/77345909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faef0004b80 msgr2=0x7faef0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/77345909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faef0004b80 0x7faef0005000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7faf040c1bc0 tx=0x7faefc00b040).stop 2023-05-17T14:54:22.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf08b89700 1 -- 172.21.15.27:0/77345909 reap_dead start 2023-05-17T14:54:22.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf0a5ec700 1 -- 172.21.15.27:0/77345909 shutdown_connections 2023-05-17T14:54:22.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf0a5ec700 1 -- 172.21.15.27:0/77345909 >> 172.21.15.27:0/77345909 conn(0x7faf04069e70 msgr2=0x7faf0405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:22.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf0a5ec700 1 -- 172.21.15.27:0/77345909 shutdown_connections 2023-05-17T14:54:22.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.498+0000 7faf0a5ec700 1 -- 172.21.15.27:0/77345909 wait complete. 2023-05-17T14:54:22.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.499+0000 7faf0a5ec700 1 Processor -- start 2023-05-17T14:54:22.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.499+0000 7faf0a5ec700 1 -- start start 2023-05-17T14:54:22.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf041640c0 0x7faf041644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf04165b20 0x7faf040c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 0x7faf040af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c55f0 con 0x7faf040af170 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040afae0 con 0x7faf04165b20 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c47f0 con 0x7faf041640c0 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 0x7faf040af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 0x7faf040af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34784/0 (socket says 172.21.15.27:34784) 2023-05-17T14:54:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 -- 172.21.15.27:0/4154005402 learned_addr learned my addr 172.21.15.27:0/4154005402 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf03fff700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf041640c0 0x7faf041644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf037fe700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf04165b20 0x7faf040c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 -- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf041640c0 msgr2=0x7faf041644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf041640c0 0x7faf041644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 -- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf04165b20 msgr2=0x7faf040c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf04165b20 0x7faf040c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:22.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 -- 172.21.15.27:0/4154005402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040c4a70 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf08b89700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 0x7faf040af5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7faefc00e7d0 tx=0x7faefc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc021030 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc009ac0 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040c4d50 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc013db0 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.500+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040c5310 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.501+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0405f4a0 con 0x7faf040af170 2023-05-17T14:54:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.502+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faefc01d610 con 0x7faf040af170 2023-05-17T14:54:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.502+0000 7faefbfff700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faee405ed90 0x7faee4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.502+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faefc022070 con 0x7faf040af170 2023-05-17T14:54:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.502+0000 7faf03fff700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faee405ed90 0x7faee4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.502+0000 7faf03fff700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faee405ed90 0x7faee4061250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faf0414f540 tx=0x7faeec001e50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.506+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faefc04cd90 con 0x7faf040af170 2023-05-17T14:54:22.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:22.745+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7faf0406bdf0 con 0x7faf040af170 2023-05-17T14:54:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.654+0000 7faefbfff700 1 -- 172.21.15.27:0/4154005402 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7faefc0503b0 con 0x7faf040af170 2023-05-17T14:54:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faee405ed90 msgr2=0x7faee4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faee405ed90 0x7faee4061250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faf0414f540 tx=0x7faeec001e50).stop 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 msgr2=0x7faf040af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 0x7faf040af5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7faefc00e7d0 tx=0x7faefc01a000).stop 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 shutdown_connections 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faee405ed90 0x7faee4061250 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf040af170 0x7faf040af5f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf041640c0 0x7faf041644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 --2- 172.21.15.27:0/4154005402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf04165b20 0x7faf040c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 >> 172.21.15.27:0/4154005402 conn(0x7faf04069e70 msgr2=0x7faf040cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.656+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 shutdown_connections 2023-05-17T14:54:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.657+0000 7faf0a5ec700 1 -- 172.21.15.27:0/4154005402 wait complete. 2023-05-17T14:54:23.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T14:54:23.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.797+0000 7f1b09b55700 1 Processor -- start 2023-05-17T14:54:23.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.797+0000 7f1b09b55700 1 -- start start 2023-05-17T14:54:23.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b09b55700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b04069410 0x7f1b0415f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b09b55700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b040c0c90 con 0x7f1b040c6310 2023-05-17T14:54:23.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b09b55700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b04158790 con 0x7f1b041543d0 2023-05-17T14:54:23.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b09b55700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b040c1c50 con 0x7f1b04069410 2023-05-17T14:54:23.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b02ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1b040c6310 0x7f1b04068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34352/0 (socket says 172.21.15.27:34352) 2023-05-17T14:54:23.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b02ffd700 1 -- 172.21.15.27:0/2265398868 learned_addr learned my addr 172.21.15.27:0/2265398868 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:23.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040962987 0 0) 0x7f1b040c0c90 con 0x7f1b040c6310 2023-05-17T14:54:23.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aec0033f0 con 0x7f1b040c6310 2023-05-17T14:54:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b03fff700 1 --2- 172.21.15.27:0/2265398868 >> v2:172.21.15.40:3300/0 conn(0x7f1b04069410 0x7f1b0415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908172826 0 0) 0x7f1aec0033f0 con 0x7f1b040c6310 2023-05-17T14:54:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 >> v2:172.21.15.40:3300/0 conn(0x7f1b04069410 msgr2=0x7f1b0415f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 --2- 172.21.15.27:0/2265398868 >> v2:172.21.15.40:3300/0 conn(0x7f1b04069410 0x7f1b0415f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 >> v1:172.21.15.40:6789/0 conn(0x7f1b041543d0 legacy=0x7f1b040c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04157e60 con 0x7f1b040c6310 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f1af4001470 con 0x7f1b040c6310 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 >> v1:172.21.15.27:6789/0 conn(0x7f1b040c6310 legacy=0x7f1b04068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aec0038e0 0x7f1aec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1aec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1aec005050 0x7f1aec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec00bf00 con 0x7f1aec004690 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec00c070 con 0x7f1aec0038e0 2023-05-17T14:54:23.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec00c230 con 0x7f1aec005050 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b03fff700 1 --2- 172.21.15.27:0/2265398868 >> v2:172.21.15.40:3300/0 conn(0x7f1b04069410 0x7f1b0415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.798+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1aec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b037fe700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aec0038e0 0x7f1aec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b03fff700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1aec005050 0x7f1aec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b02ffd700 1 -- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1aec005050 msgr2=0x7f1aec00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1aec005050 0x7f1aec00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b02ffd700 1 -- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aec0038e0 msgr2=0x7f1aec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aec0038e0 0x7f1aec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b02ffd700 1 -- 172.21.15.27:0/2265398868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0033f0 con 0x7f1aec004690 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b037fe700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aec0038e0 0x7f1aec003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b03fff700 1 -- 172.21.15.27:0/2265398868 reap_dead start 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1aec004b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f1af400c160 tx=0x7f1af4001e50).ready entity=mon.0 client_cookie=158a5d8b87ddc492 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4007a20 con 0x7f1aec004690 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af400ca90 con 0x7f1aec004690 2023-05-17T14:54:23.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b027fc700 1 -- 172.21.15.27:0/2265398868 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400ce30 con 0x7f1aec004690 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b09b55700 1 -- 172.21.15.27:0/2265398868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 msgr2=0x7f1aec004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.799+0000 7f1b09b55700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1aec004b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f1af400c160 tx=0x7f1af4001e50).stop 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.800+0000 7f1b09b55700 1 -- 172.21.15.27:0/2265398868 shutdown_connections 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.800+0000 7f1b09b55700 1 --2- 172.21.15.27:0/2265398868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1aec004b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.800+0000 7f1b09b55700 1 -- 172.21.15.27:0/2265398868 >> 172.21.15.27:0/2265398868 conn(0x7f1b040cb7f0 msgr2=0x7f1b040c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.800+0000 7f1b09b55700 1 -- 172.21.15.27:0/2265398868 shutdown_connections 2023-05-17T14:54:23.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.800+0000 7f1b09b55700 1 -- 172.21.15.27:0/2265398868 wait complete. 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.801+0000 7f1b09b55700 1 Processor -- start 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.801+0000 7f1b09b55700 1 -- start start 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1b04147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b04167b40 0x7f1b04167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b041547b0 0x7f1b04154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040c2410 con 0x7f1aec004690 2023-05-17T14:54:23.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04155120 con 0x7f1b04167b40 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b041454c0 con 0x7f1b041547b0 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1b04147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1b04147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34800/0 (socket says 172.21.15.27:34800) 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 -- 172.21.15.27:0/3609009038 learned_addr learned my addr 172.21.15.27:0/3609009038 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b03fff700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b041547b0 0x7f1b04154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b04167b40 0x7f1b04167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 -- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b041547b0 msgr2=0x7f1b04154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b041547b0 0x7f1b04154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 -- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b04167b40 msgr2=0x7f1b04167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b04167b40 0x7f1b04167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 -- 172.21.15.27:0/3609009038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04168670 con 0x7f1aec004690 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b037fe700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1b04147ec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f1af800e510 tx=0x7f1af8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8010450 con 0x7f1aec004690 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af80105b0 con 0x7f1aec004690 2023-05-17T14:54:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04168950 con 0x7f1aec004690 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8010930 con 0x7f1aec004690 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.802+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b040c20a0 con 0x7f1aec004690 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.803+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0406bdf0 con 0x7f1aec004690 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.804+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1af8010ce0 con 0x7f1aec004690 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.804+0000 7f1aeb7fe700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1af005ed90 0x7f1af0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.804+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1af8079ca0 con 0x7f1aec004690 2023-05-17T14:54:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.804+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1af005ed90 0x7f1af0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.804+0000 7f1b02ffd700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1af005ed90 0x7f1af0061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1b041574c0 tx=0x7f1af4015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.808+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1af807e070 con 0x7f1aec004690 2023-05-17T14:54:23.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.983+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1b04158140 con 0x7f1aec004690 2023-05-17T14:54:23.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.987+0000 7f1aeb7fe700 1 -- 172.21.15.27:0/3609009038 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1af804b1e0 con 0x7f1aec004690 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.988+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1af005ed90 msgr2=0x7f1af0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.988+0000 7f1b09b55700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1af005ed90 0x7f1af0061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1b041574c0 tx=0x7f1af4015000).stop 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.988+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 msgr2=0x7f1b04147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.988+0000 7f1b09b55700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1b04147ec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f1af800e510 tx=0x7f1af8009040).stop 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 shutdown_connections 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1af005ed90 0x7f1af0061250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b041547b0 0x7f1b04154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aec004690 0x7f1b04147ec0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 --2- 172.21.15.27:0/3609009038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b04167b40 0x7f1b04167fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 >> 172.21.15.27:0/3609009038 conn(0x7f1b040cb7f0 msgr2=0x7f1b040ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 shutdown_connections 2023-05-17T14:54:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:23.989+0000 7f1b09b55700 1 -- 172.21.15.27:0/3609009038 wait complete. 2023-05-17T14:54:24.004 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T14:54:24.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T14:54:24.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T14:54:24.068 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T14:54:24.069 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T14:54:24.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:24.069 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-05-17T14:54:24.104 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:54:24.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:24.105 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T14:54:24.159 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-05-17T14:54:24.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:24.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-05-17T14:54:24.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:54:24.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:24.199 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-17T14:54:24.255 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-05-17T14:54:24.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:24.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-05-17T14:54:24.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T14:54:24.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:24.297 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-17T14:54:24.351 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-05-17T14:54:24.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:24.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-05-17T14:54:24.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T14:54:24.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:24.389 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-17T14:54:24.445 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T14:54:24.446 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:24.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.560+0000 7fe8a5c72700 1 Processor -- start 2023-05-17T14:54:24.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.560+0000 7fe8a5c72700 1 -- start start 2023-05-17T14:54:24.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe8a5c72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8a00c6310 0x7fe8a0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe8a5c72700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00bfcd0 con 0x7fe8a00c5f30 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe8a5c72700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00c0290 con 0x7fe8a01541c0 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe8a5c72700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00aa1a0 con 0x7fe8a00c6310 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe89f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe8a00c5f30 0x7fe8a0158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34370/0 (socket says 172.21.15.27:34370) 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe89f7fe700 1 -- 172.21.15.27:0/2136795709 learned_addr learned my addr 172.21.15.27:0/2136795709 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe89effd700 1 --2- 172.21.15.27:0/2136795709 >> v2:172.21.15.40:3300/0 conn(0x7fe8a00c6310 0x7fe8a0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769201088 0 0) 0x7fe8a00bfcd0 con 0x7fe8a00c5f30 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.561+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8880033f0 con 0x7fe8a00c5f30 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2370679743 0 0) 0x7fe8880033f0 con 0x7fe8a00c5f30 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 >> v2:172.21.15.40:3300/0 conn(0x7fe8a00c6310 msgr2=0x7fe8a0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 --2- 172.21.15.27:0/2136795709 >> v2:172.21.15.40:3300/0 conn(0x7fe8a00c6310 0x7fe8a0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 >> v1:172.21.15.40:6789/0 conn(0x7fe8a01541c0 legacy=0x7fe8a00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00aa480 con 0x7fe8a00c5f30 2023-05-17T14:54:24.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fe890001470 con 0x7fe8a00c5f30 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 >> v1:172.21.15.27:6789/0 conn(0x7fe8a00c5f30 legacy=0x7fe8a0158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8880038e0 0x7fe888003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe888004690 0x7fe888004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888005000 0x7fe88800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00aa1a0 con 0x7fe888004690 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88800bf60 con 0x7fe8880038e0 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88800c0f0 con 0x7fe888005000 2023-05-17T14:54:24.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe888004690 0x7fe888004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89f7fe700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8880038e0 0x7fe888003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89ffff700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888005000 0x7fe88800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 -- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888005000 msgr2=0x7fe88800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888005000 0x7fe88800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 -- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8880038e0 msgr2=0x7fe888003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8880038e0 0x7fe888003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 -- 172.21.15.27:0/2136795709 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880033f0 con 0x7fe888004690 2023-05-17T14:54:24.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89ffff700 1 -- 172.21.15.27:0/2136795709 reap_dead start 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89effd700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe888004690 0x7fe888004b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fe894009a80 tx=0x7fe894009060).ready entity=mon.0 client_cookie=c5d87f7a79d3e457 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894009430 con 0x7fe888004690 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400e640 con 0x7fe888004690 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.562+0000 7fe89e7fc700 1 -- 172.21.15.27:0/2136795709 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400e9c0 con 0x7fe888004690 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 -- 172.21.15.27:0/2136795709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe888004690 msgr2=0x7fe888004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe888004690 0x7fe888004b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fe894009a80 tx=0x7fe894009060).stop 2023-05-17T14:54:24.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 -- 172.21.15.27:0/2136795709 shutdown_connections 2023-05-17T14:54:24.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/2136795709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe888004690 0x7fe888004b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 -- 172.21.15.27:0/2136795709 >> 172.21.15.27:0/2136795709 conn(0x7fe8a0069e70 msgr2=0x7fe8a005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:24.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 -- 172.21.15.27:0/2136795709 shutdown_connections 2023-05-17T14:54:24.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.563+0000 7fe8a5c72700 1 -- 172.21.15.27:0/2136795709 wait complete. 2023-05-17T14:54:24.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.564+0000 7fe8a5c72700 1 Processor -- start 2023-05-17T14:54:24.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.564+0000 7fe8a5c72700 1 -- start start 2023-05-17T14:54:24.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe8a5c72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888004690 0x7fe8a0144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe8a5c72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8a0144b30 0x7fe8a0151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe8a5c72700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 0x7fe8a00c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe8a5c72700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0156940 con 0x7fe8a0151850 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe8a5c72700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0152930 con 0x7fe888004690 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe8a5c72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0151db0 con 0x7fe8a0144b30 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 0x7fe8a00c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 0x7fe8a00c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34824/0 (socket says 172.21.15.27:34824) 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 -- 172.21.15.27:0/1353510687 learned_addr learned my addr 172.21.15.27:0/1353510687 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89f7fe700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888004690 0x7fe8a0144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89effd700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8a0144b30 0x7fe8a0151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 -- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8a0144b30 msgr2=0x7fe8a0151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8a0144b30 0x7fe8a0151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 -- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888004690 msgr2=0x7fe8a0144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888004690 0x7fe8a0144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 -- 172.21.15.27:0/1353510687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0152090 con 0x7fe8a0151850 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.565+0000 7fe89ffff700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 0x7fe8a00c9b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fe8a00c8490 tx=0x7fe898007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.566+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898006c30 con 0x7fe8a0151850 2023-05-17T14:54:24.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.566+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898006d90 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.566+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a0152370 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.566+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898007260 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.566+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a0153420 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.567+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0156ab0 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.567+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe89801e070 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.567+0000 7fe8877fe700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe88c05ed90 0x7fe88c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.567+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe898079100 con 0x7fe8a0151850 2023-05-17T14:54:24.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.567+0000 7fe89f7fe700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe88c05ed90 0x7fe88c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.568+0000 7fe89f7fe700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe88c05ed90 0x7fe88c061250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe890000e50 tx=0x7fe890001e50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:24.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.571+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe89804a6a0 con 0x7fe8a0151850 2023-05-17T14:54:24.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.786+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8a005f4a0 con 0x7fe8a0151850 2023-05-17T14:54:24.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.787+0000 7fe8877fe700 1 -- 172.21.15.27:0/1353510687 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7fe89804dcc0 con 0x7fe8a0151850 2023-05-17T14:54:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:24.791 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:24.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe88c05ed90 msgr2=0x7fe88c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe88c05ed90 0x7fe88c061250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe890000e50 tx=0x7fe890001e50).stop 2023-05-17T14:54:24.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 msgr2=0x7fe8a00c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 0x7fe8a00c9b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fe8a00c8490 tx=0x7fe898007f30).stop 2023-05-17T14:54:24.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 shutdown_connections 2023-05-17T14:54:24.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe88c05ed90 0x7fe88c061250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8a0151850 0x7fe8a00c9b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888004690 0x7fe8a0144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 --2- 172.21.15.27:0/1353510687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8a0144b30 0x7fe8a0151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 >> 172.21.15.27:0/1353510687 conn(0x7fe8a0069e70 msgr2=0x7fe8a00aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:24.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 shutdown_connections 2023-05-17T14:54:24.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.788+0000 7fe8a5c72700 1 -- 172.21.15.27:0/1353510687 wait complete. 2023-05-17T14:54:24.795 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:24.804 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.918+0000 7f024e95b700 1 Processor -- start 2023-05-17T14:54:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.918+0000 7f024e95b700 1 -- start start 2023-05-17T14:54:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024e95b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f0248069060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024e95b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 0x7f0248069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024e95b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02480c07a0 con 0x7f0248153fa0 2023-05-17T14:54:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024e95b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0248069d70 con 0x7f02480c6490 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024e95b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02480c1c40 con 0x7f02480aae70 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024cef8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 0x7f0248069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f02477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f0248069060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024cef8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 0x7f0248069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:52760/0 (socket says 172.21.15.27:52760) 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f0247fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0248153fa0 0x7f02480c5d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40392/0 (socket says 172.21.15.27:40392) 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f02477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f0248069060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35942/0 (socket says 172.21.15.27:35942) 2023-05-17T14:54:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.919+0000 7f024cef8700 1 -- 172.21.15.27:0/408873187 learned_addr learned my addr 172.21.15.27:0/408873187 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f02477fe700 1 -- 172.21.15.27:0/408873187 >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 msgr2=0x7f0248069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f02477fe700 1 --2- 172.21.15.27:0/408873187 >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 0x7f0248069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f02477fe700 1 -- 172.21.15.27:0/408873187 >> v1:172.21.15.40:6789/0 conn(0x7f0248153fa0 legacy=0x7f02480c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f02477fe700 1 -- 172.21.15.27:0/408873187 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02480bfe70 con 0x7f02480aae70 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024cef8700 1 --2- 172.21.15.27:0/408873187 >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 0x7f0248069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f02477fe700 1 --2- 172.21.15.27:0/408873187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f0248069060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f023c006fd0 tx=0x7f023c006f40).ready entity=mon.2 client_cookie=921370342c0b6c69 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f0246ffd700 1 -- 172.21.15.27:0/408873187 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c005880 con 0x7f02480aae70 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f0246ffd700 1 -- 172.21.15.27:0/408873187 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c0059e0 con 0x7f02480aae70 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f0246ffd700 1 -- 172.21.15.27:0/408873187 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c005d60 con 0x7f02480aae70 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 -- 172.21.15.27:0/408873187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 msgr2=0x7f0248069060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 --2- 172.21.15.27:0/408873187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f0248069060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f023c006fd0 tx=0x7f023c006f40).stop 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 -- 172.21.15.27:0/408873187 shutdown_connections 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 --2- 172.21.15.27:0/408873187 >> v2:172.21.15.40:3300/0 conn(0x7f02480c6490 0x7f0248069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 --2- 172.21.15.27:0/408873187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f0248069060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 -- 172.21.15.27:0/408873187 >> 172.21.15.27:0/408873187 conn(0x7f02480cb810 msgr2=0x7f02480c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 -- 172.21.15.27:0/408873187 shutdown_connections 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.920+0000 7f024e95b700 1 -- 172.21.15.27:0/408873187 wait complete. 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 Processor -- start 2023-05-17T14:54:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 -- start start 2023-05-17T14:54:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f024814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02480c6490 0x7f0248152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0248153fa0 0x7f0248153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02480add20 con 0x7f0248153fa0 2023-05-17T14:54:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02480ae8a0 con 0x7f02480c6490 2023-05-17T14:54:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.922+0000 7f024e95b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02480adf70 con 0x7f02480aae70 2023-05-17T14:54:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f0247fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f024814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0248153fa0 0x7f0248153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f0247fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f024814cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:35944/0 (socket says 172.21.15.27:35944) 2023-05-17T14:54:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f0247fff700 1 -- 172.21.15.27:0/3053761391 learned_addr learned my addr 172.21.15.27:0/3053761391 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f02477fe700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02480c6490 0x7f0248152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 -- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 msgr2=0x7f024814cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f024814cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 -- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02480c6490 msgr2=0x7f0248152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02480c6490 0x7f0248152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 -- 172.21.15.27:0/3053761391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240009ae0 con 0x7f0248153fa0 2023-05-17T14:54:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f0247fff700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f024814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024cef8700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0248153fa0 0x7f0248153290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f02480cad40 tx=0x7f024000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400092e0 con 0x7f0248153fa0 2023-05-17T14:54:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000f040 con 0x7f0248153fa0 2023-05-17T14:54:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000cb70 con 0x7f0248153fa0 2023-05-17T14:54:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c009250 con 0x7f0248153fa0 2023-05-17T14:54:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.923+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02480ae530 con 0x7f0248153fa0 2023-05-17T14:54:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.924+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02480aea10 con 0x7f0248153fa0 2023-05-17T14:54:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.925+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f024001b030 con 0x7f0248153fa0 2023-05-17T14:54:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.925+0000 7f022ffff700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f023405ed90 0x7f0234061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.925+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0240079840 con 0x7f0248153fa0 2023-05-17T14:54:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.925+0000 7f0247fff700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f023405ed90 0x7f0234061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:24.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.925+0000 7f0247fff700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f023405ed90 0x7f0234061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0238007fd0 tx=0x7f0238000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:24.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:24.929+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f024004ae90 con 0x7f0248153fa0 2023-05-17T14:54:25.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.104+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02480aec30 con 0x7f0248153fa0 2023-05-17T14:54:25.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.105+0000 7f022ffff700 1 -- 172.21.15.27:0/3053761391 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f024004e4b0 con 0x7f0248153fa0 2023-05-17T14:54:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:25.110 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:25.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f023405ed90 msgr2=0x7f0234061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f023405ed90 0x7f0234061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0238007fd0 tx=0x7f0238000bc0).stop 2023-05-17T14:54:25.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0248153fa0 msgr2=0x7f0248153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0248153fa0 0x7f0248153290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f02480cad40 tx=0x7f024000b040).stop 2023-05-17T14:54:25.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 shutdown_connections 2023-05-17T14:54:25.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f023405ed90 0x7f0234061250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0248153fa0 0x7f0248153290 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02480aae70 0x7f024814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 --2- 172.21.15.27:0/3053761391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02480c6490 0x7f0248152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 >> 172.21.15.27:0/3053761391 conn(0x7f02480cb810 msgr2=0x7f02480ac760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 shutdown_connections 2023-05-17T14:54:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.107+0000 7f024e95b700 1 -- 172.21.15.27:0/3053761391 wait complete. 2023-05-17T14:54:25.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:53:50.567559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:53:51.853878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T14:54:25.125 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:25.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.239+0000 7f0872209700 1 Processor -- start 2023-05-17T14:54:25.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.239+0000 7f0872209700 1 -- start start 2023-05-17T14:54:25.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f0872209700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f086c0c1910 0x7f086c0bc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f0872209700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f086c153bc0 0x7f086c154050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f0872209700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0c4560 con 0x7f086c0bc2d0 2023-05-17T14:54:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f0872209700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c154540 con 0x7f086c0c1910 2023-05-17T14:54:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f0872209700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0c3950 con 0x7f086c153bc0 2023-05-17T14:54:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f086b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f086c0bc2d0 0x7f086c158690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34404/0 (socket says 172.21.15.27:34404) 2023-05-17T14:54:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f086b7fe700 1 -- 172.21.15.27:0/2237481091 learned_addr learned my addr 172.21.15.27:0/2237481091 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.240+0000 7f086affd700 1 --2- 172.21.15.27:0/2237481091 >> v2:172.21.15.27:3300/0 conn(0x7f086c0c1910 0x7f086c0bc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086bfff700 1 --2- 172.21.15.27:0/2237481091 >> v2:172.21.15.40:3300/0 conn(0x7f086c153bc0 0x7f086c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086a7fc700 1 -- 172.21.15.27:0/2237481091 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446579258 0 0) 0x7f086c0c4560 con 0x7f086c0bc2d0 2023-05-17T14:54:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086a7fc700 1 -- 172.21.15.27:0/2237481091 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08540033f0 con 0x7f086c0bc2d0 2023-05-17T14:54:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086affd700 1 -- 172.21.15.27:0/2237481091 >> v2:172.21.15.40:3300/0 conn(0x7f086c153bc0 msgr2=0x7f086c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:25.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086affd700 1 --2- 172.21.15.27:0/2237481091 >> v2:172.21.15.40:3300/0 conn(0x7f086c153bc0 0x7f086c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086affd700 1 -- 172.21.15.27:0/2237481091 >> v1:172.21.15.27:6789/0 conn(0x7f086c0bc2d0 legacy=0x7f086c158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086affd700 1 -- 172.21.15.27:0/2237481091 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0c3c30 con 0x7f086c0c1910 2023-05-17T14:54:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086affd700 1 --2- 172.21.15.27:0/2237481091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c0c1910 0x7f086c0bc6b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f086c0c1dc0 tx=0x7f0860009060).ready entity=mon.0 client_cookie=27670dc51fd77c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086a7fc700 1 -- 172.21.15.27:0/2237481091 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000d4a0 con 0x7f086c0c1910 2023-05-17T14:54:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086a7fc700 1 -- 172.21.15.27:0/2237481091 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086000d600 con 0x7f086c0c1910 2023-05-17T14:54:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f086a7fc700 1 -- 172.21.15.27:0/2237481091 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000d980 con 0x7f086c0c1910 2023-05-17T14:54:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.241+0000 7f0872209700 1 -- 172.21.15.27:0/2237481091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c0c1910 msgr2=0x7f086c0bc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 --2- 172.21.15.27:0/2237481091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c0c1910 0x7f086c0bc6b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f086c0c1dc0 tx=0x7f0860009060).stop 2023-05-17T14:54:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 -- 172.21.15.27:0/2237481091 shutdown_connections 2023-05-17T14:54:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 --2- 172.21.15.27:0/2237481091 >> v2:172.21.15.40:3300/0 conn(0x7f086c153bc0 0x7f086c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 --2- 172.21.15.27:0/2237481091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c0c1910 0x7f086c0bc6b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 -- 172.21.15.27:0/2237481091 >> 172.21.15.27:0/2237481091 conn(0x7f086c069810 msgr2=0x7f086c069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 -- 172.21.15.27:0/2237481091 shutdown_connections 2023-05-17T14:54:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.242+0000 7f0872209700 1 -- 172.21.15.27:0/2237481091 wait complete. 2023-05-17T14:54:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.243+0000 7f0872209700 1 Processor -- start 2023-05-17T14:54:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.243+0000 7f0872209700 1 -- start start 2023-05-17T14:54:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f086c0bc2d0 0x7f086c168a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f086c0c1910 0x7f086c0aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 0x7f086c14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0ad150 con 0x7f086c153bc0 2023-05-17T14:54:25.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c168600 con 0x7f086c0c1910 2023-05-17T14:54:25.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0ace70 con 0x7f086c0bc2d0 2023-05-17T14:54:25.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 0x7f086c14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 0x7f086c14fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34852/0 (socket says 172.21.15.27:34852) 2023-05-17T14:54:25.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 -- 172.21.15.27:0/770282878 learned_addr learned my addr 172.21.15.27:0/770282878 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:25.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086affd700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f086c0c1910 0x7f086c0aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086b7fe700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f086c0bc2d0 0x7f086c168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 -- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f086c0bc2d0 msgr2=0x7f086c168a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f086c0bc2d0 0x7f086c168a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 -- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f086c0c1910 msgr2=0x7f086c0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f086c0c1910 0x7f086c0aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 -- 172.21.15.27:0/770282878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600092a0 con 0x7f086c153bc0 2023-05-17T14:54:25.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086affd700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f086c0c1910 0x7f086c0aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:25.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f086bfff700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 0x7f086c14fea0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0864009e20 tx=0x7f086400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864009b50 con 0x7f086c153bc0 2023-05-17T14:54:25.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400f040 con 0x7f086c153bc0 2023-05-17T14:54:25.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c167fb0 con 0x7f086c153bc0 2023-05-17T14:54:25.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400ce30 con 0x7f086c153bc0 2023-05-17T14:54:25.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.244+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0a9680 con 0x7f086c153bc0 2023-05-17T14:54:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.245+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c168790 con 0x7f086c153bc0 2023-05-17T14:54:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.246+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0864013610 con 0x7f086c153bc0 2023-05-17T14:54:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.246+0000 7f08537fe700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f085805ed90 0x7f0858061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.246+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f086407a460 con 0x7f086c153bc0 2023-05-17T14:54:25.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.246+0000 7f086b7fe700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f085805ed90 0x7f0858061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.246+0000 7f086b7fe700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f085805ed90 0x7f0858061250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f086c0a8bb0 tx=0x7f085c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.250+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f086404ba00 con 0x7f086c153bc0 2023-05-17T14:54:25.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.426+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f086c0c3f10 con 0x7f086c153bc0 2023-05-17T14:54:25.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.427+0000 7f08537fe700 1 -- 172.21.15.27:0/770282878 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f086404f020 con 0x7f086c153bc0 2023-05-17T14:54:25.431 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:25.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.428+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f085805ed90 msgr2=0x7f0858061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.428+0000 7f0872209700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f085805ed90 0x7f0858061250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f086c0a8bb0 tx=0x7f085c009040).stop 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 msgr2=0x7f086c14fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 0x7f086c14fea0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0864009e20 tx=0x7f086400b040).stop 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 shutdown_connections 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f085805ed90 0x7f0858061250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f086c153bc0 0x7f086c14fea0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f086c0bc2d0 0x7f086c168a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 --2- 172.21.15.27:0/770282878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f086c0c1910 0x7f086c0aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 >> 172.21.15.27:0/770282878 conn(0x7f086c069810 msgr2=0x7f086c0c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:25.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 shutdown_connections 2023-05-17T14:54:25.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.429+0000 7f0872209700 1 -- 172.21.15.27:0/770282878 wait complete. 2023-05-17T14:54:25.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:25.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.559+0000 7f22bb3dc700 1 Processor -- start 2023-05-17T14:54:25.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.559+0000 7f22bb3dc700 1 -- start start 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22bb3dc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f22b40c6310 0x7f22b4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22bb3dc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b4158790 con 0x7f22b40691f0 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22bb3dc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b4157e60 con 0x7f22b41543d0 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22bb3dc700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40c1c50 con 0x7f22b40c6310 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22b8977700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f22b40c6310 0x7f22b4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22b9979700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f22b40691f0 0x7f22b40bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34422/0 (socket says 172.21.15.27:34422) 2023-05-17T14:54:25.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22b8977700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f22b40c6310 0x7f22b4068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34858/0 (socket says 172.21.15.27:34858) 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.560+0000 7f22b9979700 1 -- 172.21.15.27:0/1071918436 learned_addr learned my addr 172.21.15.27:0/1071918436 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22b8977700 1 -- 172.21.15.27:0/1071918436 >> v1:172.21.15.40:6789/0 conn(0x7f22b41543d0 legacy=0x7f22b40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22b8977700 1 -- 172.21.15.27:0/1071918436 >> v1:172.21.15.27:6789/0 conn(0x7f22b40691f0 legacy=0x7f22b40bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22b8977700 1 -- 172.21.15.27:0/1071918436 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4158140 con 0x7f22b40c6310 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22abfff700 1 -- 172.21.15.27:0/1071918436 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202171257 0 0) 0x7f22b4158790 con 0x7f22b40691f0 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22b8977700 1 --2- 172.21.15.27:0/1071918436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40c6310 0x7f22b4068d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f22a4009760 tx=0x7f22a4009060).ready entity=mon.0 client_cookie=1d26d6174cc848d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22abfff700 1 -- 172.21.15.27:0/1071918436 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400b580 con 0x7f22b40c6310 2023-05-17T14:54:25.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22abfff700 1 -- 172.21.15.27:0/1071918436 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a400b6e0 con 0x7f22b40c6310 2023-05-17T14:54:25.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22abfff700 1 -- 172.21.15.27:0/1071918436 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400ba60 con 0x7f22b40c6310 2023-05-17T14:54:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1071918436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40c6310 msgr2=0x7f22b4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1071918436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40c6310 0x7f22b4068d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f22a4009760 tx=0x7f22a4009060).stop 2023-05-17T14:54:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1071918436 shutdown_connections 2023-05-17T14:54:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1071918436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40c6310 0x7f22b4068d00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1071918436 >> 172.21.15.27:0/1071918436 conn(0x7f22b40cb7f0 msgr2=0x7f22b40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1071918436 shutdown_connections 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.561+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1071918436 wait complete. 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.562+0000 7f22bb3dc700 1 Processor -- start 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 -- start start 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 0x7f22b4167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b40c6310 0x7f22b41645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b41543d0 0x7f22b4164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40ae6f0 con 0x7f22b40691f0 2023-05-17T14:54:25.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40c33b0 con 0x7f22b40c6310 2023-05-17T14:54:25.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22bb3dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40ade00 con 0x7f22b41543d0 2023-05-17T14:54:25.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.563+0000 7f22b9178700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 0x7f22b4167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 0x7f22b4167450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34862/0 (socket says 172.21.15.27:34862) 2023-05-17T14:54:25.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 -- 172.21.15.27:0/1860786582 learned_addr learned my addr 172.21.15.27:0/1860786582 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:25.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b8977700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b40c6310 0x7f22b41645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9979700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b41543d0 0x7f22b4164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 -- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b41543d0 msgr2=0x7f22b4164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b41543d0 0x7f22b4164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 -- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b40c6310 msgr2=0x7f22b41645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b40c6310 0x7f22b41645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 -- 172.21.15.27:0/1860786582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40092a0 con 0x7f22b40691f0 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b8977700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b40c6310 0x7f22b41645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22b9178700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 0x7f22b4167450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f22ac00c7c0 tx=0x7f22ac0015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac006a20 con 0x7f22b40691f0 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac006b80 con 0x7f22b40691f0 2023-05-17T14:54:25.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b40ae0a0 con 0x7f22b40691f0 2023-05-17T14:54:25.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac007020 con 0x7f22b40691f0 2023-05-17T14:54:25.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.564+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b4167940 con 0x7f22b40691f0 2023-05-17T14:54:25.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.565+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b406bdf0 con 0x7f22b40691f0 2023-05-17T14:54:25.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.565+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f22ac018020 con 0x7f22b40691f0 2023-05-17T14:54:25.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.566+0000 7f22a97fa700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f229805ed90 0x7f2298061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.566+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22ac079140 con 0x7f22b40691f0 2023-05-17T14:54:25.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.566+0000 7f22b8977700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f229805ed90 0x7f2298061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.566+0000 7f22b8977700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f229805ed90 0x7f2298061250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f22b40c6710 tx=0x7f22a4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.570+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22ac0488f0 con 0x7f22b40691f0 2023-05-17T14:54:25.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.742+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22b4158420 con 0x7f22b40691f0 2023-05-17T14:54:25.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.742+0000 7f22a97fa700 1 -- 172.21.15.27:0/1860786582 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22ac04a6e0 con 0x7f22b40691f0 2023-05-17T14:54:25.747 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:25.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f229805ed90 msgr2=0x7f2298061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f229805ed90 0x7f2298061250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f22b40c6710 tx=0x7f22a4017000).stop 2023-05-17T14:54:25.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 msgr2=0x7f22b4167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 0x7f22b4167450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f22ac00c7c0 tx=0x7f22ac0015c0).stop 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 shutdown_connections 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f229805ed90 0x7f2298061250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b41543d0 0x7f22b4164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b40691f0 0x7f22b4167450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 --2- 172.21.15.27:0/1860786582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b40c6310 0x7f22b41645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 >> 172.21.15.27:0/1860786582 conn(0x7f22b40cb7f0 msgr2=0x7f22b4153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:25.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 shutdown_connections 2023-05-17T14:54:25.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.744+0000 7f22bb3dc700 1 -- 172.21.15.27:0/1860786582 wait complete. 2023-05-17T14:54:25.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T14:54:25.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.875+0000 7f0a9a0db700 1 Processor -- start 2023-05-17T14:54:25.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.875+0000 7f0a9a0db700 1 -- start start 2023-05-17T14:54:25.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a9a0db700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a94153ef0 0x7f0a940cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a9a0db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a94157980 0x7f0a940c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a9a0db700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940c60d0 con 0x7f0a940cac00 2023-05-17T14:54:25.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a9a0db700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a941588b0 con 0x7f0a94153ef0 2023-05-17T14:54:25.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a9a0db700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a94157e10 con 0x7f0a94157980 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a94153ef0 0x7f0a940cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a94153ef0 0x7f0a940cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34872/0 (socket says 172.21.15.27:34872) 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 -- 172.21.15.27:0/3315890277 learned_addr learned my addr 172.21.15.27:0/3315890277 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a998da700 1 --2- 172.21.15.27:0/3315890277 >> v2:172.21.15.40:3300/0 conn(0x7f0a94157980 0x7f0a940c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 -- 172.21.15.27:0/3315890277 >> v2:172.21.15.40:3300/0 conn(0x7f0a94157980 msgr2=0x7f0a940c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 --2- 172.21.15.27:0/3315890277 >> v2:172.21.15.40:3300/0 conn(0x7f0a94157980 0x7f0a940c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 -- 172.21.15.27:0/3315890277 >> v1:172.21.15.40:6789/0 conn(0x7f0a940cac00 legacy=0x7f0a941537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 -- 172.21.15.27:0/3315890277 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94158010 con 0x7f0a94153ef0 2023-05-17T14:54:25.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a988d8700 1 --2- 172.21.15.27:0/3315890277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94153ef0 0x7f0a940cafe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f0a940c6310 tx=0x7f0a880090f0).ready entity=mon.0 client_cookie=2aa925abe32c96c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.876+0000 7f0a93fff700 1 -- 172.21.15.27:0/3315890277 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800b600 con 0x7f0a94153ef0 2023-05-17T14:54:25.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a93fff700 1 -- 172.21.15.27:0/3315890277 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800b760 con 0x7f0a94153ef0 2023-05-17T14:54:25.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a93fff700 1 -- 172.21.15.27:0/3315890277 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800bae0 con 0x7f0a94153ef0 2023-05-17T14:54:25.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3315890277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94153ef0 msgr2=0x7f0a940cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3315890277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94153ef0 0x7f0a940cafe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f0a940c6310 tx=0x7f0a880090f0).stop 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3315890277 shutdown_connections 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3315890277 >> v2:172.21.15.40:3300/0 conn(0x7f0a94157980 0x7f0a940c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3315890277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94153ef0 0x7f0a940cafe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3315890277 >> 172.21.15.27:0/3315890277 conn(0x7f0a9405dd50 msgr2=0x7f0a9405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3315890277 shutdown_connections 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.877+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3315890277 wait complete. 2023-05-17T14:54:25.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.878+0000 7f0a9a0db700 1 Processor -- start 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.878+0000 7f0a9a0db700 1 -- start start 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a9a0db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a940cac00 0x7f0a9413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a9a0db700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a94153ef0 0x7f0a94168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a9a0db700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 0x7f0a94155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a9a0db700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94142e60 con 0x7f0a94157980 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a9a0db700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940ae1c0 con 0x7f0a94153ef0 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a9a0db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94155730 con 0x7f0a940cac00 2023-05-17T14:54:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 0x7f0a94155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 0x7f0a94155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34880/0 (socket says 172.21.15.27:34880) 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 -- 172.21.15.27:0/3874714267 learned_addr learned my addr 172.21.15.27:0/3874714267 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a988d8700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a94153ef0 0x7f0a94168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a990d9700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a940cac00 0x7f0a9413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 -- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a940cac00 msgr2=0x7f0a9413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a940cac00 0x7f0a9413fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 -- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a94153ef0 msgr2=0x7f0a94168270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a94153ef0 0x7f0a94168270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.879+0000 7f0a998da700 1 -- 172.21.15.27:0/3874714267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009370 con 0x7f0a94157980 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a990d9700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a940cac00 0x7f0a9413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a988d8700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a94153ef0 0x7f0a94168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a998da700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 0x7f0a94155920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0a8400d8c0 tx=0x7f0a84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840095b0 con 0x7f0a94157980 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84009710 con 0x7f0a94157980 2023-05-17T14:54:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94155450 con 0x7f0a94157980 2023-05-17T14:54:25.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84009a90 con 0x7f0a94157980 2023-05-17T14:54:25.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.880+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a940ade50 con 0x7f0a94157980 2023-05-17T14:54:25.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.881+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a94047150 con 0x7f0a94157980 2023-05-17T14:54:25.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.881+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0a84013480 con 0x7f0a94157980 2023-05-17T14:54:25.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.882+0000 7f0a917fa700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a8005ed60 0x7f0a80061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:25.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.882+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a84079fa0 con 0x7f0a94157980 2023-05-17T14:54:25.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.882+0000 7f0a990d9700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a8005ed60 0x7f0a80061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:25.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.882+0000 7f0a990d9700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a8005ed60 0x7f0a80061220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0a8c007fd0 tx=0x7f0a8c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:25.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:25.886+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a8404b3d0 con 0x7f0a94157980 2023-05-17T14:54:26.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.060+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a940c63b0 con 0x7f0a94157980 2023-05-17T14:54:26.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.061+0000 7f0a917fa700 1 -- 172.21.15.27:0/3874714267 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a8404e9f0 con 0x7f0a94157980 2023-05-17T14:54:26.066 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:26.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a8005ed60 msgr2=0x7f0a80061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a8005ed60 0x7f0a80061220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0a8c007fd0 tx=0x7f0a8c009040).stop 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 msgr2=0x7f0a94155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 0x7f0a94155920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0a8400d8c0 tx=0x7f0a84008040).stop 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 shutdown_connections 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a8005ed60 0x7f0a80061220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a94157980 0x7f0a94155920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a940cac00 0x7f0a9413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 --2- 172.21.15.27:0/3874714267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a94153ef0 0x7f0a94168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.062+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 >> 172.21.15.27:0/3874714267 conn(0x7f0a9405dd50 msgr2=0x7f0a940c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:26.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.063+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 shutdown_connections 2023-05-17T14:54:26.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.063+0000 7f0a9a0db700 1 -- 172.21.15.27:0/3874714267 wait complete. 2023-05-17T14:54:26.079 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T14:54:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.193+0000 7f2683265700 1 Processor -- start 2023-05-17T14:54:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.193+0000 7f2683265700 1 -- start start 2023-05-17T14:54:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2683265700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f267c0c6310 0x7f267c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2683265700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2683265700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c158790 con 0x7f267c1543d0 2023-05-17T14:54:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2683265700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0c1c50 con 0x7f267c0c6310 2023-05-17T14:54:26.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2683265700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c157e60 con 0x7f267c0691f0 2023-05-17T14:54:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2681001700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f267c1543d0 0x7f267c0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34446/0 (socket says 172.21.15.27:34446) 2023-05-17T14:54:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2681001700 1 -- 172.21.15.27:0/98384453 learned_addr learned my addr 172.21.15.27:0/98384453 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2680800700 1 --2- 172.21.15.27:0/98384453 >> v2:172.21.15.40:3300/0 conn(0x7f267c0c6310 0x7f267c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.194+0000 7f2681802700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f267bfff700 1 -- 172.21.15.27:0/98384453 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755066680 0 0) 0x7f267c158790 con 0x7f267c1543d0 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f267bfff700 1 -- 172.21.15.27:0/98384453 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26640033f0 con 0x7f267c1543d0 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f2680800700 1 -- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 msgr2=0x7f267c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f2680800700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f2680800700 1 -- 172.21.15.27:0/98384453 >> v1:172.21.15.27:6789/0 conn(0x7f267c1543d0 legacy=0x7f267c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f2680800700 1 -- 172.21.15.27:0/98384453 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c158140 con 0x7f267c0c6310 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f267bfff700 1 -- 172.21.15.27:0/98384453 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106625572 0 0) 0x7f26640033f0 con 0x7f267c1543d0 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f2681802700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:26.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f2680800700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c0c6310 0x7f267c068d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2670009760 tx=0x7f2670009060).ready entity=mon.1 client_cookie=d92476676d249fa4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f267bfff700 1 -- 172.21.15.27:0/98384453 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000d4a0 con 0x7f267c0c6310 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f267bfff700 1 -- 172.21.15.27:0/98384453 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000d600 con 0x7f267c0c6310 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.195+0000 7f267bfff700 1 -- 172.21.15.27:0/98384453 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000d980 con 0x7f267c0c6310 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 -- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c0c6310 msgr2=0x7f267c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c0c6310 0x7f267c068d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2670009760 tx=0x7f2670009060).stop 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 -- 172.21.15.27:0/98384453 shutdown_connections 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 --2- 172.21.15.27:0/98384453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c0c6310 0x7f267c068d00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 -- 172.21.15.27:0/98384453 >> 172.21.15.27:0/98384453 conn(0x7f267c0cb7f0 msgr2=0x7f267c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:26.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 -- 172.21.15.27:0/98384453 shutdown_connections 2023-05-17T14:54:26.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.196+0000 7f2683265700 1 -- 172.21.15.27:0/98384453 wait complete. 2023-05-17T14:54:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.197+0000 7f2683265700 1 Processor -- start 2023-05-17T14:54:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.197+0000 7f2683265700 1 -- start start 2023-05-17T14:54:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2683265700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2683265700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 0x7f267c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2683265700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c1543d0 0x7f267c0afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2683265700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c165610 con 0x7f267c0c6310 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2683265700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0af000 con 0x7f267c1543d0 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2683265700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0c4ba0 con 0x7f267c0691f0 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 0x7f267c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 0x7f267c0aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34892/0 (socket says 172.21.15.27:34892) 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 -- 172.21.15.27:0/1663043920 learned_addr learned my addr 172.21.15.27:0/1663043920 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 -- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 msgr2=0x7f267c165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 -- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c1543d0 msgr2=0x7f267c0afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2681802700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c1543d0 0x7f267c0afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c1543d0 0x7f267c0afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.198+0000 7f2680800700 1 -- 172.21.15.27:0/1663043920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0092a0 con 0x7f267c0c6310 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.199+0000 7f2680800700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 0x7f267c0aeb10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f2670010000 tx=0x7f2670016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.199+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670000c90 con 0x7f267c0c6310 2023-05-17T14:54:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.199+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000d770 con 0x7f267c0c6310 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.199+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26700092a0 con 0x7f267c0c6310 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.199+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267001d660 con 0x7f267c0c6310 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.199+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c0ae330 con 0x7f267c0c6310 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.200+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c06bdf0 con 0x7f267c0c6310 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.200+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f267000f070 con 0x7f267c0c6310 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.200+0000 7f26797fa700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f266805ed90 0x7f2668061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.200+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f267007b170 con 0x7f267c0c6310 2023-05-17T14:54:26.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.200+0000 7f2681001700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f266805ed90 0x7f2668061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.201+0000 7f2681001700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f266805ed90 0x7f2668061250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2674007fd0 tx=0x7f2674007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.204+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f267004c710 con 0x7f267c0c6310 2023-05-17T14:54:26.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.376+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f267c158420 con 0x7f267c0c6310 2023-05-17T14:54:26.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.377+0000 7f26797fa700 1 -- 172.21.15.27:0/1663043920 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f267004fd30 con 0x7f267c0c6310 2023-05-17T14:54:26.382 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T14:54:26.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.378+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f266805ed90 msgr2=0x7f2668061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.378+0000 7f2683265700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f266805ed90 0x7f2668061250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2674007fd0 tx=0x7f2674007bb0).stop 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.378+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 msgr2=0x7f267c0aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.378+0000 7f2683265700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 0x7f267c0aeb10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f2670010000 tx=0x7f2670016000).stop 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 shutdown_connections 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f266805ed90 0x7f2668061250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f267c1543d0 0x7f267c0afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f267c0691f0 0x7f267c165120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:26.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 --2- 172.21.15.27:0/1663043920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f267c0c6310 0x7f267c0aeb10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 >> 172.21.15.27:0/1663043920 conn(0x7f267c0cb7f0 msgr2=0x7f267c0c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:26.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 shutdown_connections 2023-05-17T14:54:26.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.379+0000 7f2683265700 1 -- 172.21.15.27:0/1663043920 wait complete. 2023-05-17T14:54:26.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:26.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.505+0000 7f441fccd700 1 Processor -- start 2023-05-17T14:54:26.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.506+0000 7f441fccd700 1 -- start start 2023-05-17T14:54:26.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.506+0000 7f441fccd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 0x7f4418150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.506+0000 7f441fccd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4418067cb0 0x7f4418068160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441fccd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4418068650 con 0x7f44180c3dd0 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441fccd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44180c4250 con 0x7f4418067cb0 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441fccd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418065710 con 0x7f4418150970 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441d268700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f44180c3dd0 0x7f4418064ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34462/0 (socket says 172.21.15.27:34462) 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441d268700 1 -- 172.21.15.27:0/1556226042 learned_addr learned my addr 172.21.15.27:0/1556226042 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441da69700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 0x7f4418150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441e26a700 1 --2- 172.21.15.27:0/1556226042 >> v2:172.21.15.40:3300/0 conn(0x7f4418067cb0 0x7f4418068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793732730 0 0) 0x7f440c001110 con 0x7f44180c3dd0 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44000033f0 con 0x7f44180c3dd0 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972694122 0 0) 0x7f44000033f0 con 0x7f44180c3dd0 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 msgr2=0x7f4418150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 0x7f4418150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 >> v2:172.21.15.40:3300/0 conn(0x7f4418067cb0 msgr2=0x7f4418068160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:26.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 --2- 172.21.15.27:0/1556226042 >> v2:172.21.15.40:3300/0 conn(0x7f4418067cb0 0x7f4418068160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180bc9b0 con 0x7f44180c3dd0 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f440c001600 con 0x7f44180c3dd0 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 >> v1:172.21.15.27:6789/0 conn(0x7f44180c3dd0 legacy=0x7f4418064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 0x7f44000038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4400003e10 0x7f4400004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f4400005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180c4250 con 0x7f4400004b80 2023-05-17T14:54:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418065710 con 0x7f4400003e10 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.507+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440000b8e0 con 0x7f4418150970 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f4400005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441da69700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 0x7f44000038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441d268700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4400003e10 0x7f4400004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 -- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 msgr2=0x7f44000038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4418150970 0x7f44000038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 -- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4400003e10 msgr2=0x7f4400004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4400003e10 0x7f4400004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 -- 172.21.15.27:0/1556226042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000033f0 con 0x7f4400004b80 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441e26a700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f4400005000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f440800e240 tx=0x7f440800b040).ready entity=mon.0 client_cookie=d3a0fbe50d7268c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408009ac0 con 0x7f4400004b80 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440800f040 con 0x7f4400004b80 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441ca67700 1 -- 172.21.15.27:0/1556226042 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440800ed00 con 0x7f4400004b80 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441fccd700 1 -- 172.21.15.27:0/1556226042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 msgr2=0x7f4400005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.508+0000 7f441fccd700 1 --2- 172.21.15.27:0/1556226042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f4400005000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f440800e240 tx=0x7f440800b040).stop 2023-05-17T14:54:26.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.509+0000 7f441e26a700 1 -- 172.21.15.27:0/1556226042 reap_dead start 2023-05-17T14:54:26.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.509+0000 7f441fccd700 1 -- 172.21.15.27:0/1556226042 shutdown_connections 2023-05-17T14:54:26.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.509+0000 7f441fccd700 1 -- 172.21.15.27:0/1556226042 >> 172.21.15.27:0/1556226042 conn(0x7f44180c7920 msgr2=0x7f44180c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:26.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.509+0000 7f441fccd700 1 -- 172.21.15.27:0/1556226042 shutdown_connections 2023-05-17T14:54:26.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.509+0000 7f441fccd700 1 -- 172.21.15.27:0/1556226042 wait complete. 2023-05-17T14:54:26.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 Processor -- start 2023-05-17T14:54:26.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 -- start start 2023-05-17T14:54:26.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f44181673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44180a7e20 0x7f4418142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441813d3c0 0x7f44180c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418143030 con 0x7f4400004b80 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418168310 con 0x7f441813d3c0 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.510+0000 7f441fccd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418152130 con 0x7f44180a7e20 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f44181673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f44181673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34912/0 (socket says 172.21.15.27:34912) 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 -- 172.21.15.27:0/4270509616 learned_addr learned my addr 172.21.15.27:0/4270509616 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:26.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441d268700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44180a7e20 0x7f4418142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441e26a700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441813d3c0 0x7f44180c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 -- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44180a7e20 msgr2=0x7f4418142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44180a7e20 0x7f4418142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 -- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441813d3c0 msgr2=0x7f44180c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441813d3c0 0x7f44180c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 -- 172.21.15.27:0/4270509616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418167a70 con 0x7f4400004b80 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441e26a700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441813d3c0 0x7f44180c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:26.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441da69700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f44181673b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f44100119c0 tx=0x7f4410009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410011eb0 con 0x7f4400004b80 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000f940 con 0x7f4400004b80 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4418167d50 con 0x7f4400004b80 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000fcc0 con 0x7f4400004b80 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.511+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441813d820 con 0x7f4400004b80 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.512+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441806bdf0 con 0x7f4400004b80 2023-05-17T14:54:26.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.513+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4410024070 con 0x7f4400004b80 2023-05-17T14:54:26.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.513+0000 7f4415ffb700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f440405ed90 0x7f4404061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.513+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f441007a500 con 0x7f4400004b80 2023-05-17T14:54:26.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.513+0000 7f441d268700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f440405ed90 0x7f4404061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.514+0000 7f441d268700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f440405ed90 0x7f4404061250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f440c0079f0 tx=0x7f440c007900).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.517+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f441004baa0 con 0x7f4400004b80 2023-05-17T14:54:26.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.732+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44180bcc90 con 0x7f4400004b80 2023-05-17T14:54:26.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.732+0000 7f4415ffb700 1 -- 172.21.15.27:0/4270509616 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f4410018070 con 0x7f4400004b80 2023-05-17T14:54:26.737 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:26.737 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:26.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f440405ed90 msgr2=0x7f4404061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f440405ed90 0x7f4404061250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f440c0079f0 tx=0x7f440c007900).stop 2023-05-17T14:54:26.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 msgr2=0x7f44181673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f44181673b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f44100119c0 tx=0x7f4410009060).stop 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 shutdown_connections 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f440405ed90 0x7f4404061250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441813d3c0 0x7f44180c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4400004b80 0x7f44181673b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 --2- 172.21.15.27:0/4270509616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44180a7e20 0x7f4418142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 >> 172.21.15.27:0/4270509616 conn(0x7f44180c7920 msgr2=0x7f44180ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:26.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 shutdown_connections 2023-05-17T14:54:26.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.734+0000 7f441fccd700 1 -- 172.21.15.27:0/4270509616 wait complete. 2023-05-17T14:54:26.741 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:26.751 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:26.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.861+0000 7f1edf570700 1 Processor -- start 2023-05-17T14:54:26.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.861+0000 7f1edf570700 1 -- start start 2023-05-17T14:54:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edf570700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 0x7f1ed80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edf570700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edf570700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80bfcd0 con 0x7f1ed81541c0 2023-05-17T14:54:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edf570700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80c0290 con 0x7f1ed80c5f30 2023-05-17T14:54:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edf570700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80aa1a0 con 0x7f1ed8158880 2023-05-17T14:54:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edcb0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edd30c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 0x7f1ed80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1eddb0d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1ed81541c0 0x7f1ed80c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40486/0 (socket says 172.21.15.27:40486) 2023-05-17T14:54:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edd30c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 0x7f1ed80c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:52848/0 (socket says 172.21.15.27:52848) 2023-05-17T14:54:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1edcb0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36030/0 (socket says 172.21.15.27:36030) 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.862+0000 7f1eddb0d700 1 -- 172.21.15.27:0/3770690589 learned_addr learned my addr 172.21.15.27:0/3770690589 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3770690589 >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 msgr2=0x7f1ed80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1edcb0b700 1 --2- 172.21.15.27:0/3770690589 >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 0x7f1ed80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3770690589 >> v1:172.21.15.40:6789/0 conn(0x7f1ed81541c0 legacy=0x7f1ed80c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3770690589 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80aa480 con 0x7f1ed8158880 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1edd30c700 1 --2- 172.21.15.27:0/3770690589 >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 0x7f1ed80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1edcb0b700 1 --2- 172.21.15.27:0/3770690589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8153cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1ec8009760 tx=0x7f1ec8009060).ready entity=mon.2 client_cookie=4ecdfc9eafd178bf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1ecffff700 1 -- 172.21.15.27:0/3770690589 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800f510 con 0x7f1ed8158880 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1ecffff700 1 -- 172.21.15.27:0/3770690589 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800f670 con 0x7f1ed8158880 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.863+0000 7f1ecffff700 1 -- 172.21.15.27:0/3770690589 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800f9f0 con 0x7f1ed8158880 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 -- 172.21.15.27:0/3770690589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 msgr2=0x7f1ed8153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 --2- 172.21.15.27:0/3770690589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8153cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1ec8009760 tx=0x7f1ec8009060).stop 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 -- 172.21.15.27:0/3770690589 shutdown_connections 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 --2- 172.21.15.27:0/3770690589 >> v2:172.21.15.40:3300/0 conn(0x7f1ed80c5f30 0x7f1ed80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 --2- 172.21.15.27:0/3770690589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8153cd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 -- 172.21.15.27:0/3770690589 >> 172.21.15.27:0/3770690589 conn(0x7f1ed8069e70 msgr2=0x7f1ed805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:26.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 -- 172.21.15.27:0/3770690589 shutdown_connections 2023-05-17T14:54:26.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.864+0000 7f1edf570700 1 -- 172.21.15.27:0/3770690589 wait complete. 2023-05-17T14:54:26.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.865+0000 7f1edf570700 1 Processor -- start 2023-05-17T14:54:26.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.865+0000 7f1edf570700 1 -- start start 2023-05-17T14:54:26.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed80c5f30 0x7f1ed814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 0x7f1ed8152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8152b00 con 0x7f1ed81541c0 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed814f980 con 0x7f1ed80c5f30 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8168770 con 0x7f1ed8158880 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 0x7f1ed8152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 0x7f1ed8152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34926/0 (socket says 172.21.15.27:34926) 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3520355959 learned_addr learned my addr 172.21.15.27:0/3520355959 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edd30c700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed80c5f30 0x7f1ed814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1eddb0d700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 msgr2=0x7f1ed8167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed80c5f30 msgr2=0x7f1ed814f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed80c5f30 0x7f1ed814f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 -- 172.21.15.27:0/3520355959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0009a20 con 0x7f1ed81541c0 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edcb0b700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 0x7f1ed8152f90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f1ec8009e00 tx=0x7f1ec8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800f7e0 con 0x7f1ed81541c0 2023-05-17T14:54:26.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800f940 con 0x7f1ed81541c0 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec80092a0 con 0x7f1ed81541c0 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.866+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec801b660 con 0x7f1ed81541c0 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.867+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed81524b0 con 0x7f1ed81541c0 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.867+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed8152cb0 con 0x7f1ed81541c0 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.868+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1ec802b070 con 0x7f1ed81541c0 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.868+0000 7f1ecd7fa700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1ebc05ed90 0x7f1ebc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:26.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.868+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ec807b330 con 0x7f1ed81541c0 2023-05-17T14:54:26.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.868+0000 7f1edd30c700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1ebc05ed90 0x7f1ebc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:26.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.869+0000 7f1edd30c700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1ebc05ed90 0x7f1ebc061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1ed0009fd0 tx=0x7f1ed000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:26.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:26.872+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ed8152cb0 con 0x7f1ed81541c0 2023-05-17T14:54:27.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.047+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed805f4a0 con 0x7f1ed81541c0 2023-05-17T14:54:27.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.048+0000 7f1ecd7fa700 1 -- 172.21.15.27:0/3520355959 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f1ec801f090 con 0x7f1ed81541c0 2023-05-17T14:54:27.053 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:27.053 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:27.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1ebc05ed90 msgr2=0x7f1ebc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1ebc05ed90 0x7f1ebc061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1ed0009fd0 tx=0x7f1ed000b040).stop 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 msgr2=0x7f1ed8152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 0x7f1ed8152f90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f1ec8009e00 tx=0x7f1ec8017000).stop 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 shutdown_connections 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1ebc05ed90 0x7f1ebc061250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ed8158880 0x7f1ed8167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ed80c5f30 0x7f1ed814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 --2- 172.21.15.27:0/3520355959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ed81541c0 0x7f1ed8152f90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 >> 172.21.15.27:0/3520355959 conn(0x7f1ed8069e70 msgr2=0x7f1ed80aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:27.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 shutdown_connections 2023-05-17T14:54:27.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.050+0000 7f1edf570700 1 -- 172.21.15.27:0/3520355959 wait complete. 2023-05-17T14:54:27.066 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T14:54:27.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:27.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.177+0000 7f3fc9b51700 1 Processor -- start 2023-05-17T14:54:27.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.177+0000 7f3fc9b51700 1 -- start start 2023-05-17T14:54:27.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fc9b51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc40c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fc9b51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fc4158880 0x7f3fc4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fc9b51700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40bfcd0 con 0x7f3fc41541c0 2023-05-17T14:54:27.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fc9b51700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40c0290 con 0x7f3fc4158880 2023-05-17T14:54:27.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fc9b51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40aa1a0 con 0x7f3fc40c5f30 2023-05-17T14:54:27.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc40c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.178+0000 7f3fbbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fc4158880 0x7f3fc4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc40c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36042/0 (socket says 172.21.15.27:36042) 2023-05-17T14:54:27.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 -- 172.21.15.27:0/2343541038 learned_addr learned my addr 172.21.15.27:0/2343541038 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:27.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 -- 172.21.15.27:0/2343541038 >> v2:172.21.15.40:3300/0 conn(0x7f3fc4158880 msgr2=0x7f3fc4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:27.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 --2- 172.21.15.27:0/2343541038 >> v2:172.21.15.40:3300/0 conn(0x7f3fc4158880 0x7f3fc4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 -- 172.21.15.27:0/2343541038 >> v1:172.21.15.40:6789/0 conn(0x7f3fc41541c0 legacy=0x7f3fc40c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 -- 172.21.15.27:0/2343541038 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40aa480 con 0x7f3fc40c5f30 2023-05-17T14:54:27.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc37fe700 1 --2- 172.21.15.27:0/2343541038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc40c6310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3fb4006fd0 tx=0x7f3fb40090f0).ready entity=mon.2 client_cookie=9e181c8009906c5b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc2ffd700 1 -- 172.21.15.27:0/2343541038 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400b580 con 0x7f3fc40c5f30 2023-05-17T14:54:27.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc2ffd700 1 -- 172.21.15.27:0/2343541038 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400b6e0 con 0x7f3fc40c5f30 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.179+0000 7f3fc2ffd700 1 -- 172.21.15.27:0/2343541038 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400ba60 con 0x7f3fc40c5f30 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 -- 172.21.15.27:0/2343541038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 msgr2=0x7f3fc40c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/2343541038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc40c6310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3fb4006fd0 tx=0x7f3fb40090f0).stop 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 -- 172.21.15.27:0/2343541038 shutdown_connections 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/2343541038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc40c6310 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/2343541038 >> v2:172.21.15.40:3300/0 conn(0x7f3fc4158880 0x7f3fc4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 -- 172.21.15.27:0/2343541038 >> 172.21.15.27:0/2343541038 conn(0x7f3fc4069e70 msgr2=0x7f3fc405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:27.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 -- 172.21.15.27:0/2343541038 shutdown_connections 2023-05-17T14:54:27.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.180+0000 7f3fc9b51700 1 -- 172.21.15.27:0/2343541038 wait complete. 2023-05-17T14:54:27.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.181+0000 7f3fc9b51700 1 Processor -- start 2023-05-17T14:54:27.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.181+0000 7f3fc9b51700 1 -- start start 2023-05-17T14:54:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc41541c0 0x7f3fc4155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 0x7f3fc4150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c37b0 con 0x7f3fc4158880 2023-05-17T14:54:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc414f6b0 con 0x7f3fc41541c0 2023-05-17T14:54:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4155960 con 0x7f3fc40c5f30 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 0x7f3fc4150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 0x7f3fc4150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34942/0 (socket says 172.21.15.27:34942) 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 -- 172.21.15.27:0/1682798389 learned_addr learned my addr 172.21.15.27:0/1682798389 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fbbfff700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc41541c0 0x7f3fc4155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 -- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 msgr2=0x7f3fc414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 -- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc41541c0 msgr2=0x7f3fc4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc41541c0 0x7f3fc4155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 -- 172.21.15.27:0/1682798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009370 con 0x7f3fc4158880 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc3fff700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 0x7f3fc4150b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f3fbc002230 tx=0x7f3fbc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00e4a0 con 0x7f3fc4158880 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00e600 con 0x7f3fc4158880 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00e980 con 0x7f3fc4158880 2023-05-17T14:54:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40c2e80 con 0x7f3fc4158880 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.182+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc40c3440 con 0x7f3fc4158880 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.183+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc40c3960 con 0x7f3fc4158880 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.184+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3fbc019030 con 0x7f3fc4158880 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.184+0000 7f3fbb7fe700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3fa405ed60 0x7f3fa4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.184+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3fbc079000 con 0x7f3fc4158880 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.184+0000 7f3fc37fe700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3fa405ed60 0x7f3fa4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.184+0000 7f3fc37fe700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3fa405ed60 0x7f3fa4061220 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3fb4009fd0 tx=0x7f3fb4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.188+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fbc0488f0 con 0x7f3fc4158880 2023-05-17T14:54:27.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.406+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fc405f4a0 con 0x7f3fc4158880 2023-05-17T14:54:27.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.406+0000 7f3fbb7fe700 1 -- 172.21.15.27:0/1682798389 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f3fbc04a650 con 0x7f3fc4158880 2023-05-17T14:54:27.411 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:27.411 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:27.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3fa405ed60 msgr2=0x7f3fa4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3fa405ed60 0x7f3fa4061220 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3fb4009fd0 tx=0x7f3fb4017000).stop 2023-05-17T14:54:27.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 msgr2=0x7f3fc4150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 0x7f3fc4150b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f3fbc002230 tx=0x7f3fbc0015e0).stop 2023-05-17T14:54:27.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 shutdown_connections 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3fa405ed60 0x7f3fa4061220 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc4158880 0x7f3fc4150b80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fc40c5f30 0x7f3fc414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 --2- 172.21.15.27:0/1682798389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc41541c0 0x7f3fc4155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 >> 172.21.15.27:0/1682798389 conn(0x7f3fc4069e70 msgr2=0x7f3fc40af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 shutdown_connections 2023-05-17T14:54:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.408+0000 7f3fc9b51700 1 -- 172.21.15.27:0/1682798389 wait complete. 2023-05-17T14:54:27.415 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:27.425 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:27.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.535+0000 7f18d9576700 1 Processor -- start 2023-05-17T14:54:27.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.535+0000 7f18d9576700 1 -- start start 2023-05-17T14:54:27.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d9576700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18d4065a60 0x7f18d4152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d9576700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d40c4430 con 0x7f18d40663a0 2023-05-17T14:54:27.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d9576700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d40c3e70 con 0x7f18d4151ca0 2023-05-17T14:54:27.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d9576700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d40c4150 con 0x7f18d4065a60 2023-05-17T14:54:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18d4065a60 0x7f18d4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f18d40663a0 0x7f18d40be2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34512/0 (socket says 172.21.15.27:34512) 2023-05-17T14:54:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.536+0000 7f18d37fe700 1 -- 172.21.15.27:0/1610969339 learned_addr learned my addr 172.21.15.27:0/1610969339 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:27.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d27fc700 1 -- 172.21.15.27:0/1610969339 >> v1:172.21.15.40:6789/0 conn(0x7f18d4151ca0 legacy=0x7f18d4065350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:27.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d27fc700 1 -- 172.21.15.27:0/1610969339 >> v1:172.21.15.27:6789/0 conn(0x7f18d40663a0 legacy=0x7f18d40be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d27fc700 1 -- 172.21.15.27:0/1610969339 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40bdad0 con 0x7f18d4065a60 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d1ffb700 1 -- 172.21.15.27:0/1610969339 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923421598 0 0) 0x7f18d40c4430 con 0x7f18d40663a0 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d27fc700 1 --2- 172.21.15.27:0/1610969339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d4152080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f18c8009760 tx=0x7f18c8009060).ready entity=mon.0 client_cookie=96c54e628c287cd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d1ffb700 1 -- 172.21.15.27:0/1610969339 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800b520 con 0x7f18d4065a60 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d1ffb700 1 -- 172.21.15.27:0/1610969339 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800b680 con 0x7f18d4065a60 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d1ffb700 1 -- 172.21.15.27:0/1610969339 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800ba00 con 0x7f18d4065a60 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 -- 172.21.15.27:0/1610969339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 msgr2=0x7f18d4152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 --2- 172.21.15.27:0/1610969339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d4152080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f18c8009760 tx=0x7f18c8009060).stop 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 -- 172.21.15.27:0/1610969339 shutdown_connections 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 --2- 172.21.15.27:0/1610969339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d4152080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 -- 172.21.15.27:0/1610969339 >> 172.21.15.27:0/1610969339 conn(0x7f18d40c94d0 msgr2=0x7f18d40c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 -- 172.21.15.27:0/1610969339 shutdown_connections 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.537+0000 7f18d9576700 1 -- 172.21.15.27:0/1610969339 wait complete. 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 Processor -- start 2023-05-17T14:54:27.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 -- start start 2023-05-17T14:54:27.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d41660f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18d40663a0 0x7f18d4158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18d4151ca0 0x7f18d4152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40adb90 con 0x7f18d4065a60 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40aea80 con 0x7f18d4151ca0 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d9576700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40acf10 con 0x7f18d40663a0 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.539+0000 7f18d2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d41660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d41660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34952/0 (socket says 172.21.15.27:34952) 2023-05-17T14:54:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 -- 172.21.15.27:0/2939398823 learned_addr learned my addr 172.21.15.27:0/2939398823 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d27fc700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18d40663a0 0x7f18d4158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d37fe700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18d4151ca0 0x7f18d4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 -- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18d40663a0 msgr2=0x7f18d4158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18d40663a0 0x7f18d4158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 -- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18d4151ca0 msgr2=0x7f18d4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18d4151ca0 0x7f18d4152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 -- 172.21.15.27:0/2939398823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80092a0 con 0x7f18d4065a60 2023-05-17T14:54:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d27fc700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18d40663a0 0x7f18d4158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d37fe700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18d4151ca0 0x7f18d4152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d2ffd700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d41660f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f18cc00b460 tx=0x7f18cc006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc012410 con 0x7f18d4065a60 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc012590 con 0x7f18d4065a60 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d40ad1f0 con 0x7f18d4065a60 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc012950 con 0x7f18d4065a60 2023-05-17T14:54:27.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.540+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d40ad7b0 con 0x7f18d4065a60 2023-05-17T14:54:27.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.541+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d406bdf0 con 0x7f18d4065a60 2023-05-17T14:54:27.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.541+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f18cc00f030 con 0x7f18d4065a60 2023-05-17T14:54:27.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.542+0000 7f18baffd700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18c005ed90 0x7f18c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.542+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f18cc0797c0 con 0x7f18d4065a60 2023-05-17T14:54:27.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.542+0000 7f18d27fc700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18c005ed90 0x7f18c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.542+0000 7f18d27fc700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18c005ed90 0x7f18c0061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f18d4065e60 tx=0x7f18c8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.546+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18cc04ad60 con 0x7f18d4065a60 2023-05-17T14:54:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.768+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18d40bddb0 con 0x7f18d4065a60 2023-05-17T14:54:27.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.769+0000 7f18baffd700 1 -- 172.21.15.27:0/2939398823 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f18cc04e380 con 0x7f18d4065a60 2023-05-17T14:54:27.774 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:27.774 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2347558571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2347558571},{"type":"v1","addr":"172.21.15.40:6833","nonce":2347558571}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1156014677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1156014677},{"type":"v1","addr":"172.21.15.40:6835","nonce":1156014677}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2718553659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2718553659},{"type":"v1","addr":"172.21.15.27:6835","nonce":2718553659}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:53:52.874961+0000","modified":"2023-05-17T14:53:55.885951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/2714336229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":2714336229},{"type":"v1","addr":"172.21.15.27:6837","nonce":2714336229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-17T14:54:27.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.770+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18c005ed90 msgr2=0x7f18c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.770+0000 7f18d9576700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18c005ed90 0x7f18c0061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f18d4065e60 tx=0x7f18c8017000).stop 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 msgr2=0x7f18d41660f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d41660f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f18cc00b460 tx=0x7f18cc006f20).stop 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 shutdown_connections 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18c005ed90 0x7f18c0061250 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18d4151ca0 0x7f18d4152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18d4065a60 0x7f18d41660f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 --2- 172.21.15.27:0/2939398823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18d40663a0 0x7f18d4158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 >> 172.21.15.27:0/2939398823 conn(0x7f18d40c94d0 msgr2=0x7f18d414f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:27.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 shutdown_connections 2023-05-17T14:54:27.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.771+0000 7f18d9576700 1 -- 172.21.15.27:0/2939398823 wait complete. 2023-05-17T14:54:27.777 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2023-05-17T14:54:27.787 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 Processor -- start 2023-05-17T14:54:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 -- start start 2023-05-17T14:54:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7eec151ca0 0x7f7eec152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7eec0663a0 0x7f7eec0c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec0c4430 con 0x7f7eec065350 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0c3e70 con 0x7f7eec151ca0 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.898+0000 7f7ef1043700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0c4150 con 0x7f7eec0663a0 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eead9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7eec151ca0 0x7f7eec152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eeb59e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7eec065350 0x7f7eec155ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34522/0 (socket says 172.21.15.27:34522) 2023-05-17T14:54:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eeb59e700 1 -- 172.21.15.27:0/1763796005 learned_addr learned my addr 172.21.15.27:0/1763796005 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eea59c700 1 --2- 172.21.15.27:0/1763796005 >> v2:172.21.15.40:3300/0 conn(0x7f7eec0663a0 0x7f7eec0c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eead9d700 1 -- 172.21.15.27:0/1763796005 >> v2:172.21.15.40:3300/0 conn(0x7f7eec0663a0 msgr2=0x7f7eec0c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eead9d700 1 --2- 172.21.15.27:0/1763796005 >> v2:172.21.15.40:3300/0 conn(0x7f7eec0663a0 0x7f7eec0c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eead9d700 1 -- 172.21.15.27:0/1763796005 >> v1:172.21.15.27:6789/0 conn(0x7f7eec065350 legacy=0x7f7eec155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eead9d700 1 -- 172.21.15.27:0/1763796005 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec0bdad0 con 0x7f7eec151ca0 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7ee9d9b700 1 -- 172.21.15.27:0/1763796005 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249840851 0 0) 0x7f7eec0c4430 con 0x7f7eec065350 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7eead9d700 1 --2- 172.21.15.27:0/1763796005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec151ca0 0x7f7eec152080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7eec0c89a0 tx=0x7f7ee4009060).ready entity=mon.0 client_cookie=46f6802d26d96365 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7ee9d9b700 1 -- 172.21.15.27:0/1763796005 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400b580 con 0x7f7eec151ca0 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7ee9d9b700 1 -- 172.21.15.27:0/1763796005 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400b6e0 con 0x7f7eec151ca0 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.899+0000 7f7ee9d9b700 1 -- 172.21.15.27:0/1763796005 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400ba60 con 0x7f7eec151ca0 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 -- 172.21.15.27:0/1763796005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec151ca0 msgr2=0x7f7eec152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 --2- 172.21.15.27:0/1763796005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec151ca0 0x7f7eec152080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7eec0c89a0 tx=0x7f7ee4009060).stop 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 -- 172.21.15.27:0/1763796005 shutdown_connections 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 --2- 172.21.15.27:0/1763796005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec151ca0 0x7f7eec152080 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 --2- 172.21.15.27:0/1763796005 >> v2:172.21.15.40:3300/0 conn(0x7f7eec0663a0 0x7f7eec0c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 -- 172.21.15.27:0/1763796005 >> 172.21.15.27:0/1763796005 conn(0x7f7eec0c94d0 msgr2=0x7f7eec0c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 -- 172.21.15.27:0/1763796005 shutdown_connections 2023-05-17T14:54:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.900+0000 7f7ef1043700 1 -- 172.21.15.27:0/1763796005 wait complete. 2023-05-17T14:54:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.901+0000 7f7ef1043700 1 Processor -- start 2023-05-17T14:54:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.901+0000 7f7ef1043700 1 -- start start 2023-05-17T14:54:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 0x7f7eec13f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eec0663a0 0x7f7eec0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eec151ca0 0x7f7eec0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec1624a0 con 0x7f7eec065350 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0ace00 con 0x7f7eec151ca0 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0ad0e0 con 0x7f7eec0663a0 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 0x7f7eec13f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 0x7f7eec13f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34966/0 (socket says 172.21.15.27:34966) 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 -- 172.21.15.27:0/2288923215 learned_addr learned my addr 172.21.15.27:0/2288923215 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eea59c700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eec0663a0 0x7f7eec0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eeb59e700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eec151ca0 0x7f7eec0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 -- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eec0663a0 msgr2=0x7f7eec0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eec0663a0 0x7f7eec0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 -- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eec151ca0 msgr2=0x7f7eec0ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eec151ca0 0x7f7eec0ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 -- 172.21.15.27:0/2288923215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40092a0 con 0x7f7eec065350 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eea59c700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eec0663a0 0x7f7eec0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7eead9d700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 0x7f7eec13f690 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7ee4009e80 tx=0x7f7ee4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400b850 con 0x7f7eec065350 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400b9b0 con 0x7f7eec065350 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec0ad3c0 con 0x7f7eec065350 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.902+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee401b690 con 0x7f7eec065350 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.903+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec0acb20 con 0x7f7eec065350 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.903+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec06bdf0 con 0x7f7eec065350 2023-05-17T14:54:27.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.904+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ee400f070 con 0x7f7eec065350 2023-05-17T14:54:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.904+0000 7f7ee2ffd700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ecc05ed90 0x7f7ecc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.904+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ee407b220 con 0x7f7eec065350 2023-05-17T14:54:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.904+0000 7f7eea59c700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ecc05ed90 0x7f7ecc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.905+0000 7f7eea59c700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ecc05ed90 0x7f7ecc061250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f7eec14fde0 tx=0x7f7ed4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:27.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:27.908+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ee404c7c0 con 0x7f7eec065350 2023-05-17T14:54:28.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.082+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eec0bddb0 con 0x7f7eec065350 2023-05-17T14:54:28.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.083+0000 7f7ee2ffd700 1 -- 172.21.15.27:0/2288923215 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f7ee4023360 con 0x7f7eec065350 2023-05-17T14:54:28.088 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:28.088 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:53:53.876796+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:53:50.567559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T14:53:51.853878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ecc05ed90 msgr2=0x7f7ecc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ecc05ed90 0x7f7ecc061250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f7eec14fde0 tx=0x7f7ed4008040).stop 2023-05-17T14:54:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 msgr2=0x7f7eec13f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 0x7f7eec13f690 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7ee4009e80 tx=0x7f7ee4017000).stop 2023-05-17T14:54:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 shutdown_connections 2023-05-17T14:54:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ecc05ed90 0x7f7ecc061250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eec151ca0 0x7f7eec0ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7eec065350 0x7f7eec13f690 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 --2- 172.21.15.27:0/2288923215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eec0663a0 0x7f7eec0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 >> 172.21.15.27:0/2288923215 conn(0x7f7eec0c94d0 msgr2=0x7f7eec0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:28.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 shutdown_connections 2023-05-17T14:54:28.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.085+0000 7f7ef1043700 1 -- 172.21.15.27:0/2288923215 wait complete. 2023-05-17T14:54:28.102 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T14:54:28.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.213+0000 7f6632083700 1 Processor -- start 2023-05-17T14:54:28.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.213+0000 7f6632083700 1 -- start start 2023-05-17T14:54:28.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f6632083700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f662c154090 0x7f662c154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f6632083700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c0cb450 0x7f662c0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f6632083700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f662c068f00 0x7f662c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f6632083700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c069fa0 con 0x7f662c154090 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f6632083700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c0698a0 con 0x7f662c068f00 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f6632083700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0c5a50 con 0x7f662c0cb450 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f662b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f662c154090 0x7f662c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f662b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f662c154090 0x7f662c154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34974/0 (socket says 172.21.15.27:34974) 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f662b7fe700 1 -- 172.21.15.27:0/2656374603 learned_addr learned my addr 172.21.15.27:0/2656374603 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f662bfff700 1 --2- 172.21.15.27:0/2656374603 >> v2:172.21.15.40:3300/0 conn(0x7f662c068f00 0x7f662c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.214+0000 7f662affd700 1 --2- 172.21.15.27:0/2656374603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c0cb450 0x7f662c0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662b7fe700 1 -- 172.21.15.27:0/2656374603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c0cb450 msgr2=0x7f662c0cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662b7fe700 1 --2- 172.21.15.27:0/2656374603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c0cb450 0x7f662c0cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662b7fe700 1 -- 172.21.15.27:0/2656374603 >> v2:172.21.15.40:3300/0 conn(0x7f662c068f00 msgr2=0x7f662c0693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:28.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662b7fe700 1 --2- 172.21.15.27:0/2656374603 >> v2:172.21.15.40:3300/0 conn(0x7f662c068f00 0x7f662c0693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662b7fe700 1 -- 172.21.15.27:0/2656374603 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0c04e0 con 0x7f662c154090 2023-05-17T14:54:28.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662b7fe700 1 --2- 172.21.15.27:0/2656374603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c154090 0x7f662c154470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f661c006fd0 tx=0x7f661c0090f0).ready entity=mon.0 client_cookie=a166d082c46dbff8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:28.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662a7fc700 1 -- 172.21.15.27:0/2656374603 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00f510 con 0x7f662c154090 2023-05-17T14:54:28.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662a7fc700 1 -- 172.21.15.27:0/2656374603 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00f670 con 0x7f662c154090 2023-05-17T14:54:28.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f662a7fc700 1 -- 172.21.15.27:0/2656374603 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00f9f0 con 0x7f662c154090 2023-05-17T14:54:28.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 -- 172.21.15.27:0/2656374603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c154090 msgr2=0x7f662c154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 --2- 172.21.15.27:0/2656374603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c154090 0x7f662c154470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f661c006fd0 tx=0x7f661c0090f0).stop 2023-05-17T14:54:28.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 -- 172.21.15.27:0/2656374603 shutdown_connections 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 --2- 172.21.15.27:0/2656374603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c154090 0x7f662c154470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 --2- 172.21.15.27:0/2656374603 >> v2:172.21.15.40:3300/0 conn(0x7f662c068f00 0x7f662c0693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 --2- 172.21.15.27:0/2656374603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c0cb450 0x7f662c0cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 -- 172.21.15.27:0/2656374603 >> 172.21.15.27:0/2656374603 conn(0x7f662c05e7e0 msgr2=0x7f662c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 -- 172.21.15.27:0/2656374603 shutdown_connections 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.215+0000 7f6632083700 1 -- 172.21.15.27:0/2656374603 wait complete. 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 Processor -- start 2023-05-17T14:54:28.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 -- start start 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 0x7f662c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f662c0cb450 0x7f662c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c154090 0x7f662c0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0aecc0 con 0x7f662c068f00 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0aef60 con 0x7f662c0cb450 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f6632083700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0af240 con 0x7f662c154090 2023-05-17T14:54:28.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.217+0000 7f662b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 0x7f662c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 0x7f662c155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34980/0 (socket says 172.21.15.27:34980) 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 -- 172.21.15.27:0/2961274544 learned_addr learned my addr 172.21.15.27:0/2961274544 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662affd700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f662c0cb450 0x7f662c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662bfff700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c154090 0x7f662c0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 -- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c154090 msgr2=0x7f662c0afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c154090 0x7f662c0afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 -- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f662c0cb450 msgr2=0x7f662c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f662c0cb450 0x7f662c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 -- 172.21.15.27:0/2961274544 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c009370 con 0x7f662c068f00 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f662b7fe700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 0x7f662c155d20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f662c067f70 tx=0x7f661c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00fe80 con 0x7f662c068f00 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00f7e0 con 0x7f662c068f00 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c0af520 con 0x7f662c068f00 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c01b640 con 0x7f662c068f00 2023-05-17T14:54:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.218+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c14f300 con 0x7f662c068f00 2023-05-17T14:54:28.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.219+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c0afa40 con 0x7f662c068f00 2023-05-17T14:54:28.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.219+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f661c00f070 con 0x7f662c068f00 2023-05-17T14:54:28.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.220+0000 7f66137fe700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f661805ed90 0x7f6618061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.220+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f661c07b0b0 con 0x7f662c068f00 2023-05-17T14:54:28.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.220+0000 7f662affd700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f661805ed90 0x7f6618061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.220+0000 7f662affd700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f661805ed90 0x7f6618061250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f662c1678a0 tx=0x7f6620009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:28.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.224+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f662c0afa40 con 0x7f662c068f00 2023-05-17T14:54:28.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.441+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f662c0b0630 con 0x7f662c068f00 2023-05-17T14:54:28.668 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T14:54:28.664+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T14:54:28.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.673+0000 7f66137fe700 1 -- 172.21.15.27:0/2961274544 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f661c050080 con 0x7f662c068f00 2023-05-17T14:54:28.679 INFO:tasks.ceph.mds.c.smithi027.stderr: -1501> 2023-05-17T14:53:58.733+0000 7f8dbbec0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T14:54:28.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f661805ed90 msgr2=0x7f6618061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f661805ed90 0x7f6618061250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f662c1678a0 tx=0x7f6620009060).stop 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 msgr2=0x7f662c155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 0x7f662c155d20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f662c067f70 tx=0x7f661c017000).stop 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 shutdown_connections 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f661805ed90 0x7f6618061250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f662c154090 0x7f662c0afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f662c068f00 0x7f662c155d20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 --2- 172.21.15.27:0/2961274544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f662c0cb450 0x7f662c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 >> 172.21.15.27:0/2961274544 conn(0x7f662c05e7e0 msgr2=0x7f662c0c42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:28.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 shutdown_connections 2023-05-17T14:54:28.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.675+0000 7f6632083700 1 -- 172.21.15.27:0/2961274544 wait complete. 2023-05-17T14:54:28.682 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T14:54:28.693 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T14:54:28.701 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T14:54:28.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.806+0000 7fd95eaeb700 1 Processor -- start 2023-05-17T14:54:28.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.806+0000 7fd95eaeb700 1 -- start start 2023-05-17T14:54:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95eaeb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd9580c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95eaeb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9580c60f0 0x7fd958068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95eaeb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580c0c90 con 0x7fd9580691f0 2023-05-17T14:54:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95eaeb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580c1c50 con 0x7fd9580c60f0 2023-05-17T14:54:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95eaeb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd958158790 con 0x7fd9581543d0 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95d088700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd9580691f0 0x7fd9581547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34570/0 (socket says 172.21.15.27:34570) 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95d088700 1 -- 172.21.15.27:0/920207216 learned_addr learned my addr 172.21.15.27:0/920207216 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd95c887700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd9580c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd957fff700 1 --2- 172.21.15.27:0/920207216 >> v2:172.21.15.40:3300/0 conn(0x7fd9580c60f0 0x7fd958068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456468300 0 0) 0x7fd9580c0c90 con 0x7fd9580691f0 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.807+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9440033f0 con 0x7fd9580691f0 2023-05-17T14:54:28.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674225242 0 0) 0x7fd9440033f0 con 0x7fd9580691f0 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 msgr2=0x7fd9580c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd9580c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 >> v2:172.21.15.40:3300/0 conn(0x7fd9580c60f0 msgr2=0x7fd958068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 --2- 172.21.15.27:0/920207216 >> v2:172.21.15.40:3300/0 conn(0x7fd9580c60f0 0x7fd958068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9580c6570 con 0x7fd9580691f0 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fd940001470 con 0x7fd9580691f0 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd95c887700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd9580c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 >> v1:172.21.15.27:6789/0 conn(0x7fd9580691f0 legacy=0x7fd9581547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9440038e0 0x7fd944003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd944004690 0x7fd944004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd944005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958158790 con 0x7fd944004690 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944004470 con 0x7fd9440038e0 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94400b8e0 con 0x7fd9581543d0 2023-05-17T14:54:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd944004690 0x7fd944004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd95c887700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9440038e0 0x7fd944003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd95d088700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd944005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 -- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 msgr2=0x7fd944005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd944005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 -- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9440038e0 msgr2=0x7fd944003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9440038e0 0x7fd944003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 -- 172.21.15.27:0/920207216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500092a0 con 0x7fd944004690 2023-05-17T14:54:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd95d088700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9581543d0 0x7fd944005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd957fff700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd944004690 0x7fd944004b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fd94800e210 tx=0x7fd94800b040).ready entity=mon.0 client_cookie=da451bf5754c25d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948009ac0 con 0x7fd944004690 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800f040 con 0x7fd944004690 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.808+0000 7fd9577fe700 1 -- 172.21.15.27:0/920207216 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800ecd0 con 0x7fd944004690 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95eaeb700 1 -- 172.21.15.27:0/920207216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd944004690 msgr2=0x7fd944004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/920207216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd944004690 0x7fd944004b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fd94800e210 tx=0x7fd94800b040).stop 2023-05-17T14:54:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95d088700 1 -- 172.21.15.27:0/920207216 reap_dead start 2023-05-17T14:54:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95eaeb700 1 -- 172.21.15.27:0/920207216 shutdown_connections 2023-05-17T14:54:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95eaeb700 1 -- 172.21.15.27:0/920207216 >> 172.21.15.27:0/920207216 conn(0x7fd9580cb7f0 msgr2=0x7fd9580c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95eaeb700 1 -- 172.21.15.27:0/920207216 shutdown_connections 2023-05-17T14:54:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.809+0000 7fd95eaeb700 1 -- 172.21.15.27:0/920207216 wait complete. 2023-05-17T14:54:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.810+0000 7fd95eaeb700 1 Processor -- start 2023-05-17T14:54:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.810+0000 7fd95eaeb700 1 -- start start 2023-05-17T14:54:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95eaeb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd944004690 0x7fd958147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95eaeb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 0x7fd9580c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95eaeb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9580ac340 0x7fd9580ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95eaeb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580c3110 con 0x7fd9580c27a0 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95eaeb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580c20c0 con 0x7fd9580ac340 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95eaeb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580c3f20 con 0x7fd944004690 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 0x7fd9580c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 0x7fd9580c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35022/0 (socket says 172.21.15.27:35022) 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 -- 172.21.15.27:0/3575686058 learned_addr learned my addr 172.21.15.27:0/3575686058 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95c887700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd944004690 0x7fd958147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95d088700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9580ac340 0x7fd9580ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 -- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd944004690 msgr2=0x7fd958147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd944004690 0x7fd958147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 -- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9580ac340 msgr2=0x7fd9580ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9580ac340 0x7fd9580ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd957fff700 1 -- 172.21.15.27:0/3575686058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9580accb0 con 0x7fd9580c27a0 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.811+0000 7fd95d088700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9580ac340 0x7fd9580ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.812+0000 7fd957fff700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 0x7fd9580c2c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fd94800e800 tx=0x7fd94801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.812+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480139f0 con 0x7fd9580c27a0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.812+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948013b50 con 0x7fd9580c27a0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.812+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9580c3310 con 0x7fd9580c27a0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.812+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94801d400 con 0x7fd9580c27a0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.812+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9580c38d0 con 0x7fd9580c27a0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.813+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9580c40d0 con 0x7fd9580c27a0 2023-05-17T14:54:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.813+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd94802d070 con 0x7fd9580c27a0 2023-05-17T14:54:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.813+0000 7fd954ff9700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd93805ed90 0x7fd938061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.813+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd94807baa0 con 0x7fd9580c27a0 2023-05-17T14:54:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.813+0000 7fd95c887700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd93805ed90 0x7fd938061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.814+0000 7fd95c887700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd93805ed90 0x7fd938061250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd950006d80 tx=0x7fd950008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:28.818+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9580c40d0 con 0x7fd9580c27a0 2023-05-17T14:54:29.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.034+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd9580c4090 con 0x7fd9580c27a0 2023-05-17T14:54:29.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.676+0000 7fd954ff9700 1 -- 172.21.15.27:0/3575686058 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd94804cff0 con 0x7fd9580c27a0 2023-05-17T14:54:29.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd93805ed90 msgr2=0x7fd938061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:29.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd93805ed90 0x7fd938061250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd950006d80 tx=0x7fd950008040).stop 2023-05-17T14:54:29.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 msgr2=0x7fd9580c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 0x7fd9580c2c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fd94800e800 tx=0x7fd94801a000).stop 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 shutdown_connections 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd93805ed90 0x7fd938061250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9580ac340 0x7fd9580ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd944004690 0x7fd958147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 --2- 172.21.15.27:0/3575686058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9580c27a0 0x7fd9580c2c20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.678+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 >> 172.21.15.27:0/3575686058 conn(0x7fd9580cb7f0 msgr2=0x7fd958156aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:29.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.679+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 shutdown_connections 2023-05-17T14:54:29.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.679+0000 7fd95eaeb700 1 -- 172.21.15.27:0/3575686058 wait complete. 2023-05-17T14:54:29.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T14:54:29.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.856+0000 7f4ede43f700 1 Processor -- start 2023-05-17T14:54:29.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.856+0000 7f4ede43f700 1 -- start start 2023-05-17T14:54:29.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ede43f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ed8151c90 0x7f4ed8152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:29.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ede43f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed80c0520 0x7f4ed8081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:29.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ede43f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed8158010 con 0x7f4ed8154980 2023-05-17T14:54:29.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ede43f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8154f60 con 0x7f4ed8151c90 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ede43f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8155240 con 0x7f4ed80c0520 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ed8151c90 0x7f4ed8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.857+0000 7f4ed7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ed8151c90 0x7f4ed8152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35028/0 (socket says 172.21.15.27:35028) 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed7fff700 1 -- 172.21.15.27:0/609291217 learned_addr learned my addr 172.21.15.27:0/609291217 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4edc9dc700 1 --2- 172.21.15.27:0/609291217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed80c0520 0x7f4ed8081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed7fff700 1 -- 172.21.15.27:0/609291217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed80c0520 msgr2=0x7f4ed8081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed7fff700 1 --2- 172.21.15.27:0/609291217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed80c0520 0x7f4ed8081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed7fff700 1 -- 172.21.15.27:0/609291217 >> v1:172.21.15.40:6789/0 conn(0x7f4ed8154980 legacy=0x7f4ed80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed7fff700 1 -- 172.21.15.27:0/609291217 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8155520 con 0x7f4ed8151c90 2023-05-17T14:54:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed7fff700 1 --2- 172.21.15.27:0/609291217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8152070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f4ec8006fd0 tx=0x7f4ec80090f0).ready entity=mon.0 client_cookie=3430458bc98d014 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed77fe700 1 -- 172.21.15.27:0/609291217 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800b600 con 0x7f4ed8151c90 2023-05-17T14:54:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed77fe700 1 -- 172.21.15.27:0/609291217 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800b760 con 0x7f4ed8151c90 2023-05-17T14:54:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.858+0000 7f4ed77fe700 1 -- 172.21.15.27:0/609291217 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800bae0 con 0x7f4ed8151c90 2023-05-17T14:54:29.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 -- 172.21.15.27:0/609291217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 msgr2=0x7f4ed8152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:29.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 --2- 172.21.15.27:0/609291217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8152070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f4ec8006fd0 tx=0x7f4ec80090f0).stop 2023-05-17T14:54:29.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 -- 172.21.15.27:0/609291217 shutdown_connections 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 --2- 172.21.15.27:0/609291217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed80c0520 0x7f4ed8081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 --2- 172.21.15.27:0/609291217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8152070 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 -- 172.21.15.27:0/609291217 >> 172.21.15.27:0/609291217 conn(0x7f4ed80cae10 msgr2=0x7f4ed80cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 -- 172.21.15.27:0/609291217 shutdown_connections 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.859+0000 7f4ede43f700 1 -- 172.21.15.27:0/609291217 wait complete. 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.860+0000 7f4ede43f700 1 Processor -- start 2023-05-17T14:54:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.860+0000 7f4ede43f700 1 -- start start 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ed80c0520 0x7f4ed80aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8168850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed8154980 0x7f4ed8164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80aa6f0 con 0x7f4ed8151c90 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81652c0 con 0x7f4ed80c0520 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81655a0 con 0x7f4ed8154980 2023-05-17T14:54:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8168850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8168850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35032/0 (socket says 172.21.15.27:35032) 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 -- 172.21.15.27:0/3909876809 learned_addr learned my addr 172.21.15.27:0/3909876809 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ed7fff700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ed80c0520 0x7f4ed80aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4edc9dc700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed8154980 0x7f4ed8164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 -- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed8154980 msgr2=0x7f4ed8164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed8154980 0x7f4ed8164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 -- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ed80c0520 msgr2=0x7f4ed80aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:29.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ed80c0520 0x7f4ed80aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 -- 172.21.15.27:0/3909876809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8009370 con 0x7f4ed8151c90 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ecffff700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8168850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f4ec000c440 tx=0x7f4ec0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00123f0 con 0x7f4ed8151c90 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0001e90 con 0x7f4ed8151c90 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed8165880 con 0x7f4ed8151c90 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00127a0 con 0x7f4ed8151c90 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.861+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8168330 con 0x7f4ed8151c90 2023-05-17T14:54:29.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.862+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed806bdf0 con 0x7f4ed8151c90 2023-05-17T14:54:29.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.863+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ec0010070 con 0x7f4ed8151c90 2023-05-17T14:54:29.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.863+0000 7f4ed4ff9700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4eb805ed90 0x7f4eb8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:29.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.863+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4ec0078bd0 con 0x7f4ed8151c90 2023-05-17T14:54:29.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.863+0000 7f4ed7fff700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4eb805ed90 0x7f4eb8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:29.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.863+0000 7f4ed7fff700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4eb805ed90 0x7f4eb8061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4ec8009130 tx=0x7f4ec8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:29.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:29.867+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ec00478f0 con 0x7f4ed8151c90 2023-05-17T14:54:29.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:29.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:30.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.041+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ed8154090 con 0x7f4ed8151c90 2023-05-17T14:54:30.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.677+0000 7f4ed4ff9700 1 -- 172.21.15.27:0/3909876809 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4ec004db50 con 0x7f4ed8151c90 2023-05-17T14:54:30.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4eb805ed90 msgr2=0x7f4eb8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4eb805ed90 0x7f4eb8061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4ec8009130 tx=0x7f4ec8017000).stop 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 msgr2=0x7f4ed8168850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8168850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f4ec000c440 tx=0x7f4ec0007db0).stop 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 shutdown_connections 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4eb805ed90 0x7f4eb8061250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ed8154980 0x7f4ed8164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ed80c0520 0x7f4ed80aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 --2- 172.21.15.27:0/3909876809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ed8151c90 0x7f4ed8168850 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 >> 172.21.15.27:0/3909876809 conn(0x7f4ed80cae10 msgr2=0x7f4ed81566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:30.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 shutdown_connections 2023-05-17T14:54:30.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.679+0000 7f4ede43f700 1 -- 172.21.15.27:0/3909876809 wait complete. 2023-05-17T14:54:30.686 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T14:54:30.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T14:54:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.816+0000 7ff388928700 1 Processor -- start 2023-05-17T14:54:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.816+0000 7ff388928700 1 -- start start 2023-05-17T14:54:30.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff388928700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff3840a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff388928700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff384154a50 con 0x7ff3840c1080 2023-05-17T14:54:30.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff388928700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff384154d30 con 0x7ff384154520 2023-05-17T14:54:30.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff388928700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff384155010 con 0x7ff3840c1460 2023-05-17T14:54:30.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3837fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff3840c1080 0x7ff3840c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34600/0 (socket says 172.21.15.27:34600) 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3837fe700 1 -- 172.21.15.27:0/1151581776 learned_addr learned my addr 172.21.15.27:0/1151581776 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff383fff700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff3840a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500324736 0 0) 0x7ff384154a50 con 0x7ff3840c1080 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c0033f0 con 0x7ff3840c1080 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101298239 0 0) 0x7ff36c0033f0 con 0x7ff3840c1080 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 msgr2=0x7ff3840a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:30.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff3840a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 >> v1:172.21.15.40:6789/0 conn(0x7ff384154520 legacy=0x7ff3840c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3841552f0 con 0x7ff3840c1080 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7ff374001470 con 0x7ff3840c1080 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.817+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 >> v1:172.21.15.27:6789/0 conn(0x7ff3840c1080 legacy=0x7ff3840c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff36c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff36c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36c004b80 0x7ff36c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384155010 con 0x7ff36c003910 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c00b8e0 con 0x7ff36c004b80 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c00ba50 con 0x7ff3840c1460 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff36c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff383fff700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36c004b80 0x7ff36c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff382ffd700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff36c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 -- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 msgr2=0x7ff36c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff36c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 -- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36c004b80 msgr2=0x7ff36c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36c004b80 0x7ff36c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 -- 172.21.15.27:0/1151581776 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0033f0 con 0x7ff36c003910 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff382ffd700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840c1460 0x7ff36c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3837fe700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff36c003cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7ff37400c190 tx=0x7ff374001e70).ready entity=mon.0 client_cookie=938cc6773042a64a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374007a40 con 0x7ff36c003910 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37400ca60 con 0x7ff36c003910 2023-05-17T14:54:30.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.818+0000 7ff3827fc700 1 -- 172.21.15.27:0/1151581776 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37400cde0 con 0x7ff36c003910 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff388928700 1 -- 172.21.15.27:0/1151581776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 msgr2=0x7ff36c003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff388928700 1 --2- 172.21.15.27:0/1151581776 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff36c003cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7ff37400c190 tx=0x7ff374001e70).stop 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff383fff700 1 -- 172.21.15.27:0/1151581776 reap_dead start 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff388928700 1 -- 172.21.15.27:0/1151581776 shutdown_connections 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff388928700 1 -- 172.21.15.27:0/1151581776 >> 172.21.15.27:0/1151581776 conn(0x7ff38405dd50 msgr2=0x7ff38405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff388928700 1 -- 172.21.15.27:0/1151581776 shutdown_connections 2023-05-17T14:54:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.819+0000 7ff388928700 1 -- 172.21.15.27:0/1151581776 wait complete. 2023-05-17T14:54:30.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.820+0000 7ff388928700 1 Processor -- start 2023-05-17T14:54:30.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.820+0000 7ff388928700 1 -- start start 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff3841672f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3840c8ba0 0x7ff3840aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840af220 0x7ff384147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c9f20 con 0x7ff36c003910 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841678b0 con 0x7ff3840c8ba0 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff384167b90 con 0x7ff3840af220 2023-05-17T14:54:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff3841672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff3841672f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35050/0 (socket says 172.21.15.27:35050) 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 -- 172.21.15.27:0/713727710 learned_addr learned my addr 172.21.15.27:0/713727710 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 -- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840af220 msgr2=0x7ff384147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840af220 0x7ff384147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff382ffd700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3840c8ba0 0x7ff3840aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 -- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3840c8ba0 msgr2=0x7ff3840aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3840c8ba0 0x7ff3840aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 -- 172.21.15.27:0/713727710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384167e70 con 0x7ff36c003910 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff3837fe700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff3841672f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff37400c780 tx=0x7ff374015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740075c0 con 0x7ff36c003910 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740046b0 con 0x7ff36c003910 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff384168150 con 0x7ff36c003910 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.821+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374004a50 con 0x7ff36c003910 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.822+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3840c9020 con 0x7ff36c003910 2023-05-17T14:54:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.822+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff384047150 con 0x7ff36c003910 2023-05-17T14:54:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.823+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff37401d070 con 0x7ff36c003910 2023-05-17T14:54:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.823+0000 7ff36b7fe700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff37005ed90 0x7ff370061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.823+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7ff37407a760 con 0x7ff36c003910 2023-05-17T14:54:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.823+0000 7ff382ffd700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff37005ed90 0x7ff370061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.824+0000 7ff382ffd700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff37005ed90 0x7ff370061250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ff378000c00 tx=0x7ff378009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:30.827+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff37404be60 con 0x7ff36c003910 2023-05-17T14:54:31.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.005+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff384163f60 con 0x7ff36c003910 2023-05-17T14:54:31.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.685+0000 7ff36b7fe700 1 -- 172.21.15.27:0/713727710 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff37401a030 con 0x7ff36c003910 2023-05-17T14:54:31.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff37005ed90 msgr2=0x7ff370061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:31.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff37005ed90 0x7ff370061250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ff378000c00 tx=0x7ff378009040).stop 2023-05-17T14:54:31.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 msgr2=0x7ff3841672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:31.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff3841672f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff37400c780 tx=0x7ff374015000).stop 2023-05-17T14:54:31.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 shutdown_connections 2023-05-17T14:54:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff37005ed90 0x7ff370061250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3840af220 0x7ff384147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff36c003910 0x7ff3841672f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 --2- 172.21.15.27:0/713727710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3840c8ba0 0x7ff3840aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 >> 172.21.15.27:0/713727710 conn(0x7ff38405dd50 msgr2=0x7ff38405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 shutdown_connections 2023-05-17T14:54:31.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.687+0000 7ff388928700 1 -- 172.21.15.27:0/713727710 wait complete. 2023-05-17T14:54:31.694 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T14:54:31.705 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T14:54:31.706 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T14:54:31.706 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T14:54:31.706 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T14:54:31.706 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T14:54:31.707 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T14:54:31.707 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T14:54:31.707 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T14:54:31.707 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T14:54:31.708 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T14:54:31.708 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T14:54:31.708 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T14:54:31.708 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T14:54:31.709 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T14:54:31.709 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T14:54:31.709 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T14:54:31.715 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T14:54:31.715 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T14:54:31.716 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T14:54:31.717 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T14:54:31.719 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T14:54:31.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T14:54:31.720 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T14:54:31.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T14:54:31.758 INFO:tasks.ceph.mds.a:Started 2023-05-17T14:54:31.759 DEBUG:teuthology.parallel:result is None 2023-05-17T14:54:31.759 INFO:tasks.ceph.mds.c:Started 2023-05-17T14:54:31.760 DEBUG:teuthology.parallel:result is None 2023-05-17T14:54:31.762 INFO:tasks.ceph.mds.b:Started 2023-05-17T14:54:31.762 DEBUG:teuthology.parallel:result is None 2023-05-17T14:54:31.763 INFO:tasks.ceph.mds.d:Started 2023-05-17T14:54:31.763 DEBUG:teuthology.parallel:result is None 2023-05-17T14:54:31.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T14:54:31.836 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T14:54:31.837 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T14:54:31.843 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T14:54:31.843 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T14:54:31.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.893+0000 7f4163769700 1 Processor -- start 2023-05-17T14:54:31.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.893+0000 7f4163769700 1 -- start start 2023-05-17T14:54:31.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4163769700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f415c0c2930 0x7f415c0c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4163769700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c0673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4163769700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c155030 con 0x7f415c0692a0 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4163769700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c154180 con 0x7f415c0c2930 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4163769700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c154420 con 0x7f415c066f50 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f415c0c2930 0x7f415c0c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f415c0c2930 0x7f415c0c2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35082/0 (socket says 172.21.15.27:35082) 2023-05-17T14:54:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 -- 172.21.15.27:0/1540419991 learned_addr learned my addr 172.21.15.27:0/1540419991 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4160d04700 1 --2- 172.21.15.27:0/1540419991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c0673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 -- 172.21.15.27:0/1540419991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 msgr2=0x7f415c0673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 --2- 172.21.15.27:0/1540419991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c0673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 -- 172.21.15.27:0/1540419991 >> v1:172.21.15.40:6789/0 conn(0x7f415c0692a0 legacy=0x7f415c065bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 -- 172.21.15.27:0/1540419991 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c154700 con 0x7f415c0c2930 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.894+0000 7f4161505700 1 --2- 172.21.15.27:0/1540419991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0c2930 0x7f415c0c2d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f414c006fd0 tx=0x7f414c0090f0).ready entity=mon.0 client_cookie=79e6040af0909176 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4153fff700 1 -- 172.21.15.27:0/1540419991 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00b580 con 0x7f415c0c2930 2023-05-17T14:54:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4153fff700 1 -- 172.21.15.27:0/1540419991 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c00b6e0 con 0x7f415c0c2930 2023-05-17T14:54:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4153fff700 1 -- 172.21.15.27:0/1540419991 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00ba60 con 0x7f415c0c2930 2023-05-17T14:54:31.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 -- 172.21.15.27:0/1540419991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0c2930 msgr2=0x7f415c0c2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:31.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 --2- 172.21.15.27:0/1540419991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0c2930 0x7f415c0c2d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f414c006fd0 tx=0x7f414c0090f0).stop 2023-05-17T14:54:31.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 -- 172.21.15.27:0/1540419991 shutdown_connections 2023-05-17T14:54:31.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 --2- 172.21.15.27:0/1540419991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0c2930 0x7f415c0c2d10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 --2- 172.21.15.27:0/1540419991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c0673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 -- 172.21.15.27:0/1540419991 >> 172.21.15.27:0/1540419991 conn(0x7f415c05e7e0 msgr2=0x7f415c0c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 -- 172.21.15.27:0/1540419991 shutdown_connections 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.895+0000 7f4163769700 1 -- 172.21.15.27:0/1540419991 wait complete. 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.896+0000 7f4163769700 1 Processor -- start 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.896+0000 7f4163769700 1 -- start start 2023-05-17T14:54:31.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4163769700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4163769700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 0x7f415c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4163769700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415c0c2930 0x7f415c146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4163769700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c152800 con 0x7f415c0692a0 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4163769700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0a7270 con 0x7f415c0c2930 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4163769700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0a6660 con 0x7f415c066f50 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4160d04700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 0x7f415c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4160d04700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 0x7f415c145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35088/0 (socket says 172.21.15.27:35088) 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4160d04700 1 -- 172.21.15.27:0/4000644260 learned_addr learned my addr 172.21.15.27:0/4000644260 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4161d06700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415c0c2930 0x7f415c146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.897+0000 7f4161505700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4160d04700 1 -- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 msgr2=0x7f415c140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4160d04700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4160d04700 1 -- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415c0c2930 msgr2=0x7f415c146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4160d04700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415c0c2930 0x7f415c146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4160d04700 1 -- 172.21.15.27:0/4000644260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c009370 con 0x7f415c0692a0 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4160d04700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 0x7f415c145da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f415800e930 tx=0x7f4158009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158012600 con 0x7f415c0692a0 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4158012760 con 0x7f415c0692a0 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0a6940 con 0x7f415c0692a0 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158012ae0 con 0x7f415c0692a0 2023-05-17T14:54:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.898+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c0a6f80 con 0x7f415c0692a0 2023-05-17T14:54:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.899+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c0bd9d0 con 0x7f415c0692a0 2023-05-17T14:54:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.899+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4158022070 con 0x7f415c0692a0 2023-05-17T14:54:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.899+0000 7f41517fa700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f414005ed90 0x7f4140061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.900+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4158079af0 con 0x7f415c0692a0 2023-05-17T14:54:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.900+0000 7f4161505700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f414005ed90 0x7f4140061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.900+0000 7f4161505700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f414005ed90 0x7f4140061250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f414c009130 tx=0x7f414c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:31.904+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f415804b390 con 0x7f415c0692a0 2023-05-17T14:54:32.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.101+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f415c06a970 con 0x7f415c0692a0 2023-05-17T14:54:32.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.875+0000 7f41517fa700 1 -- 172.21.15.27:0/4000644260 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f415804e9b0 con 0x7f415c0692a0 2023-05-17T14:54:32.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f414005ed90 msgr2=0x7f4140061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f414005ed90 0x7f4140061250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f414c009130 tx=0x7f414c017000).stop 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 msgr2=0x7f415c145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 0x7f415c145da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f415800e930 tx=0x7f4158009060).stop 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 shutdown_connections 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f414005ed90 0x7f4140061250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415c0c2930 0x7f415c146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:32.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f415c066f50 0x7f415c140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:32.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 --2- 172.21.15.27:0/4000644260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f415c0692a0 0x7f415c145da0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:32.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.877+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 >> 172.21.15.27:0/4000644260 conn(0x7f415c05e7e0 msgr2=0x7f415c0c4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:32.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.878+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 shutdown_connections 2023-05-17T14:54:32.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:32.878+0000 7f4163769700 1 -- 172.21.15.27:0/4000644260 wait complete. 2023-05-17T14:54:32.884 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T14:54:32.897 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T14:54:33.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.014+0000 7f271dc2e700 1 Processor -- start 2023-05-17T14:54:33.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.015+0000 7f271dc2e700 1 -- start start 2023-05-17T14:54:33.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.015+0000 7f271dc2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27180c60c0 0x7f27180c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.015+0000 7f271dc2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 0x7f2718153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.015+0000 7f271dc2e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271805e7e0 con 0x7f27180aa3b0 2023-05-17T14:54:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.015+0000 7f271dc2e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271805eac0 con 0x7f27180c60c0 2023-05-17T14:54:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.015+0000 7f271dc2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180bfd70 con 0x7f27180a9f70 2023-05-17T14:54:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f2716ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 0x7f2718153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f2716ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 0x7f2718153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36214/0 (socket says 172.21.15.27:36214) 2023-05-17T14:54:33.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f27177fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27180c60c0 0x7f27180c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f2716ffd700 1 -- 172.21.15.27:0/1307256433 learned_addr learned my addr 172.21.15.27:0/1307256433 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f27177fe700 1 -- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 msgr2=0x7f2718153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f27177fe700 1 --2- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 0x7f2718153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f27177fe700 1 -- 172.21.15.27:0/1307256433 >> v1:172.21.15.40:6789/0 conn(0x7f27180aa3b0 legacy=0x7f2718157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f27177fe700 1 -- 172.21.15.27:0/1307256433 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180c0050 con 0x7f27180c60c0 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f2716ffd700 1 --2- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 0x7f2718153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.016+0000 7f27177fe700 1 --2- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180c60c0 0x7f27180c64a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f2708009760 tx=0x7f2708009060).ready entity=mon.1 client_cookie=4e8c9244237c6ad3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f27167fc700 1 -- 172.21.15.27:0/1307256433 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800f510 con 0x7f27180c60c0 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f27167fc700 1 -- 172.21.15.27:0/1307256433 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800f670 con 0x7f27180c60c0 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f27167fc700 1 -- 172.21.15.27:0/1307256433 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800f9f0 con 0x7f27180c60c0 2023-05-17T14:54:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 -- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180c60c0 msgr2=0x7f27180c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 --2- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180c60c0 0x7f27180c64a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f2708009760 tx=0x7f2708009060).stop 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 -- 172.21.15.27:0/1307256433 shutdown_connections 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 --2- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180c60c0 0x7f27180c64a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 --2- 172.21.15.27:0/1307256433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180a9f70 0x7f2718153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 -- 172.21.15.27:0/1307256433 >> 172.21.15.27:0/1307256433 conn(0x7f2718069e70 msgr2=0x7f271805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 -- 172.21.15.27:0/1307256433 shutdown_connections 2023-05-17T14:54:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.017+0000 7f271dc2e700 1 -- 172.21.15.27:0/1307256433 wait complete. 2023-05-17T14:54:33.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.018+0000 7f271dc2e700 1 Processor -- start 2023-05-17T14:54:33.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.018+0000 7f271dc2e700 1 -- start start 2023-05-17T14:54:33.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f271dc2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180a9f70 0x7f271814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f271dc2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 0x7f27180c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f271dc2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180c60c0 0x7f2718167bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f271dc2e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180abbb0 con 0x7f27180aa3b0 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f271dc2e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180ac9a0 con 0x7f27180a9f70 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f271dc2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271814ff40 con 0x7f27180c60c0 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f2716ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 0x7f27180c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f2716ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 0x7f27180c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35108/0 (socket says 172.21.15.27:35108) 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f2716ffd700 1 -- 172.21.15.27:0/4111174981 learned_addr learned my addr 172.21.15.27:0/4111174981 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f27177fe700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180a9f70 0x7f271814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.019+0000 7f2717fff700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180c60c0 0x7f2718167bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2716ffd700 1 -- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180c60c0 msgr2=0x7f2718167bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2716ffd700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180c60c0 0x7f2718167bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2716ffd700 1 -- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180a9f70 msgr2=0x7f271814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2716ffd700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180a9f70 0x7f271814fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2716ffd700 1 -- 172.21.15.27:0/4111174981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009370 con 0x7f27180aa3b0 2023-05-17T14:54:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2717fff700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180c60c0 0x7f2718167bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f2716ffd700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 0x7f27180c1e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f270c00ea50 tx=0x7f270c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00c850 con 0x7f27180aa3b0 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c00c9b0 con 0x7f27180aa3b0 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27080092a0 con 0x7f27180aa3b0 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00cd30 con 0x7f27180aa3b0 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.020+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27180ac070 con 0x7f27180aa3b0 2023-05-17T14:54:33.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.021+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271805f4a0 con 0x7f27180aa3b0 2023-05-17T14:54:33.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.021+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f270c022070 con 0x7f27180aa3b0 2023-05-17T14:54:33.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.021+0000 7f26ff7fe700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270405ed90 0x7f2704061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.022+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f270c079c30 con 0x7f27180aa3b0 2023-05-17T14:54:33.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.022+0000 7f27177fe700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270405ed90 0x7f2704061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.022+0000 7f27177fe700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270405ed90 0x7f2704061250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f2708009fd0 tx=0x7f2708017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.026+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f270c04b520 con 0x7f27180aa3b0 2023-05-17T14:54:33.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.269+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f271806bdf0 con 0x7f27180aa3b0 2023-05-17T14:54:33.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.270+0000 7f26ff7fe700 1 -- 172.21.15.27:0/4111174981 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f270c016020 con 0x7f27180aa3b0 2023-05-17T14:54:33.275 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:33.275 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T14:54:33.275 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T14:54:33.275 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T14:54:33.276 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.277 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T14:54:33.278 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.279 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T14:54:33.280 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.281 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.282 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T14:54:33.283 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.284 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.285 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.287 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.288 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T14:54:33.289 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T14:54:33.290 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.291 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T14:54:33.293 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.294 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T14:54:33.295 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.296 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-mds", 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBu6mRkytWnKRAAhQpvCuipZZZKiIFBAVdzVQ==", 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-mds" 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.297 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-mgr", 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBu6mRk2OCnKRAAWfX4UryrI4Mm3uh8aF6fdw==", 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-osd", 2023-05-17T14:54:33.298 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBu6mRkDemnKRAAYOnwAfIoGROl0vV9iHu0Cw==", 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-osd" 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rbd", 2023-05-17T14:54:33.299 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBu6mRka/KnKRAAACqjvNzaK+VMzWFh/WyxmA==", 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBu6mRkdvqnKRAAf3VFC4uUKrI/ZiLQ54KYfQ==", 2023-05-17T14:54:33.300 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rgw", 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBu6mRkhQKoKRAAcK2Z4xJmshWkEug1RT0A4A==", 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.301 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T14:54:33.302 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T14:54:33.303 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T14:54:33.304 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T14:54:33.304 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T14:54:33.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.304 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:33.304 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T14:54:33.304 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T14:54:33.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.271+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270405ed90 msgr2=0x7f2704061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270405ed90 0x7f2704061250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f2708009fd0 tx=0x7f2708017000).stop 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 msgr2=0x7f27180c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 0x7f27180c1e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f270c00ea50 tx=0x7f270c0090f0).stop 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 shutdown_connections 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270405ed90 0x7f2704061250 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27180c60c0 0x7f2718167bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180a9f70 0x7f271814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 --2- 172.21.15.27:0/4111174981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180aa3b0 0x7f27180c1e10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 >> 172.21.15.27:0/4111174981 conn(0x7f2718069e70 msgr2=0x7f2718156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:33.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 shutdown_connections 2023-05-17T14:54:33.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.272+0000 7f271dc2e700 1 -- 172.21.15.27:0/4111174981 wait complete. 2023-05-17T14:54:33.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-17T14:54:33.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.419+0000 7f2a5f64a700 1 Processor -- start 2023-05-17T14:54:33.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5f64a700 1 -- start start 2023-05-17T14:54:33.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5f64a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a58154090 0x7f2a58154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5f64a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a580cb450 0x7f2a580cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5f64a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580c5a50 con 0x7f2a58068f00 2023-05-17T14:54:33.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5f64a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a58069fa0 con 0x7f2a58154090 2023-05-17T14:54:33.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5f64a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a580c04e0 con 0x7f2a580cb450 2023-05-17T14:54:33.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.420+0000 7f2a5d3e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a58154090 0x7f2a58154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a58154090 0x7f2a58154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35114/0 (socket says 172.21.15.27:35114) 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 -- 172.21.15.27:0/2354854128 learned_addr learned my addr 172.21.15.27:0/2354854128 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 -- 172.21.15.27:0/2354854128 >> v2:172.21.15.40:3300/0 conn(0x7f2a580cb450 msgr2=0x7f2a580cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5cbe5700 1 --2- 172.21.15.27:0/2354854128 >> v2:172.21.15.40:3300/0 conn(0x7f2a580cb450 0x7f2a580cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 --2- 172.21.15.27:0/2354854128 >> v2:172.21.15.40:3300/0 conn(0x7f2a580cb450 0x7f2a580cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 -- 172.21.15.27:0/2354854128 >> v1:172.21.15.40:6789/0 conn(0x7f2a58068f00 legacy=0x7f2a58157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:33.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 -- 172.21.15.27:0/2354854128 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580c0760 con 0x7f2a58154090 2023-05-17T14:54:33.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5cbe5700 1 --2- 172.21.15.27:0/2354854128 >> v2:172.21.15.40:3300/0 conn(0x7f2a580cb450 0x7f2a580cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:33.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a5d3e6700 1 --2- 172.21.15.27:0/2354854128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a58154090 0x7f2a58154470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2a580bff40 tx=0x7f2a500090f0).ready entity=mon.0 client_cookie=9b9dab8aaa5e2259 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a57fff700 1 -- 172.21.15.27:0/2354854128 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000b5a0 con 0x7f2a58154090 2023-05-17T14:54:33.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a57fff700 1 -- 172.21.15.27:0/2354854128 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000b700 con 0x7f2a58154090 2023-05-17T14:54:33.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.421+0000 7f2a57fff700 1 -- 172.21.15.27:0/2354854128 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000ba80 con 0x7f2a58154090 2023-05-17T14:54:33.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 -- 172.21.15.27:0/2354854128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a58154090 msgr2=0x7f2a58154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/2354854128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a58154090 0x7f2a58154470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2a580bff40 tx=0x7f2a500090f0).stop 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 -- 172.21.15.27:0/2354854128 shutdown_connections 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/2354854128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a58154090 0x7f2a58154470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/2354854128 >> v2:172.21.15.40:3300/0 conn(0x7f2a580cb450 0x7f2a580cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 -- 172.21.15.27:0/2354854128 >> 172.21.15.27:0/2354854128 conn(0x7f2a5805e7e0 msgr2=0x7f2a580cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 -- 172.21.15.27:0/2354854128 shutdown_connections 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.422+0000 7f2a5f64a700 1 -- 172.21.15.27:0/2354854128 wait complete. 2023-05-17T14:54:33.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.423+0000 7f2a5f64a700 1 Processor -- start 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.423+0000 7f2a5f64a700 1 -- start start 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5f64a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a58068f00 0x7f2a580ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5f64a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 0x7f2a58164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5f64a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a58154090 0x7f2a580c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5f64a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58165300 con 0x7f2a580cb450 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5f64a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58157880 con 0x7f2a58154090 2023-05-17T14:54:33.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5f64a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58157b60 con 0x7f2a58068f00 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 0x7f2a58164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 0x7f2a58164e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35122/0 (socket says 172.21.15.27:35122) 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 -- 172.21.15.27:0/3813209807 learned_addr learned my addr 172.21.15.27:0/3813209807 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5dbe7700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a58154090 0x7f2a580c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5d3e6700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a58068f00 0x7f2a580ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 -- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a58068f00 msgr2=0x7f2a580ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a58068f00 0x7f2a580ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 -- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a58154090 msgr2=0x7f2a580c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a58154090 0x7f2a580c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 -- 172.21.15.27:0/3813209807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009370 con 0x7f2a580cb450 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5dbe7700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a58154090 0x7f2a580c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5d3e6700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a58068f00 0x7f2a580ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a5cbe5700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 0x7f2a58164e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f2a4c00c880 tx=0x7f2a4c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.424+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c010580 con 0x7f2a580cb450 2023-05-17T14:54:33.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.425+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c0106e0 con 0x7f2a580cb450 2023-05-17T14:54:33.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.425+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a580add90 con 0x7f2a580cb450 2023-05-17T14:54:33.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.425+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c010a60 con 0x7f2a580cb450 2023-05-17T14:54:33.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.425+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a580ae350 con 0x7f2a580cb450 2023-05-17T14:54:33.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.425+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a580c0a40 con 0x7f2a580cb450 2023-05-17T14:54:33.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.426+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2a4c01b460 con 0x7f2a580cb450 2023-05-17T14:54:33.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.426+0000 7f2a557fa700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a4405ed90 0x7f2a44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.426+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2a4c079b40 con 0x7f2a580cb450 2023-05-17T14:54:33.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.426+0000 7f2a5d3e6700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a4405ed90 0x7f2a44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.427+0000 7f2a5d3e6700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a4405ed90 0x7f2a44061250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2a50006df0 tx=0x7f2a50015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.430+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a4c04b2c0 con 0x7f2a580cb450 2023-05-17T14:54:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.670+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2a58068ae0 con 0x7f2a580cb450 2023-05-17T14:54:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.673+0000 7f2a557fa700 1 -- 172.21.15.27:0/3813209807 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v3) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2a4c04e8e0 con 0x7f2a580cb450 2023-05-17T14:54:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.675+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a4405ed90 msgr2=0x7f2a44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.675+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a4405ed90 0x7f2a44061250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2a50006df0 tx=0x7f2a50015000).stop 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.675+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 msgr2=0x7f2a58164e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.675+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 0x7f2a58164e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f2a4c00c880 tx=0x7f2a4c008040).stop 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.675+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 shutdown_connections 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2a4405ed90 0x7f2a44061250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a58154090 0x7f2a580c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a58068f00 0x7f2a580ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 --2- 172.21.15.27:0/3813209807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a580cb450 0x7f2a58164e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 >> 172.21.15.27:0/3813209807 conn(0x7f2a5805e7e0 msgr2=0x7f2a581533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:33.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 shutdown_connections 2023-05-17T14:54:33.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.676+0000 7f2a5f64a700 1 -- 172.21.15.27:0/3813209807 wait complete. 2023-05-17T14:54:33.682 INFO:teuthology.orchestra.run.smithi027.stderr:updated 2023-05-17T14:54:33.692 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-17T14:54:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.804+0000 7fba7f3b3700 1 Processor -- start 2023-05-17T14:54:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.804+0000 7fba7f3b3700 1 -- start start 2023-05-17T14:54:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7f3b3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba78154090 0x7fba78154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7f3b3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba78069610 0x7fba780cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7f3b3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba780c5a50 con 0x7fba780cb450 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7f3b3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba78069fa0 con 0x7fba78154090 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7f3b3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780c04e0 con 0x7fba78069610 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba78154090 0x7fba78154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba78154090 0x7fba78154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35128/0 (socket says 172.21.15.27:35128) 2023-05-17T14:54:33.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 -- 172.21.15.27:0/1435071576 learned_addr learned my addr 172.21.15.27:0/1435071576 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d950700 1 --2- 172.21.15.27:0/1435071576 >> v2:172.21.15.40:3300/0 conn(0x7fba78069610 0x7fba780cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 -- 172.21.15.27:0/1435071576 >> v2:172.21.15.40:3300/0 conn(0x7fba78069610 msgr2=0x7fba780cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 --2- 172.21.15.27:0/1435071576 >> v2:172.21.15.40:3300/0 conn(0x7fba78069610 0x7fba780cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 -- 172.21.15.27:0/1435071576 >> v1:172.21.15.40:6789/0 conn(0x7fba780cb450 legacy=0x7fba78068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.805+0000 7fba7d14f700 1 -- 172.21.15.27:0/1435071576 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780c0760 con 0x7fba78154090 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7d950700 1 --2- 172.21.15.27:0/1435071576 >> v2:172.21.15.40:3300/0 conn(0x7fba78069610 0x7fba780cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:33.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7d14f700 1 --2- 172.21.15.27:0/1435071576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba78154090 0x7fba78154470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fba780c1000 tx=0x7fba700090f0).ready entity=mon.0 client_cookie=4a974b05fb2114d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba77fff700 1 -- 172.21.15.27:0/1435071576 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000b5a0 con 0x7fba78154090 2023-05-17T14:54:33.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba77fff700 1 -- 172.21.15.27:0/1435071576 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7000b700 con 0x7fba78154090 2023-05-17T14:54:33.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba77fff700 1 -- 172.21.15.27:0/1435071576 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000ba80 con 0x7fba78154090 2023-05-17T14:54:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 -- 172.21.15.27:0/1435071576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba78154090 msgr2=0x7fba78154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/1435071576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba78154090 0x7fba78154470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fba780c1000 tx=0x7fba700090f0).stop 2023-05-17T14:54:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 -- 172.21.15.27:0/1435071576 shutdown_connections 2023-05-17T14:54:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/1435071576 >> v2:172.21.15.40:3300/0 conn(0x7fba78069610 0x7fba780cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/1435071576 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba78154090 0x7fba78154470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 -- 172.21.15.27:0/1435071576 >> 172.21.15.27:0/1435071576 conn(0x7fba7805e7e0 msgr2=0x7fba780cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 -- 172.21.15.27:0/1435071576 shutdown_connections 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.806+0000 7fba7f3b3700 1 -- 172.21.15.27:0/1435071576 wait complete. 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.807+0000 7fba7f3b3700 1 Processor -- start 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 -- start start 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba78069610 0x7fba78153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 0x7fba780adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba78154090 0x7fba781407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba78152160 con 0x7fba780cb450 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba78152440 con 0x7fba78069610 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7f3b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba78152720 con 0x7fba78154090 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.808+0000 7fba7c94e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 0x7fba780adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 0x7fba780adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35136/0 (socket says 172.21.15.27:35136) 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 -- 172.21.15.27:0/2673092239 learned_addr learned my addr 172.21.15.27:0/2673092239 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:33.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7d950700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba78154090 0x7fba781407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7d14f700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba78069610 0x7fba78153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 -- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba78154090 msgr2=0x7fba781407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba78154090 0x7fba781407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 -- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba78069610 msgr2=0x7fba78153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba78069610 0x7fba78153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 -- 172.21.15.27:0/2673092239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70009370 con 0x7fba780cb450 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7c94e700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 0x7fba780adf60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fba6c00c440 tx=0x7fba6c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c012400 con 0x7fba780cb450 2023-05-17T14:54:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c012580 con 0x7fba780cb450 2023-05-17T14:54:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba78152a00 con 0x7fba780cb450 2023-05-17T14:54:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c012940 con 0x7fba780cb450 2023-05-17T14:54:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.809+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba780ae450 con 0x7fba780cb450 2023-05-17T14:54:33.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.810+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba780c0a40 con 0x7fba780cb450 2023-05-17T14:54:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.811+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fba6c019030 con 0x7fba780cb450 2023-05-17T14:54:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.811+0000 7fba757fa700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba6405ed90 0x7fba64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.811+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fba6c078a50 con 0x7fba780cb450 2023-05-17T14:54:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.811+0000 7fba7d14f700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba6405ed90 0x7fba64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.811+0000 7fba7d14f700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba6405ed90 0x7fba64061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fba70009130 tx=0x7fba70015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:33.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:33.816+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba6c0488f0 con 0x7fba780cb450 2023-05-17T14:54:34.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.057+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fba7806c350 con 0x7fba780cb450 2023-05-17T14:54:34.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.061+0000 7fba757fa700 1 -- 172.21.15.27:0/2673092239 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v4) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba6c04a3f0 con 0x7fba780cb450 2023-05-17T14:54:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba6405ed90 msgr2=0x7fba64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba6405ed90 0x7fba64061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fba70009130 tx=0x7fba70015000).stop 2023-05-17T14:54:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 msgr2=0x7fba780adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 0x7fba780adf60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fba6c00c440 tx=0x7fba6c007de0).stop 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 shutdown_connections 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fba6405ed90 0x7fba64061250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba78154090 0x7fba781407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba78069610 0x7fba78153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 --2- 172.21.15.27:0/2673092239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba780cb450 0x7fba780adf60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 >> 172.21.15.27:0/2673092239 conn(0x7fba7805e7e0 msgr2=0x7fba780ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 shutdown_connections 2023-05-17T14:54:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.063+0000 7fba7f3b3700 1 -- 172.21.15.27:0/2673092239 wait complete. 2023-05-17T14:54:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:updated 2023-05-17T14:54:34.079 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-17T14:54:34.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.192+0000 7f63d482e700 1 Processor -- start 2023-05-17T14:54:34.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.192+0000 7f63d482e700 1 -- start start 2023-05-17T14:54:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63d482e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63d0154090 0x7f63d0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63d482e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63d0069610 0x7f63d00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63d482e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00c5a50 con 0x7f63d00cb450 2023-05-17T14:54:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63d482e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d0069fa0 con 0x7f63d0069610 2023-05-17T14:54:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63d482e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00c04e0 con 0x7f63d0154090 2023-05-17T14:54:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63ced9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63d0069610 0x7f63d00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63cdd9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f63d00cb450 0x7f63d0068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34708/0 (socket says 172.21.15.27:34708) 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63ced9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63d0069610 0x7f63d00cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35144/0 (socket says 172.21.15.27:35144) 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63cdd9b700 1 -- 172.21.15.27:0/1245377003 learned_addr learned my addr 172.21.15.27:0/1245377003 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.193+0000 7f63ce59c700 1 --2- 172.21.15.27:0/1245377003 >> v2:172.21.15.40:3300/0 conn(0x7f63d0154090 0x7f63d0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63ced9d700 1 -- 172.21.15.27:0/1245377003 >> v2:172.21.15.40:3300/0 conn(0x7f63d0154090 msgr2=0x7f63d0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63ced9d700 1 --2- 172.21.15.27:0/1245377003 >> v2:172.21.15.40:3300/0 conn(0x7f63d0154090 0x7f63d0154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63ced9d700 1 -- 172.21.15.27:0/1245377003 >> v1:172.21.15.27:6789/0 conn(0x7f63d00cb450 legacy=0x7f63d0068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63cd59a700 1 -- 172.21.15.27:0/1245377003 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720617953 0 0) 0x7f63d00c5a50 con 0x7f63d00cb450 2023-05-17T14:54:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63ced9d700 1 -- 172.21.15.27:0/1245377003 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00c0760 con 0x7f63d0069610 2023-05-17T14:54:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63ced9d700 1 --2- 172.21.15.27:0/1245377003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d0069610 0x7f63d00cb8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f63d00689a0 tx=0x7f63c0009780).ready entity=mon.0 client_cookie=704ef088dbebacf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63cd59a700 1 -- 172.21.15.27:0/1245377003 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000e070 con 0x7f63d0069610 2023-05-17T14:54:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63cd59a700 1 -- 172.21.15.27:0/1245377003 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000bb60 con 0x7f63d0069610 2023-05-17T14:54:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63cd59a700 1 -- 172.21.15.27:0/1245377003 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0012410 con 0x7f63d0069610 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63d482e700 1 -- 172.21.15.27:0/1245377003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d0069610 msgr2=0x7f63d00cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.194+0000 7f63d482e700 1 --2- 172.21.15.27:0/1245377003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d0069610 0x7f63d00cb8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f63d00689a0 tx=0x7f63c0009780).stop 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.195+0000 7f63d482e700 1 -- 172.21.15.27:0/1245377003 shutdown_connections 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.195+0000 7f63d482e700 1 --2- 172.21.15.27:0/1245377003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d0069610 0x7f63d00cb8d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.195+0000 7f63d482e700 1 --2- 172.21.15.27:0/1245377003 >> v2:172.21.15.40:3300/0 conn(0x7f63d0154090 0x7f63d0154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.195+0000 7f63d482e700 1 -- 172.21.15.27:0/1245377003 >> 172.21.15.27:0/1245377003 conn(0x7f63d005e7e0 msgr2=0x7f63d00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.195+0000 7f63d482e700 1 -- 172.21.15.27:0/1245377003 shutdown_connections 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.195+0000 7f63d482e700 1 -- 172.21.15.27:0/1245377003 wait complete. 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 Processor -- start 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 -- start start 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63d0069610 0x7f63d00b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 0x7f63d0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63d0154090 0x7f63d0167b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00afc90 con 0x7f63d00cb450 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00b0610 con 0x7f63d0069610 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63d482e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00af080 con 0x7f63d0154090 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.196+0000 7f63cdd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 0x7f63d0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 0x7f63d0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35150/0 (socket says 172.21.15.27:35150) 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 -- 172.21.15.27:0/2919337171 learned_addr learned my addr 172.21.15.27:0/2919337171 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63ce59c700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63d0069610 0x7f63d00b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 -- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63d0154090 msgr2=0x7f63d0167b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63ced9d700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63d0154090 0x7f63d0167b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63d0154090 0x7f63d0167b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 -- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63d0069610 msgr2=0x7f63d00b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63d0069610 0x7f63d00b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 -- 172.21.15.27:0/2919337171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009a20 con 0x7f63d00cb450 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63ce59c700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63d0069610 0x7f63d00b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63cdd9b700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 0x7f63d0152f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f63b800c4e0 tx=0x7f63b8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80072e0 con 0x7f63d00cb450 2023-05-17T14:54:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8007440 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d00af360 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80057a0 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.197+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d00af920 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.198+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d00c0a40 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.198+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f63b801a060 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.199+0000 7f63c67fc700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63b005ed90 0x7f63b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.199+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f63b80790b0 con 0x7f63d00cb450 2023-05-17T14:54:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.199+0000 7f63ce59c700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63b005ed90 0x7f63b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.199+0000 7f63ce59c700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63b005ed90 0x7f63b0061250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f63c8006d80 tx=0x7f63c8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:34.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.203+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63b804a9a0 con 0x7f63d00cb450 2023-05-17T14:54:34.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.444+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f63d006c350 con 0x7f63d00cb450 2023-05-17T14:54:34.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.448+0000 7f63c67fc700 1 -- 172.21.15.27:0/2919337171 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f63b8018070 con 0x7f63d00cb450 2023-05-17T14:54:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63b005ed90 msgr2=0x7f63b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63b005ed90 0x7f63b0061250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f63c8006d80 tx=0x7f63c8008040).stop 2023-05-17T14:54:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 msgr2=0x7f63d0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 0x7f63d0152f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f63b800c4e0 tx=0x7f63b8007c70).stop 2023-05-17T14:54:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 shutdown_connections 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f63b005ed90 0x7f63b0061250 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63d0154090 0x7f63d0167b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63d0069610 0x7f63d00b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 --2- 172.21.15.27:0/2919337171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63d00cb450 0x7f63d0152f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 >> 172.21.15.27:0/2919337171 conn(0x7f63d005e7e0 msgr2=0x7f63d00ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 shutdown_connections 2023-05-17T14:54:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.450+0000 7f63d482e700 1 -- 172.21.15.27:0/2919337171 wait complete. 2023-05-17T14:54:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:updated 2023-05-17T14:54:34.465 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-17T14:54:34.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.579+0000 7f6c015a4700 1 Processor -- start 2023-05-17T14:54:34.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.579+0000 7f6c015a4700 1 -- start start 2023-05-17T14:54:34.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6c015a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0cac00 0x7f6bfc0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6c015a4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc158010 con 0x7f6bfc153ef0 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6c015a4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc1582f0 con 0x7f6bfc157980 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6c015a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc1588b0 con 0x7f6bfc0cac00 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6c00da3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6bfc153ef0 0x7f6bfc0c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34720/0 (socket says 172.21.15.27:34720) 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6c00da3700 1 -- 172.21.15.27:0/2142322307 learned_addr learned my addr 172.21.15.27:0/2142322307 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591624888 0 0) 0x7f6bfc158010 con 0x7f6bfc153ef0 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be40033f0 con 0x7f6bfc153ef0 2023-05-17T14:54:34.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.580+0000 7f6bfbfff700 1 --2- 172.21.15.27:0/2142322307 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0cac00 0x7f6bfc0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2502283519 0 0) 0x7f6be40033f0 con 0x7f6bfc153ef0 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0cac00 msgr2=0x7f6bfc0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 --2- 172.21.15.27:0/2142322307 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0cac00 0x7f6bfc0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 >> v1:172.21.15.40:6789/0 conn(0x7f6bfc157980 legacy=0x7f6bfc1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc1585d0 con 0x7f6bfc153ef0 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f6bf40017f0 con 0x7f6bfc153ef0 2023-05-17T14:54:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfbfff700 1 --2- 172.21.15.27:0/2142322307 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0cac00 0x7f6bfc0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 >> v1:172.21.15.27:6789/0 conn(0x7f6bfc153ef0 legacy=0x7f6bfc0c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be40038e0 0x7f6be4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be4004690 0x7f6be4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6be4005050 0x7f6be400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc1588b0 con 0x7f6be4004690 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be400bf30 con 0x7f6be4005050 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be400c0f0 con 0x7f6be40038e0 2023-05-17T14:54:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be4004690 0x7f6be4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfbfff700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be40038e0 0x7f6be4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6c00da3700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6be4005050 0x7f6be400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be40038e0 msgr2=0x7f6be4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be40038e0 0x7f6be4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6be4005050 msgr2=0x7f6be400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6be4005050 0x7f6be400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6c00da3700 1 -- 172.21.15.27:0/2142322307 reap_dead start 2023-05-17T14:54:34.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/2142322307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40033f0 con 0x7f6be4004690 2023-05-17T14:54:34.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be4004690 0x7f6be4004b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6bf0001730 tx=0x7f6bf0007bb0).ready entity=mon.0 client_cookie=b5b9b72d906e033f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:34.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0007020 con 0x7f6be4004690 2023-05-17T14:54:34.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.581+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0007180 con 0x7f6be4004690 2023-05-17T14:54:34.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6bfaffd700 1 -- 172.21.15.27:0/2142322307 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0007520 con 0x7f6be4004690 2023-05-17T14:54:34.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 -- 172.21.15.27:0/2142322307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be4004690 msgr2=0x7f6be4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be4004690 0x7f6be4004b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f6bf0001730 tx=0x7f6bf0007bb0).stop 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 -- 172.21.15.27:0/2142322307 shutdown_connections 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 --2- 172.21.15.27:0/2142322307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6be4004690 0x7f6be4004b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 -- 172.21.15.27:0/2142322307 >> 172.21.15.27:0/2142322307 conn(0x7f6bfc05dd50 msgr2=0x7f6bfc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 -- 172.21.15.27:0/2142322307 shutdown_connections 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.582+0000 7f6c015a4700 1 -- 172.21.15.27:0/2142322307 wait complete. 2023-05-17T14:54:34.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.583+0000 7f6c015a4700 1 Processor -- start 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 -- start start 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be4004690 0x7f6bfc14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 0x7f6bfc151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc1521d0 0x7f6bfc0aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc168810 con 0x7f6bfc167840 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc1571c0 con 0x7f6bfc1521d0 2023-05-17T14:54:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6c015a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc14f4a0 con 0x7f6be4004690 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6bfb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 0x7f6bfc151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6bfb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 0x7f6bfc151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35172/0 (socket says 172.21.15.27:35172) 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.584+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/961787878 learned_addr learned my addr 172.21.15.27:0/961787878 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6c00da3700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc1521d0 0x7f6bfc0aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfbfff700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be4004690 0x7f6bfc14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be4004690 msgr2=0x7f6bfc14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be4004690 0x7f6bfc14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc1521d0 msgr2=0x7f6bfc0aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc1521d0 0x7f6bfc0aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfb7fe700 1 -- 172.21.15.27:0/961787878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc167cc0 con 0x7f6bfc167840 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6c00da3700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc1521d0 0x7f6bfc0aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6bfb7fe700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 0x7f6bfc151ce0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f6bf0001d20 tx=0x7f6bf0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0007020 con 0x7f6bfc167840 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0013670 con 0x7f6bfc167840 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc167f70 con 0x7f6bfc167840 2023-05-17T14:54:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0013a30 con 0x7f6bfc167840 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.585+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc168530 con 0x7f6bfc167840 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.586+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc14f270 con 0x7f6bfc167840 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.586+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6bf0010030 con 0x7f6bfc167840 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.587+0000 7f6be3fff700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6be805ed90 0x7f6be8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.587+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6bf007a170 con 0x7f6bfc167840 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.587+0000 7f6bfbfff700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6be805ed90 0x7f6be8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.587+0000 7f6bfbfff700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6be805ed90 0x7f6be8061250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f6bec00bc10 tx=0x7f6bec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:34.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.591+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bfc14f270 con 0x7f6bfc167840 2023-05-17T14:54:34.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.828+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6bfc14f270 con 0x7f6bfc167840 2023-05-17T14:54:34.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.834+0000 7f6be3fff700 1 -- 172.21.15.27:0/961787878 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6bfc14f270 con 0x7f6bfc167840 2023-05-17T14:54:34.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6be805ed90 msgr2=0x7f6be8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6be805ed90 0x7f6be8061250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f6bec00bc10 tx=0x7f6bec008040).stop 2023-05-17T14:54:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 msgr2=0x7f6bfc151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 0x7f6bfc151ce0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f6bf0001d20 tx=0x7f6bf0015000).stop 2023-05-17T14:54:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 shutdown_connections 2023-05-17T14:54:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6be805ed90 0x7f6be8061250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc1521d0 0x7f6bfc0aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6be4004690 0x7f6bfc14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 --2- 172.21.15.27:0/961787878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bfc167840 0x7f6bfc151ce0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:34.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.835+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 >> 172.21.15.27:0/961787878 conn(0x7f6bfc05dd50 msgr2=0x7f6bfc0abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:34.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.836+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 shutdown_connections 2023-05-17T14:54:34.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.836+0000 7f6c015a4700 1 -- 172.21.15.27:0/961787878 wait complete. 2023-05-17T14:54:34.841 INFO:teuthology.orchestra.run.smithi027.stderr:updated 2023-05-17T14:54:34.851 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-17T14:54:34.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.963+0000 7f7e88d1e700 1 Processor -- start 2023-05-17T14:54:35.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.963+0000 7f7e88d1e700 1 -- start start 2023-05-17T14:54:35.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e88d1e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e84153f10 0x7f7e840cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e88d1e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e840c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e88d1e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e840c61a0 0x7f7e84157c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e88d1e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e840c01c0 con 0x7f7e84153f10 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e88d1e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e840c6630 con 0x7f7e840c61a0 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e88d1e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840698b0 con 0x7f7e84069060 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e8259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e84153f10 0x7f7e840cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e8259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e84153f10 0x7f7e840cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35176/0 (socket says 172.21.15.27:35176) 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e8259c700 1 -- 172.21.15.27:0/3363183919 learned_addr learned my addr 172.21.15.27:0/3363183919 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e82d9d700 1 --2- 172.21.15.27:0/3363183919 >> v2:172.21.15.40:3300/0 conn(0x7f7e840c61a0 0x7f7e84157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e81d9b700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e840c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.964+0000 7f7e8259c700 1 -- 172.21.15.27:0/3363183919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 msgr2=0x7f7e840c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8259c700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e840c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8259c700 1 -- 172.21.15.27:0/3363183919 >> v2:172.21.15.40:3300/0 conn(0x7f7e840c61a0 msgr2=0x7f7e84157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:35.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8259c700 1 --2- 172.21.15.27:0/3363183919 >> v2:172.21.15.40:3300/0 conn(0x7f7e840c61a0 0x7f7e84157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8259c700 1 -- 172.21.15.27:0/3363183919 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84069b90 con 0x7f7e84153f10 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e81d9b700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e840c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8259c700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840cb920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f7e840843f0 tx=0x7f7e7c009840).ready entity=mon.0 client_cookie=18caeebe82d4d9a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8159a700 1 -- 172.21.15.27:0/3363183919 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00e070 con 0x7f7e84153f10 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8159a700 1 -- 172.21.15.27:0/3363183919 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00ba50 con 0x7f7e84153f10 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e8159a700 1 -- 172.21.15.27:0/3363183919 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00bdd0 con 0x7f7e84153f10 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 -- 172.21.15.27:0/3363183919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 msgr2=0x7f7e840cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840cb920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f7e840843f0 tx=0x7f7e7c009840).stop 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 -- 172.21.15.27:0/3363183919 shutdown_connections 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840cb920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/3363183919 >> v2:172.21.15.40:3300/0 conn(0x7f7e840c61a0 0x7f7e84157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/3363183919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e840c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 -- 172.21.15.27:0/3363183919 >> 172.21.15.27:0/3363183919 conn(0x7f7e8405e820 msgr2=0x7f7e840cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 -- 172.21.15.27:0/3363183919 shutdown_connections 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.965+0000 7f7e88d1e700 1 -- 172.21.15.27:0/3363183919 wait complete. 2023-05-17T14:54:35.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.966+0000 7f7e88d1e700 1 Processor -- start 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 -- start start 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e8414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e840c61a0 0x7f7e840abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840ac7e0 con 0x7f7e84153f10 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e841683b0 con 0x7f7e840c61a0 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e88d1e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84167ac0 con 0x7f7e84069060 2023-05-17T14:54:35.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e82d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e82d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35186/0 (socket says 172.21.15.27:35186) 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e82d9d700 1 -- 172.21.15.27:0/1347469498 learned_addr learned my addr 172.21.15.27:0/1347469498 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e81d9b700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e840c61a0 0x7f7e840abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.967+0000 7f7e8259c700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e8414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e82d9d700 1 -- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 msgr2=0x7f7e8414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e82d9d700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e8414cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e82d9d700 1 -- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e840c61a0 msgr2=0x7f7e840abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e82d9d700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e840c61a0 0x7f7e840abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e82d9d700 1 -- 172.21.15.27:0/1347469498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c009ae0 con 0x7f7e84153f10 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e82d9d700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840ac2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f7e7400d890 tx=0x7f7e74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74011590 con 0x7f7e84153f10 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e740116f0 con 0x7f7e84153f10 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e84167d60 con 0x7f7e84153f10 2023-05-17T14:54:35.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74011a70 con 0x7f7e84153f10 2023-05-17T14:54:35.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.968+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e840b0c90 con 0x7f7e84153f10 2023-05-17T14:54:35.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.969+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e840c5aa0 con 0x7f7e84153f10 2023-05-17T14:54:35.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.969+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7e7401c460 con 0x7f7e84153f10 2023-05-17T14:54:35.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.970+0000 7f7e7a7fc700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7e6405ed90 0x7f7e64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.970+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7e740795f0 con 0x7f7e84153f10 2023-05-17T14:54:35.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.970+0000 7f7e8259c700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7e6405ed90 0x7f7e64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.970+0000 7f7e8259c700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7e6405ed90 0x7f7e64061250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7e840843f0 tx=0x7f7e7c009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:34.974+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e7404ae80 con 0x7f7e84153f10 2023-05-17T14:54:35.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.213+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7e840bfe50 con 0x7f7e84153f10 2023-05-17T14:54:35.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.216+0000 7f7e7a7fc700 1 -- 172.21.15.27:0/1347469498 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e7404e4a0 con 0x7f7e84153f10 2023-05-17T14:54:35.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7e6405ed90 msgr2=0x7f7e64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7e6405ed90 0x7f7e64061250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7e840843f0 tx=0x7f7e7c009840).stop 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 msgr2=0x7f7e840ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840ac2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f7e7400d890 tx=0x7f7e74008040).stop 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 shutdown_connections 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7e6405ed90 0x7f7e64061250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e84153f10 0x7f7e840ac2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e84069060 0x7f7e8414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 --2- 172.21.15.27:0/1347469498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e840c61a0 0x7f7e840abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 >> 172.21.15.27:0/1347469498 conn(0x7f7e8405e820 msgr2=0x7f7e8414e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:35.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 shutdown_connections 2023-05-17T14:54:35.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.218+0000 7f7e88d1e700 1 -- 172.21.15.27:0/1347469498 wait complete. 2023-05-17T14:54:35.257 INFO:teuthology.orchestra.run.smithi027.stderr:updated 2023-05-17T14:54:35.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-17T14:54:35.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.371+0000 7fd8a1afd700 1 Processor -- start 2023-05-17T14:54:35.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.371+0000 7fd8a1afd700 1 -- start start 2023-05-17T14:54:35.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.372+0000 7fd8a1afd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c154470 0x7fd89c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.372+0000 7fd8a1afd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0c5a50 con 0x7fd89c154090 2023-05-17T14:54:35.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.372+0000 7fd8a1afd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0c04e0 con 0x7fd89c0693f0 2023-05-17T14:54:35.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.372+0000 7fd8a1afd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c069fa0 con 0x7fd89c154470 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.372+0000 7fd89b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd89c154090 0x7fd89c0cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34752/0 (socket says 172.21.15.27:34752) 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.372+0000 7fd89b7fe700 1 -- 172.21.15.27:0/147227203 learned_addr learned my addr 172.21.15.27:0/147227203 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89affd700 1 --2- 172.21.15.27:0/147227203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c154470 0x7fd89c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351703880 0 0) 0x7fd89c0c5a50 con 0x7fd89c154090 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8840033f0 con 0x7fd89c154090 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740361544 0 0) 0x7fd89c0c04e0 con 0x7fd89c0693f0 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c0c5a50 con 0x7fd89c0693f0 2023-05-17T14:54:35.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89affd700 1 -- 172.21.15.27:0/147227203 >> v1:172.21.15.40:6789/0 conn(0x7fd89c0693f0 legacy=0x7fd89c0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89affd700 1 -- 172.21.15.27:0/147227203 >> v1:172.21.15.27:6789/0 conn(0x7fd89c154090 legacy=0x7fd89c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89affd700 1 -- 172.21.15.27:0/147227203 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c069860 con 0x7fd89c154470 2023-05-17T14:54:35.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89affd700 1 --2- 172.21.15.27:0/147227203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c154470 0x7fd89c068f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd890009790 tx=0x7fd890009060).ready entity=mon.2 client_cookie=874e8fb6d0424496 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000f510 con 0x7fd89c154470 2023-05-17T14:54:35.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000f670 con 0x7fd89c154470 2023-05-17T14:54:35.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.373+0000 7fd89a7fc700 1 -- 172.21.15.27:0/147227203 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000f9f0 con 0x7fd89c154470 2023-05-17T14:54:35.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 -- 172.21.15.27:0/147227203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c154470 msgr2=0x7fd89c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/147227203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c154470 0x7fd89c068f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd890009790 tx=0x7fd890009060).stop 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 -- 172.21.15.27:0/147227203 shutdown_connections 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/147227203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c154470 0x7fd89c068f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 -- 172.21.15.27:0/147227203 >> 172.21.15.27:0/147227203 conn(0x7fd89c05e7e0 msgr2=0x7fd89c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 -- 172.21.15.27:0/147227203 shutdown_connections 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.374+0000 7fd8a1afd700 1 -- 172.21.15.27:0/147227203 wait complete. 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.375+0000 7fd8a1afd700 1 Processor -- start 2023-05-17T14:54:35.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.375+0000 7fd8a1afd700 1 -- start start 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c0693f0 0x7fd89c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89c154090 0x7fd89c165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 0x7fd89c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c155300 con 0x7fd89c154470 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c1658e0 con 0x7fd89c154090 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c166460 con 0x7fd89c0693f0 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 0x7fd89c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 0x7fd89c0c3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35200/0 (socket says 172.21.15.27:35200) 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 -- 172.21.15.27:0/2868650268 learned_addr learned my addr 172.21.15.27:0/2868650268 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89b7fe700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c0693f0 0x7fd89c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89affd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89c154090 0x7fd89c165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 -- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c0693f0 msgr2=0x7fd89c154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c0693f0 0x7fd89c154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 -- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89c154090 msgr2=0x7fd89c165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89c154090 0x7fd89c165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 -- 172.21.15.27:0/2868650268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900092a0 con 0x7fd89c154470 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89b7fe700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c0693f0 0x7fd89c154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89affd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89c154090 0x7fd89c165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd89bfff700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 0x7fd89c0c3df0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd89400c7f0 tx=0x7fd89400cbb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894002240 con 0x7fd89c154470 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8940023a0 con 0x7fd89c154470 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c165b30 con 0x7fd89c154470 2023-05-17T14:54:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940017c0 con 0x7fd89c154470 2023-05-17T14:54:35.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.376+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c1660f0 con 0x7fd89c154470 2023-05-17T14:54:35.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.378+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c1665a0 con 0x7fd89c154470 2023-05-17T14:54:35.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.378+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd894019030 con 0x7fd89c154470 2023-05-17T14:54:35.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.378+0000 7fd8837fe700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd88805ed90 0x7fd888061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.378+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd894078e80 con 0x7fd89c154470 2023-05-17T14:54:35.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.378+0000 7fd89b7fe700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd88805ed90 0x7fd888061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.378+0000 7fd89b7fe700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd88805ed90 0x7fd888061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd89c158ec0 tx=0x7fd88c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.382+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd89404e1a0 con 0x7fd89c154470 2023-05-17T14:54:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.620+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd89c0c4bf0 con 0x7fd89c154470 2023-05-17T14:54:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.625+0000 7fd8837fe700 1 -- 172.21.15.27:0/2868650268 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd89404dd90 con 0x7fd89c154470 2023-05-17T14:54:35.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd88805ed90 msgr2=0x7fd888061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd88805ed90 0x7fd888061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd89c158ec0 tx=0x7fd88c009040).stop 2023-05-17T14:54:35.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 msgr2=0x7fd89c0c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 0x7fd89c0c3df0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd89400c7f0 tx=0x7fd89400cbb0).stop 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 shutdown_connections 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd88805ed90 0x7fd888061250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd89c154470 0x7fd89c0c3df0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89c0693f0 0x7fd89c154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 --2- 172.21.15.27:0/2868650268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89c154090 0x7fd89c165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 >> 172.21.15.27:0/2868650268 conn(0x7fd89c05e7e0 msgr2=0x7fd89c0ad2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:35.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 shutdown_connections 2023-05-17T14:54:35.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.627+0000 7fd8a1afd700 1 -- 172.21.15.27:0/2868650268 wait complete. 2023-05-17T14:54:35.633 INFO:teuthology.orchestra.run.smithi027.stderr:updated 2023-05-17T14:54:35.643 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 Processor -- start 2023-05-17T14:54:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 -- start start 2023-05-17T14:54:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6000c5f30 0x7fc6000c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc600158880 0x7fc600153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6001541c0 0x7fc6000c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6000bfcd0 con 0x7fc600158880 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6000c0290 con 0x7fc6000c5f30 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.756+0000 7fc607069700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000aa1a0 con 0x7fc6001541c0 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc600158880 0x7fc600153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc600158880 0x7fc600153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35206/0 (socket says 172.21.15.27:35206) 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 -- 172.21.15.27:0/3905067566 learned_addr learned my addr 172.21.15.27:0/3905067566 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc605606700 1 --2- 172.21.15.27:0/3905067566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6001541c0 0x7fc6000c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc604e05700 1 --2- 172.21.15.27:0/3905067566 >> v2:172.21.15.40:3300/0 conn(0x7fc6000c5f30 0x7fc6000c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 -- 172.21.15.27:0/3905067566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6001541c0 msgr2=0x7fc6000c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 --2- 172.21.15.27:0/3905067566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6001541c0 0x7fc6000c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 -- 172.21.15.27:0/3905067566 >> v2:172.21.15.40:3300/0 conn(0x7fc6000c5f30 msgr2=0x7fc6000c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 --2- 172.21.15.27:0/3905067566 >> v2:172.21.15.40:3300/0 conn(0x7fc6000c5f30 0x7fc6000c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 -- 172.21.15.27:0/3905067566 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000aa480 con 0x7fc600158880 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5fffff700 1 --2- 172.21.15.27:0/3905067566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc600158880 0x7fc600153cd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fc600083a50 tx=0x7fc5f40090f0).ready entity=mon.0 client_cookie=88bc71bc74aeadca server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5ff7fe700 1 -- 172.21.15.27:0/3905067566 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400b600 con 0x7fc600158880 2023-05-17T14:54:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5ff7fe700 1 -- 172.21.15.27:0/3905067566 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f400b760 con 0x7fc600158880 2023-05-17T14:54:35.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.757+0000 7fc5ff7fe700 1 -- 172.21.15.27:0/3905067566 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400bae0 con 0x7fc600158880 2023-05-17T14:54:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 -- 172.21.15.27:0/3905067566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc600158880 msgr2=0x7fc600153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 --2- 172.21.15.27:0/3905067566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc600158880 0x7fc600153cd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fc600083a50 tx=0x7fc5f40090f0).stop 2023-05-17T14:54:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 -- 172.21.15.27:0/3905067566 shutdown_connections 2023-05-17T14:54:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 --2- 172.21.15.27:0/3905067566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6001541c0 0x7fc6000c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 --2- 172.21.15.27:0/3905067566 >> v2:172.21.15.40:3300/0 conn(0x7fc6000c5f30 0x7fc6000c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 --2- 172.21.15.27:0/3905067566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc600158880 0x7fc600153cd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 -- 172.21.15.27:0/3905067566 >> 172.21.15.27:0/3905067566 conn(0x7fc600069e70 msgr2=0x7fc60005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 -- 172.21.15.27:0/3905067566 shutdown_connections 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.758+0000 7fc607069700 1 -- 172.21.15.27:0/3905067566 wait complete. 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.759+0000 7fc607069700 1 Processor -- start 2023-05-17T14:54:35.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.759+0000 7fc607069700 1 -- start start 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc607069700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 0x7fc600154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc607069700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001541c0 0x7fc600155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc607069700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc600158880 0x7fc6000c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc607069700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600165380 con 0x7fc6000c5f30 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc607069700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600164800 con 0x7fc6001541c0 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc607069700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc600164ae0 con 0x7fc600158880 2023-05-17T14:54:35.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 0x7fc600154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 0x7fc600154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35212/0 (socket says 172.21.15.27:35212) 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 -- 172.21.15.27:0/1862238233 learned_addr learned my addr 172.21.15.27:0/1862238233 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc5fffff700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001541c0 0x7fc600155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc605606700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc600158880 0x7fc6000c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 -- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc600158880 msgr2=0x7fc6000c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc600158880 0x7fc6000c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 -- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001541c0 msgr2=0x7fc600155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001541c0 0x7fc600155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 -- 172.21.15.27:0/1862238233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4009370 con 0x7fc6000c5f30 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.760+0000 7fc604e05700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 0x7fc600154650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fc5f800e190 tx=0x7fc5f8009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.761+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800ecd0 con 0x7fc6000c5f30 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.761+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800ee30 con 0x7fc6000c5f30 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.761+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc600164dc0 con 0x7fc6000c5f30 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.761+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8014610 con 0x7fc6000c5f30 2023-05-17T14:54:35.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.761+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600154b40 con 0x7fc6000c5f30 2023-05-17T14:54:35.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.762+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc600167a80 con 0x7fc6000c5f30 2023-05-17T14:54:35.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.762+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc5f801b030 con 0x7fc6000c5f30 2023-05-17T14:54:35.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.762+0000 7fc5fcff9700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc5ec05ed90 0x7fc5ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:35.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.763+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc5f8079b00 con 0x7fc6000c5f30 2023-05-17T14:54:35.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.763+0000 7fc5fffff700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc5ec05ed90 0x7fc5ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:35.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.763+0000 7fc5fffff700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc5ec05ed90 0x7fc5ec061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fc5f4009130 tx=0x7fc5f4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:35.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.767+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc600167a80 con 0x7fc6000c5f30 2023-05-17T14:54:35.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.940+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc600167a80 con 0x7fc6000c5f30 2023-05-17T14:54:35.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.941+0000 7fc5fcff9700 1 -- 172.21.15.27:0/1862238233 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13712 (secure 0 0 0) 0x7fc5f804b3f0 con 0x7fc6000c5f30 2023-05-17T14:54:35.945 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:35.945 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:54:32.873278+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:35.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc5ec05ed90 msgr2=0x7fc5ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc5ec05ed90 0x7fc5ec061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fc5f4009130 tx=0x7fc5f4017000).stop 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 msgr2=0x7fc600154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 0x7fc600154650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fc5f800e190 tx=0x7fc5f8009920).stop 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 shutdown_connections 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc5ec05ed90 0x7fc5ec061250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc600158880 0x7fc6000c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6000c5f30 0x7fc600154650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 --2- 172.21.15.27:0/1862238233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001541c0 0x7fc600155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:35.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.942+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 >> 172.21.15.27:0/1862238233 conn(0x7fc600069e70 msgr2=0x7fc6000ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:35.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.943+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 shutdown_connections 2023-05-17T14:54:35.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:35.943+0000 7fc607069700 1 -- 172.21.15.27:0/1862238233 wait complete. 2023-05-17T14:54:35.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T14:54:35.959 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T14:54:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.074+0000 7f85b56e4700 1 Processor -- start 2023-05-17T14:54:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.074+0000 7f85b56e4700 1 -- start start 2023-05-17T14:54:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85b56e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c5b10 0x7f85b00c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85b56e4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f85b00c0300 0x7f85b00c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85b56e4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b0157c20 con 0x7f85b01544f0 2023-05-17T14:54:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85b56e4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b0154970 con 0x7f85b00c0300 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85b56e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b0154b70 con 0x7f85b00c5b10 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85af7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f85b00c0300 0x7f85b00c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85ae7fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f85b01544f0 0x7f85b00a9dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34782/0 (socket says 172.21.15.27:34782) 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85ae7fc700 1 -- 172.21.15.27:0/2140099423 learned_addr learned my addr 172.21.15.27:0/2140099423 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85aeffd700 1 --2- 172.21.15.27:0/2140099423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c5b10 0x7f85b00c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85af7fe700 1 -- 172.21.15.27:0/2140099423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c5b10 msgr2=0x7f85b00c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:36.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85af7fe700 1 --2- 172.21.15.27:0/2140099423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c5b10 0x7f85b00c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85af7fe700 1 -- 172.21.15.27:0/2140099423 >> v1:172.21.15.27:6789/0 conn(0x7f85b01544f0 legacy=0x7f85b00a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85adffb700 1 -- 172.21.15.27:0/2140099423 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249302462 0 0) 0x7f85b0157c20 con 0x7f85b01544f0 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85af7fe700 1 -- 172.21.15.27:0/2140099423 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0154e50 con 0x7f85b00c0300 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85af7fe700 1 --2- 172.21.15.27:0/2140099423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b00c0300 0x7f85b00c77b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f85a0009e60 tx=0x7f85a0009780).ready entity=mon.0 client_cookie=a591a5d0e3f656ca server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85adffb700 1 -- 172.21.15.27:0/2140099423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a000e070 con 0x7f85b00c0300 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85adffb700 1 -- 172.21.15.27:0/2140099423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a000bb60 con 0x7f85b00c0300 2023-05-17T14:54:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.075+0000 7f85adffb700 1 -- 172.21.15.27:0/2140099423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0012410 con 0x7f85b00c0300 2023-05-17T14:54:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 -- 172.21.15.27:0/2140099423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b00c0300 msgr2=0x7f85b00c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 --2- 172.21.15.27:0/2140099423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b00c0300 0x7f85b00c77b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f85a0009e60 tx=0x7f85a0009780).stop 2023-05-17T14:54:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 -- 172.21.15.27:0/2140099423 shutdown_connections 2023-05-17T14:54:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 --2- 172.21.15.27:0/2140099423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b00c0300 0x7f85b00c77b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 --2- 172.21.15.27:0/2140099423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c5b10 0x7f85b00c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 -- 172.21.15.27:0/2140099423 >> 172.21.15.27:0/2140099423 conn(0x7f85b005dd50 msgr2=0x7f85b005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 -- 172.21.15.27:0/2140099423 shutdown_connections 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.076+0000 7f85b56e4700 1 -- 172.21.15.27:0/2140099423 wait complete. 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.077+0000 7f85b56e4700 1 Processor -- start 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.077+0000 7f85b56e4700 1 -- start start 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85b56e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c0300 0x7f85b0164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85b56e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b00c5b10 0x7f85b01672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85b56e4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 0x7f85b01677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85b56e4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b0167c90 con 0x7f85b01544f0 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85b56e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00ac810 con 0x7f85b00c5b10 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85b56e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00af760 con 0x7f85b00c0300 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 0x7f85b01677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 0x7f85b01677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35226/0 (socket says 172.21.15.27:35226) 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 -- 172.21.15.27:0/1527375995 learned_addr learned my addr 172.21.15.27:0/1527375995 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:36.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85ae7fc700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b00c5b10 0x7f85b01672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85aeffd700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c0300 0x7f85b0164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 -- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c0300 msgr2=0x7f85b0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c0300 0x7f85b0164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 -- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b00c5b10 msgr2=0x7f85b01672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b00c5b10 0x7f85b01672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85af7fe700 1 -- 172.21.15.27:0/1527375995 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009a20 con 0x7f85b01544f0 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.078+0000 7f85aeffd700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c0300 0x7f85b0164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:36.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85ae7fc700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b00c5b10 0x7f85b01672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85af7fe700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 0x7f85b01677a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f85a000b6c0 tx=0x7f85a0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0021070 con 0x7f85b01544f0 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a001d630 con 0x7f85b01544f0 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b00aeb90 con 0x7f85b01544f0 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a001d9d0 con 0x7f85b01544f0 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.079+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b00af110 con 0x7f85b01544f0 2023-05-17T14:54:36.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.080+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b00689b0 con 0x7f85b01544f0 2023-05-17T14:54:36.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.080+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f85a0026410 con 0x7f85b01544f0 2023-05-17T14:54:36.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.080+0000 7f85a6ffd700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f859005ed90 0x7f8590061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.081+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f85a007baa0 con 0x7f85b01544f0 2023-05-17T14:54:36.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.081+0000 7f85aeffd700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f859005ed90 0x7f8590061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.081+0000 7f85aeffd700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f859005ed90 0x7f8590061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f85a8006d80 tx=0x7f85a8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.085+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f85a004d330 con 0x7f85b01544f0 2023-05-17T14:54:36.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.254+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f85b0047150 con 0x7f85b01544f0 2023-05-17T14:54:36.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.254+0000 7f85a6ffd700 1 -- 172.21.15.27:0/1527375995 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f85a0050950 con 0x7f85b01544f0 2023-05-17T14:54:36.258 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T14:54:36.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f859005ed90 msgr2=0x7f8590061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f859005ed90 0x7f8590061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f85a8006d80 tx=0x7f85a8008040).stop 2023-05-17T14:54:36.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 msgr2=0x7f85b01677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 0x7f85b01677a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f85a000b6c0 tx=0x7f85a0009780).stop 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 shutdown_connections 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f859005ed90 0x7f8590061250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85b01544f0 0x7f85b01677a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85b00c0300 0x7f85b0164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 --2- 172.21.15.27:0/1527375995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b00c5b10 0x7f85b01672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 >> 172.21.15.27:0/1527375995 conn(0x7f85b005dd50 msgr2=0x7f85b0068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:36.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 shutdown_connections 2023-05-17T14:54:36.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.256+0000 7f85b56e4700 1 -- 172.21.15.27:0/1527375995 wait complete. 2023-05-17T14:54:36.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T14:54:36.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.386+0000 7fad8a1a8700 1 Processor -- start 2023-05-17T14:54:36.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.387+0000 7fad8a1a8700 1 -- start start 2023-05-17T14:54:36.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.387+0000 7fad8a1a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad840a9e90 0x7fad840bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.387+0000 7fad8a1a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad840c0480 0x7fad84157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad8a1a8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84154840 con 0x7fad84153d50 2023-05-17T14:54:36.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad8a1a8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad84157b00 con 0x7fad840c0480 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad8a1a8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84155310 con 0x7fad840a9e90 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad899a7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fad840c0480 0x7fad84157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad891a6700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fad84153d50 0x7fad84154130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34794/0 (socket says 172.21.15.27:34794) 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad891a6700 1 -- 172.21.15.27:0/990249926 learned_addr learned my addr 172.21.15.27:0/990249926 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad83fff700 1 -- 172.21.15.27:0/990249926 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660595202 0 0) 0x7fad84154840 con 0x7fad84153d50 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad83fff700 1 -- 172.21.15.27:0/990249926 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0033f0 con 0x7fad84153d50 2023-05-17T14:54:36.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad889a5700 1 --2- 172.21.15.27:0/990249926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad840a9e90 0x7fad840bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad899a7700 1 -- 172.21.15.27:0/990249926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad840a9e90 msgr2=0x7fad840bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad899a7700 1 --2- 172.21.15.27:0/990249926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad840a9e90 0x7fad840bff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad899a7700 1 -- 172.21.15.27:0/990249926 >> v1:172.21.15.27:6789/0 conn(0x7fad84153d50 legacy=0x7fad84154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad899a7700 1 -- 172.21.15.27:0/990249926 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84154a70 con 0x7fad840c0480 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad899a7700 1 --2- 172.21.15.27:0/990249926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840c0480 0x7fad84157f90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fad74009760 tx=0x7fad74009060).ready entity=mon.0 client_cookie=d53c9046a1593318 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad83fff700 1 -- 172.21.15.27:0/990249926 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400f510 con 0x7fad840c0480 2023-05-17T14:54:36.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad83fff700 1 -- 172.21.15.27:0/990249926 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400f670 con 0x7fad840c0480 2023-05-17T14:54:36.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.388+0000 7fad83fff700 1 -- 172.21.15.27:0/990249926 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400f9f0 con 0x7fad840c0480 2023-05-17T14:54:36.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 -- 172.21.15.27:0/990249926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840c0480 msgr2=0x7fad84157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/990249926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840c0480 0x7fad84157f90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fad74009760 tx=0x7fad74009060).stop 2023-05-17T14:54:36.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 -- 172.21.15.27:0/990249926 shutdown_connections 2023-05-17T14:54:36.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/990249926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840c0480 0x7fad84157f90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/990249926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad840a9e90 0x7fad840bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 -- 172.21.15.27:0/990249926 >> 172.21.15.27:0/990249926 conn(0x7fad8405dd50 msgr2=0x7fad8405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 -- 172.21.15.27:0/990249926 shutdown_connections 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.389+0000 7fad8a1a8700 1 -- 172.21.15.27:0/990249926 wait complete. 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.390+0000 7fad8a1a8700 1 Processor -- start 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.390+0000 7fad8a1a8700 1 -- start start 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad8a1a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 0x7fad8414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad8a1a8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad840c0480 0x7fad84156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad8a1a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84153d50 0x7fad84156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad8a1a8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84156e50 con 0x7fad840a9e90 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad8a1a8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840c28f0 con 0x7fad840c0480 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad8a1a8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840c1ce0 con 0x7fad84153d50 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 0x7fad8414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 0x7fad8414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35238/0 (socket says 172.21.15.27:35238) 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 -- 172.21.15.27:0/1215408363 learned_addr learned my addr 172.21.15.27:0/1215408363 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad889a5700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad840c0480 0x7fad84156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad899a7700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84153d50 0x7fad84156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 -- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84153d50 msgr2=0x7fad84156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84153d50 0x7fad84156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 -- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad840c0480 msgr2=0x7fad84156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad840c0480 0x7fad84156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 -- 172.21.15.27:0/1215408363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad740092a0 con 0x7fad840a9e90 2023-05-17T14:54:36.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad899a7700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84153d50 0x7fad84156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.391+0000 7fad891a6700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 0x7fad8414e100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fad7c00c820 tx=0x7fad7c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.392+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c005d30 con 0x7fad840a9e90 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.392+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c005e90 con 0x7fad840a9e90 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.392+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad840c1fc0 con 0x7fad840a9e90 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.392+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c007320 con 0x7fad840a9e90 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.392+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad840c2580 con 0x7fad840a9e90 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.393+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84047150 con 0x7fad840a9e90 2023-05-17T14:54:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.393+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fad7c010030 con 0x7fad840a9e90 2023-05-17T14:54:36.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.393+0000 7fad817fa700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fad7005ed90 0x7fad70061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.393+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fad7c079740 con 0x7fad840a9e90 2023-05-17T14:54:36.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.393+0000 7fad889a5700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fad7005ed90 0x7fad70061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.394+0000 7fad889a5700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fad7005ed90 0x7fad70061250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fad840c31e0 tx=0x7fad78008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.397+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad7c04b030 con 0x7fad840a9e90 2023-05-17T14:54:36.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.571+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad840bfd70 con 0x7fad840a9e90 2023-05-17T14:54:36.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.572+0000 7fad817fa700 1 -- 172.21.15.27:0/1215408363 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad7c04e650 con 0x7fad840a9e90 2023-05-17T14:54:36.576 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T14:54:36.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.573+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fad7005ed90 msgr2=0x7fad70061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.573+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fad7005ed90 0x7fad70061250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fad840c31e0 tx=0x7fad78008040).stop 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.573+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 msgr2=0x7fad8414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.573+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 0x7fad8414e100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fad7c00c820 tx=0x7fad7c001650).stop 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 shutdown_connections 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fad7005ed90 0x7fad70061250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84153d50 0x7fad84156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad840a9e90 0x7fad8414e100 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 --2- 172.21.15.27:0/1215408363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad840c0480 0x7fad84156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 >> 172.21.15.27:0/1215408363 conn(0x7fad8405dd50 msgr2=0x7fad840c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:36.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 shutdown_connections 2023-05-17T14:54:36.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.574+0000 7fad8a1a8700 1 -- 172.21.15.27:0/1215408363 wait complete. 2023-05-17T14:54:36.589 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T14:54:36.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.701+0000 7f501759e700 1 Processor -- start 2023-05-17T14:54:36.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.701+0000 7f501759e700 1 -- start start 2023-05-17T14:54:36.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f501759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50181544f0 0x7f50180a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f501759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 0x7f50180c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f501759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50181549b0 con 0x7f50180c1180 2023-05-17T14:54:36.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f501759e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5018154c90 con 0x7f50181544f0 2023-05-17T14:54:36.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f501759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5018154f70 con 0x7f50180aa070 2023-05-17T14:54:36.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f5016d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 0x7f50180c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f5016d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 0x7f50180c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36360/0 (socket says 172.21.15.27:36360) 2023-05-17T14:54:36.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f5016d9d700 1 -- 172.21.15.27:0/2367717898 learned_addr learned my addr 172.21.15.27:0/2367717898 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:36.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f5015d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50181544f0 0x7f50180a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.702+0000 7f501659c700 1 --1- 172.21.15.27:0/2367717898 >> v1:172.21.15.40:6789/0 conn(0x7f50180c1180 0x7f50180c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40810/0 (socket says 172.21.15.27:40810) 2023-05-17T14:54:36.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f5016d9d700 1 -- 172.21.15.27:0/2367717898 >> v2:172.21.15.40:3300/0 conn(0x7f50181544f0 msgr2=0x7f50180a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:36.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f5016d9d700 1 --2- 172.21.15.27:0/2367717898 >> v2:172.21.15.40:3300/0 conn(0x7f50181544f0 0x7f50180a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f5016d9d700 1 -- 172.21.15.27:0/2367717898 >> v1:172.21.15.40:6789/0 conn(0x7f50180c1180 legacy=0x7f50180c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f5016d9d700 1 -- 172.21.15.27:0/2367717898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018155250 con 0x7f50180aa070 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f5015d9b700 1 --2- 172.21.15.27:0/2367717898 >> v2:172.21.15.40:3300/0 conn(0x7f50181544f0 0x7f50180a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f5016d9d700 1 --2- 172.21.15.27:0/2367717898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 0x7f50180c74a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5010009f20 tx=0x7f5010009840).ready entity=mon.2 client_cookie=8f59d67468b7f9d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501559a700 1 -- 172.21.15.27:0/2367717898 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000e070 con 0x7f50180aa070 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501559a700 1 -- 172.21.15.27:0/2367717898 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000b9d0 con 0x7f50180aa070 2023-05-17T14:54:36.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501559a700 1 -- 172.21.15.27:0/2367717898 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000bd50 con 0x7f50180aa070 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 -- 172.21.15.27:0/2367717898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 msgr2=0x7f50180c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 --2- 172.21.15.27:0/2367717898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 0x7f50180c74a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5010009f20 tx=0x7f5010009840).stop 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 -- 172.21.15.27:0/2367717898 shutdown_connections 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 --2- 172.21.15.27:0/2367717898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50180aa070 0x7f50180c74a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 --2- 172.21.15.27:0/2367717898 >> v2:172.21.15.40:3300/0 conn(0x7f50181544f0 0x7f50180a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 -- 172.21.15.27:0/2367717898 >> 172.21.15.27:0/2367717898 conn(0x7f501805dd50 msgr2=0x7f501805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 -- 172.21.15.27:0/2367717898 shutdown_connections 2023-05-17T14:54:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.703+0000 7f501759e700 1 -- 172.21.15.27:0/2367717898 wait complete. 2023-05-17T14:54:36.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.704+0000 7f501759e700 1 Processor -- start 2023-05-17T14:54:36.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 -- start start 2023-05-17T14:54:36.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50180aa070 0x7f5018149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 0x7f50180cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50181544f0 0x7f501814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50180cb900 con 0x7f50180c1180 2023-05-17T14:54:36.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501813bf10 con 0x7f50180aa070 2023-05-17T14:54:36.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f501759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180c96c0 con 0x7f50181544f0 2023-05-17T14:54:36.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f5015d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 0x7f50180cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f5015d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 0x7f50180cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35254/0 (socket says 172.21.15.27:35254) 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.705+0000 7f5015d9b700 1 -- 172.21.15.27:0/4023478720 learned_addr learned my addr 172.21.15.27:0/4023478720 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5016d9d700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50181544f0 0x7f501814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f501659c700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50180aa070 0x7f5018149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5015d9b700 1 -- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50181544f0 msgr2=0x7f501814bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5015d9b700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50181544f0 0x7f501814bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5015d9b700 1 -- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50180aa070 msgr2=0x7f5018149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5015d9b700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50180aa070 0x7f5018149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5015d9b700 1 -- 172.21.15.27:0/4023478720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0092a0 con 0x7f50180c1180 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f501659c700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50180aa070 0x7f5018149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f5015d9b700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 0x7f50180cb410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f500c00e980 tx=0x7f500c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00c850 con 0x7f50180c1180 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c00c9b0 con 0x7f50180c1180 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00cd30 con 0x7f50180c1180 2023-05-17T14:54:36.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5010009ae0 con 0x7f50180c1180 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.706+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50180c9070 con 0x7f50180c1180 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.707+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50180c9830 con 0x7f50180c1180 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.707+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f500c022070 con 0x7f50180c1180 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.708+0000 7f50067fc700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff805ed90 0x7f4ff8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.708+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f500c079ca0 con 0x7f50180c1180 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.708+0000 7f501659c700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff805ed90 0x7f4ff8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.708+0000 7f501659c700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff805ed90 0x7f4ff8061250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f50080016b0 tx=0x7f5008009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:36.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.712+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f500c07e070 con 0x7f50180c1180 2023-05-17T14:54:36.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.889+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f501806bdf0 con 0x7f50180c1180 2023-05-17T14:54:36.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.890+0000 7f50067fc700 1 -- 172.21.15.27:0/4023478720 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7f500c04b590 con 0x7f50180c1180 2023-05-17T14:54:36.894 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:36.894 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T14:54:36.894 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:36.894 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:36.895 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T14:54:36.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff805ed90 msgr2=0x7f4ff8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff805ed90 0x7f4ff8061250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f50080016b0 tx=0x7f5008009040).stop 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 msgr2=0x7f50180cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 0x7f50180cb410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f500c00e980 tx=0x7f500c009060).stop 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 shutdown_connections 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff805ed90 0x7f4ff8061250 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50181544f0 0x7f501814bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50180aa070 0x7f5018149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 --2- 172.21.15.27:0/4023478720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50180c1180 0x7f50180cb410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:36.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 >> 172.21.15.27:0/4023478720 conn(0x7f501805dd50 msgr2=0x7f50180ac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:36.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 shutdown_connections 2023-05-17T14:54:36.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:36.892+0000 7f501759e700 1 -- 172.21.15.27:0/4023478720 wait complete. 2023-05-17T14:54:36.907 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T14:54:36.908 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T14:54:37.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.024+0000 7f649143d700 1 Processor -- start 2023-05-17T14:54:37.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.024+0000 7f649143d700 1 -- start start 2023-05-17T14:54:37.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f649143d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f648c1540a0 0x7f648c0be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f649143d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c154480 0x7f648c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f649143d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0beae0 con 0x7f648c067db0 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f649143d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0bedc0 con 0x7f648c1540a0 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f649143d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0bf0a0 con 0x7f648c154480 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f648c1540a0 0x7f648c0be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f648c1540a0 0x7f648c0be120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35260/0 (socket says 172.21.15.27:35260) 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 -- 172.21.15.27:0/1207435350 learned_addr learned my addr 172.21.15.27:0/1207435350 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:37.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648b7fe700 1 --2- 172.21.15.27:0/1207435350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c154480 0x7f648c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 -- 172.21.15.27:0/1207435350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c154480 msgr2=0x7f648c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 --2- 172.21.15.27:0/1207435350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c154480 0x7f648c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 -- 172.21.15.27:0/1207435350 >> v1:172.21.15.40:6789/0 conn(0x7f648c067db0 legacy=0x7f648c063f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.025+0000 7f648affd700 1 -- 172.21.15.27:0/1207435350 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0bf380 con 0x7f648c1540a0 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f648affd700 1 --2- 172.21.15.27:0/1207435350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c1540a0 0x7f648c0be120 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6484009f20 tx=0x7f6484009840).ready entity=mon.0 client_cookie=75c5a2132d129530 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f6489ffb700 1 -- 172.21.15.27:0/1207435350 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400e070 con 0x7f648c1540a0 2023-05-17T14:54:37.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f6489ffb700 1 -- 172.21.15.27:0/1207435350 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400ba80 con 0x7f648c1540a0 2023-05-17T14:54:37.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f6489ffb700 1 -- 172.21.15.27:0/1207435350 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400be00 con 0x7f648c1540a0 2023-05-17T14:54:37.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 -- 172.21.15.27:0/1207435350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c1540a0 msgr2=0x7f648c0be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 --2- 172.21.15.27:0/1207435350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c1540a0 0x7f648c0be120 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6484009f20 tx=0x7f6484009840).stop 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 -- 172.21.15.27:0/1207435350 shutdown_connections 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 --2- 172.21.15.27:0/1207435350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c154480 0x7f648c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 --2- 172.21.15.27:0/1207435350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c1540a0 0x7f648c0be120 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 -- 172.21.15.27:0/1207435350 >> 172.21.15.27:0/1207435350 conn(0x7f648c0c8ad0 msgr2=0x7f648c0c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 -- 172.21.15.27:0/1207435350 shutdown_connections 2023-05-17T14:54:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.026+0000 7f649143d700 1 -- 172.21.15.27:0/1207435350 wait complete. 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.027+0000 7f649143d700 1 Processor -- start 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 -- start start 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c067db0 0x7f648c165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f648c1540a0 0x7f648c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 0x7f648c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c14ee20 con 0x7f648c150250 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c165870 con 0x7f648c1540a0 2023-05-17T14:54:37.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f649143d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c150ba0 con 0x7f648c067db0 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f648b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 0x7f648c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f648b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 0x7f648c1506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35270/0 (socket says 172.21.15.27:35270) 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f648b7fe700 1 -- 172.21.15.27:0/2336350983 learned_addr learned my addr 172.21.15.27:0/2336350983 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f648affd700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c067db0 0x7f648c165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.028+0000 7f648a7fc700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f648c1540a0 0x7f648c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f648b7fe700 1 -- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c067db0 msgr2=0x7f648c165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f648b7fe700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c067db0 0x7f648c165380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f648b7fe700 1 -- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f648c1540a0 msgr2=0x7f648c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f648b7fe700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f648c1540a0 0x7f648c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f648b7fe700 1 -- 172.21.15.27:0/2336350983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484009ae0 con 0x7f648c150250 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f648b7fe700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 0x7f648c1506b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f647c00c580 tx=0x7f647c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c010580 con 0x7f648c150250 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c0106e0 con 0x7f648c150250 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c14e210 con 0x7f648c150250 2023-05-17T14:54:37.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c010a60 con 0x7f648c150250 2023-05-17T14:54:37.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.029+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c14e7d0 con 0x7f648c150250 2023-05-17T14:54:37.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.030+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c0c8940 con 0x7f648c150250 2023-05-17T14:54:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.030+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f647c01b460 con 0x7f648c150250 2023-05-17T14:54:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.031+0000 7f6482ffd700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f646c05ed90 0x7f646c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.031+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f647c079680 con 0x7f648c150250 2023-05-17T14:54:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.031+0000 7f648affd700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f646c05ed90 0x7f646c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.031+0000 7f648affd700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f646c05ed90 0x7f646c061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6484009f20 tx=0x7f6484009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.035+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f647c04af10 con 0x7f648c150250 2023-05-17T14:54:37.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.212+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f648c14efd0 con 0x7f648c150250 2023-05-17T14:54:37.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.701+0000 7f6482ffd700 1 -- 172.21.15.27:0/2336350983 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f648c14efd0 con 0x7f648c150250 2023-05-17T14:54:37.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f646c05ed90 msgr2=0x7f646c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f646c05ed90 0x7f646c061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6484009f20 tx=0x7f6484009840).stop 2023-05-17T14:54:37.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 msgr2=0x7f648c1506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 0x7f648c1506b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f647c00c580 tx=0x7f647c008040).stop 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 shutdown_connections 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f646c05ed90 0x7f646c061250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648c150250 0x7f648c1506b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f648c067db0 0x7f648c165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 --2- 172.21.15.27:0/2336350983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f648c1540a0 0x7f648c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 >> 172.21.15.27:0/2336350983 conn(0x7f648c0c8ad0 msgr2=0x7f648c15a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:37.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 shutdown_connections 2023-05-17T14:54:37.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.704+0000 7f649143d700 1 -- 172.21.15.27:0/2336350983 wait complete. 2023-05-17T14:54:37.710 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T14:54:37.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T14:54:37.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.844+0000 7ff462653700 1 Processor -- start 2023-05-17T14:54:37.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.844+0000 7ff462653700 1 -- start start 2023-05-17T14:54:37.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff462653700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff45c0c6310 0x7ff45c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff462653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0691f0 0x7ff45c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff462653700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c158790 con 0x7ff45c1543d0 2023-05-17T14:54:37.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff462653700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0c1c50 con 0x7ff45c0c6310 2023-05-17T14:54:37.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff462653700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c157e60 con 0x7ff45c0691f0 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff45b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff45c0c6310 0x7ff45c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff45b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff45c0c6310 0x7ff45c068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35278/0 (socket says 172.21.15.27:35278) 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.845+0000 7ff45b7fe700 1 -- 172.21.15.27:0/3653215389 learned_addr learned my addr 172.21.15.27:0/3653215389 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff460bf0700 1 --2- 172.21.15.27:0/3653215389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0691f0 0x7ff45c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45b7fe700 1 -- 172.21.15.27:0/3653215389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0691f0 msgr2=0x7ff45c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45b7fe700 1 --2- 172.21.15.27:0/3653215389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0691f0 0x7ff45c0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45b7fe700 1 -- 172.21.15.27:0/3653215389 >> v1:172.21.15.40:6789/0 conn(0x7ff45c1543d0 legacy=0x7ff45c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45b7fe700 1 -- 172.21.15.27:0/3653215389 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c158140 con 0x7ff45c0c6310 2023-05-17T14:54:37.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45b7fe700 1 --2- 172.21.15.27:0/3653215389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0c6310 0x7ff45c068d00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff44c006fd0 tx=0x7ff44c0090f0).ready entity=mon.0 client_cookie=c2abb0bca114e429 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:37.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45affd700 1 -- 172.21.15.27:0/3653215389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00b600 con 0x7ff45c0c6310 2023-05-17T14:54:37.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45affd700 1 -- 172.21.15.27:0/3653215389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00b760 con 0x7ff45c0c6310 2023-05-17T14:54:37.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.846+0000 7ff45affd700 1 -- 172.21.15.27:0/3653215389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00bae0 con 0x7ff45c0c6310 2023-05-17T14:54:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 -- 172.21.15.27:0/3653215389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0c6310 msgr2=0x7ff45c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 --2- 172.21.15.27:0/3653215389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0c6310 0x7ff45c068d00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff44c006fd0 tx=0x7ff44c0090f0).stop 2023-05-17T14:54:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 -- 172.21.15.27:0/3653215389 shutdown_connections 2023-05-17T14:54:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 --2- 172.21.15.27:0/3653215389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0691f0 0x7ff45c0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 --2- 172.21.15.27:0/3653215389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0c6310 0x7ff45c068d00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 -- 172.21.15.27:0/3653215389 >> 172.21.15.27:0/3653215389 conn(0x7ff45c0cb7f0 msgr2=0x7ff45c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 -- 172.21.15.27:0/3653215389 shutdown_connections 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.847+0000 7ff462653700 1 -- 172.21.15.27:0/3653215389 wait complete. 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.848+0000 7ff462653700 1 Processor -- start 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.848+0000 7ff462653700 1 -- start start 2023-05-17T14:54:37.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 0x7ff45c0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0c6310 0x7ff45c1429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff45c1543d0 0x7ff45c0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c1409a0 con 0x7ff45c0691f0 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c142ed0 con 0x7ff45c1543d0 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0b0da0 con 0x7ff45c0c6310 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 0x7ff45c0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 0x7ff45c0ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35280/0 (socket says 172.21.15.27:35280) 2023-05-17T14:54:37.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 -- 172.21.15.27:0/3014248117 learned_addr learned my addr 172.21.15.27:0/3014248117 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff460bf0700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff45c1543d0 0x7ff45c0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45b7fe700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0c6310 0x7ff45c1429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 -- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0c6310 msgr2=0x7ff45c1429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0c6310 0x7ff45c1429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 -- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff45c1543d0 msgr2=0x7ff45c0b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff45c1543d0 0x7ff45c0b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:37.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 -- 172.21.15.27:0/3014248117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c009370 con 0x7ff45c0691f0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff460bf0700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff45c1543d0 0x7ff45c0b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff45bfff700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 0x7ff45c0ae150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7ff44400c440 tx=0x7ff444007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444007020 con 0x7ff45c0691f0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444007180 con 0x7ff45c0691f0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c140000 con 0x7ff45c0691f0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444007520 con 0x7ff45c0691f0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.849+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c1405c0 con 0x7ff45c0691f0 2023-05-17T14:54:37.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.850+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c06bdf0 con 0x7ff45c0691f0 2023-05-17T14:54:37.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.851+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff444010070 con 0x7ff45c0691f0 2023-05-17T14:54:37.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.851+0000 7ff453fff700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff43c05ed90 0x7ff43c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:37.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.851+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff444078bc0 con 0x7ff45c0691f0 2023-05-17T14:54:37.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.851+0000 7ff45b7fe700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff43c05ed90 0x7ff43c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:37.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.852+0000 7ff45b7fe700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff43c05ed90 0x7ff43c061250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ff45c0c6710 tx=0x7ff44c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:37.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:37.856+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4440478f0 con 0x7ff45c0691f0 2023-05-17T14:54:38.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.028+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff45c158420 con 0x7ff45c0691f0 2023-05-17T14:54:38.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.711+0000 7ff453fff700 1 -- 172.21.15.27:0/3014248117 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff44404a340 con 0x7ff45c0691f0 2023-05-17T14:54:38.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.717+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff43c05ed90 msgr2=0x7ff43c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.717+0000 7ff462653700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff43c05ed90 0x7ff43c061250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ff45c0c6710 tx=0x7ff44c017000).stop 2023-05-17T14:54:38.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.717+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 msgr2=0x7ff45c0ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.717+0000 7ff462653700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 0x7ff45c0ae150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7ff44400c440 tx=0x7ff444007e00).stop 2023-05-17T14:54:38.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.718+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 shutdown_connections 2023-05-17T14:54:38.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.718+0000 7ff462653700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff43c05ed90 0x7ff43c061250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.718+0000 7ff462653700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff45c1543d0 0x7ff45c0b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.718+0000 7ff462653700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff45c0691f0 0x7ff45c0ae150 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0x7ff44400c440 tx=0x7ff444007e00).stop 2023-05-17T14:54:38.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.718+0000 7ff462653700 1 --2- 172.21.15.27:0/3014248117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff45c0c6310 0x7ff45c1429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.718+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 >> 172.21.15.27:0/3014248117 conn(0x7ff45c0cb7f0 msgr2=0x7ff45c1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:38.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.719+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 shutdown_connections 2023-05-17T14:54:38.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.719+0000 7ff462653700 1 -- 172.21.15.27:0/3014248117 wait complete. 2023-05-17T14:54:38.731 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T14:54:38.748 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T14:54:38.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.866+0000 7f0ac49e2700 1 Processor -- start 2023-05-17T14:54:38.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0ac49e2700 1 -- start start 2023-05-17T14:54:38.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0ac49e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 0x7f0ac0157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0ac49e2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac0158010 con 0x7f0ac00cac00 2023-05-17T14:54:38.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0ac49e2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac01582f0 con 0x7f0ac0153ef0 2023-05-17T14:54:38.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0ac49e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01588b0 con 0x7f0ac00cafe0 2023-05-17T14:54:38.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0abed9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0ac00cac00 0x7f0ac01537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34850/0 (socket says 172.21.15.27:34850) 2023-05-17T14:54:38.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.867+0000 7f0abed9d700 1 -- 172.21.15.27:0/4126107219 learned_addr learned my addr 172.21.15.27:0/4126107219 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:38.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abf59e700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 0x7f0ac0157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878968260 0 0) 0x7f0ac0158010 con 0x7f0ac00cac00 2023-05-17T14:54:38.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aac0033f0 con 0x7f0ac00cac00 2023-05-17T14:54:38.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522008719 0 0) 0x7f0ac01582f0 con 0x7f0ac0153ef0 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac0158010 con 0x7f0ac0153ef0 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1217561973 0 0) 0x7f0aac0033f0 con 0x7f0ac00cac00 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 msgr2=0x7f0ac0157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 0x7f0ac0157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 >> v1:172.21.15.40:6789/0 conn(0x7f0ac0153ef0 legacy=0x7f0ac00c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac01585d0 con 0x7f0ac00cac00 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f0ab8001470 con 0x7f0ac00cac00 2023-05-17T14:54:38.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 >> v1:172.21.15.27:6789/0 conn(0x7f0ac00cac00 legacy=0x7f0ac01537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac003aa0 0x7f0aac003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aac004690 0x7f0aac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 0x7f0aac005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01588b0 con 0x7f0aac004690 2023-05-17T14:54:38.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac00b990 con 0x7f0aac003aa0 2023-05-17T14:54:38.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac00bb20 con 0x7f0ac00cafe0 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abe59c700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aac004690 0x7f0aac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abed9d700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac003aa0 0x7f0aac003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abf59e700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 0x7f0aac005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abe59c700 1 -- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 msgr2=0x7f0aac005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abe59c700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00cafe0 0x7f0aac005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abe59c700 1 -- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac003aa0 msgr2=0x7f0aac003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.868+0000 7f0abe59c700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac003aa0 0x7f0aac003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0abe59c700 1 -- 172.21.15.27:0/4126107219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0033f0 con 0x7f0aac004690 2023-05-17T14:54:38.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0abe59c700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aac004690 0x7f0aac004b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f0aa80018c0 tx=0x7f0aa8007bb0).ready entity=mon.0 client_cookie=e00a017661a7860d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:38.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8007020 con 0x7f0aac004690 2023-05-17T14:54:38.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8007180 con 0x7f0aac004690 2023-05-17T14:54:38.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0abdd9b700 1 -- 172.21.15.27:0/4126107219 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8007500 con 0x7f0aac004690 2023-05-17T14:54:38.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0ac49e2700 1 -- 172.21.15.27:0/4126107219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aac004690 msgr2=0x7f0aac004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/4126107219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aac004690 0x7f0aac004b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f0aa80018c0 tx=0x7f0aa8007bb0).stop 2023-05-17T14:54:38.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0abf59e700 1 -- 172.21.15.27:0/4126107219 reap_dead start 2023-05-17T14:54:38.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0ac49e2700 1 -- 172.21.15.27:0/4126107219 shutdown_connections 2023-05-17T14:54:38.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0ac49e2700 1 -- 172.21.15.27:0/4126107219 >> 172.21.15.27:0/4126107219 conn(0x7f0ac005dd50 msgr2=0x7f0ac005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:38.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0ac49e2700 1 -- 172.21.15.27:0/4126107219 shutdown_connections 2023-05-17T14:54:38.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.869+0000 7f0ac49e2700 1 -- 172.21.15.27:0/4126107219 wait complete. 2023-05-17T14:54:38.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 Processor -- start 2023-05-17T14:54:38.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 -- start start 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac004690 0x7f0ac00c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 0x7f0ac0155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00b0820 0x7f0ac0155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00cb440 con 0x7f0ac0142010 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00c2010 con 0x7f0aac004690 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0ac49e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00c2290 con 0x7f0ac00b0820 2023-05-17T14:54:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0abe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 0x7f0ac0155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0abe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 0x7f0ac0155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35302/0 (socket says 172.21.15.27:35302) 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.871+0000 7f0abe59c700 1 -- 172.21.15.27:0/1291338271 learned_addr learned my addr 172.21.15.27:0/1291338271 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abed9d700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac004690 0x7f0ac00c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abf59e700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00b0820 0x7f0ac0155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abe59c700 1 -- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00b0820 msgr2=0x7f0ac0155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abe59c700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00b0820 0x7f0ac0155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abe59c700 1 -- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac004690 msgr2=0x7f0ac00c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abe59c700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac004690 0x7f0ac00c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abe59c700 1 -- 172.21.15.27:0/1291338271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00c2570 con 0x7f0ac0142010 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0abe59c700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 0x7f0ac0155450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f0aac005630 tx=0x7f0aa8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8012610 con 0x7f0ac0142010 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8012770 con 0x7f0ac0142010 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00c2850 con 0x7f0ac0142010 2023-05-17T14:54:38.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8012b30 con 0x7f0ac0142010 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.872+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00c2e10 con 0x7f0ac0142010 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.873+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac0047150 con 0x7f0ac0142010 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.873+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0aa8024030 con 0x7f0ac0142010 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.874+0000 7f0ab6ffd700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0aa005ed90 0x7f0aa0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.874+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f0aa807a730 con 0x7f0ac0142010 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.874+0000 7f0abed9d700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0aa005ed90 0x7f0aa0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.874+0000 7f0abed9d700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0aa005ed90 0x7f0aa0061250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f0ab8001200 tx=0x7f0ab8001d20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:38.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:38.878+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0aa804bde0 con 0x7f0ac0142010 2023-05-17T14:54:39.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.093+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0ac00c63b0 con 0x7f0ac0142010 2023-05-17T14:54:39.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.100+0000 7f0ab6ffd700 1 -- 172.21.15.27:0/1291338271 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0aa8022020 con 0x7f0ac0142010 2023-05-17T14:54:39.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0aa005ed90 msgr2=0x7f0aa0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0aa005ed90 0x7f0aa0061250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f0ab8001200 tx=0x7f0ab8001d20).stop 2023-05-17T14:54:39.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 msgr2=0x7f0ac0155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 0x7f0ac0155450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f0aac005630 tx=0x7f0aa8016000).stop 2023-05-17T14:54:39.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 shutdown_connections 2023-05-17T14:54:39.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0aa005ed90 0x7f0aa0061250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00b0820 0x7f0ac0155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aac004690 0x7f0ac00c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 --2- 172.21.15.27:0/1291338271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ac0142010 0x7f0ac0155450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.104+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 >> 172.21.15.27:0/1291338271 conn(0x7f0ac005dd50 msgr2=0x7f0ac0150730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:39.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.107+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 shutdown_connections 2023-05-17T14:54:39.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.108+0000 7f0ac49e2700 1 -- 172.21.15.27:0/1291338271 wait complete. 2023-05-17T14:54:39.114 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 5 and data pool 6 2023-05-17T14:54:39.131 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.243+0000 7fb60658b700 1 Processor -- start 2023-05-17T14:54:39.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.243+0000 7fb60658b700 1 -- start start 2023-05-17T14:54:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb60658b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb600153ff0 0x7fb600064f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb60658b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6001543d0 0x7fb6000bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb60658b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb600064ae0 con 0x7fb6000c4a80 2023-05-17T14:54:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb60658b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6000641b0 con 0x7fb6001543d0 2023-05-17T14:54:39.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb60658b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb600064490 con 0x7fb600153ff0 2023-05-17T14:54:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb5ff7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6001543d0 0x7fb6000bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb600153ff0 0x7fb600064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb604b28700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb6000c4a80 0x7fb60005dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40892/0 (socket says 172.21.15.27:40892) 2023-05-17T14:54:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb5ff7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6001543d0 0x7fb6000bdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:53256/0 (socket says 172.21.15.27:53256) 2023-05-17T14:54:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb600153ff0 0x7fb600064f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36434/0 (socket says 172.21.15.27:36434) 2023-05-17T14:54:39.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb604b28700 1 -- 172.21.15.27:0/3928716524 learned_addr learned my addr 172.21.15.27:0/3928716524 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb5ff7fe700 1 -- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb600153ff0 msgr2=0x7fb600064f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.244+0000 7fb5ff7fe700 1 --2- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb600153ff0 0x7fb600064f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb5ff7fe700 1 -- 172.21.15.27:0/3928716524 >> v1:172.21.15.40:6789/0 conn(0x7fb6000c4a80 legacy=0x7fb60005dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb5ff7fe700 1 -- 172.21.15.27:0/3928716524 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600064770 con 0x7fb6001543d0 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb5ff7fe700 1 --2- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6001543d0 0x7fb6000bdd00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb5e8009760 tx=0x7fb5e8009060).ready entity=mon.1 client_cookie=60dd1e31a65fba69 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb5feffd700 1 -- 172.21.15.27:0/3928716524 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800f510 con 0x7fb6001543d0 2023-05-17T14:54:39.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb5feffd700 1 -- 172.21.15.27:0/3928716524 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800f670 con 0x7fb6001543d0 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb5feffd700 1 -- 172.21.15.27:0/3928716524 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800f9f0 con 0x7fb6001543d0 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 -- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6001543d0 msgr2=0x7fb6000bdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 --2- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6001543d0 0x7fb6000bdd00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb5e8009760 tx=0x7fb5e8009060).stop 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 -- 172.21.15.27:0/3928716524 shutdown_connections 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 --2- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb600153ff0 0x7fb600064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 --2- 172.21.15.27:0/3928716524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6001543d0 0x7fb6000bdd00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 -- 172.21.15.27:0/3928716524 >> 172.21.15.27:0/3928716524 conn(0x7fb6000c83a0 msgr2=0x7fb6000c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 -- 172.21.15.27:0/3928716524 shutdown_connections 2023-05-17T14:54:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.245+0000 7fb60658b700 1 -- 172.21.15.27:0/3928716524 wait complete. 2023-05-17T14:54:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.246+0000 7fb60658b700 1 Processor -- start 2023-05-17T14:54:39.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 -- start start 2023-05-17T14:54:39.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 0x7fb60014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb600153ff0 0x7fb6000aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6000aad70 0x7fb6000a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6000bedf0 con 0x7fb6000c4a80 2023-05-17T14:54:39.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6000ab7e0 con 0x7fb600153ff0 2023-05-17T14:54:39.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb60658b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6000ab220 con 0x7fb6000aad70 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.247+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 0x7fb60014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 0x7fb60014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35330/0 (socket says 172.21.15.27:35330) 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 -- 172.21.15.27:0/4000133096 learned_addr learned my addr 172.21.15.27:0/4000133096 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5ff7fe700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb600153ff0 0x7fb6000aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb604b28700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6000aad70 0x7fb6000a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 -- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6000aad70 msgr2=0x7fb6000a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6000aad70 0x7fb6000a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 -- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb600153ff0 msgr2=0x7fb6000aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb600153ff0 0x7fb6000aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 -- 172.21.15.27:0/4000133096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80092a0 con 0x7fb6000c4a80 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5fffff700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 0x7fb60014fba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb5f000e980 tx=0x7fb5f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0012600 con 0x7fb6000c4a80 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0012760 con 0x7fb6000c4a80 2023-05-17T14:54:39.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6000ab500 con 0x7fb6000c4a80 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0012ae0 con 0x7fb6000c4a80 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.248+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb600150090 con 0x7fb6000c4a80 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.249+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb600065bc0 con 0x7fb6000c4a80 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.249+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb5f0022070 con 0x7fb6000c4a80 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.250+0000 7fb5f7fff700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb5e005ed90 0x7fb5e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.250+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb5f0079e60 con 0x7fb6000c4a80 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.250+0000 7fb5ff7fe700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb5e005ed90 0x7fb5e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.250+0000 7fb5ff7fe700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb5e005ed90 0x7fb5e0061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb600066670 tx=0x7fb5e8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.254+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5f004b400 con 0x7fb6000c4a80 2023-05-17T14:54:39.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.431+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb600063ea0 con 0x7fb6000c4a80 2023-05-17T14:54:39.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.432+0000 7fb5f7fff700 1 -- 172.21.15.27:0/4000133096 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fb5f0016020 con 0x7fb6000c4a80 2023-05-17T14:54:39.436 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:39.436 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":33,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:54:39.094375+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:54:37.248347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T14:54:38.064177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb5e005ed90 msgr2=0x7fb5e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb5e005ed90 0x7fb5e0061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb600066670 tx=0x7fb5e8017000).stop 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 msgr2=0x7fb60014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 0x7fb60014fba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb5f000e980 tx=0x7fb5f0009060).stop 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 shutdown_connections 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb5e005ed90 0x7fb5e0061250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6000aad70 0x7fb6000a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6000c4a80 0x7fb60014fba0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 --2- 172.21.15.27:0/4000133096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb600153ff0 0x7fb6000aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 >> 172.21.15.27:0/4000133096 conn(0x7fb6000c83a0 msgr2=0x7fb6000c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 shutdown_connections 2023-05-17T14:54:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.434+0000 7fb60658b700 1 -- 172.21.15.27:0/4000133096 wait complete. 2023-05-17T14:54:39.450 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.562+0000 7f0cd58d1700 1 Processor -- start 2023-05-17T14:54:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.562+0000 7f0cd58d1700 1 -- start start 2023-05-17T14:54:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd58d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd58d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cd00aa070 0x7f0cd00c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd58d1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd01549b0 con 0x7f0cd00c1180 2023-05-17T14:54:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd58d1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd0154c90 con 0x7f0cd00aa070 2023-05-17T14:54:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd58d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0154f70 con 0x7f0cd01544f0 2023-05-17T14:54:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd50d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cd00aa070 0x7f0cd00c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd48cf700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0cd00c1180 0x7f0cd00c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:40902/0 (socket says 172.21.15.27:40902) 2023-05-17T14:54:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd48cf700 1 -- 172.21.15.27:0/2747429010 learned_addr learned my addr 172.21.15.27:0/2747429010 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:39.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd50d0700 1 -- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 msgr2=0x7f0cd00a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:39.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd50d0700 1 --2- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd50d0700 1 -- 172.21.15.27:0/2747429010 >> v1:172.21.15.40:6789/0 conn(0x7f0cd00c1180 legacy=0x7f0cd00c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0ccf7fe700 1 -- 172.21.15.27:0/2747429010 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659523587 0 0) 0x7f0cd01549b0 con 0x7f0cd00c1180 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.563+0000 7f0cd50d0700 1 -- 172.21.15.27:0/2747429010 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0155250 con 0x7f0cd00aa070 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd50d0700 1 --2- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00aa070 0x7f0cd00c74a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0cb8009760 tx=0x7f0cb8009060).ready entity=mon.1 client_cookie=61b385329b0f048f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0ccf7fe700 1 -- 172.21.15.27:0/2747429010 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80090d0 con 0x7f0cd00aa070 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0ccf7fe700 1 -- 172.21.15.27:0/2747429010 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb800f510 con 0x7f0cd00aa070 2023-05-17T14:54:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0ccf7fe700 1 -- 172.21.15.27:0/2747429010 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800f890 con 0x7f0cd00aa070 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 -- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00aa070 msgr2=0x7f0cd00c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00aa070 0x7f0cd00c74a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0cb8009760 tx=0x7f0cb8009060).stop 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 -- 172.21.15.27:0/2747429010 shutdown_connections 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00aa070 0x7f0cd00c74a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/2747429010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 -- 172.21.15.27:0/2747429010 >> 172.21.15.27:0/2747429010 conn(0x7f0cd005dd50 msgr2=0x7f0cd005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 -- 172.21.15.27:0/2747429010 shutdown_connections 2023-05-17T14:54:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.564+0000 7f0cd58d1700 1 -- 172.21.15.27:0/2747429010 wait complete. 2023-05-17T14:54:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.565+0000 7f0cd58d1700 1 Processor -- start 2023-05-17T14:54:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 -- start start 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 0x7f0cd0151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00c1180 0x7f0cd00af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd00ae6d0 con 0x7f0cd00aa070 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0151d40 con 0x7f0cd00c1180 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.566+0000 7f0cd58d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd00adac0 con 0x7f0cd01544f0 2023-05-17T14:54:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 0x7f0cd0151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 0x7f0cd0151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35346/0 (socket says 172.21.15.27:35346) 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 -- 172.21.15.27:0/3829632152 learned_addr learned my addr 172.21.15.27:0/3829632152 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0ccffff700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00c1180 0x7f0cd00af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd50d0700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 -- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 msgr2=0x7f0cd00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 -- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00c1180 msgr2=0x7f0cd00af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00c1180 0x7f0cd00af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 -- 172.21.15.27:0/3829632152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb80092a0 con 0x7f0cd00aa070 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd48cf700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 0x7f0cd0151850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f0cc800c4e0 tx=0x7f0cc8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800ce90 con 0x7f0cd00aa070 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd00adda0 con 0x7f0cd00aa070 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc80072e0 con 0x7f0cd00aa070 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8007660 con 0x7f0cd00aa070 2023-05-17T14:54:39.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.567+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd00ae360 con 0x7f0cd00aa070 2023-05-17T14:54:39.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.568+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd00ae9b0 con 0x7f0cd00aa070 2023-05-17T14:54:39.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.569+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0cc8010070 con 0x7f0cd00aa070 2023-05-17T14:54:39.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.569+0000 7f0cccff9700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0cb005ed90 0x7f0cb0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.569+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0cc8079200 con 0x7f0cd00aa070 2023-05-17T14:54:39.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.569+0000 7f0ccffff700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0cb005ed90 0x7f0cb0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.569+0000 7f0ccffff700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0cb005ed90 0x7f0cb0061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0cc0009fd0 tx=0x7f0cc000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.573+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0cc804a7a0 con 0x7f0cd00aa070 2023-05-17T14:54:39.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.748+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd006bdf0 con 0x7f0cd00aa070 2023-05-17T14:54:39.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.749+0000 7f0cccff9700 1 -- 172.21.15.27:0/3829632152 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f0cc804ddc0 con 0x7f0cd00aa070 2023-05-17T14:54:39.753 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:39.753 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":33,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:54:39.094375+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:54:37.248347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T14:54:38.064177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0cb005ed90 msgr2=0x7f0cb0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0cb005ed90 0x7f0cb0061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0cc0009fd0 tx=0x7f0cc000b040).stop 2023-05-17T14:54:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 msgr2=0x7f0cd0151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 0x7f0cd0151850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f0cc800c4e0 tx=0x7f0cc8007c70).stop 2023-05-17T14:54:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 shutdown_connections 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0cb005ed90 0x7f0cb0061250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cd01544f0 0x7f0cd00caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd00aa070 0x7f0cd0151850 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 --2- 172.21.15.27:0/3829632152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cd00c1180 0x7f0cd00af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 >> 172.21.15.27:0/3829632152 conn(0x7f0cd005dd50 msgr2=0x7f0cd00c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 shutdown_connections 2023-05-17T14:54:39.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.751+0000 7f0cd58d1700 1 -- 172.21.15.27:0/3829632152 wait complete. 2023-05-17T14:54:39.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T14:54:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.881+0000 7f2727fff700 1 Processor -- start 2023-05-17T14:54:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.881+0000 7f2727fff700 1 -- start start 2023-05-17T14:54:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2727fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27280cac00 0x7f27280cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2727fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2728158010 con 0x7f2728153ef0 2023-05-17T14:54:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2727fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27281582f0 con 0x7f2728157980 2023-05-17T14:54:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2727fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27281588b0 con 0x7f27280cac00 2023-05-17T14:54:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f27277fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2728153ef0 0x7f27280c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34922/0 (socket says 172.21.15.27:34922) 2023-05-17T14:54:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f27277fe700 1 -- 172.21.15.27:0/1481699017 learned_addr learned my addr 172.21.15.27:0/1481699017 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2726ffd700 1 --2- 172.21.15.27:0/1481699017 >> v2:172.21.15.40:3300/0 conn(0x7f27280cac00 0x7f27280cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105334432 0 0) 0x7f2728158010 con 0x7f2728153ef0 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.882+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27140033f0 con 0x7f2728153ef0 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953049558 0 0) 0x7f27281582f0 con 0x7f2728157980 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2728158010 con 0x7f2728157980 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140150965 0 0) 0x7f27140033f0 con 0x7f2728153ef0 2023-05-17T14:54:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 >> v2:172.21.15.40:3300/0 conn(0x7f27280cac00 msgr2=0x7f27280cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 --2- 172.21.15.27:0/1481699017 >> v2:172.21.15.40:3300/0 conn(0x7f27280cac00 0x7f27280cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 >> v1:172.21.15.40:6789/0 conn(0x7f2728157980 legacy=0x7f27281537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27281585d0 con 0x7f2728153ef0 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f2718001470 con 0x7f2728153ef0 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 >> v1:172.21.15.27:6789/0 conn(0x7f2728153ef0 legacy=0x7f27280c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714003a70 0x7f2714003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2714004690 0x7f2714004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2714005000 0x7f271400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27281588b0 con 0x7f2714004690 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271400be80 con 0x7f2714005000 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271400c040 con 0x7f2714003a70 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2714004690 0x7f2714004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2726ffd700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714003a70 0x7f2714003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27277fe700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2714005000 0x7f271400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 -- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714003a70 msgr2=0x7f2714003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714003a70 0x7f2714003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 -- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2714005000 msgr2=0x7f271400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2714005000 0x7f271400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 -- 172.21.15.27:0/1481699017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140033f0 con 0x7f2714004690 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27277fe700 1 -- 172.21.15.27:0/1481699017 reap_dead start 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f27267fc700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2714004690 0x7f2714004b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2710001860 tx=0x7f2710007bb0).ready entity=mon.0 client_cookie=45598ff5608f498d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.883+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710007020 con 0x7f2714004690 2023-05-17T14:54:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710007180 con 0x7f2714004690 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2725ffb700 1 -- 172.21.15.27:0/1481699017 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710007500 con 0x7f2714004690 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 -- 172.21.15.27:0/1481699017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2714004690 msgr2=0x7f2714004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2714004690 0x7f2714004b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2710001860 tx=0x7f2710007bb0).stop 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 -- 172.21.15.27:0/1481699017 shutdown_connections 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 --2- 172.21.15.27:0/1481699017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2714004690 0x7f2714004b10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 -- 172.21.15.27:0/1481699017 >> 172.21.15.27:0/1481699017 conn(0x7f272805dd50 msgr2=0x7f272805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 -- 172.21.15.27:0/1481699017 shutdown_connections 2023-05-17T14:54:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.884+0000 7f2727fff700 1 -- 172.21.15.27:0/1481699017 wait complete. 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.885+0000 7f2727fff700 1 Processor -- start 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.885+0000 7f2727fff700 1 -- start start 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2727fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714004690 0x7f272814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2727fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272814f690 0x7f27281644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2727fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 0x7f2728164e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2727fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280c0330 con 0x7f27281649b0 2023-05-17T14:54:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2727fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272814dfb0 con 0x7f272814f690 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2727fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2728150490 con 0x7f2714004690 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 0x7f2728164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 0x7f2728164e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35372/0 (socket says 172.21.15.27:35372) 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 -- 172.21.15.27:0/3966642309 learned_addr learned my addr 172.21.15.27:0/3966642309 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f2726ffd700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714004690 0x7f272814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27267fc700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272814f690 0x7f27281644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 -- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714004690 msgr2=0x7f272814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714004690 0x7f272814f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 -- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272814f690 msgr2=0x7f27281644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272814f690 0x7f27281644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.886+0000 7f27277fe700 1 -- 172.21.15.27:0/3966642309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728165320 con 0x7f27281649b0 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.887+0000 7f27277fe700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 0x7f2728164e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f27280c50b0 tx=0x7f2718001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.887+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180114c0 con 0x7f27281649b0 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.887+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718011620 con 0x7f27281649b0 2023-05-17T14:54:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.887+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272814fbf0 con 0x7f27281649b0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.887+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180119c0 con 0x7f27281649b0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.887+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27281501b0 con 0x7f27281649b0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.888+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2728047150 con 0x7f27281649b0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.888+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2718011d30 con 0x7f27281649b0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.888+0000 7f271effd700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270805ed90 0x7f2708061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.888+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2718079100 con 0x7f27281649b0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.889+0000 7f2726ffd700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270805ed90 0x7f2708061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.889+0000 7f2726ffd700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270805ed90 0x7f2708061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f2720009fd0 tx=0x7f272000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:39.893+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27180498f0 con 0x7f27281649b0 2023-05-17T14:54:40.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:40.112+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f27280c63b0 con 0x7f27281649b0 2023-05-17T14:54:41.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.102+0000 7f271effd700 1 -- 172.21.15.27:0/3966642309 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f271804a750 con 0x7f27281649b0 2023-05-17T14:54:41.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.104+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270805ed90 msgr2=0x7f2708061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.104+0000 7f2727fff700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270805ed90 0x7f2708061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f2720009fd0 tx=0x7f272000b040).stop 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.104+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 msgr2=0x7f2728164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.104+0000 7f2727fff700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 0x7f2728164e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f27280c50b0 tx=0x7f2718001df0).stop 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 shutdown_connections 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f270805ed90 0x7f2708061250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27281649b0 0x7f2728164e30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2714004690 0x7f272814f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 --2- 172.21.15.27:0/3966642309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272814f690 0x7f27281644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 >> 172.21.15.27:0/3966642309 conn(0x7f272805dd50 msgr2=0x7f272814e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:41.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 shutdown_connections 2023-05-17T14:54:41.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.105+0000 7f2727fff700 1 -- 172.21.15.27:0/3966642309 wait complete. 2023-05-17T14:54:41.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T14:54:41.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.245+0000 7feaa4d67700 1 Processor -- start 2023-05-17T14:54:41.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.245+0000 7feaa4d67700 1 -- start start 2023-05-17T14:54:41.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7feaa4d67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa014fc50 0x7feaa0067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:41.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7feaa4d67700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feaa0153db0 0x7feaa00bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:41.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7feaa4d67700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa0066dc0 con 0x7feaa00bc7d0 2023-05-17T14:54:41.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7feaa4d67700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa00bd140 con 0x7feaa0153db0 2023-05-17T14:54:41.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7feaa4d67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0153390 con 0x7feaa014fc50 2023-05-17T14:54:41.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feaa0153db0 0x7feaa00bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:41.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feaa0153db0 0x7feaa00bcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35376/0 (socket says 172.21.15.27:35376) 2023-05-17T14:54:41.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 -- 172.21.15.27:0/1016968425 learned_addr learned my addr 172.21.15.27:0/1016968425 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9e59c700 1 --2- 172.21.15.27:0/1016968425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa014fc50 0x7feaa0067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 -- 172.21.15.27:0/1016968425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa014fc50 msgr2=0x7feaa0067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 --2- 172.21.15.27:0/1016968425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa014fc50 0x7feaa0067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 -- 172.21.15.27:0/1016968425 >> v1:172.21.15.40:6789/0 conn(0x7feaa00bc7d0 legacy=0x7feaa01536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:41.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 -- 172.21.15.27:0/1016968425 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0066490 con 0x7feaa0153db0 2023-05-17T14:54:41.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.246+0000 7fea9ed9d700 1 --2- 172.21.15.27:0/1016968425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa00bcc50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fea98009f20 tx=0x7fea98009840).ready entity=mon.0 client_cookie=889affddcdbea631 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:41.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7fea9dd9b700 1 -- 172.21.15.27:0/1016968425 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800e070 con 0x7feaa0153db0 2023-05-17T14:54:41.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7fea9dd9b700 1 -- 172.21.15.27:0/1016968425 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9800ba40 con 0x7feaa0153db0 2023-05-17T14:54:41.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7fea9dd9b700 1 -- 172.21.15.27:0/1016968425 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800bdc0 con 0x7feaa0153db0 2023-05-17T14:54:41.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 -- 172.21.15.27:0/1016968425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 msgr2=0x7feaa00bcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:41.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 --2- 172.21.15.27:0/1016968425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa00bcc50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fea98009f20 tx=0x7fea98009840).stop 2023-05-17T14:54:41.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 -- 172.21.15.27:0/1016968425 shutdown_connections 2023-05-17T14:54:41.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 --2- 172.21.15.27:0/1016968425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa00bcc50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 --2- 172.21.15.27:0/1016968425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa014fc50 0x7feaa0067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 -- 172.21.15.27:0/1016968425 >> 172.21.15.27:0/1016968425 conn(0x7feaa0069810 msgr2=0x7feaa0069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:41.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 -- 172.21.15.27:0/1016968425 shutdown_connections 2023-05-17T14:54:41.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.247+0000 7feaa4d67700 1 -- 172.21.15.27:0/1016968425 wait complete. 2023-05-17T14:54:41.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.248+0000 7feaa4d67700 1 Processor -- start 2023-05-17T14:54:41.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.248+0000 7feaa4d67700 1 -- start start 2023-05-17T14:54:41.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7feaa4d67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa00bc7d0 0x7feaa0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:41.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7feaa4d67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaa014fc50 0x7feaa0063790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:41.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7feaa4d67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa0063c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:41.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7feaa4d67700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0064170 con 0x7feaa0153db0 2023-05-17T14:54:41.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7feaa4d67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0146670 con 0x7feaa014fc50 2023-05-17T14:54:41.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7feaa4d67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01661f0 con 0x7feaa00bc7d0 2023-05-17T14:54:41.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa0063c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:41.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa0063c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35384/0 (socket says 172.21.15.27:35384) 2023-05-17T14:54:41.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 -- 172.21.15.27:0/4033505283 learned_addr learned my addr 172.21.15.27:0/4033505283 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:41.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea97fff700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaa014fc50 0x7feaa0063790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:41.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9e59c700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa00bc7d0 0x7feaa0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:41.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 -- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa00bc7d0 msgr2=0x7feaa0156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:41.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa00bc7d0 0x7feaa0156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 -- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaa014fc50 msgr2=0x7feaa0063790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:41.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaa014fc50 0x7feaa0063790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:41.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 -- 172.21.15.27:0/4033505283 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98009ae0 con 0x7feaa0153db0 2023-05-17T14:54:41.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea97fff700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaa014fc50 0x7feaa0063790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:41.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9e59c700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa00bc7d0 0x7feaa0156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:41.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.249+0000 7fea9ed9d700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa0063c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7feaa0065bc0 tx=0x7fea98009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:41.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.250+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800bdc0 con 0x7feaa0153db0 2023-05-17T14:54:41.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.250+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9801d470 con 0x7feaa0153db0 2023-05-17T14:54:41.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.250+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa01655e0 con 0x7feaa0153db0 2023-05-17T14:54:41.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.250+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9801d810 con 0x7feaa0153db0 2023-05-17T14:54:41.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.250+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa0165ba0 con 0x7feaa0153db0 2023-05-17T14:54:41.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.251+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa0166360 con 0x7feaa0153db0 2023-05-17T14:54:41.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.251+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fea9801dc40 con 0x7feaa0153db0 2023-05-17T14:54:41.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.251+0000 7fea967fc700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fea8005ed90 0x7fea80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:41.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.251+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea9807bef0 con 0x7feaa0153db0 2023-05-17T14:54:41.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.251+0000 7fea9e59c700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fea8005ed90 0x7fea80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:41.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.252+0000 7fea9e59c700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fea8005ed90 0x7fea80061250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fea90008900 tx=0x7fea90008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:41.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.255+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea9804d490 con 0x7feaa0153db0 2023-05-17T14:54:41.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:41.475+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feaa0166360 con 0x7feaa0153db0 2023-05-17T14:54:42.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.108+0000 7fea967fc700 1 -- 172.21.15.27:0/4033505283 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fea98050ab0 con 0x7feaa0153db0 2023-05-17T14:54:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fea8005ed90 msgr2=0x7fea80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fea8005ed90 0x7fea80061250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fea90008900 tx=0x7fea90008040).stop 2023-05-17T14:54:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 msgr2=0x7feaa0063c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa0063c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7feaa0065bc0 tx=0x7fea98009840).stop 2023-05-17T14:54:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 shutdown_connections 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fea8005ed90 0x7fea80061250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaa0153db0 0x7feaa0063c80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaa00bc7d0 0x7feaa0156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 --2- 172.21.15.27:0/4033505283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaa014fc50 0x7feaa0063790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 >> 172.21.15.27:0/4033505283 conn(0x7feaa0069810 msgr2=0x7feaa0155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 shutdown_connections 2023-05-17T14:54:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.110+0000 7feaa4d67700 1 -- 172.21.15.27:0/4033505283 wait complete. 2023-05-17T14:54:42.127 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:42.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.243+0000 7fa5c359e700 1 Processor -- start 2023-05-17T14:54:42.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.243+0000 7fa5c359e700 1 -- start start 2023-05-17T14:54:42.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5c41571b0 0x7fa5c4157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c40c0120 con 0x7fa5c40caf10 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c40c6e20 con 0x7fa5c41571b0 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40aaa60 con 0x7fa5c40c5bf0 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5c41571b0 0x7fa5c4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5c41571b0 0x7fa5c4157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35388/0 (socket says 172.21.15.27:35388) 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c2d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa5c40caf10 0x7fa5c40c74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34950/0 (socket says 172.21.15.27:34950) 2023-05-17T14:54:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 -- 172.21.15.27:0/1115668965 learned_addr learned my addr 172.21.15.27:0/1115668965 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c1d9b700 1 --2- 172.21.15.27:0/1115668965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 -- 172.21.15.27:0/1115668965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 msgr2=0x7fa5c40caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 --2- 172.21.15.27:0/1115668965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 -- 172.21.15.27:0/1115668965 >> v1:172.21.15.27:6789/0 conn(0x7fa5c40caf10 legacy=0x7fa5c40c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c159a700 1 -- 172.21.15.27:0/1115668965 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954978433 0 0) 0x7fa5c40c0120 con 0x7fa5c40caf10 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.244+0000 7fa5c259c700 1 -- 172.21.15.27:0/1115668965 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40cb3a0 con 0x7fa5c41571b0 2023-05-17T14:54:42.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c259c700 1 --2- 172.21.15.27:0/1115668965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4157970 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fa5bc006fd0 tx=0x7fa5bc0090f0).ready entity=mon.0 client_cookie=2241342a448b3893 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c159a700 1 -- 172.21.15.27:0/1115668965 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00b600 con 0x7fa5c41571b0 2023-05-17T14:54:42.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c159a700 1 -- 172.21.15.27:0/1115668965 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00b760 con 0x7fa5c41571b0 2023-05-17T14:54:42.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c159a700 1 -- 172.21.15.27:0/1115668965 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00bae0 con 0x7fa5c41571b0 2023-05-17T14:54:42.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 -- 172.21.15.27:0/1115668965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 msgr2=0x7fa5c4157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1115668965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4157970 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fa5bc006fd0 tx=0x7fa5bc0090f0).stop 2023-05-17T14:54:42.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 -- 172.21.15.27:0/1115668965 shutdown_connections 2023-05-17T14:54:42.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1115668965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4157970 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1115668965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 -- 172.21.15.27:0/1115668965 >> 172.21.15.27:0/1115668965 conn(0x7fa5c405dd50 msgr2=0x7fa5c405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 -- 172.21.15.27:0/1115668965 shutdown_connections 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.245+0000 7fa5c359e700 1 -- 172.21.15.27:0/1115668965 wait complete. 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.246+0000 7fa5c359e700 1 Processor -- start 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.246+0000 7fa5c359e700 1 -- start start 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c40caf10 0x7fa5c40a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4163cc0 con 0x7fa5c41571b0 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40a3140 con 0x7fa5c40caf10 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40b0070 con 0x7fa5c40c5bf0 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35398/0 (socket says 172.21.15.27:35398) 2023-05-17T14:54:42.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c2d9d700 1 -- 172.21.15.27:0/1050343932 learned_addr learned my addr 172.21.15.27:0/1050343932 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.247+0000 7fa5c259c700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c2d9d700 1 -- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 msgr2=0x7fa5c40afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c1d9b700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c40caf10 0x7fa5c40a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c2d9d700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c2d9d700 1 -- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c40caf10 msgr2=0x7fa5c40a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c2d9d700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c40caf10 0x7fa5c40a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c2d9d700 1 -- 172.21.15.27:0/1050343932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc009370 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c2d9d700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4155470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa5b400c810 tx=0x7fa5b4007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4005c70 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4005df0 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c40b0350 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4007360 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.248+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c40b0910 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.249+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c406bdf0 con 0x7fa5c41571b0 2023-05-17T14:54:42.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.249+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa5b4010030 con 0x7fa5c41571b0 2023-05-17T14:54:42.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.250+0000 7fa5b27fc700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa5a405ed90 0x7fa5a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.250+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa5b4079a70 con 0x7fa5c41571b0 2023-05-17T14:54:42.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.250+0000 7fa5c259c700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa5a405ed90 0x7fa5a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.250+0000 7fa5c259c700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa5a405ed90 0x7fa5a4061250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fa5bc009130 tx=0x7fa5bc017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.254+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5b404b010 con 0x7fa5c41571b0 2023-05-17T14:54:42.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.468+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5c4158880 con 0x7fa5c41571b0 2023-05-17T14:54:42.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.469+0000 7fa5b27fc700 1 -- 172.21.15.27:0/1050343932 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4480 (secure 0 0 0) 0x7fa5b4079e60 con 0x7fa5c41571b0 2023-05-17T14:54:42.473 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:42.473 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:54:39.094710+0000","modified":"2023-05-17T14:54:42.101891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6836/149717180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":149717180},{"type":"v1","addr":"172.21.15.27:6836","nonce":149717180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-17T14:54:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa5a405ed90 msgr2=0x7fa5a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa5a405ed90 0x7fa5a4061250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fa5bc009130 tx=0x7fa5bc017000).stop 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 msgr2=0x7fa5c4155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4155470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa5b400c810 tx=0x7fa5b4007f10).stop 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 shutdown_connections 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa5a405ed90 0x7fa5a4061250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5c41571b0 0x7fa5c4155470 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c40c5bf0 0x7fa5c40afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 --2- 172.21.15.27:0/1050343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c40caf10 0x7fa5c40a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 >> 172.21.15.27:0/1050343932 conn(0x7fa5c405dd50 msgr2=0x7fa5c4157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 shutdown_connections 2023-05-17T14:54:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.470+0000 7fa5c359e700 1 -- 172.21.15.27:0/1050343932 wait complete. 2023-05-17T14:54:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2023-05-17T14:54:42.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T14:54:42.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.598+0000 7f3d62713700 1 Processor -- start 2023-05-17T14:54:42.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.598+0000 7f3d62713700 1 -- start start 2023-05-17T14:54:42.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d62713700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d5c1544f0 0x7f3d5c0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d62713700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c0aa070 0x7f3d5c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d62713700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c1549b0 con 0x7f3d5c0c1180 2023-05-17T14:54:42.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d62713700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c154c90 con 0x7f3d5c0aa070 2023-05-17T14:54:42.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d62713700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c154f70 con 0x7f3d5c1544f0 2023-05-17T14:54:42.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c0aa070 0x7f3d5c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c0aa070 0x7f3d5c0c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35404/0 (socket says 172.21.15.27:35404) 2023-05-17T14:54:42.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 -- 172.21.15.27:0/2102659565 learned_addr learned my addr 172.21.15.27:0/2102659565 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:42.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d60f10700 1 --2- 172.21.15.27:0/2102659565 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c1544f0 0x7f3d5c0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 -- 172.21.15.27:0/2102659565 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c1544f0 msgr2=0x7f3d5c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:42.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 --2- 172.21.15.27:0/2102659565 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c1544f0 0x7f3d5c0a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 -- 172.21.15.27:0/2102659565 >> v1:172.21.15.40:6789/0 conn(0x7f3d5c0c1180 legacy=0x7f3d5c0c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 -- 172.21.15.27:0/2102659565 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c155250 con 0x7f3d5c0aa070 2023-05-17T14:54:42.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.599+0000 7f3d61f12700 1 --2- 172.21.15.27:0/2102659565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c0c74a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f3d5c0c8580 tx=0x7f3d54009840).ready entity=mon.0 client_cookie=58dbc9f6a7e32825 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d53fff700 1 -- 172.21.15.27:0/2102659565 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400e070 con 0x7f3d5c0aa070 2023-05-17T14:54:42.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d53fff700 1 -- 172.21.15.27:0/2102659565 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5400ba20 con 0x7f3d5c0aa070 2023-05-17T14:54:42.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d53fff700 1 -- 172.21.15.27:0/2102659565 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400bda0 con 0x7f3d5c0aa070 2023-05-17T14:54:42.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 -- 172.21.15.27:0/2102659565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0aa070 msgr2=0x7f3d5c0c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 --2- 172.21.15.27:0/2102659565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c0c74a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f3d5c0c8580 tx=0x7f3d54009840).stop 2023-05-17T14:54:42.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 -- 172.21.15.27:0/2102659565 shutdown_connections 2023-05-17T14:54:42.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 --2- 172.21.15.27:0/2102659565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c0c74a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 --2- 172.21.15.27:0/2102659565 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c1544f0 0x7f3d5c0a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 -- 172.21.15.27:0/2102659565 >> 172.21.15.27:0/2102659565 conn(0x7f3d5c05dd50 msgr2=0x7f3d5c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 -- 172.21.15.27:0/2102659565 shutdown_connections 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.600+0000 7f3d62713700 1 -- 172.21.15.27:0/2102659565 wait complete. 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.601+0000 7f3d62713700 1 Processor -- start 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.601+0000 7f3d62713700 1 -- start start 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d62713700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d62713700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1180 0x7f3d5c0a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d62713700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d62713700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c4a80 con 0x7f3d5c1544f0 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d62713700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c1684f0 con 0x7f3d5c0aa070 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d62713700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c3e70 con 0x7f3d5c0c1180 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d61f12700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d61f12700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35410/0 (socket says 172.21.15.27:35410) 2023-05-17T14:54:42.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d61f12700 1 -- 172.21.15.27:0/3317135274 learned_addr learned my addr 172.21.15.27:0/3317135274 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d60f10700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1180 0x7f3d5c0a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.602+0000 7f3d61711700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61f12700 1 -- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1180 msgr2=0x7f3d5c0a8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61f12700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1180 0x7f3d5c0a8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61f12700 1 -- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0aa070 msgr2=0x7f3d5c168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61f12700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61f12700 1 -- 172.21.15.27:0/3317135274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54009ae0 con 0x7f3d5c1544f0 2023-05-17T14:54:42.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d60f10700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1180 0x7f3d5c0a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61711700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c168000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d61f12700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c1b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f3d5400b6c0 tx=0x7f3d54009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540092e0 con 0x7f3d5c1544f0 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5401e470 con 0x7f3d5c1544f0 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0c4150 con 0x7f3d5c1544f0 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5401e7f0 con 0x7f3d5c1544f0 2023-05-17T14:54:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.603+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0c4710 con 0x7f3d5c1544f0 2023-05-17T14:54:42.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.604+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c0c4c30 con 0x7f3d5c1544f0 2023-05-17T14:54:42.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.604+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3d54025030 con 0x7f3d5c1544f0 2023-05-17T14:54:42.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.605+0000 7f3d517fa700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3d4005ed90 0x7f3d40061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.605+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d5407b1e0 con 0x7f3d5c1544f0 2023-05-17T14:54:42.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.605+0000 7f3d61711700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3d4005ed90 0x7f3d40061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.605+0000 7f3d61711700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3d4005ed90 0x7f3d40061250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3d58001730 tx=0x7f3d58009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.609+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d5c0c4c30 con 0x7f3d5c1544f0 2023-05-17T14:54:42.698 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T14:54:42.695+0000 7f9c0e209700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T14:54:42.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.781+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d5c06bdf0 con 0x7f3d5c1544f0 2023-05-17T14:54:42.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.782+0000 7f3d517fa700 1 -- 172.21.15.27:0/3317135274 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f3d54023070 con 0x7f3d5c1544f0 2023-05-17T14:54:42.786 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:42.786 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":34,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T14:54:40.096021+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:54:37.248347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T14:54:38.064177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T14:54:42.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3d4005ed90 msgr2=0x7f3d40061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3d4005ed90 0x7f3d40061250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3d58001730 tx=0x7f3d58009040).stop 2023-05-17T14:54:42.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 msgr2=0x7f3d5c0c1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c1b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f3d5400b6c0 tx=0x7f3d54009840).stop 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 shutdown_connections 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3d4005ed90 0x7f3d40061250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c1b10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0aa070 0x7f3d5c168000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 --2- 172.21.15.27:0/3317135274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1180 0x7f3d5c0a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 >> 172.21.15.27:0/3317135274 conn(0x7f3d5c05dd50 msgr2=0x7f3d5c1556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 shutdown_connections 2023-05-17T14:54:42.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.784+0000 7f3d62713700 1 -- 172.21.15.27:0/3317135274 wait complete. 2023-05-17T14:54:42.800 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T14:54:42.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T14:54:42.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.912+0000 7fb147e5f700 1 Processor -- start 2023-05-17T14:54:42.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.912+0000 7fb147e5f700 1 -- start start 2023-05-17T14:54:42.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb147e5f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1400c60c0 0x7fb1400c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb147e5f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1400aa3b0 0x7fb1400c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb147e5f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14005e7e0 con 0x7fb1400a9f70 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb147e5f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14005eac0 con 0x7fb1400c60c0 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb147e5f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1400bfd70 con 0x7fb1400aa3b0 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb145bfb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1400c60c0 0x7fb1400c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb1453fa700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb1400a9f70 0x7fb140153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34976/0 (socket says 172.21.15.27:34976) 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb1453fa700 1 -- 172.21.15.27:0/1021416411 learned_addr learned my addr 172.21.15.27:0/1021416411 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb1463fc700 1 --2- 172.21.15.27:0/1021416411 >> v2:172.21.15.40:3300/0 conn(0x7fb1400aa3b0 0x7fb1400c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb145bfb700 1 -- 172.21.15.27:0/1021416411 >> v2:172.21.15.40:3300/0 conn(0x7fb1400aa3b0 msgr2=0x7fb1400c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb145bfb700 1 --2- 172.21.15.27:0/1021416411 >> v2:172.21.15.40:3300/0 conn(0x7fb1400aa3b0 0x7fb1400c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb145bfb700 1 -- 172.21.15.27:0/1021416411 >> v1:172.21.15.27:6789/0 conn(0x7fb1400a9f70 legacy=0x7fb140153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb144bf9700 1 -- 172.21.15.27:0/1021416411 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794925605 0 0) 0x7fb14005e7e0 con 0x7fb1400a9f70 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb145bfb700 1 -- 172.21.15.27:0/1021416411 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1400c0050 con 0x7fb1400c60c0 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb1463fc700 1 --2- 172.21.15.27:0/1021416411 >> v2:172.21.15.40:3300/0 conn(0x7fb1400aa3b0 0x7fb1400c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb145bfb700 1 --2- 172.21.15.27:0/1021416411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c64a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb14005fcf0 tx=0x7fb138009780).ready entity=mon.0 client_cookie=64ab1775a67797f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb144bf9700 1 -- 172.21.15.27:0/1021416411 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800e070 con 0x7fb1400c60c0 2023-05-17T14:54:42.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb144bf9700 1 -- 172.21.15.27:0/1021416411 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800bc30 con 0x7fb1400c60c0 2023-05-17T14:54:42.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.913+0000 7fb144bf9700 1 -- 172.21.15.27:0/1021416411 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138012410 con 0x7fb1400c60c0 2023-05-17T14:54:42.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 -- 172.21.15.27:0/1021416411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 msgr2=0x7fb1400c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 --2- 172.21.15.27:0/1021416411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c64a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb14005fcf0 tx=0x7fb138009780).stop 2023-05-17T14:54:42.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 -- 172.21.15.27:0/1021416411 shutdown_connections 2023-05-17T14:54:42.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 --2- 172.21.15.27:0/1021416411 >> v2:172.21.15.40:3300/0 conn(0x7fb1400aa3b0 0x7fb1400c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 --2- 172.21.15.27:0/1021416411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c64a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 -- 172.21.15.27:0/1021416411 >> 172.21.15.27:0/1021416411 conn(0x7fb140069e70 msgr2=0x7fb14005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 -- 172.21.15.27:0/1021416411 shutdown_connections 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.914+0000 7fb147e5f700 1 -- 172.21.15.27:0/1021416411 wait complete. 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.915+0000 7fb147e5f700 1 Processor -- start 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.915+0000 7fb147e5f700 1 -- start start 2023-05-17T14:54:42.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb147e5f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1400a9f70 0x7fb140143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb147e5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1400aa3b0 0x7fb1400c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb147e5f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb147e5f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400c9f70 con 0x7fb1400c60c0 2023-05-17T14:54:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb147e5f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb140150880 con 0x7fb1400a9f70 2023-05-17T14:54:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb147e5f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb140150270 con 0x7fb1400aa3b0 2023-05-17T14:54:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35422/0 (socket says 172.21.15.27:35422) 2023-05-17T14:54:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 -- 172.21.15.27:0/4283949963 learned_addr learned my addr 172.21.15.27:0/4283949963 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb145bfb700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1400a9f70 0x7fb140143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 -- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1400aa3b0 msgr2=0x7fb1400c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1400aa3b0 0x7fb1400c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:42.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 -- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1400a9f70 msgr2=0x7fb140143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:42.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1400a9f70 0x7fb140143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:42.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 -- 172.21.15.27:0/4283949963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009a20 con 0x7fb1400c60c0 2023-05-17T14:54:42.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.916+0000 7fb1463fc700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c9a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fb13000c880 tx=0x7fb130008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.917+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130010580 con 0x7fb1400c60c0 2023-05-17T14:54:42.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.917+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300106e0 con 0x7fb1400c60c0 2023-05-17T14:54:42.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.917+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1400ca170 con 0x7fb1400c60c0 2023-05-17T14:54:42.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.917+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130010a60 con 0x7fb1400c60c0 2023-05-17T14:54:42.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.917+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1400ca450 con 0x7fb1400c60c0 2023-05-17T14:54:42.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.918+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb140150a10 con 0x7fb1400c60c0 2023-05-17T14:54:42.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.918+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb13001b460 con 0x7fb1400c60c0 2023-05-17T14:54:42.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.918+0000 7fb13dffb700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb12c05ed90 0x7fb12c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:42.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.918+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb130079c50 con 0x7fb1400c60c0 2023-05-17T14:54:42.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.918+0000 7fb145bfb700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb12c05ed90 0x7fb12c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:42.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.919+0000 7fb145bfb700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb12c05ed90 0x7fb12c061250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb138009fd0 tx=0x7fb138009780).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:42.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:42.923+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb13004b190 con 0x7fb1400c60c0 2023-05-17T14:54:43.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.092+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb14005f4a0 con 0x7fb12c05ed90 2023-05-17T14:54:43.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.102+0000 7fb13dffb700 1 -- 172.21.15.27:0/4283949963 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336412 (secure 0 0 0) 0x7fb14005f4a0 con 0x7fb12c05ed90 2023-05-17T14:54:43.108 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:43.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb12c05ed90 msgr2=0x7fb12c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb12c05ed90 0x7fb12c061250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb138009fd0 tx=0x7fb138009780).stop 2023-05-17T14:54:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 msgr2=0x7fb1400c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c9a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fb13000c880 tx=0x7fb130008040).stop 2023-05-17T14:54:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 shutdown_connections 2023-05-17T14:54:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb12c05ed90 0x7fb12c061250 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1400c60c0 0x7fb1400c9a80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1400a9f70 0x7fb140143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 --2- 172.21.15.27:0/4283949963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1400aa3b0 0x7fb1400c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 >> 172.21.15.27:0/4283949963 conn(0x7fb140069e70 msgr2=0x7fb1400afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 shutdown_connections 2023-05-17T14:54:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.105+0000 7fb147e5f700 1 -- 172.21.15.27:0/4283949963 wait complete. 2023-05-17T14:54:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T14:54:43.121 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-05-17T14:54:41.571183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":44892,"kb_used_data":2908,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":754929828,"statfs":{"total":773094113280,"available":773048143872,"internally_reserved":0,"allocated":2977792,"data_stored":1190252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4317,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.584061"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117309+0000","last_change":"2023-05-17T14:54:39.117309+0000","last_active":"2023-05-17T14:54:39.117309+0000","last_peered":"2023-05-17T14:54:39.117309+0000","last_clean":"2023-05-17T14:54:39.117309+0000","last_became_active":"2023-05-17T14:54:39.116694+0000","last_became_peered":"2023-05-17T14:54:39.116694+0000","last_unstale":"2023-05-17T14:54:39.117309+0000","last_undegraded":"2023-05-17T14:54:39.117309+0000","last_fullsized":"2023-05-17T14:54:39.117309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127347+0000","last_change":"2023-05-17T14:54:38.736765+0000","last_active":"2023-05-17T14:54:39.127347+0000","last_peered":"2023-05-17T14:54:39.127347+0000","last_clean":"2023-05-17T14:54:39.127347+0000","last_became_active":"2023-05-17T14:54:38.736441+0000","last_became_peered":"2023-05-17T14:54:38.736441+0000","last_unstale":"2023-05-17T14:54:39.127347+0000","last_undegraded":"2023-05-17T14:54:39.127347+0000","last_fullsized":"2023-05-17T14:54:39.127347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.107573+0000","last_change":"2023-05-17T14:54:39.107573+0000","last_active":"2023-05-17T14:54:39.107573+0000","last_peered":"2023-05-17T14:54:39.107573+0000","last_clean":"2023-05-17T14:54:39.107573+0000","last_became_active":"2023-05-17T14:54:39.107319+0000","last_became_peered":"2023-05-17T14:54:39.107319+0000","last_unstale":"2023-05-17T14:54:39.107573+0000","last_undegraded":"2023-05-17T14:54:39.107573+0000","last_fullsized":"2023-05-17T14:54:39.107573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.730955+0000","last_change":"2023-05-17T14:54:38.723116+0000","last_active":"2023-05-17T14:54:38.730955+0000","last_peered":"2023-05-17T14:54:38.730955+0000","last_clean":"2023-05-17T14:54:38.730955+0000","last_became_active":"2023-05-17T14:54:38.722789+0000","last_became_peered":"2023-05-17T14:54:38.722789+0000","last_unstale":"2023-05-17T14:54:38.730955+0000","last_undegraded":"2023-05-17T14:54:38.730955+0000","last_fullsized":"2023-05-17T14:54:38.730955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.114761+0000","last_change":"2023-05-17T14:54:39.114761+0000","last_active":"2023-05-17T14:54:39.114761+0000","last_peered":"2023-05-17T14:54:39.114761+0000","last_clean":"2023-05-17T14:54:39.114761+0000","last_became_active":"2023-05-17T14:54:39.114542+0000","last_became_peered":"2023-05-17T14:54:39.114542+0000","last_unstale":"2023-05-17T14:54:39.114761+0000","last_undegraded":"2023-05-17T14:54:39.114761+0000","last_fullsized":"2023-05-17T14:54:39.114761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740663+0000","last_change":"2023-05-17T14:54:38.734197+0000","last_active":"2023-05-17T14:54:38.740663+0000","last_peered":"2023-05-17T14:54:38.740663+0000","last_clean":"2023-05-17T14:54:38.740663+0000","last_became_active":"2023-05-17T14:54:38.733426+0000","last_became_peered":"2023-05-17T14:54:38.733426+0000","last_unstale":"2023-05-17T14:54:38.740663+0000","last_undegraded":"2023-05-17T14:54:38.740663+0000","last_fullsized":"2023-05-17T14:54:38.740663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115030+0000","last_change":"2023-05-17T14:54:39.115030+0000","last_active":"2023-05-17T14:54:39.115030+0000","last_peered":"2023-05-17T14:54:39.115030+0000","last_clean":"2023-05-17T14:54:39.115030+0000","last_became_active":"2023-05-17T14:54:39.114734+0000","last_became_peered":"2023-05-17T14:54:39.114734+0000","last_unstale":"2023-05-17T14:54:39.115030+0000","last_undegraded":"2023-05-17T14:54:39.115030+0000","last_fullsized":"2023-05-17T14:54:39.115030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124581+0000","last_change":"2023-05-17T14:54:38.738723+0000","last_active":"2023-05-17T14:54:39.124581+0000","last_peered":"2023-05-17T14:54:39.124581+0000","last_clean":"2023-05-17T14:54:39.124581+0000","last_became_active":"2023-05-17T14:54:38.738256+0000","last_became_peered":"2023-05-17T14:54:38.738256+0000","last_unstale":"2023-05-17T14:54:39.124581+0000","last_undegraded":"2023-05-17T14:54:39.124581+0000","last_fullsized":"2023-05-17T14:54:39.124581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124260+0000","last_change":"2023-05-17T14:54:39.124260+0000","last_active":"2023-05-17T14:54:39.124260+0000","last_peered":"2023-05-17T14:54:39.124260+0000","last_clean":"2023-05-17T14:54:39.124260+0000","last_became_active":"2023-05-17T14:54:39.123988+0000","last_became_peered":"2023-05-17T14:54:39.123988+0000","last_unstale":"2023-05-17T14:54:39.124260+0000","last_undegraded":"2023-05-17T14:54:39.124260+0000","last_fullsized":"2023-05-17T14:54:39.124260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108057+0000","last_change":"2023-05-17T14:54:38.725465+0000","last_active":"2023-05-17T14:54:39.108057+0000","last_peered":"2023-05-17T14:54:39.108057+0000","last_clean":"2023-05-17T14:54:39.108057+0000","last_became_active":"2023-05-17T14:54:38.724730+0000","last_became_peered":"2023-05-17T14:54:38.724730+0000","last_unstale":"2023-05-17T14:54:39.108057+0000","last_undegraded":"2023-05-17T14:54:39.108057+0000","last_fullsized":"2023-05-17T14:54:39.108057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117006+0000","last_change":"2023-05-17T14:54:39.117006+0000","last_active":"2023-05-17T14:54:39.117006+0000","last_peered":"2023-05-17T14:54:39.117006+0000","last_clean":"2023-05-17T14:54:39.117006+0000","last_became_active":"2023-05-17T14:54:39.116696+0000","last_became_peered":"2023-05-17T14:54:39.116696+0000","last_unstale":"2023-05-17T14:54:39.117006+0000","last_undegraded":"2023-05-17T14:54:39.117006+0000","last_fullsized":"2023-05-17T14:54:39.117006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113048+0000","last_change":"2023-05-17T14:54:38.737288+0000","last_active":"2023-05-17T14:54:39.113048+0000","last_peered":"2023-05-17T14:54:39.113048+0000","last_clean":"2023-05-17T14:54:39.113048+0000","last_became_active":"2023-05-17T14:54:38.737009+0000","last_became_peered":"2023-05-17T14:54:38.737009+0000","last_unstale":"2023-05-17T14:54:39.113048+0000","last_undegraded":"2023-05-17T14:54:39.113048+0000","last_fullsized":"2023-05-17T14:54:39.113048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118614+0000","last_change":"2023-05-17T14:54:39.118614+0000","last_active":"2023-05-17T14:54:39.118614+0000","last_peered":"2023-05-17T14:54:39.118614+0000","last_clean":"2023-05-17T14:54:39.118614+0000","last_became_active":"2023-05-17T14:54:39.118415+0000","last_became_peered":"2023-05-17T14:54:39.118415+0000","last_unstale":"2023-05-17T14:54:39.118614+0000","last_undegraded":"2023-05-17T14:54:39.118614+0000","last_fullsized":"2023-05-17T14:54:39.118614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739928+0000","last_change":"2023-05-17T14:54:38.738670+0000","last_active":"2023-05-17T14:54:38.739928+0000","last_peered":"2023-05-17T14:54:38.739928+0000","last_clean":"2023-05-17T14:54:38.739928+0000","last_became_active":"2023-05-17T14:54:38.738157+0000","last_became_peered":"2023-05-17T14:54:38.738157+0000","last_unstale":"2023-05-17T14:54:38.739928+0000","last_undegraded":"2023-05-17T14:54:38.739928+0000","last_fullsized":"2023-05-17T14:54:38.739928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117333+0000","last_change":"2023-05-17T14:54:39.117333+0000","last_active":"2023-05-17T14:54:39.117333+0000","last_peered":"2023-05-17T14:54:39.117333+0000","last_clean":"2023-05-17T14:54:39.117333+0000","last_became_active":"2023-05-17T14:54:39.117068+0000","last_became_peered":"2023-05-17T14:54:39.117068+0000","last_unstale":"2023-05-17T14:54:39.117333+0000","last_undegraded":"2023-05-17T14:54:39.117333+0000","last_fullsized":"2023-05-17T14:54:39.117333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739619+0000","last_change":"2023-05-17T14:54:38.736446+0000","last_active":"2023-05-17T14:54:38.739619+0000","last_peered":"2023-05-17T14:54:38.739619+0000","last_clean":"2023-05-17T14:54:38.739619+0000","last_became_active":"2023-05-17T14:54:38.735564+0000","last_became_peered":"2023-05-17T14:54:38.735564+0000","last_unstale":"2023-05-17T14:54:38.739619+0000","last_undegraded":"2023-05-17T14:54:38.739619+0000","last_fullsized":"2023-05-17T14:54:38.739619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.110089+0000","last_change":"2023-05-17T14:54:39.110089+0000","last_active":"2023-05-17T14:54:39.110089+0000","last_peered":"2023-05-17T14:54:39.110089+0000","last_clean":"2023-05-17T14:54:39.110089+0000","last_became_active":"2023-05-17T14:54:39.109865+0000","last_became_peered":"2023-05-17T14:54:39.109865+0000","last_unstale":"2023-05-17T14:54:39.110089+0000","last_undegraded":"2023-05-17T14:54:39.110089+0000","last_fullsized":"2023-05-17T14:54:39.110089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740585+0000","last_change":"2023-05-17T14:54:38.731210+0000","last_active":"2023-05-17T14:54:38.740585+0000","last_peered":"2023-05-17T14:54:38.740585+0000","last_clean":"2023-05-17T14:54:38.740585+0000","last_became_active":"2023-05-17T14:54:38.730873+0000","last_became_peered":"2023-05-17T14:54:38.730873+0000","last_unstale":"2023-05-17T14:54:38.740585+0000","last_undegraded":"2023-05-17T14:54:38.740585+0000","last_fullsized":"2023-05-17T14:54:38.740585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113889+0000","last_change":"2023-05-17T14:54:39.113889+0000","last_active":"2023-05-17T14:54:39.113889+0000","last_peered":"2023-05-17T14:54:39.113889+0000","last_clean":"2023-05-17T14:54:39.113889+0000","last_became_active":"2023-05-17T14:54:39.113539+0000","last_became_peered":"2023-05-17T14:54:39.113539+0000","last_unstale":"2023-05-17T14:54:39.113889+0000","last_undegraded":"2023-05-17T14:54:39.113889+0000","last_fullsized":"2023-05-17T14:54:39.113889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.734149+0000","last_change":"2023-05-17T14:54:38.732737+0000","last_active":"2023-05-17T14:54:38.734149+0000","last_peered":"2023-05-17T14:54:38.734149+0000","last_clean":"2023-05-17T14:54:38.734149+0000","last_became_active":"2023-05-17T14:54:38.732432+0000","last_became_peered":"2023-05-17T14:54:38.732432+0000","last_unstale":"2023-05-17T14:54:38.734149+0000","last_undegraded":"2023-05-17T14:54:38.734149+0000","last_fullsized":"2023-05-17T14:54:38.734149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116364+0000","last_change":"2023-05-17T14:54:39.116364+0000","last_active":"2023-05-17T14:54:39.116364+0000","last_peered":"2023-05-17T14:54:39.116364+0000","last_clean":"2023-05-17T14:54:39.116364+0000","last_became_active":"2023-05-17T14:54:39.116050+0000","last_became_peered":"2023-05-17T14:54:39.116050+0000","last_unstale":"2023-05-17T14:54:39.116364+0000","last_undegraded":"2023-05-17T14:54:39.116364+0000","last_fullsized":"2023-05-17T14:54:39.116364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738518+0000","last_change":"2023-05-17T14:54:38.734519+0000","last_active":"2023-05-17T14:54:38.738518+0000","last_peered":"2023-05-17T14:54:38.738518+0000","last_clean":"2023-05-17T14:54:38.738518+0000","last_became_active":"2023-05-17T14:54:38.734020+0000","last_became_peered":"2023-05-17T14:54:38.734020+0000","last_unstale":"2023-05-17T14:54:38.738518+0000","last_undegraded":"2023-05-17T14:54:38.738518+0000","last_fullsized":"2023-05-17T14:54:38.738518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.107465+0000","last_change":"2023-05-17T14:54:39.107465+0000","last_active":"2023-05-17T14:54:39.107465+0000","last_peered":"2023-05-17T14:54:39.107465+0000","last_clean":"2023-05-17T14:54:39.107465+0000","last_became_active":"2023-05-17T14:54:39.107201+0000","last_became_peered":"2023-05-17T14:54:39.107201+0000","last_unstale":"2023-05-17T14:54:39.107465+0000","last_undegraded":"2023-05-17T14:54:39.107465+0000","last_fullsized":"2023-05-17T14:54:39.107465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.128531+0000","last_change":"2023-05-17T14:54:38.732781+0000","last_active":"2023-05-17T14:54:39.128531+0000","last_peered":"2023-05-17T14:54:39.128531+0000","last_clean":"2023-05-17T14:54:39.128531+0000","last_became_active":"2023-05-17T14:54:38.732393+0000","last_became_peered":"2023-05-17T14:54:38.732393+0000","last_unstale":"2023-05-17T14:54:39.128531+0000","last_undegraded":"2023-05-17T14:54:39.128531+0000","last_fullsized":"2023-05-17T14:54:39.128531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127845+0000","last_change":"2023-05-17T14:54:39.127845+0000","last_active":"2023-05-17T14:54:39.127845+0000","last_peered":"2023-05-17T14:54:39.127845+0000","last_clean":"2023-05-17T14:54:39.127845+0000","last_became_active":"2023-05-17T14:54:39.126323+0000","last_became_peered":"2023-05-17T14:54:39.126323+0000","last_unstale":"2023-05-17T14:54:39.127845+0000","last_undegraded":"2023-05-17T14:54:39.127845+0000","last_fullsized":"2023-05-17T14:54:39.127845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108168+0000","last_change":"2023-05-17T14:54:38.725651+0000","last_active":"2023-05-17T14:54:39.108168+0000","last_peered":"2023-05-17T14:54:39.108168+0000","last_clean":"2023-05-17T14:54:39.108168+0000","last_became_active":"2023-05-17T14:54:38.725183+0000","last_became_peered":"2023-05-17T14:54:38.725183+0000","last_unstale":"2023-05-17T14:54:39.108168+0000","last_undegraded":"2023-05-17T14:54:39.108168+0000","last_fullsized":"2023-05-17T14:54:39.108168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.109929+0000","last_change":"2023-05-17T14:54:39.109929+0000","last_active":"2023-05-17T14:54:39.109929+0000","last_peered":"2023-05-17T14:54:39.109929+0000","last_clean":"2023-05-17T14:54:39.109929+0000","last_became_active":"2023-05-17T14:54:39.109594+0000","last_became_peered":"2023-05-17T14:54:39.109594+0000","last_unstale":"2023-05-17T14:54:39.109929+0000","last_undegraded":"2023-05-17T14:54:39.109929+0000","last_fullsized":"2023-05-17T14:54:39.109929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.737647+0000","last_change":"2023-05-17T14:54:38.733360+0000","last_active":"2023-05-17T14:54:38.737647+0000","last_peered":"2023-05-17T14:54:38.737647+0000","last_clean":"2023-05-17T14:54:38.737647+0000","last_became_active":"2023-05-17T14:54:38.733082+0000","last_became_peered":"2023-05-17T14:54:38.733082+0000","last_unstale":"2023-05-17T14:54:38.737647+0000","last_undegraded":"2023-05-17T14:54:38.737647+0000","last_fullsized":"2023-05-17T14:54:38.737647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113713+0000","last_change":"2023-05-17T14:54:39.113713+0000","last_active":"2023-05-17T14:54:39.113713+0000","last_peered":"2023-05-17T14:54:39.113713+0000","last_clean":"2023-05-17T14:54:39.113713+0000","last_became_active":"2023-05-17T14:54:39.113440+0000","last_became_peered":"2023-05-17T14:54:39.113440+0000","last_unstale":"2023-05-17T14:54:39.113713+0000","last_undegraded":"2023-05-17T14:54:39.113713+0000","last_fullsized":"2023-05-17T14:54:39.113713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.735845+0000","last_change":"2023-05-17T14:54:38.731293+0000","last_active":"2023-05-17T14:54:38.735845+0000","last_peered":"2023-05-17T14:54:38.735845+0000","last_clean":"2023-05-17T14:54:38.735845+0000","last_became_active":"2023-05-17T14:54:38.730997+0000","last_became_peered":"2023-05-17T14:54:38.730997+0000","last_unstale":"2023-05-17T14:54:38.735845+0000","last_undegraded":"2023-05-17T14:54:38.735845+0000","last_fullsized":"2023-05-17T14:54:38.735845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116340+0000","last_change":"2023-05-17T14:54:39.116340+0000","last_active":"2023-05-17T14:54:39.116340+0000","last_peered":"2023-05-17T14:54:39.116340+0000","last_clean":"2023-05-17T14:54:39.116340+0000","last_became_active":"2023-05-17T14:54:39.116024+0000","last_became_peered":"2023-05-17T14:54:39.116024+0000","last_unstale":"2023-05-17T14:54:39.116340+0000","last_undegraded":"2023-05-17T14:54:39.116340+0000","last_fullsized":"2023-05-17T14:54:39.116340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127669+0000","last_change":"2023-05-17T14:54:38.735852+0000","last_active":"2023-05-17T14:54:39.127669+0000","last_peered":"2023-05-17T14:54:39.127669+0000","last_clean":"2023-05-17T14:54:39.127669+0000","last_became_active":"2023-05-17T14:54:38.735139+0000","last_became_peered":"2023-05-17T14:54:38.735139+0000","last_unstale":"2023-05-17T14:54:39.127669+0000","last_undegraded":"2023-05-17T14:54:39.127669+0000","last_fullsized":"2023-05-17T14:54:39.127669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123199+0000","last_change":"2023-05-17T14:54:39.123199+0000","last_active":"2023-05-17T14:54:39.123199+0000","last_peered":"2023-05-17T14:54:39.123199+0000","last_clean":"2023-05-17T14:54:39.123199+0000","last_became_active":"2023-05-17T14:54:39.122891+0000","last_became_peered":"2023-05-17T14:54:39.122891+0000","last_unstale":"2023-05-17T14:54:39.123199+0000","last_undegraded":"2023-05-17T14:54:39.123199+0000","last_fullsized":"2023-05-17T14:54:39.123199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739799+0000","last_change":"2023-05-17T14:54:38.737843+0000","last_active":"2023-05-17T14:54:38.739799+0000","last_peered":"2023-05-17T14:54:38.739799+0000","last_clean":"2023-05-17T14:54:38.739799+0000","last_became_active":"2023-05-17T14:54:38.737511+0000","last_became_peered":"2023-05-17T14:54:38.737511+0000","last_unstale":"2023-05-17T14:54:38.739799+0000","last_undegraded":"2023-05-17T14:54:38.739799+0000","last_fullsized":"2023-05-17T14:54:38.739799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.125890+0000","last_change":"2023-05-17T14:54:39.125890+0000","last_active":"2023-05-17T14:54:39.125890+0000","last_peered":"2023-05-17T14:54:39.125890+0000","last_clean":"2023-05-17T14:54:39.125890+0000","last_became_active":"2023-05-17T14:54:39.125550+0000","last_became_peered":"2023-05-17T14:54:39.125550+0000","last_unstale":"2023-05-17T14:54:39.125890+0000","last_undegraded":"2023-05-17T14:54:39.125890+0000","last_fullsized":"2023-05-17T14:54:39.125890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736636+0000","last_change":"2023-05-17T14:54:38.731421+0000","last_active":"2023-05-17T14:54:38.736636+0000","last_peered":"2023-05-17T14:54:38.736636+0000","last_clean":"2023-05-17T14:54:38.736636+0000","last_became_active":"2023-05-17T14:54:38.730326+0000","last_became_peered":"2023-05-17T14:54:38.730326+0000","last_unstale":"2023-05-17T14:54:38.736636+0000","last_undegraded":"2023-05-17T14:54:38.736636+0000","last_fullsized":"2023-05-17T14:54:38.736636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119452+0000","last_change":"2023-05-17T14:54:39.119452+0000","last_active":"2023-05-17T14:54:39.119452+0000","last_peered":"2023-05-17T14:54:39.119452+0000","last_clean":"2023-05-17T14:54:39.119452+0000","last_became_active":"2023-05-17T14:54:39.119160+0000","last_became_peered":"2023-05-17T14:54:39.119160+0000","last_unstale":"2023-05-17T14:54:39.119452+0000","last_undegraded":"2023-05-17T14:54:39.119452+0000","last_fullsized":"2023-05-17T14:54:39.119452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108142+0000","last_change":"2023-05-17T14:54:38.727259+0000","last_active":"2023-05-17T14:54:39.108142+0000","last_peered":"2023-05-17T14:54:39.108142+0000","last_clean":"2023-05-17T14:54:39.108142+0000","last_became_active":"2023-05-17T14:54:38.727014+0000","last_became_peered":"2023-05-17T14:54:38.727014+0000","last_unstale":"2023-05-17T14:54:39.108142+0000","last_undegraded":"2023-05-17T14:54:39.108142+0000","last_fullsized":"2023-05-17T14:54:39.108142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127119+0000","last_change":"2023-05-17T14:54:39.127119+0000","last_active":"2023-05-17T14:54:39.127119+0000","last_peered":"2023-05-17T14:54:39.127119+0000","last_clean":"2023-05-17T14:54:39.127119+0000","last_became_active":"2023-05-17T14:54:39.126829+0000","last_became_peered":"2023-05-17T14:54:39.126829+0000","last_unstale":"2023-05-17T14:54:39.127119+0000","last_undegraded":"2023-05-17T14:54:39.127119+0000","last_fullsized":"2023-05-17T14:54:39.127119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.741323+0000","last_change":"2023-05-17T14:54:38.739396+0000","last_active":"2023-05-17T14:54:38.741323+0000","last_peered":"2023-05-17T14:54:38.741323+0000","last_clean":"2023-05-17T14:54:38.741323+0000","last_became_active":"2023-05-17T14:54:38.739097+0000","last_became_peered":"2023-05-17T14:54:38.739097+0000","last_unstale":"2023-05-17T14:54:38.741323+0000","last_undegraded":"2023-05-17T14:54:38.741323+0000","last_fullsized":"2023-05-17T14:54:38.741323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.121993+0000","last_change":"2023-05-17T14:54:39.121993+0000","last_active":"2023-05-17T14:54:39.121993+0000","last_peered":"2023-05-17T14:54:39.121993+0000","last_clean":"2023-05-17T14:54:39.121993+0000","last_became_active":"2023-05-17T14:54:39.121418+0000","last_became_peered":"2023-05-17T14:54:39.121418+0000","last_unstale":"2023-05-17T14:54:39.121993+0000","last_undegraded":"2023-05-17T14:54:39.121993+0000","last_fullsized":"2023-05-17T14:54:39.121993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.103082+0000","last_change":"2023-05-17T14:54:38.731922+0000","last_active":"2023-05-17T14:54:39.103082+0000","last_peered":"2023-05-17T14:54:39.103082+0000","last_clean":"2023-05-17T14:54:39.103082+0000","last_became_active":"2023-05-17T14:54:38.731618+0000","last_became_peered":"2023-05-17T14:54:38.731618+0000","last_unstale":"2023-05-17T14:54:39.103082+0000","last_undegraded":"2023-05-17T14:54:39.103082+0000","last_fullsized":"2023-05-17T14:54:39.103082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123753+0000","last_change":"2023-05-17T14:54:39.123753+0000","last_active":"2023-05-17T14:54:39.123753+0000","last_peered":"2023-05-17T14:54:39.123753+0000","last_clean":"2023-05-17T14:54:39.123753+0000","last_became_active":"2023-05-17T14:54:39.123486+0000","last_became_peered":"2023-05-17T14:54:39.123486+0000","last_unstale":"2023-05-17T14:54:39.123753+0000","last_undegraded":"2023-05-17T14:54:39.123753+0000","last_fullsized":"2023-05-17T14:54:39.123753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740532+0000","last_change":"2023-05-17T14:54:38.736694+0000","last_active":"2023-05-17T14:54:38.740532+0000","last_peered":"2023-05-17T14:54:38.740532+0000","last_clean":"2023-05-17T14:54:38.740532+0000","last_became_active":"2023-05-17T14:54:38.736358+0000","last_became_peered":"2023-05-17T14:54:38.736358+0000","last_unstale":"2023-05-17T14:54:38.740532+0000","last_undegraded":"2023-05-17T14:54:38.740532+0000","last_fullsized":"2023-05-17T14:54:38.740532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113152+0000","last_change":"2023-05-17T14:54:39.113152+0000","last_active":"2023-05-17T14:54:39.113152+0000","last_peered":"2023-05-17T14:54:39.113152+0000","last_clean":"2023-05-17T14:54:39.113152+0000","last_became_active":"2023-05-17T14:54:39.112803+0000","last_became_peered":"2023-05-17T14:54:39.112803+0000","last_unstale":"2023-05-17T14:54:39.113152+0000","last_undegraded":"2023-05-17T14:54:39.113152+0000","last_fullsized":"2023-05-17T14:54:39.113152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736585+0000","last_change":"2023-05-17T14:54:38.731909+0000","last_active":"2023-05-17T14:54:38.736585+0000","last_peered":"2023-05-17T14:54:38.736585+0000","last_clean":"2023-05-17T14:54:38.736585+0000","last_became_active":"2023-05-17T14:54:38.731521+0000","last_became_peered":"2023-05-17T14:54:38.731521+0000","last_unstale":"2023-05-17T14:54:38.736585+0000","last_undegraded":"2023-05-17T14:54:38.736585+0000","last_fullsized":"2023-05-17T14:54:38.736585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.128701+0000","last_change":"2023-05-17T14:54:39.128701+0000","last_active":"2023-05-17T14:54:39.128701+0000","last_peered":"2023-05-17T14:54:39.128701+0000","last_clean":"2023-05-17T14:54:39.128701+0000","last_became_active":"2023-05-17T14:54:39.126613+0000","last_became_peered":"2023-05-17T14:54:39.126613+0000","last_unstale":"2023-05-17T14:54:39.128701+0000","last_undegraded":"2023-05-17T14:54:39.128701+0000","last_fullsized":"2023-05-17T14:54:39.128701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.733873+0000","last_change":"2023-05-17T14:54:38.730671+0000","last_active":"2023-05-17T14:54:38.733873+0000","last_peered":"2023-05-17T14:54:38.733873+0000","last_clean":"2023-05-17T14:54:38.733873+0000","last_became_active":"2023-05-17T14:54:38.730371+0000","last_became_peered":"2023-05-17T14:54:38.730371+0000","last_unstale":"2023-05-17T14:54:38.733873+0000","last_undegraded":"2023-05-17T14:54:38.733873+0000","last_fullsized":"2023-05-17T14:54:38.733873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118312+0000","last_change":"2023-05-17T14:54:39.118312+0000","last_active":"2023-05-17T14:54:39.118312+0000","last_peered":"2023-05-17T14:54:39.118312+0000","last_clean":"2023-05-17T14:54:39.118312+0000","last_became_active":"2023-05-17T14:54:39.118028+0000","last_became_peered":"2023-05-17T14:54:39.118028+0000","last_unstale":"2023-05-17T14:54:39.118312+0000","last_undegraded":"2023-05-17T14:54:39.118312+0000","last_fullsized":"2023-05-17T14:54:39.118312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.729825+0000","last_change":"2023-05-17T14:54:38.726458+0000","last_active":"2023-05-17T14:54:38.729825+0000","last_peered":"2023-05-17T14:54:38.729825+0000","last_clean":"2023-05-17T14:54:38.729825+0000","last_became_active":"2023-05-17T14:54:38.726187+0000","last_became_peered":"2023-05-17T14:54:38.726187+0000","last_unstale":"2023-05-17T14:54:38.729825+0000","last_undegraded":"2023-05-17T14:54:38.729825+0000","last_fullsized":"2023-05-17T14:54:38.729825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119086+0000","last_change":"2023-05-17T14:54:39.119086+0000","last_active":"2023-05-17T14:54:39.119086+0000","last_peered":"2023-05-17T14:54:39.119086+0000","last_clean":"2023-05-17T14:54:39.119086+0000","last_became_active":"2023-05-17T14:54:39.118774+0000","last_became_peered":"2023-05-17T14:54:39.118774+0000","last_unstale":"2023-05-17T14:54:39.119086+0000","last_undegraded":"2023-05-17T14:54:39.119086+0000","last_fullsized":"2023-05-17T14:54:39.119086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736658+0000","last_change":"2023-05-17T14:54:38.731679+0000","last_active":"2023-05-17T14:54:38.736658+0000","last_peered":"2023-05-17T14:54:38.736658+0000","last_clean":"2023-05-17T14:54:38.736658+0000","last_became_active":"2023-05-17T14:54:38.731146+0000","last_became_peered":"2023-05-17T14:54:38.731146+0000","last_unstale":"2023-05-17T14:54:38.736658+0000","last_undegraded":"2023-05-17T14:54:38.736658+0000","last_fullsized":"2023-05-17T14:54:38.736658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.111491+0000","last_change":"2023-05-17T14:54:39.111491+0000","last_active":"2023-05-17T14:54:39.111491+0000","last_peered":"2023-05-17T14:54:39.111491+0000","last_clean":"2023-05-17T14:54:39.111491+0000","last_became_active":"2023-05-17T14:54:39.111253+0000","last_became_peered":"2023-05-17T14:54:39.111253+0000","last_unstale":"2023-05-17T14:54:39.111491+0000","last_undegraded":"2023-05-17T14:54:39.111491+0000","last_fullsized":"2023-05-17T14:54:39.111491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.743693+0000","last_change":"2023-05-17T14:54:38.739990+0000","last_active":"2023-05-17T14:54:38.743693+0000","last_peered":"2023-05-17T14:54:38.743693+0000","last_clean":"2023-05-17T14:54:38.743693+0000","last_became_active":"2023-05-17T14:54:38.739620+0000","last_became_peered":"2023-05-17T14:54:38.739620+0000","last_unstale":"2023-05-17T14:54:38.743693+0000","last_undegraded":"2023-05-17T14:54:38.743693+0000","last_fullsized":"2023-05-17T14:54:38.743693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115737+0000","last_change":"2023-05-17T14:54:39.115737+0000","last_active":"2023-05-17T14:54:39.115737+0000","last_peered":"2023-05-17T14:54:39.115737+0000","last_clean":"2023-05-17T14:54:39.115737+0000","last_became_active":"2023-05-17T14:54:39.115445+0000","last_became_peered":"2023-05-17T14:54:39.115445+0000","last_unstale":"2023-05-17T14:54:39.115737+0000","last_undegraded":"2023-05-17T14:54:39.115737+0000","last_fullsized":"2023-05-17T14:54:39.115737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.735676+0000","last_change":"2023-05-17T14:54:38.731245+0000","last_active":"2023-05-17T14:54:38.735676+0000","last_peered":"2023-05-17T14:54:38.735676+0000","last_clean":"2023-05-17T14:54:38.735676+0000","last_became_active":"2023-05-17T14:54:38.730199+0000","last_became_peered":"2023-05-17T14:54:38.730199+0000","last_unstale":"2023-05-17T14:54:38.735676+0000","last_undegraded":"2023-05-17T14:54:38.735676+0000","last_fullsized":"2023-05-17T14:54:38.735676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120807+0000","last_change":"2023-05-17T14:54:39.120807+0000","last_active":"2023-05-17T14:54:39.120807+0000","last_peered":"2023-05-17T14:54:39.120807+0000","last_clean":"2023-05-17T14:54:39.120807+0000","last_became_active":"2023-05-17T14:54:39.120496+0000","last_became_peered":"2023-05-17T14:54:39.120496+0000","last_unstale":"2023-05-17T14:54:39.120807+0000","last_undegraded":"2023-05-17T14:54:39.120807+0000","last_fullsized":"2023-05-17T14:54:39.120807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740630+0000","last_change":"2023-05-17T14:54:38.737222+0000","last_active":"2023-05-17T14:54:38.740630+0000","last_peered":"2023-05-17T14:54:38.740630+0000","last_clean":"2023-05-17T14:54:38.740630+0000","last_became_active":"2023-05-17T14:54:38.736834+0000","last_became_peered":"2023-05-17T14:54:38.736834+0000","last_unstale":"2023-05-17T14:54:38.740630+0000","last_undegraded":"2023-05-17T14:54:38.740630+0000","last_fullsized":"2023-05-17T14:54:38.740630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123197+0000","last_change":"2023-05-17T14:54:39.123197+0000","last_active":"2023-05-17T14:54:39.123197+0000","last_peered":"2023-05-17T14:54:39.123197+0000","last_clean":"2023-05-17T14:54:39.123197+0000","last_became_active":"2023-05-17T14:54:39.122892+0000","last_became_peered":"2023-05-17T14:54:39.122892+0000","last_unstale":"2023-05-17T14:54:39.123197+0000","last_undegraded":"2023-05-17T14:54:39.123197+0000","last_fullsized":"2023-05-17T14:54:39.123197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739617+0000","last_change":"2023-05-17T14:54:38.738010+0000","last_active":"2023-05-17T14:54:38.739617+0000","last_peered":"2023-05-17T14:54:38.739617+0000","last_clean":"2023-05-17T14:54:38.739617+0000","last_became_active":"2023-05-17T14:54:38.737695+0000","last_became_peered":"2023-05-17T14:54:38.737695+0000","last_unstale":"2023-05-17T14:54:38.739617+0000","last_undegraded":"2023-05-17T14:54:38.739617+0000","last_fullsized":"2023-05-17T14:54:38.739617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116628+0000","last_change":"2023-05-17T14:54:39.116628+0000","last_active":"2023-05-17T14:54:39.116628+0000","last_peered":"2023-05-17T14:54:39.116628+0000","last_clean":"2023-05-17T14:54:39.116628+0000","last_became_active":"2023-05-17T14:54:39.116314+0000","last_became_peered":"2023-05-17T14:54:39.116314+0000","last_unstale":"2023-05-17T14:54:39.116628+0000","last_undegraded":"2023-05-17T14:54:39.116628+0000","last_fullsized":"2023-05-17T14:54:39.116628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738585+0000","last_change":"2023-05-17T14:54:38.733705+0000","last_active":"2023-05-17T14:54:38.738585+0000","last_peered":"2023-05-17T14:54:38.738585+0000","last_clean":"2023-05-17T14:54:38.738585+0000","last_became_active":"2023-05-17T14:54:38.733360+0000","last_became_peered":"2023-05-17T14:54:38.733360+0000","last_unstale":"2023-05-17T14:54:38.738585+0000","last_undegraded":"2023-05-17T14:54:38.738585+0000","last_fullsized":"2023-05-17T14:54:38.738585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124504+0000","last_change":"2023-05-17T14:54:39.124504+0000","last_active":"2023-05-17T14:54:39.124504+0000","last_peered":"2023-05-17T14:54:39.124504+0000","last_clean":"2023-05-17T14:54:39.124504+0000","last_became_active":"2023-05-17T14:54:39.124180+0000","last_became_peered":"2023-05-17T14:54:39.124180+0000","last_unstale":"2023-05-17T14:54:39.124504+0000","last_undegraded":"2023-05-17T14:54:39.124504+0000","last_fullsized":"2023-05-17T14:54:39.124504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738733+0000","last_change":"2023-05-17T14:54:38.730765+0000","last_active":"2023-05-17T14:54:38.738733+0000","last_peered":"2023-05-17T14:54:38.738733+0000","last_clean":"2023-05-17T14:54:38.738733+0000","last_became_active":"2023-05-17T14:54:38.730482+0000","last_became_peered":"2023-05-17T14:54:38.730482+0000","last_unstale":"2023-05-17T14:54:38.738733+0000","last_undegraded":"2023-05-17T14:54:38.738733+0000","last_fullsized":"2023-05-17T14:54:38.738733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.130101+0000","last_change":"2023-05-17T14:54:39.130101+0000","last_active":"2023-05-17T14:54:39.130101+0000","last_peered":"2023-05-17T14:54:39.130101+0000","last_clean":"2023-05-17T14:54:39.130101+0000","last_became_active":"2023-05-17T14:54:39.129710+0000","last_became_peered":"2023-05-17T14:54:39.129710+0000","last_unstale":"2023-05-17T14:54:39.130101+0000","last_undegraded":"2023-05-17T14:54:39.130101+0000","last_fullsized":"2023-05-17T14:54:39.130101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.109545+0000","last_change":"2023-05-17T14:54:38.732936+0000","last_active":"2023-05-17T14:54:39.109545+0000","last_peered":"2023-05-17T14:54:39.109545+0000","last_clean":"2023-05-17T14:54:39.109545+0000","last_became_active":"2023-05-17T14:54:38.732626+0000","last_became_peered":"2023-05-17T14:54:38.732626+0000","last_unstale":"2023-05-17T14:54:39.109545+0000","last_undegraded":"2023-05-17T14:54:39.109545+0000","last_fullsized":"2023-05-17T14:54:39.109545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127321+0000","last_change":"2023-05-17T14:54:39.127321+0000","last_active":"2023-05-17T14:54:39.127321+0000","last_peered":"2023-05-17T14:54:39.127321+0000","last_clean":"2023-05-17T14:54:39.127321+0000","last_became_active":"2023-05-17T14:54:39.127072+0000","last_became_peered":"2023-05-17T14:54:39.127072+0000","last_unstale":"2023-05-17T14:54:39.127321+0000","last_undegraded":"2023-05-17T14:54:39.127321+0000","last_fullsized":"2023-05-17T14:54:39.127321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.102542+0000","last_change":"2023-05-17T14:54:38.732107+0000","last_active":"2023-05-17T14:54:39.102542+0000","last_peered":"2023-05-17T14:54:39.102542+0000","last_clean":"2023-05-17T14:54:39.102542+0000","last_became_active":"2023-05-17T14:54:38.731537+0000","last_became_peered":"2023-05-17T14:54:38.731537+0000","last_unstale":"2023-05-17T14:54:39.102542+0000","last_undegraded":"2023-05-17T14:54:39.102542+0000","last_fullsized":"2023-05-17T14:54:39.102542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117363+0000","last_change":"2023-05-17T14:54:39.117363+0000","last_active":"2023-05-17T14:54:39.117363+0000","last_peered":"2023-05-17T14:54:39.117363+0000","last_clean":"2023-05-17T14:54:39.117363+0000","last_became_active":"2023-05-17T14:54:39.117073+0000","last_became_peered":"2023-05-17T14:54:39.117073+0000","last_unstale":"2023-05-17T14:54:39.117363+0000","last_undegraded":"2023-05-17T14:54:39.117363+0000","last_fullsized":"2023-05-17T14:54:39.117363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.125126+0000","last_change":"2023-05-17T14:54:38.739933+0000","last_active":"2023-05-17T14:54:39.125126+0000","last_peered":"2023-05-17T14:54:39.125126+0000","last_clean":"2023-05-17T14:54:39.125126+0000","last_became_active":"2023-05-17T14:54:38.739235+0000","last_became_peered":"2023-05-17T14:54:38.739235+0000","last_unstale":"2023-05-17T14:54:39.125126+0000","last_undegraded":"2023-05-17T14:54:39.125126+0000","last_fullsized":"2023-05-17T14:54:39.125126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126193+0000","last_change":"2023-05-17T14:54:39.126193+0000","last_active":"2023-05-17T14:54:39.126193+0000","last_peered":"2023-05-17T14:54:39.126193+0000","last_clean":"2023-05-17T14:54:39.126193+0000","last_became_active":"2023-05-17T14:54:39.125743+0000","last_became_peered":"2023-05-17T14:54:39.125743+0000","last_unstale":"2023-05-17T14:54:39.126193+0000","last_undegraded":"2023-05-17T14:54:39.126193+0000","last_fullsized":"2023-05-17T14:54:39.126193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738331+0000","last_change":"2023-05-17T14:54:38.729692+0000","last_active":"2023-05-17T14:54:38.738331+0000","last_peered":"2023-05-17T14:54:38.738331+0000","last_clean":"2023-05-17T14:54:38.738331+0000","last_became_active":"2023-05-17T14:54:38.729367+0000","last_became_peered":"2023-05-17T14:54:38.729367+0000","last_unstale":"2023-05-17T14:54:38.738331+0000","last_undegraded":"2023-05-17T14:54:38.738331+0000","last_fullsized":"2023-05-17T14:54:38.738331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.106711+0000","last_change":"2023-05-17T14:54:39.106711+0000","last_active":"2023-05-17T14:54:39.106711+0000","last_peered":"2023-05-17T14:54:39.106711+0000","last_clean":"2023-05-17T14:54:39.106711+0000","last_became_active":"2023-05-17T14:54:39.106486+0000","last_became_peered":"2023-05-17T14:54:39.106486+0000","last_unstale":"2023-05-17T14:54:39.106711+0000","last_undegraded":"2023-05-17T14:54:39.106711+0000","last_fullsized":"2023-05-17T14:54:39.106711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740454+0000","last_change":"2023-05-17T14:54:38.733934+0000","last_active":"2023-05-17T14:54:38.740454+0000","last_peered":"2023-05-17T14:54:38.740454+0000","last_clean":"2023-05-17T14:54:38.740454+0000","last_became_active":"2023-05-17T14:54:38.733213+0000","last_became_peered":"2023-05-17T14:54:38.733213+0000","last_unstale":"2023-05-17T14:54:38.740454+0000","last_undegraded":"2023-05-17T14:54:38.740454+0000","last_fullsized":"2023-05-17T14:54:38.740454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.128397+0000","last_change":"2023-05-17T14:54:39.128397+0000","last_active":"2023-05-17T14:54:39.128397+0000","last_peered":"2023-05-17T14:54:39.128397+0000","last_clean":"2023-05-17T14:54:39.128397+0000","last_became_active":"2023-05-17T14:54:39.126233+0000","last_became_peered":"2023-05-17T14:54:39.126233+0000","last_unstale":"2023-05-17T14:54:39.128397+0000","last_undegraded":"2023-05-17T14:54:39.128397+0000","last_fullsized":"2023-05-17T14:54:39.128397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.741710+0000","last_change":"2023-05-17T14:54:38.739377+0000","last_active":"2023-05-17T14:54:38.741710+0000","last_peered":"2023-05-17T14:54:38.741710+0000","last_clean":"2023-05-17T14:54:38.741710+0000","last_became_active":"2023-05-17T14:54:38.739055+0000","last_became_peered":"2023-05-17T14:54:38.739055+0000","last_unstale":"2023-05-17T14:54:38.741710+0000","last_undegraded":"2023-05-17T14:54:38.741710+0000","last_fullsized":"2023-05-17T14:54:38.741710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120962+0000","last_change":"2023-05-17T14:54:39.120962+0000","last_active":"2023-05-17T14:54:39.120962+0000","last_peered":"2023-05-17T14:54:39.120962+0000","last_clean":"2023-05-17T14:54:39.120962+0000","last_became_active":"2023-05-17T14:54:39.120673+0000","last_became_peered":"2023-05-17T14:54:39.120673+0000","last_unstale":"2023-05-17T14:54:39.120962+0000","last_undegraded":"2023-05-17T14:54:39.120962+0000","last_fullsized":"2023-05-17T14:54:39.120962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739103+0000","last_change":"2023-05-17T14:54:38.735025+0000","last_active":"2023-05-17T14:54:38.739103+0000","last_peered":"2023-05-17T14:54:38.739103+0000","last_clean":"2023-05-17T14:54:38.739103+0000","last_became_active":"2023-05-17T14:54:38.734753+0000","last_became_peered":"2023-05-17T14:54:38.734753+0000","last_unstale":"2023-05-17T14:54:38.739103+0000","last_undegraded":"2023-05-17T14:54:38.739103+0000","last_fullsized":"2023-05-17T14:54:38.739103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120052+0000","last_change":"2023-05-17T14:54:39.120052+0000","last_active":"2023-05-17T14:54:39.120052+0000","last_peered":"2023-05-17T14:54:39.120052+0000","last_clean":"2023-05-17T14:54:39.120052+0000","last_became_active":"2023-05-17T14:54:39.119468+0000","last_became_peered":"2023-05-17T14:54:39.119468+0000","last_unstale":"2023-05-17T14:54:39.120052+0000","last_undegraded":"2023-05-17T14:54:39.120052+0000","last_fullsized":"2023-05-17T14:54:39.120052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740420+0000","last_change":"2023-05-17T14:54:38.732212+0000","last_active":"2023-05-17T14:54:38.740420+0000","last_peered":"2023-05-17T14:54:38.740420+0000","last_clean":"2023-05-17T14:54:38.740420+0000","last_became_active":"2023-05-17T14:54:38.731874+0000","last_became_peered":"2023-05-17T14:54:38.731874+0000","last_unstale":"2023-05-17T14:54:38.740420+0000","last_undegraded":"2023-05-17T14:54:38.740420+0000","last_fullsized":"2023-05-17T14:54:38.740420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117851+0000","last_change":"2023-05-17T14:54:39.117851+0000","last_active":"2023-05-17T14:54:39.117851+0000","last_peered":"2023-05-17T14:54:39.117851+0000","last_clean":"2023-05-17T14:54:39.117851+0000","last_became_active":"2023-05-17T14:54:39.117046+0000","last_became_peered":"2023-05-17T14:54:39.117046+0000","last_unstale":"2023-05-17T14:54:39.117851+0000","last_undegraded":"2023-05-17T14:54:39.117851+0000","last_fullsized":"2023-05-17T14:54:39.117851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736496+0000","last_change":"2023-05-17T14:54:38.730397+0000","last_active":"2023-05-17T14:54:38.736496+0000","last_peered":"2023-05-17T14:54:38.736496+0000","last_clean":"2023-05-17T14:54:38.736496+0000","last_became_active":"2023-05-17T14:54:38.730086+0000","last_became_peered":"2023-05-17T14:54:38.730086+0000","last_unstale":"2023-05-17T14:54:38.736496+0000","last_undegraded":"2023-05-17T14:54:38.736496+0000","last_fullsized":"2023-05-17T14:54:38.736496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.122442+0000","last_change":"2023-05-17T14:54:39.122442+0000","last_active":"2023-05-17T14:54:39.122442+0000","last_peered":"2023-05-17T14:54:39.122442+0000","last_clean":"2023-05-17T14:54:39.122442+0000","last_became_active":"2023-05-17T14:54:39.121818+0000","last_became_peered":"2023-05-17T14:54:39.121818+0000","last_unstale":"2023-05-17T14:54:39.122442+0000","last_undegraded":"2023-05-17T14:54:39.122442+0000","last_fullsized":"2023-05-17T14:54:39.122442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740593+0000","last_change":"2023-05-17T14:54:38.734904+0000","last_active":"2023-05-17T14:54:38.740593+0000","last_peered":"2023-05-17T14:54:38.740593+0000","last_clean":"2023-05-17T14:54:38.740593+0000","last_became_active":"2023-05-17T14:54:38.734586+0000","last_became_peered":"2023-05-17T14:54:38.734586+0000","last_unstale":"2023-05-17T14:54:38.740593+0000","last_undegraded":"2023-05-17T14:54:38.740593+0000","last_fullsized":"2023-05-17T14:54:38.740593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119385+0000","last_change":"2023-05-17T14:54:39.119385+0000","last_active":"2023-05-17T14:54:39.119385+0000","last_peered":"2023-05-17T14:54:39.119385+0000","last_clean":"2023-05-17T14:54:39.119385+0000","last_became_active":"2023-05-17T14:54:39.119094+0000","last_became_peered":"2023-05-17T14:54:39.119094+0000","last_unstale":"2023-05-17T14:54:39.119385+0000","last_undegraded":"2023-05-17T14:54:39.119385+0000","last_fullsized":"2023-05-17T14:54:39.119385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126431+0000","last_change":"2023-05-17T14:54:38.730761+0000","last_active":"2023-05-17T14:54:39.126431+0000","last_peered":"2023-05-17T14:54:39.126431+0000","last_clean":"2023-05-17T14:54:39.126431+0000","last_became_active":"2023-05-17T14:54:38.730480+0000","last_became_peered":"2023-05-17T14:54:38.730480+0000","last_unstale":"2023-05-17T14:54:39.126431+0000","last_undegraded":"2023-05-17T14:54:39.126431+0000","last_fullsized":"2023-05-17T14:54:39.126431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113004+0000","last_change":"2023-05-17T14:54:39.113004+0000","last_active":"2023-05-17T14:54:39.113004+0000","last_peered":"2023-05-17T14:54:39.113004+0000","last_clean":"2023-05-17T14:54:39.113004+0000","last_became_active":"2023-05-17T14:54:39.112710+0000","last_became_peered":"2023-05-17T14:54:39.112710+0000","last_unstale":"2023-05-17T14:54:39.113004+0000","last_undegraded":"2023-05-17T14:54:39.113004+0000","last_fullsized":"2023-05-17T14:54:39.113004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123428+0000","last_change":"2023-05-17T14:54:38.730962+0000","last_active":"2023-05-17T14:54:39.123428+0000","last_peered":"2023-05-17T14:54:39.123428+0000","last_clean":"2023-05-17T14:54:39.123428+0000","last_became_active":"2023-05-17T14:54:38.730676+0000","last_became_peered":"2023-05-17T14:54:38.730676+0000","last_unstale":"2023-05-17T14:54:39.123428+0000","last_undegraded":"2023-05-17T14:54:39.123428+0000","last_fullsized":"2023-05-17T14:54:39.123428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.107424+0000","last_change":"2023-05-17T14:54:39.107424+0000","last_active":"2023-05-17T14:54:39.107424+0000","last_peered":"2023-05-17T14:54:39.107424+0000","last_clean":"2023-05-17T14:54:39.107424+0000","last_became_active":"2023-05-17T14:54:39.107184+0000","last_became_peered":"2023-05-17T14:54:39.107184+0000","last_unstale":"2023-05-17T14:54:39.107424+0000","last_undegraded":"2023-05-17T14:54:39.107424+0000","last_fullsized":"2023-05-17T14:54:39.107424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113010+0000","last_change":"2023-05-17T14:54:38.727928+0000","last_active":"2023-05-17T14:54:39.113010+0000","last_peered":"2023-05-17T14:54:39.113010+0000","last_clean":"2023-05-17T14:54:39.113010+0000","last_became_active":"2023-05-17T14:54:38.727615+0000","last_became_peered":"2023-05-17T14:54:38.727615+0000","last_unstale":"2023-05-17T14:54:39.113010+0000","last_undegraded":"2023-05-17T14:54:39.113010+0000","last_fullsized":"2023-05-17T14:54:39.113010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115572+0000","last_change":"2023-05-17T14:54:39.115572+0000","last_active":"2023-05-17T14:54:39.115572+0000","last_peered":"2023-05-17T14:54:39.115572+0000","last_clean":"2023-05-17T14:54:39.115572+0000","last_became_active":"2023-05-17T14:54:39.115271+0000","last_became_peered":"2023-05-17T14:54:39.115271+0000","last_unstale":"2023-05-17T14:54:39.115572+0000","last_undegraded":"2023-05-17T14:54:39.115572+0000","last_fullsized":"2023-05-17T14:54:39.115572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739382+0000","last_change":"2023-05-17T14:54:38.737265+0000","last_active":"2023-05-17T14:54:38.739382+0000","last_peered":"2023-05-17T14:54:38.739382+0000","last_clean":"2023-05-17T14:54:38.739382+0000","last_became_active":"2023-05-17T14:54:38.737002+0000","last_became_peered":"2023-05-17T14:54:38.737002+0000","last_unstale":"2023-05-17T14:54:38.739382+0000","last_undegraded":"2023-05-17T14:54:38.739382+0000","last_fullsized":"2023-05-17T14:54:38.739382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119888+0000","last_change":"2023-05-17T14:54:39.119888+0000","last_active":"2023-05-17T14:54:39.119888+0000","last_peered":"2023-05-17T14:54:39.119888+0000","last_clean":"2023-05-17T14:54:39.119888+0000","last_became_active":"2023-05-17T14:54:39.119553+0000","last_became_peered":"2023-05-17T14:54:39.119553+0000","last_unstale":"2023-05-17T14:54:39.119888+0000","last_undegraded":"2023-05-17T14:54:39.119888+0000","last_fullsized":"2023-05-17T14:54:39.119888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738566+0000","last_change":"2023-05-17T14:54:38.732294+0000","last_active":"2023-05-17T14:54:38.738566+0000","last_peered":"2023-05-17T14:54:38.738566+0000","last_clean":"2023-05-17T14:54:38.738566+0000","last_became_active":"2023-05-17T14:54:38.732016+0000","last_became_peered":"2023-05-17T14:54:38.732016+0000","last_unstale":"2023-05-17T14:54:38.738566+0000","last_undegraded":"2023-05-17T14:54:38.738566+0000","last_fullsized":"2023-05-17T14:54:38.738566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116765+0000","last_change":"2023-05-17T14:54:39.116765+0000","last_active":"2023-05-17T14:54:39.116765+0000","last_peered":"2023-05-17T14:54:39.116765+0000","last_clean":"2023-05-17T14:54:39.116765+0000","last_became_active":"2023-05-17T14:54:39.115235+0000","last_became_peered":"2023-05-17T14:54:39.115235+0000","last_unstale":"2023-05-17T14:54:39.116765+0000","last_undegraded":"2023-05-17T14:54:39.116765+0000","last_fullsized":"2023-05-17T14:54:39.116765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124274+0000","last_change":"2023-05-17T14:54:38.734842+0000","last_active":"2023-05-17T14:54:39.124274+0000","last_peered":"2023-05-17T14:54:39.124274+0000","last_clean":"2023-05-17T14:54:39.124274+0000","last_became_active":"2023-05-17T14:54:38.732620+0000","last_became_peered":"2023-05-17T14:54:38.732620+0000","last_unstale":"2023-05-17T14:54:39.124274+0000","last_undegraded":"2023-05-17T14:54:39.124274+0000","last_fullsized":"2023-05-17T14:54:39.124274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117219+0000","last_change":"2023-05-17T14:54:39.117219+0000","last_active":"2023-05-17T14:54:39.117219+0000","last_peered":"2023-05-17T14:54:39.117219+0000","last_clean":"2023-05-17T14:54:39.117219+0000","last_became_active":"2023-05-17T14:54:39.116897+0000","last_became_peered":"2023-05-17T14:54:39.116897+0000","last_unstale":"2023-05-17T14:54:39.117219+0000","last_undegraded":"2023-05-17T14:54:39.117219+0000","last_fullsized":"2023-05-17T14:54:39.117219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.102623+0000","last_change":"2023-05-17T14:54:38.734393+0000","last_active":"2023-05-17T14:54:39.102623+0000","last_peered":"2023-05-17T14:54:39.102623+0000","last_clean":"2023-05-17T14:54:39.102623+0000","last_became_active":"2023-05-17T14:54:38.734072+0000","last_became_peered":"2023-05-17T14:54:38.734072+0000","last_unstale":"2023-05-17T14:54:39.102623+0000","last_undegraded":"2023-05-17T14:54:39.102623+0000","last_fullsized":"2023-05-17T14:54:39.102623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126554+0000","last_change":"2023-05-17T14:54:39.126554+0000","last_active":"2023-05-17T14:54:39.126554+0000","last_peered":"2023-05-17T14:54:39.126554+0000","last_clean":"2023-05-17T14:54:39.126554+0000","last_became_active":"2023-05-17T14:54:39.125771+0000","last_became_peered":"2023-05-17T14:54:39.125771+0000","last_unstale":"2023-05-17T14:54:39.126554+0000","last_undegraded":"2023-05-17T14:54:39.126554+0000","last_fullsized":"2023-05-17T14:54:39.126554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120676+0000","last_change":"2023-05-17T14:54:38.734610+0000","last_active":"2023-05-17T14:54:39.120676+0000","last_peered":"2023-05-17T14:54:39.120676+0000","last_clean":"2023-05-17T14:54:39.120676+0000","last_became_active":"2023-05-17T14:54:38.734292+0000","last_became_peered":"2023-05-17T14:54:38.734292+0000","last_unstale":"2023-05-17T14:54:39.120676+0000","last_undegraded":"2023-05-17T14:54:39.120676+0000","last_fullsized":"2023-05-17T14:54:39.120676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116613+0000","last_change":"2023-05-17T14:54:39.116613+0000","last_active":"2023-05-17T14:54:39.116613+0000","last_peered":"2023-05-17T14:54:39.116613+0000","last_clean":"2023-05-17T14:54:39.116613+0000","last_became_active":"2023-05-17T14:54:39.114747+0000","last_became_peered":"2023-05-17T14:54:39.114747+0000","last_unstale":"2023-05-17T14:54:39.116613+0000","last_undegraded":"2023-05-17T14:54:39.116613+0000","last_fullsized":"2023-05-17T14:54:39.116613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736385+0000","last_change":"2023-05-17T14:54:38.732880+0000","last_active":"2023-05-17T14:54:38.736385+0000","last_peered":"2023-05-17T14:54:38.736385+0000","last_clean":"2023-05-17T14:54:38.736385+0000","last_became_active":"2023-05-17T14:54:38.732590+0000","last_became_peered":"2023-05-17T14:54:38.732590+0000","last_unstale":"2023-05-17T14:54:38.736385+0000","last_undegraded":"2023-05-17T14:54:38.736385+0000","last_fullsized":"2023-05-17T14:54:38.736385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119595+0000","last_change":"2023-05-17T14:54:39.119595+0000","last_active":"2023-05-17T14:54:39.119595+0000","last_peered":"2023-05-17T14:54:39.119595+0000","last_clean":"2023-05-17T14:54:39.119595+0000","last_became_active":"2023-05-17T14:54:39.119304+0000","last_became_peered":"2023-05-17T14:54:39.119304+0000","last_unstale":"2023-05-17T14:54:39.119595+0000","last_undegraded":"2023-05-17T14:54:39.119595+0000","last_fullsized":"2023-05-17T14:54:39.119595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.743656+0000","last_change":"2023-05-17T14:54:38.738357+0000","last_active":"2023-05-17T14:54:38.743656+0000","last_peered":"2023-05-17T14:54:38.743656+0000","last_clean":"2023-05-17T14:54:38.743656+0000","last_became_active":"2023-05-17T14:54:38.738060+0000","last_became_peered":"2023-05-17T14:54:38.738060+0000","last_unstale":"2023-05-17T14:54:38.743656+0000","last_undegraded":"2023-05-17T14:54:38.743656+0000","last_fullsized":"2023-05-17T14:54:38.743656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118965+0000","last_change":"2023-05-17T14:54:39.118965+0000","last_active":"2023-05-17T14:54:39.118965+0000","last_peered":"2023-05-17T14:54:39.118965+0000","last_clean":"2023-05-17T14:54:39.118965+0000","last_became_active":"2023-05-17T14:54:39.118629+0000","last_became_peered":"2023-05-17T14:54:39.118629+0000","last_unstale":"2023-05-17T14:54:39.118965+0000","last_undegraded":"2023-05-17T14:54:39.118965+0000","last_fullsized":"2023-05-17T14:54:39.118965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108262+0000","last_change":"2023-05-17T14:54:38.733304+0000","last_active":"2023-05-17T14:54:39.108262+0000","last_peered":"2023-05-17T14:54:39.108262+0000","last_clean":"2023-05-17T14:54:39.108262+0000","last_became_active":"2023-05-17T14:54:38.733033+0000","last_became_peered":"2023-05-17T14:54:38.733033+0000","last_unstale":"2023-05-17T14:54:39.108262+0000","last_undegraded":"2023-05-17T14:54:39.108262+0000","last_fullsized":"2023-05-17T14:54:39.108262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116550+0000","last_change":"2023-05-17T14:54:39.116550+0000","last_active":"2023-05-17T14:54:39.116550+0000","last_peered":"2023-05-17T14:54:39.116550+0000","last_clean":"2023-05-17T14:54:39.116550+0000","last_became_active":"2023-05-17T14:54:39.116281+0000","last_became_peered":"2023-05-17T14:54:39.116281+0000","last_unstale":"2023-05-17T14:54:39.116550+0000","last_undegraded":"2023-05-17T14:54:39.116550+0000","last_fullsized":"2023-05-17T14:54:39.116550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736163+0000","last_change":"2023-05-17T14:54:38.731878+0000","last_active":"2023-05-17T14:54:38.736163+0000","last_peered":"2023-05-17T14:54:38.736163+0000","last_clean":"2023-05-17T14:54:38.736163+0000","last_became_active":"2023-05-17T14:54:38.731200+0000","last_became_peered":"2023-05-17T14:54:38.731200+0000","last_unstale":"2023-05-17T14:54:38.736163+0000","last_undegraded":"2023-05-17T14:54:38.736163+0000","last_fullsized":"2023-05-17T14:54:38.736163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113879+0000","last_change":"2023-05-17T14:54:39.113879+0000","last_active":"2023-05-17T14:54:39.113879+0000","last_peered":"2023-05-17T14:54:39.113879+0000","last_clean":"2023-05-17T14:54:39.113879+0000","last_became_active":"2023-05-17T14:54:39.113558+0000","last_became_peered":"2023-05-17T14:54:39.113558+0000","last_unstale":"2023-05-17T14:54:39.113879+0000","last_undegraded":"2023-05-17T14:54:39.113879+0000","last_fullsized":"2023-05-17T14:54:39.113879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739941+0000","last_change":"2023-05-17T14:54:38.738839+0000","last_active":"2023-05-17T14:54:38.739941+0000","last_peered":"2023-05-17T14:54:38.739941+0000","last_clean":"2023-05-17T14:54:38.739941+0000","last_became_active":"2023-05-17T14:54:38.738504+0000","last_became_peered":"2023-05-17T14:54:38.738504+0000","last_unstale":"2023-05-17T14:54:38.739941+0000","last_undegraded":"2023-05-17T14:54:38.739941+0000","last_fullsized":"2023-05-17T14:54:38.739941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118296+0000","last_change":"2023-05-17T14:54:39.118296+0000","last_active":"2023-05-17T14:54:39.118296+0000","last_peered":"2023-05-17T14:54:39.118296+0000","last_clean":"2023-05-17T14:54:39.118296+0000","last_became_active":"2023-05-17T14:54:39.118001+0000","last_became_peered":"2023-05-17T14:54:39.118001+0000","last_unstale":"2023-05-17T14:54:39.118296+0000","last_undegraded":"2023-05-17T14:54:39.118296+0000","last_fullsized":"2023-05-17T14:54:39.118296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736211+0000","last_change":"2023-05-17T14:54:38.732737+0000","last_active":"2023-05-17T14:54:38.736211+0000","last_peered":"2023-05-17T14:54:38.736211+0000","last_clean":"2023-05-17T14:54:38.736211+0000","last_became_active":"2023-05-17T14:54:38.732457+0000","last_became_peered":"2023-05-17T14:54:38.732457+0000","last_unstale":"2023-05-17T14:54:38.736211+0000","last_undegraded":"2023-05-17T14:54:38.736211+0000","last_fullsized":"2023-05-17T14:54:38.736211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116508+0000","last_change":"2023-05-17T14:54:39.116508+0000","last_active":"2023-05-17T14:54:39.116508+0000","last_peered":"2023-05-17T14:54:39.116508+0000","last_clean":"2023-05-17T14:54:39.116508+0000","last_became_active":"2023-05-17T14:54:39.116227+0000","last_became_peered":"2023-05-17T14:54:39.116227+0000","last_unstale":"2023-05-17T14:54:39.116508+0000","last_undegraded":"2023-05-17T14:54:39.116508+0000","last_fullsized":"2023-05-17T14:54:39.116508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736700+0000","last_change":"2023-05-17T14:54:38.732318+0000","last_active":"2023-05-17T14:54:38.736700+0000","last_peered":"2023-05-17T14:54:38.736700+0000","last_clean":"2023-05-17T14:54:38.736700+0000","last_became_active":"2023-05-17T14:54:38.730705+0000","last_became_peered":"2023-05-17T14:54:38.730705+0000","last_unstale":"2023-05-17T14:54:38.736700+0000","last_undegraded":"2023-05-17T14:54:38.736700+0000","last_fullsized":"2023-05-17T14:54:38.736700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.714188+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T14:54:38.714188+0000","last_peered":"2023-05-17T14:54:38.714188+0000","last_clean":"2023-05-17T14:54:38.714188+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T14:54:38.714188+0000","last_undegraded":"2023-05-17T14:54:38.714188+0000","last_fullsized":"2023-05-17T14:54:38.714188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115975+0000","last_change":"2023-05-17T14:54:39.115975+0000","last_active":"2023-05-17T14:54:39.115975+0000","last_peered":"2023-05-17T14:54:39.115975+0000","last_clean":"2023-05-17T14:54:39.115975+0000","last_became_active":"2023-05-17T14:54:39.115753+0000","last_became_peered":"2023-05-17T14:54:39.115753+0000","last_unstale":"2023-05-17T14:54:39.115975+0000","last_undegraded":"2023-05-17T14:54:39.115975+0000","last_fullsized":"2023-05-17T14:54:39.115975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.730500+0000","last_change":"2023-05-17T14:54:38.728610+0000","last_active":"2023-05-17T14:54:38.730500+0000","last_peered":"2023-05-17T14:54:38.730500+0000","last_clean":"2023-05-17T14:54:38.730500+0000","last_became_active":"2023-05-17T14:54:38.728414+0000","last_became_peered":"2023-05-17T14:54:38.728414+0000","last_unstale":"2023-05-17T14:54:38.730500+0000","last_undegraded":"2023-05-17T14:54:38.730500+0000","last_fullsized":"2023-05-17T14:54:38.730500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.717890+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T14:54:38.717890+0000","last_peered":"2023-05-17T14:54:38.717890+0000","last_clean":"2023-05-17T14:54:38.717890+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T14:54:38.717890+0000","last_undegraded":"2023-05-17T14:54:38.717890+0000","last_fullsized":"2023-05-17T14:54:38.717890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.122602+0000","last_change":"2023-05-17T14:54:39.122602+0000","last_active":"2023-05-17T14:54:39.122602+0000","last_peered":"2023-05-17T14:54:39.122602+0000","last_clean":"2023-05-17T14:54:39.122602+0000","last_became_active":"2023-05-17T14:54:39.122226+0000","last_became_peered":"2023-05-17T14:54:39.122226+0000","last_unstale":"2023-05-17T14:54:39.122602+0000","last_undegraded":"2023-05-17T14:54:39.122602+0000","last_fullsized":"2023-05-17T14:54:39.122602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.741359+0000","last_change":"2023-05-17T14:54:38.739570+0000","last_active":"2023-05-17T14:54:38.741359+0000","last_peered":"2023-05-17T14:54:38.741359+0000","last_clean":"2023-05-17T14:54:38.741359+0000","last_became_active":"2023-05-17T14:54:38.739319+0000","last_became_peered":"2023-05-17T14:54:38.739319+0000","last_unstale":"2023-05-17T14:54:38.741359+0000","last_undegraded":"2023-05-17T14:54:38.741359+0000","last_fullsized":"2023-05-17T14:54:38.741359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.714495+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T14:54:38.714495+0000","last_peered":"2023-05-17T14:54:38.714495+0000","last_clean":"2023-05-17T14:54:38.714495+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T14:54:38.714495+0000","last_undegraded":"2023-05-17T14:54:38.714495+0000","last_fullsized":"2023-05-17T14:54:38.714495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120280+0000","last_change":"2023-05-17T14:54:39.120280+0000","last_active":"2023-05-17T14:54:39.120280+0000","last_peered":"2023-05-17T14:54:39.120280+0000","last_clean":"2023-05-17T14:54:39.120280+0000","last_became_active":"2023-05-17T14:54:39.120004+0000","last_became_peered":"2023-05-17T14:54:39.120004+0000","last_unstale":"2023-05-17T14:54:39.120280+0000","last_undegraded":"2023-05-17T14:54:39.120280+0000","last_fullsized":"2023-05-17T14:54:39.120280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739556+0000","last_change":"2023-05-17T14:54:38.736142+0000","last_active":"2023-05-17T14:54:38.739556+0000","last_peered":"2023-05-17T14:54:38.739556+0000","last_clean":"2023-05-17T14:54:38.739556+0000","last_became_active":"2023-05-17T14:54:38.735767+0000","last_became_peered":"2023-05-17T14:54:38.735767+0000","last_unstale":"2023-05-17T14:54:38.739556+0000","last_undegraded":"2023-05-17T14:54:38.739556+0000","last_fullsized":"2023-05-17T14:54:38.739556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.717264+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T14:54:38.717264+0000","last_peered":"2023-05-17T14:54:38.717264+0000","last_clean":"2023-05-17T14:54:38.717264+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T14:54:38.717264+0000","last_undegraded":"2023-05-17T14:54:38.717264+0000","last_fullsized":"2023-05-17T14:54:38.717264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.720280+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T14:54:38.720280+0000","last_peered":"2023-05-17T14:54:38.720280+0000","last_clean":"2023-05-17T14:54:38.720280+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T14:54:38.720280+0000","last_undegraded":"2023-05-17T14:54:38.720280+0000","last_fullsized":"2023-05-17T14:54:38.720280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.121338+0000","last_change":"2023-05-17T14:54:39.121338+0000","last_active":"2023-05-17T14:54:39.121338+0000","last_peered":"2023-05-17T14:54:39.121338+0000","last_clean":"2023-05-17T14:54:39.121338+0000","last_became_active":"2023-05-17T14:54:39.121102+0000","last_became_peered":"2023-05-17T14:54:39.121102+0000","last_unstale":"2023-05-17T14:54:39.121338+0000","last_undegraded":"2023-05-17T14:54:39.121338+0000","last_fullsized":"2023-05-17T14:54:39.121338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126430+0000","last_change":"2023-05-17T14:54:38.733819+0000","last_active":"2023-05-17T14:54:39.126430+0000","last_peered":"2023-05-17T14:54:39.126430+0000","last_clean":"2023-05-17T14:54:39.126430+0000","last_became_active":"2023-05-17T14:54:38.733505+0000","last_became_peered":"2023-05-17T14:54:38.733505+0000","last_unstale":"2023-05-17T14:54:39.126430+0000","last_undegraded":"2023-05-17T14:54:39.126430+0000","last_fullsized":"2023-05-17T14:54:39.126430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.721525+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T14:54:38.721525+0000","last_peered":"2023-05-17T14:54:38.721525+0000","last_clean":"2023-05-17T14:54:38.721525+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T14:54:38.721525+0000","last_undegraded":"2023-05-17T14:54:38.721525+0000","last_fullsized":"2023-05-17T14:54:38.721525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119402+0000","last_change":"2023-05-17T14:54:39.119402+0000","last_active":"2023-05-17T14:54:39.119402+0000","last_peered":"2023-05-17T14:54:39.119402+0000","last_clean":"2023-05-17T14:54:39.119402+0000","last_became_active":"2023-05-17T14:54:39.119193+0000","last_became_peered":"2023-05-17T14:54:39.119193+0000","last_unstale":"2023-05-17T14:54:39.119402+0000","last_undegraded":"2023-05-17T14:54:39.119402+0000","last_fullsized":"2023-05-17T14:54:39.119402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738339+0000","last_change":"2023-05-17T14:54:38.732013+0000","last_active":"2023-05-17T14:54:38.738339+0000","last_peered":"2023-05-17T14:54:38.738339+0000","last_clean":"2023-05-17T14:54:38.738339+0000","last_became_active":"2023-05-17T14:54:38.731695+0000","last_became_peered":"2023-05-17T14:54:38.731695+0000","last_unstale":"2023-05-17T14:54:38.738339+0000","last_undegraded":"2023-05-17T14:54:38.738339+0000","last_fullsized":"2023-05-17T14:54:38.738339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.726654+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T14:54:38.726654+0000","last_peered":"2023-05-17T14:54:38.726654+0000","last_clean":"2023-05-17T14:54:38.726654+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T14:54:38.726654+0000","last_undegraded":"2023-05-17T14:54:38.726654+0000","last_fullsized":"2023-05-17T14:54:38.726654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126287+0000","last_change":"2023-05-17T14:54:39.126287+0000","last_active":"2023-05-17T14:54:39.126287+0000","last_peered":"2023-05-17T14:54:39.126287+0000","last_clean":"2023-05-17T14:54:39.126287+0000","last_became_active":"2023-05-17T14:54:39.125979+0000","last_became_peered":"2023-05-17T14:54:39.125979+0000","last_unstale":"2023-05-17T14:54:39.126287+0000","last_undegraded":"2023-05-17T14:54:39.126287+0000","last_fullsized":"2023-05-17T14:54:39.126287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736526+0000","last_change":"2023-05-17T14:54:38.729434+0000","last_active":"2023-05-17T14:54:38.736526+0000","last_peered":"2023-05-17T14:54:38.736526+0000","last_clean":"2023-05-17T14:54:38.736526+0000","last_became_active":"2023-05-17T14:54:38.729112+0000","last_became_peered":"2023-05-17T14:54:38.729112+0000","last_unstale":"2023-05-17T14:54:38.736526+0000","last_undegraded":"2023-05-17T14:54:38.736526+0000","last_fullsized":"2023-05-17T14:54:38.736526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.714844+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T14:54:38.714844+0000","last_peered":"2023-05-17T14:54:38.714844+0000","last_clean":"2023-05-17T14:54:38.714844+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T14:54:38.714844+0000","last_undegraded":"2023-05-17T14:54:38.714844+0000","last_fullsized":"2023-05-17T14:54:38.714844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120054+0000","last_change":"2023-05-17T14:54:39.120054+0000","last_active":"2023-05-17T14:54:39.120054+0000","last_peered":"2023-05-17T14:54:39.120054+0000","last_clean":"2023-05-17T14:54:39.120054+0000","last_became_active":"2023-05-17T14:54:39.119709+0000","last_became_peered":"2023-05-17T14:54:39.119709+0000","last_unstale":"2023-05-17T14:54:39.120054+0000","last_undegraded":"2023-05-17T14:54:39.120054+0000","last_fullsized":"2023-05-17T14:54:39.120054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.731908+0000","last_change":"2023-05-17T14:54:38.727076+0000","last_active":"2023-05-17T14:54:38.731908+0000","last_peered":"2023-05-17T14:54:38.731908+0000","last_clean":"2023-05-17T14:54:38.731908+0000","last_became_active":"2023-05-17T14:54:38.726389+0000","last_became_peered":"2023-05-17T14:54:38.726389+0000","last_unstale":"2023-05-17T14:54:38.731908+0000","last_undegraded":"2023-05-17T14:54:38.731908+0000","last_fullsized":"2023-05-17T14:54:38.731908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.724867+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T14:54:38.724867+0000","last_peered":"2023-05-17T14:54:38.724867+0000","last_clean":"2023-05-17T14:54:38.724867+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T14:54:38.724867+0000","last_undegraded":"2023-05-17T14:54:38.724867+0000","last_fullsized":"2023-05-17T14:54:38.724867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5692,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366148,"statfs":{"total":96636764160,"available":96630935552,"internally_reserved":0,"allocated":380928,"data_stored":152640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5468,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366372,"statfs":{"total":96636764160,"available":96631164928,"internally_reserved":0,"allocated":348160,"data_stored":138138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5628,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366212,"statfs":{"total":96636764160,"available":96631001088,"internally_reserved":0,"allocated":380928,"data_stored":152156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5624,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366216,"statfs":{"total":96636764160,"available":96631005184,"internally_reserved":0,"allocated":376832,"data_stored":152030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5416,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366424,"statfs":{"total":96636764160,"available":96631218176,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5704,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366136,"statfs":{"total":96636764160,"available":96630923264,"internally_reserved":0,"allocated":393216,"data_stored":153636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5752,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366088,"statfs":{"total":96636764160,"available":96630874112,"internally_reserved":0,"allocated":376832,"data_stored":152018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5608,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366232,"statfs":{"total":96636764160,"available":96631021568,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T14:54:43.130 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T14:54:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.274+0000 7fb8fc5bf700 1 Processor -- start 2023-05-17T14:54:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.274+0000 7fb8fc5bf700 1 -- start start 2023-05-17T14:54:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.275+0000 7fb8fc5bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.275+0000 7fb8fc5bf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f4069020 con 0x7fb8f4065aa0 2023-05-17T14:54:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.275+0000 7fb8fc5bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f4155700 con 0x7fb8f4067ec0 2023-05-17T14:54:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.275+0000 7fb8fc5bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40c3610 con 0x7fb8f41540d0 2023-05-17T14:54:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.275+0000 7fb8fab5c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb8f4065aa0 0x7fb8f40c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34990/0 (socket says 172.21.15.27:34990) 2023-05-17T14:54:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.275+0000 7fb8fab5c700 1 -- 172.21.15.27:0/1299904638 learned_addr learned my addr 172.21.15.27:0/1299904638 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8fa35b700 1 --2- 172.21.15.27:0/1299904638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227828796 0 0) 0x7fb8f4069020 con 0x7fb8f4065aa0 2023-05-17T14:54:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8dc0033f0 con 0x7fb8f4065aa0 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373823577 0 0) 0x7fb8f4155700 con 0x7fb8f4067ec0 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f4069020 con 0x7fb8f4067ec0 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4239429417 0 0) 0x7fb8dc0033f0 con 0x7fb8f4065aa0 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8fa35b700 1 -- 172.21.15.27:0/1299904638 >> v1:172.21.15.40:6789/0 conn(0x7fb8f4067ec0 legacy=0x7fb8f4065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8fa35b700 1 -- 172.21.15.27:0/1299904638 >> v1:172.21.15.27:6789/0 conn(0x7fb8f4065aa0 legacy=0x7fb8f40c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8fa35b700 1 -- 172.21.15.27:0/1299904638 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4068410 con 0x7fb8f41540d0 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8fa35b700 1 --2- 172.21.15.27:0/1299904638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4155210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb8ec009790 tx=0x7fb8ec009060).ready entity=mon.2 client_cookie=945dc807e07a4e0b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40017f0 con 0x7fb8f41540d0 2023-05-17T14:54:43.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec011400 con 0x7fb8f41540d0 2023-05-17T14:54:43.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.276+0000 7fb8f9359700 1 -- 172.21.15.27:0/1299904638 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec011780 con 0x7fb8f41540d0 2023-05-17T14:54:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/1299904638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 msgr2=0x7fb8f4155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/1299904638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4155210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb8ec009790 tx=0x7fb8ec009060).stop 2023-05-17T14:54:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/1299904638 shutdown_connections 2023-05-17T14:54:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/1299904638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4155210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/1299904638 >> 172.21.15.27:0/1299904638 conn(0x7fb8f40c94a0 msgr2=0x7fb8f40c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/1299904638 shutdown_connections 2023-05-17T14:54:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.277+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/1299904638 wait complete. 2023-05-17T14:54:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.278+0000 7fb8fc5bf700 1 Processor -- start 2023-05-17T14:54:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.278+0000 7fb8fc5bf700 1 -- start start 2023-05-17T14:54:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 0x7fb8f4150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4067ec0 0x7fb8f40aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40aaf20 con 0x7fb8f4065aa0 2023-05-17T14:54:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4152c40 con 0x7fb8f4067ec0 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41652b0 con 0x7fb8f41540d0 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 0x7fb8f4150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 0x7fb8f4150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35432/0 (socket says 172.21.15.27:35432) 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 -- 172.21.15.27:0/612411019 learned_addr learned my addr 172.21.15.27:0/612411019 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fab5c700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8f9b5a700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4067ec0 0x7fb8f40aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 -- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 msgr2=0x7fb8f4164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4164dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 -- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4067ec0 msgr2=0x7fb8f40aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4067ec0 0x7fb8f40aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 -- 172.21.15.27:0/612411019 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0092a0 con 0x7fb8f4065aa0 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8f9b5a700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4067ec0 0x7fb8f40aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fab5c700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4164dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fa35b700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 0x7fb8f4150130 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fb8ec009d80 tx=0x7fb8ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec010950 con 0x7fb8f4065aa0 2023-05-17T14:54:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec010ab0 con 0x7fb8f4065aa0 2023-05-17T14:54:43.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f41530d0 con 0x7fb8f4065aa0 2023-05-17T14:54:43.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.279+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec010e50 con 0x7fb8f4065aa0 2023-05-17T14:54:43.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.280+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4152310 con 0x7fb8f4065aa0 2023-05-17T14:54:43.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.280+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4152f20 con 0x7fb8f4065aa0 2023-05-17T14:54:43.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.281+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb8ec023020 con 0x7fb8f4065aa0 2023-05-17T14:54:43.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.281+0000 7fb8f27fc700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb8e005ed90 0x7fb8e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.281+0000 7fb8f9b5a700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb8e005ed90 0x7fb8e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.281+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb8ec07b420 con 0x7fb8f4065aa0 2023-05-17T14:54:43.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.282+0000 7fb8f9b5a700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb8e005ed90 0x7fb8e0061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb8f4066610 tx=0x7fb8e8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.286+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8ec04c9c0 con 0x7fb8f4065aa0 2023-05-17T14:54:43.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.455+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8f4066370 con 0x7fb8e005ed90 2023-05-17T14:54:43.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.464+0000 7fb8f27fc700 1 -- 172.21.15.27:0/612411019 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336412 (secure 0 0 0) 0x7fb8f4066370 con 0x7fb8e005ed90 2023-05-17T14:54:43.471 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb8e005ed90 msgr2=0x7fb8e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb8e005ed90 0x7fb8e0061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb8f4066610 tx=0x7fb8e8009040).stop 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 msgr2=0x7fb8f4150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 0x7fb8f4150130 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fb8ec009d80 tx=0x7fb8ec016000).stop 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 shutdown_connections 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb8e005ed90 0x7fb8e0061250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f41540d0 0x7fb8f4164dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f4065aa0 0x7fb8f4150130 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 --2- 172.21.15.27:0/612411019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4067ec0 0x7fb8f40aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 >> 172.21.15.27:0/612411019 conn(0x7fb8f40c94a0 msgr2=0x7fb8f40c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 shutdown_connections 2023-05-17T14:54:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.467+0000 7fb8fc5bf700 1 -- 172.21.15.27:0/612411019 wait complete. 2023-05-17T14:54:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T14:54:43.483 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-05-17T14:54:41.571183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":44892,"kb_used_data":2908,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":754929828,"statfs":{"total":773094113280,"available":773048143872,"internally_reserved":0,"allocated":2977792,"data_stored":1190252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4317,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.584061"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117309+0000","last_change":"2023-05-17T14:54:39.117309+0000","last_active":"2023-05-17T14:54:39.117309+0000","last_peered":"2023-05-17T14:54:39.117309+0000","last_clean":"2023-05-17T14:54:39.117309+0000","last_became_active":"2023-05-17T14:54:39.116694+0000","last_became_peered":"2023-05-17T14:54:39.116694+0000","last_unstale":"2023-05-17T14:54:39.117309+0000","last_undegraded":"2023-05-17T14:54:39.117309+0000","last_fullsized":"2023-05-17T14:54:39.117309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127347+0000","last_change":"2023-05-17T14:54:38.736765+0000","last_active":"2023-05-17T14:54:39.127347+0000","last_peered":"2023-05-17T14:54:39.127347+0000","last_clean":"2023-05-17T14:54:39.127347+0000","last_became_active":"2023-05-17T14:54:38.736441+0000","last_became_peered":"2023-05-17T14:54:38.736441+0000","last_unstale":"2023-05-17T14:54:39.127347+0000","last_undegraded":"2023-05-17T14:54:39.127347+0000","last_fullsized":"2023-05-17T14:54:39.127347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.107573+0000","last_change":"2023-05-17T14:54:39.107573+0000","last_active":"2023-05-17T14:54:39.107573+0000","last_peered":"2023-05-17T14:54:39.107573+0000","last_clean":"2023-05-17T14:54:39.107573+0000","last_became_active":"2023-05-17T14:54:39.107319+0000","last_became_peered":"2023-05-17T14:54:39.107319+0000","last_unstale":"2023-05-17T14:54:39.107573+0000","last_undegraded":"2023-05-17T14:54:39.107573+0000","last_fullsized":"2023-05-17T14:54:39.107573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.730955+0000","last_change":"2023-05-17T14:54:38.723116+0000","last_active":"2023-05-17T14:54:38.730955+0000","last_peered":"2023-05-17T14:54:38.730955+0000","last_clean":"2023-05-17T14:54:38.730955+0000","last_became_active":"2023-05-17T14:54:38.722789+0000","last_became_peered":"2023-05-17T14:54:38.722789+0000","last_unstale":"2023-05-17T14:54:38.730955+0000","last_undegraded":"2023-05-17T14:54:38.730955+0000","last_fullsized":"2023-05-17T14:54:38.730955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.114761+0000","last_change":"2023-05-17T14:54:39.114761+0000","last_active":"2023-05-17T14:54:39.114761+0000","last_peered":"2023-05-17T14:54:39.114761+0000","last_clean":"2023-05-17T14:54:39.114761+0000","last_became_active":"2023-05-17T14:54:39.114542+0000","last_became_peered":"2023-05-17T14:54:39.114542+0000","last_unstale":"2023-05-17T14:54:39.114761+0000","last_undegraded":"2023-05-17T14:54:39.114761+0000","last_fullsized":"2023-05-17T14:54:39.114761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740663+0000","last_change":"2023-05-17T14:54:38.734197+0000","last_active":"2023-05-17T14:54:38.740663+0000","last_peered":"2023-05-17T14:54:38.740663+0000","last_clean":"2023-05-17T14:54:38.740663+0000","last_became_active":"2023-05-17T14:54:38.733426+0000","last_became_peered":"2023-05-17T14:54:38.733426+0000","last_unstale":"2023-05-17T14:54:38.740663+0000","last_undegraded":"2023-05-17T14:54:38.740663+0000","last_fullsized":"2023-05-17T14:54:38.740663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115030+0000","last_change":"2023-05-17T14:54:39.115030+0000","last_active":"2023-05-17T14:54:39.115030+0000","last_peered":"2023-05-17T14:54:39.115030+0000","last_clean":"2023-05-17T14:54:39.115030+0000","last_became_active":"2023-05-17T14:54:39.114734+0000","last_became_peered":"2023-05-17T14:54:39.114734+0000","last_unstale":"2023-05-17T14:54:39.115030+0000","last_undegraded":"2023-05-17T14:54:39.115030+0000","last_fullsized":"2023-05-17T14:54:39.115030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124581+0000","last_change":"2023-05-17T14:54:38.738723+0000","last_active":"2023-05-17T14:54:39.124581+0000","last_peered":"2023-05-17T14:54:39.124581+0000","last_clean":"2023-05-17T14:54:39.124581+0000","last_became_active":"2023-05-17T14:54:38.738256+0000","last_became_peered":"2023-05-17T14:54:38.738256+0000","last_unstale":"2023-05-17T14:54:39.124581+0000","last_undegraded":"2023-05-17T14:54:39.124581+0000","last_fullsized":"2023-05-17T14:54:39.124581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124260+0000","last_change":"2023-05-17T14:54:39.124260+0000","last_active":"2023-05-17T14:54:39.124260+0000","last_peered":"2023-05-17T14:54:39.124260+0000","last_clean":"2023-05-17T14:54:39.124260+0000","last_became_active":"2023-05-17T14:54:39.123988+0000","last_became_peered":"2023-05-17T14:54:39.123988+0000","last_unstale":"2023-05-17T14:54:39.124260+0000","last_undegraded":"2023-05-17T14:54:39.124260+0000","last_fullsized":"2023-05-17T14:54:39.124260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108057+0000","last_change":"2023-05-17T14:54:38.725465+0000","last_active":"2023-05-17T14:54:39.108057+0000","last_peered":"2023-05-17T14:54:39.108057+0000","last_clean":"2023-05-17T14:54:39.108057+0000","last_became_active":"2023-05-17T14:54:38.724730+0000","last_became_peered":"2023-05-17T14:54:38.724730+0000","last_unstale":"2023-05-17T14:54:39.108057+0000","last_undegraded":"2023-05-17T14:54:39.108057+0000","last_fullsized":"2023-05-17T14:54:39.108057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117006+0000","last_change":"2023-05-17T14:54:39.117006+0000","last_active":"2023-05-17T14:54:39.117006+0000","last_peered":"2023-05-17T14:54:39.117006+0000","last_clean":"2023-05-17T14:54:39.117006+0000","last_became_active":"2023-05-17T14:54:39.116696+0000","last_became_peered":"2023-05-17T14:54:39.116696+0000","last_unstale":"2023-05-17T14:54:39.117006+0000","last_undegraded":"2023-05-17T14:54:39.117006+0000","last_fullsized":"2023-05-17T14:54:39.117006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113048+0000","last_change":"2023-05-17T14:54:38.737288+0000","last_active":"2023-05-17T14:54:39.113048+0000","last_peered":"2023-05-17T14:54:39.113048+0000","last_clean":"2023-05-17T14:54:39.113048+0000","last_became_active":"2023-05-17T14:54:38.737009+0000","last_became_peered":"2023-05-17T14:54:38.737009+0000","last_unstale":"2023-05-17T14:54:39.113048+0000","last_undegraded":"2023-05-17T14:54:39.113048+0000","last_fullsized":"2023-05-17T14:54:39.113048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118614+0000","last_change":"2023-05-17T14:54:39.118614+0000","last_active":"2023-05-17T14:54:39.118614+0000","last_peered":"2023-05-17T14:54:39.118614+0000","last_clean":"2023-05-17T14:54:39.118614+0000","last_became_active":"2023-05-17T14:54:39.118415+0000","last_became_peered":"2023-05-17T14:54:39.118415+0000","last_unstale":"2023-05-17T14:54:39.118614+0000","last_undegraded":"2023-05-17T14:54:39.118614+0000","last_fullsized":"2023-05-17T14:54:39.118614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739928+0000","last_change":"2023-05-17T14:54:38.738670+0000","last_active":"2023-05-17T14:54:38.739928+0000","last_peered":"2023-05-17T14:54:38.739928+0000","last_clean":"2023-05-17T14:54:38.739928+0000","last_became_active":"2023-05-17T14:54:38.738157+0000","last_became_peered":"2023-05-17T14:54:38.738157+0000","last_unstale":"2023-05-17T14:54:38.739928+0000","last_undegraded":"2023-05-17T14:54:38.739928+0000","last_fullsized":"2023-05-17T14:54:38.739928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117333+0000","last_change":"2023-05-17T14:54:39.117333+0000","last_active":"2023-05-17T14:54:39.117333+0000","last_peered":"2023-05-17T14:54:39.117333+0000","last_clean":"2023-05-17T14:54:39.117333+0000","last_became_active":"2023-05-17T14:54:39.117068+0000","last_became_peered":"2023-05-17T14:54:39.117068+0000","last_unstale":"2023-05-17T14:54:39.117333+0000","last_undegraded":"2023-05-17T14:54:39.117333+0000","last_fullsized":"2023-05-17T14:54:39.117333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739619+0000","last_change":"2023-05-17T14:54:38.736446+0000","last_active":"2023-05-17T14:54:38.739619+0000","last_peered":"2023-05-17T14:54:38.739619+0000","last_clean":"2023-05-17T14:54:38.739619+0000","last_became_active":"2023-05-17T14:54:38.735564+0000","last_became_peered":"2023-05-17T14:54:38.735564+0000","last_unstale":"2023-05-17T14:54:38.739619+0000","last_undegraded":"2023-05-17T14:54:38.739619+0000","last_fullsized":"2023-05-17T14:54:38.739619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.110089+0000","last_change":"2023-05-17T14:54:39.110089+0000","last_active":"2023-05-17T14:54:39.110089+0000","last_peered":"2023-05-17T14:54:39.110089+0000","last_clean":"2023-05-17T14:54:39.110089+0000","last_became_active":"2023-05-17T14:54:39.109865+0000","last_became_peered":"2023-05-17T14:54:39.109865+0000","last_unstale":"2023-05-17T14:54:39.110089+0000","last_undegraded":"2023-05-17T14:54:39.110089+0000","last_fullsized":"2023-05-17T14:54:39.110089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740585+0000","last_change":"2023-05-17T14:54:38.731210+0000","last_active":"2023-05-17T14:54:38.740585+0000","last_peered":"2023-05-17T14:54:38.740585+0000","last_clean":"2023-05-17T14:54:38.740585+0000","last_became_active":"2023-05-17T14:54:38.730873+0000","last_became_peered":"2023-05-17T14:54:38.730873+0000","last_unstale":"2023-05-17T14:54:38.740585+0000","last_undegraded":"2023-05-17T14:54:38.740585+0000","last_fullsized":"2023-05-17T14:54:38.740585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113889+0000","last_change":"2023-05-17T14:54:39.113889+0000","last_active":"2023-05-17T14:54:39.113889+0000","last_peered":"2023-05-17T14:54:39.113889+0000","last_clean":"2023-05-17T14:54:39.113889+0000","last_became_active":"2023-05-17T14:54:39.113539+0000","last_became_peered":"2023-05-17T14:54:39.113539+0000","last_unstale":"2023-05-17T14:54:39.113889+0000","last_undegraded":"2023-05-17T14:54:39.113889+0000","last_fullsized":"2023-05-17T14:54:39.113889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.734149+0000","last_change":"2023-05-17T14:54:38.732737+0000","last_active":"2023-05-17T14:54:38.734149+0000","last_peered":"2023-05-17T14:54:38.734149+0000","last_clean":"2023-05-17T14:54:38.734149+0000","last_became_active":"2023-05-17T14:54:38.732432+0000","last_became_peered":"2023-05-17T14:54:38.732432+0000","last_unstale":"2023-05-17T14:54:38.734149+0000","last_undegraded":"2023-05-17T14:54:38.734149+0000","last_fullsized":"2023-05-17T14:54:38.734149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116364+0000","last_change":"2023-05-17T14:54:39.116364+0000","last_active":"2023-05-17T14:54:39.116364+0000","last_peered":"2023-05-17T14:54:39.116364+0000","last_clean":"2023-05-17T14:54:39.116364+0000","last_became_active":"2023-05-17T14:54:39.116050+0000","last_became_peered":"2023-05-17T14:54:39.116050+0000","last_unstale":"2023-05-17T14:54:39.116364+0000","last_undegraded":"2023-05-17T14:54:39.116364+0000","last_fullsized":"2023-05-17T14:54:39.116364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738518+0000","last_change":"2023-05-17T14:54:38.734519+0000","last_active":"2023-05-17T14:54:38.738518+0000","last_peered":"2023-05-17T14:54:38.738518+0000","last_clean":"2023-05-17T14:54:38.738518+0000","last_became_active":"2023-05-17T14:54:38.734020+0000","last_became_peered":"2023-05-17T14:54:38.734020+0000","last_unstale":"2023-05-17T14:54:38.738518+0000","last_undegraded":"2023-05-17T14:54:38.738518+0000","last_fullsized":"2023-05-17T14:54:38.738518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.107465+0000","last_change":"2023-05-17T14:54:39.107465+0000","last_active":"2023-05-17T14:54:39.107465+0000","last_peered":"2023-05-17T14:54:39.107465+0000","last_clean":"2023-05-17T14:54:39.107465+0000","last_became_active":"2023-05-17T14:54:39.107201+0000","last_became_peered":"2023-05-17T14:54:39.107201+0000","last_unstale":"2023-05-17T14:54:39.107465+0000","last_undegraded":"2023-05-17T14:54:39.107465+0000","last_fullsized":"2023-05-17T14:54:39.107465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.128531+0000","last_change":"2023-05-17T14:54:38.732781+0000","last_active":"2023-05-17T14:54:39.128531+0000","last_peered":"2023-05-17T14:54:39.128531+0000","last_clean":"2023-05-17T14:54:39.128531+0000","last_became_active":"2023-05-17T14:54:38.732393+0000","last_became_peered":"2023-05-17T14:54:38.732393+0000","last_unstale":"2023-05-17T14:54:39.128531+0000","last_undegraded":"2023-05-17T14:54:39.128531+0000","last_fullsized":"2023-05-17T14:54:39.128531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127845+0000","last_change":"2023-05-17T14:54:39.127845+0000","last_active":"2023-05-17T14:54:39.127845+0000","last_peered":"2023-05-17T14:54:39.127845+0000","last_clean":"2023-05-17T14:54:39.127845+0000","last_became_active":"2023-05-17T14:54:39.126323+0000","last_became_peered":"2023-05-17T14:54:39.126323+0000","last_unstale":"2023-05-17T14:54:39.127845+0000","last_undegraded":"2023-05-17T14:54:39.127845+0000","last_fullsized":"2023-05-17T14:54:39.127845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108168+0000","last_change":"2023-05-17T14:54:38.725651+0000","last_active":"2023-05-17T14:54:39.108168+0000","last_peered":"2023-05-17T14:54:39.108168+0000","last_clean":"2023-05-17T14:54:39.108168+0000","last_became_active":"2023-05-17T14:54:38.725183+0000","last_became_peered":"2023-05-17T14:54:38.725183+0000","last_unstale":"2023-05-17T14:54:39.108168+0000","last_undegraded":"2023-05-17T14:54:39.108168+0000","last_fullsized":"2023-05-17T14:54:39.108168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.109929+0000","last_change":"2023-05-17T14:54:39.109929+0000","last_active":"2023-05-17T14:54:39.109929+0000","last_peered":"2023-05-17T14:54:39.109929+0000","last_clean":"2023-05-17T14:54:39.109929+0000","last_became_active":"2023-05-17T14:54:39.109594+0000","last_became_peered":"2023-05-17T14:54:39.109594+0000","last_unstale":"2023-05-17T14:54:39.109929+0000","last_undegraded":"2023-05-17T14:54:39.109929+0000","last_fullsized":"2023-05-17T14:54:39.109929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.737647+0000","last_change":"2023-05-17T14:54:38.733360+0000","last_active":"2023-05-17T14:54:38.737647+0000","last_peered":"2023-05-17T14:54:38.737647+0000","last_clean":"2023-05-17T14:54:38.737647+0000","last_became_active":"2023-05-17T14:54:38.733082+0000","last_became_peered":"2023-05-17T14:54:38.733082+0000","last_unstale":"2023-05-17T14:54:38.737647+0000","last_undegraded":"2023-05-17T14:54:38.737647+0000","last_fullsized":"2023-05-17T14:54:38.737647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113713+0000","last_change":"2023-05-17T14:54:39.113713+0000","last_active":"2023-05-17T14:54:39.113713+0000","last_peered":"2023-05-17T14:54:39.113713+0000","last_clean":"2023-05-17T14:54:39.113713+0000","last_became_active":"2023-05-17T14:54:39.113440+0000","last_became_peered":"2023-05-17T14:54:39.113440+0000","last_unstale":"2023-05-17T14:54:39.113713+0000","last_undegraded":"2023-05-17T14:54:39.113713+0000","last_fullsized":"2023-05-17T14:54:39.113713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.735845+0000","last_change":"2023-05-17T14:54:38.731293+0000","last_active":"2023-05-17T14:54:38.735845+0000","last_peered":"2023-05-17T14:54:38.735845+0000","last_clean":"2023-05-17T14:54:38.735845+0000","last_became_active":"2023-05-17T14:54:38.730997+0000","last_became_peered":"2023-05-17T14:54:38.730997+0000","last_unstale":"2023-05-17T14:54:38.735845+0000","last_undegraded":"2023-05-17T14:54:38.735845+0000","last_fullsized":"2023-05-17T14:54:38.735845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116340+0000","last_change":"2023-05-17T14:54:39.116340+0000","last_active":"2023-05-17T14:54:39.116340+0000","last_peered":"2023-05-17T14:54:39.116340+0000","last_clean":"2023-05-17T14:54:39.116340+0000","last_became_active":"2023-05-17T14:54:39.116024+0000","last_became_peered":"2023-05-17T14:54:39.116024+0000","last_unstale":"2023-05-17T14:54:39.116340+0000","last_undegraded":"2023-05-17T14:54:39.116340+0000","last_fullsized":"2023-05-17T14:54:39.116340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127669+0000","last_change":"2023-05-17T14:54:38.735852+0000","last_active":"2023-05-17T14:54:39.127669+0000","last_peered":"2023-05-17T14:54:39.127669+0000","last_clean":"2023-05-17T14:54:39.127669+0000","last_became_active":"2023-05-17T14:54:38.735139+0000","last_became_peered":"2023-05-17T14:54:38.735139+0000","last_unstale":"2023-05-17T14:54:39.127669+0000","last_undegraded":"2023-05-17T14:54:39.127669+0000","last_fullsized":"2023-05-17T14:54:39.127669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123199+0000","last_change":"2023-05-17T14:54:39.123199+0000","last_active":"2023-05-17T14:54:39.123199+0000","last_peered":"2023-05-17T14:54:39.123199+0000","last_clean":"2023-05-17T14:54:39.123199+0000","last_became_active":"2023-05-17T14:54:39.122891+0000","last_became_peered":"2023-05-17T14:54:39.122891+0000","last_unstale":"2023-05-17T14:54:39.123199+0000","last_undegraded":"2023-05-17T14:54:39.123199+0000","last_fullsized":"2023-05-17T14:54:39.123199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739799+0000","last_change":"2023-05-17T14:54:38.737843+0000","last_active":"2023-05-17T14:54:38.739799+0000","last_peered":"2023-05-17T14:54:38.739799+0000","last_clean":"2023-05-17T14:54:38.739799+0000","last_became_active":"2023-05-17T14:54:38.737511+0000","last_became_peered":"2023-05-17T14:54:38.737511+0000","last_unstale":"2023-05-17T14:54:38.739799+0000","last_undegraded":"2023-05-17T14:54:38.739799+0000","last_fullsized":"2023-05-17T14:54:38.739799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.125890+0000","last_change":"2023-05-17T14:54:39.125890+0000","last_active":"2023-05-17T14:54:39.125890+0000","last_peered":"2023-05-17T14:54:39.125890+0000","last_clean":"2023-05-17T14:54:39.125890+0000","last_became_active":"2023-05-17T14:54:39.125550+0000","last_became_peered":"2023-05-17T14:54:39.125550+0000","last_unstale":"2023-05-17T14:54:39.125890+0000","last_undegraded":"2023-05-17T14:54:39.125890+0000","last_fullsized":"2023-05-17T14:54:39.125890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736636+0000","last_change":"2023-05-17T14:54:38.731421+0000","last_active":"2023-05-17T14:54:38.736636+0000","last_peered":"2023-05-17T14:54:38.736636+0000","last_clean":"2023-05-17T14:54:38.736636+0000","last_became_active":"2023-05-17T14:54:38.730326+0000","last_became_peered":"2023-05-17T14:54:38.730326+0000","last_unstale":"2023-05-17T14:54:38.736636+0000","last_undegraded":"2023-05-17T14:54:38.736636+0000","last_fullsized":"2023-05-17T14:54:38.736636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119452+0000","last_change":"2023-05-17T14:54:39.119452+0000","last_active":"2023-05-17T14:54:39.119452+0000","last_peered":"2023-05-17T14:54:39.119452+0000","last_clean":"2023-05-17T14:54:39.119452+0000","last_became_active":"2023-05-17T14:54:39.119160+0000","last_became_peered":"2023-05-17T14:54:39.119160+0000","last_unstale":"2023-05-17T14:54:39.119452+0000","last_undegraded":"2023-05-17T14:54:39.119452+0000","last_fullsized":"2023-05-17T14:54:39.119452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108142+0000","last_change":"2023-05-17T14:54:38.727259+0000","last_active":"2023-05-17T14:54:39.108142+0000","last_peered":"2023-05-17T14:54:39.108142+0000","last_clean":"2023-05-17T14:54:39.108142+0000","last_became_active":"2023-05-17T14:54:38.727014+0000","last_became_peered":"2023-05-17T14:54:38.727014+0000","last_unstale":"2023-05-17T14:54:39.108142+0000","last_undegraded":"2023-05-17T14:54:39.108142+0000","last_fullsized":"2023-05-17T14:54:39.108142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127119+0000","last_change":"2023-05-17T14:54:39.127119+0000","last_active":"2023-05-17T14:54:39.127119+0000","last_peered":"2023-05-17T14:54:39.127119+0000","last_clean":"2023-05-17T14:54:39.127119+0000","last_became_active":"2023-05-17T14:54:39.126829+0000","last_became_peered":"2023-05-17T14:54:39.126829+0000","last_unstale":"2023-05-17T14:54:39.127119+0000","last_undegraded":"2023-05-17T14:54:39.127119+0000","last_fullsized":"2023-05-17T14:54:39.127119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.741323+0000","last_change":"2023-05-17T14:54:38.739396+0000","last_active":"2023-05-17T14:54:38.741323+0000","last_peered":"2023-05-17T14:54:38.741323+0000","last_clean":"2023-05-17T14:54:38.741323+0000","last_became_active":"2023-05-17T14:54:38.739097+0000","last_became_peered":"2023-05-17T14:54:38.739097+0000","last_unstale":"2023-05-17T14:54:38.741323+0000","last_undegraded":"2023-05-17T14:54:38.741323+0000","last_fullsized":"2023-05-17T14:54:38.741323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.121993+0000","last_change":"2023-05-17T14:54:39.121993+0000","last_active":"2023-05-17T14:54:39.121993+0000","last_peered":"2023-05-17T14:54:39.121993+0000","last_clean":"2023-05-17T14:54:39.121993+0000","last_became_active":"2023-05-17T14:54:39.121418+0000","last_became_peered":"2023-05-17T14:54:39.121418+0000","last_unstale":"2023-05-17T14:54:39.121993+0000","last_undegraded":"2023-05-17T14:54:39.121993+0000","last_fullsized":"2023-05-17T14:54:39.121993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.103082+0000","last_change":"2023-05-17T14:54:38.731922+0000","last_active":"2023-05-17T14:54:39.103082+0000","last_peered":"2023-05-17T14:54:39.103082+0000","last_clean":"2023-05-17T14:54:39.103082+0000","last_became_active":"2023-05-17T14:54:38.731618+0000","last_became_peered":"2023-05-17T14:54:38.731618+0000","last_unstale":"2023-05-17T14:54:39.103082+0000","last_undegraded":"2023-05-17T14:54:39.103082+0000","last_fullsized":"2023-05-17T14:54:39.103082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123753+0000","last_change":"2023-05-17T14:54:39.123753+0000","last_active":"2023-05-17T14:54:39.123753+0000","last_peered":"2023-05-17T14:54:39.123753+0000","last_clean":"2023-05-17T14:54:39.123753+0000","last_became_active":"2023-05-17T14:54:39.123486+0000","last_became_peered":"2023-05-17T14:54:39.123486+0000","last_unstale":"2023-05-17T14:54:39.123753+0000","last_undegraded":"2023-05-17T14:54:39.123753+0000","last_fullsized":"2023-05-17T14:54:39.123753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740532+0000","last_change":"2023-05-17T14:54:38.736694+0000","last_active":"2023-05-17T14:54:38.740532+0000","last_peered":"2023-05-17T14:54:38.740532+0000","last_clean":"2023-05-17T14:54:38.740532+0000","last_became_active":"2023-05-17T14:54:38.736358+0000","last_became_peered":"2023-05-17T14:54:38.736358+0000","last_unstale":"2023-05-17T14:54:38.740532+0000","last_undegraded":"2023-05-17T14:54:38.740532+0000","last_fullsized":"2023-05-17T14:54:38.740532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113152+0000","last_change":"2023-05-17T14:54:39.113152+0000","last_active":"2023-05-17T14:54:39.113152+0000","last_peered":"2023-05-17T14:54:39.113152+0000","last_clean":"2023-05-17T14:54:39.113152+0000","last_became_active":"2023-05-17T14:54:39.112803+0000","last_became_peered":"2023-05-17T14:54:39.112803+0000","last_unstale":"2023-05-17T14:54:39.113152+0000","last_undegraded":"2023-05-17T14:54:39.113152+0000","last_fullsized":"2023-05-17T14:54:39.113152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736585+0000","last_change":"2023-05-17T14:54:38.731909+0000","last_active":"2023-05-17T14:54:38.736585+0000","last_peered":"2023-05-17T14:54:38.736585+0000","last_clean":"2023-05-17T14:54:38.736585+0000","last_became_active":"2023-05-17T14:54:38.731521+0000","last_became_peered":"2023-05-17T14:54:38.731521+0000","last_unstale":"2023-05-17T14:54:38.736585+0000","last_undegraded":"2023-05-17T14:54:38.736585+0000","last_fullsized":"2023-05-17T14:54:38.736585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.128701+0000","last_change":"2023-05-17T14:54:39.128701+0000","last_active":"2023-05-17T14:54:39.128701+0000","last_peered":"2023-05-17T14:54:39.128701+0000","last_clean":"2023-05-17T14:54:39.128701+0000","last_became_active":"2023-05-17T14:54:39.126613+0000","last_became_peered":"2023-05-17T14:54:39.126613+0000","last_unstale":"2023-05-17T14:54:39.128701+0000","last_undegraded":"2023-05-17T14:54:39.128701+0000","last_fullsized":"2023-05-17T14:54:39.128701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.733873+0000","last_change":"2023-05-17T14:54:38.730671+0000","last_active":"2023-05-17T14:54:38.733873+0000","last_peered":"2023-05-17T14:54:38.733873+0000","last_clean":"2023-05-17T14:54:38.733873+0000","last_became_active":"2023-05-17T14:54:38.730371+0000","last_became_peered":"2023-05-17T14:54:38.730371+0000","last_unstale":"2023-05-17T14:54:38.733873+0000","last_undegraded":"2023-05-17T14:54:38.733873+0000","last_fullsized":"2023-05-17T14:54:38.733873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118312+0000","last_change":"2023-05-17T14:54:39.118312+0000","last_active":"2023-05-17T14:54:39.118312+0000","last_peered":"2023-05-17T14:54:39.118312+0000","last_clean":"2023-05-17T14:54:39.118312+0000","last_became_active":"2023-05-17T14:54:39.118028+0000","last_became_peered":"2023-05-17T14:54:39.118028+0000","last_unstale":"2023-05-17T14:54:39.118312+0000","last_undegraded":"2023-05-17T14:54:39.118312+0000","last_fullsized":"2023-05-17T14:54:39.118312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.729825+0000","last_change":"2023-05-17T14:54:38.726458+0000","last_active":"2023-05-17T14:54:38.729825+0000","last_peered":"2023-05-17T14:54:38.729825+0000","last_clean":"2023-05-17T14:54:38.729825+0000","last_became_active":"2023-05-17T14:54:38.726187+0000","last_became_peered":"2023-05-17T14:54:38.726187+0000","last_unstale":"2023-05-17T14:54:38.729825+0000","last_undegraded":"2023-05-17T14:54:38.729825+0000","last_fullsized":"2023-05-17T14:54:38.729825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119086+0000","last_change":"2023-05-17T14:54:39.119086+0000","last_active":"2023-05-17T14:54:39.119086+0000","last_peered":"2023-05-17T14:54:39.119086+0000","last_clean":"2023-05-17T14:54:39.119086+0000","last_became_active":"2023-05-17T14:54:39.118774+0000","last_became_peered":"2023-05-17T14:54:39.118774+0000","last_unstale":"2023-05-17T14:54:39.119086+0000","last_undegraded":"2023-05-17T14:54:39.119086+0000","last_fullsized":"2023-05-17T14:54:39.119086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736658+0000","last_change":"2023-05-17T14:54:38.731679+0000","last_active":"2023-05-17T14:54:38.736658+0000","last_peered":"2023-05-17T14:54:38.736658+0000","last_clean":"2023-05-17T14:54:38.736658+0000","last_became_active":"2023-05-17T14:54:38.731146+0000","last_became_peered":"2023-05-17T14:54:38.731146+0000","last_unstale":"2023-05-17T14:54:38.736658+0000","last_undegraded":"2023-05-17T14:54:38.736658+0000","last_fullsized":"2023-05-17T14:54:38.736658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.111491+0000","last_change":"2023-05-17T14:54:39.111491+0000","last_active":"2023-05-17T14:54:39.111491+0000","last_peered":"2023-05-17T14:54:39.111491+0000","last_clean":"2023-05-17T14:54:39.111491+0000","last_became_active":"2023-05-17T14:54:39.111253+0000","last_became_peered":"2023-05-17T14:54:39.111253+0000","last_unstale":"2023-05-17T14:54:39.111491+0000","last_undegraded":"2023-05-17T14:54:39.111491+0000","last_fullsized":"2023-05-17T14:54:39.111491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.743693+0000","last_change":"2023-05-17T14:54:38.739990+0000","last_active":"2023-05-17T14:54:38.743693+0000","last_peered":"2023-05-17T14:54:38.743693+0000","last_clean":"2023-05-17T14:54:38.743693+0000","last_became_active":"2023-05-17T14:54:38.739620+0000","last_became_peered":"2023-05-17T14:54:38.739620+0000","last_unstale":"2023-05-17T14:54:38.743693+0000","last_undegraded":"2023-05-17T14:54:38.743693+0000","last_fullsized":"2023-05-17T14:54:38.743693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115737+0000","last_change":"2023-05-17T14:54:39.115737+0000","last_active":"2023-05-17T14:54:39.115737+0000","last_peered":"2023-05-17T14:54:39.115737+0000","last_clean":"2023-05-17T14:54:39.115737+0000","last_became_active":"2023-05-17T14:54:39.115445+0000","last_became_peered":"2023-05-17T14:54:39.115445+0000","last_unstale":"2023-05-17T14:54:39.115737+0000","last_undegraded":"2023-05-17T14:54:39.115737+0000","last_fullsized":"2023-05-17T14:54:39.115737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.735676+0000","last_change":"2023-05-17T14:54:38.731245+0000","last_active":"2023-05-17T14:54:38.735676+0000","last_peered":"2023-05-17T14:54:38.735676+0000","last_clean":"2023-05-17T14:54:38.735676+0000","last_became_active":"2023-05-17T14:54:38.730199+0000","last_became_peered":"2023-05-17T14:54:38.730199+0000","last_unstale":"2023-05-17T14:54:38.735676+0000","last_undegraded":"2023-05-17T14:54:38.735676+0000","last_fullsized":"2023-05-17T14:54:38.735676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120807+0000","last_change":"2023-05-17T14:54:39.120807+0000","last_active":"2023-05-17T14:54:39.120807+0000","last_peered":"2023-05-17T14:54:39.120807+0000","last_clean":"2023-05-17T14:54:39.120807+0000","last_became_active":"2023-05-17T14:54:39.120496+0000","last_became_peered":"2023-05-17T14:54:39.120496+0000","last_unstale":"2023-05-17T14:54:39.120807+0000","last_undegraded":"2023-05-17T14:54:39.120807+0000","last_fullsized":"2023-05-17T14:54:39.120807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740630+0000","last_change":"2023-05-17T14:54:38.737222+0000","last_active":"2023-05-17T14:54:38.740630+0000","last_peered":"2023-05-17T14:54:38.740630+0000","last_clean":"2023-05-17T14:54:38.740630+0000","last_became_active":"2023-05-17T14:54:38.736834+0000","last_became_peered":"2023-05-17T14:54:38.736834+0000","last_unstale":"2023-05-17T14:54:38.740630+0000","last_undegraded":"2023-05-17T14:54:38.740630+0000","last_fullsized":"2023-05-17T14:54:38.740630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123197+0000","last_change":"2023-05-17T14:54:39.123197+0000","last_active":"2023-05-17T14:54:39.123197+0000","last_peered":"2023-05-17T14:54:39.123197+0000","last_clean":"2023-05-17T14:54:39.123197+0000","last_became_active":"2023-05-17T14:54:39.122892+0000","last_became_peered":"2023-05-17T14:54:39.122892+0000","last_unstale":"2023-05-17T14:54:39.123197+0000","last_undegraded":"2023-05-17T14:54:39.123197+0000","last_fullsized":"2023-05-17T14:54:39.123197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739617+0000","last_change":"2023-05-17T14:54:38.738010+0000","last_active":"2023-05-17T14:54:38.739617+0000","last_peered":"2023-05-17T14:54:38.739617+0000","last_clean":"2023-05-17T14:54:38.739617+0000","last_became_active":"2023-05-17T14:54:38.737695+0000","last_became_peered":"2023-05-17T14:54:38.737695+0000","last_unstale":"2023-05-17T14:54:38.739617+0000","last_undegraded":"2023-05-17T14:54:38.739617+0000","last_fullsized":"2023-05-17T14:54:38.739617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116628+0000","last_change":"2023-05-17T14:54:39.116628+0000","last_active":"2023-05-17T14:54:39.116628+0000","last_peered":"2023-05-17T14:54:39.116628+0000","last_clean":"2023-05-17T14:54:39.116628+0000","last_became_active":"2023-05-17T14:54:39.116314+0000","last_became_peered":"2023-05-17T14:54:39.116314+0000","last_unstale":"2023-05-17T14:54:39.116628+0000","last_undegraded":"2023-05-17T14:54:39.116628+0000","last_fullsized":"2023-05-17T14:54:39.116628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738585+0000","last_change":"2023-05-17T14:54:38.733705+0000","last_active":"2023-05-17T14:54:38.738585+0000","last_peered":"2023-05-17T14:54:38.738585+0000","last_clean":"2023-05-17T14:54:38.738585+0000","last_became_active":"2023-05-17T14:54:38.733360+0000","last_became_peered":"2023-05-17T14:54:38.733360+0000","last_unstale":"2023-05-17T14:54:38.738585+0000","last_undegraded":"2023-05-17T14:54:38.738585+0000","last_fullsized":"2023-05-17T14:54:38.738585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124504+0000","last_change":"2023-05-17T14:54:39.124504+0000","last_active":"2023-05-17T14:54:39.124504+0000","last_peered":"2023-05-17T14:54:39.124504+0000","last_clean":"2023-05-17T14:54:39.124504+0000","last_became_active":"2023-05-17T14:54:39.124180+0000","last_became_peered":"2023-05-17T14:54:39.124180+0000","last_unstale":"2023-05-17T14:54:39.124504+0000","last_undegraded":"2023-05-17T14:54:39.124504+0000","last_fullsized":"2023-05-17T14:54:39.124504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738733+0000","last_change":"2023-05-17T14:54:38.730765+0000","last_active":"2023-05-17T14:54:38.738733+0000","last_peered":"2023-05-17T14:54:38.738733+0000","last_clean":"2023-05-17T14:54:38.738733+0000","last_became_active":"2023-05-17T14:54:38.730482+0000","last_became_peered":"2023-05-17T14:54:38.730482+0000","last_unstale":"2023-05-17T14:54:38.738733+0000","last_undegraded":"2023-05-17T14:54:38.738733+0000","last_fullsized":"2023-05-17T14:54:38.738733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.130101+0000","last_change":"2023-05-17T14:54:39.130101+0000","last_active":"2023-05-17T14:54:39.130101+0000","last_peered":"2023-05-17T14:54:39.130101+0000","last_clean":"2023-05-17T14:54:39.130101+0000","last_became_active":"2023-05-17T14:54:39.129710+0000","last_became_peered":"2023-05-17T14:54:39.129710+0000","last_unstale":"2023-05-17T14:54:39.130101+0000","last_undegraded":"2023-05-17T14:54:39.130101+0000","last_fullsized":"2023-05-17T14:54:39.130101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.109545+0000","last_change":"2023-05-17T14:54:38.732936+0000","last_active":"2023-05-17T14:54:39.109545+0000","last_peered":"2023-05-17T14:54:39.109545+0000","last_clean":"2023-05-17T14:54:39.109545+0000","last_became_active":"2023-05-17T14:54:38.732626+0000","last_became_peered":"2023-05-17T14:54:38.732626+0000","last_unstale":"2023-05-17T14:54:39.109545+0000","last_undegraded":"2023-05-17T14:54:39.109545+0000","last_fullsized":"2023-05-17T14:54:39.109545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.127321+0000","last_change":"2023-05-17T14:54:39.127321+0000","last_active":"2023-05-17T14:54:39.127321+0000","last_peered":"2023-05-17T14:54:39.127321+0000","last_clean":"2023-05-17T14:54:39.127321+0000","last_became_active":"2023-05-17T14:54:39.127072+0000","last_became_peered":"2023-05-17T14:54:39.127072+0000","last_unstale":"2023-05-17T14:54:39.127321+0000","last_undegraded":"2023-05-17T14:54:39.127321+0000","last_fullsized":"2023-05-17T14:54:39.127321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.102542+0000","last_change":"2023-05-17T14:54:38.732107+0000","last_active":"2023-05-17T14:54:39.102542+0000","last_peered":"2023-05-17T14:54:39.102542+0000","last_clean":"2023-05-17T14:54:39.102542+0000","last_became_active":"2023-05-17T14:54:38.731537+0000","last_became_peered":"2023-05-17T14:54:38.731537+0000","last_unstale":"2023-05-17T14:54:39.102542+0000","last_undegraded":"2023-05-17T14:54:39.102542+0000","last_fullsized":"2023-05-17T14:54:39.102542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117363+0000","last_change":"2023-05-17T14:54:39.117363+0000","last_active":"2023-05-17T14:54:39.117363+0000","last_peered":"2023-05-17T14:54:39.117363+0000","last_clean":"2023-05-17T14:54:39.117363+0000","last_became_active":"2023-05-17T14:54:39.117073+0000","last_became_peered":"2023-05-17T14:54:39.117073+0000","last_unstale":"2023-05-17T14:54:39.117363+0000","last_undegraded":"2023-05-17T14:54:39.117363+0000","last_fullsized":"2023-05-17T14:54:39.117363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.125126+0000","last_change":"2023-05-17T14:54:38.739933+0000","last_active":"2023-05-17T14:54:39.125126+0000","last_peered":"2023-05-17T14:54:39.125126+0000","last_clean":"2023-05-17T14:54:39.125126+0000","last_became_active":"2023-05-17T14:54:38.739235+0000","last_became_peered":"2023-05-17T14:54:38.739235+0000","last_unstale":"2023-05-17T14:54:39.125126+0000","last_undegraded":"2023-05-17T14:54:39.125126+0000","last_fullsized":"2023-05-17T14:54:39.125126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126193+0000","last_change":"2023-05-17T14:54:39.126193+0000","last_active":"2023-05-17T14:54:39.126193+0000","last_peered":"2023-05-17T14:54:39.126193+0000","last_clean":"2023-05-17T14:54:39.126193+0000","last_became_active":"2023-05-17T14:54:39.125743+0000","last_became_peered":"2023-05-17T14:54:39.125743+0000","last_unstale":"2023-05-17T14:54:39.126193+0000","last_undegraded":"2023-05-17T14:54:39.126193+0000","last_fullsized":"2023-05-17T14:54:39.126193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738331+0000","last_change":"2023-05-17T14:54:38.729692+0000","last_active":"2023-05-17T14:54:38.738331+0000","last_peered":"2023-05-17T14:54:38.738331+0000","last_clean":"2023-05-17T14:54:38.738331+0000","last_became_active":"2023-05-17T14:54:38.729367+0000","last_became_peered":"2023-05-17T14:54:38.729367+0000","last_unstale":"2023-05-17T14:54:38.738331+0000","last_undegraded":"2023-05-17T14:54:38.738331+0000","last_fullsized":"2023-05-17T14:54:38.738331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.106711+0000","last_change":"2023-05-17T14:54:39.106711+0000","last_active":"2023-05-17T14:54:39.106711+0000","last_peered":"2023-05-17T14:54:39.106711+0000","last_clean":"2023-05-17T14:54:39.106711+0000","last_became_active":"2023-05-17T14:54:39.106486+0000","last_became_peered":"2023-05-17T14:54:39.106486+0000","last_unstale":"2023-05-17T14:54:39.106711+0000","last_undegraded":"2023-05-17T14:54:39.106711+0000","last_fullsized":"2023-05-17T14:54:39.106711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740454+0000","last_change":"2023-05-17T14:54:38.733934+0000","last_active":"2023-05-17T14:54:38.740454+0000","last_peered":"2023-05-17T14:54:38.740454+0000","last_clean":"2023-05-17T14:54:38.740454+0000","last_became_active":"2023-05-17T14:54:38.733213+0000","last_became_peered":"2023-05-17T14:54:38.733213+0000","last_unstale":"2023-05-17T14:54:38.740454+0000","last_undegraded":"2023-05-17T14:54:38.740454+0000","last_fullsized":"2023-05-17T14:54:38.740454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.128397+0000","last_change":"2023-05-17T14:54:39.128397+0000","last_active":"2023-05-17T14:54:39.128397+0000","last_peered":"2023-05-17T14:54:39.128397+0000","last_clean":"2023-05-17T14:54:39.128397+0000","last_became_active":"2023-05-17T14:54:39.126233+0000","last_became_peered":"2023-05-17T14:54:39.126233+0000","last_unstale":"2023-05-17T14:54:39.128397+0000","last_undegraded":"2023-05-17T14:54:39.128397+0000","last_fullsized":"2023-05-17T14:54:39.128397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.741710+0000","last_change":"2023-05-17T14:54:38.739377+0000","last_active":"2023-05-17T14:54:38.741710+0000","last_peered":"2023-05-17T14:54:38.741710+0000","last_clean":"2023-05-17T14:54:38.741710+0000","last_became_active":"2023-05-17T14:54:38.739055+0000","last_became_peered":"2023-05-17T14:54:38.739055+0000","last_unstale":"2023-05-17T14:54:38.741710+0000","last_undegraded":"2023-05-17T14:54:38.741710+0000","last_fullsized":"2023-05-17T14:54:38.741710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120962+0000","last_change":"2023-05-17T14:54:39.120962+0000","last_active":"2023-05-17T14:54:39.120962+0000","last_peered":"2023-05-17T14:54:39.120962+0000","last_clean":"2023-05-17T14:54:39.120962+0000","last_became_active":"2023-05-17T14:54:39.120673+0000","last_became_peered":"2023-05-17T14:54:39.120673+0000","last_unstale":"2023-05-17T14:54:39.120962+0000","last_undegraded":"2023-05-17T14:54:39.120962+0000","last_fullsized":"2023-05-17T14:54:39.120962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739103+0000","last_change":"2023-05-17T14:54:38.735025+0000","last_active":"2023-05-17T14:54:38.739103+0000","last_peered":"2023-05-17T14:54:38.739103+0000","last_clean":"2023-05-17T14:54:38.739103+0000","last_became_active":"2023-05-17T14:54:38.734753+0000","last_became_peered":"2023-05-17T14:54:38.734753+0000","last_unstale":"2023-05-17T14:54:38.739103+0000","last_undegraded":"2023-05-17T14:54:38.739103+0000","last_fullsized":"2023-05-17T14:54:38.739103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120052+0000","last_change":"2023-05-17T14:54:39.120052+0000","last_active":"2023-05-17T14:54:39.120052+0000","last_peered":"2023-05-17T14:54:39.120052+0000","last_clean":"2023-05-17T14:54:39.120052+0000","last_became_active":"2023-05-17T14:54:39.119468+0000","last_became_peered":"2023-05-17T14:54:39.119468+0000","last_unstale":"2023-05-17T14:54:39.120052+0000","last_undegraded":"2023-05-17T14:54:39.120052+0000","last_fullsized":"2023-05-17T14:54:39.120052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740420+0000","last_change":"2023-05-17T14:54:38.732212+0000","last_active":"2023-05-17T14:54:38.740420+0000","last_peered":"2023-05-17T14:54:38.740420+0000","last_clean":"2023-05-17T14:54:38.740420+0000","last_became_active":"2023-05-17T14:54:38.731874+0000","last_became_peered":"2023-05-17T14:54:38.731874+0000","last_unstale":"2023-05-17T14:54:38.740420+0000","last_undegraded":"2023-05-17T14:54:38.740420+0000","last_fullsized":"2023-05-17T14:54:38.740420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117851+0000","last_change":"2023-05-17T14:54:39.117851+0000","last_active":"2023-05-17T14:54:39.117851+0000","last_peered":"2023-05-17T14:54:39.117851+0000","last_clean":"2023-05-17T14:54:39.117851+0000","last_became_active":"2023-05-17T14:54:39.117046+0000","last_became_peered":"2023-05-17T14:54:39.117046+0000","last_unstale":"2023-05-17T14:54:39.117851+0000","last_undegraded":"2023-05-17T14:54:39.117851+0000","last_fullsized":"2023-05-17T14:54:39.117851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736496+0000","last_change":"2023-05-17T14:54:38.730397+0000","last_active":"2023-05-17T14:54:38.736496+0000","last_peered":"2023-05-17T14:54:38.736496+0000","last_clean":"2023-05-17T14:54:38.736496+0000","last_became_active":"2023-05-17T14:54:38.730086+0000","last_became_peered":"2023-05-17T14:54:38.730086+0000","last_unstale":"2023-05-17T14:54:38.736496+0000","last_undegraded":"2023-05-17T14:54:38.736496+0000","last_fullsized":"2023-05-17T14:54:38.736496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.122442+0000","last_change":"2023-05-17T14:54:39.122442+0000","last_active":"2023-05-17T14:54:39.122442+0000","last_peered":"2023-05-17T14:54:39.122442+0000","last_clean":"2023-05-17T14:54:39.122442+0000","last_became_active":"2023-05-17T14:54:39.121818+0000","last_became_peered":"2023-05-17T14:54:39.121818+0000","last_unstale":"2023-05-17T14:54:39.122442+0000","last_undegraded":"2023-05-17T14:54:39.122442+0000","last_fullsized":"2023-05-17T14:54:39.122442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.740593+0000","last_change":"2023-05-17T14:54:38.734904+0000","last_active":"2023-05-17T14:54:38.740593+0000","last_peered":"2023-05-17T14:54:38.740593+0000","last_clean":"2023-05-17T14:54:38.740593+0000","last_became_active":"2023-05-17T14:54:38.734586+0000","last_became_peered":"2023-05-17T14:54:38.734586+0000","last_unstale":"2023-05-17T14:54:38.740593+0000","last_undegraded":"2023-05-17T14:54:38.740593+0000","last_fullsized":"2023-05-17T14:54:38.740593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119385+0000","last_change":"2023-05-17T14:54:39.119385+0000","last_active":"2023-05-17T14:54:39.119385+0000","last_peered":"2023-05-17T14:54:39.119385+0000","last_clean":"2023-05-17T14:54:39.119385+0000","last_became_active":"2023-05-17T14:54:39.119094+0000","last_became_peered":"2023-05-17T14:54:39.119094+0000","last_unstale":"2023-05-17T14:54:39.119385+0000","last_undegraded":"2023-05-17T14:54:39.119385+0000","last_fullsized":"2023-05-17T14:54:39.119385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126431+0000","last_change":"2023-05-17T14:54:38.730761+0000","last_active":"2023-05-17T14:54:39.126431+0000","last_peered":"2023-05-17T14:54:39.126431+0000","last_clean":"2023-05-17T14:54:39.126431+0000","last_became_active":"2023-05-17T14:54:38.730480+0000","last_became_peered":"2023-05-17T14:54:38.730480+0000","last_unstale":"2023-05-17T14:54:39.126431+0000","last_undegraded":"2023-05-17T14:54:39.126431+0000","last_fullsized":"2023-05-17T14:54:39.126431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113004+0000","last_change":"2023-05-17T14:54:39.113004+0000","last_active":"2023-05-17T14:54:39.113004+0000","last_peered":"2023-05-17T14:54:39.113004+0000","last_clean":"2023-05-17T14:54:39.113004+0000","last_became_active":"2023-05-17T14:54:39.112710+0000","last_became_peered":"2023-05-17T14:54:39.112710+0000","last_unstale":"2023-05-17T14:54:39.113004+0000","last_undegraded":"2023-05-17T14:54:39.113004+0000","last_fullsized":"2023-05-17T14:54:39.113004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.123428+0000","last_change":"2023-05-17T14:54:38.730962+0000","last_active":"2023-05-17T14:54:39.123428+0000","last_peered":"2023-05-17T14:54:39.123428+0000","last_clean":"2023-05-17T14:54:39.123428+0000","last_became_active":"2023-05-17T14:54:38.730676+0000","last_became_peered":"2023-05-17T14:54:38.730676+0000","last_unstale":"2023-05-17T14:54:39.123428+0000","last_undegraded":"2023-05-17T14:54:39.123428+0000","last_fullsized":"2023-05-17T14:54:39.123428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.107424+0000","last_change":"2023-05-17T14:54:39.107424+0000","last_active":"2023-05-17T14:54:39.107424+0000","last_peered":"2023-05-17T14:54:39.107424+0000","last_clean":"2023-05-17T14:54:39.107424+0000","last_became_active":"2023-05-17T14:54:39.107184+0000","last_became_peered":"2023-05-17T14:54:39.107184+0000","last_unstale":"2023-05-17T14:54:39.107424+0000","last_undegraded":"2023-05-17T14:54:39.107424+0000","last_fullsized":"2023-05-17T14:54:39.107424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113010+0000","last_change":"2023-05-17T14:54:38.727928+0000","last_active":"2023-05-17T14:54:39.113010+0000","last_peered":"2023-05-17T14:54:39.113010+0000","last_clean":"2023-05-17T14:54:39.113010+0000","last_became_active":"2023-05-17T14:54:38.727615+0000","last_became_peered":"2023-05-17T14:54:38.727615+0000","last_unstale":"2023-05-17T14:54:39.113010+0000","last_undegraded":"2023-05-17T14:54:39.113010+0000","last_fullsized":"2023-05-17T14:54:39.113010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115572+0000","last_change":"2023-05-17T14:54:39.115572+0000","last_active":"2023-05-17T14:54:39.115572+0000","last_peered":"2023-05-17T14:54:39.115572+0000","last_clean":"2023-05-17T14:54:39.115572+0000","last_became_active":"2023-05-17T14:54:39.115271+0000","last_became_peered":"2023-05-17T14:54:39.115271+0000","last_unstale":"2023-05-17T14:54:39.115572+0000","last_undegraded":"2023-05-17T14:54:39.115572+0000","last_fullsized":"2023-05-17T14:54:39.115572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739382+0000","last_change":"2023-05-17T14:54:38.737265+0000","last_active":"2023-05-17T14:54:38.739382+0000","last_peered":"2023-05-17T14:54:38.739382+0000","last_clean":"2023-05-17T14:54:38.739382+0000","last_became_active":"2023-05-17T14:54:38.737002+0000","last_became_peered":"2023-05-17T14:54:38.737002+0000","last_unstale":"2023-05-17T14:54:38.739382+0000","last_undegraded":"2023-05-17T14:54:38.739382+0000","last_fullsized":"2023-05-17T14:54:38.739382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119888+0000","last_change":"2023-05-17T14:54:39.119888+0000","last_active":"2023-05-17T14:54:39.119888+0000","last_peered":"2023-05-17T14:54:39.119888+0000","last_clean":"2023-05-17T14:54:39.119888+0000","last_became_active":"2023-05-17T14:54:39.119553+0000","last_became_peered":"2023-05-17T14:54:39.119553+0000","last_unstale":"2023-05-17T14:54:39.119888+0000","last_undegraded":"2023-05-17T14:54:39.119888+0000","last_fullsized":"2023-05-17T14:54:39.119888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738566+0000","last_change":"2023-05-17T14:54:38.732294+0000","last_active":"2023-05-17T14:54:38.738566+0000","last_peered":"2023-05-17T14:54:38.738566+0000","last_clean":"2023-05-17T14:54:38.738566+0000","last_became_active":"2023-05-17T14:54:38.732016+0000","last_became_peered":"2023-05-17T14:54:38.732016+0000","last_unstale":"2023-05-17T14:54:38.738566+0000","last_undegraded":"2023-05-17T14:54:38.738566+0000","last_fullsized":"2023-05-17T14:54:38.738566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116765+0000","last_change":"2023-05-17T14:54:39.116765+0000","last_active":"2023-05-17T14:54:39.116765+0000","last_peered":"2023-05-17T14:54:39.116765+0000","last_clean":"2023-05-17T14:54:39.116765+0000","last_became_active":"2023-05-17T14:54:39.115235+0000","last_became_peered":"2023-05-17T14:54:39.115235+0000","last_unstale":"2023-05-17T14:54:39.116765+0000","last_undegraded":"2023-05-17T14:54:39.116765+0000","last_fullsized":"2023-05-17T14:54:39.116765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.124274+0000","last_change":"2023-05-17T14:54:38.734842+0000","last_active":"2023-05-17T14:54:39.124274+0000","last_peered":"2023-05-17T14:54:39.124274+0000","last_clean":"2023-05-17T14:54:39.124274+0000","last_became_active":"2023-05-17T14:54:38.732620+0000","last_became_peered":"2023-05-17T14:54:38.732620+0000","last_unstale":"2023-05-17T14:54:39.124274+0000","last_undegraded":"2023-05-17T14:54:39.124274+0000","last_fullsized":"2023-05-17T14:54:39.124274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.117219+0000","last_change":"2023-05-17T14:54:39.117219+0000","last_active":"2023-05-17T14:54:39.117219+0000","last_peered":"2023-05-17T14:54:39.117219+0000","last_clean":"2023-05-17T14:54:39.117219+0000","last_became_active":"2023-05-17T14:54:39.116897+0000","last_became_peered":"2023-05-17T14:54:39.116897+0000","last_unstale":"2023-05-17T14:54:39.117219+0000","last_undegraded":"2023-05-17T14:54:39.117219+0000","last_fullsized":"2023-05-17T14:54:39.117219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.102623+0000","last_change":"2023-05-17T14:54:38.734393+0000","last_active":"2023-05-17T14:54:39.102623+0000","last_peered":"2023-05-17T14:54:39.102623+0000","last_clean":"2023-05-17T14:54:39.102623+0000","last_became_active":"2023-05-17T14:54:38.734072+0000","last_became_peered":"2023-05-17T14:54:38.734072+0000","last_unstale":"2023-05-17T14:54:39.102623+0000","last_undegraded":"2023-05-17T14:54:39.102623+0000","last_fullsized":"2023-05-17T14:54:39.102623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126554+0000","last_change":"2023-05-17T14:54:39.126554+0000","last_active":"2023-05-17T14:54:39.126554+0000","last_peered":"2023-05-17T14:54:39.126554+0000","last_clean":"2023-05-17T14:54:39.126554+0000","last_became_active":"2023-05-17T14:54:39.125771+0000","last_became_peered":"2023-05-17T14:54:39.125771+0000","last_unstale":"2023-05-17T14:54:39.126554+0000","last_undegraded":"2023-05-17T14:54:39.126554+0000","last_fullsized":"2023-05-17T14:54:39.126554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120676+0000","last_change":"2023-05-17T14:54:38.734610+0000","last_active":"2023-05-17T14:54:39.120676+0000","last_peered":"2023-05-17T14:54:39.120676+0000","last_clean":"2023-05-17T14:54:39.120676+0000","last_became_active":"2023-05-17T14:54:38.734292+0000","last_became_peered":"2023-05-17T14:54:38.734292+0000","last_unstale":"2023-05-17T14:54:39.120676+0000","last_undegraded":"2023-05-17T14:54:39.120676+0000","last_fullsized":"2023-05-17T14:54:39.120676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116613+0000","last_change":"2023-05-17T14:54:39.116613+0000","last_active":"2023-05-17T14:54:39.116613+0000","last_peered":"2023-05-17T14:54:39.116613+0000","last_clean":"2023-05-17T14:54:39.116613+0000","last_became_active":"2023-05-17T14:54:39.114747+0000","last_became_peered":"2023-05-17T14:54:39.114747+0000","last_unstale":"2023-05-17T14:54:39.116613+0000","last_undegraded":"2023-05-17T14:54:39.116613+0000","last_fullsized":"2023-05-17T14:54:39.116613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736385+0000","last_change":"2023-05-17T14:54:38.732880+0000","last_active":"2023-05-17T14:54:38.736385+0000","last_peered":"2023-05-17T14:54:38.736385+0000","last_clean":"2023-05-17T14:54:38.736385+0000","last_became_active":"2023-05-17T14:54:38.732590+0000","last_became_peered":"2023-05-17T14:54:38.732590+0000","last_unstale":"2023-05-17T14:54:38.736385+0000","last_undegraded":"2023-05-17T14:54:38.736385+0000","last_fullsized":"2023-05-17T14:54:38.736385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119595+0000","last_change":"2023-05-17T14:54:39.119595+0000","last_active":"2023-05-17T14:54:39.119595+0000","last_peered":"2023-05-17T14:54:39.119595+0000","last_clean":"2023-05-17T14:54:39.119595+0000","last_became_active":"2023-05-17T14:54:39.119304+0000","last_became_peered":"2023-05-17T14:54:39.119304+0000","last_unstale":"2023-05-17T14:54:39.119595+0000","last_undegraded":"2023-05-17T14:54:39.119595+0000","last_fullsized":"2023-05-17T14:54:39.119595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.743656+0000","last_change":"2023-05-17T14:54:38.738357+0000","last_active":"2023-05-17T14:54:38.743656+0000","last_peered":"2023-05-17T14:54:38.743656+0000","last_clean":"2023-05-17T14:54:38.743656+0000","last_became_active":"2023-05-17T14:54:38.738060+0000","last_became_peered":"2023-05-17T14:54:38.738060+0000","last_unstale":"2023-05-17T14:54:38.743656+0000","last_undegraded":"2023-05-17T14:54:38.743656+0000","last_fullsized":"2023-05-17T14:54:38.743656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118965+0000","last_change":"2023-05-17T14:54:39.118965+0000","last_active":"2023-05-17T14:54:39.118965+0000","last_peered":"2023-05-17T14:54:39.118965+0000","last_clean":"2023-05-17T14:54:39.118965+0000","last_became_active":"2023-05-17T14:54:39.118629+0000","last_became_peered":"2023-05-17T14:54:39.118629+0000","last_unstale":"2023-05-17T14:54:39.118965+0000","last_undegraded":"2023-05-17T14:54:39.118965+0000","last_fullsized":"2023-05-17T14:54:39.118965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.108262+0000","last_change":"2023-05-17T14:54:38.733304+0000","last_active":"2023-05-17T14:54:39.108262+0000","last_peered":"2023-05-17T14:54:39.108262+0000","last_clean":"2023-05-17T14:54:39.108262+0000","last_became_active":"2023-05-17T14:54:38.733033+0000","last_became_peered":"2023-05-17T14:54:38.733033+0000","last_unstale":"2023-05-17T14:54:39.108262+0000","last_undegraded":"2023-05-17T14:54:39.108262+0000","last_fullsized":"2023-05-17T14:54:39.108262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116550+0000","last_change":"2023-05-17T14:54:39.116550+0000","last_active":"2023-05-17T14:54:39.116550+0000","last_peered":"2023-05-17T14:54:39.116550+0000","last_clean":"2023-05-17T14:54:39.116550+0000","last_became_active":"2023-05-17T14:54:39.116281+0000","last_became_peered":"2023-05-17T14:54:39.116281+0000","last_unstale":"2023-05-17T14:54:39.116550+0000","last_undegraded":"2023-05-17T14:54:39.116550+0000","last_fullsized":"2023-05-17T14:54:39.116550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736163+0000","last_change":"2023-05-17T14:54:38.731878+0000","last_active":"2023-05-17T14:54:38.736163+0000","last_peered":"2023-05-17T14:54:38.736163+0000","last_clean":"2023-05-17T14:54:38.736163+0000","last_became_active":"2023-05-17T14:54:38.731200+0000","last_became_peered":"2023-05-17T14:54:38.731200+0000","last_unstale":"2023-05-17T14:54:38.736163+0000","last_undegraded":"2023-05-17T14:54:38.736163+0000","last_fullsized":"2023-05-17T14:54:38.736163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.113879+0000","last_change":"2023-05-17T14:54:39.113879+0000","last_active":"2023-05-17T14:54:39.113879+0000","last_peered":"2023-05-17T14:54:39.113879+0000","last_clean":"2023-05-17T14:54:39.113879+0000","last_became_active":"2023-05-17T14:54:39.113558+0000","last_became_peered":"2023-05-17T14:54:39.113558+0000","last_unstale":"2023-05-17T14:54:39.113879+0000","last_undegraded":"2023-05-17T14:54:39.113879+0000","last_fullsized":"2023-05-17T14:54:39.113879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739941+0000","last_change":"2023-05-17T14:54:38.738839+0000","last_active":"2023-05-17T14:54:38.739941+0000","last_peered":"2023-05-17T14:54:38.739941+0000","last_clean":"2023-05-17T14:54:38.739941+0000","last_became_active":"2023-05-17T14:54:38.738504+0000","last_became_peered":"2023-05-17T14:54:38.738504+0000","last_unstale":"2023-05-17T14:54:38.739941+0000","last_undegraded":"2023-05-17T14:54:38.739941+0000","last_fullsized":"2023-05-17T14:54:38.739941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.118296+0000","last_change":"2023-05-17T14:54:39.118296+0000","last_active":"2023-05-17T14:54:39.118296+0000","last_peered":"2023-05-17T14:54:39.118296+0000","last_clean":"2023-05-17T14:54:39.118296+0000","last_became_active":"2023-05-17T14:54:39.118001+0000","last_became_peered":"2023-05-17T14:54:39.118001+0000","last_unstale":"2023-05-17T14:54:39.118296+0000","last_undegraded":"2023-05-17T14:54:39.118296+0000","last_fullsized":"2023-05-17T14:54:39.118296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736211+0000","last_change":"2023-05-17T14:54:38.732737+0000","last_active":"2023-05-17T14:54:38.736211+0000","last_peered":"2023-05-17T14:54:38.736211+0000","last_clean":"2023-05-17T14:54:38.736211+0000","last_became_active":"2023-05-17T14:54:38.732457+0000","last_became_peered":"2023-05-17T14:54:38.732457+0000","last_unstale":"2023-05-17T14:54:38.736211+0000","last_undegraded":"2023-05-17T14:54:38.736211+0000","last_fullsized":"2023-05-17T14:54:38.736211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.116508+0000","last_change":"2023-05-17T14:54:39.116508+0000","last_active":"2023-05-17T14:54:39.116508+0000","last_peered":"2023-05-17T14:54:39.116508+0000","last_clean":"2023-05-17T14:54:39.116508+0000","last_became_active":"2023-05-17T14:54:39.116227+0000","last_became_peered":"2023-05-17T14:54:39.116227+0000","last_unstale":"2023-05-17T14:54:39.116508+0000","last_undegraded":"2023-05-17T14:54:39.116508+0000","last_fullsized":"2023-05-17T14:54:39.116508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736700+0000","last_change":"2023-05-17T14:54:38.732318+0000","last_active":"2023-05-17T14:54:38.736700+0000","last_peered":"2023-05-17T14:54:38.736700+0000","last_clean":"2023-05-17T14:54:38.736700+0000","last_became_active":"2023-05-17T14:54:38.730705+0000","last_became_peered":"2023-05-17T14:54:38.730705+0000","last_unstale":"2023-05-17T14:54:38.736700+0000","last_undegraded":"2023-05-17T14:54:38.736700+0000","last_fullsized":"2023-05-17T14:54:38.736700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.714188+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T14:54:38.714188+0000","last_peered":"2023-05-17T14:54:38.714188+0000","last_clean":"2023-05-17T14:54:38.714188+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T14:54:38.714188+0000","last_undegraded":"2023-05-17T14:54:38.714188+0000","last_fullsized":"2023-05-17T14:54:38.714188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.115975+0000","last_change":"2023-05-17T14:54:39.115975+0000","last_active":"2023-05-17T14:54:39.115975+0000","last_peered":"2023-05-17T14:54:39.115975+0000","last_clean":"2023-05-17T14:54:39.115975+0000","last_became_active":"2023-05-17T14:54:39.115753+0000","last_became_peered":"2023-05-17T14:54:39.115753+0000","last_unstale":"2023-05-17T14:54:39.115975+0000","last_undegraded":"2023-05-17T14:54:39.115975+0000","last_fullsized":"2023-05-17T14:54:39.115975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.730500+0000","last_change":"2023-05-17T14:54:38.728610+0000","last_active":"2023-05-17T14:54:38.730500+0000","last_peered":"2023-05-17T14:54:38.730500+0000","last_clean":"2023-05-17T14:54:38.730500+0000","last_became_active":"2023-05-17T14:54:38.728414+0000","last_became_peered":"2023-05-17T14:54:38.728414+0000","last_unstale":"2023-05-17T14:54:38.730500+0000","last_undegraded":"2023-05-17T14:54:38.730500+0000","last_fullsized":"2023-05-17T14:54:38.730500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.717890+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T14:54:38.717890+0000","last_peered":"2023-05-17T14:54:38.717890+0000","last_clean":"2023-05-17T14:54:38.717890+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T14:54:38.717890+0000","last_undegraded":"2023-05-17T14:54:38.717890+0000","last_fullsized":"2023-05-17T14:54:38.717890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.122602+0000","last_change":"2023-05-17T14:54:39.122602+0000","last_active":"2023-05-17T14:54:39.122602+0000","last_peered":"2023-05-17T14:54:39.122602+0000","last_clean":"2023-05-17T14:54:39.122602+0000","last_became_active":"2023-05-17T14:54:39.122226+0000","last_became_peered":"2023-05-17T14:54:39.122226+0000","last_unstale":"2023-05-17T14:54:39.122602+0000","last_undegraded":"2023-05-17T14:54:39.122602+0000","last_fullsized":"2023-05-17T14:54:39.122602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.741359+0000","last_change":"2023-05-17T14:54:38.739570+0000","last_active":"2023-05-17T14:54:38.741359+0000","last_peered":"2023-05-17T14:54:38.741359+0000","last_clean":"2023-05-17T14:54:38.741359+0000","last_became_active":"2023-05-17T14:54:38.739319+0000","last_became_peered":"2023-05-17T14:54:38.739319+0000","last_unstale":"2023-05-17T14:54:38.741359+0000","last_undegraded":"2023-05-17T14:54:38.741359+0000","last_fullsized":"2023-05-17T14:54:38.741359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.714495+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T14:54:38.714495+0000","last_peered":"2023-05-17T14:54:38.714495+0000","last_clean":"2023-05-17T14:54:38.714495+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T14:54:38.714495+0000","last_undegraded":"2023-05-17T14:54:38.714495+0000","last_fullsized":"2023-05-17T14:54:38.714495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120280+0000","last_change":"2023-05-17T14:54:39.120280+0000","last_active":"2023-05-17T14:54:39.120280+0000","last_peered":"2023-05-17T14:54:39.120280+0000","last_clean":"2023-05-17T14:54:39.120280+0000","last_became_active":"2023-05-17T14:54:39.120004+0000","last_became_peered":"2023-05-17T14:54:39.120004+0000","last_unstale":"2023-05-17T14:54:39.120280+0000","last_undegraded":"2023-05-17T14:54:39.120280+0000","last_fullsized":"2023-05-17T14:54:39.120280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.739556+0000","last_change":"2023-05-17T14:54:38.736142+0000","last_active":"2023-05-17T14:54:38.739556+0000","last_peered":"2023-05-17T14:54:38.739556+0000","last_clean":"2023-05-17T14:54:38.739556+0000","last_became_active":"2023-05-17T14:54:38.735767+0000","last_became_peered":"2023-05-17T14:54:38.735767+0000","last_unstale":"2023-05-17T14:54:38.739556+0000","last_undegraded":"2023-05-17T14:54:38.739556+0000","last_fullsized":"2023-05-17T14:54:38.739556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.717264+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T14:54:38.717264+0000","last_peered":"2023-05-17T14:54:38.717264+0000","last_clean":"2023-05-17T14:54:38.717264+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T14:54:38.717264+0000","last_undegraded":"2023-05-17T14:54:38.717264+0000","last_fullsized":"2023-05-17T14:54:38.717264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.720280+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T14:54:38.720280+0000","last_peered":"2023-05-17T14:54:38.720280+0000","last_clean":"2023-05-17T14:54:38.720280+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T14:54:38.720280+0000","last_undegraded":"2023-05-17T14:54:38.720280+0000","last_fullsized":"2023-05-17T14:54:38.720280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.121338+0000","last_change":"2023-05-17T14:54:39.121338+0000","last_active":"2023-05-17T14:54:39.121338+0000","last_peered":"2023-05-17T14:54:39.121338+0000","last_clean":"2023-05-17T14:54:39.121338+0000","last_became_active":"2023-05-17T14:54:39.121102+0000","last_became_peered":"2023-05-17T14:54:39.121102+0000","last_unstale":"2023-05-17T14:54:39.121338+0000","last_undegraded":"2023-05-17T14:54:39.121338+0000","last_fullsized":"2023-05-17T14:54:39.121338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126430+0000","last_change":"2023-05-17T14:54:38.733819+0000","last_active":"2023-05-17T14:54:39.126430+0000","last_peered":"2023-05-17T14:54:39.126430+0000","last_clean":"2023-05-17T14:54:39.126430+0000","last_became_active":"2023-05-17T14:54:38.733505+0000","last_became_peered":"2023-05-17T14:54:38.733505+0000","last_unstale":"2023-05-17T14:54:39.126430+0000","last_undegraded":"2023-05-17T14:54:39.126430+0000","last_fullsized":"2023-05-17T14:54:39.126430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.721525+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T14:54:38.721525+0000","last_peered":"2023-05-17T14:54:38.721525+0000","last_clean":"2023-05-17T14:54:38.721525+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T14:54:38.721525+0000","last_undegraded":"2023-05-17T14:54:38.721525+0000","last_fullsized":"2023-05-17T14:54:38.721525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.119402+0000","last_change":"2023-05-17T14:54:39.119402+0000","last_active":"2023-05-17T14:54:39.119402+0000","last_peered":"2023-05-17T14:54:39.119402+0000","last_clean":"2023-05-17T14:54:39.119402+0000","last_became_active":"2023-05-17T14:54:39.119193+0000","last_became_peered":"2023-05-17T14:54:39.119193+0000","last_unstale":"2023-05-17T14:54:39.119402+0000","last_undegraded":"2023-05-17T14:54:39.119402+0000","last_fullsized":"2023-05-17T14:54:39.119402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.738339+0000","last_change":"2023-05-17T14:54:38.732013+0000","last_active":"2023-05-17T14:54:38.738339+0000","last_peered":"2023-05-17T14:54:38.738339+0000","last_clean":"2023-05-17T14:54:38.738339+0000","last_became_active":"2023-05-17T14:54:38.731695+0000","last_became_peered":"2023-05-17T14:54:38.731695+0000","last_unstale":"2023-05-17T14:54:38.738339+0000","last_undegraded":"2023-05-17T14:54:38.738339+0000","last_fullsized":"2023-05-17T14:54:38.738339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.726654+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T14:54:38.726654+0000","last_peered":"2023-05-17T14:54:38.726654+0000","last_clean":"2023-05-17T14:54:38.726654+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T14:54:38.726654+0000","last_undegraded":"2023-05-17T14:54:38.726654+0000","last_fullsized":"2023-05-17T14:54:38.726654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.126287+0000","last_change":"2023-05-17T14:54:39.126287+0000","last_active":"2023-05-17T14:54:39.126287+0000","last_peered":"2023-05-17T14:54:39.126287+0000","last_clean":"2023-05-17T14:54:39.126287+0000","last_became_active":"2023-05-17T14:54:39.125979+0000","last_became_peered":"2023-05-17T14:54:39.125979+0000","last_unstale":"2023-05-17T14:54:39.126287+0000","last_undegraded":"2023-05-17T14:54:39.126287+0000","last_fullsized":"2023-05-17T14:54:39.126287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.736526+0000","last_change":"2023-05-17T14:54:38.729434+0000","last_active":"2023-05-17T14:54:38.736526+0000","last_peered":"2023-05-17T14:54:38.736526+0000","last_clean":"2023-05-17T14:54:38.736526+0000","last_became_active":"2023-05-17T14:54:38.729112+0000","last_became_peered":"2023-05-17T14:54:38.729112+0000","last_unstale":"2023-05-17T14:54:38.736526+0000","last_undegraded":"2023-05-17T14:54:38.736526+0000","last_fullsized":"2023-05-17T14:54:38.736526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.714844+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T14:54:38.714844+0000","last_peered":"2023-05-17T14:54:38.714844+0000","last_clean":"2023-05-17T14:54:38.714844+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T14:54:38.714844+0000","last_undegraded":"2023-05-17T14:54:38.714844+0000","last_fullsized":"2023-05-17T14:54:38.714844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-17T14:54:39.120054+0000","last_change":"2023-05-17T14:54:39.120054+0000","last_active":"2023-05-17T14:54:39.120054+0000","last_peered":"2023-05-17T14:54:39.120054+0000","last_clean":"2023-05-17T14:54:39.120054+0000","last_became_active":"2023-05-17T14:54:39.119709+0000","last_became_peered":"2023-05-17T14:54:39.119709+0000","last_unstale":"2023-05-17T14:54:39.120054+0000","last_undegraded":"2023-05-17T14:54:39.120054+0000","last_fullsized":"2023-05-17T14:54:39.120054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:38.701396+0000","last_clean_scrub_stamp":"2023-05-17T14:54:38.701396+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.731908+0000","last_change":"2023-05-17T14:54:38.727076+0000","last_active":"2023-05-17T14:54:38.731908+0000","last_peered":"2023-05-17T14:54:38.731908+0000","last_clean":"2023-05-17T14:54:38.731908+0000","last_became_active":"2023-05-17T14:54:38.726389+0000","last_became_peered":"2023-05-17T14:54:38.726389+0000","last_unstale":"2023-05-17T14:54:38.731908+0000","last_undegraded":"2023-05-17T14:54:38.731908+0000","last_fullsized":"2023-05-17T14:54:38.731908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:54:37.696167+0000","last_clean_scrub_stamp":"2023-05-17T14:54:37.696167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-17T14:54:38.724867+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T14:54:38.724867+0000","last_peered":"2023-05-17T14:54:38.724867+0000","last_clean":"2023-05-17T14:54:38.724867+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T14:54:38.724867+0000","last_undegraded":"2023-05-17T14:54:38.724867+0000","last_fullsized":"2023-05-17T14:54:38.724867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5692,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366148,"statfs":{"total":96636764160,"available":96630935552,"internally_reserved":0,"allocated":380928,"data_stored":152640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5468,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366372,"statfs":{"total":96636764160,"available":96631164928,"internally_reserved":0,"allocated":348160,"data_stored":138138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5628,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366212,"statfs":{"total":96636764160,"available":96631001088,"internally_reserved":0,"allocated":380928,"data_stored":152156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5624,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366216,"statfs":{"total":96636764160,"available":96631005184,"internally_reserved":0,"allocated":376832,"data_stored":152030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5416,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366424,"statfs":{"total":96636764160,"available":96631218176,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5704,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366136,"statfs":{"total":96636764160,"available":96630923264,"internally_reserved":0,"allocated":393216,"data_stored":153636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5752,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366088,"statfs":{"total":96636764160,"available":96630874112,"internally_reserved":0,"allocated":376832,"data_stored":152018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5608,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366232,"statfs":{"total":96636764160,"available":96631021568,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T14:54:43.490 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T14:54:43.491 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T14:54:43.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 Processor -- start 2023-05-17T14:54:43.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 -- start start 2023-05-17T14:54:43.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155470 0x7f88840c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88840641f0 0x7f8884064680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8884063d60 con 0x7f8884155090 2023-05-17T14:54:43.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8884063470 con 0x7f88840641f0 2023-05-17T14:54:43.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.643+0000 7f888927d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8884063710 con 0x7f8884155470 2023-05-17T14:54:43.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88837fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88840641f0 0x7f8884064680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f8882ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8884155090 0x7f88840bbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35002/0 (socket says 172.21.15.27:35002) 2023-05-17T14:54:43.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f8882ffd700 1 -- 172.21.15.27:0/4018024180 learned_addr learned my addr 172.21.15.27:0/4018024180 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:43.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88827fc700 1 --2- 172.21.15.27:0/4018024180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155470 0x7f88840c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88837fe700 1 -- 172.21.15.27:0/4018024180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155470 msgr2=0x7f88840c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:43.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88837fe700 1 --2- 172.21.15.27:0/4018024180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155470 0x7f88840c18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88837fe700 1 -- 172.21.15.27:0/4018024180 >> v1:172.21.15.27:6789/0 conn(0x7f8884155090 legacy=0x7f88840bbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88837fe700 1 -- 172.21.15.27:0/4018024180 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840639f0 con 0x7f88840641f0 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f8881ffb700 1 -- 172.21.15.27:0/4018024180 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678036614 0 0) 0x7f8884063d60 con 0x7f8884155090 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f88837fe700 1 --2- 172.21.15.27:0/4018024180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f8884064680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f8874009760 tx=0x7f8874009060).ready entity=mon.0 client_cookie=570b2bd860abd5f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f8881ffb700 1 -- 172.21.15.27:0/4018024180 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740090d0 con 0x7f88840641f0 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f8881ffb700 1 -- 172.21.15.27:0/4018024180 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887400b580 con 0x7f88840641f0 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.644+0000 7f8881ffb700 1 -- 172.21.15.27:0/4018024180 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887400b900 con 0x7f88840641f0 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 -- 172.21.15.27:0/4018024180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 msgr2=0x7f8884064680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 --2- 172.21.15.27:0/4018024180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f8884064680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f8874009760 tx=0x7f8874009060).stop 2023-05-17T14:54:43.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 -- 172.21.15.27:0/4018024180 shutdown_connections 2023-05-17T14:54:43.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 --2- 172.21.15.27:0/4018024180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f8884064680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 --2- 172.21.15.27:0/4018024180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155470 0x7f88840c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 -- 172.21.15.27:0/4018024180 >> 172.21.15.27:0/4018024180 conn(0x7f88840c7a00 msgr2=0x7f88840c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:43.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 -- 172.21.15.27:0/4018024180 shutdown_connections 2023-05-17T14:54:43.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.645+0000 7f888927d700 1 -- 172.21.15.27:0/4018024180 wait complete. 2023-05-17T14:54:43.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.646+0000 7f888927d700 1 Processor -- start 2023-05-17T14:54:43.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.646+0000 7f888927d700 1 -- start start 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f888414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155090 0x7f88841496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8884155470 0x7f888414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8884166010 con 0x7f88840641f0 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888414b6c0 con 0x7f8884155470 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888414b9a0 con 0x7f8884155090 2023-05-17T14:54:43.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f888414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f888414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35446/0 (socket says 172.21.15.27:35446) 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 -- 172.21.15.27:0/105377715 learned_addr learned my addr 172.21.15.27:0/105377715 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f88827fc700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155090 0x7f88841496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f88837fe700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8884155470 0x7f888414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 -- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155090 msgr2=0x7f88841496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155090 0x7f88841496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 -- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8884155470 msgr2=0x7f888414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8884155470 0x7f888414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 -- 172.21.15.27:0/105377715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740092a0 con 0x7f88840641f0 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f8882ffd700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f888414c1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f887c00c960 tx=0x7f887c001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c005d30 con 0x7f88840641f0 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c005e90 con 0x7f88840641f0 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c007320 con 0x7f88840641f0 2023-05-17T14:54:43.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888414bc80 con 0x7f88840641f0 2023-05-17T14:54:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.647+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8884149bb0 con 0x7f88840641f0 2023-05-17T14:54:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.648+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888414b520 con 0x7f88840641f0 2023-05-17T14:54:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.649+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f887c010030 con 0x7f88840641f0 2023-05-17T14:54:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.649+0000 7f887affd700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f886405ed90 0x7f8864061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.649+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f887c079a40 con 0x7f88840641f0 2023-05-17T14:54:43.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.649+0000 7f88827fc700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f886405ed90 0x7f8864061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:43.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.649+0000 7f88827fc700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f886405ed90 0x7f8864061250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f888414adf0 tx=0x7f886c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:43.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.653+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f888414b520 con 0x7f88840641f0 2023-05-17T14:54:43.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.894+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f888414b520 con 0x7f88840641f0 2023-05-17T14:54:43.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.897+0000 7f887affd700 1 -- 172.21.15.27:0/105377715 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 184+0+0 (secure 0 0 0) 0x7f888414b520 con 0x7f88840641f0 2023-05-17T14:54:43.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f886405ed90 msgr2=0x7f8864061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f886405ed90 0x7f8864061250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f888414adf0 tx=0x7f886c008040).stop 2023-05-17T14:54:43.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 msgr2=0x7f888414c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:43.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f888414c1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f887c00c960 tx=0x7f887c001630).stop 2023-05-17T14:54:43.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 shutdown_connections 2023-05-17T14:54:43.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f886405ed90 0x7f8864061250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8884155470 0x7f888414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88840641f0 0x7f888414c1a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 --2- 172.21.15.27:0/105377715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8884155090 0x7f88841496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:43.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 >> 172.21.15.27:0/105377715 conn(0x7f88840c7a00 msgr2=0x7f88840695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:43.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 shutdown_connections 2023-05-17T14:54:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:43.899+0000 7f888927d700 1 -- 172.21.15.27:0/105377715 wait complete. 2023-05-17T14:54:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T14:54:43.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T14:54:44.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.028+0000 7f645578c700 1 Processor -- start 2023-05-17T14:54:44.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.028+0000 7f645578c700 1 -- start start 2023-05-17T14:54:44.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.028+0000 7f645578c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64500c1730 0x7f64501543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.028+0000 7f645578c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500bfcd0 con 0x7f64500c5f30 2023-05-17T14:54:44.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.028+0000 7f645578c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500c0290 con 0x7f64500c6310 2023-05-17T14:54:44.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.028+0000 7f645578c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64500aa1a0 con 0x7f64500c1730 2023-05-17T14:54:44.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64500c1730 0x7f64501543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644effd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f64500c5f30 0x7f6450158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35016/0 (socket says 172.21.15.27:35016) 2023-05-17T14:54:44.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644effd700 1 -- 172.21.15.27:0/118185841 learned_addr learned my addr 172.21.15.27:0/118185841 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644f7fe700 1 --2- 172.21.15.27:0/118185841 >> v2:172.21.15.27:3300/0 conn(0x7f64500c1730 0x7f64501543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35458/0 (socket says 172.21.15.27:35458) 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644f7fe700 1 -- 172.21.15.27:0/118185841 >> v1:172.21.15.40:6789/0 conn(0x7f64500c6310 legacy=0x7f6450153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644f7fe700 1 -- 172.21.15.27:0/118185841 >> v1:172.21.15.27:6789/0 conn(0x7f64500c5f30 legacy=0x7f6450158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644dffb700 1 -- 172.21.15.27:0/118185841 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573527099 0 0) 0x7f64500bfcd0 con 0x7f64500c5f30 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644f7fe700 1 -- 172.21.15.27:0/118185841 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500aa480 con 0x7f64500c1730 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644f7fe700 1 --2- 172.21.15.27:0/118185841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c1730 0x7f64501543e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f6440009e60 tx=0x7f6440009780).ready entity=mon.0 client_cookie=7e7bd789ef19b5e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644dffb700 1 -- 172.21.15.27:0/118185841 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000e070 con 0x7f64500c1730 2023-05-17T14:54:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644dffb700 1 -- 172.21.15.27:0/118185841 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000bbf0 con 0x7f64500c1730 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.029+0000 7f644dffb700 1 -- 172.21.15.27:0/118185841 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440012410 con 0x7f64500c1730 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 -- 172.21.15.27:0/118185841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c1730 msgr2=0x7f64501543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 --2- 172.21.15.27:0/118185841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c1730 0x7f64501543e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f6440009e60 tx=0x7f6440009780).stop 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 -- 172.21.15.27:0/118185841 shutdown_connections 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 --2- 172.21.15.27:0/118185841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c1730 0x7f64501543e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 -- 172.21.15.27:0/118185841 >> 172.21.15.27:0/118185841 conn(0x7f6450069e70 msgr2=0x7f645005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 -- 172.21.15.27:0/118185841 shutdown_connections 2023-05-17T14:54:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.030+0000 7f645578c700 1 -- 172.21.15.27:0/118185841 wait complete. 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.031+0000 7f645578c700 1 Processor -- start 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.031+0000 7f645578c700 1 -- start start 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64500c1730 0x7f64500c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64500c5f30 0x7f64501554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 0x7f64500c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64501654a0 con 0x7f64500c6310 2023-05-17T14:54:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450164b90 con 0x7f64500c1730 2023-05-17T14:54:44.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64500ca200 con 0x7f64500c5f30 2023-05-17T14:54:44.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 0x7f64500c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 0x7f64500c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35464/0 (socket says 172.21.15.27:35464) 2023-05-17T14:54:44.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 -- 172.21.15.27:0/3628537329 learned_addr learned my addr 172.21.15.27:0/3628537329 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644effd700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64500c1730 0x7f64500c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644e7fc700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64500c5f30 0x7f64501554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 -- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64500c5f30 msgr2=0x7f64501554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64500c5f30 0x7f64501554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 -- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64500c1730 msgr2=0x7f64500c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64500c1730 0x7f64500c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 -- 172.21.15.27:0/3628537329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440009a20 con 0x7f64500c6310 2023-05-17T14:54:44.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644effd700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64500c1730 0x7f64500c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644e7fc700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64500c5f30 0x7f64501554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f644f7fe700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 0x7f64500c4050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f644000b6c0 tx=0x7f6440009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400117d0 con 0x7f64500c6310 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440011930 con 0x7f64500c6310 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6450164e50 con 0x7f64500c6310 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440011cd0 con 0x7f64500c6310 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.032+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6450157e60 con 0x7f64500c6310 2023-05-17T14:54:44.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.033+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645005f4a0 con 0x7f64500c6310 2023-05-17T14:54:44.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.034+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f644001d630 con 0x7f64500c6310 2023-05-17T14:54:44.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.034+0000 7f6436ffd700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f643c05ed90 0x7f643c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.034+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f644007bd90 con 0x7f64500c6310 2023-05-17T14:54:44.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.034+0000 7f644effd700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f643c05ed90 0x7f643c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.035+0000 7f644effd700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f643c05ed90 0x7f643c061250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6448001750 tx=0x7f6448009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.038+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f644004d330 con 0x7f64500c6310 2023-05-17T14:54:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.255+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f645006bdf0 con 0x7f64500c6310 2023-05-17T14:54:44.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.255+0000 7f6436ffd700 1 -- 172.21.15.27:0/3628537329 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4480 (secure 0 0 0) 0x7f6440050950 con 0x7f64500c6310 2023-05-17T14:54:44.259 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T14:54:44.260 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:54:39.094710+0000","modified":"2023-05-17T14:54:42.101891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6836/149717180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":149717180},{"type":"v1","addr":"172.21.15.27:6836","nonce":149717180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-17T14:54:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f643c05ed90 msgr2=0x7f643c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f643c05ed90 0x7f643c061250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6448001750 tx=0x7f6448009040).stop 2023-05-17T14:54:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 msgr2=0x7f64500c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 0x7f64500c4050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f644000b6c0 tx=0x7f6440009780).stop 2023-05-17T14:54:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 shutdown_connections 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f643c05ed90 0x7f643c061250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64500c6310 0x7f64500c4050 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64500c1730 0x7f64500c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 --2- 172.21.15.27:0/3628537329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64500c5f30 0x7f64501554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 >> 172.21.15.27:0/3628537329 conn(0x7f6450069e70 msgr2=0x7f64500ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 shutdown_connections 2023-05-17T14:54:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.257+0000 7f645578c700 1 -- 172.21.15.27:0/3628537329 wait complete. 2023-05-17T14:54:44.263 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2023-05-17T14:54:44.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T14:54:39.094710+0000', 'modified': '2023-05-17T14:54:42.101891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6836/149717180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6834', 'nonce': 149717180}, {'type': 'v1', 'addr': '172.21.15.27:6836', 'nonce': 149717180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T14:54:44.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T14:54:44.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-17T14:54:44.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.792+0000 7ff295258700 1 Processor -- start 2023-05-17T14:54:44.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.792+0000 7ff295258700 1 -- start start 2023-05-17T14:54:44.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff295258700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 0x7ff290154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff295258700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2900cb450 0x7ff2900cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff295258700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2900c5a50 con 0x7ff290068f00 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff295258700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff290069fa0 con 0x7ff2900cb450 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff295258700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900c04e0 con 0x7ff290154090 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff28ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 0x7ff290154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff28ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 0x7ff290154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36578/0 (socket says 172.21.15.27:36578) 2023-05-17T14:54:44.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff28e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2900cb450 0x7ff2900cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff28f59e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff290068f00 0x7ff290157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:41032/0 (socket says 172.21.15.27:41032) 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.793+0000 7ff28ed9d700 1 -- 172.21.15.27:0/4168655822 learned_addr learned my addr 172.21.15.27:0/4168655822 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28ed9d700 1 -- 172.21.15.27:0/4168655822 >> v2:172.21.15.40:3300/0 conn(0x7ff2900cb450 msgr2=0x7ff2900cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/4168655822 >> v2:172.21.15.40:3300/0 conn(0x7ff2900cb450 0x7ff2900cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28ed9d700 1 -- 172.21.15.27:0/4168655822 >> v1:172.21.15.40:6789/0 conn(0x7ff290068f00 legacy=0x7ff290157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28ed9d700 1 -- 172.21.15.27:0/4168655822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900c0760 con 0x7ff290154090 2023-05-17T14:54:44.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28e59c700 1 --2- 172.21.15.27:0/4168655822 >> v2:172.21.15.40:3300/0 conn(0x7ff2900cb450 0x7ff2900cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:44.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/4168655822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 0x7ff290154470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff288009830 tx=0x7ff2880090f0).ready entity=mon.2 client_cookie=e0b2104391cef6a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28dd9b700 1 -- 172.21.15.27:0/4168655822 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800b580 con 0x7ff290154090 2023-05-17T14:54:44.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28dd9b700 1 -- 172.21.15.27:0/4168655822 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800b6e0 con 0x7ff290154090 2023-05-17T14:54:44.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.794+0000 7ff28dd9b700 1 -- 172.21.15.27:0/4168655822 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800ba60 con 0x7ff290154090 2023-05-17T14:54:44.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 -- 172.21.15.27:0/4168655822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 msgr2=0x7ff290154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 --2- 172.21.15.27:0/4168655822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 0x7ff290154470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff288009830 tx=0x7ff2880090f0).stop 2023-05-17T14:54:44.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 -- 172.21.15.27:0/4168655822 shutdown_connections 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 --2- 172.21.15.27:0/4168655822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290154090 0x7ff290154470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 --2- 172.21.15.27:0/4168655822 >> v2:172.21.15.40:3300/0 conn(0x7ff2900cb450 0x7ff2900cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 -- 172.21.15.27:0/4168655822 >> 172.21.15.27:0/4168655822 conn(0x7ff29005e7e0 msgr2=0x7ff2900cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 -- 172.21.15.27:0/4168655822 shutdown_connections 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.795+0000 7ff295258700 1 -- 172.21.15.27:0/4168655822 wait complete. 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.796+0000 7ff295258700 1 Processor -- start 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.796+0000 7ff295258700 1 -- start start 2023-05-17T14:54:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290068f00 0x7ff290157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 0x7ff290158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff290154090 0x7ff29014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29014fa10 con 0x7ff2900cb450 2023-05-17T14:54:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29014fcf0 con 0x7ff290154090 2023-05-17T14:54:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290153210 con 0x7ff290068f00 2023-05-17T14:54:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 0x7ff290158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 0x7ff290158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35474/0 (socket says 172.21.15.27:35474) 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 -- 172.21.15.27:0/3034020589 learned_addr learned my addr 172.21.15.27:0/3034020589 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28f59e700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff290154090 0x7ff29014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290068f00 0x7ff290157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 -- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290068f00 msgr2=0x7ff290157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290068f00 0x7ff290157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 -- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff290154090 msgr2=0x7ff29014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff290154090 0x7ff29014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 -- 172.21.15.27:0/3034020589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780092a0 con 0x7ff2900cb450 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 0x7ff290158520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff27800ea50 tx=0x7ff278009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff286ffd700 1 -- 172.21.15.27:0/3034020589 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800c850 con 0x7ff2900cb450 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff286ffd700 1 -- 172.21.15.27:0/3034020589 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800c9b0 con 0x7ff2900cb450 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff288009370 con 0x7ff2900cb450 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.797+0000 7ff286ffd700 1 -- 172.21.15.27:0/3034020589 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800cd30 con 0x7ff2900cb450 2023-05-17T14:54:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.798+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2901537d0 con 0x7ff2900cb450 2023-05-17T14:54:44.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.799+0000 7ff286ffd700 1 -- 172.21.15.27:0/3034020589 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff278022070 con 0x7ff2900cb450 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.799+0000 7ff286ffd700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff27005ed60 0x7ff270061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.799+0000 7ff286ffd700 1 -- 172.21.15.27:0/3034020589 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff27807a160 con 0x7ff2900cb450 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.799+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff27005ed60 0x7ff270061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.800+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff27005ed60 0x7ff270061220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff288009130 tx=0x7ff288017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.801+0000 7ff2a6beab80 1 Processor -- start 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.801+0000 7ff2a6beab80 1 -- start start 2023-05-17T14:54:44.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f559c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f576940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f4f75e0 con 0x556f8f576560 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f46e8a0 con 0x556f8f57b480 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f8f483900 con 0x556f8f532300 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f559c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f559c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35482/0 (socket says 172.21.15.27:35482) 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28ed9d700 1 -- 172.21.15.27:0/51797905 learned_addr learned my addr 172.21.15.27:0/51797905 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28e59c700 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f576940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28f59e700 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28ed9d700 1 -- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 msgr2=0x556f8f52c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.802+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff28ed9d700 1 -- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 msgr2=0x556f8f576940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f576940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff28ed9d700 1 -- 172.21.15.27:0/51797905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f8f4f7450 con 0x556f8f576560 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff28e59c700 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f576940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f559c50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7ff288000d50 tx=0x7ff288020070).ready entity=mon.0 client_cookie=bbe3def9eafb302f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff26ffff700 1 -- 172.21.15.27:0/51797905 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880069b0 con 0x556f8f576560 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff26ffff700 1 -- 172.21.15.27:0/51797905 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800b9d0 con 0x556f8f576560 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.803+0000 7ff26ffff700 1 -- 172.21.15.27:0/51797905 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28801eb00 con 0x556f8f576560 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 -- 172.21.15.27:0/51797905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 msgr2=0x556f8f559c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f559c50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7ff288000d50 tx=0x7ff288020070).stop 2023-05-17T14:54:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 -- 172.21.15.27:0/51797905 shutdown_connections 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f559c50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/51797905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f576940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 -- 172.21.15.27:0/51797905 >> 172.21.15.27:0/51797905 conn(0x556f8f2eee40 msgr2=0x556f8f57a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 -- 172.21.15.27:0/51797905 shutdown_connections 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 -- 172.21.15.27:0/51797905 wait complete. 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 -- start start 2023-05-17T14:54:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.804+0000 7ff2a6beab80 1 Processor -- start 2023-05-17T14:54:44.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f587620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f44aed0 con 0x556f8f576560 2023-05-17T14:54:44.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f5882a0 con 0x556f8f57b480 2023-05-17T14:54:44.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f8f52c300 con 0x556f8f532300 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff2a6beab80 10 client.0 ll_register_callbacks cb 0x556f8f4f11f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35486/0 (socket says 172.21.15.27:35486) 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff28e59c700 1 -- 172.21.15.27:0/3022186963 learned_addr learned my addr 172.21.15.27:0/3022186963 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.805+0000 7ff28f59e700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f587620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28e59c700 1 -- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 msgr2=0x556f8f52d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28e59c700 1 -- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 msgr2=0x556f8f587620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f587620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28e59c700 1 -- 172.21.15.27:0/3022186963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2900c0760 con 0x556f8f576560 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28f59e700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f587620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55ae80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7ff278078490 tx=0x7ff278011000).ready entity=mon.0 client_cookie=cbd2e7dd57a0c017 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff26d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T14:54:44.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3022186963 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27804e8b0 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3022186963 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff27804ea10 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f8f525460 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3022186963 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff27804b3c0 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 10 client.5100 fetch_fsmap learned FSMap version 15 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556f8f326310 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3022186963 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f8f525460 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3022186963 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff27804e320 con 0x556f8f576560 2023-05-17T14:54:44.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 10 client.5100 fetch_fsmap finished waiting for FSMap version 15 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 10 client.5100 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 20 client.5100 populate_metadata read hostname 'smithi027' 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f5869d0 0x556f8f589ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 4 client.5100 mds_command: new command op to 4920 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 --> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f8f2eaca0 con 0x556f8f5869d0 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.806+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f5869d0 0x556f8f589ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff26d7fa700 10 client.5100 ms_handle_connect on v2:172.21.15.27:6834/149717180 2023-05-17T14:54:44.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f5869d0 0x556f8f589ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9385320a4d1e3966 server_cookie=322a30cc172b35b9 in_seq=0 out_seq=0 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3022186963 <== mds.0 v2:172.21.15.27:6834/149717180 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x556f8f2eaca0 con 0x556f8f5869d0 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff26d7fa700 10 client.5100 handle_command_reply: tid=0 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff2a6beab80 1 client.5100 shutdown 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 msgr2=0x556f8f55ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.807+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55ae80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7ff278078490 tx=0x7ff278011000).stop 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 shutdown_connections 2023-05-17T14:54:44.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f5869d0 0x556f8f589ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f587620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff26d7fa700 0 client.5100 ms_handle_reset on v2:172.21.15.27:6834/149717180 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f52d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3022186963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55ae80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 >> 172.21.15.27:0/3022186963 conn(0x556f8f2eee40 msgr2=0x556f8f5772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 shutdown_connections 2023-05-17T14:54:44.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3022186963 wait complete. 2023-05-17T14:54:44.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.808+0000 7ff2a6beab80 20 client.5100 trim_cache size 0 max 16384 2023-05-17T14:54:44.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.824+0000 7ff2a6beab80 1 Processor -- start 2023-05-17T14:54:44.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.824+0000 7ff2a6beab80 1 -- start start 2023-05-17T14:54:44.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f585f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f554410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f55ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f55bef0 con 0x556f8f576560 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f586db0 con 0x556f8f57b480 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f8f52b380 con 0x556f8f532300 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f554410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f554410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35494/0 (socket says 172.21.15.27:35494) 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 -- 172.21.15.27:0/3435083538 learned_addr learned my addr 172.21.15.27:0/3435083538 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28f59e700 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f55ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f585f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 -- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 msgr2=0x556f8f585f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f585f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 -- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 msgr2=0x556f8f55ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f55ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.825+0000 7ff28e59c700 1 -- 172.21.15.27:0/3435083538 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f8f47c880 con 0x556f8f576560 2023-05-17T14:54:44.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f554410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7ff27804f2f0 tx=0x7ff278058000).ready entity=mon.0 client_cookie=7463f440cae39d6c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff284bd1700 1 -- 172.21.15.27:0/3435083538 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800e030 con 0x556f8f576560 2023-05-17T14:54:44.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff284bd1700 1 -- 172.21.15.27:0/3435083538 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27804e320 con 0x556f8f576560 2023-05-17T14:54:44.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff284bd1700 1 -- 172.21.15.27:0/3435083538 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27804e490 con 0x556f8f576560 2023-05-17T14:54:44.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3435083538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 msgr2=0x556f8f554410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f554410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7ff27804f2f0 tx=0x7ff278058000).stop 2023-05-17T14:54:44.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3435083538 shutdown_connections 2023-05-17T14:54:44.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f57b480 0x556f8f55ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f532300 0x556f8f585f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3435083538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f554410 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3435083538 >> 172.21.15.27:0/3435083538 conn(0x556f8f2eee40 msgr2=0x556f8f528b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3435083538 shutdown_connections 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.826+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3435083538 wait complete. 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.827+0000 7ff2a6beab80 1 -- start start 2023-05-17T14:54:44.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.827+0000 7ff2a6beab80 1 Processor -- start 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f532300 0x556f8f577710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f57b480 0x556f8f55fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f5df810 con 0x556f8f576560 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8f55cda0 con 0x556f8f532300 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f8f575320 con 0x556f8f57b480 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 10 client.0 ll_register_callbacks cb 0x556f8f4f11f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T14:54:44.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35500/0 (socket says 172.21.15.27:35500) 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 -- 172.21.15.27:0/3205350923 learned_addr learned my addr 172.21.15.27:0/3205350923 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f532300 0x556f8f577710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28f59e700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f57b480 0x556f8f55fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 -- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f57b480 msgr2=0x556f8f55fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f57b480 0x556f8f55fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 -- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f532300 msgr2=0x556f8f577710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f532300 0x556f8f577710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 -- 172.21.15.27:0/3205350923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f8f326310 con 0x556f8f576560 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f532300 0x556f8f577710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28f59e700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f57b480 0x556f8f55fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff28e59c700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55f990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff27804f2f0 tx=0x7ff278065000).ready entity=mon.0 client_cookie=3b27a67e63a99c0b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff26d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T14:54:44.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3205350923 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800e030 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3205350923 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff2780193e0 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f8f588130 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3205350923 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2780195a0 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.828+0000 7ff2a6beab80 10 client.5106 fetch_fsmap learned FSMap version 15 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556f8f478070 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3205350923 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f8f588130 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3205350923 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff27806c070 con 0x556f8f576560 2023-05-17T14:54:44.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 10 client.5106 fetch_fsmap finished waiting for FSMap version 15 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 10 client.5106 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 20 client.5106 populate_metadata read hostname 'smithi027' 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f560370 0x556f8f5dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 4 client.5106 mds_command: new command op to 4920 tid=0[{"prefix": "status"}] 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 --> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff28800b9d0 con 0x556f8f560370 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f560370 0x556f8f5dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff26d7fa700 10 client.5106 ms_handle_connect on v2:172.21.15.27:6834/149717180 2023-05-17T14:54:44.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff28ed9d700 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f560370 0x556f8f5dfa80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=41026b09877a1687 server_cookie=c6ffba68625276ac in_seq=0 out_seq=0 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff26d7fa700 1 -- 172.21.15.27:0/3205350923 <== mds.0 v2:172.21.15.27:6834/149717180 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7ff28800b9d0 con 0x556f8f560370 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff26d7fa700 10 client.5106 handle_command_reply: tid=0 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 1 client.5106 shutdown 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 msgr2=0x556f8f55f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.829+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55f990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff27804f2f0 tx=0x7ff278065000).stop 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 shutdown_connections 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:6834/149717180,v1:172.21.15.27:6836/149717180] conn(0x556f8f560370 0x556f8f5dfa80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x556f8f57b480 0x556f8f55fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f8f532300 0x556f8f577710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 --2- 172.21.15.27:0/3205350923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8f576560 0x556f8f55f990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff26d7fa700 0 client.5106 ms_handle_reset on v2:172.21.15.27:6834/149717180 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 >> 172.21.15.27:0/3205350923 conn(0x556f8f2eee40 msgr2=0x556f8f590420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 shutdown_connections 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 1 -- 172.21.15.27:0/3205350923 wait complete. 2023-05-17T14:54:44.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff2a6beab80 20 client.5106 trim_cache size 0 max 16384 2023-05-17T14:54:44.845 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T14:54:44.845 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T14:54:44.845 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T14:54:44.845 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4920, 2023-05-17T14:54:44.845 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 5.7341680339999996, 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 15, 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 34, 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 34, 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 12.995282572000001 2023-05-17T14:54:44.846 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff27005ed60 msgr2=0x7ff270061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff27005ed60 0x7ff270061220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff288009130 tx=0x7ff288017000).stop 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 msgr2=0x7ff290158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 0x7ff290158520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff27800ea50 tx=0x7ff278009060).stop 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 shutdown_connections 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff27005ed60 0x7ff270061220 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff290154090 0x7ff29014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290068f00 0x7ff290157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 --2- 172.21.15.27:0/3034020589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2900cb450 0x7ff290158520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 >> 172.21.15.27:0/3034020589 conn(0x7ff29005e7e0 msgr2=0x7ff2900aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 shutdown_connections 2023-05-17T14:54:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.830+0000 7ff295258700 1 -- 172.21.15.27:0/3034020589 wait complete. 2023-05-17T14:54:44.849 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T14:54:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.949+0000 7f54b88de700 1 Processor -- start 2023-05-17T14:54:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.949+0000 7f54b88de700 1 -- start start 2023-05-17T14:54:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.949+0000 7f54b88de700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54b40697a0 0x7f54b4068c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b88de700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b40c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b88de700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40c7440 con 0x7f54b40c5950 2023-05-17T14:54:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b88de700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b41543d0 con 0x7f54b40697a0 2023-05-17T14:54:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b88de700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4154690 con 0x7f54b4069b80 2023-05-17T14:54:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b40c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b40c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:36616/0 (socket says 172.21.15.27:36616) 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 -- 172.21.15.27:0/801278715 learned_addr learned my addr 172.21.15.27:0/801278715 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b259c700 1 --2- 172.21.15.27:0/801278715 >> v2:172.21.15.40:3300/0 conn(0x7f54b40697a0 0x7f54b4068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b159a700 1 -- 172.21.15.27:0/801278715 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952801104 0 0) 0x7f54b40c7440 con 0x7f54b40c5950 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 -- 172.21.15.27:0/801278715 >> v2:172.21.15.40:3300/0 conn(0x7f54b40697a0 msgr2=0x7f54b4068c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 --2- 172.21.15.27:0/801278715 >> v2:172.21.15.40:3300/0 conn(0x7f54b40697a0 0x7f54b4068c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 -- 172.21.15.27:0/801278715 >> v1:172.21.15.40:6789/0 conn(0x7f54b40c5950 legacy=0x7f54b40bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.950+0000 7f54b1d9b700 1 -- 172.21.15.27:0/801278715 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4154970 con 0x7f54b4069b80 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b1d9b700 1 --2- 172.21.15.27:0/801278715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b40c5460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f549c006fd0 tx=0x7f549c0090f0).ready entity=mon.2 client_cookie=19e385ece94d59b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b159a700 1 -- 172.21.15.27:0/801278715 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00b580 con 0x7f54b4069b80 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b159a700 1 -- 172.21.15.27:0/801278715 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00b6e0 con 0x7f54b4069b80 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b159a700 1 -- 172.21.15.27:0/801278715 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00ba80 con 0x7f54b4069b80 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 -- 172.21.15.27:0/801278715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 msgr2=0x7f54b40c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 --2- 172.21.15.27:0/801278715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b40c5460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f549c006fd0 tx=0x7f549c0090f0).stop 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 -- 172.21.15.27:0/801278715 shutdown_connections 2023-05-17T14:54:44.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 --2- 172.21.15.27:0/801278715 >> v2:172.21.15.40:3300/0 conn(0x7f54b40697a0 0x7f54b4068c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 --2- 172.21.15.27:0/801278715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b40c5460 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 -- 172.21.15.27:0/801278715 >> 172.21.15.27:0/801278715 conn(0x7f54b40c7900 msgr2=0x7f54b40c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:44.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 -- 172.21.15.27:0/801278715 shutdown_connections 2023-05-17T14:54:44.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.951+0000 7f54b88de700 1 -- 172.21.15.27:0/801278715 wait complete. 2023-05-17T14:54:44.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.952+0000 7f54b88de700 1 Processor -- start 2023-05-17T14:54:44.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.952+0000 7f54b88de700 1 -- start start 2023-05-17T14:54:44.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b88de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 0x7f54b40a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b88de700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b88de700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b40c5950 0x7f54b40aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b88de700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40ac540 con 0x7f54b40697a0 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b88de700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40ac210 con 0x7f54b40c5950 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b88de700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40ab680 con 0x7f54b4069b80 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 0x7f54b40a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 0x7f54b40a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35512/0 (socket says 172.21.15.27:35512) 2023-05-17T14:54:44.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b259c700 1 -- 172.21.15.27:0/2889963051 learned_addr learned my addr 172.21.15.27:0/2889963051 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b1d9b700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.953+0000 7f54b2d9d700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b40c5950 0x7f54b40aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b259c700 1 -- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 msgr2=0x7f54b414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b259c700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b259c700 1 -- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b40c5950 msgr2=0x7f54b40aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b259c700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b40c5950 0x7f54b40aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:44.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b259c700 1 -- 172.21.15.27:0/2889963051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c009370 con 0x7f54b40697a0 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b1d9b700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b2d9d700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b40c5950 0x7f54b40aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b259c700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 0x7f54b40a8440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f54ac00e950 tx=0x7f54ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00c850 con 0x7f54b40697a0 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00c9b0 con 0x7f54b40697a0 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40ab960 con 0x7f54b40697a0 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00cd30 con 0x7f54b40697a0 2023-05-17T14:54:44.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.954+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b414a890 con 0x7f54b40697a0 2023-05-17T14:54:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.955+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b414aae0 con 0x7f54b40697a0 2023-05-17T14:54:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.955+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f54ac022070 con 0x7f54b40697a0 2023-05-17T14:54:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.956+0000 7f54aa7fc700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549405ed90 0x7f5494061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.956+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f54ac07a040 con 0x7f54b40697a0 2023-05-17T14:54:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.956+0000 7f54b1d9b700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549405ed90 0x7f5494061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.956+0000 7f54b1d9b700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549405ed90 0x7f5494061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f549c009fd0 tx=0x7f549c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:44.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:44.960+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54ac04b5e0 con 0x7f54b40697a0 2023-05-17T14:54:45.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.175+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f54b405e6a0 con 0x7f54b40697a0 2023-05-17T14:54:45.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.175+0000 7f54aa7fc700 1 -- 172.21.15.27:0/2889963051 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f54ac016070 con 0x7f54b40697a0 2023-05-17T14:54:45.179 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T14:54:45.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549405ed90 msgr2=0x7f5494061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:45.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549405ed90 0x7f5494061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f549c009fd0 tx=0x7f549c017000).stop 2023-05-17T14:54:45.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 msgr2=0x7f54b40a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:45.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 0x7f54b40a8440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f54ac00e950 tx=0x7f54ac009060).stop 2023-05-17T14:54:45.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 shutdown_connections 2023-05-17T14:54:45.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f549405ed90 0x7f5494061250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b40c5950 0x7f54b40aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54b40697a0 0x7f54b40a8440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 --2- 172.21.15.27:0/2889963051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b4069b80 0x7f54b414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 >> 172.21.15.27:0/2889963051 conn(0x7f54b40c7900 msgr2=0x7f54b4155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:45.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 shutdown_connections 2023-05-17T14:54:45.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.177+0000 7f54b88de700 1 -- 172.21.15.27:0/2889963051 wait complete. 2023-05-17T14:54:45.191 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T14:54:45.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T14:54:45.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T14:54:45.192 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T14:54:45.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T14:54:45.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T14:54:45.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T14:54:45.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T14:54:45.194 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T14:54:45.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.194 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T14:54:45.209 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T14:54:45.209 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T14:54:45.209 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T14:54:45.209 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:45.210 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42227sec preferred_lft 42227sec 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:45.211 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T14:54:45.212 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T14:54:45.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.214 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T14:54:45.272 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T14:54:45.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.274 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T14:54:45.329 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T14:54:45.330 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T14:54:45.330 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T14:54:45.330 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T14:54:45.330 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T14:54:45.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.331 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T14:54:45.331 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T14:54:45.331 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T14:54:45.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T14:54:45.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T14:54:45.332 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T14:54:45.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.430 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T14:54:45.444 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T14:54:45.444 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T14:54:45.444 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T14:54:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T14:54:45.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.508 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T14:54:45.562 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T14:54:45.562 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:45.640 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:45.641 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T14:54:45.682 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T14:54:45.683 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T14:54:45.684 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T14:54:45.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T14:54:45.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T14:54:45.750 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T14:54:45.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.902+0000 7fab7359e700 1 Processor -- start 2023-05-17T14:54:45.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.902+0000 7fab7359e700 1 -- start start 2023-05-17T14:54:45.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab740cac00 0x7fab740cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:45.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab74153ef0 0x7fab740c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:45.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab740c60d0 con 0x7fab74157980 2023-05-17T14:54:45.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab741588b0 con 0x7fab74153ef0 2023-05-17T14:54:45.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab74157e00 con 0x7fab740cac00 2023-05-17T14:54:45.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab74153ef0 0x7fab740c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:45.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab74153ef0 0x7fab740c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35530/0 (socket says 172.21.15.27:35530) 2023-05-17T14:54:45.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 -- 172.21.15.27:0/508701694 learned_addr learned my addr 172.21.15.27:0/508701694 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:45.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7259c700 1 --2- 172.21.15.27:0/508701694 >> v2:172.21.15.40:3300/0 conn(0x7fab740cac00 0x7fab740cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 -- 172.21.15.27:0/508701694 >> v2:172.21.15.40:3300/0 conn(0x7fab740cac00 msgr2=0x7fab740cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 --2- 172.21.15.27:0/508701694 >> v2:172.21.15.40:3300/0 conn(0x7fab740cac00 0x7fab740cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 -- 172.21.15.27:0/508701694 >> v1:172.21.15.40:6789/0 conn(0x7fab74157980 legacy=0x7fab741537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 -- 172.21.15.27:0/508701694 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74158010 con 0x7fab74153ef0 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab72d9d700 1 --2- 172.21.15.27:0/508701694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740c5be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fab74069f80 tx=0x7fab640090f0).ready entity=mon.0 client_cookie=5fbf0e48718aa344 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7159a700 1 -- 172.21.15.27:0/508701694 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400b5a0 con 0x7fab74153ef0 2023-05-17T14:54:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7159a700 1 -- 172.21.15.27:0/508701694 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400b700 con 0x7fab74153ef0 2023-05-17T14:54:45.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.903+0000 7fab7159a700 1 -- 172.21.15.27:0/508701694 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400ba80 con 0x7fab74153ef0 2023-05-17T14:54:45.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 -- 172.21.15.27:0/508701694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 msgr2=0x7fab740c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:45.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 --2- 172.21.15.27:0/508701694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740c5be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fab74069f80 tx=0x7fab640090f0).stop 2023-05-17T14:54:45.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 -- 172.21.15.27:0/508701694 shutdown_connections 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 --2- 172.21.15.27:0/508701694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740c5be0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 --2- 172.21.15.27:0/508701694 >> v2:172.21.15.40:3300/0 conn(0x7fab740cac00 0x7fab740cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 -- 172.21.15.27:0/508701694 >> 172.21.15.27:0/508701694 conn(0x7fab7405dd50 msgr2=0x7fab7405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 -- 172.21.15.27:0/508701694 shutdown_connections 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.904+0000 7fab7359e700 1 -- 172.21.15.27:0/508701694 wait complete. 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.905+0000 7fab7359e700 1 Processor -- start 2023-05-17T14:54:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.905+0000 7fab7359e700 1 -- start start 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab740cac00 0x7fab74167760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab74157980 0x7fab74156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740af860 con 0x7fab74153ef0 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740affe0 con 0x7fab74157980 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab74157230 con 0x7fab740cac00 2023-05-17T14:54:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35532/0 (socket says 172.21.15.27:35532) 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 -- 172.21.15.27:0/1755685334 learned_addr learned my addr 172.21.15.27:0/1755685334 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab72d9d700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab74157980 0x7fab74156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7259c700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab740cac00 0x7fab74167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 -- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab740cac00 msgr2=0x7fab74167760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab740cac00 0x7fab74167760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 -- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab74157980 msgr2=0x7fab74156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab74157980 0x7fab74156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 -- 172.21.15.27:0/1755685334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64009370 con 0x7fab74153ef0 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab72d9d700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab74157980 0x7fab74156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab7259c700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab740cac00 0x7fab74167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.906+0000 7fab71d9b700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740afaf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fab5c00b460 tx=0x7fab5c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.907+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c012410 con 0x7fab74153ef0 2023-05-17T14:54:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.907+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c012590 con 0x7fab74153ef0 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.907+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab74167d20 con 0x7fab74153ef0 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.907+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c012950 con 0x7fab74153ef0 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.907+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab741682e0 con 0x7fab74153ef0 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.907+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab74047150 con 0x7fab74153ef0 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.908+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fab5c00f030 con 0x7fab74153ef0 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.908+0000 7fab6a7fc700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fab5405ed90 0x7fab54061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.908+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fab5c079830 con 0x7fab74153ef0 2023-05-17T14:54:45.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.908+0000 7fab7259c700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fab5405ed90 0x7fab54061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:45.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.909+0000 7fab7259c700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fab5405ed90 0x7fab54061250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fab6c007540 tx=0x7fab6c00b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:45.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:45.912+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab5c04add0 con 0x7fab74153ef0 2023-05-17T14:54:46.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.113+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fab740c63b0 con 0x7fab5405ed90 2023-05-17T14:54:46.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.115+0000 7fab6a7fc700 1 -- 172.21.15.27:0/1755685334 <== mgr.4104 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fab740c63b0 con 0x7fab5405ed90 2023-05-17T14:54:46.118 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T14:54:46.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T14:54:46.119 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T14:54:46.119 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T14:54:46.119 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T14:54:46.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fab5405ed90 msgr2=0x7fab54061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:46.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fab5405ed90 0x7fab54061250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fab6c007540 tx=0x7fab6c00b040).stop 2023-05-17T14:54:46.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 msgr2=0x7fab740afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:46.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740afaf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fab5c00b460 tx=0x7fab5c006f20).stop 2023-05-17T14:54:46.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 shutdown_connections 2023-05-17T14:54:46.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fab5405ed90 0x7fab54061250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab74157980 0x7fab74156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab740cac00 0x7fab74167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 --2- 172.21.15.27:0/1755685334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab74153ef0 0x7fab740afaf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 >> 172.21.15.27:0/1755685334 conn(0x7fab7405dd50 msgr2=0x7fab740ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:46.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 shutdown_connections 2023-05-17T14:54:46.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.117+0000 7fab7359e700 1 -- 172.21.15.27:0/1755685334 wait complete. 2023-05-17T14:54:46.133 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T14:54:46.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.247+0000 7f0abf28d700 1 Processor -- start 2023-05-17T14:54:46.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.247+0000 7f0abf28d700 1 -- start start 2023-05-17T14:54:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abf28d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ab80c4290 0x7f0ab80c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abf28d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0ab80bda70 0x7f0ab8154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abf28d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80bcd40 con 0x7f0ab8155290 2023-05-17T14:54:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abf28d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab80bd5e0 con 0x7f0ab80bda70 2023-05-17T14:54:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abf28d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab8158b00 con 0x7f0ab80c4290 2023-05-17T14:54:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abda8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0ab80bda70 0x7f0ab8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abea8c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0ab8155290 0x7f0ab8157dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35106/0 (socket says 172.21.15.27:35106) 2023-05-17T14:54:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abea8c700 1 -- 172.21.15.27:0/298227442 learned_addr learned my addr 172.21.15.27:0/298227442 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:46.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abda8a700 1 -- 172.21.15.27:0/298227442 >> v2:172.21.15.40:3300/0 conn(0x7f0ab80c4290 msgr2=0x7f0ab80c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abda8a700 1 --2- 172.21.15.27:0/298227442 >> v2:172.21.15.40:3300/0 conn(0x7f0ab80c4290 0x7f0ab80c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abda8a700 1 -- 172.21.15.27:0/298227442 >> v1:172.21.15.27:6789/0 conn(0x7f0ab8155290 legacy=0x7f0ab8157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abda8a700 1 -- 172.21.15.27:0/298227442 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80bcf90 con 0x7f0ab80bda70 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abd289700 1 -- 172.21.15.27:0/298227442 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460743330 0 0) 0x7f0ab80bcd40 con 0x7f0ab8155290 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abda8a700 1 --2- 172.21.15.27:0/298227442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80bda70 0x7f0ab8154da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f0ab8062d90 tx=0x7f0aa8009060).ready entity=mon.0 client_cookie=8ece88f7f7ccddb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abd289700 1 -- 172.21.15.27:0/298227442 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80090d0 con 0x7f0ab80bda70 2023-05-17T14:54:46.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abd289700 1 -- 172.21.15.27:0/298227442 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa800b580 con 0x7f0ab80bda70 2023-05-17T14:54:46.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.248+0000 7f0abd289700 1 -- 172.21.15.27:0/298227442 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800b900 con 0x7f0ab80bda70 2023-05-17T14:54:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 -- 172.21.15.27:0/298227442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80bda70 msgr2=0x7f0ab8154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 --2- 172.21.15.27:0/298227442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80bda70 0x7f0ab8154da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f0ab8062d90 tx=0x7f0aa8009060).stop 2023-05-17T14:54:46.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 -- 172.21.15.27:0/298227442 shutdown_connections 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 --2- 172.21.15.27:0/298227442 >> v2:172.21.15.40:3300/0 conn(0x7f0ab80c4290 0x7f0ab80c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 --2- 172.21.15.27:0/298227442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80bda70 0x7f0ab8154da0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 -- 172.21.15.27:0/298227442 >> 172.21.15.27:0/298227442 conn(0x7f0ab8067cb0 msgr2=0x7f0ab80680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 -- 172.21.15.27:0/298227442 shutdown_connections 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.249+0000 7f0abf28d700 1 -- 172.21.15.27:0/298227442 wait complete. 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.250+0000 7f0abf28d700 1 Processor -- start 2023-05-17T14:54:46.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.250+0000 7f0abf28d700 1 -- start start 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ab80bda70 0x7f0ab80a8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 0x7f0ab8165430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab8155290 0x7f0ab80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80a9170 con 0x7f0ab80c4290 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8165920 con 0x7f0ab8155290 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80a7220 con 0x7f0ab80bda70 2023-05-17T14:54:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 0x7f0ab8165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 0x7f0ab8165430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35548/0 (socket says 172.21.15.27:35548) 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 -- 172.21.15.27:0/1811955149 learned_addr learned my addr 172.21.15.27:0/1811955149 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abea8c700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab8155290 0x7f0ab80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abe28b700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ab80bda70 0x7f0ab80a8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 -- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ab80bda70 msgr2=0x7f0ab80a8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ab80bda70 0x7f0ab80a8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 -- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab8155290 msgr2=0x7f0ab80a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab8155290 0x7f0ab80a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 -- 172.21.15.27:0/1811955149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80092a0 con 0x7f0ab80c4290 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abe28b700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ab80bda70 0x7f0ab80a8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abda8a700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 0x7f0ab8165430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f0ab805ee30 tx=0x7f0aa8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800b900 con 0x7f0ab80c4290 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa800bcc0 con 0x7f0ab80c4290 2023-05-17T14:54:46.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa801b410 con 0x7f0ab80c4290 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.251+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab80a7500 con 0x7f0ab80c4290 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.252+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab80a7ac0 con 0x7f0ab80c4290 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.252+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab8047150 con 0x7f0ab80c4290 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.253+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0aa800f070 con 0x7f0ab80c4290 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.253+0000 7f0aae7fc700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a9c05ed90 0x7f0a9c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.253+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0aa807b5c0 con 0x7f0ab80c4290 2023-05-17T14:54:46.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.253+0000 7f0abe28b700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a9c05ed90 0x7f0a9c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:46.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.254+0000 7f0abe28b700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a9c05ed90 0x7f0a9c061250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0ab400a900 tx=0x7f0ab4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:46.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.257+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0aa804cb60 con 0x7f0ab80c4290 2023-05-17T14:54:46.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:46.480+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0ab8068910 con 0x7f0ab80c4290 2023-05-17T14:54:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.130+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f0aa80794c0 con 0x7f0ab80c4290 2023-05-17T14:54:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.131+0000 7f0aae7fc700 1 -- 172.21.15.27:0/1811955149 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0aa8042960 con 0x7f0ab80c4290 2023-05-17T14:54:47.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a9c05ed90 msgr2=0x7f0a9c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a9c05ed90 0x7f0a9c061250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0ab400a900 tx=0x7f0ab4008040).stop 2023-05-17T14:54:47.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 msgr2=0x7f0ab8165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 0x7f0ab8165430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f0ab805ee30 tx=0x7f0aa8017000).stop 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 shutdown_connections 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0a9c05ed90 0x7f0a9c061250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab8155290 0x7f0ab80a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ab80bda70 0x7f0ab80a8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 --2- 172.21.15.27:0/1811955149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ab80c4290 0x7f0ab8165430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 >> 172.21.15.27:0/1811955149 conn(0x7f0ab8067cb0 msgr2=0x7f0ab814de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 shutdown_connections 2023-05-17T14:54:47.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.134+0000 7f0abf28d700 1 -- 172.21.15.27:0/1811955149 wait complete. 2023-05-17T14:54:47.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T14:54:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.274+0000 7fddd1ddb700 1 Processor -- start 2023-05-17T14:54:47.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.274+0000 7fddd1ddb700 1 -- start start 2023-05-17T14:54:47.279 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:47.275+0000 7f152b5f2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T14:54:47.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddd1ddb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc154090 0x7fddcc154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddd1ddb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddcc0cb450 0x7fddcc0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddd1ddb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fddcc068f00 0x7fddcc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddd1ddb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc069fa0 con 0x7fddcc068f00 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddd1ddb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0698a0 con 0x7fddcc0cb450 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddd1ddb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0c5a50 con 0x7fddcc154090 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddcbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fddcc068f00 0x7fddcc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddcbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fddcc068f00 0x7fddcc0693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35580/0 (socket says 172.21.15.27:35580) 2023-05-17T14:54:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddcbfff700 1 -- 172.21.15.27:0/2313638256 learned_addr learned my addr 172.21.15.27:0/2313638256 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddcaffd700 1 --2- 172.21.15.27:0/2313638256 >> v2:172.21.15.40:3300/0 conn(0x7fddcc0cb450 0x7fddcc0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.275+0000 7fddcb7fe700 1 --2- 172.21.15.27:0/2313638256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc154090 0x7fddcc154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddcbfff700 1 -- 172.21.15.27:0/2313638256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc154090 msgr2=0x7fddcc154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddcbfff700 1 --2- 172.21.15.27:0/2313638256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc154090 0x7fddcc154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddcbfff700 1 -- 172.21.15.27:0/2313638256 >> v2:172.21.15.40:3300/0 conn(0x7fddcc0cb450 msgr2=0x7fddcc0cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddcbfff700 1 --2- 172.21.15.27:0/2313638256 >> v2:172.21.15.40:3300/0 conn(0x7fddcc0cb450 0x7fddcc0cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddcbfff700 1 -- 172.21.15.27:0/2313638256 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0c04e0 con 0x7fddcc068f00 2023-05-17T14:54:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddcbfff700 1 --2- 172.21.15.27:0/2313638256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc0693b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fddc4009f20 tx=0x7fddc4009840).ready entity=mon.0 client_cookie=f61eb2c85a60160d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddca7fc700 1 -- 172.21.15.27:0/2313638256 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400e070 con 0x7fddcc068f00 2023-05-17T14:54:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddca7fc700 1 -- 172.21.15.27:0/2313638256 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400b930 con 0x7fddcc068f00 2023-05-17T14:54:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddca7fc700 1 -- 172.21.15.27:0/2313638256 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400bcb0 con 0x7fddcc068f00 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddd1ddb700 1 -- 172.21.15.27:0/2313638256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 msgr2=0x7fddcc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.276+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/2313638256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc0693b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fddc4009f20 tx=0x7fddc4009840).stop 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 -- 172.21.15.27:0/2313638256 shutdown_connections 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/2313638256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc0693b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/2313638256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc154090 0x7fddcc154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/2313638256 >> v2:172.21.15.40:3300/0 conn(0x7fddcc0cb450 0x7fddcc0cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 -- 172.21.15.27:0/2313638256 >> 172.21.15.27:0/2313638256 conn(0x7fddcc05e7e0 msgr2=0x7fddcc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 -- 172.21.15.27:0/2313638256 shutdown_connections 2023-05-17T14:54:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.277+0000 7fddd1ddb700 1 -- 172.21.15.27:0/2313638256 wait complete. 2023-05-17T14:54:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.279+0000 7fddd1ddb700 1 Processor -- start 2023-05-17T14:54:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.279+0000 7fddd1ddb700 1 -- start start 2023-05-17T14:54:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddd1ddb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddd1ddb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb450 0x7fddcc14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddd1ddb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc154090 0x7fddcc152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddd1ddb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc151230 con 0x7fddcc068f00 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddd1ddb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc150620 con 0x7fddcc154090 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddd1ddb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc150900 con 0x7fddcc0cb450 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc1516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35586/0 (socket says 172.21.15.27:35586) 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 -- 172.21.15.27:0/1193949857 learned_addr learned my addr 172.21.15.27:0/1193949857 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcaffd700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb450 0x7fddcc14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcbfff700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc154090 0x7fddcc152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 -- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb450 msgr2=0x7fddcc14e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb450 0x7fddcc14e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 -- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc154090 msgr2=0x7fddcc152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc154090 0x7fddcc152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.280+0000 7fddcb7fe700 1 -- 172.21.15.27:0/1193949857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009ae0 con 0x7fddcc068f00 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.281+0000 7fddcb7fe700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc1516c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fddb400e900 tx=0x7fddb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.281+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4012600 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.281+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4012760 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.281+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc150be0 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.281+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4012ae0 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.281+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc0aefe0 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.282+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc06bdf0 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.282+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fddb4022070 con 0x7fddcc068f00 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.283+0000 7fddc37fe700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fddac05edb0 0x7fddac061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.283+0000 7fddcaffd700 1 -- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fddac05edb0 msgr2=0x7fddac061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T14:54:47.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.283+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fddb4079da0 con 0x7fddcc068f00 2023-05-17T14:54:47.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.283+0000 7fddcaffd700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fddac05edb0 0x7fddac061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T14:54:47.292 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:47.283+0000 7efe39a5f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T14:54:47.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.287+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fddb404b340 con 0x7fddcc068f00 2023-05-17T14:54:47.344 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:47.340+0000 7f152b5f2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T14:54:47.353 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:47.349+0000 7efe39a5f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T14:54:47.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.463+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fddcc153750 con 0x7fddcc068f00 2023-05-17T14:54:47.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.466+0000 7fddc37fe700 1 -- 172.21.15.27:0/1193949857 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7fddb4016070 con 0x7fddcc068f00 2023-05-17T14:54:47.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fddac05edb0 msgr2=0x7fddac061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T14:54:47.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fddac05edb0 0x7fddac061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 msgr2=0x7fddcc1516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc1516c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fddb400e900 tx=0x7fddb4009060).stop 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 shutdown_connections 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fddac05edb0 0x7fddac061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc154090 0x7fddcc152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fddcc068f00 0x7fddcc1516c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 --2- 172.21.15.27:0/1193949857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb450 0x7fddcc14e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 >> 172.21.15.27:0/1193949857 conn(0x7fddcc05e7e0 msgr2=0x7fddcc0ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:47.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 shutdown_connections 2023-05-17T14:54:47.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.468+0000 7fddd1ddb700 1 -- 172.21.15.27:0/1193949857 wait complete. 2023-05-17T14:54:47.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:47.485 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T14:54:47.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:47.503 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-05-17T14:54:47.559 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-05-17T14:54:47.627 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:47.624+0000 7f152b5f2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T14:54:47.641 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:47.637+0000 7efe39a5f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T14:54:47.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.717+0000 7fe7ca8be700 1 Processor -- start 2023-05-17T14:54:47.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.717+0000 7fe7ca8be700 1 -- start start 2023-05-17T14:54:47.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7ca8be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4151c90 0x7fe7c4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7ca8be700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe7c40c0520 0x7fe7c4081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7ca8be700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c4158010 con 0x7fe7c4154980 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7ca8be700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c4154f60 con 0x7fe7c40c0520 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7ca8be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4155240 con 0x7fe7c4151c90 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c8e5b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe7c40c0520 0x7fe7c4081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe7c4154980 0x7fe7c40c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35178/0 (socket says 172.21.15.27:35178) 2023-05-17T14:54:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c37fe700 1 -- 172.21.15.27:0/2841950769 learned_addr learned my addr 172.21.15.27:0/2841950769 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c3fff700 1 --2- 172.21.15.27:0/2841950769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4151c90 0x7fe7c4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c8e5b700 1 -- 172.21.15.27:0/2841950769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4151c90 msgr2=0x7fe7c4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c8e5b700 1 --2- 172.21.15.27:0/2841950769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4151c90 0x7fe7c4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c8e5b700 1 -- 172.21.15.27:0/2841950769 >> v1:172.21.15.27:6789/0 conn(0x7fe7c4154980 legacy=0x7fe7c40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c2ffd700 1 -- 172.21.15.27:0/2841950769 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732177288 0 0) 0x7fe7c4158010 con 0x7fe7c4154980 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c8e5b700 1 -- 172.21.15.27:0/2841950769 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4155520 con 0x7fe7c40c0520 2023-05-17T14:54:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.718+0000 7fe7c8e5b700 1 --2- 172.21.15.27:0/2841950769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4081fd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fe7bc009e60 tx=0x7fe7bc009780).ready entity=mon.0 client_cookie=74efa6b36f95ca94 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:47.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7c2ffd700 1 -- 172.21.15.27:0/2841950769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00e070 con 0x7fe7c40c0520 2023-05-17T14:54:47.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7c2ffd700 1 -- 172.21.15.27:0/2841950769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc00bb60 con 0x7fe7c40c0520 2023-05-17T14:54:47.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7c2ffd700 1 -- 172.21.15.27:0/2841950769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc012410 con 0x7fe7c40c0520 2023-05-17T14:54:47.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 -- 172.21.15.27:0/2841950769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 msgr2=0x7fe7c4081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/2841950769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4081fd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fe7bc009e60 tx=0x7fe7bc009780).stop 2023-05-17T14:54:47.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 -- 172.21.15.27:0/2841950769 shutdown_connections 2023-05-17T14:54:47.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/2841950769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4081fd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/2841950769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4151c90 0x7fe7c4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 -- 172.21.15.27:0/2841950769 >> 172.21.15.27:0/2841950769 conn(0x7fe7c40cae10 msgr2=0x7fe7c40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 -- 172.21.15.27:0/2841950769 shutdown_connections 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.719+0000 7fe7ca8be700 1 -- 172.21.15.27:0/2841950769 wait complete. 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.721+0000 7fe7ca8be700 1 Processor -- start 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.721+0000 7fe7ca8be700 1 -- start start 2023-05-17T14:54:47.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.721+0000 7fe7ca8be700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.721+0000 7fe7ca8be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c4151c90 0x7fe7c40addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.721+0000 7fe7ca8be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4154980 0x7fe7c4153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7ca8be700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40af620 con 0x7fe7c40c0520 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7ca8be700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40ae7b0 con 0x7fe7c4151c90 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7ca8be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40aea90 con 0x7fe7c4154980 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35620/0 (socket says 172.21.15.27:35620) 2023-05-17T14:54:47.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 -- 172.21.15.27:0/4115897720 learned_addr learned my addr 172.21.15.27:0/4115897720 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c8e5b700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4154980 0x7fe7c4153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c4151c90 0x7fe7c40addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4154980 msgr2=0x7fe7c4153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4154980 0x7fe7c4153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c4151c90 msgr2=0x7fe7c40addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c4151c90 0x7fe7c40addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 -- 172.21.15.27:0/4115897720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc009a20 con 0x7fe7c40c0520 2023-05-17T14:54:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7c3fff700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4150ad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fe7b400e950 tx=0x7fe7b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4012600 con 0x7fe7c40c0520 2023-05-17T14:54:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b4012760 con 0x7fe7c40c0520 2023-05-17T14:54:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c40aed70 con 0x7fe7c40c0520 2023-05-17T14:54:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4012ae0 con 0x7fe7c40c0520 2023-05-17T14:54:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.722+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c4150fc0 con 0x7fe7c40c0520 2023-05-17T14:54:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.723+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c406bdf0 con 0x7fe7c40c0520 2023-05-17T14:54:47.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.724+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fe7b4022070 con 0x7fe7c40c0520 2023-05-17T14:54:47.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.724+0000 7fe7bbfff700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:47.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.724+0000 7fe7c37fe700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T14:54:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.725+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe7b407a590 con 0x7fe7c40c0520 2023-05-17T14:54:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.725+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T14:54:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.728+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7b404ba20 con 0x7fe7c40c0520 2023-05-17T14:54:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.926+0000 7fe7c37fe700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T14:54:47.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.926+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T14:54:47.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:47.927+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c40af760 con 0x7fe7a405ede0 2023-05-17T14:54:48.284 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:48.280+0000 7f152b5f2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T14:54:48.299 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:48.296+0000 7efe39a5f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T14:54:48.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:48.327+0000 7fe7c37fe700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T14:54:48.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:48.327+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T14:54:48.351 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:48.347+0000 7f152b5f2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T14:54:48.367 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:48.363+0000 7efe39a5f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T14:54:48.542 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:48.538+0000 7f152b5f2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T14:54:48.558 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:48.555+0000 7efe39a5f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T14:54:48.975 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:48.971+0000 7f152b5f2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T14:54:48.991 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:48.987+0000 7efe39a5f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T14:54:49.081 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:49.078+0000 7f152b5f2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:54:49.098 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:49.095+0000 7efe39a5f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:54:49.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:49.128+0000 7fe7c37fe700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T14:54:49.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:49.128+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T14:54:49.238 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:49.234+0000 7f152b5f2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T14:54:49.255 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:49.251+0000 7efe39a5f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T14:54:49.314 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:49.310+0000 7f152b5f2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T14:54:49.332 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:49.328+0000 7efe39a5f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T14:54:49.383 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:49.379+0000 7f152b5f2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T14:54:49.401 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:49.397+0000 7efe39a5f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T14:54:49.651 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:49.647+0000 7f152b5f2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T14:54:49.670 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:49.666+0000 7efe39a5f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T14:54:49.838 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:49.834+0000 7f152b5f2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T14:54:49.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:49.854+0000 7efe39a5f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T14:54:50.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:50.507+0000 7f152b5f2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T14:54:50.535 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:50.531+0000 7efe39a5f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T14:54:50.580 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:50.576+0000 7f152b5f2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T14:54:50.604 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:50.601+0000 7efe39a5f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T14:54:50.656 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:50.652+0000 7f152b5f2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T14:54:50.681 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:50.677+0000 7efe39a5f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T14:54:50.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:50.729+0000 7fe7c37fe700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T14:54:50.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:50.729+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T14:54:50.804 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:50.800+0000 7f152b5f2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T14:54:50.830 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:50.826+0000 7efe39a5f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T14:54:50.875 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:50.871+0000 7f152b5f2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T14:54:50.902 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:50.899+0000 7efe39a5f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T14:54:50.992 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:50.989+0000 7f152b5f2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T14:54:51.022 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.018+0000 7efe39a5f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T14:54:51.102 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:51.099+0000 7f152b5f2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:54:51.133 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.130+0000 7efe39a5f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T14:54:51.401 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:51.397+0000 7f152b5f2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T14:54:51.431 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.427+0000 7efe39a5f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T14:54:51.472 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T14:54:51.469+0000 7f152b5f2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T14:54:51.503 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.499+0000 7efe39a5f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T14:54:51.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:51.537+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 6) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fe7b4078380 con 0x7fe7c40c0520 2023-05-17T14:54:51.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:51.538+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T14:54:51.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:51.538+0000 7fe7bbfff700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:51.602 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.597+0000 7efdb8241700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.602 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.597+0000 7efdb8241700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.602 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.597+0000 7efdb8241700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.602 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.597+0000 7efdb8241700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.602 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.597+0000 7efdb8241700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.603 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.598+0000 7efdb523b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.603 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.598+0000 7efdb523b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.603 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.598+0000 7efdb523b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.603 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.598+0000 7efdb523b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:51.603 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:54:51.598+0000 7efdb523b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:54:52.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.556+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fe7b4078700 con 0x7fe7c40c0520 2023-05-17T14:54:52.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.556+0000 7fe7bbfff700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a402fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:52.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.556+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7a4007bd0 con 0x7fe7a405ede0 2023-05-17T14:54:52.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.557+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a402fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:52.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.559+0000 7fe7c37fe700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a402fd40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe7c40aa100 tx=0x7fe7ac007dd0).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:52.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.577+0000 7fe7bbfff700 1 -- 172.21.15.27:0/4115897720 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe7a4007bd0 con 0x7fe7a405ede0 2023-05-17T14:54:52.581 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir0 2023-05-17T14:54:52.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 msgr2=0x7fe7a402fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a402fd40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe7c40aa100 tx=0x7fe7ac007dd0).stop 2023-05-17T14:54:52.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 msgr2=0x7fe7c4150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4150ad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fe7b400e950 tx=0x7fe7b4009060).stop 2023-05-17T14:54:52.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 shutdown_connections 2023-05-17T14:54:52.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe7a405ede0 0x7fe7a402fd40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7c4154980 0x7fe7c4153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7c40c0520 0x7fe7c4150ad0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 --2- 172.21.15.27:0/4115897720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c4151c90 0x7fe7c40addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.579+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 >> 172.21.15.27:0/4115897720 conn(0x7fe7c40cae10 msgr2=0x7fe7c40c77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:52.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.580+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 shutdown_connections 2023-05-17T14:54:52.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.580+0000 7fe7ca8be700 1 -- 172.21.15.27:0/4115897720 wait complete. 2023-05-17T14:54:52.598 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-05-17T14:54:52.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:52.599 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-05-17T14:54:52.655 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-05-17T14:54:52.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.816+0000 7f9e08ff6700 1 Processor -- start 2023-05-17T14:54:52.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.817+0000 7f9e08ff6700 1 -- start start 2023-05-17T14:54:52.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.817+0000 7f9e08ff6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e04152070 0x7f9e04154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:52.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e08ff6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04158010 con 0x7f9e040c0520 2023-05-17T14:54:52.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e08ff6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04154f60 con 0x7f9e04151c90 2023-05-17T14:54:52.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e08ff6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e04155240 con 0x7f9e04152070 2023-05-17T14:54:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e02d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9e040c0520 0x7f9e04081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35384/0 (socket says 172.21.15.27:35384) 2023-05-17T14:54:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e02d9d700 1 -- 172.21.15.27:0/294523550 learned_addr learned my addr 172.21.15.27:0/294523550 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e01d9b700 1 --2- 172.21.15.27:0/294523550 >> v2:172.21.15.40:3300/0 conn(0x7f9e04152070 0x7f9e04154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e0159a700 1 -- 172.21.15.27:0/294523550 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206114804 0 0) 0x7f9e04158010 con 0x7f9e040c0520 2023-05-17T14:54:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e0159a700 1 -- 172.21.15.27:0/294523550 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df00033f0 con 0x7f9e040c0520 2023-05-17T14:54:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e01d9b700 1 -- 172.21.15.27:0/294523550 >> v1:172.21.15.40:6789/0 conn(0x7f9e04151c90 legacy=0x7f9e040c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e01d9b700 1 -- 172.21.15.27:0/294523550 >> v1:172.21.15.27:6789/0 conn(0x7f9e040c0520 legacy=0x7f9e04081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e0159a700 1 -- 172.21.15.27:0/294523550 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 706842262 0 0) 0x7f9df00033f0 con 0x7f9e040c0520 2023-05-17T14:54:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e01d9b700 1 -- 172.21.15.27:0/294523550 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04155520 con 0x7f9e04152070 2023-05-17T14:54:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e01d9b700 1 --2- 172.21.15.27:0/294523550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04154980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f9dec009760 tx=0x7f9dec009060).ready entity=mon.1 client_cookie=944616ceb9f0e879 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.818+0000 7f9e0159a700 1 -- 172.21.15.27:0/294523550 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40017f0 con 0x7f9e04152070 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e0159a700 1 -- 172.21.15.27:0/294523550 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec011400 con 0x7f9e04152070 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e0159a700 1 -- 172.21.15.27:0/294523550 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011780 con 0x7f9e04152070 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 -- 172.21.15.27:0/294523550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 msgr2=0x7f9e04154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/294523550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04154980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f9dec009760 tx=0x7f9dec009060).stop 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 -- 172.21.15.27:0/294523550 shutdown_connections 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/294523550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04154980 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 -- 172.21.15.27:0/294523550 >> 172.21.15.27:0/294523550 conn(0x7f9e040cae10 msgr2=0x7f9e040cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:52.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 -- 172.21.15.27:0/294523550 shutdown_connections 2023-05-17T14:54:52.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.819+0000 7f9e08ff6700 1 -- 172.21.15.27:0/294523550 wait complete. 2023-05-17T14:54:52.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.820+0000 7f9e08ff6700 1 Processor -- start 2023-05-17T14:54:52.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.820+0000 7f9e08ff6700 1 -- start start 2023-05-17T14:54:52.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e08ff6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e040c0520 0x7f9e040c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:52.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e08ff6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 0x7f9e040c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:52.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e08ff6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:52.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e08ff6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040c3410 con 0x7f9e04151c90 2023-05-17T14:54:52.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e08ff6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040c2800 con 0x7f9e04152070 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e08ff6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040c2ae0 con 0x7f9e040c0520 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 0x7f9e040c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 0x7f9e040c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35826/0 (socket says 172.21.15.27:35826) 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 -- 172.21.15.27:0/3345124855 learned_addr learned my addr 172.21.15.27:0/3345124855 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e02d9d700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e0259c700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e040c0520 0x7f9e040c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:52.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 -- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e040c0520 msgr2=0x7f9e040c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e040c0520 0x7f9e040c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 -- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 msgr2=0x7f9e04146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 -- 172.21.15.27:0/3345124855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec0092a0 con 0x7f9e04151c90 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e0259c700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e040c0520 0x7f9e040c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e02d9d700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.821+0000 7f9e01d9b700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 0x7f9e040c1eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f9dec009e00 tx=0x7f9dec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:52.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.822+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec010a20 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.822+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec010b80 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.822+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e040c2dc0 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.822+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec01d430 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.822+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04151180 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.822+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e04151370 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.823+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f9dec00f070 con 0x7f9e04151c90 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.823+0000 7f9dfa7fc700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9de405ed70 0x7f9de4061230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:52.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.823+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9dec07b210 con 0x7f9e04151c90 2023-05-17T14:54:52.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.823+0000 7f9e0259c700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9de405ed70 0x7f9de4061230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:52.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.824+0000 7f9e0259c700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9de405ed70 0x7f9de4061230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9dfc001730 tx=0x7f9dfc009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:52.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:52.828+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9dec04c7a0 con 0x7f9e04151c90 2023-05-17T14:54:53.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.023+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e040c3550 con 0x7f9de405ed70 2023-05-17T14:54:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.026+0000 7f9dfa7fc700 1 -- 172.21.15.27:0/3345124855 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9e040c3550 con 0x7f9de405ed70 2023-05-17T14:54:53.030 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir1 2023-05-17T14:54:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9de405ed70 msgr2=0x7f9de4061230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9de405ed70 0x7f9de4061230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9dfc001730 tx=0x7f9dfc009040).stop 2023-05-17T14:54:53.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 msgr2=0x7f9e040c1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 0x7f9e040c1eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f9dec009e00 tx=0x7f9dec014000).stop 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 shutdown_connections 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9de405ed70 0x7f9de4061230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e04152070 0x7f9e04146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e040c0520 0x7f9e040c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 --2- 172.21.15.27:0/3345124855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e04151c90 0x7f9e040c1eb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 >> 172.21.15.27:0/3345124855 conn(0x7f9e040cae10 msgr2=0x7f9e040c9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 shutdown_connections 2023-05-17T14:54:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.028+0000 7f9e08ff6700 1 -- 172.21.15.27:0/3345124855 wait complete. 2023-05-17T14:54:53.044 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-05-17T14:54:53.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:53.044 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-05-17T14:54:53.059 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-05-17T14:54:53.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.216+0000 7fc9663f6700 1 Processor -- start 2023-05-17T14:54:53.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.216+0000 7fc9663f6700 1 -- start start 2023-05-17T14:54:53.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc9663f6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc960151c90 0x7fc960152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc9663f6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc960154980 0x7fc9600c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc9663f6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc960158010 con 0x7fc9600c0520 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc9663f6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc960154f60 con 0x7fc960154980 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc9663f6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc960155240 con 0x7fc960151c90 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc960154980 0x7fc9600c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc960154980 0x7fc9600c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35832/0 (socket says 172.21.15.27:35832) 2023-05-17T14:54:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 -- 172.21.15.27:0/2478173264 learned_addr learned my addr 172.21.15.27:0/2478173264 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95ffff700 1 --2- 172.21.15.27:0/2478173264 >> v2:172.21.15.40:3300/0 conn(0x7fc960151c90 0x7fc960152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 -- 172.21.15.27:0/2478173264 >> v2:172.21.15.40:3300/0 conn(0x7fc960151c90 msgr2=0x7fc960152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 --2- 172.21.15.27:0/2478173264 >> v2:172.21.15.40:3300/0 conn(0x7fc960151c90 0x7fc960152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 -- 172.21.15.27:0/2478173264 >> v1:172.21.15.40:6789/0 conn(0x7fc9600c0520 legacy=0x7fc960081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.217+0000 7fc95f7fe700 1 -- 172.21.15.27:0/2478173264 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960155520 con 0x7fc960154980 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc95f7fe700 1 --2- 172.21.15.27:0/2478173264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c6150 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fc960084120 tx=0x7fc9500090f0).ready entity=mon.0 client_cookie=6fe9e40f89519605 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:53.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc95effd700 1 -- 172.21.15.27:0/2478173264 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95000b520 con 0x7fc960154980 2023-05-17T14:54:53.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc95effd700 1 -- 172.21.15.27:0/2478173264 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95000b680 con 0x7fc960154980 2023-05-17T14:54:53.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc95effd700 1 -- 172.21.15.27:0/2478173264 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95000ba00 con 0x7fc960154980 2023-05-17T14:54:53.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 -- 172.21.15.27:0/2478173264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 msgr2=0x7fc9600c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 --2- 172.21.15.27:0/2478173264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c6150 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fc960084120 tx=0x7fc9500090f0).stop 2023-05-17T14:54:53.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 -- 172.21.15.27:0/2478173264 shutdown_connections 2023-05-17T14:54:53.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 --2- 172.21.15.27:0/2478173264 >> v2:172.21.15.40:3300/0 conn(0x7fc960151c90 0x7fc960152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 --2- 172.21.15.27:0/2478173264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c6150 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 -- 172.21.15.27:0/2478173264 >> 172.21.15.27:0/2478173264 conn(0x7fc9600cae10 msgr2=0x7fc9600cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 -- 172.21.15.27:0/2478173264 shutdown_connections 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.218+0000 7fc9663f6700 1 -- 172.21.15.27:0/2478173264 wait complete. 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.219+0000 7fc9663f6700 1 Processor -- start 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 -- start start 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9600c0520 0x7fc9600c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc960151c90 0x7fc9600ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600ae730 con 0x7fc960154980 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c2fa0 con 0x7fc9600c0520 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc9663f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc960158420 con 0x7fc960151c90 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc964993700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc964993700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35838/0 (socket says 172.21.15.27:35838) 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.220+0000 7fc964993700 1 -- 172.21.15.27:0/3243026688 learned_addr learned my addr 172.21.15.27:0/3243026688 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc95ffff700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9600c0520 0x7fc9600c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc95f7fe700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc960151c90 0x7fc9600ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc964993700 1 -- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc960151c90 msgr2=0x7fc9600ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc964993700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc960151c90 0x7fc9600ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc964993700 1 -- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9600c0520 msgr2=0x7fc9600c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc964993700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9600c0520 0x7fc9600c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc964993700 1 -- 172.21.15.27:0/3243026688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950009370 con 0x7fc960154980 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc95ffff700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9600c0520 0x7fc9600c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc964993700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c1eb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fc95800c790 tx=0x7fc9580015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:53.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958010510 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958010670 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600c2700 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580109f0 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.221+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9600c2cc0 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.222+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96006bdf0 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.222+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fc958010070 con 0x7fc960154980 2023-05-17T14:54:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.223+0000 7fc957fff700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc94005ed40 0x7fc940061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.223+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc9580797c0 con 0x7fc960154980 2023-05-17T14:54:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.223+0000 7fc95ffff700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc94005ed40 0x7fc940061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.223+0000 7fc95ffff700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc94005ed40 0x7fc940061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc948009c00 tx=0x7fc948008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.227+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc95804ad50 con 0x7fc960154980 2023-05-17T14:54:53.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.422+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc960155800 con 0x7fc94005ed40 2023-05-17T14:54:53.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.425+0000 7fc957fff700 1 -- 172.21.15.27:0/3243026688 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc960155800 con 0x7fc94005ed40 2023-05-17T14:54:53.429 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir2 2023-05-17T14:54:53.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc94005ed40 msgr2=0x7fc940061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc94005ed40 0x7fc940061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc948009c00 tx=0x7fc948008040).stop 2023-05-17T14:54:53.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 msgr2=0x7fc9600c1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c1eb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fc95800c790 tx=0x7fc9580015e0).stop 2023-05-17T14:54:53.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 shutdown_connections 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc94005ed40 0x7fc940061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc960154980 0x7fc9600c1eb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9600c0520 0x7fc9600c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 --2- 172.21.15.27:0/3243026688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc960151c90 0x7fc9600ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 >> 172.21.15.27:0/3243026688 conn(0x7fc9600cae10 msgr2=0x7fc9600c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 shutdown_connections 2023-05-17T14:54:53.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.427+0000 7fc9663f6700 1 -- 172.21.15.27:0/3243026688 wait complete. 2023-05-17T14:54:53.442 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-05-17T14:54:53.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:53.443 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-05-17T14:54:53.460 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-05-17T14:54:53.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.618+0000 7f9604d2f700 1 Processor -- start 2023-05-17T14:54:53.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.618+0000 7f9604d2f700 1 -- start start 2023-05-17T14:54:53.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f9604d2f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9600153fa0 0x7f96000c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f9604d2f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96000826e0 0x7f96000aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f9604d2f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000c1610 con 0x7f96000aa130 2023-05-17T14:54:53.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f9604d2f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000c0a00 con 0x7f96000826e0 2023-05-17T14:54:53.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f9604d2f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000c0ce0 con 0x7f9600153fa0 2023-05-17T14:54:53.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96000826e0 0x7f96000aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96000826e0 0x7f96000aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35846/0 (socket says 172.21.15.27:35846) 2023-05-17T14:54:53.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 -- 172.21.15.27:0/3360193758 learned_addr learned my addr 172.21.15.27:0/3360193758 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:53.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fe59c700 1 --2- 172.21.15.27:0/3360193758 >> v2:172.21.15.40:3300/0 conn(0x7f9600153fa0 0x7f96000c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 -- 172.21.15.27:0/3360193758 >> v2:172.21.15.40:3300/0 conn(0x7f9600153fa0 msgr2=0x7f96000c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:53.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 --2- 172.21.15.27:0/3360193758 >> v2:172.21.15.40:3300/0 conn(0x7f9600153fa0 0x7f96000c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 -- 172.21.15.27:0/3360193758 >> v1:172.21.15.40:6789/0 conn(0x7f96000aa130 legacy=0x7f9600081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.619+0000 7f95fed9d700 1 -- 172.21.15.27:0/3360193758 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000c0fc0 con 0x7f96000826e0 2023-05-17T14:54:53.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f95fed9d700 1 --2- 172.21.15.27:0/3360193758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f96000aae50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f96000cad20 tx=0x7f95f0009840).ready entity=mon.0 client_cookie=503aeec2d9382643 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:53.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f95fd59a700 1 -- 172.21.15.27:0/3360193758 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000e070 con 0x7f96000826e0 2023-05-17T14:54:53.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f95fd59a700 1 -- 172.21.15.27:0/3360193758 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000ba20 con 0x7f96000826e0 2023-05-17T14:54:53.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f95fd59a700 1 -- 172.21.15.27:0/3360193758 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000bda0 con 0x7f96000826e0 2023-05-17T14:54:53.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 -- 172.21.15.27:0/3360193758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 msgr2=0x7f96000aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 --2- 172.21.15.27:0/3360193758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f96000aae50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f96000cad20 tx=0x7f95f0009840).stop 2023-05-17T14:54:53.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 -- 172.21.15.27:0/3360193758 shutdown_connections 2023-05-17T14:54:53.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 --2- 172.21.15.27:0/3360193758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f96000aae50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 --2- 172.21.15.27:0/3360193758 >> v2:172.21.15.40:3300/0 conn(0x7f9600153fa0 0x7f96000c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 -- 172.21.15.27:0/3360193758 >> 172.21.15.27:0/3360193758 conn(0x7f960005e820 msgr2=0x7f96000cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:53.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 -- 172.21.15.27:0/3360193758 shutdown_connections 2023-05-17T14:54:53.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.620+0000 7f9604d2f700 1 -- 172.21.15.27:0/3360193758 wait complete. 2023-05-17T14:54:53.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.621+0000 7f9604d2f700 1 Processor -- start 2023-05-17T14:54:53.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.621+0000 7f9604d2f700 1 -- start start 2023-05-17T14:54:53.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f9604d2f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f960013d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f9604d2f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96000aa130 0x7f96000aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f9604d2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9600153fa0 0x7f96000ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f9604d2f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000ab7f0 con 0x7f96000826e0 2023-05-17T14:54:53.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f9604d2f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000aceb0 con 0x7f96000aa130 2023-05-17T14:54:53.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f9604d2f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96000c20b0 con 0x7f9600153fa0 2023-05-17T14:54:53.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f95fe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f960013d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f95fe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f960013d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35848/0 (socket says 172.21.15.27:35848) 2023-05-17T14:54:53.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.622+0000 7f95fe59c700 1 -- 172.21.15.27:0/1899478377 learned_addr learned my addr 172.21.15.27:0/1899478377 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95fe59c700 1 -- 172.21.15.27:0/1899478377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9600153fa0 msgr2=0x7f96000ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95fe59c700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9600153fa0 0x7f96000ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95fe59c700 1 -- 172.21.15.27:0/1899478377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96000aa130 msgr2=0x7f96000aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95fe59c700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96000aa130 0x7f96000aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:53.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95fe59c700 1 -- 172.21.15.27:0/1899478377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009ae0 con 0x7f96000826e0 2023-05-17T14:54:53.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95fe59c700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f960013d640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f95f800e900 tx=0x7f95f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:53.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800c640 con 0x7f96000826e0 2023-05-17T14:54:53.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f800c7a0 con 0x7f96000826e0 2023-05-17T14:54:53.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9600155da0 con 0x7f96000826e0 2023-05-17T14:54:53.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800cb20 con 0x7f96000826e0 2023-05-17T14:54:53.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.623+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9600156360 con 0x7f96000826e0 2023-05-17T14:54:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.624+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96000c12a0 con 0x7f96000826e0 2023-05-17T14:54:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.624+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f95f8022070 con 0x7f96000826e0 2023-05-17T14:54:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.625+0000 7f95f67fc700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95e005ee30 0x7f95e00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.625+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f95f807a160 con 0x7f96000826e0 2023-05-17T14:54:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.625+0000 7f95fdd9b700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95e005ee30 0x7f95e00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.625+0000 7f95fdd9b700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95e005ee30 0x7f95e00612f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9600167d50 tx=0x7f95e80079c0).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.629+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95f804b470 con 0x7f96000826e0 2023-05-17T14:54:53.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.827+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f96000c21f0 con 0x7f95e005ee30 2023-05-17T14:54:53.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.831+0000 7f95f67fc700 1 -- 172.21.15.27:0/1899478377 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f95e8012400 con 0x7f95e005ee30 2023-05-17T14:54:53.835 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir3 2023-05-17T14:54:53.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95e005ee30 msgr2=0x7f95e00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95e005ee30 0x7f95e00612f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9600167d50 tx=0x7f95e80079c0).stop 2023-05-17T14:54:53.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 msgr2=0x7f960013d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:53.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f960013d640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f95f800e900 tx=0x7f95f8009060).stop 2023-05-17T14:54:53.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 shutdown_connections 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f95e005ee30 0x7f95e00612f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9600153fa0 0x7f96000ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96000826e0 0x7f960013d640 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 --2- 172.21.15.27:0/1899478377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96000aa130 0x7f96000aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 >> 172.21.15.27:0/1899478377 conn(0x7f960005e820 msgr2=0x7f96000ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 shutdown_connections 2023-05-17T14:54:53.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:53.833+0000 7f9604d2f700 1 -- 172.21.15.27:0/1899478377 wait complete. 2023-05-17T14:54:53.848 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-05-17T14:54:53.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:53.849 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-05-17T14:54:53.865 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-05-17T14:54:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.020+0000 7f8a108d6700 1 Processor -- start 2023-05-17T14:54:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.020+0000 7f8a108d6700 1 -- start start 2023-05-17T14:54:54.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.021+0000 7f8a108d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a0c0c5310 0x7f8a0c0be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.021+0000 7f8a108d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0bea40 0x7f8a0c0c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.021+0000 7f8a108d6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c069c20 con 0x7f8a0c0a7fa0 2023-05-17T14:54:54.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.021+0000 7f8a108d6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c154570 con 0x7f8a0c0c5310 2023-05-17T14:54:54.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.021+0000 7f8a108d6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0beed0 con 0x7f8a0c0bea40 2023-05-17T14:54:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a09d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a0c0c5310 0x7f8a0c0be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8a0c0a7fa0 0x7f8a0c068730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35418/0 (socket says 172.21.15.27:35418) 2023-05-17T14:54:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0a59c700 1 -- 172.21.15.27:0/3256740625 learned_addr learned my addr 172.21.15.27:0/3256740625 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0ad9d700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0bea40 0x7f8a0c0c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a09d9b700 1 -- 172.21.15.27:0/3256740625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0bea40 msgr2=0x7f8a0c0c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a09d9b700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0bea40 0x7f8a0c0c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a09d9b700 1 -- 172.21.15.27:0/3256740625 >> v1:172.21.15.27:6789/0 conn(0x7f8a0c0a7fa0 legacy=0x7f8a0c068730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a09d9b700 1 -- 172.21.15.27:0/3256740625 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0a8380 con 0x7f8a0c0c5310 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0959a700 1 -- 172.21.15.27:0/3256740625 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241780296 0 0) 0x7f8a0c069c20 con 0x7f8a0c0a7fa0 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0ad9d700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0bea40 0x7f8a0c0c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a09d9b700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0be550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f89f4009760 tx=0x7f89f4009060).ready entity=mon.0 client_cookie=17cef8ce4b25f144 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0959a700 1 -- 172.21.15.27:0/3256740625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400b580 con 0x7f8a0c0c5310 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0959a700 1 -- 172.21.15.27:0/3256740625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f400b6e0 con 0x7f8a0c0c5310 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.022+0000 7f8a0959a700 1 -- 172.21.15.27:0/3256740625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400ba60 con 0x7f8a0c0c5310 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 -- 172.21.15.27:0/3256740625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 msgr2=0x7f8a0c0be550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0be550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f89f4009760 tx=0x7f89f4009060).stop 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 -- 172.21.15.27:0/3256740625 shutdown_connections 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0bea40 0x7f8a0c0c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 --2- 172.21.15.27:0/3256740625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0be550 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 -- 172.21.15.27:0/3256740625 >> 172.21.15.27:0/3256740625 conn(0x7f8a0c092160 msgr2=0x7f8a0c062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 -- 172.21.15.27:0/3256740625 shutdown_connections 2023-05-17T14:54:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.023+0000 7f8a108d6700 1 -- 172.21.15.27:0/3256740625 wait complete. 2023-05-17T14:54:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.024+0000 7f8a108d6700 1 Processor -- start 2023-05-17T14:54:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.024+0000 7f8a108d6700 1 -- start start 2023-05-17T14:54:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0a7fa0 0x7f8a0c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0c0bea40 0x7f8a0c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0aa600 con 0x7f8a0c0c5310 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0aca60 con 0x7f8a0c0bea40 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0aa850 con 0x7f8a0c0a7fa0 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35866/0 (socket says 172.21.15.27:35866) 2023-05-17T14:54:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 -- 172.21.15.27:0/1460942527 learned_addr learned my addr 172.21.15.27:0/1460942527 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0a59c700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0a7fa0 0x7f8a0c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a09d9b700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0c0bea40 0x7f8a0c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 -- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0a7fa0 msgr2=0x7f8a0c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0a7fa0 0x7f8a0c0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 -- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0c0bea40 msgr2=0x7f8a0c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0c0bea40 0x7f8a0c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 -- 172.21.15.27:0/1460942527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40092a0 con 0x7f8a0c0c5310 2023-05-17T14:54:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a0ad9d700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0c6e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f89fc00c650 tx=0x7f89fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010580 con 0x7f8a0c0c5310 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0106e0 con 0x7f8a0c0c5310 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010a60 con 0x7f8a0c0c5310 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0aab30 con 0x7f8a0c0c5310 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.025+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c159150 con 0x7f8a0c0c5310 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.026+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c0acc60 con 0x7f8a0c0c5310 2023-05-17T14:54:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.027+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f89fc01b460 con 0x7f8a0c0c5310 2023-05-17T14:54:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.027+0000 7f8a027fc700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f89ec05ee30 0x7f89ec0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.027+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f89fc079eb0 con 0x7f8a0c0c5310 2023-05-17T14:54:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.027+0000 7f8a0a59c700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f89ec05ee30 0x7f89ec0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.028+0000 7f8a0a59c700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f89ec05ee30 0x7f89ec0612f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8a04007fd0 tx=0x7f8a04009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.031+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a0c0acc60 con 0x7f8a0c0c5310 2023-05-17T14:54:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.234+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a0c0acc60 con 0x7f89ec05ee30 2023-05-17T14:54:54.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.238+0000 7f8a027fc700 1 -- 172.21.15.27:0/1460942527 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8a0c0acc60 con 0x7f89ec05ee30 2023-05-17T14:54:54.242 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir4 2023-05-17T14:54:54.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f89ec05ee30 msgr2=0x7f89ec0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f89ec05ee30 0x7f89ec0612f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8a04007fd0 tx=0x7f8a04009040).stop 2023-05-17T14:54:54.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 msgr2=0x7f8a0c0c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0c6e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f89fc00c650 tx=0x7f89fc008040).stop 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 shutdown_connections 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f89ec05ee30 0x7f89ec0612f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0c0c5310 0x7f8a0c0c6e00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a0c0a7fa0 0x7f8a0c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 --2- 172.21.15.27:0/1460942527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0c0bea40 0x7f8a0c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 >> 172.21.15.27:0/1460942527 conn(0x7f8a0c092160 msgr2=0x7f8a0c064670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 shutdown_connections 2023-05-17T14:54:54.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.240+0000 7f8a108d6700 1 -- 172.21.15.27:0/1460942527 wait complete. 2023-05-17T14:54:54.255 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-05-17T14:54:54.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:54.256 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-05-17T14:54:54.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-05-17T14:54:54.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.428+0000 7f7f7a941700 1 Processor -- start 2023-05-17T14:54:54.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.428+0000 7f7f7a941700 1 -- start start 2023-05-17T14:54:54.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f7a941700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 0x7f7f74152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f7a941700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f74158010 con 0x7f7f74154980 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f7a941700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f74154f60 con 0x7f7f740c0520 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f7a941700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74155240 con 0x7f7f74151c90 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f737fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7f74154980 0x7f7f740c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35434/0 (socket says 172.21.15.27:35434) 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f737fe700 1 -- 172.21.15.27:0/3666598363 learned_addr learned my addr 172.21.15.27:0/3666598363 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634509532 0 0) 0x7f7f74158010 con 0x7f7f74154980 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f73fff700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 0x7f7f74152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f5c0033f0 con 0x7f7f74154980 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253457417 0 0) 0x7f7f5c0033f0 con 0x7f7f74154980 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 msgr2=0x7f7f74152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f72ffd700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 0x7f7f74152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.429+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 >> v1:172.21.15.40:6789/0 conn(0x7f7f740c0520 legacy=0x7f7f74081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74155520 con 0x7f7f74154980 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f7f68001470 con 0x7f7f74154980 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 >> v1:172.21.15.27:6789/0 conn(0x7f7f74154980 legacy=0x7f7f740c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f5c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f5c004690 0x7f7f5c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 0x7f7f5c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74155240 con 0x7f7f5c003910 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c00b910 con 0x7f7f5c004690 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c00bad0 con 0x7f7f74151c90 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f5c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f737fe700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f5c004690 0x7f7f5c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f78ede700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 0x7f7f5c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 -- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 msgr2=0x7f7f5c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f74151c90 0x7f7f5c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 -- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f5c004690 msgr2=0x7f7f5c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f5c004690 0x7f7f5c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 -- 172.21.15.27:0/3666598363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0033f0 con 0x7f7f5c003910 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f73fff700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f5c003d30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f7f64009a60 tx=0x7f7f64009060).ready entity=mon.0 client_cookie=298a6280d268e88d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64009ea0 con 0x7f7f5c003910 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64009430 con 0x7f7f5c003910 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.430+0000 7f7f72ffd700 1 -- 172.21.15.27:0/3666598363 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400e870 con 0x7f7f5c003910 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f7a941700 1 -- 172.21.15.27:0/3666598363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 msgr2=0x7f7f5c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f7a941700 1 --2- 172.21.15.27:0/3666598363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f5c003d30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f7f64009a60 tx=0x7f7f64009060).stop 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f78ede700 1 -- 172.21.15.27:0/3666598363 reap_dead start 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f7a941700 1 -- 172.21.15.27:0/3666598363 shutdown_connections 2023-05-17T14:54:54.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f7a941700 1 -- 172.21.15.27:0/3666598363 >> 172.21.15.27:0/3666598363 conn(0x7f7f740cae10 msgr2=0x7f7f740cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:54.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f7a941700 1 -- 172.21.15.27:0/3666598363 shutdown_connections 2023-05-17T14:54:54.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.431+0000 7f7f7a941700 1 -- 172.21.15.27:0/3666598363 wait complete. 2023-05-17T14:54:54.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.432+0000 7f7f7a941700 1 Processor -- start 2023-05-17T14:54:54.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.432+0000 7f7f7a941700 1 -- start start 2023-05-17T14:54:54.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f7a941700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f740ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f7a941700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f740c22b0 0x7f7f740c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f7a941700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f74150370 0x7f7f74153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f7a941700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740c3430 con 0x7f7f5c003910 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f7a941700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740ae520 con 0x7f7f74150370 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f7a941700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740c3150 con 0x7f7f740c22b0 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f740ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f740ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35882/0 (socket says 172.21.15.27:35882) 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 -- 172.21.15.27:0/2350053306 learned_addr learned my addr 172.21.15.27:0/2350053306 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f737fe700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f740c22b0 0x7f7f740c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f78ede700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f74150370 0x7f7f74153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 -- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f740c22b0 msgr2=0x7f7f740c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f740c22b0 0x7f7f740c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 -- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f74150370 msgr2=0x7f7f74153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f74150370 0x7f7f74153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f73fff700 1 -- 172.21.15.27:0/2350053306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740aded0 con 0x7f7f5c003910 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.433+0000 7f7f78ede700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f74150370 0x7f7f74153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.434+0000 7f7f73fff700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f740ae9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f7f6401b520 tx=0x7f7f6401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.434+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64020070 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.434+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6401ba90 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.434+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6401be50 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.434+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f740ae1b0 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.434+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f741507d0 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.435+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7406bdf0 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.435+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f7f64025670 con 0x7f7f5c003910 2023-05-17T14:54:54.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.436+0000 7f7f5bfff700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f6005ee30 0x7f7f600612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.436+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f7f6407b350 con 0x7f7f5c003910 2023-05-17T14:54:54.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.436+0000 7f7f737fe700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f6005ee30 0x7f7f600612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.436+0000 7f7f737fe700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f6005ee30 0x7f7f600612f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7f74157e40 tx=0x7f7f68001e50).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.440+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f6404c820 con 0x7f7f5c003910 2023-05-17T14:54:54.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.640+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f741575e0 con 0x7f7f6005ee30 2023-05-17T14:54:54.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.644+0000 7f7f5bfff700 1 -- 172.21.15.27:0/2350053306 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f7f741575e0 con 0x7f7f6005ee30 2023-05-17T14:54:54.648 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir5 2023-05-17T14:54:54.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f6005ee30 msgr2=0x7f7f600612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f6005ee30 0x7f7f600612f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7f74157e40 tx=0x7f7f68001e50).stop 2023-05-17T14:54:54.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 msgr2=0x7f7f740ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f740ae9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f7f6401b520 tx=0x7f7f6401a000).stop 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 shutdown_connections 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7f6005ee30 0x7f7f600612f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f74150370 0x7f7f74153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f5c003910 0x7f7f740ae9b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 --2- 172.21.15.27:0/2350053306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f740c22b0 0x7f7f740c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 >> 172.21.15.27:0/2350053306 conn(0x7f7f740cae10 msgr2=0x7f7f740c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:54.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 shutdown_connections 2023-05-17T14:54:54.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.646+0000 7f7f7a941700 1 -- 172.21.15.27:0/2350053306 wait complete. 2023-05-17T14:54:54.661 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-05-17T14:54:54.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:54.662 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-05-17T14:54:54.678 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-05-17T14:54:54.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.835+0000 7f2b2eb16700 1 Processor -- start 2023-05-17T14:54:54.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.835+0000 7f2b2eb16700 1 -- start start 2023-05-17T14:54:54.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.836+0000 7f2b2eb16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28151c90 0x7f2b28152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.836+0000 7f2b2eb16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 0x7f2b280c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.836+0000 7f2b2eb16700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b28158010 con 0x7f2b280c0520 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.836+0000 7f2b2eb16700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b28154f60 con 0x7f2b28154980 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.836+0000 7f2b2eb16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28155240 con 0x7f2b28151c90 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.836+0000 7f2b27fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 0x7f2b280c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2c8b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28151c90 0x7f2b28152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b27fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 0x7f2b280c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:53820/0 (socket says 172.21.15.27:53820) 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b27fff700 1 -- 172.21.15.27:0/3609241541 learned_addr learned my addr 172.21.15.27:0/3609241541 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:54.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2d0b3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b280c0520 0x7f2b28081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:41454/0 (socket says 172.21.15.27:41454) 2023-05-17T14:54:54.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/3609241541 >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 msgr2=0x7f2b280c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:54.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2c8b2700 1 --2- 172.21.15.27:0/3609241541 >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 0x7f2b280c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/3609241541 >> v1:172.21.15.40:6789/0 conn(0x7f2b280c0520 legacy=0x7f2b28081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/3609241541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28155520 con 0x7f2b28151c90 2023-05-17T14:54:54.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b27fff700 1 --2- 172.21.15.27:0/3609241541 >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 0x7f2b280c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:54.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b2c8b2700 1 --2- 172.21.15.27:0/3609241541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28151c90 0x7f2b28152070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2b20009760 tx=0x7f2b20009060).ready entity=mon.2 client_cookie=7401cb71f3a1e431 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b277fe700 1 -- 172.21.15.27:0/3609241541 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000f510 con 0x7f2b28151c90 2023-05-17T14:54:54.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b277fe700 1 -- 172.21.15.27:0/3609241541 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000f670 con 0x7f2b28151c90 2023-05-17T14:54:54.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.837+0000 7f2b277fe700 1 -- 172.21.15.27:0/3609241541 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000f9f0 con 0x7f2b28151c90 2023-05-17T14:54:54.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 -- 172.21.15.27:0/3609241541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28151c90 msgr2=0x7f2b28152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/3609241541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28151c90 0x7f2b28152070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2b20009760 tx=0x7f2b20009060).stop 2023-05-17T14:54:54.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 -- 172.21.15.27:0/3609241541 shutdown_connections 2023-05-17T14:54:54.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/3609241541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28151c90 0x7f2b28152070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/3609241541 >> v2:172.21.15.40:3300/0 conn(0x7f2b28154980 0x7f2b280c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 -- 172.21.15.27:0/3609241541 >> 172.21.15.27:0/3609241541 conn(0x7f2b280cae10 msgr2=0x7f2b280cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:54.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 -- 172.21.15.27:0/3609241541 shutdown_connections 2023-05-17T14:54:54.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.838+0000 7f2b2eb16700 1 -- 172.21.15.27:0/3609241541 wait complete. 2023-05-17T14:54:54.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.839+0000 7f2b2eb16700 1 Processor -- start 2023-05-17T14:54:54.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.839+0000 7f2b2eb16700 1 -- start start 2023-05-17T14:54:54.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2eb16700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 0x7f2b2815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2eb16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b28151c90 0x7f2b28150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2eb16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28154980 0x7f2b280ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2eb16700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280c2e60 con 0x7f2b280c0520 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2eb16700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815a970 con 0x7f2b28151c90 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2eb16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280c2250 con 0x7f2b28154980 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 0x7f2b2815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 0x7f2b2815a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35892/0 (socket says 172.21.15.27:35892) 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/477685903 learned_addr learned my addr 172.21.15.27:0/477685903 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2d0b3700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28154980 0x7f2b280ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b27fff700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b28151c90 0x7f2b28150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28154980 msgr2=0x7f2b280ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28154980 0x7f2b280ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b28151c90 msgr2=0x7f2b28150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b28151c90 0x7f2b28150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 -- 172.21.15.27:0/477685903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18009ae0 con 0x7f2b280c0520 2023-05-17T14:54:54.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2d0b3700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28154980 0x7f2b280ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b27fff700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b28151c90 0x7f2b28150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.840+0000 7f2b2c8b2700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 0x7f2b2815a480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f2b28155380 tx=0x7f2b20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.841+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000f7e0 con 0x7f2b280c0520 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.841+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000f940 con 0x7f2b280c0520 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.841+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b200092a0 con 0x7f2b280c0520 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.841+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2001b660 con 0x7f2b280c0520 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.841+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b280c2810 con 0x7f2b280c0520 2023-05-17T14:54:54.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.842+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2806bdf0 con 0x7f2b280c0520 2023-05-17T14:54:54.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.842+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f2b2000f070 con 0x7f2b280c0520 2023-05-17T14:54:54.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.842+0000 7f2b24ff9700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b0805ee30 0x7f2b080612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:54.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.842+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2b2007b8e0 con 0x7f2b280c0520 2023-05-17T14:54:54.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.842+0000 7f2b27fff700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b0805ee30 0x7f2b080612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:54.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.843+0000 7f2b27fff700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b0805ee30 0x7f2b080612f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f2b180072d0 tx=0x7f2b1800b040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:54.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:54.847+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b2004cd00 con 0x7f2b280c0520 2023-05-17T14:54:55.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.043+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b280c2fa0 con 0x7f2b0805ee30 2023-05-17T14:54:55.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.047+0000 7f2b24ff9700 1 -- 172.21.15.27:0/477685903 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2b18009200 con 0x7f2b0805ee30 2023-05-17T14:54:55.051 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir6 2023-05-17T14:54:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b0805ee30 msgr2=0x7f2b080612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b0805ee30 0x7f2b080612f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f2b180072d0 tx=0x7f2b1800b040).stop 2023-05-17T14:54:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 msgr2=0x7f2b2815a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 0x7f2b2815a480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f2b28155380 tx=0x7f2b20017000).stop 2023-05-17T14:54:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 shutdown_connections 2023-05-17T14:54:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b0805ee30 0x7f2b080612f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.048+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b28154980 0x7f2b280ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.049+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b280c0520 0x7f2b2815a480 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.049+0000 7f2b2eb16700 1 --2- 172.21.15.27:0/477685903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b28151c90 0x7f2b28150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.049+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 >> 172.21.15.27:0/477685903 conn(0x7f2b280cae10 msgr2=0x7f2b280c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:55.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.049+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 shutdown_connections 2023-05-17T14:54:55.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.049+0000 7f2b2eb16700 1 -- 172.21.15.27:0/477685903 wait complete. 2023-05-17T14:54:55.064 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-05-17T14:54:55.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:55.065 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-05-17T14:54:55.080 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-05-17T14:54:55.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 Processor -- start 2023-05-17T14:54:55.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 -- start start 2023-05-17T14:54:55.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38d0152070 0x7f38d0154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f38d00c0520 0x7f38d0081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d0158010 con 0x7f38d0151c90 2023-05-17T14:54:55.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d0154f60 con 0x7f38d00c0520 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.239+0000 7f38d5c6a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d0155240 con 0x7f38d0152070 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cf7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f38d0151c90 0x7f38d00c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35462/0 (socket says 172.21.15.27:35462) 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cf7fe700 1 -- 172.21.15.27:0/1261347821 learned_addr learned my addr 172.21.15.27:0/1261347821 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cffff700 1 --2- 172.21.15.27:0/1261347821 >> v2:172.21.15.27:3300/0 conn(0x7f38d00c0520 0x7f38d0081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38ce7fc700 1 -- 172.21.15.27:0/1261347821 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449403079 0 0) 0x7f38d0158010 con 0x7f38d0151c90 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38ceffd700 1 --2- 172.21.15.27:0/1261347821 >> v2:172.21.15.40:3300/0 conn(0x7f38d0152070 0x7f38d0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38ce7fc700 1 -- 172.21.15.27:0/1261347821 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38bc0033f0 con 0x7f38d0151c90 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cffff700 1 -- 172.21.15.27:0/1261347821 >> v2:172.21.15.40:3300/0 conn(0x7f38d0152070 msgr2=0x7f38d0154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cffff700 1 --2- 172.21.15.27:0/1261347821 >> v2:172.21.15.40:3300/0 conn(0x7f38d0152070 0x7f38d0154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cffff700 1 -- 172.21.15.27:0/1261347821 >> v1:172.21.15.27:6789/0 conn(0x7f38d0151c90 legacy=0x7f38d00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cffff700 1 -- 172.21.15.27:0/1261347821 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0155520 con 0x7f38d00c0520 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38cffff700 1 --2- 172.21.15.27:0/1261347821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d00c0520 0x7f38d0081fd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f38d0083ff0 tx=0x7f38c8009780).ready entity=mon.0 client_cookie=4a6015682abbbaf3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38ce7fc700 1 -- 172.21.15.27:0/1261347821 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800e070 con 0x7f38d00c0520 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38ce7fc700 1 -- 172.21.15.27:0/1261347821 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800bb60 con 0x7f38d00c0520 2023-05-17T14:54:55.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.240+0000 7f38ce7fc700 1 -- 172.21.15.27:0/1261347821 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8012410 con 0x7f38d00c0520 2023-05-17T14:54:55.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 -- 172.21.15.27:0/1261347821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d00c0520 msgr2=0x7f38d0081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/1261347821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d00c0520 0x7f38d0081fd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f38d0083ff0 tx=0x7f38c8009780).stop 2023-05-17T14:54:55.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 -- 172.21.15.27:0/1261347821 shutdown_connections 2023-05-17T14:54:55.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/1261347821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d00c0520 0x7f38d0081fd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/1261347821 >> v2:172.21.15.40:3300/0 conn(0x7f38d0152070 0x7f38d0154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 -- 172.21.15.27:0/1261347821 >> 172.21.15.27:0/1261347821 conn(0x7f38d00cae10 msgr2=0x7f38d00cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:55.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 -- 172.21.15.27:0/1261347821 shutdown_connections 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.241+0000 7f38d5c6a700 1 -- 172.21.15.27:0/1261347821 wait complete. 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.242+0000 7f38d5c6a700 1 Processor -- start 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.242+0000 7f38d5c6a700 1 -- start start 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38d5c6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d00c0520 0x7f38d0167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38d5c6a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 0x7f38d00af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38d5c6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0152070 0x7f38d0150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38d5c6a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00ae0c0 con 0x7f38d0151c90 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38d5c6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00b0ea0 con 0x7f38d00c0520 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38d5c6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00b0bc0 con 0x7f38d0152070 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 0x7f38d00af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 0x7f38d00af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35908/0 (socket says 172.21.15.27:35908) 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 -- 172.21.15.27:0/376877926 learned_addr learned my addr 172.21.15.27:0/376877926 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38cffff700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0152070 0x7f38d0150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38cf7fe700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d00c0520 0x7f38d0167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 -- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0152070 msgr2=0x7f38d0150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0152070 0x7f38d0150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 -- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d00c0520 msgr2=0x7f38d0167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d00c0520 0x7f38d0167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 -- 172.21.15.27:0/376877926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8009a20 con 0x7f38d0151c90 2023-05-17T14:54:55.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38cf7fe700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d00c0520 0x7f38d0167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:55.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38cffff700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0152070 0x7f38d0150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38ceffd700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 0x7f38d00af180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f38c000d890 tx=0x7f38c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00125f0 con 0x7f38d0151c90 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0012750 con 0x7f38d0151c90 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.243+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0012ad0 con 0x7f38d0151c90 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.244+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d00ae6a0 con 0x7f38d0151c90 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.244+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d00aec60 con 0x7f38d0151c90 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.244+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d006bdf0 con 0x7f38d0151c90 2023-05-17T14:54:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.245+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f38c0013480 con 0x7f38d0151c90 2023-05-17T14:54:55.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.245+0000 7f38c77fe700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f38b005ee30 0x7f38b00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.245+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f38c007a000 con 0x7f38d0151c90 2023-05-17T14:54:55.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.245+0000 7f38cf7fe700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f38b005ee30 0x7f38b00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.246+0000 7f38cf7fe700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f38b005ee30 0x7f38b00612f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f38b8005750 tx=0x7f38b8009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:55.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.250+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38c004b3c0 con 0x7f38d0151c90 2023-05-17T14:54:55.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.449+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f38d0155800 con 0x7f38b005ee30 2023-05-17T14:54:55.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.452+0000 7f38c77fe700 1 -- 172.21.15.27:0/376877926 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f38d0155800 con 0x7f38b005ee30 2023-05-17T14:54:55.456 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir7 2023-05-17T14:54:55.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f38b005ee30 msgr2=0x7f38b00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f38b005ee30 0x7f38b00612f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f38b8005750 tx=0x7f38b8009040).stop 2023-05-17T14:54:55.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 msgr2=0x7f38d00af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 0x7f38d00af180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f38c000d890 tx=0x7f38c0008040).stop 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 shutdown_connections 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f38b005ee30 0x7f38b00612f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0152070 0x7f38d0150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d00c0520 0x7f38d0167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 --2- 172.21.15.27:0/376877926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0151c90 0x7f38d00af180 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 >> 172.21.15.27:0/376877926 conn(0x7f38d00cae10 msgr2=0x7f38d00c0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:55.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 shutdown_connections 2023-05-17T14:54:55.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.454+0000 7f38d5c6a700 1 -- 172.21.15.27:0/376877926 wait complete. 2023-05-17T14:54:55.470 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-05-17T14:54:55.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:55.470 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-05-17T14:54:55.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-05-17T14:54:55.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.643+0000 7f38ac67f700 1 Processor -- start 2023-05-17T14:54:55.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.643+0000 7f38ac67f700 1 -- start start 2023-05-17T14:54:55.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38ac67f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f38a40826e0 0x7f38a415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38ac67f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a40c1610 con 0x7f38a4153fa0 2023-05-17T14:54:55.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38ac67f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a40abe60 con 0x7f38a40c0420 2023-05-17T14:54:55.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38ac67f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a40c0a00 con 0x7f38a40826e0 2023-05-17T14:54:55.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aa41b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f38a4153fa0 0x7f38a40aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35476/0 (socket says 172.21.15.27:35476) 2023-05-17T14:54:55.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aa41b700 1 -- 172.21.15.27:0/473239777 learned_addr learned my addr 172.21.15.27:0/473239777 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:55.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aac1c700 1 --2- 172.21.15.27:0/473239777 >> v2:172.21.15.27:3300/0 conn(0x7f38a40826e0 0x7f38a415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38a9419700 1 -- 172.21.15.27:0/473239777 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251831024 0 0) 0x7f38a40c1610 con 0x7f38a4153fa0 2023-05-17T14:54:55.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38a9419700 1 -- 172.21.15.27:0/473239777 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38900033f0 con 0x7f38a4153fa0 2023-05-17T14:54:55.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aac1c700 1 -- 172.21.15.27:0/473239777 >> v1:172.21.15.40:6789/0 conn(0x7f38a40c0420 legacy=0x7f38a4081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:55.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aac1c700 1 -- 172.21.15.27:0/473239777 >> v1:172.21.15.27:6789/0 conn(0x7f38a4153fa0 legacy=0x7f38a40aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aac1c700 1 -- 172.21.15.27:0/473239777 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40c0ce0 con 0x7f38a40826e0 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.644+0000 7f38aac1c700 1 --2- 172.21.15.27:0/473239777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a415ecb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f389c009e60 tx=0x7f389c009780).ready entity=mon.0 client_cookie=c16f91050178d15a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38a9419700 1 -- 172.21.15.27:0/473239777 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00e070 con 0x7f38a40826e0 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38a9419700 1 -- 172.21.15.27:0/473239777 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00bb20 con 0x7f38a40826e0 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38a9419700 1 -- 172.21.15.27:0/473239777 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00bea0 con 0x7f38a40826e0 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 -- 172.21.15.27:0/473239777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 msgr2=0x7f38a415ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 --2- 172.21.15.27:0/473239777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a415ecb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f389c009e60 tx=0x7f389c009780).stop 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 -- 172.21.15.27:0/473239777 shutdown_connections 2023-05-17T14:54:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 --2- 172.21.15.27:0/473239777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a415ecb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 -- 172.21.15.27:0/473239777 >> 172.21.15.27:0/473239777 conn(0x7f38a405e820 msgr2=0x7f38a40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 -- 172.21.15.27:0/473239777 shutdown_connections 2023-05-17T14:54:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.645+0000 7f38ac67f700 1 -- 172.21.15.27:0/473239777 wait complete. 2023-05-17T14:54:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.646+0000 7f38ac67f700 1 Processor -- start 2023-05-17T14:54:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.646+0000 7f38ac67f700 1 -- start start 2023-05-17T14:54:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38ac67f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38ac67f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38a40c0420 0x7f38a40c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38ac67f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a4153fa0 0x7f38a40c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38ac67f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41573f0 con 0x7f38a40826e0 2023-05-17T14:54:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38ac67f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41576d0 con 0x7f38a4153fa0 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38ac67f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41579b0 con 0x7f38a40c0420 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a41408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35920/0 (socket says 172.21.15.27:35920) 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 -- 172.21.15.27:0/3049395340 learned_addr learned my addr 172.21.15.27:0/3049395340 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38a9c1a700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38a40c0420 0x7f38a40c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aac1c700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a4153fa0 0x7f38a40c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 -- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38a40c0420 msgr2=0x7f38a40c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38a40c0420 0x7f38a40c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 -- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a4153fa0 msgr2=0x7f38a40c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a4153fa0 0x7f38a40c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38aa41b700 1 -- 172.21.15.27:0/3049395340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c009a20 con 0x7f38a40826e0 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.647+0000 7f38a9c1a700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38a40c0420 0x7f38a40c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.648+0000 7f38aa41b700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a41408d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f38a000c420 tx=0x7f38a0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.648+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00072e0 con 0x7f38a40826e0 2023-05-17T14:54:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.648+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0007440 con 0x7f38a40826e0 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.648+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a4157c90 con 0x7f38a40826e0 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.648+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00057a0 con 0x7f38a40826e0 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.648+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a41446f0 con 0x7f38a40826e0 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.649+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a41581b0 con 0x7f38a40826e0 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.649+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f38a001a060 con 0x7f38a40826e0 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.650+0000 7f389a7fc700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f388805ee30 0x7f38880612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.650+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f38a0079110 con 0x7f38a40826e0 2023-05-17T14:54:55.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.650+0000 7f38a9c1a700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f388805ee30 0x7f38880612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:55.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.650+0000 7f38a9c1a700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f388805ee30 0x7f38880612f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f38940026f0 tx=0x7f3894009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:55.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.654+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38a004a530 con 0x7f38a40826e0 2023-05-17T14:54:55.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.851+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f38a40c0fc0 con 0x7f388805ee30 2023-05-17T14:54:55.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.854+0000 7f389a7fc700 1 -- 172.21.15.27:0/3049395340 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f38a40c0fc0 con 0x7f388805ee30 2023-05-17T14:54:55.858 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir8 2023-05-17T14:54:55.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f388805ee30 msgr2=0x7f38880612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f388805ee30 0x7f38880612f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f38940026f0 tx=0x7f3894009040).stop 2023-05-17T14:54:55.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 msgr2=0x7f38a41408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a41408d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f38a000c420 tx=0x7f38a0007c80).stop 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 shutdown_connections 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f388805ee30 0x7f38880612f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a4153fa0 0x7f38a40c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a40826e0 0x7f38a41408d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 --2- 172.21.15.27:0/3049395340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38a40c0420 0x7f38a40c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 >> 172.21.15.27:0/3049395340 conn(0x7f38a405e820 msgr2=0x7f38a40c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:55.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 shutdown_connections 2023-05-17T14:54:55.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:55.856+0000 7f38ac67f700 1 -- 172.21.15.27:0/3049395340 wait complete. 2023-05-17T14:54:55.871 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-05-17T14:54:55.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T14:54:55.872 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-05-17T14:54:55.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-05-17T14:54:56.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.043+0000 7fc504517700 1 Processor -- start 2023-05-17T14:54:56.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.043+0000 7fc504517700 1 -- start start 2023-05-17T14:54:56.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc504517700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 0x7fc4fc0c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc504517700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4fc0aa130 0x7fc4fc081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc504517700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0c1610 con 0x7fc4fc0824c0 2023-05-17T14:54:56.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc504517700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc082930 con 0x7fc4fc0aa130 2023-05-17T14:54:56.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc504517700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0abe60 con 0x7fc4fc153fa0 2023-05-17T14:54:56.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc502ab4700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc4fc0824c0 0x7fc4fc068de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35492/0 (socket says 172.21.15.27:35492) 2023-05-17T14:54:56.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc502ab4700 1 -- 172.21.15.27:0/798253202 learned_addr learned my addr 172.21.15.27:0/798253202 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:56.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc5022b3700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 0x7fc4fc0c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc501ab2700 1 --2- 172.21.15.27:0/798253202 >> v2:172.21.15.40:3300/0 conn(0x7fc4fc0aa130 0x7fc4fc081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881811964 0 0) 0x7fc4fc0c1610 con 0x7fc4fc0824c0 2023-05-17T14:54:56.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.044+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e40033f0 con 0x7fc4fc0824c0 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972270911 0 0) 0x7fc4e40033f0 con 0x7fc4fc0824c0 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 msgr2=0x7fc4fc0c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 0x7fc4fc0c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 >> v2:172.21.15.40:3300/0 conn(0x7fc4fc0aa130 msgr2=0x7fc4fc081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 --2- 172.21.15.27:0/798253202 >> v2:172.21.15.40:3300/0 conn(0x7fc4fc0aa130 0x7fc4fc081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0c0a00 con 0x7fc4fc0824c0 2023-05-17T14:54:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fc4ec0017f0 con 0x7fc4fc0824c0 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 >> v1:172.21.15.27:6789/0 conn(0x7fc4fc0824c0 legacy=0x7fc4fc068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 0x7fc4e40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e4003e10 0x7fc4e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e4004b80 0x7fc4e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc082930 con 0x7fc4e4003e10 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0abe60 con 0x7fc4e4004b80 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e400b8e0 con 0x7fc4fc153fa0 2023-05-17T14:54:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e4003e10 0x7fc4e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5022b3700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 0x7fc4e40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc502ab4700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e4004b80 0x7fc4e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 -- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 msgr2=0x7fc4e40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4fc153fa0 0x7fc4e40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 -- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e4004b80 msgr2=0x7fc4e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e4004b80 0x7fc4e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 -- 172.21.15.27:0/798253202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e40033f0 con 0x7fc4e4003e10 2023-05-17T14:54:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc502ab4700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e4004b80 0x7fc4e4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc501ab2700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e4003e10 0x7fc4e4004690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fc4f0009a80 tx=0x7fc4f0009060).ready entity=mon.0 client_cookie=f8dea3f95e47e409 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0009430 con 0x7fc4e4003e10 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f000e640 con 0x7fc4e4003e10 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.045+0000 7fc5012b1700 1 -- 172.21.15.27:0/798253202 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000e9c0 con 0x7fc4e4003e10 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc504517700 1 -- 172.21.15.27:0/798253202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e4003e10 msgr2=0x7fc4e4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc504517700 1 --2- 172.21.15.27:0/798253202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4e4003e10 0x7fc4e4004690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fc4f0009a80 tx=0x7fc4f0009060).stop 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc502ab4700 1 -- 172.21.15.27:0/798253202 reap_dead start 2023-05-17T14:54:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc504517700 1 -- 172.21.15.27:0/798253202 shutdown_connections 2023-05-17T14:54:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc504517700 1 -- 172.21.15.27:0/798253202 >> 172.21.15.27:0/798253202 conn(0x7fc4fc05e820 msgr2=0x7fc4fc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc504517700 1 -- 172.21.15.27:0/798253202 shutdown_connections 2023-05-17T14:54:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.046+0000 7fc504517700 1 -- 172.21.15.27:0/798253202 wait complete. 2023-05-17T14:54:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.047+0000 7fc504517700 1 Processor -- start 2023-05-17T14:54:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.047+0000 7fc504517700 1 -- start start 2023-05-17T14:54:56.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc504517700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4e4003e10 0x7fc4fc0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc504517700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 0x7fc4fc0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc504517700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4fc0af030 0x7fc4fc167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc504517700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc14f600 con 0x7fc4fc0b0990 2023-05-17T14:54:56.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc504517700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c4c60 con 0x7fc4fc0af030 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc504517700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc167fb0 con 0x7fc4e4003e10 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 0x7fc4fc0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 0x7fc4fc0aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35942/0 (socket says 172.21.15.27:35942) 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 -- 172.21.15.27:0/2817396406 learned_addr learned my addr 172.21.15.27:0/2817396406 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 -- 172.21.15.27:0/2817396406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4e4003e10 msgr2=0x7fc4fc0b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4e4003e10 0x7fc4fc0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:56.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 -- 172.21.15.27:0/2817396406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4fc0af030 msgr2=0x7fc4fc167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4fc0af030 0x7fc4fc167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 -- 172.21.15.27:0/2817396406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc168290 con 0x7fc4fc0b0990 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.048+0000 7fc501ab2700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 0x7fc4fc0aeb40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fc4e40045a0 tx=0x7fc4f001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.049+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000ed30 con 0x7fc4fc0b0990 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.049+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f000ee90 con 0x7fc4fc0b0990 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.049+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc0ae060 con 0x7fc4fc0b0990 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.049+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f001b450 con 0x7fc4fc0b0990 2023-05-17T14:54:56.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.049+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc0ae620 con 0x7fc4fc0b0990 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.049+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc06bdf0 con 0x7fc4fc0b0990 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.050+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fc4f001b840 con 0x7fc4fc0b0990 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.050+0000 7fc4fa7fc700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc4e805ee30 0x7fc4e80612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.050+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc4f007b9f0 con 0x7fc4fc0b0990 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.050+0000 7fc5022b3700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc4e805ee30 0x7fc4e80612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.051+0000 7fc5022b3700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc4e805ee30 0x7fc4e80612f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc4f4006d80 tx=0x7fc4f4009060).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.054+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4f007de60 con 0x7fc4fc0b0990 2023-05-17T14:54:56.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.250+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4fc167d50 con 0x7fc4e805ee30 2023-05-17T14:54:56.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.254+0000 7fc4fa7fc700 1 -- 172.21.15.27:0/2817396406 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc4fc167d50 con 0x7fc4e805ee30 2023-05-17T14:54:56.258 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/dir9 2023-05-17T14:54:56.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc4e805ee30 msgr2=0x7fc4e80612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc4e805ee30 0x7fc4e80612f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc4f4006d80 tx=0x7fc4f4009060).stop 2023-05-17T14:54:56.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 msgr2=0x7fc4fc0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 0x7fc4fc0aeb40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fc4e40045a0 tx=0x7fc4f001a000).stop 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 shutdown_connections 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc4e805ee30 0x7fc4e80612f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4fc0af030 0x7fc4fc167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4e4003e10 0x7fc4fc0b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 --2- 172.21.15.27:0/2817396406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4fc0b0990 0x7fc4fc0aeb40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 >> 172.21.15.27:0/2817396406 conn(0x7fc4fc05e820 msgr2=0x7fc4fc153000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:56.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 shutdown_connections 2023-05-17T14:54:56.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.256+0000 7fc504517700 1 -- 172.21.15.27:0/2817396406 wait complete. 2023-05-17T14:54:56.271 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-05-17T14:54:56.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-05-17T14:54:56.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.388+0000 7fb2cd64d700 1 Processor -- start 2023-05-17T14:54:56.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.388+0000 7fb2cd64d700 1 -- start start 2023-05-17T14:54:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2cd64d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2c8153fa0 0x7fb2c80c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2cd64d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2c80aa130 0x7fb2c8081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2cd64d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2cd64d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c80c1610 con 0x7fb2c8153fa0 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2cd64d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c80828f0 con 0x7fb2c80aa130 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2cd64d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80c0a00 con 0x7fb2c80824c0 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2c8153fa0 0x7fb2c80c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2c8153fa0 0x7fb2c80c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35948/0 (socket says 172.21.15.27:35948) 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 -- 172.21.15.27:0/3176200888 learned_addr learned my addr 172.21.15.27:0/3176200888 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c67fc700 1 --2- 172.21.15.27:0/3176200888 >> v2:172.21.15.40:3300/0 conn(0x7fb2c80aa130 0x7fb2c8081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 -- 172.21.15.27:0/3176200888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 msgr2=0x7fb2c8068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c77fe700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 -- 172.21.15.27:0/3176200888 >> v2:172.21.15.40:3300/0 conn(0x7fb2c80aa130 msgr2=0x7fb2c8081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 --2- 172.21.15.27:0/3176200888 >> v2:172.21.15.40:3300/0 conn(0x7fb2c80aa130 0x7fb2c8081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c6ffd700 1 -- 172.21.15.27:0/3176200888 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c80c0ce0 con 0x7fb2c8153fa0 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c67fc700 1 --2- 172.21.15.27:0/3176200888 >> v2:172.21.15.40:3300/0 conn(0x7fb2c80aa130 0x7fb2c8081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:56.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.389+0000 7fb2c77fe700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2c6ffd700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c0420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fb2c80cbe30 tx=0x7fb2c0009840).ready entity=mon.0 client_cookie=7bbf12f20bef1721 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2c5ffb700 1 -- 172.21.15.27:0/3176200888 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000e070 con 0x7fb2c8153fa0 2023-05-17T14:54:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2c5ffb700 1 -- 172.21.15.27:0/3176200888 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c000ba50 con 0x7fb2c8153fa0 2023-05-17T14:54:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2c5ffb700 1 -- 172.21.15.27:0/3176200888 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000bdd0 con 0x7fb2c8153fa0 2023-05-17T14:54:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 -- 172.21.15.27:0/3176200888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8153fa0 msgr2=0x7fb2c80c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c0420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fb2c80cbe30 tx=0x7fb2c0009840).stop 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 -- 172.21.15.27:0/3176200888 shutdown_connections 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c0420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/3176200888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/3176200888 >> v2:172.21.15.40:3300/0 conn(0x7fb2c80aa130 0x7fb2c8081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 -- 172.21.15.27:0/3176200888 >> 172.21.15.27:0/3176200888 conn(0x7fb2c805e820 msgr2=0x7fb2c80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 -- 172.21.15.27:0/3176200888 shutdown_connections 2023-05-17T14:54:56.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.390+0000 7fb2cd64d700 1 -- 172.21.15.27:0/3176200888 wait complete. 2023-05-17T14:54:56.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 Processor -- start 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 -- start start 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 0x7fb2c80ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80c28e0 con 0x7fb2c80aa130 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80c1fb0 con 0x7fb2c8153fa0 2023-05-17T14:54:56.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2cd64d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80c2290 con 0x7fb2c80824c0 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2c67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 0x7fb2c80ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2c67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 0x7fb2c80ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35952/0 (socket says 172.21.15.27:35952) 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.392+0000 7fb2c67fc700 1 -- 172.21.15.27:0/4225253510 learned_addr learned my addr 172.21.15.27:0/4225253510 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c77fe700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c6ffd700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c67fc700 1 -- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 msgr2=0x7fb2c8163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c67fc700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8163d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c67fc700 1 -- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c8153fa0 msgr2=0x7fb2c80c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c67fc700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c67fc700 1 -- 172.21.15.27:0/4225253510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0009ae0 con 0x7fb2c80aa130 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2c67fc700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 0x7fb2c80ae770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fb2b000c880 tx=0x7fb2b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0010580 con 0x7fb2c80aa130 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00106e0 con 0x7fb2c80aa130 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c80c2570 con 0x7fb2c80aa130 2023-05-17T14:54:56.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0010a60 con 0x7fb2c80aa130 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.393+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c80add90 con 0x7fb2c80aa130 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.394+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c80c2a50 con 0x7fb2c80aa130 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.394+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fb2b001b460 con 0x7fb2c80aa130 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.395+0000 7fb2beffd700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb2a805ee30 0x7fb2a80612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.395+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fb2b0079e30 con 0x7fb2c80aa130 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.395+0000 7fb2c6ffd700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb2a805ee30 0x7fb2a80612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.395+0000 7fb2c6ffd700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb2a805ee30 0x7fb2a80612f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb2c0009880 tx=0x7fb2c80c1580).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.399+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2b004b1f0 con 0x7fb2c80aa130 2023-05-17T14:54:56.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.600+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2c806bdf0 con 0x7fb2a805ee30 2023-05-17T14:54:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.604+0000 7fb2beffd700 1 -- 172.21.15.27:0/4225253510 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb2c806bdf0 con 0x7fb2a805ee30 2023-05-17T14:54:56.608 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-05-17T14:54:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb2a805ee30 msgr2=0x7fb2a80612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb2a805ee30 0x7fb2a80612f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb2c0009880 tx=0x7fb2c80c1580).stop 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 msgr2=0x7fb2c80ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 0x7fb2c80ae770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fb2b000c880 tx=0x7fb2b0008040).stop 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 shutdown_connections 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb2a805ee30 0x7fb2a80612f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c8153fa0 0x7fb2c80c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c80824c0 0x7fb2c8163d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 --2- 172.21.15.27:0/4225253510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c80aa130 0x7fb2c80ae770 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.606+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 >> 172.21.15.27:0/4225253510 conn(0x7fb2c805e820 msgr2=0x7fb2c80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:56.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.607+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 shutdown_connections 2023-05-17T14:54:56.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.607+0000 7fb2cd64d700 1 -- 172.21.15.27:0/4225253510 wait complete. 2023-05-17T14:54:56.622 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-05-17T14:54:56.622 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-05-17T14:54:56.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 Processor -- start 2023-05-17T14:54:56.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 -- start start 2023-05-17T14:54:56.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f08a00c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f08a00c5d60 0x7f08a00c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a0154a50 con 0x7f08a00c1080 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a0154d30 con 0x7f08a00c5d60 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.739+0000 7f08a532e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0155010 con 0x7f08a0154520 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f08a00c1080 0x7f08a00c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35520/0 (socket says 172.21.15.27:35520) 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089ffff700 1 -- 172.21.15.27:0/3990790710 learned_addr learned my addr 172.21.15.27:0/3990790710 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089f7fe700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f08a00c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f08a4b2d700 1 --2- 172.21.15.27:0/3990790710 >> v2:172.21.15.40:3300/0 conn(0x7f08a00c5d60 0x7f08a00c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346780597 0 0) 0x7f08a0154a50 con 0x7f08a00c1080 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f088c0033f0 con 0x7f08a00c1080 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089021672 0 0) 0x7f088c0033f0 con 0x7f08a00c1080 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 msgr2=0x7f08a00c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f08a00c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 >> v2:172.21.15.40:3300/0 conn(0x7f08a00c5d60 msgr2=0x7f08a00c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 --2- 172.21.15.27:0/3990790710 >> v2:172.21.15.40:3300/0 conn(0x7f08a00c5d60 0x7f08a00c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a01552f0 con 0x7f08a00c1080 2023-05-17T14:54:56.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f0890001470 con 0x7f08a00c1080 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089f7fe700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f08a00c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 >> v1:172.21.15.27:6789/0 conn(0x7f08a00c1080 legacy=0x7f08a00c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f088c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f088c003dd0 0x7f088c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c004b80 0x7f088c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0154d30 con 0x7f088c004b80 2023-05-17T14:54:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0155010 con 0x7f088c003dd0 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c00b8e0 con 0x7f08a0154520 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f08a4b2d700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c004b80 0x7f088c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089f7fe700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f088c003dd0 0x7f088c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.740+0000 7f089ffff700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f088c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 -- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 msgr2=0x7f088c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a0154520 0x7f088c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 -- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f088c003dd0 msgr2=0x7f088c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f088c003dd0 0x7f088c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 -- 172.21.15.27:0/3990790710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880092a0 con 0x7f088c004b80 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c004b80 0x7f088c005000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f089800e210 tx=0x7f089800b040).ready entity=mon.0 client_cookie=fddec8f5e33fcfa7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898009ac0 con 0x7f088c004b80 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089800f040 con 0x7f088c004b80 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f089effd700 1 -- 172.21.15.27:0/3990790710 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089800ecd0 con 0x7f088c004b80 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a532e700 1 -- 172.21.15.27:0/3990790710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c004b80 msgr2=0x7f088c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a532e700 1 --2- 172.21.15.27:0/3990790710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f088c004b80 0x7f088c005000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f089800e210 tx=0x7f089800b040).stop 2023-05-17T14:54:56.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a4b2d700 1 -- 172.21.15.27:0/3990790710 reap_dead start 2023-05-17T14:54:56.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a532e700 1 -- 172.21.15.27:0/3990790710 shutdown_connections 2023-05-17T14:54:56.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a532e700 1 -- 172.21.15.27:0/3990790710 >> 172.21.15.27:0/3990790710 conn(0x7f08a005dd50 msgr2=0x7f08a005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:56.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a532e700 1 -- 172.21.15.27:0/3990790710 shutdown_connections 2023-05-17T14:54:56.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.741+0000 7f08a532e700 1 -- 172.21.15.27:0/3990790710 wait complete. 2023-05-17T14:54:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.742+0000 7f08a532e700 1 Processor -- start 2023-05-17T14:54:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 -- start start 2023-05-17T14:54:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a014fc10 0x7f08a00c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 0x7f08a00ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08a01681f0 0x7f08a0159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0167d60 con 0x7f08a014fff0 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00ae980 con 0x7f08a01681f0 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.743+0000 7f08a532e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00aec50 con 0x7f08a014fc10 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 0x7f08a00ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 0x7f08a00ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35972/0 (socket says 172.21.15.27:35972) 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 -- 172.21.15.27:0/4242739314 learned_addr learned my addr 172.21.15.27:0/4242739314 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089ffff700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a014fc10 0x7f08a00c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f08a4b2d700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08a01681f0 0x7f08a0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 -- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a014fc10 msgr2=0x7f08a00c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a014fc10 0x7f08a00c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 -- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08a01681f0 msgr2=0x7f08a0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08a01681f0 0x7f08a0159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 -- 172.21.15.27:0/4242739314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00aef30 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f089f7fe700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 0x7f08a00ae490 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f0888011b40 tx=0x7f0888009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800f940 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800faa0 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a01679f0 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800fe20 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.744+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a0159780 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.745+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a0047150 con 0x7f08a014fff0 2023-05-17T14:54:56.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.745+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f0888024070 con 0x7f08a014fff0 2023-05-17T14:54:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.746+0000 7f0897fff700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f088005ee30 0x7f08800612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.746+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f088807a8d0 con 0x7f08a014fff0 2023-05-17T14:54:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.746+0000 7f089ffff700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f088005ee30 0x7f08800612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.746+0000 7f089ffff700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f088005ee30 0x7f08800612f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0890001ed0 tx=0x7f0890007040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.750+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f088804bcf0 con 0x7f08a014fff0 2023-05-17T14:54:56.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.951+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f08a0167870 con 0x7f088005ee30 2023-05-17T14:54:56.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.955+0000 7f0897fff700 1 -- 172.21.15.27:0/4242739314 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0890010040 con 0x7f088005ee30 2023-05-17T14:54:56.959 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-05-17T14:54:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f088005ee30 msgr2=0x7f08800612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f088005ee30 0x7f08800612f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0890001ed0 tx=0x7f0890007040).stop 2023-05-17T14:54:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 msgr2=0x7f08a00ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 0x7f08a00ae490 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f0888011b40 tx=0x7f0888009060).stop 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 shutdown_connections 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f088005ee30 0x7f08800612f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08a01681f0 0x7f08a0159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08a014fc10 0x7f08a00c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 --2- 172.21.15.27:0/4242739314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a014fff0 0x7f08a00ae490 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 >> 172.21.15.27:0/4242739314 conn(0x7f08a005dd50 msgr2=0x7f08a0153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 shutdown_connections 2023-05-17T14:54:56.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:56.957+0000 7f08a532e700 1 -- 172.21.15.27:0/4242739314 wait complete. 2023-05-17T14:54:56.973 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-05-17T14:54:56.973 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-05-17T14:54:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.090+0000 7f5c87f7d700 1 Processor -- start 2023-05-17T14:54:57.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.090+0000 7f5c87f7d700 1 -- start start 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c87f7d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5c80153fa0 0x7f5c800c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c87f7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800aa130 0x7f5c80081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c87f7d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800c1610 con 0x7f5c800824c0 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c87f7d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c80082910 con 0x7f5c80153fa0 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c87f7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800abe60 con 0x7f5c800aa130 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85d19700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5c80153fa0 0x7f5c800c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c8651a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5c800824c0 0x7f5c80068de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35542/0 (socket says 172.21.15.27:35542) 2023-05-17T14:54:57.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c8651a700 1 -- 172.21.15.27:0/3259970735 learned_addr learned my addr 172.21.15.27:0/3259970735 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:57.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85518700 1 --2- 172.21.15.27:0/3259970735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800aa130 0x7f5c80081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85d19700 1 -- 172.21.15.27:0/3259970735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800aa130 msgr2=0x7f5c80081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:57.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85d19700 1 --2- 172.21.15.27:0/3259970735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800aa130 0x7f5c80081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85d19700 1 -- 172.21.15.27:0/3259970735 >> v1:172.21.15.27:6789/0 conn(0x7f5c800824c0 legacy=0x7f5c80068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85d19700 1 -- 172.21.15.27:0/3259970735 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800c0a00 con 0x7f5c80153fa0 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c84d17700 1 -- 172.21.15.27:0/3259970735 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700628104 0 0) 0x7f5c800c1610 con 0x7f5c800824c0 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.091+0000 7f5c85d19700 1 --2- 172.21.15.27:0/3259970735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c80153fa0 0x7f5c800c0420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5c78009e60 tx=0x7f5c78009780).ready entity=mon.0 client_cookie=f63dfcb2663e31d1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c84d17700 1 -- 172.21.15.27:0/3259970735 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800e070 con 0x7f5c80153fa0 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c84d17700 1 -- 172.21.15.27:0/3259970735 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800bc30 con 0x7f5c80153fa0 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c84d17700 1 -- 172.21.15.27:0/3259970735 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78012410 con 0x7f5c80153fa0 2023-05-17T14:54:57.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 -- 172.21.15.27:0/3259970735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c80153fa0 msgr2=0x7f5c800c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/3259970735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c80153fa0 0x7f5c800c0420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5c78009e60 tx=0x7f5c78009780).stop 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 -- 172.21.15.27:0/3259970735 shutdown_connections 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/3259970735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c80153fa0 0x7f5c800c0420 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/3259970735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800aa130 0x7f5c80081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 -- 172.21.15.27:0/3259970735 >> 172.21.15.27:0/3259970735 conn(0x7f5c8005e820 msgr2=0x7f5c800cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 -- 172.21.15.27:0/3259970735 shutdown_connections 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.092+0000 7f5c87f7d700 1 -- 172.21.15.27:0/3259970735 wait complete. 2023-05-17T14:54:57.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.093+0000 7f5c87f7d700 1 Processor -- start 2023-05-17T14:54:57.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.093+0000 7f5c87f7d700 1 -- start start 2023-05-17T14:54:57.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c87f7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800824c0 0x7f5c80164aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c87f7d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 0x7f5c800b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c87f7d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c80153fa0 0x7f5c800c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c87f7d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800c47a0 con 0x7f5c800aa130 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c87f7d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80165360 con 0x7f5c80153fa0 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c87f7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80164f90 con 0x7f5c800824c0 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 0x7f5c800b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 0x7f5c800b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35984/0 (socket says 172.21.15.27:35984) 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 -- 172.21.15.27:0/69626472 learned_addr learned my addr 172.21.15.27:0/69626472 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c8651a700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c80153fa0 0x7f5c800c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85d19700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800824c0 0x7f5c80164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 -- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800824c0 msgr2=0x7f5c80164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800824c0 0x7f5c80164aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 -- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c80153fa0 msgr2=0x7f5c800c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c80153fa0 0x7f5c800c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.094+0000 7f5c85518700 1 -- 172.21.15.27:0/69626472 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009a20 con 0x7f5c800aa130 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.095+0000 7f5c85518700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 0x7f5c800b0900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f5c7400c850 tx=0x7f5c74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.095+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74010580 con 0x7f5c800aa130 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.095+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740106e0 con 0x7f5c800aa130 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.095+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800b0df0 con 0x7f5c800aa130 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.095+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74010a60 con 0x7f5c800aa130 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.095+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c800c3f00 con 0x7f5c800aa130 2023-05-17T14:54:57.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.096+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c801654d0 con 0x7f5c800aa130 2023-05-17T14:54:57.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.096+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f5c7401b460 con 0x7f5c800aa130 2023-05-17T14:54:57.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.097+0000 7f5c7dffb700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5c6c05ee00 0x7f5c6c0612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.097+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5c74079e90 con 0x7f5c800aa130 2023-05-17T14:54:57.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.097+0000 7f5c85d19700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5c6c05ee00 0x7f5c6c0612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.097+0000 7f5c85d19700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5c6c05ee00 0x7f5c6c0612c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5c780097c0 tx=0x7f5c800c1580).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.101+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c7404b250 con 0x7f5c800aa130 2023-05-17T14:54:57.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.302+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c8006bdf0 con 0x7f5c6c05ee00 2023-05-17T14:54:57.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.306+0000 7f5c7dffb700 1 -- 172.21.15.27:0/69626472 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5c8006bdf0 con 0x7f5c6c05ee00 2023-05-17T14:54:57.310 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-05-17T14:54:57.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5c6c05ee00 msgr2=0x7f5c6c0612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5c6c05ee00 0x7f5c6c0612c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5c780097c0 tx=0x7f5c800c1580).stop 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 msgr2=0x7f5c800b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 0x7f5c800b0900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f5c7400c850 tx=0x7f5c74008040).stop 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 shutdown_connections 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f5c6c05ee00 0x7f5c6c0612c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c80153fa0 0x7f5c800c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c800824c0 0x7f5c80164aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 --2- 172.21.15.27:0/69626472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c800aa130 0x7f5c800b0900 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.308+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 >> 172.21.15.27:0/69626472 conn(0x7f5c8005e820 msgr2=0x7f5c801531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:57.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.309+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 shutdown_connections 2023-05-17T14:54:57.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.309+0000 7f5c87f7d700 1 -- 172.21.15.27:0/69626472 wait complete. 2023-05-17T14:54:57.324 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-05-17T14:54:57.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-05-17T14:54:57.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.441+0000 7fa244f5a700 1 Processor -- start 2023-05-17T14:54:57.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.441+0000 7fa244f5a700 1 -- start start 2023-05-17T14:54:57.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa244f5a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2400c1460 0x7fa2400a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa244f5a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa240154a50 con 0x7fa2400c1080 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa244f5a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa240154d30 con 0x7fa240154520 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa244f5a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa240155010 con 0x7fa2400c1460 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa2400c1080 0x7fa2400c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35554/0 (socket says 172.21.15.27:35554) 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23f7fe700 1 -- 172.21.15.27:0/974426611 learned_addr learned my addr 172.21.15.27:0/974426611 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23ffff700 1 --2- 172.21.15.27:0/974426611 >> v2:172.21.15.40:3300/0 conn(0x7fa2400c1460 0x7fa2400a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882712344 0 0) 0x7fa240154a50 con 0x7fa2400c1080 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa22c0033f0 con 0x7fa2400c1080 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448584791 0 0) 0x7fa22c0033f0 con 0x7fa2400c1080 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 >> v2:172.21.15.40:3300/0 conn(0x7fa2400c1460 msgr2=0x7fa2400a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 --2- 172.21.15.27:0/974426611 >> v2:172.21.15.40:3300/0 conn(0x7fa2400c1460 0x7fa2400a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 >> v1:172.21.15.40:6789/0 conn(0x7fa240154520 legacy=0x7fa2400c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2401552f0 con 0x7fa2400c1080 2023-05-17T14:54:57.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fa228001470 con 0x7fa2400c1080 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 >> v1:172.21.15.27:6789/0 conn(0x7fa2400c1080 legacy=0x7fa2400c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa22c0038e0 0x7fa22c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c004690 0x7fa22c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22c005000 0x7fa22c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa240155010 con 0x7fa22c005000 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c00bf60 con 0x7fa22c004690 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.442+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c00c0f0 con 0x7fa22c0038e0 2023-05-17T14:54:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22c005000 0x7fa22c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23f7fe700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa22c0038e0 0x7fa22c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23effd700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c004690 0x7fa22c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 -- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa22c0038e0 msgr2=0x7fa22c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa22c0038e0 0x7fa22c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 -- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c004690 msgr2=0x7fa22c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c004690 0x7fa22c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 -- 172.21.15.27:0/974426611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0033f0 con 0x7fa22c005000 2023-05-17T14:54:57.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 -- 172.21.15.27:0/974426611 reap_dead start 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23ffff700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22c005000 0x7fa22c00b8e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fa23800e210 tx=0x7fa23800b040).ready entity=mon.0 client_cookie=c3b8a6c710bb63c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238009ac0 con 0x7fa22c005000 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800f040 con 0x7fa22c005000 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.443+0000 7fa23e7fc700 1 -- 172.21.15.27:0/974426611 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800ed10 con 0x7fa22c005000 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 -- 172.21.15.27:0/974426611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22c005000 msgr2=0x7fa22c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22c005000 0x7fa22c00b8e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fa23800e210 tx=0x7fa23800b040).stop 2023-05-17T14:54:57.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 -- 172.21.15.27:0/974426611 shutdown_connections 2023-05-17T14:54:57.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 --2- 172.21.15.27:0/974426611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa22c005000 0x7fa22c00b8e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 -- 172.21.15.27:0/974426611 >> 172.21.15.27:0/974426611 conn(0x7fa24005dd50 msgr2=0x7fa24005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:57.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 -- 172.21.15.27:0/974426611 shutdown_connections 2023-05-17T14:54:57.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.444+0000 7fa244f5a700 1 -- 172.21.15.27:0/974426611 wait complete. 2023-05-17T14:54:57.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.445+0000 7fa244f5a700 1 Processor -- start 2023-05-17T14:54:57.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.445+0000 7fa244f5a700 1 -- start start 2023-05-17T14:54:57.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c005000 0x7fa240165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa240147310 0x7fa2400abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 0x7fa2400c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400ca660 con 0x7fa2400ac090 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400ac510 con 0x7fa22c005000 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400c9560 con 0x7fa240147310 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 0x7fa2400c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 0x7fa2400c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36008/0 (socket says 172.21.15.27:36008) 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 -- 172.21.15.27:0/1726611412 learned_addr learned my addr 172.21.15.27:0/1726611412 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:57.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23f7fe700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c005000 0x7fa240165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23effd700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa240147310 0x7fa2400abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 -- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa240147310 msgr2=0x7fa2400abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa240147310 0x7fa2400abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 -- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c005000 msgr2=0x7fa240165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c005000 0x7fa240165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 -- 172.21.15.27:0/1726611412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400c9840 con 0x7fa2400ac090 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23effd700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa240147310 0x7fa2400abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:57.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa23ffff700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 0x7fa2400c8870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fa240062d60 tx=0x7fa238018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23801d460 con 0x7fa2400ac090 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23801d5c0 con 0x7fa2400ac090 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400ca010 con 0x7fa2400ac090 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23801d980 con 0x7fa2400ac090 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.446+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa240147790 con 0x7fa2400ac090 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.447+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400ca7d0 con 0x7fa2400ac090 2023-05-17T14:54:57.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.448+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fa238019040 con 0x7fa2400ac090 2023-05-17T14:54:57.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.448+0000 7fa2377fe700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa22005ee30 0x7fa2200612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.448+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa23807bd90 con 0x7fa2400ac090 2023-05-17T14:54:57.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.448+0000 7fa23f7fe700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa22005ee30 0x7fa2200612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.448+0000 7fa23f7fe700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa22005ee30 0x7fa2200612f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa228001050 tx=0x7fa228001e50).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.452+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa23804d1b0 con 0x7fa2400ac090 2023-05-17T14:54:57.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.653+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa240047150 con 0x7fa22005ee30 2023-05-17T14:54:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.656+0000 7fa2377fe700 1 -- 172.21.15.27:0/1726611412 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa240047150 con 0x7fa22005ee30 2023-05-17T14:54:57.660 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-05-17T14:54:57.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.658+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa22005ee30 msgr2=0x7fa2200612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.658+0000 7fa244f5a700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa22005ee30 0x7fa2200612f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa228001050 tx=0x7fa228001e50).stop 2023-05-17T14:54:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.658+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 msgr2=0x7fa2400c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.658+0000 7fa244f5a700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 0x7fa2400c8870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fa240062d60 tx=0x7fa238018000).stop 2023-05-17T14:54:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 shutdown_connections 2023-05-17T14:54:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa22005ee30 0x7fa2200612f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2400ac090 0x7fa2400c8870 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa22c005000 0x7fa240165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 --2- 172.21.15.27:0/1726611412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa240147310 0x7fa2400abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 >> 172.21.15.27:0/1726611412 conn(0x7fa24005dd50 msgr2=0x7fa2401512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 shutdown_connections 2023-05-17T14:54:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.659+0000 7fa244f5a700 1 -- 172.21.15.27:0/1726611412 wait complete. 2023-05-17T14:54:57.674 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-05-17T14:54:57.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-05-17T14:54:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.791+0000 7f6316b36700 1 Processor -- start 2023-05-17T14:54:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.791+0000 7f6316b36700 1 -- start start 2023-05-17T14:54:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f6316b36700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6310152070 0x7f6310154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f6316b36700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63100c0520 0x7f6310081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f6316b36700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6310158010 con 0x7f6310151c90 2023-05-17T14:54:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f6316b36700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6310154f60 con 0x7f6310152070 2023-05-17T14:54:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f6316b36700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6310155240 con 0x7f63100c0520 2023-05-17T14:54:57.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f630ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6310152070 0x7f6310154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f63148d2700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6310151c90 0x7f63100c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35574/0 (socket says 172.21.15.27:35574) 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.792+0000 7f63148d2700 1 -- 172.21.15.27:0/1912352557 learned_addr learned my addr 172.21.15.27:0/1912352557 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f63150d3700 1 --2- 172.21.15.27:0/1912352557 >> v2:172.21.15.40:3300/0 conn(0x7f63100c0520 0x7f6310081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630ffff700 1 -- 172.21.15.27:0/1912352557 >> v2:172.21.15.40:3300/0 conn(0x7f63100c0520 msgr2=0x7f6310081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630ffff700 1 --2- 172.21.15.27:0/1912352557 >> v2:172.21.15.40:3300/0 conn(0x7f63100c0520 0x7f6310081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630ffff700 1 -- 172.21.15.27:0/1912352557 >> v1:172.21.15.27:6789/0 conn(0x7f6310151c90 legacy=0x7f63100c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630f7fe700 1 -- 172.21.15.27:0/1912352557 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266389047 0 0) 0x7f6310158010 con 0x7f6310151c90 2023-05-17T14:54:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630ffff700 1 -- 172.21.15.27:0/1912352557 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310155520 con 0x7f6310152070 2023-05-17T14:54:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f63150d3700 1 --2- 172.21.15.27:0/1912352557 >> v2:172.21.15.40:3300/0 conn(0x7f63100c0520 0x7f6310081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630ffff700 1 --2- 172.21.15.27:0/1912352557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6310152070 0x7f6310154980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6310154e70 tx=0x7f6304009060).ready entity=mon.0 client_cookie=f76dff964f99b4f1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630f7fe700 1 -- 172.21.15.27:0/1912352557 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400b580 con 0x7f6310152070 2023-05-17T14:54:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630f7fe700 1 -- 172.21.15.27:0/1912352557 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400b6e0 con 0x7f6310152070 2023-05-17T14:54:57.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.793+0000 7f630f7fe700 1 -- 172.21.15.27:0/1912352557 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400ba60 con 0x7f6310152070 2023-05-17T14:54:57.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 -- 172.21.15.27:0/1912352557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6310152070 msgr2=0x7f6310154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 --2- 172.21.15.27:0/1912352557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6310152070 0x7f6310154980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6310154e70 tx=0x7f6304009060).stop 2023-05-17T14:54:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 -- 172.21.15.27:0/1912352557 shutdown_connections 2023-05-17T14:54:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 --2- 172.21.15.27:0/1912352557 >> v2:172.21.15.40:3300/0 conn(0x7f63100c0520 0x7f6310081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 --2- 172.21.15.27:0/1912352557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6310152070 0x7f6310154980 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 -- 172.21.15.27:0/1912352557 >> 172.21.15.27:0/1912352557 conn(0x7f63100cae10 msgr2=0x7f63100cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 -- 172.21.15.27:0/1912352557 shutdown_connections 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.794+0000 7f6316b36700 1 -- 172.21.15.27:0/1912352557 wait complete. 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.795+0000 7f6316b36700 1 Processor -- start 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.795+0000 7f6316b36700 1 -- start start 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 0x7f63100ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6310151c90 0x7f6310150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6310152070 0x7f63100abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6310159a70 con 0x7f63100c0520 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63100aed30 con 0x7f6310151c90 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63100af010 con 0x7f6310152070 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 0x7f63100ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 0x7f63100ae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36018/0 (socket says 172.21.15.27:36018) 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 -- 172.21.15.27:0/327891038 learned_addr learned my addr 172.21.15.27:0/327891038 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63150d3700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6310152070 0x7f63100abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f630ffff700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6310151c90 0x7f6310150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 -- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6310152070 msgr2=0x7f63100abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6310152070 0x7f63100abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 -- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6310151c90 msgr2=0x7f6310150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6310151c90 0x7f6310150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 -- 172.21.15.27:0/327891038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040092a0 con 0x7f63100c0520 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63150d3700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6310152070 0x7f63100abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f630ffff700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6310151c90 0x7f6310150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:57.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f63148d2700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 0x7f63100ae430 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f630800c960 tx=0x7f6308001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308005d30 con 0x7f63100c0520 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308005e90 con 0x7f63100c0520 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308007320 con 0x7f63100c0520 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63100af2f0 con 0x7f63100c0520 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.796+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63100c1eb0 con 0x7f63100c0520 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.797+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631006bdf0 con 0x7f63100c0520 2023-05-17T14:54:57.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.798+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f6308010030 con 0x7f63100c0520 2023-05-17T14:54:57.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.798+0000 7f630cff9700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f62fc05ee30 0x7f62fc0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:57.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.798+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6308079df0 con 0x7f63100c0520 2023-05-17T14:54:57.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.798+0000 7f630ffff700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f62fc05ee30 0x7f62fc0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:57.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.798+0000 7f630ffff700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f62fc05ee30 0x7f62fc0612f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f63100acd40 tx=0x7f6304017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:57.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.802+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f630804b210 con 0x7f63100c0520 2023-05-17T14:54:58.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:57.999+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6310159bb0 con 0x7f62fc05ee30 2023-05-17T14:54:58.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.003+0000 7f630cff9700 1 -- 172.21.15.27:0/327891038 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f630400b850 con 0x7f62fc05ee30 2023-05-17T14:54:58.007 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-05-17T14:54:58.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.004+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f62fc05ee30 msgr2=0x7f62fc0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.004+0000 7f6316b36700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f62fc05ee30 0x7f62fc0612f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f63100acd40 tx=0x7f6304017000).stop 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.004+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 msgr2=0x7f63100ae430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.004+0000 7f6316b36700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 0x7f63100ae430 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f630800c960 tx=0x7f6308001630).stop 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 shutdown_connections 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f62fc05ee30 0x7f62fc0612f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6310152070 0x7f63100abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63100c0520 0x7f63100ae430 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 --2- 172.21.15.27:0/327891038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6310151c90 0x7f6310150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 >> 172.21.15.27:0/327891038 conn(0x7f63100cae10 msgr2=0x7f6310155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:58.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 shutdown_connections 2023-05-17T14:54:58.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.005+0000 7f6316b36700 1 -- 172.21.15.27:0/327891038 wait complete. 2023-05-17T14:54:58.020 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-05-17T14:54:58.020 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-05-17T14:54:58.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.137+0000 7f2b70c72700 1 Processor -- start 2023-05-17T14:54:58.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.137+0000 7f2b70c72700 1 -- start start 2023-05-17T14:54:58.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b70c72700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2b6c151c90 0x7f2b6c152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b70c72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c154980 0x7f2b6c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b70c72700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c158010 con 0x7f2b6c0c0520 2023-05-17T14:54:58.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b70c72700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c154f60 con 0x7f2b6c151c90 2023-05-17T14:54:58.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b70c72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c155240 con 0x7f2b6c154980 2023-05-17T14:54:58.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2b6c151c90 0x7f2b6c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6ad9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2b6c0c0520 0x7f2b6c081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35592/0 (socket says 172.21.15.27:35592) 2023-05-17T14:54:58.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6ad9d700 1 -- 172.21.15.27:0/1315368077 learned_addr learned my addr 172.21.15.27:0/1315368077 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:58.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b69d9b700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c154980 0x7f2b6c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6a59c700 1 -- 172.21.15.27:0/1315368077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c154980 msgr2=0x7f2b6c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6a59c700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c154980 0x7f2b6c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6a59c700 1 -- 172.21.15.27:0/1315368077 >> v1:172.21.15.27:6789/0 conn(0x7f2b6c0c0520 legacy=0x7f2b6c081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6a59c700 1 -- 172.21.15.27:0/1315368077 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c155520 con 0x7f2b6c151c90 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6959a700 1 -- 172.21.15.27:0/1315368077 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389574 0 0) 0x7f2b6c158010 con 0x7f2b6c0c0520 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b69d9b700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c154980 0x7f2b6c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.138+0000 7f2b6a59c700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c151c90 0x7f2b6c152070 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f2b64009760 tx=0x7f2b64009060).ready entity=mon.0 client_cookie=127fa87aac1db789 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b6959a700 1 -- 172.21.15.27:0/1315368077 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400b580 con 0x7f2b6c151c90 2023-05-17T14:54:58.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b6959a700 1 -- 172.21.15.27:0/1315368077 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400b6e0 con 0x7f2b6c151c90 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b6959a700 1 -- 172.21.15.27:0/1315368077 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400ba60 con 0x7f2b6c151c90 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 -- 172.21.15.27:0/1315368077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c151c90 msgr2=0x7f2b6c152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c151c90 0x7f2b6c152070 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f2b64009760 tx=0x7f2b64009060).stop 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 -- 172.21.15.27:0/1315368077 shutdown_connections 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c151c90 0x7f2b6c152070 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 --2- 172.21.15.27:0/1315368077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c154980 0x7f2b6c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 -- 172.21.15.27:0/1315368077 >> 172.21.15.27:0/1315368077 conn(0x7f2b6c0cae10 msgr2=0x7f2b6c0cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:58.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 -- 172.21.15.27:0/1315368077 shutdown_connections 2023-05-17T14:54:58.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.139+0000 7f2b70c72700 1 -- 172.21.15.27:0/1315368077 wait complete. 2023-05-17T14:54:58.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.140+0000 7f2b70c72700 1 Processor -- start 2023-05-17T14:54:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.140+0000 7f2b70c72700 1 -- start start 2023-05-17T14:54:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b70c72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b6c0c0520 0x7f2b6c0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b70c72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c151c90 0x7f2b6c0c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b70c72700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 0x7f2b6c168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b70c72700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c1679d0 con 0x7f2b6c154980 2023-05-17T14:54:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b70c72700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0c23a0 con 0x7f2b6c0c0520 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b70c72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0c2a60 con 0x7f2b6c151c90 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 0x7f2b6c168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 0x7f2b6c168190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36036/0 (socket says 172.21.15.27:36036) 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 -- 172.21.15.27:0/628281664 learned_addr learned my addr 172.21.15.27:0/628281664 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b69d9b700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c151c90 0x7f2b6c0c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6a59c700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b6c0c0520 0x7f2b6c0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 -- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c151c90 msgr2=0x7f2b6c0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c151c90 0x7f2b6c0c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 -- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b6c0c0520 msgr2=0x7f2b6c0b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b6c0c0520 0x7f2b6c0b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.141+0000 7f2b6ad9d700 1 -- 172.21.15.27:0/628281664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640092a0 con 0x7f2b6c154980 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.142+0000 7f2b6ad9d700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 0x7f2b6c168190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2b5c00c7e0 tx=0x7f2b5c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.142+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c005d30 con 0x7f2b6c154980 2023-05-17T14:54:58.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.142+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c005e90 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.142+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c007320 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.142+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c0c2d40 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.142+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c0c3020 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.143+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c0b0f10 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.143+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f2b5c010030 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.143+0000 7f2b627fc700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b4c05ee30 0x7f2b4c0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.143+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2b5c079cb0 con 0x7f2b6c154980 2023-05-17T14:54:58.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.143+0000 7f2b6a59c700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b4c05ee30 0x7f2b4c0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.144+0000 7f2b6a59c700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b4c05ee30 0x7f2b4c0612f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2b6400b340 tx=0x7f2b64017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.147+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b5c04b0d0 con 0x7f2b6c154980 2023-05-17T14:54:58.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.346+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6c06bdf0 con 0x7f2b4c05ee30 2023-05-17T14:54:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.350+0000 7f2b627fc700 1 -- 172.21.15.27:0/628281664 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2b6c06bdf0 con 0x7f2b4c05ee30 2023-05-17T14:54:58.354 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-05-17T14:54:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b4c05ee30 msgr2=0x7f2b4c0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b4c05ee30 0x7f2b4c0612f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2b6400b340 tx=0x7f2b64017000).stop 2023-05-17T14:54:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 msgr2=0x7f2b6c168190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 0x7f2b6c168190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2b5c00c7e0 tx=0x7f2b5c007f90).stop 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 shutdown_connections 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2b4c05ee30 0x7f2b4c0612f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b6c154980 0x7f2b6c168190 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b6c0c0520 0x7f2b6c0b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 --2- 172.21.15.27:0/628281664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b6c151c90 0x7f2b6c0c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 >> 172.21.15.27:0/628281664 conn(0x7f2b6c0cae10 msgr2=0x7f2b6c0c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 shutdown_connections 2023-05-17T14:54:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.352+0000 7f2b70c72700 1 -- 172.21.15.27:0/628281664 wait complete. 2023-05-17T14:54:58.367 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-05-17T14:54:58.368 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-05-17T14:54:58.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.485+0000 7fc72f71a700 1 Processor -- start 2023-05-17T14:54:58.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.485+0000 7fc72f71a700 1 -- start start 2023-05-17T14:54:58.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72f71a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc728153fa0 0x7fc7280c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72f71a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7280aa130 0x7fc728081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72f71a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7280c1610 con 0x7fc7280824c0 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72f71a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280abe60 con 0x7fc728153fa0 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72f71a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280c0a00 con 0x7fc7280aa130 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72d4b6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc728153fa0 0x7fc7280c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72dcb7700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc7280824c0 0x7fc728068de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35606/0 (socket says 172.21.15.27:35606) 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72dcb7700 1 -- 172.21.15.27:0/671107303 learned_addr learned my addr 172.21.15.27:0/671107303 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72ccb5700 1 --2- 172.21.15.27:0/671107303 >> v2:172.21.15.40:3300/0 conn(0x7fc7280aa130 0x7fc728081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72d4b6700 1 -- 172.21.15.27:0/671107303 >> v2:172.21.15.40:3300/0 conn(0x7fc7280aa130 msgr2=0x7fc728081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72d4b6700 1 --2- 172.21.15.27:0/671107303 >> v2:172.21.15.40:3300/0 conn(0x7fc7280aa130 0x7fc728081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72d4b6700 1 -- 172.21.15.27:0/671107303 >> v1:172.21.15.27:6789/0 conn(0x7fc7280824c0 legacy=0x7fc728068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc727fff700 1 -- 172.21.15.27:0/671107303 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854623790 0 0) 0x7fc7280c1610 con 0x7fc7280824c0 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72d4b6700 1 -- 172.21.15.27:0/671107303 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280c0ce0 con 0x7fc728153fa0 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72ccb5700 1 --2- 172.21.15.27:0/671107303 >> v2:172.21.15.40:3300/0 conn(0x7fc7280aa130 0x7fc728081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc72d4b6700 1 --2- 172.21.15.27:0/671107303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc728153fa0 0x7fc7280c0420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc7280cbe30 tx=0x7fc720009060).ready entity=mon.0 client_cookie=d51ffe637a6fde5d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc727fff700 1 -- 172.21.15.27:0/671107303 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000b580 con 0x7fc728153fa0 2023-05-17T14:54:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc727fff700 1 -- 172.21.15.27:0/671107303 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b6e0 con 0x7fc728153fa0 2023-05-17T14:54:58.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.486+0000 7fc727fff700 1 -- 172.21.15.27:0/671107303 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000ba60 con 0x7fc728153fa0 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 -- 172.21.15.27:0/671107303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc728153fa0 msgr2=0x7fc7280c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 --2- 172.21.15.27:0/671107303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc728153fa0 0x7fc7280c0420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc7280cbe30 tx=0x7fc720009060).stop 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 -- 172.21.15.27:0/671107303 shutdown_connections 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 --2- 172.21.15.27:0/671107303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc728153fa0 0x7fc7280c0420 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 --2- 172.21.15.27:0/671107303 >> v2:172.21.15.40:3300/0 conn(0x7fc7280aa130 0x7fc728081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 -- 172.21.15.27:0/671107303 >> 172.21.15.27:0/671107303 conn(0x7fc72805e820 msgr2=0x7fc7280cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:58.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 -- 172.21.15.27:0/671107303 shutdown_connections 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.487+0000 7fc72f71a700 1 -- 172.21.15.27:0/671107303 wait complete. 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.488+0000 7fc72f71a700 1 Processor -- start 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.488+0000 7fc72f71a700 1 -- start start 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72f71a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 0x7fc7280c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72f71a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7280aa130 0x7fc728161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72f71a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc728153fa0 0x7fc7280a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72f71a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280aea20 con 0x7fc7280824c0 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72f71a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc728161e30 con 0x7fc7280aa130 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72f71a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280c3e00 con 0x7fc728153fa0 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 0x7fc7280c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 0x7fc7280c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36046/0 (socket says 172.21.15.27:36046) 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 -- 172.21.15.27:0/236882242 learned_addr learned my addr 172.21.15.27:0/236882242 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 -- 172.21.15.27:0/236882242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc728153fa0 msgr2=0x7fc7280a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc728153fa0 0x7fc7280a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 -- 172.21.15.27:0/236882242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7280aa130 msgr2=0x7fc728161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7280aa130 0x7fc728161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 -- 172.21.15.27:0/236882242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7200092a0 con 0x7fc7280824c0 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.489+0000 7fc72d4b6700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 0x7fc7280c3860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fc720009fd0 tx=0x7fc720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.490+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000b850 con 0x7fc7280824c0 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.490+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b9b0 con 0x7fc7280824c0 2023-05-17T14:54:58.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.490+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7280c40e0 con 0x7fc7280824c0 2023-05-17T14:54:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.490+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72001b690 con 0x7fc7280824c0 2023-05-17T14:54:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.490+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7280c46a0 con 0x7fc7280824c0 2023-05-17T14:54:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.490+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7280aeb90 con 0x7fc7280824c0 2023-05-17T14:54:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.491+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fc72002a070 con 0x7fc7280824c0 2023-05-17T14:54:58.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.491+0000 7fc7257fa700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc71405ee30 0x7fc7140612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.491+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc72007b390 con 0x7fc7280824c0 2023-05-17T14:54:58.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.491+0000 7fc72ccb5700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc71405ee30 0x7fc7140612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.492+0000 7fc72ccb5700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc71405ee30 0x7fc7140612f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc71c006d80 tx=0x7fc71c008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.495+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc7280aeb90 con 0x7fc7280824c0 2023-05-17T14:54:58.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.696+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7280aeb60 con 0x7fc71405ee30 2023-05-17T14:54:58.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.700+0000 7fc7257fa700 1 -- 172.21.15.27:0/236882242 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc7280aeb60 con 0x7fc71405ee30 2023-05-17T14:54:58.704 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-05-17T14:54:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc71405ee30 msgr2=0x7fc7140612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc71405ee30 0x7fc7140612f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc71c006d80 tx=0x7fc71c008040).stop 2023-05-17T14:54:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 msgr2=0x7fc7280c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 0x7fc7280c3860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fc720009fd0 tx=0x7fc720017000).stop 2023-05-17T14:54:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 shutdown_connections 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc71405ee30 0x7fc7140612f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc728153fa0 0x7fc7280a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7280824c0 0x7fc7280c3860 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 --2- 172.21.15.27:0/236882242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7280aa130 0x7fc728161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 >> 172.21.15.27:0/236882242 conn(0x7fc72805e820 msgr2=0x7fc728068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 shutdown_connections 2023-05-17T14:54:58.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.702+0000 7fc72f71a700 1 -- 172.21.15.27:0/236882242 wait complete. 2023-05-17T14:54:58.717 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-05-17T14:54:58.718 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-05-17T14:54:58.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.834+0000 7efdf6722700 1 Processor -- start 2023-05-17T14:54:58.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.835+0000 7efdf6722700 1 -- start start 2023-05-17T14:54:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.835+0000 7efdf6722700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf005e460 0x7efdf00c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.835+0000 7efdf6722700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf0063f70 con 0x7efdf0153f80 2023-05-17T14:54:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.835+0000 7efdf6722700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf0158980 con 0x7efdf00c50b0 2023-05-17T14:54:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.835+0000 7efdf6722700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0065400 con 0x7efdf005e460 2023-05-17T14:54:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdeffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efdf0153f80 0x7efdf0064cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35616/0 (socket says 172.21.15.27:35616) 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdeffff700 1 -- 172.21.15.27:0/1858477364 learned_addr learned my addr 172.21.15.27:0/1858477364 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdf4cbf700 1 --2- 172.21.15.27:0/1858477364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf005e460 0x7efdf00c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216516293 0 0) 0x7efdf0063f70 con 0x7efdf0153f80 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efddc0033f0 con 0x7efdf0153f80 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465296258 0 0) 0x7efdf0158980 con 0x7efdf00c50b0 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0063f70 con 0x7efdf00c50b0 2023-05-17T14:54:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187732338 0 0) 0x7efddc0033f0 con 0x7efdf0153f80 2023-05-17T14:54:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdf4cbf700 1 -- 172.21.15.27:0/1858477364 >> v1:172.21.15.40:6789/0 conn(0x7efdf00c50b0 legacy=0x7efdf005dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdf4cbf700 1 -- 172.21.15.27:0/1858477364 >> v1:172.21.15.27:6789/0 conn(0x7efdf0153f80 legacy=0x7efdf0064cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdf4cbf700 1 -- 172.21.15.27:0/1858477364 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0064210 con 0x7efdf005e460 2023-05-17T14:54:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdf4cbf700 1 --2- 172.21.15.27:0/1858477364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf005e460 0x7efdf00c1fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7efde8009e90 tx=0x7efde8009780).ready entity=mon.2 client_cookie=d6d5382f3565f916 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800e070 con 0x7efdf005e460 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde800b7a0 con 0x7efdf005e460 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.836+0000 7efdef7fe700 1 -- 172.21.15.27:0/1858477364 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0001470 con 0x7efdf005e460 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 -- 172.21.15.27:0/1858477364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf005e460 msgr2=0x7efdf00c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 --2- 172.21.15.27:0/1858477364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf005e460 0x7efdf00c1fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7efde8009e90 tx=0x7efde8009780).stop 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 -- 172.21.15.27:0/1858477364 shutdown_connections 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 --2- 172.21.15.27:0/1858477364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf005e460 0x7efdf00c1fd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 -- 172.21.15.27:0/1858477364 >> 172.21.15.27:0/1858477364 conn(0x7efdf00c84a0 msgr2=0x7efdf00c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 -- 172.21.15.27:0/1858477364 shutdown_connections 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.837+0000 7efdf6722700 1 -- 172.21.15.27:0/1858477364 wait complete. 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.838+0000 7efdf6722700 1 Processor -- start 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.838+0000 7efdf6722700 1 -- start start 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf6722700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf005e460 0x7efdf00ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf6722700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 0x7efdf0149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf6722700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf0153f80 0x7efdf00a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf6722700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0167760 con 0x7efdf00c50b0 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf6722700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf01685c0 con 0x7efdf005e460 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf6722700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf01679b0 con 0x7efdf0153f80 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 0x7efdf0149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 0x7efdf0149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36062/0 (socket says 172.21.15.27:36062) 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 -- 172.21.15.27:0/2374553213 learned_addr learned my addr 172.21.15.27:0/2374553213 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:58.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdeffff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf005e460 0x7efdf00ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdf4cbf700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf0153f80 0x7efdf00a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 -- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf0153f80 msgr2=0x7efdf00a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf0153f80 0x7efdf00a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 -- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf005e460 msgr2=0x7efdf00ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf005e460 0x7efdf00ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 -- 172.21.15.27:0/2374553213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009a20 con 0x7efdf00c50b0 2023-05-17T14:54:58.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdeffff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf005e460 0x7efdf00ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efde7fff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 0x7efdf0149c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efdd800c3a0 tx=0x7efdd8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.839+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800f470 con 0x7efdf00c50b0 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.840+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800f5d0 con 0x7efdf00c50b0 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.840+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf0167c90 con 0x7efdf00c50b0 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.840+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800f780 con 0x7efdf00c50b0 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.840+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf0168250 con 0x7efdf00c50b0 2023-05-17T14:54:58.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.840+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf0062740 con 0x7efdf00c50b0 2023-05-17T14:54:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.841+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7efdd8010070 con 0x7efdf00c50b0 2023-05-17T14:54:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.841+0000 7efdecff9700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdd005ee30 0x7efdd00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.841+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7efdd8079090 con 0x7efdf00c50b0 2023-05-17T14:54:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.841+0000 7efdeffff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdd005ee30 0x7efdd00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.842+0000 7efdeffff700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdd005ee30 0x7efdd00612f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7efde0001ed0 tx=0x7efde0009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:58.845+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efdd80478f0 con 0x7efdf00c50b0 2023-05-17T14:54:59.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.050+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf00a8530 con 0x7efdd005ee30 2023-05-17T14:54:59.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.054+0000 7efdecff9700 1 -- 172.21.15.27:0/2374553213 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7efde0007170 con 0x7efdd005ee30 2023-05-17T14:54:59.058 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-05-17T14:54:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdd005ee30 msgr2=0x7efdd00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdd005ee30 0x7efdd00612f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7efde0001ed0 tx=0x7efde0009040).stop 2023-05-17T14:54:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 msgr2=0x7efdf0149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 0x7efdf0149c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efdd800c3a0 tx=0x7efdd8007c40).stop 2023-05-17T14:54:59.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 shutdown_connections 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdd005ee30 0x7efdd00612f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf0153f80 0x7efdf00a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf005e460 0x7efdf00ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 --2- 172.21.15.27:0/2374553213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf00c50b0 0x7efdf0149c40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 >> 172.21.15.27:0/2374553213 conn(0x7efdf00c84a0 msgr2=0x7efdf014b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 shutdown_connections 2023-05-17T14:54:59.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.056+0000 7efdf6722700 1 -- 172.21.15.27:0/2374553213 wait complete. 2023-05-17T14:54:59.071 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-05-17T14:54:59.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-05-17T14:54:59.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.189+0000 7f9427b19700 1 Processor -- start 2023-05-17T14:54:59.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.189+0000 7f9427b19700 1 -- start start 2023-05-17T14:54:59.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f9427b19700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9420151c90 0x7f9420152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f9427b19700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9420158010 con 0x7f9420154980 2023-05-17T14:54:59.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f9427b19700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9420154f60 con 0x7f94200c0520 2023-05-17T14:54:59.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f9427b19700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9420155240 con 0x7f9420151c90 2023-05-17T14:54:59.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f94250b4700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9420154980 0x7f94200c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35634/0 (socket says 172.21.15.27:35634) 2023-05-17T14:54:59.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f94250b4700 1 -- 172.21.15.27:0/2331388126 learned_addr learned my addr 172.21.15.27:0/2331388126 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T14:54:59.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765278983 0 0) 0x7f9420158010 con 0x7f9420154980 2023-05-17T14:54:59.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f94258b5700 1 --2- 172.21.15.27:0/2331388126 >> v2:172.21.15.40:3300/0 conn(0x7f9420151c90 0x7f9420152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.190+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94080033f0 con 0x7f9420154980 2023-05-17T14:54:59.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438742765 0 0) 0x7f94080033f0 con 0x7f9420154980 2023-05-17T14:54:59.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 >> v2:172.21.15.40:3300/0 conn(0x7f9420151c90 msgr2=0x7f9420152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:59.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 --2- 172.21.15.27:0/2331388126 >> v2:172.21.15.40:3300/0 conn(0x7f9420151c90 0x7f9420152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 >> v1:172.21.15.40:6789/0 conn(0x7f94200c0520 legacy=0x7f9420081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420155520 con 0x7f9420154980 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f9414001470 con 0x7f9420154980 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 >> v1:172.21.15.27:6789/0 conn(0x7f9420154980 legacy=0x7f94200c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94080038e0 0x7f9408003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9408004690 0x7f9408004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9408005000 0x7f940800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9420155240 con 0x7f9408004690 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940800beb0 con 0x7f94080038e0 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940800c070 con 0x7f9408005000 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9408004690 0x7f9408004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94258b5700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94080038e0 0x7f9408003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94260b6700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9408005000 0x7f940800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 -- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9408005000 msgr2=0x7f940800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:59.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9408005000 0x7f940800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 -- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94080038e0 msgr2=0x7f9408003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94080038e0 0x7f9408003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94260b6700 1 -- 172.21.15.27:0/2331388126 reap_dead start 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 -- 172.21.15.27:0/2331388126 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080033f0 con 0x7f9408004690 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94250b4700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9408004690 0x7f9408004b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f941400c160 tx=0x7f9420157f80).ready entity=mon.0 client_cookie=3cc53c5b7ee70695 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.191+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400ca50 con 0x7f9408004690 2023-05-17T14:54:59.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400cbb0 con 0x7f9408004690 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f94248b3700 1 -- 172.21.15.27:0/2331388126 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140070d0 con 0x7f9408004690 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 -- 172.21.15.27:0/2331388126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9408004690 msgr2=0x7f9408004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9408004690 0x7f9408004b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f941400c160 tx=0x7f9420157f80).stop 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 -- 172.21.15.27:0/2331388126 shutdown_connections 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 --2- 172.21.15.27:0/2331388126 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9408004690 0x7f9408004b10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 -- 172.21.15.27:0/2331388126 >> 172.21.15.27:0/2331388126 conn(0x7f94200cae10 msgr2=0x7f94200cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:59.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 -- 172.21.15.27:0/2331388126 shutdown_connections 2023-05-17T14:54:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.192+0000 7f9427b19700 1 -- 172.21.15.27:0/2331388126 wait complete. 2023-05-17T14:54:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.193+0000 7f9427b19700 1 Processor -- start 2023-05-17T14:54:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.193+0000 7f9427b19700 1 -- start start 2023-05-17T14:54:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f9427b19700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9408004690 0x7f94200ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f9427b19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94200c3190 0x7f9420164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f9427b19700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 0x7f9420164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f9427b19700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94200ae3d0 con 0x7f94200c3610 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f9427b19700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94200adda0 con 0x7f9408004690 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f9427b19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9420164db0 con 0x7f94200c3190 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 0x7f9420164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 0x7f9420164770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36084/0 (socket says 172.21.15.27:36084) 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 -- 172.21.15.27:0/3332575734 learned_addr learned my addr 172.21.15.27:0/3332575734 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:59.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94258b5700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9408004690 0x7f94200ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94250b4700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94200c3190 0x7f9420164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 -- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94200c3190 msgr2=0x7f9420164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94200c3190 0x7f9420164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 -- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9408004690 msgr2=0x7f94200ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9408004690 0x7f94200ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94260b6700 1 -- 172.21.15.27:0/3332575734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420165090 con 0x7f94200c3610 2023-05-17T14:54:59.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.194+0000 7f94258b5700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9408004690 0x7f94200ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.195+0000 7f94260b6700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 0x7f9420164770 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f9420084590 tx=0x7f9410007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.195+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410007240 con 0x7f94200c3610 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.195+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94100073a0 con 0x7f94200c3610 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.195+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94200ae060 con 0x7f94200c3610 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.195+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94100066a0 con 0x7f94200c3610 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.195+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94200c4fc0 con 0x7f94200c3610 2023-05-17T14:54:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.196+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942006bdf0 con 0x7f94200c3610 2023-05-17T14:54:59.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.196+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f941001f070 con 0x7f94200c3610 2023-05-17T14:54:59.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.197+0000 7f941dffb700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f940c05ee30 0x7f940c0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.197+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f94100793a0 con 0x7f94200c3610 2023-05-17T14:54:59.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.197+0000 7f94258b5700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f940c05ee30 0x7f940c0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.197+0000 7f94258b5700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f940c05ee30 0x7f940c0612f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9418009fd0 tx=0x7f941800b040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:59.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.201+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f941004a7c0 con 0x7f94200c3610 2023-05-17T14:54:59.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.400+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9420155800 con 0x7f940c05ee30 2023-05-17T14:54:59.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.404+0000 7f941dffb700 1 -- 172.21.15.27:0/3332575734 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9420155800 con 0x7f940c05ee30 2023-05-17T14:54:59.408 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-05-17T14:54:59.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f940c05ee30 msgr2=0x7f940c0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f940c05ee30 0x7f940c0612f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9418009fd0 tx=0x7f941800b040).stop 2023-05-17T14:54:59.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 msgr2=0x7f9420164770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 0x7f9420164770 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f9420084590 tx=0x7f9410007bb0).stop 2023-05-17T14:54:59.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 shutdown_connections 2023-05-17T14:54:59.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f940c05ee30 0x7f940c0612f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94200c3610 0x7f9420164770 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9408004690 0x7f94200ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 --2- 172.21.15.27:0/3332575734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94200c3190 0x7f9420164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.405+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 >> 172.21.15.27:0/3332575734 conn(0x7f94200cae10 msgr2=0x7f9420155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.406+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 shutdown_connections 2023-05-17T14:54:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.406+0000 7f9427b19700 1 -- 172.21.15.27:0/3332575734 wait complete. 2023-05-17T14:54:59.421 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-05-17T14:54:59.421 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-05-17T14:54:59.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.538+0000 7fcfeb454700 1 Processor -- start 2023-05-17T14:54:59.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.538+0000 7fcfeb454700 1 -- start start 2023-05-17T14:54:59.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.539+0000 7fcfeb454700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfe4153ea0 0x7fcfe4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.539+0000 7fcfeb454700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe40c5bf0 0x7fcfe4158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.539+0000 7fcfeb454700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe41546e0 con 0x7fcfe4154280 2023-05-17T14:54:59.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.539+0000 7fcfeb454700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe4068920 con 0x7fcfe4153ea0 2023-05-17T14:54:59.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.539+0000 7fcfeb454700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4158d40 con 0x7fcfe40c5bf0 2023-05-17T14:54:59.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfe4153ea0 0x7fcfe4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe99f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe40c5bf0 0x7fcfe4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfe4153ea0 0x7fcfe4068db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:54018/0 (socket says 172.21.15.27:54018) 2023-05-17T14:54:59.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 -- 172.21.15.27:0/2874604464 learned_addr learned my addr 172.21.15.27:0/2874604464 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:59.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 -- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe40c5bf0 msgr2=0x7fcfe4158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T14:54:59.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 --2- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe40c5bf0 0x7fcfe4158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 -- 172.21.15.27:0/2874604464 >> v1:172.21.15.40:6789/0 conn(0x7fcfe4154280 legacy=0x7fcfe40c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 -- 172.21.15.27:0/2874604464 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4067ff0 con 0x7fcfe4153ea0 2023-05-17T14:54:59.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe99f1700 1 --2- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe40c5bf0 0x7fcfe4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe91f0700 1 --2- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe4153ea0 0x7fcfe4068db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fcfdc006fd0 tx=0x7fcfdc0090f0).ready entity=mon.1 client_cookie=ab666508f14f8c9b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe3fff700 1 -- 172.21.15.27:0/2874604464 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00b580 con 0x7fcfe4153ea0 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe3fff700 1 -- 172.21.15.27:0/2874604464 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc00b6e0 con 0x7fcfe4153ea0 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.540+0000 7fcfe3fff700 1 -- 172.21.15.27:0/2874604464 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00ba60 con 0x7fcfe4153ea0 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 -- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe4153ea0 msgr2=0x7fcfe4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 --2- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe4153ea0 0x7fcfe4068db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fcfdc006fd0 tx=0x7fcfdc0090f0).stop 2023-05-17T14:54:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 -- 172.21.15.27:0/2874604464 shutdown_connections 2023-05-17T14:54:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 --2- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe40c5bf0 0x7fcfe4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 --2- 172.21.15.27:0/2874604464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe4153ea0 0x7fcfe4068db0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 -- 172.21.15.27:0/2874604464 >> 172.21.15.27:0/2874604464 conn(0x7fcfe4062280 msgr2=0x7fcfe4062690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 -- 172.21.15.27:0/2874604464 shutdown_connections 2023-05-17T14:54:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.541+0000 7fcfeb454700 1 -- 172.21.15.27:0/2874604464 wait complete. 2023-05-17T14:54:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.542+0000 7fcfeb454700 1 Processor -- start 2023-05-17T14:54:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.542+0000 7fcfeb454700 1 -- start start 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfeb454700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe40c5bf0 0x7fcfe40add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfeb454700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe4153ea0 0x7fcfe4156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfeb454700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 0x7fcfe4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfeb454700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4168c00 con 0x7fcfe4154280 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfeb454700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4157370 con 0x7fcfe40c5bf0 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfeb454700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4165210 con 0x7fcfe4153ea0 2023-05-17T14:54:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfe99f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 0x7fcfe4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfe99f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 0x7fcfe4156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36096/0 (socket says 172.21.15.27:36096) 2023-05-17T14:54:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfe99f1700 1 -- 172.21.15.27:0/3635239170 learned_addr learned my addr 172.21.15.27:0/3635239170 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T14:54:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfe89ef700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe4153ea0 0x7fcfe4156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.543+0000 7fcfe91f0700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe40c5bf0 0x7fcfe40add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe99f1700 1 -- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe4153ea0 msgr2=0x7fcfe4156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe99f1700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe4153ea0 0x7fcfe4156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe99f1700 1 -- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe40c5bf0 msgr2=0x7fcfe40add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe99f1700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe40c5bf0 0x7fcfe40add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe99f1700 1 -- 172.21.15.27:0/3635239170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009a20 con 0x7fcfe4154280 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe99f1700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 0x7fcfe4156e80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fcfd4009fc0 tx=0x7fcfd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400ccd0 con 0x7fcfe4154280 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd400f040 con 0x7fcfe4154280 2023-05-17T14:54:59.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc009370 con 0x7fcfe4154280 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4013610 con 0x7fcfe4154280 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.544+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe41648e0 con 0x7fcfe4154280 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.545+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe41653a0 con 0x7fcfe4154280 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.545+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fcfd40139c0 con 0x7fcfe4154280 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.546+0000 7fcfe17fa700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfd005ee30 0x7fcfd00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.546+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fcfd407a8c0 con 0x7fcfe4154280 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.546+0000 7fcfe91f0700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfd005ee30 0x7fcfd00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T14:54:59.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.546+0000 7fcfe91f0700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfd005ee30 0x7fcfd00612f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fcfdc009130 tx=0x7fcfdc017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T14:54:59.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.550+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcfd404bce0 con 0x7fcfe4154280 2023-05-17T14:54:59.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.754+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe40682d0 con 0x7fcfd005ee30 2023-05-17T14:54:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.758+0000 7fcfe17fa700 1 -- 172.21.15.27:0/3635239170 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcfe40682d0 con 0x7fcfd005ee30 2023-05-17T14:54:59.762 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-05-17T14:54:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfd005ee30 msgr2=0x7fcfd00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfd005ee30 0x7fcfd00612f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fcfdc009130 tx=0x7fcfdc017000).stop 2023-05-17T14:54:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 msgr2=0x7fcfe4156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T14:54:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 0x7fcfe4156e80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fcfd4009fc0 tx=0x7fcfd400b040).stop 2023-05-17T14:54:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 shutdown_connections 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcfd005ee30 0x7fcfd00612f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcfe4154280 0x7fcfe4156e80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfe40c5bf0 0x7fcfe40add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 --2- 172.21.15.27:0/3635239170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfe4153ea0 0x7fcfe4156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 >> 172.21.15.27:0/3635239170 conn(0x7fcfe4062280 msgr2=0x7fcfe40c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 shutdown_connections 2023-05-17T14:54:59.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T14:54:59.760+0000 7fcfeb454700 1 -- 172.21.15.27:0/3635239170 wait complete. 2023-05-17T14:54:59.775 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-05-17T14:54:59.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:54:59.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:55:00.010 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:55:00.006+0000 7efda6a1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:55:00.010 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:55:00.006+0000 7efda6a1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:55:00.010 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:55:00.006+0000 7efda6a1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:55:00.010 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:55:00.006+0000 7efda6a1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:55:00.011 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T14:55:00.006+0000 7efda6a1e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T14:55:30.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:55:30.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:00.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:00.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:30.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:30.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:00.229 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:00.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:30.294 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:30.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:00.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:00.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:30.480 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:30.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:00.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:00.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:30.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:30.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:00.746 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:00.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:30.819 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:30.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:00.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:00.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:30.981 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:30.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:01.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:01.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:31.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:31.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:01.330 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:01.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:31.418 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:31.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:01.490 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:01.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:31.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:31.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:01.694 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:01.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:18.777 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-05-17T15:05:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.908+0000 7fc03ffff700 1 Processor -- start 2023-05-17T15:05:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.908+0000 7fc03ffff700 1 -- start start 2023-05-17T15:05:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc040154070 0x7fc0400be150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc0400be640 0x7fc040068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03ffff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400beab0 con 0x7fc040153c90 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400c5eb0 con 0x7fc0400be640 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc040063170 con 0x7fc040154070 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03effd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc040153c90 0x7fc040062a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35676/0 (socket says 172.21.15.27:35676) 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03effd700 1 -- 172.21.15.27:0/3795912418 learned_addr learned my addr 172.21.15.27:0/3795912418 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03f7fe700 1 --2- 172.21.15.27:0/3795912418 >> v2:172.21.15.27:3300/0 conn(0x7fc0400be640 0x7fc040068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03dffb700 1 -- 172.21.15.27:0/3795912418 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885161436 0 0) 0x7fc0400beab0 con 0x7fc040153c90 2023-05-17T15:05:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03dffb700 1 -- 172.21.15.27:0/3795912418 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c0033f0 con 0x7fc040153c90 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03f7fe700 1 -- 172.21.15.27:0/3795912418 >> v2:172.21.15.40:3300/0 conn(0x7fc040154070 msgr2=0x7fc0400be150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03e7fc700 1 --2- 172.21.15.27:0/3795912418 >> v2:172.21.15.40:3300/0 conn(0x7fc040154070 0x7fc0400be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03f7fe700 1 --2- 172.21.15.27:0/3795912418 >> v2:172.21.15.40:3300/0 conn(0x7fc040154070 0x7fc0400be150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03f7fe700 1 -- 172.21.15.27:0/3795912418 >> v1:172.21.15.27:6789/0 conn(0x7fc040153c90 legacy=0x7fc040062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03f7fe700 1 -- 172.21.15.27:0/3795912418 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400bedf0 con 0x7fc0400be640 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.909+0000 7fc03e7fc700 1 --2- 172.21.15.27:0/3795912418 >> v2:172.21.15.40:3300/0 conn(0x7fc040154070 0x7fc0400be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03f7fe700 1 --2- 172.21.15.27:0/3795912418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040068ca0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fc040066480 tx=0x7fc030009780).ready entity=mon.0 client_cookie=722f7420ca2631e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:18.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03dffb700 1 -- 172.21.15.27:0/3795912418 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000e070 con 0x7fc0400be640 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03dffb700 1 -- 172.21.15.27:0/3795912418 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000bb60 con 0x7fc0400be640 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03dffb700 1 -- 172.21.15.27:0/3795912418 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030012410 con 0x7fc0400be640 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 -- 172.21.15.27:0/3795912418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 msgr2=0x7fc040068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 --2- 172.21.15.27:0/3795912418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040068ca0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fc040066480 tx=0x7fc030009780).stop 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 -- 172.21.15.27:0/3795912418 shutdown_connections 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 --2- 172.21.15.27:0/3795912418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040068ca0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:18.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 --2- 172.21.15.27:0/3795912418 >> v2:172.21.15.40:3300/0 conn(0x7fc040154070 0x7fc0400be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 -- 172.21.15.27:0/3795912418 >> 172.21.15.27:0/3795912418 conn(0x7fc040082930 msgr2=0x7fc040091f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 -- 172.21.15.27:0/3795912418 shutdown_connections 2023-05-17T15:05:18.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.910+0000 7fc03ffff700 1 -- 172.21.15.27:0/3795912418 wait complete. 2023-05-17T15:05:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 Processor -- start 2023-05-17T15:05:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 -- start start 2023-05-17T15:05:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040164b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc040153c90 0x7fc040156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:18.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc040154070 0x7fc0400adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401568f0 con 0x7fc0400be640 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040155a00 con 0x7fc040154070 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040155ce0 con 0x7fc040153c90 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.912+0000 7fc03effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040164b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36120/0 (socket says 172.21.15.27:36120) 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 -- 172.21.15.27:0/773527223 learned_addr learned my addr 172.21.15.27:0/773527223 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03f7fe700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc040154070 0x7fc0400adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:18.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03e7fc700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc040153c90 0x7fc040156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 -- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc040153c90 msgr2=0x7fc040156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc040153c90 0x7fc040156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 -- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc040154070 msgr2=0x7fc0400adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc040154070 0x7fc0400adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 -- 172.21.15.27:0/773527223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009a20 con 0x7fc0400be640 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03f7fe700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc040154070 0x7fc0400adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03effd700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040164b10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fc03800c4b0 tx=0x7fc038007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380072e0 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc038007440 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc040155fc0 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038005880 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.913+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc040156580 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.914+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040156bd0 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.914+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fc03801a060 con 0x7fc0400be640 2023-05-17T15:05:18.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.915+0000 7fc036ffd700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc02005ee70 0x7fc020061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.915+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc0380794a0 con 0x7fc0400be640 2023-05-17T15:05:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.915+0000 7fc03e7fc700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc02005ee70 0x7fc020061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.915+0000 7fc03e7fc700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc02005ee70 0x7fc020061330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc0401544b0 tx=0x7fc028008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:18.919+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc03804a950 con 0x7fc0400be640 2023-05-17T15:05:19.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.116+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc040156a30 con 0x7fc02005ee70 2023-05-17T15:05:19.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.120+0000 7fc036ffd700 1 -- 172.21.15.27:0/773527223 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc02800c030 con 0x7fc02005ee70 2023-05-17T15:05:19.124 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-05-17T15:05:19.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc02005ee70 msgr2=0x7fc020061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc02005ee70 0x7fc020061330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc0401544b0 tx=0x7fc028008040).stop 2023-05-17T15:05:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 msgr2=0x7fc040164b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040164b10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fc03800c4b0 tx=0x7fc038007b00).stop 2023-05-17T15:05:19.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 shutdown_connections 2023-05-17T15:05:19.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc02005ee70 0x7fc020061330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc040154070 0x7fc0400adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0400be640 0x7fc040164b10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 --2- 172.21.15.27:0/773527223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc040153c90 0x7fc040156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 >> 172.21.15.27:0/773527223 conn(0x7fc040082930 msgr2=0x7fc0400c0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:19.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 shutdown_connections 2023-05-17T15:05:19.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.122+0000 7fc03ffff700 1 -- 172.21.15.27:0/773527223 wait complete. 2023-05-17T15:05:19.138 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-05-17T15:05:19.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-05-17T15:05:19.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.256+0000 7fdd066d3700 1 Processor -- start 2023-05-17T15:05:19.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.256+0000 7fdd066d3700 1 -- start start 2023-05-17T15:05:19.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdd066d3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdd00151c90 0x7fdd00152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdd066d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd000c0520 0x7fdd00081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdd066d3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd00158010 con 0x7fdd00154980 2023-05-17T15:05:19.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdd066d3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd00154f60 con 0x7fdd00151c90 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdd066d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd00155240 con 0x7fdd000c0520 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcfffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdd00151c90 0x7fdd00152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcff7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdd00154980 0x7fdd000c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35690/0 (socket says 172.21.15.27:35690) 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcff7fe700 1 -- 172.21.15.27:0/818754281 learned_addr learned my addr 172.21.15.27:0/818754281 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdd04c70700 1 --2- 172.21.15.27:0/818754281 >> v2:172.21.15.40:3300/0 conn(0x7fdd000c0520 0x7fdd00081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcfffff700 1 -- 172.21.15.27:0/818754281 >> v2:172.21.15.40:3300/0 conn(0x7fdd000c0520 msgr2=0x7fdd00081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:19.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcfffff700 1 --2- 172.21.15.27:0/818754281 >> v2:172.21.15.40:3300/0 conn(0x7fdd000c0520 0x7fdd00081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcfffff700 1 -- 172.21.15.27:0/818754281 >> v1:172.21.15.27:6789/0 conn(0x7fdd00154980 legacy=0x7fdd000c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcfffff700 1 -- 172.21.15.27:0/818754281 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00155520 con 0x7fdd00151c90 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.257+0000 7fdcfffff700 1 --2- 172.21.15.27:0/818754281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00152070 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fdd00068a80 tx=0x7fdcf4009060).ready entity=mon.0 client_cookie=89270e52a1a0b393 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdcfeffd700 1 -- 172.21.15.27:0/818754281 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400b580 con 0x7fdd00151c90 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdcfeffd700 1 -- 172.21.15.27:0/818754281 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf400b6e0 con 0x7fdd00151c90 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdcfeffd700 1 -- 172.21.15.27:0/818754281 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400ba60 con 0x7fdd00151c90 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 -- 172.21.15.27:0/818754281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 msgr2=0x7fdd00152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 --2- 172.21.15.27:0/818754281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00152070 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fdd00068a80 tx=0x7fdcf4009060).stop 2023-05-17T15:05:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 -- 172.21.15.27:0/818754281 shutdown_connections 2023-05-17T15:05:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 --2- 172.21.15.27:0/818754281 >> v2:172.21.15.40:3300/0 conn(0x7fdd000c0520 0x7fdd00081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 --2- 172.21.15.27:0/818754281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00152070 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 -- 172.21.15.27:0/818754281 >> 172.21.15.27:0/818754281 conn(0x7fdd000cae10 msgr2=0x7fdd000cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 -- 172.21.15.27:0/818754281 shutdown_connections 2023-05-17T15:05:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.258+0000 7fdd066d3700 1 -- 172.21.15.27:0/818754281 wait complete. 2023-05-17T15:05:19.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.259+0000 7fdd066d3700 1 Processor -- start 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.259+0000 7fdd066d3700 1 -- start start 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd066d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd000c0520 0x7fdd0014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd066d3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00165970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd066d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd00154980 0x7fdd00153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd066d3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000af010 con 0x7fdd00151c90 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd066d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd00167d70 con 0x7fdd00154980 2023-05-17T15:05:19.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd066d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000ae230 con 0x7fdd000c0520 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdcff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdcff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00165970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36136/0 (socket says 172.21.15.27:36136) 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdcff7fe700 1 -- 172.21.15.27:0/1680099139 learned_addr learned my addr 172.21.15.27:0/1680099139 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdcfffff700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd000c0520 0x7fdd0014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.260+0000 7fdd04c70700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd00154980 0x7fdd00153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdcff7fe700 1 -- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd000c0520 msgr2=0x7fdd0014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdcff7fe700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd000c0520 0x7fdd0014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdcff7fe700 1 -- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd00154980 msgr2=0x7fdd00153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdcff7fe700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd00154980 0x7fdd00153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdcff7fe700 1 -- 172.21.15.27:0/1680099139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf40092a0 con 0x7fdd00151c90 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdcff7fe700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00165970 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdcf0001eb0 tx=0x7fdcf0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00070d0 con 0x7fdd00151c90 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf0007230 con 0x7fdd00151c90 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00075d0 con 0x7fdd00151c90 2023-05-17T15:05:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000ae770 con 0x7fdd00151c90 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.261+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000aed30 con 0x7fdd00151c90 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.262+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd00167f20 con 0x7fdd00151c90 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.262+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fdcf0010070 con 0x7fdd00151c90 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.262+0000 7fdce7fff700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdcec05ee70 0x7fdcec061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.263+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fdcf0079180 con 0x7fdd00151c90 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.263+0000 7fdcfffff700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdcec05ee70 0x7fdcec061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.263+0000 7fdcfffff700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdcec05ee70 0x7fdcec061330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdcf4009fd0 tx=0x7fdcf4017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.267+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd00167f20 con 0x7fdd00151c90 2023-05-17T15:05:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.472+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd00167ee0 con 0x7fdcec05ee70 2023-05-17T15:05:19.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.476+0000 7fdce7fff700 1 -- 172.21.15.27:0/1680099139 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdd00167ee0 con 0x7fdcec05ee70 2023-05-17T15:05:19.479 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdcec05ee70 msgr2=0x7fdcec061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdcec05ee70 0x7fdcec061330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdcf4009fd0 tx=0x7fdcf4017000).stop 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 msgr2=0x7fdd00165970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00165970 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdcf0001eb0 tx=0x7fdcf0007e50).stop 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 shutdown_connections 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdcec05ee70 0x7fdcec061330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd00154980 0x7fdd00153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd000c0520 0x7fdd0014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 --2- 172.21.15.27:0/1680099139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd00151c90 0x7fdd00165970 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 >> 172.21.15.27:0/1680099139 conn(0x7fdd000cae10 msgr2=0x7fdd00081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:19.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 shutdown_connections 2023-05-17T15:05:19.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.478+0000 7fdd066d3700 1 -- 172.21.15.27:0/1680099139 wait complete. 2023-05-17T15:05:19.493 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-05-17T15:05:19.493 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-05-17T15:05:19.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.611+0000 7f43568ab700 1 Processor -- start 2023-05-17T15:05:19.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.611+0000 7f43568ab700 1 -- start start 2023-05-17T15:05:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.611+0000 7f43568ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4350151c90 0x7f4350152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f43568ab700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4350154980 0x7f43500c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f43568ab700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4350158010 con 0x7f43500c0520 2023-05-17T15:05:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f43568ab700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350154f60 con 0x7f4350154980 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f43568ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350155240 con 0x7f4350151c90 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4350154980 0x7f43500c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f4354e48700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f43500c0520 0x7f4350081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35706/0 (socket says 172.21.15.27:35706) 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f4354e48700 1 -- 172.21.15.27:0/226564765 learned_addr learned my addr 172.21.15.27:0/226564765 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434ffff700 1 --2- 172.21.15.27:0/226564765 >> v2:172.21.15.40:3300/0 conn(0x7f4350151c90 0x7f4350152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434f7fe700 1 -- 172.21.15.27:0/226564765 >> v2:172.21.15.40:3300/0 conn(0x7f4350151c90 msgr2=0x7f4350152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434f7fe700 1 --2- 172.21.15.27:0/226564765 >> v2:172.21.15.40:3300/0 conn(0x7f4350151c90 0x7f4350152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434f7fe700 1 -- 172.21.15.27:0/226564765 >> v1:172.21.15.27:6789/0 conn(0x7f43500c0520 legacy=0x7f4350081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434f7fe700 1 -- 172.21.15.27:0/226564765 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350155520 con 0x7f4350154980 2023-05-17T15:05:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434ffff700 1 --2- 172.21.15.27:0/226564765 >> v2:172.21.15.40:3300/0 conn(0x7f4350151c90 0x7f4350152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434f7fe700 1 --2- 172.21.15.27:0/226564765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c6150 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f4350084120 tx=0x7f4344009060).ready entity=mon.0 client_cookie=ac75cf83a341049a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434effd700 1 -- 172.21.15.27:0/226564765 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400b580 con 0x7f4350154980 2023-05-17T15:05:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434effd700 1 -- 172.21.15.27:0/226564765 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434400b6e0 con 0x7f4350154980 2023-05-17T15:05:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.612+0000 7f434effd700 1 -- 172.21.15.27:0/226564765 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400ba60 con 0x7f4350154980 2023-05-17T15:05:19.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 -- 172.21.15.27:0/226564765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 msgr2=0x7f43500c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 --2- 172.21.15.27:0/226564765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c6150 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f4350084120 tx=0x7f4344009060).stop 2023-05-17T15:05:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 -- 172.21.15.27:0/226564765 shutdown_connections 2023-05-17T15:05:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 --2- 172.21.15.27:0/226564765 >> v2:172.21.15.40:3300/0 conn(0x7f4350151c90 0x7f4350152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 --2- 172.21.15.27:0/226564765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c6150 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 -- 172.21.15.27:0/226564765 >> 172.21.15.27:0/226564765 conn(0x7f43500cae10 msgr2=0x7f43500cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 -- 172.21.15.27:0/226564765 shutdown_connections 2023-05-17T15:05:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.613+0000 7f43568ab700 1 -- 172.21.15.27:0/226564765 wait complete. 2023-05-17T15:05:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.614+0000 7f43568ab700 1 Processor -- start 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.614+0000 7f43568ab700 1 -- start start 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f43568ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43500c0520 0x7f435014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f43568ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4350151c90 0x7f43500c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f43568ab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f43568ab700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500af570 con 0x7f4350154980 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f43568ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500af850 con 0x7f43500c0520 2023-05-17T15:05:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f43568ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500afb30 con 0x7f4350151c90 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36152/0 (socket says 172.21.15.27:36152) 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 -- 172.21.15.27:0/1454689273 learned_addr learned my addr 172.21.15.27:0/1454689273 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f434ffff700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43500c0520 0x7f435014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f434f7fe700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4350151c90 0x7f43500c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 -- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4350151c90 msgr2=0x7f43500c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4350151c90 0x7f43500c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 -- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43500c0520 msgr2=0x7f435014f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43500c0520 0x7f435014f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 -- 172.21.15.27:0/1454689273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440092a0 con 0x7f4350154980 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.615+0000 7f4354e48700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c4af0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f434800c790 tx=0x7f43480015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.616+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348005d30 con 0x7f4350154980 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.616+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4348005e90 con 0x7f4350154980 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.616+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500afe10 con 0x7f4350154980 2023-05-17T15:05:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.616+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348007320 con 0x7f4350154980 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.616+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4350168e50 con 0x7f4350154980 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.617+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43500b0330 con 0x7f4350154980 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.617+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f4348010030 con 0x7f4350154980 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.617+0000 7f4337fff700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f433c05ee70 0x7f433c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.617+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f4348079a40 con 0x7f4350154980 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.617+0000 7f434ffff700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f433c05ee70 0x7f433c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.618+0000 7f434ffff700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f433c05ee70 0x7f433c061330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f434000abd0 tx=0x7f4340008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.621+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43500b0330 con 0x7f4350154980 2023-05-17T15:05:19.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.824+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f43500b0330 con 0x7f433c05ee70 2023-05-17T15:05:19.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.827+0000 7f4337fff700 1 -- 172.21.15.27:0/1454689273 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f43500b0330 con 0x7f433c05ee70 2023-05-17T15:05:19.831 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-05-17T15:05:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f433c05ee70 msgr2=0x7f433c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f433c05ee70 0x7f433c061330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f434000abd0 tx=0x7f4340008040).stop 2023-05-17T15:05:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 msgr2=0x7f43500c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c4af0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f434800c790 tx=0x7f43480015e0).stop 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 shutdown_connections 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f433c05ee70 0x7f433c061330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4350154980 0x7f43500c4af0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43500c0520 0x7f435014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 --2- 172.21.15.27:0/1454689273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4350151c90 0x7f43500c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 >> 172.21.15.27:0/1454689273 conn(0x7f43500cae10 msgr2=0x7f4350156410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:19.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 shutdown_connections 2023-05-17T15:05:19.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.829+0000 7f43568ab700 1 -- 172.21.15.27:0/1454689273 wait complete. 2023-05-17T15:05:19.844 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-05-17T15:05:19.845 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-05-17T15:05:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.961+0000 7f4cf0579700 1 Processor -- start 2023-05-17T15:05:19.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.961+0000 7f4cf0579700 1 -- start start 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cf0579700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ce8153d50 0x7f4ce8154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cf0579700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80c0390 0x7f4ce80a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cf0579700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce80aa6b0 con 0x7f4ce80aa250 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cf0579700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce8157e20 con 0x7f4ce8153d50 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cf0579700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8158100 con 0x7f4ce80c0390 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cee315700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ce8153d50 0x7f4ce8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cee315700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ce8153d50 0x7f4ce8154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36156/0 (socket says 172.21.15.27:36156) 2023-05-17T15:05:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.962+0000 7f4cee315700 1 -- 172.21.15.27:0/3218435307 learned_addr learned my addr 172.21.15.27:0/3218435307 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cedb14700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80c0390 0x7f4ce80a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cee315700 1 -- 172.21.15.27:0/3218435307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80c0390 msgr2=0x7f4ce80a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cee315700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80c0390 0x7f4ce80a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cee315700 1 -- 172.21.15.27:0/3218435307 >> v1:172.21.15.40:6789/0 conn(0x7f4ce80aa250 legacy=0x7f4ce80c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:19.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cee315700 1 -- 172.21.15.27:0/3218435307 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce81583e0 con 0x7f4ce8153d50 2023-05-17T15:05:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cedb14700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80c0390 0x7f4ce80a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cee315700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce8153d50 0x7f4ce8154130 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f4ce0006fd0 tx=0x7f4ce00090f0).ready entity=mon.0 client_cookie=5956128b5e60210f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4ced313700 1 -- 172.21.15.27:0/3218435307 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000b600 con 0x7f4ce8153d50 2023-05-17T15:05:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4ced313700 1 -- 172.21.15.27:0/3218435307 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000b760 con 0x7f4ce8153d50 2023-05-17T15:05:19.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4ced313700 1 -- 172.21.15.27:0/3218435307 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000bae0 con 0x7f4ce8153d50 2023-05-17T15:05:19.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cf0579700 1 -- 172.21.15.27:0/3218435307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce8153d50 msgr2=0x7f4ce8154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.963+0000 7f4cf0579700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce8153d50 0x7f4ce8154130 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f4ce0006fd0 tx=0x7f4ce00090f0).stop 2023-05-17T15:05:19.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.964+0000 7f4cf0579700 1 -- 172.21.15.27:0/3218435307 shutdown_connections 2023-05-17T15:05:19.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.964+0000 7f4cf0579700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce8153d50 0x7f4ce8154130 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.964+0000 7f4cf0579700 1 --2- 172.21.15.27:0/3218435307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80c0390 0x7f4ce80a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.964+0000 7f4cf0579700 1 -- 172.21.15.27:0/3218435307 >> 172.21.15.27:0/3218435307 conn(0x7f4ce80cae00 msgr2=0x7f4ce80cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.964+0000 7f4cf0579700 1 -- 172.21.15.27:0/3218435307 shutdown_connections 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.964+0000 7f4cf0579700 1 -- 172.21.15.27:0/3218435307 wait complete. 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 Processor -- start 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 -- start start 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80aa250 0x7f4ce814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 0x7f4ce80c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ce8153d50 0x7f4ce80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c1ea0 con 0x7f4ce80c0390 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c3e90 con 0x7f4ce8153d50 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.965+0000 7f4cf0579700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c4170 con 0x7f4ce80aa250 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 0x7f4ce80c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 0x7f4ce80c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36164/0 (socket says 172.21.15.27:36164) 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 -- 172.21.15.27:0/2238412010 learned_addr learned my addr 172.21.15.27:0/2238412010 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:19.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cee315700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80aa250 0x7f4ce814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4ceeb16700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ce8153d50 0x7f4ce80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 -- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80aa250 msgr2=0x7f4ce814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80aa250 0x7f4ce814ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 -- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ce8153d50 msgr2=0x7f4ce80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ce8153d50 0x7f4ce80c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 -- 172.21.15.27:0/2238412010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009370 con 0x7f4ce80c0390 2023-05-17T15:05:19.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cedb14700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 0x7f4ce80c3520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f4cdc00c880 tx=0x7f4cdc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc010580 con 0x7f4ce80c0390 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc0106e0 con 0x7f4ce80c0390 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce80c4450 con 0x7f4ce80c0390 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc010a60 con 0x7f4ce80c0390 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.966+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce80addb0 con 0x7f4ce80c0390 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.967+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce80c9b60 con 0x7f4ce80c0390 2023-05-17T15:05:19.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.967+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f4cdc01b460 con 0x7f4ce80c0390 2023-05-17T15:05:19.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.968+0000 7f4ce67fc700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4cd405ee70 0x7f4cd4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:19.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.968+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f4cdc079cb0 con 0x7f4ce80c0390 2023-05-17T15:05:19.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.968+0000 7f4cee315700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4cd405ee70 0x7f4cd4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:19.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.968+0000 7f4cee315700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4cd405ee70 0x7f4cd4061330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4ce0009130 tx=0x7f4ce0017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:19.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:19.972+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cdc04b100 con 0x7f4ce80c0390 2023-05-17T15:05:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.173+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ce80c1fe0 con 0x7f4cd405ee70 2023-05-17T15:05:20.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.176+0000 7f4ce67fc700 1 -- 172.21.15.27:0/2238412010 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4ce80c1fe0 con 0x7f4cd405ee70 2023-05-17T15:05:20.180 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-05-17T15:05:20.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.178+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4cd405ee70 msgr2=0x7f4cd4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.178+0000 7f4cf0579700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4cd405ee70 0x7f4cd4061330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4ce0009130 tx=0x7f4ce0017000).stop 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.178+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 msgr2=0x7f4ce80c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.178+0000 7f4cf0579700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 0x7f4ce80c3520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f4cdc00c880 tx=0x7f4cdc008040).stop 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 shutdown_connections 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4cd405ee70 0x7f4cd4061330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ce8153d50 0x7f4ce80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ce80aa250 0x7f4ce814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 --2- 172.21.15.27:0/2238412010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ce80c0390 0x7f4ce80c3520 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 >> 172.21.15.27:0/2238412010 conn(0x7f4ce80cae00 msgr2=0x7f4ce80cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 shutdown_connections 2023-05-17T15:05:20.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.179+0000 7f4cf0579700 1 -- 172.21.15.27:0/2238412010 wait complete. 2023-05-17T15:05:20.193 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-05-17T15:05:20.194 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-05-17T15:05:20.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.310+0000 7f1672172700 1 Processor -- start 2023-05-17T15:05:20.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.310+0000 7f1672172700 1 -- start start 2023-05-17T15:05:20.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f1672172700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f166c154980 0x7f166c081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f1672172700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c158010 con 0x7f166c151c90 2023-05-17T15:05:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f1672172700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0c0c30 con 0x7f166c152070 2023-05-17T15:05:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f1672172700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c154f60 con 0x7f166c154980 2023-05-17T15:05:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f166bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f166c154980 0x7f166c081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f166b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f166c151c90 0x7f166c0c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35732/0 (socket says 172.21.15.27:35732) 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.311+0000 7f166b7fe700 1 -- 172.21.15.27:0/3165879414 learned_addr learned my addr 172.21.15.27:0/3165879414 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166bfff700 1 -- 172.21.15.27:0/3165879414 >> v1:172.21.15.40:6789/0 conn(0x7f166c152070 legacy=0x7f166c0c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166bfff700 1 -- 172.21.15.27:0/3165879414 >> v1:172.21.15.27:6789/0 conn(0x7f166c151c90 legacy=0x7f166c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166bfff700 1 -- 172.21.15.27:0/3165879414 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c155240 con 0x7f166c154980 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166a7fc700 1 -- 172.21.15.27:0/3165879414 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054136158 0 0) 0x7f166c158010 con 0x7f166c151c90 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166bfff700 1 --2- 172.21.15.27:0/3165879414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c154980 0x7f166c081fd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f165c009760 tx=0x7f165c009060).ready entity=mon.0 client_cookie=487604735665732a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166a7fc700 1 -- 172.21.15.27:0/3165879414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00b520 con 0x7f166c154980 2023-05-17T15:05:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166a7fc700 1 -- 172.21.15.27:0/3165879414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00b680 con 0x7f166c154980 2023-05-17T15:05:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f166a7fc700 1 -- 172.21.15.27:0/3165879414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00ba00 con 0x7f166c154980 2023-05-17T15:05:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f1672172700 1 -- 172.21.15.27:0/3165879414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c154980 msgr2=0x7f166c081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f1672172700 1 --2- 172.21.15.27:0/3165879414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c154980 0x7f166c081fd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f165c009760 tx=0x7f165c009060).stop 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f1672172700 1 -- 172.21.15.27:0/3165879414 shutdown_connections 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f1672172700 1 --2- 172.21.15.27:0/3165879414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c154980 0x7f166c081fd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f1672172700 1 -- 172.21.15.27:0/3165879414 >> 172.21.15.27:0/3165879414 conn(0x7f166c0cae10 msgr2=0x7f166c0cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.312+0000 7f1672172700 1 -- 172.21.15.27:0/3165879414 shutdown_connections 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.313+0000 7f1672172700 1 -- 172.21.15.27:0/3165879414 wait complete. 2023-05-17T15:05:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.314+0000 7f1672172700 1 Processor -- start 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.314+0000 7f1672172700 1 -- start start 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.314+0000 7f1672172700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 0x7f166c146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f166c152070 0x7f166c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f166c154980 0x7f166c153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0aea70 con 0x7f166c151c90 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c146940 con 0x7f166c154980 2023-05-17T15:05:20.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0ade60 con 0x7f166c152070 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 0x7f166c146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 0x7f166c146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36176/0 (socket says 172.21.15.27:36176) 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 -- 172.21.15.27:0/3342360383 learned_addr learned my addr 172.21.15.27:0/3342360383 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166bfff700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f166c154980 0x7f166c153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166affd700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f166c152070 0x7f166c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 -- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f166c152070 msgr2=0x7f166c1508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f166c152070 0x7f166c1508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 -- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f166c154980 msgr2=0x7f166c153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f166c154980 0x7f166c153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 -- 172.21.15.27:0/3342360383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0092a0 con 0x7f166c151c90 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166affd700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f166c152070 0x7f166c1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f166b7fe700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 0x7f166c146450 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f166400c960 tx=0x7f1664001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664005d30 con 0x7f166c151c90 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1664005e90 con 0x7f166c151c90 2023-05-17T15:05:20.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c0ae140 con 0x7f166c151c90 2023-05-17T15:05:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664007340 con 0x7f166c151c90 2023-05-17T15:05:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.315+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c0ae700 con 0x7f166c151c90 2023-05-17T15:05:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.317+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c0aede0 con 0x7f166c151c90 2023-05-17T15:05:20.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.317+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f1664010030 con 0x7f166c151c90 2023-05-17T15:05:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.317+0000 7f16637fe700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f164c05ee70 0x7f164c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.317+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1664079c20 con 0x7f166c151c90 2023-05-17T15:05:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.317+0000 7f166affd700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f164c05ee70 0x7f164c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.318+0000 7f166affd700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f164c05ee70 0x7f164c061330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f166c0aa7e0 tx=0x7f1654009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:20.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.321+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f166404b180 con 0x7f166c151c90 2023-05-17T15:05:20.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.522+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f166c0aebb0 con 0x7f164c05ee70 2023-05-17T15:05:20.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.525+0000 7f16637fe700 1 -- 172.21.15.27:0/3342360383 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f16540023c0 con 0x7f164c05ee70 2023-05-17T15:05:20.529 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-05-17T15:05:20.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f164c05ee70 msgr2=0x7f164c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f164c05ee70 0x7f164c061330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f166c0aa7e0 tx=0x7f1654009040).stop 2023-05-17T15:05:20.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 msgr2=0x7f166c146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 0x7f166c146450 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f166400c960 tx=0x7f1664001630).stop 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 shutdown_connections 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f164c05ee70 0x7f164c061330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f166c154980 0x7f166c153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f166c151c90 0x7f166c146450 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 --2- 172.21.15.27:0/3342360383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f166c152070 0x7f166c1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 >> 172.21.15.27:0/3342360383 conn(0x7f166c0cae10 msgr2=0x7f166c155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:20.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.527+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 shutdown_connections 2023-05-17T15:05:20.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.528+0000 7f1672172700 1 -- 172.21.15.27:0/3342360383 wait complete. 2023-05-17T15:05:20.542 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-05-17T15:05:20.543 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-05-17T15:05:20.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.660+0000 7f195ffff700 1 Processor -- start 2023-05-17T15:05:20.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.660+0000 7f195ffff700 1 -- start start 2023-05-17T15:05:20.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f19600c1080 0x7f19600c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195ffff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1960154a50 con 0x7f19600c5d60 2023-05-17T15:05:20.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195ffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1960154d30 con 0x7f1960154520 2023-05-17T15:05:20.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1960155010 con 0x7f19600c1080 2023-05-17T15:05:20.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f19600c5d60 0x7f19600a99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35750/0 (socket says 172.21.15.27:35750) 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f19600c1080 0x7f19600c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195f7fe700 1 -- 172.21.15.27:0/2947782235 learned_addr learned my addr 172.21.15.27:0/2947782235 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195effd700 1 -- 172.21.15.27:0/2947782235 >> v1:172.21.15.40:6789/0 conn(0x7f1960154520 legacy=0x7f19600c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195effd700 1 -- 172.21.15.27:0/2947782235 >> v1:172.21.15.27:6789/0 conn(0x7f19600c5d60 legacy=0x7f19600a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195dffb700 1 -- 172.21.15.27:0/2947782235 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696766019 0 0) 0x7f1960154a50 con 0x7f19600c5d60 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195effd700 1 -- 172.21.15.27:0/2947782235 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19601552f0 con 0x7f19600c1080 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195effd700 1 --2- 172.21.15.27:0/2947782235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f19600c1460 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f1958009760 tx=0x7f1958009060).ready entity=mon.0 client_cookie=be0bac52e891191f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:20.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195dffb700 1 -- 172.21.15.27:0/2947782235 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800b580 con 0x7f19600c1080 2023-05-17T15:05:20.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195dffb700 1 -- 172.21.15.27:0/2947782235 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195800b6e0 con 0x7f19600c1080 2023-05-17T15:05:20.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.661+0000 7f195dffb700 1 -- 172.21.15.27:0/2947782235 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800ba60 con 0x7f19600c1080 2023-05-17T15:05:20.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 -- 172.21.15.27:0/2947782235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 msgr2=0x7f19600c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 --2- 172.21.15.27:0/2947782235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f19600c1460 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f1958009760 tx=0x7f1958009060).stop 2023-05-17T15:05:20.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 -- 172.21.15.27:0/2947782235 shutdown_connections 2023-05-17T15:05:20.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 --2- 172.21.15.27:0/2947782235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f19600c1460 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 -- 172.21.15.27:0/2947782235 >> 172.21.15.27:0/2947782235 conn(0x7f196005dd50 msgr2=0x7f196005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 -- 172.21.15.27:0/2947782235 shutdown_connections 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.662+0000 7f195ffff700 1 -- 172.21.15.27:0/2947782235 wait complete. 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.663+0000 7f195ffff700 1 Processor -- start 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.663+0000 7f195ffff700 1 -- start start 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f1960164a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19600c5d60 0x7f19600ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1960154520 0x7f19601508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600ca3f0 con 0x7f19600c1080 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600c94f0 con 0x7f19600c5d60 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19600c97d0 con 0x7f1960154520 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f1960164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f1960164a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36192/0 (socket says 172.21.15.27:36192) 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 -- 172.21.15.27:0/2370586412 learned_addr learned my addr 172.21.15.27:0/2370586412 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 -- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1960154520 msgr2=0x7f19601508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1960154520 0x7f19601508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 -- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19600c5d60 msgr2=0x7f19600ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195e7fc700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19600c5d60 0x7f19600ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19600c5d60 0x7f19600ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 -- 172.21.15.27:0/2370586412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580092a0 con 0x7f19600c1080 2023-05-17T15:05:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.664+0000 7f195effd700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f1960164a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f1958009eb0 tx=0x7f1958017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.665+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800ba60 con 0x7f19600c1080 2023-05-17T15:05:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.665+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958000c90 con 0x7f19600c1080 2023-05-17T15:05:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.665+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19600ca640 con 0x7f19600c1080 2023-05-17T15:05:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.665+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195801b640 con 0x7f19600c1080 2023-05-17T15:05:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.665+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19600adf00 con 0x7f19600c1080 2023-05-17T15:05:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.665+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19600cab60 con 0x7f19600c1080 2023-05-17T15:05:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.666+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f195800f070 con 0x7f19600c1080 2023-05-17T15:05:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.666+0000 7f1956ffd700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005ee70 0x7f1940061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.666+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f195807b8d0 con 0x7f19600c1080 2023-05-17T15:05:20.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.666+0000 7f195e7fc700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005ee70 0x7f1940061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.667+0000 7f195e7fc700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005ee70 0x7f1940061330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f19480015e0 tx=0x7f1948009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:20.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.670+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19600cab60 con 0x7f19600c1080 2023-05-17T15:05:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.868+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f19600cab60 con 0x7f194005ee70 2023-05-17T15:05:20.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.872+0000 7f1956ffd700 1 -- 172.21.15.27:0/2370586412 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f19600cab60 con 0x7f194005ee70 2023-05-17T15:05:20.876 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-05-17T15:05:20.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005ee70 msgr2=0x7f1940061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005ee70 0x7f1940061330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f19480015e0 tx=0x7f1948009040).stop 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 msgr2=0x7f1960164a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f1960164a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f1958009eb0 tx=0x7f1958017000).stop 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 shutdown_connections 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f194005ee70 0x7f1940061330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1960154520 0x7f19601508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:20.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19600c1080 0x7f1960164a60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 --2- 172.21.15.27:0/2370586412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19600c5d60 0x7f19600ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 >> 172.21.15.27:0/2370586412 conn(0x7f196005dd50 msgr2=0x7f1960152170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 shutdown_connections 2023-05-17T15:05:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:20.874+0000 7f195ffff700 1 -- 172.21.15.27:0/2370586412 wait complete. 2023-05-17T15:05:20.889 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-05-17T15:05:20.889 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-05-17T15:05:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.006+0000 7f3a5dfd8700 1 Processor -- start 2023-05-17T15:05:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.006+0000 7f3a5dfd8700 1 -- start start 2023-05-17T15:05:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a5dfd8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a581540a0 0x7f3a580be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a5dfd8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3a58067db0 0x7f3a58063f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a5dfd8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a580beae0 con 0x7f3a58154480 2023-05-17T15:05:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a5dfd8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580bedc0 con 0x7f3a58067db0 2023-05-17T15:05:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a5dfd8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580bf0a0 con 0x7f3a581540a0 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a56ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3a58067db0 0x7f3a58063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a57fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3a58154480 0x7f3a58065400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35760/0 (socket says 172.21.15.27:35760) 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a57fff700 1 -- 172.21.15.27:0/471329894 learned_addr learned my addr 172.21.15.27:0/471329894 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a577fe700 1 --2- 172.21.15.27:0/471329894 >> v2:172.21.15.40:3300/0 conn(0x7f3a581540a0 0x7f3a580be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a56ffd700 1 -- 172.21.15.27:0/471329894 >> v2:172.21.15.40:3300/0 conn(0x7f3a581540a0 msgr2=0x7f3a580be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a56ffd700 1 --2- 172.21.15.27:0/471329894 >> v2:172.21.15.40:3300/0 conn(0x7f3a581540a0 0x7f3a580be120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a56ffd700 1 -- 172.21.15.27:0/471329894 >> v1:172.21.15.27:6789/0 conn(0x7f3a58154480 legacy=0x7f3a58065400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a567fc700 1 -- 172.21.15.27:0/471329894 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669183500 0 0) 0x7f3a580beae0 con 0x7f3a58154480 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a56ffd700 1 -- 172.21.15.27:0/471329894 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580bf380 con 0x7f3a58067db0 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.007+0000 7f3a577fe700 1 --2- 172.21.15.27:0/471329894 >> v2:172.21.15.40:3300/0 conn(0x7f3a581540a0 0x7f3a580be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a56ffd700 1 --2- 172.21.15.27:0/471329894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a58067db0 0x7f3a58063f00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f3a58067230 tx=0x7f3a4c009060).ready entity=mon.0 client_cookie=aa8abb5249f7d7d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a567fc700 1 -- 172.21.15.27:0/471329894 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00b580 con 0x7f3a58067db0 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a567fc700 1 -- 172.21.15.27:0/471329894 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00b6e0 con 0x7f3a58067db0 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a567fc700 1 -- 172.21.15.27:0/471329894 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00ba60 con 0x7f3a58067db0 2023-05-17T15:05:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/471329894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a58067db0 msgr2=0x7f3a58063f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/471329894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a58067db0 0x7f3a58063f00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f3a58067230 tx=0x7f3a4c009060).stop 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/471329894 shutdown_connections 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/471329894 >> v2:172.21.15.40:3300/0 conn(0x7f3a581540a0 0x7f3a580be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/471329894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a58067db0 0x7f3a58063f00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/471329894 >> 172.21.15.27:0/471329894 conn(0x7f3a580c8ad0 msgr2=0x7f3a580c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/471329894 shutdown_connections 2023-05-17T15:05:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.008+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/471329894 wait complete. 2023-05-17T15:05:21.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.009+0000 7f3a5dfd8700 1 Processor -- start 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.009+0000 7f3a5dfd8700 1 -- start start 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a5dfd8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a58067db0 0x7f3a580a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a5dfd8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a581540a0 0x7f3a580a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a5dfd8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 0x7f3a580bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a5dfd8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580ab3a0 con 0x7f3a580bfb70 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a5dfd8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580aa790 con 0x7f3a581540a0 2023-05-17T15:05:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a5dfd8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580aaa70 con 0x7f3a58067db0 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 0x7f3a580bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 0x7f3a580bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36208/0 (socket says 172.21.15.27:36208) 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.010+0000 7f3a57fff700 1 -- 172.21.15.27:0/1451078208 learned_addr learned my addr 172.21.15.27:0/1451078208 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a56ffd700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a581540a0 0x7f3a580a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a577fe700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a58067db0 0x7f3a580a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a57fff700 1 -- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a58067db0 msgr2=0x7f3a580a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a57fff700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a58067db0 0x7f3a580a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a57fff700 1 -- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a581540a0 msgr2=0x7f3a580a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a57fff700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a581540a0 0x7f3a580a9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a57fff700 1 -- 172.21.15.27:0/1451078208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0092a0 con 0x7f3a580bfb70 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a57fff700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 0x7f3a580bffb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f3a5000c810 tx=0x7f3a500014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50005d30 con 0x7f3a580bfb70 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a50005e90 con 0x7f3a580bfb70 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a580aad50 con 0x7f3a580bfb70 2023-05-17T15:05:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50007340 con 0x7f3a580bfb70 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.011+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a580aa340 con 0x7f3a580bfb70 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.012+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a580ab510 con 0x7f3a580bfb70 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.012+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f3a50010030 con 0x7f3a580bfb70 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.013+0000 7f3a3f7fe700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3a4405eea0 0x7f3a44061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.013+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f3a50079c60 con 0x7f3a580bfb70 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.013+0000 7f3a577fe700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3a4405eea0 0x7f3a44061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.013+0000 7f3a577fe700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3a4405eea0 0x7f3a44061360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3a4800aa70 tx=0x7f3a48008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.017+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3a5004b110 con 0x7f3a580bfb70 2023-05-17T15:05:21.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.214+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a580637d0 con 0x7f3a4405eea0 2023-05-17T15:05:21.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.218+0000 7f3a3f7fe700 1 -- 172.21.15.27:0/1451078208 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3a580637d0 con 0x7f3a4405eea0 2023-05-17T15:05:21.222 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-05-17T15:05:21.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3a4405eea0 msgr2=0x7f3a44061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3a4405eea0 0x7f3a44061360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3a4800aa70 tx=0x7f3a48008040).stop 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 msgr2=0x7f3a580bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 0x7f3a580bffb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f3a5000c810 tx=0x7f3a500014d0).stop 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 shutdown_connections 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f3a4405eea0 0x7f3a44061360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a580bfb70 0x7f3a580bffb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a58067db0 0x7f3a580a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 --2- 172.21.15.27:0/1451078208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a581540a0 0x7f3a580a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 >> 172.21.15.27:0/1451078208 conn(0x7f3a580c8ad0 msgr2=0x7f3a580c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:21.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 shutdown_connections 2023-05-17T15:05:21.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.220+0000 7f3a5dfd8700 1 -- 172.21.15.27:0/1451078208 wait complete. 2023-05-17T15:05:21.235 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-05-17T15:05:21.235 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-05-17T15:05:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.352+0000 7f24b359e700 1 Processor -- start 2023-05-17T15:05:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.352+0000 7f24b359e700 1 -- start start 2023-05-17T15:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f24b40c2bb0 0x7f24b4066c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b4154380 0x7f24b40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b40c1510 con 0x7f24b4153fa0 2023-05-17T15:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b40c1c70 con 0x7f24b40c2bb0 2023-05-17T15:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40667c0 con 0x7f24b4154380 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b1d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f24b40c2bb0 0x7f24b4066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f24b4153fa0 0x7f24b40c0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35774/0 (socket says 172.21.15.27:35774) 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b259c700 1 -- 172.21.15.27:0/2115542884 learned_addr learned my addr 172.21.15.27:0/2115542884 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b2d9d700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b4154380 0x7f24b40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b1d9b700 1 -- 172.21.15.27:0/2115542884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b4154380 msgr2=0x7f24b40c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b1d9b700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b4154380 0x7f24b40c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b1d9b700 1 -- 172.21.15.27:0/2115542884 >> v1:172.21.15.27:6789/0 conn(0x7f24b4153fa0 legacy=0x7f24b40c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b159a700 1 -- 172.21.15.27:0/2115542884 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889004459 0 0) 0x7f24ac001110 con 0x7f24b4153fa0 2023-05-17T15:05:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b1d9b700 1 -- 172.21.15.27:0/2115542884 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4065bb0 con 0x7f24b40c2bb0 2023-05-17T15:05:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b2d9d700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b4154380 0x7f24b40c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b1d9b700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b40c2bb0 0x7f24b4066c50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f24a8009760 tx=0x7f24a8009060).ready entity=mon.0 client_cookie=cd86d2a5e6c7394b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b159a700 1 -- 172.21.15.27:0/2115542884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800b580 con 0x7f24b40c2bb0 2023-05-17T15:05:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b159a700 1 -- 172.21.15.27:0/2115542884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a800b6e0 con 0x7f24b40c2bb0 2023-05-17T15:05:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.353+0000 7f24b159a700 1 -- 172.21.15.27:0/2115542884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800ba60 con 0x7f24b40c2bb0 2023-05-17T15:05:21.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 -- 172.21.15.27:0/2115542884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b40c2bb0 msgr2=0x7f24b4066c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b40c2bb0 0x7f24b4066c50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f24a8009760 tx=0x7f24a8009060).stop 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 -- 172.21.15.27:0/2115542884 shutdown_connections 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b4154380 0x7f24b40c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 --2- 172.21.15.27:0/2115542884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b40c2bb0 0x7f24b4066c50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 -- 172.21.15.27:0/2115542884 >> 172.21.15.27:0/2115542884 conn(0x7f24b40694b0 msgr2=0x7f24b40698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 -- 172.21.15.27:0/2115542884 shutdown_connections 2023-05-17T15:05:21.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.354+0000 7f24b359e700 1 -- 172.21.15.27:0/2115542884 wait complete. 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.355+0000 7f24b359e700 1 Processor -- start 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.355+0000 7f24b359e700 1 -- start start 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b40c2bb0 0x7f24b4139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24b4153fa0 0x7f24b405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 0x7f24b405e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b405e730 con 0x7f24b4154380 2023-05-17T15:05:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40a8420 con 0x7f24b4153fa0 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40bd9c0 con 0x7f24b40c2bb0 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 0x7f24b405e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 0x7f24b405e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36222/0 (socket says 172.21.15.27:36222) 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 -- 172.21.15.27:0/414448355 learned_addr learned my addr 172.21.15.27:0/414448355 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b259c700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b40c2bb0 0x7f24b4139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b1d9b700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24b4153fa0 0x7f24b405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 -- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b40c2bb0 msgr2=0x7f24b4139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b40c2bb0 0x7f24b4139de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 -- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24b4153fa0 msgr2=0x7f24b405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24b4153fa0 0x7f24b405dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 -- 172.21.15.27:0/414448355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80092a0 con 0x7f24b4154380 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.356+0000 7f24b2d9d700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 0x7f24b405e240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f24a400d180 tx=0x7f24a4009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.357+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400de20 con 0x7f24b4154380 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.357+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a400f040 con 0x7f24b4154380 2023-05-17T15:05:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.357+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4013600 con 0x7f24b4154380 2023-05-17T15:05:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.357+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b40c0340 con 0x7f24b4154380 2023-05-17T15:05:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.357+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b40a7ee0 con 0x7f24b4154380 2023-05-17T15:05:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.358+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b4068ee0 con 0x7f24b4154380 2023-05-17T15:05:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.358+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f24a40139f0 con 0x7f24b4154380 2023-05-17T15:05:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.358+0000 7f24a27fc700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f249405ee70 0x7f2494061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.358+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f24a407a5c0 con 0x7f24b4154380 2023-05-17T15:05:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.358+0000 7f24b259c700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f249405ee70 0x7f2494061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.359+0000 7f24b259c700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f249405ee70 0x7f2494061330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f24ac001640 tx=0x7f24ac009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.362+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24a404ba70 con 0x7f24b4154380 2023-05-17T15:05:21.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.564+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f24b4047150 con 0x7f249405ee70 2023-05-17T15:05:21.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.568+0000 7f24a27fc700 1 -- 172.21.15.27:0/414448355 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f24b4047150 con 0x7f249405ee70 2023-05-17T15:05:21.572 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-05-17T15:05:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f249405ee70 msgr2=0x7f2494061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f249405ee70 0x7f2494061330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f24ac001640 tx=0x7f24ac009040).stop 2023-05-17T15:05:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 msgr2=0x7f24b405e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 0x7f24b405e240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f24a400d180 tx=0x7f24a4009a50).stop 2023-05-17T15:05:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 shutdown_connections 2023-05-17T15:05:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f249405ee70 0x7f2494061330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24b4154380 0x7f24b405e240 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24b40c2bb0 0x7f24b4139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 --2- 172.21.15.27:0/414448355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24b4153fa0 0x7f24b405dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 >> 172.21.15.27:0/414448355 conn(0x7f24b40694b0 msgr2=0x7f24b40c0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 shutdown_connections 2023-05-17T15:05:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.570+0000 7f24b359e700 1 -- 172.21.15.27:0/414448355 wait complete. 2023-05-17T15:05:21.585 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-05-17T15:05:21.586 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-05-17T15:05:21.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.701+0000 7f4500962700 1 Processor -- start 2023-05-17T15:05:21.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.701+0000 7f4500962700 1 -- start start 2023-05-17T15:05:21.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f4500962700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f44fc151ae0 0x7f44fc0bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f4500962700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc155c20 con 0x7f44fc0c7da0 2023-05-17T15:05:21.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f4500962700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc155f00 con 0x7f44fc151ec0 2023-05-17T15:05:21.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f4500962700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc1561e0 con 0x7f44fc151ae0 2023-05-17T15:05:21.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f44fad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f44fc151ae0 0x7f44fc0bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f44fb59e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f44fc0c7da0 0x7f44fc0636b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35792/0 (socket says 172.21.15.27:35792) 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.702+0000 7f44fb59e700 1 -- 172.21.15.27:0/3081615403 learned_addr learned my addr 172.21.15.27:0/3081615403 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44fad9d700 1 -- 172.21.15.27:0/3081615403 >> v1:172.21.15.40:6789/0 conn(0x7f44fc151ec0 legacy=0x7f44fc0c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44fad9d700 1 -- 172.21.15.27:0/3081615403 >> v1:172.21.15.27:6789/0 conn(0x7f44fc0c7da0 legacy=0x7f44fc0636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44fad9d700 1 -- 172.21.15.27:0/3081615403 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc1564c0 con 0x7f44fc151ae0 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44f9d9b700 1 -- 172.21.15.27:0/3081615403 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995111419 0 0) 0x7f44fc155c20 con 0x7f44fc0c7da0 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44fad9d700 1 --2- 172.21.15.27:0/3081615403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc151ae0 0x7f44fc0bd080 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f44f4009760 tx=0x7f44f4009060).ready entity=mon.0 client_cookie=e4f86a384e2d1930 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44f9d9b700 1 -- 172.21.15.27:0/3081615403 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40090d0 con 0x7f44fc151ae0 2023-05-17T15:05:21.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44f9d9b700 1 -- 172.21.15.27:0/3081615403 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400b520 con 0x7f44fc151ae0 2023-05-17T15:05:21.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f44f9d9b700 1 -- 172.21.15.27:0/3081615403 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400b8a0 con 0x7f44fc151ae0 2023-05-17T15:05:21.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f4500962700 1 -- 172.21.15.27:0/3081615403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc151ae0 msgr2=0x7f44fc0bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.703+0000 7f4500962700 1 --2- 172.21.15.27:0/3081615403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc151ae0 0x7f44fc0bd080 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f44f4009760 tx=0x7f44f4009060).stop 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.704+0000 7f4500962700 1 -- 172.21.15.27:0/3081615403 shutdown_connections 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.704+0000 7f4500962700 1 --2- 172.21.15.27:0/3081615403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc151ae0 0x7f44fc0bd080 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.704+0000 7f4500962700 1 -- 172.21.15.27:0/3081615403 >> 172.21.15.27:0/3081615403 conn(0x7f44fc066ae0 msgr2=0x7f44fc066ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.704+0000 7f4500962700 1 -- 172.21.15.27:0/3081615403 shutdown_connections 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.704+0000 7f4500962700 1 -- 172.21.15.27:0/3081615403 wait complete. 2023-05-17T15:05:21.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.705+0000 7f4500962700 1 Processor -- start 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.705+0000 7f4500962700 1 -- start start 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44fc0c7da0 0x7f44fc0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44fc151ec0 0x7f44fc063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 0x7f44fc1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0bf7f0 con 0x7f44fc1508d0 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0bfad0 con 0x7f44fc0c7da0 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0bfdb0 con 0x7f44fc151ec0 2023-05-17T15:05:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 0x7f44fc1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 0x7f44fc1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36236/0 (socket says 172.21.15.27:36236) 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 -- 172.21.15.27:0/2573063791 learned_addr learned my addr 172.21.15.27:0/2573063791 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fad9d700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44fc0c7da0 0x7f44fc0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fa59c700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44fc151ec0 0x7f44fc063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 -- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44fc151ec0 msgr2=0x7f44fc063fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44fc151ec0 0x7f44fc063fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 -- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44fc0c7da0 msgr2=0x7f44fc0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44fc0c7da0 0x7f44fc0aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 -- 172.21.15.27:0/2573063791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40092a0 con 0x7f44fc1508d0 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44fb59e700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 0x7f44fc1491c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f44ec00c7e0 tx=0x7f44ec007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec005d30 con 0x7f44fc1508d0 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec005e90 con 0x7f44fc1508d0 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc0c0090 con 0x7f44fc1508d0 2023-05-17T15:05:21.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007320 con 0x7f44fc1508d0 2023-05-17T15:05:21.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.706+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc0644d0 con 0x7f44fc1508d0 2023-05-17T15:05:21.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.707+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc047150 con 0x7f44fc1508d0 2023-05-17T15:05:21.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.708+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f44ec010030 con 0x7f44fc1508d0 2023-05-17T15:05:21.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.708+0000 7f44f2ffd700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44dc05eea0 0x7f44dc061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:21.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.708+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f44ec079a60 con 0x7f44fc1508d0 2023-05-17T15:05:21.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.708+0000 7f44fad9d700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44dc05eea0 0x7f44dc061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:21.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.708+0000 7f44fad9d700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44dc05eea0 0x7f44dc061360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f44fc0c40f0 tx=0x7f44f4017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:21.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.712+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f44ec04af10 con 0x7f44fc1508d0 2023-05-17T15:05:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.912+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f44fc0c0530 con 0x7f44dc05eea0 2023-05-17T15:05:21.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.915+0000 7f44f2ffd700 1 -- 172.21.15.27:0/2573063791 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f44fc0c0530 con 0x7f44dc05eea0 2023-05-17T15:05:21.919 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-05-17T15:05:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44dc05eea0 msgr2=0x7f44dc061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44dc05eea0 0x7f44dc061360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f44fc0c40f0 tx=0x7f44f4017000).stop 2023-05-17T15:05:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 msgr2=0x7f44fc1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 0x7f44fc1491c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f44ec00c7e0 tx=0x7f44ec007f90).stop 2023-05-17T15:05:21.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 shutdown_connections 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44dc05eea0 0x7f44dc061360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f44fc1508d0 0x7f44fc1491c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44fc0c7da0 0x7f44fc0aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 --2- 172.21.15.27:0/2573063791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44fc151ec0 0x7f44fc063fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 >> 172.21.15.27:0/2573063791 conn(0x7f44fc066ae0 msgr2=0x7f44fc150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 shutdown_connections 2023-05-17T15:05:21.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:21.917+0000 7f4500962700 1 -- 172.21.15.27:0/2573063791 wait complete. 2023-05-17T15:05:21.932 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-05-17T15:05:21.933 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-05-17T15:05:22.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.049+0000 7fef77ec8700 1 Processor -- start 2023-05-17T15:05:22.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.049+0000 7fef77ec8700 1 -- start start 2023-05-17T15:05:22.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef77ec8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef77ec8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70065300 con 0x7fef7005dd50 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef77ec8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef700c3b40 con 0x7fef70157770 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef77ec8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef700636d0 con 0x7fef70157390 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef76465700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fef7005dd50 0x7fef700bc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35806/0 (socket says 172.21.15.27:35806) 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef76465700 1 -- 172.21.15.27:0/1283245202 learned_addr learned my addr 172.21.15.27:0/1283245202 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef75c64700 1 --2- 172.21.15.27:0/1283245202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960915724 0 0) 0x7fef70065300 con 0x7fef7005dd50 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef580033f0 con 0x7fef7005dd50 2023-05-17T15:05:22.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588967499 0 0) 0x7fef700c3b40 con 0x7fef70157770 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef70065300 con 0x7fef70157770 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef75c64700 1 -- 172.21.15.27:0/1283245202 >> v1:172.21.15.40:6789/0 conn(0x7fef70157770 legacy=0x7fef70063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef75c64700 1 -- 172.21.15.27:0/1283245202 >> v1:172.21.15.27:6789/0 conn(0x7fef7005dd50 legacy=0x7fef700bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.050+0000 7fef75c64700 1 -- 172.21.15.27:0/1283245202 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700646f0 con 0x7fef70157390 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef75c64700 1 --2- 172.21.15.27:0/1283245202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700c3650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fef68009790 tx=0x7fef68009060).ready entity=mon.2 client_cookie=53cd88f4668010bc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6800f510 con 0x7fef70157390 2023-05-17T15:05:22.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6800f670 con 0x7fef70157390 2023-05-17T15:05:22.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef74c62700 1 -- 172.21.15.27:0/1283245202 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6800f9f0 con 0x7fef70157390 2023-05-17T15:05:22.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 -- 172.21.15.27:0/1283245202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 msgr2=0x7fef700c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 --2- 172.21.15.27:0/1283245202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700c3650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fef68009790 tx=0x7fef68009060).stop 2023-05-17T15:05:22.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 -- 172.21.15.27:0/1283245202 shutdown_connections 2023-05-17T15:05:22.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 --2- 172.21.15.27:0/1283245202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700c3650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 -- 172.21.15.27:0/1283245202 >> 172.21.15.27:0/1283245202 conn(0x7fef700c84a0 msgr2=0x7fef700c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 -- 172.21.15.27:0/1283245202 shutdown_connections 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.051+0000 7fef77ec8700 1 -- 172.21.15.27:0/1283245202 wait complete. 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 Processor -- start 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 -- start start 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7005dd50 0x7fef7014a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 0x7fef700c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700c1880 con 0x7fef70157770 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700a8cc0 con 0x7fef7005dd50 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef77ec8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef700a8fa0 con 0x7fef70157390 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef76465700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 0x7fef700c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef76465700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 0x7fef700c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36250/0 (socket says 172.21.15.27:36250) 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.053+0000 7fef76465700 1 -- 172.21.15.27:0/3281623158 learned_addr learned my addr 172.21.15.27:0/3281623158 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef75463700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef75c64700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7005dd50 0x7fef7014a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef76465700 1 -- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 msgr2=0x7fef700a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef76465700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef76465700 1 -- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7005dd50 msgr2=0x7fef7014a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef76465700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7005dd50 0x7fef7014a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef76465700 1 -- 172.21.15.27:0/3281623158 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680092a0 con 0x7fef70157770 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef75463700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef76465700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 0x7fef700c6170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fef60001560 tx=0x7fef60001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60005d30 con 0x7fef70157770 2023-05-17T15:05:22.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60005e90 con 0x7fef70157770 2023-05-17T15:05:22.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60007320 con 0x7fef70157770 2023-05-17T15:05:22.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef700a9280 con 0x7fef70157770 2023-05-17T15:05:22.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.054+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7014a980 con 0x7fef70157770 2023-05-17T15:05:22.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.055+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef700a97a0 con 0x7fef70157770 2023-05-17T15:05:22.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.055+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fef60010030 con 0x7fef70157770 2023-05-17T15:05:22.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.056+0000 7fef6dffb700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef5c05ee70 0x7fef5c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.056+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fef60079be0 con 0x7fef70157770 2023-05-17T15:05:22.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.056+0000 7fef75c64700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef5c05ee70 0x7fef5c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.056+0000 7fef75c64700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef5c05ee70 0x7fef5c061330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fef68009f00 tx=0x7fef68017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.060+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef700a97a0 con 0x7fef70157770 2023-05-17T15:05:22.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.257+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fef700a97a0 con 0x7fef5c05ee70 2023-05-17T15:05:22.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.260+0000 7fef6dffb700 1 -- 172.21.15.27:0/3281623158 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fef700a97a0 con 0x7fef5c05ee70 2023-05-17T15:05:22.264 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-05-17T15:05:22.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef5c05ee70 msgr2=0x7fef5c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef5c05ee70 0x7fef5c061330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fef68009f00 tx=0x7fef68017000).stop 2023-05-17T15:05:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 msgr2=0x7fef700c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 0x7fef700c6170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fef60001560 tx=0x7fef60001650).stop 2023-05-17T15:05:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 shutdown_connections 2023-05-17T15:05:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef5c05ee70 0x7fef5c061330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef70157770 0x7fef700c6170 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7005dd50 0x7fef7014a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 --2- 172.21.15.27:0/3281623158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef70157390 0x7fef700a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.262+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 >> 172.21.15.27:0/3281623158 conn(0x7fef700c84a0 msgr2=0x7fef700c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:22.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.263+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 shutdown_connections 2023-05-17T15:05:22.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.263+0000 7fef77ec8700 1 -- 172.21.15.27:0/3281623158 wait complete. 2023-05-17T15:05:22.277 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-05-17T15:05:22.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:22.278 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-05-17T15:05:22.294 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:22.294 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:22.294 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:22.294 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:22.296 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:22.297 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-05-17T15:05:22.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.451+0000 7f9a6ebbd700 1 Processor -- start 2023-05-17T15:05:22.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6ebbd700 1 -- start start 2023-05-17T15:05:22.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6ebbd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a68067db0 0x7f9a68063f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6ebbd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9a68154480 0x7f9a680643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6ebbd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a680be830 con 0x7f9a681540a0 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6ebbd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680648e0 con 0x7f9a68154480 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6ebbd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680beae0 con 0x7f9a68067db0 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6d15a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9a68154480 0x7f9a680643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6c959700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9a681540a0 0x7f9a680be120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35816/0 (socket says 172.21.15.27:35816) 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.452+0000 7f9a6c959700 1 -- 172.21.15.27:0/2843221303 learned_addr learned my addr 172.21.15.27:0/2843221303 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a67fff700 1 --2- 172.21.15.27:0/2843221303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a68067db0 0x7f9a68063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a6d15a700 1 -- 172.21.15.27:0/2843221303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a68067db0 msgr2=0x7f9a68063f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a6d15a700 1 --2- 172.21.15.27:0/2843221303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a68067db0 0x7f9a68063f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a6d15a700 1 -- 172.21.15.27:0/2843221303 >> v1:172.21.15.27:6789/0 conn(0x7f9a681540a0 legacy=0x7f9a680be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a6d15a700 1 -- 172.21.15.27:0/2843221303 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680bedc0 con 0x7f9a68154480 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a677fe700 1 -- 172.21.15.27:0/2843221303 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091576608 0 0) 0x7f9a680be830 con 0x7f9a681540a0 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a6d15a700 1 --2- 172.21.15.27:0/2843221303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68154480 0x7f9a680643f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f9a50009760 tx=0x7f9a50009060).ready entity=mon.0 client_cookie=e3941f9394fd56b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a677fe700 1 -- 172.21.15.27:0/2843221303 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000b580 con 0x7f9a68154480 2023-05-17T15:05:22.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a677fe700 1 -- 172.21.15.27:0/2843221303 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000b6e0 con 0x7f9a68154480 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.453+0000 7f9a677fe700 1 -- 172.21.15.27:0/2843221303 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000ba60 con 0x7f9a68154480 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/2843221303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68154480 msgr2=0x7f9a680643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/2843221303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68154480 0x7f9a680643f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f9a50009760 tx=0x7f9a50009060).stop 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/2843221303 shutdown_connections 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/2843221303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68154480 0x7f9a680643f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/2843221303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a68067db0 0x7f9a68063f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/2843221303 >> 172.21.15.27:0/2843221303 conn(0x7f9a680c8ad0 msgr2=0x7f9a680c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/2843221303 shutdown_connections 2023-05-17T15:05:22.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.454+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/2843221303 wait complete. 2023-05-17T15:05:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.455+0000 7f9a6ebbd700 1 Processor -- start 2023-05-17T15:05:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.455+0000 7f9a6ebbd700 1 -- start start 2023-05-17T15:05:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 0x7f9a68146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a681540a0 0x7f9a6814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a68146b30 0x7f9a68150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68150960 con 0x7f9a68067db0 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680aa920 con 0x7f9a68146b30 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680a9d10 con 0x7f9a681540a0 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 0x7f9a68146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 0x7f9a68146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36260/0 (socket says 172.21.15.27:36260) 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 -- 172.21.15.27:0/1338023513 learned_addr learned my addr 172.21.15.27:0/1338023513 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a67fff700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a681540a0 0x7f9a6814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6d15a700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a68146b30 0x7f9a68150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 -- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a681540a0 msgr2=0x7f9a6814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a681540a0 0x7f9a6814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 -- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a68146b30 msgr2=0x7f9a68150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a68146b30 0x7f9a68150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 -- 172.21.15.27:0/1338023513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500092a0 con 0x7f9a68067db0 2023-05-17T15:05:22.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a67fff700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a681540a0 0x7f9a6814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6d15a700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a68146b30 0x7f9a68150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6c959700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 0x7f9a68146640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f9a6000c960 tx=0x7f9a60001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60005d30 con 0x7f9a68067db0 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60005e90 con 0x7f9a68067db0 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680a9ff0 con 0x7f9a68067db0 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.456+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60007320 con 0x7f9a68067db0 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.457+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a680aa5b0 con 0x7f9a68067db0 2023-05-17T15:05:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.457+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6806bdf0 con 0x7f9a68067db0 2023-05-17T15:05:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.458+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f9a60010030 con 0x7f9a68067db0 2023-05-17T15:05:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.458+0000 7f9a64ff9700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9a4805ee70 0x7f9a48061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.458+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f9a60079d30 con 0x7f9a68067db0 2023-05-17T15:05:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.458+0000 7f9a67fff700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9a4805ee70 0x7f9a48061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.459+0000 7f9a67fff700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9a4805ee70 0x7f9a48061330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9a680c85c0 tx=0x7f9a58008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.462+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9a6004b1e0 con 0x7f9a68067db0 2023-05-17T15:05:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.660+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a6805e430 con 0x7f9a4805ee70 2023-05-17T15:05:22.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.661+0000 7f9a64ff9700 1 -- 172.21.15.27:0/1338023513 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9a6805e430 con 0x7f9a4805ee70 2023-05-17T15:05:22.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:22.665 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:52", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9a4805ee70 msgr2=0x7f9a48061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9a4805ee70 0x7f9a48061330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9a680c85c0 tx=0x7f9a58008040).stop 2023-05-17T15:05:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 msgr2=0x7f9a68146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 0x7f9a68146640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f9a6000c960 tx=0x7f9a60001630).stop 2023-05-17T15:05:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 shutdown_connections 2023-05-17T15:05:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9a4805ee70 0x7f9a48061330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a68146b30 0x7f9a68150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a68067db0 0x7f9a68146640 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 --2- 172.21.15.27:0/1338023513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a681540a0 0x7f9a6814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 >> 172.21.15.27:0/1338023513 conn(0x7f9a680c8ad0 msgr2=0x7f9a68152730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 shutdown_connections 2023-05-17T15:05:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.663+0000 7f9a6ebbd700 1 -- 172.21.15.27:0/1338023513 wait complete. 2023-05-17T15:05:22.679 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:52", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:22.679 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:52', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:22.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:22.680 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-05-17T15:05:22.696 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:22.696 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:22.696 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:22.696 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:22.696 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:22.698 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:22.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-05-17T15:05:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.853+0000 7ff072339700 1 Processor -- start 2023-05-17T15:05:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.853+0000 7ff072339700 1 -- start start 2023-05-17T15:05:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff072339700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff06c153fa0 0x7ff06c0c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff072339700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff06c0826e0 0x7ff06c0aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff072339700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0c1610 con 0x7ff06c0aa130 2023-05-17T15:05:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff072339700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0c0a00 con 0x7ff06c153fa0 2023-05-17T15:05:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff072339700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0c0ce0 con 0x7ff06c0826e0 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff06c153fa0 0x7ff06c0c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff06c0aa130 0x7ff06c081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35832/0 (socket says 172.21.15.27:35832) 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06b7fe700 1 -- 172.21.15.27:0/2053847741 learned_addr learned my addr 172.21.15.27:0/2053847741 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06bfff700 1 -- 172.21.15.27:0/2053847741 >> v2:172.21.15.40:3300/0 conn(0x7ff06c0826e0 msgr2=0x7ff06c0aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff0708d6700 1 --2- 172.21.15.27:0/2053847741 >> v2:172.21.15.40:3300/0 conn(0x7ff06c0826e0 0x7ff06c0aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06bfff700 1 --2- 172.21.15.27:0/2053847741 >> v2:172.21.15.40:3300/0 conn(0x7ff06c0826e0 0x7ff06c0aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06affd700 1 -- 172.21.15.27:0/2053847741 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121930819 0 0) 0x7ff06c0c1610 con 0x7ff06c0aa130 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06bfff700 1 -- 172.21.15.27:0/2053847741 >> v1:172.21.15.27:6789/0 conn(0x7ff06c0aa130 legacy=0x7ff06c081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06bfff700 1 -- 172.21.15.27:0/2053847741 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0c0fc0 con 0x7ff06c153fa0 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff0708d6700 1 --2- 172.21.15.27:0/2053847741 >> v2:172.21.15.40:3300/0 conn(0x7ff06c0826e0 0x7ff06c0aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06bfff700 1 --2- 172.21.15.27:0/2053847741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c153fa0 0x7ff06c0c0420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7ff06c0c5cb0 tx=0x7ff054009060).ready entity=mon.0 client_cookie=5503b38077ee0272 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06affd700 1 -- 172.21.15.27:0/2053847741 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400b580 con 0x7ff06c153fa0 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06affd700 1 -- 172.21.15.27:0/2053847741 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400b6e0 con 0x7ff06c153fa0 2023-05-17T15:05:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.854+0000 7ff06affd700 1 -- 172.21.15.27:0/2053847741 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400ba60 con 0x7ff06c153fa0 2023-05-17T15:05:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 -- 172.21.15.27:0/2053847741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c153fa0 msgr2=0x7ff06c0c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 --2- 172.21.15.27:0/2053847741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c153fa0 0x7ff06c0c0420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7ff06c0c5cb0 tx=0x7ff054009060).stop 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 -- 172.21.15.27:0/2053847741 shutdown_connections 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 --2- 172.21.15.27:0/2053847741 >> v2:172.21.15.40:3300/0 conn(0x7ff06c0826e0 0x7ff06c0aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 --2- 172.21.15.27:0/2053847741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c153fa0 0x7ff06c0c0420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 -- 172.21.15.27:0/2053847741 >> 172.21.15.27:0/2053847741 conn(0x7ff06c05e820 msgr2=0x7ff06c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 -- 172.21.15.27:0/2053847741 shutdown_connections 2023-05-17T15:05:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.855+0000 7ff072339700 1 -- 172.21.15.27:0/2053847741 wait complete. 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.856+0000 7ff072339700 1 Processor -- start 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.856+0000 7ff072339700 1 -- start start 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff072339700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 0x7ff06c0a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff072339700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff06c0aa130 0x7ff06c0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff072339700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff06c153fa0 0x7ff06c167880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff072339700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0af480 con 0x7ff06c0826e0 2023-05-17T15:05:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff072339700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0c4af0 con 0x7ff06c153fa0 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff072339700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c1683f0 con 0x7ff06c0aa130 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 0x7ff06c0a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 0x7ff06c0a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36274/0 (socket says 172.21.15.27:36274) 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 -- 172.21.15.27:0/1168691152 learned_addr learned my addr 172.21.15.27:0/1168691152 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 -- 172.21.15.27:0/1168691152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff06c0aa130 msgr2=0x7ff06c0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff06c0aa130 0x7ff06c0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 -- 172.21.15.27:0/1168691152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff06c153fa0 msgr2=0x7ff06c167880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff06c153fa0 0x7ff06c167880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 -- 172.21.15.27:0/1168691152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540092a0 con 0x7ff06c0826e0 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff06bfff700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 0x7ff06c0a92f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7ff06c0cacf0 tx=0x7ff054017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.857+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400b850 con 0x7ff06c0826e0 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.858+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400b9b0 con 0x7ff06c0826e0 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.858+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c1686d0 con 0x7ff06c0826e0 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.858+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05401b690 con 0x7ff06c0826e0 2023-05-17T15:05:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.858+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c0af110 con 0x7ff06c0826e0 2023-05-17T15:05:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.858+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c06bdf0 con 0x7ff06c0826e0 2023-05-17T15:05:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.859+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ff05400f070 con 0x7ff06c0826e0 2023-05-17T15:05:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.859+0000 7ff063fff700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff04c05ee70 0x7ff04c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.859+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff05407b6b0 con 0x7ff06c0826e0 2023-05-17T15:05:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.859+0000 7ff06b7fe700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff04c05ee70 0x7ff04c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.860+0000 7ff06b7fe700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff04c05ee70 0x7ff04c061330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff05c0011e0 tx=0x7ff05c007850).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:22.863+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff05404ca50 con 0x7ff06c0826e0 2023-05-17T15:05:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.060+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff06c0af5c0 con 0x7ff04c05ee70 2023-05-17T15:05:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.062+0000 7ff063fff700 1 -- 172.21.15.27:0/1168691152 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff05c007110 con 0x7ff04c05ee70 2023-05-17T15:05:23.065 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:23.066 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:53", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:23.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff04c05ee70 msgr2=0x7ff04c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff04c05ee70 0x7ff04c061330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff05c0011e0 tx=0x7ff05c007850).stop 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 msgr2=0x7ff06c0a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 0x7ff06c0a92f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7ff06c0cacf0 tx=0x7ff054017000).stop 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 shutdown_connections 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff04c05ee70 0x7ff04c061330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff06c153fa0 0x7ff06c167880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:23.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff06c0826e0 0x7ff06c0a92f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 --2- 172.21.15.27:0/1168691152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff06c0aa130 0x7ff06c0af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:23.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 >> 172.21.15.27:0/1168691152 conn(0x7ff06c05e820 msgr2=0x7ff06c0ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:23.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 shutdown_connections 2023-05-17T15:05:23.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.064+0000 7ff072339700 1 -- 172.21.15.27:0/1168691152 wait complete. 2023-05-17T15:05:23.079 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:53", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:23.079 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:53', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:23.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:23.080 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-05-17T15:05:23.095 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:23.096 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:23.096 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:23.096 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:23.096 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:23.096 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:23.097 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:23.097 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:23.097 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:23.097 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:23.097 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:23.097 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:23.098 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-05-17T15:05:23.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.250+0000 7f18c3f37700 1 Processor -- start 2023-05-17T15:05:23.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.251+0000 7f18c3f37700 1 -- start start 2023-05-17T15:05:23.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.251+0000 7f18c3f37700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18bc153fa0 0x7f18bc0c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.251+0000 7f18c3f37700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0c1610 con 0x7f18bc0826e0 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.251+0000 7f18c3f37700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0c0a00 con 0x7f18bc0aa130 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.251+0000 7f18c3f37700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc0c0ce0 con 0x7f18bc153fa0 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c24d4700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f18bc0826e0 0x7f18bc0aae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35844/0 (socket says 172.21.15.27:35844) 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c24d4700 1 -- 172.21.15.27:0/435575329 learned_addr learned my addr 172.21.15.27:0/435575329 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220805288 0 0) 0x7f18bc0c1610 con 0x7f18bc0826e0 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/435575329 >> v2:172.21.15.40:3300/0 conn(0x7f18bc153fa0 0x7f18bc0c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a40033f0 con 0x7f18bc0826e0 2023-05-17T15:05:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3499387753 0 0) 0x7f18a40033f0 con 0x7f18bc0826e0 2023-05-17T15:05:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 >> v2:172.21.15.40:3300/0 conn(0x7f18bc153fa0 msgr2=0x7f18bc0c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 --2- 172.21.15.27:0/435575329 >> v2:172.21.15.40:3300/0 conn(0x7f18bc153fa0 0x7f18bc0c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 >> v1:172.21.15.40:6789/0 conn(0x7f18bc0aa130 legacy=0x7f18bc081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0c0fc0 con 0x7f18bc0826e0 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f18ac0017f0 con 0x7f18bc0826e0 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 >> v1:172.21.15.27:6789/0 conn(0x7f18bc0826e0 legacy=0x7f18bc0aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18a40038e0 0x7f18a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a4004690 0x7f18a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a4005000 0x7f18a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0c0ce0 con 0x7f18a40038e0 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400bf60 con 0x7f18a4005000 2023-05-17T15:05:23.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400c0f0 con 0x7f18a4004690 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18a40038e0 0x7f18a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c14d2700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a4004690 0x7f18a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.252+0000 7f18c24d4700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a4005000 0x7f18a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c1cd3700 1 -- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a4004690 msgr2=0x7f18a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a4004690 0x7f18a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c1cd3700 1 -- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a4005000 msgr2=0x7f18a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a4005000 0x7f18a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c1cd3700 1 -- 172.21.15.27:0/435575329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40033f0 con 0x7f18a40038e0 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c24d4700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a4005000 0x7f18a400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c14d2700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a4004690 0x7f18a4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c24d4700 1 -- 172.21.15.27:0/435575329 reap_dead start 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18a40038e0 0x7f18a4003d00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f18b4009a80 tx=0x7f18b4009060).ready entity=mon.0 client_cookie=809d7dd844ee37e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4009430 con 0x7f18a40038e0 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b400e640 con 0x7f18a40038e0 2023-05-17T15:05:23.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c0cd1700 1 -- 172.21.15.27:0/435575329 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400e9c0 con 0x7f18a40038e0 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c3f37700 1 -- 172.21.15.27:0/435575329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18a40038e0 msgr2=0x7f18a4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c3f37700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18a40038e0 0x7f18a4003d00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f18b4009a80 tx=0x7f18b4009060).stop 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c3f37700 1 -- 172.21.15.27:0/435575329 shutdown_connections 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c3f37700 1 --2- 172.21.15.27:0/435575329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18a40038e0 0x7f18a4003d00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.253+0000 7f18c3f37700 1 -- 172.21.15.27:0/435575329 >> 172.21.15.27:0/435575329 conn(0x7f18bc05e820 msgr2=0x7f18bc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.254+0000 7f18c3f37700 1 -- 172.21.15.27:0/435575329 shutdown_connections 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.254+0000 7f18c3f37700 1 -- 172.21.15.27:0/435575329 wait complete. 2023-05-17T15:05:23.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 Processor -- start 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 -- start start 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a40038e0 0x7f18bc0a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18bc0ae700 0x7f18bc148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 0x7f18bc1679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0af880 con 0x7f18bc167550 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc167ea0 con 0x7f18a40038e0 2023-05-17T15:05:23.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.255+0000 7f18c3f37700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0aec70 con 0x7f18bc0ae700 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 0x7f18bc1679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 0x7f18bc1679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36296/0 (socket says 172.21.15.27:36296) 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 -- 172.21.15.27:0/2691225178 learned_addr learned my addr 172.21.15.27:0/2691225178 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a40038e0 0x7f18bc0a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c14d2700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18bc0ae700 0x7f18bc148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 -- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18bc0ae700 msgr2=0x7f18bc148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18bc0ae700 0x7f18bc148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 -- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a40038e0 msgr2=0x7f18bc0a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a40038e0 0x7f18bc0a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 -- 172.21.15.27:0/2691225178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0aef50 con 0x7f18bc167550 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c14d2700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18bc0ae700 0x7f18bc148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c24d4700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 0x7f18bc1679b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f18ac001370 tx=0x7f18ac001300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00e7d0 con 0x7f18bc167550 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00e930 con 0x7f18bc167550 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc0af230 con 0x7f18bc167550 2023-05-17T15:05:23.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00ecf0 con 0x7f18bc167550 2023-05-17T15:05:23.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.256+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc146640 con 0x7f18bc167550 2023-05-17T15:05:23.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.257+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc0afa30 con 0x7f18bc167550 2023-05-17T15:05:23.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.258+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f18ac0133e0 con 0x7f18bc167550 2023-05-17T15:05:23.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.258+0000 7f18b9ffb700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18a805ee70 0x7f18a8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.258+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f18ac079c10 con 0x7f18bc167550 2023-05-17T15:05:23.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.258+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18a805ee70 0x7f18a8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.258+0000 7f18c1cd3700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18a805ee70 0x7f18a8061330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f18b4006d50 tx=0x7f18b401a000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:23.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.262+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18bc0afa30 con 0x7f18bc167550 2023-05-17T15:05:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.462+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18bc06bdf0 con 0x7f18a805ee70 2023-05-17T15:05:23.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.463+0000 7f18b9ffb700 1 -- 172.21.15.27:0/2691225178 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f18bc06bdf0 con 0x7f18a805ee70 2023-05-17T15:05:23.467 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:23.467 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:53", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18a805ee70 msgr2=0x7f18a8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18a805ee70 0x7f18a8061330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f18b4006d50 tx=0x7f18b401a000).stop 2023-05-17T15:05:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 msgr2=0x7f18bc1679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 0x7f18bc1679b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f18ac001370 tx=0x7f18ac001300).stop 2023-05-17T15:05:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 shutdown_connections 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f18a805ee70 0x7f18a8061330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18bc167550 0x7f18bc1679b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a40038e0 0x7f18bc0a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 --2- 172.21.15.27:0/2691225178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18bc0ae700 0x7f18bc148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 >> 172.21.15.27:0/2691225178 conn(0x7f18bc05e820 msgr2=0x7f18bc1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 shutdown_connections 2023-05-17T15:05:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.465+0000 7f18c3f37700 1 -- 172.21.15.27:0/2691225178 wait complete. 2023-05-17T15:05:23.480 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:53", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:23.481 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:53', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:23.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:23.482 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-05-17T15:05:23.496 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:23.497 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:23.497 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:23.497 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:23.497 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:23.497 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:23.497 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:23.498 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:23.498 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:23.498 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:23.498 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:23.499 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:23.499 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-05-17T15:05:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.655+0000 7f6fbab99700 1 Processor -- start 2023-05-17T15:05:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.655+0000 7f6fbab99700 1 -- start start 2023-05-17T15:05:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fbab99700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fb4151c10 0x7f6fb41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fbab99700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6fb40c6070 0x7f6fb40a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fbab99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb40be490 0x7f6fb40be900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fbab99700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb40c6490 con 0x7f6fb40c6070 2023-05-17T15:05:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fbab99700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb40c5340 con 0x7f6fb4151c10 2023-05-17T15:05:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fbab99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c5be0 con 0x7f6fb40be490 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6fb40c6070 0x7f6fb40a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6fb40c6070 0x7f6fb40a7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36302/0 (socket says 172.21.15.27:36302) 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 -- 172.21.15.27:0/3501097342 learned_addr learned my addr 172.21.15.27:0/3501097342 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb9136700 1 --2- 172.21.15.27:0/3501097342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb40be490 0x7f6fb40be900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb8935700 1 --2- 172.21.15.27:0/3501097342 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4151c10 0x7f6fb41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 -- 172.21.15.27:0/3501097342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb40be490 msgr2=0x7f6fb40be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 --2- 172.21.15.27:0/3501097342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb40be490 0x7f6fb40be900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 -- 172.21.15.27:0/3501097342 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4151c10 msgr2=0x7f6fb41564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 --2- 172.21.15.27:0/3501097342 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4151c10 0x7f6fb41564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 -- 172.21.15.27:0/3501097342 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40bedf0 con 0x7f6fb40c6070 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb3fff700 1 --2- 172.21.15.27:0/3501097342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40c6070 0x7f6fb40a7ac0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f6fb4066e10 tx=0x7f6fa4009840).ready entity=mon.0 client_cookie=af083af44e8ee8e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb37fe700 1 -- 172.21.15.27:0/3501097342 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400e070 con 0x7f6fb40c6070 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb37fe700 1 -- 172.21.15.27:0/3501097342 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa400ba50 con 0x7f6fb40c6070 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.656+0000 7f6fb37fe700 1 -- 172.21.15.27:0/3501097342 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400bdd0 con 0x7f6fb40c6070 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 -- 172.21.15.27:0/3501097342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40c6070 msgr2=0x7f6fb40a7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 --2- 172.21.15.27:0/3501097342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40c6070 0x7f6fb40a7ac0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f6fb4066e10 tx=0x7f6fa4009840).stop 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 -- 172.21.15.27:0/3501097342 shutdown_connections 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 --2- 172.21.15.27:0/3501097342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb40be490 0x7f6fb40be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 --2- 172.21.15.27:0/3501097342 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4151c10 0x7f6fb41564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 --2- 172.21.15.27:0/3501097342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40c6070 0x7f6fb40a7ac0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 -- 172.21.15.27:0/3501097342 >> 172.21.15.27:0/3501097342 conn(0x7f6fb4092160 msgr2=0x7f6fb4062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 -- 172.21.15.27:0/3501097342 shutdown_connections 2023-05-17T15:05:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.657+0000 7f6fbab99700 1 -- 172.21.15.27:0/3501097342 wait complete. 2023-05-17T15:05:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.658+0000 7f6fbab99700 1 Processor -- start 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.658+0000 7f6fbab99700 1 -- start start 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fbab99700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 0x7f6fb414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fbab99700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb40c6070 0x7f6fb40c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fbab99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb4151c10 0x7f6fb4162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fbab99700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4163120 con 0x7f6fb40be490 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fbab99700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb41636c0 con 0x7f6fb40c6070 2023-05-17T15:05:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fbab99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb414f140 con 0x7f6fb4151c10 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 0x7f6fb414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 0x7f6fb414ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36306/0 (socket says 172.21.15.27:36306) 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 -- 172.21.15.27:0/4018518443 learned_addr learned my addr 172.21.15.27:0/4018518443 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb9136700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb4151c10 0x7f6fb4162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 -- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb4151c10 msgr2=0x7f6fb4162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb4151c10 0x7f6fb4162040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 -- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb40c6070 msgr2=0x7f6fb40c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb40c6070 0x7f6fb40c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.659+0000 7f6fb8935700 1 -- 172.21.15.27:0/4018518443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4009ae0 con 0x7f6fb40be490 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.660+0000 7f6fb8935700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 0x7f6fb414ec50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f6fac00d890 tx=0x7f6fac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.660+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0125f0 con 0x7f6fb40be490 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.660+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac012750 con 0x7f6fb40be490 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.660+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb40c24c0 con 0x7f6fb40be490 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.660+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac012ad0 con 0x7f6fb40be490 2023-05-17T15:05:23.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.660+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb414f680 con 0x7f6fb40be490 2023-05-17T15:05:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.661+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb406bdf0 con 0x7f6fb40be490 2023-05-17T15:05:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.661+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6fac013480 con 0x7f6fb40be490 2023-05-17T15:05:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.661+0000 7f6fb0ff9700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f9405ee70 0x7f6f94061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.661+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6fac079fb0 con 0x7f6fb40be490 2023-05-17T15:05:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.661+0000 7f6fb3fff700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f9405ee70 0x7f6f94061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.662+0000 7f6fb3fff700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f9405ee70 0x7f6f94061330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6fb40aeb70 tx=0x7f6fa4009840).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:23.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.665+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6fac04b480 con 0x7f6fb40be490 2023-05-17T15:05:23.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.862+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fb4082f10 con 0x7f6f9405ee70 2023-05-17T15:05:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.864+0000 7f6fb0ff9700 1 -- 172.21.15.27:0/4018518443 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6fb4082f10 con 0x7f6f9405ee70 2023-05-17T15:05:23.868 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:23.868 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:53", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.865+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f9405ee70 msgr2=0x7f6f94061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.865+0000 7f6fbab99700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f9405ee70 0x7f6f94061330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6fb40aeb70 tx=0x7f6fa4009840).stop 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.865+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 msgr2=0x7f6fb414ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.865+0000 7f6fbab99700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 0x7f6fb414ec50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f6fac00d890 tx=0x7f6fac008040).stop 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 shutdown_connections 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f9405ee70 0x7f6f94061330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb4151c10 0x7f6fb4162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6fb40be490 0x7f6fb414ec50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 --2- 172.21.15.27:0/4018518443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb40c6070 0x7f6fb40c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 >> 172.21.15.27:0/4018518443 conn(0x7f6fb4092160 msgr2=0x7f6fb41509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 shutdown_connections 2023-05-17T15:05:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:23.866+0000 7f6fbab99700 1 -- 172.21.15.27:0/4018518443 wait complete. 2023-05-17T15:05:23.881 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:53", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:23.881 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:53', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:23.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:23.882 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-05-17T15:05:23.897 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:23.898 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:23.899 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:23.899 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:23.899 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:23.899 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:23.900 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-05-17T15:05:24.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 Processor -- start 2023-05-17T15:05:24.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 -- start start 2023-05-17T15:05:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2004154520 0x7f20040c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20040c5d60 0x7f20040c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2004154a50 con 0x7f20040c1080 2023-05-17T15:05:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2004154d30 con 0x7f2004154520 2023-05-17T15:05:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f2008999700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2004155010 con 0x7f20040c5d60 2023-05-17T15:05:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.053+0000 7f200259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2004154520 0x7f20040c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2004154520 0x7f20040c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36316/0 (socket says 172.21.15.27:36316) 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 -- 172.21.15.27:0/4246950104 learned_addr learned my addr 172.21.15.27:0/4246950104 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200359e700 1 --2- 172.21.15.27:0/4246950104 >> v2:172.21.15.40:3300/0 conn(0x7f20040c5d60 0x7f20040c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 -- 172.21.15.27:0/4246950104 >> v2:172.21.15.40:3300/0 conn(0x7f20040c5d60 msgr2=0x7f20040c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 --2- 172.21.15.27:0/4246950104 >> v2:172.21.15.40:3300/0 conn(0x7f20040c5d60 0x7f20040c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 -- 172.21.15.27:0/4246950104 >> v1:172.21.15.40:6789/0 conn(0x7f20040c1080 legacy=0x7f20040c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 -- 172.21.15.27:0/4246950104 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20041552f0 con 0x7f2004154520 2023-05-17T15:05:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200359e700 1 --2- 172.21.15.27:0/4246950104 >> v2:172.21.15.40:3300/0 conn(0x7f20040c5d60 0x7f20040c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f200259c700 1 --2- 172.21.15.27:0/4246950104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040c1460 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f20040c09f0 tx=0x7f1fec0090f0).ready entity=mon.0 client_cookie=50ff29a67c13974f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f2001d9b700 1 -- 172.21.15.27:0/4246950104 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00b600 con 0x7f2004154520 2023-05-17T15:05:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f2001d9b700 1 -- 172.21.15.27:0/4246950104 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00b760 con 0x7f2004154520 2023-05-17T15:05:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.054+0000 7f2001d9b700 1 -- 172.21.15.27:0/4246950104 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00bae0 con 0x7f2004154520 2023-05-17T15:05:24.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 -- 172.21.15.27:0/4246950104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 msgr2=0x7f20040c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 --2- 172.21.15.27:0/4246950104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040c1460 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f20040c09f0 tx=0x7f1fec0090f0).stop 2023-05-17T15:05:24.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 -- 172.21.15.27:0/4246950104 shutdown_connections 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 --2- 172.21.15.27:0/4246950104 >> v2:172.21.15.40:3300/0 conn(0x7f20040c5d60 0x7f20040c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 --2- 172.21.15.27:0/4246950104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040c1460 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 -- 172.21.15.27:0/4246950104 >> 172.21.15.27:0/4246950104 conn(0x7f200405dd50 msgr2=0x7f200405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 -- 172.21.15.27:0/4246950104 shutdown_connections 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.055+0000 7f2008999700 1 -- 172.21.15.27:0/4246950104 wait complete. 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.056+0000 7f2008999700 1 Processor -- start 2023-05-17T15:05:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.056+0000 7f2008999700 1 -- start start 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040c1080 0x7f20041501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20040c5d60 0x7f20041506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004150c90 con 0x7f2004154520 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040afb70 con 0x7f20040c1080 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20040afe50 con 0x7f20040c5d60 2023-05-17T15:05:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36324/0 (socket says 172.21.15.27:36324) 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 -- 172.21.15.27:0/885480333 learned_addr learned my addr 172.21.15.27:0/885480333 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2002d9d700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040c1080 0x7f20041501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200259c700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20040c5d60 0x7f20041506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 -- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20040c5d60 msgr2=0x7f20041506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20040c5d60 0x7f20041506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 -- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040c1080 msgr2=0x7f20041501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040c1080 0x7f20041501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 -- 172.21.15.27:0/885480333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec009370 con 0x7f2004154520 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f200359e700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040aaa90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f1ff400d860 tx=0x7f1ff4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011590 con 0x7f2004154520 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff40116f0 con 0x7f2004154520 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20040b0130 con 0x7f2004154520 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.057+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011a90 con 0x7f2004154520 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.058+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20040c1d00 con 0x7f2004154520 2023-05-17T15:05:24.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.058+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2004047150 con 0x7f2004154520 2023-05-17T15:05:24.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.059+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f1ff4012420 con 0x7f2004154520 2023-05-17T15:05:24.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.059+0000 7f1ffaffd700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fe405ee70 0x7f1fe4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.059+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1ff40797e0 con 0x7f2004154520 2023-05-17T15:05:24.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.059+0000 7f2002d9d700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fe405ee70 0x7f1fe4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.060+0000 7f2002d9d700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fe405ee70 0x7f1fe4061330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1ffc004290 tx=0x7f1ffc001560).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.063+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ff404ac30 con 0x7f2004154520 2023-05-17T15:05:24.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.260+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20040bfb70 con 0x7f1fe405ee70 2023-05-17T15:05:24.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.261+0000 7f1ffaffd700 1 -- 172.21.15.27:0/885480333 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f20040bfb70 con 0x7f1fe405ee70 2023-05-17T15:05:24.265 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:24.265 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:54", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:24.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fe405ee70 msgr2=0x7f1fe4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fe405ee70 0x7f1fe4061330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1ffc004290 tx=0x7f1ffc001560).stop 2023-05-17T15:05:24.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 msgr2=0x7f20040aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040aaa90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f1ff400d860 tx=0x7f1ff4008040).stop 2023-05-17T15:05:24.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 shutdown_connections 2023-05-17T15:05:24.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fe405ee70 0x7f1fe4061330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004154520 0x7f20040aaa90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040c1080 0x7f20041501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 --2- 172.21.15.27:0/885480333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20040c5d60 0x7f20041506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 >> 172.21.15.27:0/885480333 conn(0x7f200405dd50 msgr2=0x7f2004151730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:24.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 shutdown_connections 2023-05-17T15:05:24.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.263+0000 7f2008999700 1 -- 172.21.15.27:0/885480333 wait complete. 2023-05-17T15:05:24.278 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:54", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:24.278 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:54', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:24.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:24.279 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-05-17T15:05:24.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:24.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:24.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:24.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:24.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:24.295 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:24.296 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:24.296 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:24.296 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:24.296 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:24.296 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:24.296 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:24.297 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-05-17T15:05:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.451+0000 7fb63f2a1700 1 Processor -- start 2023-05-17T15:05:24.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.451+0000 7fb63f2a1700 1 -- start start 2023-05-17T15:05:24.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63f2a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6380c1460 0x7fb6380a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63f2a1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb638154a50 con 0x7fb6380c1080 2023-05-17T15:05:24.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63f2a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb638154d30 con 0x7fb638154520 2023-05-17T15:05:24.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63f2a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb638155010 con 0x7fb6380c1460 2023-05-17T15:05:24.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63e29f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb6380c1080 0x7fb6380c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35890/0 (socket says 172.21.15.27:35890) 2023-05-17T15:05:24.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63e29f700 1 -- 172.21.15.27:0/3339991988 learned_addr learned my addr 172.21.15.27:0/3339991988 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:24.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018838159 0 0) 0x7fb638154a50 con 0x7fb6380c1080 2023-05-17T15:05:24.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6200033f0 con 0x7fb6380c1080 2023-05-17T15:05:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/3339991988 >> v2:172.21.15.40:3300/0 conn(0x7fb6380c1460 0x7fb6380a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751765457 0 0) 0x7fb6200033f0 con 0x7fb6380c1080 2023-05-17T15:05:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 >> v2:172.21.15.40:3300/0 conn(0x7fb6380c1460 msgr2=0x7fb6380a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 --2- 172.21.15.27:0/3339991988 >> v2:172.21.15.40:3300/0 conn(0x7fb6380c1460 0x7fb6380a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 >> v1:172.21.15.40:6789/0 conn(0x7fb638154520 legacy=0x7fb6380c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6381552f0 con 0x7fb6380c1080 2023-05-17T15:05:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fb630001470 con 0x7fb6380c1080 2023-05-17T15:05:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 >> v1:172.21.15.27:6789/0 conn(0x7fb6380c1080 legacy=0x7fb6380c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6200038e0 0x7fb620003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620004690 0x7fb620004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb620005000 0x7fb62000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638155010 con 0x7fb620005000 2023-05-17T15:05:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62000bf60 con 0x7fb620004690 2023-05-17T15:05:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.452+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62000c0f0 con 0x7fb6200038e0 2023-05-17T15:05:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb620005000 0x7fb62000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63e29f700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6200038e0 0x7fb620003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63da9e700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620004690 0x7fb620004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 -- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6200038e0 msgr2=0x7fb620003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6200038e0 0x7fb620003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 -- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620004690 msgr2=0x7fb620004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620004690 0x7fb620004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 -- 172.21.15.27:0/3339991988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200033f0 con 0x7fb620005000 2023-05-17T15:05:24.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 -- 172.21.15.27:0/3339991988 reap_dead start 2023-05-17T15:05:24.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb620005000 0x7fb62000b8e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fb62800e210 tx=0x7fb62800b040).ready entity=mon.0 client_cookie=a01af7b1148ddd95 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628009ac0 con 0x7fb620005000 2023-05-17T15:05:24.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800f040 con 0x7fb620005000 2023-05-17T15:05:24.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.453+0000 7fb63d29d700 1 -- 172.21.15.27:0/3339991988 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800ed10 con 0x7fb620005000 2023-05-17T15:05:24.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 -- 172.21.15.27:0/3339991988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb620005000 msgr2=0x7fb62000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb620005000 0x7fb62000b8e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fb62800e210 tx=0x7fb62800b040).stop 2023-05-17T15:05:24.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 -- 172.21.15.27:0/3339991988 shutdown_connections 2023-05-17T15:05:24.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/3339991988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb620005000 0x7fb62000b8e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 -- 172.21.15.27:0/3339991988 >> 172.21.15.27:0/3339991988 conn(0x7fb63805dd50 msgr2=0x7fb63805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:24.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 -- 172.21.15.27:0/3339991988 shutdown_connections 2023-05-17T15:05:24.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.454+0000 7fb63f2a1700 1 -- 172.21.15.27:0/3339991988 wait complete. 2023-05-17T15:05:24.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.455+0000 7fb63f2a1700 1 Processor -- start 2023-05-17T15:05:24.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.455+0000 7fb63f2a1700 1 -- start start 2023-05-17T15:05:24.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620005000 0x7fb6380c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb638147270 0x7fb6380aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 0x7fb6380abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380ac440 con 0x7fb6381476f0 2023-05-17T15:05:24.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c9060 con 0x7fb620005000 2023-05-17T15:05:24.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380af3e0 con 0x7fb638147270 2023-05-17T15:05:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 0x7fb6380abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 0x7fb6380abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36344/0 (socket says 172.21.15.27:36344) 2023-05-17T15:05:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 -- 172.21.15.27:0/1954019025 learned_addr learned my addr 172.21.15.27:0/1954019025 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63da9e700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb638147270 0x7fb6380aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63e29f700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620005000 0x7fb6380c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 -- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb638147270 msgr2=0x7fb6380aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb638147270 0x7fb6380aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 -- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620005000 msgr2=0x7fb6380c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620005000 0x7fb6380c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 -- 172.21.15.27:0/1954019025 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380af100 con 0x7fb6381476f0 2023-05-17T15:05:24.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63da9e700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb638147270 0x7fb6380aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63eaa0700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 0x7fb6380abf50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fb638062d60 tx=0x7fb628018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62801d460 con 0x7fb6381476f0 2023-05-17T15:05:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62801d5c0 con 0x7fb6381476f0 2023-05-17T15:05:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6380c8a10 con 0x7fb6381476f0 2023-05-17T15:05:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62801d980 con 0x7fb6381476f0 2023-05-17T15:05:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.456+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6380ae3d0 con 0x7fb6381476f0 2023-05-17T15:05:24.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.457+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6380c8870 con 0x7fb6381476f0 2023-05-17T15:05:24.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.457+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb62802c070 con 0x7fb6381476f0 2023-05-17T15:05:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.458+0000 7fb6367fc700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb62405ee70 0x7fb624061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.458+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb62807bd30 con 0x7fb6381476f0 2023-05-17T15:05:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.458+0000 7fb63e29f700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb62405ee70 0x7fb624061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.458+0000 7fb63e29f700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb62405ee70 0x7fb624061330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb6300015a0 tx=0x7fb630009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.462+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6380c8870 con 0x7fb6381476f0 2023-05-17T15:05:24.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.656+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6380c8870 con 0x7fb62405ee70 2023-05-17T15:05:24.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.657+0000 7fb6367fc700 1 -- 172.21.15.27:0/1954019025 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fb6380c8870 con 0x7fb62405ee70 2023-05-17T15:05:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:24.661 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:54", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:24.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb62405ee70 msgr2=0x7fb624061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb62405ee70 0x7fb624061330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb6300015a0 tx=0x7fb630009040).stop 2023-05-17T15:05:24.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 msgr2=0x7fb6380abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 0x7fb6380abf50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fb638062d60 tx=0x7fb628018000).stop 2023-05-17T15:05:24.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 shutdown_connections 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb62405ee70 0x7fb624061330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6381476f0 0x7fb6380abf50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb620005000 0x7fb6380c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 --2- 172.21.15.27:0/1954019025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb638147270 0x7fb6380aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 >> 172.21.15.27:0/1954019025 conn(0x7fb63805dd50 msgr2=0x7fb6381509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 shutdown_connections 2023-05-17T15:05:24.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.659+0000 7fb63f2a1700 1 -- 172.21.15.27:0/1954019025 wait complete. 2023-05-17T15:05:24.674 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:54", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:24.675 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:54', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:24.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:24.676 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-05-17T15:05:24.691 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:24.691 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:24.692 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:24.693 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:24.693 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:24.693 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:24.693 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-05-17T15:05:24.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.846+0000 7f78bc475700 1 Processor -- start 2023-05-17T15:05:24.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.847+0000 7f78bc475700 1 -- start start 2023-05-17T15:05:24.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.847+0000 7f78bc475700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b4153000 0x7f78b41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.847+0000 7f78bc475700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b40c5340 con 0x7f78b40c6070 2023-05-17T15:05:24.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.847+0000 7f78bc475700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b40c5be0 con 0x7f78b4151c10 2023-05-17T15:05:24.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.847+0000 7f78bc475700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40a8270 con 0x7f78b4153000 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78baa12700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f78b40c6070 0x7f78b40be490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35912/0 (socket says 172.21.15.27:35912) 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78baa12700 1 -- 172.21.15.27:0/233547937 learned_addr learned my addr 172.21.15.27:0/233547937 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b9a10700 1 --2- 172.21.15.27:0/233547937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b4153000 0x7f78b41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b920f700 1 -- 172.21.15.27:0/233547937 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976400706 0 0) 0x7f78b40c5340 con 0x7f78b40c6070 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b920f700 1 -- 172.21.15.27:0/233547937 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f789c0033f0 con 0x7f78b40c6070 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b920f700 1 -- 172.21.15.27:0/233547937 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616863790 0 0) 0x7f789c0033f0 con 0x7f78b40c6070 2023-05-17T15:05:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b9a10700 1 -- 172.21.15.27:0/233547937 >> v1:172.21.15.40:6789/0 conn(0x7f78b4151c10 legacy=0x7f78b40a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b9a10700 1 -- 172.21.15.27:0/233547937 >> v1:172.21.15.27:6789/0 conn(0x7f78b40c6070 legacy=0x7f78b40be490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b9a10700 1 -- 172.21.15.27:0/233547937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b40c5590 con 0x7f78b4153000 2023-05-17T15:05:24.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b9a10700 1 --2- 172.21.15.27:0/233547937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b4153000 0x7f78b41564c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78a8009790 tx=0x7f78a8009060).ready entity=mon.2 client_cookie=79684e8b7859db9a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.848+0000 7f78b920f700 1 -- 172.21.15.27:0/233547937 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40017f0 con 0x7f78b4153000 2023-05-17T15:05:24.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78b920f700 1 -- 172.21.15.27:0/233547937 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8012410 con 0x7f78b4153000 2023-05-17T15:05:24.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78b920f700 1 -- 172.21.15.27:0/233547937 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8012790 con 0x7f78b4153000 2023-05-17T15:05:24.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 -- 172.21.15.27:0/233547937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b4153000 msgr2=0x7f78b41564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 --2- 172.21.15.27:0/233547937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b4153000 0x7f78b41564c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78a8009790 tx=0x7f78a8009060).stop 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 -- 172.21.15.27:0/233547937 shutdown_connections 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 --2- 172.21.15.27:0/233547937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b4153000 0x7f78b41564c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 -- 172.21.15.27:0/233547937 >> 172.21.15.27:0/233547937 conn(0x7f78b4092160 msgr2=0x7f78b4062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 -- 172.21.15.27:0/233547937 shutdown_connections 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.849+0000 7f78bc475700 1 -- 172.21.15.27:0/233547937 wait complete. 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.850+0000 7f78bc475700 1 Processor -- start 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.850+0000 7f78bc475700 1 -- start start 2023-05-17T15:05:24.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78bc475700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b40c6070 0x7f78b40a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78bc475700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b4151c10 0x7f78b40a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78bc475700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 0x7f78b40a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78bc475700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40a7160 con 0x7f78b4153000 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78bc475700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40a6550 con 0x7f78b4151c10 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78bc475700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40a6830 con 0x7f78b40c6070 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 0x7f78b40a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 0x7f78b40a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36358/0 (socket says 172.21.15.27:36358) 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 -- 172.21.15.27:0/3449708743 learned_addr learned my addr 172.21.15.27:0/3449708743 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78ba211700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b40c6070 0x7f78b40a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78b9a10700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b4151c10 0x7f78b40a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 -- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b40c6070 msgr2=0x7f78b40a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b40c6070 0x7f78b40a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 -- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b4151c10 msgr2=0x7f78b40a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b4151c10 0x7f78b40a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.851+0000 7f78baa12700 1 -- 172.21.15.27:0/3449708743 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80092a0 con 0x7f78b4153000 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.852+0000 7f78baa12700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 0x7f78b40a9b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f78a400cb60 tx=0x7f78a4001da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.852+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004c40 con 0x7f78b4153000 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.852+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a4004de0 con 0x7f78b4153000 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.852+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40073c0 con 0x7f78b4153000 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.852+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b40a6b10 con 0x7f78b4153000 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.852+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b40a6270 con 0x7f78b4153000 2023-05-17T15:05:24.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.853+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b406bdf0 con 0x7f78b4153000 2023-05-17T15:05:24.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.853+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f78a4010070 con 0x7f78b4153000 2023-05-17T15:05:24.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.853+0000 7f78b27fc700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78a005ee70 0x7f78a0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:24.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.854+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f78a4079aa0 con 0x7f78b4153000 2023-05-17T15:05:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.854+0000 7f78ba211700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78a005ee70 0x7f78a0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.854+0000 7f78ba211700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78a005ee70 0x7f78a0061330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f78ac0037d0 tx=0x7f78ac009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:24.858+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78a404ae40 con 0x7f78b4153000 2023-05-17T15:05:25.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.054+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78b4082f10 con 0x7f78a005ee70 2023-05-17T15:05:25.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.055+0000 7f78b27fc700 1 -- 172.21.15.27:0/3449708743 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f78b4082f10 con 0x7f78a005ee70 2023-05-17T15:05:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:25.059 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:55", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:25.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78a005ee70 msgr2=0x7f78a0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78a005ee70 0x7f78a0061330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f78ac0037d0 tx=0x7f78ac009040).stop 2023-05-17T15:05:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 msgr2=0x7f78b40a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 0x7f78b40a9b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f78a400cb60 tx=0x7f78a4001da0).stop 2023-05-17T15:05:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 shutdown_connections 2023-05-17T15:05:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f78a005ee70 0x7f78a0061330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78b4153000 0x7f78b40a9b00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b40c6070 0x7f78b40a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 --2- 172.21.15.27:0/3449708743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b4151c10 0x7f78b40a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 >> 172.21.15.27:0/3449708743 conn(0x7f78b4092160 msgr2=0x7f78b414bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 shutdown_connections 2023-05-17T15:05:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.057+0000 7f78bc475700 1 -- 172.21.15.27:0/3449708743 wait complete. 2023-05-17T15:05:25.072 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:55", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:25.073 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:55', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:25.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:25.073 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-05-17T15:05:25.089 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:25.089 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:25.089 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:25.089 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:25.089 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:25.090 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:25.090 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:25.090 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:25.090 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:25.090 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:25.090 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:25.090 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:25.091 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-05-17T15:05:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.245+0000 7f80396ea700 1 Processor -- start 2023-05-17T15:05:25.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.245+0000 7f80396ea700 1 -- start start 2023-05-17T15:05:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80396ea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80340c1080 0x7f80340c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80396ea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8034154520 0x7f80340c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80396ea700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8034154a50 con 0x7f80340c5d60 2023-05-17T15:05:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80396ea700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8034154d30 con 0x7f80340c1080 2023-05-17T15:05:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80396ea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8034155010 con 0x7f8034154520 2023-05-17T15:05:25.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8038ee9700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f80340c5d60 0x7f80340a99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35928/0 (socket says 172.21.15.27:35928) 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8033fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80340c1080 0x7f80340c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8038ee9700 1 -- 172.21.15.27:0/3873206327 learned_addr learned my addr 172.21.15.27:0/3873206327 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80337fe700 1 --2- 172.21.15.27:0/3873206327 >> v2:172.21.15.40:3300/0 conn(0x7f8034154520 0x7f80340c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8033fff700 1 -- 172.21.15.27:0/3873206327 >> v2:172.21.15.40:3300/0 conn(0x7f8034154520 msgr2=0x7f80340c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8033fff700 1 --2- 172.21.15.27:0/3873206327 >> v2:172.21.15.40:3300/0 conn(0x7f8034154520 0x7f80340c02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8033fff700 1 -- 172.21.15.27:0/3873206327 >> v1:172.21.15.27:6789/0 conn(0x7f80340c5d60 legacy=0x7f80340a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8032ffd700 1 -- 172.21.15.27:0/3873206327 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149920319 0 0) 0x7f8034154a50 con 0x7f80340c5d60 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8033fff700 1 -- 172.21.15.27:0/3873206327 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80341552f0 con 0x7f80340c1080 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f80337fe700 1 --2- 172.21.15.27:0/3873206327 >> v2:172.21.15.40:3300/0 conn(0x7f8034154520 0x7f80340c02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8033fff700 1 --2- 172.21.15.27:0/3873206327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340c1460 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f8034067d20 tx=0x7f801c009060).ready entity=mon.0 client_cookie=928331b57c5ea0cb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8032ffd700 1 -- 172.21.15.27:0/3873206327 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00b580 con 0x7f80340c1080 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8032ffd700 1 -- 172.21.15.27:0/3873206327 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c00b6e0 con 0x7f80340c1080 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.246+0000 7f8032ffd700 1 -- 172.21.15.27:0/3873206327 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00ba60 con 0x7f80340c1080 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 -- 172.21.15.27:0/3873206327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 msgr2=0x7f80340c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 --2- 172.21.15.27:0/3873206327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340c1460 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f8034067d20 tx=0x7f801c009060).stop 2023-05-17T15:05:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 -- 172.21.15.27:0/3873206327 shutdown_connections 2023-05-17T15:05:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 --2- 172.21.15.27:0/3873206327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340c1460 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 --2- 172.21.15.27:0/3873206327 >> v2:172.21.15.40:3300/0 conn(0x7f8034154520 0x7f80340c02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 -- 172.21.15.27:0/3873206327 >> 172.21.15.27:0/3873206327 conn(0x7f803405dd50 msgr2=0x7f803405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 -- 172.21.15.27:0/3873206327 shutdown_connections 2023-05-17T15:05:25.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.247+0000 7f80396ea700 1 -- 172.21.15.27:0/3873206327 wait complete. 2023-05-17T15:05:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.248+0000 7f80396ea700 1 Processor -- start 2023-05-17T15:05:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.248+0000 7f80396ea700 1 -- start start 2023-05-17T15:05:25.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80396ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80396ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340c5d60 0x7f80340c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80396ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8034154520 0x7f80340c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80396ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340c49b0 con 0x7f80340c1080 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80396ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340c2830 con 0x7f80340c5d60 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80396ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80340c2b10 con 0x7f8034154520 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36368/0 (socket says 172.21.15.27:36368) 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 -- 172.21.15.27:0/2902193099 learned_addr learned my addr 172.21.15.27:0/2902193099 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f80337fe700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340c5d60 0x7f80340c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8038ee9700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8034154520 0x7f80340c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 -- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8034154520 msgr2=0x7f80340c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8034154520 0x7f80340c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 -- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340c5d60 msgr2=0x7f80340c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340c5d60 0x7f80340c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 -- 172.21.15.27:0/2902193099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0092a0 con 0x7f80340c1080 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.249+0000 7f8033fff700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340a9bd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f803405f170 tx=0x7f801c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.250+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00ba60 con 0x7f80340c1080 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.250+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c000c90 con 0x7f80340c1080 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.250+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c01b660 con 0x7f80340c1080 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.250+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80340c2df0 con 0x7f80340c1080 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.250+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80340c33b0 con 0x7f80340c1080 2023-05-17T15:05:25.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.250+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8034047150 con 0x7f80340c1080 2023-05-17T15:05:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.251+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f801c02b070 con 0x7f80340c1080 2023-05-17T15:05:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.251+0000 7f802bfff700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f801405eea0 0x7f8014061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.251+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f801c07b780 con 0x7f80340c1080 2023-05-17T15:05:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.251+0000 7f80337fe700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f801405eea0 0x7f8014061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.252+0000 7f80337fe700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f801405eea0 0x7f8014061360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f80340ad1a0 tx=0x7f8024008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:25.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.255+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f801c04cbd0 con 0x7f80340c1080 2023-05-17T15:05:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.455+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80340bfb70 con 0x7f801405eea0 2023-05-17T15:05:25.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.456+0000 7f802bfff700 1 -- 172.21.15.27:0/2902193099 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f80340bfb70 con 0x7f801405eea0 2023-05-17T15:05:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:25.460 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:55", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:25.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f801405eea0 msgr2=0x7f8014061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f801405eea0 0x7f8014061360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f80340ad1a0 tx=0x7f8024008040).stop 2023-05-17T15:05:25.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 msgr2=0x7f80340a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340a9bd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f803405f170 tx=0x7f801c017000).stop 2023-05-17T15:05:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 shutdown_connections 2023-05-17T15:05:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f801405eea0 0x7f8014061360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8034154520 0x7f80340c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80340c1080 0x7f80340a9bd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 --2- 172.21.15.27:0/2902193099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340c5d60 0x7f80340c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.458+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 >> 172.21.15.27:0/2902193099 conn(0x7f803405dd50 msgr2=0x7f80341533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.459+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 shutdown_connections 2023-05-17T15:05:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.459+0000 7f80396ea700 1 -- 172.21.15.27:0/2902193099 wait complete. 2023-05-17T15:05:25.474 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:55", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:25.474 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:55', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:25.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:25.475 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-05-17T15:05:25.490 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:25.490 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:25.490 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:25.492 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:25.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-05-17T15:05:25.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.646+0000 7f6d71b85700 1 Processor -- start 2023-05-17T15:05:25.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.646+0000 7f6d71b85700 1 -- start start 2023-05-17T15:05:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d71b85700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d6c151c90 0x7f6d6c152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d71b85700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c158010 con 0x7f6d6c0c0520 2023-05-17T15:05:25.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d71b85700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c154f60 con 0x7f6d6c154980 2023-05-17T15:05:25.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d71b85700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c155240 con 0x7f6d6c151c90 2023-05-17T15:05:25.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d6c151c90 0x7f6d6c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6d6c0c0520 0x7f6d6c081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35938/0 (socket says 172.21.15.27:35938) 2023-05-17T15:05:25.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6bfff700 1 -- 172.21.15.27:0/650338690 learned_addr learned my addr 172.21.15.27:0/650338690 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:25.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6b7fe700 1 -- 172.21.15.27:0/650338690 >> v1:172.21.15.40:6789/0 conn(0x7f6d6c154980 legacy=0x7f6d6c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6b7fe700 1 -- 172.21.15.27:0/650338690 >> v1:172.21.15.27:6789/0 conn(0x7f6d6c0c0520 legacy=0x7f6d6c081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6b7fe700 1 -- 172.21.15.27:0/650338690 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c155520 con 0x7f6d6c151c90 2023-05-17T15:05:25.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6a7fc700 1 -- 172.21.15.27:0/650338690 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190553176 0 0) 0x7f6d6c158010 con 0x7f6d6c0c0520 2023-05-17T15:05:25.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.647+0000 7f6d6b7fe700 1 --2- 172.21.15.27:0/650338690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c152070 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6d5c009760 tx=0x7f6d5c009060).ready entity=mon.0 client_cookie=12291184c3d673ba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d6a7fc700 1 -- 172.21.15.27:0/650338690 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00b580 con 0x7f6d6c151c90 2023-05-17T15:05:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d6a7fc700 1 -- 172.21.15.27:0/650338690 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00b6e0 con 0x7f6d6c151c90 2023-05-17T15:05:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d6a7fc700 1 -- 172.21.15.27:0/650338690 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00ba60 con 0x7f6d6c151c90 2023-05-17T15:05:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 -- 172.21.15.27:0/650338690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 msgr2=0x7f6d6c152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 --2- 172.21.15.27:0/650338690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c152070 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6d5c009760 tx=0x7f6d5c009060).stop 2023-05-17T15:05:25.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 -- 172.21.15.27:0/650338690 shutdown_connections 2023-05-17T15:05:25.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 --2- 172.21.15.27:0/650338690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c152070 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 -- 172.21.15.27:0/650338690 >> 172.21.15.27:0/650338690 conn(0x7f6d6c0cae10 msgr2=0x7f6d6c0cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:25.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 -- 172.21.15.27:0/650338690 shutdown_connections 2023-05-17T15:05:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.648+0000 7f6d71b85700 1 -- 172.21.15.27:0/650338690 wait complete. 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 Processor -- start 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 -- start start 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d6c0c0520 0x7f6d6c0c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d6c154980 0x7f6d6c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0af070 con 0x7f6d6c151c90 2023-05-17T15:05:25.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c5070 con 0x7f6d6c154980 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d71b85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c5350 con 0x7f6d6c0c0520 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d6affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d6affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c0c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36384/0 (socket says 172.21.15.27:36384) 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.650+0000 7f6d6affd700 1 -- 172.21.15.27:0/175422124 learned_addr learned my addr 172.21.15.27:0/175422124 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6b7fe700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d6c0c0520 0x7f6d6c0c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6bfff700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d6c154980 0x7f6d6c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6affd700 1 -- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d6c0c0520 msgr2=0x7f6d6c0c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6affd700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d6c0c0520 0x7f6d6c0c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6affd700 1 -- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d6c154980 msgr2=0x7f6d6c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6affd700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d6c154980 0x7f6d6c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6affd700 1 -- 172.21.15.27:0/175422124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0092a0 con 0x7f6d6c151c90 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d6affd700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c0c4890 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f6d6000c440 tx=0x7f6d60007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60007020 con 0x7f6d6c151c90 2023-05-17T15:05:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60007180 con 0x7f6d6c151c90 2023-05-17T15:05:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0af280 con 0x7f6d6c151c90 2023-05-17T15:05:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60007520 con 0x7f6d6c151c90 2023-05-17T15:05:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.651+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c0c4d80 con 0x7f6d6c151c90 2023-05-17T15:05:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.652+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0c6230 con 0x7f6d6c151c90 2023-05-17T15:05:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.652+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6d60010070 con 0x7f6d6c151c90 2023-05-17T15:05:25.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.653+0000 7f6d537fe700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6d5805ee70 0x7f6d58061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:25.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.653+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6d60078fc0 con 0x7f6d6c151c90 2023-05-17T15:05:25.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.653+0000 7f6d6b7fe700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6d5805ee70 0x7f6d58061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:25.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.653+0000 7f6d6b7fe700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6d5805ee70 0x7f6d58061330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6d5c00b340 tx=0x7f6d5c017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:25.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.657+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d600478f0 con 0x7f6d6c151c90 2023-05-17T15:05:25.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.855+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d6c06bdf0 con 0x7f6d5805ee70 2023-05-17T15:05:25.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.857+0000 7f6d537fe700 1 -- 172.21.15.27:0/175422124 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6d6c06bdf0 con 0x7f6d5805ee70 2023-05-17T15:05:25.861 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:25.861 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:55", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:25.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6d5805ee70 msgr2=0x7f6d58061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6d5805ee70 0x7f6d58061330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6d5c00b340 tx=0x7f6d5c017000).stop 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 msgr2=0x7f6d6c0c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c0c4890 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f6d6000c440 tx=0x7f6d60007e00).stop 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 shutdown_connections 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6d5805ee70 0x7f6d58061330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d6c154980 0x7f6d6c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d6c0c0520 0x7f6d6c0c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 --2- 172.21.15.27:0/175422124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c151c90 0x7f6d6c0c4890 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:25.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 >> 172.21.15.27:0/175422124 conn(0x7f6d6c0cae10 msgr2=0x7f6d6c156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:25.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 shutdown_connections 2023-05-17T15:05:25.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:25.859+0000 7f6d71b85700 1 -- 172.21.15.27:0/175422124 wait complete. 2023-05-17T15:05:25.874 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:55", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:25.874 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:55', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:25.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:25.875 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-05-17T15:05:25.890 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:25.890 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:25.890 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:25.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:25.892 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-14_55_00_UTC', 'scheduled-2023-05-17-14_56_00_UTC', 'scheduled-2023-05-17-14_57_00_UTC', 'scheduled-2023-05-17-14_58_00_UTC', 'scheduled-2023-05-17-14_59_00_UTC', 'scheduled-2023-05-17-15_00_00_UTC', 'scheduled-2023-05-17-15_01_00_UTC', 'scheduled-2023-05-17-15_02_00_UTC', 'scheduled-2023-05-17-15_03_00_UTC', 'scheduled-2023-05-17-15_04_00_UTC', 'scheduled-2023-05-17-15_05_00_UTC'] 2023-05-17T15:05:25.892 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-05-17T15:05:26.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.045+0000 7fa64a674700 1 Processor -- start 2023-05-17T15:05:26.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.045+0000 7fa64a674700 1 -- start start 2023-05-17T15:05:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa64a674700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa644153fa0 0x7fa6440c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa64a674700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6440aa130 0x7fa644081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa64a674700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6440824c0 0x7fa644068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa64a674700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440c1610 con 0x7fa6440824c0 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa64a674700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644082930 con 0x7fa6440aa130 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa64a674700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c0a00 con 0x7fa644153fa0 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa648c11700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6440824c0 0x7fa644068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa648c11700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6440824c0 0x7fa644068de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36392/0 (socket says 172.21.15.27:36392) 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa648c11700 1 -- 172.21.15.27:0/751316461 learned_addr learned my addr 172.21.15.27:0/751316461 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa6437fe700 1 --2- 172.21.15.27:0/751316461 >> v2:172.21.15.40:3300/0 conn(0x7fa6440aa130 0x7fa644081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.046+0000 7fa643fff700 1 --2- 172.21.15.27:0/751316461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa644153fa0 0x7fa6440c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa648c11700 1 -- 172.21.15.27:0/751316461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa644153fa0 msgr2=0x7fa6440c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa648c11700 1 --2- 172.21.15.27:0/751316461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa644153fa0 0x7fa6440c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa648c11700 1 -- 172.21.15.27:0/751316461 >> v2:172.21.15.40:3300/0 conn(0x7fa6440aa130 msgr2=0x7fa644081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa648c11700 1 --2- 172.21.15.27:0/751316461 >> v2:172.21.15.40:3300/0 conn(0x7fa6440aa130 0x7fa644081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa648c11700 1 -- 172.21.15.27:0/751316461 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440c0ce0 con 0x7fa6440824c0 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa648c11700 1 --2- 172.21.15.27:0/751316461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440824c0 0x7fa644068de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fa6440cb760 tx=0x7fa63c009840).ready entity=mon.0 client_cookie=9c77582e4ca4c8d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa642ffd700 1 -- 172.21.15.27:0/751316461 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00e070 con 0x7fa6440824c0 2023-05-17T15:05:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa642ffd700 1 -- 172.21.15.27:0/751316461 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00ba50 con 0x7fa6440824c0 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa642ffd700 1 -- 172.21.15.27:0/751316461 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00bdd0 con 0x7fa6440824c0 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 -- 172.21.15.27:0/751316461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440824c0 msgr2=0x7fa644068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 --2- 172.21.15.27:0/751316461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440824c0 0x7fa644068de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fa6440cb760 tx=0x7fa63c009840).stop 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 -- 172.21.15.27:0/751316461 shutdown_connections 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 --2- 172.21.15.27:0/751316461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440824c0 0x7fa644068de0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 --2- 172.21.15.27:0/751316461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa644153fa0 0x7fa6440c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 --2- 172.21.15.27:0/751316461 >> v2:172.21.15.40:3300/0 conn(0x7fa6440aa130 0x7fa644081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 -- 172.21.15.27:0/751316461 >> 172.21.15.27:0/751316461 conn(0x7fa64405e820 msgr2=0x7fa6440cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 -- 172.21.15.27:0/751316461 shutdown_connections 2023-05-17T15:05:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.047+0000 7fa64a674700 1 -- 172.21.15.27:0/751316461 wait complete. 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.048+0000 7fa64a674700 1 Processor -- start 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 -- start start 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6440824c0 0x7fa6440b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 0x7fa644167850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa644153fa0 0x7fa6441433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644167d40 con 0x7fa6440aa130 2023-05-17T15:05:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644143890 con 0x7fa644153fa0 2023-05-17T15:05:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa64a674700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644167fc0 con 0x7fa6440824c0 2023-05-17T15:05:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa6437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 0x7fa644167850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa6437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 0x7fa644167850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36396/0 (socket says 172.21.15.27:36396) 2023-05-17T15:05:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.049+0000 7fa6437fe700 1 -- 172.21.15.27:0/3056478453 learned_addr learned my addr 172.21.15.27:0/3056478453 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa648c11700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa644153fa0 0x7fa6441433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa643fff700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6440824c0 0x7fa6440b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa6437fe700 1 -- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6440824c0 msgr2=0x7fa6440b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa6437fe700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6440824c0 0x7fa6440b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa6437fe700 1 -- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa644153fa0 msgr2=0x7fa6441433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa6437fe700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa644153fa0 0x7fa6441433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa6437fe700 1 -- 172.21.15.27:0/3056478453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009ae0 con 0x7fa6440aa130 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa6437fe700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 0x7fa644167850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fa63800d890 tx=0x7fa638008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800f520 con 0x7fa6440aa130 2023-05-17T15:05:26.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63800f680 con 0x7fa6440aa130 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6441682a0 con 0x7fa6440aa130 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800fa00 con 0x7fa6440aa130 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.050+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6440c3320 con 0x7fa6440aa130 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.051+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6440c34e0 con 0x7fa6440aa130 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.051+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fa63801a030 con 0x7fa6440aa130 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.052+0000 7fa62bfff700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa63005ee70 0x7fa630061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.052+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa638079760 con 0x7fa6440aa130 2023-05-17T15:05:26.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.052+0000 7fa643fff700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa63005ee70 0x7fa630061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.052+0000 7fa643fff700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa63005ee70 0x7fa630061330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa63400bb10 tx=0x7fa634008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:26.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.056+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa63804abb0 con 0x7fa6440aa130 2023-05-17T15:05:26.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.252+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6440c31a0 con 0x7fa63005ee70 2023-05-17T15:05:26.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.253+0000 7fa62bfff700 1 -- 172.21.15.27:0/3056478453 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fa63400b750 con 0x7fa63005ee70 2023-05-17T15:05:26.257 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:26.257 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:56", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa63005ee70 msgr2=0x7fa630061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa63005ee70 0x7fa630061330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa63400bb10 tx=0x7fa634008040).stop 2023-05-17T15:05:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 msgr2=0x7fa644167850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 0x7fa644167850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fa63800d890 tx=0x7fa638008040).stop 2023-05-17T15:05:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 shutdown_connections 2023-05-17T15:05:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa63005ee70 0x7fa630061330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa644153fa0 0x7fa6441433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6440824c0 0x7fa6440b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 --2- 172.21.15.27:0/3056478453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6440aa130 0x7fa644167850 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 >> 172.21.15.27:0/3056478453 conn(0x7fa64405e820 msgr2=0x7fa6440c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 shutdown_connections 2023-05-17T15:05:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.255+0000 7fa64a674700 1 -- 172.21.15.27:0/3056478453 wait complete. 2023-05-17T15:05:26.270 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T14:54:56", "first": "2023-05-17T14:55:00", "last": "2023-05-17T15:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-17T15:05:26.271 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T14:54:56', 'first': '2023-05-17T14:55:00', 'last': '2023-05-17T15:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-17T15:05:26.271 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-05-17T15:05:26.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.387+0000 7f8cc5de4700 1 Processor -- start 2023-05-17T15:05:26.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.388+0000 7f8cc5de4700 1 -- start start 2023-05-17T15:05:26.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.388+0000 7f8cc5de4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8cc00a7fa0 0x7f8cc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.388+0000 7f8cc5de4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc0069c20 con 0x7f8cc00bec60 2023-05-17T15:05:26.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.388+0000 7f8cc5de4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc00a8380 con 0x7f8cc00c5310 2023-05-17T15:05:26.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.388+0000 7f8cc5de4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc0154570 con 0x7f8cc00a7fa0 2023-05-17T15:05:26.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8cc00a7fa0 0x7f8cc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8cc00bec60 0x7f8cc00c3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35968/0 (socket says 172.21.15.27:35968) 2023-05-17T15:05:26.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbffff700 1 -- 172.21.15.27:0/1191989666 learned_addr learned my addr 172.21.15.27:0/1191989666 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:26.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbf7fe700 1 -- 172.21.15.27:0/1191989666 >> v1:172.21.15.40:6789/0 conn(0x7f8cc00c5310 legacy=0x7f8cc00be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:26.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbf7fe700 1 -- 172.21.15.27:0/1191989666 >> v1:172.21.15.27:6789/0 conn(0x7f8cc00bec60 legacy=0x7f8cc00c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbf7fe700 1 -- 172.21.15.27:0/1191989666 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0069010 con 0x7f8cc00a7fa0 2023-05-17T15:05:26.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbf7fe700 1 --2- 172.21.15.27:0/1191989666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00a7fa0 0x7f8cc0068730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f8ca8009760 tx=0x7f8ca8009060).ready entity=mon.0 client_cookie=e380aaea9aab22c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:26.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbe7fc700 1 -- 172.21.15.27:0/1191989666 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800b520 con 0x7f8cc00a7fa0 2023-05-17T15:05:26.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbe7fc700 1 -- 172.21.15.27:0/1191989666 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800b680 con 0x7f8cc00a7fa0 2023-05-17T15:05:26.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.389+0000 7f8cbe7fc700 1 -- 172.21.15.27:0/1191989666 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800ba00 con 0x7f8cc00a7fa0 2023-05-17T15:05:26.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 -- 172.21.15.27:0/1191989666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00a7fa0 msgr2=0x7f8cc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/1191989666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00a7fa0 0x7f8cc0068730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f8ca8009760 tx=0x7f8ca8009060).stop 2023-05-17T15:05:26.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 -- 172.21.15.27:0/1191989666 shutdown_connections 2023-05-17T15:05:26.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/1191989666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00a7fa0 0x7f8cc0068730 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 -- 172.21.15.27:0/1191989666 >> 172.21.15.27:0/1191989666 conn(0x7f8cc0092160 msgr2=0x7f8cc0062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:26.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 -- 172.21.15.27:0/1191989666 shutdown_connections 2023-05-17T15:05:26.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.390+0000 7f8cc5de4700 1 -- 172.21.15.27:0/1191989666 wait complete. 2023-05-17T15:05:26.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.391+0000 7f8cc5de4700 1 Processor -- start 2023-05-17T15:05:26.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.391+0000 7f8cc5de4700 1 -- start start 2023-05-17T15:05:26.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cc00a7fa0 0x7f8cc01680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cc00bec60 0x7f8cc0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 0x7f8cc014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00aa260 con 0x7f8cc00c5310 2023-05-17T15:05:26.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0152c60 con 0x7f8cc00bec60 2023-05-17T15:05:26.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00a9650 con 0x7f8cc00a7fa0 2023-05-17T15:05:26.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 0x7f8cc014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 0x7f8cc014b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36412/0 (socket says 172.21.15.27:36412) 2023-05-17T15:05:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 -- 172.21.15.27:0/2929734809 learned_addr learned my addr 172.21.15.27:0/2929734809 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbf7fe700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cc00a7fa0 0x7f8cc01680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbeffd700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cc00bec60 0x7f8cc0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 -- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cc00a7fa0 msgr2=0x7f8cc01680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cc00a7fa0 0x7f8cc01680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 -- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cc00bec60 msgr2=0x7f8cc0152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cc00bec60 0x7f8cc0152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 -- 172.21.15.27:0/2929734809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca80092a0 con 0x7f8cc00c5310 2023-05-17T15:05:26.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbeffd700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cc00bec60 0x7f8cc0152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:26.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cbffff700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 0x7f8cc014b110 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f8cb800c7f0 tx=0x7f8cb8001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:26.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8005d30 con 0x7f8cc00c5310 2023-05-17T15:05:26.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb8005e90 con 0x7f8cc00c5310 2023-05-17T15:05:26.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc00a9930 con 0x7f8cc00c5310 2023-05-17T15:05:26.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8007320 con 0x7f8cc00c5310 2023-05-17T15:05:26.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.392+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc00a9ef0 con 0x7f8cc00c5310 2023-05-17T15:05:26.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.393+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc006bdf0 con 0x7f8cc00c5310 2023-05-17T15:05:26.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.394+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8cb8010030 con 0x7f8cc00c5310 2023-05-17T15:05:26.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.394+0000 7f8cb77fe700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ca005ee70 0x7f8ca0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:26.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.394+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8cb8079ad0 con 0x7f8cc00c5310 2023-05-17T15:05:26.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.394+0000 7f8cbf7fe700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ca005ee70 0x7f8ca0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:26.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.394+0000 7f8cbf7fe700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ca005ee70 0x7f8ca0061330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8cc00ab6d0 tx=0x7f8ca8017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:26.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.398+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8cb804af80 con 0x7f8cc00c5310 2023-05-17T15:05:26.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.601+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cc00692f0 con 0x7f8ca005ee70 2023-05-17T15:05:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.605+0000 7f8cb77fe700 1 -- 172.21.15.27:0/2929734809 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8cc00692f0 con 0x7f8ca005ee70 2023-05-17T15:05:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-05-17T15:05:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ca005ee70 msgr2=0x7f8ca0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ca005ee70 0x7f8ca0061330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8cc00ab6d0 tx=0x7f8ca8017000).stop 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 msgr2=0x7f8cc014b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 0x7f8cc014b110 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f8cb800c7f0 tx=0x7f8cb8001560).stop 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 shutdown_connections 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f8ca005ee70 0x7f8ca0061330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8cc00c5310 0x7f8cc014b110 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cc00a7fa0 0x7f8cc01680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 --2- 172.21.15.27:0/2929734809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cc00bec60 0x7f8cc0152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 >> 172.21.15.27:0/2929734809 conn(0x7f8cc0092160 msgr2=0x7f8cc0064890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 shutdown_connections 2023-05-17T15:05:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:26.607+0000 7f8cc5de4700 1 -- 172.21.15.27:0/2929734809 wait complete. 2023-05-17T15:05:26.622 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-05-17T15:05:26.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.623 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-05-17T15:05:26.638 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:26.638 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:26.638 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:26.638 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:26.638 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:26.638 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:26.639 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:26.639 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:26.639 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:26.639 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:26.639 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:26.639 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:26.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.640 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:26.703 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:26.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.704 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:26.770 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:26.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.771 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:26.835 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:26.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.836 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:26.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:26.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.900 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:26.962 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:26.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:26.963 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:27.025 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:27.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.025 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:27.086 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:27.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.086 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:27.150 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:27.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.151 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:27.212 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:27.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.213 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:27.274 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:27.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.275 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:27.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.336 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-05-17T15:05:27.393 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-05-17T15:05:27.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.548+0000 7f4732371700 1 Processor -- start 2023-05-17T15:05:27.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.549+0000 7f4732371700 1 -- start start 2023-05-17T15:05:27.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.549+0000 7f4732371700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f472c0c1080 0x7f472c0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:27.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f4732371700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:27.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f4732371700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c154a50 con 0x7f472c154520 2023-05-17T15:05:27.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f4732371700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c154d30 con 0x7f472c0c1080 2023-05-17T15:05:27.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f4732371700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c155010 con 0x7f472c0c5d60 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f472c0c1080 0x7f472c0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f472c0c1080 0x7f472c0c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36416/0 (socket says 172.21.15.27:36416) 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 -- 172.21.15.27:0/2908341864 learned_addr learned my addr 172.21.15.27:0/2908341864 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f4731b70700 1 --2- 172.21.15.27:0/2908341864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 -- 172.21.15.27:0/2908341864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 msgr2=0x7f472c0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 --2- 172.21.15.27:0/2908341864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 -- 172.21.15.27:0/2908341864 >> v1:172.21.15.40:6789/0 conn(0x7f472c154520 legacy=0x7f472c0c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 -- 172.21.15.27:0/2908341864 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c1552f0 con 0x7f472c0c1080 2023-05-17T15:05:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f473136f700 1 --2- 172.21.15.27:0/2908341864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c0c1460 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f4724006fd0 tx=0x7f47240090f0).ready entity=mon.0 client_cookie=a9d5a22969c0203 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f472bfff700 1 -- 172.21.15.27:0/2908341864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472400b600 con 0x7f472c0c1080 2023-05-17T15:05:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f472bfff700 1 -- 172.21.15.27:0/2908341864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472400b760 con 0x7f472c0c1080 2023-05-17T15:05:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.550+0000 7f472bfff700 1 -- 172.21.15.27:0/2908341864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472400bae0 con 0x7f472c0c1080 2023-05-17T15:05:27.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 -- 172.21.15.27:0/2908341864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 msgr2=0x7f472c0c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:27.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 --2- 172.21.15.27:0/2908341864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c0c1460 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f4724006fd0 tx=0x7f47240090f0).stop 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 -- 172.21.15.27:0/2908341864 shutdown_connections 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 --2- 172.21.15.27:0/2908341864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 --2- 172.21.15.27:0/2908341864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c0c1460 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 -- 172.21.15.27:0/2908341864 >> 172.21.15.27:0/2908341864 conn(0x7f472c05dd50 msgr2=0x7f472c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 -- 172.21.15.27:0/2908341864 shutdown_connections 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.551+0000 7f4732371700 1 -- 172.21.15.27:0/2908341864 wait complete. 2023-05-17T15:05:27.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.552+0000 7f4732371700 1 Processor -- start 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.552+0000 7f4732371700 1 -- start start 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4732371700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4732371700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4732371700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472c154520 0x7f472c05e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4732371700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0adcb0 con 0x7f472c0c1080 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4732371700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0cabf0 con 0x7f472c154520 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4732371700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0caec0 con 0x7f472c0c5d60 2023-05-17T15:05:27.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36422/0 (socket says 172.21.15.27:36422) 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 -- 172.21.15.27:0/1861747374 learned_addr learned my addr 172.21.15.27:0/1861747374 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 -- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 msgr2=0x7f472c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4731b70700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472c154520 0x7f472c05e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f4730b6e700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 -- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472c154520 msgr2=0x7f472c05e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472c154520 0x7f472c05e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 -- 172.21.15.27:0/1861747374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724009370 con 0x7f472c0c1080 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.553+0000 7f473136f700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c168220 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f472c05f170 tx=0x7f4724017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.554+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724006a40 con 0x7f472c0c1080 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.554+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472400b8d0 con 0x7f472c0c1080 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.554+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c0cb1a0 con 0x7f472c0c1080 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.554+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472401c670 con 0x7f472c0c1080 2023-05-17T15:05:27.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.554+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c0cb760 con 0x7f472c0c1080 2023-05-17T15:05:27.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.554+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c0adf90 con 0x7f472c0c1080 2023-05-17T15:05:27.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.555+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f472400f070 con 0x7f472c0c1080 2023-05-17T15:05:27.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.555+0000 7f47297fa700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f471805ee70 0x7f4718061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:27.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.555+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f472407b450 con 0x7f472c0c1080 2023-05-17T15:05:27.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.555+0000 7f4730b6e700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f471805ee70 0x7f4718061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:27.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.556+0000 7f4730b6e700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f471805ee70 0x7f4718061330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f472c150100 tx=0x7f4720008040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:27.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.559+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f472404c900 con 0x7f472c0c1080 2023-05-17T15:05:27.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.758+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f472c047150 con 0x7f471805ee70 2023-05-17T15:05:27.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.761+0000 7f47297fa700 1 -- 172.21.15.27:0/1861747374 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f472c047150 con 0x7f471805ee70 2023-05-17T15:05:27.765 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-05-17T15:05:27.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f471805ee70 msgr2=0x7f4718061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:27.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f471805ee70 0x7f4718061330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f472c150100 tx=0x7f4720008040).stop 2023-05-17T15:05:27.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 msgr2=0x7f472c168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:27.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c168220 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f472c05f170 tx=0x7f4724017000).stop 2023-05-17T15:05:27.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 shutdown_connections 2023-05-17T15:05:27.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f471805ee70 0x7f4718061330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472c154520 0x7f472c05e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c0c1080 0x7f472c168220 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 --2- 172.21.15.27:0/1861747374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472c0c5d60 0x7f472c0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:27.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 >> 172.21.15.27:0/1861747374 conn(0x7f472c05dd50 msgr2=0x7f472c152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:27.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 shutdown_connections 2023-05-17T15:05:27.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:27.763+0000 7f4732371700 1 -- 172.21.15.27:0/1861747374 wait complete. 2023-05-17T15:05:27.778 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-05-17T15:05:27.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.779 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-05-17T15:05:27.794 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:27.795 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:27.795 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:27.795 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:27.795 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:27.796 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:27.796 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:27.796 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:27.796 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:27.797 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:27.797 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:27.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:27.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.798 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:27.866 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:27.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.867 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:27.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:27.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.931 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:27.991 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:27.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:27.992 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:28.052 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:28.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.053 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:28.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:28.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.113 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:28.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:28.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.173 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:28.232 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:28.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.233 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:28.292 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:28.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.293 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:28.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:28.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.353 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:28.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:28.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.413 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:28.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.473 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-05-17T15:05:28.530 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-05-17T15:05:28.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.687+0000 7fb57496b700 1 Processor -- start 2023-05-17T15:05:28.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.687+0000 7fb57496b700 1 -- start start 2023-05-17T15:05:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb57496b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 0x7fb5700c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb57496b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb570154a50 con 0x7fb5700c5d60 2023-05-17T15:05:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb57496b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb570154d30 con 0x7fb5700c1080 2023-05-17T15:05:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb57496b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb570155010 con 0x7fb570154520 2023-05-17T15:05:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb5700c5d60 0x7fb5700a99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:35996/0 (socket says 172.21.15.27:35996) 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56ffff700 1 -- 172.21.15.27:0/1029317937 learned_addr learned my addr 172.21.15.27:0/1029317937 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319913310 0 0) 0x7fb570154a50 con 0x7fb5700c5d60 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56effd700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 0x7fb5700c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c0033f0 con 0x7fb5700c5d60 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1086581901 0 0) 0x7fb55c0033f0 con 0x7fb5700c5d60 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 msgr2=0x7fb5700c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:28.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 0x7fb5700c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 >> v1:172.21.15.40:6789/0 conn(0x7fb5700c1080 legacy=0x7fb5700c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5701552f0 con 0x7fb5700c5d60 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fb5600017f0 con 0x7fb5700c5d60 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 >> v1:172.21.15.27:6789/0 conn(0x7fb5700c5d60 legacy=0x7fb5700a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c003910 0x7fb55c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 0x7fb55c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570155010 con 0x7fb55c003910 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c00b940 con 0x7fb55c004690 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c00bb00 con 0x7fb570154520 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.688+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c003910 0x7fb55c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56effd700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56ffff700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 0x7fb55c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56f7fe700 1 -- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 msgr2=0x7fb55c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570154520 0x7fb55c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56f7fe700 1 -- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c004690 msgr2=0x7fb55c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56f7fe700 1 -- 172.21.15.27:0/1029317937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0033f0 con 0x7fb55c003910 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c003910 0x7fb55c003d30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fb568001730 tx=0x7fb568007bb0).ready entity=mon.0 client_cookie=92f67a879bf523f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568007020 con 0x7fb55c003910 2023-05-17T15:05:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568007180 con 0x7fb55c003910 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.689+0000 7fb56e7fc700 1 -- 172.21.15.27:0/1029317937 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568007500 con 0x7fb55c003910 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb57496b700 1 -- 172.21.15.27:0/1029317937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c003910 msgr2=0x7fb55c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb57496b700 1 --2- 172.21.15.27:0/1029317937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c003910 0x7fb55c003d30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fb568001730 tx=0x7fb568007bb0).stop 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb56ffff700 1 -- 172.21.15.27:0/1029317937 reap_dead start 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb57496b700 1 -- 172.21.15.27:0/1029317937 shutdown_connections 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb57496b700 1 -- 172.21.15.27:0/1029317937 >> 172.21.15.27:0/1029317937 conn(0x7fb57005dd50 msgr2=0x7fb57005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb57496b700 1 -- 172.21.15.27:0/1029317937 shutdown_connections 2023-05-17T15:05:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.690+0000 7fb57496b700 1 -- 172.21.15.27:0/1029317937 wait complete. 2023-05-17T15:05:28.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.691+0000 7fb57496b700 1 Processor -- start 2023-05-17T15:05:28.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.691+0000 7fb57496b700 1 -- start start 2023-05-17T15:05:28.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c003910 0x7fb5701518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570159f90 0x7fb57015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 0x7fb5700af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b0090 con 0x7fb5700aed80 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570157d50 con 0x7fb55c003910 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701582d0 con 0x7fb570159f90 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 0x7fb5700af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 0x7fb5700af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36446/0 (socket says 172.21.15.27:36446) 2023-05-17T15:05:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 -- 172.21.15.27:0/1395832816 learned_addr learned my addr 172.21.15.27:0/1395832816 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56effd700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570159f90 0x7fb57015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c003910 0x7fb5701518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 -- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570159f90 msgr2=0x7fb57015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570159f90 0x7fb57015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 -- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c003910 msgr2=0x7fb5701518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c003910 0x7fb5701518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 -- 172.21.15.27:0/1395832816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57015a900 con 0x7fb5700aed80 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb56ffff700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 0x7fb5700af200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fb57005f170 tx=0x7fb5600017e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600079f0 con 0x7fb5700aed80 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000f8a0 con 0x7fb5700aed80 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570151dd0 con 0x7fb5700aed80 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000fc40 con 0x7fb5700aed80 2023-05-17T15:05:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.692+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700afdb0 con 0x7fb5700aed80 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.693+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb570158460 con 0x7fb5700aed80 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.694+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb56001b030 con 0x7fb5700aed80 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.694+0000 7fb5677fe700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb55005ee70 0x7fb550061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.694+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6442+0+0 (secure 0 0 0) 0x7fb560079690 con 0x7fb5700aed80 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.694+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb55005ee70 0x7fb550061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.694+0000 7fb56f7fe700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb55005ee70 0x7fb550061330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb568001010 tx=0x7fb568015000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.698+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb56004ab80 con 0x7fb5700aed80 2023-05-17T15:05:28.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.903+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5700bfb70 con 0x7fb55005ee70 2023-05-17T15:05:28.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.906+0000 7fb5677fe700 1 -- 172.21.15.27:0/1395832816 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fb5700bfb70 con 0x7fb55005ee70 2023-05-17T15:05:28.910 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-05-17T15:05:28.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb55005ee70 msgr2=0x7fb550061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb55005ee70 0x7fb550061330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb568001010 tx=0x7fb568015000).stop 2023-05-17T15:05:28.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 msgr2=0x7fb5700af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:28.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 0x7fb5700af200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fb57005f170 tx=0x7fb5600017e0).stop 2023-05-17T15:05:28.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 shutdown_connections 2023-05-17T15:05:28.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb55005ee70 0x7fb550061330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5700aed80 0x7fb5700af200 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb55c003910 0x7fb5701518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 --2- 172.21.15.27:0/1395832816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb570159f90 0x7fb57015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:28.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 >> 172.21.15.27:0/1395832816 conn(0x7fb57005dd50 msgr2=0x7fb5700c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:28.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 shutdown_connections 2023-05-17T15:05:28.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:28.908+0000 7fb57496b700 1 -- 172.21.15.27:0/1395832816 wait complete. 2023-05-17T15:05:28.923 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-05-17T15:05:28.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.924 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-05-17T15:05:28.941 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:28.942 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:28.942 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:28.943 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:28.944 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:28.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:28.944 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:29.014 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:29.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.015 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:29.075 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:29.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.076 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:29.136 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:29.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.137 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:29.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:29.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.197 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:29.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:29.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.257 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:29.316 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:29.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.317 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:29.376 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:29.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.377 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:29.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:29.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.437 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:29.496 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:29.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.497 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:29.557 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:29.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.558 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:29.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:29.618 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-05-17T15:05:29.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-05-17T15:05:29.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.842+0000 7f90a9860700 1 Processor -- start 2023-05-17T15:05:29.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.843+0000 7f90a9860700 1 -- start start 2023-05-17T15:05:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.843+0000 7f90a9860700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 0x7f90a4154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.843+0000 7f90a9860700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90a40c0390 0x7f90a40a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.843+0000 7f90a9860700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a40aa6e0 con 0x7f90a40aa250 2023-05-17T15:05:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.843+0000 7f90a9860700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a4157e20 con 0x7f90a40c0390 2023-05-17T15:05:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.843+0000 7f90a9860700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4158100 con 0x7f90a4153d50 2023-05-17T15:05:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 0x7f90a4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 0x7f90a4154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:37560/0 (socket says 172.21.15.27:37560) 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 -- 172.21.15.27:0/373765358 learned_addr learned my addr 172.21.15.27:0/373765358 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a27fc700 1 --2- 172.21.15.27:0/373765358 >> v2:172.21.15.40:3300/0 conn(0x7f90a40c0390 0x7f90a40a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 -- 172.21.15.27:0/373765358 >> v2:172.21.15.40:3300/0 conn(0x7f90a40c0390 msgr2=0x7f90a40a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 --2- 172.21.15.27:0/373765358 >> v2:172.21.15.40:3300/0 conn(0x7f90a40c0390 0x7f90a40a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 -- 172.21.15.27:0/373765358 >> v1:172.21.15.40:6789/0 conn(0x7f90a40aa250 legacy=0x7f90a40c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 -- 172.21.15.27:0/373765358 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a41583e0 con 0x7f90a4153d50 2023-05-17T15:05:29.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.844+0000 7f90a2ffd700 1 --2- 172.21.15.27:0/373765358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 0x7f90a4154130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9094006fd0 tx=0x7f90940090f0).ready entity=mon.2 client_cookie=e68cd17933e93699 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:29.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.845+0000 7f90a1ffb700 1 -- 172.21.15.27:0/373765358 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b520 con 0x7f90a4153d50 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.845+0000 7f90a1ffb700 1 -- 172.21.15.27:0/373765358 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400b680 con 0x7f90a4153d50 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.845+0000 7f90a1ffb700 1 -- 172.21.15.27:0/373765358 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400ba00 con 0x7f90a4153d50 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 -- 172.21.15.27:0/373765358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 msgr2=0x7f90a4154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 --2- 172.21.15.27:0/373765358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 0x7f90a4154130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9094006fd0 tx=0x7f90940090f0).stop 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 -- 172.21.15.27:0/373765358 shutdown_connections 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 --2- 172.21.15.27:0/373765358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a4153d50 0x7f90a4154130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 --2- 172.21.15.27:0/373765358 >> v2:172.21.15.40:3300/0 conn(0x7f90a40c0390 0x7f90a40a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:29.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 -- 172.21.15.27:0/373765358 >> 172.21.15.27:0/373765358 conn(0x7f90a40cae00 msgr2=0x7f90a40cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:29.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 -- 172.21.15.27:0/373765358 shutdown_connections 2023-05-17T15:05:29.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.846+0000 7f90a9860700 1 -- 172.21.15.27:0/373765358 wait complete. 2023-05-17T15:05:29.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.847+0000 7f90a9860700 1 Processor -- start 2023-05-17T15:05:29.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.847+0000 7f90a9860700 1 -- start start 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a9860700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a40aa250 0x7f90a4165230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a9860700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 0x7f90a4142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a9860700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a4153d50 0x7f90a40b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a9860700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40ae110 con 0x7f90a40c0390 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a9860700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40af990 con 0x7f90a4153d50 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a9860700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b0210 con 0x7f90a40aa250 2023-05-17T15:05:29.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 0x7f90a4142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 0x7f90a4142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36458/0 (socket says 172.21.15.27:36458) 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a27fc700 1 -- 172.21.15.27:0/2848904 learned_addr learned my addr 172.21.15.27:0/2848904 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a37fe700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a4153d50 0x7f90a40b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.848+0000 7f90a2ffd700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a40aa250 0x7f90a4165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a27fc700 1 -- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a40aa250 msgr2=0x7f90a4165230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a27fc700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a40aa250 0x7f90a4165230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:29.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a27fc700 1 -- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a4153d50 msgr2=0x7f90a40b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a27fc700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a4153d50 0x7f90a40b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a27fc700 1 -- 172.21.15.27:0/2848904 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009370 con 0x7f90a40c0390 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a27fc700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 0x7f90a4142870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f909800e880 tx=0x7f9098009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098012600 con 0x7f90a40c0390 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9098012760 con 0x7f90a40c0390 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a4154f10 con 0x7f90a40c0390 2023-05-17T15:05:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098012ae0 con 0x7f90a40c0390 2023-05-17T15:05:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.849+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a40afea0 con 0x7f90a40c0390 2023-05-17T15:05:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.850+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a4165780 con 0x7f90a40c0390 2023-05-17T15:05:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.851+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f909801a3b0 con 0x7f90a40c0390 2023-05-17T15:05:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.851+0000 7f908affd700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f909005ee70 0x7f9090061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.851+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f909807a060 con 0x7f90a40c0390 2023-05-17T15:05:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.851+0000 7f90a2ffd700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f909005ee70 0x7f9090061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.852+0000 7f90a2ffd700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f909005ee70 0x7f9090061330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f9094009130 tx=0x7f9094015000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:29.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:29.856+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f909804b350 con 0x7f90a40c0390 2023-05-17T15:05:30.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.069+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f90a41586c0 con 0x7f909005ee70 2023-05-17T15:05:30.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.072+0000 7f908affd700 1 -- 172.21.15.27:0/2848904 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f90a41586c0 con 0x7f909005ee70 2023-05-17T15:05:30.076 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-05-17T15:05:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f909005ee70 msgr2=0x7f9090061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f909005ee70 0x7f9090061330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f9094009130 tx=0x7f9094015000).stop 2023-05-17T15:05:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 msgr2=0x7f90a4142870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 0x7f90a4142870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f909800e880 tx=0x7f9098009060).stop 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 shutdown_connections 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f909005ee70 0x7f9090061330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a4153d50 0x7f90a40b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a40aa250 0x7f90a4165230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 --2- 172.21.15.27:0/2848904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a40c0390 0x7f90a4142870 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 >> 172.21.15.27:0/2848904 conn(0x7f90a40cae00 msgr2=0x7f90a40acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:30.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 shutdown_connections 2023-05-17T15:05:30.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:30.074+0000 7f90a9860700 1 -- 172.21.15.27:0/2848904 wait complete. 2023-05-17T15:05:30.089 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-05-17T15:05:30.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.090 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-05-17T15:05:30.106 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:30.106 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:30.107 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:30.108 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:30.108 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:30.108 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:30.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.109 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:30.181 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:30.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.182 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:30.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:30.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.243 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:30.303 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:30.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.304 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:30.363 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:30.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.364 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:30.431 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:30.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.432 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:30.493 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:30.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.493 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:30.553 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:30.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.554 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:30.615 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:30.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.617 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:30.676 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:30.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.677 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:30.736 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:30.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.737 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:30.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:30.797 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-05-17T15:05:30.860 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-05-17T15:05:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.044+0000 7f45dc145700 1 Processor -- start 2023-05-17T15:05:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.044+0000 7f45dc145700 1 -- start start 2023-05-17T15:05:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45dc145700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45d4151c90 0x7f45d4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45dc145700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4158010 con 0x7f45d4154980 2023-05-17T15:05:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45dc145700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4154f60 con 0x7f45d40c0520 2023-05-17T15:05:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45dc145700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d4155240 con 0x7f45d4151c90 2023-05-17T15:05:31.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45d96e0700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f45d4154980 0x7f45d40c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36028/0 (socket says 172.21.15.27:36028) 2023-05-17T15:05:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45d96e0700 1 -- 172.21.15.27:0/3344887931 learned_addr learned my addr 172.21.15.27:0/3344887931 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45d9ee1700 1 --2- 172.21.15.27:0/3344887931 >> v2:172.21.15.40:3300/0 conn(0x7f45d4151c90 0x7f45d4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45d8edf700 1 -- 172.21.15.27:0/3344887931 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306131136 0 0) 0x7f45d4158010 con 0x7f45d4154980 2023-05-17T15:05:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.045+0000 7f45d8edf700 1 -- 172.21.15.27:0/3344887931 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45bc0033f0 con 0x7f45d4154980 2023-05-17T15:05:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d9ee1700 1 -- 172.21.15.27:0/3344887931 >> v1:172.21.15.40:6789/0 conn(0x7f45d40c0520 legacy=0x7f45d4081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d9ee1700 1 -- 172.21.15.27:0/3344887931 >> v1:172.21.15.27:6789/0 conn(0x7f45d4154980 legacy=0x7f45d40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d9ee1700 1 -- 172.21.15.27:0/3344887931 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4155520 con 0x7f45d4151c90 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d9ee1700 1 --2- 172.21.15.27:0/3344887931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4151c90 0x7f45d4152070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f45cc009760 tx=0x7f45cc009060).ready entity=mon.1 client_cookie=ce583df14d37e075 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d8edf700 1 -- 172.21.15.27:0/3344887931 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00f510 con 0x7f45d4151c90 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d8edf700 1 -- 172.21.15.27:0/3344887931 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc00f670 con 0x7f45d4151c90 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45d8edf700 1 -- 172.21.15.27:0/3344887931 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00f9f0 con 0x7f45d4151c90 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45dc145700 1 -- 172.21.15.27:0/3344887931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4151c90 msgr2=0x7f45d4152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45dc145700 1 --2- 172.21.15.27:0/3344887931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4151c90 0x7f45d4152070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f45cc009760 tx=0x7f45cc009060).stop 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45dc145700 1 -- 172.21.15.27:0/3344887931 shutdown_connections 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45dc145700 1 --2- 172.21.15.27:0/3344887931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4151c90 0x7f45d4152070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.046+0000 7f45dc145700 1 -- 172.21.15.27:0/3344887931 >> 172.21.15.27:0/3344887931 conn(0x7f45d40cae10 msgr2=0x7f45d40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.047+0000 7f45dc145700 1 -- 172.21.15.27:0/3344887931 shutdown_connections 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.047+0000 7f45dc145700 1 -- 172.21.15.27:0/3344887931 wait complete. 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 Processor -- start 2023-05-17T15:05:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 -- start start 2023-05-17T15:05:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d40c0520 0x7f45d4150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 0x7f45d40c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4154980 0x7f45d4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40c3460 con 0x7f45d4151c90 2023-05-17T15:05:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4150a50 con 0x7f45d4154980 2023-05-17T15:05:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45dc145700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d40c2850 con 0x7f45d40c0520 2023-05-17T15:05:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45d96e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 0x7f45d40c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45d96e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 0x7f45d40c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36472/0 (socket says 172.21.15.27:36472) 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45d96e0700 1 -- 172.21.15.27:0/1165476107 learned_addr learned my addr 172.21.15.27:0/1165476107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45d9ee1700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d40c0520 0x7f45d4150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.048+0000 7f45da6e2700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4154980 0x7f45d4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d96e0700 1 -- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d40c0520 msgr2=0x7f45d4150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d96e0700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d40c0520 0x7f45d4150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d96e0700 1 -- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4154980 msgr2=0x7f45d4158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d96e0700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4154980 0x7f45d4158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d96e0700 1 -- 172.21.15.27:0/1165476107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0092a0 con 0x7f45d4151c90 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d96e0700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 0x7f45d40c1eb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f45c800c420 tx=0x7f45c8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80070d0 con 0x7f45d4151c90 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8007230 con 0x7f45d4151c90 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80075b0 con 0x7f45d4151c90 2023-05-17T15:05:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d40c2b30 con 0x7f45d4151c90 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.049+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d40c30f0 con 0x7f45d4151c90 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.050+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d40c3610 con 0x7f45d4151c90 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.050+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f45c8010070 con 0x7f45d4151c90 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.051+0000 7f45d1ffb700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f45c005ee70 0x7f45c0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.051+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f45c80794c0 con 0x7f45d4151c90 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.051+0000 7f45d9ee1700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f45c005ee70 0x7f45c0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.051+0000 7f45d9ee1700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f45c005ee70 0x7f45c0061330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f45cc009760 tx=0x7f45cc017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.055+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45d40c3610 con 0x7f45d4151c90 2023-05-17T15:05:31.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.252+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f45d40c35a0 con 0x7f45c005ee70 2023-05-17T15:05:31.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.256+0000 7f45d1ffb700 1 -- 172.21.15.27:0/1165476107 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f45d40c35a0 con 0x7f45c005ee70 2023-05-17T15:05:31.260 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-05-17T15:05:31.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f45c005ee70 msgr2=0x7f45c0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f45c005ee70 0x7f45c0061330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f45cc009760 tx=0x7f45cc017000).stop 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 msgr2=0x7f45d40c1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 0x7f45d40c1eb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f45c800c420 tx=0x7f45c8007c80).stop 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 shutdown_connections 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f45c005ee70 0x7f45c0061330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d4154980 0x7f45d4158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d40c0520 0x7f45d4150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 --2- 172.21.15.27:0/1165476107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45d4151c90 0x7f45d40c1eb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:31.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 >> 172.21.15.27:0/1165476107 conn(0x7f45d40cae10 msgr2=0x7f45d4155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:31.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 shutdown_connections 2023-05-17T15:05:31.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:31.258+0000 7f45dc145700 1 -- 172.21.15.27:0/1165476107 wait complete. 2023-05-17T15:05:31.273 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-05-17T15:05:31.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.274 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-05-17T15:05:31.288 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:31.290 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:31.290 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:31.290 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:31.290 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:31.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:31.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.292 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:31.353 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:31.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.354 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:31.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:31.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.414 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:31.474 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:31.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.475 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:31.534 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:31.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.535 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:31.594 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:31.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.595 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:31.655 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:31.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.655 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:31.715 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:31.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.716 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:31.766 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:31.783 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:31.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.784 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:31.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:31.857 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:31.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.858 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:31.952 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:31.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:31.952 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:32.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.020 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-05-17T15:05:32.078 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-05-17T15:05:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 Processor -- start 2023-05-17T15:05:32.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 -- start start 2023-05-17T15:05:32.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f49c40c1080 0x7f49c40c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49c40c5d60 0x7f49c40c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c4154a50 con 0x7f49c4154520 2023-05-17T15:05:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c4154d30 con 0x7f49c40c1080 2023-05-17T15:05:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.234+0000 7f49c3fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c4155010 con 0x7f49c40c5d60 2023-05-17T15:05:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f49c40c1080 0x7f49c40c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f49c40c1080 0x7f49c40c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36478/0 (socket says 172.21.15.27:36478) 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 -- 172.21.15.27:0/4171562543 learned_addr learned my addr 172.21.15.27:0/4171562543 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c37fe700 1 --2- 172.21.15.27:0/4171562543 >> v2:172.21.15.40:3300/0 conn(0x7f49c40c5d60 0x7f49c40c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 -- 172.21.15.27:0/4171562543 >> v2:172.21.15.40:3300/0 conn(0x7f49c40c5d60 msgr2=0x7f49c40c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 --2- 172.21.15.27:0/4171562543 >> v2:172.21.15.40:3300/0 conn(0x7f49c40c5d60 0x7f49c40c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 -- 172.21.15.27:0/4171562543 >> v1:172.21.15.40:6789/0 conn(0x7f49c4154520 legacy=0x7f49c40c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 -- 172.21.15.27:0/4171562543 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c41552f0 con 0x7f49c40c1080 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c2ffd700 1 --2- 172.21.15.27:0/4171562543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c40c1460 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f49c40c09f0 tx=0x7f49bc009840).ready entity=mon.0 client_cookie=64a69677d7285487 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c1ffb700 1 -- 172.21.15.27:0/4171562543 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00e070 con 0x7f49c40c1080 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c1ffb700 1 -- 172.21.15.27:0/4171562543 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00ba20 con 0x7f49c40c1080 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.235+0000 7f49c1ffb700 1 -- 172.21.15.27:0/4171562543 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00bda0 con 0x7f49c40c1080 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 -- 172.21.15.27:0/4171562543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 msgr2=0x7f49c40c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 --2- 172.21.15.27:0/4171562543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c40c1460 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f49c40c09f0 tx=0x7f49bc009840).stop 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 -- 172.21.15.27:0/4171562543 shutdown_connections 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 --2- 172.21.15.27:0/4171562543 >> v2:172.21.15.40:3300/0 conn(0x7f49c40c5d60 0x7f49c40c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 --2- 172.21.15.27:0/4171562543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c40c1460 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 -- 172.21.15.27:0/4171562543 >> 172.21.15.27:0/4171562543 conn(0x7f49c405dd50 msgr2=0x7f49c405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:32.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 -- 172.21.15.27:0/4171562543 shutdown_connections 2023-05-17T15:05:32.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.236+0000 7f49c3fff700 1 -- 172.21.15.27:0/4171562543 wait complete. 2023-05-17T15:05:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.237+0000 7f49c3fff700 1 Processor -- start 2023-05-17T15:05:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.237+0000 7f49c3fff700 1 -- start start 2023-05-17T15:05:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c4143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49c40c5d60 0x7f49c40c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c4154520 0x7f49c41567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c3fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40ca510 con 0x7f49c40c1080 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c3fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40ca7f0 con 0x7f49c4154520 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c3fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40caad0 con 0x7f49c40c5d60 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c4143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c4143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36484/0 (socket says 172.21.15.27:36484) 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 -- 172.21.15.27:0/104343241 learned_addr learned my addr 172.21.15.27:0/104343241 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c37fe700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c4154520 0x7f49c41567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 -- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49c40c5d60 msgr2=0x7f49c40c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c27fc700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49c40c5d60 0x7f49c40c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49c40c5d60 0x7f49c40c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 -- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c4154520 msgr2=0x7f49c41567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c4154520 0x7f49c41567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 -- 172.21.15.27:0/104343241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc009ae0 con 0x7f49c40c1080 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c37fe700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c4154520 0x7f49c41567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49c2ffd700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c4143970 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f49bc00b6c0 tx=0x7f49bc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.238+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00bb90 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.239+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00bcf0 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.239+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c40cadb0 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.239+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc01e680 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.239+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c40ca120 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.240+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4069fc0 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.240+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f49bc025030 con 0x7f49c40c1080 2023-05-17T15:05:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.240+0000 7f49baffd700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f49a405ee70 0x7f49a4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.240+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f49bc07b460 con 0x7f49c40c1080 2023-05-17T15:05:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.240+0000 7f49c27fc700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f49a405ee70 0x7f49a4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.241+0000 7f49c27fc700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f49a405ee70 0x7f49a4061330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f49c40adfc0 tx=0x7f49ac009040).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.244+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49bc04c760 con 0x7f49c40c1080 2023-05-17T15:05:32.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.444+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c414fe00 con 0x7f49a405ee70 2023-05-17T15:05:32.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.448+0000 7f49baffd700 1 -- 172.21.15.27:0/104343241 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f49c414fe00 con 0x7f49a405ee70 2023-05-17T15:05:32.452 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-05-17T15:05:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f49a405ee70 msgr2=0x7f49a4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f49a405ee70 0x7f49a4061330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f49c40adfc0 tx=0x7f49ac009040).stop 2023-05-17T15:05:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 msgr2=0x7f49c4143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c4143970 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f49bc00b6c0 tx=0x7f49bc009840).stop 2023-05-17T15:05:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 shutdown_connections 2023-05-17T15:05:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f49a405ee70 0x7f49a4061330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c4154520 0x7f49c41567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49c40c1080 0x7f49c4143970 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 --2- 172.21.15.27:0/104343241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49c40c5d60 0x7f49c40c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:32.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 >> 172.21.15.27:0/104343241 conn(0x7f49c405dd50 msgr2=0x7f49c4152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:32.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 shutdown_connections 2023-05-17T15:05:32.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:32.450+0000 7f49c3fff700 1 -- 172.21.15.27:0/104343241 wait complete. 2023-05-17T15:05:32.465 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-05-17T15:05:32.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.466 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-05-17T15:05:32.481 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:32.481 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:32.482 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:32.483 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:32.483 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:32.483 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:32.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.484 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:32.545 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:32.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.545 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:32.607 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:32.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.607 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:32.668 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:32.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.669 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:32.729 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:32.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.730 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:32.793 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:32.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.794 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:32.867 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:32.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.868 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:32.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:32.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.930 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:32.990 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:32.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:32.991 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:33.051 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:33.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.052 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:33.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:33.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.113 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:33.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.174 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-05-17T15:05:33.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-05-17T15:05:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.398+0000 7fab0ad41700 1 Processor -- start 2023-05-17T15:05:33.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.398+0000 7fab0ad41700 1 -- start start 2023-05-17T15:05:33.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab0ad41700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab040c0420 0x7fab04081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab0ad41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 0x7fab040aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab0ad41700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040c1610 con 0x7fab04153fa0 2023-05-17T15:05:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab0ad41700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab040828f0 con 0x7fab040c0420 2023-05-17T15:05:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab0ad41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab040c0a00 con 0x7fab040824c0 2023-05-17T15:05:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab08add700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fab04153fa0 0x7fab040aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36054/0 (socket says 172.21.15.27:36054) 2023-05-17T15:05:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab08add700 1 -- 172.21.15.27:0/1597256673 learned_addr learned my addr 172.21.15.27:0/1597256673 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab092de700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 0x7fab040aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab03fff700 1 --2- 172.21.15.27:0/1597256673 >> v2:172.21.15.40:3300/0 conn(0x7fab040c0420 0x7fab04081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531919982 0 0) 0x7fab040c1610 con 0x7fab04153fa0 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf40033f0 con 0x7fab04153fa0 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687793264 0 0) 0x7faaf40033f0 con 0x7fab04153fa0 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 msgr2=0x7fab040aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 0x7fab040aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 >> v2:172.21.15.40:3300/0 conn(0x7fab040c0420 msgr2=0x7fab04081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 --2- 172.21.15.27:0/1597256673 >> v2:172.21.15.40:3300/0 conn(0x7fab040c0420 0x7fab04081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040c0ce0 con 0x7fab04153fa0 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7faaf8001470 con 0x7fab04153fa0 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 >> v1:172.21.15.27:6789/0 conn(0x7fab04153fa0 legacy=0x7fab040aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 0x7faaf40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4003e10 0x7faaf4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7faaf4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040828f0 con 0x7faaf4004b80 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040c0a00 con 0x7faaf4003e10 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.399+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf400b8e0 con 0x7fab040824c0 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7faaf4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab08add700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 0x7faaf40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab03fff700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4003e10 0x7faaf4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 -- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 msgr2=0x7faaf40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040824c0 0x7faaf40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 -- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4003e10 msgr2=0x7faaf4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4003e10 0x7faaf4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 -- 172.21.15.27:0/1597256673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40033f0 con 0x7faaf4004b80 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab092de700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7faaf4005000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faafc00e240 tx=0x7faafc00b040).ready entity=mon.0 client_cookie=8ff31339ff1c9bf7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc009ac0 con 0x7faaf4004b80 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc00f040 con 0x7faaf4004b80 2023-05-17T15:05:33.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.400+0000 7fab037fe700 1 -- 172.21.15.27:0/1597256673 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00ed00 con 0x7faaf4004b80 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab0ad41700 1 -- 172.21.15.27:0/1597256673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 msgr2=0x7faaf4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab0ad41700 1 --2- 172.21.15.27:0/1597256673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7faaf4005000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faafc00e240 tx=0x7faafc00b040).stop 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab092de700 1 -- 172.21.15.27:0/1597256673 reap_dead start 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab0ad41700 1 -- 172.21.15.27:0/1597256673 shutdown_connections 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab0ad41700 1 -- 172.21.15.27:0/1597256673 >> 172.21.15.27:0/1597256673 conn(0x7fab0405e820 msgr2=0x7fab040cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab0ad41700 1 -- 172.21.15.27:0/1597256673 shutdown_connections 2023-05-17T15:05:33.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.401+0000 7fab0ad41700 1 -- 172.21.15.27:0/1597256673 wait complete. 2023-05-17T15:05:33.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.402+0000 7fab0ad41700 1 Processor -- start 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.402+0000 7fab0ad41700 1 -- start start 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7fab0414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab040add70 0x7fab041587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040ae1f0 0x7fab04158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab041591a0 con 0x7faaf4004b80 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab041577b0 con 0x7fab040add70 2023-05-17T15:05:33.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab04158330 con 0x7fab040ae1f0 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7fab0414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7fab0414a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36504/0 (socket says 172.21.15.27:36504) 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 -- 172.21.15.27:0/2593006291 learned_addr learned my addr 172.21.15.27:0/2593006291 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab03fff700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab040add70 0x7fab041587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab092de700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040ae1f0 0x7fab04158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 -- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040ae1f0 msgr2=0x7fab04158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:33.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040ae1f0 0x7fab04158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 -- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab040add70 msgr2=0x7fab041587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab040add70 0x7fab041587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 -- 172.21.15.27:0/2593006291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0414a650 con 0x7faaf4004b80 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab08add700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7fab0414a160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7faaf8004760 tx=0x7faaf8001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011590 con 0x7faaf4004b80 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf80116f0 con 0x7faaf4004b80 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011a90 con 0x7faaf4004b80 2023-05-17T15:05:33.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab04157a00 con 0x7faaf4004b80 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.403+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab04157fc0 con 0x7faaf4004b80 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.404+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0406bdf0 con 0x7faaf4004b80 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.405+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7faaf801c360 con 0x7faaf4004b80 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.405+0000 7fab00ff9700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faae805ee40 0x7faae8061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.405+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7050+0+0 (secure 0 0 0) 0x7faaf80796d0 con 0x7faaf4004b80 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.405+0000 7fab03fff700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faae805ee40 0x7faae8061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.405+0000 7fab03fff700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faae805ee40 0x7faae8061300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fab041594c0 tx=0x7faaf0009060).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:33.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.409+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faaf80498f0 con 0x7faaf4004b80 2023-05-17T15:05:33.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.603+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fab040c0fc0 con 0x7faae805ee40 2023-05-17T15:05:33.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.607+0000 7fab00ff9700 1 -- 172.21.15.27:0/2593006291 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fab040c0fc0 con 0x7faae805ee40 2023-05-17T15:05:33.611 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-05-17T15:05:33.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.608+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faae805ee40 msgr2=0x7faae8061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:33.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.608+0000 7fab0ad41700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faae805ee40 0x7faae8061300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fab041594c0 tx=0x7faaf0009060).stop 2023-05-17T15:05:33.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.608+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 msgr2=0x7fab0414a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.608+0000 7fab0ad41700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7fab0414a160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7faaf8004760 tx=0x7faaf8001e90).stop 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 shutdown_connections 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faae805ee40 0x7faae8061300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab040ae1f0 0x7fab04158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faaf4004b80 0x7fab0414a160 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 --2- 172.21.15.27:0/2593006291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab040add70 0x7fab041587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 >> 172.21.15.27:0/2593006291 conn(0x7fab0405e820 msgr2=0x7fab040c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:33.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 shutdown_connections 2023-05-17T15:05:33.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:33.609+0000 7fab0ad41700 1 -- 172.21.15.27:0/2593006291 wait complete. 2023-05-17T15:05:33.625 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-05-17T15:05:33.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.625 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-05-17T15:05:33.640 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:33.640 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:33.641 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:33.642 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:33.642 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:33.642 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:33.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.643 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:33.704 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:33.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.705 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:33.765 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:33.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.766 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:33.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:33.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.827 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:33.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:33.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.900 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:33.961 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:33.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:33.962 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:34.022 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:34.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.023 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:34.085 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:34.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.085 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:34.146 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:34.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.147 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:34.209 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:34.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.210 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:34.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:34.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.272 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:34.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.335 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-05-17T15:05:34.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-05-17T15:05:34.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.549+0000 7f761b37d700 1 Processor -- start 2023-05-17T15:05:34.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.549+0000 7f761b37d700 1 -- start start 2023-05-17T15:05:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f761b37d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7614063a50 0x7f7614158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f761b37d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76140c3820 con 0x7f7614062280 2023-05-17T15:05:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f761b37d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76140c18e0 con 0x7f7614151010 2023-05-17T15:05:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f761b37d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76140c1bc0 con 0x7f7614063a50 2023-05-17T15:05:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f7618918700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7614063a50 0x7f7614158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:34.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f761991a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7614062280 0x7f761415b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36076/0 (socket says 172.21.15.27:36076) 2023-05-17T15:05:34.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f761991a700 1 -- 172.21.15.27:0/3909579527 learned_addr learned my addr 172.21.15.27:0/3909579527 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.550+0000 7f7618918700 1 -- 172.21.15.27:0/3909579527 >> v1:172.21.15.40:6789/0 conn(0x7f7614151010 legacy=0x7f7614063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7618918700 1 -- 172.21.15.27:0/3909579527 >> v1:172.21.15.27:6789/0 conn(0x7f7614062280 legacy=0x7f761415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7613fff700 1 -- 172.21.15.27:0/3909579527 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89258922 0 0) 0x7f76140c3820 con 0x7f7614062280 2023-05-17T15:05:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7618918700 1 -- 172.21.15.27:0/3909579527 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140c1ea0 con 0x7f7614063a50 2023-05-17T15:05:34.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7618918700 1 --2- 172.21.15.27:0/3909579527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614063a50 0x7f7614158c70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f7608009760 tx=0x7f7608009060).ready entity=mon.0 client_cookie=908afcefe79e4d2f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7613fff700 1 -- 172.21.15.27:0/3909579527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608009120 con 0x7f7614063a50 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7613fff700 1 -- 172.21.15.27:0/3909579527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800b580 con 0x7f7614063a50 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f7613fff700 1 -- 172.21.15.27:0/3909579527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800b900 con 0x7f7614063a50 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 -- 172.21.15.27:0/3909579527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614063a50 msgr2=0x7f7614158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 --2- 172.21.15.27:0/3909579527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614063a50 0x7f7614158c70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f7608009760 tx=0x7f7608009060).stop 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 -- 172.21.15.27:0/3909579527 shutdown_connections 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 --2- 172.21.15.27:0/3909579527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614063a50 0x7f7614158c70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:34.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 -- 172.21.15.27:0/3909579527 >> 172.21.15.27:0/3909579527 conn(0x7f7614068740 msgr2=0x7f76140c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:34.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 -- 172.21.15.27:0/3909579527 shutdown_connections 2023-05-17T15:05:34.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.551+0000 7f761b37d700 1 -- 172.21.15.27:0/3909579527 wait complete. 2023-05-17T15:05:34.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.552+0000 7f761b37d700 1 Processor -- start 2023-05-17T15:05:34.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 -- start start 2023-05-17T15:05:34.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7614062280 0x7f76140a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:34.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7614063a50 0x7f7614161d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:34.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 0x7f76140a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:34.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614162230 con 0x7f7614151010 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614141930 con 0x7f7614063a50 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761b37d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140a0980 con 0x7f7614062280 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.553+0000 7f761991a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 0x7f76140a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 0x7f76140a3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36520/0 (socket says 172.21.15.27:36520) 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 -- 172.21.15.27:0/1887905794 learned_addr learned my addr 172.21.15.27:0/1887905794 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f7618918700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7614063a50 0x7f7614161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 -- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7614062280 msgr2=0x7f76140a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:34.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7614062280 0x7f76140a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 -- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7614063a50 msgr2=0x7f7614161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7614063a50 0x7f7614161d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 -- 172.21.15.27:0/1887905794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080092a0 con 0x7f7614151010 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761991a700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 0x7f76140a3730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f760400c790 tx=0x7f7604007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604005d30 con 0x7f7614151010 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604007110 con 0x7f7614151010 2023-05-17T15:05:34.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76140a1500 con 0x7f7614151010 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040074d0 con 0x7f7614151010 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.554+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76140a0eb0 con 0x7f7614151010 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.555+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761406a970 con 0x7f7614151010 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.555+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f7604010030 con 0x7f7614151010 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.556+0000 7f76117fa700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f760005ee70 0x7f7600061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.556+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7018+0+0 (secure 0 0 0) 0x7f7604079ed0 con 0x7f7614151010 2023-05-17T15:05:34.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.556+0000 7f7619119700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f760005ee70 0x7f7600061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:34.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.556+0000 7f7619119700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f760005ee70 0x7f7600061330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f760c001470 tx=0x7f760c0079c0).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:34.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.560+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f760404b0d0 con 0x7f7614151010 2023-05-17T15:05:34.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.773+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f761406bdf0 con 0x7f760005ee70 2023-05-17T15:05:34.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.776+0000 7f76117fa700 1 -- 172.21.15.27:0/1887905794 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f761406bdf0 con 0x7f760005ee70 2023-05-17T15:05:34.781 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-05-17T15:05:34.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f760005ee70 msgr2=0x7f7600061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:34.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f760005ee70 0x7f7600061330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f760c001470 tx=0x7f760c0079c0).stop 2023-05-17T15:05:34.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 msgr2=0x7f76140a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:34.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 0x7f76140a3730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f760400c790 tx=0x7f7604007f30).stop 2023-05-17T15:05:34.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 shutdown_connections 2023-05-17T15:05:34.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f760005ee70 0x7f7600061330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:34.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7614151010 0x7f76140a3730 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:34.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7614062280 0x7f76140a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:34.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 --2- 172.21.15.27:0/1887905794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7614063a50 0x7f7614161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:34.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 >> 172.21.15.27:0/1887905794 conn(0x7f7614068740 msgr2=0x7f76140c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:34.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 shutdown_connections 2023-05-17T15:05:34.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:34.778+0000 7f761b37d700 1 -- 172.21.15.27:0/1887905794 wait complete. 2023-05-17T15:05:34.794 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-05-17T15:05:34.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.795 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-05-17T15:05:34.810 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:34.811 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:34.812 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:34.812 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:34.812 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:34.812 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:34.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.813 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:34.878 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:34.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.880 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:34.948 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:34.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:34.949 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:35.009 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:35.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.010 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:35.071 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:35.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.073 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:35.133 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:35.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.134 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:35.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:35.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.197 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:35.259 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:35.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.260 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:35.322 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:35.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.323 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:35.385 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:35.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.385 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:35.447 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:35.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.448 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:35.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.511 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-05-17T15:05:35.570 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-05-17T15:05:35.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.744+0000 7f914d015700 1 Processor -- start 2023-05-17T15:05:35.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.744+0000 7f914d015700 1 -- start start 2023-05-17T15:05:35.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f914d015700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9148151c90 0x7f9148152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:35.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f914d015700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91480c0520 0x7f9148081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:35.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f914d015700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9148158010 con 0x7f9148154980 2023-05-17T15:05:35.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f914d015700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9148154f60 con 0x7f9148151c90 2023-05-17T15:05:35.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f914d015700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9148155240 con 0x7f91480c0520 2023-05-17T15:05:35.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9148151c90 0x7f9148152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:35.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9148151c90 0x7f9148152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36524/0 (socket says 172.21.15.27:36524) 2023-05-17T15:05:35.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 -- 172.21.15.27:0/393521878 learned_addr learned my addr 172.21.15.27:0/393521878 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:35.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f914759e700 1 --2- 172.21.15.27:0/393521878 >> v2:172.21.15.40:3300/0 conn(0x7f91480c0520 0x7f9148081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:35.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 -- 172.21.15.27:0/393521878 >> v2:172.21.15.40:3300/0 conn(0x7f91480c0520 msgr2=0x7f9148081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:35.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 --2- 172.21.15.27:0/393521878 >> v2:172.21.15.40:3300/0 conn(0x7f91480c0520 0x7f9148081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 -- 172.21.15.27:0/393521878 >> v1:172.21.15.40:6789/0 conn(0x7f9148154980 legacy=0x7f91480c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:35.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 -- 172.21.15.27:0/393521878 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148155520 con 0x7f9148151c90 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.745+0000 7f9146d9d700 1 --2- 172.21.15.27:0/393521878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f9148152070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9148068a80 tx=0x7f91400090f0).ready entity=mon.0 client_cookie=edcf8a3771bc209d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f9145d9b700 1 -- 172.21.15.27:0/393521878 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914000b600 con 0x7f9148151c90 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f9145d9b700 1 -- 172.21.15.27:0/393521878 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914000b760 con 0x7f9148151c90 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f9145d9b700 1 -- 172.21.15.27:0/393521878 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914000bae0 con 0x7f9148151c90 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 -- 172.21.15.27:0/393521878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 msgr2=0x7f9148152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 --2- 172.21.15.27:0/393521878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f9148152070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9148068a80 tx=0x7f91400090f0).stop 2023-05-17T15:05:35.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 -- 172.21.15.27:0/393521878 shutdown_connections 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 --2- 172.21.15.27:0/393521878 >> v2:172.21.15.40:3300/0 conn(0x7f91480c0520 0x7f9148081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 --2- 172.21.15.27:0/393521878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f9148152070 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 -- 172.21.15.27:0/393521878 >> 172.21.15.27:0/393521878 conn(0x7f91480cae10 msgr2=0x7f91480cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 -- 172.21.15.27:0/393521878 shutdown_connections 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.746+0000 7f914d015700 1 -- 172.21.15.27:0/393521878 wait complete. 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.747+0000 7f914d015700 1 Processor -- start 2023-05-17T15:05:35.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.747+0000 7f914d015700 1 -- start start 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914d015700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91480c0520 0x7f9148150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914d015700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f91480af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914d015700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9148154980 0x7f91480ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914d015700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91481510f0 con 0x7f9148151c90 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914d015700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480c3f00 con 0x7f9148154980 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914d015700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91480c41e0 con 0x7f91480c0520 2023-05-17T15:05:35.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f91480af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f91480af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36534/0 (socket says 172.21.15.27:36534) 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914659c700 1 -- 172.21.15.27:0/3471486045 learned_addr learned my addr 172.21.15.27:0/3471486045 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f9146d9d700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91480c0520 0x7f9148150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914759e700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9148154980 0x7f91480ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914659c700 1 -- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91480c0520 msgr2=0x7f9148150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.748+0000 7f914659c700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91480c0520 0x7f9148150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f914659c700 1 -- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9148154980 msgr2=0x7f91480ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f914659c700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9148154980 0x7f91480ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f914659c700 1 -- 172.21.15.27:0/3471486045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009370 con 0x7f9148151c90 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f914659c700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f91480af420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f913000c440 tx=0x7f9130007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130007020 con 0x7f9148151c90 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130007180 con 0x7f9148151c90 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91480c44c0 con 0x7f9148151c90 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130007520 con 0x7f9148151c90 2023-05-17T15:05:35.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.749+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91480c4a80 con 0x7f9148151c90 2023-05-17T15:05:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.750+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914806bdf0 con 0x7f9148151c90 2023-05-17T15:05:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.750+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f9130010070 con 0x7f9148151c90 2023-05-17T15:05:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.750+0000 7f913effd700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f912805ee70 0x7f9128061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.751+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7034+0+0 (secure 0 0 0) 0x7f9130079170 con 0x7f9148151c90 2023-05-17T15:05:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.751+0000 7f9146d9d700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f912805ee70 0x7f9128061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:35.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.751+0000 7f9146d9d700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f912805ee70 0x7f9128061330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9140009130 tx=0x7f9140017000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:35.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.755+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91300478f0 con 0x7f9148151c90 2023-05-17T15:05:35.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.952+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f91480468f0 con 0x7f912805ee70 2023-05-17T15:05:35.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.956+0000 7f913effd700 1 -- 172.21.15.27:0/3471486045 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f91480468f0 con 0x7f912805ee70 2023-05-17T15:05:35.963 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-05-17T15:05:35.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.959+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f912805ee70 msgr2=0x7f9128061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.959+0000 7f914d015700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f912805ee70 0x7f9128061330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9140009130 tx=0x7f9140017000).stop 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.959+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 msgr2=0x7f91480af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.959+0000 7f914d015700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f91480af420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f913000c440 tx=0x7f9130007e00).stop 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 shutdown_connections 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f912805ee70 0x7f9128061330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9148154980 0x7f91480ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91480c0520 0x7f9148150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 --2- 172.21.15.27:0/3471486045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9148151c90 0x7f91480af420 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:35.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 >> 172.21.15.27:0/3471486045 conn(0x7f91480cae10 msgr2=0x7f91480c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:35.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 shutdown_connections 2023-05-17T15:05:35.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:35.960+0000 7f914d015700 1 -- 172.21.15.27:0/3471486045 wait complete. 2023-05-17T15:05:35.980 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-05-17T15:05:35.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.981 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-05-17T15:05:35.996 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:35.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:35.998 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:35.998 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:35.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:35.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:35.999 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:36.073 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:36.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.074 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:36.134 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:36.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.135 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:36.195 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:36.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.196 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:36.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:36.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.257 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:36.318 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:36.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.319 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:36.379 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:36.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.380 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:36.442 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:36.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.443 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:36.504 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:36.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.505 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:36.565 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:36.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.566 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:36.645 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:36.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.646 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:36.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:36.718 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-05-17T15:05:36.777 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-05-17T15:05:36.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.951+0000 7fdc8b49d700 1 Processor -- start 2023-05-17T15:05:36.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.951+0000 7fdc8b49d700 1 -- start start 2023-05-17T15:05:36.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc8b49d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc840c0420 0x7fdc84081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc8b49d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840c1610 con 0x7fdc840824c0 2023-05-17T15:05:36.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc8b49d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840828f0 con 0x7fdc84153fa0 2023-05-17T15:05:36.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc8b49d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc840c0a00 con 0x7fdc840c0420 2023-05-17T15:05:36.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc89a3a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdc840824c0 0x7fdc840aae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36102/0 (socket says 172.21.15.27:36102) 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc89a3a700 1 -- 172.21.15.27:0/1932985963 learned_addr learned my addr 172.21.15.27:0/1932985963 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc88a38700 1 --2- 172.21.15.27:0/1932985963 >> v2:172.21.15.40:3300/0 conn(0x7fdc840c0420 0x7fdc84081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126925375 0 0) 0x7fdc840c1610 con 0x7fdc840824c0 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6c0033f0 con 0x7fdc840824c0 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532214395 0 0) 0x7fdc6c0033f0 con 0x7fdc840824c0 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 >> v2:172.21.15.40:3300/0 conn(0x7fdc840c0420 msgr2=0x7fdc84081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:36.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 --2- 172.21.15.27:0/1932985963 >> v2:172.21.15.40:3300/0 conn(0x7fdc840c0420 0x7fdc84081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 >> v1:172.21.15.40:6789/0 conn(0x7fdc84153fa0 legacy=0x7fdc840aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.952+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840c0ce0 con 0x7fdc840824c0 2023-05-17T15:05:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fdc740017f0 con 0x7fdc840824c0 2023-05-17T15:05:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 >> v1:172.21.15.27:6789/0 conn(0x7fdc840824c0 legacy=0x7fdc840aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc6c0038e0 0x7fdc6c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c004690 0x7fdc6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc6c005050 0x7fdc6c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c0a00 con 0x7fdc6c0038e0 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c00bfe0 con 0x7fdc6c004690 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c00c1a0 con 0x7fdc6c005050 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc88a38700 1 --2- 172.21.15.27:0/1932985963 >> v2:172.21.15.40:3300/0 conn(0x7fdc840c0420 0x7fdc84081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc6c0038e0 0x7fdc6c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89a3a700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc6c005050 0x7fdc6c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc88a38700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c004690 0x7fdc6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 -- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc6c005050 msgr2=0x7fdc6c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc6c005050 0x7fdc6c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 -- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c004690 msgr2=0x7fdc6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c004690 0x7fdc6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 -- 172.21.15.27:0/1932985963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0033f0 con 0x7fdc6c0038e0 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89a3a700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc6c005050 0x7fdc6c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89a3a700 1 -- 172.21.15.27:0/1932985963 reap_dead start 2023-05-17T15:05:36.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc89239700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc6c0038e0 0x7fdc6c003d00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fdc7c001700 tx=0x7fdc7c007bb0).ready entity=mon.0 client_cookie=29357c314803a6bb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:36.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c007020 con 0x7fdc6c0038e0 2023-05-17T15:05:36.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c007180 con 0x7fdc6c0038e0 2023-05-17T15:05:36.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.953+0000 7fdc83fff700 1 -- 172.21.15.27:0/1932985963 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c007520 con 0x7fdc6c0038e0 2023-05-17T15:05:36.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 -- 172.21.15.27:0/1932985963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc6c0038e0 msgr2=0x7fdc6c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:36.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc6c0038e0 0x7fdc6c003d00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fdc7c001700 tx=0x7fdc7c007bb0).stop 2023-05-17T15:05:36.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 -- 172.21.15.27:0/1932985963 shutdown_connections 2023-05-17T15:05:36.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/1932985963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc6c0038e0 0x7fdc6c003d00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:36.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 -- 172.21.15.27:0/1932985963 >> 172.21.15.27:0/1932985963 conn(0x7fdc8405e820 msgr2=0x7fdc840cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:36.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 -- 172.21.15.27:0/1932985963 shutdown_connections 2023-05-17T15:05:36.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.954+0000 7fdc8b49d700 1 -- 172.21.15.27:0/1932985963 wait complete. 2023-05-17T15:05:36.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.955+0000 7fdc8b49d700 1 Processor -- start 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.955+0000 7fdc8b49d700 1 -- start start 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc8b49d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c0038e0 0x7fdc840b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc8b49d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 0x7fdc8413bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc8b49d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc840ca600 0x7fdc840caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc8b49d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c2a20 con 0x7fdc8414ff70 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc8b49d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840caf70 con 0x7fdc6c0038e0 2023-05-17T15:05:36.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc8b49d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841503f0 con 0x7fdc840ca600 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 0x7fdc8413bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 0x7fdc8413bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36552/0 (socket says 172.21.15.27:36552) 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 -- 172.21.15.27:0/2371413817 learned_addr learned my addr 172.21.15.27:0/2371413817 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc89239700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c0038e0 0x7fdc840b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc89a3a700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc840ca600 0x7fdc840caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 -- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc840ca600 msgr2=0x7fdc840caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc840ca600 0x7fdc840caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 -- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c0038e0 msgr2=0x7fdc840b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c0038e0 0x7fdc840b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 -- 172.21.15.27:0/2371413817 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840b0b90 con 0x7fdc8414ff70 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc89239700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c0038e0 0x7fdc840b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc89a3a700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc840ca600 0x7fdc840caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.956+0000 7fdc88a38700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 0x7fdc8413bf40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fdc780119c0 tx=0x7fdc78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.957+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800f8e0 con 0x7fdc8414ff70 2023-05-17T15:05:36.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.957+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7800fa40 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.957+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840c23d0 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.957+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800fdc0 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.957+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8413c430 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.958+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8406bdf0 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.958+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fdc78025070 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.958+0000 7fdc817fa700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdc7005ee70 0x7fdc70061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.958+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fdc7807a7d0 con 0x7fdc8414ff70 2023-05-17T15:05:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.958+0000 7fdc89239700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdc7005ee70 0x7fdc70061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.959+0000 7fdc89239700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdc7005ee70 0x7fdc70061330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fdc7c001510 tx=0x7fdc7c016000).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:36.963+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdc7804b990 con 0x7fdc8414ff70 2023-05-17T15:05:37.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.161+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc840c2250 con 0x7fdc7005ee70 2023-05-17T15:05:37.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.164+0000 7fdc817fa700 1 -- 172.21.15.27:0/2371413817 <== mgr.5136 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fdc7c007950 con 0x7fdc7005ee70 2023-05-17T15:05:37.173 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-05-17T15:05:37.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdc7005ee70 msgr2=0x7fdc70061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:37.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdc7005ee70 0x7fdc70061330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fdc7c001510 tx=0x7fdc7c016000).stop 2023-05-17T15:05:37.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 msgr2=0x7fdc8413bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:37.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 0x7fdc8413bf40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fdc780119c0 tx=0x7fdc78008040).stop 2023-05-17T15:05:37.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 shutdown_connections 2023-05-17T15:05:37.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fdc7005ee70 0x7fdc70061330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:37.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc840ca600 0x7fdc840caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:37.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc6c0038e0 0x7fdc840b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:37.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 --2- 172.21.15.27:0/2371413817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc8414ff70 0x7fdc8413bf40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:37.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 >> 172.21.15.27:0/2371413817 conn(0x7fdc8405e820 msgr2=0x7fdc840c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:37.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.170+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 shutdown_connections 2023-05-17T15:05:37.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:37.171+0000 7fdc8b49d700 1 -- 172.21.15.27:0/2371413817 wait complete. 2023-05-17T15:05:37.193 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-05-17T15:05:37.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.194 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-05-17T15:05:37.209 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:37.209 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:37.210 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:37.211 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:37.211 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_55_00_UTC 2023-05-17T15:05:37.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.211 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_55_00_UTC) 2023-05-17T15:05:37.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_56_00_UTC 2023-05-17T15:05:37.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.272 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_56_00_UTC) 2023-05-17T15:05:37.332 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_57_00_UTC 2023-05-17T15:05:37.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.333 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_57_00_UTC) 2023-05-17T15:05:37.393 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_58_00_UTC 2023-05-17T15:05:37.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.394 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_58_00_UTC) 2023-05-17T15:05:37.455 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_59_00_UTC 2023-05-17T15:05:37.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.456 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-14_59_00_UTC) 2023-05-17T15:05:37.516 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_00_00_UTC 2023-05-17T15:05:37.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.517 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_00_00_UTC) 2023-05-17T15:05:37.578 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_01_00_UTC 2023-05-17T15:05:37.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.579 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_01_00_UTC) 2023-05-17T15:05:37.666 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_02_00_UTC 2023-05-17T15:05:37.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.667 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_02_00_UTC) 2023-05-17T15:05:37.696 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_03_00_UTC 2023-05-17T15:05:37.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.698 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_03_00_UTC) 2023-05-17T15:05:37.776 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_04_00_UTC 2023-05-17T15:05:37.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.777 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_04_00_UTC) 2023-05-17T15:05:37.837 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_05_00_UTC 2023-05-17T15:05:37.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.838 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-17-15_05_00_UTC) 2023-05-17T15:05:37.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:37.899 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-05-17T15:05:37.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:05:38.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.109+0000 7f7c3359e700 1 Processor -- start 2023-05-17T15:05:38.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.109+0000 7f7c3359e700 1 -- start start 2023-05-17T15:05:38.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c3359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c340acdb0 0x7f7c340ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:38.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c3359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c34154e90 0x7f7c340c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:38.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c3359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340c6240 con 0x7f7c340c5db0 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c3359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34155310 con 0x7f7c34154e90 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c3359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34157de0 con 0x7f7c340acdb0 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c34154e90 0x7f7c340c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c34154e90 0x7f7c340c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36558/0 (socket says 172.21.15.27:36558) 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 -- 172.21.15.27:0/2085874844 learned_addr learned my addr 172.21.15.27:0/2085874844 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c3259c700 1 --2- 172.21.15.27:0/2085874844 >> v2:172.21.15.40:3300/0 conn(0x7f7c340acdb0 0x7f7c340ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 -- 172.21.15.27:0/2085874844 >> v2:172.21.15.40:3300/0 conn(0x7f7c340acdb0 msgr2=0x7f7c340ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 --2- 172.21.15.27:0/2085874844 >> v2:172.21.15.40:3300/0 conn(0x7f7c340acdb0 0x7f7c340ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 -- 172.21.15.27:0/2085874844 >> v1:172.21.15.40:6789/0 conn(0x7f7c340c5db0 legacy=0x7f7c340a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 -- 172.21.15.27:0/2085874844 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c341580c0 con 0x7f7c34154e90 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.110+0000 7f7c31d9b700 1 --2- 172.21.15.27:0/2085874844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c340c58c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7c340c81e0 tx=0x7f7c1c0090f0).ready entity=mon.0 client_cookie=8ca0b1b7e166e2fb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3159a700 1 -- 172.21.15.27:0/2085874844 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00b600 con 0x7f7c34154e90 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3159a700 1 -- 172.21.15.27:0/2085874844 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00b760 con 0x7f7c34154e90 2023-05-17T15:05:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3159a700 1 -- 172.21.15.27:0/2085874844 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00bae0 con 0x7f7c34154e90 2023-05-17T15:05:38.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 -- 172.21.15.27:0/2085874844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 msgr2=0x7f7c340c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:38.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 --2- 172.21.15.27:0/2085874844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c340c58c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7c340c81e0 tx=0x7f7c1c0090f0).stop 2023-05-17T15:05:38.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 -- 172.21.15.27:0/2085874844 shutdown_connections 2023-05-17T15:05:38.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 --2- 172.21.15.27:0/2085874844 >> v2:172.21.15.40:3300/0 conn(0x7f7c340acdb0 0x7f7c340ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 --2- 172.21.15.27:0/2085874844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c340c58c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 -- 172.21.15.27:0/2085874844 >> 172.21.15.27:0/2085874844 conn(0x7f7c3405dd50 msgr2=0x7f7c3405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:38.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 -- 172.21.15.27:0/2085874844 shutdown_connections 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.111+0000 7f7c3359e700 1 -- 172.21.15.27:0/2085874844 wait complete. 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.112+0000 7f7c3359e700 1 Processor -- start 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.112+0000 7f7c3359e700 1 -- start start 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c340acdb0 0x7f7c340b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c340c5db0 0x7f7c340ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c34163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:38.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340aeb10 con 0x7f7c34154e90 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c1bd0 con 0x7f7c340acdb0 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c1eb0 con 0x7f7c340c5db0 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c34163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c34163f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36568/0 (socket says 172.21.15.27:36568) 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 -- 172.21.15.27:0/54766716 learned_addr learned my addr 172.21.15.27:0/54766716 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c3259c700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c340acdb0 0x7f7c340b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:38.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c31d9b700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c340c5db0 0x7f7c340ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 -- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c340c5db0 msgr2=0x7f7c340ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c340c5db0 0x7f7c340ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 -- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c340acdb0 msgr2=0x7f7c340b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c340acdb0 0x7f7c340b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.113+0000 7f7c32d9d700 1 -- 172.21.15.27:0/54766716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009370 con 0x7f7c34154e90 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.114+0000 7f7c32d9d700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c34163f90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7c2400c440 tx=0x7f7c24007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.114+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240123f0 con 0x7f7c34154e90 2023-05-17T15:05:38.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.114+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24001e90 con 0x7f7c34154e90 2023-05-17T15:05:38.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.114+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340c2190 con 0x7f7c34154e90 2023-05-17T15:05:38.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.114+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24012760 con 0x7f7c34154e90 2023-05-17T15:05:38.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.114+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340ae820 con 0x7f7c34154e90 2023-05-17T15:05:38.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.115+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340c6b20 con 0x7f7c34154e90 2023-05-17T15:05:38.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.115+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f7c24010070 con 0x7f7c34154e90 2023-05-17T15:05:38.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.115+0000 7f7c2a7fc700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c1405ee70 0x7f7c14061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:38.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.115+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f7c24079060 con 0x7f7c34154e90 2023-05-17T15:05:38.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.115+0000 7f7c3259c700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c1405ee70 0x7f7c14061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:38.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.116+0000 7f7c3259c700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c1405ee70 0x7f7c14061330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7c2c007640 tx=0x7f7c2c009850).ready entity=mgr.5136 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:38.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.120+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c240478f0 con 0x7f7c34154e90 2023-05-17T15:05:38.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.336+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f7c34047150 con 0x7f7c34154e90 2023-05-17T15:05:38.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.841+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7c24076b80 con 0x7f7c34154e90 2023-05-17T15:05:38.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.843+0000 7f7c2a7fc700 1 -- 172.21.15.27:0/54766716 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7c240734b0 con 0x7f7c34154e90 2023-05-17T15:05:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c1405ee70 msgr2=0x7f7c14061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c1405ee70 0x7f7c14061330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7c2c007640 tx=0x7f7c2c009850).stop 2023-05-17T15:05:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 msgr2=0x7f7c34163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c34163f90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7c2400c440 tx=0x7f7c24007d70).stop 2023-05-17T15:05:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 shutdown_connections 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c1405ee70 0x7f7c14061330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c34154e90 0x7f7c34163f90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c340acdb0 0x7f7c340b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 --2- 172.21.15.27:0/54766716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c340c5db0 0x7f7c340ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 >> 172.21.15.27:0/54766716 conn(0x7f7c3405dd50 msgr2=0x7f7c34149a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 shutdown_connections 2023-05-17T15:05:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:38.845+0000 7f7c3359e700 1 -- 172.21.15.27:0/54766716 wait complete. 2023-05-17T15:05:38.863 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:05:38.864 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:05:38.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:05:38.926 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:05:38.926 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:05:38.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:05:38.927 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:05:39.012 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:39.007+0000 7fc792564680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:05:39.014 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:39.010+0000 7ff48abfe680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:05:39.078 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:39.073+0000 7fc792564680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:05:39.081 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:39.077+0000 7ff48abfe680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:05:39.361 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:39.356+0000 7fc792564680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:05:39.365 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:39.361+0000 7ff48abfe680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:05:40.033 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:40.028+0000 7fc792564680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:05:40.042 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:40.038+0000 7ff48abfe680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:05:40.100 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:40.096+0000 7fc792564680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:05:40.109 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:40.106+0000 7ff48abfe680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:05:40.300 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:40.295+0000 7fc792564680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:05:40.304 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:40.301+0000 7ff48abfe680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:05:40.738 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:40.734+0000 7fc792564680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:05:40.748 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:40.745+0000 7ff48abfe680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:05:40.846 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:40.841+0000 7fc792564680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:05:40.856 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:40.853+0000 7ff48abfe680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:05:41.003 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:40.998+0000 7fc792564680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:05:41.013 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:41.010+0000 7ff48abfe680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:05:41.080 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:41.075+0000 7fc792564680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:05:41.090 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:41.087+0000 7ff48abfe680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:05:41.149 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:41.144+0000 7fc792564680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:05:41.160 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:41.156+0000 7ff48abfe680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:05:41.420 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:41.415+0000 7fc792564680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:05:41.429 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:41.426+0000 7ff48abfe680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:05:41.609 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:41.605+0000 7fc792564680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:05:41.618 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:41.614+0000 7ff48abfe680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:05:41.864 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:05:41.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:05:41.865 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:05:41.881 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:05:42.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.036+0000 7f2cb40c5700 1 Processor -- start 2023-05-17T15:05:42.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.036+0000 7f2cb40c5700 1 -- start start 2023-05-17T15:05:42.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb40c5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2cac0c60c0 0x7f2cac0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb40c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0aa3b0 0x7f2cac0c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb40c5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac05e7e0 con 0x7f2cac0a9f70 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb40c5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac05eac0 con 0x7f2cac0c60c0 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb40c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0bfd70 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb1e61700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2cac0c60c0 0x7f2cac0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb1660700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2cac0a9f70 0x7f2cac153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36270/0 (socket says 172.21.15.27:36270) 2023-05-17T15:05:42.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb1660700 1 -- 172.21.15.27:0/1369432800 learned_addr learned my addr 172.21.15.27:0/1369432800 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.037+0000 7f2cb2662700 1 --2- 172.21.15.27:0/1369432800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0aa3b0 0x7f2cac0c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb1e61700 1 -- 172.21.15.27:0/1369432800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0aa3b0 msgr2=0x7f2cac0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb1e61700 1 --2- 172.21.15.27:0/1369432800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0aa3b0 0x7f2cac0c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb1e61700 1 -- 172.21.15.27:0/1369432800 >> v1:172.21.15.27:6789/0 conn(0x7f2cac0a9f70 legacy=0x7f2cac153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb0e5f700 1 -- 172.21.15.27:0/1369432800 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507630264 0 0) 0x7f2cac05e7e0 con 0x7f2cac0a9f70 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb1e61700 1 -- 172.21.15.27:0/1369432800 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac0c0050 con 0x7f2cac0c60c0 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb1e61700 1 --2- 172.21.15.27:0/1369432800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0c60c0 0x7f2cac0c64a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f2ca8009760 tx=0x7f2ca8009060).ready entity=mon.0 client_cookie=cb4bc298087d68f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:42.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb0e5f700 1 -- 172.21.15.27:0/1369432800 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800b580 con 0x7f2cac0c60c0 2023-05-17T15:05:42.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb0e5f700 1 -- 172.21.15.27:0/1369432800 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca800b6e0 con 0x7f2cac0c60c0 2023-05-17T15:05:42.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb0e5f700 1 -- 172.21.15.27:0/1369432800 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800ba60 con 0x7f2cac0c60c0 2023-05-17T15:05:42.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1369432800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0c60c0 msgr2=0x7f2cac0c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.038+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1369432800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0c60c0 0x7f2cac0c64a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f2ca8009760 tx=0x7f2ca8009060).stop 2023-05-17T15:05:42.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.039+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1369432800 shutdown_connections 2023-05-17T15:05:42.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.039+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1369432800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0aa3b0 0x7f2cac0c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.039+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1369432800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0c60c0 0x7f2cac0c64a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.039+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1369432800 >> 172.21.15.27:0/1369432800 conn(0x7f2cac069e70 msgr2=0x7f2cac05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.039+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1369432800 shutdown_connections 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.039+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1369432800 wait complete. 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.040+0000 7f2cb40c5700 1 Processor -- start 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.040+0000 7f2cb40c5700 1 -- start start 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cac0a9f70 0x7f2cac0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 0x7f2cac14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0c60c0 0x7f2cac154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0c8b80 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0c93e0 con 0x7f2cac0a9f70 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac154d80 con 0x7f2cac0c60c0 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 0x7f2cac14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 0x7f2cac14d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36712/0 (socket says 172.21.15.27:36712) 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 -- 172.21.15.27:0/1032957308 learned_addr learned my addr 172.21.15.27:0/1032957308 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1e61700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cac0a9f70 0x7f2cac0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb2662700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0c60c0 0x7f2cac154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 -- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0c60c0 msgr2=0x7f2cac154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0c60c0 0x7f2cac154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 -- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cac0a9f70 msgr2=0x7f2cac0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cac0a9f70 0x7f2cac0cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 -- 172.21.15.27:0/1032957308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80092a0 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb1660700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 0x7f2cac14d580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f2ca000c4e0 tx=0x7f2ca0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000ce90 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca00072e0 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac0c8d90 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.041+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0007660 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.042+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac154a00 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.042+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac0c9570 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.043+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2ca0010070 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.044+0000 7f2c9dffb700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 0x7f2c900612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.044+0000 7f2cb1e61700 1 -- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 msgr2=0x7f2c900612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:05:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.044+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7366+0+0 (secure 0 0 0) 0x7f2ca0079da0 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.044+0000 7f2cb1e61700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 0x7f2c900612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:05:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.047+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ca004adb0 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.245+0000 7f2cb1e61700 1 -- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 msgr2=0x7f2c900612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:05:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.245+0000 7f2cb1e61700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 0x7f2c900612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:05:42.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.265+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cac05f4a0 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.265+0000 7f2c9dffb700 1 -- 172.21.15.27:0/1032957308 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4480 (secure 0 0 0) 0x7f2ca004e3d0 con 0x7f2cac0aa3b0 2023-05-17T15:05:42.269 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:42.269 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:54:39.094710+0000","modified":"2023-05-17T14:54:42.101891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6836/149717180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":149717180},{"type":"v1","addr":"172.21.15.27:6836","nonce":149717180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-17T15:05:42.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.267+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 msgr2=0x7f2c900612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:05:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.267+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 0x7f2c900612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 msgr2=0x7f2cac14d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 0x7f2cac14d580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f2ca000c4e0 tx=0x7f2ca0007c70).stop 2023-05-17T15:05:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 shutdown_connections 2023-05-17T15:05:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2c9005edf0 0x7f2c900612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cac0c60c0 0x7f2cac154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cac0a9f70 0x7f2cac0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 --2- 172.21.15.27:0/1032957308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cac0aa3b0 0x7f2cac14d580 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 >> 172.21.15.27:0/1032957308 conn(0x7f2cac069e70 msgr2=0x7f2cac0b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 shutdown_connections 2023-05-17T15:05:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.268+0000 7f2cb40c5700 1 -- 172.21.15.27:0/1032957308 wait complete. 2023-05-17T15:05:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2023-05-17T15:05:42.283 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:05:42.293 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.290+0000 7fc792564680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:05:42.295 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.292+0000 7ff48abfe680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:05:42.366 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.363+0000 7ff48abfe680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:05:42.367 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.364+0000 7fc792564680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:05:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.398+0000 7f826366b700 1 Processor -- start 2023-05-17T15:05:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.398+0000 7f826366b700 1 -- start start 2023-05-17T15:05:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f826366b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c153fa0 0x7f825c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f826366b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f825c0aae70 0x7f825c0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f826366b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f825c069060 0x7f825c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f826366b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c069d70 con 0x7f825c0aae70 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f826366b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0c6760 con 0x7f825c069060 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f826366b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c07a0 con 0x7f825c153fa0 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f8260c06700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f825c0aae70 0x7f825c0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f8260c06700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f825c0aae70 0x7f825c0c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36722/0 (socket says 172.21.15.27:36722) 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f8260c06700 1 -- 172.21.15.27:0/2171658603 learned_addr learned my addr 172.21.15.27:0/2171658603 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f8261407700 1 --2- 172.21.15.27:0/2171658603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c153fa0 0x7f825c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.399+0000 7f8261c08700 1 --2- 172.21.15.27:0/2171658603 >> v2:172.21.15.40:3300/0 conn(0x7f825c069060 0x7f825c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8260c06700 1 -- 172.21.15.27:0/2171658603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c153fa0 msgr2=0x7f825c0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8260c06700 1 --2- 172.21.15.27:0/2171658603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c153fa0 0x7f825c0c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8260c06700 1 -- 172.21.15.27:0/2171658603 >> v2:172.21.15.40:3300/0 conn(0x7f825c069060 msgr2=0x7f825c0694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8260c06700 1 --2- 172.21.15.27:0/2171658603 >> v2:172.21.15.40:3300/0 conn(0x7f825c069060 0x7f825c0694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8260c06700 1 -- 172.21.15.27:0/2171658603 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0bfe70 con 0x7f825c0aae70 2023-05-17T15:05:42.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8260c06700 1 --2- 172.21.15.27:0/2171658603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c0aae70 0x7f825c0c6270 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f825c06a950 tx=0x7f8258009060).ready entity=mon.0 client_cookie=8ddadf4001a3ae server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:42.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8253fff700 1 -- 172.21.15.27:0/2171658603 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258005880 con 0x7f825c0aae70 2023-05-17T15:05:42.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8253fff700 1 -- 172.21.15.27:0/2171658603 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580059e0 con 0x7f825c0aae70 2023-05-17T15:05:42.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f8253fff700 1 -- 172.21.15.27:0/2171658603 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258005d60 con 0x7f825c0aae70 2023-05-17T15:05:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f826366b700 1 -- 172.21.15.27:0/2171658603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c0aae70 msgr2=0x7f825c0c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f826366b700 1 --2- 172.21.15.27:0/2171658603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c0aae70 0x7f825c0c6270 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f825c06a950 tx=0x7f8258009060).stop 2023-05-17T15:05:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f826366b700 1 -- 172.21.15.27:0/2171658603 shutdown_connections 2023-05-17T15:05:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f826366b700 1 --2- 172.21.15.27:0/2171658603 >> v2:172.21.15.40:3300/0 conn(0x7f825c069060 0x7f825c0694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.400+0000 7f826366b700 1 --2- 172.21.15.27:0/2171658603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c153fa0 0x7f825c0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.401+0000 7f826366b700 1 --2- 172.21.15.27:0/2171658603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c0aae70 0x7f825c0c6270 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.401+0000 7f826366b700 1 -- 172.21.15.27:0/2171658603 >> 172.21.15.27:0/2171658603 conn(0x7f825c0cb810 msgr2=0x7f825c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.401+0000 7f826366b700 1 -- 172.21.15.27:0/2171658603 shutdown_connections 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.401+0000 7f826366b700 1 -- 172.21.15.27:0/2171658603 wait complete. 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.402+0000 7f826366b700 1 Processor -- start 2023-05-17T15:05:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.402+0000 7f826366b700 1 -- start start 2023-05-17T15:05:42.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f826366b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f825c069060 0x7f825c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f826366b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c0aae70 0x7f825c0a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f826366b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c153fa0 0x7f825c0c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f826366b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c164200 con 0x7f825c153fa0 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f826366b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c164410 con 0x7f825c069060 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f826366b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1646f0 con 0x7f825c0aae70 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261c08700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c153fa0 0x7f825c0c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261c08700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c153fa0 0x7f825c0c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36730/0 (socket says 172.21.15.27:36730) 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261c08700 1 -- 172.21.15.27:0/2326478392 learned_addr learned my addr 172.21.15.27:0/2326478392 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261407700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f825c069060 0x7f825c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8260c06700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c0aae70 0x7f825c0a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261407700 1 -- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c0aae70 msgr2=0x7f825c0a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261407700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c0aae70 0x7f825c0a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261407700 1 -- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c153fa0 msgr2=0x7f825c0c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261407700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c153fa0 0x7f825c0c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.404+0000 7f8261407700 1 -- 172.21.15.27:0/2326478392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258009300 con 0x7f825c069060 2023-05-17T15:05:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.405+0000 7f8261407700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f825c069060 0x7f825c0add20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f824c00e900 tx=0x7f824c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.405+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c009450 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.405+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c012600 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.405+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c1649d0 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.405+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c012980 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.405+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c164f90 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.406+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c06bdf0 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.406+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f824c022070 con 0x7f825c069060 2023-05-17T15:05:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.406+0000 7f82517fa700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f824005ee20 0x7f82400612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.406+0000 7f8260c06700 1 -- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f824005ee20 msgr2=0x7f82400612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:05:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.407+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7366+0+0 (secure 0 0 0) 0x7f824c07a2b0 con 0x7f825c069060 2023-05-17T15:05:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.407+0000 7f8260c06700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f824005ee20 0x7f82400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:05:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.411+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f824c04b350 con 0x7f825c069060 2023-05-17T15:05:42.442 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.439+0000 7ff48abfe680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:05:42.448 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.444+0000 7fc792564680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:05:42.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.588+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825c0c0150 con 0x7f825c069060 2023-05-17T15:05:42.592 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.588+0000 7ff48abfe680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:05:42.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.589+0000 7f82517fa700 1 -- 172.21.15.27:0/2326478392 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18825 (secure 0 0 0) 0x7f824c04e970 con 0x7f825c069060 2023-05-17T15:05:42.593 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:42.594 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":50,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:39.609626+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:54:37.248347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T14:54:38.064177+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6833/86332":"2023-05-18T14:54:51.513720+0000","172.21.15.27:0/3516131969":"2023-05-18T14:54:51.513720+0000","172.21.15.27:0/1880994171":"2023-05-18T14:54:51.513720+0000","172.21.15.27:6832/86332":"2023-05-18T14:54:51.513720+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":6,"length":1},{"begin":10,"length":1},{"begin":16,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":57,"length":1},{"begin":61,"length":1},{"begin":67,"length":1},{"begin":71,"length":1},{"begin":77,"length":1},{"begin":81,"length":1},{"begin":87,"length":1},{"begin":91,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":199,"length":22}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":61,"length":1},{"begin":71,"length":1},{"begin":81,"length":1},{"begin":91,"length":1},{"begin":101,"length":1},{"begin":216,"length":5}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2},{"begin":5,"length":1},{"begin":9,"length":1},{"begin":12,"length":2},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":22,"length":2},{"begin":25,"length":1},{"begin":29,"length":1},{"begin":32,"length":2},{"begin":35,"length":1},{"begin":39,"length":1},{"begin":42,"length":2},{"begin":45,"length":1},{"begin":49,"length":1},{"begin":53,"length":2},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":63,"length":2},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":73,"length":2},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":2},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":93,"length":2},{"begin":96,"length":1},{"begin":100,"length":1},{"begin":103,"length":1},{"begin":106,"length":1},{"begin":109,"length":2},{"begin":155,"length":44}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:05:42.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f824005ee20 msgr2=0x7f82400612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:05:42.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f824005ee20 0x7f82400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:42.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f825c069060 msgr2=0x7f825c0add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f825c069060 0x7f825c0add20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f824c00e900 tx=0x7f824c009060).stop 2023-05-17T15:05:42.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 shutdown_connections 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f824005ee20 0x7f82400612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f825c153fa0 0x7f825c0c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f825c069060 0x7f825c0add20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 --2- 172.21.15.27:0/2326478392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f825c0aae70 0x7f825c0a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 >> 172.21.15.27:0/2326478392 conn(0x7f825c0cb810 msgr2=0x7f825c14eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 shutdown_connections 2023-05-17T15:05:42.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.591+0000 7f826366b700 1 -- 172.21.15.27:0/2326478392 wait complete. 2023-05-17T15:05:42.600 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.596+0000 7fc792564680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:05:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T14:54:37.248347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T14:54:38.064177+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:05:42.608 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:05:42.664 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.660+0000 7ff48abfe680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:05:42.675 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.671+0000 7fc792564680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:05:42.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.766+0000 7f9e3e1f6700 1 Processor -- start 2023-05-17T15:05:42.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.766+0000 7f9e3e1f6700 1 -- start start 2023-05-17T15:05:42.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e3e1f6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e381543d0 0x7f9e380c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e3e1f6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e38158790 con 0x7f9e38069410 2023-05-17T15:05:42.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e3e1f6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380c6570 con 0x7f9e380c60f0 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e3e1f6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e380c1c50 con 0x7f9e381543d0 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e37fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9e38069410 0x7f9e380bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36300/0 (socket says 172.21.15.27:36300) 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e37fff700 1 -- 172.21.15.27:0/2245265986 learned_addr learned my addr 172.21.15.27:0/2245265986 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e377fe700 1 --2- 172.21.15.27:0/2245265986 >> v2:172.21.15.40:3300/0 conn(0x7f9e381543d0 0x7f9e380c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e367fc700 1 -- 172.21.15.27:0/2245265986 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363655402 0 0) 0x7f9e38158790 con 0x7f9e38069410 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e367fc700 1 -- 172.21.15.27:0/2245265986 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e200033f0 con 0x7f9e38069410 2023-05-17T15:05:42.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e377fe700 1 -- 172.21.15.27:0/2245265986 >> v1:172.21.15.40:6789/0 conn(0x7f9e380c60f0 legacy=0x7f9e38068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e377fe700 1 -- 172.21.15.27:0/2245265986 >> v1:172.21.15.27:6789/0 conn(0x7f9e38069410 legacy=0x7f9e380bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e377fe700 1 -- 172.21.15.27:0/2245265986 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38157e60 con 0x7f9e381543d0 2023-05-17T15:05:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.767+0000 7f9e377fe700 1 --2- 172.21.15.27:0/2245265986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e380c5c00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9e28009760 tx=0x7f9e28009060).ready entity=mon.1 client_cookie=4419f81b797916e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e367fc700 1 -- 172.21.15.27:0/2245265986 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800f510 con 0x7f9e381543d0 2023-05-17T15:05:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e367fc700 1 -- 172.21.15.27:0/2245265986 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800f670 con 0x7f9e381543d0 2023-05-17T15:05:42.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e367fc700 1 -- 172.21.15.27:0/2245265986 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800f9f0 con 0x7f9e381543d0 2023-05-17T15:05:42.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/2245265986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 msgr2=0x7f9e380c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/2245265986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e380c5c00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9e28009760 tx=0x7f9e28009060).stop 2023-05-17T15:05:42.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/2245265986 shutdown_connections 2023-05-17T15:05:42.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/2245265986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e380c5c00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/2245265986 >> 172.21.15.27:0/2245265986 conn(0x7f9e380cb7f0 msgr2=0x7f9e380c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/2245265986 shutdown_connections 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.768+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/2245265986 wait complete. 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.769+0000 7f9e3e1f6700 1 Processor -- start 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.769+0000 7f9e3e1f6700 1 -- start start 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e3e1f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e38069410 0x7f9e380c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e3e1f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 0x7f9e38164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e3e1f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e38144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e3e1f6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381653b0 con 0x7f9e380c60f0 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e3e1f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c2430 con 0x7f9e381543d0 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e3e1f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c2710 con 0x7f9e38069410 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e36ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 0x7f9e38164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e36ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 0x7f9e38164ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36740/0 (socket says 172.21.15.27:36740) 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e36ffd700 1 -- 172.21.15.27:0/3169345939 learned_addr learned my addr 172.21.15.27:0/3169345939 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e37fff700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e38144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.770+0000 7f9e377fe700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e38069410 0x7f9e380c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e36ffd700 1 -- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e38069410 msgr2=0x7f9e380c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e36ffd700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e38069410 0x7f9e380c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e36ffd700 1 -- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 msgr2=0x7f9e38144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e36ffd700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e38144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e36ffd700 1 -- 172.21.15.27:0/3169345939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280092a0 con 0x7f9e380c60f0 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e37fff700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e38144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:05:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e36ffd700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 0x7f9e38164ec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f9e2c00c4c0 tx=0x7f9e2c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00ce70 con 0x7f9e380c60f0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c001e90 con 0x7f9e380c60f0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380c29f0 con 0x7f9e380c60f0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c007250 con 0x7f9e380c60f0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.771+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e380c2fb0 con 0x7f9e380c60f0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.772+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9e2c010070 con 0x7f9e380c60f0 2023-05-17T15:05:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.772+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380c31d0 con 0x7f9e380c60f0 2023-05-17T15:05:42.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.773+0000 7f9e1f7fe700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9e2405ee20 0x7f9e240612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:42.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.773+0000 7f9e377fe700 1 -- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9e2405ee20 msgr2=0x7f9e240612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:05:42.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.773+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7366+0+0 (secure 0 0 0) 0x7f9e2c0797a0 con 0x7f9e380c60f0 2023-05-17T15:05:42.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.773+0000 7f9e377fe700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9e2405ee20 0x7f9e240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:05:42.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.777+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e2c04a840 con 0x7f9e380c60f0 2023-05-17T15:05:42.784 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.781+0000 7ff48abfe680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:05:42.799 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.796+0000 7fc792564680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:05:42.895 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:42.892+0000 7ff48abfe680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:05:42.911 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:42.908+0000 7fc792564680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:05:42.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.951+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9e3806bdf0 con 0x7f9e380c60f0 2023-05-17T15:05:42.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.951+0000 7f9e1f7fe700 1 -- 172.21.15.27:0/3169345939 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v50) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9e2c04de60 con 0x7f9e380c60f0 2023-05-17T15:05:42.955 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:05:42.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9e2405ee20 msgr2=0x7f9e240612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:05:42.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9e2405ee20 0x7f9e240612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:42.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 msgr2=0x7f9e38164ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:42.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 0x7f9e38164ec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f9e2c00c4c0 tx=0x7f9e2c007e00).stop 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 shutdown_connections 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9e2405ee20 0x7f9e240612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e381543d0 0x7f9e38144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e38069410 0x7f9e380c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 --2- 172.21.15.27:0/3169345939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e380c60f0 0x7f9e38164ec0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 >> 172.21.15.27:0/3169345939 conn(0x7f9e380cb7f0 msgr2=0x7f9e380c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:42.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 shutdown_connections 2023-05-17T15:05:42.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:42.953+0000 7f9e3e1f6700 1 -- 172.21.15.27:0/3169345939 wait complete. 2023-05-17T15:05:42.969 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:05:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.129+0000 7ff60fdb1700 1 Processor -- start 2023-05-17T15:05:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.130+0000 7ff60fdb1700 1 -- start start 2023-05-17T15:05:43.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60fdb1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6081543d0 0x7ff6080c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60fdb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60fdb1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6080691f0 0x7ff6081547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60fdb1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080c1c50 con 0x7ff6080691f0 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60fdb1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff608158790 con 0x7ff6081543d0 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60fdb1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080c6570 con 0x7ff6080c60f0 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.131+0000 7ff60e34e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6080691f0 0x7ff6081547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60db4d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6081543d0 0x7ff6080c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6080691f0 0x7ff6081547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36752/0 (socket says 172.21.15.27:36752) 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 -- 172.21.15.27:0/3559951999 learned_addr learned my addr 172.21.15.27:0/3559951999 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60d34c700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 -- 172.21.15.27:0/3559951999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 msgr2=0x7ff608068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 -- 172.21.15.27:0/3559951999 >> v2:172.21.15.40:3300/0 conn(0x7ff6081543d0 msgr2=0x7ff6080c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 --2- 172.21.15.27:0/3559951999 >> v2:172.21.15.40:3300/0 conn(0x7ff6081543d0 0x7ff6080c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 -- 172.21.15.27:0/3559951999 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608157e60 con 0x7ff6080691f0 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60d34c700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60e34e700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff6081547b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff608155970 tx=0x7ff600009840).ready entity=mon.0 client_cookie=f4d88d971710ffef server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.132+0000 7ff60cb4b700 1 -- 172.21.15.27:0/3559951999 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60000e070 con 0x7ff6080691f0 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60cb4b700 1 -- 172.21.15.27:0/3559951999 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60000ba20 con 0x7ff6080691f0 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60cb4b700 1 -- 172.21.15.27:0/3559951999 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60000bda0 con 0x7ff6080691f0 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 -- 172.21.15.27:0/3559951999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 msgr2=0x7ff6081547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff6081547b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff608155970 tx=0x7ff600009840).stop 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 -- 172.21.15.27:0/3559951999 shutdown_connections 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff6081547b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/3559951999 >> v2:172.21.15.40:3300/0 conn(0x7ff6081543d0 0x7ff6080c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/3559951999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 -- 172.21.15.27:0/3559951999 >> 172.21.15.27:0/3559951999 conn(0x7ff6080cb7f0 msgr2=0x7ff6080c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 -- 172.21.15.27:0/3559951999 shutdown_connections 2023-05-17T15:05:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.133+0000 7ff60fdb1700 1 -- 172.21.15.27:0/3559951999 wait complete. 2023-05-17T15:05:43.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.134+0000 7ff60fdb1700 1 Processor -- start 2023-05-17T15:05:43.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 -- start start 2023-05-17T15:05:43.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff608163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6081543d0 0x7ff6080af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6081648a0 con 0x7ff6080691f0 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff608164b80 con 0x7ff6081543d0 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60fdb1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff608164e60 con 0x7ff6080c60f0 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60db4d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff608163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60db4d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff608163fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36754/0 (socket says 172.21.15.27:36754) 2023-05-17T15:05:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60d34c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60db4d700 1 -- 172.21.15.27:0/491468152 learned_addr learned my addr 172.21.15.27:0/491468152 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.135+0000 7ff60e34e700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6081543d0 0x7ff6080af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60db4d700 1 -- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 msgr2=0x7ff608152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60db4d700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60db4d700 1 -- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6081543d0 msgr2=0x7ff6080af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60db4d700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6081543d0 0x7ff6080af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60db4d700 1 -- 172.21.15.27:0/491468152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600009ae0 con 0x7ff6080691f0 2023-05-17T15:05:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60db4d700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff608163fe0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff5fc00e900 tx=0x7ff5fc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc012600 con 0x7ff6080691f0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc012760 con 0x7ff6080691f0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6080aec80 con 0x7ff6080691f0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc012ae0 con 0x7ff6080691f0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.136+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6081644d0 con 0x7ff6080691f0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.137+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff5fc022070 con 0x7ff6080691f0 2023-05-17T15:05:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.137+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6080af2d0 con 0x7ff6080691f0 2023-05-17T15:05:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.138+0000 7ff5f9ffb700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff5ec05ee20 0x7ff5ec0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.138+0000 7ff60d34c700 1 -- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff5ec05ee20 msgr2=0x7ff5ec0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:05:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.138+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7366+0+0 (secure 0 0 0) 0x7ff5fc07a300 con 0x7ff6080691f0 2023-05-17T15:05:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.138+0000 7ff60d34c700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff5ec05ee20 0x7ff5ec0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:05:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.142+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5fc04b2d0 con 0x7ff6080691f0 2023-05-17T15:05:43.197 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:43.194+0000 7ff48abfe680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:05:43.228 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.224+0000 7fc792564680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:05:43.269 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:05:43.266+0000 7ff48abfe680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:05:43.301 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.297+0000 7fc792564680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:05:43.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.322+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7ff5fc077c30 con 0x7ff6080691f0 2023-05-17T15:05:43.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.322+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff5ec05ee20 msgr2=0x7ff5ec0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:05:43.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.322+0000 7ff5f9ffb700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff5ec05ee20 0x7ff5ec0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:43.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.341+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff608158140 con 0x7ff6080691f0 2023-05-17T15:05:43.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.341+0000 7ff5f9ffb700 1 -- 172.21.15.27:0/491468152 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff5fc06cce0 con 0x7ff6080691f0 2023-05-17T15:05:43.345 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:05:43.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 msgr2=0x7ff608163fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff608163fe0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff5fc00e900 tx=0x7ff5fc009060).stop 2023-05-17T15:05:43.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 shutdown_connections 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff5ec05ee20 0x7ff5ec0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6081543d0 0x7ff6080af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6080691f0 0x7ff608163fe0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 --2- 172.21.15.27:0/491468152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6080c60f0 0x7ff608152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 >> 172.21.15.27:0/491468152 conn(0x7ff6080cb7f0 msgr2=0x7ff6080a9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 shutdown_connections 2023-05-17T15:05:43.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.343+0000 7ff60fdb1700 1 -- 172.21.15.27:0/491468152 wait complete. 2023-05-17T15:05:43.361 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:05:43.381 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc71554f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.381 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc71554f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.381 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc71554f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc71554f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc71554f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc712549700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc712549700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc712549700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc712549700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:05:43.377+0000 7fc712549700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:05:43.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.478+0000 7fb127413700 1 Processor -- start 2023-05-17T15:05:43.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.478+0000 7fb127413700 1 -- start start 2023-05-17T15:05:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.479+0000 7fb127413700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.479+0000 7fb127413700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1201563d0 con 0x7fb1200bdf00 2023-05-17T15:05:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.479+0000 7fb127413700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb120156830 con 0x7fb1200a7e90 2023-05-17T15:05:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.479+0000 7fb127413700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200bdab0 con 0x7fb120155a60 2023-05-17T15:05:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.479+0000 7fb1259b0700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb1200bdf00 0x7fb1200be350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36388/0 (socket says 172.21.15.27:36388) 2023-05-17T15:05:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.479+0000 7fb1259b0700 1 -- 172.21.15.27:0/953251469 learned_addr learned my addr 172.21.15.27:0/953251469 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb1249ae700 1 --2- 172.21.15.27:0/953251469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525290005 0 0) 0x7fb1201563d0 con 0x7fb1200bdf00 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1080033f0 con 0x7fb1200bdf00 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343938610 0 0) 0x7fb120156830 con 0x7fb1200a7e90 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1201563d0 con 0x7fb1200a7e90 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb1249ae700 1 -- 172.21.15.27:0/953251469 >> v1:172.21.15.40:6789/0 conn(0x7fb1200a7e90 legacy=0x7fb1200c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb1249ae700 1 -- 172.21.15.27:0/953251469 >> v1:172.21.15.27:6789/0 conn(0x7fb1200bdf00 legacy=0x7fb1200be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb1249ae700 1 -- 172.21.15.27:0/953251469 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120065e90 con 0x7fb120155a60 2023-05-17T15:05:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb1249ae700 1 --2- 172.21.15.27:0/953251469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120155ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb114009790 tx=0x7fb114009060).ready entity=mon.2 client_cookie=3080232297058485 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11400f510 con 0x7fb120155a60 2023-05-17T15:05:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11400f670 con 0x7fb120155a60 2023-05-17T15:05:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.480+0000 7fb11ffff700 1 -- 172.21.15.27:0/953251469 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11400f9f0 con 0x7fb120155a60 2023-05-17T15:05:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 -- 172.21.15.27:0/953251469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 msgr2=0x7fb120155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 --2- 172.21.15.27:0/953251469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120155ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb114009790 tx=0x7fb114009060).stop 2023-05-17T15:05:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 -- 172.21.15.27:0/953251469 shutdown_connections 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 --2- 172.21.15.27:0/953251469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120155ee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 -- 172.21.15.27:0/953251469 >> 172.21.15.27:0/953251469 conn(0x7fb1200c94b0 msgr2=0x7fb1200c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 -- 172.21.15.27:0/953251469 shutdown_connections 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.481+0000 7fb127413700 1 -- 172.21.15.27:0/953251469 wait complete. 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.482+0000 7fb127413700 1 Processor -- start 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.482+0000 7fb127413700 1 -- start start 2023-05-17T15:05:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb127413700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 0x7fb1201500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb127413700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1200bdf00 0x7fb120162330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb127413700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120162820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb127413700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200bfb50 con 0x7fb1200a7e90 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb127413700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120150b30 con 0x7fb1200bdf00 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb127413700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb120150e10 con 0x7fb120155a60 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 0x7fb1201500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 0x7fb1201500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36828/0 (socket says 172.21.15.27:36828) 2023-05-17T15:05:43.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 -- 172.21.15.27:0/2313691314 learned_addr learned my addr 172.21.15.27:0/2313691314 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1249ae700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1200bdf00 0x7fb120162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1259b0700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 -- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 msgr2=0x7fb120162820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120162820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 -- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1200bdf00 msgr2=0x7fb120162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1200bdf00 0x7fb120162330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 -- 172.21.15.27:0/2313691314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140092a0 con 0x7fb1200a7e90 2023-05-17T15:05:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1259b0700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.483+0000 7fb1251af700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 0x7fb1201500e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fb11800c440 tx=0x7fb118007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.484+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800f470 con 0x7fb1200a7e90 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.484+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800f5d0 con 0x7fb1200a7e90 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.484+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1201510f0 con 0x7fb1200a7e90 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.484+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800f990 con 0x7fb1200a7e90 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.484+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb120152080 con 0x7fb1200a7e90 2023-05-17T15:05:43.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.485+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12006bdf0 con 0x7fb1200a7e90 2023-05-17T15:05:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.485+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fb118019030 con 0x7fb1200a7e90 2023-05-17T15:05:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.486+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6874+0+0 (secure 0 0 0) 0x7fb118079590 con 0x7fb1200a7e90 2023-05-17T15:05:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.489+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb11804a960 con 0x7fb1200a7e90 2023-05-17T15:05:43.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.664+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb120066170 con 0x7fb1200a7e90 2023-05-17T15:05:43.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.664+0000 7fb11d7fa700 1 -- 172.21.15.27:0/2313691314 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb11804df80 con 0x7fb1200a7e90 2023-05-17T15:05:43.669 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:05:43.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 msgr2=0x7fb1201500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 0x7fb1201500e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fb11800c440 tx=0x7fb118007c90).stop 2023-05-17T15:05:43.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 shutdown_connections 2023-05-17T15:05:43.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb120155a60 0x7fb120162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1200a7e90 0x7fb1201500e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 --2- 172.21.15.27:0/2313691314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1200bdf00 0x7fb120162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 >> 172.21.15.27:0/2313691314 conn(0x7fb1200c94b0 msgr2=0x7fb12014eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:43.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 shutdown_connections 2023-05-17T15:05:43.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.666+0000 7fb127413700 1 -- 172.21.15.27:0/2313691314 wait complete. 2023-05-17T15:05:43.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:05:43.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.836+0000 7fec0b59e700 1 Processor -- start 2023-05-17T15:05:43.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.837+0000 7fec0b59e700 1 -- start start 2023-05-17T15:05:43.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.837+0000 7fec0b59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fec0c151d50 0x7fec0c0a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.837+0000 7fec0b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c0a5b30 0x7fec0c0637f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.837+0000 7fec0b59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c064170 con 0x7fec0c063ce0 2023-05-17T15:05:43.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0b59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0bd8e0 con 0x7fec0c151d50 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0bdbc0 con 0x7fec0c0a5b30 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fec0c151d50 0x7fec0c0a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fec0c151d50 0x7fec0c0a5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36834/0 (socket says 172.21.15.27:36834) 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 -- 172.21.15.27:0/1788420711 learned_addr learned my addr 172.21.15.27:0/1788420711 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec09d9b700 1 --2- 172.21.15.27:0/1788420711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c0a5b30 0x7fec0c0637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 -- 172.21.15.27:0/1788420711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c0a5b30 msgr2=0x7fec0c0637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:43.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 --2- 172.21.15.27:0/1788420711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c0a5b30 0x7fec0c0637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 -- 172.21.15.27:0/1788420711 >> v1:172.21.15.40:6789/0 conn(0x7fec0c063ce0 legacy=0x7fec0c0be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 -- 172.21.15.27:0/1788420711 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0bdea0 con 0x7fec0c151d50 2023-05-17T15:05:43.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0a59c700 1 --2- 172.21.15.27:0/1788420711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c151d50 0x7fec0c0a5640 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fec04009810 tx=0x7fec04009060).ready entity=mon.0 client_cookie=73f896a0baf1acbe server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:43.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0959a700 1 -- 172.21.15.27:0/1788420711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04005880 con 0x7fec0c151d50 2023-05-17T15:05:43.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0959a700 1 -- 172.21.15.27:0/1788420711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec040059e0 con 0x7fec0c151d50 2023-05-17T15:05:43.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.838+0000 7fec0959a700 1 -- 172.21.15.27:0/1788420711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04005d60 con 0x7fec0c151d50 2023-05-17T15:05:43.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 -- 172.21.15.27:0/1788420711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c151d50 msgr2=0x7fec0c0a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 --2- 172.21.15.27:0/1788420711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c151d50 0x7fec0c0a5640 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fec04009810 tx=0x7fec04009060).stop 2023-05-17T15:05:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 -- 172.21.15.27:0/1788420711 shutdown_connections 2023-05-17T15:05:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 --2- 172.21.15.27:0/1788420711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c151d50 0x7fec0c0a5640 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 --2- 172.21.15.27:0/1788420711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c0a5b30 0x7fec0c0637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 -- 172.21.15.27:0/1788420711 >> 172.21.15.27:0/1788420711 conn(0x7fec0c062a60 msgr2=0x7fec0c0c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 -- 172.21.15.27:0/1788420711 shutdown_connections 2023-05-17T15:05:43.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.839+0000 7fec0b59e700 1 -- 172.21.15.27:0/1788420711 wait complete. 2023-05-17T15:05:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.840+0000 7fec0b59e700 1 Processor -- start 2023-05-17T15:05:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.840+0000 7fec0b59e700 1 -- start start 2023-05-17T15:05:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec0c063ce0 0x7fec0c14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 0x7fec0c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c151d50 0x7fec0c0a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1567b0 con 0x7fec0c0a5b30 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c155ba0 con 0x7fec0c063ce0 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c155e80 con 0x7fec0c151d50 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 0x7fec0c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 0x7fec0c156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36842/0 (socket says 172.21.15.27:36842) 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 -- 172.21.15.27:0/2719118347 learned_addr learned my addr 172.21.15.27:0/2719118347 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:43.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0a59c700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec0c063ce0 0x7fec0c14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0ad9d700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c151d50 0x7fec0c0a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 -- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c151d50 msgr2=0x7fec0c0a8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c151d50 0x7fec0c0a8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 -- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec0c063ce0 msgr2=0x7fec0c14ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec0c063ce0 0x7fec0c14ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 -- 172.21.15.27:0/2719118347 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04009300 con 0x7fec0c0a5b30 2023-05-17T15:05:43.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec09d9b700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 0x7fec0c156c40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fec0000e950 tx=0x7fec00009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000c850 con 0x7fec0c0a5b30 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000c9b0 con 0x7fec0c0a5b30 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c156160 con 0x7fec0c0a5b30 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000cd30 con 0x7fec0c0a5b30 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.841+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c0a9490 con 0x7fec0c0a5b30 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.842+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c047150 con 0x7fec0c0a5b30 2023-05-17T15:05:43.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.843+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fec00022070 con 0x7fec0c0a5b30 2023-05-17T15:05:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.843+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6874+0+0 (secure 0 0 0) 0x7fec0007a220 con 0x7fec0c0a5b30 2023-05-17T15:05:43.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:43.847+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec0004b570 con 0x7fec0c0a5b30 2023-05-17T15:05:44.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.021+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec0c0be180 con 0x7fec0c0a5b30 2023-05-17T15:05:44.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.022+0000 7febfa7fc700 1 -- 172.21.15.27:0/2719118347 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec00016020 con 0x7fec0c0a5b30 2023-05-17T15:05:44.025 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:05:44.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 msgr2=0x7fec0c156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 0x7fec0c156c40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fec0000e950 tx=0x7fec00009060).stop 2023-05-17T15:05:44.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 shutdown_connections 2023-05-17T15:05:44.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec0c151d50 0x7fec0c0a8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec0c063ce0 0x7fec0c14ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 --2- 172.21.15.27:0/2719118347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec0c0a5b30 0x7fec0c156c40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 >> 172.21.15.27:0/2719118347 conn(0x7fec0c062a60 msgr2=0x7fec0c0a5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:44.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 shutdown_connections 2023-05-17T15:05:44.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.024+0000 7fec0b59e700 1 -- 172.21.15.27:0/2719118347 wait complete. 2023-05-17T15:05:44.039 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:05:44.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.151+0000 7fbdc0a92700 1 Processor -- start 2023-05-17T15:05:44.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.151+0000 7fbdc0a92700 1 -- start start 2023-05-17T15:05:44.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdc0a92700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbdbc155730 0x7fbdbc0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdc0a92700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0c3190 con 0x7fbdbc0bdc90 2023-05-17T15:05:44.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdc0a92700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0c19f0 con 0x7fbdbc154c40 2023-05-17T15:05:44.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdc0a92700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0c1cd0 con 0x7fbdbc155730 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdb9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbdbc155730 0x7fbdbc0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdbad9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbdbc0bdc90 0x7fbdbc1508f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36410/0 (socket says 172.21.15.27:36410) 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.152+0000 7fbdbad9d700 1 -- 172.21.15.27:0/216413870 learned_addr learned my addr 172.21.15.27:0/216413870 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb9d9b700 1 -- 172.21.15.27:0/216413870 >> v1:172.21.15.40:6789/0 conn(0x7fbdbc154c40 legacy=0x7fbdbc155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb9d9b700 1 -- 172.21.15.27:0/216413870 >> v1:172.21.15.27:6789/0 conn(0x7fbdbc0bdc90 legacy=0x7fbdbc1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb9d9b700 1 -- 172.21.15.27:0/216413870 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0c3430 con 0x7fbdbc155730 2023-05-17T15:05:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb9d9b700 1 --2- 172.21.15.27:0/216413870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc0aa120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fbda4009760 tx=0x7fbda4009060).ready entity=mon.0 client_cookie=b1a53566e417e82f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb959a700 1 -- 172.21.15.27:0/216413870 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400b580 con 0x7fbdbc155730 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb959a700 1 -- 172.21.15.27:0/216413870 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400b6e0 con 0x7fbdbc155730 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdb959a700 1 -- 172.21.15.27:0/216413870 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400ba60 con 0x7fbdbc155730 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 -- 172.21.15.27:0/216413870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 msgr2=0x7fbdbc0aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/216413870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc0aa120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fbda4009760 tx=0x7fbda4009060).stop 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 -- 172.21.15.27:0/216413870 shutdown_connections 2023-05-17T15:05:44.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/216413870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc0aa120 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 -- 172.21.15.27:0/216413870 >> 172.21.15.27:0/216413870 conn(0x7fbdbc068750 msgr2=0x7fbdbc0c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 -- 172.21.15.27:0/216413870 shutdown_connections 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.153+0000 7fbdc0a92700 1 -- 172.21.15.27:0/216413870 wait complete. 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 Processor -- start 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 -- start start 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdbc0bdc90 0x7fbdbc0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdbc154c40 0x7fbdbc1611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc063d10 con 0x7fbdbc155730 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc13c820 con 0x7fbdbc0bdc90 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdc0a92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0abbe0 con 0x7fbdbc154c40 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdbad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdbad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc1533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36856/0 (socket says 172.21.15.27:36856) 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdbad9d700 1 -- 172.21.15.27:0/409734355 learned_addr learned my addr 172.21.15.27:0/409734355 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:44.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdba59c700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdbc0bdc90 0x7fbdbc0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.155+0000 7fbdb9d9b700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdbc154c40 0x7fbdbc1611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdbad9d700 1 -- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdbc154c40 msgr2=0x7fbdbc1611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdbad9d700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdbc154c40 0x7fbdbc1611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdbad9d700 1 -- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdbc0bdc90 msgr2=0x7fbdbc0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdbad9d700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdbc0bdc90 0x7fbdbc0ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdbad9d700 1 -- 172.21.15.27:0/409734355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40092a0 con 0x7fbdbc155730 2023-05-17T15:05:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdbad9d700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc1533d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fbdac00c410 tx=0x7fbdac007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0070d0 con 0x7fbdbc155730 2023-05-17T15:05:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac007230 con 0x7fbdbc155730 2023-05-17T15:05:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0075b0 con 0x7fbdbc155730 2023-05-17T15:05:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc0ac560 con 0x7fbdbc155730 2023-05-17T15:05:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.156+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc0ab590 con 0x7fbdbc155730 2023-05-17T15:05:44.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.157+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc0abd50 con 0x7fbdbc155730 2023-05-17T15:05:44.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.157+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fbdac010070 con 0x7fbdbc155730 2023-05-17T15:05:44.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.158+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6874+0+0 (secure 0 0 0) 0x7fbdac079170 con 0x7fbdbc155730 2023-05-17T15:05:44.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.162+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbdac04a570 con 0x7fbdbc155730 2023-05-17T15:05:44.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.348+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fbdac076e20 con 0x7fbdbc155730 2023-05-17T15:05:44.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.349+0000 7fbdb27fc700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbd9c030180 0x7fbd9c067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.350+0000 7fbdba59c700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbd9c030180 0x7fbd9c067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.350+0000 7fbdba59c700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbd9c030180 0x7fbd9c067bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fbdb4004290 tx=0x7fbdb4001590).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.387+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdbc0c3710 con 0x7fbdbc155730 2023-05-17T15:05:44.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.387+0000 7fbdb27fc700 1 -- 172.21.15.27:0/409734355 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4480 (secure 0 0 0) 0x7fbdac06ea80 con 0x7fbdbc155730 2023-05-17T15:05:44.391 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:44.391 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:54:39.094710+0000","modified":"2023-05-17T14:54:42.101891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6836/149717180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":149717180},{"type":"v1","addr":"172.21.15.27:6836","nonce":149717180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-17T15:05:44.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbd9c030180 msgr2=0x7fbd9c067bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbd9c030180 0x7fbd9c067bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fbdb4004290 tx=0x7fbdb4001590).stop 2023-05-17T15:05:44.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 msgr2=0x7fbdbc1533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc1533d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fbdac00c410 tx=0x7fbdac007d70).stop 2023-05-17T15:05:44.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 shutdown_connections 2023-05-17T15:05:44.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fbd9c030180 0x7fbd9c067bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdbc155730 0x7fbdbc1533d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdbc0bdc90 0x7fbdbc0ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 --2- 172.21.15.27:0/409734355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdbc154c40 0x7fbdbc1611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 >> 172.21.15.27:0/409734355 conn(0x7fbdbc068750 msgr2=0x7fbdbc0c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:44.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 shutdown_connections 2023-05-17T15:05:44.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.389+0000 7fbdc0a92700 1 -- 172.21.15.27:0/409734355 wait complete. 2023-05-17T15:05:44.395 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2023-05-17T15:05:44.405 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:05:44.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.518+0000 7f58ac035700 1 Processor -- start 2023-05-17T15:05:44.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.518+0000 7f58ac035700 1 -- start start 2023-05-17T15:05:44.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58ac035700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58a40c5f30 0x7f58a40c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58ac035700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58a4158880 0x7f58a4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58ac035700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40bfcd0 con 0x7f58a41541c0 2023-05-17T15:05:44.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58ac035700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40c0290 con 0x7f58a40c5f30 2023-05-17T15:05:44.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58ac035700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40aa1a0 con 0x7f58a4158880 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58a40c5f30 0x7f58a40c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58a40c5f30 0x7f58a40c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36882/0 (socket says 172.21.15.27:36882) 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 -- 172.21.15.27:0/3687095845 learned_addr learned my addr 172.21.15.27:0/3687095845 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a95d0700 1 --2- 172.21.15.27:0/3687095845 >> v2:172.21.15.40:3300/0 conn(0x7f58a4158880 0x7f58a4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 -- 172.21.15.27:0/3687095845 >> v2:172.21.15.40:3300/0 conn(0x7f58a4158880 msgr2=0x7f58a4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 --2- 172.21.15.27:0/3687095845 >> v2:172.21.15.40:3300/0 conn(0x7f58a4158880 0x7f58a4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 -- 172.21.15.27:0/3687095845 >> v1:172.21.15.40:6789/0 conn(0x7f58a41541c0 legacy=0x7f58a40c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 -- 172.21.15.27:0/3687095845 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40aa480 con 0x7f58a40c5f30 2023-05-17T15:05:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a9dd1700 1 --2- 172.21.15.27:0/3687095845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a40c5f30 0x7f58a40c6310 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f58a40c57b0 tx=0x7f589c0090f0).ready entity=mon.0 client_cookie=141a0f4f257711 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a8dcf700 1 -- 172.21.15.27:0/3687095845 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00b600 con 0x7f58a40c5f30 2023-05-17T15:05:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a8dcf700 1 -- 172.21.15.27:0/3687095845 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c00b760 con 0x7f58a40c5f30 2023-05-17T15:05:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.519+0000 7f58a8dcf700 1 -- 172.21.15.27:0/3687095845 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00bae0 con 0x7f58a40c5f30 2023-05-17T15:05:44.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 -- 172.21.15.27:0/3687095845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a40c5f30 msgr2=0x7f58a40c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 --2- 172.21.15.27:0/3687095845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a40c5f30 0x7f58a40c6310 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f58a40c57b0 tx=0x7f589c0090f0).stop 2023-05-17T15:05:44.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 -- 172.21.15.27:0/3687095845 shutdown_connections 2023-05-17T15:05:44.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 --2- 172.21.15.27:0/3687095845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a40c5f30 0x7f58a40c6310 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 --2- 172.21.15.27:0/3687095845 >> v2:172.21.15.40:3300/0 conn(0x7f58a4158880 0x7f58a4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 -- 172.21.15.27:0/3687095845 >> 172.21.15.27:0/3687095845 conn(0x7f58a4069e70 msgr2=0x7f58a405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:44.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 -- 172.21.15.27:0/3687095845 shutdown_connections 2023-05-17T15:05:44.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.520+0000 7f58ac035700 1 -- 172.21.15.27:0/3687095845 wait complete. 2023-05-17T15:05:44.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.521+0000 7f58ac035700 1 Processor -- start 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.521+0000 7f58ac035700 1 -- start start 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a40c5f30 0x7f58a4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a41541c0 0x7f58a4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 0x7f58a414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4154650 con 0x7f58a4158880 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4154c10 con 0x7f58a41541c0 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4157f30 con 0x7f58a40c5f30 2023-05-17T15:05:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 0x7f58a414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 0x7f58a414f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36890/0 (socket says 172.21.15.27:36890) 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 -- 172.21.15.27:0/1413854542 learned_addr learned my addr 172.21.15.27:0/1413854542 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a9dd1700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a40c5f30 0x7f58a4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a95d0700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a41541c0 0x7f58a4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 -- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a40c5f30 msgr2=0x7f58a4156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a40c5f30 0x7f58a4156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 -- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a41541c0 msgr2=0x7f58a4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a41541c0 0x7f58a4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 -- 172.21.15.27:0/1413854542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c009370 con 0x7f58a4158880 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a9dd1700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a40c5f30 0x7f58a4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a95d0700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a41541c0 0x7f58a4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58aa5d2700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 0x7f58a414f1c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5894002230 tx=0x7f58940015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894010510 con 0x7f58a4158880 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894010670 con 0x7f58a4158880 2023-05-17T15:05:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a4158200 con 0x7f58a4158880 2023-05-17T15:05:44.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.522+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940109f0 con 0x7f58a4158880 2023-05-17T15:05:44.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.523+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a41548a0 con 0x7f58a4158880 2023-05-17T15:05:44.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.524+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a405f4a0 con 0x7f58a4158880 2023-05-17T15:05:44.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.524+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5894010070 con 0x7f58a4158880 2023-05-17T15:05:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.524+0000 7f58a1ffb700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f589005ecf0 0x7f58900611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.524+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6934+0+0 (secure 0 0 0) 0x7f58940799c0 con 0x7f58a4158880 2023-05-17T15:05:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.524+0000 7f58a9dd1700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f589005ecf0 0x7f58900611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.525+0000 7f58a9dd1700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f589005ecf0 0x7f58900611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f589c00b3c0 tx=0x7f589c017000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.529+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f589404acd0 con 0x7f58a4158880 2023-05-17T15:05:44.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.711+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58a406bdf0 con 0x7f58a4158880 2023-05-17T15:05:44.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.712+0000 7f58a1ffb700 1 -- 172.21.15.27:0/1413854542 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f589404e2f0 con 0x7f58a4158880 2023-05-17T15:05:44.715 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:44.716 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:44.312938+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:54:37.248347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T14:54:38.064177+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1117017077":"2023-05-18T15:05:43.311577+0000","172.21.15.27:0/3834618831":"2023-05-18T15:05:43.311577+0000","172.21.15.27:0/74438321":"2023-05-18T15:05:43.311577+0000","172.21.15.27:6832/86332":"2023-05-18T14:54:51.513720+0000","172.21.15.27:0/1880994171":"2023-05-18T14:54:51.513720+0000","172.21.15.27:0/1898448746":"2023-05-18T15:05:43.311577+0000","172.21.15.27:0/3516131969":"2023-05-18T14:54:51.513720+0000","172.21.15.27:6833/86332":"2023-05-18T14:54:51.513720+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":6,"length":1},{"begin":10,"length":1},{"begin":16,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":57,"length":1},{"begin":61,"length":1},{"begin":67,"length":1},{"begin":71,"length":1},{"begin":77,"length":1},{"begin":81,"length":1},{"begin":87,"length":1},{"begin":91,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:05:44.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f589005ecf0 msgr2=0x7f58900611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f589005ecf0 0x7f58900611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f589c00b3c0 tx=0x7f589c017000).stop 2023-05-17T15:05:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 msgr2=0x7f58a414f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 0x7f58a414f1c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5894002230 tx=0x7f58940015e0).stop 2023-05-17T15:05:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 shutdown_connections 2023-05-17T15:05:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f589005ecf0 0x7f58900611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58a4158880 0x7f58a414f1c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a40c5f30 0x7f58a4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 --2- 172.21.15.27:0/1413854542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a41541c0 0x7f58a4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 >> 172.21.15.27:0/1413854542 conn(0x7f58a4069e70 msgr2=0x7f58a40af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 shutdown_connections 2023-05-17T15:05:44.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.714+0000 7f58ac035700 1 -- 172.21.15.27:0/1413854542 wait complete. 2023-05-17T15:05:44.730 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:05:44.730 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:05:44.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.842+0000 7f60bfc42700 1 Processor -- start 2023-05-17T15:05:44.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.843+0000 7f60bfc42700 1 -- start start 2023-05-17T15:05:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.843+0000 7f60bfc42700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60b8153e40 0x7f60b8154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.843+0000 7f60bfc42700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b80c4540 con 0x7f60b8065af0 2023-05-17T15:05:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.843+0000 7f60bfc42700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b80c36b0 con 0x7f60b80c49d0 2023-05-17T15:05:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.843+0000 7f60bfc42700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b80c3930 con 0x7f60b8153e40 2023-05-17T15:05:44.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.843+0000 7f60bd9de700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60b8153e40 0x7f60b8154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bd9de700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60b8153e40 0x7f60b8154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36894/0 (socket says 172.21.15.27:36894) 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bd9de700 1 -- 172.21.15.27:0/1609763632 learned_addr learned my addr 172.21.15.27:0/1609763632 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60be1df700 1 --1- 172.21.15.27:0/1609763632 >> v1:172.21.15.27:6789/0 conn(0x7f60b8065af0 0x7f60b80bd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36458/0 (socket says 172.21.15.27:36458) 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bd9de700 1 -- 172.21.15.27:0/1609763632 >> v1:172.21.15.40:6789/0 conn(0x7f60b80c49d0 legacy=0x7f60b80653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bd9de700 1 -- 172.21.15.27:0/1609763632 >> v1:172.21.15.27:6789/0 conn(0x7f60b8065af0 legacy=0x7f60b80bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bd9de700 1 -- 172.21.15.27:0/1609763632 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80c3c10 con 0x7f60b8153e40 2023-05-17T15:05:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bd9de700 1 --2- 172.21.15.27:0/1609763632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b8153e40 0x7f60b8154220 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f60b4006fd0 tx=0x7f60b40090f0).ready entity=mon.0 client_cookie=350992ba3ada931d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bc9dc700 1 -- 172.21.15.27:0/1609763632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400b600 con 0x7f60b8153e40 2023-05-17T15:05:44.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bc9dc700 1 -- 172.21.15.27:0/1609763632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b400b760 con 0x7f60b8153e40 2023-05-17T15:05:44.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.844+0000 7f60bc9dc700 1 -- 172.21.15.27:0/1609763632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400bae0 con 0x7f60b8153e40 2023-05-17T15:05:44.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 -- 172.21.15.27:0/1609763632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b8153e40 msgr2=0x7f60b8154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1609763632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b8153e40 0x7f60b8154220 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f60b4006fd0 tx=0x7f60b40090f0).stop 2023-05-17T15:05:44.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 -- 172.21.15.27:0/1609763632 shutdown_connections 2023-05-17T15:05:44.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1609763632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b8153e40 0x7f60b8154220 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 -- 172.21.15.27:0/1609763632 >> 172.21.15.27:0/1609763632 conn(0x7f60b80c9560 msgr2=0x7f60b80c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:44.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 -- 172.21.15.27:0/1609763632 shutdown_connections 2023-05-17T15:05:44.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.845+0000 7f60bfc42700 1 -- 172.21.15.27:0/1609763632 wait complete. 2023-05-17T15:05:44.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.846+0000 7f60bfc42700 1 Processor -- start 2023-05-17T15:05:44.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.846+0000 7f60bfc42700 1 -- start start 2023-05-17T15:05:44.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b8065af0 0x7f60b8151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 0x7f60b8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8153e40 0x7f60b8150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b814fe80 con 0x7f60b80c49d0 2023-05-17T15:05:44.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80a8e00 con 0x7f60b8153e40 2023-05-17T15:05:44.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80a7f50 con 0x7f60b8065af0 2023-05-17T15:05:44.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 0x7f60b8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 0x7f60b8150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36900/0 (socket says 172.21.15.27:36900) 2023-05-17T15:05:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 -- 172.21.15.27:0/1081361861 learned_addr learned my addr 172.21.15.27:0/1081361861 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd9de700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b8065af0 0x7f60b8151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60be1df700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8153e40 0x7f60b8150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 -- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b8065af0 msgr2=0x7f60b8151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b8065af0 0x7f60b8151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 -- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8153e40 msgr2=0x7f60b8150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:44.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8153e40 0x7f60b8150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:44.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 -- 172.21.15.27:0/1081361861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009370 con 0x7f60b80c49d0 2023-05-17T15:05:44.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bd1dd700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 0x7f60b8150350 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f60a800c440 tx=0x7f60a8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8012400 con 0x7f60b80c49d0 2023-05-17T15:05:44.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a8012580 con 0x7f60b80c49d0 2023-05-17T15:05:44.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b80a81f0 con 0x7f60b80c49d0 2023-05-17T15:05:44.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.847+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8012940 con 0x7f60b80c49d0 2023-05-17T15:05:44.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.848+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b80a87b0 con 0x7f60b80c49d0 2023-05-17T15:05:44.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.849+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b80a8f70 con 0x7f60b80c49d0 2023-05-17T15:05:44.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.849+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f60a8019030 con 0x7f60b80c49d0 2023-05-17T15:05:44.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.849+0000 7f60adffb700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f609c05ecf0 0x7f609c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:44.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.849+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6934+0+0 (secure 0 0 0) 0x7f60a8078f00 con 0x7f60b80c49d0 2023-05-17T15:05:44.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.849+0000 7f60bd9de700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f609c05ecf0 0x7f609c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:44.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.850+0000 7f60bd9de700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f609c05ecf0 0x7f609c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f60b4009130 tx=0x7f60b4017000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:44.853+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60a80488f0 con 0x7f60b80c49d0 2023-05-17T15:05:45.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.067+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60b80c3ef0 con 0x7f60b80c49d0 2023-05-17T15:05:45.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.068+0000 7f60adffb700 1 -- 172.21.15.27:0/1081361861 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4480 (secure 0 0 0) 0x7f60a804a2c0 con 0x7f60b80c49d0 2023-05-17T15:05:45.072 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:45.072 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:54:39.094710+0000","modified":"2023-05-17T14:54:42.101891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6836/149717180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":149717180},{"type":"v1","addr":"172.21.15.27:6836","nonce":149717180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-17T15:05:45.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f609c05ecf0 msgr2=0x7f609c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f609c05ecf0 0x7f609c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f60b4009130 tx=0x7f60b4017000).stop 2023-05-17T15:05:45.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 msgr2=0x7f60b8150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 0x7f60b8150350 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f60a800c440 tx=0x7f60a8007de0).stop 2023-05-17T15:05:45.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 shutdown_connections 2023-05-17T15:05:45.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f609c05ecf0 0x7f609c0611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8153e40 0x7f60b8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b8065af0 0x7f60b8151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 --2- 172.21.15.27:0/1081361861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60b80c49d0 0x7f60b8150350 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 >> 172.21.15.27:0/1081361861 conn(0x7f60b80c9560 msgr2=0x7f60b80abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:45.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 shutdown_connections 2023-05-17T15:05:45.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.070+0000 7f60bfc42700 1 -- 172.21.15.27:0/1081361861 wait complete. 2023-05-17T15:05:45.076 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2023-05-17T15:05:45.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:05:45.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 Processor -- start 2023-05-17T15:05:45.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 -- start start 2023-05-17T15:05:45.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa7d00c5f30 0x7fa7d00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d0158880 0x7fa7d0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7d01541c0 0x7fa7d00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00bfcd0 con 0x7fa7d01541c0 2023-05-17T15:05:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00c0290 con 0x7fa7d00c5f30 2023-05-17T15:05:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.198+0000 7fa7d70fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00aa1a0 con 0x7fa7d0158880 2023-05-17T15:05:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7d01541c0 0x7fa7d00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7d01541c0 0x7fa7d00c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36910/0 (socket says 172.21.15.27:36910) 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 -- 172.21.15.27:0/2209515778 learned_addr learned my addr 172.21.15.27:0/2209515778 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7cffff700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d0158880 0x7fa7d0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d4e96700 1 --2- 172.21.15.27:0/2209515778 >> v2:172.21.15.40:3300/0 conn(0x7fa7d00c5f30 0x7fa7d00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 -- 172.21.15.27:0/2209515778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d0158880 msgr2=0x7fa7d0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d0158880 0x7fa7d0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 -- 172.21.15.27:0/2209515778 >> v2:172.21.15.40:3300/0 conn(0x7fa7d00c5f30 msgr2=0x7fa7d00c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:45.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 --2- 172.21.15.27:0/2209515778 >> v2:172.21.15.40:3300/0 conn(0x7fa7d00c5f30 0x7fa7d00c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 -- 172.21.15.27:0/2209515778 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00aa480 con 0x7fa7d01541c0 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d4e96700 1 --2- 172.21.15.27:0/2209515778 >> v2:172.21.15.40:3300/0 conn(0x7fa7d00c5f30 0x7fa7d00c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7cffff700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d0158880 0x7fa7d0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7d5697700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d00c7480 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa7d0083a50 tx=0x7fa7b80090f0).ready entity=mon.0 client_cookie=3dab7eb8956c0f09 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7cf7fe700 1 -- 172.21.15.27:0/2209515778 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800b600 con 0x7fa7d01541c0 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7cf7fe700 1 -- 172.21.15.27:0/2209515778 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b800b760 con 0x7fa7d01541c0 2023-05-17T15:05:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.199+0000 7fa7cf7fe700 1 -- 172.21.15.27:0/2209515778 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800bae0 con 0x7fa7d01541c0 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 -- 172.21.15.27:0/2209515778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 msgr2=0x7fa7d00c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d00c7480 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa7d0083a50 tx=0x7fa7b80090f0).stop 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 -- 172.21.15.27:0/2209515778 shutdown_connections 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d00c7480 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/2209515778 >> v2:172.21.15.40:3300/0 conn(0x7fa7d00c5f30 0x7fa7d00c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/2209515778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d0158880 0x7fa7d0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 -- 172.21.15.27:0/2209515778 >> 172.21.15.27:0/2209515778 conn(0x7fa7d0069e70 msgr2=0x7fa7d005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 -- 172.21.15.27:0/2209515778 shutdown_connections 2023-05-17T15:05:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.200+0000 7fa7d70fa700 1 -- 172.21.15.27:0/2209515778 wait complete. 2023-05-17T15:05:45.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.201+0000 7fa7d70fa700 1 Processor -- start 2023-05-17T15:05:45.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.201+0000 7fa7d70fa700 1 -- start start 2023-05-17T15:05:45.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d70fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d00c5f30 0x7fa7d00c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d70fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d70fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7d0158880 0x7fa7d0140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d70fa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0151af0 con 0x7fa7d01541c0 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d70fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c3a30 con 0x7fa7d0158880 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d70fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0150700 con 0x7fa7d00c5f30 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d0151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36914/0 (socket says 172.21.15.27:36914) 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 -- 172.21.15.27:0/3762874533 learned_addr learned my addr 172.21.15.27:0/3762874533 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d5697700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7d0158880 0x7fa7d0140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d4e96700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d00c5f30 0x7fa7d00c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 -- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d00c5f30 msgr2=0x7fa7d00c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d00c5f30 0x7fa7d00c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 -- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7d0158880 msgr2=0x7fa7d0140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7d0158880 0x7fa7d0140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 -- 172.21.15.27:0/3762874533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8009370 con 0x7fa7d01541c0 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d4e96700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d00c5f30 0x7fa7d00c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7d5697700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7d0158880 0x7fa7d0140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:45.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.202+0000 7fa7cffff700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d0151f80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fa7c000d8c0 tx=0x7fa7c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.203+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00095b0 con 0x7fa7d01541c0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.203+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0009710 con 0x7fa7d01541c0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.203+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d01514a0 con 0x7fa7d01541c0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.203+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0009a90 con 0x7fa7d01541c0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.203+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d0152470 con 0x7fa7d01541c0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.203+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0151ca0 con 0x7fa7d01541c0 2023-05-17T15:05:45.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.204+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fa7c0013480 con 0x7fa7d01541c0 2023-05-17T15:05:45.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.204+0000 7fa7ccff9700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7b005ecf0 0x7fa7b00611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.204+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6934+0+0 (secure 0 0 0) 0x7fa7c0079c10 con 0x7fa7d01541c0 2023-05-17T15:05:45.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.204+0000 7fa7d4e96700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7b005ecf0 0x7fa7b00611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.205+0000 7fa7d4e96700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7b005ecf0 0x7fa7b00611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa7c80076e0 tx=0x7fa7c80098f0).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.208+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7d0151ca0 con 0x7fa7d01541c0 2023-05-17T15:05:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.424+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d0151ca0 con 0x7fa7d01541c0 2023-05-17T15:05:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.425+0000 7fa7ccff9700 1 -- 172.21.15.27:0/3762874533 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4480 (secure 0 0 0) 0x7fa7d0151ca0 con 0x7fa7d01541c0 2023-05-17T15:05:45.429 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:45.429 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T14:54:39.094710+0000","modified":"2023-05-17T14:54:42.101891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6836/149717180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":149717180},{"type":"v1","addr":"172.21.15.27:6836","nonce":149717180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-17T15:05:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7b005ecf0 msgr2=0x7fa7b00611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7b005ecf0 0x7fa7b00611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa7c80076e0 tx=0x7fa7c80098f0).stop 2023-05-17T15:05:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 msgr2=0x7fa7d0151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d0151f80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fa7c000d8c0 tx=0x7fa7c0008040).stop 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 shutdown_connections 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa7b005ecf0 0x7fa7b00611b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7d0158880 0x7fa7d0140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7d00c5f30 0x7fa7d00c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 --2- 172.21.15.27:0/3762874533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d01541c0 0x7fa7d0151f80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.426+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 >> 172.21.15.27:0/3762874533 conn(0x7fa7d0069e70 msgr2=0x7fa7d00add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:45.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.427+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 shutdown_connections 2023-05-17T15:05:45.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.427+0000 7fa7d70fa700 1 -- 172.21.15.27:0/3762874533 wait complete. 2023-05-17T15:05:45.432 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2023-05-17T15:05:45.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:05:45.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.555+0000 7f36ac527700 1 Processor -- start 2023-05-17T15:05:45.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.555+0000 7f36ac527700 1 -- start start 2023-05-17T15:05:45.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.556+0000 7f36ac527700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 0x7f36a4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.556+0000 7f36ac527700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 0x7f36a40c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.556+0000 7f36ac527700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a40bfcd0 con 0x7f36a40c5f30 2023-05-17T15:05:45.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.556+0000 7f36ac527700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a40c0290 con 0x7f36a41541c0 2023-05-17T15:05:45.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.556+0000 7f36ac527700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40aa1a0 con 0x7f36a40c6310 2023-05-17T15:05:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36aaac4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 0x7f36a40c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 0x7f36a4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 0x7f36a4153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:38032/0 (socket says 172.21.15.27:38032) 2023-05-17T15:05:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36aa2c3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f36a40c5f30 0x7f36a4158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:42484/0 (socket says 172.21.15.27:42484) 2023-05-17T15:05:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36aaac4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 0x7f36a40c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:54852/0 (socket says 172.21.15.27:54852) 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36aa2c3700 1 -- 172.21.15.27:0/2019174432 learned_addr learned my addr 172.21.15.27:0/2019174432 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 -- 172.21.15.27:0/2019174432 >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 msgr2=0x7f36a40c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 --2- 172.21.15.27:0/2019174432 >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 0x7f36a40c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 -- 172.21.15.27:0/2019174432 >> v1:172.21.15.40:6789/0 conn(0x7f36a40c5f30 legacy=0x7f36a4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 -- 172.21.15.27:0/2019174432 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a40aa480 con 0x7f36a40c6310 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36aaac4700 1 --2- 172.21.15.27:0/2019174432 >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 0x7f36a40c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a9ac2700 1 --2- 172.21.15.27:0/2019174432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 0x7f36a4153cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3698009760 tx=0x7f3698009060).ready entity=mon.2 client_cookie=e199ff6a843b0dd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a92c1700 1 -- 172.21.15.27:0/2019174432 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800f510 con 0x7f36a40c6310 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a92c1700 1 -- 172.21.15.27:0/2019174432 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800f670 con 0x7f36a40c6310 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.557+0000 7f36a92c1700 1 -- 172.21.15.27:0/2019174432 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800f9f0 con 0x7f36a40c6310 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 -- 172.21.15.27:0/2019174432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 msgr2=0x7f36a4153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 --2- 172.21.15.27:0/2019174432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 0x7f36a4153cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3698009760 tx=0x7f3698009060).stop 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 -- 172.21.15.27:0/2019174432 shutdown_connections 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 --2- 172.21.15.27:0/2019174432 >> v2:172.21.15.40:3300/0 conn(0x7f36a41541c0 0x7f36a40c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 --2- 172.21.15.27:0/2019174432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c6310 0x7f36a4153cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 -- 172.21.15.27:0/2019174432 >> 172.21.15.27:0/2019174432 conn(0x7f36a4069e70 msgr2=0x7f36a405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:45.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 -- 172.21.15.27:0/2019174432 shutdown_connections 2023-05-17T15:05:45.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.558+0000 7f36ac527700 1 -- 172.21.15.27:0/2019174432 wait complete. 2023-05-17T15:05:45.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.559+0000 7f36ac527700 1 Processor -- start 2023-05-17T15:05:45.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.559+0000 7f36ac527700 1 -- start start 2023-05-17T15:05:45.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36ac527700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c5f30 0x7f36a414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36ac527700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 0x7f36a4151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36ac527700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36a41541c0 0x7f36a41520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36ac527700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4156fe0 con 0x7f36a40c6310 2023-05-17T15:05:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36ac527700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4155ae0 con 0x7f36a41541c0 2023-05-17T15:05:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36ac527700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4157860 con 0x7f36a40c5f30 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 0x7f36a4151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 0x7f36a4151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36926/0 (socket says 172.21.15.27:36926) 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 -- 172.21.15.27:0/3569662344 learned_addr learned my addr 172.21.15.27:0/3569662344 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36aa2c3700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c5f30 0x7f36a414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36aaac4700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36a41541c0 0x7f36a41520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 -- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c5f30 msgr2=0x7f36a414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c5f30 0x7f36a414f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 -- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36a41541c0 msgr2=0x7f36a41520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36a41541c0 0x7f36a41520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 -- 172.21.15.27:0/3569662344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009a20 con 0x7f36a40c6310 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a9ac2700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 0x7f36a4151bf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f369800f590 tx=0x7f3698017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.560+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800f7e0 con 0x7f36a40c6310 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.561+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800f940 con 0x7f36a40c6310 2023-05-17T15:05:45.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.561+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36980092a0 con 0x7f36a40c6310 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.561+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369801b660 con 0x7f36a40c6310 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.561+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a4157210 con 0x7f36a40c6310 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.561+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a405f4a0 con 0x7f36a40c6310 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.562+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f369800f070 con 0x7f36a40c6310 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.562+0000 7f36a27fc700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f369005ecf0 0x7f36900611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.562+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6890+0+0 (secure 0 0 0) 0x7f369807b680 con 0x7f36a40c6310 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.562+0000 7f36aa2c3700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f369005ecf0 0x7f36900611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.563+0000 7f36aa2c3700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f369005ecf0 0x7f36900611b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f369c000c00 tx=0x7f369c009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.566+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f369804ca70 con 0x7f36a40c6310 2023-05-17T15:05:45.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.619+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3698079320 con 0x7f36a40c6310 2023-05-17T15:05:45.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.740+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a406bdf0 con 0x7f36a40c6310 2023-05-17T15:05:45.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.741+0000 7f36a27fc700 1 -- 172.21.15.27:0/3569662344 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18091 (secure 0 0 0) 0x7f3698028090 con 0x7f36a40c6310 2023-05-17T15:05:45.746 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:45.746 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":53,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:45.344990+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-17T14:54:37.248347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-17T14:54:38.064177+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1117017077":"2023-05-18T15:05:43.311577+0000","172.21.15.27:0/3834618831":"2023-05-18T15:05:43.311577+0000","172.21.15.27:0/74438321":"2023-05-18T15:05:43.311577+0000","172.21.15.27:6832/86332":"2023-05-18T14:54:51.513720+0000","172.21.15.27:0/1880994171":"2023-05-18T14:54:51.513720+0000","172.21.15.27:0/1898448746":"2023-05-18T15:05:43.311577+0000","172.21.15.27:0/3516131969":"2023-05-18T14:54:51.513720+0000","172.21.15.27:6833/86332":"2023-05-18T14:54:51.513720+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":6,"length":1},{"begin":10,"length":1},{"begin":16,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":57,"length":1},{"begin":61,"length":1},{"begin":67,"length":1},{"begin":71,"length":1},{"begin":77,"length":1},{"begin":81,"length":1},{"begin":87,"length":1},{"begin":91,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:05:45.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f369005ecf0 msgr2=0x7f36900611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f369005ecf0 0x7f36900611b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f369c000c00 tx=0x7f369c009040).stop 2023-05-17T15:05:45.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 msgr2=0x7f36a4151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 0x7f36a4151bf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f369800f590 tx=0x7f3698017000).stop 2023-05-17T15:05:45.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 shutdown_connections 2023-05-17T15:05:45.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f369005ecf0 0x7f36900611b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36a41541c0 0x7f36a41520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36a40c5f30 0x7f36a414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 --2- 172.21.15.27:0/3569662344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36a40c6310 0x7f36a4151bf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 >> 172.21.15.27:0/3569662344 conn(0x7f36a4069e70 msgr2=0x7f36a40acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:45.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 shutdown_connections 2023-05-17T15:05:45.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.743+0000 7f36ac527700 1 -- 172.21.15.27:0/3569662344 wait complete. 2023-05-17T15:05:45.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:05:45.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.871+0000 7f337385a700 1 Processor -- start 2023-05-17T15:05:45.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f337385a700 1 -- start start 2023-05-17T15:05:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f337385a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f336c069610 0x7f336c15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f337385a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c0c5a50 con 0x7f336c154090 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f337385a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c0c04e0 con 0x7f336c154470 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f337385a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c069fa0 con 0x7f336c069610 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f33715f6700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f336c154090 0x7f336c0cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36494/0 (socket says 172.21.15.27:36494) 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.872+0000 7f33715f6700 1 -- 172.21.15.27:0/1117475355 learned_addr learned my addr 172.21.15.27:0/1117475355 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111785668 0 0) 0x7f336c0c5a50 con 0x7f336c154090 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33540033f0 con 0x7f336c154090 2023-05-17T15:05:45.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f3371df7700 1 --2- 172.21.15.27:0/1117475355 >> v2:172.21.15.40:3300/0 conn(0x7f336c069610 0x7f336c15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320203856 0 0) 0x7f33540033f0 con 0x7f336c154090 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 >> v2:172.21.15.40:3300/0 conn(0x7f336c069610 msgr2=0x7f336c15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 --2- 172.21.15.27:0/1117475355 >> v2:172.21.15.40:3300/0 conn(0x7f336c069610 0x7f336c15ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 >> v1:172.21.15.40:6789/0 conn(0x7f336c154470 legacy=0x7f336c068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0c0760 con 0x7f336c154090 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f3364001470 con 0x7f336c154090 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 >> v1:172.21.15.27:6789/0 conn(0x7f336c154090 legacy=0x7f336c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33540038e0 0x7f3354003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3354004690 0x7f3354004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3354005000 0x7f335400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c069fa0 con 0x7f33540038e0 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335400beb0 con 0x7f3354005000 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335400c070 con 0x7f3354004690 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f33715f6700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33540038e0 0x7f3354003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f3371df7700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3354005000 0x7f335400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f3370df5700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3354004690 0x7f3354004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f33715f6700 1 -- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3354004690 msgr2=0x7f3354004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f33715f6700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3354004690 0x7f3354004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f33715f6700 1 -- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3354005000 msgr2=0x7f335400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f33715f6700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3354005000 0x7f335400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f33715f6700 1 -- 172.21.15.27:0/1117475355 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540033f0 con 0x7f33540038e0 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f3371df7700 1 -- 172.21.15.27:0/1117475355 reap_dead start 2023-05-17T15:05:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.873+0000 7f3370df5700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3354004690 0x7f3354004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:45.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f33715f6700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33540038e0 0x7f3354003d00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f336400c160 tx=0x7f336c0c1030).ready entity=mon.0 client_cookie=a486f2691d10834e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400ca10 con 0x7f33540038e0 2023-05-17T15:05:45.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400cb70 con 0x7f33540038e0 2023-05-17T15:05:45.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f336bfff700 1 -- 172.21.15.27:0/1117475355 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33640070d0 con 0x7f33540038e0 2023-05-17T15:05:45.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 -- 172.21.15.27:0/1117475355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33540038e0 msgr2=0x7f3354003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33540038e0 0x7f3354003d00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f336400c160 tx=0x7f336c0c1030).stop 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 -- 172.21.15.27:0/1117475355 shutdown_connections 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 --2- 172.21.15.27:0/1117475355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33540038e0 0x7f3354003d00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 -- 172.21.15.27:0/1117475355 >> 172.21.15.27:0/1117475355 conn(0x7f336c05e7e0 msgr2=0x7f336c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 -- 172.21.15.27:0/1117475355 shutdown_connections 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.874+0000 7f337385a700 1 -- 172.21.15.27:0/1117475355 wait complete. 2023-05-17T15:05:45.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.875+0000 7f337385a700 1 Processor -- start 2023-05-17T15:05:45.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.875+0000 7f337385a700 1 -- start start 2023-05-17T15:05:45.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f337385a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33540038e0 0x7f336c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f337385a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f336c152e90 0x7f336c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f337385a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 0x7f336c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f337385a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c155350 con 0x7f336c155d50 2023-05-17T15:05:45.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f337385a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c152180 con 0x7f336c152e90 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f337385a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c151570 con 0x7f33540038e0 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f3371df7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 0x7f336c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f3371df7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 0x7f336c1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36946/0 (socket says 172.21.15.27:36946) 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.876+0000 7f3371df7700 1 -- 172.21.15.27:0/2466542791 learned_addr learned my addr 172.21.15.27:0/2466542791 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f33715f6700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33540038e0 0x7f336c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3370df5700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f336c152e90 0x7f336c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3371df7700 1 -- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33540038e0 msgr2=0x7f336c150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3371df7700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33540038e0 0x7f336c150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3371df7700 1 -- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f336c152e90 msgr2=0x7f336c155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3371df7700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f336c152e90 0x7f336c155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3371df7700 1 -- 172.21.15.27:0/2466542791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c151850 con 0x7f336c155d50 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3370df5700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f336c152e90 0x7f336c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f33715f6700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33540038e0 0x7f336c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f3371df7700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 0x7f336c1561d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f335c0094d0 tx=0x7f335c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00e040 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00f040 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c151b30 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00fe50 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.877+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c1566c0 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.878+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c06c350 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.878+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f335c015660 con 0x7f336c155d50 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.879+0000 7f33697fa700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f335805ee20 0x7f33580612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:45.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.879+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6890+0+0 (secure 0 0 0) 0x7f335c07abd0 con 0x7f336c155d50 2023-05-17T15:05:45.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.879+0000 7f33715f6700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f335805ee20 0x7f33580612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:45.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.879+0000 7f33715f6700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f335805ee20 0x7f33580612e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f336400c160 tx=0x7f3364015000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:45.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:45.883+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f335c04be50 con 0x7f336c155d50 2023-05-17T15:05:46.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.104+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f336c068ae0 con 0x7f336c155d50 2023-05-17T15:05:46.619 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:05:46.615+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:05:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.618+0000 7f33697fa700 1 -- 172.21.15.27:0/2466542791 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f335c04f470 con 0x7f336c155d50 2023-05-17T15:05:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.621+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f335805ee20 msgr2=0x7f33580612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.621+0000 7f337385a700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f335805ee20 0x7f33580612e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f336400c160 tx=0x7f3364015000).stop 2023-05-17T15:05:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 msgr2=0x7f336c1561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 0x7f336c1561d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f335c0094d0 tx=0x7f335c00b040).stop 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 shutdown_connections 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f335805ee20 0x7f33580612e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f336c155d50 0x7f336c1561d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33540038e0 0x7f336c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 --2- 172.21.15.27:0/2466542791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f336c152e90 0x7f336c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 >> 172.21.15.27:0/2466542791 conn(0x7f336c05e7e0 msgr2=0x7f336c068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 shutdown_connections 2023-05-17T15:05:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.622+0000 7f337385a700 1 -- 172.21.15.27:0/2466542791 wait complete. 2023-05-17T15:05:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:05:46.642 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:05:46.663 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:05:46.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.758+0000 7facd93e9700 1 Processor -- start 2023-05-17T15:05:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.758+0000 7facd93e9700 1 -- start start 2023-05-17T15:05:46.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd93e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 0x7facd40cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd93e9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd4158010 con 0x7facd40cac00 2023-05-17T15:05:46.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd93e9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd41582f0 con 0x7facd4157980 2023-05-17T15:05:46.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd3fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7facd40cac00 0x7facd41537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36524/0 (socket says 172.21.15.27:36524) 2023-05-17T15:05:46.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd3fff700 1 -- 172.21.15.27:0/3139101089 learned_addr learned my addr 172.21.15.27:0/3139101089 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd93e9700 1 -- 172.21.15.27:0/3139101089 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd41588b0 con 0x7facd4153ef0 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd37fe700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 0x7facd40cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539412238 0 0) 0x7facd4158010 con 0x7facd40cac00 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facbc0033f0 con 0x7facd40cac00 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856388730 0 0) 0x7facd41582f0 con 0x7facd4157980 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd4158010 con 0x7facd4157980 2023-05-17T15:05:46.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127124274 0 0) 0x7facbc0033f0 con 0x7facd40cac00 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 msgr2=0x7facd40cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 0x7facd40cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 >> v1:172.21.15.40:6789/0 conn(0x7facd4157980 legacy=0x7facd40c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.759+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd41585d0 con 0x7facd40cac00 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7facc4001470 con 0x7facd40cac00 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 >> v1:172.21.15.27:6789/0 conn(0x7facd40cac00 legacy=0x7facd41537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 0x7facbc003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facbc003fb0 0x7facbc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc004b80 0x7facbc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd41588b0 con 0x7facbc003fb0 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc00b990 con 0x7facbc004b80 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc00bb50 con 0x7facd4153ef0 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facbc003fb0 0x7facbc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd3fff700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 0x7facbc003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd8be8700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc004b80 0x7facbc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 -- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 msgr2=0x7facbc003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd4153ef0 0x7facbc003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 -- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc004b80 msgr2=0x7facbc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc004b80 0x7facbc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 -- 172.21.15.27:0/3139101089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0033f0 con 0x7facbc003fb0 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd37fe700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facbc003fb0 0x7facbc004690 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7facc8009a80 tx=0x7facc8009060).ready entity=mon.0 client_cookie=d5020f36a064b43c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8009430 con 0x7facbc003fb0 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800e640 con 0x7facbc003fb0 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.760+0000 7facd2ffd700 1 -- 172.21.15.27:0/3139101089 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc800e9c0 con 0x7facbc003fb0 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd93e9700 1 -- 172.21.15.27:0/3139101089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facbc003fb0 msgr2=0x7facbc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd93e9700 1 --2- 172.21.15.27:0/3139101089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facbc003fb0 0x7facbc004690 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7facc8009a80 tx=0x7facc8009060).stop 2023-05-17T15:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd8be8700 1 -- 172.21.15.27:0/3139101089 reap_dead start 2023-05-17T15:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd93e9700 1 -- 172.21.15.27:0/3139101089 shutdown_connections 2023-05-17T15:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd93e9700 1 -- 172.21.15.27:0/3139101089 >> 172.21.15.27:0/3139101089 conn(0x7facd405dd50 msgr2=0x7facd405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd93e9700 1 -- 172.21.15.27:0/3139101089 shutdown_connections 2023-05-17T15:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.761+0000 7facd93e9700 1 -- 172.21.15.27:0/3139101089 wait complete. 2023-05-17T15:05:46.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.762+0000 7facd93e9700 1 Processor -- start 2023-05-17T15:05:46.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.762+0000 7facd93e9700 1 -- start start 2023-05-17T15:05:46.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd93e9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc003fb0 0x7facd413db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd93e9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 0x7facd40c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd93e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd413e440 0x7facd413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd93e9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd413edb0 con 0x7facd40c3950 2023-05-17T15:05:46.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd93e9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c34c0 con 0x7facbc003fb0 2023-05-17T15:05:46.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd93e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c28b0 con 0x7facd413e440 2023-05-17T15:05:46.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 0x7facd40c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 0x7facd40c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36976/0 (socket says 172.21.15.27:36976) 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 -- 172.21.15.27:0/3151190488 learned_addr learned my addr 172.21.15.27:0/3151190488 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd3fff700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc003fb0 0x7facd413db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd8be8700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd413e440 0x7facd413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 -- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd413e440 msgr2=0x7facd413e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd413e440 0x7facd413e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 -- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc003fb0 msgr2=0x7facd413db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc003fb0 0x7facd413db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 -- 172.21.15.27:0/3151190488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40c2b90 con 0x7facd40c3950 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd3fff700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc003fb0 0x7facd413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.763+0000 7facd37fe700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 0x7facd40c3dd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7facbc005650 tx=0x7facc801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.764+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8000cb0 con 0x7facd40c3950 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.764+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800e7b0 con 0x7facd40c3950 2023-05-17T15:05:46.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.764+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40c2e70 con 0x7facd40c3950 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.764+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8026440 con 0x7facd40c3950 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.764+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd413e070 con 0x7facd40c3950 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.765+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd4047150 con 0x7facd40c3950 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.765+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7facc802c020 con 0x7facd40c3950 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.765+0000 7facbbfff700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facc005ee20 0x7facc00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.765+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6976+0+0 (secure 0 0 0) 0x7facc807ba00 con 0x7facd40c3950 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.765+0000 7facd3fff700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facc005ee20 0x7facc00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:46.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.766+0000 7facd3fff700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facc005ee20 0x7facc00612e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7facc4000e10 tx=0x7facc4009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:46.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.769+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7facc804cc30 con 0x7facd40c3950 2023-05-17T15:05:46.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:46.988+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7facd40c4a00 con 0x7facd40c3950 2023-05-17T15:05:47.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.619+0000 7facbbfff700 1 -- 172.21.15.27:0/3151190488 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7facc8050250 con 0x7facd40c3950 2023-05-17T15:05:47.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facc005ee20 msgr2=0x7facc00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facc005ee20 0x7facc00612e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7facc4000e10 tx=0x7facc4009040).stop 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 msgr2=0x7facd40c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 0x7facd40c3dd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7facbc005650 tx=0x7facc801a000).stop 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 shutdown_connections 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facc005ee20 0x7facc00612e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7facd413e440 0x7facd413e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facbc003fb0 0x7facd413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 --2- 172.21.15.27:0/3151190488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facd40c3950 0x7facd40c3dd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 >> 172.21.15.27:0/3151190488 conn(0x7facd405dd50 msgr2=0x7facd4151060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:47.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 shutdown_connections 2023-05-17T15:05:47.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.622+0000 7facd93e9700 1 -- 172.21.15.27:0/3151190488 wait complete. 2023-05-17T15:05:47.639 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:05:47.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.797+0000 7fc3e9829700 1 Processor -- start 2023-05-17T15:05:47.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.797+0000 7fc3e9829700 1 -- start start 2023-05-17T15:05:47.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e9829700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3e4151c90 0x7fc3e4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:47.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e9829700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3e40c0520 0x7fc3e4081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:47.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e9829700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e4158010 con 0x7fc3e4154980 2023-05-17T15:05:47.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e9829700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e4154f60 con 0x7fc3e40c0520 2023-05-17T15:05:47.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e9829700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e4155240 con 0x7fc3e4151c90 2023-05-17T15:05:47.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3e40c0520 0x7fc3e4081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:47.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e27fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc3e4154980 0x7fc3e40c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36548/0 (socket says 172.21.15.27:36548) 2023-05-17T15:05:47.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc3e40c0520 0x7fc3e4081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36988/0 (socket says 172.21.15.27:36988) 2023-05-17T15:05:47.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e27fc700 1 -- 172.21.15.27:0/2717302674 learned_addr learned my addr 172.21.15.27:0/2717302674 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:47.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e2ffd700 1 --2- 172.21.15.27:0/2717302674 >> v2:172.21.15.40:3300/0 conn(0x7fc3e4151c90 0x7fc3e4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:47.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e37fe700 1 -- 172.21.15.27:0/2717302674 >> v2:172.21.15.40:3300/0 conn(0x7fc3e4151c90 msgr2=0x7fc3e4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e37fe700 1 --2- 172.21.15.27:0/2717302674 >> v2:172.21.15.40:3300/0 conn(0x7fc3e4151c90 0x7fc3e4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e37fe700 1 -- 172.21.15.27:0/2717302674 >> v1:172.21.15.27:6789/0 conn(0x7fc3e4154980 legacy=0x7fc3e40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e37fe700 1 -- 172.21.15.27:0/2717302674 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4155520 con 0x7fc3e40c0520 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.798+0000 7fc3e1ffb700 1 -- 172.21.15.27:0/2717302674 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434033516 0 0) 0x7fc3e4158010 con 0x7fc3e4154980 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e2ffd700 1 --2- 172.21.15.27:0/2717302674 >> v2:172.21.15.40:3300/0 conn(0x7fc3e4151c90 0x7fc3e4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e37fe700 1 --2- 172.21.15.27:0/2717302674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40c0520 0x7fc3e4081fd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc3e4084120 tx=0x7fc3d4009060).ready entity=mon.0 client_cookie=971afcfb7d4439bd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:47.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e1ffb700 1 -- 172.21.15.27:0/2717302674 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400b580 con 0x7fc3e40c0520 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e1ffb700 1 -- 172.21.15.27:0/2717302674 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400b6e0 con 0x7fc3e40c0520 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e1ffb700 1 -- 172.21.15.27:0/2717302674 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400ba60 con 0x7fc3e40c0520 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 -- 172.21.15.27:0/2717302674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40c0520 msgr2=0x7fc3e4081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 --2- 172.21.15.27:0/2717302674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40c0520 0x7fc3e4081fd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc3e4084120 tx=0x7fc3d4009060).stop 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 -- 172.21.15.27:0/2717302674 shutdown_connections 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 --2- 172.21.15.27:0/2717302674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e40c0520 0x7fc3e4081fd0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 --2- 172.21.15.27:0/2717302674 >> v2:172.21.15.40:3300/0 conn(0x7fc3e4151c90 0x7fc3e4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 -- 172.21.15.27:0/2717302674 >> 172.21.15.27:0/2717302674 conn(0x7fc3e40cae10 msgr2=0x7fc3e40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:47.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 -- 172.21.15.27:0/2717302674 shutdown_connections 2023-05-17T15:05:47.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.799+0000 7fc3e9829700 1 -- 172.21.15.27:0/2717302674 wait complete. 2023-05-17T15:05:47.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 Processor -- start 2023-05-17T15:05:47.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 -- start start 2023-05-17T15:05:47.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e40c0520 0x7fc3e40c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:47.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e4151c90 0x7fc3e40c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 0x7fc3e414fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c4830 con 0x7fc3e4154980 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40af4c0 con 0x7fc3e40c0520 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.801+0000 7fc3e9829700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4150de0 con 0x7fc3e4151c90 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 0x7fc3e414fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 0x7fc3e414fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36994/0 (socket says 172.21.15.27:36994) 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 -- 172.21.15.27:0/4103241746 learned_addr learned my addr 172.21.15.27:0/4103241746 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:47.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e27fc700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e4151c90 0x7fc3e40c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e2ffd700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e40c0520 0x7fc3e40c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 -- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e4151c90 msgr2=0x7fc3e40c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e4151c90 0x7fc3e40c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 -- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e40c0520 msgr2=0x7fc3e40c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e40c0520 0x7fc3e40c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 -- 172.21.15.27:0/4103241746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d40092a0 con 0x7fc3e4154980 2023-05-17T15:05:47.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e37fe700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 0x7fc3e414fde0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fc3d4009fd0 tx=0x7fc3d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400b850 con 0x7fc3e4154980 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400b9b0 con 0x7fc3e4154980 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e40c4a20 con 0x7fc3e4154980 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d401b660 con 0x7fc3e4154980 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.802+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e40af150 con 0x7fc3e4154980 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.803+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e406bdf0 con 0x7fc3e4154980 2023-05-17T15:05:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.803+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc3d400f070 con 0x7fc3e4154980 2023-05-17T15:05:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.804+0000 7fc3daffd700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc3c405ee20 0x7fc3c40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.804+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6976+0+0 (secure 0 0 0) 0x7fc3d407bc20 con 0x7fc3e4154980 2023-05-17T15:05:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.804+0000 7fc3e2ffd700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc3c405ee20 0x7fc3c40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.804+0000 7fc3e2ffd700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc3c405ee20 0x7fc3c40612e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc3dc0094d0 tx=0x7fc3dc00b040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.808+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3d404cef0 con 0x7fc3e4154980 2023-05-17T15:05:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:47.981+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc3e4154760 con 0x7fc3e4154980 2023-05-17T15:05:48.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.681+0000 7fc3daffd700 1 -- 172.21.15.27:0/4103241746 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc3d4050510 con 0x7fc3e4154980 2023-05-17T15:05:48.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.684+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc3c405ee20 msgr2=0x7fc3c40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:48.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.684+0000 7fc3e9829700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc3c405ee20 0x7fc3c40612e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc3dc0094d0 tx=0x7fc3dc00b040).stop 2023-05-17T15:05:48.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 msgr2=0x7fc3e414fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:48.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 0x7fc3e414fde0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fc3d4009fd0 tx=0x7fc3d4017000).stop 2023-05-17T15:05:48.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 shutdown_connections 2023-05-17T15:05:48.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc3c405ee20 0x7fc3c40612e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc3e4154980 0x7fc3e414fde0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e40c0520 0x7fc3e40c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 --2- 172.21.15.27:0/4103241746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e4151c90 0x7fc3e40c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.685+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 >> 172.21.15.27:0/4103241746 conn(0x7fc3e40cae10 msgr2=0x7fc3e40c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.686+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 shutdown_connections 2023-05-17T15:05:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.686+0000 7fc3e9829700 1 -- 172.21.15.27:0/4103241746 wait complete. 2023-05-17T15:05:48.691 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:05:48.704 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:05:48.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 Processor -- start 2023-05-17T15:05:48.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 -- start start 2023-05-17T15:05:48.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1fd8153f80 0x7f1fd8064cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:48.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd805e460 0x7f1fd80c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:48.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd8063f70 con 0x7f1fd80c50b0 2023-05-17T15:05:48.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd80bdcc0 con 0x7f1fd8153f80 2023-05-17T15:05:48.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.824+0000 7f1fdeb42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8158980 con 0x7f1fd805e460 2023-05-17T15:05:48.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdc8de700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1fd8153f80 0x7f1fd8064cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:48.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fd7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1fd80c50b0 0x7f1fd805dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36562/0 (socket says 172.21.15.27:36562) 2023-05-17T15:05:48.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fd7fff700 1 -- 172.21.15.27:0/90833901 learned_addr learned my addr 172.21.15.27:0/90833901 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:48.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdd0df700 1 --2- 172.21.15.27:0/90833901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd805e460 0x7f1fd80c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:48.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdc8de700 1 -- 172.21.15.27:0/90833901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd805e460 msgr2=0x7f1fd80c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:48.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdc8de700 1 --2- 172.21.15.27:0/90833901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd805e460 0x7f1fd80c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdc8de700 1 -- 172.21.15.27:0/90833901 >> v1:172.21.15.27:6789/0 conn(0x7f1fd80c50b0 legacy=0x7f1fd805dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fd77fe700 1 -- 172.21.15.27:0/90833901 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769921917 0 0) 0x7f1fd8063f70 con 0x7f1fd80c50b0 2023-05-17T15:05:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdc8de700 1 -- 172.21.15.27:0/90833901 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8064210 con 0x7f1fd8153f80 2023-05-17T15:05:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fdc8de700 1 --2- 172.21.15.27:0/90833901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd8153f80 0x7f1fd8064cf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1fd0009e60 tx=0x7f1fd0009780).ready entity=mon.0 client_cookie=709fe680e12e600f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fd77fe700 1 -- 172.21.15.27:0/90833901 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000e070 con 0x7f1fd8153f80 2023-05-17T15:05:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fd77fe700 1 -- 172.21.15.27:0/90833901 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000bc30 con 0x7f1fd8153f80 2023-05-17T15:05:48.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.825+0000 7f1fd77fe700 1 -- 172.21.15.27:0/90833901 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0012410 con 0x7f1fd8153f80 2023-05-17T15:05:48.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 -- 172.21.15.27:0/90833901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd8153f80 msgr2=0x7f1fd8064cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:48.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/90833901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd8153f80 0x7f1fd8064cf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1fd0009e60 tx=0x7f1fd0009780).stop 2023-05-17T15:05:48.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 -- 172.21.15.27:0/90833901 shutdown_connections 2023-05-17T15:05:48.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/90833901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd805e460 0x7f1fd80c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/90833901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd8153f80 0x7f1fd8064cf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 -- 172.21.15.27:0/90833901 >> 172.21.15.27:0/90833901 conn(0x7f1fd80c84a0 msgr2=0x7f1fd80c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:48.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 -- 172.21.15.27:0/90833901 shutdown_connections 2023-05-17T15:05:48.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.826+0000 7f1fdeb42700 1 -- 172.21.15.27:0/90833901 wait complete. 2023-05-17T15:05:48.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.827+0000 7f1fdeb42700 1 Processor -- start 2023-05-17T15:05:48.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.827+0000 7f1fdeb42700 1 -- start start 2023-05-17T15:05:48.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdeb42700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 0x7f1fd814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:48.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdeb42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fd80c50b0 0x7f1fd80aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:48.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdeb42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd8153f80 0x7f1fd80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:48.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdeb42700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80ab360 con 0x7f1fd805e460 2023-05-17T15:05:48.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdeb42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8150c60 con 0x7f1fd80c50b0 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdeb42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80a8b50 con 0x7f1fd8153f80 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 0x7f1fd814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 0x7f1fd814d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37004/0 (socket says 172.21.15.27:37004) 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 -- 172.21.15.27:0/86756523 learned_addr learned my addr 172.21.15.27:0/86756523 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 -- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd8153f80 msgr2=0x7f1fd80aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fd7fff700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fd80c50b0 0x7f1fd80aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdd0df700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd8153f80 0x7f1fd80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd8153f80 0x7f1fd80aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 -- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fd80c50b0 msgr2=0x7f1fd80aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fd80c50b0 0x7f1fd80aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 -- 172.21.15.27:0/86756523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0009a20 con 0x7f1fd805e460 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fd7fff700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fd80c50b0 0x7f1fd80aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdd0df700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd8153f80 0x7f1fd80aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.828+0000 7f1fdc8de700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 0x7f1fd814d820 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f1fd000b6c0 tx=0x7f1fd0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.829+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd001d630 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.829+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd001d790 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.829+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd80a8e30 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.829+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd001db10 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.829+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd80a93f0 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.829+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd8150a30 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.830+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f1fd0026410 con 0x7f1fd805e460 2023-05-17T15:05:48.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.830+0000 7f1fd4ff9700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fb805ee20 0x7f1fb80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:48.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.830+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6538+0+0 (secure 0 0 0) 0x7f1fd007bf00 con 0x7f1fd805e460 2023-05-17T15:05:48.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.830+0000 7f1fd7fff700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fb805ee20 0x7f1fb80612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:48.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.831+0000 7f1fd7fff700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fb805ee20 0x7f1fb80612e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1fd8155e50 tx=0x7f1fc0009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:48.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:48.834+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1fd8150a30 con 0x7f1fd805e460 2023-05-17T15:05:49.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.012+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1fd8150a30 con 0x7f1fd805e460 2023-05-17T15:05:49.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.617+0000 7f1fd4ff9700 1 -- 172.21.15.27:0/86756523 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1fd8150a30 con 0x7f1fd805e460 2023-05-17T15:05:49.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fb805ee20 msgr2=0x7f1fb80612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fb805ee20 0x7f1fb80612e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1fd8155e50 tx=0x7f1fc0009040).stop 2023-05-17T15:05:49.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 msgr2=0x7f1fd814d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 0x7f1fd814d820 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f1fd000b6c0 tx=0x7f1fd0009780).stop 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 shutdown_connections 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f1fb805ee20 0x7f1fb80612e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1fd8153f80 0x7f1fd80aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1fd805e460 0x7f1fd814d820 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 --2- 172.21.15.27:0/86756523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fd80c50b0 0x7f1fd80aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 >> 172.21.15.27:0/86756523 conn(0x7f1fd80c84a0 msgr2=0x7f1fd8157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:49.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 shutdown_connections 2023-05-17T15:05:49.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.619+0000 7f1fdeb42700 1 -- 172.21.15.27:0/86756523 wait complete. 2023-05-17T15:05:49.625 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:05:49.637 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:05:49.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 Processor -- start 2023-05-17T15:05:49.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 -- start start 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7801543d0 0x7ff7800c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff780069410 0x7ff7800bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780158790 con 0x7ff7800c60f0 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7800c1c50 con 0x7ff780069410 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.755+0000 7ff786dbd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800c6570 con 0x7ff7801543d0 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff78535a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff780069410 0x7ff7800bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff77ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff7800c60f0 0x7ff780068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36574/0 (socket says 172.21.15.27:36574) 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff77ffff700 1 -- 172.21.15.27:0/2423955960 learned_addr learned my addr 172.21.15.27:0/2423955960 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff784b59700 1 --2- 172.21.15.27:0/2423955960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7801543d0 0x7ff7800c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff78535a700 1 -- 172.21.15.27:0/2423955960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7801543d0 msgr2=0x7ff7800c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff78535a700 1 --2- 172.21.15.27:0/2423955960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7801543d0 0x7ff7800c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff78535a700 1 -- 172.21.15.27:0/2423955960 >> v1:172.21.15.27:6789/0 conn(0x7ff7800c60f0 legacy=0x7ff780068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff77f7fe700 1 -- 172.21.15.27:0/2423955960 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090751006 0 0) 0x7ff780158790 con 0x7ff7800c60f0 2023-05-17T15:05:49.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff78535a700 1 -- 172.21.15.27:0/2423955960 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780157e60 con 0x7ff780069410 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff78535a700 1 --2- 172.21.15.27:0/2423955960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff780069410 0x7ff7800bfc80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7ff768009760 tx=0x7ff768009060).ready entity=mon.0 client_cookie=541c7b096332ca1f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff77f7fe700 1 -- 172.21.15.27:0/2423955960 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800b580 con 0x7ff780069410 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff77f7fe700 1 -- 172.21.15.27:0/2423955960 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800b6e0 con 0x7ff780069410 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.756+0000 7ff77f7fe700 1 -- 172.21.15.27:0/2423955960 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800ba60 con 0x7ff780069410 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 -- 172.21.15.27:0/2423955960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff780069410 msgr2=0x7ff7800bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 --2- 172.21.15.27:0/2423955960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff780069410 0x7ff7800bfc80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7ff768009760 tx=0x7ff768009060).stop 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 -- 172.21.15.27:0/2423955960 shutdown_connections 2023-05-17T15:05:49.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 --2- 172.21.15.27:0/2423955960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff780069410 0x7ff7800bfc80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 --2- 172.21.15.27:0/2423955960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7801543d0 0x7ff7800c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 -- 172.21.15.27:0/2423955960 >> 172.21.15.27:0/2423955960 conn(0x7ff7800cb7f0 msgr2=0x7ff7800c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 -- 172.21.15.27:0/2423955960 shutdown_connections 2023-05-17T15:05:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.757+0000 7ff786dbd700 1 -- 172.21.15.27:0/2423955960 wait complete. 2023-05-17T15:05:49.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.758+0000 7ff786dbd700 1 Processor -- start 2023-05-17T15:05:49.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.758+0000 7ff786dbd700 1 -- start start 2023-05-17T15:05:49.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff780069410 0x7ff7800af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7800c60f0 0x7ff780151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 0x7ff7800a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780165440 con 0x7ff7801543d0 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780164e60 con 0x7ff7800c60f0 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800b0140 con 0x7ff780069410 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 0x7ff7800a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:49.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 0x7ff7800a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37022/0 (socket says 172.21.15.27:37022) 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 -- 172.21.15.27:0/1210958660 learned_addr learned my addr 172.21.15.27:0/1210958660 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff784b59700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff780069410 0x7ff7800af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff77ffff700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7800c60f0 0x7ff780151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 -- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff780069410 msgr2=0x7ff7800af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff780069410 0x7ff7800af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 -- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7800c60f0 msgr2=0x7ff780151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7800c60f0 0x7ff780151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 -- 172.21.15.27:0/1210958660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680092a0 con 0x7ff7801543d0 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff784b59700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff780069410 0x7ff7800af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff77ffff700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7800c60f0 0x7ff780151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff78535a700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 0x7ff7800a9e00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff768009eb0 tx=0x7ff768017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800ba60 con 0x7ff7801543d0 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76801b410 con 0x7ff7801543d0 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.759+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7800b0420 con 0x7ff7801543d0 2023-05-17T15:05:49.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.760+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76801b790 con 0x7ff7801543d0 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.760+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7800afb40 con 0x7ff7801543d0 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.760+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78006bdf0 con 0x7ff7801543d0 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.761+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff76800f070 con 0x7ff7801543d0 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.761+0000 7ff77cff9700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff76005ee20 0x7ff7600612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.761+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6123+0+0 (secure 0 0 0) 0x7ff76807b850 con 0x7ff7801543d0 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.761+0000 7ff784b59700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff76005ee20 0x7ff7600612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:49.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.762+0000 7ff784b59700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff76005ee20 0x7ff7600612e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff778006fd0 tx=0x7ff778008040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:49.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.765+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff76804cdd0 con 0x7ff7801543d0 2023-05-17T15:05:49.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.942+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff780068ac0 con 0x7ff7801543d0 2023-05-17T15:05:49.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.946+0000 7ff77cff9700 1 -- 172.21.15.27:0/1210958660 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v4) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff7680503f0 con 0x7ff7801543d0 2023-05-17T15:05:49.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff76005ee20 msgr2=0x7ff7600612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff76005ee20 0x7ff7600612e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff778006fd0 tx=0x7ff778008040).stop 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 msgr2=0x7ff7800a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 0x7ff7800a9e00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff768009eb0 tx=0x7ff768017000).stop 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 shutdown_connections 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff76005ee20 0x7ff7600612e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7801543d0 0x7ff7800a9e00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff780069410 0x7ff7800af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 --2- 172.21.15.27:0/1210958660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7800c60f0 0x7ff780151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 >> 172.21.15.27:0/1210958660 conn(0x7ff7800cb7f0 msgr2=0x7ff7801539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 shutdown_connections 2023-05-17T15:05:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:49.948+0000 7ff786dbd700 1 -- 172.21.15.27:0/1210958660 wait complete. 2023-05-17T15:05:49.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:05:50.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.085+0000 7f9bb5a04700 1 Processor -- start 2023-05-17T15:05:50.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.085+0000 7f9bb5a04700 1 -- start start 2023-05-17T15:05:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.085+0000 7f9bb5a04700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bb0155090 0x7f9bb00c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.085+0000 7f9bb5a04700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9bb0155470 0x7f9bb00bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.085+0000 7f9bb5a04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb0064680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bb5a04700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb0063d60 con 0x7f9bb0155470 2023-05-17T15:05:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bb5a04700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb0063470 con 0x7f9bb0155090 2023-05-17T15:05:50.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bb5a04700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0063710 con 0x7f9bb00641f0 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9bb0155470 0x7f9bb00bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9bb0155470 0x7f9bb00bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37028/0 (socket says 172.21.15.27:37028) 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 -- 172.21.15.27:0/44102520 learned_addr learned my addr 172.21.15.27:0/44102520 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9baf7fe700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb0064680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 -- 172.21.15.27:0/44102520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 msgr2=0x7f9bb0064680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9baeffd700 1 --2- 172.21.15.27:0/44102520 >> v2:172.21.15.40:3300/0 conn(0x7f9bb0155090 0x7f9bb00c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb0064680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 -- 172.21.15.27:0/44102520 >> v2:172.21.15.40:3300/0 conn(0x7f9bb0155090 msgr2=0x7f9bb00c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 --2- 172.21.15.27:0/44102520 >> v2:172.21.15.40:3300/0 conn(0x7f9bb0155090 0x7f9bb00c18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 -- 172.21.15.27:0/44102520 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00639f0 con 0x7f9bb0155470 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9baf7fe700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb0064680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9baeffd700 1 --2- 172.21.15.27:0/44102520 >> v2:172.21.15.40:3300/0 conn(0x7f9bb0155090 0x7f9bb00c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9bae7fc700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155470 0x7f9bb00bbe90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9bb006a890 tx=0x7f9ba40090f0).ready entity=mon.0 client_cookie=6c3db7e9def59eea server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9badffb700 1 -- 172.21.15.27:0/44102520 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400b600 con 0x7f9bb0155470 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9badffb700 1 -- 172.21.15.27:0/44102520 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400b760 con 0x7f9bb0155470 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.086+0000 7f9badffb700 1 -- 172.21.15.27:0/44102520 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400bb00 con 0x7f9bb0155470 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 -- 172.21.15.27:0/44102520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155470 msgr2=0x7f9bb00bbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155470 0x7f9bb00bbe90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9bb006a890 tx=0x7f9ba40090f0).stop 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 -- 172.21.15.27:0/44102520 shutdown_connections 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb0064680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/44102520 >> v2:172.21.15.40:3300/0 conn(0x7f9bb0155090 0x7f9bb00c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/44102520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155470 0x7f9bb00bbe90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 -- 172.21.15.27:0/44102520 >> 172.21.15.27:0/44102520 conn(0x7f9bb00c7a00 msgr2=0x7f9bb00c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:50.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 -- 172.21.15.27:0/44102520 shutdown_connections 2023-05-17T15:05:50.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.087+0000 7f9bb5a04700 1 -- 172.21.15.27:0/44102520 wait complete. 2023-05-17T15:05:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.088+0000 7f9bb5a04700 1 Processor -- start 2023-05-17T15:05:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.088+0000 7f9bb5a04700 1 -- start start 2023-05-17T15:05:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bb5a04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb01520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bb5a04700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 0x7f9bb00a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bb5a04700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bb0155470 0x7f9bb00a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bb5a04700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0147700 con 0x7f9bb0155090 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bb5a04700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00a3d80 con 0x7f9bb0155470 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bb5a04700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00a4060 con 0x7f9bb00641f0 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 0x7f9bb00a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 0x7f9bb00a8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37034/0 (socket says 172.21.15.27:37034) 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 -- 172.21.15.27:0/170679327 learned_addr learned my addr 172.21.15.27:0/170679327 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9baf7fe700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bb0155470 0x7f9bb00a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9baeffd700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb01520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 -- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 msgr2=0x7f9bb01520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb01520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 -- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bb0155470 msgr2=0x7f9bb00a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bb0155470 0x7f9bb00a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 -- 172.21.15.27:0/170679327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009370 con 0x7f9bb0155090 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9baf7fe700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bb0155470 0x7f9bb00a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9baeffd700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.089+0000 7f9bae7fc700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 0x7f9bb00a8300 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9ba4006fd0 tx=0x7f9ba4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.090+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400b8d0 con 0x7f9bb0155090 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.090+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400ba30 con 0x7f9bb0155090 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.090+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb00a8be0 con 0x7f9bb0155090 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.090+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba401c420 con 0x7f9bb0155090 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.090+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb00a91a0 con 0x7f9bb0155090 2023-05-17T15:05:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.090+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb00a41f0 con 0x7f9bb0155090 2023-05-17T15:05:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.091+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9ba402c070 con 0x7f9bb0155090 2023-05-17T15:05:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.091+0000 7f9b96ffd700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9b9c05ee20 0x7f9b9c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.091+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6123+0+0 (secure 0 0 0) 0x7f9ba407b9a0 con 0x7f9bb0155090 2023-05-17T15:05:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.092+0000 7f9baeffd700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9b9c05ee20 0x7f9b9c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.092+0000 7f9baeffd700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9b9c05ee20 0x7f9b9c0612e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9ba800d640 tx=0x7f9ba8007670).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.095+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ba404cf20 con 0x7f9bb0155090 2023-05-17T15:05:50.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.267+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9bb00c1eb0 con 0x7f9bb0155090 2023-05-17T15:05:50.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.271+0000 7f9b96ffd700 1 -- 172.21.15.27:0/170679327 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ba402a070 con 0x7f9bb0155090 2023-05-17T15:05:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9b9c05ee20 msgr2=0x7f9b9c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9b9c05ee20 0x7f9b9c0612e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9ba800d640 tx=0x7f9ba8007670).stop 2023-05-17T15:05:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 msgr2=0x7f9bb00a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 0x7f9bb00a8300 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9ba4006fd0 tx=0x7f9ba4017000).stop 2023-05-17T15:05:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 shutdown_connections 2023-05-17T15:05:50.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f9b9c05ee20 0x7f9b9c0612e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bb0155470 0x7f9bb00a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bb00641f0 0x7f9bb01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 --2- 172.21.15.27:0/170679327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9bb0155090 0x7f9bb00a8300 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 >> 172.21.15.27:0/170679327 conn(0x7f9bb00c7a00 msgr2=0x7f9bb0154170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:50.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 shutdown_connections 2023-05-17T15:05:50.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.273+0000 7f9bb5a04700 1 -- 172.21.15.27:0/170679327 wait complete. 2023-05-17T15:05:50.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-05-17T15:05:50.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.401+0000 7f7ec80a5700 1 Processor -- start 2023-05-17T15:05:50.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.401+0000 7f7ec80a5700 1 -- start start 2023-05-17T15:05:50.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec80a5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ec00c6310 0x7f7ec0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec80a5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec00bfcd0 con 0x7f7ec00c5f30 2023-05-17T15:05:50.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec80a5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec00c0290 con 0x7f7ec01541c0 2023-05-17T15:05:50.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec80a5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec00aa1a0 con 0x7f7ec00c6310 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ec00c6310 0x7f7ec0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7ec00c6310 0x7f7ec0153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37042/0 (socket says 172.21.15.27:37042) 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 -- 172.21.15.27:0/151676421 learned_addr learned my addr 172.21.15.27:0/151676421 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5e41700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7ec00c5f30 0x7f7ec0158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36602/0 (socket says 172.21.15.27:36602) 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 -- 172.21.15.27:0/151676421 >> v1:172.21.15.40:6789/0 conn(0x7f7ec01541c0 legacy=0x7f7ec00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 -- 172.21.15.27:0/151676421 >> v1:172.21.15.27:6789/0 conn(0x7f7ec00c5f30 legacy=0x7f7ec0158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec4e3f700 1 -- 172.21.15.27:0/151676421 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175335124 0 0) 0x7f7ec00bfcd0 con 0x7f7ec00c5f30 2023-05-17T15:05:50.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 -- 172.21.15.27:0/151676421 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec00aa480 con 0x7f7ec00c6310 2023-05-17T15:05:50.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec5640700 1 --2- 172.21.15.27:0/151676421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec0153cd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f7eb0006fd0 tx=0x7f7eb00090f0).ready entity=mon.0 client_cookie=88e3052bbd471907 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec4e3f700 1 -- 172.21.15.27:0/151676421 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000b600 con 0x7f7ec00c6310 2023-05-17T15:05:50.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec4e3f700 1 -- 172.21.15.27:0/151676421 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb000b760 con 0x7f7ec00c6310 2023-05-17T15:05:50.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.402+0000 7f7ec4e3f700 1 -- 172.21.15.27:0/151676421 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000bae0 con 0x7f7ec00c6310 2023-05-17T15:05:50.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 -- 172.21.15.27:0/151676421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 msgr2=0x7f7ec0153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/151676421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec0153cd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f7eb0006fd0 tx=0x7f7eb00090f0).stop 2023-05-17T15:05:50.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 -- 172.21.15.27:0/151676421 shutdown_connections 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/151676421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec0153cd0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 -- 172.21.15.27:0/151676421 >> 172.21.15.27:0/151676421 conn(0x7f7ec0069e70 msgr2=0x7f7ec005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 -- 172.21.15.27:0/151676421 shutdown_connections 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.403+0000 7f7ec80a5700 1 -- 172.21.15.27:0/151676421 wait complete. 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.404+0000 7f7ec80a5700 1 Processor -- start 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.404+0000 7f7ec80a5700 1 -- start start 2023-05-17T15:05:50.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec80a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ec00c5f30 0x7f7ec00c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec80a5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec80a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec01541c0 0x7f7ec00afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec80a5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00c3870 con 0x7f7ec00c6310 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec80a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00cb1c0 con 0x7f7ec01541c0 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec80a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0169070 con 0x7f7ec00c5f30 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37048/0 (socket says 172.21.15.27:37048) 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 -- 172.21.15.27:0/961823270 learned_addr learned my addr 172.21.15.27:0/961823270 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5e41700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ec00c5f30 0x7f7ec00c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec6642700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec01541c0 0x7f7ec00afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 -- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ec00c5f30 msgr2=0x7f7ec00c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ec00c5f30 0x7f7ec00c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 -- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec01541c0 msgr2=0x7f7ec00afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec01541c0 0x7f7ec00afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 -- 172.21.15.27:0/961823270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0009370 con 0x7f7ec00c6310 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5e41700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ec00c5f30 0x7f7ec00c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.405+0000 7f7ec5640700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec014c9a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f7ec0083770 tx=0x7f7eb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.406+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000bae0 con 0x7f7ec00c6310 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.406+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0000c90 con 0x7f7ec00c6310 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.406+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec00c9270 con 0x7f7ec00c6310 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.406+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb001c650 con 0x7f7ec00c6310 2023-05-17T15:05:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.406+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec00c8f00 con 0x7f7ec00c6310 2023-05-17T15:05:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.407+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec005f4a0 con 0x7f7ec00c6310 2023-05-17T15:05:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.407+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7eb002c070 con 0x7f7ec00c6310 2023-05-17T15:05:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.407+0000 7f7eb5ffb700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ea405ee20 0x7f7ea40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.408+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6123+0+0 (secure 0 0 0) 0x7f7eb007b8b0 con 0x7f7ec00c6310 2023-05-17T15:05:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.408+0000 7f7ec5e41700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ea405ee20 0x7f7ea40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.408+0000 7f7ec5e41700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ea405ee20 0x7f7ea40612e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7ebc000c00 tx=0x7f7ebc007cd0).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.412+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7eb004ce30 con 0x7f7ec00c6310 2023-05-17T15:05:50.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.653+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f7ec006bdf0 con 0x7f7ec00c6310 2023-05-17T15:05:50.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.687+0000 7f7eb5ffb700 1 -- 172.21.15.27:0/961823270 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v422) v1 ==== 158+0+0 (secure 0 0 0) 0x7f7eb002a070 con 0x7f7ec00c6310 2023-05-17T15:05:50.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ea405ee20 msgr2=0x7f7ea40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ea405ee20 0x7f7ea40612e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7ebc000c00 tx=0x7f7ebc007cd0).stop 2023-05-17T15:05:50.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 msgr2=0x7f7ec014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec014c9a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f7ec0083770 tx=0x7f7eb0017000).stop 2023-05-17T15:05:50.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 shutdown_connections 2023-05-17T15:05:50.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7ea405ee20 0x7f7ea40612e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ec01541c0 0x7f7ec00afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ec00c5f30 0x7f7ec00c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 --2- 172.21.15.27:0/961823270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ec00c6310 0x7f7ec014c9a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 >> 172.21.15.27:0/961823270 conn(0x7f7ec0069e70 msgr2=0x7f7ec00ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:50.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 shutdown_connections 2023-05-17T15:05:50.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.689+0000 7f7ec80a5700 1 -- 172.21.15.27:0/961823270 wait complete. 2023-05-17T15:05:50.705 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-05-17T15:05:50.705 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-05-17T15:05:50.705 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:05:50.706 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-05-17T15:05:50.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.818+0000 7f0fc26d7700 1 Processor -- start 2023-05-17T15:05:50.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.818+0000 7f0fc26d7700 1 -- start start 2023-05-17T15:05:50.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fc26d7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fbc153fa0 0x7f0fbc0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fc26d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fc26d7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0c07a0 con 0x7f0fbc0aae70 2023-05-17T15:05:50.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fc26d7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc069d70 con 0x7f0fbc153fa0 2023-05-17T15:05:50.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fc26d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c6760 con 0x7f0fbc069770 2023-05-17T15:05:50.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fbc153fa0 0x7f0fbc0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbb7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0fbc0aae70 0x7f0fbc069060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36616/0 (socket says 172.21.15.27:36616) 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbb7fe700 1 -- 172.21.15.27:0/3760942862 learned_addr learned my addr 172.21.15.27:0/3760942862 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fc0c74700 1 --2- 172.21.15.27:0/3760942862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbbfff700 1 -- 172.21.15.27:0/3760942862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 msgr2=0x7f0fbc0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbbfff700 1 --2- 172.21.15.27:0/3760942862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbbfff700 1 -- 172.21.15.27:0/3760942862 >> v1:172.21.15.27:6789/0 conn(0x7f0fbc0aae70 legacy=0x7f0fbc069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbaffd700 1 -- 172.21.15.27:0/3760942862 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718778985 0 0) 0x7f0fbc0c07a0 con 0x7f0fbc0aae70 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbbfff700 1 -- 172.21.15.27:0/3760942862 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0c1c40 con 0x7f0fbc153fa0 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.819+0000 7f0fbbfff700 1 --2- 172.21.15.27:0/3760942862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c5d80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0fb0009760 tx=0x7f0fb0009060).ready entity=mon.0 client_cookie=7887b8f1cae10fd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fbaffd700 1 -- 172.21.15.27:0/3760942862 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000b580 con 0x7f0fbc153fa0 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fbaffd700 1 -- 172.21.15.27:0/3760942862 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000b6e0 con 0x7f0fbc153fa0 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fbaffd700 1 -- 172.21.15.27:0/3760942862 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ba60 con 0x7f0fbc153fa0 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 -- 172.21.15.27:0/3760942862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 msgr2=0x7f0fbc0c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/3760942862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c5d80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0fb0009760 tx=0x7f0fb0009060).stop 2023-05-17T15:05:50.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 -- 172.21.15.27:0/3760942862 shutdown_connections 2023-05-17T15:05:50.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/3760942862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/3760942862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c5d80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 -- 172.21.15.27:0/3760942862 >> 172.21.15.27:0/3760942862 conn(0x7f0fbc0cb810 msgr2=0x7f0fbc0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:50.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 -- 172.21.15.27:0/3760942862 shutdown_connections 2023-05-17T15:05:50.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.820+0000 7f0fc26d7700 1 -- 172.21.15.27:0/3760942862 wait complete. 2023-05-17T15:05:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.821+0000 7f0fc26d7700 1 Processor -- start 2023-05-17T15:05:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.821+0000 7f0fc26d7700 1 -- start start 2023-05-17T15:05:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc26d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc26d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fbc0aae70 0x7f0fbc14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc26d7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc26d7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1546b0 con 0x7f0fbc153fa0 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc26d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc154990 con 0x7f0fbc0aae70 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc26d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc154c70 con 0x7f0fbc069770 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37064/0 (socket says 172.21.15.27:37064) 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 -- 172.21.15.27:0/1982957463 learned_addr learned my addr 172.21.15.27:0/1982957463 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:50.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fbbfff700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fbb7fe700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fbc0aae70 0x7f0fbc14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 -- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 msgr2=0x7f0fbc0aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0aa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 -- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fbc0aae70 msgr2=0x7f0fbc14bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:50.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.822+0000 7f0fc0c74700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fbc0aae70 0x7f0fbc14bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:50.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fc0c74700 1 -- 172.21.15.27:0/1982957463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00092a0 con 0x7f0fbc153fa0 2023-05-17T15:05:50.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fc0c74700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c3f60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0fb4009fa0 tx=0x7f0fb4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400ed20 con 0x7f0fbc153fa0 2023-05-17T15:05:50.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc154f50 con 0x7f0fbc153fa0 2023-05-17T15:05:50.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc154380 con 0x7f0fbc153fa0 2023-05-17T15:05:50.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400ee80 con 0x7f0fbc153fa0 2023-05-17T15:05:50.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.823+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4014610 con 0x7f0fbc153fa0 2023-05-17T15:05:50.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.824+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc06bdf0 con 0x7f0fbc153fa0 2023-05-17T15:05:50.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.824+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f0fb401b030 con 0x7f0fbc153fa0 2023-05-17T15:05:50.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.824+0000 7f0fa3fff700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fa805ee20 0x7f0fa80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:50.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.825+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6123+0+0 (secure 0 0 0) 0x7f0fb407a090 con 0x7f0fbc153fa0 2023-05-17T15:05:50.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.825+0000 7f0fbbfff700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fa805ee20 0x7f0fa80612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:50.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.825+0000 7f0fbbfff700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fa805ee20 0x7f0fa80612e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0fb000b340 tx=0x7f0fb0017000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:50.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:50.829+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fb404b5b0 con 0x7f0fbc153fa0 2023-05-17T15:05:51.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.069+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f0fbc0bfe70 con 0x7f0fbc153fa0 2023-05-17T15:05:51.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.693+0000 7f0fa3fff700 1 -- 172.21.15.27:0/1982957463 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v423) v1 ==== 157+0+0 (secure 0 0 0) 0x7f0fb404ebd0 con 0x7f0fbc153fa0 2023-05-17T15:05:51.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fa805ee20 msgr2=0x7f0fa80612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fa805ee20 0x7f0fa80612e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0fb000b340 tx=0x7f0fb0017000).stop 2023-05-17T15:05:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 msgr2=0x7f0fbc0c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c3f60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0fb4009fa0 tx=0x7f0fb4009900).stop 2023-05-17T15:05:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 shutdown_connections 2023-05-17T15:05:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0fa805ee20 0x7f0fa80612e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fbc153fa0 0x7f0fbc0c3f60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fbc069770 0x7f0fbc0aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 --2- 172.21.15.27:0/1982957463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fbc0aae70 0x7f0fbc14bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 >> 172.21.15.27:0/1982957463 conn(0x7f0fbc0cb810 msgr2=0x7f0fbc0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:51.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 shutdown_connections 2023-05-17T15:05:51.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.695+0000 7f0fc26d7700 1 -- 172.21.15.27:0/1982957463 wait complete. 2023-05-17T15:05:51.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:05:51.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.829+0000 7fe8bdbcc700 1 Processor -- start 2023-05-17T15:05:51.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.830+0000 7fe8bdbcc700 1 -- start start 2023-05-17T15:05:51.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.830+0000 7fe8bdbcc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8b8153dc0 0x7fe8b80626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:51.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.830+0000 7fe8bdbcc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80bc050 con 0x7fe8b8066ed0 2023-05-17T15:05:51.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.830+0000 7fe8bdbcc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b8067610 con 0x7fe8b81541a0 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.830+0000 7fe8bdbcc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80695d0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe8b8066ed0 0x7fe8b80c3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36632/0 (socket says 172.21.15.27:36632) 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b7fff700 1 -- 172.21.15.27:0/4283459064 learned_addr learned my addr 172.21.15.27:0/4283459064 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b77fe700 1 --2- 172.21.15.27:0/4283459064 >> v2:172.21.15.40:3300/0 conn(0x7fe8b8153dc0 0x7fe8b80626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271378445 0 0) 0x7fe8b80bc050 con 0x7fe8b8066ed0 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a00033f0 con 0x7fe8b8066ed0 2023-05-17T15:05:51.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165870135 0 0) 0x7fe8b8067610 con 0x7fe8b81541a0 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b80bc050 con 0x7fe8b81541a0 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b77fe700 1 -- 172.21.15.27:0/4283459064 >> v1:172.21.15.40:6789/0 conn(0x7fe8b81541a0 legacy=0x7fe8b80bcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b77fe700 1 -- 172.21.15.27:0/4283459064 >> v1:172.21.15.27:6789/0 conn(0x7fe8b8066ed0 legacy=0x7fe8b80c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b77fe700 1 -- 172.21.15.27:0/4283459064 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80bc2a0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b77fe700 1 --2- 172.21.15.27:0/4283459064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80626c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fe8a8009760 tx=0x7fe8a8009060).ready entity=mon.1 client_cookie=a59bf26bac23cca3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800d4a0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.831+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800d600 con 0x7fe8b8153dc0 2023-05-17T15:05:51.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8b67fc700 1 -- 172.21.15.27:0/4283459064 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800d980 con 0x7fe8b8153dc0 2023-05-17T15:05:51.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/4283459064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8153dc0 msgr2=0x7fe8b80626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/4283459064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80626c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fe8a8009760 tx=0x7fe8a8009060).stop 2023-05-17T15:05:51.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/4283459064 shutdown_connections 2023-05-17T15:05:51.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/4283459064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80626c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/4283459064 >> 172.21.15.27:0/4283459064 conn(0x7fe8b8063dd0 msgr2=0x7fe8b8067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:51.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/4283459064 shutdown_connections 2023-05-17T15:05:51.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.832+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/4283459064 wait complete. 2023-05-17T15:05:51.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.833+0000 7fe8bdbcc700 1 Processor -- start 2023-05-17T15:05:51.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.833+0000 7fe8bdbcc700 1 -- start start 2023-05-17T15:05:51.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8bdbcc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8066ed0 0x7fe8b814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8bdbcc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8bdbcc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8b81541a0 0x7fe8b80c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8bdbcc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c2b40 con 0x7fe8b8153dc0 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8bdbcc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80a79e0 con 0x7fe8b8066ed0 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8bdbcc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80a6dd0 con 0x7fe8b81541a0 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:51.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37074/0 (socket says 172.21.15.27:37074) 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 -- 172.21.15.27:0/3975629844 learned_addr learned my addr 172.21.15.27:0/3975629844 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b7fff700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8b81541a0 0x7fe8b80c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b77fe700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8066ed0 0x7fe8b814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 -- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8b81541a0 msgr2=0x7fe8b80c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8b81541a0 0x7fe8b80c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 -- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8066ed0 msgr2=0x7fe8b814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8066ed0 0x7fe8b814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b6ffd700 1 -- 172.21.15.27:0/3975629844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a80092a0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.834+0000 7fe8b7fff700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8b81541a0 0x7fe8b80c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.835+0000 7fe8b6ffd700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80c2160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fe8ac00c420 tx=0x7fe8ac007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.835+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00f470 con 0x7fe8b8153dc0 2023-05-17T15:05:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.835+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac00f5d0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.835+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b80a70b0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.835+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00f990 con 0x7fe8b8153dc0 2023-05-17T15:05:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.835+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b80a7670 con 0x7fe8b8153dc0 2023-05-17T15:05:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.836+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b80a7b70 con 0x7fe8b8153dc0 2023-05-17T15:05:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.836+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe8ac019030 con 0x7fe8b8153dc0 2023-05-17T15:05:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.836+0000 7fe89f7fe700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe8a405edf0 0x7fe8a40612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.836+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6123+0+0 (secure 0 0 0) 0x7fe8ac0790c0 con 0x7fe8b8153dc0 2023-05-17T15:05:51.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.836+0000 7fe8b77fe700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe8a405edf0 0x7fe8a40612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.837+0000 7fe8b77fe700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe8a405edf0 0x7fe8a40612b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe8a8006d60 tx=0x7fe8a8016000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:51.841+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8ac04a640 con 0x7fe8b8153dc0 2023-05-17T15:05:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.010+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe8b80a7d70 con 0x7fe8b8153dc0 2023-05-17T15:05:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.016+0000 7fe89f7fe700 1 -- 172.21.15.27:0/3975629844 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe8ac04dc60 con 0x7fe8b8153dc0 2023-05-17T15:05:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe8a405edf0 msgr2=0x7fe8a40612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe8a405edf0 0x7fe8a40612b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe8a8006d60 tx=0x7fe8a8016000).stop 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 msgr2=0x7fe8b80c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80c2160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fe8ac00c420 tx=0x7fe8ac007c60).stop 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 shutdown_connections 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fe8a405edf0 0x7fe8a40612b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8b81541a0 0x7fe8b80c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8b8066ed0 0x7fe8b814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 --2- 172.21.15.27:0/3975629844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8b8153dc0 0x7fe8b80c2160 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 >> 172.21.15.27:0/3975629844 conn(0x7fe8b8063dd0 msgr2=0x7fe8b8150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 shutdown_connections 2023-05-17T15:05:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.018+0000 7fe8bdbcc700 1 -- 172.21.15.27:0/3975629844 wait complete. 2023-05-17T15:05:52.034 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:05:52.034 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:05:52.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:05:52.097 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:05:52.097 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:05:52.098 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:05:52.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.214+0000 7f60eeea6700 1 Processor -- start 2023-05-17T15:05:52.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.214+0000 7f60eeea6700 1 -- start start 2023-05-17T15:05:52.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60eeea6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60e8153fa0 0x7f60e80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60eeea6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80c07a0 con 0x7f60e80aae70 2023-05-17T15:05:52.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60eeea6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80bfe70 con 0x7f60e8069770 2023-05-17T15:05:52.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60eeea6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e8069d70 con 0x7f60e8153fa0 2023-05-17T15:05:52.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f60e80aae70 0x7f60e8069060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36644/0 (socket says 172.21.15.27:36644) 2023-05-17T15:05:52.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e7fff700 1 -- 172.21.15.27:0/1238528782 learned_addr learned my addr 172.21.15.27:0/1238528782 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:52.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008429596 0 0) 0x7f60e80c07a0 con 0x7f60e80aae70 2023-05-17T15:05:52.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d40033f0 con 0x7f60e80aae70 2023-05-17T15:05:52.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60ecc42700 1 --2- 172.21.15.27:0/1238528782 >> v2:172.21.15.40:3300/0 conn(0x7f60e8153fa0 0x7f60e80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332492315 0 0) 0x7f60d40033f0 con 0x7f60e80aae70 2023-05-17T15:05:52.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 >> v2:172.21.15.40:3300/0 conn(0x7f60e8153fa0 msgr2=0x7f60e80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:52.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 --2- 172.21.15.27:0/1238528782 >> v2:172.21.15.40:3300/0 conn(0x7f60e8153fa0 0x7f60e80c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 >> v1:172.21.15.40:6789/0 conn(0x7f60e8069770 legacy=0x7f60e80c0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80c0150 con 0x7f60e80aae70 2023-05-17T15:05:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f60d8001970 con 0x7f60e80aae70 2023-05-17T15:05:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.215+0000 7f60ecc42700 1 --2- 172.21.15.27:0/1238528782 >> v2:172.21.15.40:3300/0 conn(0x7f60e8153fa0 0x7f60e80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 >> v1:172.21.15.27:6789/0 conn(0x7f60e80aae70 legacy=0x7f60e8069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d40038e0 0x7f60d4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60d4004690 0x7f60d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d4005050 0x7f60d400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8069d70 con 0x7f60d4004690 2023-05-17T15:05:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400bf30 con 0x7f60d4005050 2023-05-17T15:05:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400c0f0 con 0x7f60d40038e0 2023-05-17T15:05:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60d4004690 0x7f60d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60ed443700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d4005050 0x7f60d400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60ecc42700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d40038e0 0x7f60d4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 -- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d40038e0 msgr2=0x7f60d4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d40038e0 0x7f60d4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 -- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d4005050 msgr2=0x7f60d400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60d4005050 0x7f60d400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 -- 172.21.15.27:0/1238528782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40033f0 con 0x7f60d4004690 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60ed443700 1 -- 172.21.15.27:0/1238528782 reap_dead start 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60d4004690 0x7f60d4004b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f60d800c5f0 tx=0x7f60d8007b20).ready entity=mon.0 client_cookie=7ccce4aa6c3f210b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8007d50 con 0x7f60d4004690 2023-05-17T15:05:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800cdf0 con 0x7f60d4004690 2023-05-17T15:05:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.216+0000 7f60e77fe700 1 -- 172.21.15.27:0/1238528782 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8005c20 con 0x7f60d4004690 2023-05-17T15:05:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 -- 172.21.15.27:0/1238528782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60d4004690 msgr2=0x7f60d4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60d4004690 0x7f60d4004b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f60d800c5f0 tx=0x7f60d8007b20).stop 2023-05-17T15:05:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 -- 172.21.15.27:0/1238528782 shutdown_connections 2023-05-17T15:05:52.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1238528782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60d4004690 0x7f60d4004b10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 -- 172.21.15.27:0/1238528782 >> 172.21.15.27:0/1238528782 conn(0x7f60e80cb810 msgr2=0x7f60e80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:52.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 -- 172.21.15.27:0/1238528782 shutdown_connections 2023-05-17T15:05:52.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.217+0000 7f60eeea6700 1 -- 172.21.15.27:0/1238528782 wait complete. 2023-05-17T15:05:52.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.218+0000 7f60eeea6700 1 Processor -- start 2023-05-17T15:05:52.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.218+0000 7f60eeea6700 1 -- start start 2023-05-17T15:05:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d4004690 0x7f60e81651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 0x7f60e81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80c3f60 0x7f60e80c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e814fdf0 con 0x7f60e8154380 2023-05-17T15:05:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80c4890 con 0x7f60e80c3f60 2023-05-17T15:05:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8154880 con 0x7f60d4004690 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 0x7f60e81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 0x7f60e81531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37094/0 (socket says 172.21.15.27:37094) 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 -- 172.21.15.27:0/1710220357 learned_addr learned my addr 172.21.15.27:0/1710220357 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60ecc42700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d4004690 0x7f60e81651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60ed443700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80c3f60 0x7f60e80c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 -- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d4004690 msgr2=0x7f60e81651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d4004690 0x7f60e81651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 -- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80c3f60 msgr2=0x7f60e80c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80c3f60 0x7f60e80c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 -- 172.21.15.27:0/1710220357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8154b60 con 0x7f60e8154380 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60ed443700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80c3f60 0x7f60e80c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e7fff700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 0x7f60e81531c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f60d400bf00 tx=0x7f60d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8001930 con 0x7f60e8154380 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80059f0 con 0x7f60e8154380 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8154e40 con 0x7f60e8154380 2023-05-17T15:05:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.219+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8013450 con 0x7f60e8154380 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.220+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8155400 con 0x7f60e8154380 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.220+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e806bdf0 con 0x7f60e8154380 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.221+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f60d8027070 con 0x7f60e8154380 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.221+0000 7f60e4ff9700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f60c805ee20 0x7f60c80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.221+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6123+0+0 (secure 0 0 0) 0x7f60d807ab20 con 0x7f60e8154380 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.221+0000 7f60ecc42700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f60c805ee20 0x7f60c80612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.221+0000 7f60ecc42700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f60c805ee20 0x7f60c80612e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f60d000bc30 tx=0x7f60d0008040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:52.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.225+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60d804c120 con 0x7f60e8154380 2023-05-17T15:05:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.442+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e8082fe0 con 0x7f60e8154380 2023-05-17T15:05:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.442+0000 7f60e4ff9700 1 -- 172.21.15.27:0/1710220357 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f60d8025030 con 0x7f60e8154380 2023-05-17T15:05:52.446 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:52.447 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/70399952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6835","nonce":70399952},{"type":"v1","addr":"172.21.15.27:6837","nonce":70399952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1864555027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1864555027},{"type":"v1","addr":"172.21.15.40:6835","nonce":1864555027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1364101917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1364101917},{"type":"v1","addr":"172.21.15.40:6834","nonce":1364101917}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6836/3618310400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":3618310400},{"type":"v1","addr":"172.21.15.27:6836","nonce":3618310400}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2023-05-17T15:05:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f60c805ee20 msgr2=0x7f60c80612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f60c805ee20 0x7f60c80612e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f60d000bc30 tx=0x7f60d0008040).stop 2023-05-17T15:05:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 msgr2=0x7f60e81531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 0x7f60e81531c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f60d400bf00 tx=0x7f60d8015000).stop 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 shutdown_connections 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f60c805ee20 0x7f60c80612e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80c3f60 0x7f60e80c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60d4004690 0x7f60e81651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 --2- 172.21.15.27:0/1710220357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e8154380 0x7f60e81531c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 >> 172.21.15.27:0/1710220357 conn(0x7f60e80cb810 msgr2=0x7f60e80c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 shutdown_connections 2023-05-17T15:05:52.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.444+0000 7f60eeea6700 1 -- 172.21.15.27:0/1710220357 wait complete. 2023-05-17T15:05:52.450 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 17 2023-05-17T15:05:52.461 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:05:52.461 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:05:52.462 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:05:52.462 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:05:52.462 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:05:52.462 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:05:52.463 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:05:52.463 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:05:52.463 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:05:52.463 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:05:52.464 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:05:52.464 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:05:52.464 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:05:52.464 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:05:52.465 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:05:52.465 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:05:52.470 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:05:52.470 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:05:52.471 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:05:52.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:05:52.478 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:05:52.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:05:52.479 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:05:52.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:05:52.513 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:05:52.514 DEBUG:teuthology.parallel:result is None 2023-05-17T15:05:52.514 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:05:52.515 DEBUG:teuthology.parallel:result is None 2023-05-17T15:05:52.521 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:05:52.521 DEBUG:teuthology.parallel:result is None 2023-05-17T15:05:52.521 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:05:52.522 DEBUG:teuthology.parallel:result is None 2023-05-17T15:05:52.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:05:52.586 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:05:52.587 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:05:52.609 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:05:52.609 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:05:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.642+0000 7f5489a0f700 1 Processor -- start 2023-05-17T15:05:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.642+0000 7f5489a0f700 1 -- start start 2023-05-17T15:05:52.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5489a0f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5484153ef0 0x7f54840cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5489a0f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5484157980 0x7f54840c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5489a0f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840c60d0 con 0x7f54840cac00 2023-05-17T15:05:52.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5489a0f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54841588b0 con 0x7f5484153ef0 2023-05-17T15:05:52.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5489a0f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5484157e10 con 0x7f5484157980 2023-05-17T15:05:52.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5484153ef0 0x7f54840cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5484153ef0 0x7f54840cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37126/0 (socket says 172.21.15.27:37126) 2023-05-17T15:05:52.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 -- 172.21.15.27:0/899437881 learned_addr learned my addr 172.21.15.27:0/899437881 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:52.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f548920e700 1 --2- 172.21.15.27:0/899437881 >> v2:172.21.15.40:3300/0 conn(0x7f5484157980 0x7f54840c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 -- 172.21.15.27:0/899437881 >> v2:172.21.15.40:3300/0 conn(0x7f5484157980 msgr2=0x7f54840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:52.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 --2- 172.21.15.27:0/899437881 >> v2:172.21.15.40:3300/0 conn(0x7f5484157980 0x7f54840c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 -- 172.21.15.27:0/899437881 >> v1:172.21.15.40:6789/0 conn(0x7f54840cac00 legacy=0x7f54841537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 -- 172.21.15.27:0/899437881 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484158010 con 0x7f5484153ef0 2023-05-17T15:05:52.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.643+0000 7f5483fff700 1 --2- 172.21.15.27:0/899437881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f54840cafe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f54840c6310 tx=0x7f54700090f0).ready entity=mon.0 client_cookie=b8949834e4d9e8d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.644+0000 7f54837fe700 1 -- 172.21.15.27:0/899437881 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000b520 con 0x7f5484153ef0 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.644+0000 7f54837fe700 1 -- 172.21.15.27:0/899437881 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000b680 con 0x7f5484153ef0 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.644+0000 7f54837fe700 1 -- 172.21.15.27:0/899437881 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000ba00 con 0x7f5484153ef0 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 -- 172.21.15.27:0/899437881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 msgr2=0x7f54840cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 --2- 172.21.15.27:0/899437881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f54840cafe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f54840c6310 tx=0x7f54700090f0).stop 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 -- 172.21.15.27:0/899437881 shutdown_connections 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 --2- 172.21.15.27:0/899437881 >> v2:172.21.15.40:3300/0 conn(0x7f5484157980 0x7f54840c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 --2- 172.21.15.27:0/899437881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f54840cafe0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 -- 172.21.15.27:0/899437881 >> 172.21.15.27:0/899437881 conn(0x7f548405dd50 msgr2=0x7f548405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 -- 172.21.15.27:0/899437881 shutdown_connections 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.645+0000 7f5489a0f700 1 -- 172.21.15.27:0/899437881 wait complete. 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.646+0000 7f5489a0f700 1 Processor -- start 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.646+0000 7f5489a0f700 1 -- start start 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54840cac00 0x7f548413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f5484168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5484157980 0x7f5484155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5484142e60 con 0x7f5484153ef0 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840ae1c0 con 0x7f5484157980 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5484155730 con 0x7f54840cac00 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f5484168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f5484168270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37132/0 (socket says 172.21.15.27:37132) 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 -- 172.21.15.27:0/2767995712 learned_addr learned my addr 172.21.15.27:0/2767995712 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:52.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f548920e700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5484157980 0x7f5484155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5488a0d700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54840cac00 0x7f548413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 -- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54840cac00 msgr2=0x7f548413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54840cac00 0x7f548413fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 -- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5484157980 msgr2=0x7f5484155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5484157980 0x7f5484155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 -- 172.21.15.27:0/2767995712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470009370 con 0x7f5484153ef0 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5483fff700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f5484168270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f54840c85c0 tx=0x7f5470015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:52.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470000bc0 con 0x7f5484153ef0 2023-05-17T15:05:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000b7f0 con 0x7f5484153ef0 2023-05-17T15:05:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5484155450 con 0x7f5484153ef0 2023-05-17T15:05:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470000d20 con 0x7f5484153ef0 2023-05-17T15:05:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.647+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54840ade50 con 0x7f5484153ef0 2023-05-17T15:05:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.648+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54840ae350 con 0x7f5484153ef0 2023-05-17T15:05:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.649+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f547002b070 con 0x7f5484153ef0 2023-05-17T15:05:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.649+0000 7f5480ff9700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f546805edf0 0x7f54680612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:52.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.649+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f547007b4b0 con 0x7f5484153ef0 2023-05-17T15:05:52.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.649+0000 7f5488a0d700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f546805edf0 0x7f54680612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:52.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.650+0000 7f5488a0d700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f546805edf0 0x7f54680612b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5478003860 tx=0x7f5478007d40).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:52.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.653+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5470050660 con 0x7f5484153ef0 2023-05-17T15:05:52.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:52.846+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5484047150 con 0x7f5484153ef0 2023-05-17T15:05:53.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.701+0000 7f5480ff9700 1 -- 172.21.15.27:0/2767995712 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5470029020 con 0x7f5484153ef0 2023-05-17T15:05:53.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f546805edf0 msgr2=0x7f54680612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:53.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f546805edf0 0x7f54680612b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5478003860 tx=0x7f5478007d40).stop 2023-05-17T15:05:53.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 msgr2=0x7f5484168270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:53.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f5484168270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f54840c85c0 tx=0x7f5470015000).stop 2023-05-17T15:05:53.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 shutdown_connections 2023-05-17T15:05:53.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f546805edf0 0x7f54680612b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5484157980 0x7f5484155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54840cac00 0x7f548413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 --2- 172.21.15.27:0/2767995712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5484153ef0 0x7f5484168270 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 >> 172.21.15.27:0/2767995712 conn(0x7f548405dd50 msgr2=0x7f54840c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 shutdown_connections 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.704+0000 7f5489a0f700 1 -- 172.21.15.27:0/2767995712 wait complete. 2023-05-17T15:05:53.710 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:05:53.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:05:53.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.844+0000 7fd891e42700 1 Processor -- start 2023-05-17T15:05:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.844+0000 7fd891e42700 1 -- start start 2023-05-17T15:05:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891e42700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd88c0c1180 0x7fd88c0c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891e42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c0c1560 0x7fd88c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891e42700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c0c07e0 con 0x7fd88c1544f0 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891e42700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c1549b0 con 0x7fd88c0c1180 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891e42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c154c90 con 0x7fd88c0c1560 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd88bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd88c1544f0 0x7fd88c0a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36704/0 (socket says 172.21.15.27:36704) 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd88bfff700 1 -- 172.21.15.27:0/1027314693 learned_addr learned my addr 172.21.15.27:0/1027314693 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891641700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c0c1560 0x7fd88c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:53.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd890e40700 1 --2- 172.21.15.27:0/1027314693 >> v2:172.21.15.40:3300/0 conn(0x7fd88c0c1180 0x7fd88c0c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:53.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd88b7fe700 1 -- 172.21.15.27:0/1027314693 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177752522 0 0) 0x7fd88c0c07e0 con 0x7fd88c1544f0 2023-05-17T15:05:53.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd88b7fe700 1 -- 172.21.15.27:0/1027314693 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c0033f0 con 0x7fd88c1544f0 2023-05-17T15:05:53.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd890e40700 1 -- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c0c1560 msgr2=0x7fd88c0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:53.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd890e40700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c0c1560 0x7fd88c0c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd890e40700 1 -- 172.21.15.27:0/1027314693 >> v1:172.21.15.27:6789/0 conn(0x7fd88c1544f0 legacy=0x7fd88c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd890e40700 1 -- 172.21.15.27:0/1027314693 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c154f70 con 0x7fd88c0c1180 2023-05-17T15:05:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.845+0000 7fd891641700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c0c1560 0x7fd88c0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:05:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd890e40700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0c02f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fd880009760 tx=0x7fd880009060).ready entity=mon.1 client_cookie=2dbe0a87f8535588 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd88b7fe700 1 -- 172.21.15.27:0/1027314693 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8800090d0 con 0x7fd88c0c1180 2023-05-17T15:05:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd88b7fe700 1 -- 172.21.15.27:0/1027314693 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000d4a0 con 0x7fd88c0c1180 2023-05-17T15:05:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd88b7fe700 1 -- 172.21.15.27:0/1027314693 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000d820 con 0x7fd88c0c1180 2023-05-17T15:05:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 -- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 msgr2=0x7fd88c0c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0c02f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fd880009760 tx=0x7fd880009060).stop 2023-05-17T15:05:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 -- 172.21.15.27:0/1027314693 shutdown_connections 2023-05-17T15:05:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c0c1560 0x7fd88c0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 --2- 172.21.15.27:0/1027314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0c02f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 -- 172.21.15.27:0/1027314693 >> 172.21.15.27:0/1027314693 conn(0x7fd88c05dd50 msgr2=0x7fd88c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 -- 172.21.15.27:0/1027314693 shutdown_connections 2023-05-17T15:05:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.846+0000 7fd891e42700 1 -- 172.21.15.27:0/1027314693 wait complete. 2023-05-17T15:05:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.847+0000 7fd891e42700 1 Processor -- start 2023-05-17T15:05:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 -- start start 2023-05-17T15:05:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 0x7fd88c0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c1544f0 0x7fd88c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0c22f0 con 0x7fd88c0c1560 2023-05-17T15:05:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0aebb0 con 0x7fd88c0c1180 2023-05-17T15:05:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd891e42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0c2010 con 0x7fd88c1544f0 2023-05-17T15:05:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd88bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 0x7fd88c0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd88bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 0x7fd88c0cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37148/0 (socket says 172.21.15.27:37148) 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.848+0000 7fd88bfff700 1 -- 172.21.15.27:0/570966113 learned_addr learned my addr 172.21.15.27:0/570966113 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd891641700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c1544f0 0x7fd88c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd890e40700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd88bfff700 1 -- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c1544f0 msgr2=0x7fd88c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd88bfff700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c1544f0 0x7fd88c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd88bfff700 1 -- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 msgr2=0x7fd88c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd88bfff700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd88bfff700 1 -- 172.21.15.27:0/570966113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd884009a20 con 0x7fd88c0c1560 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd890e40700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd88bfff700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 0x7fd88c0cb170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fd87800c5c0 tx=0x7fd878007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780072e0 con 0x7fd88c0c1560 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878007440 con 0x7fd88c0c1560 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780057a0 con 0x7fd88c0c1560 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8800092a0 con 0x7fd88c0c1560 2023-05-17T15:05:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.849+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c0ae840 con 0x7fd88c0c1560 2023-05-17T15:05:53.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.850+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c06bdf0 con 0x7fd88c0c1560 2023-05-17T15:05:53.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.850+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd878010070 con 0x7fd88c0c1560 2023-05-17T15:05:53.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.851+0000 7fd888ff9700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd87005ee20 0x7fd8700612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:53.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.851+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fd878078f70 con 0x7fd88c0c1560 2023-05-17T15:05:53.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.851+0000 7fd890e40700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd87005ee20 0x7fd8700612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:53.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.851+0000 7fd890e40700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd87005ee20 0x7fd8700612e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd88000d260 tx=0x7fd880016000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:53.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:53.855+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd87804a810 con 0x7fd88c0c1560 2023-05-17T15:05:54.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.093+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd88c0b0a90 con 0x7fd88c0c1560 2023-05-17T15:05:54.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.093+0000 7fd888ff9700 1 -- 172.21.15.27:0/570966113 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fd87804de30 con 0x7fd88c0c1560 2023-05-17T15:05:54.097 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:54.097 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:05:54.098 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:05:54.098 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.098 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:05:54.098 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:05:54.098 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.098 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.099 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:05:54.100 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:05:54.100 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.100 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.100 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:05:54.100 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:05:54.100 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.101 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.101 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.101 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:05:54.101 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.102 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:05:54.103 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.104 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.105 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.105 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.105 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.105 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.105 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:05:54.106 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:05:54.106 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.106 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.106 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:05:54.107 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.108 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.108 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.108 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.108 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.108 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.110 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.111 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.111 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.111 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:05:54.111 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.112 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:05:54.114 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.115 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:05:54.116 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:05:54.117 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.117 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.117 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:05:54.117 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:05:54.117 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:05:54.117 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.118 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.118 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:05:54.118 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:05:54.118 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.118 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:05:54.119 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:05:54.120 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.120 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:05:54.120 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:05:54.120 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:05:54.120 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:05:54.121 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.121 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.121 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.121 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:05:54.122 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:05:54.122 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.122 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:05:54.122 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:05:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:05:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:05:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:05:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:05:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:05:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:05:54.127 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:05:54.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd87005ee20 msgr2=0x7fd8700612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd87005ee20 0x7fd8700612e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd88000d260 tx=0x7fd880016000).stop 2023-05-17T15:05:54.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 msgr2=0x7fd88c0cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 0x7fd88c0cb170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fd87800c5c0 tx=0x7fd878007c80).stop 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 shutdown_connections 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd87005ee20 0x7fd8700612e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd88c1544f0 0x7fd88c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd88c0c1180 0x7fd88c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 --2- 172.21.15.27:0/570966113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c0c1560 0x7fd88c0cb170 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 >> 172.21.15.27:0/570966113 conn(0x7fd88c05dd50 msgr2=0x7fd88c151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:54.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 shutdown_connections 2023-05-17T15:05:54.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.095+0000 7fd891e42700 1 -- 172.21.15.27:0/570966113 wait complete. 2023-05-17T15:05:54.131 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:05:54.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.244+0000 7f500dd31700 1 Processor -- start 2023-05-17T15:05:54.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.244+0000 7f500dd31700 1 -- start start 2023-05-17T15:05:54.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f500dd31700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50080c6310 0x7f5008153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f500dd31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50081541c0 0x7f50080c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f500dd31700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080bfcd0 con 0x7f50080c5f30 2023-05-17T15:05:54.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f500dd31700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080c0290 con 0x7f50080c6310 2023-05-17T15:05:54.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f500dd31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080aa1a0 con 0x7f50081541c0 2023-05-17T15:05:54.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f5006ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50080c6310 0x7f5008153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f5006ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50080c6310 0x7f5008153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37158/0 (socket says 172.21.15.27:37158) 2023-05-17T15:05:54.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f5006ffd700 1 -- 172.21.15.27:0/626914385 learned_addr learned my addr 172.21.15.27:0/626914385 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.245+0000 7f5007fff700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50081541c0 0x7f50080c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f5006ffd700 1 -- 172.21.15.27:0/626914385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50081541c0 msgr2=0x7f50080c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f5006ffd700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50081541c0 0x7f50080c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f5006ffd700 1 -- 172.21.15.27:0/626914385 >> v1:172.21.15.40:6789/0 conn(0x7f50080c5f30 legacy=0x7f5008158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f5006ffd700 1 -- 172.21.15.27:0/626914385 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080aa480 con 0x7f50080c6310 2023-05-17T15:05:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f5007fff700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50081541c0 0x7f50080c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f5006ffd700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50080c6310 0x7f5008153cd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f4ffc006fd0 tx=0x7f4ffc0090f0).ready entity=mon.0 client_cookie=f05198573890226 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f50067fc700 1 -- 172.21.15.27:0/626914385 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00b600 con 0x7f50080c6310 2023-05-17T15:05:54.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f50067fc700 1 -- 172.21.15.27:0/626914385 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00b760 con 0x7f50080c6310 2023-05-17T15:05:54.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f50067fc700 1 -- 172.21.15.27:0/626914385 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00bae0 con 0x7f50080c6310 2023-05-17T15:05:54.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 -- 172.21.15.27:0/626914385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50080c6310 msgr2=0x7f5008153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50080c6310 0x7f5008153cd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f4ffc006fd0 tx=0x7f4ffc0090f0).stop 2023-05-17T15:05:54.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 -- 172.21.15.27:0/626914385 shutdown_connections 2023-05-17T15:05:54.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50081541c0 0x7f50080c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 --2- 172.21.15.27:0/626914385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50080c6310 0x7f5008153cd0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 -- 172.21.15.27:0/626914385 >> 172.21.15.27:0/626914385 conn(0x7f5008069e70 msgr2=0x7f500805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:54.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 -- 172.21.15.27:0/626914385 shutdown_connections 2023-05-17T15:05:54.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.246+0000 7f500dd31700 1 -- 172.21.15.27:0/626914385 wait complete. 2023-05-17T15:05:54.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 Processor -- start 2023-05-17T15:05:54.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 -- start start 2023-05-17T15:05:54.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50080c5f30 0x7f50080ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50080c6310 0x7f5008154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 0x7f5008143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080cb620 con 0x7f50081541c0 2023-05-17T15:05:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008154e40 con 0x7f50080c5f30 2023-05-17T15:05:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.248+0000 7f500dd31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080caa10 con 0x7f50080c6310 2023-05-17T15:05:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 0x7f5008143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 0x7f5008143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37166/0 (socket says 172.21.15.27:37166) 2023-05-17T15:05:54.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 -- 172.21.15.27:0/142116617 learned_addr learned my addr 172.21.15.27:0/142116617 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:54.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5006ffd700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50080c6310 0x7f5008154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f50077fe700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50080c5f30 0x7f50080ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 -- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50080c6310 msgr2=0x7f5008154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50080c6310 0x7f5008154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 -- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50080c5f30 msgr2=0x7f50080ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50080c5f30 0x7f50080ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 -- 172.21.15.27:0/142116617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009370 con 0x7f50081541c0 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f5007fff700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 0x7f5008143980 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f500000cef0 tx=0x7f5000007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000ad20 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000ae80 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50080cacf0 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000016610 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.249+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080cb2b0 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.250+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080cb7d0 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.251+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f50000203f0 con 0x7f50081541c0 2023-05-17T15:05:54.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.251+0000 7f4fef7fe700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff405edf0 0x7f4ff40612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.251+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f500007a320 con 0x7f50081541c0 2023-05-17T15:05:54.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.251+0000 7f50077fe700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff405edf0 0x7f4ff40612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.251+0000 7f50077fe700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff405edf0 0x7f4ff40612b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ff80038b0 tx=0x7f4ff8007d20).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.255+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50080cb7d0 con 0x7f50081541c0 2023-05-17T15:05:54.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.429+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50080cb7d0 con 0x7f50081541c0 2023-05-17T15:05:54.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.430+0000 7f4fef7fe700 1 -- 172.21.15.27:0/142116617 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13782 (secure 0 0 0) 0x7f50080cb7d0 con 0x7f50081541c0 2023-05-17T15:05:54.434 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:54.435 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":61,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:53.695166+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:05:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff405edf0 msgr2=0x7f4ff40612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff405edf0 0x7f4ff40612b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ff80038b0 tx=0x7f4ff8007d20).stop 2023-05-17T15:05:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 msgr2=0x7f5008143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 0x7f5008143980 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f500000cef0 tx=0x7f5000007860).stop 2023-05-17T15:05:54.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 shutdown_connections 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f4ff405edf0 0x7f4ff40612b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50081541c0 0x7f5008143980 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50080c5f30 0x7f50080ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 --2- 172.21.15.27:0/142116617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50080c6310 0x7f5008154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 >> 172.21.15.27:0/142116617 conn(0x7f5008069e70 msgr2=0x7f50080c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 shutdown_connections 2023-05-17T15:05:54.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.432+0000 7f500dd31700 1 -- 172.21.15.27:0/142116617 wait complete. 2023-05-17T15:05:54.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:05:54.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:05:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.563+0000 7f9a0e4ef700 1 Processor -- start 2023-05-17T15:05:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.563+0000 7f9a0e4ef700 1 -- start start 2023-05-17T15:05:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0e4ef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a08153d50 0x7f9a080a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0e4ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a08154130 0x7f9a080bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0e4ef700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a08157b00 con 0x7f9a081545b0 2023-05-17T15:05:54.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0e4ef700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080aa380 con 0x7f9a08153d50 2023-05-17T15:05:54.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0e4ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08155310 con 0x7f9a08154130 2023-05-17T15:05:54.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0dcee700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9a081545b0 0x7f9a08157f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36736/0 (socket says 172.21.15.27:36736) 2023-05-17T15:05:54.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0dcee700 1 -- 172.21.15.27:0/2546132677 learned_addr learned my addr 172.21.15.27:0/2546132677 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:54.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0ccec700 1 --2- 172.21.15.27:0/2546132677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a08154130 0x7f9a080bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0d4ed700 1 --2- 172.21.15.27:0/2546132677 >> v2:172.21.15.40:3300/0 conn(0x7f9a08153d50 0x7f9a080a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a07fff700 1 -- 172.21.15.27:0/2546132677 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894997482 0 0) 0x7f9a08157b00 con 0x7f9a081545b0 2023-05-17T15:05:54.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a07fff700 1 -- 172.21.15.27:0/2546132677 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f00033f0 con 0x7f9a081545b0 2023-05-17T15:05:54.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a07fff700 1 -- 172.21.15.27:0/2546132677 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2052953133 0 0) 0x7f99f00033f0 con 0x7f9a081545b0 2023-05-17T15:05:54.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0ccec700 1 -- 172.21.15.27:0/2546132677 >> v2:172.21.15.40:3300/0 conn(0x7f9a08153d50 msgr2=0x7f9a080a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0ccec700 1 --2- 172.21.15.27:0/2546132677 >> v2:172.21.15.40:3300/0 conn(0x7f9a08153d50 0x7f9a080a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0ccec700 1 -- 172.21.15.27:0/2546132677 >> v1:172.21.15.27:6789/0 conn(0x7f9a081545b0 legacy=0x7f9a08157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.564+0000 7f9a0ccec700 1 -- 172.21.15.27:0/2546132677 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08154a70 con 0x7f9a08154130 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0ccec700 1 --2- 172.21.15.27:0/2546132677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a08154130 0x7f9a080bff90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f99fc009760 tx=0x7f99fc009060).ready entity=mon.2 client_cookie=4da7681b9cab80b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a07fff700 1 -- 172.21.15.27:0/2546132677 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8001470 con 0x7f9a08154130 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a07fff700 1 -- 172.21.15.27:0/2546132677 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc011400 con 0x7f9a08154130 2023-05-17T15:05:54.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a07fff700 1 -- 172.21.15.27:0/2546132677 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc011780 con 0x7f9a08154130 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/2546132677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a08154130 msgr2=0x7f9a080bff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/2546132677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a08154130 0x7f9a080bff90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f99fc009760 tx=0x7f99fc009060).stop 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/2546132677 shutdown_connections 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/2546132677 >> v2:172.21.15.40:3300/0 conn(0x7f9a08153d50 0x7f9a080a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/2546132677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a08154130 0x7f9a080bff90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/2546132677 >> 172.21.15.27:0/2546132677 conn(0x7f9a0805dd50 msgr2=0x7f9a0805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:54.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/2546132677 shutdown_connections 2023-05-17T15:05:54.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.565+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/2546132677 wait complete. 2023-05-17T15:05:54.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.566+0000 7f9a0e4ef700 1 Processor -- start 2023-05-17T15:05:54.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 -- start start 2023-05-17T15:05:54.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a08153d50 0x7f9a08142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 0x7f9a080ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a081545b0 0x7f9a080abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080c24e0 con 0x7f9a08154130 2023-05-17T15:05:54.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08143310 con 0x7f9a08153d50 2023-05-17T15:05:54.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0e4ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080af160 con 0x7f9a081545b0 2023-05-17T15:05:54.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.567+0000 7f9a0ccec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 0x7f9a080ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 0x7f9a080ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37178/0 (socket says 172.21.15.27:37178) 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 -- 172.21.15.27:0/953974361 learned_addr learned my addr 172.21.15.27:0/953974361 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0dcee700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a081545b0 0x7f9a080abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0d4ed700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a08153d50 0x7f9a08142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 -- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a081545b0 msgr2=0x7f9a080abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a081545b0 0x7f9a080abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 -- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a08153d50 msgr2=0x7f9a08142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a08153d50 0x7f9a08142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 -- 172.21.15.27:0/953974361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0092a0 con 0x7f9a08154130 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0dcee700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a081545b0 0x7f9a080abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0ccec700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 0x7f9a080ae710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f99fc009d50 tx=0x7f99fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0108a0 con 0x7f9a08154130 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc010a00 con 0x7f9a08154130 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a080c1bb0 con 0x7f9a08154130 2023-05-17T15:05:54.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc010da0 con 0x7f9a08154130 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.568+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a080c2170 con 0x7f9a08154130 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.569+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a08047150 con 0x7f9a08154130 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.570+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f99fc023020 con 0x7f9a08154130 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.570+0000 7f9a057fa700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99f405ee20 0x7f99f40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.570+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f99fc07af80 con 0x7f9a08154130 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.570+0000 7f9a0d4ed700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99f405ee20 0x7f99f40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.570+0000 7f9a0d4ed700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99f405ee20 0x7f99f40612e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9a0000f570 tx=0x7f9a0000b040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.574+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99fc04c820 con 0x7f9a08154130 2023-05-17T15:05:54.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.750+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9a08154d50 con 0x7f9a08154130 2023-05-17T15:05:54.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.750+0000 7f9a057fa700 1 -- 172.21.15.27:0/953974361 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v61) v1 ==== 110+0+10 (secure 0 0 0) 0x7f99fc04fe40 con 0x7f9a08154130 2023-05-17T15:05:54.754 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:05:54.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99f405ee20 msgr2=0x7f99f40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99f405ee20 0x7f99f40612e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9a0000f570 tx=0x7f9a0000b040).stop 2023-05-17T15:05:54.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 msgr2=0x7f9a080ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 0x7f9a080ae710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f99fc009d50 tx=0x7f99fc016000).stop 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 shutdown_connections 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99f405ee20 0x7f99f40612e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a081545b0 0x7f9a080abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a08153d50 0x7f9a08142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 --2- 172.21.15.27:0/953974361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a08154130 0x7f9a080ae710 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.752+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 >> 172.21.15.27:0/953974361 conn(0x7f9a0805dd50 msgr2=0x7f9a080c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:54.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.753+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 shutdown_connections 2023-05-17T15:05:54.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.753+0000 7f9a0e4ef700 1 -- 172.21.15.27:0/953974361 wait complete. 2023-05-17T15:05:54.768 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:05:54.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.883+0000 7f562b0ba700 1 Processor -- start 2023-05-17T15:05:54.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.883+0000 7f562b0ba700 1 -- start start 2023-05-17T15:05:54.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562b0ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 0x7f56240cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562b0ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5624153ef0 0x7f56240c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562b0ba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56240c60d0 con 0x7f5624157980 2023-05-17T15:05:54.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562b0ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56241588b0 con 0x7f5624153ef0 2023-05-17T15:05:54.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562b0ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5624157e00 con 0x7f56240cac00 2023-05-17T15:05:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a0b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 0x7f56240cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a8b9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5624153ef0 0x7f56240c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a0b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 0x7f56240cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:38294/0 (socket says 172.21.15.27:38294) 2023-05-17T15:05:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a0b8700 1 -- 172.21.15.27:0/1830818156 learned_addr learned my addr 172.21.15.27:0/1830818156 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:54.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a8b9700 1 -- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 msgr2=0x7f56240cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:54.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a8b9700 1 --2- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 0x7f56240cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a8b9700 1 -- 172.21.15.27:0/1830818156 >> v1:172.21.15.40:6789/0 conn(0x7f5624157980 legacy=0x7f56241537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f56290b6700 1 -- 172.21.15.27:0/1830818156 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349668255 0 0) 0x7f56240c60d0 con 0x7f5624157980 2023-05-17T15:05:54.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a8b9700 1 -- 172.21.15.27:0/1830818156 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624158010 con 0x7f5624153ef0 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.884+0000 7f562a0b8700 1 --2- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 0x7f56240cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562a8b9700 1 --2- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240c5be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f561c009e90 tx=0x7f561c009780).ready entity=mon.1 client_cookie=85f8ad9d7abc1cfe server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f56290b6700 1 -- 172.21.15.27:0/1830818156 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c00e070 con 0x7f5624153ef0 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f56290b6700 1 -- 172.21.15.27:0/1830818156 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c00bb20 con 0x7f5624153ef0 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f56290b6700 1 -- 172.21.15.27:0/1830818156 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c00bea0 con 0x7f5624153ef0 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 -- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 msgr2=0x7f56240c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 --2- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240c5be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f561c009e90 tx=0x7f561c009780).stop 2023-05-17T15:05:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 -- 172.21.15.27:0/1830818156 shutdown_connections 2023-05-17T15:05:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 --2- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240c5be0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 --2- 172.21.15.27:0/1830818156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56240cac00 0x7f56240cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 -- 172.21.15.27:0/1830818156 >> 172.21.15.27:0/1830818156 conn(0x7f562405dd50 msgr2=0x7f562405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 -- 172.21.15.27:0/1830818156 shutdown_connections 2023-05-17T15:05:54.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.885+0000 7f562b0ba700 1 -- 172.21.15.27:0/1830818156 wait complete. 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.886+0000 7f562b0ba700 1 Processor -- start 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.886+0000 7f562b0ba700 1 -- start start 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562b0ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 0x7f56240c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562b0ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562b0ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5624157980 0x7f56240c0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562b0ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562414f110 con 0x7f56240cac00 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562b0ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56240c36d0 con 0x7f5624153ef0 2023-05-17T15:05:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562b0ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56240c3110 con 0x7f5624157980 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562a0b8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 0x7f56240c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562a0b8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 0x7f56240c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37192/0 (socket says 172.21.15.27:37192) 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.887+0000 7f562a0b8700 1 -- 172.21.15.27:0/715623293 learned_addr learned my addr 172.21.15.27:0/715623293 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f56298b7700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a8b9700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5624157980 0x7f56240c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a0b8700 1 -- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5624157980 msgr2=0x7f56240c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a0b8700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5624157980 0x7f56240c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a0b8700 1 -- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 msgr2=0x7f56240b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a0b8700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a0b8700 1 -- 172.21.15.27:0/715623293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5620009370 con 0x7f56240cac00 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f56298b7700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a8b9700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5624157980 0x7f56240c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562a0b8700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 0x7f56240c2b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f562000ea20 tx=0x7f56200090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562000c850 con 0x7f56240cac00 2023-05-17T15:05:54.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562000c9b0 con 0x7f56240cac00 2023-05-17T15:05:54.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c009a20 con 0x7f56240cac00 2023-05-17T15:05:54.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562000cd30 con 0x7f56240cac00 2023-05-17T15:05:54.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.888+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5624155530 con 0x7f56240cac00 2023-05-17T15:05:54.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.889+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5624047150 con 0x7f56240cac00 2023-05-17T15:05:54.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.889+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f5620022070 con 0x7f56240cac00 2023-05-17T15:05:54.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.890+0000 7f561a7fc700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f560805ee20 0x7f56080612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:54.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.890+0000 7f56298b7700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f560805ee20 0x7f56080612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:54.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.890+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f5620079eb0 con 0x7f56240cac00 2023-05-17T15:05:54.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.890+0000 7f56298b7700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f560805ee20 0x7f56080612e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f56241656d0 tx=0x7f5614009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:54.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:54.894+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f562004b640 con 0x7f56240cac00 2023-05-17T15:05:55.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.066+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56240cb7d0 con 0x7f56240cac00 2023-05-17T15:05:55.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.066+0000 7f561a7fc700 1 -- 172.21.15.27:0/715623293 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5620016020 con 0x7f56240cac00 2023-05-17T15:05:55.070 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:05:55.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f560805ee20 msgr2=0x7f56080612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f560805ee20 0x7f56080612e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f56241656d0 tx=0x7f5614009040).stop 2023-05-17T15:05:55.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 msgr2=0x7f56240c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 0x7f56240c2b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f562000ea20 tx=0x7f56200090f0).stop 2023-05-17T15:05:55.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 shutdown_connections 2023-05-17T15:05:55.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f560805ee20 0x7f56080612e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5624157980 0x7f56240c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56240cac00 0x7f56240c2b10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 --2- 172.21.15.27:0/715623293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5624153ef0 0x7f56240b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 >> 172.21.15.27:0/715623293 conn(0x7f562405dd50 msgr2=0x7f56240c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 shutdown_connections 2023-05-17T15:05:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.068+0000 7f562b0ba700 1 -- 172.21.15.27:0/715623293 wait complete. 2023-05-17T15:05:55.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:05:55.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.195+0000 7fcf6c75d700 1 Processor -- start 2023-05-17T15:05:55.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.195+0000 7fcf6c75d700 1 -- start start 2023-05-17T15:05:55.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf6c75d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf640c6310 0x7fcf64153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf6c75d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf640c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf6c75d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf640bfcd0 con 0x7fcf640c5f30 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf6c75d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf640c0290 con 0x7fcf640c6310 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf6c75d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640aa1a0 con 0x7fcf641541c0 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf69cf8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf640c6310 0x7fcf64153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf69cf8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf640c6310 0x7fcf64153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37198/0 (socket says 172.21.15.27:37198) 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.196+0000 7fcf69cf8700 1 -- 172.21.15.27:0/1424423370 learned_addr learned my addr 172.21.15.27:0/1424423370 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf6acfa700 1 --2- 172.21.15.27:0/1424423370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf640c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf69cf8700 1 -- 172.21.15.27:0/1424423370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 msgr2=0x7fcf640c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf69cf8700 1 --2- 172.21.15.27:0/1424423370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf640c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf69cf8700 1 -- 172.21.15.27:0/1424423370 >> v1:172.21.15.40:6789/0 conn(0x7fcf640c5f30 legacy=0x7fcf64158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf69cf8700 1 -- 172.21.15.27:0/1424423370 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640aa480 con 0x7fcf640c6310 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf69cf8700 1 --2- 172.21.15.27:0/1424423370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64153cd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fcf58006fd0 tx=0x7fcf580090f0).ready entity=mon.0 client_cookie=126dea1892908923 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf694f7700 1 -- 172.21.15.27:0/1424423370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5800b600 con 0x7fcf640c6310 2023-05-17T15:05:55.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf694f7700 1 -- 172.21.15.27:0/1424423370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5800b760 con 0x7fcf640c6310 2023-05-17T15:05:55.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf694f7700 1 -- 172.21.15.27:0/1424423370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5800bae0 con 0x7fcf640c6310 2023-05-17T15:05:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf6c75d700 1 -- 172.21.15.27:0/1424423370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 msgr2=0x7fcf64153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.197+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/1424423370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64153cd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fcf58006fd0 tx=0x7fcf580090f0).stop 2023-05-17T15:05:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.198+0000 7fcf6c75d700 1 -- 172.21.15.27:0/1424423370 shutdown_connections 2023-05-17T15:05:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.198+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/1424423370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf640c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.198+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/1424423370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64153cd0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.198+0000 7fcf6c75d700 1 -- 172.21.15.27:0/1424423370 >> 172.21.15.27:0/1424423370 conn(0x7fcf64069e70 msgr2=0x7fcf6405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.198+0000 7fcf6c75d700 1 -- 172.21.15.27:0/1424423370 shutdown_connections 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.198+0000 7fcf6c75d700 1 -- 172.21.15.27:0/1424423370 wait complete. 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 Processor -- start 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 -- start start 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf640c5f30 0x7fcf64154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf64167680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c33a0 con 0x7fcf640c6310 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640ca520 con 0x7fcf640c5f30 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf6c75d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64154fd0 con 0x7fcf641541c0 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.199+0000 7fcf69cf8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37204/0 (socket says 172.21.15.27:37204) 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 -- 172.21.15.27:0/304401028 learned_addr learned my addr 172.21.15.27:0/304401028 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf6a4f9700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf640c5f30 0x7fcf64154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf6acfa700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf64167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 -- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 msgr2=0x7fcf64167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf64167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 -- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf640c5f30 msgr2=0x7fcf64154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf640c5f30 0x7fcf64154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 -- 172.21.15.27:0/304401028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58009370 con 0x7fcf640c6310 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf6acfa700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf64167680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf69cf8700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64155220 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fcf64083770 tx=0x7fcf58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58006a40 con 0x7fcf640c6310 2023-05-17T15:05:55.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5800b8d0 con 0x7fcf640c6310 2023-05-17T15:05:55.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf640c2160 con 0x7fcf640c6310 2023-05-17T15:05:55.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5801c670 con 0x7fcf640c6310 2023-05-17T15:05:55.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.200+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf640c4e00 con 0x7fcf640c6310 2023-05-17T15:05:55.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.201+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6405f4a0 con 0x7fcf640c6310 2023-05-17T15:05:55.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.201+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fcf5802c070 con 0x7fcf640c6310 2023-05-17T15:05:55.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.202+0000 7fcf627fc700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf5005edf0 0x7fcf500612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.202+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fcf5807b450 con 0x7fcf640c6310 2023-05-17T15:05:55.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.202+0000 7fcf6a4f9700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf5005edf0 0x7fcf500612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.202+0000 7fcf6a4f9700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf5005edf0 0x7fcf500612b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fcf5c0038b0 tx=0x7fcf5c007d20).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.206+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf5804ccf0 con 0x7fcf640c6310 2023-05-17T15:05:55.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.381+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcf6406bdf0 con 0x7fcf640c6310 2023-05-17T15:05:55.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.381+0000 7fcf627fc700 1 -- 172.21.15.27:0/304401028 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcf5802a020 con 0x7fcf640c6310 2023-05-17T15:05:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:55.387 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:05:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:05:55.387 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:05:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:05:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:05:55.388 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:05:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:05:55.389 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:05:55.389 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:05:55.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf5005edf0 msgr2=0x7fcf500612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf5005edf0 0x7fcf500612b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fcf5c0038b0 tx=0x7fcf5c007d20).stop 2023-05-17T15:05:55.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 msgr2=0x7fcf64155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64155220 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fcf64083770 tx=0x7fcf58017000).stop 2023-05-17T15:05:55.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 shutdown_connections 2023-05-17T15:05:55.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf5005edf0 0x7fcf500612b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf641541c0 0x7fcf64167680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf640c5f30 0x7fcf64154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 --2- 172.21.15.27:0/304401028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf640c6310 0x7fcf64155220 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 >> 172.21.15.27:0/304401028 conn(0x7fcf64069e70 msgr2=0x7fcf640add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:55.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 shutdown_connections 2023-05-17T15:05:55.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.383+0000 7fcf6c75d700 1 -- 172.21.15.27:0/304401028 wait complete. 2023-05-17T15:05:55.399 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:05:55.399 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:05:55.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.516+0000 7efda99bf700 1 Processor -- start 2023-05-17T15:05:55.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.516+0000 7efda99bf700 1 -- start start 2023-05-17T15:05:55.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda99bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efda40a8130 0x7efda415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda99bf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda4153780 con 0x7efda40c40f0 2023-05-17T15:05:55.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda99bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40be2b0 con 0x7efda414c510 2023-05-17T15:05:55.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda99bf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40be010 con 0x7efda40a8130 2023-05-17T15:05:55.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efd9bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efda40c40f0 0x7efda40a7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36774/0 (socket says 172.21.15.27:36774) 2023-05-17T15:05:55.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efd9bfff700 1 -- 172.21.15.27:0/3490574632 learned_addr learned my addr 172.21.15.27:0/3490574632 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:55.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda37fe700 1 --2- 172.21.15.27:0/3490574632 >> v2:172.21.15.40:3300/0 conn(0x7efda40a8130 0x7efda415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610852845 0 0) 0x7efda4153780 con 0x7efda40c40f0 2023-05-17T15:05:55.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.517+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd900033f0 con 0x7efda40c40f0 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533435092 0 0) 0x7efda40be2b0 con 0x7efda414c510 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda4153780 con 0x7efda414c510 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183090028 0 0) 0x7efd900033f0 con 0x7efda40c40f0 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda37fe700 1 -- 172.21.15.27:0/3490574632 >> v1:172.21.15.40:6789/0 conn(0x7efda414c510 legacy=0x7efda41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda37fe700 1 -- 172.21.15.27:0/3490574632 >> v1:172.21.15.27:6789/0 conn(0x7efda40c40f0 legacy=0x7efda40a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda37fe700 1 -- 172.21.15.27:0/3490574632 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4152e50 con 0x7efda40a8130 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda37fe700 1 --2- 172.21.15.27:0/3490574632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda415cbc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7efd9c009e60 tx=0x7efd9c009780).ready entity=mon.1 client_cookie=c38d1e5f3d58bd89 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e070 con 0x7efda40a8130 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00b7a0 con 0x7efda40a8130 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.518+0000 7efda27fc700 1 -- 172.21.15.27:0/3490574632 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c001470 con 0x7efda40a8130 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 -- 172.21.15.27:0/3490574632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 msgr2=0x7efda415cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 --2- 172.21.15.27:0/3490574632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda415cbc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7efd9c009e60 tx=0x7efd9c009780).stop 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 -- 172.21.15.27:0/3490574632 shutdown_connections 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 --2- 172.21.15.27:0/3490574632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda415cbc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 -- 172.21.15.27:0/3490574632 >> 172.21.15.27:0/3490574632 conn(0x7efda40c8ad0 msgr2=0x7efda40c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:55.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 -- 172.21.15.27:0/3490574632 shutdown_connections 2023-05-17T15:05:55.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.519+0000 7efda99bf700 1 -- 172.21.15.27:0/3490574632 wait complete. 2023-05-17T15:05:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 Processor -- start 2023-05-17T15:05:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 -- start start 2023-05-17T15:05:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c40f0 0x7efda4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 0x7efda40a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda414d850 con 0x7efda414c510 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40685b0 con 0x7efda40a8130 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.520+0000 7efda99bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda4068890 con 0x7efda40c40f0 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 0x7efda40a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 0x7efda40a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37220/0 (socket says 172.21.15.27:37220) 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 -- 172.21.15.27:0/2630220586 learned_addr learned my addr 172.21.15.27:0/2630220586 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efd9bfff700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c40f0 0x7efda4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda2ffd700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 -- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c40f0 msgr2=0x7efda4067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c40f0 0x7efda4067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 -- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 msgr2=0x7efda414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 -- 172.21.15.27:0/2630220586 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c009a20 con 0x7efda414c510 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda37fe700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 0x7efda40a9fb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7efd9c00b610 tx=0x7efd9c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c009460 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c01d440 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda4068b70 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c01d7c0 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.521+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda40681a0 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.522+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda414d630 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.523+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7efd9c024030 con 0x7efda414c510 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.523+0000 7efd9affd700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efd8405ee20 0x7efd840612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.523+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5313+0+0 (secure 0 0 0) 0x7efd9c07b040 con 0x7efda414c510 2023-05-17T15:05:55.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.523+0000 7efda2ffd700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efd8405ee20 0x7efd840612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.523+0000 7efda2ffd700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efd8405ee20 0x7efd840612e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efd94003890 tx=0x7efd94007bd0).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.527+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd9c04c990 con 0x7efda414c510 2023-05-17T15:05:55.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.699+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7efda40c4500 con 0x7efda414c510 2023-05-17T15:05:55.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.789+0000 7efd9affd700 1 -- 172.21.15.27:0/2630220586 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 152+0+0 (secure 0 0 0) 0x7efd9c022070 con 0x7efda414c510 2023-05-17T15:05:55.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efd8405ee20 msgr2=0x7efd840612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efd8405ee20 0x7efd840612e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efd94003890 tx=0x7efd94007bd0).stop 2023-05-17T15:05:55.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 msgr2=0x7efda40a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 0x7efda40a9fb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7efd9c00b610 tx=0x7efd9c009780).stop 2023-05-17T15:05:55.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 shutdown_connections 2023-05-17T15:05:55.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efd8405ee20 0x7efd840612e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda414c510 0x7efda40a9fb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda40a8130 0x7efda414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 --2- 172.21.15.27:0/2630220586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c40f0 0x7efda4067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.793+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 >> 172.21.15.27:0/2630220586 conn(0x7efda40c8ad0 msgr2=0x7efda4065400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.794+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 shutdown_connections 2023-05-17T15:05:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.794+0000 7efda99bf700 1 -- 172.21.15.27:0/2630220586 wait complete. 2023-05-17T15:05:55.805 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:05:55.813 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:05:55.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.931+0000 7fd0773b1700 1 Processor -- start 2023-05-17T15:05:55.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.931+0000 7fd0773b1700 1 -- start start 2023-05-17T15:05:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd0773b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd070069410 0x7fd07015f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd0773b1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0700c0c90 con 0x7fd0700c6310 2023-05-17T15:05:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd0773b1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd070158790 con 0x7fd0701543d0 2023-05-17T15:05:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd0773b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700c1c50 con 0x7fd070069410 2023-05-17T15:05:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd07494c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd0700c6310 0x7fd070068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36788/0 (socket says 172.21.15.27:36788) 2023-05-17T15:05:55.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd07494c700 1 -- 172.21.15.27:0/3604023841 learned_addr learned my addr 172.21.15.27:0/3604023841 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:55.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd07594e700 1 --2- 172.21.15.27:0/3604023841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd070069410 0x7fd07015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320350749 0 0) 0x7fd0700c0c90 con 0x7fd0700c6310 2023-05-17T15:05:55.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.932+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0580033f0 con 0x7fd0700c6310 2023-05-17T15:05:55.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859761073 0 0) 0x7fd070158790 con 0x7fd0701543d0 2023-05-17T15:05:55.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0700c0c90 con 0x7fd0701543d0 2023-05-17T15:05:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 395968373 0 0) 0x7fd0580033f0 con 0x7fd0700c6310 2023-05-17T15:05:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd07594e700 1 -- 172.21.15.27:0/3604023841 >> v1:172.21.15.40:6789/0 conn(0x7fd0701543d0 legacy=0x7fd0700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd07594e700 1 -- 172.21.15.27:0/3604023841 >> v1:172.21.15.27:6789/0 conn(0x7fd0700c6310 legacy=0x7fd070068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd07594e700 1 -- 172.21.15.27:0/3604023841 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070157e60 con 0x7fd070069410 2023-05-17T15:05:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd07594e700 1 --2- 172.21.15.27:0/3604023841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd070069410 0x7fd07015f160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd060009e90 tx=0x7fd060009780).ready entity=mon.2 client_cookie=b444bae24782b313 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000e070 con 0x7fd070069410 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000b7a0 con 0x7fd070069410 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd06ffff700 1 -- 172.21.15.27:0/3604023841 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064001470 con 0x7fd070069410 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd0773b1700 1 -- 172.21.15.27:0/3604023841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd070069410 msgr2=0x7fd07015f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3604023841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd070069410 0x7fd07015f160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd060009e90 tx=0x7fd060009780).stop 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd0773b1700 1 -- 172.21.15.27:0/3604023841 shutdown_connections 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3604023841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd070069410 0x7fd07015f160 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.933+0000 7fd0773b1700 1 -- 172.21.15.27:0/3604023841 >> 172.21.15.27:0/3604023841 conn(0x7fd0700cb7f0 msgr2=0x7fd0700c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.934+0000 7fd0773b1700 1 -- 172.21.15.27:0/3604023841 shutdown_connections 2023-05-17T15:05:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.934+0000 7fd0773b1700 1 -- 172.21.15.27:0/3604023841 wait complete. 2023-05-17T15:05:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.935+0000 7fd0773b1700 1 Processor -- start 2023-05-17T15:05:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.935+0000 7fd0773b1700 1 -- start start 2023-05-17T15:05:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd070069410 0x7fd0700c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 0x7fd0700adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0701543d0 0x7fd070147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700af110 con 0x7fd0700c6310 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700ae500 con 0x7fd070069410 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700ae7e0 con 0x7fd0701543d0 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 0x7fd0700adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 0x7fd0700adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37232/0 (socket says 172.21.15.27:37232) 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 -- 172.21.15.27:0/3242963034 learned_addr learned my addr 172.21.15.27:0/3242963034 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07594e700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0701543d0 0x7fd070147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07514d700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd070069410 0x7fd0700c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 -- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0701543d0 msgr2=0x7fd070147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0701543d0 0x7fd070147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 -- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd070069410 msgr2=0x7fd0700c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd070069410 0x7fd0700c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 -- 172.21.15.27:0/3242963034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009a20 con 0x7fd0700c6310 2023-05-17T15:05:55.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd07494c700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 0x7fd0700adcd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fd06400c810 tx=0x7fd064001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064007320 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064007480 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0700aeac0 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0640059b0 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.936+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0700ae1c0 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.937+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07006bdf0 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.938+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd064010030 con 0x7fd0700c6310 2023-05-17T15:05:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.938+0000 7fd06d7fa700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd05c05ee20 0x7fd05c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:55.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.938+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5683+0+0 (secure 0 0 0) 0x7fd064079880 con 0x7fd0700c6310 2023-05-17T15:05:55.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.938+0000 7fd07514d700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd05c05ee20 0x7fd05c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:55.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.939+0000 7fd07514d700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd05c05ee20 0x7fd05c0612e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd068007fd0 tx=0x7fd068007b90).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:55.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:55.943+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd06404aea0 con 0x7fd0700c6310 2023-05-17T15:05:56.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.117+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd070158140 con 0x7fd0700c6310 2023-05-17T15:05:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.800+0000 7fd06d7fa700 1 -- 172.21.15.27:0/3242963034 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd06404e4c0 con 0x7fd0700c6310 2023-05-17T15:05:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.808+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd05c05ee20 msgr2=0x7fd05c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.808+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd05c05ee20 0x7fd05c0612e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd068007fd0 tx=0x7fd068007b90).stop 2023-05-17T15:05:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.808+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 msgr2=0x7fd0700adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.808+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 0x7fd0700adcd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fd06400c810 tx=0x7fd064001a00).stop 2023-05-17T15:05:56.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 shutdown_connections 2023-05-17T15:05:56.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd05c05ee20 0x7fd05c0612e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0701543d0 0x7fd070147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd070069410 0x7fd0700c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 --2- 172.21.15.27:0/3242963034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0700c6310 0x7fd0700adcd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 >> 172.21.15.27:0/3242963034 conn(0x7fd0700cb7f0 msgr2=0x7fd070153860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 shutdown_connections 2023-05-17T15:05:56.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.817+0000 7fd0773b1700 1 -- 172.21.15.27:0/3242963034 wait complete. 2023-05-17T15:05:56.829 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:05:56.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:05:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 Processor -- start 2023-05-17T15:05:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 -- start start 2023-05-17T15:05:56.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff578153fb0 0x7ff578063dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:56.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff5780642b0 0x7ff57805dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:56.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5780c2b80 con 0x7ff57805e240 2023-05-17T15:05:56.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff578064730 con 0x7ff5780642b0 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.959+0000 7ff57dd15700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57805e6b0 con 0x7ff578153fb0 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff576ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff5780642b0 0x7ff57805dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff577fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff57805e240 0x7ff5780c3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36802/0 (socket says 172.21.15.27:36802) 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff577fff700 1 -- 172.21.15.27:0/4182408219 learned_addr learned my addr 172.21.15.27:0/4182408219 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff5777fe700 1 --2- 172.21.15.27:0/4182408219 >> v2:172.21.15.40:3300/0 conn(0x7ff578153fb0 0x7ff578063dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff576ffd700 1 -- 172.21.15.27:0/4182408219 >> v2:172.21.15.40:3300/0 conn(0x7ff578153fb0 msgr2=0x7ff578063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff576ffd700 1 --2- 172.21.15.27:0/4182408219 >> v2:172.21.15.40:3300/0 conn(0x7ff578153fb0 0x7ff578063dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff576ffd700 1 -- 172.21.15.27:0/4182408219 >> v1:172.21.15.27:6789/0 conn(0x7ff57805e240 legacy=0x7ff5780c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff576ffd700 1 -- 172.21.15.27:0/4182408219 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780be580 con 0x7ff5780642b0 2023-05-17T15:05:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff5767fc700 1 -- 172.21.15.27:0/4182408219 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933676111 0 0) 0x7ff5780c2b80 con 0x7ff57805e240 2023-05-17T15:05:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff576ffd700 1 --2- 172.21.15.27:0/4182408219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff57805dd50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7ff5780c7820 tx=0x7ff56c009060).ready entity=mon.0 client_cookie=5d017e1325f3d223 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff5767fc700 1 -- 172.21.15.27:0/4182408219 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00b580 con 0x7ff5780642b0 2023-05-17T15:05:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff5767fc700 1 -- 172.21.15.27:0/4182408219 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00b6e0 con 0x7ff5780642b0 2023-05-17T15:05:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.960+0000 7ff5767fc700 1 -- 172.21.15.27:0/4182408219 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00ba60 con 0x7ff5780642b0 2023-05-17T15:05:56.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 -- 172.21.15.27:0/4182408219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 msgr2=0x7ff57805dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 --2- 172.21.15.27:0/4182408219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff57805dd50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7ff5780c7820 tx=0x7ff56c009060).stop 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 -- 172.21.15.27:0/4182408219 shutdown_connections 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 --2- 172.21.15.27:0/4182408219 >> v2:172.21.15.40:3300/0 conn(0x7ff578153fb0 0x7ff578063dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 --2- 172.21.15.27:0/4182408219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff57805dd50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 -- 172.21.15.27:0/4182408219 >> 172.21.15.27:0/4182408219 conn(0x7ff5780c7910 msgr2=0x7ff5780c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 -- 172.21.15.27:0/4182408219 shutdown_connections 2023-05-17T15:05:56.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.961+0000 7ff57dd15700 1 -- 172.21.15.27:0/4182408219 wait complete. 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.962+0000 7ff57dd15700 1 Processor -- start 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.962+0000 7ff57dd15700 1 -- start start 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff57dd15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff57805e240 0x7ff5780a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff57dd15700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff578167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff57dd15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff578153fb0 0x7ff5781473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff57dd15700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780a6b60 con 0x7ff5780642b0 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff57dd15700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578167d60 con 0x7ff57805e240 2023-05-17T15:05:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff57dd15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff578167fc0 con 0x7ff578153fb0 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff578167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff578167870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37246/0 (socket says 172.21.15.27:37246) 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 -- 172.21.15.27:0/2079363596 learned_addr learned my addr 172.21.15.27:0/2079363596 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff577fff700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff578153fb0 0x7ff5781473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff5777fe700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff57805e240 0x7ff5780a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 -- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff578153fb0 msgr2=0x7ff5781473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff578153fb0 0x7ff5781473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 -- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff57805e240 msgr2=0x7ff5780a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff57805e240 0x7ff5780a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 -- 172.21.15.27:0/2079363596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0092a0 con 0x7ff5780642b0 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff5777fe700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff57805e240 0x7ff5780a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff576ffd700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff578167870 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff56c009fd0 tx=0x7ff56c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.963+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00b850 con 0x7ff5780642b0 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.964+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00b9b0 con 0x7ff5780642b0 2023-05-17T15:05:56.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.964+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5781682a0 con 0x7ff5780642b0 2023-05-17T15:05:56.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.964+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c01b660 con 0x7ff5780642b0 2023-05-17T15:05:56.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.964+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5780abca0 con 0x7ff5780642b0 2023-05-17T15:05:56.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.964+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5781687c0 con 0x7ff5780642b0 2023-05-17T15:05:56.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.965+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff56c02b070 con 0x7ff5780642b0 2023-05-17T15:05:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.965+0000 7ff55f7fe700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff56405ee20 0x7ff5640612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.965+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6065+0+0 (secure 0 0 0) 0x7ff56c07b960 con 0x7ff5780642b0 2023-05-17T15:05:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.966+0000 7ff5777fe700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff56405ee20 0x7ff5640612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.966+0000 7ff5777fe700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff56405ee20 0x7ff5640612e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff568006fd0 tx=0x7ff568008040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:56.970+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff56c04ce80 con 0x7ff5780642b0 2023-05-17T15:05:57.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.186+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff5781687c0 con 0x7ff5780642b0 2023-05-17T15:05:57.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.191+0000 7ff55f7fe700 1 -- 172.21.15.27:0/2079363596 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff5781687c0 con 0x7ff5780642b0 2023-05-17T15:05:57.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.202+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff56405ee20 msgr2=0x7ff5640612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.202+0000 7ff57dd15700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff56405ee20 0x7ff5640612e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff568006fd0 tx=0x7ff568008040).stop 2023-05-17T15:05:57.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 msgr2=0x7ff578167870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff578167870 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7ff56c009fd0 tx=0x7ff56c017000).stop 2023-05-17T15:05:57.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 shutdown_connections 2023-05-17T15:05:57.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7ff56405ee20 0x7ff5640612e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff578153fb0 0x7ff5781473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff57805e240 0x7ff5780a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.203+0000 7ff57dd15700 1 --2- 172.21.15.27:0/2079363596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5780642b0 0x7ff578167870 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.204+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 >> 172.21.15.27:0/2079363596 conn(0x7ff5780c7910 msgr2=0x7ff578153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:57.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.204+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 shutdown_connections 2023-05-17T15:05:57.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.204+0000 7ff57dd15700 1 -- 172.21.15.27:0/2079363596 wait complete. 2023-05-17T15:05:57.210 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 7 and data pool 8 2023-05-17T15:05:57.229 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:05:57.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.341+0000 7fc22125e700 1 Processor -- start 2023-05-17T15:05:57.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.341+0000 7fc22125e700 1 -- start start 2023-05-17T15:05:57.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc22125e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc21c0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc22125e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc21c0c25b0 0x7fc21c0c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc22125e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0a6a90 con 0x7fc21c14ff10 2023-05-17T15:05:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc22125e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0c3370 con 0x7fc21c0c25b0 2023-05-17T15:05:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc22125e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0c3650 con 0x7fc21c0c6fe0 2023-05-17T15:05:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc21c14ff10 0x7fc21c150390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36830/0 (socket says 172.21.15.27:36830) 2023-05-17T15:05:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21b7fe700 1 -- 172.21.15.27:0/657532021 learned_addr learned my addr 172.21.15.27:0/657532021 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21bfff700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc21c0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447971050 0 0) 0x7fc21c0a6a90 con 0x7fc21c14ff10 2023-05-17T15:05:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc220a5d700 1 --2- 172.21.15.27:0/657532021 >> v2:172.21.15.40:3300/0 conn(0x7fc21c0c25b0 0x7fc21c0c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2080033f0 con 0x7fc21c14ff10 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385948552 0 0) 0x7fc2080033f0 con 0x7fc21c14ff10 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 msgr2=0x7fc21c0c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc21c0c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 >> v2:172.21.15.40:3300/0 conn(0x7fc21c0c25b0 msgr2=0x7fc21c0c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 --2- 172.21.15.27:0/657532021 >> v2:172.21.15.40:3300/0 conn(0x7fc21c0c25b0 0x7fc21c0c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0bbee0 con 0x7fc21c14ff10 2023-05-17T15:05:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.342+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fc204001470 con 0x7fc21c14ff10 2023-05-17T15:05:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 >> v1:172.21.15.27:6789/0 conn(0x7fc21c14ff10 legacy=0x7fc21c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc208003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc208004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc208004b80 0x7fc208005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0c3370 con 0x7fc2080038e0 2023-05-17T15:05:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0c3650 con 0x7fc208004b80 2023-05-17T15:05:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20800b8e0 con 0x7fc21c0c6fe0 2023-05-17T15:05:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc208003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21b7fe700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc208004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc220a5d700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc208004b80 0x7fc208005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 -- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 msgr2=0x7fc208004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc208004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 -- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc208004b80 msgr2=0x7fc208005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc208004b80 0x7fc208005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 -- 172.21.15.27:0/657532021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2080033f0 con 0x7fc2080038e0 2023-05-17T15:05:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21b7fe700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c0c6fe0 0x7fc208004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc220a5d700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc208004b80 0x7fc208005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21bfff700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc208003d00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fc20c009a80 tx=0x7fc20c009060).ready entity=mon.0 client_cookie=3ef77f5ad9b9327 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c009430 con 0x7fc2080038e0 2023-05-17T15:05:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00e640 con 0x7fc2080038e0 2023-05-17T15:05:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.343+0000 7fc21affd700 1 -- 172.21.15.27:0/657532021 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00e9c0 con 0x7fc2080038e0 2023-05-17T15:05:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc22125e700 1 -- 172.21.15.27:0/657532021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 msgr2=0x7fc208003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc22125e700 1 --2- 172.21.15.27:0/657532021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc208003d00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fc20c009a80 tx=0x7fc20c009060).stop 2023-05-17T15:05:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc220a5d700 1 -- 172.21.15.27:0/657532021 reap_dead start 2023-05-17T15:05:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc22125e700 1 -- 172.21.15.27:0/657532021 shutdown_connections 2023-05-17T15:05:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc22125e700 1 -- 172.21.15.27:0/657532021 >> 172.21.15.27:0/657532021 conn(0x7fc21c067cb0 msgr2=0x7fc21c0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc22125e700 1 -- 172.21.15.27:0/657532021 shutdown_connections 2023-05-17T15:05:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.344+0000 7fc22125e700 1 -- 172.21.15.27:0/657532021 wait complete. 2023-05-17T15:05:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.345+0000 7fc22125e700 1 Processor -- start 2023-05-17T15:05:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.345+0000 7fc22125e700 1 -- start start 2023-05-17T15:05:57.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc22125e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc21c0a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc22125e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c144170 0x7fc21c13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc22125e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc21c0ab5c0 0x7fc21c0bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc22125e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1401f0 con 0x7fc2080038e0 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc22125e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0ab130 con 0x7fc21c0ab5c0 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc22125e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1445f0 con 0x7fc21c144170 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc21c0a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc21c0a9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37278/0 (socket says 172.21.15.27:37278) 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 -- 172.21.15.27:0/1729676107 learned_addr learned my addr 172.21.15.27:0/1729676107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21b7fe700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c144170 0x7fc21c13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc220a5d700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc21c0ab5c0 0x7fc21c0bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 -- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c144170 msgr2=0x7fc21c13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c144170 0x7fc21c13fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 -- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc21c0ab5c0 msgr2=0x7fc21c0bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc21c0ab5c0 0x7fc21c0bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 -- 172.21.15.27:0/1729676107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0aa520 con 0x7fc2080038e0 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21b7fe700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c144170 0x7fc21c13fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc21bfff700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc21c0a9e90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc20c00e4b0 tx=0x7fc20c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.346+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ed30 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.347+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00eeb0 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.347+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0aa800 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.347+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c01b450 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.347+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0aadc0 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.348+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c06bdf0 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.348+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc20c01b800 con 0x7fc2080038e0 2023-05-17T15:05:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.348+0000 7fc213fff700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1fc05ee20 0x7fc1fc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.348+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fc20c07de00 con 0x7fc2080038e0 2023-05-17T15:05:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.348+0000 7fc21b7fe700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1fc05ee20 0x7fc1fc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.349+0000 7fc21b7fe700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1fc05ee20 0x7fc1fc0612e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc204001200 tx=0x7fc204009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.353+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc20c04f3d0 con 0x7fc2080038e0 2023-05-17T15:05:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.524+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc21c0bc1c0 con 0x7fc2080038e0 2023-05-17T15:05:57.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.525+0000 7fc213fff700 1 -- 172.21.15.27:0/1729676107 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+17011 (secure 0 0 0) 0x7fc20c07f020 con 0x7fc2080038e0 2023-05-17T15:05:57.529 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:57.530 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":64,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:57.187246+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:05:55.736103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-17T15:05:56.153758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:05:57.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1fc05ee20 msgr2=0x7fc1fc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1fc05ee20 0x7fc1fc0612e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc204001200 tx=0x7fc204009040).stop 2023-05-17T15:05:57.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 msgr2=0x7fc21c0a9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc21c0a9e90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fc20c00e4b0 tx=0x7fc20c01a000).stop 2023-05-17T15:05:57.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 shutdown_connections 2023-05-17T15:05:57.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc1fc05ee20 0x7fc1fc0612e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc21c0ab5c0 0x7fc21c0bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2080038e0 0x7fc21c0a9e90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 --2- 172.21.15.27:0/1729676107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc21c144170 0x7fc21c13fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 >> 172.21.15.27:0/1729676107 conn(0x7fc21c067cb0 msgr2=0x7fc21c0c2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 shutdown_connections 2023-05-17T15:05:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.527+0000 7fc22125e700 1 -- 172.21.15.27:0/1729676107 wait complete. 2023-05-17T15:05:57.543 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:05:57.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.655+0000 7f7dcb0d9700 1 Processor -- start 2023-05-17T15:05:57.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.655+0000 7f7dcb0d9700 1 -- start start 2023-05-17T15:05:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dcb0d9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7dc414e2a0 0x7f7dc40bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dcb0d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc40c3b40 0x7f7dc4151510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dcb0d9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc4154d60 con 0x7f7dc414dec0 2023-05-17T15:05:57.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dcb0d9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc40c2f80 con 0x7f7dc414e2a0 2023-05-17T15:05:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dcb0d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4066ac0 con 0x7f7dc40c3b40 2023-05-17T15:05:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dc3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7dc414e2a0 0x7f7dc40bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dc9676700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc40c3b40 0x7f7dc4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dc8e75700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7dc414dec0 0x7f7dc40bc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:42850/0 (socket says 172.21.15.27:42850) 2023-05-17T15:05:57.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.656+0000 7f7dc8e75700 1 -- 172.21.15.27:0/2493935416 learned_addr learned my addr 172.21.15.27:0/2493935416 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc37fe700 1 -- 172.21.15.27:0/2493935416 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963194549 0 0) 0x7f7dc4154d60 con 0x7f7dc414dec0 2023-05-17T15:05:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc37fe700 1 -- 172.21.15.27:0/2493935416 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db00033f0 con 0x7f7dc414dec0 2023-05-17T15:05:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc9676700 1 -- 172.21.15.27:0/2493935416 >> v2:172.21.15.40:3300/0 conn(0x7f7dc414e2a0 msgr2=0x7f7dc40bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc9676700 1 --2- 172.21.15.27:0/2493935416 >> v2:172.21.15.40:3300/0 conn(0x7f7dc414e2a0 0x7f7dc40bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc9676700 1 -- 172.21.15.27:0/2493935416 >> v1:172.21.15.40:6789/0 conn(0x7f7dc414dec0 legacy=0x7f7dc40bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc9676700 1 -- 172.21.15.27:0/2493935416 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4151a00 con 0x7f7dc40c3b40 2023-05-17T15:05:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc9676700 1 --2- 172.21.15.27:0/2493935416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc40c3b40 0x7f7dc4151510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7dac009760 tx=0x7f7dac009060).ready entity=mon.2 client_cookie=2ca6bcc4bacbcf66 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc37fe700 1 -- 172.21.15.27:0/2493935416 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00d4a0 con 0x7f7dc40c3b40 2023-05-17T15:05:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc37fe700 1 -- 172.21.15.27:0/2493935416 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00d600 con 0x7f7dc40c3b40 2023-05-17T15:05:57.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.657+0000 7f7dc37fe700 1 -- 172.21.15.27:0/2493935416 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00d980 con 0x7f7dc40c3b40 2023-05-17T15:05:57.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2493935416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc40c3b40 msgr2=0x7f7dc4151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2493935416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc40c3b40 0x7f7dc4151510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7dac009760 tx=0x7f7dac009060).stop 2023-05-17T15:05:57.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2493935416 shutdown_connections 2023-05-17T15:05:57.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2493935416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc40c3b40 0x7f7dc4151510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2493935416 >> v2:172.21.15.40:3300/0 conn(0x7f7dc414e2a0 0x7f7dc40bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2493935416 >> 172.21.15.27:0/2493935416 conn(0x7f7dc405dd50 msgr2=0x7f7dc405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:57.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2493935416 shutdown_connections 2023-05-17T15:05:57.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.658+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2493935416 wait complete. 2023-05-17T15:05:57.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.659+0000 7f7dcb0d9700 1 Processor -- start 2023-05-17T15:05:57.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.659+0000 7f7dcb0d9700 1 -- start start 2023-05-17T15:05:57.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dcb0d9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc40c3b40 0x7f7dc4143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dcb0d9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 0x7f7dc4146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dcb0d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc414e2a0 0x7f7dc4146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dcb0d9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4146b00 con 0x7f7dc414dec0 2023-05-17T15:05:57.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dcb0d9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41649b0 con 0x7f7dc40c3b40 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dcb0d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4146d00 con 0x7f7dc414e2a0 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 0x7f7dc4146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 0x7f7dc4146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37294/0 (socket says 172.21.15.27:37294) 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc3fff700 1 -- 172.21.15.27:0/2161769340 learned_addr learned my addr 172.21.15.27:0/2161769340 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc9676700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc414e2a0 0x7f7dc4146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc8e75700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc40c3b40 0x7f7dc4143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc3fff700 1 -- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc414e2a0 msgr2=0x7f7dc4146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.660+0000 7f7dc3fff700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc414e2a0 0x7f7dc4146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc3fff700 1 -- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc40c3b40 msgr2=0x7f7dc4143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc3fff700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc40c3b40 0x7f7dc4143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc3fff700 1 -- 172.21.15.27:0/2161769340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0092a0 con 0x7f7dc414dec0 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc3fff700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 0x7f7dc4146120 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f7db4009df0 tx=0x7f7db400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400caa0 con 0x7f7dc414dec0 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400f040 con 0x7f7dc414dec0 2023-05-17T15:05:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ce10 con 0x7f7dc414dec0 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc4164080 con 0x7f7dc414dec0 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.661+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc4164640 con 0x7f7dc414dec0 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.662+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4164b20 con 0x7f7dc414dec0 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.662+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7db4013610 con 0x7f7dc414dec0 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.662+0000 7f7dc0ff9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7da405ee20 0x7f7da40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.663+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f7db407a4b0 con 0x7f7dc414dec0 2023-05-17T15:05:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.663+0000 7f7dc8e75700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7da405ee20 0x7f7da40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.663+0000 7f7dc8e75700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7da405ee20 0x7f7da40612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7dbc000c00 tx=0x7f7dbc009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.667+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7db404ba00 con 0x7f7dc414dec0 2023-05-17T15:05:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.842+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dc406bdf0 con 0x7f7dc414dec0 2023-05-17T15:05:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.843+0000 7f7dc0ff9700 1 -- 172.21.15.27:0/2161769340 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+17011 (secure 0 0 0) 0x7f7db404f020 con 0x7f7dc414dec0 2023-05-17T15:05:57.847 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:05:57.847 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":64,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:57.187246+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:05:55.736103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-17T15:05:56.153758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:05:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7da405ee20 msgr2=0x7f7da40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7da405ee20 0x7f7da40612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7dbc000c00 tx=0x7f7dbc009040).stop 2023-05-17T15:05:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 msgr2=0x7f7dc4146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 0x7f7dc4146120 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f7db4009df0 tx=0x7f7db400b040).stop 2023-05-17T15:05:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 shutdown_connections 2023-05-17T15:05:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7da405ee20 0x7f7da40612e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc414e2a0 0x7f7dc4146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc40c3b40 0x7f7dc4143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 --2- 172.21.15.27:0/2161769340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7dc414dec0 0x7f7dc4146120 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.844+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 >> 172.21.15.27:0/2161769340 conn(0x7f7dc405dd50 msgr2=0x7f7dc4147090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.845+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 shutdown_connections 2023-05-17T15:05:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.845+0000 7f7dcb0d9700 1 -- 172.21.15.27:0/2161769340 wait complete. 2023-05-17T15:05:57.860 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:05:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.975+0000 7fb277a0a700 1 Processor -- start 2023-05-17T15:05:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.975+0000 7fb277a0a700 1 -- start start 2023-05-17T15:05:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb277a0a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 0x7fb2700c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb277a0a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb270069410 0x7fb2700bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb277a0a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb270158790 con 0x7fb2700c60f0 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb277a0a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2700c1c50 con 0x7fb270069410 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb277a0a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700c6570 con 0x7fb2701543d0 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb274fa5700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb2700c60f0 0x7fb270068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36864/0 (socket says 172.21.15.27:36864) 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb274fa5700 1 -- 172.21.15.27:0/2080256009 learned_addr learned my addr 172.21.15.27:0/2080256009 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb2757a6700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 0x7fb2700c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.976+0000 7fb275fa7700 1 --2- 172.21.15.27:0/2080256009 >> v2:172.21.15.40:3300/0 conn(0x7fb270069410 0x7fb2700bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107166455 0 0) 0x7fb270158790 con 0x7fb2700c60f0 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2580033f0 con 0x7fb2700c60f0 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609481102 0 0) 0x7fb2580033f0 con 0x7fb2700c60f0 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 msgr2=0x7fb2700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 0x7fb2700c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 >> v2:172.21.15.40:3300/0 conn(0x7fb270069410 msgr2=0x7fb2700bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 --2- 172.21.15.27:0/2080256009 >> v2:172.21.15.40:3300/0 conn(0x7fb270069410 0x7fb2700bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb270157e60 con 0x7fb2700c60f0 2023-05-17T15:05:57.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fb264001470 con 0x7fb2700c60f0 2023-05-17T15:05:57.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 >> v1:172.21.15.27:6789/0 conn(0x7fb2700c60f0 legacy=0x7fb270068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 0x7fb2580038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb258003e10 0x7fb258004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb258004b80 0x7fb258005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700c6570 con 0x7fb258004b80 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25800b8e0 con 0x7fb258003e10 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25800ba20 con 0x7fb2701543d0 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb258004b80 0x7fb258005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb2757a6700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 0x7fb2580038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb274fa5700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb258003e10 0x7fb258004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 -- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 msgr2=0x7fb2580038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2701543d0 0x7fb2580038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 -- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb258003e10 msgr2=0x7fb258004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb258003e10 0x7fb258004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 -- 172.21.15.27:0/2080256009 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580033f0 con 0x7fb258004b80 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.977+0000 7fb275fa7700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb258004b80 0x7fb258005000 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fb26000e240 tx=0x7fb26000b040).ready entity=mon.0 client_cookie=467a08fc51e0dbbb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260009ac0 con 0x7fb258004b80 2023-05-17T15:05:57.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26000f040 con 0x7fb258004b80 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb26ffff700 1 -- 172.21.15.27:0/2080256009 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26000ed00 con 0x7fb258004b80 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb277a0a700 1 -- 172.21.15.27:0/2080256009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb258004b80 msgr2=0x7fb258005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb277a0a700 1 --2- 172.21.15.27:0/2080256009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb258004b80 0x7fb258005000 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fb26000e240 tx=0x7fb26000b040).stop 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb275fa7700 1 -- 172.21.15.27:0/2080256009 reap_dead start 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb277a0a700 1 -- 172.21.15.27:0/2080256009 shutdown_connections 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb277a0a700 1 -- 172.21.15.27:0/2080256009 >> 172.21.15.27:0/2080256009 conn(0x7fb2700cb7f0 msgr2=0x7fb2700c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb277a0a700 1 -- 172.21.15.27:0/2080256009 shutdown_connections 2023-05-17T15:05:57.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.978+0000 7fb277a0a700 1 -- 172.21.15.27:0/2080256009 wait complete. 2023-05-17T15:05:57.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.979+0000 7fb277a0a700 1 Processor -- start 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.979+0000 7fb277a0a700 1 -- start start 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb277a0a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 0x7fb2700c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb277a0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb270147c10 0x7fb2700b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb277a0a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb270155950 0x7fb270155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb277a0a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb270152e70 con 0x7fb270147830 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb277a0a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2701562c0 con 0x7fb270147c10 2023-05-17T15:05:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb277a0a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb270167aa0 con 0x7fb270155950 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 0x7fb2700c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 0x7fb2700c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37312/0 (socket says 172.21.15.27:37312) 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 -- 172.21.15.27:0/3568651774 learned_addr learned my addr 172.21.15.27:0/3568651774 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb275fa7700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb270155950 0x7fb270155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb274fa5700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb270147c10 0x7fb2700b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 -- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb270155950 msgr2=0x7fb270155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb270155950 0x7fb270155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 -- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb270147c10 msgr2=0x7fb2700b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb270147c10 0x7fb2700b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.980+0000 7fb2757a6700 1 -- 172.21.15.27:0/3568651774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb270167d80 con 0x7fb270147830 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.981+0000 7fb2757a6700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 0x7fb2700c1dc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fb2680119c0 tx=0x7fb268009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.981+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800f700 con 0x7fb270147830 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.981+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26800f860 con 0x7fb270147830 2023-05-17T15:05:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.981+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb270168060 con 0x7fb270147830 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.981+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800fbe0 con 0x7fb270147830 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.981+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb270167770 con 0x7fb270147830 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.982+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27006bdf0 con 0x7fb270147830 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.982+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb268014440 con 0x7fb270147830 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.983+0000 7fb26d7fa700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb25c05ee20 0x7fb25c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.983+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fb26807a150 con 0x7fb270147830 2023-05-17T15:05:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.983+0000 7fb274fa5700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb25c05ee20 0x7fb25c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.983+0000 7fb274fa5700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb25c05ee20 0x7fb25c0612e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb264001050 tx=0x7fb264001e90).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:57.987+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb26804b640 con 0x7fb270147830 2023-05-17T15:05:58.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:58.203+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb270158140 con 0x7fb270147830 2023-05-17T15:05:59.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.204+0000 7fb26d7fa700 1 -- 172.21.15.27:0/3568651774 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb26804ec60 con 0x7fb270147830 2023-05-17T15:05:59.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb25c05ee20 msgr2=0x7fb25c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb25c05ee20 0x7fb25c0612e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb264001050 tx=0x7fb264001e90).stop 2023-05-17T15:05:59.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 msgr2=0x7fb2700c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 0x7fb2700c1dc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fb2680119c0 tx=0x7fb268009060).stop 2023-05-17T15:05:59.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 shutdown_connections 2023-05-17T15:05:59.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb25c05ee20 0x7fb25c0612e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb270155950 0x7fb270155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb270147830 0x7fb2700c1dc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 --2- 172.21.15.27:0/3568651774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb270147c10 0x7fb2700b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 >> 172.21.15.27:0/3568651774 conn(0x7fb2700cb7f0 msgr2=0x7fb2701539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:59.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 shutdown_connections 2023-05-17T15:05:59.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.206+0000 7fb277a0a700 1 -- 172.21.15.27:0/3568651774 wait complete. 2023-05-17T15:05:59.225 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:05:59.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.347+0000 7f36cb30a700 1 Processor -- start 2023-05-17T15:05:59.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.347+0000 7f36cb30a700 1 -- start start 2023-05-17T15:05:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36cb30a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 0x7f36c40c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36cb30a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40c70d0 con 0x7f36c414b230 2023-05-17T15:05:59.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36cb30a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40c1300 con 0x7f36c414ae50 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36cb30a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40c1ea0 con 0x7f36c4151c70 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36c9b07700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f36c414b230 0x7f36c40c1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36884/0 (socket says 172.21.15.27:36884) 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36c9b07700 1 -- 172.21.15.27:0/86554739 learned_addr learned my addr 172.21.15.27:0/86554739 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36cab09700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 0x7f36c40c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220885462 0 0) 0x7f36c40c70d0 con 0x7f36c414b230 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36ac0033f0 con 0x7f36c414b230 2023-05-17T15:05:59.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.348+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056563538 0 0) 0x7f36ac0033f0 con 0x7f36c414b230 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 msgr2=0x7f36c40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 0x7f36c40c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 >> v1:172.21.15.40:6789/0 conn(0x7f36c414ae50 legacy=0x7f36c40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40c6df0 con 0x7f36c414b230 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f36b80015f0 con 0x7f36c414b230 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 >> v1:172.21.15.27:6789/0 conn(0x7f36c414b230 legacy=0x7f36c40c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 0x7f36ac003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac003e40 0x7f36ac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36ac004b80 0x7f36ac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40c1ea0 con 0x7f36ac004b80 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac00b990 con 0x7f36ac003e40 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac00bb50 con 0x7f36c4151c70 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36ac004b80 0x7f36ac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9b07700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac003e40 0x7f36ac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36ca308700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 0x7f36ac003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 -- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 msgr2=0x7f36ac003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c4151c70 0x7f36ac003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 -- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac003e40 msgr2=0x7f36ac004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac003e40 0x7f36ac004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 -- 172.21.15.27:0/86554739 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0033f0 con 0x7f36ac004b80 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36cab09700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36ac004b80 0x7f36ac005000 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f36b400e210 tx=0x7f36b400b040).ready entity=mon.0 client_cookie=8036fdb3b3ba7f72 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4009ac0 con 0x7f36ac004b80 2023-05-17T15:05:59.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b400f040 con 0x7f36ac004b80 2023-05-17T15:05:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.349+0000 7f36c9306700 1 -- 172.21.15.27:0/86554739 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400ecd0 con 0x7f36ac004b80 2023-05-17T15:05:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cb30a700 1 -- 172.21.15.27:0/86554739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36ac004b80 msgr2=0x7f36ac005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cb30a700 1 --2- 172.21.15.27:0/86554739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36ac004b80 0x7f36ac005000 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f36b400e210 tx=0x7f36b400b040).stop 2023-05-17T15:05:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cab09700 1 -- 172.21.15.27:0/86554739 reap_dead start 2023-05-17T15:05:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cb30a700 1 -- 172.21.15.27:0/86554739 shutdown_connections 2023-05-17T15:05:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cb30a700 1 -- 172.21.15.27:0/86554739 >> 172.21.15.27:0/86554739 conn(0x7f36c40693a0 msgr2=0x7f36c40697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:05:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cb30a700 1 -- 172.21.15.27:0/86554739 shutdown_connections 2023-05-17T15:05:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.350+0000 7f36cb30a700 1 -- 172.21.15.27:0/86554739 wait complete. 2023-05-17T15:05:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.351+0000 7f36cb30a700 1 Processor -- start 2023-05-17T15:05:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.351+0000 7f36cb30a700 1 -- start start 2023-05-17T15:05:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cb30a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac004b80 0x7f36c4140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cb30a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c41533d0 0x7f36c41469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cb30a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 0x7f36c40ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cb30a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4143810 con 0x7f36c40ab000 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cb30a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41439a0 con 0x7f36ac004b80 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cb30a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40ab950 con 0x7f36c41533d0 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 0x7f36c40ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 0x7f36c40ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37336/0 (socket says 172.21.15.27:37336) 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 -- 172.21.15.27:0/4066365057 learned_addr learned my addr 172.21.15.27:0/4066365057 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36ca308700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac004b80 0x7f36c4140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36c9b07700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c41533d0 0x7f36c41469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 -- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c41533d0 msgr2=0x7f36c41469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c41533d0 0x7f36c41469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 -- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac004b80 msgr2=0x7f36c4140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:05:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac004b80 0x7f36c4140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.352+0000 7f36cab09700 1 -- 172.21.15.27:0/4066365057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4147250 con 0x7f36c40ab000 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.353+0000 7f36cab09700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 0x7f36c40ab460 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f36ac005650 tx=0x7f36b401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.353+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4021030 con 0x7f36c40ab000 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.353+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b4009ac0 con 0x7f36c40ab000 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.353+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c4147530 con 0x7f36c40ab000 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.353+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4013d10 con 0x7f36c40ab000 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.353+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c4147af0 con 0x7f36c40ab000 2023-05-17T15:05:59.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.354+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c4147ce0 con 0x7f36c40ab000 2023-05-17T15:05:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.354+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f36b401d610 con 0x7f36c40ab000 2023-05-17T15:05:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.355+0000 7f36c27fc700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f36b005ee20 0x7f36b00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:05:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.355+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f36b4022070 con 0x7f36c40ab000 2023-05-17T15:05:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.355+0000 7f36ca308700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f36b005ee20 0x7f36b00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:05:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.355+0000 7f36ca308700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f36b005ee20 0x7f36b00612e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f36bc007fd0 tx=0x7f36bc007bb0).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:05:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.359+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f36b404cd60 con 0x7f36c40ab000 2023-05-17T15:05:59.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:05:59.579+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f36c4047150 con 0x7f36c40ab000 2023-05-17T15:06:00.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.211+0000 7f36c27fc700 1 -- 172.21.15.27:0/4066365057 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36b4050380 con 0x7f36c40ab000 2023-05-17T15:06:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f36b005ee20 msgr2=0x7f36b00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f36b005ee20 0x7f36b00612e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f36bc007fd0 tx=0x7f36bc007bb0).stop 2023-05-17T15:06:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 msgr2=0x7f36c40ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 0x7f36c40ab460 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f36ac005650 tx=0x7f36b401a000).stop 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 shutdown_connections 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f36b005ee20 0x7f36b00612e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36c40ab000 0x7f36c40ab460 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ac004b80 0x7f36c4140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 --2- 172.21.15.27:0/4066365057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c41533d0 0x7f36c41469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.213+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 >> 172.21.15.27:0/4066365057 conn(0x7f36c40693a0 msgr2=0x7f36c40a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.214+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 shutdown_connections 2023-05-17T15:06:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.214+0000 7f36cb30a700 1 -- 172.21.15.27:0/4066365057 wait complete. 2023-05-17T15:06:00.231 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:06:00.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.348+0000 7f99b9a98700 1 Processor -- start 2023-05-17T15:06:00.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.349+0000 7f99b9a98700 1 -- start start 2023-05-17T15:06:00.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.349+0000 7f99b9a98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 0x7f99b4155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.349+0000 7f99b9a98700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b4069020 con 0x7f99b41540d0 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.349+0000 7f99b9a98700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b4155700 con 0x7f99b4067ec0 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.349+0000 7f99b9a98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c3610 con 0x7f99b4065aa0 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.349+0000 7f99b37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f99b41540d0 0x7f99b4065390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36902/0 (socket says 172.21.15.27:36902) 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b37fe700 1 -- 172.21.15.27:0/3471583722 learned_addr learned my addr 172.21.15.27:0/3471583722 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b2ffd700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 0x7f99b4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620561325 0 0) 0x7f99b4069020 con 0x7f99b41540d0 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f999c0033f0 con 0x7f99b41540d0 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716558087 0 0) 0x7f999c0033f0 con 0x7f99b41540d0 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 msgr2=0x7f99b4155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 0x7f99b4155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 >> v1:172.21.15.40:6789/0 conn(0x7f99b4067ec0 legacy=0x7f99b40c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4068410 con 0x7f99b41540d0 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f99a4001470 con 0x7f99b41540d0 2023-05-17T15:06:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 >> v1:172.21.15.27:6789/0 conn(0x7f99b41540d0 legacy=0x7f99b4065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c003910 0x7f999c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 0x7f999c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f999c004b80 0x7f999c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c3610 con 0x7f999c004b80 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c00b8e0 con 0x7f999c003910 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c00ba50 con 0x7f99b4065aa0 2023-05-17T15:06:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b3fff700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f999c004b80 0x7f999c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b37fe700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c003910 0x7f999c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.350+0000 7f99b2ffd700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 0x7f999c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 -- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 msgr2=0x7f999c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b4065aa0 0x7f999c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 -- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c003910 msgr2=0x7f999c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c003910 0x7f999c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 -- 172.21.15.27:0/3471583722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0033f0 con 0x7f999c004b80 2023-05-17T15:06:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f999c004b80 0x7f999c005000 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f99ac001f20 tx=0x7f99ac007f10).ready entity=mon.0 client_cookie=6ddbf5add04ec73b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0017e0 con 0x7f999c004b80 2023-05-17T15:06:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00c670 con 0x7f999c004b80 2023-05-17T15:06:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b27fc700 1 -- 172.21.15.27:0/3471583722 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00c9f0 con 0x7f999c004b80 2023-05-17T15:06:00.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b9a98700 1 -- 172.21.15.27:0/3471583722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f999c004b80 msgr2=0x7f999c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b9a98700 1 --2- 172.21.15.27:0/3471583722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f999c004b80 0x7f999c005000 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f99ac001f20 tx=0x7f99ac007f10).stop 2023-05-17T15:06:00.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b3fff700 1 -- 172.21.15.27:0/3471583722 reap_dead start 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b9a98700 1 -- 172.21.15.27:0/3471583722 shutdown_connections 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b9a98700 1 -- 172.21.15.27:0/3471583722 >> 172.21.15.27:0/3471583722 conn(0x7f99b40c94a0 msgr2=0x7f99b40c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b9a98700 1 -- 172.21.15.27:0/3471583722 shutdown_connections 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.351+0000 7f99b9a98700 1 -- 172.21.15.27:0/3471583722 wait complete. 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 Processor -- start 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 -- start start 2023-05-17T15:06:00.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c004b80 0x7f99b40abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b40bfaf0 0x7f99b41501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 0x7f99b4151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c0be0 con 0x7f99b40a8c00 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40bffd0 con 0x7f999c004b80 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b9a98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c02b0 con 0x7f99b40bfaf0 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.353+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 0x7f99b4151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 0x7f99b4151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37356/0 (socket says 172.21.15.27:37356) 2023-05-17T15:06:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 -- 172.21.15.27:0/1539345170 learned_addr learned my addr 172.21.15.27:0/1539345170 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b2ffd700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b40bfaf0 0x7f99b41501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b37fe700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c004b80 0x7f99b40abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 -- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b40bfaf0 msgr2=0x7f99b41501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b40bfaf0 0x7f99b41501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 -- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c004b80 msgr2=0x7f99b40abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c004b80 0x7f99b40abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 -- 172.21.15.27:0/1539345170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40c0590 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b3fff700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 0x7f99b4151c00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f99ac007f50 tx=0x7f99ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0017e0 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00c7e0 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b40c0870 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac01d620 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.354+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b41506b0 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.355+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b40c0d90 con 0x7f99b40a8c00 2023-05-17T15:06:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.355+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f99ac003070 con 0x7f99b40a8c00 2023-05-17T15:06:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.356+0000 7f999b7fe700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99a005ee20 0x7f99a00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.356+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f99ac07b290 con 0x7f99b40a8c00 2023-05-17T15:06:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.356+0000 7f99b37fe700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99a005ee20 0x7f99a00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.356+0000 7f99b37fe700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99a005ee20 0x7f99a00612e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f99a4001d00 tx=0x7f99a4001e70).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.360+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99b40c0d90 con 0x7f99b40a8c00 2023-05-17T15:06:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.573+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99b40c0a00 con 0x7f99b40a8c00 2023-05-17T15:06:00.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.574+0000 7f999b7fe700 1 -- 172.21.15.27:0/1539345170 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f99ac04c7e0 con 0x7f99b40a8c00 2023-05-17T15:06:00.578 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:06:00.578 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:05:57.187691+0000","modified":"2023-05-17T15:06:00.203429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/3759557665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":3759557665},{"type":"v1","addr":"172.21.15.27:6837","nonce":3759557665}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-17T15:06:00.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99a005ee20 msgr2=0x7f99a00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99a005ee20 0x7f99a00612e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f99a4001d00 tx=0x7f99a4001e70).stop 2023-05-17T15:06:00.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 msgr2=0x7f99b4151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 0x7f99b4151c00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f99ac007f50 tx=0x7f99ac017000).stop 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 shutdown_connections 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f99a005ee20 0x7f99a00612e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99b40a8c00 0x7f99b4151c00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f999c004b80 0x7f99b40abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 --2- 172.21.15.27:0/1539345170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99b40bfaf0 0x7f99b41501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 >> 172.21.15.27:0/1539345170 conn(0x7f99b40c94a0 msgr2=0x7f99b4153090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:00.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 shutdown_connections 2023-05-17T15:06:00.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.575+0000 7f99b9a98700 1 -- 172.21.15.27:0/1539345170 wait complete. 2023-05-17T15:06:00.581 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2023-05-17T15:06:00.591 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:06:00.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.703+0000 7f730776e700 1 Processor -- start 2023-05-17T15:06:00.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.703+0000 7f730776e700 1 -- start start 2023-05-17T15:06:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f730776e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f73000c5f30 0x7f73000c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f730776e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f73001543e0 0x7f73000c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f730776e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73000bfcd0 con 0x7f7300158880 2023-05-17T15:06:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f730776e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000c0290 con 0x7f73001543e0 2023-05-17T15:06:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f730776e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000aa1a0 con 0x7f73000c5f30 2023-05-17T15:06:00.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f7305d0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f73001543e0 0x7f73000c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f7305d0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f73001543e0 0x7f73000c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37362/0 (socket says 172.21.15.27:37362) 2023-05-17T15:06:00.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.704+0000 7f7305d0b700 1 -- 172.21.15.27:0/2310516081 learned_addr learned my addr 172.21.15.27:0/2310516081 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:00.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f730550a700 1 --2- 172.21.15.27:0/2310516081 >> v2:172.21.15.40:3300/0 conn(0x7f73000c5f30 0x7f73000c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f7305d0b700 1 -- 172.21.15.27:0/2310516081 >> v2:172.21.15.40:3300/0 conn(0x7f73000c5f30 msgr2=0x7f73000c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:00.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f7305d0b700 1 --2- 172.21.15.27:0/2310516081 >> v2:172.21.15.40:3300/0 conn(0x7f73000c5f30 0x7f73000c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f7305d0b700 1 -- 172.21.15.27:0/2310516081 >> v1:172.21.15.40:6789/0 conn(0x7f7300158880 legacy=0x7f7300153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f7305d0b700 1 -- 172.21.15.27:0/2310516081 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000aa480 con 0x7f73001543e0 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f730550a700 1 --2- 172.21.15.27:0/2310516081 >> v2:172.21.15.40:3300/0 conn(0x7f73000c5f30 0x7f73000c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f7305d0b700 1 --2- 172.21.15.27:0/2310516081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f73000c0720 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f7300083a50 tx=0x7f72f0009840).ready entity=mon.0 client_cookie=5d57a01b5243c0cb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f72fffff700 1 -- 172.21.15.27:0/2310516081 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000e070 con 0x7f73001543e0 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f72fffff700 1 -- 172.21.15.27:0/2310516081 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000ba50 con 0x7f73001543e0 2023-05-17T15:06:00.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f72fffff700 1 -- 172.21.15.27:0/2310516081 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000bdd0 con 0x7f73001543e0 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f730776e700 1 -- 172.21.15.27:0/2310516081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 msgr2=0x7f73000c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.705+0000 7f730776e700 1 --2- 172.21.15.27:0/2310516081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f73000c0720 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f7300083a50 tx=0x7f72f0009840).stop 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.706+0000 7f730776e700 1 -- 172.21.15.27:0/2310516081 shutdown_connections 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.706+0000 7f730776e700 1 --2- 172.21.15.27:0/2310516081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f73000c0720 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.706+0000 7f730776e700 1 --2- 172.21.15.27:0/2310516081 >> v2:172.21.15.40:3300/0 conn(0x7f73000c5f30 0x7f73000c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.706+0000 7f730776e700 1 -- 172.21.15.27:0/2310516081 >> 172.21.15.27:0/2310516081 conn(0x7f7300069e70 msgr2=0x7f730005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:00.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.706+0000 7f730776e700 1 -- 172.21.15.27:0/2310516081 shutdown_connections 2023-05-17T15:06:00.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.706+0000 7f730776e700 1 -- 172.21.15.27:0/2310516081 wait complete. 2023-05-17T15:06:00.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.707+0000 7f730776e700 1 Processor -- start 2023-05-17T15:06:00.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.707+0000 7f730776e700 1 -- start start 2023-05-17T15:06:00.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73000c5f30 0x7f7300164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f730013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7300158880 0x7f73000c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300165460 con 0x7f73001543e0 2023-05-17T15:06:00.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000c36e0 con 0x7f73000c5f30 2023-05-17T15:06:00.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73000c39c0 con 0x7f7300158880 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f730013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f730013def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37368/0 (socket says 172.21.15.27:37368) 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730550a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73000c5f30 0x7f7300164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 -- 172.21.15.27:0/3458140601 learned_addr learned my addr 172.21.15.27:0/3458140601 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7305d0b700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7300158880 0x7f73000c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 -- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7300158880 msgr2=0x7f73000c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7300158880 0x7f73000c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 -- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73000c5f30 msgr2=0x7f7300164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73000c5f30 0x7f7300164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 -- 172.21.15.27:0/3458140601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0009ae0 con 0x7f73001543e0 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f7304d09700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f730013def0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f72f400c440 tx=0x7f72f4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4007020 con 0x7f73001543e0 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4007180 con 0x7f73001543e0 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73000c3ca0 con 0x7f73001543e0 2023-05-17T15:06:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4007520 con 0x7f73001543e0 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.708+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730013e3e0 con 0x7f73001543e0 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.709+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730005f4a0 con 0x7f73001543e0 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.710+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f72f4010070 con 0x7f73001543e0 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.710+0000 7f72fd7fa700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f72ec05edf0 0x7f72ec0612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.710+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f72f4078ca0 con 0x7f73001543e0 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.710+0000 7f730550a700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f72ec05edf0 0x7f72ec0612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.710+0000 7f730550a700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f72ec05edf0 0x7f72ec0612b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7300168970 tx=0x7f72f8008040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.714+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72f40478f0 con 0x7f73001543e0 2023-05-17T15:06:00.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.886+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f730006bdf0 con 0x7f73001543e0 2023-05-17T15:06:00.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.887+0000 7f72fd7fa700 1 -- 172.21.15.27:0/3458140601 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16998 (secure 0 0 0) 0x7f72f407d070 con 0x7f73001543e0 2023-05-17T15:06:00.891 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:06:00.891 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":65,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:05:58.189598+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:05:55.736103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-17T15:05:56.153758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:06:00.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f72ec05edf0 msgr2=0x7f72ec0612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f72ec05edf0 0x7f72ec0612b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7300168970 tx=0x7f72f8008040).stop 2023-05-17T15:06:00.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 msgr2=0x7f730013def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:00.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f730013def0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f72f400c440 tx=0x7f72f4007e00).stop 2023-05-17T15:06:00.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 shutdown_connections 2023-05-17T15:06:00.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f72ec05edf0 0x7f72ec0612b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7300158880 0x7f73000c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73000c5f30 0x7f7300164f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 --2- 172.21.15.27:0/3458140601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73001543e0 0x7f730013def0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:00.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 >> 172.21.15.27:0/3458140601 conn(0x7f7300069e70 msgr2=0x7f73000ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:00.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 shutdown_connections 2023-05-17T15:06:00.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:00.889+0000 7f730776e700 1 -- 172.21.15.27:0/3458140601 wait complete. 2023-05-17T15:06:00.905 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:06:00.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:06:01.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.018+0000 7fcf56bcf700 1 Processor -- start 2023-05-17T15:06:01.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.018+0000 7fcf56bcf700 1 -- start start 2023-05-17T15:06:01.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf56bcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcf500c5f30 0x7fcf500c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf56bcf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf50158880 0x7fcf50153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf56bcf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500bfcd0 con 0x7fcf501541c0 2023-05-17T15:06:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf56bcf700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500c0290 con 0x7fcf50158880 2023-05-17T15:06:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf56bcf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500aa1a0 con 0x7fcf500c5f30 2023-05-17T15:06:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf50158880 0x7fcf50153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf50158880 0x7fcf50153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37376/0 (socket says 172.21.15.27:37376) 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 -- 172.21.15.27:0/3875033217 learned_addr learned my addr 172.21.15.27:0/3875033217 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf5496b700 1 --2- 172.21.15.27:0/3875033217 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c5f30 0x7fcf500c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 -- 172.21.15.27:0/3875033217 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c5f30 msgr2=0x7fcf500c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/3875033217 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c5f30 0x7fcf500c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 -- 172.21.15.27:0/3875033217 >> v1:172.21.15.40:6789/0 conn(0x7fcf501541c0 legacy=0x7fcf500c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 -- 172.21.15.27:0/3875033217 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500aa480 con 0x7fcf50158880 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf5496b700 1 --2- 172.21.15.27:0/3875033217 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c5f30 0x7fcf500c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:06:01.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/3875033217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf50153cd0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fcf50083a50 tx=0x7fcf40009840).ready entity=mon.0 client_cookie=17fc3c0981a29180 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4f7fe700 1 -- 172.21.15.27:0/3875033217 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000e070 con 0x7fcf50158880 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.019+0000 7fcf4f7fe700 1 -- 172.21.15.27:0/3875033217 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4000ba50 con 0x7fcf50158880 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf4f7fe700 1 -- 172.21.15.27:0/3875033217 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000bdd0 con 0x7fcf50158880 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 -- 172.21.15.27:0/3875033217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 msgr2=0x7fcf50153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/3875033217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf50153cd0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fcf50083a50 tx=0x7fcf40009840).stop 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 -- 172.21.15.27:0/3875033217 shutdown_connections 2023-05-17T15:06:01.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/3875033217 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c5f30 0x7fcf500c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/3875033217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf50153cd0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 -- 172.21.15.27:0/3875033217 >> 172.21.15.27:0/3875033217 conn(0x7fcf50069e70 msgr2=0x7fcf5005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:01.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 -- 172.21.15.27:0/3875033217 shutdown_connections 2023-05-17T15:06:01.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.020+0000 7fcf56bcf700 1 -- 172.21.15.27:0/3875033217 wait complete. 2023-05-17T15:06:01.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.021+0000 7fcf56bcf700 1 Processor -- start 2023-05-17T15:06:01.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.021+0000 7fcf56bcf700 1 -- start start 2023-05-17T15:06:01.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf56bcf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf500c5f30 0x7fcf501682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf56bcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf501541c0 0x7fcf5014de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf56bcf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf500cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf56bcf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c3610 con 0x7fcf50158880 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf56bcf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c3180 con 0x7fcf500c5f30 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf56bcf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c2290 con 0x7fcf501541c0 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf500cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf500cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37384/0 (socket says 172.21.15.27:37384) 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 -- 172.21.15.27:0/913367370 learned_addr learned my addr 172.21.15.27:0/913367370 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:01.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5496b700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf500c5f30 0x7fcf501682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf501541c0 0x7fcf5014de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 -- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf501541c0 msgr2=0x7fcf5014de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf501541c0 0x7fcf5014de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 -- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf500c5f30 msgr2=0x7fcf501682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.022+0000 7fcf5516c700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf500c5f30 0x7fcf501682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf5516c700 1 -- 172.21.15.27:0/913367370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40009ae0 con 0x7fcf50158880 2023-05-17T15:06:01.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf501541c0 0x7fcf5014de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf5496b700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf500c5f30 0x7fcf501682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf5516c700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf500cb220 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fcf4800c440 tx=0x7fcf48007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800f470 con 0x7fcf50158880 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48001e90 con 0x7fcf50158880 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500c2570 con 0x7fcf50158880 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800f7e0 con 0x7fcf50158880 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.023+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500c2b30 con 0x7fcf50158880 2023-05-17T15:06:01.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.024+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf500c32f0 con 0x7fcf50158880 2023-05-17T15:06:01.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.024+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fcf48010070 con 0x7fcf50158880 2023-05-17T15:06:01.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.024+0000 7fcf4cff9700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf3005ee20 0x7fcf300612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.025+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fcf48078f20 con 0x7fcf50158880 2023-05-17T15:06:01.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.025+0000 7fcf5496b700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf3005ee20 0x7fcf300612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.025+0000 7fcf5496b700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf3005ee20 0x7fcf300612e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcf38006d80 tx=0x7fcf38008040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.029+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf480478f0 con 0x7fcf50158880 2023-05-17T15:06:01.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.196+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf5005f4a0 con 0x7fcf3005ee20 2023-05-17T15:06:01.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.207+0000 7fcf4cff9700 1 -- 172.21.15.27:0/913367370 <== mgr.5547 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350210 (secure 0 0 0) 0x7fcf5005f4a0 con 0x7fcf3005ee20 2023-05-17T15:06:01.215 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:06:01.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf3005ee20 msgr2=0x7fcf300612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf3005ee20 0x7fcf300612e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcf38006d80 tx=0x7fcf38008040).stop 2023-05-17T15:06:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 msgr2=0x7fcf500cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf500cb220 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fcf4800c440 tx=0x7fcf48007d70).stop 2023-05-17T15:06:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 shutdown_connections 2023-05-17T15:06:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcf3005ee20 0x7fcf300612e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf50158880 0x7fcf500cb220 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf500c5f30 0x7fcf501682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 --2- 172.21.15.27:0/913367370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf501541c0 0x7fcf5014de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 >> 172.21.15.27:0/913367370 conn(0x7fcf50069e70 msgr2=0x7fcf50157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 shutdown_connections 2023-05-17T15:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.210+0000 7fcf56bcf700 1 -- 172.21.15.27:0/913367370 wait complete. 2023-05-17T15:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:06:01.226 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-17T15:05:59.332711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":128576,"kb_used_data":5568,"kb_used_omap":0,"kb_used_meta":122944,"kb_avail":754846144,"statfs":{"total":773094113280,"available":772962451456,"internally_reserved":0,"allocated":5701632,"data_stored":2787072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":125894656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14998730,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-719,"num_write_kb":-15551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.323652"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-05-17T15:05:53.423853+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:05:53.423853+0000","last_peered":"2023-05-17T15:05:53.423853+0000","last_clean":"2023-05-17T15:05:53.423853+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:05:53.423853+0000","last_undegraded":"2023-05-17T15:05:53.423853+0000","last_fullsized":"2023-05-17T15:05:53.423853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.642442+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:05:52.642442+0000","last_peered":"2023-05-17T15:05:52.642442+0000","last_clean":"2023-05-17T15:05:52.642442+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:05:52.642442+0000","last_undegraded":"2023-05-17T15:05:52.642442+0000","last_fullsized":"2023-05-17T15:05:52.642442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.635170+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:05:52.635170+0000","last_peered":"2023-05-17T15:05:52.635170+0000","last_clean":"2023-05-17T15:05:52.635170+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:05:52.635170+0000","last_undegraded":"2023-05-17T15:05:52.635170+0000","last_fullsized":"2023-05-17T15:05:52.635170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.642429+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:05:52.642429+0000","last_peered":"2023-05-17T15:05:52.642429+0000","last_clean":"2023-05-17T15:05:52.642429+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:05:52.642429+0000","last_undegraded":"2023-05-17T15:05:52.642429+0000","last_fullsized":"2023-05-17T15:05:52.642429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.613035+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:05:52.613035+0000","last_peered":"2023-05-17T15:05:52.613035+0000","last_clean":"2023-05-17T15:05:52.613035+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:05:52.613035+0000","last_undegraded":"2023-05-17T15:05:52.613035+0000","last_fullsized":"2023-05-17T15:05:52.613035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.613361+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:05:52.613361+0000","last_peered":"2023-05-17T15:05:52.613361+0000","last_clean":"2023-05-17T15:05:52.613361+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:05:52.613361+0000","last_undegraded":"2023-05-17T15:05:52.613361+0000","last_fullsized":"2023-05-17T15:05:52.613361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.613199+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:05:52.613199+0000","last_peered":"2023-05-17T15:05:52.613199+0000","last_clean":"2023-05-17T15:05:52.613199+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:05:52.613199+0000","last_undegraded":"2023-05-17T15:05:52.613199+0000","last_fullsized":"2023-05-17T15:05:52.613199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-05-17T15:05:53.423835+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:05:53.423835+0000","last_peered":"2023-05-17T15:05:53.423835+0000","last_clean":"2023-05-17T15:05:53.423835+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:05:53.423835+0000","last_undegraded":"2023-05-17T15:05:53.423835+0000","last_fullsized":"2023-05-17T15:05:53.423835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:56.788764+0000","last_change":"2023-05-17T15:05:56.788764+0000","last_active":"2023-05-17T15:05:56.788764+0000","last_peered":"2023-05-17T15:05:56.788764+0000","last_clean":"2023-05-17T15:05:56.788764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:56.788764+0000","last_undegraded":"2023-05-17T15:05:56.788764+0000","last_fullsized":"2023-05-17T15:05:56.788764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:05:55.786246+0000","last_change":"2023-05-17T15:05:55.786246+0000","last_active":"2023-05-17T15:05:55.786246+0000","last_peered":"2023-05-17T15:05:55.786246+0000","last_clean":"2023-05-17T15:05:55.786246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:05:55.786246+0000","last_undegraded":"2023-05-17T15:05:55.786246+0000","last_fullsized":"2023-05-17T15:05:55.786246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-17T15:05:52.610051+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:05:52.610051+0000","last_peered":"2023-05-17T15:05:52.610051+0000","last_clean":"2023-05-17T15:05:52.610051+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:05:52.610051+0000","last_undegraded":"2023-05-17T15:05:52.610051+0000","last_fullsized":"2023-05-17T15:05:52.610051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16064,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":15360,"kb_avail":94355776,"statfs":{"total":96636764160,"available":96620314624,"internally_reserved":0,"allocated":712704,"data_stored":348404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15728640},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59999999999999998,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.37,"15min":0.34599999999999997},"max":{"1min":0.72899999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.433}]},{"osd":1,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":0.73099999999999998,"5min":0.875,"15min":0.89000000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.69299999999999995,"5min":0.83599999999999997,"15min":1.0109999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.72599999999999998,"5min":0.90900000000000003,"15min":0.95099999999999996},"last":0.621}]},{"osd":4,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48899999999999999,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.751,"15min":1.0740000000000001},"last":0.374},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.873,"15min":0.95899999999999996},"last":0.498}]},{"osd":5,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.91500000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":1.042},"last":0.58999999999999997}]},{"osd":6,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59999999999999998,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":0.80300000000000005,"15min":0.99199999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.33900000000000002},"max":{"1min":0.74299999999999999,"5min":0.90800000000000003,"15min":0.94099999999999995},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15464,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356376,"statfs":{"total":96636764160,"available":96620929024,"internally_reserved":0,"allocated":688128,"data_stored":336534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.81100000000000005,"15min":0.92900000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.35199999999999998},"max":{"1min":0.69999999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64500000000000002,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63500000000000001,"15min":0.61699999999999999},"min":{"1min":0.48099999999999998,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.91600000000000004},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.48899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.82799999999999996,"15min":0.92800000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.88600000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":0.80400000000000005,"15min":0.86399999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.83999999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.90100000000000002},"last":0.60699999999999998}]},{"osd":5,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.32600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.052},"last":0.747},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84899999999999998,"15min":0.92200000000000004},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.89500000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.96699999999999997},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15360,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94356480,"statfs":{"total":96636764160,"available":96621035520,"internally_reserved":0,"allocated":712704,"data_stored":348404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40300000000000002,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.247},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.42099999999999999},"min":{"1min":0.35199999999999998,"5min":0.26400000000000001,"15min":0.23000000000000001},"max":{"1min":0.65800000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.372}]},{"osd":2,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.24199999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.41899999999999998},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.34699999999999998}]},{"osd":3,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.435},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.23200000000000001},"max":{"1min":0.65500000000000003,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.498,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":0.92400000000000004,"15min":0.94899999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.629},"min":{"1min":0.435,"5min":0.435,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.41299999999999998,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":1.056,"15min":1.056},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.53500000000000003,"5min":0.41399999999999998,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":0.93700000000000006,"15min":1.6100000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.92400000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.65500000000000003},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.39100000000000001},"max":{"1min":0.98599999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69399999999999995,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.755}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10956,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":10240,"kb_avail":94360884,"statfs":{"total":96636764160,"available":96625545216,"internally_reserved":0,"allocated":724992,"data_stored":354259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10485760},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.28599999999999998,"5min":0.24299999999999999,"15min":0.23200000000000001},"max":{"1min":0.55700000000000005,"5min":0.66100000000000003,"15min":0.69599999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.39400000000000002},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.245},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.69099999999999995},"last":0.44}]},{"osd":2,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.443,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.23300000000000001},"max":{"1min":0.63,"5min":0.69499999999999995,"15min":0.70899999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.252},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42699999999999999,"15min":0.39500000000000002},"min":{"1min":0.29899999999999999,"5min":0.28299999999999997,"15min":0.214},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.81299999999999994},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.46400000000000002},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70999999999999996,"15min":0.67100000000000004},"min":{"1min":0.52700000000000002,"5min":0.45500000000000002,"15min":0.34899999999999998},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.98699999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.91300000000000003,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67400000000000004,"15min":0.64300000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.34599999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.39100000000000001},"max":{"1min":0.99399999999999999,"5min":1.012,"15min":1.1739999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.46100000000000002,"15min":0.35499999999999998},"max":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":1.119},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.68400000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":0.995,"15min":1.087},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0569999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":0.95899999999999996,"15min":1.0740000000000001},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16448,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94355392,"statfs":{"total":96636764160,"available":96619921408,"internally_reserved":0,"allocated":712704,"data_stored":348404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.378,"15min":0.35699999999999998},"min":{"1min":0.26100000000000001,"5min":0.24099999999999999,"15min":0.23300000000000001},"max":{"1min":0.51400000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.24199999999999999},"max":{"1min":0.47799999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39800000000000002}]},{"osd":1,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.38100000000000001},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.245},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.439},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.25800000000000001},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":0.68999999999999995},"last":0.441}]},{"osd":3,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.42699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.439,"15min":0.41699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.23599999999999999},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69699999999999995,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.93600000000000005,"5min":0.97199999999999998,"15min":1.0529999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.57499999999999996,"5min":0.46500000000000002,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.046},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.997,"15min":1.014},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65900000000000003,"15min":0.63400000000000001},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.39400000000000002},"max":{"1min":0.85099999999999998,"5min":0.95699999999999996,"15min":1.014},"last":0.629}]},{"osd":6,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.64400000000000002},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.0069999999999999,"15min":1.0860000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.38200000000000001},"max":{"1min":0.90700000000000003,"5min":1.002,"15min":1.03},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71499999999999997,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19456,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":18752,"kb_avail":94352384,"statfs":{"total":96636764160,"available":96616841216,"internally_reserved":0,"allocated":712704,"data_stored":348404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19202048},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.377,"15min":0.34399999999999997},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.377},"min":{"1min":0.32300000000000001,"5min":0.27700000000000002,"15min":0.215},"max":{"1min":0.54200000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.308}]},{"osd":1,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.432,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.58799999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.377},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.30599999999999999},"max":{"1min":0.60299999999999998,"5min":0.71199999999999997,"15min":0.75700000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45000000000000001,"15min":0.41099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.58399999999999996,"5min":0.628,"15min":0.628},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46400000000000002},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.64200000000000002,"5min":0.76200000000000001,"15min":0.79800000000000004},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.64300000000000002},"min":{"1min":0.52700000000000002,"5min":0.378,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.0049999999999999,"15min":1.034},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":1.04,"15min":3.4590000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":3.4289999999999998},"last":0.745},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.629},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":1.107},"last":0.80200000000000005}]},{"osd":6,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":1.032,"15min":3.4049999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.66900000000000004},"min":{"1min":0.56200000000000006,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":1.091,"15min":1.091},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.40200000000000002},"max":{"1min":0.88600000000000001,"5min":1.1519999999999999,"15min":3.391},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":15808,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94356032,"statfs":{"total":96636764160,"available":96620576768,"internally_reserved":0,"allocated":712704,"data_stored":348404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.55700000000000005},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.0069999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.38200000000000001,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.82599999999999996},"last":0.40300000000000002}]},{"osd":1,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.79500000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.37}]},{"osd":2,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.55500000000000005},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.314},"max":{"1min":0.748,"5min":0.82199999999999995,"15min":0.83699999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.88300000000000001,"15min":0.96899999999999997},"last":0.44},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.64700000000000002,"5min":0.79800000000000004,"15min":0.86799999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.86099999999999999,"15min":1.0369999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":1.004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61299999999999999,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.99199999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":1.0629999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.92500000000000004},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19020,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":18304,"kb_avail":94352820,"statfs":{"total":96636764160,"available":96617287680,"internally_reserved":0,"allocated":724992,"data_stored":354259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18743296},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.60599999999999998},"min":{"1min":0.47999999999999998,"5min":0.40600000000000003,"15min":0.32700000000000001},"max":{"1min":0.78500000000000003,"5min":0.86699999999999999,"15min":0.876},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65300000000000002,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.88100000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63400000000000001,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.53800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.995},"last":0.80000000000000004}]},{"osd":2,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.36299999999999999},"max":{"1min":0.68999999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.629}]},{"osd":3,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45800000000000002,"5min":0.38600000000000001,"15min":0.36199999999999999},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.96199999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.76800000000000002,"5min":0.81000000000000005,"15min":0.85999999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46999999999999997,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.66600000000000004,"5min":0.76700000000000002,"15min":0.91700000000000004},"last":0.438},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.92700000000000005},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.85599999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.91100000000000003},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56899999999999995,"15min":0.60399999999999998},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.31},"max":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.92500000000000004},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:06:01.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:06:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.379+0000 7fef893e7700 1 Processor -- start 2023-05-17T15:06:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.379+0000 7fef893e7700 1 -- start start 2023-05-17T15:06:01.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef893e7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef840c1730 0x7fef841543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef893e7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840bfcd0 con 0x7fef840c6310 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef893e7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840c0290 con 0x7fef840c5f30 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef893e7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840aa1a0 con 0x7fef840c1730 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef827fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fef840c6310 0x7fef84153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36952/0 (socket says 172.21.15.27:36952) 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef827fc700 1 -- 172.21.15.27:0/3277707998 learned_addr learned my addr 172.21.15.27:0/3277707998 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef837fe700 1 --2- 172.21.15.27:0/3277707998 >> v2:172.21.15.40:3300/0 conn(0x7fef840c1730 0x7fef841543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240245840 0 0) 0x7fef840bfcd0 con 0x7fef840c6310 2023-05-17T15:06:01.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef6c0033f0 con 0x7fef840c6310 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386917504 0 0) 0x7fef840c0290 con 0x7fef840c5f30 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef840bfcd0 con 0x7fef840c5f30 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.380+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596922486 0 0) 0x7fef6c0033f0 con 0x7fef840c6310 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef837fe700 1 -- 172.21.15.27:0/3277707998 >> v1:172.21.15.40:6789/0 conn(0x7fef840c5f30 legacy=0x7fef84158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef837fe700 1 -- 172.21.15.27:0/3277707998 >> v1:172.21.15.27:6789/0 conn(0x7fef840c6310 legacy=0x7fef84153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef837fe700 1 -- 172.21.15.27:0/3277707998 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840aa480 con 0x7fef840c1730 2023-05-17T15:06:01.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef837fe700 1 --2- 172.21.15.27:0/3277707998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c1730 0x7fef841543e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fef74009e60 tx=0x7fef74009780).ready entity=mon.1 client_cookie=4ccc6269497182b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400e070 con 0x7fef840c1730 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400b7a0 con 0x7fef840c1730 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef81ffb700 1 -- 172.21.15.27:0/3277707998 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78001470 con 0x7fef840c1730 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 -- 172.21.15.27:0/3277707998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c1730 msgr2=0x7fef841543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 --2- 172.21.15.27:0/3277707998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c1730 0x7fef841543e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fef74009e60 tx=0x7fef74009780).stop 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 -- 172.21.15.27:0/3277707998 shutdown_connections 2023-05-17T15:06:01.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 --2- 172.21.15.27:0/3277707998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c1730 0x7fef841543e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 -- 172.21.15.27:0/3277707998 >> 172.21.15.27:0/3277707998 conn(0x7fef84069e70 msgr2=0x7fef8405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:01.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 -- 172.21.15.27:0/3277707998 shutdown_connections 2023-05-17T15:06:01.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.381+0000 7fef893e7700 1 -- 172.21.15.27:0/3277707998 wait complete. 2023-05-17T15:06:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 Processor -- start 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 -- start start 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 0x7fef84155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef840c5f30 0x7fef8414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c6310 0x7fef8414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840ca2d0 con 0x7fef840c1730 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84155760 con 0x7fef840c6310 2023-05-17T15:06:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef893e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840c9710 con 0x7fef840c5f30 2023-05-17T15:06:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.383+0000 7fef82ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 0x7fef84155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 0x7fef84155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37394/0 (socket says 172.21.15.27:37394) 2023-05-17T15:06:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 -- 172.21.15.27:0/1766871087 learned_addr learned my addr 172.21.15.27:0/1766871087 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef837fe700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c6310 0x7fef8414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef827fc700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef840c5f30 0x7fef8414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 -- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef840c5f30 msgr2=0x7fef8414d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef840c5f30 0x7fef8414d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 -- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c6310 msgr2=0x7fef8414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c6310 0x7fef8414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 -- 172.21.15.27:0/1766871087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009a20 con 0x7fef840c1730 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef837fe700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c6310 0x7fef8414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef827fc700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef840c5f30 0x7fef8414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:06:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef82ffd700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 0x7fef84155270 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fef7c00c490 tx=0x7fef7c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00f470 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00f5d0 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef840c99f0 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00f970 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.384+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8414d5a0 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.385+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef840ca440 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.386+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fef7c019030 con 0x7fef840c1730 2023-05-17T15:06:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.386+0000 7fef6affd700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef7005ee20 0x7fef700612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.386+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fef7c079100 con 0x7fef840c1730 2023-05-17T15:06:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.386+0000 7fef827fc700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef7005ee20 0x7fef700612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.386+0000 7fef827fc700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef7005ee20 0x7fef700612e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fef78001ed0 tx=0x7fef780015a0).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.390+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef7c04a650 con 0x7fef840c1730 2023-05-17T15:06:01.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.558+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef840ca150 con 0x7fef7005ee20 2023-05-17T15:06:01.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.568+0000 7fef6affd700 1 -- 172.21.15.27:0/1766871087 <== mgr.5547 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361618 (secure 0 0 0) 0x7fef7800e630 con 0x7fef7005ee20 2023-05-17T15:06:01.575 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:06:01.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef7005ee20 msgr2=0x7fef700612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef7005ee20 0x7fef700612e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fef78001ed0 tx=0x7fef780015a0).stop 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 msgr2=0x7fef84155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 0x7fef84155270 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fef7c00c490 tx=0x7fef7c007c90).stop 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 shutdown_connections 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fef7005ee20 0x7fef700612e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840c6310 0x7fef8414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef840c1730 0x7fef84155270 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 --2- 172.21.15.27:0/1766871087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef840c5f30 0x7fef8414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 >> 172.21.15.27:0/1766871087 conn(0x7fef84069e70 msgr2=0x7fef84159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:01.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 shutdown_connections 2023-05-17T15:06:01.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.572+0000 7fef893e7700 1 -- 172.21.15.27:0/1766871087 wait complete. 2023-05-17T15:06:01.579 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:06:01.587 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-05-17T15:06:01.333068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":130556,"kb_used_data":6076,"kb_used_omap":0,"kb_used_meta":124416,"kb_avail":754844164,"statfs":{"total":773094113280,"available":772960423936,"internally_reserved":0,"allocated":6221824,"data_stored":3034112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":127401984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14998730,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-719,"num_write_kb":-15551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.323652"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.207956+0000","last_change":"2023-05-17T15:05:57.206066+0000","last_active":"2023-05-17T15:05:57.207956+0000","last_peered":"2023-05-17T15:05:57.207956+0000","last_clean":"2023-05-17T15:05:57.207956+0000","last_became_active":"2023-05-17T15:05:57.205825+0000","last_became_peered":"2023-05-17T15:05:57.205825+0000","last_unstale":"2023-05-17T15:05:57.207956+0000","last_undegraded":"2023-05-17T15:05:57.207956+0000","last_fullsized":"2023-05-17T15:05:57.207956+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.212984+0000","last_change":"2023-05-17T15:05:56.814259+0000","last_active":"2023-05-17T15:05:57.212984+0000","last_peered":"2023-05-17T15:05:57.212984+0000","last_clean":"2023-05-17T15:05:57.212984+0000","last_became_active":"2023-05-17T15:05:56.813955+0000","last_became_peered":"2023-05-17T15:05:56.813955+0000","last_unstale":"2023-05-17T15:05:57.212984+0000","last_undegraded":"2023-05-17T15:05:57.212984+0000","last_fullsized":"2023-05-17T15:05:57.212984+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.217116+0000","last_change":"2023-05-17T15:05:57.214325+0000","last_active":"2023-05-17T15:05:57.217116+0000","last_peered":"2023-05-17T15:05:57.217116+0000","last_clean":"2023-05-17T15:05:57.217116+0000","last_became_active":"2023-05-17T15:05:57.214024+0000","last_became_peered":"2023-05-17T15:05:57.214024+0000","last_unstale":"2023-05-17T15:05:57.217116+0000","last_undegraded":"2023-05-17T15:05:57.217116+0000","last_fullsized":"2023-05-17T15:05:57.217116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199779+0000","last_change":"2023-05-17T15:05:56.817147+0000","last_active":"2023-05-17T15:05:57.199779+0000","last_peered":"2023-05-17T15:05:57.199779+0000","last_clean":"2023-05-17T15:05:57.199779+0000","last_became_active":"2023-05-17T15:05:56.816835+0000","last_became_peered":"2023-05-17T15:05:56.816835+0000","last_unstale":"2023-05-17T15:05:57.199779+0000","last_undegraded":"2023-05-17T15:05:57.199779+0000","last_fullsized":"2023-05-17T15:05:57.199779+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218449+0000","last_change":"2023-05-17T15:05:57.212356+0000","last_active":"2023-05-17T15:05:57.218449+0000","last_peered":"2023-05-17T15:05:57.218449+0000","last_clean":"2023-05-17T15:05:57.218449+0000","last_became_active":"2023-05-17T15:05:57.212051+0000","last_became_peered":"2023-05-17T15:05:57.212051+0000","last_unstale":"2023-05-17T15:05:57.218449+0000","last_undegraded":"2023-05-17T15:05:57.218449+0000","last_fullsized":"2023-05-17T15:05:57.218449+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194124+0000","last_change":"2023-05-17T15:05:56.808816+0000","last_active":"2023-05-17T15:05:57.194124+0000","last_peered":"2023-05-17T15:05:57.194124+0000","last_clean":"2023-05-17T15:05:57.194124+0000","last_became_active":"2023-05-17T15:05:56.808388+0000","last_became_peered":"2023-05-17T15:05:56.808388+0000","last_unstale":"2023-05-17T15:05:57.194124+0000","last_undegraded":"2023-05-17T15:05:57.194124+0000","last_fullsized":"2023-05-17T15:05:57.194124+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211230+0000","last_change":"2023-05-17T15:05:57.207887+0000","last_active":"2023-05-17T15:05:57.211230+0000","last_peered":"2023-05-17T15:05:57.211230+0000","last_clean":"2023-05-17T15:05:57.211230+0000","last_became_active":"2023-05-17T15:05:57.206941+0000","last_became_peered":"2023-05-17T15:05:57.206941+0000","last_unstale":"2023-05-17T15:05:57.211230+0000","last_undegraded":"2023-05-17T15:05:57.211230+0000","last_fullsized":"2023-05-17T15:05:57.211230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.213894+0000","last_change":"2023-05-17T15:05:56.818523+0000","last_active":"2023-05-17T15:05:57.213894+0000","last_peered":"2023-05-17T15:05:57.213894+0000","last_clean":"2023-05-17T15:05:57.213894+0000","last_became_active":"2023-05-17T15:05:56.818252+0000","last_became_peered":"2023-05-17T15:05:56.818252+0000","last_unstale":"2023-05-17T15:05:57.213894+0000","last_undegraded":"2023-05-17T15:05:57.213894+0000","last_fullsized":"2023-05-17T15:05:57.213894+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222545+0000","last_change":"2023-05-17T15:05:57.215949+0000","last_active":"2023-05-17T15:05:57.222545+0000","last_peered":"2023-05-17T15:05:57.222545+0000","last_clean":"2023-05-17T15:05:57.222545+0000","last_became_active":"2023-05-17T15:05:57.215649+0000","last_became_peered":"2023-05-17T15:05:57.215649+0000","last_unstale":"2023-05-17T15:05:57.222545+0000","last_undegraded":"2023-05-17T15:05:57.222545+0000","last_fullsized":"2023-05-17T15:05:57.222545+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215223+0000","last_change":"2023-05-17T15:05:56.813504+0000","last_active":"2023-05-17T15:05:57.215223+0000","last_peered":"2023-05-17T15:05:57.215223+0000","last_clean":"2023-05-17T15:05:57.215223+0000","last_became_active":"2023-05-17T15:05:56.813208+0000","last_became_peered":"2023-05-17T15:05:56.813208+0000","last_unstale":"2023-05-17T15:05:57.215223+0000","last_undegraded":"2023-05-17T15:05:57.215223+0000","last_fullsized":"2023-05-17T15:05:57.215223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211351+0000","last_change":"2023-05-17T15:05:57.205622+0000","last_active":"2023-05-17T15:05:57.211351+0000","last_peered":"2023-05-17T15:05:57.211351+0000","last_clean":"2023-05-17T15:05:57.211351+0000","last_became_active":"2023-05-17T15:05:57.205415+0000","last_became_peered":"2023-05-17T15:05:57.205415+0000","last_unstale":"2023-05-17T15:05:57.211351+0000","last_undegraded":"2023-05-17T15:05:57.211351+0000","last_fullsized":"2023-05-17T15:05:57.211351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.219096+0000","last_change":"2023-05-17T15:05:56.818845+0000","last_active":"2023-05-17T15:05:57.219096+0000","last_peered":"2023-05-17T15:05:57.219096+0000","last_clean":"2023-05-17T15:05:57.219096+0000","last_became_active":"2023-05-17T15:05:56.818248+0000","last_became_peered":"2023-05-17T15:05:56.818248+0000","last_unstale":"2023-05-17T15:05:57.219096+0000","last_undegraded":"2023-05-17T15:05:57.219096+0000","last_fullsized":"2023-05-17T15:05:57.219096+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.214144+0000","last_change":"2023-05-17T15:05:57.209338+0000","last_active":"2023-05-17T15:05:57.214144+0000","last_peered":"2023-05-17T15:05:57.214144+0000","last_clean":"2023-05-17T15:05:57.214144+0000","last_became_active":"2023-05-17T15:05:57.209107+0000","last_became_peered":"2023-05-17T15:05:57.209107+0000","last_unstale":"2023-05-17T15:05:57.214144+0000","last_undegraded":"2023-05-17T15:05:57.214144+0000","last_fullsized":"2023-05-17T15:05:57.214144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.195967+0000","last_change":"2023-05-17T15:05:56.818295+0000","last_active":"2023-05-17T15:05:57.195967+0000","last_peered":"2023-05-17T15:05:57.195967+0000","last_clean":"2023-05-17T15:05:57.195967+0000","last_became_active":"2023-05-17T15:05:56.818012+0000","last_became_peered":"2023-05-17T15:05:56.818012+0000","last_unstale":"2023-05-17T15:05:57.195967+0000","last_undegraded":"2023-05-17T15:05:57.195967+0000","last_fullsized":"2023-05-17T15:05:57.195967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222283+0000","last_change":"2023-05-17T15:05:57.213394+0000","last_active":"2023-05-17T15:05:57.222283+0000","last_peered":"2023-05-17T15:05:57.222283+0000","last_clean":"2023-05-17T15:05:57.222283+0000","last_became_active":"2023-05-17T15:05:57.213061+0000","last_became_peered":"2023-05-17T15:05:57.213061+0000","last_unstale":"2023-05-17T15:05:57.222283+0000","last_undegraded":"2023-05-17T15:05:57.222283+0000","last_fullsized":"2023-05-17T15:05:57.222283+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.192225+0000","last_change":"2023-05-17T15:05:56.825848+0000","last_active":"2023-05-17T15:05:57.192225+0000","last_peered":"2023-05-17T15:05:57.192225+0000","last_clean":"2023-05-17T15:05:57.192225+0000","last_became_active":"2023-05-17T15:05:56.825317+0000","last_became_peered":"2023-05-17T15:05:56.825317+0000","last_unstale":"2023-05-17T15:05:57.192225+0000","last_undegraded":"2023-05-17T15:05:57.192225+0000","last_fullsized":"2023-05-17T15:05:57.192225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222217+0000","last_change":"2023-05-17T15:05:57.213521+0000","last_active":"2023-05-17T15:05:57.222217+0000","last_peered":"2023-05-17T15:05:57.222217+0000","last_clean":"2023-05-17T15:05:57.222217+0000","last_became_active":"2023-05-17T15:05:57.212412+0000","last_became_peered":"2023-05-17T15:05:57.212412+0000","last_unstale":"2023-05-17T15:05:57.222217+0000","last_undegraded":"2023-05-17T15:05:57.222217+0000","last_fullsized":"2023-05-17T15:05:57.222217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194257+0000","last_change":"2023-05-17T15:05:56.823052+0000","last_active":"2023-05-17T15:05:57.194257+0000","last_peered":"2023-05-17T15:05:57.194257+0000","last_clean":"2023-05-17T15:05:57.194257+0000","last_became_active":"2023-05-17T15:05:56.822734+0000","last_became_peered":"2023-05-17T15:05:56.822734+0000","last_unstale":"2023-05-17T15:05:57.194257+0000","last_undegraded":"2023-05-17T15:05:57.194257+0000","last_fullsized":"2023-05-17T15:05:57.194257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.213161+0000","last_change":"2023-05-17T15:05:57.204342+0000","last_active":"2023-05-17T15:05:57.213161+0000","last_peered":"2023-05-17T15:05:57.213161+0000","last_clean":"2023-05-17T15:05:57.213161+0000","last_became_active":"2023-05-17T15:05:57.204015+0000","last_became_peered":"2023-05-17T15:05:57.204015+0000","last_unstale":"2023-05-17T15:05:57.213161+0000","last_undegraded":"2023-05-17T15:05:57.213161+0000","last_fullsized":"2023-05-17T15:05:57.213161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.193262+0000","last_change":"2023-05-17T15:05:56.825069+0000","last_active":"2023-05-17T15:05:57.193262+0000","last_peered":"2023-05-17T15:05:57.193262+0000","last_clean":"2023-05-17T15:05:57.193262+0000","last_became_active":"2023-05-17T15:05:56.824784+0000","last_became_peered":"2023-05-17T15:05:56.824784+0000","last_unstale":"2023-05-17T15:05:57.193262+0000","last_undegraded":"2023-05-17T15:05:57.193262+0000","last_fullsized":"2023-05-17T15:05:57.193262+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.208108+0000","last_change":"2023-05-17T15:05:57.207023+0000","last_active":"2023-05-17T15:05:57.208108+0000","last_peered":"2023-05-17T15:05:57.208108+0000","last_clean":"2023-05-17T15:05:57.208108+0000","last_became_active":"2023-05-17T15:05:57.206729+0000","last_became_peered":"2023-05-17T15:05:57.206729+0000","last_unstale":"2023-05-17T15:05:57.208108+0000","last_undegraded":"2023-05-17T15:05:57.208108+0000","last_fullsized":"2023-05-17T15:05:57.208108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.193633+0000","last_change":"2023-05-17T15:05:56.823874+0000","last_active":"2023-05-17T15:05:57.193633+0000","last_peered":"2023-05-17T15:05:57.193633+0000","last_clean":"2023-05-17T15:05:57.193633+0000","last_became_active":"2023-05-17T15:05:56.823574+0000","last_became_peered":"2023-05-17T15:05:56.823574+0000","last_unstale":"2023-05-17T15:05:57.193633+0000","last_undegraded":"2023-05-17T15:05:57.193633+0000","last_fullsized":"2023-05-17T15:05:57.193633+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.208471+0000","last_change":"2023-05-17T15:05:57.205194+0000","last_active":"2023-05-17T15:05:57.208471+0000","last_peered":"2023-05-17T15:05:57.208471+0000","last_clean":"2023-05-17T15:05:57.208471+0000","last_became_active":"2023-05-17T15:05:57.204806+0000","last_became_peered":"2023-05-17T15:05:57.204806+0000","last_unstale":"2023-05-17T15:05:57.208471+0000","last_undegraded":"2023-05-17T15:05:57.208471+0000","last_fullsized":"2023-05-17T15:05:57.208471+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.225374+0000","last_change":"2023-05-17T15:05:56.809880+0000","last_active":"2023-05-17T15:05:57.225374+0000","last_peered":"2023-05-17T15:05:57.225374+0000","last_clean":"2023-05-17T15:05:57.225374+0000","last_became_active":"2023-05-17T15:05:56.809396+0000","last_became_peered":"2023-05-17T15:05:56.809396+0000","last_unstale":"2023-05-17T15:05:57.225374+0000","last_undegraded":"2023-05-17T15:05:57.225374+0000","last_fullsized":"2023-05-17T15:05:57.225374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222199+0000","last_change":"2023-05-17T15:05:57.217032+0000","last_active":"2023-05-17T15:05:57.222199+0000","last_peered":"2023-05-17T15:05:57.222199+0000","last_clean":"2023-05-17T15:05:57.222199+0000","last_became_active":"2023-05-17T15:05:57.216743+0000","last_became_peered":"2023-05-17T15:05:57.216743+0000","last_unstale":"2023-05-17T15:05:57.222199+0000","last_undegraded":"2023-05-17T15:05:57.222199+0000","last_fullsized":"2023-05-17T15:05:57.222199+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222724+0000","last_change":"2023-05-17T15:05:56.821512+0000","last_active":"2023-05-17T15:05:57.222724+0000","last_peered":"2023-05-17T15:05:57.222724+0000","last_clean":"2023-05-17T15:05:57.222724+0000","last_became_active":"2023-05-17T15:05:56.821216+0000","last_became_peered":"2023-05-17T15:05:56.821216+0000","last_unstale":"2023-05-17T15:05:57.222724+0000","last_undegraded":"2023-05-17T15:05:57.222724+0000","last_fullsized":"2023-05-17T15:05:57.222724+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218909+0000","last_change":"2023-05-17T15:05:57.215045+0000","last_active":"2023-05-17T15:05:57.218909+0000","last_peered":"2023-05-17T15:05:57.218909+0000","last_clean":"2023-05-17T15:05:57.218909+0000","last_became_active":"2023-05-17T15:05:57.214648+0000","last_became_peered":"2023-05-17T15:05:57.214648+0000","last_unstale":"2023-05-17T15:05:57.218909+0000","last_undegraded":"2023-05-17T15:05:57.218909+0000","last_fullsized":"2023-05-17T15:05:57.218909+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.192806+0000","last_change":"2023-05-17T15:05:56.824586+0000","last_active":"2023-05-17T15:05:57.192806+0000","last_peered":"2023-05-17T15:05:57.192806+0000","last_clean":"2023-05-17T15:05:57.192806+0000","last_became_active":"2023-05-17T15:05:56.824326+0000","last_became_peered":"2023-05-17T15:05:56.824326+0000","last_unstale":"2023-05-17T15:05:57.192806+0000","last_undegraded":"2023-05-17T15:05:57.192806+0000","last_fullsized":"2023-05-17T15:05:57.192806+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.221511+0000","last_change":"2023-05-17T15:05:57.216032+0000","last_active":"2023-05-17T15:05:57.221511+0000","last_peered":"2023-05-17T15:05:57.221511+0000","last_clean":"2023-05-17T15:05:57.221511+0000","last_became_active":"2023-05-17T15:05:57.215774+0000","last_became_peered":"2023-05-17T15:05:57.215774+0000","last_unstale":"2023-05-17T15:05:57.221511+0000","last_undegraded":"2023-05-17T15:05:57.221511+0000","last_fullsized":"2023-05-17T15:05:57.221511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.197751+0000","last_change":"2023-05-17T15:05:56.815902+0000","last_active":"2023-05-17T15:05:57.197751+0000","last_peered":"2023-05-17T15:05:57.197751+0000","last_clean":"2023-05-17T15:05:57.197751+0000","last_became_active":"2023-05-17T15:05:56.815626+0000","last_became_peered":"2023-05-17T15:05:56.815626+0000","last_unstale":"2023-05-17T15:05:57.197751+0000","last_undegraded":"2023-05-17T15:05:57.197751+0000","last_fullsized":"2023-05-17T15:05:57.197751+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211181+0000","last_change":"2023-05-17T15:05:57.210050+0000","last_active":"2023-05-17T15:05:57.211181+0000","last_peered":"2023-05-17T15:05:57.211181+0000","last_clean":"2023-05-17T15:05:57.211181+0000","last_became_active":"2023-05-17T15:05:57.209801+0000","last_became_peered":"2023-05-17T15:05:57.209801+0000","last_unstale":"2023-05-17T15:05:57.211181+0000","last_undegraded":"2023-05-17T15:05:57.211181+0000","last_fullsized":"2023-05-17T15:05:57.211181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.217844+0000","last_change":"2023-05-17T15:05:56.816879+0000","last_active":"2023-05-17T15:05:57.217844+0000","last_peered":"2023-05-17T15:05:57.217844+0000","last_clean":"2023-05-17T15:05:57.217844+0000","last_became_active":"2023-05-17T15:05:56.816544+0000","last_became_peered":"2023-05-17T15:05:56.816544+0000","last_unstale":"2023-05-17T15:05:57.217844+0000","last_undegraded":"2023-05-17T15:05:57.217844+0000","last_fullsized":"2023-05-17T15:05:57.217844+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215272+0000","last_change":"2023-05-17T15:05:57.210833+0000","last_active":"2023-05-17T15:05:57.215272+0000","last_peered":"2023-05-17T15:05:57.215272+0000","last_clean":"2023-05-17T15:05:57.215272+0000","last_became_active":"2023-05-17T15:05:57.210515+0000","last_became_peered":"2023-05-17T15:05:57.210515+0000","last_unstale":"2023-05-17T15:05:57.215272+0000","last_undegraded":"2023-05-17T15:05:57.215272+0000","last_fullsized":"2023-05-17T15:05:57.215272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194233+0000","last_change":"2023-05-17T15:05:56.811236+0000","last_active":"2023-05-17T15:05:57.194233+0000","last_peered":"2023-05-17T15:05:57.194233+0000","last_clean":"2023-05-17T15:05:57.194233+0000","last_became_active":"2023-05-17T15:05:56.810989+0000","last_became_peered":"2023-05-17T15:05:56.810989+0000","last_unstale":"2023-05-17T15:05:57.194233+0000","last_undegraded":"2023-05-17T15:05:57.194233+0000","last_fullsized":"2023-05-17T15:05:57.194233+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218439+0000","last_change":"2023-05-17T15:05:57.213611+0000","last_active":"2023-05-17T15:05:57.218439+0000","last_peered":"2023-05-17T15:05:57.218439+0000","last_clean":"2023-05-17T15:05:57.218439+0000","last_became_active":"2023-05-17T15:05:57.213293+0000","last_became_peered":"2023-05-17T15:05:57.213293+0000","last_unstale":"2023-05-17T15:05:57.218439+0000","last_undegraded":"2023-05-17T15:05:57.218439+0000","last_fullsized":"2023-05-17T15:05:57.218439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194073+0000","last_change":"2023-05-17T15:05:56.823823+0000","last_active":"2023-05-17T15:05:57.194073+0000","last_peered":"2023-05-17T15:05:57.194073+0000","last_clean":"2023-05-17T15:05:57.194073+0000","last_became_active":"2023-05-17T15:05:56.823544+0000","last_became_peered":"2023-05-17T15:05:56.823544+0000","last_unstale":"2023-05-17T15:05:57.194073+0000","last_undegraded":"2023-05-17T15:05:57.194073+0000","last_fullsized":"2023-05-17T15:05:57.194073+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215171+0000","last_change":"2023-05-17T15:05:57.209391+0000","last_active":"2023-05-17T15:05:57.215171+0000","last_peered":"2023-05-17T15:05:57.215171+0000","last_clean":"2023-05-17T15:05:57.215171+0000","last_became_active":"2023-05-17T15:05:57.209088+0000","last_became_peered":"2023-05-17T15:05:57.209088+0000","last_unstale":"2023-05-17T15:05:57.215171+0000","last_undegraded":"2023-05-17T15:05:57.215171+0000","last_fullsized":"2023-05-17T15:05:57.215171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.220046+0000","last_change":"2023-05-17T15:05:56.815936+0000","last_active":"2023-05-17T15:05:57.220046+0000","last_peered":"2023-05-17T15:05:57.220046+0000","last_clean":"2023-05-17T15:05:57.220046+0000","last_became_active":"2023-05-17T15:05:56.815609+0000","last_became_peered":"2023-05-17T15:05:56.815609+0000","last_unstale":"2023-05-17T15:05:57.220046+0000","last_undegraded":"2023-05-17T15:05:57.220046+0000","last_fullsized":"2023-05-17T15:05:57.220046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211604+0000","last_change":"2023-05-17T15:05:57.206651+0000","last_active":"2023-05-17T15:05:57.211604+0000","last_peered":"2023-05-17T15:05:57.211604+0000","last_clean":"2023-05-17T15:05:57.211604+0000","last_became_active":"2023-05-17T15:05:57.206375+0000","last_became_peered":"2023-05-17T15:05:57.206375+0000","last_unstale":"2023-05-17T15:05:57.211604+0000","last_undegraded":"2023-05-17T15:05:57.211604+0000","last_fullsized":"2023-05-17T15:05:57.211604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.203137+0000","last_change":"2023-05-17T15:05:56.826341+0000","last_active":"2023-05-17T15:05:57.203137+0000","last_peered":"2023-05-17T15:05:57.203137+0000","last_clean":"2023-05-17T15:05:57.203137+0000","last_became_active":"2023-05-17T15:05:56.826046+0000","last_became_peered":"2023-05-17T15:05:56.826046+0000","last_unstale":"2023-05-17T15:05:57.203137+0000","last_undegraded":"2023-05-17T15:05:57.203137+0000","last_fullsized":"2023-05-17T15:05:57.203137+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.216296+0000","last_change":"2023-05-17T15:05:57.212289+0000","last_active":"2023-05-17T15:05:57.216296+0000","last_peered":"2023-05-17T15:05:57.216296+0000","last_clean":"2023-05-17T15:05:57.216296+0000","last_became_active":"2023-05-17T15:05:57.210836+0000","last_became_peered":"2023-05-17T15:05:57.210836+0000","last_unstale":"2023-05-17T15:05:57.216296+0000","last_undegraded":"2023-05-17T15:05:57.216296+0000","last_fullsized":"2023-05-17T15:05:57.216296+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.219086+0000","last_change":"2023-05-17T15:05:56.819293+0000","last_active":"2023-05-17T15:05:57.219086+0000","last_peered":"2023-05-17T15:05:57.219086+0000","last_clean":"2023-05-17T15:05:57.219086+0000","last_became_active":"2023-05-17T15:05:56.818789+0000","last_became_peered":"2023-05-17T15:05:56.818789+0000","last_unstale":"2023-05-17T15:05:57.219086+0000","last_undegraded":"2023-05-17T15:05:57.219086+0000","last_fullsized":"2023-05-17T15:05:57.219086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218653+0000","last_change":"2023-05-17T15:05:57.216543+0000","last_active":"2023-05-17T15:05:57.218653+0000","last_peered":"2023-05-17T15:05:57.218653+0000","last_clean":"2023-05-17T15:05:57.218653+0000","last_became_active":"2023-05-17T15:05:57.216397+0000","last_became_peered":"2023-05-17T15:05:57.216397+0000","last_unstale":"2023-05-17T15:05:57.218653+0000","last_undegraded":"2023-05-17T15:05:57.218653+0000","last_fullsized":"2023-05-17T15:05:57.218653+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.193888+0000","last_change":"2023-05-17T15:05:56.815204+0000","last_active":"2023-05-17T15:05:57.193888+0000","last_peered":"2023-05-17T15:05:57.193888+0000","last_clean":"2023-05-17T15:05:57.193888+0000","last_became_active":"2023-05-17T15:05:56.814875+0000","last_became_peered":"2023-05-17T15:05:56.814875+0000","last_unstale":"2023-05-17T15:05:57.193888+0000","last_undegraded":"2023-05-17T15:05:57.193888+0000","last_fullsized":"2023-05-17T15:05:57.193888+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222501+0000","last_change":"2023-05-17T15:05:57.216812+0000","last_active":"2023-05-17T15:05:57.222501+0000","last_peered":"2023-05-17T15:05:57.222501+0000","last_clean":"2023-05-17T15:05:57.222501+0000","last_became_active":"2023-05-17T15:05:57.216372+0000","last_became_peered":"2023-05-17T15:05:57.216372+0000","last_unstale":"2023-05-17T15:05:57.222501+0000","last_undegraded":"2023-05-17T15:05:57.222501+0000","last_fullsized":"2023-05-17T15:05:57.222501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.204219+0000","last_change":"2023-05-17T15:05:56.812912+0000","last_active":"2023-05-17T15:05:57.204219+0000","last_peered":"2023-05-17T15:05:57.204219+0000","last_clean":"2023-05-17T15:05:57.204219+0000","last_became_active":"2023-05-17T15:05:56.812614+0000","last_became_peered":"2023-05-17T15:05:56.812614+0000","last_unstale":"2023-05-17T15:05:57.204219+0000","last_undegraded":"2023-05-17T15:05:57.204219+0000","last_fullsized":"2023-05-17T15:05:57.204219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218148+0000","last_change":"2023-05-17T15:05:57.211987+0000","last_active":"2023-05-17T15:05:57.218148+0000","last_peered":"2023-05-17T15:05:57.218148+0000","last_clean":"2023-05-17T15:05:57.218148+0000","last_became_active":"2023-05-17T15:05:57.211729+0000","last_became_peered":"2023-05-17T15:05:57.211729+0000","last_unstale":"2023-05-17T15:05:57.218148+0000","last_undegraded":"2023-05-17T15:05:57.218148+0000","last_fullsized":"2023-05-17T15:05:57.218148+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.197320+0000","last_change":"2023-05-17T15:05:56.811350+0000","last_active":"2023-05-17T15:05:57.197320+0000","last_peered":"2023-05-17T15:05:57.197320+0000","last_clean":"2023-05-17T15:05:57.197320+0000","last_became_active":"2023-05-17T15:05:56.811050+0000","last_became_peered":"2023-05-17T15:05:56.811050+0000","last_unstale":"2023-05-17T15:05:57.197320+0000","last_undegraded":"2023-05-17T15:05:57.197320+0000","last_fullsized":"2023-05-17T15:05:57.197320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211548+0000","last_change":"2023-05-17T15:05:57.204630+0000","last_active":"2023-05-17T15:05:57.211548+0000","last_peered":"2023-05-17T15:05:57.211548+0000","last_clean":"2023-05-17T15:05:57.211548+0000","last_became_active":"2023-05-17T15:05:57.202260+0000","last_became_peered":"2023-05-17T15:05:57.202260+0000","last_unstale":"2023-05-17T15:05:57.211548+0000","last_undegraded":"2023-05-17T15:05:57.211548+0000","last_fullsized":"2023-05-17T15:05:57.211548+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.201146+0000","last_change":"2023-05-17T15:05:56.818656+0000","last_active":"2023-05-17T15:05:57.201146+0000","last_peered":"2023-05-17T15:05:57.201146+0000","last_clean":"2023-05-17T15:05:57.201146+0000","last_became_active":"2023-05-17T15:05:56.818354+0000","last_became_peered":"2023-05-17T15:05:56.818354+0000","last_unstale":"2023-05-17T15:05:57.201146+0000","last_undegraded":"2023-05-17T15:05:57.201146+0000","last_fullsized":"2023-05-17T15:05:57.201146+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211398+0000","last_change":"2023-05-17T15:05:57.205945+0000","last_active":"2023-05-17T15:05:57.211398+0000","last_peered":"2023-05-17T15:05:57.211398+0000","last_clean":"2023-05-17T15:05:57.211398+0000","last_became_active":"2023-05-17T15:05:57.205451+0000","last_became_peered":"2023-05-17T15:05:57.205451+0000","last_unstale":"2023-05-17T15:05:57.211398+0000","last_undegraded":"2023-05-17T15:05:57.211398+0000","last_fullsized":"2023-05-17T15:05:57.211398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.203012+0000","last_change":"2023-05-17T15:05:56.821375+0000","last_active":"2023-05-17T15:05:57.203012+0000","last_peered":"2023-05-17T15:05:57.203012+0000","last_clean":"2023-05-17T15:05:57.203012+0000","last_became_active":"2023-05-17T15:05:56.821065+0000","last_became_peered":"2023-05-17T15:05:56.821065+0000","last_unstale":"2023-05-17T15:05:57.203012+0000","last_undegraded":"2023-05-17T15:05:57.203012+0000","last_fullsized":"2023-05-17T15:05:57.203012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222285+0000","last_change":"2023-05-17T15:05:57.213695+0000","last_active":"2023-05-17T15:05:57.222285+0000","last_peered":"2023-05-17T15:05:57.222285+0000","last_clean":"2023-05-17T15:05:57.222285+0000","last_became_active":"2023-05-17T15:05:57.212880+0000","last_became_peered":"2023-05-17T15:05:57.212880+0000","last_unstale":"2023-05-17T15:05:57.222285+0000","last_undegraded":"2023-05-17T15:05:57.222285+0000","last_fullsized":"2023-05-17T15:05:57.222285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.193960+0000","last_change":"2023-05-17T15:05:56.811201+0000","last_active":"2023-05-17T15:05:57.193960+0000","last_peered":"2023-05-17T15:05:57.193960+0000","last_clean":"2023-05-17T15:05:57.193960+0000","last_became_active":"2023-05-17T15:05:56.810961+0000","last_became_peered":"2023-05-17T15:05:56.810961+0000","last_unstale":"2023-05-17T15:05:57.193960+0000","last_undegraded":"2023-05-17T15:05:57.193960+0000","last_fullsized":"2023-05-17T15:05:57.193960+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215623+0000","last_change":"2023-05-17T15:05:57.211149+0000","last_active":"2023-05-17T15:05:57.215623+0000","last_peered":"2023-05-17T15:05:57.215623+0000","last_clean":"2023-05-17T15:05:57.215623+0000","last_became_active":"2023-05-17T15:05:57.208520+0000","last_became_peered":"2023-05-17T15:05:57.208520+0000","last_unstale":"2023-05-17T15:05:57.215623+0000","last_undegraded":"2023-05-17T15:05:57.215623+0000","last_fullsized":"2023-05-17T15:05:57.215623+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.200078+0000","last_change":"2023-05-17T15:05:56.809700+0000","last_active":"2023-05-17T15:05:57.200078+0000","last_peered":"2023-05-17T15:05:57.200078+0000","last_clean":"2023-05-17T15:05:57.200078+0000","last_became_active":"2023-05-17T15:05:56.808998+0000","last_became_peered":"2023-05-17T15:05:56.808998+0000","last_unstale":"2023-05-17T15:05:57.200078+0000","last_undegraded":"2023-05-17T15:05:57.200078+0000","last_fullsized":"2023-05-17T15:05:57.200078+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.213538+0000","last_change":"2023-05-17T15:05:57.206557+0000","last_active":"2023-05-17T15:05:57.213538+0000","last_peered":"2023-05-17T15:05:57.213538+0000","last_clean":"2023-05-17T15:05:57.213538+0000","last_became_active":"2023-05-17T15:05:57.206254+0000","last_became_peered":"2023-05-17T15:05:57.206254+0000","last_unstale":"2023-05-17T15:05:57.213538+0000","last_undegraded":"2023-05-17T15:05:57.213538+0000","last_fullsized":"2023-05-17T15:05:57.213538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.200913+0000","last_change":"2023-05-17T15:05:56.818752+0000","last_active":"2023-05-17T15:05:57.200913+0000","last_peered":"2023-05-17T15:05:57.200913+0000","last_clean":"2023-05-17T15:05:57.200913+0000","last_became_active":"2023-05-17T15:05:56.818455+0000","last_became_peered":"2023-05-17T15:05:56.818455+0000","last_unstale":"2023-05-17T15:05:57.200913+0000","last_undegraded":"2023-05-17T15:05:57.200913+0000","last_fullsized":"2023-05-17T15:05:57.200913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218887+0000","last_change":"2023-05-17T15:05:57.214928+0000","last_active":"2023-05-17T15:05:57.218887+0000","last_peered":"2023-05-17T15:05:57.218887+0000","last_clean":"2023-05-17T15:05:57.218887+0000","last_became_active":"2023-05-17T15:05:57.214554+0000","last_became_peered":"2023-05-17T15:05:57.214554+0000","last_unstale":"2023-05-17T15:05:57.218887+0000","last_undegraded":"2023-05-17T15:05:57.218887+0000","last_fullsized":"2023-05-17T15:05:57.218887+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194058+0000","last_change":"2023-05-17T15:05:56.814244+0000","last_active":"2023-05-17T15:05:57.194058+0000","last_peered":"2023-05-17T15:05:57.194058+0000","last_clean":"2023-05-17T15:05:57.194058+0000","last_became_active":"2023-05-17T15:05:56.813971+0000","last_became_peered":"2023-05-17T15:05:56.813971+0000","last_unstale":"2023-05-17T15:05:57.194058+0000","last_undegraded":"2023-05-17T15:05:57.194058+0000","last_fullsized":"2023-05-17T15:05:57.194058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.221477+0000","last_change":"2023-05-17T15:05:57.215022+0000","last_active":"2023-05-17T15:05:57.221477+0000","last_peered":"2023-05-17T15:05:57.221477+0000","last_clean":"2023-05-17T15:05:57.221477+0000","last_became_active":"2023-05-17T15:05:57.214709+0000","last_became_peered":"2023-05-17T15:05:57.214709+0000","last_unstale":"2023-05-17T15:05:57.221477+0000","last_undegraded":"2023-05-17T15:05:57.221477+0000","last_fullsized":"2023-05-17T15:05:57.221477+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.197688+0000","last_change":"2023-05-17T15:05:56.810376+0000","last_active":"2023-05-17T15:05:57.197688+0000","last_peered":"2023-05-17T15:05:57.197688+0000","last_clean":"2023-05-17T15:05:57.197688+0000","last_became_active":"2023-05-17T15:05:56.810049+0000","last_became_peered":"2023-05-17T15:05:56.810049+0000","last_unstale":"2023-05-17T15:05:57.197688+0000","last_undegraded":"2023-05-17T15:05:57.197688+0000","last_fullsized":"2023-05-17T15:05:57.197688+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218200+0000","last_change":"2023-05-17T15:05:57.212179+0000","last_active":"2023-05-17T15:05:57.218200+0000","last_peered":"2023-05-17T15:05:57.218200+0000","last_clean":"2023-05-17T15:05:57.218200+0000","last_became_active":"2023-05-17T15:05:57.211898+0000","last_became_peered":"2023-05-17T15:05:57.211898+0000","last_unstale":"2023-05-17T15:05:57.218200+0000","last_undegraded":"2023-05-17T15:05:57.218200+0000","last_fullsized":"2023-05-17T15:05:57.218200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.203130+0000","last_change":"2023-05-17T15:05:56.826730+0000","last_active":"2023-05-17T15:05:57.203130+0000","last_peered":"2023-05-17T15:05:57.203130+0000","last_clean":"2023-05-17T15:05:57.203130+0000","last_became_active":"2023-05-17T15:05:56.826406+0000","last_became_peered":"2023-05-17T15:05:56.826406+0000","last_unstale":"2023-05-17T15:05:57.203130+0000","last_undegraded":"2023-05-17T15:05:57.203130+0000","last_fullsized":"2023-05-17T15:05:57.203130+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215210+0000","last_change":"2023-05-17T15:05:57.210173+0000","last_active":"2023-05-17T15:05:57.215210+0000","last_peered":"2023-05-17T15:05:57.215210+0000","last_clean":"2023-05-17T15:05:57.215210+0000","last_became_active":"2023-05-17T15:05:57.209876+0000","last_became_peered":"2023-05-17T15:05:57.209876+0000","last_unstale":"2023-05-17T15:05:57.215210+0000","last_undegraded":"2023-05-17T15:05:57.215210+0000","last_fullsized":"2023-05-17T15:05:57.215210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215619+0000","last_change":"2023-05-17T15:05:56.812048+0000","last_active":"2023-05-17T15:05:57.215619+0000","last_peered":"2023-05-17T15:05:57.215619+0000","last_clean":"2023-05-17T15:05:57.215619+0000","last_became_active":"2023-05-17T15:05:56.811800+0000","last_became_peered":"2023-05-17T15:05:56.811800+0000","last_unstale":"2023-05-17T15:05:57.215619+0000","last_undegraded":"2023-05-17T15:05:57.215619+0000","last_fullsized":"2023-05-17T15:05:57.215619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215281+0000","last_change":"2023-05-17T15:05:57.209360+0000","last_active":"2023-05-17T15:05:57.215281+0000","last_peered":"2023-05-17T15:05:57.215281+0000","last_clean":"2023-05-17T15:05:57.215281+0000","last_became_active":"2023-05-17T15:05:57.208852+0000","last_became_peered":"2023-05-17T15:05:57.208852+0000","last_unstale":"2023-05-17T15:05:57.215281+0000","last_undegraded":"2023-05-17T15:05:57.215281+0000","last_fullsized":"2023-05-17T15:05:57.215281+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.219621+0000","last_change":"2023-05-17T15:05:56.823396+0000","last_active":"2023-05-17T15:05:57.219621+0000","last_peered":"2023-05-17T15:05:57.219621+0000","last_clean":"2023-05-17T15:05:57.219621+0000","last_became_active":"2023-05-17T15:05:56.822030+0000","last_became_peered":"2023-05-17T15:05:56.822030+0000","last_unstale":"2023-05-17T15:05:57.219621+0000","last_undegraded":"2023-05-17T15:05:57.219621+0000","last_fullsized":"2023-05-17T15:05:57.219621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.214716+0000","last_change":"2023-05-17T15:05:57.209030+0000","last_active":"2023-05-17T15:05:57.214716+0000","last_peered":"2023-05-17T15:05:57.214716+0000","last_clean":"2023-05-17T15:05:57.214716+0000","last_became_active":"2023-05-17T15:05:57.208682+0000","last_became_peered":"2023-05-17T15:05:57.208682+0000","last_unstale":"2023-05-17T15:05:57.214716+0000","last_undegraded":"2023-05-17T15:05:57.214716+0000","last_fullsized":"2023-05-17T15:05:57.214716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.216635+0000","last_change":"2023-05-17T15:05:56.820310+0000","last_active":"2023-05-17T15:05:57.216635+0000","last_peered":"2023-05-17T15:05:57.216635+0000","last_clean":"2023-05-17T15:05:57.216635+0000","last_became_active":"2023-05-17T15:05:56.820024+0000","last_became_peered":"2023-05-17T15:05:56.820024+0000","last_unstale":"2023-05-17T15:05:57.216635+0000","last_undegraded":"2023-05-17T15:05:57.216635+0000","last_fullsized":"2023-05-17T15:05:57.216635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.214210+0000","last_change":"2023-05-17T15:05:57.203200+0000","last_active":"2023-05-17T15:05:57.214210+0000","last_peered":"2023-05-17T15:05:57.214210+0000","last_clean":"2023-05-17T15:05:57.214210+0000","last_became_active":"2023-05-17T15:05:57.202939+0000","last_became_peered":"2023-05-17T15:05:57.202939+0000","last_unstale":"2023-05-17T15:05:57.214210+0000","last_undegraded":"2023-05-17T15:05:57.214210+0000","last_fullsized":"2023-05-17T15:05:57.214210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.200327+0000","last_change":"2023-05-17T15:05:56.812006+0000","last_active":"2023-05-17T15:05:57.200327+0000","last_peered":"2023-05-17T15:05:57.200327+0000","last_clean":"2023-05-17T15:05:57.200327+0000","last_became_active":"2023-05-17T15:05:56.811683+0000","last_became_peered":"2023-05-17T15:05:56.811683+0000","last_unstale":"2023-05-17T15:05:57.200327+0000","last_undegraded":"2023-05-17T15:05:57.200327+0000","last_fullsized":"2023-05-17T15:05:57.200327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.217357+0000","last_change":"2023-05-17T15:05:57.214789+0000","last_active":"2023-05-17T15:05:57.217357+0000","last_peered":"2023-05-17T15:05:57.217357+0000","last_clean":"2023-05-17T15:05:57.217357+0000","last_became_active":"2023-05-17T15:05:57.214491+0000","last_became_peered":"2023-05-17T15:05:57.214491+0000","last_unstale":"2023-05-17T15:05:57.217357+0000","last_undegraded":"2023-05-17T15:05:57.217357+0000","last_fullsized":"2023-05-17T15:05:57.217357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.192617+0000","last_change":"2023-05-17T15:05:56.817354+0000","last_active":"2023-05-17T15:05:57.192617+0000","last_peered":"2023-05-17T15:05:57.192617+0000","last_clean":"2023-05-17T15:05:57.192617+0000","last_became_active":"2023-05-17T15:05:56.816478+0000","last_became_peered":"2023-05-17T15:05:56.816478+0000","last_unstale":"2023-05-17T15:05:57.192617+0000","last_undegraded":"2023-05-17T15:05:57.192617+0000","last_fullsized":"2023-05-17T15:05:57.192617+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215610+0000","last_change":"2023-05-17T15:05:57.210488+0000","last_active":"2023-05-17T15:05:57.215610+0000","last_peered":"2023-05-17T15:05:57.215610+0000","last_clean":"2023-05-17T15:05:57.215610+0000","last_became_active":"2023-05-17T15:05:57.209910+0000","last_became_peered":"2023-05-17T15:05:57.209910+0000","last_unstale":"2023-05-17T15:05:57.215610+0000","last_undegraded":"2023-05-17T15:05:57.215610+0000","last_fullsized":"2023-05-17T15:05:57.215610+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194068+0000","last_change":"2023-05-17T15:05:56.812911+0000","last_active":"2023-05-17T15:05:57.194068+0000","last_peered":"2023-05-17T15:05:57.194068+0000","last_clean":"2023-05-17T15:05:57.194068+0000","last_became_active":"2023-05-17T15:05:56.812626+0000","last_became_peered":"2023-05-17T15:05:56.812626+0000","last_unstale":"2023-05-17T15:05:57.194068+0000","last_undegraded":"2023-05-17T15:05:57.194068+0000","last_fullsized":"2023-05-17T15:05:57.194068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222487+0000","last_change":"2023-05-17T15:05:57.216644+0000","last_active":"2023-05-17T15:05:57.222487+0000","last_peered":"2023-05-17T15:05:57.222487+0000","last_clean":"2023-05-17T15:05:57.222487+0000","last_became_active":"2023-05-17T15:05:57.216023+0000","last_became_peered":"2023-05-17T15:05:57.216023+0000","last_unstale":"2023-05-17T15:05:57.222487+0000","last_undegraded":"2023-05-17T15:05:57.222487+0000","last_fullsized":"2023-05-17T15:05:57.222487+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.204351+0000","last_change":"2023-05-17T15:05:56.814877+0000","last_active":"2023-05-17T15:05:57.204351+0000","last_peered":"2023-05-17T15:05:57.204351+0000","last_clean":"2023-05-17T15:05:57.204351+0000","last_became_active":"2023-05-17T15:05:56.814520+0000","last_became_peered":"2023-05-17T15:05:56.814520+0000","last_unstale":"2023-05-17T15:05:57.204351+0000","last_undegraded":"2023-05-17T15:05:57.204351+0000","last_fullsized":"2023-05-17T15:05:57.204351+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222231+0000","last_change":"2023-05-17T15:05:57.217771+0000","last_active":"2023-05-17T15:05:57.222231+0000","last_peered":"2023-05-17T15:05:57.222231+0000","last_clean":"2023-05-17T15:05:57.222231+0000","last_became_active":"2023-05-17T15:05:57.217484+0000","last_became_peered":"2023-05-17T15:05:57.217484+0000","last_unstale":"2023-05-17T15:05:57.222231+0000","last_undegraded":"2023-05-17T15:05:57.222231+0000","last_fullsized":"2023-05-17T15:05:57.222231+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.192331+0000","last_change":"2023-05-17T15:05:56.825619+0000","last_active":"2023-05-17T15:05:57.192331+0000","last_peered":"2023-05-17T15:05:57.192331+0000","last_clean":"2023-05-17T15:05:57.192331+0000","last_became_active":"2023-05-17T15:05:56.824941+0000","last_became_peered":"2023-05-17T15:05:56.824941+0000","last_unstale":"2023-05-17T15:05:57.192331+0000","last_undegraded":"2023-05-17T15:05:57.192331+0000","last_fullsized":"2023-05-17T15:05:57.192331+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.209460+0000","last_change":"2023-05-17T15:05:57.203937+0000","last_active":"2023-05-17T15:05:57.209460+0000","last_peered":"2023-05-17T15:05:57.209460+0000","last_clean":"2023-05-17T15:05:57.209460+0000","last_became_active":"2023-05-17T15:05:57.203583+0000","last_became_peered":"2023-05-17T15:05:57.203583+0000","last_unstale":"2023-05-17T15:05:57.209460+0000","last_undegraded":"2023-05-17T15:05:57.209460+0000","last_fullsized":"2023-05-17T15:05:57.209460+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199212+0000","last_change":"2023-05-17T15:05:56.814496+0000","last_active":"2023-05-17T15:05:57.199212+0000","last_peered":"2023-05-17T15:05:57.199212+0000","last_clean":"2023-05-17T15:05:57.199212+0000","last_became_active":"2023-05-17T15:05:56.814189+0000","last_became_peered":"2023-05-17T15:05:56.814189+0000","last_unstale":"2023-05-17T15:05:57.199212+0000","last_undegraded":"2023-05-17T15:05:57.199212+0000","last_fullsized":"2023-05-17T15:05:57.199212+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215256+0000","last_change":"2023-05-17T15:05:57.209162+0000","last_active":"2023-05-17T15:05:57.215256+0000","last_peered":"2023-05-17T15:05:57.215256+0000","last_clean":"2023-05-17T15:05:57.215256+0000","last_became_active":"2023-05-17T15:05:57.208471+0000","last_became_peered":"2023-05-17T15:05:57.208471+0000","last_unstale":"2023-05-17T15:05:57.215256+0000","last_undegraded":"2023-05-17T15:05:57.215256+0000","last_fullsized":"2023-05-17T15:05:57.215256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194164+0000","last_change":"2023-05-17T15:05:56.816478+0000","last_active":"2023-05-17T15:05:57.194164+0000","last_peered":"2023-05-17T15:05:57.194164+0000","last_clean":"2023-05-17T15:05:57.194164+0000","last_became_active":"2023-05-17T15:05:56.816136+0000","last_became_peered":"2023-05-17T15:05:56.816136+0000","last_unstale":"2023-05-17T15:05:57.194164+0000","last_undegraded":"2023-05-17T15:05:57.194164+0000","last_fullsized":"2023-05-17T15:05:57.194164+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218432+0000","last_change":"2023-05-17T15:05:57.212331+0000","last_active":"2023-05-17T15:05:57.218432+0000","last_peered":"2023-05-17T15:05:57.218432+0000","last_clean":"2023-05-17T15:05:57.218432+0000","last_became_active":"2023-05-17T15:05:57.212004+0000","last_became_peered":"2023-05-17T15:05:57.212004+0000","last_unstale":"2023-05-17T15:05:57.218432+0000","last_undegraded":"2023-05-17T15:05:57.218432+0000","last_fullsized":"2023-05-17T15:05:57.218432+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215180+0000","last_change":"2023-05-17T15:05:56.821974+0000","last_active":"2023-05-17T15:05:57.215180+0000","last_peered":"2023-05-17T15:05:57.215180+0000","last_clean":"2023-05-17T15:05:57.215180+0000","last_became_active":"2023-05-17T15:05:56.821726+0000","last_became_peered":"2023-05-17T15:05:56.821726+0000","last_unstale":"2023-05-17T15:05:57.215180+0000","last_undegraded":"2023-05-17T15:05:57.215180+0000","last_fullsized":"2023-05-17T15:05:57.215180+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.205665+0000","last_change":"2023-05-17T15:05:57.202354+0000","last_active":"2023-05-17T15:05:57.205665+0000","last_peered":"2023-05-17T15:05:57.205665+0000","last_clean":"2023-05-17T15:05:57.205665+0000","last_became_active":"2023-05-17T15:05:57.201418+0000","last_became_peered":"2023-05-17T15:05:57.201418+0000","last_unstale":"2023-05-17T15:05:57.205665+0000","last_undegraded":"2023-05-17T15:05:57.205665+0000","last_fullsized":"2023-05-17T15:05:57.205665+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222616+0000","last_change":"2023-05-17T15:05:56.820285+0000","last_active":"2023-05-17T15:05:57.222616+0000","last_peered":"2023-05-17T15:05:57.222616+0000","last_clean":"2023-05-17T15:05:57.222616+0000","last_became_active":"2023-05-17T15:05:56.818267+0000","last_became_peered":"2023-05-17T15:05:56.818267+0000","last_unstale":"2023-05-17T15:05:57.222616+0000","last_undegraded":"2023-05-17T15:05:57.222616+0000","last_fullsized":"2023-05-17T15:05:57.222616+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215426+0000","last_change":"2023-05-17T15:05:57.206490+0000","last_active":"2023-05-17T15:05:57.215426+0000","last_peered":"2023-05-17T15:05:57.215426+0000","last_clean":"2023-05-17T15:05:57.215426+0000","last_became_active":"2023-05-17T15:05:57.206134+0000","last_became_peered":"2023-05-17T15:05:57.206134+0000","last_unstale":"2023-05-17T15:05:57.215426+0000","last_undegraded":"2023-05-17T15:05:57.215426+0000","last_fullsized":"2023-05-17T15:05:57.215426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.216987+0000","last_change":"2023-05-17T15:05:56.817535+0000","last_active":"2023-05-17T15:05:57.216987+0000","last_peered":"2023-05-17T15:05:57.216987+0000","last_clean":"2023-05-17T15:05:57.216987+0000","last_became_active":"2023-05-17T15:05:56.816824+0000","last_became_peered":"2023-05-17T15:05:56.816824+0000","last_unstale":"2023-05-17T15:05:57.216987+0000","last_undegraded":"2023-05-17T15:05:57.216987+0000","last_fullsized":"2023-05-17T15:05:57.216987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218863+0000","last_change":"2023-05-17T15:05:57.214846+0000","last_active":"2023-05-17T15:05:57.218863+0000","last_peered":"2023-05-17T15:05:57.218863+0000","last_clean":"2023-05-17T15:05:57.218863+0000","last_became_active":"2023-05-17T15:05:57.210823+0000","last_became_peered":"2023-05-17T15:05:57.210823+0000","last_unstale":"2023-05-17T15:05:57.218863+0000","last_undegraded":"2023-05-17T15:05:57.218863+0000","last_fullsized":"2023-05-17T15:05:57.218863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.200698+0000","last_change":"2023-05-17T15:05:56.816821+0000","last_active":"2023-05-17T15:05:57.200698+0000","last_peered":"2023-05-17T15:05:57.200698+0000","last_clean":"2023-05-17T15:05:57.200698+0000","last_became_active":"2023-05-17T15:05:56.815875+0000","last_became_peered":"2023-05-17T15:05:56.815875+0000","last_unstale":"2023-05-17T15:05:57.200698+0000","last_undegraded":"2023-05-17T15:05:57.200698+0000","last_fullsized":"2023-05-17T15:05:57.200698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222184+0000","last_change":"2023-05-17T15:05:57.213362+0000","last_active":"2023-05-17T15:05:57.222184+0000","last_peered":"2023-05-17T15:05:57.222184+0000","last_clean":"2023-05-17T15:05:57.222184+0000","last_became_active":"2023-05-17T15:05:57.213039+0000","last_became_peered":"2023-05-17T15:05:57.213039+0000","last_unstale":"2023-05-17T15:05:57.222184+0000","last_undegraded":"2023-05-17T15:05:57.222184+0000","last_fullsized":"2023-05-17T15:05:57.222184+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.195540+0000","last_change":"2023-05-17T15:05:56.817725+0000","last_active":"2023-05-17T15:05:57.195540+0000","last_peered":"2023-05-17T15:05:57.195540+0000","last_clean":"2023-05-17T15:05:57.195540+0000","last_became_active":"2023-05-17T15:05:56.817485+0000","last_became_peered":"2023-05-17T15:05:56.817485+0000","last_unstale":"2023-05-17T15:05:57.195540+0000","last_undegraded":"2023-05-17T15:05:57.195540+0000","last_fullsized":"2023-05-17T15:05:57.195540+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218130+0000","last_change":"2023-05-17T15:05:57.211745+0000","last_active":"2023-05-17T15:05:57.218130+0000","last_peered":"2023-05-17T15:05:57.218130+0000","last_clean":"2023-05-17T15:05:57.218130+0000","last_became_active":"2023-05-17T15:05:57.211398+0000","last_became_peered":"2023-05-17T15:05:57.211398+0000","last_unstale":"2023-05-17T15:05:57.218130+0000","last_undegraded":"2023-05-17T15:05:57.218130+0000","last_fullsized":"2023-05-17T15:05:57.218130+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222920+0000","last_change":"2023-05-17T15:05:56.821320+0000","last_active":"2023-05-17T15:05:57.222920+0000","last_peered":"2023-05-17T15:05:57.222920+0000","last_clean":"2023-05-17T15:05:57.222920+0000","last_became_active":"2023-05-17T15:05:56.819300+0000","last_became_peered":"2023-05-17T15:05:56.819300+0000","last_unstale":"2023-05-17T15:05:57.222920+0000","last_undegraded":"2023-05-17T15:05:57.222920+0000","last_fullsized":"2023-05-17T15:05:57.222920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222984+0000","last_change":"2023-05-17T15:05:57.218322+0000","last_active":"2023-05-17T15:05:57.222984+0000","last_peered":"2023-05-17T15:05:57.222984+0000","last_clean":"2023-05-17T15:05:57.222984+0000","last_became_active":"2023-05-17T15:05:57.218036+0000","last_became_peered":"2023-05-17T15:05:57.218036+0000","last_unstale":"2023-05-17T15:05:57.222984+0000","last_undegraded":"2023-05-17T15:05:57.222984+0000","last_fullsized":"2023-05-17T15:05:57.222984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.217809+0000","last_change":"2023-05-17T15:05:56.825715+0000","last_active":"2023-05-17T15:05:57.217809+0000","last_peered":"2023-05-17T15:05:57.217809+0000","last_clean":"2023-05-17T15:05:57.217809+0000","last_became_active":"2023-05-17T15:05:56.825362+0000","last_became_peered":"2023-05-17T15:05:56.825362+0000","last_unstale":"2023-05-17T15:05:57.217809+0000","last_undegraded":"2023-05-17T15:05:57.217809+0000","last_fullsized":"2023-05-17T15:05:57.217809+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215917+0000","last_change":"2023-05-17T15:05:57.215231+0000","last_active":"2023-05-17T15:05:57.215917+0000","last_peered":"2023-05-17T15:05:57.215917+0000","last_clean":"2023-05-17T15:05:57.215917+0000","last_became_active":"2023-05-17T15:05:57.214965+0000","last_became_peered":"2023-05-17T15:05:57.214965+0000","last_unstale":"2023-05-17T15:05:57.215917+0000","last_undegraded":"2023-05-17T15:05:57.215917+0000","last_fullsized":"2023-05-17T15:05:57.215917+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.216007+0000","last_change":"2023-05-17T15:05:56.816133+0000","last_active":"2023-05-17T15:05:57.216007+0000","last_peered":"2023-05-17T15:05:57.216007+0000","last_clean":"2023-05-17T15:05:57.216007+0000","last_became_active":"2023-05-17T15:05:56.815609+0000","last_became_peered":"2023-05-17T15:05:56.815609+0000","last_unstale":"2023-05-17T15:05:57.216007+0000","last_undegraded":"2023-05-17T15:05:57.216007+0000","last_fullsized":"2023-05-17T15:05:57.216007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215149+0000","last_change":"2023-05-17T15:05:57.213164+0000","last_active":"2023-05-17T15:05:57.215149+0000","last_peered":"2023-05-17T15:05:57.215149+0000","last_clean":"2023-05-17T15:05:57.215149+0000","last_became_active":"2023-05-17T15:05:57.212932+0000","last_became_peered":"2023-05-17T15:05:57.212932+0000","last_unstale":"2023-05-17T15:05:57.215149+0000","last_undegraded":"2023-05-17T15:05:57.215149+0000","last_fullsized":"2023-05-17T15:05:57.215149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.201538+0000","last_change":"2023-05-17T15:05:56.820385+0000","last_active":"2023-05-17T15:05:57.201538+0000","last_peered":"2023-05-17T15:05:57.201538+0000","last_clean":"2023-05-17T15:05:57.201538+0000","last_became_active":"2023-05-17T15:05:56.820012+0000","last_became_peered":"2023-05-17T15:05:56.820012+0000","last_unstale":"2023-05-17T15:05:57.201538+0000","last_undegraded":"2023-05-17T15:05:57.201538+0000","last_fullsized":"2023-05-17T15:05:57.201538+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.213631+0000","last_change":"2023-05-17T15:05:57.210062+0000","last_active":"2023-05-17T15:05:57.213631+0000","last_peered":"2023-05-17T15:05:57.213631+0000","last_clean":"2023-05-17T15:05:57.213631+0000","last_became_active":"2023-05-17T15:05:57.209780+0000","last_became_peered":"2023-05-17T15:05:57.209780+0000","last_unstale":"2023-05-17T15:05:57.213631+0000","last_undegraded":"2023-05-17T15:05:57.213631+0000","last_fullsized":"2023-05-17T15:05:57.213631+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.201012+0000","last_change":"2023-05-17T15:05:56.821177+0000","last_active":"2023-05-17T15:05:57.201012+0000","last_peered":"2023-05-17T15:05:57.201012+0000","last_clean":"2023-05-17T15:05:57.201012+0000","last_became_active":"2023-05-17T15:05:56.820750+0000","last_became_peered":"2023-05-17T15:05:56.820750+0000","last_unstale":"2023-05-17T15:05:57.201012+0000","last_undegraded":"2023-05-17T15:05:57.201012+0000","last_fullsized":"2023-05-17T15:05:57.201012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215559+0000","last_change":"2023-05-17T15:05:57.209581+0000","last_active":"2023-05-17T15:05:57.215559+0000","last_peered":"2023-05-17T15:05:57.215559+0000","last_clean":"2023-05-17T15:05:57.215559+0000","last_became_active":"2023-05-17T15:05:57.207536+0000","last_became_peered":"2023-05-17T15:05:57.207536+0000","last_unstale":"2023-05-17T15:05:57.215559+0000","last_undegraded":"2023-05-17T15:05:57.215559+0000","last_fullsized":"2023-05-17T15:05:57.215559+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215914+0000","last_change":"2023-05-17T15:05:56.819789+0000","last_active":"2023-05-17T15:05:57.215914+0000","last_peered":"2023-05-17T15:05:57.215914+0000","last_clean":"2023-05-17T15:05:57.215914+0000","last_became_active":"2023-05-17T15:05:56.819520+0000","last_became_peered":"2023-05-17T15:05:56.819520+0000","last_unstale":"2023-05-17T15:05:57.215914+0000","last_undegraded":"2023-05-17T15:05:57.215914+0000","last_fullsized":"2023-05-17T15:05:57.215914+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.213738+0000","last_change":"2023-05-17T15:05:57.207402+0000","last_active":"2023-05-17T15:05:57.213738+0000","last_peered":"2023-05-17T15:05:57.213738+0000","last_clean":"2023-05-17T15:05:57.213738+0000","last_became_active":"2023-05-17T15:05:57.206121+0000","last_became_peered":"2023-05-17T15:05:57.206121+0000","last_unstale":"2023-05-17T15:05:57.213738+0000","last_undegraded":"2023-05-17T15:05:57.213738+0000","last_fullsized":"2023-05-17T15:05:57.213738+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.198411+0000","last_change":"2023-05-17T15:05:56.819057+0000","last_active":"2023-05-17T15:05:57.198411+0000","last_peered":"2023-05-17T15:05:57.198411+0000","last_clean":"2023-05-17T15:05:57.198411+0000","last_became_active":"2023-05-17T15:05:56.818576+0000","last_became_peered":"2023-05-17T15:05:56.818576+0000","last_unstale":"2023-05-17T15:05:57.198411+0000","last_undegraded":"2023-05-17T15:05:57.198411+0000","last_fullsized":"2023-05-17T15:05:57.198411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.218751+0000","last_change":"2023-05-17T15:05:57.214312+0000","last_active":"2023-05-17T15:05:57.218751+0000","last_peered":"2023-05-17T15:05:57.218751+0000","last_clean":"2023-05-17T15:05:57.218751+0000","last_became_active":"2023-05-17T15:05:57.210768+0000","last_became_peered":"2023-05-17T15:05:57.210768+0000","last_unstale":"2023-05-17T15:05:57.218751+0000","last_undegraded":"2023-05-17T15:05:57.218751+0000","last_fullsized":"2023-05-17T15:05:57.218751+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.192692+0000","last_change":"2023-05-17T15:05:56.823196+0000","last_active":"2023-05-17T15:05:57.192692+0000","last_peered":"2023-05-17T15:05:57.192692+0000","last_clean":"2023-05-17T15:05:57.192692+0000","last_became_active":"2023-05-17T15:05:56.822869+0000","last_became_peered":"2023-05-17T15:05:56.822869+0000","last_unstale":"2023-05-17T15:05:57.192692+0000","last_undegraded":"2023-05-17T15:05:57.192692+0000","last_fullsized":"2023-05-17T15:05:57.192692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.211155+0000","last_change":"2023-05-17T15:05:57.209570+0000","last_active":"2023-05-17T15:05:57.211155+0000","last_peered":"2023-05-17T15:05:57.211155+0000","last_clean":"2023-05-17T15:05:57.211155+0000","last_became_active":"2023-05-17T15:05:57.209332+0000","last_became_peered":"2023-05-17T15:05:57.209332+0000","last_unstale":"2023-05-17T15:05:57.211155+0000","last_undegraded":"2023-05-17T15:05:57.211155+0000","last_fullsized":"2023-05-17T15:05:57.211155+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.203203+0000","last_change":"2023-05-17T15:05:56.811862+0000","last_active":"2023-05-17T15:05:57.203203+0000","last_peered":"2023-05-17T15:05:57.203203+0000","last_clean":"2023-05-17T15:05:57.203203+0000","last_became_active":"2023-05-17T15:05:56.811548+0000","last_became_peered":"2023-05-17T15:05:56.811548+0000","last_unstale":"2023-05-17T15:05:57.203203+0000","last_undegraded":"2023-05-17T15:05:57.203203+0000","last_fullsized":"2023-05-17T15:05:57.203203+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.214396+0000","last_change":"2023-05-17T15:05:57.204370+0000","last_active":"2023-05-17T15:05:57.214396+0000","last_peered":"2023-05-17T15:05:57.214396+0000","last_clean":"2023-05-17T15:05:57.214396+0000","last_became_active":"2023-05-17T15:05:57.204132+0000","last_became_peered":"2023-05-17T15:05:57.204132+0000","last_unstale":"2023-05-17T15:05:57.214396+0000","last_undegraded":"2023-05-17T15:05:57.214396+0000","last_fullsized":"2023-05-17T15:05:57.214396+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.194847+0000","last_change":"2023-05-17T15:05:56.820618+0000","last_active":"2023-05-17T15:05:57.194847+0000","last_peered":"2023-05-17T15:05:57.194847+0000","last_clean":"2023-05-17T15:05:57.194847+0000","last_became_active":"2023-05-17T15:05:56.820290+0000","last_became_peered":"2023-05-17T15:05:56.820290+0000","last_unstale":"2023-05-17T15:05:57.194847+0000","last_undegraded":"2023-05-17T15:05:57.194847+0000","last_fullsized":"2023-05-17T15:05:57.194847+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.195317+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:05:57.195317+0000","last_peered":"2023-05-17T15:05:57.195317+0000","last_clean":"2023-05-17T15:05:57.195317+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:05:57.195317+0000","last_undegraded":"2023-05-17T15:05:57.195317+0000","last_fullsized":"2023-05-17T15:05:57.195317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.214409+0000","last_change":"2023-05-17T15:05:57.204830+0000","last_active":"2023-05-17T15:05:57.214409+0000","last_peered":"2023-05-17T15:05:57.214409+0000","last_clean":"2023-05-17T15:05:57.214409+0000","last_became_active":"2023-05-17T15:05:57.204408+0000","last_became_peered":"2023-05-17T15:05:57.204408+0000","last_unstale":"2023-05-17T15:05:57.214409+0000","last_undegraded":"2023-05-17T15:05:57.214409+0000","last_fullsized":"2023-05-17T15:05:57.214409+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.217745+0000","last_change":"2023-05-17T15:05:56.820299+0000","last_active":"2023-05-17T15:05:57.217745+0000","last_peered":"2023-05-17T15:05:57.217745+0000","last_clean":"2023-05-17T15:05:57.217745+0000","last_became_active":"2023-05-17T15:05:56.819999+0000","last_became_peered":"2023-05-17T15:05:56.819999+0000","last_unstale":"2023-05-17T15:05:57.217745+0000","last_undegraded":"2023-05-17T15:05:57.217745+0000","last_fullsized":"2023-05-17T15:05:57.217745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199635+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:05:57.199635+0000","last_peered":"2023-05-17T15:05:57.199635+0000","last_clean":"2023-05-17T15:05:57.199635+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:05:57.199635+0000","last_undegraded":"2023-05-17T15:05:57.199635+0000","last_fullsized":"2023-05-17T15:05:57.199635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.222422+0000","last_change":"2023-05-17T15:05:57.214685+0000","last_active":"2023-05-17T15:05:57.222422+0000","last_peered":"2023-05-17T15:05:57.222422+0000","last_clean":"2023-05-17T15:05:57.222422+0000","last_became_active":"2023-05-17T15:05:57.214461+0000","last_became_peered":"2023-05-17T15:05:57.214461+0000","last_unstale":"2023-05-17T15:05:57.222422+0000","last_undegraded":"2023-05-17T15:05:57.222422+0000","last_fullsized":"2023-05-17T15:05:57.222422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.193042+0000","last_change":"2023-05-17T15:05:56.811569+0000","last_active":"2023-05-17T15:05:57.193042+0000","last_peered":"2023-05-17T15:05:57.193042+0000","last_clean":"2023-05-17T15:05:57.193042+0000","last_became_active":"2023-05-17T15:05:56.811295+0000","last_became_peered":"2023-05-17T15:05:56.811295+0000","last_unstale":"2023-05-17T15:05:57.193042+0000","last_undegraded":"2023-05-17T15:05:57.193042+0000","last_fullsized":"2023-05-17T15:05:57.193042+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.203017+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:05:57.203017+0000","last_peered":"2023-05-17T15:05:57.203017+0000","last_clean":"2023-05-17T15:05:57.203017+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:05:57.203017+0000","last_undegraded":"2023-05-17T15:05:57.203017+0000","last_fullsized":"2023-05-17T15:05:57.203017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.216237+0000","last_change":"2023-05-17T15:05:57.211794+0000","last_active":"2023-05-17T15:05:57.216237+0000","last_peered":"2023-05-17T15:05:57.216237+0000","last_clean":"2023-05-17T15:05:57.216237+0000","last_became_active":"2023-05-17T15:05:57.211472+0000","last_became_peered":"2023-05-17T15:05:57.211472+0000","last_unstale":"2023-05-17T15:05:57.216237+0000","last_undegraded":"2023-05-17T15:05:57.216237+0000","last_fullsized":"2023-05-17T15:05:57.216237+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.192413+0000","last_change":"2023-05-17T15:05:56.823946+0000","last_active":"2023-05-17T15:05:57.192413+0000","last_peered":"2023-05-17T15:05:57.192413+0000","last_clean":"2023-05-17T15:05:57.192413+0000","last_became_active":"2023-05-17T15:05:56.823651+0000","last_became_peered":"2023-05-17T15:05:56.823651+0000","last_unstale":"2023-05-17T15:05:57.192413+0000","last_undegraded":"2023-05-17T15:05:57.192413+0000","last_fullsized":"2023-05-17T15:05:57.192413+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.200151+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:05:57.200151+0000","last_peered":"2023-05-17T15:05:57.200151+0000","last_clean":"2023-05-17T15:05:57.200151+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:05:57.200151+0000","last_undegraded":"2023-05-17T15:05:57.200151+0000","last_fullsized":"2023-05-17T15:05:57.200151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.195643+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:05:57.195643+0000","last_peered":"2023-05-17T15:05:57.195643+0000","last_clean":"2023-05-17T15:05:57.195643+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:05:57.195643+0000","last_undegraded":"2023-05-17T15:05:57.195643+0000","last_fullsized":"2023-05-17T15:05:57.195643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.208091+0000","last_change":"2023-05-17T15:05:57.206722+0000","last_active":"2023-05-17T15:05:57.208091+0000","last_peered":"2023-05-17T15:05:57.208091+0000","last_clean":"2023-05-17T15:05:57.208091+0000","last_became_active":"2023-05-17T15:05:57.206443+0000","last_became_peered":"2023-05-17T15:05:57.206443+0000","last_unstale":"2023-05-17T15:05:57.208091+0000","last_undegraded":"2023-05-17T15:05:57.208091+0000","last_fullsized":"2023-05-17T15:05:57.208091+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199327+0000","last_change":"2023-05-17T15:05:56.815112+0000","last_active":"2023-05-17T15:05:57.199327+0000","last_peered":"2023-05-17T15:05:57.199327+0000","last_clean":"2023-05-17T15:05:57.199327+0000","last_became_active":"2023-05-17T15:05:56.814528+0000","last_became_peered":"2023-05-17T15:05:56.814528+0000","last_unstale":"2023-05-17T15:05:57.199327+0000","last_undegraded":"2023-05-17T15:05:57.199327+0000","last_fullsized":"2023-05-17T15:05:57.199327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.195753+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:05:57.195753+0000","last_peered":"2023-05-17T15:05:57.195753+0000","last_clean":"2023-05-17T15:05:57.195753+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:05:57.195753+0000","last_undegraded":"2023-05-17T15:05:57.195753+0000","last_fullsized":"2023-05-17T15:05:57.195753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.216323+0000","last_change":"2023-05-17T15:05:57.203739+0000","last_active":"2023-05-17T15:05:57.216323+0000","last_peered":"2023-05-17T15:05:57.216323+0000","last_clean":"2023-05-17T15:05:57.216323+0000","last_became_active":"2023-05-17T15:05:57.203474+0000","last_became_peered":"2023-05-17T15:05:57.203474+0000","last_unstale":"2023-05-17T15:05:57.216323+0000","last_undegraded":"2023-05-17T15:05:57.216323+0000","last_fullsized":"2023-05-17T15:05:57.216323+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.200357+0000","last_change":"2023-05-17T15:05:56.818263+0000","last_active":"2023-05-17T15:05:57.200357+0000","last_peered":"2023-05-17T15:05:57.200357+0000","last_clean":"2023-05-17T15:05:57.200357+0000","last_became_active":"2023-05-17T15:05:56.817954+0000","last_became_peered":"2023-05-17T15:05:56.817954+0000","last_unstale":"2023-05-17T15:05:57.200357+0000","last_undegraded":"2023-05-17T15:05:57.200357+0000","last_fullsized":"2023-05-17T15:05:57.200357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199681+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:05:57.199681+0000","last_peered":"2023-05-17T15:05:57.199681+0000","last_clean":"2023-05-17T15:05:57.199681+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:05:57.199681+0000","last_undegraded":"2023-05-17T15:05:57.199681+0000","last_fullsized":"2023-05-17T15:05:57.199681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.219772+0000","last_change":"2023-05-17T15:05:57.217847+0000","last_active":"2023-05-17T15:05:57.219772+0000","last_peered":"2023-05-17T15:05:57.219772+0000","last_clean":"2023-05-17T15:05:57.219772+0000","last_became_active":"2023-05-17T15:05:57.217590+0000","last_became_peered":"2023-05-17T15:05:57.217590+0000","last_unstale":"2023-05-17T15:05:57.219772+0000","last_undegraded":"2023-05-17T15:05:57.219772+0000","last_fullsized":"2023-05-17T15:05:57.219772+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199566+0000","last_change":"2023-05-17T15:05:56.819108+0000","last_active":"2023-05-17T15:05:57.199566+0000","last_peered":"2023-05-17T15:05:57.199566+0000","last_clean":"2023-05-17T15:05:57.199566+0000","last_became_active":"2023-05-17T15:05:56.818494+0000","last_became_peered":"2023-05-17T15:05:56.818494+0000","last_unstale":"2023-05-17T15:05:57.199566+0000","last_undegraded":"2023-05-17T15:05:57.199566+0000","last_fullsized":"2023-05-17T15:05:57.199566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.199981+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:05:57.199981+0000","last_peered":"2023-05-17T15:05:57.199981+0000","last_clean":"2023-05-17T15:05:57.199981+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:05:57.199981+0000","last_undegraded":"2023-05-17T15:05:57.199981+0000","last_fullsized":"2023-05-17T15:05:57.199981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.215171+0000","last_change":"2023-05-17T15:05:57.206768+0000","last_active":"2023-05-17T15:05:57.215171+0000","last_peered":"2023-05-17T15:05:57.215171+0000","last_clean":"2023-05-17T15:05:57.215171+0000","last_became_active":"2023-05-17T15:05:57.206447+0000","last_became_peered":"2023-05-17T15:05:57.206447+0000","last_unstale":"2023-05-17T15:05:57.215171+0000","last_undegraded":"2023-05-17T15:05:57.215171+0000","last_fullsized":"2023-05-17T15:05:57.215171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:56.788764+0000","last_clean_scrub_stamp":"2023-05-17T15:05:56.788764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.198606+0000","last_change":"2023-05-17T15:05:56.824550+0000","last_active":"2023-05-17T15:05:57.198606+0000","last_peered":"2023-05-17T15:05:57.198606+0000","last_clean":"2023-05-17T15:05:57.198606+0000","last_became_active":"2023-05-17T15:05:56.824276+0000","last_became_peered":"2023-05-17T15:05:56.824276+0000","last_unstale":"2023-05-17T15:05:57.198606+0000","last_undegraded":"2023-05-17T15:05:57.198606+0000","last_fullsized":"2023-05-17T15:05:57.198606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:05:55.786246+0000","last_clean_scrub_stamp":"2023-05-17T15:05:55.786246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-05-17T15:05:57.201691+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:05:57.201691+0000","last_peered":"2023-05-17T15:05:57.201691+0000","last_clean":"2023-05-17T15:05:57.201691+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:05:57.201691+0000","last_undegraded":"2023-05-17T15:05:57.201691+0000","last_fullsized":"2023-05-17T15:05:57.201691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16328,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355512,"statfs":{"total":96636764160,"available":96620044288,"internally_reserved":0,"allocated":786432,"data_stored":381896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.32500000000000001,"15min":0.29699999999999999},"max":{"1min":0.747,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59999999999999998,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.37,"15min":0.34599999999999997},"max":{"1min":0.72899999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47699999999999998}]},{"osd":1,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.312,"15min":0.311},"max":{"1min":0.69399999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":0.73099999999999998,"5min":0.875,"15min":0.89000000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.69299999999999995,"5min":0.83599999999999997,"15min":1.0109999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.72599999999999998,"5min":0.90900000000000003,"15min":0.95099999999999996},"last":0.66300000000000003}]},{"osd":4,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48899999999999999,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.66900000000000004,"5min":0.751,"15min":1.0740000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.873,"15min":0.95899999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.31900000000000001},"max":{"1min":0.65300000000000002,"5min":0.877,"15min":0.91500000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":1.042},"last":0.78900000000000003}]},{"osd":6,"last update":"Wed May 17 15:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59999999999999998,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":0.80300000000000005,"15min":0.99199999999999999},"last":0.749},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.33900000000000002},"max":{"1min":0.74299999999999999,"5min":0.90800000000000003,"15min":0.94099999999999995},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15732,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94356108,"statfs":{"total":96636764160,"available":96620654592,"internally_reserved":0,"allocated":765952,"data_stored":374540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.81100000000000005,"15min":0.92900000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.35199999999999998},"max":{"1min":0.69999999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45200000000000001}]},{"osd":1,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64500000000000002,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63500000000000001,"15min":0.61699999999999999},"min":{"1min":0.48099999999999998,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.91600000000000004},"last":0.80900000000000005}]},{"osd":2,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.48899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.82799999999999996,"15min":0.92800000000000005},"last":0.503},{"interface":"front","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.88600000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":0.80400000000000005,"15min":0.86399999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.752,"5min":0.76900000000000002,"15min":0.83999999999999997},"last":0.62},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.90100000000000002},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.32600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.052},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84899999999999998,"15min":0.92200000000000004},"last":0.76900000000000002}]},{"osd":7,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.89500000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.96699999999999997},"last":0.73599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574997,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15616,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94356224,"statfs":{"total":96636764160,"available":96620773376,"internally_reserved":0,"allocated":778240,"data_stored":381308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40300000000000002,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.42099999999999999},"min":{"1min":0.35199999999999998,"5min":0.26400000000000001,"15min":0.23000000000000001},"max":{"1min":0.65800000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.24199999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.41899999999999998},"min":{"1min":0.33400000000000002,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.28999999999999998}]},{"osd":3,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.27100000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.30399999999999999,"5min":0.28000000000000003,"15min":0.23200000000000001},"max":{"1min":0.65500000000000003,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.498,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":0.92400000000000004,"15min":0.94899999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.629},"min":{"1min":0.435,"5min":0.435,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.41299999999999998,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":1.056,"15min":1.056},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.53500000000000003,"5min":0.41399999999999998,"15min":0.38},"max":{"1min":0.93200000000000005,"5min":0.93700000000000006,"15min":1.6100000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.92400000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed May 17 15:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.65500000000000003},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.39100000000000001},"max":{"1min":0.98599999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69399999999999995,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574997,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11260,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":10496,"kb_avail":94360580,"statfs":{"total":96636764160,"available":96625233920,"internally_reserved":0,"allocated":774144,"data_stored":374596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10747904},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.28599999999999998,"5min":0.24299999999999999,"15min":0.23200000000000001},"max":{"1min":0.55700000000000005,"5min":0.66100000000000003,"15min":0.69599999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.39400000000000002},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.245},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.69099999999999995},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.443,"15min":0.40600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.23300000000000001},"max":{"1min":0.63,"5min":0.69499999999999995,"15min":0.70899999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.252},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.28799999999999998}]},{"osd":3,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42699999999999999,"15min":0.39500000000000002},"min":{"1min":0.29899999999999999,"5min":0.28299999999999997,"15min":0.214},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.81299999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.46400000000000002},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.372}]},{"osd":4,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70999999999999996,"15min":0.67100000000000004},"min":{"1min":0.52700000000000002,"5min":0.45500000000000002,"15min":0.34899999999999998},"max":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.98699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.91300000000000003,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67400000000000004,"15min":0.64300000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.34599999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.39100000000000001},"max":{"1min":0.99399999999999999,"5min":1.012,"15min":1.1739999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.46100000000000002,"15min":0.35499999999999998},"max":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":1.119},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.68400000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":0.995,"15min":1.087},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed May 17 15:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0569999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":0.95899999999999996,"15min":1.0740000000000001},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16700,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94355140,"statfs":{"total":96636764160,"available":96619663360,"internally_reserved":0,"allocated":774144,"data_stored":376006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.378,"15min":0.35699999999999998},"min":{"1min":0.26100000000000001,"5min":0.24099999999999999,"15min":0.23300000000000001},"max":{"1min":0.51400000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.371},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.24199999999999999},"max":{"1min":0.47799999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27500000000000002}]},{"osd":1,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.38100000000000001},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.245},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.439},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.25800000000000001},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":0.68999999999999995},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.42699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.439,"15min":0.41699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.23599999999999999},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69699999999999995,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.93600000000000005,"5min":0.97199999999999998,"15min":1.0529999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.57499999999999996,"5min":0.46500000000000002,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.046},"last":0.57799999999999996}]},{"osd":5,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.997,"15min":1.014},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65900000000000003,"15min":0.63400000000000001},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.39400000000000002},"max":{"1min":0.85099999999999998,"5min":0.95699999999999996,"15min":1.014},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.64400000000000002},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.0069999999999999,"15min":1.0860000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.502}]},{"osd":7,"last update":"Wed May 17 15:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.38200000000000001},"max":{"1min":0.90700000000000003,"5min":1.002,"15min":1.03},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71499999999999997,"15min":0.67800000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574997,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":18944,"kb_avail":94352120,"statfs":{"total":96636764160,"available":96616570880,"internally_reserved":0,"allocated":786432,"data_stored":381884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19398656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.377,"15min":0.34399999999999997},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.377},"min":{"1min":0.32300000000000001,"5min":0.27700000000000002,"15min":0.215},"max":{"1min":0.54200000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.432,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.58799999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.30599999999999999},"max":{"1min":0.60299999999999998,"5min":0.71199999999999997,"15min":0.75700000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45000000000000001,"15min":0.41099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":0.58399999999999996,"5min":0.628,"15min":0.628},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46400000000000002},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.64200000000000002,"5min":0.76200000000000001,"15min":0.79800000000000004},"last":0.28599999999999998}]},{"osd":4,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.64300000000000002},"min":{"1min":0.52700000000000002,"5min":0.378,"15min":0.374},"max":{"1min":0.92400000000000004,"5min":1.0049999999999999,"15min":1.034},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":1.04,"15min":3.4590000000000001},"last":0.51000000000000001}]},{"osd":5,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":3.4289999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.629},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":1.107},"last":0.45400000000000001}]},{"osd":6,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":1.032,"15min":3.4049999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.66900000000000004},"min":{"1min":0.56200000000000006,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":1.091,"15min":1.091},"last":0.57299999999999995}]},{"osd":7,"last update":"Wed May 17 15:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.63700000000000001},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.40200000000000002},"max":{"1min":0.88600000000000001,"5min":1.1519999999999999,"15min":3.391},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16000,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355840,"statfs":{"total":96636764160,"available":96620380160,"internally_reserved":0,"allocated":778240,"data_stored":381772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.55700000000000005},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.0069999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.38200000000000001,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.82599999999999996},"last":0.70499999999999996}]},{"osd":1,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.79500000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.55500000000000005},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.314},"max":{"1min":0.748,"5min":0.82199999999999995,"15min":0.83699999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.88300000000000001,"15min":0.96899999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.58499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.63}]},{"osd":5,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.64700000000000002,"5min":0.79800000000000004,"15min":0.86799999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.86099999999999999,"15min":1.0369999999999999},"last":0.496}]},{"osd":6,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":1.004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61299999999999999,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed May 17 15:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":1.0629999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.92500000000000004},"last":0.44900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19200,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94352640,"statfs":{"total":96636764160,"available":96617103360,"internally_reserved":0,"allocated":778240,"data_stored":382110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.60599999999999998},"min":{"1min":0.47999999999999998,"5min":0.40600000000000003,"15min":0.32700000000000001},"max":{"1min":0.78500000000000003,"5min":0.86699999999999999,"15min":0.876},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65300000000000002,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.88100000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63400000000000001,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.53800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.995},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.36299999999999999},"max":{"1min":0.68999999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45800000000000002,"5min":0.38600000000000001,"15min":0.36199999999999999},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.96199999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.76800000000000002,"5min":0.81000000000000005,"15min":0.85999999999999999},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46999999999999997,"15min":0.50800000000000001},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.66600000000000004,"5min":0.76700000000000002,"15min":0.91700000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.92700000000000005},"last":0.66300000000000003}]},{"osd":6,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.85599999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.91100000000000003},"last":0.51000000000000001}]},{"osd":7,"last update":"Wed May 17 15:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56899999999999995,"15min":0.60399999999999998},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.31},"max":{"1min":0.77300000000000002,"5min":0.85099999999999998,"15min":0.92500000000000004},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:06:01.595 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:06:01.596 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:06:01.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.746+0000 7f46ff59e700 1 Processor -- start 2023-05-17T15:06:01.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.746+0000 7f46ff59e700 1 -- start start 2023-05-17T15:06:01.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.747+0000 7f46ff59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47000cac00 0x7f47000cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.747+0000 7f46ff59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4700157980 0x7f47000c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.747+0000 7f46ff59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47000c60d0 con 0x7f47001537e0 2023-05-17T15:06:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.747+0000 7f46ff59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47001588b0 con 0x7f4700157980 2023-05-17T15:06:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.747+0000 7f46ff59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4700157e00 con 0x7f47000cac00 2023-05-17T15:06:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4700157980 0x7f47000c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4700157980 0x7f47000c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37406/0 (socket says 172.21.15.27:37406) 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 -- 172.21.15.27:0/2291686270 learned_addr learned my addr 172.21.15.27:0/2291686270 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fe59c700 1 --2- 172.21.15.27:0/2291686270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47000cac00 0x7f47000cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 -- 172.21.15.27:0/2291686270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47000cac00 msgr2=0x7f47000cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 --2- 172.21.15.27:0/2291686270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47000cac00 0x7f47000cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 -- 172.21.15.27:0/2291686270 >> v1:172.21.15.40:6789/0 conn(0x7f47001537e0 legacy=0x7f4700153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 -- 172.21.15.27:0/2291686270 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700158010 con 0x7f4700157980 2023-05-17T15:06:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fdd9b700 1 --2- 172.21.15.27:0/2291686270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4700157980 0x7f47000c5be0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f46e8009830 tx=0x7f46e80090f0).ready entity=mon.0 client_cookie=16b213b52f8febe6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fd59a700 1 -- 172.21.15.27:0/2291686270 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800b580 con 0x7f4700157980 2023-05-17T15:06:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fd59a700 1 -- 172.21.15.27:0/2291686270 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e800b6e0 con 0x7f4700157980 2023-05-17T15:06:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.748+0000 7f46fd59a700 1 -- 172.21.15.27:0/2291686270 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800ba60 con 0x7f4700157980 2023-05-17T15:06:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 -- 172.21.15.27:0/2291686270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4700157980 msgr2=0x7f47000c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 --2- 172.21.15.27:0/2291686270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4700157980 0x7f47000c5be0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f46e8009830 tx=0x7f46e80090f0).stop 2023-05-17T15:06:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 -- 172.21.15.27:0/2291686270 shutdown_connections 2023-05-17T15:06:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 --2- 172.21.15.27:0/2291686270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47000cac00 0x7f47000cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 --2- 172.21.15.27:0/2291686270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4700157980 0x7f47000c5be0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 -- 172.21.15.27:0/2291686270 >> 172.21.15.27:0/2291686270 conn(0x7f470005dd50 msgr2=0x7f470005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 -- 172.21.15.27:0/2291686270 shutdown_connections 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.749+0000 7f46ff59e700 1 -- 172.21.15.27:0/2291686270 wait complete. 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.750+0000 7f46ff59e700 1 Processor -- start 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.750+0000 7f46ff59e700 1 -- start start 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 0x7f470014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47001537e0 0x7f4700155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4700157980 0x7f4700164580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47001655f0 con 0x7f47000cac00 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47000c3190 con 0x7f4700157980 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47000c2b80 con 0x7f47001537e0 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 0x7f470014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 0x7f470014fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37408/0 (socket says 172.21.15.27:37408) 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 -- 172.21.15.27:0/170089464 learned_addr learned my addr 172.21.15.27:0/170089464 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fdd9b700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47001537e0 0x7f4700155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fed9d700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4700157980 0x7f4700164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 -- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47001537e0 msgr2=0x7f4700155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47001537e0 0x7f4700155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 -- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4700157980 msgr2=0x7f4700164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:01.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4700157980 0x7f4700164580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:01.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 -- 172.21.15.27:0/170089464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8009370 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46fe59c700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 0x7f470014fa30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f46f800e950 tx=0x7f46f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8012600 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8012760 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4700165030 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8012ae0 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.751+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47000c2e20 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.752+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4700047150 con 0x7f47000cac00 2023-05-17T15:06:01.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.753+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f46f8022070 con 0x7f47000cac00 2023-05-17T15:06:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.753+0000 7f46f67fc700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f46e005ee20 0x7f46e00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.753+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f46f8079fe0 con 0x7f47000cac00 2023-05-17T15:06:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.753+0000 7f46fdd9b700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f46e005ee20 0x7f46e00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.753+0000 7f46fdd9b700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f46e005ee20 0x7f46e00612e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f46e8009830 tx=0x7f46e8017000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.757+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46f804b530 con 0x7f47000cac00 2023-05-17T15:06:01.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:01.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:02.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:01.998+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f47001582f0 con 0x7f47000cac00 2023-05-17T15:06:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.002+0000 7f46f67fc700 1 -- 172.21.15.27:0/170089464 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f46f8016070 con 0x7f47000cac00 2023-05-17T15:06:02.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f46e005ee20 msgr2=0x7f46e00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f46e005ee20 0x7f46e00612e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f46e8009830 tx=0x7f46e8017000).stop 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 msgr2=0x7f470014fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 0x7f470014fa30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f46f800e950 tx=0x7f46f8009060).stop 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 shutdown_connections 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f46e005ee20 0x7f46e00612e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4700157980 0x7f4700164580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47000cac00 0x7f470014fa30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 --2- 172.21.15.27:0/170089464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47001537e0 0x7f4700155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.004+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 >> 172.21.15.27:0/170089464 conn(0x7f470005dd50 msgr2=0x7f47000ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.005+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 shutdown_connections 2023-05-17T15:06:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.005+0000 7f46ff59e700 1 -- 172.21.15.27:0/170089464 wait complete. 2023-05-17T15:06:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:06:02.020 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:06:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.132+0000 7f6f499a1700 1 Processor -- start 2023-05-17T15:06:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.132+0000 7f6f499a1700 1 -- start start 2023-05-17T15:06:02.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f499a1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6f440c1560 0x7f6f440c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f499a1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f441549b0 con 0x7f6f440c1180 2023-05-17T15:06:02.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f499a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f44154c90 con 0x7f6f441544f0 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f499a1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f44154f70 con 0x7f6f440c1560 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f491a0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6f440c1560 0x7f6f440c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f4899f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6f440c1180 0x7f6f440c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36978/0 (socket says 172.21.15.27:36978) 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f4899f700 1 -- 172.21.15.27:0/1206849505 learned_addr learned my addr 172.21.15.27:0/1206849505 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f491a0700 1 -- 172.21.15.27:0/1206849505 >> v1:172.21.15.40:6789/0 conn(0x7f6f441544f0 legacy=0x7f6f440a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f491a0700 1 -- 172.21.15.27:0/1206849505 >> v1:172.21.15.27:6789/0 conn(0x7f6f440c1180 legacy=0x7f6f440c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f437fe700 1 -- 172.21.15.27:0/1206849505 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669212534 0 0) 0x7f6f441549b0 con 0x7f6f440c1180 2023-05-17T15:06:02.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f491a0700 1 -- 172.21.15.27:0/1206849505 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44155250 con 0x7f6f440c1560 2023-05-17T15:06:02.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.133+0000 7f6f491a0700 1 --2- 172.21.15.27:0/1206849505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f440c1560 0x7f6f440c74a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f6f2c009760 tx=0x7f6f2c009060).ready entity=mon.0 client_cookie=d826d4abda10ebed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f437fe700 1 -- 172.21.15.27:0/1206849505 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0090d0 con 0x7f6f440c1560 2023-05-17T15:06:02.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f437fe700 1 -- 172.21.15.27:0/1206849505 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c00b520 con 0x7f6f440c1560 2023-05-17T15:06:02.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f437fe700 1 -- 172.21.15.27:0/1206849505 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00b8a0 con 0x7f6f440c1560 2023-05-17T15:06:02.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 -- 172.21.15.27:0/1206849505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f440c1560 msgr2=0x7f6f440c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1206849505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f440c1560 0x7f6f440c74a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f6f2c009760 tx=0x7f6f2c009060).stop 2023-05-17T15:06:02.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 -- 172.21.15.27:0/1206849505 shutdown_connections 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1206849505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f440c1560 0x7f6f440c74a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 -- 172.21.15.27:0/1206849505 >> 172.21.15.27:0/1206849505 conn(0x7f6f4405dd50 msgr2=0x7f6f4405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 -- 172.21.15.27:0/1206849505 shutdown_connections 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.134+0000 7f6f499a1700 1 -- 172.21.15.27:0/1206849505 wait complete. 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.135+0000 7f6f499a1700 1 Processor -- start 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.135+0000 7f6f499a1700 1 -- start start 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f499a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c1180 0x7f6f441582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f499a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f440c1560 0x7f6f4414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f499a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 0x7f6f440cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f499a1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440add90 con 0x7f6f441544f0 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f499a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440ae070 con 0x7f6f440c1180 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f499a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440ae350 con 0x7f6f440c1560 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f491a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 0x7f6f440cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f491a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 0x7f6f440cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37424/0 (socket says 172.21.15.27:37424) 2023-05-17T15:06:02.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.136+0000 7f6f491a0700 1 -- 172.21.15.27:0/1047900840 learned_addr learned my addr 172.21.15.27:0/1047900840 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f43fff700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f440c1560 0x7f6f4414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f4899f700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c1180 0x7f6f441582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f491a0700 1 -- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f440c1560 msgr2=0x7f6f4414d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f491a0700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f440c1560 0x7f6f4414d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f491a0700 1 -- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c1180 msgr2=0x7f6f441582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f491a0700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c1180 0x7f6f441582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f491a0700 1 -- 172.21.15.27:0/1047900840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0092a0 con 0x7f6f441544f0 2023-05-17T15:06:02.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f43fff700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f440c1560 0x7f6f4414d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f4899f700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c1180 0x7f6f441582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f491a0700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 0x7f6f440cb010 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f6f44068b00 tx=0x7f6f2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011d70 con 0x7f6f441544f0 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c01b410 con 0x7f6f441544f0 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f440ae630 con 0x7f6f441544f0 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c01b7d0 con 0x7f6f441544f0 2023-05-17T15:06:02.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.137+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f44158790 con 0x7f6f441544f0 2023-05-17T15:06:02.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.138+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4406bdf0 con 0x7f6f441544f0 2023-05-17T15:06:02.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.138+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f6f2c02b070 con 0x7f6f441544f0 2023-05-17T15:06:02.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.139+0000 7f6f40ff9700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f2405ee20 0x7f6f240612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.139+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f6f2c07b880 con 0x7f6f441544f0 2023-05-17T15:06:02.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.139+0000 7f6f4899f700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f2405ee20 0x7f6f240612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.139+0000 7f6f4899f700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f2405ee20 0x7f6f240612e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6f3c001750 tx=0x7f6f3c009040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.143+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f2c04cdd0 con 0x7f6f441544f0 2023-05-17T15:06:02.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.356+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f440bfb80 con 0x7f6f441544f0 2023-05-17T15:06:02.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.356+0000 7f6f40ff9700 1 -- 172.21.15.27:0/1047900840 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f6f2c01f020 con 0x7f6f441544f0 2023-05-17T15:06:02.360 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:06:02.361 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:05:57.187691+0000","modified":"2023-05-17T15:06:00.203429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/3759557665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":3759557665},{"type":"v1","addr":"172.21.15.27:6837","nonce":3759557665}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-17T15:06:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f2405ee20 msgr2=0x7f6f240612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f2405ee20 0x7f6f240612e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6f3c001750 tx=0x7f6f3c009040).stop 2023-05-17T15:06:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 msgr2=0x7f6f440cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 0x7f6f440cb010 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f6f44068b00 tx=0x7f6f2c017000).stop 2023-05-17T15:06:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 shutdown_connections 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f6f2405ee20 0x7f6f240612e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f441544f0 0x7f6f440cb010 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c1180 0x7f6f441582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 --2- 172.21.15.27:0/1047900840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f440c1560 0x7f6f4414d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 >> 172.21.15.27:0/1047900840 conn(0x7f6f4405dd50 msgr2=0x7f6f440ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 shutdown_connections 2023-05-17T15:06:02.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.358+0000 7f6f499a1700 1 -- 172.21.15.27:0/1047900840 wait complete. 2023-05-17T15:06:02.364 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2023-05-17T15:06:02.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:05:57.187691+0000', 'modified': '2023-05-17T15:06:00.203429+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5736}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5736': {'gid': 5736, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6837/3759557665', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6836', 'nonce': 3759557665}, {'type': 'v1', 'addr': '172.21.15.27:6837', 'nonce': 3759557665}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:06:02.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:06:02.778 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-17T15:06:02.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.893+0000 7fabf5589700 1 Processor -- start 2023-05-17T15:06:02.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.893+0000 7fabf5589700 1 -- start start 2023-05-17T15:06:02.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabf5589700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fabf00c1270 0x7fabf0150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabf5589700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf0066300 0x7fabf01549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabf5589700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf00c30c0 con 0x7fabf0150ae0 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabf5589700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00bd660 con 0x7fabf00c1270 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabf5589700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c2de0 con 0x7fabf0066300 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabee7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fabf00c1270 0x7fabf0150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabeeffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fabf0150ae0 0x7fabf0065bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36992/0 (socket says 172.21.15.27:36992) 2023-05-17T15:06:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.894+0000 7fabeeffd700 1 -- 172.21.15.27:0/719716665 learned_addr learned my addr 172.21.15.27:0/719716665 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabef7fe700 1 --2- 172.21.15.27:0/719716665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf0066300 0x7fabf01549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabee7fc700 1 -- 172.21.15.27:0/719716665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf0066300 msgr2=0x7fabf01549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabee7fc700 1 --2- 172.21.15.27:0/719716665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf0066300 0x7fabf01549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabee7fc700 1 -- 172.21.15.27:0/719716665 >> v1:172.21.15.27:6789/0 conn(0x7fabf0150ae0 legacy=0x7fabf0065bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabee7fc700 1 -- 172.21.15.27:0/719716665 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00a5d50 con 0x7fabf00c1270 2023-05-17T15:06:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabedffb700 1 -- 172.21.15.27:0/719716665 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237673942 0 0) 0x7fabf00c30c0 con 0x7fabf0150ae0 2023-05-17T15:06:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabee7fc700 1 --2- 172.21.15.27:0/719716665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf00c1270 0x7fabf0150ec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fabd8009760 tx=0x7fabd8009060).ready entity=mon.0 client_cookie=d603b2f941aad4a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabedffb700 1 -- 172.21.15.27:0/719716665 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800b580 con 0x7fabf00c1270 2023-05-17T15:06:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabedffb700 1 -- 172.21.15.27:0/719716665 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800b6e0 con 0x7fabf00c1270 2023-05-17T15:06:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabedffb700 1 -- 172.21.15.27:0/719716665 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800ba60 con 0x7fabf00c1270 2023-05-17T15:06:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabf5589700 1 -- 172.21.15.27:0/719716665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf00c1270 msgr2=0x7fabf0150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabf5589700 1 --2- 172.21.15.27:0/719716665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf00c1270 0x7fabf0150ec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fabd8009760 tx=0x7fabd8009060).stop 2023-05-17T15:06:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabf5589700 1 -- 172.21.15.27:0/719716665 shutdown_connections 2023-05-17T15:06:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabf5589700 1 --2- 172.21.15.27:0/719716665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf0066300 0x7fabf01549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabf5589700 1 --2- 172.21.15.27:0/719716665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf00c1270 0x7fabf0150ec0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.895+0000 7fabf5589700 1 -- 172.21.15.27:0/719716665 >> 172.21.15.27:0/719716665 conn(0x7fabf005e7e0 msgr2=0x7fabf00c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.896+0000 7fabf5589700 1 -- 172.21.15.27:0/719716665 shutdown_connections 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.896+0000 7fabf5589700 1 -- 172.21.15.27:0/719716665 wait complete. 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.897+0000 7fabf5589700 1 Processor -- start 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.897+0000 7fabf5589700 1 -- start start 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.897+0000 7fabf5589700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 0x7fabf0140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.897+0000 7fabf5589700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf00c1270 0x7fabf0142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.897+0000 7fabf5589700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf0150ae0 0x7fabf0143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabf5589700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00bf760 con 0x7fabf0066300 2023-05-17T15:06:02.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabf5589700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0140a70 con 0x7fabf0150ae0 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabf5589700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0141f70 con 0x7fabf00c1270 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 0x7fabf0140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 0x7fabf0140580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37436/0 (socket says 172.21.15.27:37436) 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 -- 172.21.15.27:0/456082502 learned_addr learned my addr 172.21.15.27:0/456082502 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabee7fc700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf00c1270 0x7fabf0142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabef7fe700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf0150ae0 0x7fabf0143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 -- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf00c1270 msgr2=0x7fabf0142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf00c1270 0x7fabf0142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 -- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf0150ae0 msgr2=0x7fabf0143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf0150ae0 0x7fabf0143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 -- 172.21.15.27:0/456082502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80092a0 con 0x7fabf0066300 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabef7fe700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf0150ae0 0x7fabf0143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabeeffd700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 0x7fabf0140580 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fabe800c590 tx=0x7fabe8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabe6ffd700 1 -- 172.21.15.27:0/456082502 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8007e40 con 0x7fabf0066300 2023-05-17T15:06:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabe6ffd700 1 -- 172.21.15.27:0/456082502 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80072e0 con 0x7fabf0066300 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0142250 con 0x7fabf0066300 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabe6ffd700 1 -- 172.21.15.27:0/456082502 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8007660 con 0x7fabf0066300 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.898+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0142810 con 0x7fabf0066300 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.899+0000 7fabe6ffd700 1 -- 172.21.15.27:0/456082502 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fabe8010070 con 0x7fabf0066300 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.900+0000 7fabe6ffd700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fabd005ee20 0x7fabd00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.900+0000 7fabe6ffd700 1 -- 172.21.15.27:0/456082502 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fabe8079450 con 0x7fabf0066300 2023-05-17T15:06:02.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.900+0000 7fabee7fc700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fabd005ee20 0x7fabd00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.900+0000 7fabee7fc700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fabd005ee20 0x7fabd00612e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fabf00acac0 tx=0x7fabd8017000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.902+0000 7fac06f1bb80 1 Processor -- start 2023-05-17T15:06:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.902+0000 7fac06f1bb80 1 -- start start 2023-05-17T15:06:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b0ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6aac5e0 con 0x55efb6ae7300 2023-05-17T15:06:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6a238a0 con 0x55efb6b30480 2023-05-17T15:06:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efb6a38900 con 0x55efb6b2b560 2023-05-17T15:06:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37448/0 (socket says 172.21.15.27:37448) 2023-05-17T15:06:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 -- 172.21.15.27:0/2057145806 learned_addr learned my addr 172.21.15.27:0/2057145806 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabeeffd700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b0ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 -- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 msgr2=0x55efb6b0ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b0ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabee7fc700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 -- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 msgr2=0x55efb6b2b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 -- 172.21.15.27:0/2057145806 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efb6aac450 con 0x55efb6ae7300 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabeeffd700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b0ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabee7fc700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.903+0000 7fabef7fe700 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae1710 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fabe0007370 tx=0x7fabe000b040).ready entity=mon.0 client_cookie=60978f0179fe849c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fabcffff700 1 -- 172.21.15.27:0/2057145806 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0015420 con 0x55efb6ae7300 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fabcffff700 1 -- 172.21.15.27:0/2057145806 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000f070 con 0x55efb6ae7300 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fabcffff700 1 -- 172.21.15.27:0/2057145806 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0015790 con 0x55efb6ae7300 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 -- 172.21.15.27:0/2057145806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 msgr2=0x55efb6ae1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae1710 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fabe0007370 tx=0x7fabe000b040).stop 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 -- 172.21.15.27:0/2057145806 shutdown_connections 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae1710 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b0ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/2057145806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 -- 172.21.15.27:0/2057145806 >> 172.21.15.27:0/2057145806 conn(0x55efb68a3e40 msgr2=0x55efb6b2f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 -- 172.21.15.27:0/2057145806 shutdown_connections 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.904+0000 7fac06f1bb80 1 -- 172.21.15.27:0/2057145806 wait complete. 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.905+0000 7fac06f1bb80 1 -- start start 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.905+0000 7fac06f1bb80 1 Processor -- start 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6ae7300 0x55efb6b0c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 0x55efb6b11d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb69ffed0 con 0x55efb6b2b560 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b0c960 con 0x55efb6b30480 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b27ce0 con 0x55efb6ae7300 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fac06f1bb80 10 client.0 ll_register_callbacks cb 0x55efb6aa61f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 0x55efb6b11d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 0x55efb6b11d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37452/0 (socket says 172.21.15.27:37452) 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 -- 172.21.15.27:0/23964600 learned_addr learned my addr 172.21.15.27:0/23964600 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabeeffd700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6ae7300 0x55efb6b0c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabef7fe700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 -- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6ae7300 msgr2=0x55efb6b0c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6ae7300 0x55efb6b0c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 -- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 msgr2=0x55efb6b281a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b281a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.906+0000 7fabee7fc700 1 -- 172.21.15.27:0/23964600 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe0009cb0 con 0x55efb6b2b560 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabee7fc700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 0x55efb6b11d50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fabd800b340 tx=0x7fabd801d000).ready entity=mon.0 client_cookie=a6e87a9535f06677 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabcd7fa700 1 -- 172.21.15.27:0/23964600 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd801cc00 con 0x55efb6b2b560 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabcd7fa700 1 -- 172.21.15.27:0/23964600 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fabd801cd60 con 0x55efb6b2b560 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efb6ada460 con 0x55efb6b2b560 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabcd7fa700 1 -- 172.21.15.27:0/23964600 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabd8026640 con 0x55efb6b2b560 2023-05-17T15:06:02.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 10 client.5877 fetch_fsmap learned FSMap version 23 2023-05-17T15:06:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55efb68db310 con 0x55efb6b2b560 2023-05-17T15:06:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabcd7fa700 1 -- 172.21.15.27:0/23964600 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55efb6ada460 con 0x55efb6b2b560 2023-05-17T15:06:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabcd7fa700 1 -- 172.21.15.27:0/23964600 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fabd80267a0 con 0x55efb6b2b560 2023-05-17T15:06:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 10 client.5877 fetch_fsmap finished waiting for FSMap version 23 2023-05-17T15:06:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 10 client.5877 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T15:06:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 20 client.5877 populate_metadata read hostname 'smithi027' 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b12240 0x55efb6b12c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 4 client.5877 mds_command: new command op to 5736 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 --> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efb689fca0 con 0x55efb6b12240 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.907+0000 7fabeeffd700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b12240 0x55efb6b12c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fabcd7fa700 10 client.5877 ms_handle_connect on v2:172.21.15.27:6836/3759557665 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fabeeffd700 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b12240 0x55efb6b12c40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cd474101cce033a2 server_cookie=cfe39f719266910a in_seq=0 out_seq=0 2023-05-17T15:06:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fabcd7fa700 1 -- 172.21.15.27:0/23964600 <== mds.0 v2:172.21.15.27:6836/3759557665 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55efb689fca0 con 0x55efb6b12240 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fabcd7fa700 10 client.5877 handle_command_reply: tid=0 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fac06f1bb80 1 client.5877 shutdown 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 msgr2=0x55efb6b11d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 0x55efb6b11d50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fabd800b340 tx=0x7fabd801d000).stop 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.908+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 shutdown_connections 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b12240 0x55efb6b12c40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b281a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fabcd7fa700 0 client.5877 ms_handle_reset on v2:172.21.15.27:6836/3759557665 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6ae7300 0x55efb6b0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/23964600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6b2b560 0x55efb6b11d50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 >> 172.21.15.27:0/23964600 conn(0x55efb68a3e40 msgr2=0x55efb6b2f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 shutdown_connections 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 1 -- 172.21.15.27:0/23964600 wait complete. 2023-05-17T15:06:02.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.909+0000 7fac06f1bb80 20 client.5877 trim_cache size 0 max 16384 2023-05-17T15:06:02.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.925+0000 7fac06f1bb80 1 Processor -- start 2023-05-17T15:06:02.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.925+0000 7fac06f1bb80 1 -- start start 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b2b560 0x55efb6b2c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b30480 0x55efb6b2c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b0c220 con 0x55efb6ae7300 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b27b10 con 0x55efb6b2b560 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b136a0 con 0x55efb6b30480 2023-05-17T15:06:02.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37458/0 (socket says 172.21.15.27:37458) 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 -- 172.21.15.27:0/1130110024 learned_addr learned my addr 172.21.15.27:0/1130110024 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 -- 172.21.15.27:0/1130110024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b30480 msgr2=0x55efb6b2c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b30480 0x55efb6b2c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 -- 172.21.15.27:0/1130110024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b2b560 msgr2=0x55efb6b2c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b2b560 0x55efb6b2c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:02.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 -- 172.21.15.27:0/1130110024 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efb6a31880 con 0x55efb6ae7300 2023-05-17T15:06:02.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.926+0000 7fabeeffd700 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae3740 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fabe804aa00 tx=0x7fabe8050040).ready entity=mon.0 client_cookie=c42757e0d55aa216 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fabe4ff9700 1 -- 172.21.15.27:0/1130110024 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8058040 con 0x55efb6ae7300 2023-05-17T15:06:02.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fabe4ff9700 1 -- 172.21.15.27:0/1130110024 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80790e0 con 0x55efb6ae7300 2023-05-17T15:06:02.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fabe4ff9700 1 -- 172.21.15.27:0/1130110024 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe805c280 con 0x55efb6ae7300 2023-05-17T15:06:02.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 -- 172.21.15.27:0/1130110024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 msgr2=0x55efb6ae3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae3740 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fabe804aa00 tx=0x7fabe8050040).stop 2023-05-17T15:06:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 -- 172.21.15.27:0/1130110024 shutdown_connections 2023-05-17T15:06:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b30480 0x55efb6b2c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae3740 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/1130110024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b2b560 0x55efb6b2c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 -- 172.21.15.27:0/1130110024 >> 172.21.15.27:0/1130110024 conn(0x55efb68a3e40 msgr2=0x55efb6b11b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 -- 172.21.15.27:0/1130110024 shutdown_connections 2023-05-17T15:06:02.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.927+0000 7fac06f1bb80 1 -- 172.21.15.27:0/1130110024 wait complete. 2023-05-17T15:06:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.928+0000 7fac06f1bb80 1 -- start start 2023-05-17T15:06:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.928+0000 7fac06f1bb80 1 Processor -- start 2023-05-17T15:06:02.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b91900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6ae18d0 con 0x55efb6ae7300 2023-05-17T15:06:02.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b3cda0 con 0x55efb6b30480 2023-05-17T15:06:02.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efb6b91470 con 0x55efb6b2b560 2023-05-17T15:06:02.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 10 client.0 ll_register_callbacks cb 0x55efb6aa61f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:06:02.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37464/0 (socket says 172.21.15.27:37464) 2023-05-17T15:06:02.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 -- 172.21.15.27:0/4293977161 learned_addr learned my addr 172.21.15.27:0/4293977161 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:02.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabee7fc700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b91900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 -- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 msgr2=0x55efb6b91900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b91900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 -- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 msgr2=0x55efb6b2c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:02.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabef7fe700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 -- 172.21.15.27:0/4293977161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0142810 con 0x55efb6ae7300 2023-05-17T15:06:02.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabeeffd700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae0ec0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fabe804aa50 tx=0x7fabe8055000).ready entity=mon.0 client_cookie=9212f2bb6bb27e14 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:02.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:06:02.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabcd7fa700 1 -- 172.21.15.27:0/4293977161 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8058040 con 0x55efb6ae7300 2023-05-17T15:06:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabcd7fa700 1 -- 172.21.15.27:0/4293977161 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fabe804dc50 con 0x55efb6ae7300 2023-05-17T15:06:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fabe000f070 con 0x55efb6ae7300 2023-05-17T15:06:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabcd7fa700 1 -- 172.21.15.27:0/4293977161 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabe804ae30 con 0x55efb6ae7300 2023-05-17T15:06:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 10 client.5883 fetch_fsmap learned FSMap version 23 2023-05-17T15:06:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55efb6a2d070 con 0x55efb6ae7300 2023-05-17T15:06:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.929+0000 7fabcd7fa700 1 -- 172.21.15.27:0/4293977161 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000f070 con 0x55efb6ae7300 2023-05-17T15:06:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabcd7fa700 1 -- 172.21.15.27:0/4293977161 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fabe8077d10 con 0x55efb6ae7300 2023-05-17T15:06:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 10 client.5883 fetch_fsmap finished waiting for FSMap version 23 2023-05-17T15:06:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 10 client.5883 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T15:06:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 20 client.5883 populate_metadata read hostname 'smithi027' 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b4d800 0x55efb6b2c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 4 client.5883 mds_command: new command op to 5736 tid=0[{"prefix": "status"}] 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 --> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55efb68d6ca0 con 0x55efb6b4d800 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabee7fc700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b4d800 0x55efb6b2c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabcd7fa700 10 client.5883 ms_handle_connect on v2:172.21.15.27:6836/3759557665 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabee7fc700 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b4d800 0x55efb6b2c7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eeeb95601d8d14f5 server_cookie=71e05131b46589dc in_seq=0 out_seq=0 2023-05-17T15:06:02.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabcd7fa700 1 -- 172.21.15.27:0/4293977161 <== mds.0 v2:172.21.15.27:6836/3759557665 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55efb68d6ca0 con 0x55efb6b4d800 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabcd7fa700 10 client.5883 handle_command_reply: tid=0 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 client.5883 shutdown 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 msgr2=0x55efb6ae0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae0ec0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fabe804aa50 tx=0x7fabe8055000).stop 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 shutdown_connections 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:6836/3759557665,v1:172.21.15.27:6837/3759557665] conn(0x55efb6b4d800 0x55efb6b2c7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efb6b30480 0x55efb6b2c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55efb6ae7300 0x55efb6ae0ec0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 --2- 172.21.15.27:0/4293977161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55efb6b2b560 0x55efb6b91900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fabcd7fa700 0 client.5883 ms_handle_reset on v2:172.21.15.27:6836/3759557665 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 >> 172.21.15.27:0/4293977161 conn(0x55efb68a3e40 msgr2=0x55efb6b129b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 shutdown_connections 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.930+0000 7fac06f1bb80 1 -- 172.21.15.27:0/4293977161 wait complete. 2023-05-17T15:06:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fac06f1bb80 20 client.5883 trim_cache size 0 max 16384 2023-05-17T15:06:02.950 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:06:02.950 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:06:02.950 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:06:02.950 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 5736, 2023-05-17T15:06:02.950 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:06:02.950 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 5.74177085, 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 23, 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 65, 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 65, 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 10.344787495 2023-05-17T15:06:02.951 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:06:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fabd005ee20 msgr2=0x7fabd00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fabd005ee20 0x7fabd00612e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fabf00acac0 tx=0x7fabd8017000).stop 2023-05-17T15:06:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 msgr2=0x7fabf0140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 0x7fabf0140580 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fabe800c590 tx=0x7fabe8007c80).stop 2023-05-17T15:06:02.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 shutdown_connections 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fabd005ee20 0x7fabd00612e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf0150ae0 0x7fabf0143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0066300 0x7fabf0140580 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 --2- 172.21.15.27:0/456082502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fabf00c1270 0x7fabf0142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 >> 172.21.15.27:0/456082502 conn(0x7fabf005e7e0 msgr2=0x7fabf00a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 shutdown_connections 2023-05-17T15:06:02.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:02.931+0000 7fabf5589700 1 -- 172.21.15.27:0/456082502 wait complete. 2023-05-17T15:06:02.955 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:06:03.025 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:06:03.021+0000 7f3bb7db1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:06:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.055+0000 7f529e05f700 1 Processor -- start 2023-05-17T15:06:03.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.055+0000 7f529e05f700 1 -- start start 2023-05-17T15:06:03.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529e05f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f52980c8100 0x7f52980c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:03.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529e05f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5298064bc0 con 0x7f52980c3e90 2023-05-17T15:06:03.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529e05f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5298063d00 con 0x7f52980c5020 2023-05-17T15:06:03.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529e05f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5298154220 con 0x7f52980c8100 2023-05-17T15:06:03.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529c85c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f52980c8100 0x7f52980c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529d85e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f52980c3e90 0x7f52980c58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37036/0 (socket says 172.21.15.27:37036) 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529d85e700 1 -- 172.21.15.27:0/3017046925 learned_addr learned my addr 172.21.15.27:0/3017046925 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529c85c700 1 -- 172.21.15.27:0/3017046925 >> v1:172.21.15.40:6789/0 conn(0x7f52980c5020 legacy=0x7f52980635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529c85c700 1 -- 172.21.15.27:0/3017046925 >> v1:172.21.15.27:6789/0 conn(0x7f52980c3e90 legacy=0x7f52980c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f529c85c700 1 -- 172.21.15.27:0/3017046925 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298063fb0 con 0x7f52980c8100 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.056+0000 7f5297fff700 1 -- 172.21.15.27:0/3017046925 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268533398 0 0) 0x7f5298064bc0 con 0x7f52980c3e90 2023-05-17T15:06:03.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529c85c700 1 --2- 172.21.15.27:0/3017046925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c8100 0x7f52980c5400 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f528c009760 tx=0x7f528c009060).ready entity=mon.0 client_cookie=e517fd31ff838395 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f5297fff700 1 -- 172.21.15.27:0/3017046925 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00b580 con 0x7f52980c8100 2023-05-17T15:06:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f5297fff700 1 -- 172.21.15.27:0/3017046925 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00b6e0 con 0x7f52980c8100 2023-05-17T15:06:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f5297fff700 1 -- 172.21.15.27:0/3017046925 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00ba60 con 0x7f52980c8100 2023-05-17T15:06:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 -- 172.21.15.27:0/3017046925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c8100 msgr2=0x7f52980c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 --2- 172.21.15.27:0/3017046925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c8100 0x7f52980c5400 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f528c009760 tx=0x7f528c009060).stop 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 -- 172.21.15.27:0/3017046925 shutdown_connections 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 --2- 172.21.15.27:0/3017046925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c8100 0x7f52980c5400 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 -- 172.21.15.27:0/3017046925 >> 172.21.15.27:0/3017046925 conn(0x7f52980919f0 msgr2=0x7f5298091e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 -- 172.21.15.27:0/3017046925 shutdown_connections 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.057+0000 7f529e05f700 1 -- 172.21.15.27:0/3017046925 wait complete. 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.058+0000 7f529e05f700 1 Processor -- start 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.058+0000 7f529e05f700 1 -- start start 2023-05-17T15:06:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529e05f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 0x7f52980a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529e05f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52980c5020 0x7f52980c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529e05f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52980c8100 0x7f5298156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529e05f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980c1ab0 con 0x7f52980c3e90 2023-05-17T15:06:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529e05f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980c14a0 con 0x7f52980c5020 2023-05-17T15:06:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529e05f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980aaef0 con 0x7f52980c8100 2023-05-17T15:06:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.059+0000 7f529d05d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 0x7f52980a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 0x7f52980a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37478/0 (socket says 172.21.15.27:37478) 2023-05-17T15:06:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 -- 172.21.15.27:0/4256147785 learned_addr learned my addr 172.21.15.27:0/4256147785 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529c85c700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52980c5020 0x7f52980c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d85e700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52980c8100 0x7f5298156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 -- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52980c8100 msgr2=0x7f5298156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52980c8100 0x7f5298156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 -- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52980c5020 msgr2=0x7f52980c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52980c5020 0x7f52980c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 -- 172.21.15.27:0/4256147785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c0092a0 con 0x7f52980c3e90 2023-05-17T15:06:03.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529d05d700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 0x7f52980a9350 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f529000c4b0 tx=0x7f5290007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000ce60 con 0x7f52980c3e90 2023-05-17T15:06:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000f470 con 0x7f52980c3e90 2023-05-17T15:06:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52980ab1d0 con 0x7f52980c3e90 2023-05-17T15:06:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000f810 con 0x7f52980c3e90 2023-05-17T15:06:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.060+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52980c2430 con 0x7f52980c3e90 2023-05-17T15:06:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.061+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52980c1900 con 0x7f52980c3e90 2023-05-17T15:06:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.062+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f5290019030 con 0x7f52980c3e90 2023-05-17T15:06:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.062+0000 7f52957fa700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f528405ee20 0x7f52840612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.062+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f5290078ef0 con 0x7f52980c3e90 2023-05-17T15:06:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.062+0000 7f529c85c700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f528405ee20 0x7f52840612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.062+0000 7f529c85c700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f528405ee20 0x7f52840612e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f52980c8520 tx=0x7f528c017000).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.066+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f529004a440 con 0x7f52980c3e90 2023-05-17T15:06:03.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.282+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f52980c1d90 con 0x7f52980c3e90 2023-05-17T15:06:03.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.282+0000 7f52957fa700 1 -- 172.21.15.27:0/4256147785 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f529004da60 con 0x7f52980c3e90 2023-05-17T15:06:03.286 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:06:03.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f528405ee20 msgr2=0x7f52840612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f528405ee20 0x7f52840612e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f52980c8520 tx=0x7f528c017000).stop 2023-05-17T15:06:03.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 msgr2=0x7f52980a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:03.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 0x7f52980a9350 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f529000c4b0 tx=0x7f5290007e30).stop 2023-05-17T15:06:03.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 shutdown_connections 2023-05-17T15:06:03.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f528405ee20 0x7f52840612e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52980c8100 0x7f5298156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52980c3e90 0x7f52980a9350 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 --2- 172.21.15.27:0/4256147785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52980c5020 0x7f52980c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:03.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 >> 172.21.15.27:0/4256147785 conn(0x7f52980919f0 msgr2=0x7f52980c42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:03.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 shutdown_connections 2023-05-17T15:06:03.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:03.284+0000 7f529e05f700 1 -- 172.21.15.27:0/4256147785 wait complete. 2023-05-17T15:06:03.299 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:06:03.300 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:06:03.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:06:03.301 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:06:03.301 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:06:03.302 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:06:03.302 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:06:03.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:06:03.303 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:06:03.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.305 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:06:03.320 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:06:03.320 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:06:03.320 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:06:03.321 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 41549sec preferred_lft 41549sec 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:06:03.322 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:06:03.323 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:06:03.324 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:06:03.324 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.324 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:06:03.324 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:06:03.324 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:06:03.324 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:06:03.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.325 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:06:03.384 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:06:03.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.385 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:06:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:06:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:06:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:06:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:06:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:06:03.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.444 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:06:03.444 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:06:03.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:06:03.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:06:03.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:06:03.445 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:06:03.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.542 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:06:03.557 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:06:03.557 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:06:03.558 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:06:03.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.559 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:06:03.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.622 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:06:03.676 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:06:03.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:06:03.755 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:06:03.756 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:06:03.798 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:06:03.798 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:06:03.800 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:06:03.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:06:03.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:06:03.864 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:06:04.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.017+0000 7fd991df4700 1 Processor -- start 2023-05-17T15:06:04.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.017+0000 7fd991df4700 1 -- start start 2023-05-17T15:06:04.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd991df4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154470 0x7fd98c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd991df4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd98c0693f0 0x7fd98c0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd991df4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c0c5a50 con 0x7fd98c154090 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd991df4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c069fa0 con 0x7fd98c0693f0 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd991df4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0c04e0 con 0x7fd98c154470 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd98c0693f0 0x7fd98c0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd98c154090 0x7fd98c0cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37054/0 (socket says 172.21.15.27:37054) 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98b7fe700 1 -- 172.21.15.27:0/2778554833 learned_addr learned my addr 172.21.15.27:0/2778554833 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98affd700 1 --2- 172.21.15.27:0/2778554833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154470 0x7fd98c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98bfff700 1 -- 172.21.15.27:0/2778554833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154470 msgr2=0x7fd98c068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98bfff700 1 --2- 172.21.15.27:0/2778554833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154470 0x7fd98c068f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98bfff700 1 -- 172.21.15.27:0/2778554833 >> v1:172.21.15.27:6789/0 conn(0x7fd98c154090 legacy=0x7fd98c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98a7fc700 1 -- 172.21.15.27:0/2778554833 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307005514 0 0) 0x7fd98c0c5a50 con 0x7fd98c154090 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.018+0000 7fd98bfff700 1 -- 172.21.15.27:0/2778554833 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c069860 con 0x7fd98c0693f0 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd98bfff700 1 --2- 172.21.15.27:0/2778554833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c0c5ee0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd97c009760 tx=0x7fd97c009060).ready entity=mon.0 client_cookie=6b73142472943683 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd98a7fc700 1 -- 172.21.15.27:0/2778554833 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00b580 con 0x7fd98c0693f0 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd98a7fc700 1 -- 172.21.15.27:0/2778554833 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c00b6e0 con 0x7fd98c0693f0 2023-05-17T15:06:04.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd98a7fc700 1 -- 172.21.15.27:0/2778554833 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00ba60 con 0x7fd98c0693f0 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 -- 172.21.15.27:0/2778554833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 msgr2=0x7fd98c0c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 --2- 172.21.15.27:0/2778554833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c0c5ee0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd97c009760 tx=0x7fd97c009060).stop 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 -- 172.21.15.27:0/2778554833 shutdown_connections 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 --2- 172.21.15.27:0/2778554833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c0c5ee0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 --2- 172.21.15.27:0/2778554833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154470 0x7fd98c068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 -- 172.21.15.27:0/2778554833 >> 172.21.15.27:0/2778554833 conn(0x7fd98c05e7e0 msgr2=0x7fd98c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:04.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 -- 172.21.15.27:0/2778554833 shutdown_connections 2023-05-17T15:06:04.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.019+0000 7fd991df4700 1 -- 172.21.15.27:0/2778554833 wait complete. 2023-05-17T15:06:04.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.020+0000 7fd991df4700 1 Processor -- start 2023-05-17T15:06:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 -- start start 2023-05-17T15:06:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154090 0x7fd98c0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd98c154470 0x7fd98c0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0c49d0 con 0x7fd98c0693f0 2023-05-17T15:06:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0af150 con 0x7fd98c154470 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd991df4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0ae540 con 0x7fd98c154090 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c14da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37496/0 (socket says 172.21.15.27:37496) 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.021+0000 7fd98b7fe700 1 -- 172.21.15.27:0/1055384939 learned_addr learned my addr 172.21.15.27:0/1055384939 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98b7fe700 1 -- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154090 msgr2=0x7fd98c0c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98b7fe700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154090 0x7fd98c0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98bfff700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd98c154470 0x7fd98c0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98b7fe700 1 -- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd98c154470 msgr2=0x7fd98c0c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98b7fe700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd98c154470 0x7fd98c0c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98b7fe700 1 -- 172.21.15.27:0/1055384939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c0092a0 con 0x7fd98c0693f0 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd98b7fe700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c14da10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd98400c960 tx=0x7fd984001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984005d30 con 0x7fd98c0693f0 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd984005e90 con 0x7fd98c0693f0 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c0ae820 con 0x7fd98c0693f0 2023-05-17T15:06:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984007320 con 0x7fd98c0693f0 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.022+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c0aede0 con 0x7fd98c0693f0 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.023+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c069bf0 con 0x7fd98c0693f0 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.023+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd984010030 con 0x7fd98c0693f0 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.023+0000 7fd9837fe700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd96c05ee20 0x7fd96c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.024+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fd984079c90 con 0x7fd98c0693f0 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.024+0000 7fd98affd700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd96c05ee20 0x7fd96c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.024+0000 7fd98affd700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd96c05ee20 0x7fd96c0612e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd98c0ab6d0 tx=0x7fd974008040).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:04.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.028+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd98404b1e0 con 0x7fd98c0693f0 2023-05-17T15:06:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.229+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd98c06c350 con 0x7fd96c05ee20 2023-05-17T15:06:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.230+0000 7fd9837fe700 1 -- 172.21.15.27:0/1055384939 <== mgr.5547 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd98c06c350 con 0x7fd96c05ee20 2023-05-17T15:06:04.234 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:06:04.234 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:06:04.234 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:06:04.234 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:06:04.234 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:06:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd96c05ee20 msgr2=0x7fd96c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd96c05ee20 0x7fd96c0612e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd98c0ab6d0 tx=0x7fd974008040).stop 2023-05-17T15:06:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 msgr2=0x7fd98c14da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c14da10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd98400c960 tx=0x7fd984001630).stop 2023-05-17T15:06:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 shutdown_connections 2023-05-17T15:06:04.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fd96c05ee20 0x7fd96c0612e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd98c154470 0x7fd98c0c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0693f0 0x7fd98c14da10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 --2- 172.21.15.27:0/1055384939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd98c154090 0x7fd98c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 >> 172.21.15.27:0/1055384939 conn(0x7fd98c05e7e0 msgr2=0x7fd98c0ac4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 shutdown_connections 2023-05-17T15:06:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.232+0000 7fd991df4700 1 -- 172.21.15.27:0/1055384939 wait complete. 2023-05-17T15:06:04.247 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:06:04.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.362+0000 7f0677cc8700 1 Processor -- start 2023-05-17T15:06:04.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.362+0000 7f0677cc8700 1 -- start start 2023-05-17T15:06:04.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0677cc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06701543d0 0x7f06700c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0677cc8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0670069410 0x7f06700bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0677cc8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0670158790 con 0x7f06700c60f0 2023-05-17T15:06:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0677cc8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700c1c50 con 0x7f0670069410 2023-05-17T15:06:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0677cc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700c6570 con 0x7f06701543d0 2023-05-17T15:06:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0676265700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0670069410 0x7f06700bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0675263700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f06700c60f0 0x7f0670068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37070/0 (socket says 172.21.15.27:37070) 2023-05-17T15:06:04.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0675263700 1 -- 172.21.15.27:0/2412321512 learned_addr learned my addr 172.21.15.27:0/2412321512 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:04.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0674a62700 1 -- 172.21.15.27:0/2412321512 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580241146 0 0) 0x7f0670158790 con 0x7f06700c60f0 2023-05-17T15:06:04.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0675a64700 1 --2- 172.21.15.27:0/2412321512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06701543d0 0x7f06700c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0674a62700 1 -- 172.21.15.27:0/2412321512 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06580033f0 con 0x7f06700c60f0 2023-05-17T15:06:04.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0676265700 1 -- 172.21.15.27:0/2412321512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06701543d0 msgr2=0x7f06700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:04.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0676265700 1 --2- 172.21.15.27:0/2412321512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06701543d0 0x7f06700c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0676265700 1 -- 172.21.15.27:0/2412321512 >> v1:172.21.15.27:6789/0 conn(0x7f06700c60f0 legacy=0x7f0670068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.363+0000 7f0676265700 1 -- 172.21.15.27:0/2412321512 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0670157e60 con 0x7f0670069410 2023-05-17T15:06:04.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0676265700 1 --2- 172.21.15.27:0/2412321512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700bfc80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f0660009e60 tx=0x7f0660009780).ready entity=mon.0 client_cookie=b098f0c14f6ca71 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0674a62700 1 -- 172.21.15.27:0/2412321512 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000e070 con 0x7f0670069410 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0674a62700 1 -- 172.21.15.27:0/2412321512 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000bb60 con 0x7f0670069410 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0674a62700 1 -- 172.21.15.27:0/2412321512 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660012410 con 0x7f0670069410 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 -- 172.21.15.27:0/2412321512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 msgr2=0x7f06700bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 --2- 172.21.15.27:0/2412321512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700bfc80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f0660009e60 tx=0x7f0660009780).stop 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 -- 172.21.15.27:0/2412321512 shutdown_connections 2023-05-17T15:06:04.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 --2- 172.21.15.27:0/2412321512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700bfc80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 --2- 172.21.15.27:0/2412321512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06701543d0 0x7f06700c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 -- 172.21.15.27:0/2412321512 >> 172.21.15.27:0/2412321512 conn(0x7f06700cb7f0 msgr2=0x7f06700c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 -- 172.21.15.27:0/2412321512 shutdown_connections 2023-05-17T15:06:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.364+0000 7f0677cc8700 1 -- 172.21.15.27:0/2412321512 wait complete. 2023-05-17T15:06:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.365+0000 7f0677cc8700 1 Processor -- start 2023-05-17T15:06:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.365+0000 7f0677cc8700 1 -- start start 2023-05-17T15:06:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0677cc8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0677cc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06700c60f0 0x7f06700b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0677cc8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06701543d0 0x7f0670163c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0677cc8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700ae8b0 con 0x7f0670069410 2023-05-17T15:06:04.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0677cc8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700b0290 con 0x7f06701543d0 2023-05-17T15:06:04.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0677cc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700afc80 con 0x7f06700c60f0 2023-05-17T15:06:04.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0675a64700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0675a64700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37510/0 (socket says 172.21.15.27:37510) 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0675a64700 1 -- 172.21.15.27:0/1673185656 learned_addr learned my addr 172.21.15.27:0/1673185656 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.366+0000 7f0675a64700 1 -- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06700c60f0 msgr2=0x7f06700b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0675a64700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06700c60f0 0x7f06700b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0675a64700 1 -- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06701543d0 msgr2=0x7f0670163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0676265700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06701543d0 0x7f0670163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0675a64700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06701543d0 0x7f0670163c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0675a64700 1 -- 172.21.15.27:0/1673185656 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660009a20 con 0x7f0670069410 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0675a64700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700ae3c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f066800d890 tx=0x7f0668008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668011590 con 0x7f0670069410 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06680116f0 con 0x7f0670069410 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06701646c0 con 0x7f0670069410 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668011a70 con 0x7f0670069410 2023-05-17T15:06:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.367+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06700aff20 con 0x7f0670069410 2023-05-17T15:06:04.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.368+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06700b0570 con 0x7f0670069410 2023-05-17T15:06:04.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.368+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 14) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f066801c460 con 0x7f0670069410 2023-05-17T15:06:04.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.369+0000 7f066dffb700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f065c05ee20 0x7f065c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:04.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.369+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f0668079ae0 con 0x7f0670069410 2023-05-17T15:06:04.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.369+0000 7f0675263700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f065c05ee20 0x7f065c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:04.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.369+0000 7f0675263700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f065c05ee20 0x7f065c0612e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0664005750 tx=0x7f0664007850).ready entity=mgr.5547 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:04.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.373+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f066804afd0 con 0x7f0670069410 2023-05-17T15:06:04.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:04.588+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f067006bdf0 con 0x7f0670069410 2023-05-17T15:06:05.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.231+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 15) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f0668077990 con 0x7f0670069410 2023-05-17T15:06:05.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.233+0000 7f066dffb700 1 -- 172.21.15.27:0/1673185656 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7f06680736d0 con 0x7f0670069410 2023-05-17T15:06:05.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f065c05ee20 msgr2=0x7f065c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f065c05ee20 0x7f065c0612e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0664005750 tx=0x7f0664007850).stop 2023-05-17T15:06:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 msgr2=0x7f06700ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700ae3c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f066800d890 tx=0x7f0668008040).stop 2023-05-17T15:06:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 shutdown_connections 2023-05-17T15:06:05.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f065c05ee20 0x7f065c0612e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06701543d0 0x7f0670163c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0670069410 0x7f06700ae3c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 --2- 172.21.15.27:0/1673185656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06700c60f0 0x7f06700b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 >> 172.21.15.27:0/1673185656 conn(0x7f06700cb7f0 msgr2=0x7f0670155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 shutdown_connections 2023-05-17T15:06:05.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.235+0000 7f0677cc8700 1 -- 172.21.15.27:0/1673185656 wait complete. 2023-05-17T15:06:05.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:06:05.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.369+0000 7f7c1a344700 1 Processor -- start 2023-05-17T15:06:05.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.370+0000 7f7c1a344700 1 -- start start 2023-05-17T15:06:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.370+0000 7f7c1a344700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c141543d0 0x7f7c140c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.370+0000 7f7c1a344700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c14158790 con 0x7f7c14069410 2023-05-17T15:06:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.370+0000 7f7c1a344700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c140c6570 con 0x7f7c140c60f0 2023-05-17T15:06:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.370+0000 7f7c1a344700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140c1c50 con 0x7f7c141543d0 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c188e1700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7c14069410 0x7f7c140bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37110/0 (socket says 172.21.15.27:37110) 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c188e1700 1 -- 172.21.15.27:0/1087673799 learned_addr learned my addr 172.21.15.27:0/1087673799 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c13fff700 1 --2- 172.21.15.27:0/1087673799 >> v2:172.21.15.40:3300/0 conn(0x7f7c141543d0 0x7f7c140c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c12ffd700 1 -- 172.21.15.27:0/1087673799 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565411848 0 0) 0x7f7c14158790 con 0x7f7c14069410 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c12ffd700 1 -- 172.21.15.27:0/1087673799 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bfc0033f0 con 0x7f7c14069410 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c13fff700 1 -- 172.21.15.27:0/1087673799 >> v1:172.21.15.40:6789/0 conn(0x7f7c140c60f0 legacy=0x7f7c14068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c13fff700 1 -- 172.21.15.27:0/1087673799 >> v1:172.21.15.27:6789/0 conn(0x7f7c14069410 legacy=0x7f7c140bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c13fff700 1 -- 172.21.15.27:0/1087673799 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14157e60 con 0x7f7c141543d0 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c13fff700 1 --2- 172.21.15.27:0/1087673799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c5c00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f7c08009760 tx=0x7f7c08009060).ready entity=mon.1 client_cookie=687d929ff655f5ad server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c12ffd700 1 -- 172.21.15.27:0/1087673799 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800f510 con 0x7f7c141543d0 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c12ffd700 1 -- 172.21.15.27:0/1087673799 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800f670 con 0x7f7c141543d0 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.371+0000 7f7c12ffd700 1 -- 172.21.15.27:0/1087673799 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800f9f0 con 0x7f7c141543d0 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 -- 172.21.15.27:0/1087673799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 msgr2=0x7f7c140c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1087673799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c5c00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f7c08009760 tx=0x7f7c08009060).stop 2023-05-17T15:06:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 -- 172.21.15.27:0/1087673799 shutdown_connections 2023-05-17T15:06:05.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1087673799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c5c00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 -- 172.21.15.27:0/1087673799 >> 172.21.15.27:0/1087673799 conn(0x7f7c140cb7f0 msgr2=0x7f7c140c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:05.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 -- 172.21.15.27:0/1087673799 shutdown_connections 2023-05-17T15:06:05.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.372+0000 7f7c1a344700 1 -- 172.21.15.27:0/1087673799 wait complete. 2023-05-17T15:06:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.373+0000 7f7c1a344700 1 Processor -- start 2023-05-17T15:06:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.373+0000 7f7c1a344700 1 -- start start 2023-05-17T15:06:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c1a344700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c14069410 0x7f7c140c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c1a344700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 0x7f7c140abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c1a344700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c1a344700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140ad000 con 0x7f7c140c60f0 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c1a344700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140ac170 con 0x7f7c141543d0 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c1a344700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140ac3f0 con 0x7f7c14069410 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 0x7f7c140abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 0x7f7c140abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37552/0 (socket says 172.21.15.27:37552) 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 -- 172.21.15.27:0/1247442087 learned_addr learned my addr 172.21.15.27:0/1247442087 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c188e1700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c13fff700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c14069410 0x7f7c140c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 -- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c14069410 msgr2=0x7f7c140c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c14069410 0x7f7c140c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 -- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 msgr2=0x7f7c140c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.374+0000 7f7c137fe700 1 -- 172.21.15.27:0/1247442087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080092a0 con 0x7f7c140c60f0 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f7c137fe700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 0x7f7c140abc80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f7c0400c440 tx=0x7f7c04007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04012400 con 0x7f7c140c60f0 2023-05-17T15:06:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04012560 con 0x7f7c140c60f0 2023-05-17T15:06:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04012900 con 0x7f7c140c60f0 2023-05-17T15:06:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c140ac6d0 con 0x7f7c140c60f0 2023-05-17T15:06:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c140acc90 con 0x7f7c140c60f0 2023-05-17T15:06:05.384 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:05.375+0000 7f16142b1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:06:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.376+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140c5f30 con 0x7f7c140c60f0 2023-05-17T15:06:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.376+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 15) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f7c04019030 con 0x7f7c140c60f0 2023-05-17T15:06:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.377+0000 7f7bfbfff700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c0005ee70 0x7f7c00061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.377+0000 7f7c13fff700 1 -- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c0005ee70 msgr2=0x7f7c00061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:06:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.377+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f7c040799d0 con 0x7f7c140c60f0 2023-05-17T15:06:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.377+0000 7f7c13fff700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c0005ee70 0x7f7c00061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:06:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.380+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c0404afa0 con 0x7f7c140c60f0 2023-05-17T15:06:05.387 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:05.376+0000 7fe4dcc98680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:06:05.445 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:05.442+0000 7f16142b1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:06:05.446 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:05.442+0000 7fe4dcc98680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:06:05.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.554+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7c140ad140 con 0x7f7c140c60f0 2023-05-17T15:06:05.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.558+0000 7f7bfbfff700 1 -- 172.21.15.27:0/1247442087 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c04017070 con 0x7f7c140c60f0 2023-05-17T15:06:05.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c0005ee70 msgr2=0x7f7c00061330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:06:05.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c0005ee70 0x7f7c00061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:05.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 msgr2=0x7f7c140abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 0x7f7c140abc80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f7c0400c440 tx=0x7f7c04007dc0).stop 2023-05-17T15:06:05.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 shutdown_connections 2023-05-17T15:06:05.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f7c0005ee70 0x7f7c00061330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:05.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c141543d0 0x7f7c140c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c14069410 0x7f7c140c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 --2- 172.21.15.27:0/1247442087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c140c60f0 0x7f7c140abc80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 >> 172.21.15.27:0/1247442087 conn(0x7f7c140cb7f0 msgr2=0x7f7c14068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:05.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 shutdown_connections 2023-05-17T15:06:05.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.560+0000 7f7c1a344700 1 -- 172.21.15.27:0/1247442087 wait complete. 2023-05-17T15:06:05.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:05.576 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:06:05.597 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-17T15:06:05.731 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:05.727+0000 7fe4dcc98680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:06:05.736 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:05.732+0000 7f16142b1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:06:05.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.756+0000 7fad18ecc700 1 Processor -- start 2023-05-17T15:06:05.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.756+0000 7fad18ecc700 1 -- start start 2023-05-17T15:06:05.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad18ecc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad14066d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad18ecc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad141556d0 con 0x7fad141541d0 2023-05-17T15:06:05.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad18ecc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad14067280 con 0x7fad14063a50 2023-05-17T15:06:05.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad18ecc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140679c0 con 0x7fad141545b0 2023-05-17T15:06:05.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad1259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fad141541d0 0x7fad14063340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37140/0 (socket says 172.21.15.27:37140) 2023-05-17T15:06:05.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad1259c700 1 -- 172.21.15.27:0/2330599565 learned_addr learned my addr 172.21.15.27:0/2330599565 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:06:05.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.757+0000 7fad12d9d700 1 --2- 172.21.15.27:0/2330599565 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad14066d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866832325 0 0) 0x7fad141556d0 con 0x7fad141541d0 2023-05-17T15:06:05.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad000033f0 con 0x7fad141541d0 2023-05-17T15:06:05.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120503516 0 0) 0x7fad14067280 con 0x7fad14063a50 2023-05-17T15:06:05.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad141556d0 con 0x7fad14063a50 2023-05-17T15:06:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad12d9d700 1 -- 172.21.15.27:0/2330599565 >> v1:172.21.15.40:6789/0 conn(0x7fad14063a50 legacy=0x7fad140c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad12d9d700 1 -- 172.21.15.27:0/2330599565 >> v1:172.21.15.27:6789/0 conn(0x7fad141541d0 legacy=0x7fad14063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad12d9d700 1 -- 172.21.15.27:0/2330599565 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14154ac0 con 0x7fad141545b0 2023-05-17T15:06:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad12d9d700 1 --2- 172.21.15.27:0/2330599565 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad14066d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fad14064f80 tx=0x7fad0c009780).ready entity=mon.2 client_cookie=78388424abf6e542 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00e070 con 0x7fad141545b0 2023-05-17T15:06:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c00bab0 con 0x7fad141545b0 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.758+0000 7fad1159a700 1 -- 172.21.15.27:0/2330599565 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00be30 con 0x7fad141545b0 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 -- 172.21.15.27:0/2330599565 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 msgr2=0x7fad14066d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 --2- 172.21.15.27:0/2330599565 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad14066d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fad14064f80 tx=0x7fad0c009780).stop 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 -- 172.21.15.27:0/2330599565 shutdown_connections 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 --2- 172.21.15.27:0/2330599565 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad14066d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 -- 172.21.15.27:0/2330599565 >> 172.21.15.27:0/2330599565 conn(0x7fad14068740 msgr2=0x7fad140c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 -- 172.21.15.27:0/2330599565 shutdown_connections 2023-05-17T15:06:05.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.759+0000 7fad18ecc700 1 -- 172.21.15.27:0/2330599565 wait complete. 2023-05-17T15:06:05.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.760+0000 7fad18ecc700 1 Processor -- start 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.760+0000 7fad18ecc700 1 -- start start 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad14063a50 0x7fad1414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 0x7fad140aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad1414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140aa620 con 0x7fad141541d0 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140aafa0 con 0x7fad14063a50 2023-05-17T15:06:05.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140c02c0 con 0x7fad141545b0 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 0x7fad140aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 0x7fad140aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37586/0 (socket says 172.21.15.27:37586) 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 -- 172.21.15.27:0/4145055822 learned_addr learned my addr 172.21.15.27:0/4145055822 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad14063a50 0x7fad1414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad12d9d700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad1414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 msgr2=0x7fad1414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad1414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad14063a50 msgr2=0x7fad1414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad14063a50 0x7fad1414e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 -- 172.21.15.27:0/4145055822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009a20 con 0x7fad141541d0 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad11d9b700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 0x7fad140aaab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fad0400c490 tx=0x7fad04007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400ce40 con 0x7fad141541d0 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400f470 con 0x7fad141541d0 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400f830 con 0x7fad141541d0 2023-05-17T15:06:05.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad140c05a0 con 0x7fad141541d0 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.761+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1414d970 con 0x7fad141541d0 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.762+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad140c07e0 con 0x7fad141541d0 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.763+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 15) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fad04019030 con 0x7fad141541d0 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.763+0000 7fad0a7fc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.763+0000 7fad1259c700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf4061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.763+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fad04079010 con 0x7fad141541d0 2023-05-17T15:06:05.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.763+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:06:05.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.767+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad140c07e0 con 0x7fad141541d0 2023-05-17T15:06:05.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.964+0000 7fad1259c700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf4061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:06:05.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.964+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:06:05.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:05.966+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad140aa110 con 0x7facf405ee70 2023-05-17T15:06:06.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:06.365+0000 7fad1259c700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf4061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:06:06.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:06.365+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:06:06.387 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:06.384+0000 7fe4dcc98680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:06:06.400 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:06.396+0000 7f16142b1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:06:06.455 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:06.451+0000 7fe4dcc98680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:06:06.468 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:06.464+0000 7f16142b1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:06:06.646 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:06.643+0000 7fe4dcc98680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:06:06.660 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:06.657+0000 7f16142b1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:06:07.080 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.076+0000 7fe4dcc98680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:06:07.096 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.092+0000 7f16142b1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:06:07.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:07.166+0000 7fad1259c700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf4061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:06:07.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:07.166+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:06:07.187 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.184+0000 7fe4dcc98680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:06:07.204 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.200+0000 7f16142b1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:06:07.344 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.341+0000 7fe4dcc98680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:06:07.361 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.358+0000 7f16142b1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:06:07.422 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.418+0000 7fe4dcc98680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:06:07.439 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.436+0000 7f16142b1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:06:07.491 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.488+0000 7fe4dcc98680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:06:07.509 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.506+0000 7f16142b1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:06:07.760 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.756+0000 7fe4dcc98680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:06:07.780 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.776+0000 7f16142b1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:06:07.948 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:07.945+0000 7fe4dcc98680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:06:07.968 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:07.964+0000 7f16142b1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:06:08.641 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:08.637+0000 7fe4dcc98680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:06:08.645 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:08.642+0000 7f16142b1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:06:08.711 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:08.707+0000 7fe4dcc98680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:06:08.716 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:08.713+0000 7f16142b1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:06:08.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:08.767+0000 7fad1259c700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf4061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:06:08.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:08.767+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:06:08.787 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:08.784+0000 7fe4dcc98680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:06:08.793 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:08.790+0000 7f16142b1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:06:08.937 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:08.933+0000 7fe4dcc98680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:06:08.944 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:08.941+0000 7f16142b1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:06:09.009 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:09.004+0000 7fe4dcc98680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:06:09.017 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:09.013+0000 7f16142b1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:06:09.127 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:09.122+0000 7fe4dcc98680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:06:09.136 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:09.133+0000 7f16142b1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:06:09.237 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:09.233+0000 7fe4dcc98680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:06:09.247 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:09.244+0000 7f16142b1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:06:09.536 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:09.531+0000 7fe4dcc98680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:06:09.545 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:09.542+0000 7f16142b1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:06:09.608 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:06:09.604+0000 7fe4dcc98680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:06:09.619 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:09.615+0000 7f16142b1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:06:10.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:10.631+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 16) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fad04010070 con 0x7fad141541d0 2023-05-17T15:06:10.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:10.631+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf4061330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:06:10.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:10.631+0000 7fad0a7fc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf4061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:06:10.709 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f1592a93700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.709 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f1592a93700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.710 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f1592a93700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.710 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f1592a93700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.710 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f1592a93700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.710 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f158fa8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.711 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f158fa8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.711 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f158fa8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.712 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f158fa8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:10.712 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:06:10.705+0000 7f158fa8d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:06:11.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.636+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fad04077240 con 0x7fad141541d0 2023-05-17T15:06:11.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.637+0000 7fad0a7fc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf402fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.637+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad140aa110 con 0x7facf405ee70 2023-05-17T15:06:11.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.639+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf402fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.640+0000 7fad1259c700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf402fdd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fad140c1040 tx=0x7facfc009040).ready entity=mgr.5925 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:11.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.653+0000 7fad0a7fc700 1 -- 172.21.15.27:0/4145055822 <== mgr.5925 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad140aa110 con 0x7facf405ee70 2023-05-17T15:06:11.656 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path snap_test_dir1 2023-05-17T15:06:11.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 msgr2=0x7facf402fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:11.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf402fdd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fad140c1040 tx=0x7facfc009040).stop 2023-05-17T15:06:11.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 msgr2=0x7fad140aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:11.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 0x7fad140aaab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fad0400c490 tx=0x7fad04007c60).stop 2023-05-17T15:06:11.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 shutdown_connections 2023-05-17T15:06:11.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7facf405ee70 0x7facf402fdd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad141545b0 0x7fad1414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad14063a50 0x7fad1414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 --2- 172.21.15.27:0/4145055822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad141541d0 0x7fad140aaab0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 >> 172.21.15.27:0/4145055822 conn(0x7fad14068740 msgr2=0x7fad14063340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:11.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 shutdown_connections 2023-05-17T15:06:11.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.655+0000 7fad18ecc700 1 -- 172.21.15.27:0/4145055822 wait complete. 2023-05-17T15:06:11.672 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-17T15:06:11.673 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-05-17T15:06:11.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.795+0000 7fa388ea0700 1 Processor -- start 2023-05-17T15:06:11.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.795+0000 7fa388ea0700 1 -- start start 2023-05-17T15:06:11.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.796+0000 7fa388ea0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa384151c90 0x7fa384152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.796+0000 7fa388ea0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa384154980 0x7fa3840c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.796+0000 7fa388ea0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa384158010 con 0x7fa3840c0520 2023-05-17T15:06:11.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.796+0000 7fa388ea0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384154f60 con 0x7fa384151c90 2023-05-17T15:06:11.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.796+0000 7fa388ea0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384155240 con 0x7fa384154980 2023-05-17T15:06:11.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.796+0000 7fa38259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa384151c90 0x7fa384152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa384151c90 0x7fa384152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37772/0 (socket says 172.21.15.27:37772) 2023-05-17T15:06:11.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 -- 172.21.15.27:0/1871450086 learned_addr learned my addr 172.21.15.27:0/1871450086 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:11.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa381d9b700 1 --2- 172.21.15.27:0/1871450086 >> v2:172.21.15.40:3300/0 conn(0x7fa384154980 0x7fa3840c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 -- 172.21.15.27:0/1871450086 >> v2:172.21.15.40:3300/0 conn(0x7fa384154980 msgr2=0x7fa3840c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:11.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 --2- 172.21.15.27:0/1871450086 >> v2:172.21.15.40:3300/0 conn(0x7fa384154980 0x7fa3840c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 -- 172.21.15.27:0/1871450086 >> v1:172.21.15.40:6789/0 conn(0x7fa3840c0520 legacy=0x7fa384081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:11.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 -- 172.21.15.27:0/1871450086 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384155520 con 0x7fa384151c90 2023-05-17T15:06:11.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa381d9b700 1 --2- 172.21.15.27:0/1871450086 >> v2:172.21.15.40:3300/0 conn(0x7fa384154980 0x7fa3840c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:06:11.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38259c700 1 --2- 172.21.15.27:0/1871450086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa384152070 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa384083ff0 tx=0x7fa37c009840).ready entity=mon.0 client_cookie=b8a0a3881220a7e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:11.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38159a700 1 -- 172.21.15.27:0/1871450086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00e070 con 0x7fa384151c90 2023-05-17T15:06:11.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38159a700 1 -- 172.21.15.27:0/1871450086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c00ba10 con 0x7fa384151c90 2023-05-17T15:06:11.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.797+0000 7fa38159a700 1 -- 172.21.15.27:0/1871450086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00bd90 con 0x7fa384151c90 2023-05-17T15:06:11.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 -- 172.21.15.27:0/1871450086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 msgr2=0x7fa384152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:11.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 --2- 172.21.15.27:0/1871450086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa384152070 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa384083ff0 tx=0x7fa37c009840).stop 2023-05-17T15:06:11.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 -- 172.21.15.27:0/1871450086 shutdown_connections 2023-05-17T15:06:11.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 --2- 172.21.15.27:0/1871450086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa384152070 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 --2- 172.21.15.27:0/1871450086 >> v2:172.21.15.40:3300/0 conn(0x7fa384154980 0x7fa3840c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 -- 172.21.15.27:0/1871450086 >> 172.21.15.27:0/1871450086 conn(0x7fa3840cae10 msgr2=0x7fa3840cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:11.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 -- 172.21.15.27:0/1871450086 shutdown_connections 2023-05-17T15:06:11.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.798+0000 7fa388ea0700 1 -- 172.21.15.27:0/1871450086 wait complete. 2023-05-17T15:06:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.799+0000 7fa388ea0700 1 Processor -- start 2023-05-17T15:06:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.799+0000 7fa388ea0700 1 -- start start 2023-05-17T15:06:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3840c0520 0x7fa384150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa3840b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384154980 0x7fa3840b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840acc90 con 0x7fa384151c90 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840acf70 con 0x7fa384154980 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840ad250 con 0x7fa3840c0520 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa3840b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa3840b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37780/0 (socket says 172.21.15.27:37780) 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 -- 172.21.15.27:0/3033421370 learned_addr learned my addr 172.21.15.27:0/3033421370 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa38259c700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3840c0520 0x7fa384150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa382d9d700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384154980 0x7fa3840b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 -- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3840c0520 msgr2=0x7fa384150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3840c0520 0x7fa384150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 -- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384154980 msgr2=0x7fa3840b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384154980 0x7fa3840b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 -- 172.21.15.27:0/3033421370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c009ae0 con 0x7fa384151c90 2023-05-17T15:06:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa381d9b700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa3840b0640 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa36c00c880 tx=0x7fa36c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c010580 con 0x7fa384151c90 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c0106e0 con 0x7fa384151c90 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c010a60 con 0x7fa384151c90 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840ad530 con 0x7fa384151c90 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.800+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840ae500 con 0x7fa384151c90 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.801+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3840c2d60 con 0x7fa384151c90 2023-05-17T15:06:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.802+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fa36c01b460 con 0x7fa384151c90 2023-05-17T15:06:11.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.802+0000 7fa37a7fc700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa36405ed40 0x7fa364061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:11.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.802+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fa36c079b70 con 0x7fa384151c90 2023-05-17T15:06:11.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.802+0000 7fa38259c700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa36405ed40 0x7fa364061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:11.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.802+0000 7fa38259c700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa36405ed40 0x7fa364061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa37c009880 tx=0x7fa3840c72f0).ready entity=mgr.5925 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:11.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:11.806+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3840c2d60 con 0x7fa384151c90 2023-05-17T15:06:12.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.003+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3840c2d60 con 0x7fa36405ed40 2023-05-17T15:06:12.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.007+0000 7fa37a7fc700 1 -- 172.21.15.27:0/3033421370 <== mgr.5925 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa3840c2d60 con 0x7fa36405ed40 2023-05-17T15:06:12.011 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path snap_test_dir1 2023-05-17T15:06:12.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa36405ed40 msgr2=0x7fa364061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa36405ed40 0x7fa364061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa37c009880 tx=0x7fa3840c72f0).stop 2023-05-17T15:06:12.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 msgr2=0x7fa3840b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa3840b0640 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa36c00c880 tx=0x7fa36c008040).stop 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 shutdown_connections 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa36405ed40 0x7fa364061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384154980 0x7fa3840b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3840c0520 0x7fa384150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 --2- 172.21.15.27:0/3033421370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384151c90 0x7fa3840b0640 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 >> 172.21.15.27:0/3033421370 conn(0x7fa3840cae10 msgr2=0x7fa384157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 shutdown_connections 2023-05-17T15:06:12.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.009+0000 7fa388ea0700 1 -- 172.21.15.27:0/3033421370 wait complete. 2023-05-17T15:06:12.024 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-17T15:06:12.025 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-17-15_07_00 in ~48s... 2023-05-17T15:06:12.025 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-17-15_08_00 in ~108s... 2023-05-17T15:06:12.025 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-05-17T15:06:12.026 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-17T15:06:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.141+0000 7fcb8e3c9700 1 Processor -- start 2023-05-17T15:06:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.141+0000 7fcb8e3c9700 1 -- start start 2023-05-17T15:06:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8e3c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88151c90 0x7fcb88152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8e3c9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcb88154980 0x7fcb880c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8e3c9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb880c0520 0x7fcb88081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8e3c9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb88158010 con 0x7fcb88154980 2023-05-17T15:06:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8e3c9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb88154f60 con 0x7fcb880c0520 2023-05-17T15:06:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8e3c9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88155240 con 0x7fcb88151c90 2023-05-17T15:06:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb7ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcb88154980 0x7fcb880c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb7ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcb88154980 0x7fcb880c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37788/0 (socket says 172.21.15.27:37788) 2023-05-17T15:06:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb7ffff700 1 -- 172.21.15.27:0/3950688861 learned_addr learned my addr 172.21.15.27:0/3950688861 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb87fff700 1 --2- 172.21.15.27:0/3950688861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88151c90 0x7fcb88152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.142+0000 7fcb8c966700 1 --2- 172.21.15.27:0/3950688861 >> v2:172.21.15.40:3300/0 conn(0x7fcb880c0520 0x7fcb88081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb7ffff700 1 -- 172.21.15.27:0/3950688861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88151c90 msgr2=0x7fcb88152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb7ffff700 1 --2- 172.21.15.27:0/3950688861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88151c90 0x7fcb88152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb7ffff700 1 -- 172.21.15.27:0/3950688861 >> v2:172.21.15.40:3300/0 conn(0x7fcb880c0520 msgr2=0x7fcb88081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb7ffff700 1 --2- 172.21.15.27:0/3950688861 >> v2:172.21.15.40:3300/0 conn(0x7fcb880c0520 0x7fcb88081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb7ffff700 1 -- 172.21.15.27:0/3950688861 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88155520 con 0x7fcb88154980 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb7ffff700 1 --2- 172.21.15.27:0/3950688861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88154980 0x7fcb880c6150 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fcb8805fcf0 tx=0x7fcb700090f0).ready entity=mon.0 client_cookie=f22c9d495565de4b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb877fe700 1 -- 172.21.15.27:0/3950688861 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000f510 con 0x7fcb88154980 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb877fe700 1 -- 172.21.15.27:0/3950688861 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7000f670 con 0x7fcb88154980 2023-05-17T15:06:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb877fe700 1 -- 172.21.15.27:0/3950688861 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000f9f0 con 0x7fcb88154980 2023-05-17T15:06:12.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/3950688861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88154980 msgr2=0x7fcb880c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.143+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/3950688861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88154980 0x7fcb880c6150 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fcb8805fcf0 tx=0x7fcb700090f0).stop 2023-05-17T15:06:12.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/3950688861 shutdown_connections 2023-05-17T15:06:12.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/3950688861 >> v2:172.21.15.40:3300/0 conn(0x7fcb880c0520 0x7fcb88081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/3950688861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88151c90 0x7fcb88152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/3950688861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88154980 0x7fcb880c6150 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/3950688861 >> 172.21.15.27:0/3950688861 conn(0x7fcb880cae10 msgr2=0x7fcb880cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:12.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/3950688861 shutdown_connections 2023-05-17T15:06:12.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.144+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/3950688861 wait complete. 2023-05-17T15:06:12.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 Processor -- start 2023-05-17T15:06:12.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 -- start start 2023-05-17T15:06:12.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb880c0520 0x7fcb88153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 0x7fcb880b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88154980 0x7fcb880ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb881654f0 con 0x7fcb88151c90 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880c1eb0 con 0x7fcb880c0520 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.145+0000 7fcb8e3c9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88164970 con 0x7fcb88154980 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 0x7fcb880b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 0x7fcb880b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37794/0 (socket says 172.21.15.27:37794) 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 -- 172.21.15.27:0/2950973274 learned_addr learned my addr 172.21.15.27:0/2950973274 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb87fff700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb880c0520 0x7fcb88153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb8c966700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88154980 0x7fcb880ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 -- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88154980 msgr2=0x7fcb880ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88154980 0x7fcb880ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 -- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb880c0520 msgr2=0x7fcb88153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb880c0520 0x7fcb88153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 -- 172.21.15.27:0/2950973274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb70009370 con 0x7fcb88151c90 2023-05-17T15:06:12.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb8c966700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88154980 0x7fcb880ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:06:12.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb7ffff700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 0x7fcb880b06e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fcb7000fba0 tx=0x7fcb70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:12.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70011bf0 con 0x7fcb88151c90 2023-05-17T15:06:12.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70011d50 con 0x7fcb88151c90 2023-05-17T15:06:12.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7001b660 con 0x7fcb88151c90 2023-05-17T15:06:12.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb88164c50 con 0x7fcb88151c90 2023-05-17T15:06:12.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.146+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb88165210 con 0x7fcb88151c90 2023-05-17T15:06:12.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.147+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb880c3990 con 0x7fcb88151c90 2023-05-17T15:06:12.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.147+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fcb7000f070 con 0x7fcb88151c90 2023-05-17T15:06:12.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.148+0000 7fcb84ff9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb6805ed40 0x7fcb68061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:06:12.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.148+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fcb7007ae20 con 0x7fcb88151c90 2023-05-17T15:06:12.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.148+0000 7fcb87fff700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb6805ed40 0x7fcb68061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:06:12.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.148+0000 7fcb87fff700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb6805ed40 0x7fcb68061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcb78009c30 tx=0x7fcb78009060).ready entity=mgr.5925 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:06:12.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.152+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb880c3990 con 0x7fcb88151c90 2023-05-17T15:06:12.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.348+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb880c3990 con 0x7fcb6805ed40 2023-05-17T15:06:12.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.351+0000 7fcb84ff9700 1 -- 172.21.15.27:0/2950973274 <== mgr.5925 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7fcb880c3990 con 0x7fcb6805ed40 2023-05-17T15:06:12.355 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:06:12.356 INFO:teuthology.orchestra.run.smithi027.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-05-17T15:06:12.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb6805ed40 msgr2=0x7fcb68061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb6805ed40 0x7fcb68061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcb78009c30 tx=0x7fcb78009060).stop 2023-05-17T15:06:12.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 msgr2=0x7fcb880b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:06:12.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 0x7fcb880b06e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fcb7000fba0 tx=0x7fcb70017000).stop 2023-05-17T15:06:12.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 shutdown_connections 2023-05-17T15:06:12.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fcb6805ed40 0x7fcb68061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb88154980 0x7fcb880ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb880c0520 0x7fcb88153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 --2- 172.21.15.27:0/2950973274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb88151c90 0x7fcb880b06e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:06:12.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 >> 172.21.15.27:0/2950973274 conn(0x7fcb880cae10 msgr2=0x7fcb880ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:06:12.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 shutdown_connections 2023-05-17T15:06:12.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:06:12.352+0000 7fcb8e3c9700 1 -- 172.21.15.27:0/2950973274 wait complete. 2023-05-17T15:06:12.369 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-05-17T15:06:12.370 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-05-17T15:06:12.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:12.371 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:13.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:13.388 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:14.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:14.408 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:15.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:15.429 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:16.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:16.450 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:17.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:17.471 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:18.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:18.494 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:19.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:19.515 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:20.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:20.536 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:21.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:21.556 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:22.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:22.576 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:23.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:23.597 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:24.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:24.617 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:25.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:25.637 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:26.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:26.657 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:27.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:27.678 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:28.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:28.698 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:29.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:29.717 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:30.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:30.738 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:31.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:31.758 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:32.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:32.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:32.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:32.778 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:33.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:33.800 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:34.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:34.820 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:35.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:35.841 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:36.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:36.861 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:37.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:37.882 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:38.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:38.902 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:39.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:39.923 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:40.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:40.944 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:41.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:41.964 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:42.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:42.984 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:44.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:44.004 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:45.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:45.024 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:46.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:46.045 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:47.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:47.065 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:48.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:48.086 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:49.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:49.106 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:50.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:50.127 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:51.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:51.146 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:52.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:52.167 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:53.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:53.188 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:54.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:54.209 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:55.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:55.230 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:56.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:56.251 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:57.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:57.272 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:58.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:58.292 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:06:59.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:06:59.312 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:00.015 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:07:00.012+0000 7f1582272700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:07:00.016 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:07:00.012+0000 7f1582272700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:07:00.016 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:07:00.012+0000 7f1582272700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:07:00.016 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:07:00.012+0000 7f1582272700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:07:00.016 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:07:00.012+0000 7f1582272700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:07:00.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:00.332 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:00.350 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:00.351 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-17-15_07_00_UTC'] 2023-05-17T15:07:00.352 DEBUG:tasks.cephfs.test_snap_schedules:exec=1684335972.0253081, now = 1684336020.352267, timo = 48 2023-05-17T15:07:01.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:01.353 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:01.372 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:02.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:02.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:02.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:02.374 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:02.393 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:03.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:03.395 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:03.415 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:04.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:04.417 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:04.435 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:05.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:05.437 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:05.456 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:06.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:06.458 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:06.477 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:07.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:07.479 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:07.499 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:08.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:08.501 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:08.519 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:09.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:09.521 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:09.540 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:10.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:10.542 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:10.560 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:11.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:11.562 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:11.580 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:12.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:12.583 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:12.601 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:13.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:13.603 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:13.622 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:14.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:14.624 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:14.643 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:15.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:15.645 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:15.664 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:16.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:16.666 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:16.684 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:17.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:17.686 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:17.705 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:18.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:18.707 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:19.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:19.727 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:19.746 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:20.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:20.748 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:20.767 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:21.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:21.768 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:21.787 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:22.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:22.788 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:22.807 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:23.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:23.810 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:23.828 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:24.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:24.830 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:24.848 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:25.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:25.850 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:25.869 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:26.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:26.872 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:26.891 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:27.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:27.893 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:27.912 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:28.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:28.914 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:28.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:29.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:29.936 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:29.955 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:30.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:30.957 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:30.976 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:31.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:31.979 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:31.997 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:32.211 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:32.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:32.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:32.999 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:33.017 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:34.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:34.019 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:34.039 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:35.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:35.041 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:35.060 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:36.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:36.062 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:36.081 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:37.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:37.084 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:37.103 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:38.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:38.105 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:38.123 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:39.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:39.125 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:39.144 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:40.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:40.149 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:40.167 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:41.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:41.169 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:41.187 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:42.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:42.189 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:42.209 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:43.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:43.210 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:43.230 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:44.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:44.232 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:44.251 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:45.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:45.253 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:45.272 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:46.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:46.274 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:46.293 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:47.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:47.295 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:47.314 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:48.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:48.316 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:48.334 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:49.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:49.336 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:49.356 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:50.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:50.358 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:50.377 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:51.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:51.379 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:51.398 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:52.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:52.401 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:52.420 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:53.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:53.422 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:53.441 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:54.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:54.443 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:54.462 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:55.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:55.464 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:55.483 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:56.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:56.485 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:56.504 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:57.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:57.506 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:57.525 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:58.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:58.527 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:58.547 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:07:59.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:07:59.549 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:07:59.568 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:08:00.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:00.571 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:08:00.591 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:08:00.591 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_08_00_UTC 2023-05-17T15:08:00.591 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-17-15_08_00_UTC'] 2023-05-17T15:08:00.592 DEBUG:tasks.cephfs.test_snap_schedules:exec=1684335972.0253081, now = 1684336080.5924659, timo = 108 2023-05-17T15:08:01.594 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-17T15:08:01.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.724+0000 7fc449c77700 1 Processor -- start 2023-05-17T15:08:01.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.724+0000 7fc449c77700 1 -- start start 2023-05-17T15:08:01.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc449c77700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4440ad2f0 0x7fc4440c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc449c77700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4440c0ae0 0x7fc4440c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc449c77700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c80c0 0x7fc444081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc449c77700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440c6560 con 0x7fc4440ad2f0 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc449c77700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440ab0c0 con 0x7fc4440c0ae0 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc449c77700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440c8550 con 0x7fc4440c80c0 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc4437fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4440ad2f0 0x7fc4440c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc4437fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4440ad2f0 0x7fc4440c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37812/0 (socket says 172.21.15.27:37812) 2023-05-17T15:08:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.725+0000 7fc4437fe700 1 -- 172.21.15.27:0/4224001976 learned_addr learned my addr 172.21.15.27:0/4224001976 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc443fff700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c80c0 0x7fc444081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc442ffd700 1 --2- 172.21.15.27:0/4224001976 >> v2:172.21.15.40:3300/0 conn(0x7fc4440c0ae0 0x7fc4440c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4437fe700 1 -- 172.21.15.27:0/4224001976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c80c0 msgr2=0x7fc444081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4437fe700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c80c0 0x7fc444081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4437fe700 1 -- 172.21.15.27:0/4224001976 >> v2:172.21.15.40:3300/0 conn(0x7fc4440c0ae0 msgr2=0x7fc4440c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4437fe700 1 --2- 172.21.15.27:0/4224001976 >> v2:172.21.15.40:3300/0 conn(0x7fc4440c0ae0 0x7fc4440c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4437fe700 1 -- 172.21.15.27:0/4224001976 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440c1250 con 0x7fc4440ad2f0 2023-05-17T15:08:01.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc443fff700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c80c0 0x7fc444081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:01.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc442ffd700 1 --2- 172.21.15.27:0/4224001976 >> v2:172.21.15.40:3300/0 conn(0x7fc4440c0ae0 0x7fc4440c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:01.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4437fe700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4440c6070 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fc4440aa6d0 tx=0x7fc4340090f0).ready entity=mon.0 client_cookie=87cbeb211a463160 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:01.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4427fc700 1 -- 172.21.15.27:0/4224001976 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400b600 con 0x7fc4440ad2f0 2023-05-17T15:08:01.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4427fc700 1 -- 172.21.15.27:0/4224001976 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400b760 con 0x7fc4440ad2f0 2023-05-17T15:08:01.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.726+0000 7fc4427fc700 1 -- 172.21.15.27:0/4224001976 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400bae0 con 0x7fc4440ad2f0 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 -- 172.21.15.27:0/4224001976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 msgr2=0x7fc4440c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4440c6070 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fc4440aa6d0 tx=0x7fc4340090f0).stop 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 -- 172.21.15.27:0/4224001976 shutdown_connections 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4440c6070 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 --2- 172.21.15.27:0/4224001976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c80c0 0x7fc444081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 --2- 172.21.15.27:0/4224001976 >> v2:172.21.15.40:3300/0 conn(0x7fc4440c0ae0 0x7fc4440c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 -- 172.21.15.27:0/4224001976 >> 172.21.15.27:0/4224001976 conn(0x7fc44405df10 msgr2=0x7fc44405e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 -- 172.21.15.27:0/4224001976 shutdown_connections 2023-05-17T15:08:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.727+0000 7fc449c77700 1 -- 172.21.15.27:0/4224001976 wait complete. 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.728+0000 7fc449c77700 1 Processor -- start 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.728+0000 7fc449c77700 1 -- start start 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc449c77700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4441535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc449c77700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c0ae0 0x7fc444152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc449c77700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4440c80c0 0x7fc4440cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc449c77700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc444159a70 con 0x7fc4440ad2f0 2023-05-17T15:08:01.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc449c77700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc444153380 con 0x7fc4440c80c0 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc449c77700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4441569f0 con 0x7fc4440c0ae0 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4441535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4441535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37816/0 (socket says 172.21.15.27:37816) 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 -- 172.21.15.27:0/1538196305 learned_addr learned my addr 172.21.15.27:0/1538196305 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc442ffd700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c0ae0 0x7fc444152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc443fff700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4440c80c0 0x7fc4440cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 -- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c0ae0 msgr2=0x7fc444152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:01.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c0ae0 0x7fc444152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 -- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4440c80c0 msgr2=0x7fc4440cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:01.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4440c80c0 0x7fc4440cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc4437fe700 1 -- 172.21.15.27:0/1538196305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434009370 con 0x7fc4440ad2f0 2023-05-17T15:08:01.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.729+0000 7fc443fff700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4440c80c0 0x7fc4440cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.730+0000 7fc4437fe700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4441535b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fc43400b3a0 tx=0x7fc434017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.731+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400b8d0 con 0x7fc4440ad2f0 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.731+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400ba30 con 0x7fc4440ad2f0 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.731+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43401b620 con 0x7fc4440ad2f0 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.731+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc444156e80 con 0x7fc4440ad2f0 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.731+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4441594b0 con 0x7fc4440ad2f0 2023-05-17T15:08:01.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.732+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4441567c0 con 0x7fc4440ad2f0 2023-05-17T15:08:01.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.732+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fc43402b070 con 0x7fc4440ad2f0 2023-05-17T15:08:01.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.733+0000 7fc42b7fe700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc43005ee70 0x7fc430061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:01.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.733+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6539+0+0 (secure 0 0 0) 0x7fc43407b6a0 con 0x7fc4440ad2f0 2023-05-17T15:08:01.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.733+0000 7fc442ffd700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc43005ee70 0x7fc430061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:01.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.733+0000 7fc442ffd700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc43005ee70 0x7fc430061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc4440cb8e0 tx=0x7fc438008040).ready entity=mgr.5925 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:01.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.737+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4441567c0 con 0x7fc4440ad2f0 2023-05-17T15:08:01.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.937+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 --> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4441567c0 con 0x7fc43005ee70 2023-05-17T15:08:01.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.941+0000 7fc42b7fe700 1 -- 172.21.15.27:0/1538196305 <== mgr.5925 v2:172.21.15.27:6832/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc4441567c0 con 0x7fc43005ee70 2023-05-17T15:08:01.945 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path snap_test_dir1 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc43005ee70 msgr2=0x7fc430061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc43005ee70 0x7fc430061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc4440cb8e0 tx=0x7fc438008040).stop 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 msgr2=0x7fc4441535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4441535b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fc43400b3a0 tx=0x7fc434017000).stop 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 shutdown_connections 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc43005ee70 0x7fc430061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4440c80c0 0x7fc4440cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4440ad2f0 0x7fc4441535b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 --2- 172.21.15.27:0/1538196305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4440c0ae0 0x7fc444152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 >> 172.21.15.27:0/1538196305 conn(0x7fc44405df10 msgr2=0x7fc4440c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 shutdown_connections 2023-05-17T15:08:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:01.943+0000 7fc449c77700 1 -- 172.21.15.27:0/1538196305 wait complete. 2023-05-17T15:08:01.958 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-17T15:08:01.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:01.959 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:08:01.974 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:08:01.975 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_08_00_UTC 2023-05-17T15:08:01.975 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-17-15_07_00_UTC 2023-05-17T15:08:01.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:01.976 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-17-15_07_00_UTC) 2023-05-17T15:08:02.034 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-17-15_08_00_UTC 2023-05-17T15:08:02.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:02.035 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-17-15_08_00_UTC) 2023-05-17T15:08:02.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:02.095 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-17T15:08:02.153 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:08:02.284 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:02.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.319+0000 7f0e0e505700 1 Processor -- start 2023-05-17T15:08:02.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.319+0000 7f0e0e505700 1 -- start start 2023-05-17T15:08:02.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0e505700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e080bd4b0 0x7f0e080bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0e505700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080c7610 0x7f0e080c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0e505700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0e505700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e08155530 con 0x7f0e080bd4b0 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0e505700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e08154920 con 0x7f0e081506c0 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0e505700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08154c00 con 0x7f0e080c7610 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e080bd4b0 0x7f0e080bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e080bd4b0 0x7f0e080bd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37824/0 (socket says 172.21.15.27:37824) 2023-05-17T15:08:02.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 -- 172.21.15.27:0/2872568345 learned_addr learned my addr 172.21.15.27:0/2872568345 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:02.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0cd02700 1 --2- 172.21.15.27:0/2872568345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080c7610 0x7f0e080c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0dd04700 1 --2- 172.21.15.27:0/2872568345 >> v2:172.21.15.40:3300/0 conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 -- 172.21.15.27:0/2872568345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080c7610 msgr2=0x7f0e080c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:02.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 --2- 172.21.15.27:0/2872568345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080c7610 0x7f0e080c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 -- 172.21.15.27:0/2872568345 >> v2:172.21.15.40:3300/0 conn(0x7f0e081506c0 msgr2=0x7f0e08150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 --2- 172.21.15.27:0/2872568345 >> v2:172.21.15.40:3300/0 conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 -- 172.21.15.27:0/2872568345 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08154ee0 con 0x7f0e080bd4b0 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0e0d503700 1 --2- 172.21.15.27:0/2872568345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080bd4b0 0x7f0e080bd890 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f0e080c7fb0 tx=0x7f0e040090f0).ready entity=mon.0 client_cookie=1ecac9242b8c334a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0dfffff700 1 -- 172.21.15.27:0/2872568345 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400f510 con 0x7f0e080bd4b0 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0dfffff700 1 -- 172.21.15.27:0/2872568345 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400f670 con 0x7f0e080bd4b0 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.320+0000 7f0dfffff700 1 -- 172.21.15.27:0/2872568345 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400fa10 con 0x7f0e080bd4b0 2023-05-17T15:08:02.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 -- 172.21.15.27:0/2872568345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080bd4b0 msgr2=0x7f0e080bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 --2- 172.21.15.27:0/2872568345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080bd4b0 0x7f0e080bd890 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f0e080c7fb0 tx=0x7f0e040090f0).stop 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 -- 172.21.15.27:0/2872568345 shutdown_connections 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 --2- 172.21.15.27:0/2872568345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080bd4b0 0x7f0e080bd890 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 --2- 172.21.15.27:0/2872568345 >> v2:172.21.15.40:3300/0 conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 --2- 172.21.15.27:0/2872568345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080c7610 0x7f0e080c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 -- 172.21.15.27:0/2872568345 >> 172.21.15.27:0/2872568345 conn(0x7f0e08068780 msgr2=0x7f0e080c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 -- 172.21.15.27:0/2872568345 shutdown_connections 2023-05-17T15:08:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.321+0000 7f0e0e505700 1 -- 172.21.15.27:0/2872568345 wait complete. 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.322+0000 7f0e0e505700 1 Processor -- start 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.322+0000 7f0e0e505700 1 -- start start 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0e505700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080bd4b0 0x7f0e0814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0e505700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 0x7f0e080ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0e505700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0e505700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0814cf60 con 0x7f0e080c7610 2023-05-17T15:08:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0e505700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080bfd40 con 0x7f0e081506c0 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0e505700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080acec0 con 0x7f0e080bd4b0 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 0x7f0e080ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 0x7f0e080ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37832/0 (socket says 172.21.15.27:37832) 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 -- 172.21.15.27:0/1683014071 learned_addr learned my addr 172.21.15.27:0/1683014071 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0d503700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080bd4b0 0x7f0e0814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0dd04700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 -- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080bd4b0 msgr2=0x7f0e0814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080bd4b0 0x7f0e0814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 -- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e081506c0 msgr2=0x7f0e08150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.323+0000 7f0e0cd02700 1 -- 172.21.15.27:0/1683014071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009370 con 0x7f0e080c7610 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.324+0000 7f0e0cd02700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 0x7f0e080ac9d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f0df800e980 tx=0x7f0df8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.324+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8012600 con 0x7f0e080c7610 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.324+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8012760 con 0x7f0e080c7610 2023-05-17T15:08:02.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.324+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e08151040 con 0x7f0e080c7610 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.324+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8012ae0 con 0x7f0e080c7610 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.324+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e080bf410 con 0x7f0e080c7610 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.325+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e080bfef0 con 0x7f0e080c7610 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.325+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f0df8022070 con 0x7f0e080c7610 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.325+0000 7f0dfd7fa700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0dec05ee70 0x7f0dec061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.325+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6539+0+0 (secure 0 0 0) 0x7f0df807a130 con 0x7f0e080c7610 2023-05-17T15:08:02.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.325+0000 7f0e0d503700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0dec05ee70 0x7f0dec061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.326+0000 7f0e0d503700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0dec05ee70 0x7f0dec061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0e080c7fb0 tx=0x7f0e04017000).ready entity=mgr.5925 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.330+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e080bfef0 con 0x7f0e080c7610 2023-05-17T15:08:02.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.551+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0e080bfef0 con 0x7f0e080c7610 2023-05-17T15:08:02.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.742+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f0df8077e70 con 0x7f0e080c7610 2023-05-17T15:08:02.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.744+0000 7f0dfd7fa700 1 -- 172.21.15.27:0/1683014071 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0df8070720 con 0x7f0e080c7610 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0dec05ee70 msgr2=0x7f0dec061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0dec05ee70 0x7f0dec061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0e080c7fb0 tx=0x7f0e04017000).stop 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 msgr2=0x7f0e080ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 0x7f0e080ac9d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f0df800e980 tx=0x7f0df8009060).stop 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 shutdown_connections 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f0dec05ee70 0x7f0dec061330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e081506c0 0x7f0e08150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e080bd4b0 0x7f0e0814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 --2- 172.21.15.27:0/1683014071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e080c7610 0x7f0e080ac9d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:02.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 >> 172.21.15.27:0/1683014071 conn(0x7f0e08068780 msgr2=0x7f0e080c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:02.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 shutdown_connections 2023-05-17T15:08:02.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:02.746+0000 7f0e0e505700 1 -- 172.21.15.27:0/1683014071 wait complete. 2023-05-17T15:08:02.762 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:08:02.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:02.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:02.822 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:08:02.822 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:08:02.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:02.823 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:08:02.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:08:02.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:02.868 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:08:02.889 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:02.886+0000 7f84c444d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:08:02.896 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:02.893+0000 7fa50719e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:08:02.903 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:02.955 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:02.952+0000 7f84c444d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:08:02.961 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:02.958+0000 7fa50719e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:08:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.058+0000 7f450eb98700 1 Processor -- start 2023-05-17T15:08:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.058+0000 7f450eb98700 1 -- start start 2023-05-17T15:08:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450eb98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080c60c0 0x7f45080c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450eb98700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45080a9f70 0x7f4508153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450eb98700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45080aa3b0 0x7f4508154260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450eb98700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4508154750 con 0x7f45080a9f70 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450eb98700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450805e7e0 con 0x7f45080aa3b0 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450eb98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450805eac0 con 0x7f45080c60c0 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f4507fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45080a9f70 0x7f4508153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f4507fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45080a9f70 0x7f4508153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37890/0 (socket says 172.21.15.27:37890) 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f4507fff700 1 -- 172.21.15.27:0/2149084423 learned_addr learned my addr 172.21.15.27:0/2149084423 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:03.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450d135700 1 --2- 172.21.15.27:0/2149084423 >> v2:172.21.15.40:3300/0 conn(0x7f45080aa3b0 0x7f4508154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f450c934700 1 --2- 172.21.15.27:0/2149084423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080c60c0 0x7f45080c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f4507fff700 1 -- 172.21.15.27:0/2149084423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080c60c0 msgr2=0x7f45080c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.059+0000 7f4507fff700 1 --2- 172.21.15.27:0/2149084423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080c60c0 0x7f45080c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f4507fff700 1 -- 172.21.15.27:0/2149084423 >> v2:172.21.15.40:3300/0 conn(0x7f45080aa3b0 msgr2=0x7f4508154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f4507fff700 1 --2- 172.21.15.27:0/2149084423 >> v2:172.21.15.40:3300/0 conn(0x7f45080aa3b0 0x7f4508154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f4507fff700 1 -- 172.21.15.27:0/2149084423 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080bfd70 con 0x7f45080a9f70 2023-05-17T15:08:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f4507fff700 1 --2- 172.21.15.27:0/2149084423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080a9f70 0x7f4508153d70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f45080841a0 tx=0x7f44f40090f0).ready entity=mon.0 client_cookie=cdde5ee44cd8fa5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f45077fe700 1 -- 172.21.15.27:0/2149084423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f510 con 0x7f45080a9f70 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f45077fe700 1 -- 172.21.15.27:0/2149084423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400f670 con 0x7f45080a9f70 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f45077fe700 1 -- 172.21.15.27:0/2149084423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f9f0 con 0x7f45080a9f70 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 -- 172.21.15.27:0/2149084423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080a9f70 msgr2=0x7f4508153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 --2- 172.21.15.27:0/2149084423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080a9f70 0x7f4508153d70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f45080841a0 tx=0x7f44f40090f0).stop 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 -- 172.21.15.27:0/2149084423 shutdown_connections 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 --2- 172.21.15.27:0/2149084423 >> v2:172.21.15.40:3300/0 conn(0x7f45080aa3b0 0x7f4508154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 --2- 172.21.15.27:0/2149084423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080c60c0 0x7f45080c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 --2- 172.21.15.27:0/2149084423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080a9f70 0x7f4508153d70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 -- 172.21.15.27:0/2149084423 >> 172.21.15.27:0/2149084423 conn(0x7f4508069e70 msgr2=0x7f450805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 -- 172.21.15.27:0/2149084423 shutdown_connections 2023-05-17T15:08:03.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.060+0000 7f450eb98700 1 -- 172.21.15.27:0/2149084423 wait complete. 2023-05-17T15:08:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.061+0000 7f450eb98700 1 Processor -- start 2023-05-17T15:08:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 -- start start 2023-05-17T15:08:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080a9f70 0x7f450814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 0x7f45080cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45080c60c0 0x7f45080cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080cb9f0 con 0x7f45080aa3b0 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450814b280 con 0x7f45080c60c0 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f450eb98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450814f8c0 con 0x7f45080a9f70 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.062+0000 7f4507fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 0x7f45080cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 0x7f45080cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37894/0 (socket says 172.21.15.27:37894) 2023-05-17T15:08:03.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f450c934700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080a9f70 0x7f450814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 -- 172.21.15.27:0/1740819567 learned_addr learned my addr 172.21.15.27:0/1740819567 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f450d135700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45080c60c0 0x7f45080cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 -- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080a9f70 msgr2=0x7f450814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080a9f70 0x7f450814ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 -- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45080c60c0 msgr2=0x7f45080cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45080c60c0 0x7f45080cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 -- 172.21.15.27:0/1740819567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009370 con 0x7f45080aa3b0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f450d135700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45080c60c0 0x7f45080cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4507fff700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 0x7f45080cb010 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f44f4011000 tx=0x7f44f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f7e0 con 0x7f45080aa3b0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400f940 con 0x7f45080aa3b0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45080ca3a0 con 0x7f45080aa3b0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f401c670 con 0x7f45080aa3b0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.063+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080c9a70 con 0x7f45080aa3b0 2023-05-17T15:08:03.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.064+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f44f402c070 con 0x7f45080aa3b0 2023-05-17T15:08:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.065+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450805f4a0 con 0x7f45080aa3b0 2023-05-17T15:08:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.065+0000 7f4504ff9700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 0x7f44ec0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.065+0000 7f450c934700 1 -- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 msgr2=0x7f44ec0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.065+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6627+0+0 (secure 0 0 0) 0x7f44f407b730 con 0x7f45080aa3b0 2023-05-17T15:08:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.065+0000 7f450c934700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 0x7f44ec0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.069+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f44f404cab0 con 0x7f45080aa3b0 2023-05-17T15:08:03.246 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:03.242+0000 7fa50719e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:08:03.248 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:03.245+0000 7f84c444d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:08:03.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.266+0000 7f450c934700 1 -- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 msgr2=0x7f44ec0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:03.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.266+0000 7f450c934700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 0x7f44ec0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:03.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.290+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f450806bdf0 con 0x7f45080aa3b0 2023-05-17T15:08:03.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.290+0000 7f4504ff9700 1 -- 172.21.15.27:0/1740819567 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f44f4020090 con 0x7f45080aa3b0 2023-05-17T15:08:03.294 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:03.295 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:05:57.187691+0000","modified":"2023-05-17T15:06:00.203429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/3759557665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":3759557665},{"type":"v1","addr":"172.21.15.27:6837","nonce":3759557665}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-17T15:08:03.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 msgr2=0x7f44ec0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:03.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 0x7f44ec0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:03.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 msgr2=0x7f45080cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 0x7f45080cb010 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f44f4011000 tx=0x7f44f4017000).stop 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 shutdown_connections 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f44ec05ee20 0x7f44ec0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45080c60c0 0x7f45080cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45080a9f70 0x7f450814ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 --2- 172.21.15.27:0/1740819567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45080aa3b0 0x7f45080cb010 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 >> 172.21.15.27:0/1740819567 conn(0x7f4508069e70 msgr2=0x7f45080ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 shutdown_connections 2023-05-17T15:08:03.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.292+0000 7f450eb98700 1 -- 172.21.15.27:0/1740819567 wait complete. 2023-05-17T15:08:03.298 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2023-05-17T15:08:03.309 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.462+0000 7fb996ecf700 1 Processor -- start 2023-05-17T15:08:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.462+0000 7fb996ecf700 1 -- start start 2023-05-17T15:08:03.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb996ecf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9901376a0 0x7fb9900c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb996ecf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9900c22d0 0x7fb9901548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb996ecf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900c34a0 con 0x7fb9901372c0 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb996ecf700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb990064be0 con 0x7fb9901376a0 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb996ecf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900c2890 con 0x7fb9900c22d0 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb98ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9901376a0 0x7fb9900c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb994c6b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb9901372c0 0x7fb9900650d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37478/0 (socket says 172.21.15.27:37478) 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb98ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9901376a0 0x7fb9900c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37918/0 (socket says 172.21.15.27:37918) 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb994c6b700 1 -- 172.21.15.27:0/190837067 learned_addr learned my addr 172.21.15.27:0/190837067 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:03.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb99546c700 1 --2- 172.21.15.27:0/190837067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9900c22d0 0x7fb9901548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb98ffff700 1 -- 172.21.15.27:0/190837067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9900c22d0 msgr2=0x7fb9901548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb98ffff700 1 --2- 172.21.15.27:0/190837067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9900c22d0 0x7fb9901548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.463+0000 7fb98ffff700 1 -- 172.21.15.27:0/190837067 >> v1:172.21.15.27:6789/0 conn(0x7fb9901372c0 legacy=0x7fb9900650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb98ffff700 1 -- 172.21.15.27:0/190837067 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900c2b70 con 0x7fb9901376a0 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb98ffff700 1 --2- 172.21.15.27:0/190837067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9901376a0 0x7fb9900c3930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fb97c00ba00 tx=0x7fb97c00b300).ready entity=mon.0 client_cookie=7ccaf4996dd7091f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb98f7fe700 1 -- 172.21.15.27:0/190837067 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00da70 con 0x7fb9901376a0 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb98f7fe700 1 -- 172.21.15.27:0/190837067 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c00dbd0 con 0x7fb9901376a0 2023-05-17T15:08:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb98f7fe700 1 -- 172.21.15.27:0/190837067 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c010470 con 0x7fb9901376a0 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 -- 172.21.15.27:0/190837067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9901376a0 msgr2=0x7fb9900c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 --2- 172.21.15.27:0/190837067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9901376a0 0x7fb9900c3930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fb97c00ba00 tx=0x7fb97c00b300).stop 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 -- 172.21.15.27:0/190837067 shutdown_connections 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 --2- 172.21.15.27:0/190837067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9900c22d0 0x7fb9901548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 --2- 172.21.15.27:0/190837067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9901376a0 0x7fb9900c3930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 -- 172.21.15.27:0/190837067 >> 172.21.15.27:0/190837067 conn(0x7fb9900c8400 msgr2=0x7fb9900c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:03.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 -- 172.21.15.27:0/190837067 shutdown_connections 2023-05-17T15:08:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.464+0000 7fb996ecf700 1 -- 172.21.15.27:0/190837067 wait complete. 2023-05-17T15:08:03.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 Processor -- start 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 -- start start 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 0x7fb9901356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9901372c0 0x7fb99013a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9901376a0 0x7fb9901537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990138930 con 0x7fb9900c22d0 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990137a80 con 0x7fb9901372c0 2023-05-17T15:08:03.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.466+0000 7fb996ecf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990135bb0 con 0x7fb9901376a0 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 0x7fb9901356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 0x7fb9901356c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37922/0 (socket says 172.21.15.27:37922) 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 -- 172.21.15.27:0/1544606684 learned_addr learned my addr 172.21.15.27:0/1544606684 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb99546c700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9901376a0 0x7fb9901537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb98ffff700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9901372c0 0x7fb99013a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 -- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9901376a0 msgr2=0x7fb9901537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9901376a0 0x7fb9901537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 -- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9901372c0 msgr2=0x7fb99013a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9901372c0 0x7fb99013a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 -- 172.21.15.27:0/1544606684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c00b540 con 0x7fb9900c22d0 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb994c6b700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 0x7fb9901356c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fb984007fd0 tx=0x7fb984007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400ce10 con 0x7fb9900c22d0 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9840072e0 con 0x7fb9900c22d0 2023-05-17T15:08:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990137d20 con 0x7fb9900c22d0 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984007660 con 0x7fb9900c22d0 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.467+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9901382e0 con 0x7fb9900c22d0 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.468+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb990138c10 con 0x7fb9900c22d0 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.469+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb984010070 con 0x7fb9900c22d0 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.469+0000 7fb98cff9700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb97405ee20 0x7fb9740612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.469+0000 7fb98ffff700 1 -- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb97405ee20 msgr2=0x7fb9740612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.469+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6627+0+0 (secure 0 0 0) 0x7fb9840792e0 con 0x7fb9900c22d0 2023-05-17T15:08:03.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.469+0000 7fb98ffff700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb97405ee20 0x7fb9740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:03.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.473+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb98404a660 con 0x7fb9900c22d0 2023-05-17T15:08:03.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.651+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb99006bdf0 con 0x7fb9900c22d0 2023-05-17T15:08:03.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.652+0000 7fb98cff9700 1 -- 172.21.15.27:0/1544606684 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17710 (secure 0 0 0) 0x7fb98404dc80 con 0x7fb9900c22d0 2023-05-17T15:08:03.657 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:03.657 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":69,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:02.730421+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:05:55.736103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-17T15:05:56.153758+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2210631157":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/1676615034":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/4044621687":"2023-05-18T15:06:09.628667+0000","172.21.15.27:6833/86332":"2023-05-18T15:06:09.628667+0000","172.21.15.27:6832/86332":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/2758006323":"2023-05-18T15:06:09.628667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:03.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb97405ee20 msgr2=0x7fb9740612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:03.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb97405ee20 0x7fb9740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:03.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 msgr2=0x7fb9901356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 0x7fb9901356c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fb984007fd0 tx=0x7fb984007df0).stop 2023-05-17T15:08:03.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 shutdown_connections 2023-05-17T15:08:03.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fb97405ee20 0x7fb9740612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:03.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9901376a0 0x7fb9901537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9900c22d0 0x7fb9901356c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 --2- 172.21.15.27:0/1544606684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9901372c0 0x7fb99013a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 >> 172.21.15.27:0/1544606684 conn(0x7fb9900c8400 msgr2=0x7fb990151770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:03.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 shutdown_connections 2023-05-17T15:08:03.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.654+0000 7fb996ecf700 1 -- 172.21.15.27:0/1544606684 wait complete. 2023-05-17T15:08:03.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:05:55.736103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:05:56.153758+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 69, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:08:03.672 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:08:03.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.793+0000 7f97fb09d700 1 Processor -- start 2023-05-17T15:08:03.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.793+0000 7f97fb09d700 1 -- start start 2023-05-17T15:08:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97fb09d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97f41543d0 0x7f97f40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97fb09d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f4158790 con 0x7f97f4069410 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97fb09d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40c6570 con 0x7f97f40c60f0 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97fb09d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40c1c50 con 0x7f97f41543d0 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f963a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f97f4069410 0x7f97f40bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37492/0 (socket says 172.21.15.27:37492) 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f963a700 1 -- 172.21.15.27:0/2225398521 learned_addr learned my addr 172.21.15.27:0/2225398521 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f8e39700 1 --2- 172.21.15.27:0/2225398521 >> v2:172.21.15.40:3300/0 conn(0x7f97f41543d0 0x7f97f40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f37fe700 1 -- 172.21.15.27:0/2225398521 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334704571 0 0) 0x7f97f4158790 con 0x7f97f4069410 2023-05-17T15:08:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f37fe700 1 -- 172.21.15.27:0/2225398521 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e40033f0 con 0x7f97f4069410 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f8e39700 1 -- 172.21.15.27:0/2225398521 >> v1:172.21.15.40:6789/0 conn(0x7f97f40c60f0 legacy=0x7f97f4068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f8e39700 1 -- 172.21.15.27:0/2225398521 >> v1:172.21.15.27:6789/0 conn(0x7f97f4069410 legacy=0x7f97f40bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.794+0000 7f97f8e39700 1 -- 172.21.15.27:0/2225398521 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4157e60 con 0x7f97f41543d0 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97f8e39700 1 --2- 172.21.15.27:0/2225398521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f41543d0 0x7f97f40c5c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f97e8009760 tx=0x7f97e8009060).ready entity=mon.1 client_cookie=7c559332bb116d86 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97f37fe700 1 -- 172.21.15.27:0/2225398521 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800f510 con 0x7f97f41543d0 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97f37fe700 1 -- 172.21.15.27:0/2225398521 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e800f670 con 0x7f97f41543d0 2023-05-17T15:08:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97f37fe700 1 -- 172.21.15.27:0/2225398521 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800f9f0 con 0x7f97f41543d0 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 -- 172.21.15.27:0/2225398521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f41543d0 msgr2=0x7f97f40c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 --2- 172.21.15.27:0/2225398521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f41543d0 0x7f97f40c5c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f97e8009760 tx=0x7f97e8009060).stop 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 -- 172.21.15.27:0/2225398521 shutdown_connections 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 --2- 172.21.15.27:0/2225398521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f41543d0 0x7f97f40c5c00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 -- 172.21.15.27:0/2225398521 >> 172.21.15.27:0/2225398521 conn(0x7f97f40cb7f0 msgr2=0x7f97f40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 -- 172.21.15.27:0/2225398521 shutdown_connections 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.795+0000 7f97fb09d700 1 -- 172.21.15.27:0/2225398521 wait complete. 2023-05-17T15:08:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 Processor -- start 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 -- start start 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f4069410 0x7f97f40c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 0x7f97f40c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97f41543d0 0x7f97f40c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40c3470 con 0x7f97f40c60f0 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40c2860 con 0x7f97f4069410 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.797+0000 7f97fb09d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40c2b40 con 0x7f97f41543d0 2023-05-17T15:08:03.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 0x7f97f40c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 0x7f97f40c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37934/0 (socket says 172.21.15.27:37934) 2023-05-17T15:08:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 -- 172.21.15.27:0/4211955838 learned_addr learned my addr 172.21.15.27:0/4211955838 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f963a700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97f41543d0 0x7f97f40c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f8e39700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f4069410 0x7f97f40c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 -- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97f41543d0 msgr2=0x7f97f40c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97f41543d0 0x7f97f40c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 -- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f4069410 msgr2=0x7f97f40c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f4069410 0x7f97f40c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 -- 172.21.15.27:0/4211955838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80092a0 con 0x7f97f40c60f0 2023-05-17T15:08:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f3fff700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 0x7f97f40c1dc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f97e000c4c0 tx=0x7f97e0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000ce70 con 0x7f97f40c60f0 2023-05-17T15:08:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0001e90 con 0x7f97f40c60f0 2023-05-17T15:08:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f40c2e20 con 0x7f97f40c60f0 2023-05-17T15:08:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0007250 con 0x7f97f40c60f0 2023-05-17T15:08:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.798+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f40aef10 con 0x7f97f40c60f0 2023-05-17T15:08:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.799+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f40c50a0 con 0x7f97f40c60f0 2023-05-17T15:08:03.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.800+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f97e0010070 con 0x7f97f40c60f0 2023-05-17T15:08:03.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.800+0000 7f97f0ff9700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 0x7f97d80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:03.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.800+0000 7f97f8e39700 1 -- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 msgr2=0x7f97d80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:03.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.801+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f97e00794e0 con 0x7f97f40c60f0 2023-05-17T15:08:03.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.801+0000 7f97f8e39700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 0x7f97d80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:03.805+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f97e004a870 con 0x7f97f40c60f0 2023-05-17T15:08:03.909 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:03.906+0000 7fa50719e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:08:03.925 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:03.921+0000 7f84c444d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:08:03.977 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:03.973+0000 7fa50719e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:08:03.995 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:03.991+0000 7f84c444d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:08:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.002+0000 7f97f8e39700 1 -- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 msgr2=0x7f97d80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:04.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.002+0000 7f97f8e39700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 0x7f97d80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:04.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.025+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f97f406bdf0 con 0x7f97f40c60f0 2023-05-17T15:08:04.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.025+0000 7f97f0ff9700 1 -- 172.21.15.27:0/4211955838 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v70) v1 ==== 110+0+10 (secure 0 0 0) 0x7f97e004de90 con 0x7f97f40c60f0 2023-05-17T15:08:04.029 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:08:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 msgr2=0x7f97d80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 0x7f97d80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 msgr2=0x7f97f40c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 0x7f97f40c1dc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f97e000c4c0 tx=0x7f97e0007e00).stop 2023-05-17T15:08:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 shutdown_connections 2023-05-17T15:08:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f97d805ee20 0x7f97d80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97f41543d0 0x7f97f40c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f4069410 0x7f97f40c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 --2- 172.21.15.27:0/4211955838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97f40c60f0 0x7f97f40c1dc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 >> 172.21.15.27:0/4211955838 conn(0x7f97f40cb7f0 msgr2=0x7f97f40accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:04.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.027+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 shutdown_connections 2023-05-17T15:08:04.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.028+0000 7f97fb09d700 1 -- 172.21.15.27:0/4211955838 wait complete. 2023-05-17T15:08:04.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:08:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.165+0000 7f6915d9a700 1 Processor -- start 2023-05-17T15:08:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.165+0000 7f6915d9a700 1 -- start start 2023-05-17T15:08:04.170 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:04.165+0000 7fa50719e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:08:04.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915d9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 0x7f69100cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6910157980 0x7f69100c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915d9a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100c60d0 con 0x7f69100cac00 2023-05-17T15:08:04.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915d9a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69101588b0 con 0x7f6910157980 2023-05-17T15:08:04.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915d9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6910157e10 con 0x7f6910153ef0 2023-05-17T15:08:04.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915599700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6910157980 0x7f69100c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f690ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 0x7f69100cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915599700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6910157980 0x7f69100c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:55890/0 (socket says 172.21.15.27:55890) 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6915599700 1 -- 172.21.15.27:0/4103138630 learned_addr learned my addr 172.21.15.27:0/4103138630 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f690ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 0x7f69100cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:39068/0 (socket says 172.21.15.27:39068) 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.166+0000 7f6914d98700 1 --1- 172.21.15.27:0/4103138630 >> v1:172.21.15.40:6789/0 conn(0x7f69100cac00 0x7f69101537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:43520/0 (socket says 172.21.15.27:43520) 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915599700 1 -- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 msgr2=0x7f69100cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915599700 1 --2- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 0x7f69100cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915599700 1 -- 172.21.15.27:0/4103138630 >> v1:172.21.15.40:6789/0 conn(0x7f69100cac00 legacy=0x7f69101537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f690f7fe700 1 -- 172.21.15.27:0/4103138630 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632890326 0 0) 0x7f69100c60d0 con 0x7f69100cac00 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915599700 1 -- 172.21.15.27:0/4103138630 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910158010 con 0x7f6910157980 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f690ffff700 1 --2- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 0x7f69100cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915599700 1 --2- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c5be0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f6908009f80 tx=0x7f6908009840).ready entity=mon.1 client_cookie=c8421d29b80c0866 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f690f7fe700 1 -- 172.21.15.27:0/4103138630 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800e070 con 0x7f6910157980 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f690f7fe700 1 -- 172.21.15.27:0/4103138630 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800ba00 con 0x7f6910157980 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f690f7fe700 1 -- 172.21.15.27:0/4103138630 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800bd80 con 0x7f6910157980 2023-05-17T15:08:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 -- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 msgr2=0x7f69100c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 --2- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c5be0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f6908009f80 tx=0x7f6908009840).stop 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 -- 172.21.15.27:0/4103138630 shutdown_connections 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 --2- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c5be0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 --2- 172.21.15.27:0/4103138630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6910153ef0 0x7f69100cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 -- 172.21.15.27:0/4103138630 >> 172.21.15.27:0/4103138630 conn(0x7f691005dd50 msgr2=0x7f691005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 -- 172.21.15.27:0/4103138630 shutdown_connections 2023-05-17T15:08:04.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.167+0000 7f6915d9a700 1 -- 172.21.15.27:0/4103138630 wait complete. 2023-05-17T15:08:04.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 Processor -- start 2023-05-17T15:08:04.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 -- start start 2023-05-17T15:08:04.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 0x7f69100ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6910153ef0 0x7f6910154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6910141dc0 con 0x7f6910153ef0 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69101417e0 con 0x7f6910157980 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.169+0000 7f6915d9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69101572e0 con 0x7f69100cac00 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 0x7f69100ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 0x7f69100ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:39072/0 (socket says 172.21.15.27:39072) 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6915599700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 -- 172.21.15.27:0/2572593921 learned_addr learned my addr 172.21.15.27:0/2572593921 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:04.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f690ffff700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6910153ef0 0x7f6910154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 -- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 msgr2=0x7f69100c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 -- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6910153ef0 msgr2=0x7f6910154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6910153ef0 0x7f6910154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 -- 172.21.15.27:0/2572593921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0092a0 con 0x7f69100cac00 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6914d98700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 0x7f69100ca530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f690400c560 tx=0x7f6904007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:04.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040072e0 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904007440 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6908009ae0 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040058f0 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.170+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6910156fd0 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.171+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6910047150 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.172+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f690401a060 con 0x7f69100cac00 2023-05-17T15:08:04.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.172+0000 7f690cff9700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68f405edf0 0x7f68f40612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.172+0000 7f690ffff700 1 -- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68f405edf0 msgr2=0x7f68f40612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:04.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.172+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f6904079490 con 0x7f69100cac00 2023-05-17T15:08:04.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.172+0000 7f690ffff700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68f405edf0 0x7f68f40612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:04.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.176+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f690404a820 con 0x7f69100cac00 2023-05-17T15:08:04.194 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:04.191+0000 7f84c444d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:08:04.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.352+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69100c63b0 con 0x7f69100cac00 2023-05-17T15:08:04.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.353+0000 7f690cff9700 1 -- 172.21.15.27:0/2572593921 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6904018020 con 0x7f69100cac00 2023-05-17T15:08:04.357 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:08:04.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68f405edf0 msgr2=0x7f68f40612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:04.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68f405edf0 0x7f68f40612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:04.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 msgr2=0x7f69100ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 0x7f69100ca530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f690400c560 tx=0x7f6904007c90).stop 2023-05-17T15:08:04.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 shutdown_connections 2023-05-17T15:08:04.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f68f405edf0 0x7f68f40612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:04.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6910157980 0x7f69100c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69100cac00 0x7f69100ca530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 --2- 172.21.15.27:0/2572593921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6910153ef0 0x7f6910154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 >> 172.21.15.27:0/2572593921 conn(0x7f691005dd50 msgr2=0x7f691014e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:04.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 shutdown_connections 2023-05-17T15:08:04.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.356+0000 7f6915d9a700 1 -- 172.21.15.27:0/2572593921 wait complete. 2023-05-17T15:08:04.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:08:04.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.496+0000 7fc72672f700 1 Processor -- start 2023-05-17T15:08:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.497+0000 7fc72672f700 1 -- start start 2023-05-17T15:08:04.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.497+0000 7fc72672f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc7200cac00 0x7fc7200cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.497+0000 7fc72672f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc720157980 0x7fc7200c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.497+0000 7fc72672f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7200c60d0 con 0x7fc7201537e0 2023-05-17T15:08:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72672f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7201588b0 con 0x7fc7200cac00 2023-05-17T15:08:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72672f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc720157e00 con 0x7fc720157980 2023-05-17T15:08:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72572d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc7200cac00 0x7fc7200cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc725f2e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc7201537e0 0x7fc720153c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37536/0 (socket says 172.21.15.27:37536) 2023-05-17T15:08:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc725f2e700 1 -- 172.21.15.27:0/4122534127 learned_addr learned my addr 172.21.15.27:0/4122534127 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc724f2c700 1 --2- 172.21.15.27:0/4122534127 >> v2:172.21.15.40:3300/0 conn(0x7fc720157980 0x7fc7200c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc717fff700 1 -- 172.21.15.27:0/4122534127 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682314663 0 0) 0x7fc7200c60d0 con 0x7fc7201537e0 2023-05-17T15:08:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc717fff700 1 -- 172.21.15.27:0/4122534127 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c0033f0 con 0x7fc7201537e0 2023-05-17T15:08:04.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72572d700 1 -- 172.21.15.27:0/4122534127 >> v2:172.21.15.40:3300/0 conn(0x7fc720157980 msgr2=0x7fc7200c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:04.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72572d700 1 --2- 172.21.15.27:0/4122534127 >> v2:172.21.15.40:3300/0 conn(0x7fc720157980 0x7fc7200c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72572d700 1 -- 172.21.15.27:0/4122534127 >> v1:172.21.15.27:6789/0 conn(0x7fc7201537e0 legacy=0x7fc720153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72572d700 1 -- 172.21.15.27:0/4122534127 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720158010 con 0x7fc7200cac00 2023-05-17T15:08:04.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc72572d700 1 --2- 172.21.15.27:0/4122534127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7200cac00 0x7fc7200cafe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fc72005ec40 tx=0x7fc71c009060).ready entity=mon.0 client_cookie=6ce0b1eef4027403 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:04.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc717fff700 1 -- 172.21.15.27:0/4122534127 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00d4a0 con 0x7fc7200cac00 2023-05-17T15:08:04.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc717fff700 1 -- 172.21.15.27:0/4122534127 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c00d600 con 0x7fc7200cac00 2023-05-17T15:08:04.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.498+0000 7fc717fff700 1 -- 172.21.15.27:0/4122534127 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00d980 con 0x7fc7200cac00 2023-05-17T15:08:04.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 -- 172.21.15.27:0/4122534127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7200cac00 msgr2=0x7fc7200cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 --2- 172.21.15.27:0/4122534127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7200cac00 0x7fc7200cafe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fc72005ec40 tx=0x7fc71c009060).stop 2023-05-17T15:08:04.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 -- 172.21.15.27:0/4122534127 shutdown_connections 2023-05-17T15:08:04.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 --2- 172.21.15.27:0/4122534127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7200cac00 0x7fc7200cafe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 --2- 172.21.15.27:0/4122534127 >> v2:172.21.15.40:3300/0 conn(0x7fc720157980 0x7fc7200c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 -- 172.21.15.27:0/4122534127 >> 172.21.15.27:0/4122534127 conn(0x7fc72005dd50 msgr2=0x7fc72005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:04.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 -- 172.21.15.27:0/4122534127 shutdown_connections 2023-05-17T15:08:04.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.499+0000 7fc72672f700 1 -- 172.21.15.27:0/4122534127 wait complete. 2023-05-17T15:08:04.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.500+0000 7fc72672f700 1 Processor -- start 2023-05-17T15:08:04.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.500+0000 7fc72672f700 1 -- start start 2023-05-17T15:08:04.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72672f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7200cac00 0x7fc720154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72672f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7201537e0 0x7fc720156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72672f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 0x7fc720151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72672f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7201573d0 con 0x7fc720157980 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72672f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7201556b0 con 0x7fc7200cac00 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72672f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc720152490 con 0x7fc7201537e0 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc725f2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 0x7fc720151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc725f2e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 0x7fc720151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37980/0 (socket says 172.21.15.27:37980) 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc725f2e700 1 -- 172.21.15.27:0/2201254626 learned_addr learned my addr 172.21.15.27:0/2201254626 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc72572d700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7200cac00 0x7fc720154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.501+0000 7fc724f2c700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7201537e0 0x7fc720156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc725f2e700 1 -- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7201537e0 msgr2=0x7fc720156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc725f2e700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7201537e0 0x7fc720156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc725f2e700 1 -- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7200cac00 msgr2=0x7fc720154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc725f2e700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7200cac00 0x7fc720154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc725f2e700 1 -- 172.21.15.27:0/2201254626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0092a0 con 0x7fc720157980 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc725f2e700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 0x7fc720151fa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fc718005ad0 tx=0x7fc718001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:04.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718005d30 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc718005e90 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718007320 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc720154aa0 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.502+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc720155060 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.503+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc720155860 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.504+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc718010030 con 0x7fc720157980 2023-05-17T15:08:04.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.504+0000 7fc7157fa700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc70405ee20 0x7fc7040612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.504+0000 7fc72572d700 1 -- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc70405ee20 msgr2=0x7fc7040612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:04.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.504+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7fc718079be0 con 0x7fc720157980 2023-05-17T15:08:04.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.504+0000 7fc72572d700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc70405ee20 0x7fc7040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:04.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.508+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc720155860 con 0x7fc720157980 2023-05-17T15:08:04.608 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:04.605+0000 7fa50719e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:08:04.651 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:04.647+0000 7f84c444d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:08:04.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.682+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc720155820 con 0x7fc720157980 2023-05-17T15:08:04.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.682+0000 7fc7157fa700 1 -- 172.21.15.27:0/2201254626 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc71804af70 con 0x7fc720157980 2023-05-17T15:08:04.687 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:08:04.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc70405ee20 msgr2=0x7fc7040612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:04.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc70405ee20 0x7fc7040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:04.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 msgr2=0x7fc720151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 0x7fc720151fa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fc718005ad0 tx=0x7fc718001650).stop 2023-05-17T15:08:04.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 shutdown_connections 2023-05-17T15:08:04.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fc70405ee20 0x7fc7040612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:04.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc720157980 0x7fc720151fa0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7200cac00 0x7fc720154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 --2- 172.21.15.27:0/2201254626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7201537e0 0x7fc720156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 >> 172.21.15.27:0/2201254626 conn(0x7fc72005dd50 msgr2=0x7fc720152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:04.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 shutdown_connections 2023-05-17T15:08:04.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.684+0000 7fc72672f700 1 -- 172.21.15.27:0/2201254626 wait complete. 2023-05-17T15:08:04.700 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:08:04.717 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:04.714+0000 7fa50719e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:04.764 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:04.761+0000 7f84c444d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:04.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.821+0000 7f4441d9a700 1 Processor -- start 2023-05-17T15:08:04.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.821+0000 7f4441d9a700 1 -- start start 2023-05-17T15:08:04.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f4441d9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c153d30 0x7f443c0bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f4441d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f443c155220 0x7f443c154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f4441d9a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0c6140 con 0x7f443c0c5c90 2023-05-17T15:08:04.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f4441d9a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0c63e0 con 0x7f443c155220 2023-05-17T15:08:04.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f4441d9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c66c0 con 0x7f443c153d30 2023-05-17T15:08:04.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f443c0c5c90 0x7f443c0c7780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37548/0 (socket says 172.21.15.27:37548) 2023-05-17T15:08:04.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443bfff700 1 -- 172.21.15.27:0/1623387992 learned_addr learned my addr 172.21.15.27:0/1623387992 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:04.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443b7fe700 1 --2- 172.21.15.27:0/1623387992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c153d30 0x7f443c0bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443affd700 1 --2- 172.21.15.27:0/1623387992 >> v2:172.21.15.40:3300/0 conn(0x7f443c155220 0x7f443c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443a7fc700 1 -- 172.21.15.27:0/1623387992 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351209227 0 0) 0x7f443c0c6140 con 0x7f443c0c5c90 2023-05-17T15:08:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443b7fe700 1 -- 172.21.15.27:0/1623387992 >> v2:172.21.15.40:3300/0 conn(0x7f443c155220 msgr2=0x7f443c154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443b7fe700 1 --2- 172.21.15.27:0/1623387992 >> v2:172.21.15.40:3300/0 conn(0x7f443c155220 0x7f443c154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443b7fe700 1 -- 172.21.15.27:0/1623387992 >> v1:172.21.15.27:6789/0 conn(0x7f443c0c5c90 legacy=0x7f443c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.822+0000 7f443b7fe700 1 -- 172.21.15.27:0/1623387992 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c154740 con 0x7f443c153d30 2023-05-17T15:08:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f443b7fe700 1 --2- 172.21.15.27:0/1623387992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c153d30 0x7f443c0bfdd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f442c009760 tx=0x7f442c009060).ready entity=mon.2 client_cookie=4b8c5f4eab5a0c48 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f443a7fc700 1 -- 172.21.15.27:0/1623387992 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00f510 con 0x7f443c153d30 2023-05-17T15:08:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f443a7fc700 1 -- 172.21.15.27:0/1623387992 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00f670 con 0x7f443c153d30 2023-05-17T15:08:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f443a7fc700 1 -- 172.21.15.27:0/1623387992 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00f9f0 con 0x7f443c153d30 2023-05-17T15:08:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f4441d9a700 1 -- 172.21.15.27:0/1623387992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c153d30 msgr2=0x7f443c0bfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f4441d9a700 1 --2- 172.21.15.27:0/1623387992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c153d30 0x7f443c0bfdd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f442c009760 tx=0x7f442c009060).stop 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f4441d9a700 1 -- 172.21.15.27:0/1623387992 shutdown_connections 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f4441d9a700 1 --2- 172.21.15.27:0/1623387992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c153d30 0x7f443c0bfdd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f4441d9a700 1 --2- 172.21.15.27:0/1623387992 >> v2:172.21.15.40:3300/0 conn(0x7f443c155220 0x7f443c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.823+0000 7f4441d9a700 1 -- 172.21.15.27:0/1623387992 >> 172.21.15.27:0/1623387992 conn(0x7f443c05dd50 msgr2=0x7f443c05e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.824+0000 7f4441d9a700 1 -- 172.21.15.27:0/1623387992 shutdown_connections 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.824+0000 7f4441d9a700 1 -- 172.21.15.27:0/1623387992 wait complete. 2023-05-17T15:08:04.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.825+0000 7f4441d9a700 1 Processor -- start 2023-05-17T15:08:04.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.825+0000 7f4441d9a700 1 -- start start 2023-05-17T15:08:04.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f4441d9a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 0x7f443c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f4441d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c153d30 0x7f443c14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f4441d9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c155220 0x7f443c0c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f4441d9a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c1567c0 con 0x7f443c0c5c90 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f4441d9a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c25e0 con 0x7f443c153d30 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f4441d9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c14f0e0 con 0x7f443c155220 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 0x7f443c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 0x7f443c1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37990/0 (socket says 172.21.15.27:37990) 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f443b7fe700 1 -- 172.21.15.27:0/448987498 learned_addr learned my addr 172.21.15.27:0/448987498 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:04.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f443affd700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c153d30 0x7f443c14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.826+0000 7f443bfff700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c155220 0x7f443c0c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f443b7fe700 1 -- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c155220 msgr2=0x7f443c0c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f443b7fe700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c155220 0x7f443c0c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f443b7fe700 1 -- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c153d30 msgr2=0x7f443c14ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f443b7fe700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c153d30 0x7f443c14ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f443b7fe700 1 -- 172.21.15.27:0/448987498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0092a0 con 0x7f443c0c5c90 2023-05-17T15:08:04.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f443b7fe700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 0x7f443c1590f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f442c009e00 tx=0x7f442c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00f7e0 con 0x7f443c0c5c90 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00f940 con 0x7f443c0c5c90 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0c39f0 con 0x7f443c0c5c90 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c01b660 con 0x7f443c0c5c90 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.827+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c0c1f90 con 0x7f443c0c5c90 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.828+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c06bdf0 con 0x7f443c0c5c90 2023-05-17T15:08:04.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.828+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f442c00f070 con 0x7f443c0c5c90 2023-05-17T15:08:04.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.829+0000 7f44237fe700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f442805ee20 0x7f44280612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:04.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.829+0000 7f443affd700 1 -- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f442805ee20 msgr2=0x7f44280612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:04.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.829+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f442c07b5e0 con 0x7f443c0c5c90 2023-05-17T15:08:04.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.829+0000 7f443affd700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f442805ee20 0x7f44280612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:04.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:04.833+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f442c04c970 con 0x7f443c0c5c90 2023-05-17T15:08:04.877 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:04.873+0000 7fa50719e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:04.926 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:04.922+0000 7f84c444d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:04.954 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:04.951+0000 7fa50719e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:08:05.004 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:05.000+0000 7f84c444d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:08:05.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.007+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f443c154a20 con 0x7f443c0c5c90 2023-05-17T15:08:05.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.007+0000 7f44237fe700 1 -- 172.21.15.27:0/448987498 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7f442c006b30 con 0x7f443c0c5c90 2023-05-17T15:08:05.011 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:08:05.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f442805ee20 msgr2=0x7f44280612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:05.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f442805ee20 0x7f44280612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:05.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 msgr2=0x7f443c1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 0x7f443c1590f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f442c009e00 tx=0x7f442c017000).stop 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 shutdown_connections 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f442805ee20 0x7f44280612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c155220 0x7f443c0c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443c0c5c90 0x7f443c1590f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 --2- 172.21.15.27:0/448987498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c153d30 0x7f443c14ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 >> 172.21.15.27:0/448987498 conn(0x7f443c05dd50 msgr2=0x7f443c0c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:05.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 shutdown_connections 2023-05-17T15:08:05.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.009+0000 7f4441d9a700 1 -- 172.21.15.27:0/448987498 wait complete. 2023-05-17T15:08:05.023 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:05.020+0000 7fa50719e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:08:05.025 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:05.076 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:05.072+0000 7f84c444d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:08:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.140+0000 7f8507d7b700 1 Processor -- start 2023-05-17T15:08:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.140+0000 7f8507d7b700 1 -- start start 2023-05-17T15:08:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.141+0000 7f8507d7b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8500154c40 0x7f85000aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.141+0000 7f8507d7b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000c3190 con 0x7f8500155730 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.141+0000 7f8507d7b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000c19f0 con 0x7f85000bdc90 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.141+0000 7f8507d7b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000c1cd0 con 0x7f8500154c40 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.141+0000 7f8506318700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8500155730 0x7f85001508f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37564/0 (socket says 172.21.15.27:37564) 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.141+0000 7f8506318700 1 -- 172.21.15.27:0/2667615168 learned_addr learned my addr 172.21.15.27:0/2667615168 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8505b17700 1 --2- 172.21.15.27:0/2667615168 >> v2:172.21.15.40:3300/0 conn(0x7f8500154c40 0x7f85000aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8504b15700 1 -- 172.21.15.27:0/2667615168 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426816450 0 0) 0x7f85000c3190 con 0x7f8500155730 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8504b15700 1 -- 172.21.15.27:0/2667615168 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ec0033f0 con 0x7f8500155730 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8505b17700 1 -- 172.21.15.27:0/2667615168 >> v1:172.21.15.40:6789/0 conn(0x7f85000bdc90 legacy=0x7f8500155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8505b17700 1 -- 172.21.15.27:0/2667615168 >> v1:172.21.15.27:6789/0 conn(0x7f8500155730 legacy=0x7f85001508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8504b15700 1 -- 172.21.15.27:0/2667615168 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450862208 0 0) 0x7f84ec0033f0 con 0x7f8500155730 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8505b17700 1 -- 172.21.15.27:0/2667615168 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000c3430 con 0x7f8500154c40 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8505b17700 1 --2- 172.21.15.27:0/2667615168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500154c40 0x7f85000aa120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f84fc009760 tx=0x7f84fc009060).ready entity=mon.1 client_cookie=ad9678fb2d6a28cd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8504b15700 1 -- 172.21.15.27:0/2667615168 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80017f0 con 0x7f8500154c40 2023-05-17T15:08:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8504b15700 1 -- 172.21.15.27:0/2667615168 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc011400 con 0x7f8500154c40 2023-05-17T15:08:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.142+0000 7f8504b15700 1 -- 172.21.15.27:0/2667615168 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc011780 con 0x7f8500154c40 2023-05-17T15:08:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 -- 172.21.15.27:0/2667615168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500154c40 msgr2=0x7f85000aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 --2- 172.21.15.27:0/2667615168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500154c40 0x7f85000aa120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f84fc009760 tx=0x7f84fc009060).stop 2023-05-17T15:08:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 -- 172.21.15.27:0/2667615168 shutdown_connections 2023-05-17T15:08:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 --2- 172.21.15.27:0/2667615168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500154c40 0x7f85000aa120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 -- 172.21.15.27:0/2667615168 >> 172.21.15.27:0/2667615168 conn(0x7f8500068750 msgr2=0x7f85000c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 -- 172.21.15.27:0/2667615168 shutdown_connections 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.143+0000 7f8507d7b700 1 -- 172.21.15.27:0/2667615168 wait complete. 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.144+0000 7f8507d7b700 1 Processor -- start 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.144+0000 7f8507d7b700 1 -- start start 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8507d7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85000bdc90 0x7f85000c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8507d7b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 0x7f85000bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8507d7b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500155730 0x7f850013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8507d7b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500063d10 con 0x7f8500154c40 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8507d7b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850013e810 con 0x7f8500155730 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8507d7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000a6bf0 con 0x7f85000bdc90 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 0x7f85000bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 0x7f85000bf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38006/0 (socket says 172.21.15.27:38006) 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 -- 172.21.15.27:0/4145766970 learned_addr learned my addr 172.21.15.27:0/4145766970 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8506318700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500155730 0x7f850013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505b17700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85000bdc90 0x7f85000c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 -- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85000bdc90 msgr2=0x7f85000c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85000bdc90 0x7f85000c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 -- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500155730 msgr2=0x7f850013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500155730 0x7f850013db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 -- 172.21.15.27:0/4145766970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0092a0 con 0x7f8500154c40 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.145+0000 7f8505316700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 0x7f85000bf2c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f84f400c4c0 tx=0x7f84f4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.146+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400ce10 con 0x7f8500154c40 2023-05-17T15:08:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.146+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4007020 con 0x7f8500154c40 2023-05-17T15:08:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.146+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000a6ed0 con 0x7f8500154c40 2023-05-17T15:08:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.146+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40073c0 con 0x7f8500154c40 2023-05-17T15:08:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.146+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85000bfdf0 con 0x7f8500154c40 2023-05-17T15:08:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.147+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85000a7060 con 0x7f8500154c40 2023-05-17T15:08:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.147+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f84f4010070 con 0x7f8500154c40 2023-05-17T15:08:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.148+0000 7f84f1ffb700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 0x7f84e40612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.148+0000 7f8505b17700 1 -- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 msgr2=0x7f84e40612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.148+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f84f4078ed0 con 0x7f8500154c40 2023-05-17T15:08:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.148+0000 7f8505b17700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 0x7f84e40612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:05.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.152+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84f40478f0 con 0x7f8500154c40 2023-05-17T15:08:05.295 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:05.291+0000 7fa50719e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:08:05.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.349+0000 7f8505b17700 1 -- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 msgr2=0x7f84e40612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.349+0000 7f8505b17700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 0x7f84e40612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:05.355 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:05.351+0000 7f84c444d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:08:05.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.370+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85000c3710 con 0x7f8500154c40 2023-05-17T15:08:05.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.370+0000 7f84f1ffb700 1 -- 172.21.15.27:0/4145766970 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f84f404a260 con 0x7f8500154c40 2023-05-17T15:08:05.374 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:05.375 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:05:57.187691+0000","modified":"2023-05-17T15:06:00.203429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/3759557665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":3759557665},{"type":"v1","addr":"172.21.15.27:6837","nonce":3759557665}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-17T15:08:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.372+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 msgr2=0x7f84e40612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.372+0000 7f8507d7b700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 0x7f84e40612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.372+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 msgr2=0x7f85000bf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.372+0000 7f8507d7b700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 0x7f85000bf2c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f84f400c4c0 tx=0x7f84f4007dd0).stop 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 shutdown_connections 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f84e405edf0 0x7f84e40612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8500155730 0x7f850013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85000bdc90 0x7f85000c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 --2- 172.21.15.27:0/4145766970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8500154c40 0x7f85000bf2c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 >> 172.21.15.27:0/4145766970 conn(0x7f8500068750 msgr2=0x7f8500155020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 shutdown_connections 2023-05-17T15:08:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.373+0000 7f8507d7b700 1 -- 172.21.15.27:0/4145766970 wait complete. 2023-05-17T15:08:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2023-05-17T15:08:05.389 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:05.482 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:05.479+0000 7fa50719e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:05.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.506+0000 7faf78d79700 1 Processor -- start 2023-05-17T15:08:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.506+0000 7faf78d79700 1 -- start start 2023-05-17T15:08:05.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf78d79700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf740c6310 0x7faf74153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf78d79700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf741541c0 0x7faf740c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf78d79700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf740bfcd0 con 0x7faf740c5f30 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf78d79700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740c0290 con 0x7faf741541c0 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf78d79700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740aa1a0 con 0x7faf740c6310 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf72d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf741541c0 0x7faf740c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf7259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faf740c5f30 0x7faf74158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37576/0 (socket says 172.21.15.27:37576) 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf7259c700 1 -- 172.21.15.27:0/1265932832 learned_addr learned my addr 172.21.15.27:0/1265932832 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf6bfff700 1 --2- 172.21.15.27:0/1265932832 >> v2:172.21.15.40:3300/0 conn(0x7faf740c6310 0x7faf74153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf71d9b700 1 -- 172.21.15.27:0/1265932832 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334990777 0 0) 0x7faf740bfcd0 con 0x7faf740c5f30 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf72d9d700 1 -- 172.21.15.27:0/1265932832 >> v2:172.21.15.40:3300/0 conn(0x7faf740c6310 msgr2=0x7faf74153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf72d9d700 1 --2- 172.21.15.27:0/1265932832 >> v2:172.21.15.40:3300/0 conn(0x7faf740c6310 0x7faf74153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf72d9d700 1 -- 172.21.15.27:0/1265932832 >> v1:172.21.15.27:6789/0 conn(0x7faf740c5f30 legacy=0x7faf74158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf72d9d700 1 -- 172.21.15.27:0/1265932832 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740aa480 con 0x7faf741541c0 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.507+0000 7faf72d9d700 1 --2- 172.21.15.27:0/1265932832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf741541c0 0x7faf740c0720 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7faf740c57b0 tx=0x7faf6c009780).ready entity=mon.0 client_cookie=1dceb5ede4d9c106 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf71d9b700 1 -- 172.21.15.27:0/1265932832 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00e070 con 0x7faf741541c0 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf71d9b700 1 -- 172.21.15.27:0/1265932832 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c00bb60 con 0x7faf741541c0 2023-05-17T15:08:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf71d9b700 1 -- 172.21.15.27:0/1265932832 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c012410 con 0x7faf741541c0 2023-05-17T15:08:05.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 -- 172.21.15.27:0/1265932832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf741541c0 msgr2=0x7faf740c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 --2- 172.21.15.27:0/1265932832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf741541c0 0x7faf740c0720 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7faf740c57b0 tx=0x7faf6c009780).stop 2023-05-17T15:08:05.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 -- 172.21.15.27:0/1265932832 shutdown_connections 2023-05-17T15:08:05.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 --2- 172.21.15.27:0/1265932832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf741541c0 0x7faf740c0720 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 --2- 172.21.15.27:0/1265932832 >> v2:172.21.15.40:3300/0 conn(0x7faf740c6310 0x7faf74153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 -- 172.21.15.27:0/1265932832 >> 172.21.15.27:0/1265932832 conn(0x7faf74069e70 msgr2=0x7faf7405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:05.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 -- 172.21.15.27:0/1265932832 shutdown_connections 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.508+0000 7faf78d79700 1 -- 172.21.15.27:0/1265932832 wait complete. 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.509+0000 7faf78d79700 1 Processor -- start 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.509+0000 7faf78d79700 1 -- start start 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf78d79700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf740c5f30 0x7faf7414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf78d79700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 0x7faf740c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf78d79700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf741541c0 0x7faf740c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf78d79700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf740c3590 con 0x7faf740c6310 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf78d79700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf74153480 con 0x7faf741541c0 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf78d79700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf740c2980 con 0x7faf740c5f30 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 0x7faf740c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 0x7faf740c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38020/0 (socket says 172.21.15.27:38020) 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf6bfff700 1 -- 172.21.15.27:0/3532665468 learned_addr learned my addr 172.21.15.27:0/3532665468 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf72d9d700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf741541c0 0x7faf740c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.510+0000 7faf7259c700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf740c5f30 0x7faf7414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6bfff700 1 -- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf740c5f30 msgr2=0x7faf7414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6bfff700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf740c5f30 0x7faf7414ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6bfff700 1 -- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf741541c0 msgr2=0x7faf740c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6bfff700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf741541c0 0x7faf740c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6bfff700 1 -- 172.21.15.27:0/3532665468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c009a20 con 0x7faf740c6310 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf72d9d700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf741541c0 0x7faf740c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6bfff700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 0x7faf740c1e10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7faf5c00e950 tx=0x7faf5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012600 con 0x7faf740c6310 2023-05-17T15:08:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c012760 con 0x7faf740c6310 2023-05-17T15:08:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012ae0 con 0x7faf740c6310 2023-05-17T15:08:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf740c2c60 con 0x7faf740c6310 2023-05-17T15:08:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.511+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf740c3220 con 0x7faf740c6310 2023-05-17T15:08:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.512+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf740c3700 con 0x7faf740c6310 2023-05-17T15:08:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.512+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7faf5c022070 con 0x7faf740c6310 2023-05-17T15:08:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.513+0000 7faf6a7fc700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405edf0 0x7faf540612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.513+0000 7faf7259c700 1 -- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405edf0 msgr2=0x7faf540612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.513+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7faf5c07a0f0 con 0x7faf740c6310 2023-05-17T15:08:05.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.513+0000 7faf7259c700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405edf0 0x7faf540612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.517+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf5c04b480 con 0x7faf740c6310 2023-05-17T15:08:05.550 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:05.546+0000 7f84c444d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.690+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf740c3d20 con 0x7faf740c6310 2023-05-17T15:08:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.691+0000 7faf6a7fc700 1 -- 172.21.15.27:0/3532665468 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17687 (secure 0 0 0) 0x7faf5c016090 con 0x7faf740c6310 2023-05-17T15:08:05.695 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:05.695 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":70,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:03.736505+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:05:55.736103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-17T15:05:56.153758+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2210631157":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/1676615034":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/4044621687":"2023-05-18T15:06:09.628667+0000","172.21.15.27:6833/86332":"2023-05-18T15:06:09.628667+0000","172.21.15.27:6832/86332":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/2758006323":"2023-05-18T15:06:09.628667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405edf0 msgr2=0x7faf540612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405edf0 0x7faf540612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 msgr2=0x7faf740c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 0x7faf740c1e10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7faf5c00e950 tx=0x7faf5c009060).stop 2023-05-17T15:08:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 shutdown_connections 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405edf0 0x7faf540612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf741541c0 0x7faf740c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf740c5f30 0x7faf7414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 --2- 172.21.15.27:0/3532665468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf740c6310 0x7faf740c1e10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 >> 172.21.15.27:0/3532665468 conn(0x7faf74069e70 msgr2=0x7faf7414fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 shutdown_connections 2023-05-17T15:08:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.693+0000 7faf78d79700 1 -- 172.21.15.27:0/3532665468 wait complete. 2023-05-17T15:08:05.709 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:08:05.710 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.825+0000 7f2da4841700 1 Processor -- start 2023-05-17T15:08:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.825+0000 7f2da4841700 1 -- start start 2023-05-17T15:08:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2da4841700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2da0150970 0x7f2da0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2da4841700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0067cb0 0x7f2da0068120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2da4841700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da0068610 con 0x7f2da00a6ca0 2023-05-17T15:08:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2da4841700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da00a6850 con 0x7f2da0150970 2023-05-17T15:08:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2da4841700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c3810 con 0x7f2da0067cb0 2023-05-17T15:08:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2d9f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2da0150970 0x7f2da0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2d9ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0067cb0 0x7f2da0068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2d9f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2da0150970 0x7f2da0150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:55974/0 (socket says 172.21.15.27:55974) 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.826+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/2826982952 learned_addr learned my addr 172.21.15.27:0/2826982952 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0067cb0 msgr2=0x7f2da0068120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0067cb0 0x7f2da0068120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/2826982952 >> v1:172.21.15.40:6789/0 conn(0x7f2da00a6ca0 legacy=0x7f2da0151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/2826982952 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00c20e0 con 0x7f2da0150970 2023-05-17T15:08:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0067cb0 0x7f2da0068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0150970 0x7f2da0150d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2d90006fd0 tx=0x7f2d900090f0).ready entity=mon.1 client_cookie=ef683d900ba64355 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9e7fc700 1 -- 172.21.15.27:0/2826982952 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000b580 con 0x7f2da0150970 2023-05-17T15:08:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9e7fc700 1 -- 172.21.15.27:0/2826982952 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000b6e0 con 0x7f2da0150970 2023-05-17T15:08:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2d9e7fc700 1 -- 172.21.15.27:0/2826982952 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000ba60 con 0x7f2da0150970 2023-05-17T15:08:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2da4841700 1 -- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0150970 msgr2=0x7f2da0150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.827+0000 7f2da4841700 1 --2- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0150970 0x7f2da0150d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2d90006fd0 tx=0x7f2d900090f0).stop 2023-05-17T15:08:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.828+0000 7f2da4841700 1 -- 172.21.15.27:0/2826982952 shutdown_connections 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.828+0000 7f2da4841700 1 --2- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0067cb0 0x7f2da0068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.828+0000 7f2da4841700 1 --2- 172.21.15.27:0/2826982952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0150970 0x7f2da0150d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.828+0000 7f2da4841700 1 -- 172.21.15.27:0/2826982952 >> 172.21.15.27:0/2826982952 conn(0x7f2da00675b0 msgr2=0x7f2da00c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.828+0000 7f2da4841700 1 -- 172.21.15.27:0/2826982952 shutdown_connections 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.828+0000 7f2da4841700 1 -- 172.21.15.27:0/2826982952 wait complete. 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.829+0000 7f2da4841700 1 Processor -- start 2023-05-17T15:08:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.829+0000 7f2da4841700 1 -- start start 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 0x7f2da00bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da00a6ca0 0x7f2da005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0150970 0x7f2da0145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00bf8b0 con 0x7f2da0067cb0 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da014b920 con 0x7f2da00a6ca0 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da005ec50 con 0x7f2da0150970 2023-05-17T15:08:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 0x7f2da00bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 0x7f2da00bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38050/0 (socket says 172.21.15.27:38050) 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3810957794 learned_addr learned my addr 172.21.15.27:0/3810957794 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9effd700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da00a6ca0 0x7f2da005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0150970 0x7f2da0145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0150970 msgr2=0x7f2da0145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0150970 0x7f2da0145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da00a6ca0 msgr2=0x7f2da005e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da00a6ca0 0x7f2da005e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3810957794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98009a20 con 0x7f2da0067cb0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 0x7f2da00bfcd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f2d90009fd0 tx=0x7f2d90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90000bc0 con 0x7f2da0067cb0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000b850 con 0x7f2da0067cb0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d90009370 con 0x7f2da0067cb0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90000d20 con 0x7f2da0067cb0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.830+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da00bef10 con 0x7f2da0067cb0 2023-05-17T15:08:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.832+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0065560 con 0x7f2da0067cb0 2023-05-17T15:08:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.832+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2d9002b070 con 0x7f2da0067cb0 2023-05-17T15:08:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.832+0000 7f2d877fe700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.832+0000 7f2d9effd700 1 -- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 msgr2=0x7f2d8c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.832+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f2d9007b520 con 0x7f2da0067cb0 2023-05-17T15:08:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.832+0000 7f2d9effd700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:05.836+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d9004c8b0 con 0x7f2da0067cb0 2023-05-17T15:08:06.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.033+0000 7f2d9effd700 1 -- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 msgr2=0x7f2d8c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:06.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.033+0000 7f2d9effd700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:06.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.070+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2da00c3ab0 con 0x7f2da0067cb0 2023-05-17T15:08:06.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.071+0000 7f2d877fe700 1 -- 172.21.15.27:0/3810957794 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f2d90029020 con 0x7f2da0067cb0 2023-05-17T15:08:06.075 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:06.075 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:05:57.187691+0000","modified":"2023-05-17T15:06:00.203429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/3759557665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":3759557665},{"type":"v1","addr":"172.21.15.27:6837","nonce":3759557665}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-17T15:08:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 msgr2=0x7f2d8c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 msgr2=0x7f2da00bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 0x7f2da00bfcd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f2d90009fd0 tx=0x7f2d90017000).stop 2023-05-17T15:08:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 shutdown_connections 2023-05-17T15:08:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0150970 0x7f2da0145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0067cb0 0x7f2da00bfcd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 --2- 172.21.15.27:0/3810957794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da00a6ca0 0x7f2da005e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 >> 172.21.15.27:0/3810957794 conn(0x7f2da00675b0 msgr2=0x7f2da00c5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 shutdown_connections 2023-05-17T15:08:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.073+0000 7f2da4841700 1 -- 172.21.15.27:0/3810957794 wait complete. 2023-05-17T15:08:06.079 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2023-05-17T15:08:06.089 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:06.161 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.157+0000 7fa50719e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:08:06.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.207+0000 7faf6d386700 1 Processor -- start 2023-05-17T15:08:06.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.208+0000 7faf6d386700 1 -- start start 2023-05-17T15:08:06.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.208+0000 7faf6d386700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680c60c0 0x7faf680c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.208+0000 7faf6d386700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf680aa3b0 0x7faf680c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.208+0000 7faf6d386700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6805e7e0 con 0x7faf680a9f70 2023-05-17T15:08:06.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.208+0000 7faf6d386700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6805eac0 con 0x7faf680aa3b0 2023-05-17T15:08:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.208+0000 7faf6d386700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680bfd70 con 0x7faf680c60c0 2023-05-17T15:08:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf680aa3b0 0x7faf680c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf680aa3b0 0x7faf680c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38064/0 (socket says 172.21.15.27:38064) 2023-05-17T15:08:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 -- 172.21.15.27:0/1659382377 learned_addr learned my addr 172.21.15.27:0/1659382377 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf66ffd700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680c60c0 0x7faf680c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 -- 172.21.15.27:0/1659382377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680c60c0 msgr2=0x7faf680c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680c60c0 0x7faf680c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 -- 172.21.15.27:0/1659382377 >> v1:172.21.15.40:6789/0 conn(0x7faf680a9f70 legacy=0x7faf68153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 -- 172.21.15.27:0/1659382377 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680c0050 con 0x7faf680aa3b0 2023-05-17T15:08:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf66ffd700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680c60c0 0x7faf680c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf677fe700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680aa3b0 0x7faf680c0850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7faf60009f20 tx=0x7faf60009840).ready entity=mon.0 client_cookie=25a750e380c2762f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf65ffb700 1 -- 172.21.15.27:0/1659382377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000e070 con 0x7faf680aa3b0 2023-05-17T15:08:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf65ffb700 1 -- 172.21.15.27:0/1659382377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000ba80 con 0x7faf680aa3b0 2023-05-17T15:08:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.209+0000 7faf65ffb700 1 -- 172.21.15.27:0/1659382377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000be00 con 0x7faf680aa3b0 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 -- 172.21.15.27:0/1659382377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680aa3b0 msgr2=0x7faf680c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680aa3b0 0x7faf680c0850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7faf60009f20 tx=0x7faf60009840).stop 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 -- 172.21.15.27:0/1659382377 shutdown_connections 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680aa3b0 0x7faf680c0850 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 --2- 172.21.15.27:0/1659382377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680c60c0 0x7faf680c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 -- 172.21.15.27:0/1659382377 >> 172.21.15.27:0/1659382377 conn(0x7faf68069e70 msgr2=0x7faf6805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 -- 172.21.15.27:0/1659382377 shutdown_connections 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.210+0000 7faf6d386700 1 -- 172.21.15.27:0/1659382377 wait complete. 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.211+0000 7faf6d386700 1 Processor -- start 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.211+0000 7faf6d386700 1 -- start start 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf6d386700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 0x7faf68143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf6d386700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680aa3b0 0x7faf6814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf6d386700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf680c60c0 0x7faf6814b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf6d386700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c8d40 con 0x7faf680a9f70 2023-05-17T15:08:06.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf6d386700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c8fe0 con 0x7faf680c60c0 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf6d386700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c92c0 con 0x7faf680aa3b0 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 0x7faf68143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 0x7faf68143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38066/0 (socket says 172.21.15.27:38066) 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 -- 172.21.15.27:0/2328330036 learned_addr learned my addr 172.21.15.27:0/2328330036 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf677fe700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf680c60c0 0x7faf6814b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf667fc700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680aa3b0 0x7faf6814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 -- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680aa3b0 msgr2=0x7faf6814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680aa3b0 0x7faf6814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 -- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf680c60c0 msgr2=0x7faf6814b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf680c60c0 0x7faf6814b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 -- 172.21.15.27:0/2328330036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009ae0 con 0x7faf680a9f70 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.212+0000 7faf66ffd700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 0x7faf68143770 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7faf5800d890 tx=0x7faf58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.213+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58011590 con 0x7faf680a9f70 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.213+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf580116f0 con 0x7faf680a9f70 2023-05-17T15:08:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.213+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680c95a0 con 0x7faf680a9f70 2023-05-17T15:08:06.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.213+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58011a70 con 0x7faf680a9f70 2023-05-17T15:08:06.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.213+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680cb910 con 0x7faf680a9f70 2023-05-17T15:08:06.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.213+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680c9910 con 0x7faf680a9f70 2023-05-17T15:08:06.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.214+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7faf58012420 con 0x7faf680a9f70 2023-05-17T15:08:06.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.214+0000 7faf4effd700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 0x7faf540612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.214+0000 7faf667fc700 1 -- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 msgr2=0x7faf540612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:06.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.214+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7faf58079850 con 0x7faf680a9f70 2023-05-17T15:08:06.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.214+0000 7faf667fc700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 0x7faf540612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:06.231 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.227+0000 7fa50719e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:08:06.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.222+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf5804ab80 con 0x7faf680a9f70 2023-05-17T15:08:06.258 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.255+0000 7f84c444d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:08:06.307 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.303+0000 7fa50719e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:08:06.330 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.327+0000 7f84c444d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:08:06.408 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.404+0000 7f84c444d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:08:06.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.415+0000 7faf667fc700 1 -- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 msgr2=0x7faf540612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:06.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.415+0000 7faf667fc700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 0x7faf540612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.437+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf6805f4a0 con 0x7faf680a9f70 2023-05-17T15:08:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.438+0000 7faf4effd700 1 -- 172.21.15.27:0/2328330036 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7faf5804e1a0 con 0x7faf680a9f70 2023-05-17T15:08:06.442 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:06.442 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:05:57.187691+0000","modified":"2023-05-17T15:06:00.203429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6837/3759557665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":3759557665},{"type":"v1","addr":"172.21.15.27:6837","nonce":3759557665}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-17T15:08:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 msgr2=0x7faf540612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 0x7faf540612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 msgr2=0x7faf68143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 0x7faf68143770 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7faf5800d890 tx=0x7faf58008040).stop 2023-05-17T15:08:06.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 shutdown_connections 2023-05-17T15:08:06.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7faf5405ee20 0x7faf540612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:06.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf680c60c0 0x7faf6814b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf680a9f70 0x7faf68143770 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 --2- 172.21.15.27:0/2328330036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf680aa3b0 0x7faf6814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 >> 172.21.15.27:0/2328330036 conn(0x7faf68069e70 msgr2=0x7faf680ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:06.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 shutdown_connections 2023-05-17T15:08:06.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.440+0000 7faf6d386700 1 -- 172.21.15.27:0/2328330036 wait complete. 2023-05-17T15:08:06.447 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2023-05-17T15:08:06.456 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.452+0000 7fa50719e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:08:06.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:06.532 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.524+0000 7fa50719e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:08:06.565 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.562+0000 7f84c444d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:08:06.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.571+0000 7efe0dffb700 1 Processor -- start 2023-05-17T15:08:06.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.571+0000 7efe0dffb700 1 -- start start 2023-05-17T15:08:06.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe0dffb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 0x7efe08063d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe0dffb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 0x7efe080c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe0dffb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080bd6a0 con 0x7efe081540d0 2023-05-17T15:08:06.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe0dffb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080c31b0 con 0x7efe0805e460 2023-05-17T15:08:06.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe0dffb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c3490 con 0x7efe08153cf0 2023-05-17T15:08:06.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe07fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 0x7efe080c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 0x7efe08063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 0x7efe08063d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:39186/0 (socket says 172.21.15.27:39186) 2023-05-17T15:08:06.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe07fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 0x7efe080c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:56010/0 (socket says 172.21.15.27:56010) 2023-05-17T15:08:06.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 -- 172.21.15.27:0/4203188725 learned_addr learned my addr 172.21.15.27:0/4203188725 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:06.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 -- 172.21.15.27:0/4203188725 >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 msgr2=0x7efe080c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:06.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 --2- 172.21.15.27:0/4203188725 >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 0x7efe080c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 -- 172.21.15.27:0/4203188725 >> v1:172.21.15.40:6789/0 conn(0x7efe081540d0 legacy=0x7efe0805dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe067fc700 1 -- 172.21.15.27:0/4203188725 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416412627 0 0) 0x7efe080bd6a0 con 0x7efe081540d0 2023-05-17T15:08:06.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe077fe700 1 -- 172.21.15.27:0/4203188725 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080c3770 con 0x7efe08153cf0 2023-05-17T15:08:06.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.572+0000 7efe07fff700 1 --2- 172.21.15.27:0/4203188725 >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 0x7efe080c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:06.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe077fe700 1 --2- 172.21.15.27:0/4203188725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 0x7efe08063d20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7efdfc006fd0 tx=0x7efdfc0090f0).ready entity=mon.2 client_cookie=2e626306c11da641 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:06.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe067fc700 1 -- 172.21.15.27:0/4203188725 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00b580 con 0x7efe08153cf0 2023-05-17T15:08:06.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe067fc700 1 -- 172.21.15.27:0/4203188725 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc00b6e0 con 0x7efe08153cf0 2023-05-17T15:08:06.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe067fc700 1 -- 172.21.15.27:0/4203188725 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00ba60 con 0x7efe08153cf0 2023-05-17T15:08:06.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 -- 172.21.15.27:0/4203188725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 msgr2=0x7efe08063d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 --2- 172.21.15.27:0/4203188725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 0x7efe08063d20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7efdfc006fd0 tx=0x7efdfc0090f0).stop 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 -- 172.21.15.27:0/4203188725 shutdown_connections 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 --2- 172.21.15.27:0/4203188725 >> v2:172.21.15.40:3300/0 conn(0x7efe0805e460 0x7efe080c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 --2- 172.21.15.27:0/4203188725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe08153cf0 0x7efe08063d20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 -- 172.21.15.27:0/4203188725 >> 172.21.15.27:0/4203188725 conn(0x7efe080c7920 msgr2=0x7efe080c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 -- 172.21.15.27:0/4203188725 shutdown_connections 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.573+0000 7efe0dffb700 1 -- 172.21.15.27:0/4203188725 wait complete. 2023-05-17T15:08:06.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 Processor -- start 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 -- start start 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 0x7efe0814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe08153cf0 0x7efe080aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe081540d0 0x7efe080646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080a38b0 con 0x7efe0805e460 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080a3b90 con 0x7efe08153cf0 2023-05-17T15:08:06.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe0dffb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080a3e70 con 0x7efe081540d0 2023-05-17T15:08:06.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe077fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 0x7efe0814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe077fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 0x7efe0814fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38082/0 (socket says 172.21.15.27:38082) 2023-05-17T15:08:06.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe077fe700 1 -- 172.21.15.27:0/3817656038 learned_addr learned my addr 172.21.15.27:0/3817656038 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:06.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe07fff700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe081540d0 0x7efe080646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.575+0000 7efe06ffd700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe08153cf0 0x7efe080aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe077fe700 1 -- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe081540d0 msgr2=0x7efe080646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe077fe700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe081540d0 0x7efe080646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe077fe700 1 -- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe08153cf0 msgr2=0x7efe080aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe077fe700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe08153cf0 0x7efe080aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe077fe700 1 -- 172.21.15.27:0/3817656038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009a20 con 0x7efe0805e460 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe077fe700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 0x7efe0814fc60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7efdfc009fd0 tx=0x7efdfc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc006a40 con 0x7efe0805e460 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc000bc0 con 0x7efe0805e460 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc01c420 con 0x7efe0805e460 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc009370 con 0x7efe0805e460 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.576+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe080a4430 con 0x7efe0805e460 2023-05-17T15:08:06.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.577+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0806bdf0 con 0x7efe0805e460 2023-05-17T15:08:06.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.578+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7efdfc02c070 con 0x7efe0805e460 2023-05-17T15:08:06.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.578+0000 7efdef7fe700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdf405ee20 0x7efdf40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.578+0000 7efe06ffd700 1 -- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdf405ee20 msgr2=0x7efdf40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:06.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.578+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7efdfc07b900 con 0x7efe0805e460 2023-05-17T15:08:06.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.578+0000 7efe06ffd700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdf405ee20 0x7efdf40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:06.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.586+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efdfc04cd10 con 0x7efe0805e460 2023-05-17T15:08:06.644 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.641+0000 7f84c444d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:08:06.647 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.643+0000 7fa50719e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:08:06.759 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:06.755+0000 7fa50719e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:06.766 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.762+0000 7f84c444d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:08:06.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.762+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe08068e80 con 0x7efe0805e460 2023-05-17T15:08:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.763+0000 7efdef7fe700 1 -- 172.21.15.27:0/3817656038 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17687 (secure 0 0 0) 0x7efdfc02a020 con 0x7efe0805e460 2023-05-17T15:08:06.767 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:06.768 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":70,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:03.736505+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:05:55.736103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-17T15:05:56.153758+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2210631157":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/1676615034":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/4044621687":"2023-05-18T15:06:09.628667+0000","172.21.15.27:6833/86332":"2023-05-18T15:06:09.628667+0000","172.21.15.27:6832/86332":"2023-05-18T15:06:09.628667+0000","172.21.15.27:0/2758006323":"2023-05-18T15:06:09.628667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdf405ee20 msgr2=0x7efdf40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:06.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdf405ee20 0x7efdf40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 msgr2=0x7efe0814fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 0x7efe0814fc60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7efdfc009fd0 tx=0x7efdfc017000).stop 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 shutdown_connections 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7efdf405ee20 0x7efdf40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe081540d0 0x7efe080646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe0805e460 0x7efe0814fc60 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 --2- 172.21.15.27:0/3817656038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe08153cf0 0x7efe080aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.765+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 >> 172.21.15.27:0/3817656038 conn(0x7efe080c7920 msgr2=0x7efe080c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.766+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 shutdown_connections 2023-05-17T15:08:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.766+0000 7efe0dffb700 1 -- 172.21.15.27:0/3817656038 wait complete. 2023-05-17T15:08:06.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:08:06.882 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:06.878+0000 7f84c444d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:06.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.897+0000 7f00292e0700 1 Processor -- start 2023-05-17T15:08:06.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.897+0000 7f00292e0700 1 -- start start 2023-05-17T15:08:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f00292e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0024154090 0x7f0024154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f00292e0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240c5a50 con 0x7f00240cb450 2023-05-17T15:08:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f00292e0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240c04e0 con 0x7f0024069610 2023-05-17T15:08:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f00292e0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0024069fa0 con 0x7f0024154090 2023-05-17T15:08:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0022ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0024154090 0x7f0024154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f00227fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f00240cb450 0x7f0024068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37652/0 (socket says 172.21.15.27:37652) 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f00227fc700 1 -- 172.21.15.27:0/666021995 learned_addr learned my addr 172.21.15.27:0/666021995 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0022ffd700 1 -- 172.21.15.27:0/666021995 >> v1:172.21.15.40:6789/0 conn(0x7f0024069610 legacy=0x7f00240c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0022ffd700 1 -- 172.21.15.27:0/666021995 >> v1:172.21.15.27:6789/0 conn(0x7f00240cb450 legacy=0x7f0024068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0022ffd700 1 -- 172.21.15.27:0/666021995 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240c0760 con 0x7f0024154090 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0021ffb700 1 -- 172.21.15.27:0/666021995 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822853589 0 0) 0x7f00240c5a50 con 0x7f00240cb450 2023-05-17T15:08:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0022ffd700 1 --2- 172.21.15.27:0/666021995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024154090 0x7f0024154470 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f0014009760 tx=0x7f0014009060).ready entity=mon.0 client_cookie=1f4ca0b842654097 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:06.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0021ffb700 1 -- 172.21.15.27:0/666021995 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400b580 con 0x7f0024154090 2023-05-17T15:08:06.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0021ffb700 1 -- 172.21.15.27:0/666021995 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400b6e0 con 0x7f0024154090 2023-05-17T15:08:06.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.898+0000 7f0021ffb700 1 -- 172.21.15.27:0/666021995 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400ba60 con 0x7f0024154090 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 -- 172.21.15.27:0/666021995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024154090 msgr2=0x7f0024154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 --2- 172.21.15.27:0/666021995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024154090 0x7f0024154470 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f0014009760 tx=0x7f0014009060).stop 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 -- 172.21.15.27:0/666021995 shutdown_connections 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 --2- 172.21.15.27:0/666021995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024154090 0x7f0024154470 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 -- 172.21.15.27:0/666021995 >> 172.21.15.27:0/666021995 conn(0x7f002405e7e0 msgr2=0x7f00240cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 -- 172.21.15.27:0/666021995 shutdown_connections 2023-05-17T15:08:06.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.899+0000 7f00292e0700 1 -- 172.21.15.27:0/666021995 wait complete. 2023-05-17T15:08:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.902+0000 7f00292e0700 1 Processor -- start 2023-05-17T15:08:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.902+0000 7f00292e0700 1 -- start start 2023-05-17T15:08:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00292e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0024069610 0x7f0024156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00292e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 0x7f00241654e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00292e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0024154090 0x7f00241570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00292e0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0024156920 con 0x7f00240cb450 2023-05-17T15:08:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00292e0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0024150060 con 0x7f0024154090 2023-05-17T15:08:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00292e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00241659d0 con 0x7f0024069610 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00227fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 0x7f00241654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00227fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 0x7f00241654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38098/0 (socket says 172.21.15.27:38098) 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00227fc700 1 -- 172.21.15.27:0/1309413476 learned_addr learned my addr 172.21.15.27:0/1309413476 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f00237fe700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0024154090 0x7f00241570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.903+0000 7f0022ffd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0024069610 0x7f0024156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00227fc700 1 -- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0024069610 msgr2=0x7f0024156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00227fc700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0024069610 0x7f0024156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00227fc700 1 -- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0024154090 msgr2=0x7f00241570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00227fc700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0024154090 0x7f00241570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00227fc700 1 -- 172.21.15.27:0/1309413476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140092a0 con 0x7f00240cb450 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00227fc700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 0x7f00241654e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f001800c4f0 tx=0x7f0018007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180070d0 con 0x7f00240cb450 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0018007230 con 0x7f00240cb450 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0024155fa0 con 0x7f00240cb450 2023-05-17T15:08:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180075d0 con 0x7f00240cb450 2023-05-17T15:08:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.904+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0024155440 con 0x7f00240cb450 2023-05-17T15:08:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.905+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0024156130 con 0x7f00240cb450 2023-05-17T15:08:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.905+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f0018010070 con 0x7f00240cb450 2023-05-17T15:08:06.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.906+0000 7f000affd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:06.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.906+0000 7f0022ffd700 1 -- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 msgr2=0x7f00100612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:06.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.906+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6611+0+0 (secure 0 0 0) 0x7f0018079260 con 0x7f00240cb450 2023-05-17T15:08:06.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.906+0000 7f0022ffd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:06.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:06.910+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f001804a5f0 con 0x7f00240cb450 2023-05-17T15:08:07.058 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:07.054+0000 7fa50719e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:08:07.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.107+0000 7f0022ffd700 1 -- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 msgr2=0x7f00100612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6832/86332 2023-05-17T15:08:07.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.107+0000 7f0022ffd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:07.130 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:07.127+0000 7fa50719e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:08:07.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.127+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f00240c0a40 con 0x7f00240cb450 2023-05-17T15:08:07.187 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:07.184+0000 7f84c444d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:08:07.261 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:07.257+0000 7f84c444d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:08:07.279 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:08:07.275+0000 7f3bb45aa700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:07.279 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:08:07.275+0000 7f3bb45aa700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:07.279 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:08:07.275+0000 7f3bb45aa700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:08:07.294 INFO:tasks.ceph.mds.c.smithi027.stderr: -4> 2023-05-17T15:08:07.275+0000 7f3bb45aa700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:07.294 INFO:tasks.ceph.mds.c.smithi027.stderr: -3> 2023-05-17T15:08:07.275+0000 7f3bb45aa700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:07.294 INFO:tasks.ceph.mds.c.smithi027.stderr: -1> 2023-05-17T15:08:07.275+0000 7f3bb45aa700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:08:07.312 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:08:07.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.508+0000 7f0022ffd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.508+0000 7f0022ffd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-05-17T15:08:07.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.508+0000 7f0022ffd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.508+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 msgr2=0x7f00100612e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-05-17T15:08:07.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.508+0000 7f000affd700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.747 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:08:07.744+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:08:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.749+0000 7f000affd700 1 -- 172.21.15.27:0/1309413476 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f001804dc10 con 0x7f00240cb450 2023-05-17T15:08:07.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 msgr2=0x7f00241654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:07.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 0x7f00241654e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f001800c4f0 tx=0x7f0018007c10).stop 2023-05-17T15:08:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 shutdown_connections 2023-05-17T15:08:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7f001005ee20 0x7f00100612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0024154090 0x7f00241570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0024069610 0x7f0024156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 --2- 172.21.15.27:0/1309413476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00240cb450 0x7f00241654e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 >> 172.21.15.27:0/1309413476 conn(0x7f002405e7e0 msgr2=0x7f00240c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 shutdown_connections 2023-05-17T15:08:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.751+0000 7f00292e0700 1 -- 172.21.15.27:0/1309413476 wait complete. 2023-05-17T15:08:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:08:07.768 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:08:07.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.883+0000 7fa53af9f700 1 Processor -- start 2023-05-17T15:08:07.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.883+0000 7fa53af9f700 1 -- start start 2023-05-17T15:08:07.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53af9f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5340c6310 0x7fa534068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:07.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53af9f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5340691f0 0x7fa5340bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:07.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53af9f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa534158790 con 0x7fa5341543d0 2023-05-17T15:08:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53af9f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340c1c50 con 0x7fa5340691f0 2023-05-17T15:08:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53af9f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa534157e60 con 0x7fa5340c6310 2023-05-17T15:08:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5340691f0 0x7fa5340bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5340691f0 0x7fa5340bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38128/0 (socket says 172.21.15.27:38128) 2023-05-17T15:08:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 -- 172.21.15.27:0/964280769 learned_addr learned my addr 172.21.15.27:0/964280769 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa533fff700 1 --2- 172.21.15.27:0/964280769 >> v2:172.21.15.40:3300/0 conn(0x7fa5340c6310 0x7fa534068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 -- 172.21.15.27:0/964280769 >> v2:172.21.15.40:3300/0 conn(0x7fa5340c6310 msgr2=0x7fa534068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 --2- 172.21.15.27:0/964280769 >> v2:172.21.15.40:3300/0 conn(0x7fa5340c6310 0x7fa534068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 -- 172.21.15.27:0/964280769 >> v1:172.21.15.40:6789/0 conn(0x7fa5341543d0 legacy=0x7fa5340c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.884+0000 7fa53953c700 1 -- 172.21.15.27:0/964280769 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534158140 con 0x7fa5340691f0 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53953c700 1 --2- 172.21.15.27:0/964280769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa5340bfc80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fa5340c5620 tx=0x7fa51c0090f0).ready entity=mon.0 client_cookie=c26a28a88581521e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa5337fe700 1 -- 172.21.15.27:0/964280769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00b520 con 0x7fa5340691f0 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa5337fe700 1 -- 172.21.15.27:0/964280769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c00b680 con 0x7fa5340691f0 2023-05-17T15:08:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa5337fe700 1 -- 172.21.15.27:0/964280769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00ba00 con 0x7fa5340691f0 2023-05-17T15:08:07.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 -- 172.21.15.27:0/964280769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 msgr2=0x7fa5340bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:07.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 --2- 172.21.15.27:0/964280769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa5340bfc80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fa5340c5620 tx=0x7fa51c0090f0).stop 2023-05-17T15:08:07.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 -- 172.21.15.27:0/964280769 shutdown_connections 2023-05-17T15:08:07.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 --2- 172.21.15.27:0/964280769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa5340bfc80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 --2- 172.21.15.27:0/964280769 >> v2:172.21.15.40:3300/0 conn(0x7fa5340c6310 0x7fa534068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 -- 172.21.15.27:0/964280769 >> 172.21.15.27:0/964280769 conn(0x7fa5340cb7f0 msgr2=0x7fa5340c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 -- 172.21.15.27:0/964280769 shutdown_connections 2023-05-17T15:08:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.885+0000 7fa53af9f700 1 -- 172.21.15.27:0/964280769 wait complete. 2023-05-17T15:08:07.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.886+0000 7fa53af9f700 1 Processor -- start 2023-05-17T15:08:07.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 -- start start 2023-05-17T15:08:07.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa534163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:07.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5340c6310 0x7fa5340c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:07.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5341543d0 0x7fa534156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:07.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340c28c0 con 0x7fa5340691f0 2023-05-17T15:08:07.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340c2ba0 con 0x7fa5340c6310 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa53af9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b06a0 con 0x7fa5341543d0 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa538d3b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa534163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa538d3b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa534163d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38132/0 (socket says 172.21.15.27:38132) 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.887+0000 7fa538d3b700 1 -- 172.21.15.27:0/4146942938 learned_addr learned my addr 172.21.15.27:0/4146942938 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa53953c700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5341543d0 0x7fa534156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa533fff700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5340c6310 0x7fa5340c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa538d3b700 1 -- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5341543d0 msgr2=0x7fa534156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa538d3b700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5341543d0 0x7fa534156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa538d3b700 1 -- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5340c6310 msgr2=0x7fa5340c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa538d3b700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5340c6310 0x7fa5340c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa538d3b700 1 -- 172.21.15.27:0/4146942938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c009370 con 0x7fa5340691f0 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa538d3b700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa534163d90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fa52c00c7f0 tx=0x7fa52c0015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c006a20 con 0x7fa5340691f0 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c006b80 con 0x7fa5340691f0 2023-05-17T15:08:07.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5340b0980 con 0x7fa5340691f0 2023-05-17T15:08:07.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c007020 con 0x7fa5340691f0 2023-05-17T15:08:07.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.888+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5340b02f0 con 0x7fa5340691f0 2023-05-17T15:08:07.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.889+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53406bdf0 con 0x7fa5340691f0 2023-05-17T15:08:07.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.889+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fa52c018020 con 0x7fa5340691f0 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa530ff9700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 0x7fa5140612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa52c079900 con 0x7fa5340691f0 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa533fff700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 0x7fa5140612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa533fff700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 0x7fa5140612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa533fff700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 0x7fa5140612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 msgr2=0x7fa5140612e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-05-17T15:08:07.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.890+0000 7fa530ff9700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 0x7fa5140612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:07.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:07.894+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa52c04abc0 con 0x7fa5340691f0 2023-05-17T15:08:08.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.109+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa534158420 con 0x7fa5340691f0 2023-05-17T15:08:08.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.134+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 22) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fa52c07bd70 con 0x7fa5340691f0 2023-05-17T15:08:08.184 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8444432700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.184 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8444432700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.184 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8444432700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.184 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8447438700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8444432700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8447438700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8444432700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8447438700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8447438700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:08.180+0000 7f8447438700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:08.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.751+0000 7fa530ff9700 1 -- 172.21.15.27:0/4146942938 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa52c072d50 con 0x7fa5340691f0 2023-05-17T15:08:08.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 msgr2=0x7fa534163d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa534163d90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fa52c00c7f0 tx=0x7fa52c0015c0).stop 2023-05-17T15:08:08.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 shutdown_connections 2023-05-17T15:08:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:6832/86332,v1:172.21.15.27:6833/86332] conn(0x7fa51405ee20 0x7fa5140612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5341543d0 0x7fa534156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5340691f0 0x7fa534163d90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 --2- 172.21.15.27:0/4146942938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5340c6310 0x7fa5340c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 >> 172.21.15.27:0/4146942938 conn(0x7fa5340cb7f0 msgr2=0x7fa534153940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 shutdown_connections 2023-05-17T15:08:08.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.754+0000 7fa53af9f700 1 -- 172.21.15.27:0/4146942938 wait complete. 2023-05-17T15:08:08.772 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:08:08.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.890+0000 7f5aad54d700 1 Processor -- start 2023-05-17T15:08:08.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.890+0000 7f5aad54d700 1 -- start start 2023-05-17T15:08:08.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5aad54d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:08.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5aad54d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5aa8154520 0x7f5aa80c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:08.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5aad54d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa8154a50 con 0x7f5aa80c5d60 2023-05-17T15:08:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5aad54d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa8154d30 con 0x7f5aa8154520 2023-05-17T15:08:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5aad54d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8155010 con 0x7f5aa80c1080 2023-05-17T15:08:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5aa8154520 0x7f5aa80c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5aa8154520 0x7f5aa80c02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38200/0 (socket says 172.21.15.27:38200) 2023-05-17T15:08:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2976982713 learned_addr learned my addr 172.21.15.27:0/2976982713 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5aa7fff700 1 --2- 172.21.15.27:0/2976982713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2976982713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 msgr2=0x7f5aa80c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 --2- 172.21.15.27:0/2976982713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2976982713 >> v1:172.21.15.40:6789/0 conn(0x7f5aa80c5d60 legacy=0x7f5aa80a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2976982713 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa81552f0 con 0x7f5aa8154520 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.891+0000 7f5a9ffff700 1 --2- 172.21.15.27:0/2976982713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa8154520 0x7f5aa80c02e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f5a90006fd0 tx=0x7f5a900090f0).ready entity=mon.0 client_cookie=b32279ce6c4ea621 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aa77fe700 1 -- 172.21.15.27:0/2976982713 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000b600 con 0x7f5aa8154520 2023-05-17T15:08:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aa77fe700 1 -- 172.21.15.27:0/2976982713 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9000b760 con 0x7f5aa8154520 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aa77fe700 1 -- 172.21.15.27:0/2976982713 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000bae0 con 0x7f5aa8154520 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 -- 172.21.15.27:0/2976982713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa8154520 msgr2=0x7f5aa80c02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2976982713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa8154520 0x7f5aa80c02e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f5a90006fd0 tx=0x7f5a900090f0).stop 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 -- 172.21.15.27:0/2976982713 shutdown_connections 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2976982713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2976982713 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa8154520 0x7f5aa80c02e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 -- 172.21.15.27:0/2976982713 >> 172.21.15.27:0/2976982713 conn(0x7f5aa805dd50 msgr2=0x7f5aa805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 -- 172.21.15.27:0/2976982713 shutdown_connections 2023-05-17T15:08:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.892+0000 7f5aad54d700 1 -- 172.21.15.27:0/2976982713 wait complete. 2023-05-17T15:08:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.893+0000 7f5aad54d700 1 Processor -- start 2023-05-17T15:08:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.893+0000 7f5aad54d700 1 -- start start 2023-05-17T15:08:08.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aad54d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aad54d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 0x7f5aa80ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aad54d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5aa8154520 0x7f5aa814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aad54d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80c2ac0 con 0x7f5aa80c5d60 2023-05-17T15:08:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aad54d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80ac800 con 0x7f5aa8154520 2023-05-17T15:08:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aad54d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80ab950 con 0x7f5aa80c1080 2023-05-17T15:08:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5a9ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 0x7f5aa80ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5a9ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 0x7f5aa80ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38208/0 (socket says 172.21.15.27:38208) 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2153899994 learned_addr learned my addr 172.21.15.27:0/2153899994 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aa7fff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.894+0000 7f5aacd4c700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5aa8154520 0x7f5aa814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 msgr2=0x7f5aa80c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5a9ffff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5aa8154520 msgr2=0x7f5aa814aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5a9ffff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5aa8154520 0x7f5aa814aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5a9ffff700 1 -- 172.21.15.27:0/2153899994 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009370 con 0x7f5aa80c5d60 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5aa7fff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5a9ffff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 0x7f5aa80ab460 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f5a90011000 tx=0x7f5a90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000b8d0 con 0x7f5aa80c5d60 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9000ba30 con 0x7f5aa80c5d60 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa80abbf0 con 0x7f5aa80c5d60 2023-05-17T15:08:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9001c670 con 0x7f5aa80c5d60 2023-05-17T15:08:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.895+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa80ac1b0 con 0x7f5aa80c5d60 2023-05-17T15:08:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.896+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa8047150 con 0x7f5aa80c5d60 2023-05-17T15:08:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.896+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 22) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f5a90022020 con 0x7f5aa80c5d60 2023-05-17T15:08:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.897+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f5a9007b790 con 0x7f5aa80c5d60 2023-05-17T15:08:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:08.901+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a9004cbc0 con 0x7f5aa80c5d60 2023-05-17T15:08:09.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.072+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5aa80bfb70 con 0x7f5aa80c5d60 2023-05-17T15:08:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.137+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5a9000f070 con 0x7f5aa80c5d60 2023-05-17T15:08:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.138+0000 7f5aa4ff9700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a88030150 0x7f5a88067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.139+0000 7f5aa7fff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a88030150 0x7f5a88067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.140+0000 7f5aa7fff700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a88030150 0x7f5a88067a90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5a980098c0 tx=0x7f5a98008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:09.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.755+0000 7f5aa4ff9700 1 -- 172.21.15.27:0/2153899994 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5a90055b70 con 0x7f5aa80c5d60 2023-05-17T15:08:09.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.757+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a88030150 msgr2=0x7f5a88067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.757+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a88030150 0x7f5a88067a90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5a980098c0 tx=0x7f5a98008040).stop 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.757+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 msgr2=0x7f5aa80ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.757+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 0x7f5aa80ab460 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f5a90011000 tx=0x7f5a90017000).stop 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.757+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 shutdown_connections 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a88030150 0x7f5a88067a90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5aa8154520 0x7f5aa814aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5aa80c1080 0x7f5aa80c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 --2- 172.21.15.27:0/2153899994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5aa80c5d60 0x7f5aa80ab460 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 >> 172.21.15.27:0/2153899994 conn(0x7f5aa805dd50 msgr2=0x7f5aa814d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:09.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 shutdown_connections 2023-05-17T15:08:09.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.758+0000 7f5aad54d700 1 -- 172.21.15.27:0/2153899994 wait complete. 2023-05-17T15:08:09.764 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:08:09.777 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:08:09.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 Processor -- start 2023-05-17T15:08:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 -- start start 2023-05-17T15:08:09.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0854153fa0 0x7f08540c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08540aa130 0x7f0854081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f0854068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540c1610 con 0x7f08540aa130 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540828f0 con 0x7f0854153fa0 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.897+0000 7f085931c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540c0a00 con 0x7f08540824c0 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08540aa130 0x7f0854081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08540aa130 0x7f0854081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38234/0 (socket says 172.21.15.27:38234) 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 -- 172.21.15.27:0/4271842938 learned_addr learned my addr 172.21.15.27:0/4271842938 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08537fe700 1 --2- 172.21.15.27:0/4271842938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f0854068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f0852ffd700 1 --2- 172.21.15.27:0/4271842938 >> v2:172.21.15.40:3300/0 conn(0x7f0854153fa0 0x7f08540c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 -- 172.21.15.27:0/4271842938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 msgr2=0x7f0854068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:09.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 --2- 172.21.15.27:0/4271842938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f0854068de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 -- 172.21.15.27:0/4271842938 >> v2:172.21.15.40:3300/0 conn(0x7f0854153fa0 msgr2=0x7f08540c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:09.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 --2- 172.21.15.27:0/4271842938 >> v2:172.21.15.40:3300/0 conn(0x7f0854153fa0 0x7f08540c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 -- 172.21.15.27:0/4271842938 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08540c0ce0 con 0x7f08540aa130 2023-05-17T15:08:09.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f0852ffd700 1 --2- 172.21.15.27:0/4271842938 >> v2:172.21.15.40:3300/0 conn(0x7f0854153fa0 0x7f08540c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f08527fc700 1 --2- 172.21.15.27:0/4271842938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08540aa130 0x7f0854081fd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f08540cad20 tx=0x7f083c0090f0).ready entity=mon.0 client_cookie=9a634b60f048d6f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f0851ffb700 1 -- 172.21.15.27:0/4271842938 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00b600 con 0x7f08540aa130 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f0851ffb700 1 -- 172.21.15.27:0/4271842938 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00b760 con 0x7f08540aa130 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.898+0000 7f0851ffb700 1 -- 172.21.15.27:0/4271842938 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00bae0 con 0x7f08540aa130 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 -- 172.21.15.27:0/4271842938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08540aa130 msgr2=0x7f0854081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 --2- 172.21.15.27:0/4271842938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08540aa130 0x7f0854081fd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f08540cad20 tx=0x7f083c0090f0).stop 2023-05-17T15:08:09.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 -- 172.21.15.27:0/4271842938 shutdown_connections 2023-05-17T15:08:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 --2- 172.21.15.27:0/4271842938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f0854068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 --2- 172.21.15.27:0/4271842938 >> v2:172.21.15.40:3300/0 conn(0x7f0854153fa0 0x7f08540c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 --2- 172.21.15.27:0/4271842938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08540aa130 0x7f0854081fd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 -- 172.21.15.27:0/4271842938 >> 172.21.15.27:0/4271842938 conn(0x7f085405e820 msgr2=0x7f08540cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 -- 172.21.15.27:0/4271842938 shutdown_connections 2023-05-17T15:08:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.899+0000 7f085931c700 1 -- 172.21.15.27:0/4271842938 wait complete. 2023-05-17T15:08:09.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.900+0000 7f085931c700 1 Processor -- start 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.900+0000 7f085931c700 1 -- start start 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f085931c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f08540c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f085931c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08540aa130 0x7f08540add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f085931c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 0x7f085414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f085931c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540ae280 con 0x7f0854153fa0 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f085931c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540ae490 con 0x7f08540aa130 2023-05-17T15:08:09.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f085931c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540ae770 con 0x7f08540824c0 2023-05-17T15:08:09.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 0x7f085414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 0x7f085414ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38242/0 (socket says 172.21.15.27:38242) 2023-05-17T15:08:09.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 -- 172.21.15.27:0/573917986 learned_addr learned my addr 172.21.15.27:0/573917986 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:09.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f0852ffd700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f08540c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08527fc700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08540aa130 0x7f08540add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 -- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 msgr2=0x7f08540c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f08540c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 -- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08540aa130 msgr2=0x7f08540add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08540aa130 0x7f08540add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 -- 172.21.15.27:0/573917986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c009370 con 0x7f0854153fa0 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f0852ffd700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f08540c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.901+0000 7f08537fe700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 0x7f085414ab00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f084c00c650 tx=0x7f084c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:09.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.902+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c010580 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.902+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c0106e0 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.902+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08540aea50 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.902+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c010a60 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.902+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085414aff0 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.902+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08540aeef0 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.903+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f084c01b460 con 0x7f0854153fa0 2023-05-17T15:08:09.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.903+0000 7f084affd700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f083405ecc0 0x7f0834061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:09.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.903+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6329+0+0 (secure 0 0 0) 0x7f084c079b60 con 0x7f0854153fa0 2023-05-17T15:08:09.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.903+0000 7f0852ffd700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f083405ecc0 0x7f0834061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:09.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.904+0000 7f0852ffd700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f083405ecc0 0x7f0834061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f084400e4c0 tx=0x7f0844007700).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:09.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:09.907+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f084c04b070 con 0x7f0854153fa0 2023-05-17T15:08:10.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.079+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0854153640 con 0x7f0854153fa0 2023-05-17T15:08:10.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.143+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f084c077a30 con 0x7f0854153fa0 2023-05-17T15:08:10.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.759+0000 7f084affd700 1 -- 172.21.15.27:0/573917986 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7f084c072d20 con 0x7f0854153fa0 2023-05-17T15:08:10.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f083405ecc0 msgr2=0x7f0834061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:10.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f083405ecc0 0x7f0834061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f084400e4c0 tx=0x7f0844007700).stop 2023-05-17T15:08:10.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 msgr2=0x7f085414ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:10.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 0x7f085414ab00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f084c00c650 tx=0x7f084c008040).stop 2023-05-17T15:08:10.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 shutdown_connections 2023-05-17T15:08:10.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f083405ecc0 0x7f0834061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0854153fa0 0x7f085414ab00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08540824c0 0x7f08540c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 --2- 172.21.15.27:0/573917986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08540aa130 0x7f08540add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 >> 172.21.15.27:0/573917986 conn(0x7f085405e820 msgr2=0x7f0854151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:10.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 shutdown_connections 2023-05-17T15:08:10.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.762+0000 7f085931c700 1 -- 172.21.15.27:0/573917986 wait complete. 2023-05-17T15:08:10.771 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:08:10.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:08:10.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.903+0000 7f20e48ea700 1 Processor -- start 2023-05-17T15:08:10.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.903+0000 7f20e48ea700 1 -- start start 2023-05-17T15:08:10.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20e48ea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20e0155a60 0x7f20e0155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20e48ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e00bdf00 0x7f20e00be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20e48ea700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e01563d0 con 0x7f20e00a7e90 2023-05-17T15:08:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20e48ea700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00bdab0 con 0x7f20e0155a60 2023-05-17T15:08:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20e48ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0156830 con 0x7f20e00bdf00 2023-05-17T15:08:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20ddd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20e0155a60 0x7f20e0155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20ddd9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20e0155a60 0x7f20e0155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38250/0 (socket says 172.21.15.27:38250) 2023-05-17T15:08:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.904+0000 7f20ddd9b700 1 -- 172.21.15.27:0/1885591242 learned_addr learned my addr 172.21.15.27:0/1885591242 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20ded9d700 1 --2- 172.21.15.27:0/1885591242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e00bdf00 0x7f20e00be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20ddd9b700 1 -- 172.21.15.27:0/1885591242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e00bdf00 msgr2=0x7f20e00be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20ddd9b700 1 --2- 172.21.15.27:0/1885591242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e00bdf00 0x7f20e00be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20ddd9b700 1 -- 172.21.15.27:0/1885591242 >> v1:172.21.15.40:6789/0 conn(0x7f20e00a7e90 legacy=0x7f20e00c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20ddd9b700 1 -- 172.21.15.27:0/1885591242 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0065e90 con 0x7f20e0155a60 2023-05-17T15:08:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20ddd9b700 1 --2- 172.21.15.27:0/1885591242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e0155a60 0x7f20e0155ee0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f20c8006fd0 tx=0x7f20c80090f0).ready entity=mon.0 client_cookie=1770ff359943865 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20dd59a700 1 -- 172.21.15.27:0/1885591242 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800b600 con 0x7f20e0155a60 2023-05-17T15:08:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20dd59a700 1 -- 172.21.15.27:0/1885591242 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c800b760 con 0x7f20e0155a60 2023-05-17T15:08:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20dd59a700 1 -- 172.21.15.27:0/1885591242 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800bae0 con 0x7f20e0155a60 2023-05-17T15:08:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20e48ea700 1 -- 172.21.15.27:0/1885591242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e0155a60 msgr2=0x7f20e0155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.905+0000 7f20e48ea700 1 --2- 172.21.15.27:0/1885591242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e0155a60 0x7f20e0155ee0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f20c8006fd0 tx=0x7f20c80090f0).stop 2023-05-17T15:08:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.906+0000 7f20e48ea700 1 -- 172.21.15.27:0/1885591242 shutdown_connections 2023-05-17T15:08:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.906+0000 7f20e48ea700 1 --2- 172.21.15.27:0/1885591242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e00bdf00 0x7f20e00be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.906+0000 7f20e48ea700 1 --2- 172.21.15.27:0/1885591242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e0155a60 0x7f20e0155ee0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.906+0000 7f20e48ea700 1 -- 172.21.15.27:0/1885591242 >> 172.21.15.27:0/1885591242 conn(0x7f20e00c94b0 msgr2=0x7f20e00c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.906+0000 7f20e48ea700 1 -- 172.21.15.27:0/1885591242 shutdown_connections 2023-05-17T15:08:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.906+0000 7f20e48ea700 1 -- 172.21.15.27:0/1885591242 wait complete. 2023-05-17T15:08:10.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 Processor -- start 2023-05-17T15:08:10.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 -- start start 2023-05-17T15:08:10.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 0x7f20e013e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e00bdf00 0x7f20e00c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e0155a60 0x7f20e00c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c3f00 con 0x7f20e00a7e90 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.907+0000 7f20e48ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01519e0 con 0x7f20e00bdf00 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20e48ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01668b0 con 0x7f20e0155a60 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 0x7f20e013e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:10.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 0x7f20e013e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38252/0 (socket says 172.21.15.27:38252) 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 -- 172.21.15.27:0/3067320105 learned_addr learned my addr 172.21.15.27:0/3067320105 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20ded9d700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e0155a60 0x7f20e00c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20ddd9b700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e00bdf00 0x7f20e00c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 -- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e0155a60 msgr2=0x7f20e00c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e0155a60 0x7f20e00c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 -- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e00bdf00 msgr2=0x7f20e00c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e00bdf00 0x7f20e00c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:10.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 -- 172.21.15.27:0/3067320105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009370 con 0x7f20e00a7e90 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20de59c700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 0x7f20e013e6f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f20d800c440 tx=0x7f20d8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8007020 con 0x7f20e00a7e90 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8007180 con 0x7f20e00a7e90 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e01510b0 con 0x7f20e00a7e90 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.908+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8007520 con 0x7f20e00a7e90 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.909+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e0151670 con 0x7f20e00a7e90 2023-05-17T15:08:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.910+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e006bdf0 con 0x7f20e00a7e90 2023-05-17T15:08:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.912+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f20d8010070 con 0x7f20e00a7e90 2023-05-17T15:08:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.913+0000 7f20d67fc700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f20c005ed90 0x7f20c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.913+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f20d8078c10 con 0x7f20e00a7e90 2023-05-17T15:08:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.913+0000 7f20ddd9b700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f20c005ed90 0x7f20c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:10.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.913+0000 7f20ddd9b700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f20c005ed90 0x7f20c0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f20c8009130 tx=0x7f20c8017000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:10.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:10.923+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20d80478f0 con 0x7f20e00a7e90 2023-05-17T15:08:11.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.098+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f20e0066170 con 0x7f20e00a7e90 2023-05-17T15:08:11.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.102+0000 7f20d67fc700 1 -- 172.21.15.27:0/3067320105 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v8) v1 ==== 120+0+0 (secure 0 0 0) 0x7f20d804a1a0 con 0x7f20e00a7e90 2023-05-17T15:08:11.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.103+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f20c005ed90 msgr2=0x7f20c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.103+0000 7f20e48ea700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f20c005ed90 0x7f20c0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f20c8009130 tx=0x7f20c8017000).stop 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 msgr2=0x7f20e013e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 0x7f20e013e6f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f20d800c440 tx=0x7f20d8007e00).stop 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 shutdown_connections 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f20c005ed90 0x7f20c0061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20e0155a60 0x7f20e00c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20e00a7e90 0x7f20e013e6f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 --2- 172.21.15.27:0/3067320105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e00bdf00 0x7f20e00c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 >> 172.21.15.27:0/3067320105 conn(0x7f20e00c94b0 msgr2=0x7f20e014f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:11.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 shutdown_connections 2023-05-17T15:08:11.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.104+0000 7f20e48ea700 1 -- 172.21.15.27:0/3067320105 wait complete. 2023-05-17T15:08:11.121 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:08:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.235+0000 7f08a0189700 1 Processor -- start 2023-05-17T15:08:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.235+0000 7f08a0189700 1 -- start start 2023-05-17T15:08:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f08a0189700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08980c6310 0x7f0898068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f08a0189700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08980691f0 0x7f08980bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f08a0189700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0898158790 con 0x7f08981543d0 2023-05-17T15:08:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f08a0189700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08980c1c50 con 0x7f08980c6310 2023-05-17T15:08:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f08a0189700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0898157e60 con 0x7f08980691f0 2023-05-17T15:08:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08980c6310 0x7f0898068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08980c6310 0x7f0898068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38262/0 (socket says 172.21.15.27:38262) 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 -- 172.21.15.27:0/3509644860 learned_addr learned my addr 172.21.15.27:0/3509644860 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089e726700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08980691f0 0x7f08980bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 -- 172.21.15.27:0/3509644860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08980691f0 msgr2=0x7f08980bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08980691f0 0x7f08980bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 -- 172.21.15.27:0/3509644860 >> v1:172.21.15.40:6789/0 conn(0x7f08981543d0 legacy=0x7f08980c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:11.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 -- 172.21.15.27:0/3509644860 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898158140 con 0x7f08980c6310 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089e726700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08980691f0 0x7f08980bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089d724700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980c6310 0x7f0898068d00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f0888006fd0 tx=0x7f08880090f0).ready entity=mon.0 client_cookie=f3418c87dbe002f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089cf23700 1 -- 172.21.15.27:0/3509644860 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800b600 con 0x7f08980c6310 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089cf23700 1 -- 172.21.15.27:0/3509644860 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800b760 con 0x7f08980c6310 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.236+0000 7f089cf23700 1 -- 172.21.15.27:0/3509644860 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800bae0 con 0x7f08980c6310 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 -- 172.21.15.27:0/3509644860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980c6310 msgr2=0x7f0898068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980c6310 0x7f0898068d00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f0888006fd0 tx=0x7f08880090f0).stop 2023-05-17T15:08:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 -- 172.21.15.27:0/3509644860 shutdown_connections 2023-05-17T15:08:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08980691f0 0x7f08980bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 --2- 172.21.15.27:0/3509644860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980c6310 0x7f0898068d00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 -- 172.21.15.27:0/3509644860 >> 172.21.15.27:0/3509644860 conn(0x7f08980cb7f0 msgr2=0x7f08980c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 -- 172.21.15.27:0/3509644860 shutdown_connections 2023-05-17T15:08:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.237+0000 7f08a0189700 1 -- 172.21.15.27:0/3509644860 wait complete. 2023-05-17T15:08:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.238+0000 7f08a0189700 1 Processor -- start 2023-05-17T15:08:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.238+0000 7f08a0189700 1 -- start start 2023-05-17T15:08:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f08a0189700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 0x7f08980aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f08a0189700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08980c6310 0x7f0898156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f08a0189700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08981543d0 0x7f08980af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f08a0189700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08981653a0 con 0x7f08980691f0 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f08a0189700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980ade00 con 0x7f08980c6310 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f08a0189700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980ae0e0 con 0x7f08981543d0 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 0x7f08980aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 0x7f08980aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38268/0 (socket says 172.21.15.27:38268) 2023-05-17T15:08:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 -- 172.21.15.27:0/2069371768 learned_addr learned my addr 172.21.15.27:0/2069371768 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089d724700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08980c6310 0x7f0898156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 -- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08981543d0 msgr2=0x7f08980af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08981543d0 0x7f08980af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 -- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08980c6310 msgr2=0x7f0898156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08980c6310 0x7f0898156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 -- 172.21.15.27:0/2069371768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888009370 con 0x7f08980691f0 2023-05-17T15:08:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f089df25700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 0x7f08980aebc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f089400b460 tx=0x7f0894006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.239+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894012410 con 0x7f08980691f0 2023-05-17T15:08:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.240+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08940125b0 con 0x7f08980691f0 2023-05-17T15:08:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.240+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08980ae3c0 con 0x7f08980691f0 2023-05-17T15:08:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.240+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894012970 con 0x7f08980691f0 2023-05-17T15:08:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.240+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08980af0b0 con 0x7f08980691f0 2023-05-17T15:08:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.241+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089806bdf0 con 0x7f08980691f0 2023-05-17T15:08:11.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.241+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f089400f030 con 0x7f08980691f0 2023-05-17T15:08:11.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.241+0000 7f088dffb700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f087c05ed90 0x7f087c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.241+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f08940795e0 con 0x7f08980691f0 2023-05-17T15:08:11.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.241+0000 7f089d724700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f087c05ed90 0x7f087c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.242+0000 7f089d724700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f087c05ed90 0x7f087c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f08980c6710 tx=0x7f0888017000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:11.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.245+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f089404ac80 con 0x7f08980691f0 2023-05-17T15:08:11.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.418+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0898069d00 con 0x7f08980691f0 2023-05-17T15:08:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.421+0000 7f088dffb700 1 -- 172.21.15.27:0/2069371768 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f089404e2a0 con 0x7f08980691f0 2023-05-17T15:08:11.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f087c05ed90 msgr2=0x7f087c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f087c05ed90 0x7f087c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f08980c6710 tx=0x7f0888017000).stop 2023-05-17T15:08:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 msgr2=0x7f08980aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 0x7f08980aebc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f089400b460 tx=0x7f0894006f20).stop 2023-05-17T15:08:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 shutdown_connections 2023-05-17T15:08:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f087c05ed90 0x7f087c061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08981543d0 0x7f08980af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08980691f0 0x7f08980aebc0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 --2- 172.21.15.27:0/2069371768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08980c6310 0x7f0898156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 >> 172.21.15.27:0/2069371768 conn(0x7f08980cb7f0 msgr2=0x7f0898153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 shutdown_connections 2023-05-17T15:08:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.423+0000 7f08a0189700 1 -- 172.21.15.27:0/2069371768 wait complete. 2023-05-17T15:08:11.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-05-17T15:08:11.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.552+0000 7f8f3d7b1700 1 Processor -- start 2023-05-17T15:08:11.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.552+0000 7f8f3d7b1700 1 -- start start 2023-05-17T15:08:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.553+0000 7f8f3d7b1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f380bf340 0x7f8f380c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.553+0000 7f8f3d7b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 0x7f8f38065390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.553+0000 7f8f3d7b1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f38152f90 con 0x7f8f380665f0 2023-05-17T15:08:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.553+0000 7f8f3d7b1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f38153420 con 0x7f8f380bf340 2023-05-17T15:08:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.553+0000 7f8f3d7b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38152660 con 0x7f8f380c3db0 2023-05-17T15:08:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f36ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f380bf340 0x7f8f380c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 0x7f8f38065390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 0x7f8f38065390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:39384/0 (socket says 172.21.15.27:39384) 2023-05-17T15:08:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f36ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f380bf340 0x7f8f380c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:56204/0 (socket says 172.21.15.27:56204) 2023-05-17T15:08:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 -- 172.21.15.27:0/2647779124 learned_addr learned my addr 172.21.15.27:0/2647779124 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 -- 172.21.15.27:0/2647779124 >> v2:172.21.15.40:3300/0 conn(0x7f8f380bf340 msgr2=0x7f8f380c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 --2- 172.21.15.27:0/2647779124 >> v2:172.21.15.40:3300/0 conn(0x7f8f380bf340 0x7f8f380c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 -- 172.21.15.27:0/2647779124 >> v1:172.21.15.40:6789/0 conn(0x7f8f380665f0 legacy=0x7f8f38155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 -- 172.21.15.27:0/2647779124 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38152940 con 0x7f8f380c3db0 2023-05-17T15:08:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f367fc700 1 --2- 172.21.15.27:0/2647779124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 0x7f8f38065390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8f2c006fd0 tx=0x7f8f2c0090f0).ready entity=mon.2 client_cookie=23e3720e431cca28 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f35ffb700 1 -- 172.21.15.27:0/2647779124 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00b580 con 0x7f8f380c3db0 2023-05-17T15:08:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f35ffb700 1 -- 172.21.15.27:0/2647779124 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00b6e0 con 0x7f8f380c3db0 2023-05-17T15:08:11.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.554+0000 7f8f35ffb700 1 -- 172.21.15.27:0/2647779124 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00ba60 con 0x7f8f380c3db0 2023-05-17T15:08:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/2647779124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 msgr2=0x7f8f38065390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/2647779124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 0x7f8f38065390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8f2c006fd0 tx=0x7f8f2c0090f0).stop 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/2647779124 shutdown_connections 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/2647779124 >> v2:172.21.15.40:3300/0 conn(0x7f8f380bf340 0x7f8f380c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/2647779124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380c3db0 0x7f8f38065390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/2647779124 >> 172.21.15.27:0/2647779124 conn(0x7f8f380c94a0 msgr2=0x7f8f380c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/2647779124 shutdown_connections 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.555+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/2647779124 wait complete. 2023-05-17T15:08:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.556+0000 7f8f3d7b1700 1 Processor -- start 2023-05-17T15:08:11.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.556+0000 7f8f3d7b1700 1 -- start start 2023-05-17T15:08:11.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f3d7b1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f380665f0 0x7f8f380c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f3d7b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380bf340 0x7f8f380bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f3d7b1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 0x7f8f3813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f3d7b1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380c2eb0 con 0x7f8f380c3db0 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f3d7b1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380ac420 con 0x7f8f380665f0 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f3d7b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380c2670 con 0x7f8f380bf340 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 0x7f8f3813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 0x7f8f3813d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38284/0 (socket says 172.21.15.27:38284) 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 -- 172.21.15.27:0/226686177 learned_addr learned my addr 172.21.15.27:0/226686177 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f367fc700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380bf340 0x7f8f380bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f36ffd700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f380665f0 0x7f8f380c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 -- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380bf340 msgr2=0x7f8f380bfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380bf340 0x7f8f380bfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 -- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f380665f0 msgr2=0x7f8f380c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f380665f0 0x7f8f380c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 -- 172.21.15.27:0/226686177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009370 con 0x7f8f380c3db0 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.557+0000 7f8f377fe700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 0x7f8f3813d1e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f8f2800c7c0 tx=0x7f8f28001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.558+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28010510 con 0x7f8f380c3db0 2023-05-17T15:08:11.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.558+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28010670 con 0x7f8f380c3db0 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.558+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380c0240 con 0x7f8f380c3db0 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.558+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280109f0 con 0x7f8f380c3db0 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.558+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380c28f0 con 0x7f8f380c3db0 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.558+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380ac5b0 con 0x7f8f380c3db0 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.559+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8f28019030 con 0x7f8f380c3db0 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.559+0000 7f8f1effd700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8f2405ed90 0x7f8f24061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:11.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.559+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f8f28079190 con 0x7f8f380c3db0 2023-05-17T15:08:11.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.559+0000 7f8f36ffd700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8f2405ed90 0x7f8f24061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:11.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.560+0000 7f8f36ffd700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8f2405ed90 0x7f8f24061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8f30009bc0 tx=0x7f8f30008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:11.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.563+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f280488f0 con 0x7f8f380c3db0 2023-05-17T15:08:11.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:11.810+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f8f38152c20 con 0x7f8f380c3db0 2023-05-17T15:08:12.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.777+0000 7f8f1effd700 1 -- 172.21.15.27:0/226686177 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v509) v1 ==== 154+0+0 (secure 0 0 0) 0x7f8f2804a8e0 con 0x7f8f380c3db0 2023-05-17T15:08:12.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8f2405ed90 msgr2=0x7f8f24061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:12.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8f2405ed90 0x7f8f24061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8f30009bc0 tx=0x7f8f30008040).stop 2023-05-17T15:08:12.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 msgr2=0x7f8f3813d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 0x7f8f3813d1e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f8f2800c7c0 tx=0x7f8f28001530).stop 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 shutdown_connections 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8f2405ed90 0x7f8f24061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f380c3db0 0x7f8f3813d1e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f380665f0 0x7f8f380c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 --2- 172.21.15.27:0/226686177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f380bf340 0x7f8f380bfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.779+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 >> 172.21.15.27:0/226686177 conn(0x7f8f380c94a0 msgr2=0x7f8f380a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.780+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 shutdown_connections 2023-05-17T15:08:12.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.780+0000 7f8f3d7b1700 1 -- 172.21.15.27:0/226686177 wait complete. 2023-05-17T15:08:12.799 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-05-17T15:08:12.799 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-05-17T15:08:12.800 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:08:12.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-05-17T15:08:12.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.919+0000 7fe50b314700 1 Processor -- start 2023-05-17T15:08:12.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.919+0000 7fe50b314700 1 -- start start 2023-05-17T15:08:12.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe50b314700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5040c5f30 0x7fe5040c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:12.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe50b314700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504158880 0x7fe504153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe50b314700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5040bfcd0 con 0x7fe5041541c0 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe50b314700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5040c0290 con 0x7fe5040c5f30 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe50b314700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040aa1a0 con 0x7fe504158880 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5040c5f30 0x7fe5040c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5040c5f30 0x7fe5040c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38288/0 (socket says 172.21.15.27:38288) 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 -- 172.21.15.27:0/3443501141 learned_addr learned my addr 172.21.15.27:0/3443501141 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:12.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5098b1700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe5041541c0 0x7fe5040c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37850/0 (socket says 172.21.15.27:37850) 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5088af700 1 --2- 172.21.15.27:0/3443501141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504158880 0x7fe504153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 -- 172.21.15.27:0/3443501141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504158880 msgr2=0x7fe504153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 --2- 172.21.15.27:0/3443501141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504158880 0x7fe504153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 -- 172.21.15.27:0/3443501141 >> v1:172.21.15.27:6789/0 conn(0x7fe5041541c0 legacy=0x7fe5040c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.920+0000 7fe5090b0700 1 -- 172.21.15.27:0/3443501141 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040aa480 con 0x7fe5040c5f30 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe5090b0700 1 --2- 172.21.15.27:0/3443501141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5040c5f30 0x7fe5040c6310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fe4fc006fd0 tx=0x7fe4fc0090f0).ready entity=mon.0 client_cookie=123e50eb296bf94b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:12.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe503fff700 1 -- 172.21.15.27:0/3443501141 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00b600 con 0x7fe5040c5f30 2023-05-17T15:08:12.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe503fff700 1 -- 172.21.15.27:0/3443501141 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc00b760 con 0x7fe5040c5f30 2023-05-17T15:08:12.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe503fff700 1 -- 172.21.15.27:0/3443501141 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00bae0 con 0x7fe5040c5f30 2023-05-17T15:08:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 -- 172.21.15.27:0/3443501141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5040c5f30 msgr2=0x7fe5040c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 --2- 172.21.15.27:0/3443501141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5040c5f30 0x7fe5040c6310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fe4fc006fd0 tx=0x7fe4fc0090f0).stop 2023-05-17T15:08:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 -- 172.21.15.27:0/3443501141 shutdown_connections 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 --2- 172.21.15.27:0/3443501141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5040c5f30 0x7fe5040c6310 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 --2- 172.21.15.27:0/3443501141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504158880 0x7fe504153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 -- 172.21.15.27:0/3443501141 >> 172.21.15.27:0/3443501141 conn(0x7fe504069e70 msgr2=0x7fe50405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 -- 172.21.15.27:0/3443501141 shutdown_connections 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.921+0000 7fe50b314700 1 -- 172.21.15.27:0/3443501141 wait complete. 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.922+0000 7fe50b314700 1 Processor -- start 2023-05-17T15:08:12.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.922+0000 7fe50b314700 1 -- start start 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe50b314700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5040c5f30 0x7fe5040a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe50b314700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 0x7fe5040aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe50b314700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504158880 0x7fe5040af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe50b314700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504165b20 con 0x7fe5041541c0 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe50b314700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040af7b0 con 0x7fe504158880 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe50b314700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe504165840 con 0x7fe5040c5f30 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe5088af700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 0x7fe5040aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:12.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe5088af700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 0x7fe5040aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38294/0 (socket says 172.21.15.27:38294) 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.923+0000 7fe5088af700 1 -- 172.21.15.27:0/74269412 learned_addr learned my addr 172.21.15.27:0/74269412 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5090b0700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5040c5f30 0x7fe5040a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5098b1700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504158880 0x7fe5040af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5088af700 1 -- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5040c5f30 msgr2=0x7fe5040a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5088af700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5040c5f30 0x7fe5040a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5088af700 1 -- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504158880 msgr2=0x7fe5040af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:12.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5088af700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504158880 0x7fe5040af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5088af700 1 -- 172.21.15.27:0/74269412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc009370 con 0x7fe5041541c0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5088af700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 0x7fe5040aedd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fe4f800d860 tx=0x7fe4f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8011590 con 0x7fe5041541c0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f80116f0 con 0x7fe5041541c0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe504165e50 con 0x7fe5041541c0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8011a70 con 0x7fe5041541c0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.924+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe504166410 con 0x7fe5041541c0 2023-05-17T15:08:12.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.925+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe504165cb0 con 0x7fe5041541c0 2023-05-17T15:08:12.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.925+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe4f8012420 con 0x7fe5041541c0 2023-05-17T15:08:12.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.926+0000 7fe5017fa700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe4f005ed90 0x7fe4f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:12.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.926+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fe4f80796d0 con 0x7fe5041541c0 2023-05-17T15:08:12.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.926+0000 7fe5090b0700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe4f005ed90 0x7fe4f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:12.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.926+0000 7fe5090b0700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe4f005ed90 0x7fe4f0061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4fc009130 tx=0x7fe4fc017000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:12.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:12.930+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe504165cb0 con 0x7fe5041541c0 2023-05-17T15:08:13.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.173+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fe504165cb0 con 0x7fe5041541c0 2023-05-17T15:08:13.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.779+0000 7fe5017fa700 1 -- 172.21.15.27:0/74269412 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v510) v1 ==== 159+0+0 (secure 0 0 0) 0x7fe504165cb0 con 0x7fe5041541c0 2023-05-17T15:08:13.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe4f005ed90 msgr2=0x7fe4f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:13.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe4f005ed90 0x7fe4f0061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4fc009130 tx=0x7fe4fc017000).stop 2023-05-17T15:08:13.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 msgr2=0x7fe5040aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:13.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 0x7fe5040aedd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fe4f800d860 tx=0x7fe4f8008040).stop 2023-05-17T15:08:13.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 shutdown_connections 2023-05-17T15:08:13.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe4f005ed90 0x7fe4f0061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504158880 0x7fe5040af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5040c5f30 0x7fe5040a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 --2- 172.21.15.27:0/74269412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5041541c0 0x7fe5040aedd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 >> 172.21.15.27:0/74269412 conn(0x7fe504069e70 msgr2=0x7fe5040b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:13.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 shutdown_connections 2023-05-17T15:08:13.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.781+0000 7fe50b314700 1 -- 172.21.15.27:0/74269412 wait complete. 2023-05-17T15:08:13.801 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:08:13.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.922+0000 7fc1b4f4c700 1 Processor -- start 2023-05-17T15:08:13.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.922+0000 7fc1b4f4c700 1 -- start start 2023-05-17T15:08:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1b4f4c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1b00cac00 0x7fc1b00cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1b4f4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b0157980 0x7fc1b00c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1b4f4c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00c60d0 con 0x7fc1b01537e0 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1b4f4c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b01588b0 con 0x7fc1b00cac00 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1b4f4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0157e00 con 0x7fc1b0157980 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1b00cac00 0x7fc1b00cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1affff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc1b01537e0 0x7fc1b0153c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37864/0 (socket says 172.21.15.27:37864) 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1b00cac00 0x7fc1b00cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38300/0 (socket says 172.21.15.27:38300) 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1affff700 1 -- 172.21.15.27:0/4039960619 learned_addr learned my addr 172.21.15.27:0/4039960619 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:13.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1aeffd700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b0157980 0x7fc1b00c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 -- 172.21.15.27:0/4039960619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b0157980 msgr2=0x7fc1b00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b0157980 0x7fc1b00c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 -- 172.21.15.27:0/4039960619 >> v1:172.21.15.27:6789/0 conn(0x7fc1b01537e0 legacy=0x7fc1b0153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1ae7fc700 1 -- 172.21.15.27:0/4039960619 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620902922 0 0) 0x7fc1b00c60d0 con 0x7fc1b01537e0 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 -- 172.21.15.27:0/4039960619 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0158010 con 0x7fc1b00cac00 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1aeffd700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b0157980 0x7fc1b00c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:13.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1af7fe700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b00cac00 0x7fc1b00cafe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fc1a0009790 tx=0x7fc1a0009060).ready entity=mon.0 client_cookie=8dab88733a6aa71a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.923+0000 7fc1ae7fc700 1 -- 172.21.15.27:0/4039960619 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000b580 con 0x7fc1b00cac00 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1ae7fc700 1 -- 172.21.15.27:0/4039960619 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a000b6e0 con 0x7fc1b00cac00 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1ae7fc700 1 -- 172.21.15.27:0/4039960619 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000ba60 con 0x7fc1b00cac00 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/4039960619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b00cac00 msgr2=0x7fc1b00cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b00cac00 0x7fc1b00cafe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fc1a0009790 tx=0x7fc1a0009060).stop 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/4039960619 shutdown_connections 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b00cac00 0x7fc1b00cafe0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/4039960619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b0157980 0x7fc1b00c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/4039960619 >> 172.21.15.27:0/4039960619 conn(0x7fc1b005dd50 msgr2=0x7fc1b005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/4039960619 shutdown_connections 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.924+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/4039960619 wait complete. 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.925+0000 7fc1b4f4c700 1 Processor -- start 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.925+0000 7fc1b4f4c700 1 -- start start 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1b4f4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b00cac00 0x7fc1b014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:13.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1b4f4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b01537e0 0x7fc1b0151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1b4f4c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 0x7fc1b0156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1b4f4c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0157290 con 0x7fc1b0157980 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1b4f4c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0151aa0 con 0x7fc1b00cac00 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1b4f4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0156a50 con 0x7fc1b01537e0 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 0x7fc1b0156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 0x7fc1b0156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38308/0 (socket says 172.21.15.27:38308) 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 -- 172.21.15.27:0/2330139425 learned_addr learned my addr 172.21.15.27:0/2330139425 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:13.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1aeffd700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b01537e0 0x7fc1b0151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1af7fe700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b00cac00 0x7fc1b014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 -- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b01537e0 msgr2=0x7fc1b0151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b01537e0 0x7fc1b0151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 -- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b00cac00 msgr2=0x7fc1b014e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b00cac00 0x7fc1b014e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.926+0000 7fc1affff700 1 -- 172.21.15.27:0/2330139425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00092a0 con 0x7fc1b0157980 2023-05-17T15:08:13.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.927+0000 7fc1affff700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 0x7fc1b0156560 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fc1a800c810 tx=0x7fc1a8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.927+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8005d30 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.927+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8005e90 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.927+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b0156cd0 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.927+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8007320 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.927+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b0151730 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.928+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b0151c50 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.928+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc1a8010030 con 0x7fc1b0157980 2023-05-17T15:08:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.928+0000 7fc1977fe700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc19c05ed60 0x7fc19c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:13.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.928+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fc1a8079980 con 0x7fc1b0157980 2023-05-17T15:08:13.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.929+0000 7fc1af7fe700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc19c05ed60 0x7fc19c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:13.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.929+0000 7fc1af7fe700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc19c05ed60 0x7fc19c061220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc1a0009fd0 tx=0x7fc1a0017000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:13.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:13.933+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1b0151c50 con 0x7fc1b0157980 2023-05-17T15:08:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.107+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc1b0151c50 con 0x7fc1b0157980 2023-05-17T15:08:14.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.112+0000 7fc1977fe700 1 -- 172.21.15.27:0/2330139425 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc1b0151c50 con 0x7fc1b0157980 2023-05-17T15:08:14.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc19c05ed60 msgr2=0x7fc19c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc19c05ed60 0x7fc19c061220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc1a0009fd0 tx=0x7fc1a0017000).stop 2023-05-17T15:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 msgr2=0x7fc1b0156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 0x7fc1b0156560 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fc1a800c810 tx=0x7fc1a8007f90).stop 2023-05-17T15:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 shutdown_connections 2023-05-17T15:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc19c05ed60 0x7fc19c061220 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1b0157980 0x7fc1b0156560 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b00cac00 0x7fc1b014e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 --2- 172.21.15.27:0/2330139425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1b01537e0 0x7fc1b0151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.114+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 >> 172.21.15.27:0/2330139425 conn(0x7fc1b005dd50 msgr2=0x7fc1b014f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:14.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.115+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 shutdown_connections 2023-05-17T15:08:14.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.115+0000 7fc1b4f4c700 1 -- 172.21.15.27:0/2330139425 wait complete. 2023-05-17T15:08:14.131 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:08:14.132 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:14.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:14.194 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:08:14.194 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:08:14.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:14.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.310+0000 7fa928964700 1 Processor -- start 2023-05-17T15:08:14.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.310+0000 7fa928964700 1 -- start start 2023-05-17T15:08:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.311+0000 7fa928964700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9240bf340 0x7fa9240c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.311+0000 7fa928964700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.311+0000 7fa928964700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa924152f90 con 0x7fa9240c3db0 2023-05-17T15:08:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.311+0000 7fa928964700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa924153420 con 0x7fa9240bf340 2023-05-17T15:08:14.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.311+0000 7fa928964700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa924152660 con 0x7fa924065aa0 2023-05-17T15:08:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa92259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9240bf340 0x7fa9240c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa922d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa92259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9240bf340 0x7fa9240c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:56242/0 (socket says 172.21.15.27:56242) 2023-05-17T15:08:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa92259c700 1 -- 172.21.15.27:0/1120512945 learned_addr learned my addr 172.21.15.27:0/1120512945 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa922d9d700 1 -- 172.21.15.27:0/1120512945 >> v2:172.21.15.40:3300/0 conn(0x7fa9240bf340 msgr2=0x7fa9240c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:14.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa922d9d700 1 --2- 172.21.15.27:0/1120512945 >> v2:172.21.15.40:3300/0 conn(0x7fa9240bf340 0x7fa9240c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa922d9d700 1 -- 172.21.15.27:0/1120512945 >> v1:172.21.15.40:6789/0 conn(0x7fa9240c3db0 legacy=0x7fa924065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa922d9d700 1 -- 172.21.15.27:0/1120512945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924152940 con 0x7fa924065aa0 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa922d9d700 1 --2- 172.21.15.27:0/1120512945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240bd9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa91c009e60 tx=0x7fa91c009780).ready entity=mon.2 client_cookie=447dd00d2dd6179c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa921d9b700 1 -- 172.21.15.27:0/1120512945 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00e070 con 0x7fa924065aa0 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa921d9b700 1 -- 172.21.15.27:0/1120512945 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c00bb60 con 0x7fa924065aa0 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.312+0000 7fa921d9b700 1 -- 172.21.15.27:0/1120512945 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c012410 con 0x7fa924065aa0 2023-05-17T15:08:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 -- 172.21.15.27:0/1120512945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 msgr2=0x7fa9240bd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 --2- 172.21.15.27:0/1120512945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240bd9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa91c009e60 tx=0x7fa91c009780).stop 2023-05-17T15:08:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 -- 172.21.15.27:0/1120512945 shutdown_connections 2023-05-17T15:08:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 --2- 172.21.15.27:0/1120512945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240bd9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 --2- 172.21.15.27:0/1120512945 >> v2:172.21.15.40:3300/0 conn(0x7fa9240bf340 0x7fa9240c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 -- 172.21.15.27:0/1120512945 >> 172.21.15.27:0/1120512945 conn(0x7fa9240c94a0 msgr2=0x7fa9240c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 -- 172.21.15.27:0/1120512945 shutdown_connections 2023-05-17T15:08:14.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.313+0000 7fa928964700 1 -- 172.21.15.27:0/1120512945 wait complete. 2023-05-17T15:08:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.314+0000 7fa928964700 1 Processor -- start 2023-05-17T15:08:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.314+0000 7fa928964700 1 -- start start 2023-05-17T15:08:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa928964700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa928964700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9240bf340 0x7fa924168800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa928964700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 0x7fa924168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa928964700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924169840 con 0x7fa9240c3db0 2023-05-17T15:08:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa928964700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924169280 con 0x7fa9240bf340 2023-05-17T15:08:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa928964700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa924169560 con 0x7fa924065aa0 2023-05-17T15:08:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 0x7fa924168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 0x7fa924168cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38322/0 (socket says 172.21.15.27:38322) 2023-05-17T15:08:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 -- 172.21.15.27:0/541071475 learned_addr learned my addr 172.21.15.27:0/541071475 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa91bfff700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9240bf340 0x7fa924168800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa92259c700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 -- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 msgr2=0x7fa9240ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 -- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9240bf340 msgr2=0x7fa924168800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9240bf340 0x7fa924168800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 -- 172.21.15.27:0/541071475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009a20 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.315+0000 7fa922d9d700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 0x7fa924168cf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fa9241527a0 tx=0x7fa91c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.316+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c012410 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.316+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c01d630 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.316+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9240a8b80 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.316+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c01d9f0 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.316+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9240ae740 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.317+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9240a89e0 con 0x7fa9240c3db0 2023-05-17T15:08:14.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.317+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa91c026410 con 0x7fa9240c3db0 2023-05-17T15:08:14.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.317+0000 7fa91a7fc700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa90405ed90 0x7fa904061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.317+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fa91c07bc30 con 0x7fa9240c3db0 2023-05-17T15:08:14.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.318+0000 7fa92259c700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa90405ed90 0x7fa904061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.318+0000 7fa92259c700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa90405ed90 0x7fa904061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa9240ab350 tx=0x7fa9140090f0).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:14.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.322+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9240a89e0 con 0x7fa9240c3db0 2023-05-17T15:08:14.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.538+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9240a89e0 con 0x7fa9240c3db0 2023-05-17T15:08:14.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.538+0000 7fa91a7fc700 1 -- 172.21.15.27:0/541071475 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fa9240a89e0 con 0x7fa9240c3db0 2023-05-17T15:08:14.544 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:14.544 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5081,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2796093504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2796093504},{"type":"v1","addr":"172.21.15.40:6834","nonce":2796093504}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/4059938132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4059938132},{"type":"v1","addr":"172.21.15.40:6835","nonce":4059938132}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/4002084381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":4002084381},{"type":"v1","addr":"172.21.15.27:6835","nonce":4002084381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/2352191757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2352191757},{"type":"v1","addr":"172.21.15.27:6833","nonce":2352191757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-05-17T15:08:14.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa90405ed90 msgr2=0x7fa904061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa90405ed90 0x7fa904061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa9240ab350 tx=0x7fa9140090f0).stop 2023-05-17T15:08:14.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 msgr2=0x7fa924168cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 0x7fa924168cf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fa9241527a0 tx=0x7fa91c009780).stop 2023-05-17T15:08:14.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 shutdown_connections 2023-05-17T15:08:14.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa90405ed90 0x7fa904061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9240c3db0 0x7fa924168cf0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa924065aa0 0x7fa9240ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 --2- 172.21.15.27:0/541071475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9240bf340 0x7fa924168800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 >> 172.21.15.27:0/541071475 conn(0x7fa9240c94a0 msgr2=0x7fa924150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:14.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 shutdown_connections 2023-05-17T15:08:14.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.540+0000 7fa928964700 1 -- 172.21.15.27:0/541071475 wait complete. 2023-05-17T15:08:14.548 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 25 2023-05-17T15:08:14.557 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:08:14.558 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:08:14.558 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:08:14.558 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:14.559 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:08:14.559 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:08:14.559 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:08:14.559 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:14.560 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:08:14.560 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:08:14.560 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:08:14.560 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:14.561 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:08:14.561 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:08:14.561 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:08:14.561 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:14.567 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:08:14.567 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:08:14.569 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:08:14.569 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:08:14.571 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:08:14.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:08:14.572 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:08:14.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:08:14.610 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:08:14.611 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:14.612 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:08:14.612 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:14.614 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:08:14.615 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:14.615 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:08:14.616 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:14.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:08:14.685 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:08:14.686 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:08:14.702 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:08:14.702 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:08:14.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.739+0000 7f13dcfc6700 1 Processor -- start 2023-05-17T15:08:14.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.740+0000 7f13dcfc6700 1 -- start start 2023-05-17T15:08:14.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13dcfc6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13d814af00 0x7f13d80c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13dcfc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d8151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13dcfc6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f13d8151d30 0x7f13d8154670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13dcfc6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80c73b0 con 0x7f13d8151d30 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13dcfc6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d81513b0 con 0x7f13d814af00 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13dcfc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8151050 con 0x7f13d814b2e0 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f13d8151d30 0x7f13d8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f13d8151d30 0x7f13d8154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38354/0 (socket says 172.21.15.27:38354) 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 -- 172.21.15.27:0/3701034052 learned_addr learned my addr 172.21.15.27:0/3701034052 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d659c700 1 --2- 172.21.15.27:0/3701034052 >> v2:172.21.15.40:3300/0 conn(0x7f13d814af00 0x7f13d80c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d5d9b700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d8151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 -- 172.21.15.27:0/3701034052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 msgr2=0x7f13d8151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d8151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 -- 172.21.15.27:0/3701034052 >> v2:172.21.15.40:3300/0 conn(0x7f13d814af00 msgr2=0x7f13d80c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 --2- 172.21.15.27:0/3701034052 >> v2:172.21.15.40:3300/0 conn(0x7f13d814af00 0x7f13d80c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 -- 172.21.15.27:0/3701034052 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80a6720 con 0x7f13d8151d30 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d5d9b700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d8151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:14.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d6d9d700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8154670 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f13d80c53a0 tx=0x7f13c80090f0).ready entity=mon.0 client_cookie=e6f04e093968e89f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:14.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d559a700 1 -- 172.21.15.27:0/3701034052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800b520 con 0x7f13d8151d30 2023-05-17T15:08:14.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d559a700 1 -- 172.21.15.27:0/3701034052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800b680 con 0x7f13d8151d30 2023-05-17T15:08:14.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.741+0000 7f13d559a700 1 -- 172.21.15.27:0/3701034052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800ba00 con 0x7f13d8151d30 2023-05-17T15:08:14.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 -- 172.21.15.27:0/3701034052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 msgr2=0x7f13d8154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8154670 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f13d80c53a0 tx=0x7f13c80090f0).stop 2023-05-17T15:08:14.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 -- 172.21.15.27:0/3701034052 shutdown_connections 2023-05-17T15:08:14.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8154670 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/3701034052 >> v2:172.21.15.40:3300/0 conn(0x7f13d814af00 0x7f13d80c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/3701034052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d8151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 -- 172.21.15.27:0/3701034052 >> 172.21.15.27:0/3701034052 conn(0x7f13d80c7890 msgr2=0x7f13d80c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:14.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 -- 172.21.15.27:0/3701034052 shutdown_connections 2023-05-17T15:08:14.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.742+0000 7f13dcfc6700 1 -- 172.21.15.27:0/3701034052 wait complete. 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.743+0000 7f13dcfc6700 1 Processor -- start 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.743+0000 7f13dcfc6700 1 -- start start 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13dcfc6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13d814af00 0x7f13d80a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13dcfc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d80a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13dcfc6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13dcfc6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d81488d0 con 0x7f13d8151d30 2023-05-17T15:08:14.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13dcfc6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8165c80 con 0x7f13d814af00 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13dcfc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80a9430 con 0x7f13d814b2e0 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38360/0 (socket says 172.21.15.27:38360) 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 -- 172.21.15.27:0/2682175927 learned_addr learned my addr 172.21.15.27:0/2682175927 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d659c700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13d814af00 0x7f13d80a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d5d9b700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d80a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 -- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 msgr2=0x7f13d80a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d80a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 -- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13d814af00 msgr2=0x7f13d80a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13d814af00 0x7f13d80a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.744+0000 7f13d6d9d700 1 -- 172.21.15.27:0/2682175927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c8009370 con 0x7f13d8151d30 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.745+0000 7f13d6d9d700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8165100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f13d80be8c0 tx=0x7f13c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.745+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800b7f0 con 0x7f13d8151d30 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.745+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800b950 con 0x7f13d8151d30 2023-05-17T15:08:14.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.745+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c801c670 con 0x7f13d8151d30 2023-05-17T15:08:14.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.745+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d80a9710 con 0x7f13d8151d30 2023-05-17T15:08:14.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.745+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d80a7c50 con 0x7f13d8151d30 2023-05-17T15:08:14.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.746+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d80a7e70 con 0x7f13d8151d30 2023-05-17T15:08:14.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.746+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f13c802c070 con 0x7f13d8151d30 2023-05-17T15:08:14.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.747+0000 7f13ce7fc700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f13b805ed90 0x7f13b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:14.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.747+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f13c807baf0 con 0x7f13d8151d30 2023-05-17T15:08:14.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.747+0000 7f13d659c700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f13b805ed90 0x7f13b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:14.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.747+0000 7f13d659c700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f13b805ed90 0x7f13b8061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f13d0007600 tx=0x7f13d000b040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:14.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.750+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13c804d100 con 0x7f13d8151d30 2023-05-17T15:08:14.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:14.942+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13d8165a10 con 0x7f13d8151d30 2023-05-17T15:08:15.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.798+0000 7f13ce7fc700 1 -- 172.21.15.27:0/2682175927 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13c802a020 con 0x7f13d8151d30 2023-05-17T15:08:15.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f13b805ed90 msgr2=0x7f13b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f13b805ed90 0x7f13b8061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f13d0007600 tx=0x7f13d000b040).stop 2023-05-17T15:08:15.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 msgr2=0x7f13d8165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8165100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f13d80be8c0 tx=0x7f13c8017000).stop 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 shutdown_connections 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f13b805ed90 0x7f13b8061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13d8151d30 0x7f13d8165100 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13d814af00 0x7f13d80a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 --2- 172.21.15.27:0/2682175927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13d814b2e0 0x7f13d80a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 >> 172.21.15.27:0/2682175927 conn(0x7f13d80c7890 msgr2=0x7f13d814a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 shutdown_connections 2023-05-17T15:08:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.801+0000 7f13dcfc6700 1 -- 172.21.15.27:0/2682175927 wait complete. 2023-05-17T15:08:15.808 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:08:15.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:08:15.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.939+0000 7fa800042700 1 Processor -- start 2023-05-17T15:08:15.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.939+0000 7fa800042700 1 -- start start 2023-05-17T15:08:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.939+0000 7fa800042700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f80c5f30 0x7fa7f80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa800042700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80bfcd0 con 0x7fa7f8158880 2023-05-17T15:08:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa800042700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80c0290 con 0x7fa7f81543e0 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa800042700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80aa1a0 con 0x7fa7f80c5f30 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fd5dd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa7f8158880 0x7fa7f8153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37932/0 (socket says 172.21.15.27:37932) 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fd5dd700 1 -- 172.21.15.27:0/1787858305 learned_addr learned my addr 172.21.15.27:0/1787858305 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fddde700 1 --2- 172.21.15.27:0/1787858305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f80c5f30 0x7fa7f80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575429334 0 0) 0x7fa7f80bfcd0 con 0x7fa7f8158880 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e00033f0 con 0x7fa7f8158880 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35337927 0 0) 0x7fa7f80c0290 con 0x7fa7f81543e0 2023-05-17T15:08:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f80bfcd0 con 0x7fa7f81543e0 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fddde700 1 -- 172.21.15.27:0/1787858305 >> v1:172.21.15.40:6789/0 conn(0x7fa7f81543e0 legacy=0x7fa7f80c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735361918 0 0) 0x7fa7e00033f0 con 0x7fa7f8158880 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fddde700 1 -- 172.21.15.27:0/1787858305 >> v1:172.21.15.27:6789/0 conn(0x7fa7f8158880 legacy=0x7fa7f8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fddde700 1 -- 172.21.15.27:0/1787858305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80aa480 con 0x7fa7f80c5f30 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.940+0000 7fa7fddde700 1 --2- 172.21.15.27:0/1787858305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f80c5f30 0x7fa7f80c6310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa7f0009790 tx=0x7fa7f0009060).ready entity=mon.2 client_cookie=14739bf5123b12c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec001470 con 0x7fa7f80c5f30 2023-05-17T15:08:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0011400 con 0x7fa7f80c5f30 2023-05-17T15:08:15.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa7fcddc700 1 -- 172.21.15.27:0/1787858305 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0011780 con 0x7fa7f80c5f30 2023-05-17T15:08:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 -- 172.21.15.27:0/1787858305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f80c5f30 msgr2=0x7fa7f80c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 --2- 172.21.15.27:0/1787858305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f80c5f30 0x7fa7f80c6310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa7f0009790 tx=0x7fa7f0009060).stop 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 -- 172.21.15.27:0/1787858305 shutdown_connections 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 --2- 172.21.15.27:0/1787858305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f80c5f30 0x7fa7f80c6310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 -- 172.21.15.27:0/1787858305 >> 172.21.15.27:0/1787858305 conn(0x7fa7f8069e70 msgr2=0x7fa7f805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 -- 172.21.15.27:0/1787858305 shutdown_connections 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.941+0000 7fa800042700 1 -- 172.21.15.27:0/1787858305 wait complete. 2023-05-17T15:08:15.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.942+0000 7fa800042700 1 Processor -- start 2023-05-17T15:08:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.942+0000 7fa800042700 1 -- start start 2023-05-17T15:08:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa800042700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 0x7fa7f814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa800042700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f81543e0 0x7fa7f80c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa800042700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7f8158880 0x7fa7f80c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:15.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa800042700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81501a0 con 0x7fa7f80c5f30 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa800042700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c2840 con 0x7fa7f8158880 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa800042700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c2b20 con 0x7fa7f81543e0 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa7fddde700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 0x7fa7f814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa7fddde700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 0x7fa7f814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38376/0 (socket says 172.21.15.27:38376) 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa7fddde700 1 -- 172.21.15.27:0/2742191551 learned_addr learned my addr 172.21.15.27:0/2742191551 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa7fd5dd700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f81543e0 0x7fa7f80c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.943+0000 7fa7fe5df700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7f8158880 0x7fa7f80c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:15.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7fddde700 1 -- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f81543e0 msgr2=0x7fa7f80c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7fddde700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f81543e0 0x7fa7f80c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7fddde700 1 -- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7f8158880 msgr2=0x7fa7f80c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7fddde700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7f8158880 0x7fa7f80c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7fddde700 1 -- 172.21.15.27:0/2742191551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00092a0 con 0x7fa7f80c5f30 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7fddde700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 0x7fa7f814dac0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fa7f8083770 tx=0x7fa7f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0010740 con 0x7fa7f80c5f30 2023-05-17T15:08:15.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f00108a0 con 0x7fa7f80c5f30 2023-05-17T15:08:15.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f80c2e00 con 0x7fa7f80c5f30 2023-05-17T15:08:15.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0010c60 con 0x7fa7f80c5f30 2023-05-17T15:08:15.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.944+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f81581f0 con 0x7fa7f80c5f30 2023-05-17T15:08:15.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.945+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f805f4a0 con 0x7fa7f80c5f30 2023-05-17T15:08:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.945+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa7f0024030 con 0x7fa7f80c5f30 2023-05-17T15:08:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.946+0000 7fa7f5ffb700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa7e405ed90 0x7fa7e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.946+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5341+0+0 (secure 0 0 0) 0x7fa7f007a300 con 0x7fa7f80c5f30 2023-05-17T15:08:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.946+0000 7fa7fd5dd700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa7e405ed90 0x7fa7e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.946+0000 7fa7fd5dd700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa7e405ed90 0x7fa7e4061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa7f8151ca0 tx=0x7fa7ec000bc0).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:15.950+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7f004baa0 con 0x7fa7f80c5f30 2023-05-17T15:08:16.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.185+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa7f806bdf0 con 0x7fa7f80c5f30 2023-05-17T15:08:16.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.185+0000 7fa7f5ffb700 1 -- 172.21.15.27:0/2742191551 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fa7f004f0c0 con 0x7fa7f80c5f30 2023-05-17T15:08:16.190 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:16.190 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.191 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:16.192 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:16.192 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.192 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.192 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:16.193 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.194 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:08:16.195 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.196 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.197 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.198 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.199 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:08:16.200 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.201 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.201 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.201 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.201 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.201 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.201 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.202 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.203 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:08:16.203 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:08:16.203 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.204 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:08:16.205 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:08:16.205 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.205 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.205 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.205 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:16.206 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:08:16.207 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.208 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:08:16.210 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.211 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:08:16.212 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:08:16.215 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:16.216 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.216 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:16.216 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:08:16.216 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:08:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa7e405ed90 msgr2=0x7fa7e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa7e405ed90 0x7fa7e4061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa7f8151ca0 tx=0x7fa7ec000bc0).stop 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 msgr2=0x7fa7f814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 0x7fa7f814dac0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fa7f8083770 tx=0x7fa7f0016000).stop 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 shutdown_connections 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa7e405ed90 0x7fa7e4061250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7f8158880 0x7fa7f80c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7f80c5f30 0x7fa7f814dac0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 --2- 172.21.15.27:0/2742191551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7f81543e0 0x7fa7f80c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 >> 172.21.15.27:0/2742191551 conn(0x7fa7f8069e70 msgr2=0x7fa7f80aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:16.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 shutdown_connections 2023-05-17T15:08:16.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.188+0000 7fa800042700 1 -- 172.21.15.27:0/2742191551 wait complete. 2023-05-17T15:08:16.219 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:16.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 Processor -- start 2023-05-17T15:08:16.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 -- start start 2023-05-17T15:08:16.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f46e41541c0 0x7f46e40c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40bfcd0 con 0x7f46e40c5f30 2023-05-17T15:08:16.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e40c0290 con 0x7f46e41541c0 2023-05-17T15:08:16.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46ea658700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40aa1a0 con 0x7f46e40c6310 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e8bf5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f46e41541c0 0x7f46e40c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e3fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f46e40c5f30 0x7f46e4158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37944/0 (socket says 172.21.15.27:37944) 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e3fff700 1 -- 172.21.15.27:0/3948517428 learned_addr learned my addr 172.21.15.27:0/3948517428 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46dbfff700 1 --2- 172.21.15.27:0/3948517428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e8bf5700 1 -- 172.21.15.27:0/3948517428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 msgr2=0x7f46e4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e8bf5700 1 --2- 172.21.15.27:0/3948517428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e8bf5700 1 -- 172.21.15.27:0/3948517428 >> v1:172.21.15.27:6789/0 conn(0x7f46e40c5f30 legacy=0x7f46e4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e37fe700 1 -- 172.21.15.27:0/3948517428 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467655744 0 0) 0x7f46e40bfcd0 con 0x7f46e40c5f30 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e8bf5700 1 -- 172.21.15.27:0/3948517428 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40aa480 con 0x7f46e41541c0 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e8bf5700 1 --2- 172.21.15.27:0/3948517428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40c0720 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f46dc009e60 tx=0x7f46dc009780).ready entity=mon.0 client_cookie=e0f5b4194232931d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e37fe700 1 -- 172.21.15.27:0/3948517428 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00e070 con 0x7f46e41541c0 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e37fe700 1 -- 172.21.15.27:0/3948517428 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00bc30 con 0x7f46e41541c0 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.332+0000 7f46e37fe700 1 -- 172.21.15.27:0/3948517428 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc012410 con 0x7f46e41541c0 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 -- 172.21.15.27:0/3948517428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 msgr2=0x7f46e40c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 --2- 172.21.15.27:0/3948517428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40c0720 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f46dc009e60 tx=0x7f46dc009780).stop 2023-05-17T15:08:16.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 -- 172.21.15.27:0/3948517428 shutdown_connections 2023-05-17T15:08:16.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 --2- 172.21.15.27:0/3948517428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40c0720 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 --2- 172.21.15.27:0/3948517428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 -- 172.21.15.27:0/3948517428 >> 172.21.15.27:0/3948517428 conn(0x7f46e4069e70 msgr2=0x7f46e405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:16.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 -- 172.21.15.27:0/3948517428 shutdown_connections 2023-05-17T15:08:16.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.333+0000 7f46ea658700 1 -- 172.21.15.27:0/3948517428 wait complete. 2023-05-17T15:08:16.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.334+0000 7f46ea658700 1 Processor -- start 2023-05-17T15:08:16.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.334+0000 7f46ea658700 1 -- start start 2023-05-17T15:08:16.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46ea658700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46e40c5f30 0x7f46e40ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46ea658700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46ea658700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46ea658700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4164490 con 0x7f46e41541c0 2023-05-17T15:08:16.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46ea658700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c97f0 con 0x7f46e40c5f30 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46ea658700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c8c20 con 0x7f46e40c6310 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38392/0 (socket says 172.21.15.27:38392) 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 -- 172.21.15.27:0/2763722897 learned_addr learned my addr 172.21.15.27:0/2763722897 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46dbfff700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e3fff700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46e40c5f30 0x7f46e40ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 -- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 msgr2=0x7f46e4143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 -- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46e40c5f30 msgr2=0x7f46e40ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46e40c5f30 0x7f46e40ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e8bf5700 1 -- 172.21.15.27:0/2763722897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc009a20 con 0x7f46e41541c0 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.335+0000 7f46e3fff700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46e40c5f30 0x7f46e40ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.336+0000 7f46e8bf5700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40ac450 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f46dc00b6c0 tx=0x7f46dc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.336+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc011750 con 0x7f46e41541c0 2023-05-17T15:08:16.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.336+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc0118b0 con 0x7f46e41541c0 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.336+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc011c70 con 0x7f46e41541c0 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.336+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e40c8ec0 con 0x7f46e41541c0 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.336+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e40c9480 con 0x7f46e41541c0 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.337+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e40c9960 con 0x7f46e41541c0 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.337+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f46dc01d630 con 0x7f46e41541c0 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.337+0000 7f46e0ff9700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f46c405ed90 0x7f46c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.337+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f46dc07bc40 con 0x7f46e41541c0 2023-05-17T15:08:16.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.337+0000 7f46e3fff700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f46c405ed90 0x7f46c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.338+0000 7f46e3fff700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f46c405ed90 0x7f46c4061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f46d40016f0 tx=0x7f46d4009040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.343+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46dc04d4f0 con 0x7f46e41541c0 2023-05-17T15:08:16.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.516+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46e405f4a0 con 0x7f46e41541c0 2023-05-17T15:08:16.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.517+0000 7f46e0ff9700 1 -- 172.21.15.27:0/2763722897 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13826 (secure 0 0 0) 0x7f46dc050b10 con 0x7f46e41541c0 2023-05-17T15:08:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:16.522 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":79,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:15.789774+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:16.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f46c405ed90 msgr2=0x7f46c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f46c405ed90 0x7f46c4061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f46d40016f0 tx=0x7f46d4009040).stop 2023-05-17T15:08:16.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 msgr2=0x7f46e40ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40ac450 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f46dc00b6c0 tx=0x7f46dc009780).stop 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 shutdown_connections 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f46c405ed90 0x7f46c4061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46e41541c0 0x7f46e40ac450 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46e40c5f30 0x7f46e40ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 --2- 172.21.15.27:0/2763722897 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46e40c6310 0x7f46e4143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 >> 172.21.15.27:0/2763722897 conn(0x7f46e4069e70 msgr2=0x7f46e414f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:16.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 shutdown_connections 2023-05-17T15:08:16.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.519+0000 7f46ea658700 1 -- 172.21.15.27:0/2763722897 wait complete. 2023-05-17T15:08:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:08:16.536 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:08:16.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.650+0000 7feef4a9a700 1 Processor -- start 2023-05-17T15:08:16.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.650+0000 7feef4a9a700 1 -- start start 2023-05-17T15:08:16.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.651+0000 7feef4a9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feef01543d0 0x7feef00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.651+0000 7feef4a9a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef0158790 con 0x7feef00c60f0 2023-05-17T15:08:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.651+0000 7feef4a9a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00c6570 con 0x7feef0069410 2023-05-17T15:08:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.651+0000 7feef4a9a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef00c1c50 con 0x7feef01543d0 2023-05-17T15:08:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.651+0000 7feeedd9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7feef00c60f0 0x7feef0068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37958/0 (socket says 172.21.15.27:37958) 2023-05-17T15:08:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.651+0000 7feeedd9b700 1 -- 172.21.15.27:0/2118945178 learned_addr learned my addr 172.21.15.27:0/2118945178 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 --2- 172.21.15.27:0/2118945178 >> v2:172.21.15.40:3300/0 conn(0x7feef01543d0 0x7feef00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078637259 0 0) 0x7feef0158790 con 0x7feef00c60f0 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc0033f0 con 0x7feef00c60f0 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206917598 0 0) 0x7feedc0033f0 con 0x7feef00c60f0 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 >> v2:172.21.15.40:3300/0 conn(0x7feef01543d0 msgr2=0x7feef00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 --2- 172.21.15.27:0/2118945178 >> v2:172.21.15.40:3300/0 conn(0x7feef01543d0 0x7feef00c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 >> v1:172.21.15.40:6789/0 conn(0x7feef0069410 legacy=0x7feef00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0157e60 con 0x7feef00c60f0 2023-05-17T15:08:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7feed8001470 con 0x7feef00c60f0 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 >> v1:172.21.15.27:6789/0 conn(0x7feef00c60f0 legacy=0x7feef0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc004690 0x7feedc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feedc005000 0x7feedc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00be80 con 0x7feedc0038e0 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00bff0 con 0x7feedc004690 2023-05-17T15:08:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00c1b0 con 0x7feedc005000 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeedd9b700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc004690 0x7feedc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeeed9d700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feedc005000 0x7feedc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 -- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feedc005000 msgr2=0x7feedc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feedc005000 0x7feedc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 -- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc004690 msgr2=0x7feedc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc004690 0x7feedc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeee59c700 1 -- 172.21.15.27:0/2118945178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0033f0 con 0x7feedc0038e0 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.652+0000 7feeeed9d700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feedc005000 0x7feedc00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feeeed9d700 1 -- 172.21.15.27:0/2118945178 reap_dead start 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feeee59c700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7feee800e210 tx=0x7feee800b040).ready entity=mon.0 client_cookie=424eac56ecef5f1d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8009ac0 con 0x7feedc0038e0 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800f040 con 0x7feedc0038e0 2023-05-17T15:08:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feeed59a700 1 -- 172.21.15.27:0/2118945178 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800ecd0 con 0x7feedc0038e0 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 -- 172.21.15.27:0/2118945178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feedc0038e0 msgr2=0x7feedc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7feee800e210 tx=0x7feee800b040).stop 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 -- 172.21.15.27:0/2118945178 shutdown_connections 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2118945178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 -- 172.21.15.27:0/2118945178 >> 172.21.15.27:0/2118945178 conn(0x7feef00cb7f0 msgr2=0x7feef00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 -- 172.21.15.27:0/2118945178 shutdown_connections 2023-05-17T15:08:16.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.653+0000 7feef4a9a700 1 -- 172.21.15.27:0/2118945178 wait complete. 2023-05-17T15:08:16.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 Processor -- start 2023-05-17T15:08:16.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 -- start start 2023-05-17T15:08:16.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc0038e0 0x7feef00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feef00ae850 0x7feef00afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 0x7feef00a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00ae1c0 con 0x7feef00aecd0 2023-05-17T15:08:16.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0164f40 con 0x7feedc0038e0 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feef4a9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef01643c0 con 0x7feef00ae850 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feeeed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 0x7feef00a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feeeed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 0x7feef00a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38410/0 (socket says 172.21.15.27:38410) 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.655+0000 7feeeed9d700 1 -- 172.21.15.27:0/2915912410 learned_addr learned my addr 172.21.15.27:0/2915912410 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeee59c700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc0038e0 0x7feef00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeedd9b700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feef00ae850 0x7feef00afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeeed9d700 1 -- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feef00ae850 msgr2=0x7feef00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeeed9d700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feef00ae850 0x7feef00afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeeed9d700 1 -- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc0038e0 msgr2=0x7feef00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeeed9d700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc0038e0 0x7feef00adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeeed9d700 1 -- 172.21.15.27:0/2915912410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef01646a0 con 0x7feef00aecd0 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feeeed9d700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 0x7feef00a9ba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7feef00836c0 tx=0x7feee0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000ee20 con 0x7feef00aecd0 2023-05-17T15:08:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0014430 con 0x7feef00aecd0 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef0164980 con 0x7feef00aecd0 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00147b0 con 0x7feef00aecd0 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.656+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef0163fe0 con 0x7feef00aecd0 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.657+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef00c2d90 con 0x7feef00aecd0 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.657+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feee001c060 con 0x7feef00aecd0 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.658+0000 7feee67fc700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feed005ed90 0x7feed0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.658+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5341+0+0 (secure 0 0 0) 0x7feee0078db0 con 0x7feef00aecd0 2023-05-17T15:08:16.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.658+0000 7feeee59c700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feed005ed90 0x7feed0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.658+0000 7feeee59c700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feed005ed90 0x7feed0061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7feee800afd0 tx=0x7feee801a000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.662+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feef00c2d90 con 0x7feef00aecd0 2023-05-17T15:08:16.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.834+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feef00c2d90 con 0x7feef00aecd0 2023-05-17T15:08:16.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.834+0000 7feee67fc700 1 -- 172.21.15.27:0/2915912410 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7feef00c2d90 con 0x7feef00aecd0 2023-05-17T15:08:16.838 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:08:16.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feed005ed90 msgr2=0x7feed0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feed005ed90 0x7feed0061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7feee800afd0 tx=0x7feee801a000).stop 2023-05-17T15:08:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 msgr2=0x7feef00a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 0x7feef00a9ba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7feef00836c0 tx=0x7feee0009040).stop 2023-05-17T15:08:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 shutdown_connections 2023-05-17T15:08:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feed005ed90 0x7feed0061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feef00aecd0 0x7feef00a9ba0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feedc0038e0 0x7feef00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 --2- 172.21.15.27:0/2915912410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feef00ae850 0x7feef00afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 >> 172.21.15.27:0/2915912410 conn(0x7feef00cb7f0 msgr2=0x7feef00c01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:16.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 shutdown_connections 2023-05-17T15:08:16.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.836+0000 7feef4a9a700 1 -- 172.21.15.27:0/2915912410 wait complete. 2023-05-17T15:08:16.852 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:08:16.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.967+0000 7fa4beadd700 1 Processor -- start 2023-05-17T15:08:16.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.967+0000 7fa4beadd700 1 -- start start 2023-05-17T15:08:16.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4beadd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa4b80c6310 0x7fa4b8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4beadd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4b80691f0 0x7fa4b80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4beadd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b8158790 con 0x7fa4b81543d0 2023-05-17T15:08:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4beadd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80c1c50 con 0x7fa4b80c6310 2023-05-17T15:08:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4beadd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8157e60 con 0x7fa4b80691f0 2023-05-17T15:08:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa4b80c6310 0x7fa4b8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4bc879700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa4b81543d0 0x7fa4b80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:37976/0 (socket says 172.21.15.27:37976) 2023-05-17T15:08:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4bc879700 1 -- 172.21.15.27:0/1914465981 learned_addr learned my addr 172.21.15.27:0/1914465981 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4bd07a700 1 --2- 172.21.15.27:0/1914465981 >> v2:172.21.15.40:3300/0 conn(0x7fa4b80691f0 0x7fa4b80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b7fff700 1 -- 172.21.15.27:0/1914465981 >> v2:172.21.15.40:3300/0 conn(0x7fa4b80691f0 msgr2=0x7fa4b80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b7fff700 1 --2- 172.21.15.27:0/1914465981 >> v2:172.21.15.40:3300/0 conn(0x7fa4b80691f0 0x7fa4b80bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b7fff700 1 -- 172.21.15.27:0/1914465981 >> v1:172.21.15.27:6789/0 conn(0x7fa4b81543d0 legacy=0x7fa4b80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b77fe700 1 -- 172.21.15.27:0/1914465981 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493450653 0 0) 0x7fa4b8158790 con 0x7fa4b81543d0 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b7fff700 1 -- 172.21.15.27:0/1914465981 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8158140 con 0x7fa4b80c6310 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.968+0000 7fa4b7fff700 1 --2- 172.21.15.27:0/1914465981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b80c6310 0x7fa4b8068d00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fa4b8083a00 tx=0x7fa4a8009780).ready entity=mon.0 client_cookie=d082fc304ced1de4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4b77fe700 1 -- 172.21.15.27:0/1914465981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a800e070 con 0x7fa4b80c6310 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4b77fe700 1 -- 172.21.15.27:0/1914465981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a800bc30 con 0x7fa4b80c6310 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4b77fe700 1 -- 172.21.15.27:0/1914465981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8012410 con 0x7fa4b80c6310 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 -- 172.21.15.27:0/1914465981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b80c6310 msgr2=0x7fa4b8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 --2- 172.21.15.27:0/1914465981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b80c6310 0x7fa4b8068d00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fa4b8083a00 tx=0x7fa4a8009780).stop 2023-05-17T15:08:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 -- 172.21.15.27:0/1914465981 shutdown_connections 2023-05-17T15:08:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 --2- 172.21.15.27:0/1914465981 >> v2:172.21.15.40:3300/0 conn(0x7fa4b80691f0 0x7fa4b80bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 --2- 172.21.15.27:0/1914465981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b80c6310 0x7fa4b8068d00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 -- 172.21.15.27:0/1914465981 >> 172.21.15.27:0/1914465981 conn(0x7fa4b80cb7f0 msgr2=0x7fa4b80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 -- 172.21.15.27:0/1914465981 shutdown_connections 2023-05-17T15:08:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.969+0000 7fa4beadd700 1 -- 172.21.15.27:0/1914465981 wait complete. 2023-05-17T15:08:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.970+0000 7fa4beadd700 1 Processor -- start 2023-05-17T15:08:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.970+0000 7fa4beadd700 1 -- start start 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4beadd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4b80691f0 0x7fa4b8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4beadd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4b80c6310 0x7fa4b80accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4beadd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 0x7fa4b80ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4beadd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80ad6a0 con 0x7fa4b81543d0 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4beadd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8153460 con 0x7fa4b80691f0 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4beadd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81652d0 con 0x7fa4b80c6310 2023-05-17T15:08:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4bd07a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 0x7fa4b80ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4bd07a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 0x7fa4b80ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38424/0 (socket says 172.21.15.27:38424) 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4bd07a700 1 -- 172.21.15.27:0/2299644745 learned_addr learned my addr 172.21.15.27:0/2299644745 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4b7fff700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4b80c6310 0x7fa4b80accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.971+0000 7fa4bc879700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4b80691f0 0x7fa4b8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bd07a700 1 -- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4b80c6310 msgr2=0x7fa4b80accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bd07a700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4b80c6310 0x7fa4b80accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bd07a700 1 -- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4b80691f0 msgr2=0x7fa4b8152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bd07a700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4b80691f0 0x7fa4b8152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bd07a700 1 -- 172.21.15.27:0/2299644745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8009a20 con 0x7fa4b81543d0 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bc879700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4b80691f0 0x7fa4b8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4bd07a700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 0x7fa4b80ad1b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fa4a000c680 tx=0x7fa4a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0010580 con 0x7fa4b81543d0 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a00106e0 con 0x7fa4b81543d0 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0010a60 con 0x7fa4b81543d0 2023-05-17T15:08:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80c4c40 con 0x7fa4b81543d0 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.972+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b81649a0 con 0x7fa4b81543d0 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.973+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b806bdf0 con 0x7fa4b81543d0 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.973+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa4a001b460 con 0x7fa4b81543d0 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.974+0000 7fa4b4ff9700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa49805edc0 0x7fa498061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.974+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5341+0+0 (secure 0 0 0) 0x7fa4a0079750 con 0x7fa4b81543d0 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.974+0000 7fa4bc879700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa49805edc0 0x7fa498061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.974+0000 7fa4bc879700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa49805edc0 0x7fa498061280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa4b0001710 tx=0x7fa4b0009040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:16.978+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa4a004afa0 con 0x7fa4b81543d0 2023-05-17T15:08:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.148+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4b8069d00 con 0x7fa4b81543d0 2023-05-17T15:08:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.149+0000 7fa4b4ff9700 1 -- 172.21.15.27:0/2299644745 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4a004e5c0 con 0x7fa4b81543d0 2023-05-17T15:08:17.153 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:08:17.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.150+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa49805edc0 msgr2=0x7fa498061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa49805edc0 0x7fa498061280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa4b0001710 tx=0x7fa4b0009040).stop 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 msgr2=0x7fa4b80ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 0x7fa4b80ad1b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fa4a000c680 tx=0x7fa4a0008040).stop 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 shutdown_connections 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa49805edc0 0x7fa498061280 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4b81543d0 0x7fa4b80ad1b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4b80691f0 0x7fa4b8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 --2- 172.21.15.27:0/2299644745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4b80c6310 0x7fa4b80accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 >> 172.21.15.27:0/2299644745 conn(0x7fa4b80cb7f0 msgr2=0x7fa4b80c0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 shutdown_connections 2023-05-17T15:08:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.151+0000 7fa4beadd700 1 -- 172.21.15.27:0/2299644745 wait complete. 2023-05-17T15:08:17.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:08:17.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.279+0000 7f4cfd885700 1 Processor -- start 2023-05-17T15:08:17.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.279+0000 7f4cfd885700 1 -- start start 2023-05-17T15:08:17.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cfd885700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cf80c6310 0x7f4cf8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cfd885700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf81541c0 0x7f4cf80c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cfd885700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80bfcd0 con 0x7f4cf80c5f30 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cfd885700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80c0290 con 0x7f4cf80c6310 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cfd885700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80aa1a0 con 0x7f4cf81541c0 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cf77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf81541c0 0x7f4cf80c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cf67fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cf80c6310 0x7f4cf8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cf6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4cf80c5f30 0x7f4cf8158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:43992/0 (socket says 172.21.15.27:43992) 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cf6ffd700 1 -- 172.21.15.27:0/3524729416 learned_addr learned my addr 172.21.15.27:0/3524729416 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:17.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.280+0000 7f4cf67fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cf80c6310 0x7f4cf8153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:56358/0 (socket says 172.21.15.27:56358) 2023-05-17T15:08:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf67fc700 1 -- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf81541c0 msgr2=0x7f4cf80c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf67fc700 1 --2- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf81541c0 0x7f4cf80c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf67fc700 1 -- 172.21.15.27:0/3524729416 >> v1:172.21.15.40:6789/0 conn(0x7f4cf80c5f30 legacy=0x7f4cf8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf67fc700 1 -- 172.21.15.27:0/3524729416 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80aa480 con 0x7f4cf80c6310 2023-05-17T15:08:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf5ffb700 1 -- 172.21.15.27:0/3524729416 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404291071 0 0) 0x7f4cf80bfcd0 con 0x7f4cf80c5f30 2023-05-17T15:08:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf67fc700 1 --2- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf80c6310 0x7f4cf8153cd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f4ce0009760 tx=0x7f4ce0009060).ready entity=mon.1 client_cookie=23356e3c04db38c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:17.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf5ffb700 1 -- 172.21.15.27:0/3524729416 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000f510 con 0x7f4cf80c6310 2023-05-17T15:08:17.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf5ffb700 1 -- 172.21.15.27:0/3524729416 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000f670 con 0x7f4cf80c6310 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.281+0000 7f4cf5ffb700 1 -- 172.21.15.27:0/3524729416 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000f9f0 con 0x7f4cf80c6310 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 -- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf80c6310 msgr2=0x7f4cf8153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 --2- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf80c6310 0x7f4cf8153cd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f4ce0009760 tx=0x7f4ce0009060).stop 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 -- 172.21.15.27:0/3524729416 shutdown_connections 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 --2- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf81541c0 0x7f4cf80c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 --2- 172.21.15.27:0/3524729416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf80c6310 0x7f4cf8153cd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 -- 172.21.15.27:0/3524729416 >> 172.21.15.27:0/3524729416 conn(0x7f4cf8069e70 msgr2=0x7f4cf805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 -- 172.21.15.27:0/3524729416 shutdown_connections 2023-05-17T15:08:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.282+0000 7f4cfd885700 1 -- 172.21.15.27:0/3524729416 wait complete. 2023-05-17T15:08:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.283+0000 7f4cfd885700 1 Processor -- start 2023-05-17T15:08:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.283+0000 7f4cfd885700 1 -- start start 2023-05-17T15:08:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf80c5f30 0x7f4cf80cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 0x7f4cf80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf81541c0 0x7f4cf80b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf81648d0 con 0x7f4cf80c6310 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf81658a0 con 0x7f4cf81541c0 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80c3230 con 0x7f4cf80c5f30 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 0x7f4cf80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 0x7f4cf80c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38436/0 (socket says 172.21.15.27:38436) 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 -- 172.21.15.27:0/2283747447 learned_addr learned my addr 172.21.15.27:0/2283747447 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf6ffd700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf80c5f30 0x7f4cf80cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf77fe700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf81541c0 0x7f4cf80b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 -- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf80c5f30 msgr2=0x7f4cf80cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf80c5f30 0x7f4cf80cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 -- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf81541c0 msgr2=0x7f4cf80b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf81541c0 0x7f4cf80b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 -- 172.21.15.27:0/2283747447 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00092a0 con 0x7f4cf80c6310 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cf67fc700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 0x7f4cf80c2800 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f4ce0009e00 tx=0x7f4ce0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000f7e0 con 0x7f4cf80c6310 2023-05-17T15:08:17.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000f940 con 0x7f4cf80c6310 2023-05-17T15:08:17.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce001b660 con 0x7f4cf80c6310 2023-05-17T15:08:17.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.284+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf8164ae0 con 0x7f4cf80c6310 2023-05-17T15:08:17.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.285+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf8165120 con 0x7f4cf80c6310 2023-05-17T15:08:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.285+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf805f4a0 con 0x7f4cf80c6310 2023-05-17T15:08:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.286+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ce000f070 con 0x7f4cf80c6310 2023-05-17T15:08:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.286+0000 7f4ceeffd700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4cd805ed60 0x7f4cd8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.286+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f4ce007b070 con 0x7f4cf80c6310 2023-05-17T15:08:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.286+0000 7f4cf6ffd700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4cd805ed60 0x7f4cd8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.286+0000 7f4cf6ffd700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4cd805ed60 0x7f4cd8061220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4cf00011e0 tx=0x7f4cf0007bb0).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.290+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ce004c9d0 con 0x7f4cf80c6310 2023-05-17T15:08:17.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.467+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4cf8164c70 con 0x7f4cf80c6310 2023-05-17T15:08:17.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.468+0000 7f4ceeffd700 1 -- 172.21.15.27:0/2283747447 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4ce0028070 con 0x7f4cf80c6310 2023-05-17T15:08:17.472 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:17.472 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:08:17.472 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:08:17.473 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:17.474 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:08:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4cd805ed60 msgr2=0x7f4cd8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4cd805ed60 0x7f4cd8061220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4cf00011e0 tx=0x7f4cf0007bb0).stop 2023-05-17T15:08:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 msgr2=0x7f4cf80c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 0x7f4cf80c2800 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f4ce0009e00 tx=0x7f4ce0017000).stop 2023-05-17T15:08:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 shutdown_connections 2023-05-17T15:08:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4cd805ed60 0x7f4cd8061220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cf81541c0 0x7f4cf80b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cf80c5f30 0x7f4cf80cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 --2- 172.21.15.27:0/2283747447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf80c6310 0x7f4cf80c2800 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 >> 172.21.15.27:0/2283747447 conn(0x7f4cf8069e70 msgr2=0x7f4cf80ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:17.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 shutdown_connections 2023-05-17T15:08:17.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.470+0000 7f4cfd885700 1 -- 172.21.15.27:0/2283747447 wait complete. 2023-05-17T15:08:17.485 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:08:17.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:08:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.602+0000 7f525bb67700 1 Processor -- start 2023-05-17T15:08:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 -- start start 2023-05-17T15:08:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5254153fa0 0x7f52540c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52540aa130 0x7f5254081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540824c0 0x7f5254068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540c1610 con 0x7f5254153fa0 2023-05-17T15:08:17.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540828f0 con 0x7f52540aa130 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.603+0000 7f525bb67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540c0a00 con 0x7f52540824c0 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5254153fa0 0x7f52540c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5254153fa0 0x7f52540c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38442/0 (socket says 172.21.15.27:38442) 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 -- 172.21.15.27:0/2191425065 learned_addr learned my addr 172.21.15.27:0/2191425065 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f525a104700 1 --2- 172.21.15.27:0/2191425065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540824c0 0x7f5254068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259102700 1 --2- 172.21.15.27:0/2191425065 >> v2:172.21.15.40:3300/0 conn(0x7f52540aa130 0x7f5254081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 -- 172.21.15.27:0/2191425065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540824c0 msgr2=0x7f5254068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 --2- 172.21.15.27:0/2191425065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540824c0 0x7f5254068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 -- 172.21.15.27:0/2191425065 >> v2:172.21.15.40:3300/0 conn(0x7f52540aa130 msgr2=0x7f5254081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 --2- 172.21.15.27:0/2191425065 >> v2:172.21.15.40:3300/0 conn(0x7f52540aa130 0x7f5254081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 -- 172.21.15.27:0/2191425065 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540c0ce0 con 0x7f5254153fa0 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5259903700 1 --2- 172.21.15.27:0/2191425065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5254153fa0 0x7f52540c0420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f52540cbe30 tx=0x7f524c0090f0).ready entity=mon.0 client_cookie=6704940a9f15dc73 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5258901700 1 -- 172.21.15.27:0/2191425065 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00b600 con 0x7f5254153fa0 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5258901700 1 -- 172.21.15.27:0/2191425065 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c00b760 con 0x7f5254153fa0 2023-05-17T15:08:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.604+0000 7f5258901700 1 -- 172.21.15.27:0/2191425065 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00bae0 con 0x7f5254153fa0 2023-05-17T15:08:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 -- 172.21.15.27:0/2191425065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5254153fa0 msgr2=0x7f52540c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 --2- 172.21.15.27:0/2191425065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5254153fa0 0x7f52540c0420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f52540cbe30 tx=0x7f524c0090f0).stop 2023-05-17T15:08:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 -- 172.21.15.27:0/2191425065 shutdown_connections 2023-05-17T15:08:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 --2- 172.21.15.27:0/2191425065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5254153fa0 0x7f52540c0420 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 --2- 172.21.15.27:0/2191425065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540824c0 0x7f5254068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 --2- 172.21.15.27:0/2191425065 >> v2:172.21.15.40:3300/0 conn(0x7f52540aa130 0x7f5254081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 -- 172.21.15.27:0/2191425065 >> 172.21.15.27:0/2191425065 conn(0x7f525405e820 msgr2=0x7f52540cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 -- 172.21.15.27:0/2191425065 shutdown_connections 2023-05-17T15:08:17.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.605+0000 7f525bb67700 1 -- 172.21.15.27:0/2191425065 wait complete. 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.606+0000 7f525bb67700 1 Processor -- start 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.606+0000 7f525bb67700 1 -- start start 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 0x7f5254167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540aa130 0x7f5254167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5254153fa0 0x7f52540b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5254167e30 con 0x7f52540824c0 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540a2410 con 0x7f5254153fa0 2023-05-17T15:08:17.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540c4950 con 0x7f52540aa130 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 0x7f5254167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 0x7f5254167450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38448/0 (socket says 172.21.15.27:38448) 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 -- 172.21.15.27:0/3805265230 learned_addr learned my addr 172.21.15.27:0/3805265230 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 -- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540aa130 msgr2=0x7f5254167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540aa130 0x7f5254167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 -- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5254153fa0 msgr2=0x7f52540b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525a104700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5254153fa0 0x7f52540b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5254153fa0 0x7f52540b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 -- 172.21.15.27:0/3805265230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c009370 con 0x7f52540824c0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5259903700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 0x7f5254167450 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f52540cacf0 tx=0x7f524c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00b8d0 con 0x7f52540824c0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c00ba50 con 0x7f52540824c0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c01b660 con 0x7f52540824c0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.607+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52540c4110 con 0x7f52540824c0 2023-05-17T15:08:17.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.608+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5254165180 con 0x7f52540824c0 2023-05-17T15:08:17.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.608+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525406bdf0 con 0x7f52540824c0 2023-05-17T15:08:17.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.609+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f524c02b070 con 0x7f52540824c0 2023-05-17T15:08:17.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.609+0000 7f5251ffb700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f524005ed90 0x7f5240061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:17.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.609+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f524c07b1b0 con 0x7f52540824c0 2023-05-17T15:08:17.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.609+0000 7f5259102700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f524005ed90 0x7f5240061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.610+0000 7f5259102700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f524005ed90 0x7f5240061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f52540a9c10 tx=0x7f5248008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:17.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.613+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f524c04cb10 con 0x7f52540824c0 2023-05-17T15:08:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.788+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f52540c0fc0 con 0x7f52540824c0 2023-05-17T15:08:17.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.880+0000 7f5251ffb700 1 -- 172.21.15.27:0/3805265230 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 152+0+0 (secure 0 0 0) 0x7f52540c0fc0 con 0x7f52540824c0 2023-05-17T15:08:17.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.885+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f524005ed90 msgr2=0x7f5240061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.885+0000 7f525bb67700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f524005ed90 0x7f5240061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f52540a9c10 tx=0x7f5248008040).stop 2023-05-17T15:08:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.885+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 msgr2=0x7f5254167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.885+0000 7f525bb67700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 0x7f5254167450 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f52540cacf0 tx=0x7f524c017000).stop 2023-05-17T15:08:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.886+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 shutdown_connections 2023-05-17T15:08:17.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.886+0000 7f525bb67700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f524005ed90 0x7f5240061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.886+0000 7f525bb67700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5254153fa0 0x7f52540b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.886+0000 7f525bb67700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f52540824c0 0x7f5254167450 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:17.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.886+0000 7f525bb67700 1 --2- 172.21.15.27:0/3805265230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52540aa130 0x7f5254167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:17.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.886+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 >> 172.21.15.27:0/3805265230 conn(0x7f525405e820 msgr2=0x7f52540ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:17.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.887+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 shutdown_connections 2023-05-17T15:08:17.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:17.887+0000 7f525bb67700 1 -- 172.21.15.27:0/3805265230 wait complete. 2023-05-17T15:08:17.892 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:08:17.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:08:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.024+0000 7faf9afc8700 1 Processor -- start 2023-05-17T15:08:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.024+0000 7faf9afc8700 1 -- start start 2023-05-17T15:08:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf9afc8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf941543d0 0x7faf940c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf9afc8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf94069410 0x7faf940bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf9afc8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf94158790 con 0x7faf940c60f0 2023-05-17T15:08:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf9afc8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940c1c50 con 0x7faf94069410 2023-05-17T15:08:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf9afc8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940c6570 con 0x7faf941543d0 2023-05-17T15:08:18.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf94069410 0x7faf940bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:18.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf93fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faf940c60f0 0x7faf94068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38020/0 (socket says 172.21.15.27:38020) 2023-05-17T15:08:18.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf93fff700 1 -- 172.21.15.27:0/236722282 learned_addr learned my addr 172.21.15.27:0/236722282 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:18.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 --2- 172.21.15.27:0/236722282 >> v2:172.21.15.27:3300/0 conn(0x7faf94069410 0x7faf940bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38460/0 (socket says 172.21.15.27:38460) 2023-05-17T15:08:18.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf98d64700 1 --2- 172.21.15.27:0/236722282 >> v2:172.21.15.40:3300/0 conn(0x7faf941543d0 0x7faf940c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:18.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 -- 172.21.15.27:0/236722282 >> v2:172.21.15.40:3300/0 conn(0x7faf941543d0 msgr2=0x7faf940c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:18.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 --2- 172.21.15.27:0/236722282 >> v2:172.21.15.40:3300/0 conn(0x7faf941543d0 0x7faf940c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 -- 172.21.15.27:0/236722282 >> v1:172.21.15.27:6789/0 conn(0x7faf940c60f0 legacy=0x7faf94068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:18.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf937fe700 1 -- 172.21.15.27:0/236722282 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212923133 0 0) 0x7faf94158790 con 0x7faf940c60f0 2023-05-17T15:08:18.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 -- 172.21.15.27:0/236722282 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94157e60 con 0x7faf94069410 2023-05-17T15:08:18.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.025+0000 7faf99565700 1 --2- 172.21.15.27:0/236722282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf94069410 0x7faf940bfc80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7faf94155970 tx=0x7faf8c009780).ready entity=mon.0 client_cookie=5c6af578728903ba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf937fe700 1 -- 172.21.15.27:0/236722282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00e070 con 0x7faf94069410 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf937fe700 1 -- 172.21.15.27:0/236722282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c00bc30 con 0x7faf94069410 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf937fe700 1 -- 172.21.15.27:0/236722282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c012410 con 0x7faf94069410 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 -- 172.21.15.27:0/236722282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf94069410 msgr2=0x7faf940bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 --2- 172.21.15.27:0/236722282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf94069410 0x7faf940bfc80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7faf94155970 tx=0x7faf8c009780).stop 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 -- 172.21.15.27:0/236722282 shutdown_connections 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 --2- 172.21.15.27:0/236722282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf94069410 0x7faf940bfc80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 --2- 172.21.15.27:0/236722282 >> v2:172.21.15.40:3300/0 conn(0x7faf941543d0 0x7faf940c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 -- 172.21.15.27:0/236722282 >> 172.21.15.27:0/236722282 conn(0x7faf940cb7f0 msgr2=0x7faf940c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:18.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 -- 172.21.15.27:0/236722282 shutdown_connections 2023-05-17T15:08:18.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.026+0000 7faf9afc8700 1 -- 172.21.15.27:0/236722282 wait complete. 2023-05-17T15:08:18.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.027+0000 7faf9afc8700 1 Processor -- start 2023-05-17T15:08:18.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.027+0000 7faf9afc8700 1 -- start start 2023-05-17T15:08:18.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf9afc8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf94069410 0x7faf94147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf9afc8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 0x7faf940af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf9afc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf941543d0 0x7faf940afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf9afc8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940c36c0 con 0x7faf940c60f0 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf9afc8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf94147f50 con 0x7faf94069410 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf9afc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf940b0040 con 0x7faf941543d0 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf93fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 0x7faf940af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:18.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf93fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 0x7faf940af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38464/0 (socket says 172.21.15.27:38464) 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.028+0000 7faf93fff700 1 -- 172.21.15.27:0/3018821263 learned_addr learned my addr 172.21.15.27:0/3018821263 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf98d64700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf94069410 0x7faf94147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf93fff700 1 -- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf941543d0 msgr2=0x7faf940afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf93fff700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf941543d0 0x7faf940afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf93fff700 1 -- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf94069410 msgr2=0x7faf94147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf93fff700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf94069410 0x7faf94147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf93fff700 1 -- 172.21.15.27:0/3018821263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c009a20 con 0x7faf940c60f0 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf98d64700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf94069410 0x7faf94147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf93fff700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 0x7faf940af580 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7faf8000c4e0 tx=0x7faf80007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800072e0 con 0x7faf940c60f0 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf80007440 con 0x7faf940c60f0 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf940c2d90 con 0x7faf940c60f0 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800057a0 con 0x7faf940c60f0 2023-05-17T15:08:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.029+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf940c3350 con 0x7faf940c60f0 2023-05-17T15:08:18.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.030+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9406bdf0 con 0x7faf940c60f0 2023-05-17T15:08:18.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.031+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faf8001a060 con 0x7faf940c60f0 2023-05-17T15:08:18.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.031+0000 7faf90ff9700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf7805ed90 0x7faf78061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:18.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.031+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5711+0+0 (secure 0 0 0) 0x7faf80079850 con 0x7faf940c60f0 2023-05-17T15:08:18.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.031+0000 7faf98d64700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf7805ed90 0x7faf78061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:18.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.031+0000 7faf98d64700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf7805ed90 0x7faf78061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7faf940a1ee0 tx=0x7faf88008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.035+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf8004b010 con 0x7faf940c60f0 2023-05-17T15:08:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.207+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faf94158140 con 0x7faf940c60f0 2023-05-17T15:08:18.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.885+0000 7faf90ff9700 1 -- 172.21.15.27:0/3018821263 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7faf80018030 con 0x7faf940c60f0 2023-05-17T15:08:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.893+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf7805ed90 msgr2=0x7faf78061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.893+0000 7faf9afc8700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf7805ed90 0x7faf78061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7faf940a1ee0 tx=0x7faf88008040).stop 2023-05-17T15:08:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.893+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 msgr2=0x7faf940af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.893+0000 7faf9afc8700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 0x7faf940af580 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7faf8000c4e0 tx=0x7faf80007c70).stop 2023-05-17T15:08:18.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 shutdown_connections 2023-05-17T15:08:18.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf7805ed90 0x7faf78061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf941543d0 0x7faf940afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:18.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf94069410 0x7faf94147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 --2- 172.21.15.27:0/3018821263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf940c60f0 0x7faf940af580 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:18.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 >> 172.21.15.27:0/3018821263 conn(0x7faf940cb7f0 msgr2=0x7faf941539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:18.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 shutdown_connections 2023-05-17T15:08:18.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:18.897+0000 7faf9afc8700 1 -- 172.21.15.27:0/3018821263 wait complete. 2023-05-17T15:08:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:08:18.923 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:08:19.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.040+0000 7fa228cdf700 1 Processor -- start 2023-05-17T15:08:19.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.040+0000 7fa228cdf700 1 -- start start 2023-05-17T15:08:19.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa228cdf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa224153ef0 0x7fa2240cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa228cdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa2240c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa228cdf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa224157de0 con 0x7fa2240cac00 2023-05-17T15:08:19.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa228cdf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2241588b0 con 0x7fa224153ef0 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa228cdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240c60d0 con 0x7fa224157980 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa224153ef0 0x7fa2240cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa223fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa2240c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa224153ef0 0x7fa2240cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:56402/0 (socket says 172.21.15.27:56402) 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 -- 172.21.15.27:0/4133266110 learned_addr learned my addr 172.21.15.27:0/4133266110 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa2237fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa2240cac00 0x7fa2241537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:44034/0 (socket says 172.21.15.27:44034) 2023-05-17T15:08:19.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 -- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 msgr2=0x7fa2240c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:19.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 --2- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa2240c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 -- 172.21.15.27:0/4133266110 >> v1:172.21.15.40:6789/0 conn(0x7fa2240cac00 legacy=0x7fa2241537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa222ffd700 1 -- 172.21.15.27:0/4133266110 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224158010 con 0x7fa224153ef0 2023-05-17T15:08:19.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.041+0000 7fa223fff700 1 --2- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa2240c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:19.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa222ffd700 1 --2- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa224153ef0 0x7fa2240cafe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fa218006fd0 tx=0x7fa2180090f0).ready entity=mon.1 client_cookie=c14a565069ab39e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa2227fc700 1 -- 172.21.15.27:0/4133266110 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800b580 con 0x7fa224153ef0 2023-05-17T15:08:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa2227fc700 1 -- 172.21.15.27:0/4133266110 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21800b6e0 con 0x7fa224153ef0 2023-05-17T15:08:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa2227fc700 1 -- 172.21.15.27:0/4133266110 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800ba60 con 0x7fa224153ef0 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 -- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa224153ef0 msgr2=0x7fa2240cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 --2- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa224153ef0 0x7fa2240cafe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fa218006fd0 tx=0x7fa2180090f0).stop 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 -- 172.21.15.27:0/4133266110 shutdown_connections 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 --2- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa2240c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 --2- 172.21.15.27:0/4133266110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa224153ef0 0x7fa2240cafe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 -- 172.21.15.27:0/4133266110 >> 172.21.15.27:0/4133266110 conn(0x7fa22405dd50 msgr2=0x7fa22405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:19.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 -- 172.21.15.27:0/4133266110 shutdown_connections 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.042+0000 7fa228cdf700 1 -- 172.21.15.27:0/4133266110 wait complete. 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.043+0000 7fa228cdf700 1 Processor -- start 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 -- start start 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2240cac00 0x7fa22414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 0x7fa2241678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa224167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2241682d0 con 0x7fa224153ef0 2023-05-17T15:08:19.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa224150110 con 0x7fa2240cac00 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa228cdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240af3e0 con 0x7fa224157980 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa222ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 0x7fa2241678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa222ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 0x7fa2241678f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38478/0 (socket says 172.21.15.27:38478) 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.044+0000 7fa222ffd700 1 -- 172.21.15.27:0/3215954873 learned_addr learned my addr 172.21.15.27:0/3215954873 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa223fff700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa224167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa2237fe700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2240cac00 0x7fa22414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa222ffd700 1 -- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 msgr2=0x7fa224167de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa222ffd700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa224167de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa222ffd700 1 -- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2240cac00 msgr2=0x7fa22414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa222ffd700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2240cac00 0x7fa22414d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa222ffd700 1 -- 172.21.15.27:0/3215954873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c009a20 con 0x7fa224153ef0 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa223fff700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa224167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa2237fe700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2240cac00 0x7fa22414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa222ffd700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 0x7fa2241678f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fa218009fd0 tx=0x7fa218017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800b850 con 0x7fa224153ef0 2023-05-17T15:08:19.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21800b9b0 con 0x7fa224153ef0 2023-05-17T15:08:19.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa218009370 con 0x7fa224153ef0 2023-05-17T15:08:19.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21801c670 con 0x7fa224153ef0 2023-05-17T15:08:19.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.045+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22414fac0 con 0x7fa224153ef0 2023-05-17T15:08:19.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.046+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2240c5220 con 0x7fa224153ef0 2023-05-17T15:08:19.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.047+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa21802c070 con 0x7fa224153ef0 2023-05-17T15:08:19.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.047+0000 7fa20b7fe700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa21005ed90 0x7fa210061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.047+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6093+0+0 (secure 0 0 0) 0x7fa21807b6e0 con 0x7fa224153ef0 2023-05-17T15:08:19.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.047+0000 7fa2237fe700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa21005ed90 0x7fa210061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.047+0000 7fa2237fe700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa21005ed90 0x7fa210061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa214005790 tx=0x7fa214007c90).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.051+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa21804cca0 con 0x7fa224153ef0 2023-05-17T15:08:19.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.268+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa224047150 con 0x7fa224153ef0 2023-05-17T15:08:19.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.273+0000 7fa20b7fe700 1 -- 172.21.15.27:0/3215954873 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa21802a020 con 0x7fa224153ef0 2023-05-17T15:08:19.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.277+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa21005ed90 msgr2=0x7fa210061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.277+0000 7fa228cdf700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa21005ed90 0x7fa210061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa214005790 tx=0x7fa214007c90).stop 2023-05-17T15:08:19.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.277+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 msgr2=0x7fa2241678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.277+0000 7fa228cdf700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 0x7fa2241678f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fa218009fd0 tx=0x7fa218017000).stop 2023-05-17T15:08:19.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.278+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 shutdown_connections 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.278+0000 7fa228cdf700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa21005ed90 0x7fa210061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.278+0000 7fa228cdf700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa224157980 0x7fa224167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.278+0000 7fa228cdf700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2240cac00 0x7fa22414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.278+0000 7fa228cdf700 1 --2- 172.21.15.27:0/3215954873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa224153ef0 0x7fa2241678f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.278+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 >> 172.21.15.27:0/3215954873 conn(0x7fa22405dd50 msgr2=0x7fa2240ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.280+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 shutdown_connections 2023-05-17T15:08:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.281+0000 7fa228cdf700 1 -- 172.21.15.27:0/3215954873 wait complete. 2023-05-17T15:08:19.288 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 9 and data pool 10 2023-05-17T15:08:19.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:19.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.419+0000 7f30b759e700 1 Processor -- start 2023-05-17T15:08:19.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.419+0000 7f30b759e700 1 -- start start 2023-05-17T15:08:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30b80c1180 0x7f30b80c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b80c07e0 con 0x7f30b81544f0 2023-05-17T15:08:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b81549b0 con 0x7f30b80c1560 2023-05-17T15:08:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b8154c90 con 0x7f30b80c1180 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30b80c1180 0x7f30b80c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b5d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f30b81544f0 0x7f30b80a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38046/0 (socket says 172.21.15.27:38046) 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b5d9b700 1 -- 172.21.15.27:0/1617303370 learned_addr learned my addr 172.21.15.27:0/1617303370 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b659c700 1 -- 172.21.15.27:0/1617303370 >> v1:172.21.15.40:6789/0 conn(0x7f30b80c1560 legacy=0x7f30b80c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b659c700 1 -- 172.21.15.27:0/1617303370 >> v1:172.21.15.27:6789/0 conn(0x7f30b81544f0 legacy=0x7f30b80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b659c700 1 -- 172.21.15.27:0/1617303370 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b8154f70 con 0x7f30b80c1180 2023-05-17T15:08:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.420+0000 7f30b559a700 1 -- 172.21.15.27:0/1617303370 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795891248 0 0) 0x7f30b80c07e0 con 0x7f30b81544f0 2023-05-17T15:08:19.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b659c700 1 --2- 172.21.15.27:0/1617303370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1180 0x7f30b80c02f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f30b0009760 tx=0x7f30b0009060).ready entity=mon.0 client_cookie=262616b804a3639e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b559a700 1 -- 172.21.15.27:0/1617303370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0009120 con 0x7f30b80c1180 2023-05-17T15:08:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b559a700 1 -- 172.21.15.27:0/1617303370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b000b580 con 0x7f30b80c1180 2023-05-17T15:08:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b559a700 1 -- 172.21.15.27:0/1617303370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000b900 con 0x7f30b80c1180 2023-05-17T15:08:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 -- 172.21.15.27:0/1617303370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1180 msgr2=0x7f30b80c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 --2- 172.21.15.27:0/1617303370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1180 0x7f30b80c02f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f30b0009760 tx=0x7f30b0009060).stop 2023-05-17T15:08:19.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 -- 172.21.15.27:0/1617303370 shutdown_connections 2023-05-17T15:08:19.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 --2- 172.21.15.27:0/1617303370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1180 0x7f30b80c02f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 -- 172.21.15.27:0/1617303370 >> 172.21.15.27:0/1617303370 conn(0x7f30b805dd50 msgr2=0x7f30b805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:19.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 -- 172.21.15.27:0/1617303370 shutdown_connections 2023-05-17T15:08:19.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.421+0000 7f30b759e700 1 -- 172.21.15.27:0/1617303370 wait complete. 2023-05-17T15:08:19.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.422+0000 7f30b759e700 1 Processor -- start 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.422+0000 7f30b759e700 1 -- start start 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30b80c1180 0x7f30b8152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 0x7f30b81646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30b81544f0 0x7f30b8164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80c9940 con 0x7f30b80c1560 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80c9f00 con 0x7f30b81544f0 2023-05-17T15:08:19.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b8152650 con 0x7f30b80c1180 2023-05-17T15:08:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 0x7f30b81646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 0x7f30b81646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38490/0 (socket says 172.21.15.27:38490) 2023-05-17T15:08:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b5d9b700 1 -- 172.21.15.27:0/3145531819 learned_addr learned my addr 172.21.15.27:0/3145531819 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b6d9d700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30b81544f0 0x7f30b8164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.423+0000 7f30b659c700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30b80c1180 0x7f30b8152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b5d9b700 1 -- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30b80c1180 msgr2=0x7f30b8152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b5d9b700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30b80c1180 0x7f30b8152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b5d9b700 1 -- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30b81544f0 msgr2=0x7f30b8164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b5d9b700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30b81544f0 0x7f30b8164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b5d9b700 1 -- 172.21.15.27:0/3145531819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00092a0 con 0x7f30b80c1560 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b5d9b700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 0x7f30b81646c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f30a000c4e0 tx=0x7f30a0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000ce90 con 0x7f30b80c1560 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a00072e0 con 0x7f30b80c1560 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b8165210 con 0x7f30b80c1560 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a0007660 con 0x7f30b80c1560 2023-05-17T15:08:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.424+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b80c9b90 con 0x7f30b80c1560 2023-05-17T15:08:19.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.425+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b80ca070 con 0x7f30b80c1560 2023-05-17T15:08:19.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.425+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f30a0010070 con 0x7f30b80c1560 2023-05-17T15:08:19.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.426+0000 7f30ae7fc700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f309805ed90 0x7f3098061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.426+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f30a0079760 con 0x7f30b80c1560 2023-05-17T15:08:19.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.426+0000 7f30b659c700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f309805ed90 0x7f3098061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.426+0000 7f30b659c700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f309805ed90 0x7f3098061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f30b000b340 tx=0x7f30b0017000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.429+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30a004ad30 con 0x7f30b80c1560 2023-05-17T15:08:19.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.601+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30b806bdf0 con 0x7f30b80c1560 2023-05-17T15:08:19.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.602+0000 7f30ae7fc700 1 -- 172.21.15.27:0/3145531819 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17057 (secure 0 0 0) 0x7f30a004e350 con 0x7f30b80c1560 2023-05-17T15:08:19.606 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:19.607 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":82,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:19.270052+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:17.825758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:18.244928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:19.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f309805ed90 msgr2=0x7f3098061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f309805ed90 0x7f3098061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f30b000b340 tx=0x7f30b0017000).stop 2023-05-17T15:08:19.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 msgr2=0x7f30b81646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 0x7f30b81646c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f30a000c4e0 tx=0x7f30a0007c70).stop 2023-05-17T15:08:19.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 shutdown_connections 2023-05-17T15:08:19.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f309805ed90 0x7f3098061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30b81544f0 0x7f30b8164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30b80c1180 0x7f30b8152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 --2- 172.21.15.27:0/3145531819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30b80c1560 0x7f30b81646c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 >> 172.21.15.27:0/3145531819 conn(0x7f30b805dd50 msgr2=0x7f30b80aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:19.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 shutdown_connections 2023-05-17T15:08:19.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.604+0000 7f30b759e700 1 -- 172.21.15.27:0/3145531819 wait complete. 2023-05-17T15:08:19.620 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.733+0000 7f60cfe0b700 1 Processor -- start 2023-05-17T15:08:19.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.733+0000 7f60cfe0b700 1 -- start start 2023-05-17T15:08:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cfe0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c80c64a0 0x7f60c8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cfe0b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c80aa680 con 0x7f60c8154260 2023-05-17T15:08:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cfe0b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c805e7e0 con 0x7f60c80c60c0 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cfe0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80c68e0 con 0x7f60c80c64a0 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ce3a8700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f60c8154260 0x7f60c80c0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38062/0 (socket says 172.21.15.27:38062) 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ce3a8700 1 -- 172.21.15.27:0/2006937024 learned_addr learned my addr 172.21.15.27:0/2006937024 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cd3a6700 1 --2- 172.21.15.27:0/2006937024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c80c64a0 0x7f60c8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427056012 0 0) 0x7f60c80aa680 con 0x7f60c8154260 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b00033f0 con 0x7f60c8154260 2023-05-17T15:08:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489810118 0 0) 0x7f60c805e7e0 con 0x7f60c80c60c0 2023-05-17T15:08:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c80aa680 con 0x7f60c80c60c0 2023-05-17T15:08:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 437598217 0 0) 0x7f60b00033f0 con 0x7f60c8154260 2023-05-17T15:08:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cd3a6700 1 -- 172.21.15.27:0/2006937024 >> v1:172.21.15.40:6789/0 conn(0x7f60c80c60c0 legacy=0x7f60c80a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cd3a6700 1 -- 172.21.15.27:0/2006937024 >> v1:172.21.15.27:6789/0 conn(0x7f60c8154260 legacy=0x7f60c80c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cd3a6700 1 -- 172.21.15.27:0/2006937024 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c805eac0 con 0x7f60c80c64a0 2023-05-17T15:08:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.734+0000 7f60cd3a6700 1 --2- 172.21.15.27:0/2006937024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c80c64a0 0x7f60c8153d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f60bc009790 tx=0x7f60bc009060).ready entity=mon.2 client_cookie=b91f007860369769 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8001470 con 0x7f60c80c64a0 2023-05-17T15:08:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc011400 con 0x7f60c80c64a0 2023-05-17T15:08:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60ccba5700 1 -- 172.21.15.27:0/2006937024 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc011780 con 0x7f60c80c64a0 2023-05-17T15:08:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 -- 172.21.15.27:0/2006937024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c80c64a0 msgr2=0x7f60c8153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/2006937024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c80c64a0 0x7f60c8153d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f60bc009790 tx=0x7f60bc009060).stop 2023-05-17T15:08:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 -- 172.21.15.27:0/2006937024 shutdown_connections 2023-05-17T15:08:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/2006937024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c80c64a0 0x7f60c8153d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 -- 172.21.15.27:0/2006937024 >> 172.21.15.27:0/2006937024 conn(0x7f60c8069e70 msgr2=0x7f60c805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 -- 172.21.15.27:0/2006937024 shutdown_connections 2023-05-17T15:08:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.735+0000 7f60cfe0b700 1 -- 172.21.15.27:0/2006937024 wait complete. 2023-05-17T15:08:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.736+0000 7f60cfe0b700 1 Processor -- start 2023-05-17T15:08:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.736+0000 7f60cfe0b700 1 -- start start 2023-05-17T15:08:19.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cfe0b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 0x7f60c8156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cfe0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60c80c64a0 0x7f60c80af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cfe0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c8154260 0x7f60c80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cfe0b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c814c150 con 0x7f60c80c60c0 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cfe0b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80affc0 con 0x7f60c80c64a0 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cfe0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80b02a0 con 0x7f60c8154260 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 0x7f60c8156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 0x7f60c8156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38502/0 (socket says 172.21.15.27:38502) 2023-05-17T15:08:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 -- 172.21.15.27:0/666968275 learned_addr learned my addr 172.21.15.27:0/666968275 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cd3a6700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60c80c64a0 0x7f60c80af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60ce3a8700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c8154260 0x7f60c80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 -- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c8154260 msgr2=0x7f60c80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c8154260 0x7f60c80caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 -- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60c80c64a0 msgr2=0x7f60c80af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60c80c64a0 0x7f60c80af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60cdba7700 1 -- 172.21.15.27:0/666968275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0092a0 con 0x7f60c80c60c0 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.737+0000 7f60ce3a8700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c8154260 0x7f60c80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.738+0000 7f60cdba7700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 0x7f60c8156e70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f60c000c7c0 tx=0x7f60c0002660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.738+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000a580 con 0x7f60c80c60c0 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.738+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c000a6e0 con 0x7f60c80c60c0 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.738+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000aaa0 con 0x7f60c80c60c0 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.738+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c80b0580 con 0x7f60c80c60c0 2023-05-17T15:08:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.738+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c8157360 con 0x7f60c80c60c0 2023-05-17T15:08:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.739+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c805f4a0 con 0x7f60c80c60c0 2023-05-17T15:08:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.739+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f60c0010070 con 0x7f60c80c60c0 2023-05-17T15:08:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.739+0000 7f60c5ffb700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60b405ed90 0x7f60b4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.740+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f60c00799a0 con 0x7f60c80c60c0 2023-05-17T15:08:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.740+0000 7f60cd3a6700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60b405ed90 0x7f60b4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.740+0000 7f60cd3a6700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60b405ed90 0x7f60b4061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f60bc0096e0 tx=0x7f60bc016000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.744+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60c004aef0 con 0x7f60c80c60c0 2023-05-17T15:08:19.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.919+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60c806bdf0 con 0x7f60c80c60c0 2023-05-17T15:08:19.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.920+0000 7f60c5ffb700 1 -- 172.21.15.27:0/666968275 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17057 (secure 0 0 0) 0x7f60c004e510 con 0x7f60c80c60c0 2023-05-17T15:08:19.924 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":82,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:19.270052+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:17.825758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:18.244928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:19.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.921+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60b405ed90 msgr2=0x7f60b4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.921+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60b405ed90 0x7f60b4061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f60bc0096e0 tx=0x7f60bc016000).stop 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 msgr2=0x7f60c8156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 0x7f60c8156e70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f60c000c7c0 tx=0x7f60c0002660).stop 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 shutdown_connections 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60b405ed90 0x7f60b4061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60c8154260 0x7f60c80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60c80c60c0 0x7f60c8156e70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 --2- 172.21.15.27:0/666968275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60c80c64a0 0x7f60c80af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:19.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 >> 172.21.15.27:0/666968275 conn(0x7f60c8069e70 msgr2=0x7f60c814ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:19.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 shutdown_connections 2023-05-17T15:08:19.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:19.922+0000 7f60cfe0b700 1 -- 172.21.15.27:0/666968275 wait complete. 2023-05-17T15:08:19.938 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:08:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.053+0000 7f559359e700 1 Processor -- start 2023-05-17T15:08:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.053+0000 7f559359e700 1 -- start start 2023-05-17T15:08:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5594153ef0 0x7f55940cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5594157980 0x7f55940c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55940c60d0 con 0x7f55940cac00 2023-05-17T15:08:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55941588b0 con 0x7f5594153ef0 2023-05-17T15:08:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5594157e10 con 0x7f5594157980 2023-05-17T15:08:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5594153ef0 0x7f55940cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5594153ef0 0x7f55940cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38512/0 (socket says 172.21.15.27:38512) 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f55940cac00 0x7f55941537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38072/0 (socket says 172.21.15.27:38072) 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 -- 172.21.15.27:0/3277051663 learned_addr learned my addr 172.21.15.27:0/3277051663 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5592d9d700 1 --2- 172.21.15.27:0/3277051663 >> v2:172.21.15.40:3300/0 conn(0x7f5594157980 0x7f55940c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 -- 172.21.15.27:0/3277051663 >> v2:172.21.15.40:3300/0 conn(0x7f5594157980 msgr2=0x7f55940c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 --2- 172.21.15.27:0/3277051663 >> v2:172.21.15.40:3300/0 conn(0x7f5594157980 0x7f55940c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 -- 172.21.15.27:0/3277051663 >> v1:172.21.15.27:6789/0 conn(0x7f55940cac00 legacy=0x7f55941537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559159a700 1 -- 172.21.15.27:0/3277051663 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492161802 0 0) 0x7f55940c60d0 con 0x7f55940cac00 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 -- 172.21.15.27:0/3277051663 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594158010 con 0x7f5594153ef0 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5592d9d700 1 --2- 172.21.15.27:0/3277051663 >> v2:172.21.15.40:3300/0 conn(0x7f5594157980 0x7f55940c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f5591d9b700 1 --2- 172.21.15.27:0/3277051663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594153ef0 0x7f55940cafe0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f55940c6310 tx=0x7f557c009840).ready entity=mon.0 client_cookie=f1241e25afe1b0d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559159a700 1 -- 172.21.15.27:0/3277051663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c00e070 con 0x7f5594153ef0 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559159a700 1 -- 172.21.15.27:0/3277051663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c00ba40 con 0x7f5594153ef0 2023-05-17T15:08:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.054+0000 7f559159a700 1 -- 172.21.15.27:0/3277051663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c00bdc0 con 0x7f5594153ef0 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 -- 172.21.15.27:0/3277051663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594153ef0 msgr2=0x7f55940cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 --2- 172.21.15.27:0/3277051663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594153ef0 0x7f55940cafe0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f55940c6310 tx=0x7f557c009840).stop 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 -- 172.21.15.27:0/3277051663 shutdown_connections 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 --2- 172.21.15.27:0/3277051663 >> v2:172.21.15.40:3300/0 conn(0x7f5594157980 0x7f55940c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 --2- 172.21.15.27:0/3277051663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594153ef0 0x7f55940cafe0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 -- 172.21.15.27:0/3277051663 >> 172.21.15.27:0/3277051663 conn(0x7f559405dd50 msgr2=0x7f559405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 -- 172.21.15.27:0/3277051663 shutdown_connections 2023-05-17T15:08:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.055+0000 7f559359e700 1 -- 172.21.15.27:0/3277051663 wait complete. 2023-05-17T15:08:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.056+0000 7f559359e700 1 Processor -- start 2023-05-17T15:08:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.056+0000 7f559359e700 1 -- start start 2023-05-17T15:08:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55940cac00 0x7f559414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5594153ef0 0x7f55941504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 0x7f55941509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5594165170 con 0x7f5594157980 2023-05-17T15:08:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5594150ec0 con 0x7f55940cac00 2023-05-17T15:08:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55940b0390 con 0x7f5594153ef0 2023-05-17T15:08:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 0x7f55941509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 0x7f55941509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38518/0 (socket says 172.21.15.27:38518) 2023-05-17T15:08:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 -- 172.21.15.27:0/1392564035 learned_addr learned my addr 172.21.15.27:0/1392564035 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f559259c700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55940cac00 0x7f559414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5591d9b700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5594153ef0 0x7f55941504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 -- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5594153ef0 msgr2=0x7f55941504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5594153ef0 0x7f55941504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 -- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55940cac00 msgr2=0x7f559414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55940cac00 0x7f559414d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5592d9d700 1 -- 172.21.15.27:0/1392564035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009ae0 con 0x7f5594157980 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.057+0000 7f5591d9b700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5594153ef0 0x7f55941504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.058+0000 7f5592d9d700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 0x7f55941509d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f558400d860 tx=0x7f5584008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.058+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55840125f0 con 0x7f5594157980 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.058+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5584012750 con 0x7f5594157980 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.058+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559414ddc0 con 0x7f5594157980 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.058+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584012af0 con 0x7f5594157980 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.058+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55940afd40 con 0x7f5594157980 2023-05-17T15:08:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.059+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55940b0520 con 0x7f5594157980 2023-05-17T15:08:20.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.059+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5584013480 con 0x7f5594157980 2023-05-17T15:08:20.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.059+0000 7f558a7fc700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f557405ed90 0x7f5574061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:20.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.059+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f5584079de0 con 0x7f5594157980 2023-05-17T15:08:20.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.060+0000 7f559259c700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f557405ed90 0x7f5574061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:20.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.060+0000 7f559259c700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f557405ed90 0x7f5574061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f558c007fd0 tx=0x7f558c007d70).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.064+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f558404b2d0 con 0x7f5594157980 2023-05-17T15:08:20.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:20.284+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5594047150 con 0x7f5594157980 2023-05-17T15:08:20.656 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:08:20.653+0000 7f078ab5a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:08:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.277+0000 7f558a7fc700 1 -- 172.21.15.27:0/1392564035 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5584012e60 con 0x7f5594157980 2023-05-17T15:08:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f557405ed90 msgr2=0x7f5574061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f557405ed90 0x7f5574061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f558c007fd0 tx=0x7f558c007d70).stop 2023-05-17T15:08:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 msgr2=0x7f55941509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 0x7f55941509d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f558400d860 tx=0x7f5584008040).stop 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 shutdown_connections 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f557405ed90 0x7f5574061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5594157980 0x7f55941509d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55940cac00 0x7f559414d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 --2- 172.21.15.27:0/1392564035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5594153ef0 0x7f55941504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 >> 172.21.15.27:0/1392564035 conn(0x7f559405dd50 msgr2=0x7f559414e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 shutdown_connections 2023-05-17T15:08:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.280+0000 7f559359e700 1 -- 172.21.15.27:0/1392564035 wait complete. 2023-05-17T15:08:21.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:08:21.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.424+0000 7f41fd0e5700 1 Processor -- start 2023-05-17T15:08:21.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.424+0000 7f41fd0e5700 1 -- start start 2023-05-17T15:08:21.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41fd0e5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f41f80c6310 0x7f41f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:21.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41fd0e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f80691f0 0x7f41f80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:21.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41fd0e5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f8158790 con 0x7f41f81543d0 2023-05-17T15:08:21.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41fd0e5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80c1c50 con 0x7f41f80c6310 2023-05-17T15:08:21.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41fd0e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8157e60 con 0x7f41f80691f0 2023-05-17T15:08:21.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f41f80c6310 0x7f41f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:21.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f6d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f41f81543d0 0x7f41f80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38086/0 (socket says 172.21.15.27:38086) 2023-05-17T15:08:21.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f6d9d700 1 -- 172.21.15.27:0/531341456 learned_addr learned my addr 172.21.15.27:0/531341456 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:21.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f759e700 1 --2- 172.21.15.27:0/531341456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f80691f0 0x7f41f80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:21.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f659c700 1 -- 172.21.15.27:0/531341456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f80691f0 msgr2=0x7f41f80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:21.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f659c700 1 --2- 172.21.15.27:0/531341456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f80691f0 0x7f41f80bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f659c700 1 -- 172.21.15.27:0/531341456 >> v1:172.21.15.27:6789/0 conn(0x7f41f81543d0 legacy=0x7f41f80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:21.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f5d9b700 1 -- 172.21.15.27:0/531341456 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583853361 0 0) 0x7f41f8158790 con 0x7f41f81543d0 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.425+0000 7f41f659c700 1 -- 172.21.15.27:0/531341456 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8158140 con 0x7f41f80c6310 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41f659c700 1 --2- 172.21.15.27:0/531341456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f8068d00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f41e0009760 tx=0x7f41e0009060).ready entity=mon.0 client_cookie=e6beaa7e4461d02 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41f5d9b700 1 -- 172.21.15.27:0/531341456 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000b580 con 0x7f41f80c6310 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41f5d9b700 1 -- 172.21.15.27:0/531341456 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000b6e0 con 0x7f41f80c6310 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41f5d9b700 1 -- 172.21.15.27:0/531341456 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000ba60 con 0x7f41f80c6310 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 -- 172.21.15.27:0/531341456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 msgr2=0x7f41f8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:21.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/531341456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f8068d00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f41e0009760 tx=0x7f41e0009060).stop 2023-05-17T15:08:21.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 -- 172.21.15.27:0/531341456 shutdown_connections 2023-05-17T15:08:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/531341456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f80691f0 0x7f41f80bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/531341456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f8068d00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 -- 172.21.15.27:0/531341456 >> 172.21.15.27:0/531341456 conn(0x7f41f80cb7f0 msgr2=0x7f41f80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 -- 172.21.15.27:0/531341456 shutdown_connections 2023-05-17T15:08:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.426+0000 7f41fd0e5700 1 -- 172.21.15.27:0/531341456 wait complete. 2023-05-17T15:08:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 Processor -- start 2023-05-17T15:08:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 -- start start 2023-05-17T15:08:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f80691f0 0x7f41f8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f80af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f81543d0 0x7f41f81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81647f0 con 0x7f41f80c6310 2023-05-17T15:08:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80afdf0 con 0x7f41f80691f0 2023-05-17T15:08:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41fd0e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80b00d0 con 0x7f41f81543d0 2023-05-17T15:08:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.428+0000 7f41f659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f80af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f80af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38530/0 (socket says 172.21.15.27:38530) 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 -- 172.21.15.27:0/646076363 learned_addr learned my addr 172.21.15.27:0/646076363 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f759e700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f81543d0 0x7f41f81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f6d9d700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f80691f0 0x7f41f8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 -- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f81543d0 msgr2=0x7f41f81547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f81543d0 0x7f41f81547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 -- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f80691f0 msgr2=0x7f41f8152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f80691f0 0x7f41f8152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 -- 172.21.15.27:0/646076363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00092a0 con 0x7f41f80c6310 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f6d9d700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f80691f0 0x7f41f8152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41f659c700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f80af450 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f41f8083d00 tx=0x7f41e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000b850 con 0x7f41f80c6310 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000b9b0 con 0x7f41f80c6310 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e001b640 con 0x7f41f80c6310 2023-05-17T15:08:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f80b03b0 con 0x7f41f80c6310 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.429+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f81530a0 con 0x7f41f80c6310 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.430+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f806bdf0 con 0x7f41f80c6310 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.431+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f41e000f070 con 0x7f41f80c6310 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.431+0000 7f41eeffd700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f41d805ed90 0x7f41d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.431+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f41e007b6d0 con 0x7f41f80c6310 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.431+0000 7f41f6d9d700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f41d805ed90 0x7f41d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.431+0000 7f41f6d9d700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f41d805ed90 0x7f41d8061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f41f00016f0 tx=0x7f41f0009040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:21.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.435+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41e004cc20 con 0x7f41f80c6310 2023-05-17T15:08:21.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:21.656+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41f8158420 con 0x7f41f80c6310 2023-05-17T15:08:22.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.282+0000 7f41eeffd700 1 -- 172.21.15.27:0/646076363 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41e0028020 con 0x7f41f80c6310 2023-05-17T15:08:22.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f41d805ed90 msgr2=0x7f41d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f41d805ed90 0x7f41d8061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f41f00016f0 tx=0x7f41f0009040).stop 2023-05-17T15:08:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 msgr2=0x7f41f80af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f80af450 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f41f8083d00 tx=0x7f41e0017000).stop 2023-05-17T15:08:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 shutdown_connections 2023-05-17T15:08:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f41d805ed90 0x7f41d8061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41f81543d0 0x7f41f81547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f80691f0 0x7f41f8152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 --2- 172.21.15.27:0/646076363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41f80c6310 0x7f41f80af450 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.284+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 >> 172.21.15.27:0/646076363 conn(0x7f41f80cb7f0 msgr2=0x7f41f8156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:22.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.285+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 shutdown_connections 2023-05-17T15:08:22.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.285+0000 7f41fd0e5700 1 -- 172.21.15.27:0/646076363 wait complete. 2023-05-17T15:08:22.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:22.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.420+0000 7f18252cd700 1 Processor -- start 2023-05-17T15:08:22.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.420+0000 7f18252cd700 1 -- start start 2023-05-17T15:08:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f18252cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820155410 0x7f1820065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f18252cd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1820153a60 0x7f1820153f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f18252cd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1820069000 con 0x7f1820065550 2023-05-17T15:08:22.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f18252cd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1820066850 con 0x7f1820153a60 2023-05-17T15:08:22.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f18252cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1820067f60 con 0x7f1820155410 2023-05-17T15:08:22.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1820153a60 0x7f1820153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1820153a60 0x7f1820153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38542/0 (socket says 172.21.15.27:38542) 2023-05-17T15:08:22.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 -- 172.21.15.27:0/1439735794 learned_addr learned my addr 172.21.15.27:0/1439735794 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:22.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181e7fc700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820155410 0x7f1820065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 -- 172.21.15.27:0/1439735794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820155410 msgr2=0x7f1820065930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:22.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820155410 0x7f1820065930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 -- 172.21.15.27:0/1439735794 >> v1:172.21.15.40:6789/0 conn(0x7f1820065550 legacy=0x7f1820066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181f7fe700 1 -- 172.21.15.27:0/1439735794 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820068240 con 0x7f1820153a60 2023-05-17T15:08:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.421+0000 7f181e7fc700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820155410 0x7f1820065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f181f7fe700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820153a60 0x7f1820153f10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f1810009f20 tx=0x7f1810009840).ready entity=mon.0 client_cookie=179b95ce70a2530f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f181dffb700 1 -- 172.21.15.27:0/1439735794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000e070 con 0x7f1820153a60 2023-05-17T15:08:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f181dffb700 1 -- 172.21.15.27:0/1439735794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000ba40 con 0x7f1820153a60 2023-05-17T15:08:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f181dffb700 1 -- 172.21.15.27:0/1439735794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000bdc0 con 0x7f1820153a60 2023-05-17T15:08:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 -- 172.21.15.27:0/1439735794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820153a60 msgr2=0x7f1820153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820153a60 0x7f1820153f10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f1810009f20 tx=0x7f1810009840).stop 2023-05-17T15:08:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 -- 172.21.15.27:0/1439735794 shutdown_connections 2023-05-17T15:08:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820153a60 0x7f1820153f10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 --2- 172.21.15.27:0/1439735794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820155410 0x7f1820065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 -- 172.21.15.27:0/1439735794 >> 172.21.15.27:0/1439735794 conn(0x7f18200c94a0 msgr2=0x7f18200c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 -- 172.21.15.27:0/1439735794 shutdown_connections 2023-05-17T15:08:22.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.422+0000 7f18252cd700 1 -- 172.21.15.27:0/1439735794 wait complete. 2023-05-17T15:08:22.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 Processor -- start 2023-05-17T15:08:22.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 -- start start 2023-05-17T15:08:22.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820065550 0x7f182014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820153a60 0x7f18200c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 0x7f18200c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200aba00 con 0x7f1820155410 2023-05-17T15:08:22.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c1b10 con 0x7f1820153a60 2023-05-17T15:08:22.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f18252cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182014ceb0 con 0x7f1820065550 2023-05-17T15:08:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f181f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 0x7f18200c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f181f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 0x7f18200c09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38548/0 (socket says 172.21.15.27:38548) 2023-05-17T15:08:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.424+0000 7f181f7fe700 1 -- 172.21.15.27:0/4176938953 learned_addr learned my addr 172.21.15.27:0/4176938953 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181e7fc700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820153a60 0x7f18200c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181effd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820065550 0x7f182014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181f7fe700 1 -- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820065550 msgr2=0x7f182014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181f7fe700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820065550 0x7f182014c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181f7fe700 1 -- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820153a60 msgr2=0x7f18200c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181f7fe700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820153a60 0x7f18200c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181f7fe700 1 -- 172.21.15.27:0/4176938953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009ae0 con 0x7f1820155410 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f181f7fe700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 0x7f18200c09b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f1820067a70 tx=0x7f1810009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100092e0 con 0x7f1820155410 2023-05-17T15:08:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181001e470 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18200abbe0 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181001e830 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.425+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18200ac1a0 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.426+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182006bdf0 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.426+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1810025030 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.427+0000 7f1816ffd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f180005ed90 0x7f1800061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.427+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f181007b490 con 0x7f1820155410 2023-05-17T15:08:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.427+0000 7f181effd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f180005ed90 0x7f1800061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.427+0000 7f181effd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f180005ed90 0x7f1800061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f18200aec20 tx=0x7f1818007d20).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.431+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f181004c9e0 con 0x7f1820155410 2023-05-17T15:08:22.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.647+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18200c5270 con 0x7f1820155410 2023-05-17T15:08:22.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.648+0000 7f1816ffd700 1 -- 172.21.15.27:0/4176938953 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f1810023070 con 0x7f1820155410 2023-05-17T15:08:22.652 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:22.652 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:19.270502+0000","modified":"2023-05-17T15:08:22.276979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1785297520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1785297520},{"type":"v1","addr":"172.21.15.40:6835","nonce":1785297520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-17T15:08:22.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.649+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f180005ed90 msgr2=0x7f1800061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.649+0000 7f18252cd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f180005ed90 0x7f1800061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f18200aec20 tx=0x7f1818007d20).stop 2023-05-17T15:08:22.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.649+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 msgr2=0x7f18200c09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.649+0000 7f18252cd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 0x7f18200c09b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f1820067a70 tx=0x7f1810009840).stop 2023-05-17T15:08:22.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 shutdown_connections 2023-05-17T15:08:22.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f180005ed90 0x7f1800061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1820155410 0x7f18200c09b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820065550 0x7f182014c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 --2- 172.21.15.27:0/4176938953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820153a60 0x7f18200c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 >> 172.21.15.27:0/4176938953 conn(0x7f18200c94a0 msgr2=0x7f182014d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:22.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 shutdown_connections 2023-05-17T15:08:22.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.650+0000 7f18252cd700 1 -- 172.21.15.27:0/4176938953 wait complete. 2023-05-17T15:08:22.655 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2023-05-17T15:08:22.665 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.778+0000 7fb90991e700 1 Processor -- start 2023-05-17T15:08:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.778+0000 7fb90991e700 1 -- start start 2023-05-17T15:08:22.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb90991e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9040c1730 0x7fb9041543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb90991e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040bfcd0 con 0x7fb9040c5f30 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb90991e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040c0290 con 0x7fb9040c6310 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb90991e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9040aa1a0 con 0x7fb9040c1730 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb9037fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9040c1730 0x7fb9041543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb9037fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9040c1730 0x7fb9041543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38554/0 (socket says 172.21.15.27:38554) 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb9037fe700 1 -- 172.21.15.27:0/4214184330 learned_addr learned my addr 172.21.15.27:0/4214184330 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb902ffd700 1 --1- 172.21.15.27:0/4214184330 >> v1:172.21.15.27:6789/0 conn(0x7fb9040c5f30 0x7fb904158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38114/0 (socket says 172.21.15.27:38114) 2023-05-17T15:08:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb9037fe700 1 -- 172.21.15.27:0/4214184330 >> v1:172.21.15.40:6789/0 conn(0x7fb9040c6310 legacy=0x7fb904153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb9037fe700 1 -- 172.21.15.27:0/4214184330 >> v1:172.21.15.27:6789/0 conn(0x7fb9040c5f30 legacy=0x7fb904158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb9037fe700 1 -- 172.21.15.27:0/4214184330 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040aa480 con 0x7fb9040c1730 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.779+0000 7fb901ffb700 1 -- 172.21.15.27:0/4214184330 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500109289 0 0) 0x7fb9040bfcd0 con 0x7fb9040c5f30 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb9037fe700 1 --2- 172.21.15.27:0/4214184330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c1730 0x7fb9041543e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fb8f4006fd0 tx=0x7fb8f40090f0).ready entity=mon.0 client_cookie=21a3563e4e594db9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb901ffb700 1 -- 172.21.15.27:0/4214184330 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400b600 con 0x7fb9040c1730 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb901ffb700 1 -- 172.21.15.27:0/4214184330 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f400b760 con 0x7fb9040c1730 2023-05-17T15:08:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb901ffb700 1 -- 172.21.15.27:0/4214184330 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400bae0 con 0x7fb9040c1730 2023-05-17T15:08:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 -- 172.21.15.27:0/4214184330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c1730 msgr2=0x7fb9041543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 --2- 172.21.15.27:0/4214184330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c1730 0x7fb9041543e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fb8f4006fd0 tx=0x7fb8f40090f0).stop 2023-05-17T15:08:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 -- 172.21.15.27:0/4214184330 shutdown_connections 2023-05-17T15:08:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 --2- 172.21.15.27:0/4214184330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c1730 0x7fb9041543e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 -- 172.21.15.27:0/4214184330 >> 172.21.15.27:0/4214184330 conn(0x7fb904069e70 msgr2=0x7fb90405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 -- 172.21.15.27:0/4214184330 shutdown_connections 2023-05-17T15:08:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.780+0000 7fb90991e700 1 -- 172.21.15.27:0/4214184330 wait complete. 2023-05-17T15:08:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 Processor -- start 2023-05-17T15:08:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 -- start start 2023-05-17T15:08:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9040c1730 0x7fb90414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040c5f30 0x7fb904153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 0x7fb904167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb904158060 con 0x7fb9040c6310 2023-05-17T15:08:22.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb904168da0 con 0x7fb9040c5f30 2023-05-17T15:08:22.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb90991e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb904157a50 con 0x7fb9040c1730 2023-05-17T15:08:22.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb9037fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 0x7fb904167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb9037fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 0x7fb904167f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38562/0 (socket says 172.21.15.27:38562) 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.782+0000 7fb9037fe700 1 -- 172.21.15.27:0/889203527 learned_addr learned my addr 172.21.15.27:0/889203527 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9027fc700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040c5f30 0x7fb904153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb902ffd700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9040c1730 0x7fb90414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9037fe700 1 -- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9040c1730 msgr2=0x7fb90414cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9037fe700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9040c1730 0x7fb90414cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9037fe700 1 -- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040c5f30 msgr2=0x7fb904153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9037fe700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040c5f30 0x7fb904153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9037fe700 1 -- 172.21.15.27:0/889203527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4009370 con 0x7fb9040c6310 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb9037fe700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 0x7fb904167f50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fb8f4006b30 tx=0x7fb8f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400bae0 con 0x7fb9040c6310 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f401c420 con 0x7fb9040c6310 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb904155660 con 0x7fb9040c6310 2023-05-17T15:08:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f401c7a0 con 0x7fb9040c6310 2023-05-17T15:08:22.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.783+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb904155330 con 0x7fb9040c6310 2023-05-17T15:08:22.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.784+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90405f4a0 con 0x7fb9040c6310 2023-05-17T15:08:22.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.784+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb8f402c070 con 0x7fb9040c6310 2023-05-17T15:08:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.785+0000 7fb8faffd700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb8e405ed90 0x7fb8e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.785+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fb8f407b9d0 con 0x7fb9040c6310 2023-05-17T15:08:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.785+0000 7fb902ffd700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb8e405ed90 0x7fb8e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.785+0000 7fb902ffd700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb8e405ed90 0x7fb8e4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb8fc001560 tx=0x7fb8fc007f30).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:22.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.789+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8f404cf20 con 0x7fb9040c6310 2023-05-17T15:08:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.965+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb90406bdf0 con 0x7fb9040c6310 2023-05-17T15:08:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.966+0000 7fb8faffd700 1 -- 172.21.15.27:0/889203527 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17044 (secure 0 0 0) 0x7fb8f402a070 con 0x7fb9040c6310 2023-05-17T15:08:22.970 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:22.970 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":83,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:20.271831+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:17.825758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:18.244928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb8e405ed90 msgr2=0x7fb8e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb8e405ed90 0x7fb8e4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb8fc001560 tx=0x7fb8fc007f30).stop 2023-05-17T15:08:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 msgr2=0x7fb904167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 0x7fb904167f50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fb8f4006b30 tx=0x7fb8f4017000).stop 2023-05-17T15:08:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 shutdown_connections 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb8e405ed90 0x7fb8e4061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9040c6310 0x7fb904167f50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9040c1730 0x7fb90414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 --2- 172.21.15.27:0/889203527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040c5f30 0x7fb904153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 >> 172.21.15.27:0/889203527 conn(0x7fb904069e70 msgr2=0x7fb90414d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 shutdown_connections 2023-05-17T15:08:22.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:22.968+0000 7fb90991e700 1 -- 172.21.15.27:0/889203527 wait complete. 2023-05-17T15:08:22.984 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:08:22.985 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.097+0000 7f7c125bc700 1 Processor -- start 2023-05-17T15:08:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.097+0000 7f7c125bc700 1 -- start start 2023-05-17T15:08:23.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c125bc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c0c153a70 0x7f7c0c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c125bc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c157a80 con 0x7f7c0c0c5f80 2023-05-17T15:08:23.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c125bc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c157d60 con 0x7f7c0c0ca9e0 2023-05-17T15:08:23.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c125bc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c6360 con 0x7f7c0c153a70 2023-05-17T15:08:23.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c11dbb700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7c0c0c5f80 0x7f7c0c0bfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38132/0 (socket says 172.21.15.27:38132) 2023-05-17T15:08:23.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c11dbb700 1 -- 172.21.15.27:0/3278063415 learned_addr learned my addr 172.21.15.27:0/3278063415 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c115ba700 1 --2- 172.21.15.27:0/3278063415 >> v2:172.21.15.40:3300/0 conn(0x7f7c0c153a70 0x7f7c0c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043579113 0 0) 0x7f7c0c157a80 con 0x7f7c0c0c5f80 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf40033f0 con 0x7f7c0c0c5f80 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062724596 0 0) 0x7f7c0c157d60 con 0x7f7c0c0ca9e0 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.098+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c0c157a80 con 0x7f7c0c0ca9e0 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853862762 0 0) 0x7f7bf40033f0 con 0x7f7c0c0c5f80 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 >> v2:172.21.15.40:3300/0 conn(0x7f7c0c153a70 msgr2=0x7f7c0c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 --2- 172.21.15.27:0/3278063415 >> v2:172.21.15.40:3300/0 conn(0x7f7c0c153a70 0x7f7c0c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 >> v1:172.21.15.40:6789/0 conn(0x7f7c0c0ca9e0 legacy=0x7f7c0c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c158040 con 0x7f7c0c0c5f80 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f7bfc001470 con 0x7f7c0c0c5f80 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c115ba700 1 --2- 172.21.15.27:0/3278063415 >> v2:172.21.15.40:3300/0 conn(0x7f7c0c153a70 0x7f7c0c153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 >> v1:172.21.15.27:6789/0 conn(0x7f7c0c0c5f80 legacy=0x7f7c0c0bfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4003a70 0x7f7bf4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7bf4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf4005000 0x7f7bf400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400bf60 con 0x7f7bf4004690 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400c0a0 con 0x7f7bf4003a70 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400c210 con 0x7f7bf4005000 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7bf4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c115ba700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4003a70 0x7f7bf4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c11dbb700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf4005000 0x7f7bf400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 -- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf4005000 msgr2=0x7f7bf400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf4005000 0x7f7bf400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 -- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4003a70 msgr2=0x7f7bf4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4003a70 0x7f7bf4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c11dbb700 1 -- 172.21.15.27:0/3278063415 reap_dead start 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 -- 172.21.15.27:0/3278063415 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40033f0 con 0x7f7bf4004690 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c10db9700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7bf4004b10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f7c00001f90 tx=0x7f7c00007f30).ready entity=mon.0 client_cookie=8a65a3cd8435db68 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00006a20 con 0x7f7bf4004690 2023-05-17T15:08:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00006b80 con 0x7f7bf4004690 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.099+0000 7f7c0bfff700 1 -- 172.21.15.27:0/3278063415 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000c8b0 con 0x7f7bf4004690 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 -- 172.21.15.27:0/3278063415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 msgr2=0x7f7bf4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7bf4004b10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f7c00001f90 tx=0x7f7c00007f30).stop 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 -- 172.21.15.27:0/3278063415 shutdown_connections 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 --2- 172.21.15.27:0/3278063415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7bf4004b10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 -- 172.21.15.27:0/3278063415 >> 172.21.15.27:0/3278063415 conn(0x7f7c0c05dd50 msgr2=0x7f7c0c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 -- 172.21.15.27:0/3278063415 shutdown_connections 2023-05-17T15:08:23.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.100+0000 7f7c125bc700 1 -- 172.21.15.27:0/3278063415 wait complete. 2023-05-17T15:08:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.101+0000 7f7c125bc700 1 Processor -- start 2023-05-17T15:08:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.101+0000 7f7c125bc700 1 -- start start 2023-05-17T15:08:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c125bc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7c0c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c125bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c0c0c98a0 0x7f7c0c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c125bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c0c151550 0x7f7c0c0a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c125bc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1502c0 con 0x7f7bf4004690 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c125bc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1510c0 con 0x7f7c0c0c98a0 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c125bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0c9d20 con 0x7f7c0c151550 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7c0c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7c0c14fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38578/0 (socket says 172.21.15.27:38578) 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 -- 172.21.15.27:0/2814862938 learned_addr learned my addr 172.21.15.27:0/2814862938 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:23.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 -- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c0c151550 msgr2=0x7f7c0c0a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c11dbb700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c0c151550 0x7f7c0c0a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c10db9700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c0c0c98a0 0x7f7c0c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c0c151550 0x7f7c0c0a9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 -- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c0c0c98a0 msgr2=0x7f7c0c14f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c0c0c98a0 0x7f7c0c14f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 -- 172.21.15.27:0/2814862938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c1504b0 con 0x7f7bf4004690 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.102+0000 7f7c115ba700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7c0c14fdd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f7c04011a50 tx=0x7f7c04009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.103+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400fa10 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.103+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0400fb70 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.103+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04014440 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.103+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c150790 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.103+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c150d50 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.104+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c1513a0 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.104+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7c04024070 con 0x7f7bf4004690 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.104+0000 7f7c097fa700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7bf805ed90 0x7f7bf8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.104+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f7c0407a6b0 con 0x7f7bf4004690 2023-05-17T15:08:23.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.104+0000 7f7c10db9700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7bf805ed90 0x7f7bf8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.105+0000 7f7c10db9700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7bf805ed90 0x7f7bf8061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7c0c151df0 tx=0x7f7c00015000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.108+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c0404bc00 con 0x7f7bf4004690 2023-05-17T15:08:23.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.280+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c0c158320 con 0x7f7bf805ed90 2023-05-17T15:08:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.291+0000 7f7c097fa700 1 -- 172.21.15.27:0/2814862938 <== mgr.6003 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358323 (secure 0 0 0) 0x7f7c0c158320 con 0x7f7bf805ed90 2023-05-17T15:08:23.299 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:23.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7bf805ed90 msgr2=0x7f7bf8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7bf805ed90 0x7f7bf8061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7c0c151df0 tx=0x7f7c00015000).stop 2023-05-17T15:08:23.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 msgr2=0x7f7c0c14fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7c0c14fdd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f7c04011a50 tx=0x7f7c04009060).stop 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 shutdown_connections 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7bf805ed90 0x7f7bf8061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c0c151550 0x7f7c0c0a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf4004690 0x7f7c0c14fdd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 --2- 172.21.15.27:0/2814862938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c0c0c98a0 0x7f7c0c14f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 >> 172.21.15.27:0/2814862938 conn(0x7f7c0c05dd50 msgr2=0x7f7c0c0ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:23.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 shutdown_connections 2023-05-17T15:08:23.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.294+0000 7f7c125bc700 1 -- 172.21.15.27:0/2814862938 wait complete. 2023-05-17T15:08:23.303 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:23.310 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:22.143947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138828,"kb_used_data":7564,"kb_used_omap":0,"kb_used_meta":131200,"kb_avail":754835892,"statfs":{"total":773094113280,"available":772951953408,"internally_reserved":0,"allocated":7745536,"data_stored":3855591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":134348800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27717,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.612711"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891375+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911990+0000","last_change":"2023-05-17T15:08:18.911990+0000","last_active":"2023-05-17T15:08:18.911990+0000","last_peered":"2023-05-17T15:08:18.911990+0000","last_clean":"2023-05-17T15:08:18.911990+0000","last_became_active":"2023-05-17T15:08:18.911703+0000","last_became_peered":"2023-05-17T15:08:18.911703+0000","last_unstale":"2023-05-17T15:08:18.911990+0000","last_undegraded":"2023-05-17T15:08:18.911990+0000","last_fullsized":"2023-05-17T15:08:18.911990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.898587+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902229+0000","last_change":"2023-05-17T15:08:18.902229+0000","last_active":"2023-05-17T15:08:18.902229+0000","last_peered":"2023-05-17T15:08:18.902229+0000","last_clean":"2023-05-17T15:08:18.902229+0000","last_became_active":"2023-05-17T15:08:18.901917+0000","last_became_peered":"2023-05-17T15:08:18.901917+0000","last_unstale":"2023-05-17T15:08:18.902229+0000","last_undegraded":"2023-05-17T15:08:18.902229+0000","last_fullsized":"2023-05-17T15:08:18.902229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894567+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908877+0000","last_change":"2023-05-17T15:08:18.908877+0000","last_active":"2023-05-17T15:08:18.908877+0000","last_peered":"2023-05-17T15:08:18.908877+0000","last_clean":"2023-05-17T15:08:18.908877+0000","last_became_active":"2023-05-17T15:08:18.908536+0000","last_became_peered":"2023-05-17T15:08:18.908536+0000","last_unstale":"2023-05-17T15:08:18.908877+0000","last_undegraded":"2023-05-17T15:08:18.908877+0000","last_fullsized":"2023-05-17T15:08:18.908877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893179+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904853+0000","last_change":"2023-05-17T15:08:18.904853+0000","last_active":"2023-05-17T15:08:18.904853+0000","last_peered":"2023-05-17T15:08:18.904853+0000","last_clean":"2023-05-17T15:08:18.904853+0000","last_became_active":"2023-05-17T15:08:18.904460+0000","last_became_peered":"2023-05-17T15:08:18.904460+0000","last_unstale":"2023-05-17T15:08:18.904853+0000","last_undegraded":"2023-05-17T15:08:18.904853+0000","last_fullsized":"2023-05-17T15:08:18.904853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891549+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904506+0000","last_change":"2023-05-17T15:08:18.904506+0000","last_active":"2023-05-17T15:08:18.904506+0000","last_peered":"2023-05-17T15:08:18.904506+0000","last_clean":"2023-05-17T15:08:18.904506+0000","last_became_active":"2023-05-17T15:08:18.904213+0000","last_became_peered":"2023-05-17T15:08:18.904213+0000","last_unstale":"2023-05-17T15:08:18.904506+0000","last_undegraded":"2023-05-17T15:08:18.904506+0000","last_fullsized":"2023-05-17T15:08:18.904506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891832+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902858+0000","last_change":"2023-05-17T15:08:18.902858+0000","last_active":"2023-05-17T15:08:18.902858+0000","last_peered":"2023-05-17T15:08:18.902858+0000","last_clean":"2023-05-17T15:08:18.902858+0000","last_became_active":"2023-05-17T15:08:18.902398+0000","last_became_peered":"2023-05-17T15:08:18.902398+0000","last_unstale":"2023-05-17T15:08:18.902858+0000","last_undegraded":"2023-05-17T15:08:18.902858+0000","last_fullsized":"2023-05-17T15:08:18.902858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890210+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.901694+0000","last_change":"2023-05-17T15:08:18.901694+0000","last_active":"2023-05-17T15:08:18.901694+0000","last_peered":"2023-05-17T15:08:18.901694+0000","last_clean":"2023-05-17T15:08:18.901694+0000","last_became_active":"2023-05-17T15:08:18.900872+0000","last_became_peered":"2023-05-17T15:08:18.900872+0000","last_unstale":"2023-05-17T15:08:18.901694+0000","last_undegraded":"2023-05-17T15:08:18.901694+0000","last_fullsized":"2023-05-17T15:08:18.901694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900511+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899762+0000","last_change":"2023-05-17T15:08:18.899762+0000","last_active":"2023-05-17T15:08:18.899762+0000","last_peered":"2023-05-17T15:08:18.899762+0000","last_clean":"2023-05-17T15:08:18.899762+0000","last_became_active":"2023-05-17T15:08:18.899483+0000","last_became_peered":"2023-05-17T15:08:18.899483+0000","last_unstale":"2023-05-17T15:08:18.899762+0000","last_undegraded":"2023-05-17T15:08:18.899762+0000","last_fullsized":"2023-05-17T15:08:18.899762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894058+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896324+0000","last_change":"2023-05-17T15:08:18.896324+0000","last_active":"2023-05-17T15:08:18.896324+0000","last_peered":"2023-05-17T15:08:18.896324+0000","last_clean":"2023-05-17T15:08:18.896324+0000","last_became_active":"2023-05-17T15:08:18.896047+0000","last_became_peered":"2023-05-17T15:08:18.896047+0000","last_unstale":"2023-05-17T15:08:18.896324+0000","last_undegraded":"2023-05-17T15:08:18.896324+0000","last_fullsized":"2023-05-17T15:08:18.896324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892171+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906953+0000","last_change":"2023-05-17T15:08:18.906953+0000","last_active":"2023-05-17T15:08:18.906953+0000","last_peered":"2023-05-17T15:08:18.906953+0000","last_clean":"2023-05-17T15:08:18.906953+0000","last_became_active":"2023-05-17T15:08:18.906669+0000","last_became_peered":"2023-05-17T15:08:18.906669+0000","last_unstale":"2023-05-17T15:08:18.906953+0000","last_undegraded":"2023-05-17T15:08:18.906953+0000","last_fullsized":"2023-05-17T15:08:18.906953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896009+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896887+0000","last_change":"2023-05-17T15:08:18.896887+0000","last_active":"2023-05-17T15:08:18.896887+0000","last_peered":"2023-05-17T15:08:18.896887+0000","last_clean":"2023-05-17T15:08:18.896887+0000","last_became_active":"2023-05-17T15:08:18.896589+0000","last_became_peered":"2023-05-17T15:08:18.896589+0000","last_unstale":"2023-05-17T15:08:18.896887+0000","last_undegraded":"2023-05-17T15:08:18.896887+0000","last_fullsized":"2023-05-17T15:08:18.896887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.898917+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906169+0000","last_change":"2023-05-17T15:08:18.906169+0000","last_active":"2023-05-17T15:08:18.906169+0000","last_peered":"2023-05-17T15:08:18.906169+0000","last_clean":"2023-05-17T15:08:18.906169+0000","last_became_active":"2023-05-17T15:08:18.905905+0000","last_became_peered":"2023-05-17T15:08:18.905905+0000","last_unstale":"2023-05-17T15:08:18.906169+0000","last_undegraded":"2023-05-17T15:08:18.906169+0000","last_fullsized":"2023-05-17T15:08:18.906169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897416+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910832+0000","last_change":"2023-05-17T15:08:18.910832+0000","last_active":"2023-05-17T15:08:18.910832+0000","last_peered":"2023-05-17T15:08:18.910832+0000","last_clean":"2023-05-17T15:08:18.910832+0000","last_became_active":"2023-05-17T15:08:18.910487+0000","last_became_peered":"2023-05-17T15:08:18.910487+0000","last_unstale":"2023-05-17T15:08:18.910832+0000","last_undegraded":"2023-05-17T15:08:18.910832+0000","last_fullsized":"2023-05-17T15:08:18.910832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897205+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906558+0000","last_change":"2023-05-17T15:08:18.906558+0000","last_active":"2023-05-17T15:08:18.906558+0000","last_peered":"2023-05-17T15:08:18.906558+0000","last_clean":"2023-05-17T15:08:18.906558+0000","last_became_active":"2023-05-17T15:08:18.906249+0000","last_became_peered":"2023-05-17T15:08:18.906249+0000","last_unstale":"2023-05-17T15:08:18.906558+0000","last_undegraded":"2023-05-17T15:08:18.906558+0000","last_fullsized":"2023-05-17T15:08:18.906558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896964+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.901512+0000","last_change":"2023-05-17T15:08:18.901512+0000","last_active":"2023-05-17T15:08:18.901512+0000","last_peered":"2023-05-17T15:08:18.901512+0000","last_clean":"2023-05-17T15:08:18.901512+0000","last_became_active":"2023-05-17T15:08:18.901188+0000","last_became_peered":"2023-05-17T15:08:18.901188+0000","last_unstale":"2023-05-17T15:08:18.901512+0000","last_undegraded":"2023-05-17T15:08:18.901512+0000","last_fullsized":"2023-05-17T15:08:18.901512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889451+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.900142+0000","last_change":"2023-05-17T15:08:18.900142+0000","last_active":"2023-05-17T15:08:18.900142+0000","last_peered":"2023-05-17T15:08:18.900142+0000","last_clean":"2023-05-17T15:08:18.900142+0000","last_became_active":"2023-05-17T15:08:18.899673+0000","last_became_peered":"2023-05-17T15:08:18.899673+0000","last_unstale":"2023-05-17T15:08:18.900142+0000","last_undegraded":"2023-05-17T15:08:18.900142+0000","last_fullsized":"2023-05-17T15:08:18.900142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893835+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.909889+0000","last_change":"2023-05-17T15:08:18.909889+0000","last_active":"2023-05-17T15:08:18.909889+0000","last_peered":"2023-05-17T15:08:18.909889+0000","last_clean":"2023-05-17T15:08:18.909889+0000","last_became_active":"2023-05-17T15:08:18.908186+0000","last_became_peered":"2023-05-17T15:08:18.908186+0000","last_unstale":"2023-05-17T15:08:18.909889+0000","last_undegraded":"2023-05-17T15:08:18.909889+0000","last_fullsized":"2023-05-17T15:08:18.909889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900140+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910773+0000","last_change":"2023-05-17T15:08:18.910773+0000","last_active":"2023-05-17T15:08:18.910773+0000","last_peered":"2023-05-17T15:08:18.910773+0000","last_clean":"2023-05-17T15:08:18.910773+0000","last_became_active":"2023-05-17T15:08:18.910497+0000","last_became_peered":"2023-05-17T15:08:18.910497+0000","last_unstale":"2023-05-17T15:08:18.910773+0000","last_undegraded":"2023-05-17T15:08:18.910773+0000","last_fullsized":"2023-05-17T15:08:18.910773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892745+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911295+0000","last_change":"2023-05-17T15:08:18.911295+0000","last_active":"2023-05-17T15:08:18.911295+0000","last_peered":"2023-05-17T15:08:18.911295+0000","last_clean":"2023-05-17T15:08:18.911295+0000","last_became_active":"2023-05-17T15:08:18.910808+0000","last_became_peered":"2023-05-17T15:08:18.910808+0000","last_unstale":"2023-05-17T15:08:18.911295+0000","last_undegraded":"2023-05-17T15:08:18.911295+0000","last_fullsized":"2023-05-17T15:08:18.911295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892938+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906256+0000","last_change":"2023-05-17T15:08:18.906256+0000","last_active":"2023-05-17T15:08:18.906256+0000","last_peered":"2023-05-17T15:08:18.906256+0000","last_clean":"2023-05-17T15:08:18.906256+0000","last_became_active":"2023-05-17T15:08:18.905999+0000","last_became_peered":"2023-05-17T15:08:18.905999+0000","last_unstale":"2023-05-17T15:08:18.906256+0000","last_undegraded":"2023-05-17T15:08:18.906256+0000","last_fullsized":"2023-05-17T15:08:18.906256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900402+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.909953+0000","last_change":"2023-05-17T15:08:18.909953+0000","last_active":"2023-05-17T15:08:18.909953+0000","last_peered":"2023-05-17T15:08:18.909953+0000","last_clean":"2023-05-17T15:08:18.909953+0000","last_became_active":"2023-05-17T15:08:18.909651+0000","last_became_peered":"2023-05-17T15:08:18.909651+0000","last_unstale":"2023-05-17T15:08:18.909953+0000","last_undegraded":"2023-05-17T15:08:18.909953+0000","last_fullsized":"2023-05-17T15:08:18.909953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894289+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.907734+0000","last_change":"2023-05-17T15:08:18.907734+0000","last_active":"2023-05-17T15:08:18.907734+0000","last_peered":"2023-05-17T15:08:18.907734+0000","last_clean":"2023-05-17T15:08:18.907734+0000","last_became_active":"2023-05-17T15:08:18.907160+0000","last_became_peered":"2023-05-17T15:08:18.907160+0000","last_unstale":"2023-05-17T15:08:18.907734+0000","last_undegraded":"2023-05-17T15:08:18.907734+0000","last_fullsized":"2023-05-17T15:08:18.907734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893909+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911286+0000","last_change":"2023-05-17T15:08:18.911286+0000","last_active":"2023-05-17T15:08:18.911286+0000","last_peered":"2023-05-17T15:08:18.911286+0000","last_clean":"2023-05-17T15:08:18.911286+0000","last_became_active":"2023-05-17T15:08:18.911011+0000","last_became_peered":"2023-05-17T15:08:18.911011+0000","last_unstale":"2023-05-17T15:08:18.911286+0000","last_undegraded":"2023-05-17T15:08:18.911286+0000","last_fullsized":"2023-05-17T15:08:18.911286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.888633+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910917+0000","last_change":"2023-05-17T15:08:18.910917+0000","last_active":"2023-05-17T15:08:18.910917+0000","last_peered":"2023-05-17T15:08:18.910917+0000","last_clean":"2023-05-17T15:08:18.910917+0000","last_became_active":"2023-05-17T15:08:18.910568+0000","last_became_peered":"2023-05-17T15:08:18.910568+0000","last_unstale":"2023-05-17T15:08:18.910917+0000","last_undegraded":"2023-05-17T15:08:18.910917+0000","last_fullsized":"2023-05-17T15:08:18.910917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893968+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912622+0000","last_change":"2023-05-17T15:08:18.912622+0000","last_active":"2023-05-17T15:08:18.912622+0000","last_peered":"2023-05-17T15:08:18.912622+0000","last_clean":"2023-05-17T15:08:18.912622+0000","last_became_active":"2023-05-17T15:08:18.912374+0000","last_became_peered":"2023-05-17T15:08:18.912374+0000","last_unstale":"2023-05-17T15:08:18.912622+0000","last_undegraded":"2023-05-17T15:08:18.912622+0000","last_fullsized":"2023-05-17T15:08:18.912622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890369+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904182+0000","last_change":"2023-05-17T15:08:18.904182+0000","last_active":"2023-05-17T15:08:18.904182+0000","last_peered":"2023-05-17T15:08:18.904182+0000","last_clean":"2023-05-17T15:08:18.904182+0000","last_became_active":"2023-05-17T15:08:18.903886+0000","last_became_peered":"2023-05-17T15:08:18.903886+0000","last_unstale":"2023-05-17T15:08:18.904182+0000","last_undegraded":"2023-05-17T15:08:18.904182+0000","last_fullsized":"2023-05-17T15:08:18.904182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891985+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899689+0000","last_change":"2023-05-17T15:08:18.899689+0000","last_active":"2023-05-17T15:08:18.899689+0000","last_peered":"2023-05-17T15:08:18.899689+0000","last_clean":"2023-05-17T15:08:18.899689+0000","last_became_active":"2023-05-17T15:08:18.899378+0000","last_became_peered":"2023-05-17T15:08:18.899378+0000","last_unstale":"2023-05-17T15:08:18.899689+0000","last_undegraded":"2023-05-17T15:08:18.899689+0000","last_fullsized":"2023-05-17T15:08:18.899689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890952+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904429+0000","last_change":"2023-05-17T15:08:18.904429+0000","last_active":"2023-05-17T15:08:18.904429+0000","last_peered":"2023-05-17T15:08:18.904429+0000","last_clean":"2023-05-17T15:08:18.904429+0000","last_became_active":"2023-05-17T15:08:18.904153+0000","last_became_peered":"2023-05-17T15:08:18.904153+0000","last_unstale":"2023-05-17T15:08:18.904429+0000","last_undegraded":"2023-05-17T15:08:18.904429+0000","last_fullsized":"2023-05-17T15:08:18.904429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892271+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902320+0000","last_change":"2023-05-17T15:08:18.902320+0000","last_active":"2023-05-17T15:08:18.902320+0000","last_peered":"2023-05-17T15:08:18.902320+0000","last_clean":"2023-05-17T15:08:18.902320+0000","last_became_active":"2023-05-17T15:08:18.902016+0000","last_became_peered":"2023-05-17T15:08:18.902016+0000","last_unstale":"2023-05-17T15:08:18.902320+0000","last_undegraded":"2023-05-17T15:08:18.902320+0000","last_fullsized":"2023-05-17T15:08:18.902320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892809+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908477+0000","last_change":"2023-05-17T15:08:18.908477+0000","last_active":"2023-05-17T15:08:18.908477+0000","last_peered":"2023-05-17T15:08:18.908477+0000","last_clean":"2023-05-17T15:08:18.908477+0000","last_became_active":"2023-05-17T15:08:18.908158+0000","last_became_peered":"2023-05-17T15:08:18.908158+0000","last_unstale":"2023-05-17T15:08:18.908477+0000","last_undegraded":"2023-05-17T15:08:18.908477+0000","last_fullsized":"2023-05-17T15:08:18.908477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889115+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912608+0000","last_change":"2023-05-17T15:08:18.912608+0000","last_active":"2023-05-17T15:08:18.912608+0000","last_peered":"2023-05-17T15:08:18.912608+0000","last_clean":"2023-05-17T15:08:18.912608+0000","last_became_active":"2023-05-17T15:08:18.912316+0000","last_became_peered":"2023-05-17T15:08:18.912316+0000","last_unstale":"2023-05-17T15:08:18.912608+0000","last_undegraded":"2023-05-17T15:08:18.912608+0000","last_fullsized":"2023-05-17T15:08:18.912608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897335+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896021+0000","last_change":"2023-05-17T15:08:18.896021+0000","last_active":"2023-05-17T15:08:18.896021+0000","last_peered":"2023-05-17T15:08:18.896021+0000","last_clean":"2023-05-17T15:08:18.896021+0000","last_became_active":"2023-05-17T15:08:18.895723+0000","last_became_peered":"2023-05-17T15:08:18.895723+0000","last_unstale":"2023-05-17T15:08:18.896021+0000","last_undegraded":"2023-05-17T15:08:18.896021+0000","last_fullsized":"2023-05-17T15:08:18.896021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893751+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.907691+0000","last_change":"2023-05-17T15:08:18.907691+0000","last_active":"2023-05-17T15:08:18.907691+0000","last_peered":"2023-05-17T15:08:18.907691+0000","last_clean":"2023-05-17T15:08:18.907691+0000","last_became_active":"2023-05-17T15:08:18.907412+0000","last_became_peered":"2023-05-17T15:08:18.907412+0000","last_unstale":"2023-05-17T15:08:18.907691+0000","last_undegraded":"2023-05-17T15:08:18.907691+0000","last_fullsized":"2023-05-17T15:08:18.907691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889900+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905494+0000","last_change":"2023-05-17T15:08:18.905494+0000","last_active":"2023-05-17T15:08:18.905494+0000","last_peered":"2023-05-17T15:08:18.905494+0000","last_clean":"2023-05-17T15:08:18.905494+0000","last_became_active":"2023-05-17T15:08:18.905188+0000","last_became_peered":"2023-05-17T15:08:18.905188+0000","last_unstale":"2023-05-17T15:08:18.905494+0000","last_undegraded":"2023-05-17T15:08:18.905494+0000","last_fullsized":"2023-05-17T15:08:18.905494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891331+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896212+0000","last_change":"2023-05-17T15:08:18.896212+0000","last_active":"2023-05-17T15:08:18.896212+0000","last_peered":"2023-05-17T15:08:18.896212+0000","last_clean":"2023-05-17T15:08:18.896212+0000","last_became_active":"2023-05-17T15:08:18.895083+0000","last_became_peered":"2023-05-17T15:08:18.895083+0000","last_unstale":"2023-05-17T15:08:18.896212+0000","last_undegraded":"2023-05-17T15:08:18.896212+0000","last_fullsized":"2023-05-17T15:08:18.896212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896576+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.897185+0000","last_change":"2023-05-17T15:08:18.897185+0000","last_active":"2023-05-17T15:08:18.897185+0000","last_peered":"2023-05-17T15:08:18.897185+0000","last_clean":"2023-05-17T15:08:18.897185+0000","last_became_active":"2023-05-17T15:08:18.896913+0000","last_became_peered":"2023-05-17T15:08:18.896913+0000","last_unstale":"2023-05-17T15:08:18.897185+0000","last_undegraded":"2023-05-17T15:08:18.897185+0000","last_fullsized":"2023-05-17T15:08:18.897185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897026+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899682+0000","last_change":"2023-05-17T15:08:18.899682+0000","last_active":"2023-05-17T15:08:18.899682+0000","last_peered":"2023-05-17T15:08:18.899682+0000","last_clean":"2023-05-17T15:08:18.899682+0000","last_became_active":"2023-05-17T15:08:18.899390+0000","last_became_peered":"2023-05-17T15:08:18.899390+0000","last_unstale":"2023-05-17T15:08:18.899682+0000","last_undegraded":"2023-05-17T15:08:18.899682+0000","last_fullsized":"2023-05-17T15:08:18.899682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890765+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908919+0000","last_change":"2023-05-17T15:08:18.908919+0000","last_active":"2023-05-17T15:08:18.908919+0000","last_peered":"2023-05-17T15:08:18.908919+0000","last_clean":"2023-05-17T15:08:18.908919+0000","last_became_active":"2023-05-17T15:08:18.907484+0000","last_became_peered":"2023-05-17T15:08:18.907484+0000","last_unstale":"2023-05-17T15:08:18.908919+0000","last_undegraded":"2023-05-17T15:08:18.908919+0000","last_fullsized":"2023-05-17T15:08:18.908919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896586+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902684+0000","last_change":"2023-05-17T15:08:18.902684+0000","last_active":"2023-05-17T15:08:18.902684+0000","last_peered":"2023-05-17T15:08:18.902684+0000","last_clean":"2023-05-17T15:08:18.902684+0000","last_became_active":"2023-05-17T15:08:18.902022+0000","last_became_peered":"2023-05-17T15:08:18.902022+0000","last_unstale":"2023-05-17T15:08:18.902684+0000","last_undegraded":"2023-05-17T15:08:18.902684+0000","last_fullsized":"2023-05-17T15:08:18.902684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894233+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906313+0000","last_change":"2023-05-17T15:08:18.906313+0000","last_active":"2023-05-17T15:08:18.906313+0000","last_peered":"2023-05-17T15:08:18.906313+0000","last_clean":"2023-05-17T15:08:18.906313+0000","last_became_active":"2023-05-17T15:08:18.906018+0000","last_became_peered":"2023-05-17T15:08:18.906018+0000","last_unstale":"2023-05-17T15:08:18.906313+0000","last_undegraded":"2023-05-17T15:08:18.906313+0000","last_fullsized":"2023-05-17T15:08:18.906313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893574+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912684+0000","last_change":"2023-05-17T15:08:18.912684+0000","last_active":"2023-05-17T15:08:18.912684+0000","last_peered":"2023-05-17T15:08:18.912684+0000","last_clean":"2023-05-17T15:08:18.912684+0000","last_became_active":"2023-05-17T15:08:18.912441+0000","last_became_peered":"2023-05-17T15:08:18.912441+0000","last_unstale":"2023-05-17T15:08:18.912684+0000","last_undegraded":"2023-05-17T15:08:18.912684+0000","last_fullsized":"2023-05-17T15:08:18.912684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893758+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912324+0000","last_change":"2023-05-17T15:08:18.912324+0000","last_active":"2023-05-17T15:08:18.912324+0000","last_peered":"2023-05-17T15:08:18.912324+0000","last_clean":"2023-05-17T15:08:18.912324+0000","last_became_active":"2023-05-17T15:08:18.911979+0000","last_became_peered":"2023-05-17T15:08:18.911979+0000","last_unstale":"2023-05-17T15:08:18.912324+0000","last_undegraded":"2023-05-17T15:08:18.912324+0000","last_fullsized":"2023-05-17T15:08:18.912324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896616+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.913413+0000","last_change":"2023-05-17T15:08:18.913413+0000","last_active":"2023-05-17T15:08:18.913413+0000","last_peered":"2023-05-17T15:08:18.913413+0000","last_clean":"2023-05-17T15:08:18.913413+0000","last_became_active":"2023-05-17T15:08:18.912425+0000","last_became_peered":"2023-05-17T15:08:18.912425+0000","last_unstale":"2023-05-17T15:08:18.913413+0000","last_undegraded":"2023-05-17T15:08:18.913413+0000","last_fullsized":"2023-05-17T15:08:18.913413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890106+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903216+0000","last_change":"2023-05-17T15:08:18.903216+0000","last_active":"2023-05-17T15:08:18.903216+0000","last_peered":"2023-05-17T15:08:18.903216+0000","last_clean":"2023-05-17T15:08:18.903216+0000","last_became_active":"2023-05-17T15:08:18.902750+0000","last_became_peered":"2023-05-17T15:08:18.902750+0000","last_unstale":"2023-05-17T15:08:18.903216+0000","last_undegraded":"2023-05-17T15:08:18.903216+0000","last_fullsized":"2023-05-17T15:08:18.903216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890909+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910396+0000","last_change":"2023-05-17T15:08:18.910396+0000","last_active":"2023-05-17T15:08:18.910396+0000","last_peered":"2023-05-17T15:08:18.910396+0000","last_clean":"2023-05-17T15:08:18.910396+0000","last_became_active":"2023-05-17T15:08:18.910151+0000","last_became_peered":"2023-05-17T15:08:18.910151+0000","last_unstale":"2023-05-17T15:08:18.910396+0000","last_undegraded":"2023-05-17T15:08:18.910396+0000","last_fullsized":"2023-05-17T15:08:18.910396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889001+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902500+0000","last_change":"2023-05-17T15:08:18.902500+0000","last_active":"2023-05-17T15:08:18.902500+0000","last_peered":"2023-05-17T15:08:18.902500+0000","last_clean":"2023-05-17T15:08:18.902500+0000","last_became_active":"2023-05-17T15:08:18.902198+0000","last_became_peered":"2023-05-17T15:08:18.902198+0000","last_unstale":"2023-05-17T15:08:18.902500+0000","last_undegraded":"2023-05-17T15:08:18.902500+0000","last_fullsized":"2023-05-17T15:08:18.902500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893833+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911447+0000","last_change":"2023-05-17T15:08:18.911447+0000","last_active":"2023-05-17T15:08:18.911447+0000","last_peered":"2023-05-17T15:08:18.911447+0000","last_clean":"2023-05-17T15:08:18.911447+0000","last_became_active":"2023-05-17T15:08:18.911120+0000","last_became_peered":"2023-05-17T15:08:18.911120+0000","last_unstale":"2023-05-17T15:08:18.911447+0000","last_undegraded":"2023-05-17T15:08:18.911447+0000","last_fullsized":"2023-05-17T15:08:18.911447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890247+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908352+0000","last_change":"2023-05-17T15:08:18.908352+0000","last_active":"2023-05-17T15:08:18.908352+0000","last_peered":"2023-05-17T15:08:18.908352+0000","last_clean":"2023-05-17T15:08:18.908352+0000","last_became_active":"2023-05-17T15:08:18.908040+0000","last_became_peered":"2023-05-17T15:08:18.908040+0000","last_unstale":"2023-05-17T15:08:18.908352+0000","last_undegraded":"2023-05-17T15:08:18.908352+0000","last_fullsized":"2023-05-17T15:08:18.908352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890210+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905162+0000","last_change":"2023-05-17T15:08:18.905162+0000","last_active":"2023-05-17T15:08:18.905162+0000","last_peered":"2023-05-17T15:08:18.905162+0000","last_clean":"2023-05-17T15:08:18.905162+0000","last_became_active":"2023-05-17T15:08:18.904829+0000","last_became_peered":"2023-05-17T15:08:18.904829+0000","last_unstale":"2023-05-17T15:08:18.905162+0000","last_undegraded":"2023-05-17T15:08:18.905162+0000","last_fullsized":"2023-05-17T15:08:18.905162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890401+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904328+0000","last_change":"2023-05-17T15:08:18.904328+0000","last_active":"2023-05-17T15:08:18.904328+0000","last_peered":"2023-05-17T15:08:18.904328+0000","last_clean":"2023-05-17T15:08:18.904328+0000","last_became_active":"2023-05-17T15:08:18.904058+0000","last_became_peered":"2023-05-17T15:08:18.904058+0000","last_unstale":"2023-05-17T15:08:18.904328+0000","last_undegraded":"2023-05-17T15:08:18.904328+0000","last_fullsized":"2023-05-17T15:08:18.904328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891544+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.895653+0000","last_change":"2023-05-17T15:08:18.895653+0000","last_active":"2023-05-17T15:08:18.895653+0000","last_peered":"2023-05-17T15:08:18.895653+0000","last_clean":"2023-05-17T15:08:18.895653+0000","last_became_active":"2023-05-17T15:08:18.894704+0000","last_became_peered":"2023-05-17T15:08:18.894704+0000","last_unstale":"2023-05-17T15:08:18.895653+0000","last_undegraded":"2023-05-17T15:08:18.895653+0000","last_fullsized":"2023-05-17T15:08:18.895653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892392+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903034+0000","last_change":"2023-05-17T15:08:18.903034+0000","last_active":"2023-05-17T15:08:18.903034+0000","last_peered":"2023-05-17T15:08:18.903034+0000","last_clean":"2023-05-17T15:08:18.903034+0000","last_became_active":"2023-05-17T15:08:18.901993+0000","last_became_peered":"2023-05-17T15:08:18.901993+0000","last_unstale":"2023-05-17T15:08:18.903034+0000","last_undegraded":"2023-05-17T15:08:18.903034+0000","last_fullsized":"2023-05-17T15:08:18.903034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894072+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911966+0000","last_change":"2023-05-17T15:08:18.911966+0000","last_active":"2023-05-17T15:08:18.911966+0000","last_peered":"2023-05-17T15:08:18.911966+0000","last_clean":"2023-05-17T15:08:18.911966+0000","last_became_active":"2023-05-17T15:08:18.911688+0000","last_became_peered":"2023-05-17T15:08:18.911688+0000","last_unstale":"2023-05-17T15:08:18.911966+0000","last_undegraded":"2023-05-17T15:08:18.911966+0000","last_fullsized":"2023-05-17T15:08:18.911966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892088+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905571+0000","last_change":"2023-05-17T15:08:18.905571+0000","last_active":"2023-05-17T15:08:18.905571+0000","last_peered":"2023-05-17T15:08:18.905571+0000","last_clean":"2023-05-17T15:08:18.905571+0000","last_became_active":"2023-05-17T15:08:18.905052+0000","last_became_peered":"2023-05-17T15:08:18.905052+0000","last_unstale":"2023-05-17T15:08:18.905571+0000","last_undegraded":"2023-05-17T15:08:18.905571+0000","last_fullsized":"2023-05-17T15:08:18.905571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891186+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902853+0000","last_change":"2023-05-17T15:08:18.902853+0000","last_active":"2023-05-17T15:08:18.902853+0000","last_peered":"2023-05-17T15:08:18.902853+0000","last_clean":"2023-05-17T15:08:18.902853+0000","last_became_active":"2023-05-17T15:08:18.902447+0000","last_became_peered":"2023-05-17T15:08:18.902447+0000","last_unstale":"2023-05-17T15:08:18.902853+0000","last_undegraded":"2023-05-17T15:08:18.902853+0000","last_fullsized":"2023-05-17T15:08:18.902853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896625+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896413+0000","last_change":"2023-05-17T15:08:18.896413+0000","last_active":"2023-05-17T15:08:18.896413+0000","last_peered":"2023-05-17T15:08:18.896413+0000","last_clean":"2023-05-17T15:08:18.896413+0000","last_became_active":"2023-05-17T15:08:18.896113+0000","last_became_peered":"2023-05-17T15:08:18.896113+0000","last_unstale":"2023-05-17T15:08:18.896413+0000","last_undegraded":"2023-05-17T15:08:18.896413+0000","last_fullsized":"2023-05-17T15:08:18.896413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.899017+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903669+0000","last_change":"2023-05-17T15:08:18.903669+0000","last_active":"2023-05-17T15:08:18.903669+0000","last_peered":"2023-05-17T15:08:18.903669+0000","last_clean":"2023-05-17T15:08:18.903669+0000","last_became_active":"2023-05-17T15:08:18.903362+0000","last_became_peered":"2023-05-17T15:08:18.903362+0000","last_unstale":"2023-05-17T15:08:18.903669+0000","last_undegraded":"2023-05-17T15:08:18.903669+0000","last_fullsized":"2023-05-17T15:08:18.903669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.887786+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:17.887786+0000","last_peered":"2023-05-17T15:08:17.887786+0000","last_clean":"2023-05-17T15:08:17.887786+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:17.887786+0000","last_undegraded":"2023-05-17T15:08:17.887786+0000","last_fullsized":"2023-05-17T15:08:17.887786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892325+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905697+0000","last_change":"2023-05-17T15:08:18.905697+0000","last_active":"2023-05-17T15:08:18.905697+0000","last_peered":"2023-05-17T15:08:18.905697+0000","last_clean":"2023-05-17T15:08:18.905697+0000","last_became_active":"2023-05-17T15:08:18.905379+0000","last_became_peered":"2023-05-17T15:08:18.905379+0000","last_unstale":"2023-05-17T15:08:18.905697+0000","last_undegraded":"2023-05-17T15:08:18.905697+0000","last_fullsized":"2023-05-17T15:08:18.905697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.884117+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:17.884117+0000","last_peered":"2023-05-17T15:08:17.884117+0000","last_clean":"2023-05-17T15:08:17.884117+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:17.884117+0000","last_undegraded":"2023-05-17T15:08:17.884117+0000","last_fullsized":"2023-05-17T15:08:17.884117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.888381+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902285+0000","last_change":"2023-05-17T15:08:18.902285+0000","last_active":"2023-05-17T15:08:18.902285+0000","last_peered":"2023-05-17T15:08:18.902285+0000","last_clean":"2023-05-17T15:08:18.902285+0000","last_became_active":"2023-05-17T15:08:18.901984+0000","last_became_peered":"2023-05-17T15:08:18.901984+0000","last_unstale":"2023-05-17T15:08:18.902285+0000","last_undegraded":"2023-05-17T15:08:18.902285+0000","last_fullsized":"2023-05-17T15:08:18.902285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.886186+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:17.886186+0000","last_peered":"2023-05-17T15:08:17.886186+0000","last_clean":"2023-05-17T15:08:17.886186+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:17.886186+0000","last_undegraded":"2023-05-17T15:08:17.886186+0000","last_fullsized":"2023-05-17T15:08:17.886186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893559+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910068+0000","last_change":"2023-05-17T15:08:18.910068+0000","last_active":"2023-05-17T15:08:18.910068+0000","last_peered":"2023-05-17T15:08:18.910068+0000","last_clean":"2023-05-17T15:08:18.910068+0000","last_became_active":"2023-05-17T15:08:18.908009+0000","last_became_peered":"2023-05-17T15:08:18.908009+0000","last_unstale":"2023-05-17T15:08:18.910068+0000","last_undegraded":"2023-05-17T15:08:18.910068+0000","last_fullsized":"2023-05-17T15:08:18.910068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.884072+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:17.884072+0000","last_peered":"2023-05-17T15:08:17.884072+0000","last_clean":"2023-05-17T15:08:17.884072+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:17.884072+0000","last_undegraded":"2023-05-17T15:08:17.884072+0000","last_fullsized":"2023-05-17T15:08:17.884072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.888286+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:17.888286+0000","last_peered":"2023-05-17T15:08:17.888286+0000","last_clean":"2023-05-17T15:08:17.888286+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:17.888286+0000","last_undegraded":"2023-05-17T15:08:17.888286+0000","last_fullsized":"2023-05-17T15:08:17.888286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890309+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910475+0000","last_change":"2023-05-17T15:08:18.910475+0000","last_active":"2023-05-17T15:08:18.910475+0000","last_peered":"2023-05-17T15:08:18.910475+0000","last_clean":"2023-05-17T15:08:18.910475+0000","last_became_active":"2023-05-17T15:08:18.910197+0000","last_became_peered":"2023-05-17T15:08:18.910197+0000","last_unstale":"2023-05-17T15:08:18.910475+0000","last_undegraded":"2023-05-17T15:08:18.910475+0000","last_fullsized":"2023-05-17T15:08:18.910475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.889141+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:17.889141+0000","last_peered":"2023-05-17T15:08:17.889141+0000","last_clean":"2023-05-17T15:08:17.889141+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:17.889141+0000","last_undegraded":"2023-05-17T15:08:17.889141+0000","last_fullsized":"2023-05-17T15:08:17.889141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.895924+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.913201+0000","last_change":"2023-05-17T15:08:18.913201+0000","last_active":"2023-05-17T15:08:18.913201+0000","last_peered":"2023-05-17T15:08:18.913201+0000","last_clean":"2023-05-17T15:08:18.913201+0000","last_became_active":"2023-05-17T15:08:18.912907+0000","last_became_peered":"2023-05-17T15:08:18.912907+0000","last_unstale":"2023-05-17T15:08:18.913201+0000","last_undegraded":"2023-05-17T15:08:18.913201+0000","last_fullsized":"2023-05-17T15:08:18.913201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.890147+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:17.890147+0000","last_peered":"2023-05-17T15:08:17.890147+0000","last_clean":"2023-05-17T15:08:17.890147+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:17.890147+0000","last_undegraded":"2023-05-17T15:08:17.890147+0000","last_fullsized":"2023-05-17T15:08:17.890147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892274+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912764+0000","last_change":"2023-05-17T15:08:18.912764+0000","last_active":"2023-05-17T15:08:18.912764+0000","last_peered":"2023-05-17T15:08:18.912764+0000","last_clean":"2023-05-17T15:08:18.912764+0000","last_became_active":"2023-05-17T15:08:18.912413+0000","last_became_peered":"2023-05-17T15:08:18.912413+0000","last_unstale":"2023-05-17T15:08:18.912764+0000","last_undegraded":"2023-05-17T15:08:18.912764+0000","last_fullsized":"2023-05-17T15:08:18.912764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.887759+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:17.887759+0000","last_peered":"2023-05-17T15:08:17.887759+0000","last_clean":"2023-05-17T15:08:17.887759+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:17.887759+0000","last_undegraded":"2023-05-17T15:08:17.887759+0000","last_fullsized":"2023-05-17T15:08:17.887759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896388+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.898040+0000","last_change":"2023-05-17T15:08:18.898040+0000","last_active":"2023-05-17T15:08:18.898040+0000","last_peered":"2023-05-17T15:08:18.898040+0000","last_clean":"2023-05-17T15:08:18.898040+0000","last_became_active":"2023-05-17T15:08:18.897780+0000","last_became_peered":"2023-05-17T15:08:18.897780+0000","last_unstale":"2023-05-17T15:08:18.898040+0000","last_undegraded":"2023-05-17T15:08:18.898040+0000","last_fullsized":"2023-05-17T15:08:18.898040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.886822+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:17.886822+0000","last_peered":"2023-05-17T15:08:17.886822+0000","last_clean":"2023-05-17T15:08:17.886822+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:17.886822+0000","last_undegraded":"2023-05-17T15:08:17.886822+0000","last_fullsized":"2023-05-17T15:08:17.886822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16824,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355016,"statfs":{"total":96636764160,"available":96619536384,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56200000000000006}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.38800000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.36699999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575024,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16248,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355592,"statfs":{"total":96636764160,"available":96620126208,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.498}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16056,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355784,"statfs":{"total":96636764160,"available":96620322816,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.65700000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46400000000000002,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":1.956,"15min":1.956},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.64800000000000002,"5min":1.149,"15min":1.149},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.57599999999999996,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":0.76400000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":1.103,"15min":1.6100000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.64900000000000002},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.54900000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.524,"15min":1.524},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834575024,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15940,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94355900,"statfs":{"total":96636764160,"available":96620441600,"internally_reserved":0,"allocated":978944,"data_stored":487856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.58199999999999996}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.46800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17272,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":94354568,"statfs":{"total":96636764160,"available":96619077632,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.373}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.627},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20216,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351624,"statfs":{"total":96636764160,"available":96616062976,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26800000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.505}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16440,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355400,"statfs":{"total":96636764160,"available":96619929600,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.47199999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19832,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":18880,"kb_avail":94352008,"statfs":{"total":96636764160,"available":96616456192,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19333120},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.621,"15min":0.61199999999999999},"min":{"1min":0.51000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75800000000000001,"5min":0.82399999999999995,"15min":0.876},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.629},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.88100000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":0.80300000000000005,"15min":0.995},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.54200000000000004,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.96199999999999997},"last":0.749},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85999999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.497},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.85599999999999998},"last":0.504},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36399999999999999,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":0.754,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.623},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.83699999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:23.319 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:23.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.462+0000 7f5daa334700 1 Processor -- start 2023-05-17T15:08:23.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.463+0000 7f5daa334700 1 -- start start 2023-05-17T15:08:23.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.463+0000 7f5daa334700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da4154300 0x7f5da40c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.463+0000 7f5daa334700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40c05f0 con 0x7f5da40cb470 2023-05-17T15:08:23.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.463+0000 7f5daa334700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40aa510 con 0x7f5da40c5ef0 2023-05-17T15:08:23.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.463+0000 7f5daa334700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40bfcc0 con 0x7f5da4154300 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5da40cb470 0x7f5da4153bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38150/0 (socket says 172.21.15.27:38150) 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da37fe700 1 -- 172.21.15.27:0/3700947461 learned_addr learned my addr 172.21.15.27:0/3700947461 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da88d1700 1 --2- 172.21.15.27:0/3700947461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da4154300 0x7f5da40c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111601153 0 0) 0x7f5da40c05f0 con 0x7f5da40cb470 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c0033f0 con 0x7f5da40cb470 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771802293 0 0) 0x7f5da40aa510 con 0x7f5da40c5ef0 2023-05-17T15:08:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da40c05f0 con 0x7f5da40c5ef0 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883579485 0 0) 0x7f5d8c0033f0 con 0x7f5da40cb470 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da88d1700 1 -- 172.21.15.27:0/3700947461 >> v1:172.21.15.40:6789/0 conn(0x7f5da40c5ef0 legacy=0x7f5da40a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da88d1700 1 -- 172.21.15.27:0/3700947461 >> v1:172.21.15.27:6789/0 conn(0x7f5da40cb470 legacy=0x7f5da4153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da88d1700 1 -- 172.21.15.27:0/3700947461 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40bffa0 con 0x7f5da4154300 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da88d1700 1 --2- 172.21.15.27:0/3700947461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da4154300 0x7f5da40c62d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5d9c009e90 tx=0x7f5d9c009780).ready entity=mon.2 client_cookie=52e5449e48644cf2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00e070 con 0x7f5da4154300 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00b7a0 con 0x7f5da4154300 2023-05-17T15:08:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.464+0000 7f5da2ffd700 1 -- 172.21.15.27:0/3700947461 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98001470 con 0x7f5da4154300 2023-05-17T15:08:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 -- 172.21.15.27:0/3700947461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da4154300 msgr2=0x7f5da40c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 --2- 172.21.15.27:0/3700947461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da4154300 0x7f5da40c62d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5d9c009e90 tx=0x7f5d9c009780).stop 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 -- 172.21.15.27:0/3700947461 shutdown_connections 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 --2- 172.21.15.27:0/3700947461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da4154300 0x7f5da40c62d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 -- 172.21.15.27:0/3700947461 >> 172.21.15.27:0/3700947461 conn(0x7f5da405e810 msgr2=0x7f5da40cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 -- 172.21.15.27:0/3700947461 shutdown_connections 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.465+0000 7f5daa334700 1 -- 172.21.15.27:0/3700947461 wait complete. 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.466+0000 7f5daa334700 1 Processor -- start 2023-05-17T15:08:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.466+0000 7f5daa334700 1 -- start start 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5daa334700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da40c5ef0 0x7f5da40af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5daa334700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 0x7f5da41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5daa334700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5da4154300 0x7f5da40c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5daa334700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40aec90 con 0x7f5da40cb470 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5daa334700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40af250 con 0x7f5da4154300 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5daa334700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40afbd0 con 0x7f5da40c5ef0 2023-05-17T15:08:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 0x7f5da41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 0x7f5da41530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38594/0 (socket says 172.21.15.27:38594) 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 -- 172.21.15.27:0/3068709473 learned_addr learned my addr 172.21.15.27:0/3068709473 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da88d1700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5da4154300 0x7f5da40c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da3fff700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da40c5ef0 0x7f5da40af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 -- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da40c5ef0 msgr2=0x7f5da40af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da40c5ef0 0x7f5da40af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 -- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5da4154300 msgr2=0x7f5da40c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5da4154300 0x7f5da40c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.467+0000 7f5da37fe700 1 -- 172.21.15.27:0/3068709473 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009a20 con 0x7f5da40cb470 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.468+0000 7f5da37fe700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 0x7f5da41530c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f5d9800c7c0 tx=0x7f5d98001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.468+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980072e0 con 0x7f5da40cb470 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.468+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98007440 con 0x7f5da40cb470 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.468+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980057a0 con 0x7f5da40cb470 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.468+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da40c4c00 con 0x7f5da40cb470 2023-05-17T15:08:23.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.468+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da40aeee0 con 0x7f5da40cb470 2023-05-17T15:08:23.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.469+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da405f4a0 con 0x7f5da40cb470 2023-05-17T15:08:23.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.469+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5d98010070 con 0x7f5da40cb470 2023-05-17T15:08:23.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.470+0000 7f5d8bfff700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5d9005ed90 0x7f5d90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.470+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f5d98079300 con 0x7f5da40cb470 2023-05-17T15:08:23.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.470+0000 7f5da3fff700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5d9005ed90 0x7f5d90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.470+0000 7f5da3fff700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5d9005ed90 0x7f5d90061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5d94007fd0 tx=0x7f5d94007b90).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.474+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d9804a850 con 0x7f5da40cb470 2023-05-17T15:08:23.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.643+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5da406bdf0 con 0x7f5d9005ed90 2023-05-17T15:08:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.653+0000 7f5d8bfff700 1 -- 172.21.15.27:0/3068709473 <== mgr.6003 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358323 (secure 0 0 0) 0x7f5da406bdf0 con 0x7f5d9005ed90 2023-05-17T15:08:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:23.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5d9005ed90 msgr2=0x7f5d90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5d9005ed90 0x7f5d90061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5d94007fd0 tx=0x7f5d94007b90).stop 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 msgr2=0x7f5da41530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 0x7f5da41530c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f5d9800c7c0 tx=0x7f5d98001a50).stop 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 shutdown_connections 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5d9005ed90 0x7f5d90061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5da4154300 0x7f5da40c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5da40c5ef0 0x7f5da40af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 --2- 172.21.15.27:0/3068709473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da40cb470 0x7f5da41530c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.656+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 >> 172.21.15.27:0/3068709473 conn(0x7f5da405e810 msgr2=0x7f5da40a9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.657+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 shutdown_connections 2023-05-17T15:08:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.657+0000 7f5daa334700 1 -- 172.21.15.27:0/3068709473 wait complete. 2023-05-17T15:08:23.667 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:23.672 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:22.143947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138828,"kb_used_data":7564,"kb_used_omap":0,"kb_used_meta":131200,"kb_avail":754835892,"statfs":{"total":773094113280,"available":772951953408,"internally_reserved":0,"allocated":7745536,"data_stored":3855591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":134348800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27717,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.612711"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891375+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911990+0000","last_change":"2023-05-17T15:08:18.911990+0000","last_active":"2023-05-17T15:08:18.911990+0000","last_peered":"2023-05-17T15:08:18.911990+0000","last_clean":"2023-05-17T15:08:18.911990+0000","last_became_active":"2023-05-17T15:08:18.911703+0000","last_became_peered":"2023-05-17T15:08:18.911703+0000","last_unstale":"2023-05-17T15:08:18.911990+0000","last_undegraded":"2023-05-17T15:08:18.911990+0000","last_fullsized":"2023-05-17T15:08:18.911990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.898587+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902229+0000","last_change":"2023-05-17T15:08:18.902229+0000","last_active":"2023-05-17T15:08:18.902229+0000","last_peered":"2023-05-17T15:08:18.902229+0000","last_clean":"2023-05-17T15:08:18.902229+0000","last_became_active":"2023-05-17T15:08:18.901917+0000","last_became_peered":"2023-05-17T15:08:18.901917+0000","last_unstale":"2023-05-17T15:08:18.902229+0000","last_undegraded":"2023-05-17T15:08:18.902229+0000","last_fullsized":"2023-05-17T15:08:18.902229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894567+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908877+0000","last_change":"2023-05-17T15:08:18.908877+0000","last_active":"2023-05-17T15:08:18.908877+0000","last_peered":"2023-05-17T15:08:18.908877+0000","last_clean":"2023-05-17T15:08:18.908877+0000","last_became_active":"2023-05-17T15:08:18.908536+0000","last_became_peered":"2023-05-17T15:08:18.908536+0000","last_unstale":"2023-05-17T15:08:18.908877+0000","last_undegraded":"2023-05-17T15:08:18.908877+0000","last_fullsized":"2023-05-17T15:08:18.908877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893179+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904853+0000","last_change":"2023-05-17T15:08:18.904853+0000","last_active":"2023-05-17T15:08:18.904853+0000","last_peered":"2023-05-17T15:08:18.904853+0000","last_clean":"2023-05-17T15:08:18.904853+0000","last_became_active":"2023-05-17T15:08:18.904460+0000","last_became_peered":"2023-05-17T15:08:18.904460+0000","last_unstale":"2023-05-17T15:08:18.904853+0000","last_undegraded":"2023-05-17T15:08:18.904853+0000","last_fullsized":"2023-05-17T15:08:18.904853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891549+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904506+0000","last_change":"2023-05-17T15:08:18.904506+0000","last_active":"2023-05-17T15:08:18.904506+0000","last_peered":"2023-05-17T15:08:18.904506+0000","last_clean":"2023-05-17T15:08:18.904506+0000","last_became_active":"2023-05-17T15:08:18.904213+0000","last_became_peered":"2023-05-17T15:08:18.904213+0000","last_unstale":"2023-05-17T15:08:18.904506+0000","last_undegraded":"2023-05-17T15:08:18.904506+0000","last_fullsized":"2023-05-17T15:08:18.904506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891832+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902858+0000","last_change":"2023-05-17T15:08:18.902858+0000","last_active":"2023-05-17T15:08:18.902858+0000","last_peered":"2023-05-17T15:08:18.902858+0000","last_clean":"2023-05-17T15:08:18.902858+0000","last_became_active":"2023-05-17T15:08:18.902398+0000","last_became_peered":"2023-05-17T15:08:18.902398+0000","last_unstale":"2023-05-17T15:08:18.902858+0000","last_undegraded":"2023-05-17T15:08:18.902858+0000","last_fullsized":"2023-05-17T15:08:18.902858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890210+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.901694+0000","last_change":"2023-05-17T15:08:18.901694+0000","last_active":"2023-05-17T15:08:18.901694+0000","last_peered":"2023-05-17T15:08:18.901694+0000","last_clean":"2023-05-17T15:08:18.901694+0000","last_became_active":"2023-05-17T15:08:18.900872+0000","last_became_peered":"2023-05-17T15:08:18.900872+0000","last_unstale":"2023-05-17T15:08:18.901694+0000","last_undegraded":"2023-05-17T15:08:18.901694+0000","last_fullsized":"2023-05-17T15:08:18.901694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900511+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899762+0000","last_change":"2023-05-17T15:08:18.899762+0000","last_active":"2023-05-17T15:08:18.899762+0000","last_peered":"2023-05-17T15:08:18.899762+0000","last_clean":"2023-05-17T15:08:18.899762+0000","last_became_active":"2023-05-17T15:08:18.899483+0000","last_became_peered":"2023-05-17T15:08:18.899483+0000","last_unstale":"2023-05-17T15:08:18.899762+0000","last_undegraded":"2023-05-17T15:08:18.899762+0000","last_fullsized":"2023-05-17T15:08:18.899762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894058+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896324+0000","last_change":"2023-05-17T15:08:18.896324+0000","last_active":"2023-05-17T15:08:18.896324+0000","last_peered":"2023-05-17T15:08:18.896324+0000","last_clean":"2023-05-17T15:08:18.896324+0000","last_became_active":"2023-05-17T15:08:18.896047+0000","last_became_peered":"2023-05-17T15:08:18.896047+0000","last_unstale":"2023-05-17T15:08:18.896324+0000","last_undegraded":"2023-05-17T15:08:18.896324+0000","last_fullsized":"2023-05-17T15:08:18.896324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892171+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906953+0000","last_change":"2023-05-17T15:08:18.906953+0000","last_active":"2023-05-17T15:08:18.906953+0000","last_peered":"2023-05-17T15:08:18.906953+0000","last_clean":"2023-05-17T15:08:18.906953+0000","last_became_active":"2023-05-17T15:08:18.906669+0000","last_became_peered":"2023-05-17T15:08:18.906669+0000","last_unstale":"2023-05-17T15:08:18.906953+0000","last_undegraded":"2023-05-17T15:08:18.906953+0000","last_fullsized":"2023-05-17T15:08:18.906953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896009+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896887+0000","last_change":"2023-05-17T15:08:18.896887+0000","last_active":"2023-05-17T15:08:18.896887+0000","last_peered":"2023-05-17T15:08:18.896887+0000","last_clean":"2023-05-17T15:08:18.896887+0000","last_became_active":"2023-05-17T15:08:18.896589+0000","last_became_peered":"2023-05-17T15:08:18.896589+0000","last_unstale":"2023-05-17T15:08:18.896887+0000","last_undegraded":"2023-05-17T15:08:18.896887+0000","last_fullsized":"2023-05-17T15:08:18.896887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.898917+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906169+0000","last_change":"2023-05-17T15:08:18.906169+0000","last_active":"2023-05-17T15:08:18.906169+0000","last_peered":"2023-05-17T15:08:18.906169+0000","last_clean":"2023-05-17T15:08:18.906169+0000","last_became_active":"2023-05-17T15:08:18.905905+0000","last_became_peered":"2023-05-17T15:08:18.905905+0000","last_unstale":"2023-05-17T15:08:18.906169+0000","last_undegraded":"2023-05-17T15:08:18.906169+0000","last_fullsized":"2023-05-17T15:08:18.906169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897416+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910832+0000","last_change":"2023-05-17T15:08:18.910832+0000","last_active":"2023-05-17T15:08:18.910832+0000","last_peered":"2023-05-17T15:08:18.910832+0000","last_clean":"2023-05-17T15:08:18.910832+0000","last_became_active":"2023-05-17T15:08:18.910487+0000","last_became_peered":"2023-05-17T15:08:18.910487+0000","last_unstale":"2023-05-17T15:08:18.910832+0000","last_undegraded":"2023-05-17T15:08:18.910832+0000","last_fullsized":"2023-05-17T15:08:18.910832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897205+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906558+0000","last_change":"2023-05-17T15:08:18.906558+0000","last_active":"2023-05-17T15:08:18.906558+0000","last_peered":"2023-05-17T15:08:18.906558+0000","last_clean":"2023-05-17T15:08:18.906558+0000","last_became_active":"2023-05-17T15:08:18.906249+0000","last_became_peered":"2023-05-17T15:08:18.906249+0000","last_unstale":"2023-05-17T15:08:18.906558+0000","last_undegraded":"2023-05-17T15:08:18.906558+0000","last_fullsized":"2023-05-17T15:08:18.906558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896964+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.901512+0000","last_change":"2023-05-17T15:08:18.901512+0000","last_active":"2023-05-17T15:08:18.901512+0000","last_peered":"2023-05-17T15:08:18.901512+0000","last_clean":"2023-05-17T15:08:18.901512+0000","last_became_active":"2023-05-17T15:08:18.901188+0000","last_became_peered":"2023-05-17T15:08:18.901188+0000","last_unstale":"2023-05-17T15:08:18.901512+0000","last_undegraded":"2023-05-17T15:08:18.901512+0000","last_fullsized":"2023-05-17T15:08:18.901512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889451+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.900142+0000","last_change":"2023-05-17T15:08:18.900142+0000","last_active":"2023-05-17T15:08:18.900142+0000","last_peered":"2023-05-17T15:08:18.900142+0000","last_clean":"2023-05-17T15:08:18.900142+0000","last_became_active":"2023-05-17T15:08:18.899673+0000","last_became_peered":"2023-05-17T15:08:18.899673+0000","last_unstale":"2023-05-17T15:08:18.900142+0000","last_undegraded":"2023-05-17T15:08:18.900142+0000","last_fullsized":"2023-05-17T15:08:18.900142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893835+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.909889+0000","last_change":"2023-05-17T15:08:18.909889+0000","last_active":"2023-05-17T15:08:18.909889+0000","last_peered":"2023-05-17T15:08:18.909889+0000","last_clean":"2023-05-17T15:08:18.909889+0000","last_became_active":"2023-05-17T15:08:18.908186+0000","last_became_peered":"2023-05-17T15:08:18.908186+0000","last_unstale":"2023-05-17T15:08:18.909889+0000","last_undegraded":"2023-05-17T15:08:18.909889+0000","last_fullsized":"2023-05-17T15:08:18.909889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900140+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910773+0000","last_change":"2023-05-17T15:08:18.910773+0000","last_active":"2023-05-17T15:08:18.910773+0000","last_peered":"2023-05-17T15:08:18.910773+0000","last_clean":"2023-05-17T15:08:18.910773+0000","last_became_active":"2023-05-17T15:08:18.910497+0000","last_became_peered":"2023-05-17T15:08:18.910497+0000","last_unstale":"2023-05-17T15:08:18.910773+0000","last_undegraded":"2023-05-17T15:08:18.910773+0000","last_fullsized":"2023-05-17T15:08:18.910773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892745+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911295+0000","last_change":"2023-05-17T15:08:18.911295+0000","last_active":"2023-05-17T15:08:18.911295+0000","last_peered":"2023-05-17T15:08:18.911295+0000","last_clean":"2023-05-17T15:08:18.911295+0000","last_became_active":"2023-05-17T15:08:18.910808+0000","last_became_peered":"2023-05-17T15:08:18.910808+0000","last_unstale":"2023-05-17T15:08:18.911295+0000","last_undegraded":"2023-05-17T15:08:18.911295+0000","last_fullsized":"2023-05-17T15:08:18.911295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892938+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906256+0000","last_change":"2023-05-17T15:08:18.906256+0000","last_active":"2023-05-17T15:08:18.906256+0000","last_peered":"2023-05-17T15:08:18.906256+0000","last_clean":"2023-05-17T15:08:18.906256+0000","last_became_active":"2023-05-17T15:08:18.905999+0000","last_became_peered":"2023-05-17T15:08:18.905999+0000","last_unstale":"2023-05-17T15:08:18.906256+0000","last_undegraded":"2023-05-17T15:08:18.906256+0000","last_fullsized":"2023-05-17T15:08:18.906256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900402+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.909953+0000","last_change":"2023-05-17T15:08:18.909953+0000","last_active":"2023-05-17T15:08:18.909953+0000","last_peered":"2023-05-17T15:08:18.909953+0000","last_clean":"2023-05-17T15:08:18.909953+0000","last_became_active":"2023-05-17T15:08:18.909651+0000","last_became_peered":"2023-05-17T15:08:18.909651+0000","last_unstale":"2023-05-17T15:08:18.909953+0000","last_undegraded":"2023-05-17T15:08:18.909953+0000","last_fullsized":"2023-05-17T15:08:18.909953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894289+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.907734+0000","last_change":"2023-05-17T15:08:18.907734+0000","last_active":"2023-05-17T15:08:18.907734+0000","last_peered":"2023-05-17T15:08:18.907734+0000","last_clean":"2023-05-17T15:08:18.907734+0000","last_became_active":"2023-05-17T15:08:18.907160+0000","last_became_peered":"2023-05-17T15:08:18.907160+0000","last_unstale":"2023-05-17T15:08:18.907734+0000","last_undegraded":"2023-05-17T15:08:18.907734+0000","last_fullsized":"2023-05-17T15:08:18.907734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893909+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911286+0000","last_change":"2023-05-17T15:08:18.911286+0000","last_active":"2023-05-17T15:08:18.911286+0000","last_peered":"2023-05-17T15:08:18.911286+0000","last_clean":"2023-05-17T15:08:18.911286+0000","last_became_active":"2023-05-17T15:08:18.911011+0000","last_became_peered":"2023-05-17T15:08:18.911011+0000","last_unstale":"2023-05-17T15:08:18.911286+0000","last_undegraded":"2023-05-17T15:08:18.911286+0000","last_fullsized":"2023-05-17T15:08:18.911286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.888633+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910917+0000","last_change":"2023-05-17T15:08:18.910917+0000","last_active":"2023-05-17T15:08:18.910917+0000","last_peered":"2023-05-17T15:08:18.910917+0000","last_clean":"2023-05-17T15:08:18.910917+0000","last_became_active":"2023-05-17T15:08:18.910568+0000","last_became_peered":"2023-05-17T15:08:18.910568+0000","last_unstale":"2023-05-17T15:08:18.910917+0000","last_undegraded":"2023-05-17T15:08:18.910917+0000","last_fullsized":"2023-05-17T15:08:18.910917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893968+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912622+0000","last_change":"2023-05-17T15:08:18.912622+0000","last_active":"2023-05-17T15:08:18.912622+0000","last_peered":"2023-05-17T15:08:18.912622+0000","last_clean":"2023-05-17T15:08:18.912622+0000","last_became_active":"2023-05-17T15:08:18.912374+0000","last_became_peered":"2023-05-17T15:08:18.912374+0000","last_unstale":"2023-05-17T15:08:18.912622+0000","last_undegraded":"2023-05-17T15:08:18.912622+0000","last_fullsized":"2023-05-17T15:08:18.912622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890369+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904182+0000","last_change":"2023-05-17T15:08:18.904182+0000","last_active":"2023-05-17T15:08:18.904182+0000","last_peered":"2023-05-17T15:08:18.904182+0000","last_clean":"2023-05-17T15:08:18.904182+0000","last_became_active":"2023-05-17T15:08:18.903886+0000","last_became_peered":"2023-05-17T15:08:18.903886+0000","last_unstale":"2023-05-17T15:08:18.904182+0000","last_undegraded":"2023-05-17T15:08:18.904182+0000","last_fullsized":"2023-05-17T15:08:18.904182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891985+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899689+0000","last_change":"2023-05-17T15:08:18.899689+0000","last_active":"2023-05-17T15:08:18.899689+0000","last_peered":"2023-05-17T15:08:18.899689+0000","last_clean":"2023-05-17T15:08:18.899689+0000","last_became_active":"2023-05-17T15:08:18.899378+0000","last_became_peered":"2023-05-17T15:08:18.899378+0000","last_unstale":"2023-05-17T15:08:18.899689+0000","last_undegraded":"2023-05-17T15:08:18.899689+0000","last_fullsized":"2023-05-17T15:08:18.899689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890952+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904429+0000","last_change":"2023-05-17T15:08:18.904429+0000","last_active":"2023-05-17T15:08:18.904429+0000","last_peered":"2023-05-17T15:08:18.904429+0000","last_clean":"2023-05-17T15:08:18.904429+0000","last_became_active":"2023-05-17T15:08:18.904153+0000","last_became_peered":"2023-05-17T15:08:18.904153+0000","last_unstale":"2023-05-17T15:08:18.904429+0000","last_undegraded":"2023-05-17T15:08:18.904429+0000","last_fullsized":"2023-05-17T15:08:18.904429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892271+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902320+0000","last_change":"2023-05-17T15:08:18.902320+0000","last_active":"2023-05-17T15:08:18.902320+0000","last_peered":"2023-05-17T15:08:18.902320+0000","last_clean":"2023-05-17T15:08:18.902320+0000","last_became_active":"2023-05-17T15:08:18.902016+0000","last_became_peered":"2023-05-17T15:08:18.902016+0000","last_unstale":"2023-05-17T15:08:18.902320+0000","last_undegraded":"2023-05-17T15:08:18.902320+0000","last_fullsized":"2023-05-17T15:08:18.902320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892809+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908477+0000","last_change":"2023-05-17T15:08:18.908477+0000","last_active":"2023-05-17T15:08:18.908477+0000","last_peered":"2023-05-17T15:08:18.908477+0000","last_clean":"2023-05-17T15:08:18.908477+0000","last_became_active":"2023-05-17T15:08:18.908158+0000","last_became_peered":"2023-05-17T15:08:18.908158+0000","last_unstale":"2023-05-17T15:08:18.908477+0000","last_undegraded":"2023-05-17T15:08:18.908477+0000","last_fullsized":"2023-05-17T15:08:18.908477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889115+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912608+0000","last_change":"2023-05-17T15:08:18.912608+0000","last_active":"2023-05-17T15:08:18.912608+0000","last_peered":"2023-05-17T15:08:18.912608+0000","last_clean":"2023-05-17T15:08:18.912608+0000","last_became_active":"2023-05-17T15:08:18.912316+0000","last_became_peered":"2023-05-17T15:08:18.912316+0000","last_unstale":"2023-05-17T15:08:18.912608+0000","last_undegraded":"2023-05-17T15:08:18.912608+0000","last_fullsized":"2023-05-17T15:08:18.912608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897335+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896021+0000","last_change":"2023-05-17T15:08:18.896021+0000","last_active":"2023-05-17T15:08:18.896021+0000","last_peered":"2023-05-17T15:08:18.896021+0000","last_clean":"2023-05-17T15:08:18.896021+0000","last_became_active":"2023-05-17T15:08:18.895723+0000","last_became_peered":"2023-05-17T15:08:18.895723+0000","last_unstale":"2023-05-17T15:08:18.896021+0000","last_undegraded":"2023-05-17T15:08:18.896021+0000","last_fullsized":"2023-05-17T15:08:18.896021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893751+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.907691+0000","last_change":"2023-05-17T15:08:18.907691+0000","last_active":"2023-05-17T15:08:18.907691+0000","last_peered":"2023-05-17T15:08:18.907691+0000","last_clean":"2023-05-17T15:08:18.907691+0000","last_became_active":"2023-05-17T15:08:18.907412+0000","last_became_peered":"2023-05-17T15:08:18.907412+0000","last_unstale":"2023-05-17T15:08:18.907691+0000","last_undegraded":"2023-05-17T15:08:18.907691+0000","last_fullsized":"2023-05-17T15:08:18.907691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889900+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905494+0000","last_change":"2023-05-17T15:08:18.905494+0000","last_active":"2023-05-17T15:08:18.905494+0000","last_peered":"2023-05-17T15:08:18.905494+0000","last_clean":"2023-05-17T15:08:18.905494+0000","last_became_active":"2023-05-17T15:08:18.905188+0000","last_became_peered":"2023-05-17T15:08:18.905188+0000","last_unstale":"2023-05-17T15:08:18.905494+0000","last_undegraded":"2023-05-17T15:08:18.905494+0000","last_fullsized":"2023-05-17T15:08:18.905494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891331+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896212+0000","last_change":"2023-05-17T15:08:18.896212+0000","last_active":"2023-05-17T15:08:18.896212+0000","last_peered":"2023-05-17T15:08:18.896212+0000","last_clean":"2023-05-17T15:08:18.896212+0000","last_became_active":"2023-05-17T15:08:18.895083+0000","last_became_peered":"2023-05-17T15:08:18.895083+0000","last_unstale":"2023-05-17T15:08:18.896212+0000","last_undegraded":"2023-05-17T15:08:18.896212+0000","last_fullsized":"2023-05-17T15:08:18.896212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896576+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.897185+0000","last_change":"2023-05-17T15:08:18.897185+0000","last_active":"2023-05-17T15:08:18.897185+0000","last_peered":"2023-05-17T15:08:18.897185+0000","last_clean":"2023-05-17T15:08:18.897185+0000","last_became_active":"2023-05-17T15:08:18.896913+0000","last_became_peered":"2023-05-17T15:08:18.896913+0000","last_unstale":"2023-05-17T15:08:18.897185+0000","last_undegraded":"2023-05-17T15:08:18.897185+0000","last_fullsized":"2023-05-17T15:08:18.897185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897026+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899682+0000","last_change":"2023-05-17T15:08:18.899682+0000","last_active":"2023-05-17T15:08:18.899682+0000","last_peered":"2023-05-17T15:08:18.899682+0000","last_clean":"2023-05-17T15:08:18.899682+0000","last_became_active":"2023-05-17T15:08:18.899390+0000","last_became_peered":"2023-05-17T15:08:18.899390+0000","last_unstale":"2023-05-17T15:08:18.899682+0000","last_undegraded":"2023-05-17T15:08:18.899682+0000","last_fullsized":"2023-05-17T15:08:18.899682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890765+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908919+0000","last_change":"2023-05-17T15:08:18.908919+0000","last_active":"2023-05-17T15:08:18.908919+0000","last_peered":"2023-05-17T15:08:18.908919+0000","last_clean":"2023-05-17T15:08:18.908919+0000","last_became_active":"2023-05-17T15:08:18.907484+0000","last_became_peered":"2023-05-17T15:08:18.907484+0000","last_unstale":"2023-05-17T15:08:18.908919+0000","last_undegraded":"2023-05-17T15:08:18.908919+0000","last_fullsized":"2023-05-17T15:08:18.908919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896586+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902684+0000","last_change":"2023-05-17T15:08:18.902684+0000","last_active":"2023-05-17T15:08:18.902684+0000","last_peered":"2023-05-17T15:08:18.902684+0000","last_clean":"2023-05-17T15:08:18.902684+0000","last_became_active":"2023-05-17T15:08:18.902022+0000","last_became_peered":"2023-05-17T15:08:18.902022+0000","last_unstale":"2023-05-17T15:08:18.902684+0000","last_undegraded":"2023-05-17T15:08:18.902684+0000","last_fullsized":"2023-05-17T15:08:18.902684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894233+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906313+0000","last_change":"2023-05-17T15:08:18.906313+0000","last_active":"2023-05-17T15:08:18.906313+0000","last_peered":"2023-05-17T15:08:18.906313+0000","last_clean":"2023-05-17T15:08:18.906313+0000","last_became_active":"2023-05-17T15:08:18.906018+0000","last_became_peered":"2023-05-17T15:08:18.906018+0000","last_unstale":"2023-05-17T15:08:18.906313+0000","last_undegraded":"2023-05-17T15:08:18.906313+0000","last_fullsized":"2023-05-17T15:08:18.906313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893574+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912684+0000","last_change":"2023-05-17T15:08:18.912684+0000","last_active":"2023-05-17T15:08:18.912684+0000","last_peered":"2023-05-17T15:08:18.912684+0000","last_clean":"2023-05-17T15:08:18.912684+0000","last_became_active":"2023-05-17T15:08:18.912441+0000","last_became_peered":"2023-05-17T15:08:18.912441+0000","last_unstale":"2023-05-17T15:08:18.912684+0000","last_undegraded":"2023-05-17T15:08:18.912684+0000","last_fullsized":"2023-05-17T15:08:18.912684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893758+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912324+0000","last_change":"2023-05-17T15:08:18.912324+0000","last_active":"2023-05-17T15:08:18.912324+0000","last_peered":"2023-05-17T15:08:18.912324+0000","last_clean":"2023-05-17T15:08:18.912324+0000","last_became_active":"2023-05-17T15:08:18.911979+0000","last_became_peered":"2023-05-17T15:08:18.911979+0000","last_unstale":"2023-05-17T15:08:18.912324+0000","last_undegraded":"2023-05-17T15:08:18.912324+0000","last_fullsized":"2023-05-17T15:08:18.912324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896616+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.913413+0000","last_change":"2023-05-17T15:08:18.913413+0000","last_active":"2023-05-17T15:08:18.913413+0000","last_peered":"2023-05-17T15:08:18.913413+0000","last_clean":"2023-05-17T15:08:18.913413+0000","last_became_active":"2023-05-17T15:08:18.912425+0000","last_became_peered":"2023-05-17T15:08:18.912425+0000","last_unstale":"2023-05-17T15:08:18.913413+0000","last_undegraded":"2023-05-17T15:08:18.913413+0000","last_fullsized":"2023-05-17T15:08:18.913413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890106+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903216+0000","last_change":"2023-05-17T15:08:18.903216+0000","last_active":"2023-05-17T15:08:18.903216+0000","last_peered":"2023-05-17T15:08:18.903216+0000","last_clean":"2023-05-17T15:08:18.903216+0000","last_became_active":"2023-05-17T15:08:18.902750+0000","last_became_peered":"2023-05-17T15:08:18.902750+0000","last_unstale":"2023-05-17T15:08:18.903216+0000","last_undegraded":"2023-05-17T15:08:18.903216+0000","last_fullsized":"2023-05-17T15:08:18.903216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890909+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910396+0000","last_change":"2023-05-17T15:08:18.910396+0000","last_active":"2023-05-17T15:08:18.910396+0000","last_peered":"2023-05-17T15:08:18.910396+0000","last_clean":"2023-05-17T15:08:18.910396+0000","last_became_active":"2023-05-17T15:08:18.910151+0000","last_became_peered":"2023-05-17T15:08:18.910151+0000","last_unstale":"2023-05-17T15:08:18.910396+0000","last_undegraded":"2023-05-17T15:08:18.910396+0000","last_fullsized":"2023-05-17T15:08:18.910396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889001+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902500+0000","last_change":"2023-05-17T15:08:18.902500+0000","last_active":"2023-05-17T15:08:18.902500+0000","last_peered":"2023-05-17T15:08:18.902500+0000","last_clean":"2023-05-17T15:08:18.902500+0000","last_became_active":"2023-05-17T15:08:18.902198+0000","last_became_peered":"2023-05-17T15:08:18.902198+0000","last_unstale":"2023-05-17T15:08:18.902500+0000","last_undegraded":"2023-05-17T15:08:18.902500+0000","last_fullsized":"2023-05-17T15:08:18.902500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893833+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911447+0000","last_change":"2023-05-17T15:08:18.911447+0000","last_active":"2023-05-17T15:08:18.911447+0000","last_peered":"2023-05-17T15:08:18.911447+0000","last_clean":"2023-05-17T15:08:18.911447+0000","last_became_active":"2023-05-17T15:08:18.911120+0000","last_became_peered":"2023-05-17T15:08:18.911120+0000","last_unstale":"2023-05-17T15:08:18.911447+0000","last_undegraded":"2023-05-17T15:08:18.911447+0000","last_fullsized":"2023-05-17T15:08:18.911447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890247+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908352+0000","last_change":"2023-05-17T15:08:18.908352+0000","last_active":"2023-05-17T15:08:18.908352+0000","last_peered":"2023-05-17T15:08:18.908352+0000","last_clean":"2023-05-17T15:08:18.908352+0000","last_became_active":"2023-05-17T15:08:18.908040+0000","last_became_peered":"2023-05-17T15:08:18.908040+0000","last_unstale":"2023-05-17T15:08:18.908352+0000","last_undegraded":"2023-05-17T15:08:18.908352+0000","last_fullsized":"2023-05-17T15:08:18.908352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890210+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905162+0000","last_change":"2023-05-17T15:08:18.905162+0000","last_active":"2023-05-17T15:08:18.905162+0000","last_peered":"2023-05-17T15:08:18.905162+0000","last_clean":"2023-05-17T15:08:18.905162+0000","last_became_active":"2023-05-17T15:08:18.904829+0000","last_became_peered":"2023-05-17T15:08:18.904829+0000","last_unstale":"2023-05-17T15:08:18.905162+0000","last_undegraded":"2023-05-17T15:08:18.905162+0000","last_fullsized":"2023-05-17T15:08:18.905162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890401+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904328+0000","last_change":"2023-05-17T15:08:18.904328+0000","last_active":"2023-05-17T15:08:18.904328+0000","last_peered":"2023-05-17T15:08:18.904328+0000","last_clean":"2023-05-17T15:08:18.904328+0000","last_became_active":"2023-05-17T15:08:18.904058+0000","last_became_peered":"2023-05-17T15:08:18.904058+0000","last_unstale":"2023-05-17T15:08:18.904328+0000","last_undegraded":"2023-05-17T15:08:18.904328+0000","last_fullsized":"2023-05-17T15:08:18.904328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891544+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.895653+0000","last_change":"2023-05-17T15:08:18.895653+0000","last_active":"2023-05-17T15:08:18.895653+0000","last_peered":"2023-05-17T15:08:18.895653+0000","last_clean":"2023-05-17T15:08:18.895653+0000","last_became_active":"2023-05-17T15:08:18.894704+0000","last_became_peered":"2023-05-17T15:08:18.894704+0000","last_unstale":"2023-05-17T15:08:18.895653+0000","last_undegraded":"2023-05-17T15:08:18.895653+0000","last_fullsized":"2023-05-17T15:08:18.895653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892392+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903034+0000","last_change":"2023-05-17T15:08:18.903034+0000","last_active":"2023-05-17T15:08:18.903034+0000","last_peered":"2023-05-17T15:08:18.903034+0000","last_clean":"2023-05-17T15:08:18.903034+0000","last_became_active":"2023-05-17T15:08:18.901993+0000","last_became_peered":"2023-05-17T15:08:18.901993+0000","last_unstale":"2023-05-17T15:08:18.903034+0000","last_undegraded":"2023-05-17T15:08:18.903034+0000","last_fullsized":"2023-05-17T15:08:18.903034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894072+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911966+0000","last_change":"2023-05-17T15:08:18.911966+0000","last_active":"2023-05-17T15:08:18.911966+0000","last_peered":"2023-05-17T15:08:18.911966+0000","last_clean":"2023-05-17T15:08:18.911966+0000","last_became_active":"2023-05-17T15:08:18.911688+0000","last_became_peered":"2023-05-17T15:08:18.911688+0000","last_unstale":"2023-05-17T15:08:18.911966+0000","last_undegraded":"2023-05-17T15:08:18.911966+0000","last_fullsized":"2023-05-17T15:08:18.911966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892088+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905571+0000","last_change":"2023-05-17T15:08:18.905571+0000","last_active":"2023-05-17T15:08:18.905571+0000","last_peered":"2023-05-17T15:08:18.905571+0000","last_clean":"2023-05-17T15:08:18.905571+0000","last_became_active":"2023-05-17T15:08:18.905052+0000","last_became_peered":"2023-05-17T15:08:18.905052+0000","last_unstale":"2023-05-17T15:08:18.905571+0000","last_undegraded":"2023-05-17T15:08:18.905571+0000","last_fullsized":"2023-05-17T15:08:18.905571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891186+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902853+0000","last_change":"2023-05-17T15:08:18.902853+0000","last_active":"2023-05-17T15:08:18.902853+0000","last_peered":"2023-05-17T15:08:18.902853+0000","last_clean":"2023-05-17T15:08:18.902853+0000","last_became_active":"2023-05-17T15:08:18.902447+0000","last_became_peered":"2023-05-17T15:08:18.902447+0000","last_unstale":"2023-05-17T15:08:18.902853+0000","last_undegraded":"2023-05-17T15:08:18.902853+0000","last_fullsized":"2023-05-17T15:08:18.902853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896625+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896413+0000","last_change":"2023-05-17T15:08:18.896413+0000","last_active":"2023-05-17T15:08:18.896413+0000","last_peered":"2023-05-17T15:08:18.896413+0000","last_clean":"2023-05-17T15:08:18.896413+0000","last_became_active":"2023-05-17T15:08:18.896113+0000","last_became_peered":"2023-05-17T15:08:18.896113+0000","last_unstale":"2023-05-17T15:08:18.896413+0000","last_undegraded":"2023-05-17T15:08:18.896413+0000","last_fullsized":"2023-05-17T15:08:18.896413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.899017+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903669+0000","last_change":"2023-05-17T15:08:18.903669+0000","last_active":"2023-05-17T15:08:18.903669+0000","last_peered":"2023-05-17T15:08:18.903669+0000","last_clean":"2023-05-17T15:08:18.903669+0000","last_became_active":"2023-05-17T15:08:18.903362+0000","last_became_peered":"2023-05-17T15:08:18.903362+0000","last_unstale":"2023-05-17T15:08:18.903669+0000","last_undegraded":"2023-05-17T15:08:18.903669+0000","last_fullsized":"2023-05-17T15:08:18.903669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.887786+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:17.887786+0000","last_peered":"2023-05-17T15:08:17.887786+0000","last_clean":"2023-05-17T15:08:17.887786+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:17.887786+0000","last_undegraded":"2023-05-17T15:08:17.887786+0000","last_fullsized":"2023-05-17T15:08:17.887786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892325+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905697+0000","last_change":"2023-05-17T15:08:18.905697+0000","last_active":"2023-05-17T15:08:18.905697+0000","last_peered":"2023-05-17T15:08:18.905697+0000","last_clean":"2023-05-17T15:08:18.905697+0000","last_became_active":"2023-05-17T15:08:18.905379+0000","last_became_peered":"2023-05-17T15:08:18.905379+0000","last_unstale":"2023-05-17T15:08:18.905697+0000","last_undegraded":"2023-05-17T15:08:18.905697+0000","last_fullsized":"2023-05-17T15:08:18.905697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.884117+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:17.884117+0000","last_peered":"2023-05-17T15:08:17.884117+0000","last_clean":"2023-05-17T15:08:17.884117+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:17.884117+0000","last_undegraded":"2023-05-17T15:08:17.884117+0000","last_fullsized":"2023-05-17T15:08:17.884117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.888381+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902285+0000","last_change":"2023-05-17T15:08:18.902285+0000","last_active":"2023-05-17T15:08:18.902285+0000","last_peered":"2023-05-17T15:08:18.902285+0000","last_clean":"2023-05-17T15:08:18.902285+0000","last_became_active":"2023-05-17T15:08:18.901984+0000","last_became_peered":"2023-05-17T15:08:18.901984+0000","last_unstale":"2023-05-17T15:08:18.902285+0000","last_undegraded":"2023-05-17T15:08:18.902285+0000","last_fullsized":"2023-05-17T15:08:18.902285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.886186+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:17.886186+0000","last_peered":"2023-05-17T15:08:17.886186+0000","last_clean":"2023-05-17T15:08:17.886186+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:17.886186+0000","last_undegraded":"2023-05-17T15:08:17.886186+0000","last_fullsized":"2023-05-17T15:08:17.886186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893559+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910068+0000","last_change":"2023-05-17T15:08:18.910068+0000","last_active":"2023-05-17T15:08:18.910068+0000","last_peered":"2023-05-17T15:08:18.910068+0000","last_clean":"2023-05-17T15:08:18.910068+0000","last_became_active":"2023-05-17T15:08:18.908009+0000","last_became_peered":"2023-05-17T15:08:18.908009+0000","last_unstale":"2023-05-17T15:08:18.910068+0000","last_undegraded":"2023-05-17T15:08:18.910068+0000","last_fullsized":"2023-05-17T15:08:18.910068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.884072+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:17.884072+0000","last_peered":"2023-05-17T15:08:17.884072+0000","last_clean":"2023-05-17T15:08:17.884072+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:17.884072+0000","last_undegraded":"2023-05-17T15:08:17.884072+0000","last_fullsized":"2023-05-17T15:08:17.884072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.888286+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:17.888286+0000","last_peered":"2023-05-17T15:08:17.888286+0000","last_clean":"2023-05-17T15:08:17.888286+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:17.888286+0000","last_undegraded":"2023-05-17T15:08:17.888286+0000","last_fullsized":"2023-05-17T15:08:17.888286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890309+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910475+0000","last_change":"2023-05-17T15:08:18.910475+0000","last_active":"2023-05-17T15:08:18.910475+0000","last_peered":"2023-05-17T15:08:18.910475+0000","last_clean":"2023-05-17T15:08:18.910475+0000","last_became_active":"2023-05-17T15:08:18.910197+0000","last_became_peered":"2023-05-17T15:08:18.910197+0000","last_unstale":"2023-05-17T15:08:18.910475+0000","last_undegraded":"2023-05-17T15:08:18.910475+0000","last_fullsized":"2023-05-17T15:08:18.910475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.889141+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:17.889141+0000","last_peered":"2023-05-17T15:08:17.889141+0000","last_clean":"2023-05-17T15:08:17.889141+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:17.889141+0000","last_undegraded":"2023-05-17T15:08:17.889141+0000","last_fullsized":"2023-05-17T15:08:17.889141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.895924+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.913201+0000","last_change":"2023-05-17T15:08:18.913201+0000","last_active":"2023-05-17T15:08:18.913201+0000","last_peered":"2023-05-17T15:08:18.913201+0000","last_clean":"2023-05-17T15:08:18.913201+0000","last_became_active":"2023-05-17T15:08:18.912907+0000","last_became_peered":"2023-05-17T15:08:18.912907+0000","last_unstale":"2023-05-17T15:08:18.913201+0000","last_undegraded":"2023-05-17T15:08:18.913201+0000","last_fullsized":"2023-05-17T15:08:18.913201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.890147+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:17.890147+0000","last_peered":"2023-05-17T15:08:17.890147+0000","last_clean":"2023-05-17T15:08:17.890147+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:17.890147+0000","last_undegraded":"2023-05-17T15:08:17.890147+0000","last_fullsized":"2023-05-17T15:08:17.890147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892274+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912764+0000","last_change":"2023-05-17T15:08:18.912764+0000","last_active":"2023-05-17T15:08:18.912764+0000","last_peered":"2023-05-17T15:08:18.912764+0000","last_clean":"2023-05-17T15:08:18.912764+0000","last_became_active":"2023-05-17T15:08:18.912413+0000","last_became_peered":"2023-05-17T15:08:18.912413+0000","last_unstale":"2023-05-17T15:08:18.912764+0000","last_undegraded":"2023-05-17T15:08:18.912764+0000","last_fullsized":"2023-05-17T15:08:18.912764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.887759+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:17.887759+0000","last_peered":"2023-05-17T15:08:17.887759+0000","last_clean":"2023-05-17T15:08:17.887759+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:17.887759+0000","last_undegraded":"2023-05-17T15:08:17.887759+0000","last_fullsized":"2023-05-17T15:08:17.887759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896388+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.898040+0000","last_change":"2023-05-17T15:08:18.898040+0000","last_active":"2023-05-17T15:08:18.898040+0000","last_peered":"2023-05-17T15:08:18.898040+0000","last_clean":"2023-05-17T15:08:18.898040+0000","last_became_active":"2023-05-17T15:08:18.897780+0000","last_became_peered":"2023-05-17T15:08:18.897780+0000","last_unstale":"2023-05-17T15:08:18.898040+0000","last_undegraded":"2023-05-17T15:08:18.898040+0000","last_fullsized":"2023-05-17T15:08:18.898040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.886822+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:17.886822+0000","last_peered":"2023-05-17T15:08:17.886822+0000","last_clean":"2023-05-17T15:08:17.886822+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:17.886822+0000","last_undegraded":"2023-05-17T15:08:17.886822+0000","last_fullsized":"2023-05-17T15:08:17.886822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16824,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355016,"statfs":{"total":96636764160,"available":96619536384,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56200000000000006}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.38800000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.36699999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575024,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16248,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355592,"statfs":{"total":96636764160,"available":96620126208,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.498}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16056,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355784,"statfs":{"total":96636764160,"available":96620322816,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.65700000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46400000000000002,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":1.956,"15min":1.956},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.64800000000000002,"5min":1.149,"15min":1.149},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.57599999999999996,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":0.76400000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":1.103,"15min":1.6100000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.64900000000000002},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.54900000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.524,"15min":1.524},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834575024,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15940,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94355900,"statfs":{"total":96636764160,"available":96620441600,"internally_reserved":0,"allocated":978944,"data_stored":487856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.58199999999999996}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.46800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17272,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":94354568,"statfs":{"total":96636764160,"available":96619077632,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.373}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.627},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20216,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351624,"statfs":{"total":96636764160,"available":96616062976,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26800000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.505}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16440,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355400,"statfs":{"total":96636764160,"available":96619929600,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.47199999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19832,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":18880,"kb_avail":94352008,"statfs":{"total":96636764160,"available":96616456192,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19333120},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.621,"15min":0.61199999999999999},"min":{"1min":0.51000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75800000000000001,"5min":0.82399999999999995,"15min":0.876},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.629},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.88100000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":0.80300000000000005,"15min":0.995},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.54200000000000004,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.96199999999999997},"last":0.749},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85999999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.497},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.85599999999999998},"last":0.504},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36399999999999999,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":0.754,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.623},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.83699999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:23.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:23.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.825+0000 7ff41a2e5700 1 Processor -- start 2023-05-17T15:08:23.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.825+0000 7ff41a2e5700 1 -- start start 2023-05-17T15:08:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff41a2e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4140c5f30 0x7ff4140c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff41a2e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff4140c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff41a2e5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140bfcd0 con 0x7ff414158880 2023-05-17T15:08:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff41a2e5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140c0290 con 0x7ff4140c5f30 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff41a2e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140aa1a0 con 0x7ff4141543e0 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff4137fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff414158880 0x7ff414153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38166/0 (socket says 172.21.15.27:38166) 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff4137fe700 1 -- 172.21.15.27:0/3461913884 learned_addr learned my addr 172.21.15.27:0/3461913884 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff413fff700 1 --2- 172.21.15.27:0/3461913884 >> v2:172.21.15.40:3300/0 conn(0x7ff4140c5f30 0x7ff4140c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff418882700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff4140c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.826+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843921419 0 0) 0x7ff4140bfcd0 con 0x7ff414158880 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc0033f0 con 0x7ff414158880 2023-05-17T15:08:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472142020 0 0) 0x7ff3fc0033f0 con 0x7ff414158880 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 msgr2=0x7ff4140c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff4140c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 >> v2:172.21.15.40:3300/0 conn(0x7ff4140c5f30 msgr2=0x7ff4140c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 --2- 172.21.15.27:0/3461913884 >> v2:172.21.15.40:3300/0 conn(0x7ff4140c5f30 0x7ff4140c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140aa480 con 0x7ff414158880 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff418882700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff4140c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7ff408001470 con 0x7ff414158880 2023-05-17T15:08:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 >> v1:172.21.15.27:6789/0 conn(0x7ff414158880 legacy=0x7ff414153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff3fc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff3fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c0290 con 0x7ff3fc004690 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140aa1a0 con 0x7ff3fc0038e0 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0044f0 con 0x7ff4141543e0 2023-05-17T15:08:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff413fff700 1 --2- 172.21.15.27:0/3461913884 >> v2:172.21.15.40:3300/0 conn(0x7ff4140c5f30 0x7ff4140c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff3fc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff418882700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff3fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff413fff700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 -- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 msgr2=0x7ff3fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4141543e0 0x7ff3fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 -- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3fc0038e0 msgr2=0x7ff3fc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3fc0038e0 0x7ff3fc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 -- 172.21.15.27:0/3461913884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c009a20 con 0x7ff3fc004690 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.827+0000 7ff4137fe700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff3fc004b10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7ff40800c210 tx=0x7ff408001e90).ready entity=mon.0 client_cookie=8270529d2ec089b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408007a60 con 0x7ff3fc004690 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40800cae0 con 0x7ff3fc004690 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff412ffd700 1 -- 172.21.15.27:0/3461913884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800ce80 con 0x7ff3fc004690 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff41a2e5700 1 -- 172.21.15.27:0/3461913884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 msgr2=0x7ff3fc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/3461913884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff3fc004b10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7ff40800c210 tx=0x7ff408001e90).stop 2023-05-17T15:08:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff418882700 1 -- 172.21.15.27:0/3461913884 reap_dead start 2023-05-17T15:08:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff41a2e5700 1 -- 172.21.15.27:0/3461913884 shutdown_connections 2023-05-17T15:08:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff41a2e5700 1 -- 172.21.15.27:0/3461913884 >> 172.21.15.27:0/3461913884 conn(0x7ff414069e70 msgr2=0x7ff41405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff41a2e5700 1 -- 172.21.15.27:0/3461913884 shutdown_connections 2023-05-17T15:08:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.828+0000 7ff41a2e5700 1 -- 172.21.15.27:0/3461913884 wait complete. 2023-05-17T15:08:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.829+0000 7ff41a2e5700 1 Processor -- start 2023-05-17T15:08:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.829+0000 7ff41a2e5700 1 -- start start 2023-05-17T15:08:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff41a2e5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff414152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff41a2e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff414154950 0x7ff4141573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff41a2e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff414167c10 0x7ff414168070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff41a2e5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414155ad0 con 0x7ff3fc004690 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff41a2e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414153220 con 0x7ff414154950 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff41a2e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff414168560 con 0x7ff414167c10 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff414152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff414152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38612/0 (socket says 172.21.15.27:38612) 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 -- 172.21.15.27:0/328144909 learned_addr learned my addr 172.21.15.27:0/328144909 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:23.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff418882700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff414167c10 0x7ff414168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff4137fe700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff414154950 0x7ff4141573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 -- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff414167c10 msgr2=0x7ff414168070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff414167c10 0x7ff414168070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 -- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff414154950 msgr2=0x7ff4141573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff414154950 0x7ff4141573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.830+0000 7ff413fff700 1 -- 172.21.15.27:0/328144909 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414154e50 con 0x7ff3fc004690 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff4137fe700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff414154950 0x7ff4141573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:23.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff413fff700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff414152d30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7ff404011910 tx=0x7ff404008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404015690 con 0x7ff3fc004690 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4040157f0 con 0x7ff3fc004690 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff414155130 con 0x7ff3fc004690 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404015b70 con 0x7ff3fc004690 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.831+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4141556f0 con 0x7ff3fc004690 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.832+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41405f4a0 con 0x7ff3fc004690 2023-05-17T15:08:23.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.833+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff404025070 con 0x7ff3fc004690 2023-05-17T15:08:23.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.833+0000 7ff3fbfff700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff40005ed90 0x7ff400061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:23.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.833+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ff40407a950 con 0x7ff3fc004690 2023-05-17T15:08:23.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.833+0000 7ff4137fe700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff40005ed90 0x7ff400061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:23.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.833+0000 7ff4137fe700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff40005ed90 0x7ff400061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff408000c00 tx=0x7ff408015000).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:23.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:23.836+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff40404bf20 con 0x7ff3fc004690 2023-05-17T15:08:24.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.003+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff41406bdf0 con 0x7ff40005ed90 2023-05-17T15:08:24.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.013+0000 7ff3fbfff700 1 -- 172.21.15.27:0/328144909 <== mgr.6003 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358323 (secure 0 0 0) 0x7ff41406bdf0 con 0x7ff40005ed90 2023-05-17T15:08:24.020 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:24.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff40005ed90 msgr2=0x7ff400061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff40005ed90 0x7ff400061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff408000c00 tx=0x7ff408015000).stop 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 msgr2=0x7ff414152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff414152d30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7ff404011910 tx=0x7ff404008040).stop 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 shutdown_connections 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff40005ed90 0x7ff400061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff414167c10 0x7ff414168070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3fc004690 0x7ff414152d30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 --2- 172.21.15.27:0/328144909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff414154950 0x7ff4141573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 >> 172.21.15.27:0/328144909 conn(0x7ff414069e70 msgr2=0x7ff4140add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:24.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 shutdown_connections 2023-05-17T15:08:24.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.017+0000 7ff41a2e5700 1 -- 172.21.15.27:0/328144909 wait complete. 2023-05-17T15:08:24.024 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:24.032 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:22.143947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138828,"kb_used_data":7564,"kb_used_omap":0,"kb_used_meta":131200,"kb_avail":754835892,"statfs":{"total":773094113280,"available":772951953408,"internally_reserved":0,"allocated":7745536,"data_stored":3855591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":134348800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27717,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.612711"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891375+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911990+0000","last_change":"2023-05-17T15:08:18.911990+0000","last_active":"2023-05-17T15:08:18.911990+0000","last_peered":"2023-05-17T15:08:18.911990+0000","last_clean":"2023-05-17T15:08:18.911990+0000","last_became_active":"2023-05-17T15:08:18.911703+0000","last_became_peered":"2023-05-17T15:08:18.911703+0000","last_unstale":"2023-05-17T15:08:18.911990+0000","last_undegraded":"2023-05-17T15:08:18.911990+0000","last_fullsized":"2023-05-17T15:08:18.911990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.898587+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902229+0000","last_change":"2023-05-17T15:08:18.902229+0000","last_active":"2023-05-17T15:08:18.902229+0000","last_peered":"2023-05-17T15:08:18.902229+0000","last_clean":"2023-05-17T15:08:18.902229+0000","last_became_active":"2023-05-17T15:08:18.901917+0000","last_became_peered":"2023-05-17T15:08:18.901917+0000","last_unstale":"2023-05-17T15:08:18.902229+0000","last_undegraded":"2023-05-17T15:08:18.902229+0000","last_fullsized":"2023-05-17T15:08:18.902229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894567+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908877+0000","last_change":"2023-05-17T15:08:18.908877+0000","last_active":"2023-05-17T15:08:18.908877+0000","last_peered":"2023-05-17T15:08:18.908877+0000","last_clean":"2023-05-17T15:08:18.908877+0000","last_became_active":"2023-05-17T15:08:18.908536+0000","last_became_peered":"2023-05-17T15:08:18.908536+0000","last_unstale":"2023-05-17T15:08:18.908877+0000","last_undegraded":"2023-05-17T15:08:18.908877+0000","last_fullsized":"2023-05-17T15:08:18.908877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893179+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904853+0000","last_change":"2023-05-17T15:08:18.904853+0000","last_active":"2023-05-17T15:08:18.904853+0000","last_peered":"2023-05-17T15:08:18.904853+0000","last_clean":"2023-05-17T15:08:18.904853+0000","last_became_active":"2023-05-17T15:08:18.904460+0000","last_became_peered":"2023-05-17T15:08:18.904460+0000","last_unstale":"2023-05-17T15:08:18.904853+0000","last_undegraded":"2023-05-17T15:08:18.904853+0000","last_fullsized":"2023-05-17T15:08:18.904853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891549+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904506+0000","last_change":"2023-05-17T15:08:18.904506+0000","last_active":"2023-05-17T15:08:18.904506+0000","last_peered":"2023-05-17T15:08:18.904506+0000","last_clean":"2023-05-17T15:08:18.904506+0000","last_became_active":"2023-05-17T15:08:18.904213+0000","last_became_peered":"2023-05-17T15:08:18.904213+0000","last_unstale":"2023-05-17T15:08:18.904506+0000","last_undegraded":"2023-05-17T15:08:18.904506+0000","last_fullsized":"2023-05-17T15:08:18.904506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891832+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902858+0000","last_change":"2023-05-17T15:08:18.902858+0000","last_active":"2023-05-17T15:08:18.902858+0000","last_peered":"2023-05-17T15:08:18.902858+0000","last_clean":"2023-05-17T15:08:18.902858+0000","last_became_active":"2023-05-17T15:08:18.902398+0000","last_became_peered":"2023-05-17T15:08:18.902398+0000","last_unstale":"2023-05-17T15:08:18.902858+0000","last_undegraded":"2023-05-17T15:08:18.902858+0000","last_fullsized":"2023-05-17T15:08:18.902858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890210+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.901694+0000","last_change":"2023-05-17T15:08:18.901694+0000","last_active":"2023-05-17T15:08:18.901694+0000","last_peered":"2023-05-17T15:08:18.901694+0000","last_clean":"2023-05-17T15:08:18.901694+0000","last_became_active":"2023-05-17T15:08:18.900872+0000","last_became_peered":"2023-05-17T15:08:18.900872+0000","last_unstale":"2023-05-17T15:08:18.901694+0000","last_undegraded":"2023-05-17T15:08:18.901694+0000","last_fullsized":"2023-05-17T15:08:18.901694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900511+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899762+0000","last_change":"2023-05-17T15:08:18.899762+0000","last_active":"2023-05-17T15:08:18.899762+0000","last_peered":"2023-05-17T15:08:18.899762+0000","last_clean":"2023-05-17T15:08:18.899762+0000","last_became_active":"2023-05-17T15:08:18.899483+0000","last_became_peered":"2023-05-17T15:08:18.899483+0000","last_unstale":"2023-05-17T15:08:18.899762+0000","last_undegraded":"2023-05-17T15:08:18.899762+0000","last_fullsized":"2023-05-17T15:08:18.899762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894058+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896324+0000","last_change":"2023-05-17T15:08:18.896324+0000","last_active":"2023-05-17T15:08:18.896324+0000","last_peered":"2023-05-17T15:08:18.896324+0000","last_clean":"2023-05-17T15:08:18.896324+0000","last_became_active":"2023-05-17T15:08:18.896047+0000","last_became_peered":"2023-05-17T15:08:18.896047+0000","last_unstale":"2023-05-17T15:08:18.896324+0000","last_undegraded":"2023-05-17T15:08:18.896324+0000","last_fullsized":"2023-05-17T15:08:18.896324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892171+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906953+0000","last_change":"2023-05-17T15:08:18.906953+0000","last_active":"2023-05-17T15:08:18.906953+0000","last_peered":"2023-05-17T15:08:18.906953+0000","last_clean":"2023-05-17T15:08:18.906953+0000","last_became_active":"2023-05-17T15:08:18.906669+0000","last_became_peered":"2023-05-17T15:08:18.906669+0000","last_unstale":"2023-05-17T15:08:18.906953+0000","last_undegraded":"2023-05-17T15:08:18.906953+0000","last_fullsized":"2023-05-17T15:08:18.906953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896009+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896887+0000","last_change":"2023-05-17T15:08:18.896887+0000","last_active":"2023-05-17T15:08:18.896887+0000","last_peered":"2023-05-17T15:08:18.896887+0000","last_clean":"2023-05-17T15:08:18.896887+0000","last_became_active":"2023-05-17T15:08:18.896589+0000","last_became_peered":"2023-05-17T15:08:18.896589+0000","last_unstale":"2023-05-17T15:08:18.896887+0000","last_undegraded":"2023-05-17T15:08:18.896887+0000","last_fullsized":"2023-05-17T15:08:18.896887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.898917+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906169+0000","last_change":"2023-05-17T15:08:18.906169+0000","last_active":"2023-05-17T15:08:18.906169+0000","last_peered":"2023-05-17T15:08:18.906169+0000","last_clean":"2023-05-17T15:08:18.906169+0000","last_became_active":"2023-05-17T15:08:18.905905+0000","last_became_peered":"2023-05-17T15:08:18.905905+0000","last_unstale":"2023-05-17T15:08:18.906169+0000","last_undegraded":"2023-05-17T15:08:18.906169+0000","last_fullsized":"2023-05-17T15:08:18.906169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897416+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910832+0000","last_change":"2023-05-17T15:08:18.910832+0000","last_active":"2023-05-17T15:08:18.910832+0000","last_peered":"2023-05-17T15:08:18.910832+0000","last_clean":"2023-05-17T15:08:18.910832+0000","last_became_active":"2023-05-17T15:08:18.910487+0000","last_became_peered":"2023-05-17T15:08:18.910487+0000","last_unstale":"2023-05-17T15:08:18.910832+0000","last_undegraded":"2023-05-17T15:08:18.910832+0000","last_fullsized":"2023-05-17T15:08:18.910832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897205+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906558+0000","last_change":"2023-05-17T15:08:18.906558+0000","last_active":"2023-05-17T15:08:18.906558+0000","last_peered":"2023-05-17T15:08:18.906558+0000","last_clean":"2023-05-17T15:08:18.906558+0000","last_became_active":"2023-05-17T15:08:18.906249+0000","last_became_peered":"2023-05-17T15:08:18.906249+0000","last_unstale":"2023-05-17T15:08:18.906558+0000","last_undegraded":"2023-05-17T15:08:18.906558+0000","last_fullsized":"2023-05-17T15:08:18.906558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896964+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.901512+0000","last_change":"2023-05-17T15:08:18.901512+0000","last_active":"2023-05-17T15:08:18.901512+0000","last_peered":"2023-05-17T15:08:18.901512+0000","last_clean":"2023-05-17T15:08:18.901512+0000","last_became_active":"2023-05-17T15:08:18.901188+0000","last_became_peered":"2023-05-17T15:08:18.901188+0000","last_unstale":"2023-05-17T15:08:18.901512+0000","last_undegraded":"2023-05-17T15:08:18.901512+0000","last_fullsized":"2023-05-17T15:08:18.901512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889451+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.900142+0000","last_change":"2023-05-17T15:08:18.900142+0000","last_active":"2023-05-17T15:08:18.900142+0000","last_peered":"2023-05-17T15:08:18.900142+0000","last_clean":"2023-05-17T15:08:18.900142+0000","last_became_active":"2023-05-17T15:08:18.899673+0000","last_became_peered":"2023-05-17T15:08:18.899673+0000","last_unstale":"2023-05-17T15:08:18.900142+0000","last_undegraded":"2023-05-17T15:08:18.900142+0000","last_fullsized":"2023-05-17T15:08:18.900142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893835+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.909889+0000","last_change":"2023-05-17T15:08:18.909889+0000","last_active":"2023-05-17T15:08:18.909889+0000","last_peered":"2023-05-17T15:08:18.909889+0000","last_clean":"2023-05-17T15:08:18.909889+0000","last_became_active":"2023-05-17T15:08:18.908186+0000","last_became_peered":"2023-05-17T15:08:18.908186+0000","last_unstale":"2023-05-17T15:08:18.909889+0000","last_undegraded":"2023-05-17T15:08:18.909889+0000","last_fullsized":"2023-05-17T15:08:18.909889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900140+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910773+0000","last_change":"2023-05-17T15:08:18.910773+0000","last_active":"2023-05-17T15:08:18.910773+0000","last_peered":"2023-05-17T15:08:18.910773+0000","last_clean":"2023-05-17T15:08:18.910773+0000","last_became_active":"2023-05-17T15:08:18.910497+0000","last_became_peered":"2023-05-17T15:08:18.910497+0000","last_unstale":"2023-05-17T15:08:18.910773+0000","last_undegraded":"2023-05-17T15:08:18.910773+0000","last_fullsized":"2023-05-17T15:08:18.910773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892745+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911295+0000","last_change":"2023-05-17T15:08:18.911295+0000","last_active":"2023-05-17T15:08:18.911295+0000","last_peered":"2023-05-17T15:08:18.911295+0000","last_clean":"2023-05-17T15:08:18.911295+0000","last_became_active":"2023-05-17T15:08:18.910808+0000","last_became_peered":"2023-05-17T15:08:18.910808+0000","last_unstale":"2023-05-17T15:08:18.911295+0000","last_undegraded":"2023-05-17T15:08:18.911295+0000","last_fullsized":"2023-05-17T15:08:18.911295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892938+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906256+0000","last_change":"2023-05-17T15:08:18.906256+0000","last_active":"2023-05-17T15:08:18.906256+0000","last_peered":"2023-05-17T15:08:18.906256+0000","last_clean":"2023-05-17T15:08:18.906256+0000","last_became_active":"2023-05-17T15:08:18.905999+0000","last_became_peered":"2023-05-17T15:08:18.905999+0000","last_unstale":"2023-05-17T15:08:18.906256+0000","last_undegraded":"2023-05-17T15:08:18.906256+0000","last_fullsized":"2023-05-17T15:08:18.906256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.900402+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.909953+0000","last_change":"2023-05-17T15:08:18.909953+0000","last_active":"2023-05-17T15:08:18.909953+0000","last_peered":"2023-05-17T15:08:18.909953+0000","last_clean":"2023-05-17T15:08:18.909953+0000","last_became_active":"2023-05-17T15:08:18.909651+0000","last_became_peered":"2023-05-17T15:08:18.909651+0000","last_unstale":"2023-05-17T15:08:18.909953+0000","last_undegraded":"2023-05-17T15:08:18.909953+0000","last_fullsized":"2023-05-17T15:08:18.909953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894289+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.907734+0000","last_change":"2023-05-17T15:08:18.907734+0000","last_active":"2023-05-17T15:08:18.907734+0000","last_peered":"2023-05-17T15:08:18.907734+0000","last_clean":"2023-05-17T15:08:18.907734+0000","last_became_active":"2023-05-17T15:08:18.907160+0000","last_became_peered":"2023-05-17T15:08:18.907160+0000","last_unstale":"2023-05-17T15:08:18.907734+0000","last_undegraded":"2023-05-17T15:08:18.907734+0000","last_fullsized":"2023-05-17T15:08:18.907734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893909+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911286+0000","last_change":"2023-05-17T15:08:18.911286+0000","last_active":"2023-05-17T15:08:18.911286+0000","last_peered":"2023-05-17T15:08:18.911286+0000","last_clean":"2023-05-17T15:08:18.911286+0000","last_became_active":"2023-05-17T15:08:18.911011+0000","last_became_peered":"2023-05-17T15:08:18.911011+0000","last_unstale":"2023-05-17T15:08:18.911286+0000","last_undegraded":"2023-05-17T15:08:18.911286+0000","last_fullsized":"2023-05-17T15:08:18.911286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.888633+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910917+0000","last_change":"2023-05-17T15:08:18.910917+0000","last_active":"2023-05-17T15:08:18.910917+0000","last_peered":"2023-05-17T15:08:18.910917+0000","last_clean":"2023-05-17T15:08:18.910917+0000","last_became_active":"2023-05-17T15:08:18.910568+0000","last_became_peered":"2023-05-17T15:08:18.910568+0000","last_unstale":"2023-05-17T15:08:18.910917+0000","last_undegraded":"2023-05-17T15:08:18.910917+0000","last_fullsized":"2023-05-17T15:08:18.910917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893968+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912622+0000","last_change":"2023-05-17T15:08:18.912622+0000","last_active":"2023-05-17T15:08:18.912622+0000","last_peered":"2023-05-17T15:08:18.912622+0000","last_clean":"2023-05-17T15:08:18.912622+0000","last_became_active":"2023-05-17T15:08:18.912374+0000","last_became_peered":"2023-05-17T15:08:18.912374+0000","last_unstale":"2023-05-17T15:08:18.912622+0000","last_undegraded":"2023-05-17T15:08:18.912622+0000","last_fullsized":"2023-05-17T15:08:18.912622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890369+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904182+0000","last_change":"2023-05-17T15:08:18.904182+0000","last_active":"2023-05-17T15:08:18.904182+0000","last_peered":"2023-05-17T15:08:18.904182+0000","last_clean":"2023-05-17T15:08:18.904182+0000","last_became_active":"2023-05-17T15:08:18.903886+0000","last_became_peered":"2023-05-17T15:08:18.903886+0000","last_unstale":"2023-05-17T15:08:18.904182+0000","last_undegraded":"2023-05-17T15:08:18.904182+0000","last_fullsized":"2023-05-17T15:08:18.904182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891985+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899689+0000","last_change":"2023-05-17T15:08:18.899689+0000","last_active":"2023-05-17T15:08:18.899689+0000","last_peered":"2023-05-17T15:08:18.899689+0000","last_clean":"2023-05-17T15:08:18.899689+0000","last_became_active":"2023-05-17T15:08:18.899378+0000","last_became_peered":"2023-05-17T15:08:18.899378+0000","last_unstale":"2023-05-17T15:08:18.899689+0000","last_undegraded":"2023-05-17T15:08:18.899689+0000","last_fullsized":"2023-05-17T15:08:18.899689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890952+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904429+0000","last_change":"2023-05-17T15:08:18.904429+0000","last_active":"2023-05-17T15:08:18.904429+0000","last_peered":"2023-05-17T15:08:18.904429+0000","last_clean":"2023-05-17T15:08:18.904429+0000","last_became_active":"2023-05-17T15:08:18.904153+0000","last_became_peered":"2023-05-17T15:08:18.904153+0000","last_unstale":"2023-05-17T15:08:18.904429+0000","last_undegraded":"2023-05-17T15:08:18.904429+0000","last_fullsized":"2023-05-17T15:08:18.904429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892271+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902320+0000","last_change":"2023-05-17T15:08:18.902320+0000","last_active":"2023-05-17T15:08:18.902320+0000","last_peered":"2023-05-17T15:08:18.902320+0000","last_clean":"2023-05-17T15:08:18.902320+0000","last_became_active":"2023-05-17T15:08:18.902016+0000","last_became_peered":"2023-05-17T15:08:18.902016+0000","last_unstale":"2023-05-17T15:08:18.902320+0000","last_undegraded":"2023-05-17T15:08:18.902320+0000","last_fullsized":"2023-05-17T15:08:18.902320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892809+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908477+0000","last_change":"2023-05-17T15:08:18.908477+0000","last_active":"2023-05-17T15:08:18.908477+0000","last_peered":"2023-05-17T15:08:18.908477+0000","last_clean":"2023-05-17T15:08:18.908477+0000","last_became_active":"2023-05-17T15:08:18.908158+0000","last_became_peered":"2023-05-17T15:08:18.908158+0000","last_unstale":"2023-05-17T15:08:18.908477+0000","last_undegraded":"2023-05-17T15:08:18.908477+0000","last_fullsized":"2023-05-17T15:08:18.908477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889115+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912608+0000","last_change":"2023-05-17T15:08:18.912608+0000","last_active":"2023-05-17T15:08:18.912608+0000","last_peered":"2023-05-17T15:08:18.912608+0000","last_clean":"2023-05-17T15:08:18.912608+0000","last_became_active":"2023-05-17T15:08:18.912316+0000","last_became_peered":"2023-05-17T15:08:18.912316+0000","last_unstale":"2023-05-17T15:08:18.912608+0000","last_undegraded":"2023-05-17T15:08:18.912608+0000","last_fullsized":"2023-05-17T15:08:18.912608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897335+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896021+0000","last_change":"2023-05-17T15:08:18.896021+0000","last_active":"2023-05-17T15:08:18.896021+0000","last_peered":"2023-05-17T15:08:18.896021+0000","last_clean":"2023-05-17T15:08:18.896021+0000","last_became_active":"2023-05-17T15:08:18.895723+0000","last_became_peered":"2023-05-17T15:08:18.895723+0000","last_unstale":"2023-05-17T15:08:18.896021+0000","last_undegraded":"2023-05-17T15:08:18.896021+0000","last_fullsized":"2023-05-17T15:08:18.896021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893751+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.907691+0000","last_change":"2023-05-17T15:08:18.907691+0000","last_active":"2023-05-17T15:08:18.907691+0000","last_peered":"2023-05-17T15:08:18.907691+0000","last_clean":"2023-05-17T15:08:18.907691+0000","last_became_active":"2023-05-17T15:08:18.907412+0000","last_became_peered":"2023-05-17T15:08:18.907412+0000","last_unstale":"2023-05-17T15:08:18.907691+0000","last_undegraded":"2023-05-17T15:08:18.907691+0000","last_fullsized":"2023-05-17T15:08:18.907691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889900+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905494+0000","last_change":"2023-05-17T15:08:18.905494+0000","last_active":"2023-05-17T15:08:18.905494+0000","last_peered":"2023-05-17T15:08:18.905494+0000","last_clean":"2023-05-17T15:08:18.905494+0000","last_became_active":"2023-05-17T15:08:18.905188+0000","last_became_peered":"2023-05-17T15:08:18.905188+0000","last_unstale":"2023-05-17T15:08:18.905494+0000","last_undegraded":"2023-05-17T15:08:18.905494+0000","last_fullsized":"2023-05-17T15:08:18.905494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891331+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896212+0000","last_change":"2023-05-17T15:08:18.896212+0000","last_active":"2023-05-17T15:08:18.896212+0000","last_peered":"2023-05-17T15:08:18.896212+0000","last_clean":"2023-05-17T15:08:18.896212+0000","last_became_active":"2023-05-17T15:08:18.895083+0000","last_became_peered":"2023-05-17T15:08:18.895083+0000","last_unstale":"2023-05-17T15:08:18.896212+0000","last_undegraded":"2023-05-17T15:08:18.896212+0000","last_fullsized":"2023-05-17T15:08:18.896212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896576+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.897185+0000","last_change":"2023-05-17T15:08:18.897185+0000","last_active":"2023-05-17T15:08:18.897185+0000","last_peered":"2023-05-17T15:08:18.897185+0000","last_clean":"2023-05-17T15:08:18.897185+0000","last_became_active":"2023-05-17T15:08:18.896913+0000","last_became_peered":"2023-05-17T15:08:18.896913+0000","last_unstale":"2023-05-17T15:08:18.897185+0000","last_undegraded":"2023-05-17T15:08:18.897185+0000","last_fullsized":"2023-05-17T15:08:18.897185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.897026+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.899682+0000","last_change":"2023-05-17T15:08:18.899682+0000","last_active":"2023-05-17T15:08:18.899682+0000","last_peered":"2023-05-17T15:08:18.899682+0000","last_clean":"2023-05-17T15:08:18.899682+0000","last_became_active":"2023-05-17T15:08:18.899390+0000","last_became_peered":"2023-05-17T15:08:18.899390+0000","last_unstale":"2023-05-17T15:08:18.899682+0000","last_undegraded":"2023-05-17T15:08:18.899682+0000","last_fullsized":"2023-05-17T15:08:18.899682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890765+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908919+0000","last_change":"2023-05-17T15:08:18.908919+0000","last_active":"2023-05-17T15:08:18.908919+0000","last_peered":"2023-05-17T15:08:18.908919+0000","last_clean":"2023-05-17T15:08:18.908919+0000","last_became_active":"2023-05-17T15:08:18.907484+0000","last_became_peered":"2023-05-17T15:08:18.907484+0000","last_unstale":"2023-05-17T15:08:18.908919+0000","last_undegraded":"2023-05-17T15:08:18.908919+0000","last_fullsized":"2023-05-17T15:08:18.908919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896586+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902684+0000","last_change":"2023-05-17T15:08:18.902684+0000","last_active":"2023-05-17T15:08:18.902684+0000","last_peered":"2023-05-17T15:08:18.902684+0000","last_clean":"2023-05-17T15:08:18.902684+0000","last_became_active":"2023-05-17T15:08:18.902022+0000","last_became_peered":"2023-05-17T15:08:18.902022+0000","last_unstale":"2023-05-17T15:08:18.902684+0000","last_undegraded":"2023-05-17T15:08:18.902684+0000","last_fullsized":"2023-05-17T15:08:18.902684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894233+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.906313+0000","last_change":"2023-05-17T15:08:18.906313+0000","last_active":"2023-05-17T15:08:18.906313+0000","last_peered":"2023-05-17T15:08:18.906313+0000","last_clean":"2023-05-17T15:08:18.906313+0000","last_became_active":"2023-05-17T15:08:18.906018+0000","last_became_peered":"2023-05-17T15:08:18.906018+0000","last_unstale":"2023-05-17T15:08:18.906313+0000","last_undegraded":"2023-05-17T15:08:18.906313+0000","last_fullsized":"2023-05-17T15:08:18.906313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893574+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912684+0000","last_change":"2023-05-17T15:08:18.912684+0000","last_active":"2023-05-17T15:08:18.912684+0000","last_peered":"2023-05-17T15:08:18.912684+0000","last_clean":"2023-05-17T15:08:18.912684+0000","last_became_active":"2023-05-17T15:08:18.912441+0000","last_became_peered":"2023-05-17T15:08:18.912441+0000","last_unstale":"2023-05-17T15:08:18.912684+0000","last_undegraded":"2023-05-17T15:08:18.912684+0000","last_fullsized":"2023-05-17T15:08:18.912684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893758+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912324+0000","last_change":"2023-05-17T15:08:18.912324+0000","last_active":"2023-05-17T15:08:18.912324+0000","last_peered":"2023-05-17T15:08:18.912324+0000","last_clean":"2023-05-17T15:08:18.912324+0000","last_became_active":"2023-05-17T15:08:18.911979+0000","last_became_peered":"2023-05-17T15:08:18.911979+0000","last_unstale":"2023-05-17T15:08:18.912324+0000","last_undegraded":"2023-05-17T15:08:18.912324+0000","last_fullsized":"2023-05-17T15:08:18.912324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896616+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.913413+0000","last_change":"2023-05-17T15:08:18.913413+0000","last_active":"2023-05-17T15:08:18.913413+0000","last_peered":"2023-05-17T15:08:18.913413+0000","last_clean":"2023-05-17T15:08:18.913413+0000","last_became_active":"2023-05-17T15:08:18.912425+0000","last_became_peered":"2023-05-17T15:08:18.912425+0000","last_unstale":"2023-05-17T15:08:18.913413+0000","last_undegraded":"2023-05-17T15:08:18.913413+0000","last_fullsized":"2023-05-17T15:08:18.913413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890106+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903216+0000","last_change":"2023-05-17T15:08:18.903216+0000","last_active":"2023-05-17T15:08:18.903216+0000","last_peered":"2023-05-17T15:08:18.903216+0000","last_clean":"2023-05-17T15:08:18.903216+0000","last_became_active":"2023-05-17T15:08:18.902750+0000","last_became_peered":"2023-05-17T15:08:18.902750+0000","last_unstale":"2023-05-17T15:08:18.903216+0000","last_undegraded":"2023-05-17T15:08:18.903216+0000","last_fullsized":"2023-05-17T15:08:18.903216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890909+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910396+0000","last_change":"2023-05-17T15:08:18.910396+0000","last_active":"2023-05-17T15:08:18.910396+0000","last_peered":"2023-05-17T15:08:18.910396+0000","last_clean":"2023-05-17T15:08:18.910396+0000","last_became_active":"2023-05-17T15:08:18.910151+0000","last_became_peered":"2023-05-17T15:08:18.910151+0000","last_unstale":"2023-05-17T15:08:18.910396+0000","last_undegraded":"2023-05-17T15:08:18.910396+0000","last_fullsized":"2023-05-17T15:08:18.910396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.889001+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902500+0000","last_change":"2023-05-17T15:08:18.902500+0000","last_active":"2023-05-17T15:08:18.902500+0000","last_peered":"2023-05-17T15:08:18.902500+0000","last_clean":"2023-05-17T15:08:18.902500+0000","last_became_active":"2023-05-17T15:08:18.902198+0000","last_became_peered":"2023-05-17T15:08:18.902198+0000","last_unstale":"2023-05-17T15:08:18.902500+0000","last_undegraded":"2023-05-17T15:08:18.902500+0000","last_fullsized":"2023-05-17T15:08:18.902500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893833+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911447+0000","last_change":"2023-05-17T15:08:18.911447+0000","last_active":"2023-05-17T15:08:18.911447+0000","last_peered":"2023-05-17T15:08:18.911447+0000","last_clean":"2023-05-17T15:08:18.911447+0000","last_became_active":"2023-05-17T15:08:18.911120+0000","last_became_peered":"2023-05-17T15:08:18.911120+0000","last_unstale":"2023-05-17T15:08:18.911447+0000","last_undegraded":"2023-05-17T15:08:18.911447+0000","last_fullsized":"2023-05-17T15:08:18.911447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890247+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.908352+0000","last_change":"2023-05-17T15:08:18.908352+0000","last_active":"2023-05-17T15:08:18.908352+0000","last_peered":"2023-05-17T15:08:18.908352+0000","last_clean":"2023-05-17T15:08:18.908352+0000","last_became_active":"2023-05-17T15:08:18.908040+0000","last_became_peered":"2023-05-17T15:08:18.908040+0000","last_unstale":"2023-05-17T15:08:18.908352+0000","last_undegraded":"2023-05-17T15:08:18.908352+0000","last_fullsized":"2023-05-17T15:08:18.908352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890210+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905162+0000","last_change":"2023-05-17T15:08:18.905162+0000","last_active":"2023-05-17T15:08:18.905162+0000","last_peered":"2023-05-17T15:08:18.905162+0000","last_clean":"2023-05-17T15:08:18.905162+0000","last_became_active":"2023-05-17T15:08:18.904829+0000","last_became_peered":"2023-05-17T15:08:18.904829+0000","last_unstale":"2023-05-17T15:08:18.905162+0000","last_undegraded":"2023-05-17T15:08:18.905162+0000","last_fullsized":"2023-05-17T15:08:18.905162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890401+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.904328+0000","last_change":"2023-05-17T15:08:18.904328+0000","last_active":"2023-05-17T15:08:18.904328+0000","last_peered":"2023-05-17T15:08:18.904328+0000","last_clean":"2023-05-17T15:08:18.904328+0000","last_became_active":"2023-05-17T15:08:18.904058+0000","last_became_peered":"2023-05-17T15:08:18.904058+0000","last_unstale":"2023-05-17T15:08:18.904328+0000","last_undegraded":"2023-05-17T15:08:18.904328+0000","last_fullsized":"2023-05-17T15:08:18.904328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891544+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.895653+0000","last_change":"2023-05-17T15:08:18.895653+0000","last_active":"2023-05-17T15:08:18.895653+0000","last_peered":"2023-05-17T15:08:18.895653+0000","last_clean":"2023-05-17T15:08:18.895653+0000","last_became_active":"2023-05-17T15:08:18.894704+0000","last_became_peered":"2023-05-17T15:08:18.894704+0000","last_unstale":"2023-05-17T15:08:18.895653+0000","last_undegraded":"2023-05-17T15:08:18.895653+0000","last_fullsized":"2023-05-17T15:08:18.895653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892392+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903034+0000","last_change":"2023-05-17T15:08:18.903034+0000","last_active":"2023-05-17T15:08:18.903034+0000","last_peered":"2023-05-17T15:08:18.903034+0000","last_clean":"2023-05-17T15:08:18.903034+0000","last_became_active":"2023-05-17T15:08:18.901993+0000","last_became_peered":"2023-05-17T15:08:18.901993+0000","last_unstale":"2023-05-17T15:08:18.903034+0000","last_undegraded":"2023-05-17T15:08:18.903034+0000","last_fullsized":"2023-05-17T15:08:18.903034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.894072+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.911966+0000","last_change":"2023-05-17T15:08:18.911966+0000","last_active":"2023-05-17T15:08:18.911966+0000","last_peered":"2023-05-17T15:08:18.911966+0000","last_clean":"2023-05-17T15:08:18.911966+0000","last_became_active":"2023-05-17T15:08:18.911688+0000","last_became_peered":"2023-05-17T15:08:18.911688+0000","last_unstale":"2023-05-17T15:08:18.911966+0000","last_undegraded":"2023-05-17T15:08:18.911966+0000","last_fullsized":"2023-05-17T15:08:18.911966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892088+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905571+0000","last_change":"2023-05-17T15:08:18.905571+0000","last_active":"2023-05-17T15:08:18.905571+0000","last_peered":"2023-05-17T15:08:18.905571+0000","last_clean":"2023-05-17T15:08:18.905571+0000","last_became_active":"2023-05-17T15:08:18.905052+0000","last_became_peered":"2023-05-17T15:08:18.905052+0000","last_unstale":"2023-05-17T15:08:18.905571+0000","last_undegraded":"2023-05-17T15:08:18.905571+0000","last_fullsized":"2023-05-17T15:08:18.905571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.891186+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902853+0000","last_change":"2023-05-17T15:08:18.902853+0000","last_active":"2023-05-17T15:08:18.902853+0000","last_peered":"2023-05-17T15:08:18.902853+0000","last_clean":"2023-05-17T15:08:18.902853+0000","last_became_active":"2023-05-17T15:08:18.902447+0000","last_became_peered":"2023-05-17T15:08:18.902447+0000","last_unstale":"2023-05-17T15:08:18.902853+0000","last_undegraded":"2023-05-17T15:08:18.902853+0000","last_fullsized":"2023-05-17T15:08:18.902853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896625+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.896413+0000","last_change":"2023-05-17T15:08:18.896413+0000","last_active":"2023-05-17T15:08:18.896413+0000","last_peered":"2023-05-17T15:08:18.896413+0000","last_clean":"2023-05-17T15:08:18.896413+0000","last_became_active":"2023-05-17T15:08:18.896113+0000","last_became_peered":"2023-05-17T15:08:18.896113+0000","last_unstale":"2023-05-17T15:08:18.896413+0000","last_undegraded":"2023-05-17T15:08:18.896413+0000","last_fullsized":"2023-05-17T15:08:18.896413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.899017+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.903669+0000","last_change":"2023-05-17T15:08:18.903669+0000","last_active":"2023-05-17T15:08:18.903669+0000","last_peered":"2023-05-17T15:08:18.903669+0000","last_clean":"2023-05-17T15:08:18.903669+0000","last_became_active":"2023-05-17T15:08:18.903362+0000","last_became_peered":"2023-05-17T15:08:18.903362+0000","last_unstale":"2023-05-17T15:08:18.903669+0000","last_undegraded":"2023-05-17T15:08:18.903669+0000","last_fullsized":"2023-05-17T15:08:18.903669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.887786+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:17.887786+0000","last_peered":"2023-05-17T15:08:17.887786+0000","last_clean":"2023-05-17T15:08:17.887786+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:17.887786+0000","last_undegraded":"2023-05-17T15:08:17.887786+0000","last_fullsized":"2023-05-17T15:08:17.887786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892325+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.905697+0000","last_change":"2023-05-17T15:08:18.905697+0000","last_active":"2023-05-17T15:08:18.905697+0000","last_peered":"2023-05-17T15:08:18.905697+0000","last_clean":"2023-05-17T15:08:18.905697+0000","last_became_active":"2023-05-17T15:08:18.905379+0000","last_became_peered":"2023-05-17T15:08:18.905379+0000","last_unstale":"2023-05-17T15:08:18.905697+0000","last_undegraded":"2023-05-17T15:08:18.905697+0000","last_fullsized":"2023-05-17T15:08:18.905697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.884117+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:17.884117+0000","last_peered":"2023-05-17T15:08:17.884117+0000","last_clean":"2023-05-17T15:08:17.884117+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:17.884117+0000","last_undegraded":"2023-05-17T15:08:17.884117+0000","last_fullsized":"2023-05-17T15:08:17.884117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.888381+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.902285+0000","last_change":"2023-05-17T15:08:18.902285+0000","last_active":"2023-05-17T15:08:18.902285+0000","last_peered":"2023-05-17T15:08:18.902285+0000","last_clean":"2023-05-17T15:08:18.902285+0000","last_became_active":"2023-05-17T15:08:18.901984+0000","last_became_peered":"2023-05-17T15:08:18.901984+0000","last_unstale":"2023-05-17T15:08:18.902285+0000","last_undegraded":"2023-05-17T15:08:18.902285+0000","last_fullsized":"2023-05-17T15:08:18.902285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.886186+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:17.886186+0000","last_peered":"2023-05-17T15:08:17.886186+0000","last_clean":"2023-05-17T15:08:17.886186+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:17.886186+0000","last_undegraded":"2023-05-17T15:08:17.886186+0000","last_fullsized":"2023-05-17T15:08:17.886186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.893559+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910068+0000","last_change":"2023-05-17T15:08:18.910068+0000","last_active":"2023-05-17T15:08:18.910068+0000","last_peered":"2023-05-17T15:08:18.910068+0000","last_clean":"2023-05-17T15:08:18.910068+0000","last_became_active":"2023-05-17T15:08:18.908009+0000","last_became_peered":"2023-05-17T15:08:18.908009+0000","last_unstale":"2023-05-17T15:08:18.910068+0000","last_undegraded":"2023-05-17T15:08:18.910068+0000","last_fullsized":"2023-05-17T15:08:18.910068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.884072+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:17.884072+0000","last_peered":"2023-05-17T15:08:17.884072+0000","last_clean":"2023-05-17T15:08:17.884072+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:17.884072+0000","last_undegraded":"2023-05-17T15:08:17.884072+0000","last_fullsized":"2023-05-17T15:08:17.884072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.888286+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:17.888286+0000","last_peered":"2023-05-17T15:08:17.888286+0000","last_clean":"2023-05-17T15:08:17.888286+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:17.888286+0000","last_undegraded":"2023-05-17T15:08:17.888286+0000","last_fullsized":"2023-05-17T15:08:17.888286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.890309+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.910475+0000","last_change":"2023-05-17T15:08:18.910475+0000","last_active":"2023-05-17T15:08:18.910475+0000","last_peered":"2023-05-17T15:08:18.910475+0000","last_clean":"2023-05-17T15:08:18.910475+0000","last_became_active":"2023-05-17T15:08:18.910197+0000","last_became_peered":"2023-05-17T15:08:18.910197+0000","last_unstale":"2023-05-17T15:08:18.910475+0000","last_undegraded":"2023-05-17T15:08:18.910475+0000","last_fullsized":"2023-05-17T15:08:18.910475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.889141+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:17.889141+0000","last_peered":"2023-05-17T15:08:17.889141+0000","last_clean":"2023-05-17T15:08:17.889141+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:17.889141+0000","last_undegraded":"2023-05-17T15:08:17.889141+0000","last_fullsized":"2023-05-17T15:08:17.889141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.895924+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.913201+0000","last_change":"2023-05-17T15:08:18.913201+0000","last_active":"2023-05-17T15:08:18.913201+0000","last_peered":"2023-05-17T15:08:18.913201+0000","last_clean":"2023-05-17T15:08:18.913201+0000","last_became_active":"2023-05-17T15:08:18.912907+0000","last_became_peered":"2023-05-17T15:08:18.912907+0000","last_unstale":"2023-05-17T15:08:18.913201+0000","last_undegraded":"2023-05-17T15:08:18.913201+0000","last_fullsized":"2023-05-17T15:08:18.913201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.890147+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:17.890147+0000","last_peered":"2023-05-17T15:08:17.890147+0000","last_clean":"2023-05-17T15:08:17.890147+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:17.890147+0000","last_undegraded":"2023-05-17T15:08:17.890147+0000","last_fullsized":"2023-05-17T15:08:17.890147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.892274+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.912764+0000","last_change":"2023-05-17T15:08:18.912764+0000","last_active":"2023-05-17T15:08:18.912764+0000","last_peered":"2023-05-17T15:08:18.912764+0000","last_clean":"2023-05-17T15:08:18.912764+0000","last_became_active":"2023-05-17T15:08:18.912413+0000","last_became_peered":"2023-05-17T15:08:18.912413+0000","last_unstale":"2023-05-17T15:08:18.912764+0000","last_undegraded":"2023-05-17T15:08:18.912764+0000","last_fullsized":"2023-05-17T15:08:18.912764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.887759+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:17.887759+0000","last_peered":"2023-05-17T15:08:17.887759+0000","last_clean":"2023-05-17T15:08:17.887759+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:17.887759+0000","last_undegraded":"2023-05-17T15:08:17.887759+0000","last_fullsized":"2023-05-17T15:08:17.887759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:18.877856+0000","last_change":"2023-05-17T15:08:18.896388+0000","last_active":"2023-05-17T15:08:18.877856+0000","last_peered":"2023-05-17T15:08:18.877856+0000","last_clean":"2023-05-17T15:08:18.877856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:18.877856+0000","last_undegraded":"2023-05-17T15:08:18.877856+0000","last_fullsized":"2023-05-17T15:08:18.877856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-17T15:08:18.898040+0000","last_change":"2023-05-17T15:08:18.898040+0000","last_active":"2023-05-17T15:08:18.898040+0000","last_peered":"2023-05-17T15:08:18.898040+0000","last_clean":"2023-05-17T15:08:18.898040+0000","last_became_active":"2023-05-17T15:08:18.897780+0000","last_became_peered":"2023-05-17T15:08:18.897780+0000","last_unstale":"2023-05-17T15:08:18.898040+0000","last_undegraded":"2023-05-17T15:08:18.898040+0000","last_fullsized":"2023-05-17T15:08:18.898040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-05-17T15:08:17.886822+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:17.886822+0000","last_peered":"2023-05-17T15:08:17.886822+0000","last_clean":"2023-05-17T15:08:17.886822+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:17.886822+0000","last_undegraded":"2023-05-17T15:08:17.886822+0000","last_fullsized":"2023-05-17T15:08:17.886822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16824,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355016,"statfs":{"total":96636764160,"available":96619536384,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56200000000000006}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.38800000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.36699999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575024,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16248,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355592,"statfs":{"total":96636764160,"available":96620126208,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.498}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16056,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355784,"statfs":{"total":96636764160,"available":96620322816,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.65700000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46400000000000002,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":1.956,"15min":1.956},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.64800000000000002,"5min":1.149,"15min":1.149},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.57599999999999996,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":0.76400000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":1.103,"15min":1.6100000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.64900000000000002},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.54900000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.524,"15min":1.524},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834575024,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15940,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94355900,"statfs":{"total":96636764160,"available":96620441600,"internally_reserved":0,"allocated":978944,"data_stored":487856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.58199999999999996}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.46800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17272,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":94354568,"statfs":{"total":96636764160,"available":96619077632,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.373}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.35899999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.627},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20216,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351624,"statfs":{"total":96636764160,"available":96616062976,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26800000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.505}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16440,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355400,"statfs":{"total":96636764160,"available":96619929600,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.47199999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19832,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":18880,"kb_avail":94352008,"statfs":{"total":96636764160,"available":96616456192,"internally_reserved":0,"allocated":966656,"data_stored":481105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19333120},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.621,"15min":0.61199999999999999},"min":{"1min":0.51000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75800000000000001,"5min":0.82399999999999995,"15min":0.876},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.629},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.88100000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73099999999999998,"5min":0.80300000000000005,"15min":0.995},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.54200000000000004,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.81599999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.96199999999999997},"last":0.749},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.85999999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.497},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.85599999999999998},"last":0.504},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed May 17 15:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36399999999999999,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":0.754,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.623},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.83699999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:24.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-05-17T15:08:24.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891375+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-05-17T15:08:24.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.898587+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-05-17T15:08:24.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.894567+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-05-17T15:08:24.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893179+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-05-17T15:08:24.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891549+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-05-17T15:08:24.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891832+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:24.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-05-17T15:08:24.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890210+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:24.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-05-17T15:08:24.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.900511+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-05-17T15:08:24.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.894058+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-05-17T15:08:24.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892171+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-05-17T15:08:24.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896009+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-05-17T15:08:24.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.898917+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-05-17T15:08:24.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.897416+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:24.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-05-17T15:08:24.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.897205+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-05-17T15:08:24.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896964+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-05-17T15:08:24.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.889451+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-05-17T15:08:24.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893835+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:24.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-05-17T15:08:24.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.900140+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-05-17T15:08:24.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892745+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-05-17T15:08:24.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892938+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-05-17T15:08:24.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.900402+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-05-17T15:08:24.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.894289+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:24.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-05-17T15:08:24.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893909+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:24.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-05-17T15:08:24.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.888633+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-05-17T15:08:24.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893968+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-05-17T15:08:24.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890369+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-05-17T15:08:24.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891985+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-05-17T15:08:24.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890952+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-05-17T15:08:24.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892271+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:24.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-05-17T15:08:24.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892809+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-05-17T15:08:24.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.889115+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-05-17T15:08:24.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.897335+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-05-17T15:08:24.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893751+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-05-17T15:08:24.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.889900+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-05-17T15:08:24.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891331+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:24.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-05-17T15:08:24.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896576+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-05-17T15:08:24.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.897026+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:24.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-05-17T15:08:24.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890765+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-05-17T15:08:24.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896586+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-05-17T15:08:24.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.894233+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:24.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-05-17T15:08:24.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893574+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-05-17T15:08:24.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893758+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:24.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-05-17T15:08:24.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896616+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-05-17T15:08:24.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890106+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-05-17T15:08:24.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890909+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-05-17T15:08:24.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.889001+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-05-17T15:08:24.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893833+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-05-17T15:08:24.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890247+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-05-17T15:08:24.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890210+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:24.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-05-17T15:08:24.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890401+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:24.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-05-17T15:08:24.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891544+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-05-17T15:08:24.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892392+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-05-17T15:08:24.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.894072+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-05-17T15:08:24.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892088+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-05-17T15:08:24.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.891186+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:24.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-05-17T15:08:24.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896625+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:24.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-05-17T15:08:24.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.899017+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:24.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-05-17T15:08:24.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892325+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-05-17T15:08:24.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.888381+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:24.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-05-17T15:08:24.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.893559+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-05-17T15:08:24.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.890309+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:24.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-05-17T15:08:24.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.895924+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-05-17T15:08:24.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.892274+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:24.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-05-17T15:08:24.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:18.877856+0000', 'last_change': '2023-05-17T15:08:18.896388+0000', 'last_active': '2023-05-17T15:08:18.877856+0000', 'last_peered': '2023-05-17T15:08:18.877856+0000', 'last_clean': '2023-05-17T15:08:18.877856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:18.877856+0000', 'last_undegraded': '2023-05-17T15:08:18.877856+0000', 'last_fullsized': '2023-05-17T15:08:18.877856+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:18.877856+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:24.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-17T15:08:24.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.195+0000 7f6617062700 1 Processor -- start 2023-05-17T15:08:24.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.195+0000 7f6617062700 1 -- start start 2023-05-17T15:08:24.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6617062700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66100c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6617062700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66100c1560 0x7f66100c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6617062700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100c07e0 con 0x7f66101544f0 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6617062700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66101549b0 con 0x7f66100c1560 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6617062700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6610154c90 con 0x7f66100c1180 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66100c1560 0x7f66100c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66100c1560 0x7f66100c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38624/0 (socket says 172.21.15.27:38624) 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 -- 172.21.15.27:0/2025951441 learned_addr learned my addr 172.21.15.27:0/2025951441 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616060700 1 --2- 172.21.15.27:0/2025951441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66100c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 -- 172.21.15.27:0/2025951441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 msgr2=0x7f66100c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 --2- 172.21.15.27:0/2025951441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66100c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 -- 172.21.15.27:0/2025951441 >> v1:172.21.15.40:6789/0 conn(0x7f66101544f0 legacy=0x7f66100a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 -- 172.21.15.27:0/2025951441 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610154f70 con 0x7f66100c1560 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.196+0000 7f6616861700 1 --2- 172.21.15.27:0/2025951441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100c74a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f6608009f20 tx=0x7f6608009840).ready entity=mon.0 client_cookie=997d444878293f71 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f661505e700 1 -- 172.21.15.27:0/2025951441 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800e070 con 0x7f66100c1560 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f661505e700 1 -- 172.21.15.27:0/2025951441 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800ba80 con 0x7f66100c1560 2023-05-17T15:08:24.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f661505e700 1 -- 172.21.15.27:0/2025951441 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800be00 con 0x7f66100c1560 2023-05-17T15:08:24.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 -- 172.21.15.27:0/2025951441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 msgr2=0x7f66100c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 --2- 172.21.15.27:0/2025951441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100c74a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f6608009f20 tx=0x7f6608009840).stop 2023-05-17T15:08:24.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 -- 172.21.15.27:0/2025951441 shutdown_connections 2023-05-17T15:08:24.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 --2- 172.21.15.27:0/2025951441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100c74a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 --2- 172.21.15.27:0/2025951441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66100c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 -- 172.21.15.27:0/2025951441 >> 172.21.15.27:0/2025951441 conn(0x7f661005dd50 msgr2=0x7f661005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:24.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 -- 172.21.15.27:0/2025951441 shutdown_connections 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.197+0000 7f6617062700 1 -- 172.21.15.27:0/2025951441 wait complete. 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.198+0000 7f6617062700 1 Processor -- start 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.198+0000 7f6617062700 1 -- start start 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6617062700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66101638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6617062700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6617062700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66101544f0 0x7f6610167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6617062700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100ae2f0 con 0x7f66100c1560 2023-05-17T15:08:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6617062700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100c1fa0 con 0x7f66101544f0 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6617062700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100c2280 con 0x7f66100c1180 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38628/0 (socket says 172.21.15.27:38628) 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 -- 172.21.15.27:0/3805864216 learned_addr learned my addr 172.21.15.27:0/3805864216 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6616861700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66101544f0 0x7f6610167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f6616060700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66101638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 -- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 msgr2=0x7f66101638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66101638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 -- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66101544f0 msgr2=0x7f6610167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66101544f0 0x7f6610167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.199+0000 7f661585f700 1 -- 172.21.15.27:0/3805864216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608009ae0 con 0x7f66100c1560 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.200+0000 7f661585f700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100caee0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f660000c440 tx=0x7f6600007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.200+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600007020 con 0x7f66100c1560 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.200+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600001e90 con 0x7f66100c1560 2023-05-17T15:08:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.200+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66100ca400 con 0x7f66100c1560 2023-05-17T15:08:24.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.200+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66000073b0 con 0x7f66100c1560 2023-05-17T15:08:24.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.200+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66100ca9c0 con 0x7f66100c1560 2023-05-17T15:08:24.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.201+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66100ca240 con 0x7f66100c1560 2023-05-17T15:08:24.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.201+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6600010070 con 0x7f66100c1560 2023-05-17T15:08:24.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.201+0000 7f66067fc700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65f405ed90 0x7f65f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.201+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f6600079220 con 0x7f66100c1560 2023-05-17T15:08:24.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.201+0000 7f6616060700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65f405ed90 0x7f65f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.202+0000 7f6616060700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65f405ed90 0x7f65f4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f660c00bb10 tx=0x7f660c008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:24.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.206+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f660004a770 con 0x7f66100c1560 2023-05-17T15:08:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.449+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f661006bdf0 con 0x7f66100c1560 2023-05-17T15:08:24.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.450+0000 7f66067fc700 1 -- 172.21.15.27:0/3805864216 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+951 (secure 0 0 0) 0x7f660004dd90 con 0x7f66100c1560 2023-05-17T15:08:24.454 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:24.454 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":889,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1684335223,"num_in_osds":8,"osd_in_since":1684335217,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":22,"data_bytes":2306,"bytes_used":143753216,"bytes_avail":772950360064,"bytes_total":773094113280},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6192}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-05-17T15:07:12.655393+0000","services":{}},"progress_events":{}} 2023-05-17T15:08:24.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65f405ed90 msgr2=0x7f65f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65f405ed90 0x7f65f4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f660c00bb10 tx=0x7f660c008040).stop 2023-05-17T15:08:24.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 msgr2=0x7f66100caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100caee0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f660000c440 tx=0x7f6600007d70).stop 2023-05-17T15:08:24.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 shutdown_connections 2023-05-17T15:08:24.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65f405ed90 0x7f65f4061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66101544f0 0x7f6610167300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66100c1180 0x7f66101638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 --2- 172.21.15.27:0/3805864216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66100c1560 0x7f66100caee0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 >> 172.21.15.27:0/3805864216 conn(0x7f661005dd50 msgr2=0x7f66100c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:24.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 shutdown_connections 2023-05-17T15:08:24.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.452+0000 7f6617062700 1 -- 172.21.15.27:0/3805864216 wait complete. 2023-05-17T15:08:24.467 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-17T15:08:24.468 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:24.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.580+0000 7f007759e700 1 Processor -- start 2023-05-17T15:08:24.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.580+0000 7f007759e700 1 -- start start 2023-05-17T15:08:24.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00781544f0 0x7f00780a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f00780aa070 0x7f00780c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00781549b0 con 0x7f00780c1180 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0078154c90 con 0x7f00780aa070 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0078154f70 con 0x7f00781544f0 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f00780c1180 0x7f00780c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38196/0 (socket says 172.21.15.27:38196) 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f0076d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f00780aa070 0x7f00780c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007659c700 1 -- 172.21.15.27:0/125412266 learned_addr learned my addr 172.21.15.27:0/125412266 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f0075d9b700 1 --2- 172.21.15.27:0/125412266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00781544f0 0x7f00780a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f0076d9d700 1 -- 172.21.15.27:0/125412266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00781544f0 msgr2=0x7f00780a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:24.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f0076d9d700 1 --2- 172.21.15.27:0/125412266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00781544f0 0x7f00780a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f0076d9d700 1 -- 172.21.15.27:0/125412266 >> v1:172.21.15.27:6789/0 conn(0x7f00780c1180 legacy=0x7f00780c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f007559a700 1 -- 172.21.15.27:0/125412266 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909052193 0 0) 0x7f00781549b0 con 0x7f00780c1180 2023-05-17T15:08:24.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.581+0000 7f0076d9d700 1 -- 172.21.15.27:0/125412266 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078155250 con 0x7f00780aa070 2023-05-17T15:08:24.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f0076d9d700 1 --2- 172.21.15.27:0/125412266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00780aa070 0x7f00780c74a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f0068009e60 tx=0x7f0068009780).ready entity=mon.0 client_cookie=4b24d2bb907c3060 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:24.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007559a700 1 -- 172.21.15.27:0/125412266 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800e070 con 0x7f00780aa070 2023-05-17T15:08:24.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007559a700 1 -- 172.21.15.27:0/125412266 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800bb60 con 0x7f00780aa070 2023-05-17T15:08:24.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007559a700 1 -- 172.21.15.27:0/125412266 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068012410 con 0x7f00780aa070 2023-05-17T15:08:24.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 -- 172.21.15.27:0/125412266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00780aa070 msgr2=0x7f00780c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 --2- 172.21.15.27:0/125412266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00780aa070 0x7f00780c74a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f0068009e60 tx=0x7f0068009780).stop 2023-05-17T15:08:24.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 -- 172.21.15.27:0/125412266 shutdown_connections 2023-05-17T15:08:24.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 --2- 172.21.15.27:0/125412266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00780aa070 0x7f00780c74a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 --2- 172.21.15.27:0/125412266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00781544f0 0x7f00780a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 -- 172.21.15.27:0/125412266 >> 172.21.15.27:0/125412266 conn(0x7f007805dd50 msgr2=0x7f007805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:24.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 -- 172.21.15.27:0/125412266 shutdown_connections 2023-05-17T15:08:24.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.582+0000 7f007759e700 1 -- 172.21.15.27:0/125412266 wait complete. 2023-05-17T15:08:24.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 Processor -- start 2023-05-17T15:08:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 -- start start 2023-05-17T15:08:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00780aa070 0x7f0078167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00780c1180 0x7f00780afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 0x7f00780c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078164cc0 con 0x7f00781544f0 2023-05-17T15:08:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00781681c0 con 0x7f00780aa070 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f007759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00781640b0 con 0x7f00780c1180 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f0076d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 0x7f00780c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f0076d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 0x7f00780c4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38642/0 (socket says 172.21.15.27:38642) 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.584+0000 7f0076d9d700 1 -- 172.21.15.27:0/219227993 learned_addr learned my addr 172.21.15.27:0/219227993 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f007659c700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00780aa070 0x7f0078167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0075d9b700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00780c1180 0x7f00780afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0076d9d700 1 -- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00780c1180 msgr2=0x7f00780afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0076d9d700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00780c1180 0x7f00780afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0076d9d700 1 -- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00780aa070 msgr2=0x7f0078167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0076d9d700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00780aa070 0x7f0078167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0076d9d700 1 -- 172.21.15.27:0/219227993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009a20 con 0x7f00781544f0 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f0076d9d700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 0x7f00780c4300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f0078068b00 tx=0x7f0068009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068012410 con 0x7f00781544f0 2023-05-17T15:08:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006801d630 con 0x7f00781544f0 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0078164390 con 0x7f00781544f0 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006801d9f0 con 0x7f00781544f0 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.585+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0078164950 con 0x7f00781544f0 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.586+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0078157e60 con 0x7f00781544f0 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.586+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0068026410 con 0x7f00781544f0 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.587+0000 7f006e7fc700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f005805ed90 0x7f0058061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.587+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f006807bd00 con 0x7f00781544f0 2023-05-17T15:08:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.587+0000 7f007659c700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f005805ed90 0x7f0058061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.587+0000 7f007659c700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f005805ed90 0x7f0058061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f00700011e0 tx=0x7f0070007bb0).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.591+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f006807f030 con 0x7f00781544f0 2023-05-17T15:08:24.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.762+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f007806bdf0 con 0x7f005805ed90 2023-05-17T15:08:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.772+0000 7f006e7fc700 1 -- 172.21.15.27:0/219227993 <== mgr.6003 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361249 (secure 0 0 0) 0x7f007806bdf0 con 0x7f005805ed90 2023-05-17T15:08:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:24.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f005805ed90 msgr2=0x7f0058061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f005805ed90 0x7f0058061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f00700011e0 tx=0x7f0070007bb0).stop 2023-05-17T15:08:24.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 msgr2=0x7f00780c4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:24.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 0x7f00780c4300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f0078068b00 tx=0x7f0068009780).stop 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 shutdown_connections 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f005805ed90 0x7f0058061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00781544f0 0x7f00780c4300 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00780aa070 0x7f0078167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 --2- 172.21.15.27:0/219227993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00780c1180 0x7f00780afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 >> 172.21.15.27:0/219227993 conn(0x7f007805dd50 msgr2=0x7f00780aaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:24.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 shutdown_connections 2023-05-17T15:08:24.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:24.776+0000 7f007759e700 1 -- 172.21.15.27:0/219227993 wait complete. 2023-05-17T15:08:24.785 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:24.792 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:08:24.144291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":265,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":140384,"kb_used_data":7904,"kb_used_omap":0,"kb_used_meta":132416,"kb_avail":754834336,"statfs":{"total":773094113280,"available":772950360064,"internally_reserved":0,"allocated":8093696,"data_stored":4019676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":135593984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27717,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.612711"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308368+0000","last_change":"2023-05-17T15:08:19.290803+0000","last_active":"2023-05-17T15:08:19.308368+0000","last_peered":"2023-05-17T15:08:19.308368+0000","last_clean":"2023-05-17T15:08:19.308368+0000","last_became_active":"2023-05-17T15:08:19.290484+0000","last_became_peered":"2023-05-17T15:08:19.290484+0000","last_unstale":"2023-05-17T15:08:19.308368+0000","last_undegraded":"2023-05-17T15:08:19.308368+0000","last_fullsized":"2023-05-17T15:08:19.308368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290528+0000","last_change":"2023-05-17T15:08:18.911990+0000","last_active":"2023-05-17T15:08:19.290528+0000","last_peered":"2023-05-17T15:08:19.290528+0000","last_clean":"2023-05-17T15:08:19.290528+0000","last_became_active":"2023-05-17T15:08:18.911703+0000","last_became_peered":"2023-05-17T15:08:18.911703+0000","last_unstale":"2023-05-17T15:08:19.290528+0000","last_undegraded":"2023-05-17T15:08:19.290528+0000","last_fullsized":"2023-05-17T15:08:19.290528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308887+0000","last_change":"2023-05-17T15:08:19.304909+0000","last_active":"2023-05-17T15:08:19.308887+0000","last_peered":"2023-05-17T15:08:19.308887+0000","last_clean":"2023-05-17T15:08:19.308887+0000","last_became_active":"2023-05-17T15:08:19.304572+0000","last_became_peered":"2023-05-17T15:08:19.304572+0000","last_unstale":"2023-05-17T15:08:19.308887+0000","last_undegraded":"2023-05-17T15:08:19.308887+0000","last_fullsized":"2023-05-17T15:08:19.308887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277477+0000","last_change":"2023-05-17T15:08:18.902229+0000","last_active":"2023-05-17T15:08:19.277477+0000","last_peered":"2023-05-17T15:08:19.277477+0000","last_clean":"2023-05-17T15:08:19.277477+0000","last_became_active":"2023-05-17T15:08:18.901917+0000","last_became_peered":"2023-05-17T15:08:18.901917+0000","last_unstale":"2023-05-17T15:08:19.277477+0000","last_undegraded":"2023-05-17T15:08:19.277477+0000","last_fullsized":"2023-05-17T15:08:19.277477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290218+0000","last_change":"2023-05-17T15:08:19.285240+0000","last_active":"2023-05-17T15:08:19.290218+0000","last_peered":"2023-05-17T15:08:19.290218+0000","last_clean":"2023-05-17T15:08:19.290218+0000","last_became_active":"2023-05-17T15:08:19.284964+0000","last_became_peered":"2023-05-17T15:08:19.284964+0000","last_unstale":"2023-05-17T15:08:19.290218+0000","last_undegraded":"2023-05-17T15:08:19.290218+0000","last_fullsized":"2023-05-17T15:08:19.290218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298672+0000","last_change":"2023-05-17T15:08:18.908877+0000","last_active":"2023-05-17T15:08:19.298672+0000","last_peered":"2023-05-17T15:08:19.298672+0000","last_clean":"2023-05-17T15:08:19.298672+0000","last_became_active":"2023-05-17T15:08:18.908536+0000","last_became_peered":"2023-05-17T15:08:18.908536+0000","last_unstale":"2023-05-17T15:08:19.298672+0000","last_undegraded":"2023-05-17T15:08:19.298672+0000","last_fullsized":"2023-05-17T15:08:19.298672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306773+0000","last_change":"2023-05-17T15:08:19.302979+0000","last_active":"2023-05-17T15:08:19.306773+0000","last_peered":"2023-05-17T15:08:19.306773+0000","last_clean":"2023-05-17T15:08:19.306773+0000","last_became_active":"2023-05-17T15:08:19.302718+0000","last_became_peered":"2023-05-17T15:08:19.302718+0000","last_unstale":"2023-05-17T15:08:19.306773+0000","last_undegraded":"2023-05-17T15:08:19.306773+0000","last_fullsized":"2023-05-17T15:08:19.306773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302651+0000","last_change":"2023-05-17T15:08:18.904853+0000","last_active":"2023-05-17T15:08:19.302651+0000","last_peered":"2023-05-17T15:08:19.302651+0000","last_clean":"2023-05-17T15:08:19.302651+0000","last_became_active":"2023-05-17T15:08:18.904460+0000","last_became_peered":"2023-05-17T15:08:18.904460+0000","last_unstale":"2023-05-17T15:08:19.302651+0000","last_undegraded":"2023-05-17T15:08:19.302651+0000","last_fullsized":"2023-05-17T15:08:19.302651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306971+0000","last_change":"2023-05-17T15:08:19.301653+0000","last_active":"2023-05-17T15:08:19.306971+0000","last_peered":"2023-05-17T15:08:19.306971+0000","last_clean":"2023-05-17T15:08:19.306971+0000","last_became_active":"2023-05-17T15:08:19.301195+0000","last_became_peered":"2023-05-17T15:08:19.301195+0000","last_unstale":"2023-05-17T15:08:19.306971+0000","last_undegraded":"2023-05-17T15:08:19.306971+0000","last_fullsized":"2023-05-17T15:08:19.306971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.296502+0000","last_change":"2023-05-17T15:08:18.904506+0000","last_active":"2023-05-17T15:08:19.296502+0000","last_peered":"2023-05-17T15:08:19.296502+0000","last_clean":"2023-05-17T15:08:19.296502+0000","last_became_active":"2023-05-17T15:08:18.904213+0000","last_became_peered":"2023-05-17T15:08:18.904213+0000","last_unstale":"2023-05-17T15:08:19.296502+0000","last_undegraded":"2023-05-17T15:08:19.296502+0000","last_fullsized":"2023-05-17T15:08:19.296502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298099+0000","last_change":"2023-05-17T15:08:19.293386+0000","last_active":"2023-05-17T15:08:19.298099+0000","last_peered":"2023-05-17T15:08:19.298099+0000","last_clean":"2023-05-17T15:08:19.298099+0000","last_became_active":"2023-05-17T15:08:19.293141+0000","last_became_peered":"2023-05-17T15:08:19.293141+0000","last_unstale":"2023-05-17T15:08:19.298099+0000","last_undegraded":"2023-05-17T15:08:19.298099+0000","last_fullsized":"2023-05-17T15:08:19.298099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290096+0000","last_change":"2023-05-17T15:08:18.902858+0000","last_active":"2023-05-17T15:08:19.290096+0000","last_peered":"2023-05-17T15:08:19.290096+0000","last_clean":"2023-05-17T15:08:19.290096+0000","last_became_active":"2023-05-17T15:08:18.902398+0000","last_became_peered":"2023-05-17T15:08:18.902398+0000","last_unstale":"2023-05-17T15:08:19.290096+0000","last_undegraded":"2023-05-17T15:08:19.290096+0000","last_fullsized":"2023-05-17T15:08:19.290096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306817+0000","last_change":"2023-05-17T15:08:19.304906+0000","last_active":"2023-05-17T15:08:19.306817+0000","last_peered":"2023-05-17T15:08:19.306817+0000","last_clean":"2023-05-17T15:08:19.306817+0000","last_became_active":"2023-05-17T15:08:19.304499+0000","last_became_peered":"2023-05-17T15:08:19.304499+0000","last_unstale":"2023-05-17T15:08:19.306817+0000","last_undegraded":"2023-05-17T15:08:19.306817+0000","last_fullsized":"2023-05-17T15:08:19.306817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.281785+0000","last_change":"2023-05-17T15:08:18.901694+0000","last_active":"2023-05-17T15:08:19.281785+0000","last_peered":"2023-05-17T15:08:19.281785+0000","last_clean":"2023-05-17T15:08:19.281785+0000","last_became_active":"2023-05-17T15:08:18.900872+0000","last_became_peered":"2023-05-17T15:08:18.900872+0000","last_unstale":"2023-05-17T15:08:19.281785+0000","last_undegraded":"2023-05-17T15:08:19.281785+0000","last_fullsized":"2023-05-17T15:08:19.281785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.304821+0000","last_change":"2023-05-17T15:08:19.301024+0000","last_active":"2023-05-17T15:08:19.304821+0000","last_peered":"2023-05-17T15:08:19.304821+0000","last_clean":"2023-05-17T15:08:19.304821+0000","last_became_active":"2023-05-17T15:08:19.300729+0000","last_became_peered":"2023-05-17T15:08:19.300729+0000","last_unstale":"2023-05-17T15:08:19.304821+0000","last_undegraded":"2023-05-17T15:08:19.304821+0000","last_fullsized":"2023-05-17T15:08:19.304821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.276939+0000","last_change":"2023-05-17T15:08:18.899762+0000","last_active":"2023-05-17T15:08:19.276939+0000","last_peered":"2023-05-17T15:08:19.276939+0000","last_clean":"2023-05-17T15:08:19.276939+0000","last_became_active":"2023-05-17T15:08:18.899483+0000","last_became_peered":"2023-05-17T15:08:18.899483+0000","last_unstale":"2023-05-17T15:08:19.276939+0000","last_undegraded":"2023-05-17T15:08:19.276939+0000","last_fullsized":"2023-05-17T15:08:19.276939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307195+0000","last_change":"2023-05-17T15:08:19.303972+0000","last_active":"2023-05-17T15:08:19.307195+0000","last_peered":"2023-05-17T15:08:19.307195+0000","last_clean":"2023-05-17T15:08:19.307195+0000","last_became_active":"2023-05-17T15:08:19.303685+0000","last_became_peered":"2023-05-17T15:08:19.303685+0000","last_unstale":"2023-05-17T15:08:19.307195+0000","last_undegraded":"2023-05-17T15:08:19.307195+0000","last_fullsized":"2023-05-17T15:08:19.307195+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282200+0000","last_change":"2023-05-17T15:08:18.896324+0000","last_active":"2023-05-17T15:08:19.282200+0000","last_peered":"2023-05-17T15:08:19.282200+0000","last_clean":"2023-05-17T15:08:19.282200+0000","last_became_active":"2023-05-17T15:08:18.896047+0000","last_became_peered":"2023-05-17T15:08:18.896047+0000","last_unstale":"2023-05-17T15:08:19.282200+0000","last_undegraded":"2023-05-17T15:08:19.282200+0000","last_fullsized":"2023-05-17T15:08:19.282200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309038+0000","last_change":"2023-05-17T15:08:19.293445+0000","last_active":"2023-05-17T15:08:19.309038+0000","last_peered":"2023-05-17T15:08:19.309038+0000","last_clean":"2023-05-17T15:08:19.309038+0000","last_became_active":"2023-05-17T15:08:19.292782+0000","last_became_peered":"2023-05-17T15:08:19.292782+0000","last_unstale":"2023-05-17T15:08:19.309038+0000","last_undegraded":"2023-05-17T15:08:19.309038+0000","last_fullsized":"2023-05-17T15:08:19.309038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.280829+0000","last_change":"2023-05-17T15:08:18.906953+0000","last_active":"2023-05-17T15:08:19.280829+0000","last_peered":"2023-05-17T15:08:19.280829+0000","last_clean":"2023-05-17T15:08:19.280829+0000","last_became_active":"2023-05-17T15:08:18.906669+0000","last_became_peered":"2023-05-17T15:08:18.906669+0000","last_unstale":"2023-05-17T15:08:19.280829+0000","last_undegraded":"2023-05-17T15:08:19.280829+0000","last_fullsized":"2023-05-17T15:08:19.280829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308702+0000","last_change":"2023-05-17T15:08:19.304207+0000","last_active":"2023-05-17T15:08:19.308702+0000","last_peered":"2023-05-17T15:08:19.308702+0000","last_clean":"2023-05-17T15:08:19.308702+0000","last_became_active":"2023-05-17T15:08:19.303910+0000","last_became_peered":"2023-05-17T15:08:19.303910+0000","last_unstale":"2023-05-17T15:08:19.308702+0000","last_undegraded":"2023-05-17T15:08:19.308702+0000","last_fullsized":"2023-05-17T15:08:19.308702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278710+0000","last_change":"2023-05-17T15:08:18.896887+0000","last_active":"2023-05-17T15:08:19.278710+0000","last_peered":"2023-05-17T15:08:19.278710+0000","last_clean":"2023-05-17T15:08:19.278710+0000","last_became_active":"2023-05-17T15:08:18.896589+0000","last_became_peered":"2023-05-17T15:08:18.896589+0000","last_unstale":"2023-05-17T15:08:19.278710+0000","last_undegraded":"2023-05-17T15:08:19.278710+0000","last_fullsized":"2023-05-17T15:08:19.278710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.311023+0000","last_change":"2023-05-17T15:08:19.309982+0000","last_active":"2023-05-17T15:08:19.311023+0000","last_peered":"2023-05-17T15:08:19.311023+0000","last_clean":"2023-05-17T15:08:19.311023+0000","last_became_active":"2023-05-17T15:08:19.309678+0000","last_became_peered":"2023-05-17T15:08:19.309678+0000","last_unstale":"2023-05-17T15:08:19.311023+0000","last_undegraded":"2023-05-17T15:08:19.311023+0000","last_fullsized":"2023-05-17T15:08:19.311023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309385+0000","last_change":"2023-05-17T15:08:18.906169+0000","last_active":"2023-05-17T15:08:19.309385+0000","last_peered":"2023-05-17T15:08:19.309385+0000","last_clean":"2023-05-17T15:08:19.309385+0000","last_became_active":"2023-05-17T15:08:18.905905+0000","last_became_peered":"2023-05-17T15:08:18.905905+0000","last_unstale":"2023-05-17T15:08:19.309385+0000","last_undegraded":"2023-05-17T15:08:19.309385+0000","last_fullsized":"2023-05-17T15:08:19.309385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.300220+0000","last_change":"2023-05-17T15:08:19.296944+0000","last_active":"2023-05-17T15:08:19.300220+0000","last_peered":"2023-05-17T15:08:19.300220+0000","last_clean":"2023-05-17T15:08:19.300220+0000","last_became_active":"2023-05-17T15:08:19.296696+0000","last_became_peered":"2023-05-17T15:08:19.296696+0000","last_unstale":"2023-05-17T15:08:19.300220+0000","last_undegraded":"2023-05-17T15:08:19.300220+0000","last_fullsized":"2023-05-17T15:08:19.300220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.301240+0000","last_change":"2023-05-17T15:08:18.910832+0000","last_active":"2023-05-17T15:08:19.301240+0000","last_peered":"2023-05-17T15:08:19.301240+0000","last_clean":"2023-05-17T15:08:19.301240+0000","last_became_active":"2023-05-17T15:08:18.910487+0000","last_became_peered":"2023-05-17T15:08:18.910487+0000","last_unstale":"2023-05-17T15:08:19.301240+0000","last_undegraded":"2023-05-17T15:08:19.301240+0000","last_fullsized":"2023-05-17T15:08:19.301240+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308885+0000","last_change":"2023-05-17T15:08:19.305804+0000","last_active":"2023-05-17T15:08:19.308885+0000","last_peered":"2023-05-17T15:08:19.308885+0000","last_clean":"2023-05-17T15:08:19.308885+0000","last_became_active":"2023-05-17T15:08:19.305443+0000","last_became_peered":"2023-05-17T15:08:19.305443+0000","last_unstale":"2023-05-17T15:08:19.308885+0000","last_undegraded":"2023-05-17T15:08:19.308885+0000","last_fullsized":"2023-05-17T15:08:19.308885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282268+0000","last_change":"2023-05-17T15:08:18.906558+0000","last_active":"2023-05-17T15:08:19.282268+0000","last_peered":"2023-05-17T15:08:19.282268+0000","last_clean":"2023-05-17T15:08:19.282268+0000","last_became_active":"2023-05-17T15:08:18.906249+0000","last_became_peered":"2023-05-17T15:08:18.906249+0000","last_unstale":"2023-05-17T15:08:19.282268+0000","last_undegraded":"2023-05-17T15:08:19.282268+0000","last_fullsized":"2023-05-17T15:08:19.282268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308773+0000","last_change":"2023-05-17T15:08:19.304845+0000","last_active":"2023-05-17T15:08:19.308773+0000","last_peered":"2023-05-17T15:08:19.308773+0000","last_clean":"2023-05-17T15:08:19.308773+0000","last_became_active":"2023-05-17T15:08:19.304525+0000","last_became_peered":"2023-05-17T15:08:19.304525+0000","last_unstale":"2023-05-17T15:08:19.308773+0000","last_undegraded":"2023-05-17T15:08:19.308773+0000","last_fullsized":"2023-05-17T15:08:19.308773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.281883+0000","last_change":"2023-05-17T15:08:18.901512+0000","last_active":"2023-05-17T15:08:19.281883+0000","last_peered":"2023-05-17T15:08:19.281883+0000","last_clean":"2023-05-17T15:08:19.281883+0000","last_became_active":"2023-05-17T15:08:18.901188+0000","last_became_peered":"2023-05-17T15:08:18.901188+0000","last_unstale":"2023-05-17T15:08:19.281883+0000","last_undegraded":"2023-05-17T15:08:19.281883+0000","last_fullsized":"2023-05-17T15:08:19.281883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306896+0000","last_change":"2023-05-17T15:08:19.301152+0000","last_active":"2023-05-17T15:08:19.306896+0000","last_peered":"2023-05-17T15:08:19.306896+0000","last_clean":"2023-05-17T15:08:19.306896+0000","last_became_active":"2023-05-17T15:08:19.300843+0000","last_became_peered":"2023-05-17T15:08:19.300843+0000","last_unstale":"2023-05-17T15:08:19.306896+0000","last_undegraded":"2023-05-17T15:08:19.306896+0000","last_fullsized":"2023-05-17T15:08:19.306896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.300515+0000","last_change":"2023-05-17T15:08:18.900142+0000","last_active":"2023-05-17T15:08:19.300515+0000","last_peered":"2023-05-17T15:08:19.300515+0000","last_clean":"2023-05-17T15:08:19.300515+0000","last_became_active":"2023-05-17T15:08:18.899673+0000","last_became_peered":"2023-05-17T15:08:18.899673+0000","last_unstale":"2023-05-17T15:08:19.300515+0000","last_undegraded":"2023-05-17T15:08:19.300515+0000","last_fullsized":"2023-05-17T15:08:19.300515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290173+0000","last_change":"2023-05-17T15:08:19.285245+0000","last_active":"2023-05-17T15:08:19.290173+0000","last_peered":"2023-05-17T15:08:19.290173+0000","last_clean":"2023-05-17T15:08:19.290173+0000","last_became_active":"2023-05-17T15:08:19.284445+0000","last_became_peered":"2023-05-17T15:08:19.284445+0000","last_unstale":"2023-05-17T15:08:19.290173+0000","last_undegraded":"2023-05-17T15:08:19.290173+0000","last_fullsized":"2023-05-17T15:08:19.290173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277651+0000","last_change":"2023-05-17T15:08:18.909889+0000","last_active":"2023-05-17T15:08:19.277651+0000","last_peered":"2023-05-17T15:08:19.277651+0000","last_clean":"2023-05-17T15:08:19.277651+0000","last_became_active":"2023-05-17T15:08:18.908186+0000","last_became_peered":"2023-05-17T15:08:18.908186+0000","last_unstale":"2023-05-17T15:08:19.277651+0000","last_undegraded":"2023-05-17T15:08:19.277651+0000","last_fullsized":"2023-05-17T15:08:19.277651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293604+0000","last_change":"2023-05-17T15:08:19.290579+0000","last_active":"2023-05-17T15:08:19.293604+0000","last_peered":"2023-05-17T15:08:19.293604+0000","last_clean":"2023-05-17T15:08:19.293604+0000","last_became_active":"2023-05-17T15:08:19.290269+0000","last_became_peered":"2023-05-17T15:08:19.290269+0000","last_unstale":"2023-05-17T15:08:19.293604+0000","last_undegraded":"2023-05-17T15:08:19.293604+0000","last_fullsized":"2023-05-17T15:08:19.293604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.299441+0000","last_change":"2023-05-17T15:08:18.910773+0000","last_active":"2023-05-17T15:08:19.299441+0000","last_peered":"2023-05-17T15:08:19.299441+0000","last_clean":"2023-05-17T15:08:19.299441+0000","last_became_active":"2023-05-17T15:08:18.910497+0000","last_became_peered":"2023-05-17T15:08:18.910497+0000","last_unstale":"2023-05-17T15:08:19.299441+0000","last_undegraded":"2023-05-17T15:08:19.299441+0000","last_fullsized":"2023-05-17T15:08:19.299441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308819+0000","last_change":"2023-05-17T15:08:19.291404+0000","last_active":"2023-05-17T15:08:19.308819+0000","last_peered":"2023-05-17T15:08:19.308819+0000","last_clean":"2023-05-17T15:08:19.308819+0000","last_became_active":"2023-05-17T15:08:19.291074+0000","last_became_peered":"2023-05-17T15:08:19.291074+0000","last_unstale":"2023-05-17T15:08:19.308819+0000","last_undegraded":"2023-05-17T15:08:19.308819+0000","last_fullsized":"2023-05-17T15:08:19.308819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290432+0000","last_change":"2023-05-17T15:08:18.911295+0000","last_active":"2023-05-17T15:08:19.290432+0000","last_peered":"2023-05-17T15:08:19.290432+0000","last_clean":"2023-05-17T15:08:19.290432+0000","last_became_active":"2023-05-17T15:08:18.910808+0000","last_became_peered":"2023-05-17T15:08:18.910808+0000","last_unstale":"2023-05-17T15:08:19.290432+0000","last_undegraded":"2023-05-17T15:08:19.290432+0000","last_fullsized":"2023-05-17T15:08:19.290432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.300387+0000","last_change":"2023-05-17T15:08:19.294843+0000","last_active":"2023-05-17T15:08:19.300387+0000","last_peered":"2023-05-17T15:08:19.300387+0000","last_clean":"2023-05-17T15:08:19.300387+0000","last_became_active":"2023-05-17T15:08:19.294555+0000","last_became_peered":"2023-05-17T15:08:19.294555+0000","last_unstale":"2023-05-17T15:08:19.300387+0000","last_undegraded":"2023-05-17T15:08:19.300387+0000","last_fullsized":"2023-05-17T15:08:19.300387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277728+0000","last_change":"2023-05-17T15:08:18.906256+0000","last_active":"2023-05-17T15:08:19.277728+0000","last_peered":"2023-05-17T15:08:19.277728+0000","last_clean":"2023-05-17T15:08:19.277728+0000","last_became_active":"2023-05-17T15:08:18.905999+0000","last_became_peered":"2023-05-17T15:08:18.905999+0000","last_unstale":"2023-05-17T15:08:19.277728+0000","last_undegraded":"2023-05-17T15:08:19.277728+0000","last_fullsized":"2023-05-17T15:08:19.277728+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308640+0000","last_change":"2023-05-17T15:08:19.304015+0000","last_active":"2023-05-17T15:08:19.308640+0000","last_peered":"2023-05-17T15:08:19.308640+0000","last_clean":"2023-05-17T15:08:19.308640+0000","last_became_active":"2023-05-17T15:08:19.303152+0000","last_became_peered":"2023-05-17T15:08:19.303152+0000","last_unstale":"2023-05-17T15:08:19.308640+0000","last_undegraded":"2023-05-17T15:08:19.308640+0000","last_fullsized":"2023-05-17T15:08:19.308640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307112+0000","last_change":"2023-05-17T15:08:18.909953+0000","last_active":"2023-05-17T15:08:19.307112+0000","last_peered":"2023-05-17T15:08:19.307112+0000","last_clean":"2023-05-17T15:08:19.307112+0000","last_became_active":"2023-05-17T15:08:18.909651+0000","last_became_peered":"2023-05-17T15:08:18.909651+0000","last_unstale":"2023-05-17T15:08:19.307112+0000","last_undegraded":"2023-05-17T15:08:19.307112+0000","last_fullsized":"2023-05-17T15:08:19.307112+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.303801+0000","last_change":"2023-05-17T15:08:19.299732+0000","last_active":"2023-05-17T15:08:19.303801+0000","last_peered":"2023-05-17T15:08:19.303801+0000","last_clean":"2023-05-17T15:08:19.303801+0000","last_became_active":"2023-05-17T15:08:19.299395+0000","last_became_peered":"2023-05-17T15:08:19.299395+0000","last_unstale":"2023-05-17T15:08:19.303801+0000","last_undegraded":"2023-05-17T15:08:19.303801+0000","last_fullsized":"2023-05-17T15:08:19.303801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277274+0000","last_change":"2023-05-17T15:08:18.907734+0000","last_active":"2023-05-17T15:08:19.277274+0000","last_peered":"2023-05-17T15:08:19.277274+0000","last_clean":"2023-05-17T15:08:19.277274+0000","last_became_active":"2023-05-17T15:08:18.907160+0000","last_became_peered":"2023-05-17T15:08:18.907160+0000","last_unstale":"2023-05-17T15:08:19.277274+0000","last_undegraded":"2023-05-17T15:08:19.277274+0000","last_fullsized":"2023-05-17T15:08:19.277274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306935+0000","last_change":"2023-05-17T15:08:19.304825+0000","last_active":"2023-05-17T15:08:19.306935+0000","last_peered":"2023-05-17T15:08:19.306935+0000","last_clean":"2023-05-17T15:08:19.306935+0000","last_became_active":"2023-05-17T15:08:19.304548+0000","last_became_peered":"2023-05-17T15:08:19.304548+0000","last_unstale":"2023-05-17T15:08:19.306935+0000","last_undegraded":"2023-05-17T15:08:19.306935+0000","last_fullsized":"2023-05-17T15:08:19.306935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.296396+0000","last_change":"2023-05-17T15:08:18.911286+0000","last_active":"2023-05-17T15:08:19.296396+0000","last_peered":"2023-05-17T15:08:19.296396+0000","last_clean":"2023-05-17T15:08:19.296396+0000","last_became_active":"2023-05-17T15:08:18.911011+0000","last_became_peered":"2023-05-17T15:08:18.911011+0000","last_unstale":"2023-05-17T15:08:19.296396+0000","last_undegraded":"2023-05-17T15:08:19.296396+0000","last_fullsized":"2023-05-17T15:08:19.296396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307063+0000","last_change":"2023-05-17T15:08:19.302420+0000","last_active":"2023-05-17T15:08:19.307063+0000","last_peered":"2023-05-17T15:08:19.307063+0000","last_clean":"2023-05-17T15:08:19.307063+0000","last_became_active":"2023-05-17T15:08:19.302075+0000","last_became_peered":"2023-05-17T15:08:19.302075+0000","last_unstale":"2023-05-17T15:08:19.307063+0000","last_undegraded":"2023-05-17T15:08:19.307063+0000","last_fullsized":"2023-05-17T15:08:19.307063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.276881+0000","last_change":"2023-05-17T15:08:18.910917+0000","last_active":"2023-05-17T15:08:19.276881+0000","last_peered":"2023-05-17T15:08:19.276881+0000","last_clean":"2023-05-17T15:08:19.276881+0000","last_became_active":"2023-05-17T15:08:18.910568+0000","last_became_peered":"2023-05-17T15:08:18.910568+0000","last_unstale":"2023-05-17T15:08:19.276881+0000","last_undegraded":"2023-05-17T15:08:19.276881+0000","last_fullsized":"2023-05-17T15:08:19.276881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297991+0000","last_change":"2023-05-17T15:08:19.290494+0000","last_active":"2023-05-17T15:08:19.297991+0000","last_peered":"2023-05-17T15:08:19.297991+0000","last_clean":"2023-05-17T15:08:19.297991+0000","last_became_active":"2023-05-17T15:08:19.290150+0000","last_became_peered":"2023-05-17T15:08:19.290150+0000","last_unstale":"2023-05-17T15:08:19.297991+0000","last_undegraded":"2023-05-17T15:08:19.297991+0000","last_fullsized":"2023-05-17T15:08:19.297991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278343+0000","last_change":"2023-05-17T15:08:18.912622+0000","last_active":"2023-05-17T15:08:19.278343+0000","last_peered":"2023-05-17T15:08:19.278343+0000","last_clean":"2023-05-17T15:08:19.278343+0000","last_became_active":"2023-05-17T15:08:18.912374+0000","last_became_peered":"2023-05-17T15:08:18.912374+0000","last_unstale":"2023-05-17T15:08:19.278343+0000","last_undegraded":"2023-05-17T15:08:19.278343+0000","last_fullsized":"2023-05-17T15:08:19.278343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309066+0000","last_change":"2023-05-17T15:08:19.293658+0000","last_active":"2023-05-17T15:08:19.309066+0000","last_peered":"2023-05-17T15:08:19.309066+0000","last_clean":"2023-05-17T15:08:19.309066+0000","last_became_active":"2023-05-17T15:08:19.293155+0000","last_became_peered":"2023-05-17T15:08:19.293155+0000","last_unstale":"2023-05-17T15:08:19.309066+0000","last_undegraded":"2023-05-17T15:08:19.309066+0000","last_fullsized":"2023-05-17T15:08:19.309066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.706110+0000","last_change":"2023-05-17T15:08:18.904182+0000","last_active":"2023-05-17T15:08:19.706110+0000","last_peered":"2023-05-17T15:08:19.706110+0000","last_clean":"2023-05-17T15:08:19.706110+0000","last_became_active":"2023-05-17T15:08:18.903886+0000","last_became_peered":"2023-05-17T15:08:18.903886+0000","last_unstale":"2023-05-17T15:08:19.706110+0000","last_undegraded":"2023-05-17T15:08:19.706110+0000","last_fullsized":"2023-05-17T15:08:19.706110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306633+0000","last_change":"2023-05-17T15:08:19.297079+0000","last_active":"2023-05-17T15:08:19.306633+0000","last_peered":"2023-05-17T15:08:19.306633+0000","last_clean":"2023-05-17T15:08:19.306633+0000","last_became_active":"2023-05-17T15:08:19.296600+0000","last_became_peered":"2023-05-17T15:08:19.296600+0000","last_unstale":"2023-05-17T15:08:19.306633+0000","last_undegraded":"2023-05-17T15:08:19.306633+0000","last_fullsized":"2023-05-17T15:08:19.306633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.275785+0000","last_change":"2023-05-17T15:08:18.899689+0000","last_active":"2023-05-17T15:08:19.275785+0000","last_peered":"2023-05-17T15:08:19.275785+0000","last_clean":"2023-05-17T15:08:19.275785+0000","last_became_active":"2023-05-17T15:08:18.899378+0000","last_became_peered":"2023-05-17T15:08:18.899378+0000","last_unstale":"2023-05-17T15:08:19.275785+0000","last_undegraded":"2023-05-17T15:08:19.275785+0000","last_fullsized":"2023-05-17T15:08:19.275785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307070+0000","last_change":"2023-05-17T15:08:19.302629+0000","last_active":"2023-05-17T15:08:19.307070+0000","last_peered":"2023-05-17T15:08:19.307070+0000","last_clean":"2023-05-17T15:08:19.307070+0000","last_became_active":"2023-05-17T15:08:19.302220+0000","last_became_peered":"2023-05-17T15:08:19.302220+0000","last_unstale":"2023-05-17T15:08:19.307070+0000","last_undegraded":"2023-05-17T15:08:19.307070+0000","last_fullsized":"2023-05-17T15:08:19.307070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278451+0000","last_change":"2023-05-17T15:08:18.904429+0000","last_active":"2023-05-17T15:08:19.278451+0000","last_peered":"2023-05-17T15:08:19.278451+0000","last_clean":"2023-05-17T15:08:19.278451+0000","last_became_active":"2023-05-17T15:08:18.904153+0000","last_became_peered":"2023-05-17T15:08:18.904153+0000","last_unstale":"2023-05-17T15:08:19.278451+0000","last_undegraded":"2023-05-17T15:08:19.278451+0000","last_fullsized":"2023-05-17T15:08:19.278451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290051+0000","last_change":"2023-05-17T15:08:19.287295+0000","last_active":"2023-05-17T15:08:19.290051+0000","last_peered":"2023-05-17T15:08:19.290051+0000","last_clean":"2023-05-17T15:08:19.290051+0000","last_became_active":"2023-05-17T15:08:19.286997+0000","last_became_peered":"2023-05-17T15:08:19.286997+0000","last_unstale":"2023-05-17T15:08:19.290051+0000","last_undegraded":"2023-05-17T15:08:19.290051+0000","last_fullsized":"2023-05-17T15:08:19.290051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277462+0000","last_change":"2023-05-17T15:08:18.902320+0000","last_active":"2023-05-17T15:08:19.277462+0000","last_peered":"2023-05-17T15:08:19.277462+0000","last_clean":"2023-05-17T15:08:19.277462+0000","last_became_active":"2023-05-17T15:08:18.902016+0000","last_became_peered":"2023-05-17T15:08:18.902016+0000","last_unstale":"2023-05-17T15:08:19.277462+0000","last_undegraded":"2023-05-17T15:08:19.277462+0000","last_fullsized":"2023-05-17T15:08:19.277462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308791+0000","last_change":"2023-05-17T15:08:19.291245+0000","last_active":"2023-05-17T15:08:19.308791+0000","last_peered":"2023-05-17T15:08:19.308791+0000","last_clean":"2023-05-17T15:08:19.308791+0000","last_became_active":"2023-05-17T15:08:19.290745+0000","last_became_peered":"2023-05-17T15:08:19.290745+0000","last_unstale":"2023-05-17T15:08:19.308791+0000","last_undegraded":"2023-05-17T15:08:19.308791+0000","last_fullsized":"2023-05-17T15:08:19.308791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298234+0000","last_change":"2023-05-17T15:08:18.908477+0000","last_active":"2023-05-17T15:08:19.298234+0000","last_peered":"2023-05-17T15:08:19.298234+0000","last_clean":"2023-05-17T15:08:19.298234+0000","last_became_active":"2023-05-17T15:08:18.908158+0000","last_became_peered":"2023-05-17T15:08:18.908158+0000","last_unstale":"2023-05-17T15:08:19.298234+0000","last_undegraded":"2023-05-17T15:08:19.298234+0000","last_fullsized":"2023-05-17T15:08:19.298234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307021+0000","last_change":"2023-05-17T15:08:19.301901+0000","last_active":"2023-05-17T15:08:19.307021+0000","last_peered":"2023-05-17T15:08:19.307021+0000","last_clean":"2023-05-17T15:08:19.307021+0000","last_became_active":"2023-05-17T15:08:19.301540+0000","last_became_peered":"2023-05-17T15:08:19.301540+0000","last_unstale":"2023-05-17T15:08:19.307021+0000","last_undegraded":"2023-05-17T15:08:19.307021+0000","last_fullsized":"2023-05-17T15:08:19.307021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.279401+0000","last_change":"2023-05-17T15:08:18.912608+0000","last_active":"2023-05-17T15:08:19.279401+0000","last_peered":"2023-05-17T15:08:19.279401+0000","last_clean":"2023-05-17T15:08:19.279401+0000","last_became_active":"2023-05-17T15:08:18.912316+0000","last_became_peered":"2023-05-17T15:08:18.912316+0000","last_unstale":"2023-05-17T15:08:19.279401+0000","last_undegraded":"2023-05-17T15:08:19.279401+0000","last_fullsized":"2023-05-17T15:08:19.279401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.316027+0000","last_change":"2023-05-17T15:08:19.310820+0000","last_active":"2023-05-17T15:08:19.316027+0000","last_peered":"2023-05-17T15:08:19.316027+0000","last_clean":"2023-05-17T15:08:19.316027+0000","last_became_active":"2023-05-17T15:08:19.310087+0000","last_became_peered":"2023-05-17T15:08:19.310087+0000","last_unstale":"2023-05-17T15:08:19.316027+0000","last_undegraded":"2023-05-17T15:08:19.316027+0000","last_fullsized":"2023-05-17T15:08:19.316027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278360+0000","last_change":"2023-05-17T15:08:18.896021+0000","last_active":"2023-05-17T15:08:19.278360+0000","last_peered":"2023-05-17T15:08:19.278360+0000","last_clean":"2023-05-17T15:08:19.278360+0000","last_became_active":"2023-05-17T15:08:18.895723+0000","last_became_peered":"2023-05-17T15:08:18.895723+0000","last_unstale":"2023-05-17T15:08:19.278360+0000","last_undegraded":"2023-05-17T15:08:19.278360+0000","last_fullsized":"2023-05-17T15:08:19.278360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.291520+0000","last_change":"2023-05-17T15:08:19.288752+0000","last_active":"2023-05-17T15:08:19.291520+0000","last_peered":"2023-05-17T15:08:19.291520+0000","last_clean":"2023-05-17T15:08:19.291520+0000","last_became_active":"2023-05-17T15:08:19.286940+0000","last_became_peered":"2023-05-17T15:08:19.286940+0000","last_unstale":"2023-05-17T15:08:19.291520+0000","last_undegraded":"2023-05-17T15:08:19.291520+0000","last_fullsized":"2023-05-17T15:08:19.291520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290042+0000","last_change":"2023-05-17T15:08:18.907691+0000","last_active":"2023-05-17T15:08:19.290042+0000","last_peered":"2023-05-17T15:08:19.290042+0000","last_clean":"2023-05-17T15:08:19.290042+0000","last_became_active":"2023-05-17T15:08:18.907412+0000","last_became_peered":"2023-05-17T15:08:18.907412+0000","last_unstale":"2023-05-17T15:08:19.290042+0000","last_undegraded":"2023-05-17T15:08:19.290042+0000","last_fullsized":"2023-05-17T15:08:19.290042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309111+0000","last_change":"2023-05-17T15:08:19.294895+0000","last_active":"2023-05-17T15:08:19.309111+0000","last_peered":"2023-05-17T15:08:19.309111+0000","last_clean":"2023-05-17T15:08:19.309111+0000","last_became_active":"2023-05-17T15:08:19.294635+0000","last_became_peered":"2023-05-17T15:08:19.294635+0000","last_unstale":"2023-05-17T15:08:19.309111+0000","last_undegraded":"2023-05-17T15:08:19.309111+0000","last_fullsized":"2023-05-17T15:08:19.309111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.294151+0000","last_change":"2023-05-17T15:08:18.905494+0000","last_active":"2023-05-17T15:08:19.294151+0000","last_peered":"2023-05-17T15:08:19.294151+0000","last_clean":"2023-05-17T15:08:19.294151+0000","last_became_active":"2023-05-17T15:08:18.905188+0000","last_became_peered":"2023-05-17T15:08:18.905188+0000","last_unstale":"2023-05-17T15:08:19.294151+0000","last_undegraded":"2023-05-17T15:08:19.294151+0000","last_fullsized":"2023-05-17T15:08:19.294151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.288185+0000","last_change":"2023-05-17T15:08:19.286191+0000","last_active":"2023-05-17T15:08:19.288185+0000","last_peered":"2023-05-17T15:08:19.288185+0000","last_clean":"2023-05-17T15:08:19.288185+0000","last_became_active":"2023-05-17T15:08:19.285940+0000","last_became_peered":"2023-05-17T15:08:19.285940+0000","last_unstale":"2023-05-17T15:08:19.288185+0000","last_undegraded":"2023-05-17T15:08:19.288185+0000","last_fullsized":"2023-05-17T15:08:19.288185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302149+0000","last_change":"2023-05-17T15:08:18.896212+0000","last_active":"2023-05-17T15:08:19.302149+0000","last_peered":"2023-05-17T15:08:19.302149+0000","last_clean":"2023-05-17T15:08:19.302149+0000","last_became_active":"2023-05-17T15:08:18.895083+0000","last_became_peered":"2023-05-17T15:08:18.895083+0000","last_unstale":"2023-05-17T15:08:19.302149+0000","last_undegraded":"2023-05-17T15:08:19.302149+0000","last_fullsized":"2023-05-17T15:08:19.302149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308879+0000","last_change":"2023-05-17T15:08:19.305429+0000","last_active":"2023-05-17T15:08:19.308879+0000","last_peered":"2023-05-17T15:08:19.308879+0000","last_clean":"2023-05-17T15:08:19.308879+0000","last_became_active":"2023-05-17T15:08:19.305098+0000","last_became_peered":"2023-05-17T15:08:19.305098+0000","last_unstale":"2023-05-17T15:08:19.308879+0000","last_undegraded":"2023-05-17T15:08:19.308879+0000","last_fullsized":"2023-05-17T15:08:19.308879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277418+0000","last_change":"2023-05-17T15:08:18.897185+0000","last_active":"2023-05-17T15:08:19.277418+0000","last_peered":"2023-05-17T15:08:19.277418+0000","last_clean":"2023-05-17T15:08:19.277418+0000","last_became_active":"2023-05-17T15:08:18.896913+0000","last_became_peered":"2023-05-17T15:08:18.896913+0000","last_unstale":"2023-05-17T15:08:19.277418+0000","last_undegraded":"2023-05-17T15:08:19.277418+0000","last_fullsized":"2023-05-17T15:08:19.277418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.289902+0000","last_change":"2023-05-17T15:08:19.286233+0000","last_active":"2023-05-17T15:08:19.289902+0000","last_peered":"2023-05-17T15:08:19.289902+0000","last_clean":"2023-05-17T15:08:19.289902+0000","last_became_active":"2023-05-17T15:08:19.285847+0000","last_became_peered":"2023-05-17T15:08:19.285847+0000","last_unstale":"2023-05-17T15:08:19.289902+0000","last_undegraded":"2023-05-17T15:08:19.289902+0000","last_fullsized":"2023-05-17T15:08:19.289902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277564+0000","last_change":"2023-05-17T15:08:18.899682+0000","last_active":"2023-05-17T15:08:19.277564+0000","last_peered":"2023-05-17T15:08:19.277564+0000","last_clean":"2023-05-17T15:08:19.277564+0000","last_became_active":"2023-05-17T15:08:18.899390+0000","last_became_peered":"2023-05-17T15:08:18.899390+0000","last_unstale":"2023-05-17T15:08:19.277564+0000","last_undegraded":"2023-05-17T15:08:19.277564+0000","last_fullsized":"2023-05-17T15:08:19.277564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298037+0000","last_change":"2023-05-17T15:08:19.291445+0000","last_active":"2023-05-17T15:08:19.298037+0000","last_peered":"2023-05-17T15:08:19.298037+0000","last_clean":"2023-05-17T15:08:19.298037+0000","last_became_active":"2023-05-17T15:08:19.291178+0000","last_became_peered":"2023-05-17T15:08:19.291178+0000","last_unstale":"2023-05-17T15:08:19.298037+0000","last_undegraded":"2023-05-17T15:08:19.298037+0000","last_fullsized":"2023-05-17T15:08:19.298037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277374+0000","last_change":"2023-05-17T15:08:18.908919+0000","last_active":"2023-05-17T15:08:19.277374+0000","last_peered":"2023-05-17T15:08:19.277374+0000","last_clean":"2023-05-17T15:08:19.277374+0000","last_became_active":"2023-05-17T15:08:18.907484+0000","last_became_peered":"2023-05-17T15:08:18.907484+0000","last_unstale":"2023-05-17T15:08:19.277374+0000","last_undegraded":"2023-05-17T15:08:19.277374+0000","last_fullsized":"2023-05-17T15:08:19.277374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298833+0000","last_change":"2023-05-17T15:08:19.293191+0000","last_active":"2023-05-17T15:08:19.298833+0000","last_peered":"2023-05-17T15:08:19.298833+0000","last_clean":"2023-05-17T15:08:19.298833+0000","last_became_active":"2023-05-17T15:08:19.292536+0000","last_became_peered":"2023-05-17T15:08:19.292536+0000","last_unstale":"2023-05-17T15:08:19.298833+0000","last_undegraded":"2023-05-17T15:08:19.298833+0000","last_fullsized":"2023-05-17T15:08:19.298833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277081+0000","last_change":"2023-05-17T15:08:18.902684+0000","last_active":"2023-05-17T15:08:19.277081+0000","last_peered":"2023-05-17T15:08:19.277081+0000","last_clean":"2023-05-17T15:08:19.277081+0000","last_became_active":"2023-05-17T15:08:18.902022+0000","last_became_peered":"2023-05-17T15:08:18.902022+0000","last_unstale":"2023-05-17T15:08:19.277081+0000","last_undegraded":"2023-05-17T15:08:19.277081+0000","last_fullsized":"2023-05-17T15:08:19.277081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297877+0000","last_change":"2023-05-17T15:08:19.291581+0000","last_active":"2023-05-17T15:08:19.297877+0000","last_peered":"2023-05-17T15:08:19.297877+0000","last_clean":"2023-05-17T15:08:19.297877+0000","last_became_active":"2023-05-17T15:08:19.290760+0000","last_became_peered":"2023-05-17T15:08:19.290760+0000","last_unstale":"2023-05-17T15:08:19.297877+0000","last_undegraded":"2023-05-17T15:08:19.297877+0000","last_fullsized":"2023-05-17T15:08:19.297877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277025+0000","last_change":"2023-05-17T15:08:18.906313+0000","last_active":"2023-05-17T15:08:19.277025+0000","last_peered":"2023-05-17T15:08:19.277025+0000","last_clean":"2023-05-17T15:08:19.277025+0000","last_became_active":"2023-05-17T15:08:18.906018+0000","last_became_peered":"2023-05-17T15:08:18.906018+0000","last_unstale":"2023-05-17T15:08:19.277025+0000","last_undegraded":"2023-05-17T15:08:19.277025+0000","last_fullsized":"2023-05-17T15:08:19.277025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.292498+0000","last_change":"2023-05-17T15:08:19.289245+0000","last_active":"2023-05-17T15:08:19.292498+0000","last_peered":"2023-05-17T15:08:19.292498+0000","last_clean":"2023-05-17T15:08:19.292498+0000","last_became_active":"2023-05-17T15:08:19.288765+0000","last_became_peered":"2023-05-17T15:08:19.288765+0000","last_unstale":"2023-05-17T15:08:19.292498+0000","last_undegraded":"2023-05-17T15:08:19.292498+0000","last_fullsized":"2023-05-17T15:08:19.292498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298650+0000","last_change":"2023-05-17T15:08:18.912684+0000","last_active":"2023-05-17T15:08:19.298650+0000","last_peered":"2023-05-17T15:08:19.298650+0000","last_clean":"2023-05-17T15:08:19.298650+0000","last_became_active":"2023-05-17T15:08:18.912441+0000","last_became_peered":"2023-05-17T15:08:18.912441+0000","last_unstale":"2023-05-17T15:08:19.298650+0000","last_undegraded":"2023-05-17T15:08:19.298650+0000","last_fullsized":"2023-05-17T15:08:19.298650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298263+0000","last_change":"2023-05-17T15:08:19.296905+0000","last_active":"2023-05-17T15:08:19.298263+0000","last_peered":"2023-05-17T15:08:19.298263+0000","last_clean":"2023-05-17T15:08:19.298263+0000","last_became_active":"2023-05-17T15:08:19.296577+0000","last_became_peered":"2023-05-17T15:08:19.296577+0000","last_unstale":"2023-05-17T15:08:19.298263+0000","last_undegraded":"2023-05-17T15:08:19.298263+0000","last_fullsized":"2023-05-17T15:08:19.298263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282523+0000","last_change":"2023-05-17T15:08:18.912324+0000","last_active":"2023-05-17T15:08:19.282523+0000","last_peered":"2023-05-17T15:08:19.282523+0000","last_clean":"2023-05-17T15:08:19.282523+0000","last_became_active":"2023-05-17T15:08:18.911979+0000","last_became_peered":"2023-05-17T15:08:18.911979+0000","last_unstale":"2023-05-17T15:08:19.282523+0000","last_undegraded":"2023-05-17T15:08:19.282523+0000","last_fullsized":"2023-05-17T15:08:19.282523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.304704+0000","last_change":"2023-05-17T15:08:19.298279+0000","last_active":"2023-05-17T15:08:19.304704+0000","last_peered":"2023-05-17T15:08:19.304704+0000","last_clean":"2023-05-17T15:08:19.304704+0000","last_became_active":"2023-05-17T15:08:19.297839+0000","last_became_peered":"2023-05-17T15:08:19.297839+0000","last_unstale":"2023-05-17T15:08:19.304704+0000","last_undegraded":"2023-05-17T15:08:19.304704+0000","last_fullsized":"2023-05-17T15:08:19.304704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309923+0000","last_change":"2023-05-17T15:08:18.913413+0000","last_active":"2023-05-17T15:08:19.309923+0000","last_peered":"2023-05-17T15:08:19.309923+0000","last_clean":"2023-05-17T15:08:19.309923+0000","last_became_active":"2023-05-17T15:08:18.912425+0000","last_became_peered":"2023-05-17T15:08:18.912425+0000","last_unstale":"2023-05-17T15:08:19.309923+0000","last_undegraded":"2023-05-17T15:08:19.309923+0000","last_fullsized":"2023-05-17T15:08:19.309923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308870+0000","last_change":"2023-05-17T15:08:19.290916+0000","last_active":"2023-05-17T15:08:19.308870+0000","last_peered":"2023-05-17T15:08:19.308870+0000","last_clean":"2023-05-17T15:08:19.308870+0000","last_became_active":"2023-05-17T15:08:19.290590+0000","last_became_peered":"2023-05-17T15:08:19.290590+0000","last_unstale":"2023-05-17T15:08:19.308870+0000","last_undegraded":"2023-05-17T15:08:19.308870+0000","last_fullsized":"2023-05-17T15:08:19.308870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.299328+0000","last_change":"2023-05-17T15:08:18.903216+0000","last_active":"2023-05-17T15:08:19.299328+0000","last_peered":"2023-05-17T15:08:19.299328+0000","last_clean":"2023-05-17T15:08:19.299328+0000","last_became_active":"2023-05-17T15:08:18.902750+0000","last_became_peered":"2023-05-17T15:08:18.902750+0000","last_unstale":"2023-05-17T15:08:19.299328+0000","last_undegraded":"2023-05-17T15:08:19.299328+0000","last_fullsized":"2023-05-17T15:08:19.299328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309021+0000","last_change":"2023-05-17T15:08:19.293182+0000","last_active":"2023-05-17T15:08:19.309021+0000","last_peered":"2023-05-17T15:08:19.309021+0000","last_clean":"2023-05-17T15:08:19.309021+0000","last_became_active":"2023-05-17T15:08:19.292862+0000","last_became_peered":"2023-05-17T15:08:19.292862+0000","last_unstale":"2023-05-17T15:08:19.309021+0000","last_undegraded":"2023-05-17T15:08:19.309021+0000","last_fullsized":"2023-05-17T15:08:19.309021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306114+0000","last_change":"2023-05-17T15:08:18.910396+0000","last_active":"2023-05-17T15:08:19.306114+0000","last_peered":"2023-05-17T15:08:19.306114+0000","last_clean":"2023-05-17T15:08:19.306114+0000","last_became_active":"2023-05-17T15:08:18.910151+0000","last_became_peered":"2023-05-17T15:08:18.910151+0000","last_unstale":"2023-05-17T15:08:19.306114+0000","last_undegraded":"2023-05-17T15:08:19.306114+0000","last_fullsized":"2023-05-17T15:08:19.306114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306699+0000","last_change":"2023-05-17T15:08:19.297484+0000","last_active":"2023-05-17T15:08:19.306699+0000","last_peered":"2023-05-17T15:08:19.306699+0000","last_clean":"2023-05-17T15:08:19.306699+0000","last_became_active":"2023-05-17T15:08:19.296951+0000","last_became_peered":"2023-05-17T15:08:19.296951+0000","last_unstale":"2023-05-17T15:08:19.306699+0000","last_undegraded":"2023-05-17T15:08:19.306699+0000","last_fullsized":"2023-05-17T15:08:19.306699+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.286927+0000","last_change":"2023-05-17T15:08:18.902500+0000","last_active":"2023-05-17T15:08:19.286927+0000","last_peered":"2023-05-17T15:08:19.286927+0000","last_clean":"2023-05-17T15:08:19.286927+0000","last_became_active":"2023-05-17T15:08:18.902198+0000","last_became_peered":"2023-05-17T15:08:18.902198+0000","last_unstale":"2023-05-17T15:08:19.286927+0000","last_undegraded":"2023-05-17T15:08:19.286927+0000","last_fullsized":"2023-05-17T15:08:19.286927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293643+0000","last_change":"2023-05-17T15:08:19.291015+0000","last_active":"2023-05-17T15:08:19.293643+0000","last_peered":"2023-05-17T15:08:19.293643+0000","last_clean":"2023-05-17T15:08:19.293643+0000","last_became_active":"2023-05-17T15:08:19.290703+0000","last_became_peered":"2023-05-17T15:08:19.290703+0000","last_unstale":"2023-05-17T15:08:19.293643+0000","last_undegraded":"2023-05-17T15:08:19.293643+0000","last_fullsized":"2023-05-17T15:08:19.293643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.296724+0000","last_change":"2023-05-17T15:08:18.911447+0000","last_active":"2023-05-17T15:08:19.296724+0000","last_peered":"2023-05-17T15:08:19.296724+0000","last_clean":"2023-05-17T15:08:19.296724+0000","last_became_active":"2023-05-17T15:08:18.911120+0000","last_became_peered":"2023-05-17T15:08:18.911120+0000","last_unstale":"2023-05-17T15:08:19.296724+0000","last_undegraded":"2023-05-17T15:08:19.296724+0000","last_fullsized":"2023-05-17T15:08:19.296724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.303000+0000","last_change":"2023-05-17T15:08:19.300008+0000","last_active":"2023-05-17T15:08:19.303000+0000","last_peered":"2023-05-17T15:08:19.303000+0000","last_clean":"2023-05-17T15:08:19.303000+0000","last_became_active":"2023-05-17T15:08:19.299709+0000","last_became_peered":"2023-05-17T15:08:19.299709+0000","last_unstale":"2023-05-17T15:08:19.303000+0000","last_undegraded":"2023-05-17T15:08:19.303000+0000","last_fullsized":"2023-05-17T15:08:19.303000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297088+0000","last_change":"2023-05-17T15:08:18.908352+0000","last_active":"2023-05-17T15:08:19.297088+0000","last_peered":"2023-05-17T15:08:19.297088+0000","last_clean":"2023-05-17T15:08:19.297088+0000","last_became_active":"2023-05-17T15:08:18.908040+0000","last_became_peered":"2023-05-17T15:08:18.908040+0000","last_unstale":"2023-05-17T15:08:19.297088+0000","last_undegraded":"2023-05-17T15:08:19.297088+0000","last_fullsized":"2023-05-17T15:08:19.297088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298180+0000","last_change":"2023-05-17T15:08:19.293286+0000","last_active":"2023-05-17T15:08:19.298180+0000","last_peered":"2023-05-17T15:08:19.298180+0000","last_clean":"2023-05-17T15:08:19.298180+0000","last_became_active":"2023-05-17T15:08:19.293082+0000","last_became_peered":"2023-05-17T15:08:19.293082+0000","last_unstale":"2023-05-17T15:08:19.298180+0000","last_undegraded":"2023-05-17T15:08:19.298180+0000","last_fullsized":"2023-05-17T15:08:19.298180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.303936+0000","last_change":"2023-05-17T15:08:18.905162+0000","last_active":"2023-05-17T15:08:19.303936+0000","last_peered":"2023-05-17T15:08:19.303936+0000","last_clean":"2023-05-17T15:08:19.303936+0000","last_became_active":"2023-05-17T15:08:18.904829+0000","last_became_peered":"2023-05-17T15:08:18.904829+0000","last_unstale":"2023-05-17T15:08:19.303936+0000","last_undegraded":"2023-05-17T15:08:19.303936+0000","last_fullsized":"2023-05-17T15:08:19.303936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.289987+0000","last_change":"2023-05-17T15:08:19.287359+0000","last_active":"2023-05-17T15:08:19.289987+0000","last_peered":"2023-05-17T15:08:19.289987+0000","last_clean":"2023-05-17T15:08:19.289987+0000","last_became_active":"2023-05-17T15:08:19.286801+0000","last_became_peered":"2023-05-17T15:08:19.286801+0000","last_unstale":"2023-05-17T15:08:19.289987+0000","last_undegraded":"2023-05-17T15:08:19.289987+0000","last_fullsized":"2023-05-17T15:08:19.289987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.294616+0000","last_change":"2023-05-17T15:08:18.904328+0000","last_active":"2023-05-17T15:08:19.294616+0000","last_peered":"2023-05-17T15:08:19.294616+0000","last_clean":"2023-05-17T15:08:19.294616+0000","last_became_active":"2023-05-17T15:08:18.904058+0000","last_became_peered":"2023-05-17T15:08:18.904058+0000","last_unstale":"2023-05-17T15:08:19.294616+0000","last_undegraded":"2023-05-17T15:08:19.294616+0000","last_fullsized":"2023-05-17T15:08:19.294616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306333+0000","last_change":"2023-05-17T15:08:19.296943+0000","last_active":"2023-05-17T15:08:19.306333+0000","last_peered":"2023-05-17T15:08:19.306333+0000","last_clean":"2023-05-17T15:08:19.306333+0000","last_became_active":"2023-05-17T15:08:19.296529+0000","last_became_peered":"2023-05-17T15:08:19.296529+0000","last_unstale":"2023-05-17T15:08:19.306333+0000","last_undegraded":"2023-05-17T15:08:19.306333+0000","last_fullsized":"2023-05-17T15:08:19.306333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.275990+0000","last_change":"2023-05-17T15:08:18.895653+0000","last_active":"2023-05-17T15:08:19.275990+0000","last_peered":"2023-05-17T15:08:19.275990+0000","last_clean":"2023-05-17T15:08:19.275990+0000","last_became_active":"2023-05-17T15:08:18.894704+0000","last_became_peered":"2023-05-17T15:08:18.894704+0000","last_unstale":"2023-05-17T15:08:19.275990+0000","last_undegraded":"2023-05-17T15:08:19.275990+0000","last_fullsized":"2023-05-17T15:08:19.275990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293680+0000","last_change":"2023-05-17T15:08:19.290083+0000","last_active":"2023-05-17T15:08:19.293680+0000","last_peered":"2023-05-17T15:08:19.293680+0000","last_clean":"2023-05-17T15:08:19.293680+0000","last_became_active":"2023-05-17T15:08:19.289698+0000","last_became_peered":"2023-05-17T15:08:19.289698+0000","last_unstale":"2023-05-17T15:08:19.293680+0000","last_undegraded":"2023-05-17T15:08:19.293680+0000","last_fullsized":"2023-05-17T15:08:19.293680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282224+0000","last_change":"2023-05-17T15:08:18.903034+0000","last_active":"2023-05-17T15:08:19.282224+0000","last_peered":"2023-05-17T15:08:19.282224+0000","last_clean":"2023-05-17T15:08:19.282224+0000","last_became_active":"2023-05-17T15:08:18.901993+0000","last_became_peered":"2023-05-17T15:08:18.901993+0000","last_unstale":"2023-05-17T15:08:19.282224+0000","last_undegraded":"2023-05-17T15:08:19.282224+0000","last_fullsized":"2023-05-17T15:08:19.282224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.291484+0000","last_change":"2023-05-17T15:08:19.287664+0000","last_active":"2023-05-17T15:08:19.291484+0000","last_peered":"2023-05-17T15:08:19.291484+0000","last_clean":"2023-05-17T15:08:19.291484+0000","last_became_active":"2023-05-17T15:08:19.286887+0000","last_became_peered":"2023-05-17T15:08:19.286887+0000","last_unstale":"2023-05-17T15:08:19.291484+0000","last_undegraded":"2023-05-17T15:08:19.291484+0000","last_fullsized":"2023-05-17T15:08:19.291484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297964+0000","last_change":"2023-05-17T15:08:18.911966+0000","last_active":"2023-05-17T15:08:19.297964+0000","last_peered":"2023-05-17T15:08:19.297964+0000","last_clean":"2023-05-17T15:08:19.297964+0000","last_became_active":"2023-05-17T15:08:18.911688+0000","last_became_peered":"2023-05-17T15:08:18.911688+0000","last_unstale":"2023-05-17T15:08:19.297964+0000","last_undegraded":"2023-05-17T15:08:19.297964+0000","last_fullsized":"2023-05-17T15:08:19.297964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309224+0000","last_change":"2023-05-17T15:08:19.298269+0000","last_active":"2023-05-17T15:08:19.309224+0000","last_peered":"2023-05-17T15:08:19.309224+0000","last_clean":"2023-05-17T15:08:19.309224+0000","last_became_active":"2023-05-17T15:08:19.298002+0000","last_became_peered":"2023-05-17T15:08:19.298002+0000","last_unstale":"2023-05-17T15:08:19.309224+0000","last_undegraded":"2023-05-17T15:08:19.309224+0000","last_fullsized":"2023-05-17T15:08:19.309224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277496+0000","last_change":"2023-05-17T15:08:18.905571+0000","last_active":"2023-05-17T15:08:19.277496+0000","last_peered":"2023-05-17T15:08:19.277496+0000","last_clean":"2023-05-17T15:08:19.277496+0000","last_became_active":"2023-05-17T15:08:18.905052+0000","last_became_peered":"2023-05-17T15:08:18.905052+0000","last_unstale":"2023-05-17T15:08:19.277496+0000","last_undegraded":"2023-05-17T15:08:19.277496+0000","last_fullsized":"2023-05-17T15:08:19.277496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298022+0000","last_change":"2023-05-17T15:08:19.291411+0000","last_active":"2023-05-17T15:08:19.298022+0000","last_peered":"2023-05-17T15:08:19.298022+0000","last_clean":"2023-05-17T15:08:19.298022+0000","last_became_active":"2023-05-17T15:08:19.291171+0000","last_became_peered":"2023-05-17T15:08:19.291171+0000","last_unstale":"2023-05-17T15:08:19.298022+0000","last_undegraded":"2023-05-17T15:08:19.298022+0000","last_fullsized":"2023-05-17T15:08:19.298022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277192+0000","last_change":"2023-05-17T15:08:18.902853+0000","last_active":"2023-05-17T15:08:19.277192+0000","last_peered":"2023-05-17T15:08:19.277192+0000","last_clean":"2023-05-17T15:08:19.277192+0000","last_became_active":"2023-05-17T15:08:18.902447+0000","last_became_peered":"2023-05-17T15:08:18.902447+0000","last_unstale":"2023-05-17T15:08:19.277192+0000","last_undegraded":"2023-05-17T15:08:19.277192+0000","last_fullsized":"2023-05-17T15:08:19.277192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302838+0000","last_change":"2023-05-17T15:08:19.297573+0000","last_active":"2023-05-17T15:08:19.302838+0000","last_peered":"2023-05-17T15:08:19.302838+0000","last_clean":"2023-05-17T15:08:19.302838+0000","last_became_active":"2023-05-17T15:08:19.297269+0000","last_became_peered":"2023-05-17T15:08:19.297269+0000","last_unstale":"2023-05-17T15:08:19.302838+0000","last_undegraded":"2023-05-17T15:08:19.302838+0000","last_fullsized":"2023-05-17T15:08:19.302838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.281320+0000","last_change":"2023-05-17T15:08:18.896413+0000","last_active":"2023-05-17T15:08:19.281320+0000","last_peered":"2023-05-17T15:08:19.281320+0000","last_clean":"2023-05-17T15:08:19.281320+0000","last_became_active":"2023-05-17T15:08:18.896113+0000","last_became_peered":"2023-05-17T15:08:18.896113+0000","last_unstale":"2023-05-17T15:08:19.281320+0000","last_undegraded":"2023-05-17T15:08:19.281320+0000","last_fullsized":"2023-05-17T15:08:19.281320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.313638+0000","last_change":"2023-05-17T15:08:19.310595+0000","last_active":"2023-05-17T15:08:19.313638+0000","last_peered":"2023-05-17T15:08:19.313638+0000","last_clean":"2023-05-17T15:08:19.313638+0000","last_became_active":"2023-05-17T15:08:19.310327+0000","last_became_peered":"2023-05-17T15:08:19.310327+0000","last_unstale":"2023-05-17T15:08:19.313638+0000","last_undegraded":"2023-05-17T15:08:19.313638+0000","last_fullsized":"2023-05-17T15:08:19.313638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302024+0000","last_change":"2023-05-17T15:08:18.903669+0000","last_active":"2023-05-17T15:08:19.302024+0000","last_peered":"2023-05-17T15:08:19.302024+0000","last_clean":"2023-05-17T15:08:19.302024+0000","last_became_active":"2023-05-17T15:08:18.903362+0000","last_became_peered":"2023-05-17T15:08:18.903362+0000","last_unstale":"2023-05-17T15:08:19.302024+0000","last_undegraded":"2023-05-17T15:08:19.302024+0000","last_fullsized":"2023-05-17T15:08:19.302024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282069+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:19.282069+0000","last_peered":"2023-05-17T15:08:19.282069+0000","last_clean":"2023-05-17T15:08:19.282069+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:19.282069+0000","last_undegraded":"2023-05-17T15:08:19.282069+0000","last_fullsized":"2023-05-17T15:08:19.282069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298861+0000","last_change":"2023-05-17T15:08:19.293362+0000","last_active":"2023-05-17T15:08:19.298861+0000","last_peered":"2023-05-17T15:08:19.298861+0000","last_clean":"2023-05-17T15:08:19.298861+0000","last_became_active":"2023-05-17T15:08:19.292870+0000","last_became_peered":"2023-05-17T15:08:19.292870+0000","last_unstale":"2023-05-17T15:08:19.298861+0000","last_undegraded":"2023-05-17T15:08:19.298861+0000","last_fullsized":"2023-05-17T15:08:19.298861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.275800+0000","last_change":"2023-05-17T15:08:18.905697+0000","last_active":"2023-05-17T15:08:19.275800+0000","last_peered":"2023-05-17T15:08:19.275800+0000","last_clean":"2023-05-17T15:08:19.275800+0000","last_became_active":"2023-05-17T15:08:18.905379+0000","last_became_peered":"2023-05-17T15:08:18.905379+0000","last_unstale":"2023-05-17T15:08:19.275800+0000","last_undegraded":"2023-05-17T15:08:19.275800+0000","last_fullsized":"2023-05-17T15:08:19.275800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.287093+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:19.287093+0000","last_peered":"2023-05-17T15:08:19.287093+0000","last_clean":"2023-05-17T15:08:19.287093+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:19.287093+0000","last_undegraded":"2023-05-17T15:08:19.287093+0000","last_fullsized":"2023-05-17T15:08:19.287093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306678+0000","last_change":"2023-05-17T15:08:19.297249+0000","last_active":"2023-05-17T15:08:19.306678+0000","last_peered":"2023-05-17T15:08:19.306678+0000","last_clean":"2023-05-17T15:08:19.306678+0000","last_became_active":"2023-05-17T15:08:19.296625+0000","last_became_peered":"2023-05-17T15:08:19.296625+0000","last_unstale":"2023-05-17T15:08:19.306678+0000","last_undegraded":"2023-05-17T15:08:19.306678+0000","last_fullsized":"2023-05-17T15:08:19.306678+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.287068+0000","last_change":"2023-05-17T15:08:18.902285+0000","last_active":"2023-05-17T15:08:19.287068+0000","last_peered":"2023-05-17T15:08:19.287068+0000","last_clean":"2023-05-17T15:08:19.287068+0000","last_became_active":"2023-05-17T15:08:18.901984+0000","last_became_peered":"2023-05-17T15:08:18.901984+0000","last_unstale":"2023-05-17T15:08:19.287068+0000","last_undegraded":"2023-05-17T15:08:19.287068+0000","last_fullsized":"2023-05-17T15:08:19.287068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.279484+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:19.279484+0000","last_peered":"2023-05-17T15:08:19.279484+0000","last_clean":"2023-05-17T15:08:19.279484+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:19.279484+0000","last_undegraded":"2023-05-17T15:08:19.279484+0000","last_fullsized":"2023-05-17T15:08:19.279484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290291+0000","last_change":"2023-05-17T15:08:19.285948+0000","last_active":"2023-05-17T15:08:19.290291+0000","last_peered":"2023-05-17T15:08:19.290291+0000","last_clean":"2023-05-17T15:08:19.290291+0000","last_became_active":"2023-05-17T15:08:19.284428+0000","last_became_peered":"2023-05-17T15:08:19.284428+0000","last_unstale":"2023-05-17T15:08:19.290291+0000","last_undegraded":"2023-05-17T15:08:19.290291+0000","last_fullsized":"2023-05-17T15:08:19.290291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277034+0000","last_change":"2023-05-17T15:08:18.910068+0000","last_active":"2023-05-17T15:08:19.277034+0000","last_peered":"2023-05-17T15:08:19.277034+0000","last_clean":"2023-05-17T15:08:19.277034+0000","last_became_active":"2023-05-17T15:08:18.908009+0000","last_became_peered":"2023-05-17T15:08:18.908009+0000","last_unstale":"2023-05-17T15:08:19.277034+0000","last_undegraded":"2023-05-17T15:08:19.277034+0000","last_fullsized":"2023-05-17T15:08:19.277034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.287416+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:19.287416+0000","last_peered":"2023-05-17T15:08:19.287416+0000","last_clean":"2023-05-17T15:08:19.287416+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:19.287416+0000","last_undegraded":"2023-05-17T15:08:19.287416+0000","last_fullsized":"2023-05-17T15:08:19.287416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.295541+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:19.295541+0000","last_peered":"2023-05-17T15:08:19.295541+0000","last_clean":"2023-05-17T15:08:19.295541+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:19.295541+0000","last_undegraded":"2023-05-17T15:08:19.295541+0000","last_fullsized":"2023-05-17T15:08:19.295541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.288267+0000","last_change":"2023-05-17T15:08:19.286888+0000","last_active":"2023-05-17T15:08:19.288267+0000","last_peered":"2023-05-17T15:08:19.288267+0000","last_clean":"2023-05-17T15:08:19.288267+0000","last_became_active":"2023-05-17T15:08:19.286689+0000","last_became_peered":"2023-05-17T15:08:19.286689+0000","last_unstale":"2023-05-17T15:08:19.288267+0000","last_undegraded":"2023-05-17T15:08:19.288267+0000","last_fullsized":"2023-05-17T15:08:19.288267+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.292540+0000","last_change":"2023-05-17T15:08:18.910475+0000","last_active":"2023-05-17T15:08:19.292540+0000","last_peered":"2023-05-17T15:08:19.292540+0000","last_clean":"2023-05-17T15:08:19.292540+0000","last_became_active":"2023-05-17T15:08:18.910197+0000","last_became_peered":"2023-05-17T15:08:18.910197+0000","last_unstale":"2023-05-17T15:08:19.292540+0000","last_undegraded":"2023-05-17T15:08:19.292540+0000","last_fullsized":"2023-05-17T15:08:19.292540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298119+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:19.298119+0000","last_peered":"2023-05-17T15:08:19.298119+0000","last_clean":"2023-05-17T15:08:19.298119+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:19.298119+0000","last_undegraded":"2023-05-17T15:08:19.298119+0000","last_fullsized":"2023-05-17T15:08:19.298119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.304732+0000","last_change":"2023-05-17T15:08:19.300984+0000","last_active":"2023-05-17T15:08:19.304732+0000","last_peered":"2023-05-17T15:08:19.304732+0000","last_clean":"2023-05-17T15:08:19.304732+0000","last_became_active":"2023-05-17T15:08:19.300659+0000","last_became_peered":"2023-05-17T15:08:19.300659+0000","last_unstale":"2023-05-17T15:08:19.304732+0000","last_undegraded":"2023-05-17T15:08:19.304732+0000","last_fullsized":"2023-05-17T15:08:19.304732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309674+0000","last_change":"2023-05-17T15:08:18.913201+0000","last_active":"2023-05-17T15:08:19.309674+0000","last_peered":"2023-05-17T15:08:19.309674+0000","last_clean":"2023-05-17T15:08:19.309674+0000","last_became_active":"2023-05-17T15:08:18.912907+0000","last_became_peered":"2023-05-17T15:08:18.912907+0000","last_unstale":"2023-05-17T15:08:19.309674+0000","last_undegraded":"2023-05-17T15:08:19.309674+0000","last_fullsized":"2023-05-17T15:08:19.309674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298872+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:19.298872+0000","last_peered":"2023-05-17T15:08:19.298872+0000","last_clean":"2023-05-17T15:08:19.298872+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:19.298872+0000","last_undegraded":"2023-05-17T15:08:19.298872+0000","last_fullsized":"2023-05-17T15:08:19.298872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309193+0000","last_change":"2023-05-17T15:08:19.295679+0000","last_active":"2023-05-17T15:08:19.309193+0000","last_peered":"2023-05-17T15:08:19.309193+0000","last_clean":"2023-05-17T15:08:19.309193+0000","last_became_active":"2023-05-17T15:08:19.295181+0000","last_became_peered":"2023-05-17T15:08:19.295181+0000","last_unstale":"2023-05-17T15:08:19.309193+0000","last_undegraded":"2023-05-17T15:08:19.309193+0000","last_fullsized":"2023-05-17T15:08:19.309193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298740+0000","last_change":"2023-05-17T15:08:18.912764+0000","last_active":"2023-05-17T15:08:19.298740+0000","last_peered":"2023-05-17T15:08:19.298740+0000","last_clean":"2023-05-17T15:08:19.298740+0000","last_became_active":"2023-05-17T15:08:18.912413+0000","last_became_peered":"2023-05-17T15:08:18.912413+0000","last_unstale":"2023-05-17T15:08:19.298740+0000","last_undegraded":"2023-05-17T15:08:19.298740+0000","last_fullsized":"2023-05-17T15:08:19.298740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.280814+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:19.280814+0000","last_peered":"2023-05-17T15:08:19.280814+0000","last_clean":"2023-05-17T15:08:19.280814+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:19.280814+0000","last_undegraded":"2023-05-17T15:08:19.280814+0000","last_fullsized":"2023-05-17T15:08:19.280814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293670+0000","last_change":"2023-05-17T15:08:19.289908+0000","last_active":"2023-05-17T15:08:19.293670+0000","last_peered":"2023-05-17T15:08:19.293670+0000","last_clean":"2023-05-17T15:08:19.293670+0000","last_became_active":"2023-05-17T15:08:19.289473+0000","last_became_peered":"2023-05-17T15:08:19.289473+0000","last_unstale":"2023-05-17T15:08:19.293670+0000","last_undegraded":"2023-05-17T15:08:19.293670+0000","last_fullsized":"2023-05-17T15:08:19.293670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277787+0000","last_change":"2023-05-17T15:08:18.898040+0000","last_active":"2023-05-17T15:08:19.277787+0000","last_peered":"2023-05-17T15:08:19.277787+0000","last_clean":"2023-05-17T15:08:19.277787+0000","last_became_active":"2023-05-17T15:08:18.897780+0000","last_became_peered":"2023-05-17T15:08:18.897780+0000","last_unstale":"2023-05-17T15:08:19.277787+0000","last_undegraded":"2023-05-17T15:08:19.277787+0000","last_fullsized":"2023-05-17T15:08:19.277787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277302+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:19.277302+0000","last_peered":"2023-05-17T15:08:19.277302+0000","last_clean":"2023-05-17T15:08:19.277302+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:19.277302+0000","last_undegraded":"2023-05-17T15:08:19.277302+0000","last_fullsized":"2023-05-17T15:08:19.277302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575024,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17064,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94354776,"statfs":{"total":96636764160,"available":96619290624,"internally_reserved":0,"allocated":1015808,"data_stored":502899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.75600000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85299999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.81899999999999995}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.90800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575025,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16416,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355424,"statfs":{"total":96636764160,"available":96619954176,"internally_reserved":0,"allocated":1007616,"data_stored":501917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.502}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.629}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575025,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16300,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355540,"statfs":{"total":96636764160,"available":96620072960,"internally_reserved":0,"allocated":1019904,"data_stored":502639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.65700000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46400000000000002,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":1.956,"15min":1.956},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.64800000000000002,"5min":1.149,"15min":1.149},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.57599999999999996,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":0.76400000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":1.103,"15min":1.6100000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.64900000000000002},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.54900000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.524,"15min":1.524},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834575025,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16092,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355748,"statfs":{"total":96636764160,"available":96620285952,"internally_reserved":0,"allocated":1003520,"data_stored":501883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.309}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.45000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575024,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17444,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94354396,"statfs":{"total":96636764160,"available":96618901504,"internally_reserved":0,"allocated":1011712,"data_stored":502507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.38200000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.31},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.65000000000000002}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.624}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575025,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20388,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":19392,"kb_avail":94351452,"statfs":{"total":96636764160,"available":96615886848,"internally_reserved":0,"allocated":1011712,"data_stored":502507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19857408},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.29899999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834575024,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16676,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":15680,"kb_avail":94355164,"statfs":{"total":96636764160,"available":96619687936,"internally_reserved":0,"allocated":1011712,"data_stored":502527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16056320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.77600000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.745}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.65000000000000002}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.48899999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.438},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575024,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20004,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94351836,"statfs":{"total":96636764160,"available":96616280064,"internally_reserved":0,"allocated":1011712,"data_stored":502797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.496}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.625},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:27.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:27.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.927+0000 7fb51e1e9700 1 Processor -- start 2023-05-17T15:08:27.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.927+0000 7fb51e1e9700 1 -- start start 2023-05-17T15:08:27.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51e1e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1560 0x7fb5180c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:27.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51e1e9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5181549b0 con 0x7fb5180c1180 2023-05-17T15:08:27.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51e1e9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb518154c90 con 0x7fb5181544f0 2023-05-17T15:08:27.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51e1e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb518154f70 con 0x7fb5180c1560 2023-05-17T15:08:27.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51d1e7700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb5180c1180 0x7fb5180c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38210/0 (socket says 172.21.15.27:38210) 2023-05-17T15:08:27.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51d1e7700 1 -- 172.21.15.27:0/3914918661 learned_addr learned my addr 172.21.15.27:0/3914918661 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:27.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb51d9e8700 1 --2- 172.21.15.27:0/3914918661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1560 0x7fb5180c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:27.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594679494 0 0) 0x7fb5181549b0 con 0x7fb5180c1180 2023-05-17T15:08:27.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.928+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5040033f0 con 0x7fb5180c1180 2023-05-17T15:08:27.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877770713 0 0) 0x7fb518154c90 con 0x7fb5181544f0 2023-05-17T15:08:27.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5181549b0 con 0x7fb5181544f0 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb51d9e8700 1 -- 172.21.15.27:0/3914918661 >> v1:172.21.15.40:6789/0 conn(0x7fb5181544f0 legacy=0x7fb5180a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb51d9e8700 1 -- 172.21.15.27:0/3914918661 >> v1:172.21.15.27:6789/0 conn(0x7fb5180c1180 legacy=0x7fb5180c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb51d9e8700 1 -- 172.21.15.27:0/3914918661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518155250 con 0x7fb5180c1560 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb51d9e8700 1 --2- 172.21.15.27:0/3914918661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1560 0x7fb5180c74a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb510009e90 tx=0x7fb510009780).ready entity=mon.2 client_cookie=e0ad3a1216cdb7cd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000e070 con 0x7fb5180c1560 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000bab0 con 0x7fb5180c1560 2023-05-17T15:08:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb50ffff700 1 -- 172.21.15.27:0/3914918661 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000be30 con 0x7fb5180c1560 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.929+0000 7fb51e1e9700 1 -- 172.21.15.27:0/3914918661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1560 msgr2=0x7fb5180c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.930+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/3914918661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1560 0x7fb5180c74a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb510009e90 tx=0x7fb510009780).stop 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.930+0000 7fb51e1e9700 1 -- 172.21.15.27:0/3914918661 shutdown_connections 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.930+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/3914918661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1560 0x7fb5180c74a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.930+0000 7fb51e1e9700 1 -- 172.21.15.27:0/3914918661 >> 172.21.15.27:0/3914918661 conn(0x7fb51805dd50 msgr2=0x7fb51805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.930+0000 7fb51e1e9700 1 -- 172.21.15.27:0/3914918661 shutdown_connections 2023-05-17T15:08:27.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.930+0000 7fb51e1e9700 1 -- 172.21.15.27:0/3914918661 wait complete. 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.931+0000 7fb51e1e9700 1 Processor -- start 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.931+0000 7fb51e1e9700 1 -- start start 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51e1e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1180 0x7fb518164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51e1e9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180c1560 0x7fb5180a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51e1e9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 0x7fb5180af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51e1e9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180aa050 con 0x7fb5181544f0 2023-05-17T15:08:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51e1e9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb518164ef0 con 0x7fb5180c1560 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51e1e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb518167ac0 con 0x7fb5180c1180 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 0x7fb5180af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 0x7fb5180af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38658/0 (socket says 172.21.15.27:38658) 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 -- 172.21.15.27:0/2115159665 learned_addr learned my addr 172.21.15.27:0/2115159665 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d1e7700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1180 0x7fb518164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51c9e6700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180c1560 0x7fb5180a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:27.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 -- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1180 msgr2=0x7fb518164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1180 0x7fb518164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 -- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180c1560 msgr2=0x7fb5180a8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180c1560 0x7fb5180a8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 -- 172.21.15.27:0/2115159665 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510009a20 con 0x7fb5181544f0 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.932+0000 7fb51d9e8700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 0x7fb5180af010 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fb5180c0240 tx=0x7fb518155530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.933+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51001d630 con 0x7fb5181544f0 2023-05-17T15:08:27.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.933+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51001d790 con 0x7fb5181544f0 2023-05-17T15:08:27.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.933+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518167da0 con 0x7fb5181544f0 2023-05-17T15:08:27.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.933+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51001db30 con 0x7fb5181544f0 2023-05-17T15:08:27.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.933+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb518168360 con 0x7fb5181544f0 2023-05-17T15:08:27.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.934+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518069cb0 con 0x7fb5181544f0 2023-05-17T15:08:27.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.934+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb510027460 con 0x7fb5181544f0 2023-05-17T15:08:27.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.934+0000 7fb50d7fa700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb4fc05ed90 0x7fb4fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:27.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.935+0000 7fb51d1e7700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb4fc05ed90 0x7fb4fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:27.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.935+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fb51007bd10 con 0x7fb5181544f0 2023-05-17T15:08:27.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.935+0000 7fb51d1e7700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb4fc05ed90 0x7fb4fc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb514005750 tx=0x7fb514009040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:27.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:27.939+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb51004d280 con 0x7fb5181544f0 2023-05-17T15:08:28.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.110+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb51806bdf0 con 0x7fb4fc05ed90 2023-05-17T15:08:28.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.120+0000 7fb50d7fa700 1 -- 172.21.15.27:0/2115159665 <== mgr.6003 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361249 (secure 0 0 0) 0x7fb51806bdf0 con 0x7fb4fc05ed90 2023-05-17T15:08:28.128 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:28.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb4fc05ed90 msgr2=0x7fb4fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb4fc05ed90 0x7fb4fc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb514005750 tx=0x7fb514009040).stop 2023-05-17T15:08:28.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 msgr2=0x7fb5180af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 0x7fb5180af010 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fb5180c0240 tx=0x7fb518155530).stop 2023-05-17T15:08:28.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 shutdown_connections 2023-05-17T15:08:28.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb4fc05ed90 0x7fb4fc061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5181544f0 0x7fb5180af010 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5180c1180 0x7fb518164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 --2- 172.21.15.27:0/2115159665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180c1560 0x7fb5180a8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 >> 172.21.15.27:0/2115159665 conn(0x7fb51805dd50 msgr2=0x7fb5180ab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:28.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 shutdown_connections 2023-05-17T15:08:28.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.123+0000 7fb51e1e9700 1 -- 172.21.15.27:0/2115159665 wait complete. 2023-05-17T15:08:28.136 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:28.146 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-17T15:08:26.144826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":265,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":140384,"kb_used_data":7904,"kb_used_omap":0,"kb_used_meta":132416,"kb_avail":754834336,"statfs":{"total":773094113280,"available":772950360064,"internally_reserved":0,"allocated":8093696,"data_stored":4019676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":135593984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27717,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-76,"num_write_kb":-62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.613246"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308368+0000","last_change":"2023-05-17T15:08:19.290803+0000","last_active":"2023-05-17T15:08:19.308368+0000","last_peered":"2023-05-17T15:08:19.308368+0000","last_clean":"2023-05-17T15:08:19.308368+0000","last_became_active":"2023-05-17T15:08:19.290484+0000","last_became_peered":"2023-05-17T15:08:19.290484+0000","last_unstale":"2023-05-17T15:08:19.308368+0000","last_undegraded":"2023-05-17T15:08:19.308368+0000","last_fullsized":"2023-05-17T15:08:19.308368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290528+0000","last_change":"2023-05-17T15:08:18.911990+0000","last_active":"2023-05-17T15:08:19.290528+0000","last_peered":"2023-05-17T15:08:19.290528+0000","last_clean":"2023-05-17T15:08:19.290528+0000","last_became_active":"2023-05-17T15:08:18.911703+0000","last_became_peered":"2023-05-17T15:08:18.911703+0000","last_unstale":"2023-05-17T15:08:19.290528+0000","last_undegraded":"2023-05-17T15:08:19.290528+0000","last_fullsized":"2023-05-17T15:08:19.290528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308887+0000","last_change":"2023-05-17T15:08:19.304909+0000","last_active":"2023-05-17T15:08:19.308887+0000","last_peered":"2023-05-17T15:08:19.308887+0000","last_clean":"2023-05-17T15:08:19.308887+0000","last_became_active":"2023-05-17T15:08:19.304572+0000","last_became_peered":"2023-05-17T15:08:19.304572+0000","last_unstale":"2023-05-17T15:08:19.308887+0000","last_undegraded":"2023-05-17T15:08:19.308887+0000","last_fullsized":"2023-05-17T15:08:19.308887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277477+0000","last_change":"2023-05-17T15:08:18.902229+0000","last_active":"2023-05-17T15:08:19.277477+0000","last_peered":"2023-05-17T15:08:19.277477+0000","last_clean":"2023-05-17T15:08:19.277477+0000","last_became_active":"2023-05-17T15:08:18.901917+0000","last_became_peered":"2023-05-17T15:08:18.901917+0000","last_unstale":"2023-05-17T15:08:19.277477+0000","last_undegraded":"2023-05-17T15:08:19.277477+0000","last_fullsized":"2023-05-17T15:08:19.277477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290218+0000","last_change":"2023-05-17T15:08:19.285240+0000","last_active":"2023-05-17T15:08:19.290218+0000","last_peered":"2023-05-17T15:08:19.290218+0000","last_clean":"2023-05-17T15:08:19.290218+0000","last_became_active":"2023-05-17T15:08:19.284964+0000","last_became_peered":"2023-05-17T15:08:19.284964+0000","last_unstale":"2023-05-17T15:08:19.290218+0000","last_undegraded":"2023-05-17T15:08:19.290218+0000","last_fullsized":"2023-05-17T15:08:19.290218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298672+0000","last_change":"2023-05-17T15:08:18.908877+0000","last_active":"2023-05-17T15:08:19.298672+0000","last_peered":"2023-05-17T15:08:19.298672+0000","last_clean":"2023-05-17T15:08:19.298672+0000","last_became_active":"2023-05-17T15:08:18.908536+0000","last_became_peered":"2023-05-17T15:08:18.908536+0000","last_unstale":"2023-05-17T15:08:19.298672+0000","last_undegraded":"2023-05-17T15:08:19.298672+0000","last_fullsized":"2023-05-17T15:08:19.298672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306773+0000","last_change":"2023-05-17T15:08:19.302979+0000","last_active":"2023-05-17T15:08:19.306773+0000","last_peered":"2023-05-17T15:08:19.306773+0000","last_clean":"2023-05-17T15:08:19.306773+0000","last_became_active":"2023-05-17T15:08:19.302718+0000","last_became_peered":"2023-05-17T15:08:19.302718+0000","last_unstale":"2023-05-17T15:08:19.306773+0000","last_undegraded":"2023-05-17T15:08:19.306773+0000","last_fullsized":"2023-05-17T15:08:19.306773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302651+0000","last_change":"2023-05-17T15:08:18.904853+0000","last_active":"2023-05-17T15:08:19.302651+0000","last_peered":"2023-05-17T15:08:19.302651+0000","last_clean":"2023-05-17T15:08:19.302651+0000","last_became_active":"2023-05-17T15:08:18.904460+0000","last_became_peered":"2023-05-17T15:08:18.904460+0000","last_unstale":"2023-05-17T15:08:19.302651+0000","last_undegraded":"2023-05-17T15:08:19.302651+0000","last_fullsized":"2023-05-17T15:08:19.302651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306971+0000","last_change":"2023-05-17T15:08:19.301653+0000","last_active":"2023-05-17T15:08:19.306971+0000","last_peered":"2023-05-17T15:08:19.306971+0000","last_clean":"2023-05-17T15:08:19.306971+0000","last_became_active":"2023-05-17T15:08:19.301195+0000","last_became_peered":"2023-05-17T15:08:19.301195+0000","last_unstale":"2023-05-17T15:08:19.306971+0000","last_undegraded":"2023-05-17T15:08:19.306971+0000","last_fullsized":"2023-05-17T15:08:19.306971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.296502+0000","last_change":"2023-05-17T15:08:18.904506+0000","last_active":"2023-05-17T15:08:19.296502+0000","last_peered":"2023-05-17T15:08:19.296502+0000","last_clean":"2023-05-17T15:08:19.296502+0000","last_became_active":"2023-05-17T15:08:18.904213+0000","last_became_peered":"2023-05-17T15:08:18.904213+0000","last_unstale":"2023-05-17T15:08:19.296502+0000","last_undegraded":"2023-05-17T15:08:19.296502+0000","last_fullsized":"2023-05-17T15:08:19.296502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298099+0000","last_change":"2023-05-17T15:08:19.293386+0000","last_active":"2023-05-17T15:08:19.298099+0000","last_peered":"2023-05-17T15:08:19.298099+0000","last_clean":"2023-05-17T15:08:19.298099+0000","last_became_active":"2023-05-17T15:08:19.293141+0000","last_became_peered":"2023-05-17T15:08:19.293141+0000","last_unstale":"2023-05-17T15:08:19.298099+0000","last_undegraded":"2023-05-17T15:08:19.298099+0000","last_fullsized":"2023-05-17T15:08:19.298099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290096+0000","last_change":"2023-05-17T15:08:18.902858+0000","last_active":"2023-05-17T15:08:19.290096+0000","last_peered":"2023-05-17T15:08:19.290096+0000","last_clean":"2023-05-17T15:08:19.290096+0000","last_became_active":"2023-05-17T15:08:18.902398+0000","last_became_peered":"2023-05-17T15:08:18.902398+0000","last_unstale":"2023-05-17T15:08:19.290096+0000","last_undegraded":"2023-05-17T15:08:19.290096+0000","last_fullsized":"2023-05-17T15:08:19.290096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306817+0000","last_change":"2023-05-17T15:08:19.304906+0000","last_active":"2023-05-17T15:08:19.306817+0000","last_peered":"2023-05-17T15:08:19.306817+0000","last_clean":"2023-05-17T15:08:19.306817+0000","last_became_active":"2023-05-17T15:08:19.304499+0000","last_became_peered":"2023-05-17T15:08:19.304499+0000","last_unstale":"2023-05-17T15:08:19.306817+0000","last_undegraded":"2023-05-17T15:08:19.306817+0000","last_fullsized":"2023-05-17T15:08:19.306817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.281785+0000","last_change":"2023-05-17T15:08:18.901694+0000","last_active":"2023-05-17T15:08:19.281785+0000","last_peered":"2023-05-17T15:08:19.281785+0000","last_clean":"2023-05-17T15:08:19.281785+0000","last_became_active":"2023-05-17T15:08:18.900872+0000","last_became_peered":"2023-05-17T15:08:18.900872+0000","last_unstale":"2023-05-17T15:08:19.281785+0000","last_undegraded":"2023-05-17T15:08:19.281785+0000","last_fullsized":"2023-05-17T15:08:19.281785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.304821+0000","last_change":"2023-05-17T15:08:19.301024+0000","last_active":"2023-05-17T15:08:19.304821+0000","last_peered":"2023-05-17T15:08:19.304821+0000","last_clean":"2023-05-17T15:08:19.304821+0000","last_became_active":"2023-05-17T15:08:19.300729+0000","last_became_peered":"2023-05-17T15:08:19.300729+0000","last_unstale":"2023-05-17T15:08:19.304821+0000","last_undegraded":"2023-05-17T15:08:19.304821+0000","last_fullsized":"2023-05-17T15:08:19.304821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.276939+0000","last_change":"2023-05-17T15:08:18.899762+0000","last_active":"2023-05-17T15:08:19.276939+0000","last_peered":"2023-05-17T15:08:19.276939+0000","last_clean":"2023-05-17T15:08:19.276939+0000","last_became_active":"2023-05-17T15:08:18.899483+0000","last_became_peered":"2023-05-17T15:08:18.899483+0000","last_unstale":"2023-05-17T15:08:19.276939+0000","last_undegraded":"2023-05-17T15:08:19.276939+0000","last_fullsized":"2023-05-17T15:08:19.276939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307195+0000","last_change":"2023-05-17T15:08:19.303972+0000","last_active":"2023-05-17T15:08:19.307195+0000","last_peered":"2023-05-17T15:08:19.307195+0000","last_clean":"2023-05-17T15:08:19.307195+0000","last_became_active":"2023-05-17T15:08:19.303685+0000","last_became_peered":"2023-05-17T15:08:19.303685+0000","last_unstale":"2023-05-17T15:08:19.307195+0000","last_undegraded":"2023-05-17T15:08:19.307195+0000","last_fullsized":"2023-05-17T15:08:19.307195+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282200+0000","last_change":"2023-05-17T15:08:18.896324+0000","last_active":"2023-05-17T15:08:19.282200+0000","last_peered":"2023-05-17T15:08:19.282200+0000","last_clean":"2023-05-17T15:08:19.282200+0000","last_became_active":"2023-05-17T15:08:18.896047+0000","last_became_peered":"2023-05-17T15:08:18.896047+0000","last_unstale":"2023-05-17T15:08:19.282200+0000","last_undegraded":"2023-05-17T15:08:19.282200+0000","last_fullsized":"2023-05-17T15:08:19.282200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309038+0000","last_change":"2023-05-17T15:08:19.293445+0000","last_active":"2023-05-17T15:08:19.309038+0000","last_peered":"2023-05-17T15:08:19.309038+0000","last_clean":"2023-05-17T15:08:19.309038+0000","last_became_active":"2023-05-17T15:08:19.292782+0000","last_became_peered":"2023-05-17T15:08:19.292782+0000","last_unstale":"2023-05-17T15:08:19.309038+0000","last_undegraded":"2023-05-17T15:08:19.309038+0000","last_fullsized":"2023-05-17T15:08:19.309038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.280829+0000","last_change":"2023-05-17T15:08:18.906953+0000","last_active":"2023-05-17T15:08:19.280829+0000","last_peered":"2023-05-17T15:08:19.280829+0000","last_clean":"2023-05-17T15:08:19.280829+0000","last_became_active":"2023-05-17T15:08:18.906669+0000","last_became_peered":"2023-05-17T15:08:18.906669+0000","last_unstale":"2023-05-17T15:08:19.280829+0000","last_undegraded":"2023-05-17T15:08:19.280829+0000","last_fullsized":"2023-05-17T15:08:19.280829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308702+0000","last_change":"2023-05-17T15:08:19.304207+0000","last_active":"2023-05-17T15:08:19.308702+0000","last_peered":"2023-05-17T15:08:19.308702+0000","last_clean":"2023-05-17T15:08:19.308702+0000","last_became_active":"2023-05-17T15:08:19.303910+0000","last_became_peered":"2023-05-17T15:08:19.303910+0000","last_unstale":"2023-05-17T15:08:19.308702+0000","last_undegraded":"2023-05-17T15:08:19.308702+0000","last_fullsized":"2023-05-17T15:08:19.308702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278710+0000","last_change":"2023-05-17T15:08:18.896887+0000","last_active":"2023-05-17T15:08:19.278710+0000","last_peered":"2023-05-17T15:08:19.278710+0000","last_clean":"2023-05-17T15:08:19.278710+0000","last_became_active":"2023-05-17T15:08:18.896589+0000","last_became_peered":"2023-05-17T15:08:18.896589+0000","last_unstale":"2023-05-17T15:08:19.278710+0000","last_undegraded":"2023-05-17T15:08:19.278710+0000","last_fullsized":"2023-05-17T15:08:19.278710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.311023+0000","last_change":"2023-05-17T15:08:19.309982+0000","last_active":"2023-05-17T15:08:19.311023+0000","last_peered":"2023-05-17T15:08:19.311023+0000","last_clean":"2023-05-17T15:08:19.311023+0000","last_became_active":"2023-05-17T15:08:19.309678+0000","last_became_peered":"2023-05-17T15:08:19.309678+0000","last_unstale":"2023-05-17T15:08:19.311023+0000","last_undegraded":"2023-05-17T15:08:19.311023+0000","last_fullsized":"2023-05-17T15:08:19.311023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309385+0000","last_change":"2023-05-17T15:08:18.906169+0000","last_active":"2023-05-17T15:08:19.309385+0000","last_peered":"2023-05-17T15:08:19.309385+0000","last_clean":"2023-05-17T15:08:19.309385+0000","last_became_active":"2023-05-17T15:08:18.905905+0000","last_became_peered":"2023-05-17T15:08:18.905905+0000","last_unstale":"2023-05-17T15:08:19.309385+0000","last_undegraded":"2023-05-17T15:08:19.309385+0000","last_fullsized":"2023-05-17T15:08:19.309385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.300220+0000","last_change":"2023-05-17T15:08:19.296944+0000","last_active":"2023-05-17T15:08:19.300220+0000","last_peered":"2023-05-17T15:08:19.300220+0000","last_clean":"2023-05-17T15:08:19.300220+0000","last_became_active":"2023-05-17T15:08:19.296696+0000","last_became_peered":"2023-05-17T15:08:19.296696+0000","last_unstale":"2023-05-17T15:08:19.300220+0000","last_undegraded":"2023-05-17T15:08:19.300220+0000","last_fullsized":"2023-05-17T15:08:19.300220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.301240+0000","last_change":"2023-05-17T15:08:18.910832+0000","last_active":"2023-05-17T15:08:19.301240+0000","last_peered":"2023-05-17T15:08:19.301240+0000","last_clean":"2023-05-17T15:08:19.301240+0000","last_became_active":"2023-05-17T15:08:18.910487+0000","last_became_peered":"2023-05-17T15:08:18.910487+0000","last_unstale":"2023-05-17T15:08:19.301240+0000","last_undegraded":"2023-05-17T15:08:19.301240+0000","last_fullsized":"2023-05-17T15:08:19.301240+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308885+0000","last_change":"2023-05-17T15:08:19.305804+0000","last_active":"2023-05-17T15:08:19.308885+0000","last_peered":"2023-05-17T15:08:19.308885+0000","last_clean":"2023-05-17T15:08:19.308885+0000","last_became_active":"2023-05-17T15:08:19.305443+0000","last_became_peered":"2023-05-17T15:08:19.305443+0000","last_unstale":"2023-05-17T15:08:19.308885+0000","last_undegraded":"2023-05-17T15:08:19.308885+0000","last_fullsized":"2023-05-17T15:08:19.308885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282268+0000","last_change":"2023-05-17T15:08:18.906558+0000","last_active":"2023-05-17T15:08:19.282268+0000","last_peered":"2023-05-17T15:08:19.282268+0000","last_clean":"2023-05-17T15:08:19.282268+0000","last_became_active":"2023-05-17T15:08:18.906249+0000","last_became_peered":"2023-05-17T15:08:18.906249+0000","last_unstale":"2023-05-17T15:08:19.282268+0000","last_undegraded":"2023-05-17T15:08:19.282268+0000","last_fullsized":"2023-05-17T15:08:19.282268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308773+0000","last_change":"2023-05-17T15:08:19.304845+0000","last_active":"2023-05-17T15:08:19.308773+0000","last_peered":"2023-05-17T15:08:19.308773+0000","last_clean":"2023-05-17T15:08:19.308773+0000","last_became_active":"2023-05-17T15:08:19.304525+0000","last_became_peered":"2023-05-17T15:08:19.304525+0000","last_unstale":"2023-05-17T15:08:19.308773+0000","last_undegraded":"2023-05-17T15:08:19.308773+0000","last_fullsized":"2023-05-17T15:08:19.308773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.281883+0000","last_change":"2023-05-17T15:08:18.901512+0000","last_active":"2023-05-17T15:08:19.281883+0000","last_peered":"2023-05-17T15:08:19.281883+0000","last_clean":"2023-05-17T15:08:19.281883+0000","last_became_active":"2023-05-17T15:08:18.901188+0000","last_became_peered":"2023-05-17T15:08:18.901188+0000","last_unstale":"2023-05-17T15:08:19.281883+0000","last_undegraded":"2023-05-17T15:08:19.281883+0000","last_fullsized":"2023-05-17T15:08:19.281883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306896+0000","last_change":"2023-05-17T15:08:19.301152+0000","last_active":"2023-05-17T15:08:19.306896+0000","last_peered":"2023-05-17T15:08:19.306896+0000","last_clean":"2023-05-17T15:08:19.306896+0000","last_became_active":"2023-05-17T15:08:19.300843+0000","last_became_peered":"2023-05-17T15:08:19.300843+0000","last_unstale":"2023-05-17T15:08:19.306896+0000","last_undegraded":"2023-05-17T15:08:19.306896+0000","last_fullsized":"2023-05-17T15:08:19.306896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.300515+0000","last_change":"2023-05-17T15:08:18.900142+0000","last_active":"2023-05-17T15:08:19.300515+0000","last_peered":"2023-05-17T15:08:19.300515+0000","last_clean":"2023-05-17T15:08:19.300515+0000","last_became_active":"2023-05-17T15:08:18.899673+0000","last_became_peered":"2023-05-17T15:08:18.899673+0000","last_unstale":"2023-05-17T15:08:19.300515+0000","last_undegraded":"2023-05-17T15:08:19.300515+0000","last_fullsized":"2023-05-17T15:08:19.300515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290173+0000","last_change":"2023-05-17T15:08:19.285245+0000","last_active":"2023-05-17T15:08:19.290173+0000","last_peered":"2023-05-17T15:08:19.290173+0000","last_clean":"2023-05-17T15:08:19.290173+0000","last_became_active":"2023-05-17T15:08:19.284445+0000","last_became_peered":"2023-05-17T15:08:19.284445+0000","last_unstale":"2023-05-17T15:08:19.290173+0000","last_undegraded":"2023-05-17T15:08:19.290173+0000","last_fullsized":"2023-05-17T15:08:19.290173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277651+0000","last_change":"2023-05-17T15:08:18.909889+0000","last_active":"2023-05-17T15:08:19.277651+0000","last_peered":"2023-05-17T15:08:19.277651+0000","last_clean":"2023-05-17T15:08:19.277651+0000","last_became_active":"2023-05-17T15:08:18.908186+0000","last_became_peered":"2023-05-17T15:08:18.908186+0000","last_unstale":"2023-05-17T15:08:19.277651+0000","last_undegraded":"2023-05-17T15:08:19.277651+0000","last_fullsized":"2023-05-17T15:08:19.277651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293604+0000","last_change":"2023-05-17T15:08:19.290579+0000","last_active":"2023-05-17T15:08:19.293604+0000","last_peered":"2023-05-17T15:08:19.293604+0000","last_clean":"2023-05-17T15:08:19.293604+0000","last_became_active":"2023-05-17T15:08:19.290269+0000","last_became_peered":"2023-05-17T15:08:19.290269+0000","last_unstale":"2023-05-17T15:08:19.293604+0000","last_undegraded":"2023-05-17T15:08:19.293604+0000","last_fullsized":"2023-05-17T15:08:19.293604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.299441+0000","last_change":"2023-05-17T15:08:18.910773+0000","last_active":"2023-05-17T15:08:19.299441+0000","last_peered":"2023-05-17T15:08:19.299441+0000","last_clean":"2023-05-17T15:08:19.299441+0000","last_became_active":"2023-05-17T15:08:18.910497+0000","last_became_peered":"2023-05-17T15:08:18.910497+0000","last_unstale":"2023-05-17T15:08:19.299441+0000","last_undegraded":"2023-05-17T15:08:19.299441+0000","last_fullsized":"2023-05-17T15:08:19.299441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308819+0000","last_change":"2023-05-17T15:08:19.291404+0000","last_active":"2023-05-17T15:08:19.308819+0000","last_peered":"2023-05-17T15:08:19.308819+0000","last_clean":"2023-05-17T15:08:19.308819+0000","last_became_active":"2023-05-17T15:08:19.291074+0000","last_became_peered":"2023-05-17T15:08:19.291074+0000","last_unstale":"2023-05-17T15:08:19.308819+0000","last_undegraded":"2023-05-17T15:08:19.308819+0000","last_fullsized":"2023-05-17T15:08:19.308819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290432+0000","last_change":"2023-05-17T15:08:18.911295+0000","last_active":"2023-05-17T15:08:19.290432+0000","last_peered":"2023-05-17T15:08:19.290432+0000","last_clean":"2023-05-17T15:08:19.290432+0000","last_became_active":"2023-05-17T15:08:18.910808+0000","last_became_peered":"2023-05-17T15:08:18.910808+0000","last_unstale":"2023-05-17T15:08:19.290432+0000","last_undegraded":"2023-05-17T15:08:19.290432+0000","last_fullsized":"2023-05-17T15:08:19.290432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.300387+0000","last_change":"2023-05-17T15:08:19.294843+0000","last_active":"2023-05-17T15:08:19.300387+0000","last_peered":"2023-05-17T15:08:19.300387+0000","last_clean":"2023-05-17T15:08:19.300387+0000","last_became_active":"2023-05-17T15:08:19.294555+0000","last_became_peered":"2023-05-17T15:08:19.294555+0000","last_unstale":"2023-05-17T15:08:19.300387+0000","last_undegraded":"2023-05-17T15:08:19.300387+0000","last_fullsized":"2023-05-17T15:08:19.300387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277728+0000","last_change":"2023-05-17T15:08:18.906256+0000","last_active":"2023-05-17T15:08:19.277728+0000","last_peered":"2023-05-17T15:08:19.277728+0000","last_clean":"2023-05-17T15:08:19.277728+0000","last_became_active":"2023-05-17T15:08:18.905999+0000","last_became_peered":"2023-05-17T15:08:18.905999+0000","last_unstale":"2023-05-17T15:08:19.277728+0000","last_undegraded":"2023-05-17T15:08:19.277728+0000","last_fullsized":"2023-05-17T15:08:19.277728+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308640+0000","last_change":"2023-05-17T15:08:19.304015+0000","last_active":"2023-05-17T15:08:19.308640+0000","last_peered":"2023-05-17T15:08:19.308640+0000","last_clean":"2023-05-17T15:08:19.308640+0000","last_became_active":"2023-05-17T15:08:19.303152+0000","last_became_peered":"2023-05-17T15:08:19.303152+0000","last_unstale":"2023-05-17T15:08:19.308640+0000","last_undegraded":"2023-05-17T15:08:19.308640+0000","last_fullsized":"2023-05-17T15:08:19.308640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307112+0000","last_change":"2023-05-17T15:08:18.909953+0000","last_active":"2023-05-17T15:08:19.307112+0000","last_peered":"2023-05-17T15:08:19.307112+0000","last_clean":"2023-05-17T15:08:19.307112+0000","last_became_active":"2023-05-17T15:08:18.909651+0000","last_became_peered":"2023-05-17T15:08:18.909651+0000","last_unstale":"2023-05-17T15:08:19.307112+0000","last_undegraded":"2023-05-17T15:08:19.307112+0000","last_fullsized":"2023-05-17T15:08:19.307112+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.303801+0000","last_change":"2023-05-17T15:08:19.299732+0000","last_active":"2023-05-17T15:08:19.303801+0000","last_peered":"2023-05-17T15:08:19.303801+0000","last_clean":"2023-05-17T15:08:19.303801+0000","last_became_active":"2023-05-17T15:08:19.299395+0000","last_became_peered":"2023-05-17T15:08:19.299395+0000","last_unstale":"2023-05-17T15:08:19.303801+0000","last_undegraded":"2023-05-17T15:08:19.303801+0000","last_fullsized":"2023-05-17T15:08:19.303801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277274+0000","last_change":"2023-05-17T15:08:18.907734+0000","last_active":"2023-05-17T15:08:19.277274+0000","last_peered":"2023-05-17T15:08:19.277274+0000","last_clean":"2023-05-17T15:08:19.277274+0000","last_became_active":"2023-05-17T15:08:18.907160+0000","last_became_peered":"2023-05-17T15:08:18.907160+0000","last_unstale":"2023-05-17T15:08:19.277274+0000","last_undegraded":"2023-05-17T15:08:19.277274+0000","last_fullsized":"2023-05-17T15:08:19.277274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306935+0000","last_change":"2023-05-17T15:08:19.304825+0000","last_active":"2023-05-17T15:08:19.306935+0000","last_peered":"2023-05-17T15:08:19.306935+0000","last_clean":"2023-05-17T15:08:19.306935+0000","last_became_active":"2023-05-17T15:08:19.304548+0000","last_became_peered":"2023-05-17T15:08:19.304548+0000","last_unstale":"2023-05-17T15:08:19.306935+0000","last_undegraded":"2023-05-17T15:08:19.306935+0000","last_fullsized":"2023-05-17T15:08:19.306935+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.296396+0000","last_change":"2023-05-17T15:08:18.911286+0000","last_active":"2023-05-17T15:08:19.296396+0000","last_peered":"2023-05-17T15:08:19.296396+0000","last_clean":"2023-05-17T15:08:19.296396+0000","last_became_active":"2023-05-17T15:08:18.911011+0000","last_became_peered":"2023-05-17T15:08:18.911011+0000","last_unstale":"2023-05-17T15:08:19.296396+0000","last_undegraded":"2023-05-17T15:08:19.296396+0000","last_fullsized":"2023-05-17T15:08:19.296396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307063+0000","last_change":"2023-05-17T15:08:19.302420+0000","last_active":"2023-05-17T15:08:19.307063+0000","last_peered":"2023-05-17T15:08:19.307063+0000","last_clean":"2023-05-17T15:08:19.307063+0000","last_became_active":"2023-05-17T15:08:19.302075+0000","last_became_peered":"2023-05-17T15:08:19.302075+0000","last_unstale":"2023-05-17T15:08:19.307063+0000","last_undegraded":"2023-05-17T15:08:19.307063+0000","last_fullsized":"2023-05-17T15:08:19.307063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.276881+0000","last_change":"2023-05-17T15:08:18.910917+0000","last_active":"2023-05-17T15:08:19.276881+0000","last_peered":"2023-05-17T15:08:19.276881+0000","last_clean":"2023-05-17T15:08:19.276881+0000","last_became_active":"2023-05-17T15:08:18.910568+0000","last_became_peered":"2023-05-17T15:08:18.910568+0000","last_unstale":"2023-05-17T15:08:19.276881+0000","last_undegraded":"2023-05-17T15:08:19.276881+0000","last_fullsized":"2023-05-17T15:08:19.276881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297991+0000","last_change":"2023-05-17T15:08:19.290494+0000","last_active":"2023-05-17T15:08:19.297991+0000","last_peered":"2023-05-17T15:08:19.297991+0000","last_clean":"2023-05-17T15:08:19.297991+0000","last_became_active":"2023-05-17T15:08:19.290150+0000","last_became_peered":"2023-05-17T15:08:19.290150+0000","last_unstale":"2023-05-17T15:08:19.297991+0000","last_undegraded":"2023-05-17T15:08:19.297991+0000","last_fullsized":"2023-05-17T15:08:19.297991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278343+0000","last_change":"2023-05-17T15:08:18.912622+0000","last_active":"2023-05-17T15:08:19.278343+0000","last_peered":"2023-05-17T15:08:19.278343+0000","last_clean":"2023-05-17T15:08:19.278343+0000","last_became_active":"2023-05-17T15:08:18.912374+0000","last_became_peered":"2023-05-17T15:08:18.912374+0000","last_unstale":"2023-05-17T15:08:19.278343+0000","last_undegraded":"2023-05-17T15:08:19.278343+0000","last_fullsized":"2023-05-17T15:08:19.278343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309066+0000","last_change":"2023-05-17T15:08:19.293658+0000","last_active":"2023-05-17T15:08:19.309066+0000","last_peered":"2023-05-17T15:08:19.309066+0000","last_clean":"2023-05-17T15:08:19.309066+0000","last_became_active":"2023-05-17T15:08:19.293155+0000","last_became_peered":"2023-05-17T15:08:19.293155+0000","last_unstale":"2023-05-17T15:08:19.309066+0000","last_undegraded":"2023-05-17T15:08:19.309066+0000","last_fullsized":"2023-05-17T15:08:19.309066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.706110+0000","last_change":"2023-05-17T15:08:18.904182+0000","last_active":"2023-05-17T15:08:19.706110+0000","last_peered":"2023-05-17T15:08:19.706110+0000","last_clean":"2023-05-17T15:08:19.706110+0000","last_became_active":"2023-05-17T15:08:18.903886+0000","last_became_peered":"2023-05-17T15:08:18.903886+0000","last_unstale":"2023-05-17T15:08:19.706110+0000","last_undegraded":"2023-05-17T15:08:19.706110+0000","last_fullsized":"2023-05-17T15:08:19.706110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306633+0000","last_change":"2023-05-17T15:08:19.297079+0000","last_active":"2023-05-17T15:08:19.306633+0000","last_peered":"2023-05-17T15:08:19.306633+0000","last_clean":"2023-05-17T15:08:19.306633+0000","last_became_active":"2023-05-17T15:08:19.296600+0000","last_became_peered":"2023-05-17T15:08:19.296600+0000","last_unstale":"2023-05-17T15:08:19.306633+0000","last_undegraded":"2023-05-17T15:08:19.306633+0000","last_fullsized":"2023-05-17T15:08:19.306633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.275785+0000","last_change":"2023-05-17T15:08:18.899689+0000","last_active":"2023-05-17T15:08:19.275785+0000","last_peered":"2023-05-17T15:08:19.275785+0000","last_clean":"2023-05-17T15:08:19.275785+0000","last_became_active":"2023-05-17T15:08:18.899378+0000","last_became_peered":"2023-05-17T15:08:18.899378+0000","last_unstale":"2023-05-17T15:08:19.275785+0000","last_undegraded":"2023-05-17T15:08:19.275785+0000","last_fullsized":"2023-05-17T15:08:19.275785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307070+0000","last_change":"2023-05-17T15:08:19.302629+0000","last_active":"2023-05-17T15:08:19.307070+0000","last_peered":"2023-05-17T15:08:19.307070+0000","last_clean":"2023-05-17T15:08:19.307070+0000","last_became_active":"2023-05-17T15:08:19.302220+0000","last_became_peered":"2023-05-17T15:08:19.302220+0000","last_unstale":"2023-05-17T15:08:19.307070+0000","last_undegraded":"2023-05-17T15:08:19.307070+0000","last_fullsized":"2023-05-17T15:08:19.307070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278451+0000","last_change":"2023-05-17T15:08:18.904429+0000","last_active":"2023-05-17T15:08:19.278451+0000","last_peered":"2023-05-17T15:08:19.278451+0000","last_clean":"2023-05-17T15:08:19.278451+0000","last_became_active":"2023-05-17T15:08:18.904153+0000","last_became_peered":"2023-05-17T15:08:18.904153+0000","last_unstale":"2023-05-17T15:08:19.278451+0000","last_undegraded":"2023-05-17T15:08:19.278451+0000","last_fullsized":"2023-05-17T15:08:19.278451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290051+0000","last_change":"2023-05-17T15:08:19.287295+0000","last_active":"2023-05-17T15:08:19.290051+0000","last_peered":"2023-05-17T15:08:19.290051+0000","last_clean":"2023-05-17T15:08:19.290051+0000","last_became_active":"2023-05-17T15:08:19.286997+0000","last_became_peered":"2023-05-17T15:08:19.286997+0000","last_unstale":"2023-05-17T15:08:19.290051+0000","last_undegraded":"2023-05-17T15:08:19.290051+0000","last_fullsized":"2023-05-17T15:08:19.290051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277462+0000","last_change":"2023-05-17T15:08:18.902320+0000","last_active":"2023-05-17T15:08:19.277462+0000","last_peered":"2023-05-17T15:08:19.277462+0000","last_clean":"2023-05-17T15:08:19.277462+0000","last_became_active":"2023-05-17T15:08:18.902016+0000","last_became_peered":"2023-05-17T15:08:18.902016+0000","last_unstale":"2023-05-17T15:08:19.277462+0000","last_undegraded":"2023-05-17T15:08:19.277462+0000","last_fullsized":"2023-05-17T15:08:19.277462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308791+0000","last_change":"2023-05-17T15:08:19.291245+0000","last_active":"2023-05-17T15:08:19.308791+0000","last_peered":"2023-05-17T15:08:19.308791+0000","last_clean":"2023-05-17T15:08:19.308791+0000","last_became_active":"2023-05-17T15:08:19.290745+0000","last_became_peered":"2023-05-17T15:08:19.290745+0000","last_unstale":"2023-05-17T15:08:19.308791+0000","last_undegraded":"2023-05-17T15:08:19.308791+0000","last_fullsized":"2023-05-17T15:08:19.308791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298234+0000","last_change":"2023-05-17T15:08:18.908477+0000","last_active":"2023-05-17T15:08:19.298234+0000","last_peered":"2023-05-17T15:08:19.298234+0000","last_clean":"2023-05-17T15:08:19.298234+0000","last_became_active":"2023-05-17T15:08:18.908158+0000","last_became_peered":"2023-05-17T15:08:18.908158+0000","last_unstale":"2023-05-17T15:08:19.298234+0000","last_undegraded":"2023-05-17T15:08:19.298234+0000","last_fullsized":"2023-05-17T15:08:19.298234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.307021+0000","last_change":"2023-05-17T15:08:19.301901+0000","last_active":"2023-05-17T15:08:19.307021+0000","last_peered":"2023-05-17T15:08:19.307021+0000","last_clean":"2023-05-17T15:08:19.307021+0000","last_became_active":"2023-05-17T15:08:19.301540+0000","last_became_peered":"2023-05-17T15:08:19.301540+0000","last_unstale":"2023-05-17T15:08:19.307021+0000","last_undegraded":"2023-05-17T15:08:19.307021+0000","last_fullsized":"2023-05-17T15:08:19.307021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.279401+0000","last_change":"2023-05-17T15:08:18.912608+0000","last_active":"2023-05-17T15:08:19.279401+0000","last_peered":"2023-05-17T15:08:19.279401+0000","last_clean":"2023-05-17T15:08:19.279401+0000","last_became_active":"2023-05-17T15:08:18.912316+0000","last_became_peered":"2023-05-17T15:08:18.912316+0000","last_unstale":"2023-05-17T15:08:19.279401+0000","last_undegraded":"2023-05-17T15:08:19.279401+0000","last_fullsized":"2023-05-17T15:08:19.279401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.316027+0000","last_change":"2023-05-17T15:08:19.310820+0000","last_active":"2023-05-17T15:08:19.316027+0000","last_peered":"2023-05-17T15:08:19.316027+0000","last_clean":"2023-05-17T15:08:19.316027+0000","last_became_active":"2023-05-17T15:08:19.310087+0000","last_became_peered":"2023-05-17T15:08:19.310087+0000","last_unstale":"2023-05-17T15:08:19.316027+0000","last_undegraded":"2023-05-17T15:08:19.316027+0000","last_fullsized":"2023-05-17T15:08:19.316027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.278360+0000","last_change":"2023-05-17T15:08:18.896021+0000","last_active":"2023-05-17T15:08:19.278360+0000","last_peered":"2023-05-17T15:08:19.278360+0000","last_clean":"2023-05-17T15:08:19.278360+0000","last_became_active":"2023-05-17T15:08:18.895723+0000","last_became_peered":"2023-05-17T15:08:18.895723+0000","last_unstale":"2023-05-17T15:08:19.278360+0000","last_undegraded":"2023-05-17T15:08:19.278360+0000","last_fullsized":"2023-05-17T15:08:19.278360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.291520+0000","last_change":"2023-05-17T15:08:19.288752+0000","last_active":"2023-05-17T15:08:19.291520+0000","last_peered":"2023-05-17T15:08:19.291520+0000","last_clean":"2023-05-17T15:08:19.291520+0000","last_became_active":"2023-05-17T15:08:19.286940+0000","last_became_peered":"2023-05-17T15:08:19.286940+0000","last_unstale":"2023-05-17T15:08:19.291520+0000","last_undegraded":"2023-05-17T15:08:19.291520+0000","last_fullsized":"2023-05-17T15:08:19.291520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290042+0000","last_change":"2023-05-17T15:08:18.907691+0000","last_active":"2023-05-17T15:08:19.290042+0000","last_peered":"2023-05-17T15:08:19.290042+0000","last_clean":"2023-05-17T15:08:19.290042+0000","last_became_active":"2023-05-17T15:08:18.907412+0000","last_became_peered":"2023-05-17T15:08:18.907412+0000","last_unstale":"2023-05-17T15:08:19.290042+0000","last_undegraded":"2023-05-17T15:08:19.290042+0000","last_fullsized":"2023-05-17T15:08:19.290042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309111+0000","last_change":"2023-05-17T15:08:19.294895+0000","last_active":"2023-05-17T15:08:19.309111+0000","last_peered":"2023-05-17T15:08:19.309111+0000","last_clean":"2023-05-17T15:08:19.309111+0000","last_became_active":"2023-05-17T15:08:19.294635+0000","last_became_peered":"2023-05-17T15:08:19.294635+0000","last_unstale":"2023-05-17T15:08:19.309111+0000","last_undegraded":"2023-05-17T15:08:19.309111+0000","last_fullsized":"2023-05-17T15:08:19.309111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.294151+0000","last_change":"2023-05-17T15:08:18.905494+0000","last_active":"2023-05-17T15:08:19.294151+0000","last_peered":"2023-05-17T15:08:19.294151+0000","last_clean":"2023-05-17T15:08:19.294151+0000","last_became_active":"2023-05-17T15:08:18.905188+0000","last_became_peered":"2023-05-17T15:08:18.905188+0000","last_unstale":"2023-05-17T15:08:19.294151+0000","last_undegraded":"2023-05-17T15:08:19.294151+0000","last_fullsized":"2023-05-17T15:08:19.294151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.288185+0000","last_change":"2023-05-17T15:08:19.286191+0000","last_active":"2023-05-17T15:08:19.288185+0000","last_peered":"2023-05-17T15:08:19.288185+0000","last_clean":"2023-05-17T15:08:19.288185+0000","last_became_active":"2023-05-17T15:08:19.285940+0000","last_became_peered":"2023-05-17T15:08:19.285940+0000","last_unstale":"2023-05-17T15:08:19.288185+0000","last_undegraded":"2023-05-17T15:08:19.288185+0000","last_fullsized":"2023-05-17T15:08:19.288185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302149+0000","last_change":"2023-05-17T15:08:18.896212+0000","last_active":"2023-05-17T15:08:19.302149+0000","last_peered":"2023-05-17T15:08:19.302149+0000","last_clean":"2023-05-17T15:08:19.302149+0000","last_became_active":"2023-05-17T15:08:18.895083+0000","last_became_peered":"2023-05-17T15:08:18.895083+0000","last_unstale":"2023-05-17T15:08:19.302149+0000","last_undegraded":"2023-05-17T15:08:19.302149+0000","last_fullsized":"2023-05-17T15:08:19.302149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308879+0000","last_change":"2023-05-17T15:08:19.305429+0000","last_active":"2023-05-17T15:08:19.308879+0000","last_peered":"2023-05-17T15:08:19.308879+0000","last_clean":"2023-05-17T15:08:19.308879+0000","last_became_active":"2023-05-17T15:08:19.305098+0000","last_became_peered":"2023-05-17T15:08:19.305098+0000","last_unstale":"2023-05-17T15:08:19.308879+0000","last_undegraded":"2023-05-17T15:08:19.308879+0000","last_fullsized":"2023-05-17T15:08:19.308879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277418+0000","last_change":"2023-05-17T15:08:18.897185+0000","last_active":"2023-05-17T15:08:19.277418+0000","last_peered":"2023-05-17T15:08:19.277418+0000","last_clean":"2023-05-17T15:08:19.277418+0000","last_became_active":"2023-05-17T15:08:18.896913+0000","last_became_peered":"2023-05-17T15:08:18.896913+0000","last_unstale":"2023-05-17T15:08:19.277418+0000","last_undegraded":"2023-05-17T15:08:19.277418+0000","last_fullsized":"2023-05-17T15:08:19.277418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.289902+0000","last_change":"2023-05-17T15:08:19.286233+0000","last_active":"2023-05-17T15:08:19.289902+0000","last_peered":"2023-05-17T15:08:19.289902+0000","last_clean":"2023-05-17T15:08:19.289902+0000","last_became_active":"2023-05-17T15:08:19.285847+0000","last_became_peered":"2023-05-17T15:08:19.285847+0000","last_unstale":"2023-05-17T15:08:19.289902+0000","last_undegraded":"2023-05-17T15:08:19.289902+0000","last_fullsized":"2023-05-17T15:08:19.289902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277564+0000","last_change":"2023-05-17T15:08:18.899682+0000","last_active":"2023-05-17T15:08:19.277564+0000","last_peered":"2023-05-17T15:08:19.277564+0000","last_clean":"2023-05-17T15:08:19.277564+0000","last_became_active":"2023-05-17T15:08:18.899390+0000","last_became_peered":"2023-05-17T15:08:18.899390+0000","last_unstale":"2023-05-17T15:08:19.277564+0000","last_undegraded":"2023-05-17T15:08:19.277564+0000","last_fullsized":"2023-05-17T15:08:19.277564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298037+0000","last_change":"2023-05-17T15:08:19.291445+0000","last_active":"2023-05-17T15:08:19.298037+0000","last_peered":"2023-05-17T15:08:19.298037+0000","last_clean":"2023-05-17T15:08:19.298037+0000","last_became_active":"2023-05-17T15:08:19.291178+0000","last_became_peered":"2023-05-17T15:08:19.291178+0000","last_unstale":"2023-05-17T15:08:19.298037+0000","last_undegraded":"2023-05-17T15:08:19.298037+0000","last_fullsized":"2023-05-17T15:08:19.298037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277374+0000","last_change":"2023-05-17T15:08:18.908919+0000","last_active":"2023-05-17T15:08:19.277374+0000","last_peered":"2023-05-17T15:08:19.277374+0000","last_clean":"2023-05-17T15:08:19.277374+0000","last_became_active":"2023-05-17T15:08:18.907484+0000","last_became_peered":"2023-05-17T15:08:18.907484+0000","last_unstale":"2023-05-17T15:08:19.277374+0000","last_undegraded":"2023-05-17T15:08:19.277374+0000","last_fullsized":"2023-05-17T15:08:19.277374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298833+0000","last_change":"2023-05-17T15:08:19.293191+0000","last_active":"2023-05-17T15:08:19.298833+0000","last_peered":"2023-05-17T15:08:19.298833+0000","last_clean":"2023-05-17T15:08:19.298833+0000","last_became_active":"2023-05-17T15:08:19.292536+0000","last_became_peered":"2023-05-17T15:08:19.292536+0000","last_unstale":"2023-05-17T15:08:19.298833+0000","last_undegraded":"2023-05-17T15:08:19.298833+0000","last_fullsized":"2023-05-17T15:08:19.298833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277081+0000","last_change":"2023-05-17T15:08:18.902684+0000","last_active":"2023-05-17T15:08:19.277081+0000","last_peered":"2023-05-17T15:08:19.277081+0000","last_clean":"2023-05-17T15:08:19.277081+0000","last_became_active":"2023-05-17T15:08:18.902022+0000","last_became_peered":"2023-05-17T15:08:18.902022+0000","last_unstale":"2023-05-17T15:08:19.277081+0000","last_undegraded":"2023-05-17T15:08:19.277081+0000","last_fullsized":"2023-05-17T15:08:19.277081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297877+0000","last_change":"2023-05-17T15:08:19.291581+0000","last_active":"2023-05-17T15:08:19.297877+0000","last_peered":"2023-05-17T15:08:19.297877+0000","last_clean":"2023-05-17T15:08:19.297877+0000","last_became_active":"2023-05-17T15:08:19.290760+0000","last_became_peered":"2023-05-17T15:08:19.290760+0000","last_unstale":"2023-05-17T15:08:19.297877+0000","last_undegraded":"2023-05-17T15:08:19.297877+0000","last_fullsized":"2023-05-17T15:08:19.297877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277025+0000","last_change":"2023-05-17T15:08:18.906313+0000","last_active":"2023-05-17T15:08:19.277025+0000","last_peered":"2023-05-17T15:08:19.277025+0000","last_clean":"2023-05-17T15:08:19.277025+0000","last_became_active":"2023-05-17T15:08:18.906018+0000","last_became_peered":"2023-05-17T15:08:18.906018+0000","last_unstale":"2023-05-17T15:08:19.277025+0000","last_undegraded":"2023-05-17T15:08:19.277025+0000","last_fullsized":"2023-05-17T15:08:19.277025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.292498+0000","last_change":"2023-05-17T15:08:19.289245+0000","last_active":"2023-05-17T15:08:19.292498+0000","last_peered":"2023-05-17T15:08:19.292498+0000","last_clean":"2023-05-17T15:08:19.292498+0000","last_became_active":"2023-05-17T15:08:19.288765+0000","last_became_peered":"2023-05-17T15:08:19.288765+0000","last_unstale":"2023-05-17T15:08:19.292498+0000","last_undegraded":"2023-05-17T15:08:19.292498+0000","last_fullsized":"2023-05-17T15:08:19.292498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298650+0000","last_change":"2023-05-17T15:08:18.912684+0000","last_active":"2023-05-17T15:08:19.298650+0000","last_peered":"2023-05-17T15:08:19.298650+0000","last_clean":"2023-05-17T15:08:19.298650+0000","last_became_active":"2023-05-17T15:08:18.912441+0000","last_became_peered":"2023-05-17T15:08:18.912441+0000","last_unstale":"2023-05-17T15:08:19.298650+0000","last_undegraded":"2023-05-17T15:08:19.298650+0000","last_fullsized":"2023-05-17T15:08:19.298650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298263+0000","last_change":"2023-05-17T15:08:19.296905+0000","last_active":"2023-05-17T15:08:19.298263+0000","last_peered":"2023-05-17T15:08:19.298263+0000","last_clean":"2023-05-17T15:08:19.298263+0000","last_became_active":"2023-05-17T15:08:19.296577+0000","last_became_peered":"2023-05-17T15:08:19.296577+0000","last_unstale":"2023-05-17T15:08:19.298263+0000","last_undegraded":"2023-05-17T15:08:19.298263+0000","last_fullsized":"2023-05-17T15:08:19.298263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282523+0000","last_change":"2023-05-17T15:08:18.912324+0000","last_active":"2023-05-17T15:08:19.282523+0000","last_peered":"2023-05-17T15:08:19.282523+0000","last_clean":"2023-05-17T15:08:19.282523+0000","last_became_active":"2023-05-17T15:08:18.911979+0000","last_became_peered":"2023-05-17T15:08:18.911979+0000","last_unstale":"2023-05-17T15:08:19.282523+0000","last_undegraded":"2023-05-17T15:08:19.282523+0000","last_fullsized":"2023-05-17T15:08:19.282523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.304704+0000","last_change":"2023-05-17T15:08:19.298279+0000","last_active":"2023-05-17T15:08:19.304704+0000","last_peered":"2023-05-17T15:08:19.304704+0000","last_clean":"2023-05-17T15:08:19.304704+0000","last_became_active":"2023-05-17T15:08:19.297839+0000","last_became_peered":"2023-05-17T15:08:19.297839+0000","last_unstale":"2023-05-17T15:08:19.304704+0000","last_undegraded":"2023-05-17T15:08:19.304704+0000","last_fullsized":"2023-05-17T15:08:19.304704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309923+0000","last_change":"2023-05-17T15:08:18.913413+0000","last_active":"2023-05-17T15:08:19.309923+0000","last_peered":"2023-05-17T15:08:19.309923+0000","last_clean":"2023-05-17T15:08:19.309923+0000","last_became_active":"2023-05-17T15:08:18.912425+0000","last_became_peered":"2023-05-17T15:08:18.912425+0000","last_unstale":"2023-05-17T15:08:19.309923+0000","last_undegraded":"2023-05-17T15:08:19.309923+0000","last_fullsized":"2023-05-17T15:08:19.309923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.308870+0000","last_change":"2023-05-17T15:08:19.290916+0000","last_active":"2023-05-17T15:08:19.308870+0000","last_peered":"2023-05-17T15:08:19.308870+0000","last_clean":"2023-05-17T15:08:19.308870+0000","last_became_active":"2023-05-17T15:08:19.290590+0000","last_became_peered":"2023-05-17T15:08:19.290590+0000","last_unstale":"2023-05-17T15:08:19.308870+0000","last_undegraded":"2023-05-17T15:08:19.308870+0000","last_fullsized":"2023-05-17T15:08:19.308870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.299328+0000","last_change":"2023-05-17T15:08:18.903216+0000","last_active":"2023-05-17T15:08:19.299328+0000","last_peered":"2023-05-17T15:08:19.299328+0000","last_clean":"2023-05-17T15:08:19.299328+0000","last_became_active":"2023-05-17T15:08:18.902750+0000","last_became_peered":"2023-05-17T15:08:18.902750+0000","last_unstale":"2023-05-17T15:08:19.299328+0000","last_undegraded":"2023-05-17T15:08:19.299328+0000","last_fullsized":"2023-05-17T15:08:19.299328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309021+0000","last_change":"2023-05-17T15:08:19.293182+0000","last_active":"2023-05-17T15:08:19.309021+0000","last_peered":"2023-05-17T15:08:19.309021+0000","last_clean":"2023-05-17T15:08:19.309021+0000","last_became_active":"2023-05-17T15:08:19.292862+0000","last_became_peered":"2023-05-17T15:08:19.292862+0000","last_unstale":"2023-05-17T15:08:19.309021+0000","last_undegraded":"2023-05-17T15:08:19.309021+0000","last_fullsized":"2023-05-17T15:08:19.309021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306114+0000","last_change":"2023-05-17T15:08:18.910396+0000","last_active":"2023-05-17T15:08:19.306114+0000","last_peered":"2023-05-17T15:08:19.306114+0000","last_clean":"2023-05-17T15:08:19.306114+0000","last_became_active":"2023-05-17T15:08:18.910151+0000","last_became_peered":"2023-05-17T15:08:18.910151+0000","last_unstale":"2023-05-17T15:08:19.306114+0000","last_undegraded":"2023-05-17T15:08:19.306114+0000","last_fullsized":"2023-05-17T15:08:19.306114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306699+0000","last_change":"2023-05-17T15:08:19.297484+0000","last_active":"2023-05-17T15:08:19.306699+0000","last_peered":"2023-05-17T15:08:19.306699+0000","last_clean":"2023-05-17T15:08:19.306699+0000","last_became_active":"2023-05-17T15:08:19.296951+0000","last_became_peered":"2023-05-17T15:08:19.296951+0000","last_unstale":"2023-05-17T15:08:19.306699+0000","last_undegraded":"2023-05-17T15:08:19.306699+0000","last_fullsized":"2023-05-17T15:08:19.306699+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.286927+0000","last_change":"2023-05-17T15:08:18.902500+0000","last_active":"2023-05-17T15:08:19.286927+0000","last_peered":"2023-05-17T15:08:19.286927+0000","last_clean":"2023-05-17T15:08:19.286927+0000","last_became_active":"2023-05-17T15:08:18.902198+0000","last_became_peered":"2023-05-17T15:08:18.902198+0000","last_unstale":"2023-05-17T15:08:19.286927+0000","last_undegraded":"2023-05-17T15:08:19.286927+0000","last_fullsized":"2023-05-17T15:08:19.286927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293643+0000","last_change":"2023-05-17T15:08:19.291015+0000","last_active":"2023-05-17T15:08:19.293643+0000","last_peered":"2023-05-17T15:08:19.293643+0000","last_clean":"2023-05-17T15:08:19.293643+0000","last_became_active":"2023-05-17T15:08:19.290703+0000","last_became_peered":"2023-05-17T15:08:19.290703+0000","last_unstale":"2023-05-17T15:08:19.293643+0000","last_undegraded":"2023-05-17T15:08:19.293643+0000","last_fullsized":"2023-05-17T15:08:19.293643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.296724+0000","last_change":"2023-05-17T15:08:18.911447+0000","last_active":"2023-05-17T15:08:19.296724+0000","last_peered":"2023-05-17T15:08:19.296724+0000","last_clean":"2023-05-17T15:08:19.296724+0000","last_became_active":"2023-05-17T15:08:18.911120+0000","last_became_peered":"2023-05-17T15:08:18.911120+0000","last_unstale":"2023-05-17T15:08:19.296724+0000","last_undegraded":"2023-05-17T15:08:19.296724+0000","last_fullsized":"2023-05-17T15:08:19.296724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.303000+0000","last_change":"2023-05-17T15:08:19.300008+0000","last_active":"2023-05-17T15:08:19.303000+0000","last_peered":"2023-05-17T15:08:19.303000+0000","last_clean":"2023-05-17T15:08:19.303000+0000","last_became_active":"2023-05-17T15:08:19.299709+0000","last_became_peered":"2023-05-17T15:08:19.299709+0000","last_unstale":"2023-05-17T15:08:19.303000+0000","last_undegraded":"2023-05-17T15:08:19.303000+0000","last_fullsized":"2023-05-17T15:08:19.303000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297088+0000","last_change":"2023-05-17T15:08:18.908352+0000","last_active":"2023-05-17T15:08:19.297088+0000","last_peered":"2023-05-17T15:08:19.297088+0000","last_clean":"2023-05-17T15:08:19.297088+0000","last_became_active":"2023-05-17T15:08:18.908040+0000","last_became_peered":"2023-05-17T15:08:18.908040+0000","last_unstale":"2023-05-17T15:08:19.297088+0000","last_undegraded":"2023-05-17T15:08:19.297088+0000","last_fullsized":"2023-05-17T15:08:19.297088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298180+0000","last_change":"2023-05-17T15:08:19.293286+0000","last_active":"2023-05-17T15:08:19.298180+0000","last_peered":"2023-05-17T15:08:19.298180+0000","last_clean":"2023-05-17T15:08:19.298180+0000","last_became_active":"2023-05-17T15:08:19.293082+0000","last_became_peered":"2023-05-17T15:08:19.293082+0000","last_unstale":"2023-05-17T15:08:19.298180+0000","last_undegraded":"2023-05-17T15:08:19.298180+0000","last_fullsized":"2023-05-17T15:08:19.298180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.303936+0000","last_change":"2023-05-17T15:08:18.905162+0000","last_active":"2023-05-17T15:08:19.303936+0000","last_peered":"2023-05-17T15:08:19.303936+0000","last_clean":"2023-05-17T15:08:19.303936+0000","last_became_active":"2023-05-17T15:08:18.904829+0000","last_became_peered":"2023-05-17T15:08:18.904829+0000","last_unstale":"2023-05-17T15:08:19.303936+0000","last_undegraded":"2023-05-17T15:08:19.303936+0000","last_fullsized":"2023-05-17T15:08:19.303936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.289987+0000","last_change":"2023-05-17T15:08:19.287359+0000","last_active":"2023-05-17T15:08:19.289987+0000","last_peered":"2023-05-17T15:08:19.289987+0000","last_clean":"2023-05-17T15:08:19.289987+0000","last_became_active":"2023-05-17T15:08:19.286801+0000","last_became_peered":"2023-05-17T15:08:19.286801+0000","last_unstale":"2023-05-17T15:08:19.289987+0000","last_undegraded":"2023-05-17T15:08:19.289987+0000","last_fullsized":"2023-05-17T15:08:19.289987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.294616+0000","last_change":"2023-05-17T15:08:18.904328+0000","last_active":"2023-05-17T15:08:19.294616+0000","last_peered":"2023-05-17T15:08:19.294616+0000","last_clean":"2023-05-17T15:08:19.294616+0000","last_became_active":"2023-05-17T15:08:18.904058+0000","last_became_peered":"2023-05-17T15:08:18.904058+0000","last_unstale":"2023-05-17T15:08:19.294616+0000","last_undegraded":"2023-05-17T15:08:19.294616+0000","last_fullsized":"2023-05-17T15:08:19.294616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306333+0000","last_change":"2023-05-17T15:08:19.296943+0000","last_active":"2023-05-17T15:08:19.306333+0000","last_peered":"2023-05-17T15:08:19.306333+0000","last_clean":"2023-05-17T15:08:19.306333+0000","last_became_active":"2023-05-17T15:08:19.296529+0000","last_became_peered":"2023-05-17T15:08:19.296529+0000","last_unstale":"2023-05-17T15:08:19.306333+0000","last_undegraded":"2023-05-17T15:08:19.306333+0000","last_fullsized":"2023-05-17T15:08:19.306333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.275990+0000","last_change":"2023-05-17T15:08:18.895653+0000","last_active":"2023-05-17T15:08:19.275990+0000","last_peered":"2023-05-17T15:08:19.275990+0000","last_clean":"2023-05-17T15:08:19.275990+0000","last_became_active":"2023-05-17T15:08:18.894704+0000","last_became_peered":"2023-05-17T15:08:18.894704+0000","last_unstale":"2023-05-17T15:08:19.275990+0000","last_undegraded":"2023-05-17T15:08:19.275990+0000","last_fullsized":"2023-05-17T15:08:19.275990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293680+0000","last_change":"2023-05-17T15:08:19.290083+0000","last_active":"2023-05-17T15:08:19.293680+0000","last_peered":"2023-05-17T15:08:19.293680+0000","last_clean":"2023-05-17T15:08:19.293680+0000","last_became_active":"2023-05-17T15:08:19.289698+0000","last_became_peered":"2023-05-17T15:08:19.289698+0000","last_unstale":"2023-05-17T15:08:19.293680+0000","last_undegraded":"2023-05-17T15:08:19.293680+0000","last_fullsized":"2023-05-17T15:08:19.293680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282224+0000","last_change":"2023-05-17T15:08:18.903034+0000","last_active":"2023-05-17T15:08:19.282224+0000","last_peered":"2023-05-17T15:08:19.282224+0000","last_clean":"2023-05-17T15:08:19.282224+0000","last_became_active":"2023-05-17T15:08:18.901993+0000","last_became_peered":"2023-05-17T15:08:18.901993+0000","last_unstale":"2023-05-17T15:08:19.282224+0000","last_undegraded":"2023-05-17T15:08:19.282224+0000","last_fullsized":"2023-05-17T15:08:19.282224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.291484+0000","last_change":"2023-05-17T15:08:19.287664+0000","last_active":"2023-05-17T15:08:19.291484+0000","last_peered":"2023-05-17T15:08:19.291484+0000","last_clean":"2023-05-17T15:08:19.291484+0000","last_became_active":"2023-05-17T15:08:19.286887+0000","last_became_peered":"2023-05-17T15:08:19.286887+0000","last_unstale":"2023-05-17T15:08:19.291484+0000","last_undegraded":"2023-05-17T15:08:19.291484+0000","last_fullsized":"2023-05-17T15:08:19.291484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.297964+0000","last_change":"2023-05-17T15:08:18.911966+0000","last_active":"2023-05-17T15:08:19.297964+0000","last_peered":"2023-05-17T15:08:19.297964+0000","last_clean":"2023-05-17T15:08:19.297964+0000","last_became_active":"2023-05-17T15:08:18.911688+0000","last_became_peered":"2023-05-17T15:08:18.911688+0000","last_unstale":"2023-05-17T15:08:19.297964+0000","last_undegraded":"2023-05-17T15:08:19.297964+0000","last_fullsized":"2023-05-17T15:08:19.297964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309224+0000","last_change":"2023-05-17T15:08:19.298269+0000","last_active":"2023-05-17T15:08:19.309224+0000","last_peered":"2023-05-17T15:08:19.309224+0000","last_clean":"2023-05-17T15:08:19.309224+0000","last_became_active":"2023-05-17T15:08:19.298002+0000","last_became_peered":"2023-05-17T15:08:19.298002+0000","last_unstale":"2023-05-17T15:08:19.309224+0000","last_undegraded":"2023-05-17T15:08:19.309224+0000","last_fullsized":"2023-05-17T15:08:19.309224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277496+0000","last_change":"2023-05-17T15:08:18.905571+0000","last_active":"2023-05-17T15:08:19.277496+0000","last_peered":"2023-05-17T15:08:19.277496+0000","last_clean":"2023-05-17T15:08:19.277496+0000","last_became_active":"2023-05-17T15:08:18.905052+0000","last_became_peered":"2023-05-17T15:08:18.905052+0000","last_unstale":"2023-05-17T15:08:19.277496+0000","last_undegraded":"2023-05-17T15:08:19.277496+0000","last_fullsized":"2023-05-17T15:08:19.277496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298022+0000","last_change":"2023-05-17T15:08:19.291411+0000","last_active":"2023-05-17T15:08:19.298022+0000","last_peered":"2023-05-17T15:08:19.298022+0000","last_clean":"2023-05-17T15:08:19.298022+0000","last_became_active":"2023-05-17T15:08:19.291171+0000","last_became_peered":"2023-05-17T15:08:19.291171+0000","last_unstale":"2023-05-17T15:08:19.298022+0000","last_undegraded":"2023-05-17T15:08:19.298022+0000","last_fullsized":"2023-05-17T15:08:19.298022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277192+0000","last_change":"2023-05-17T15:08:18.902853+0000","last_active":"2023-05-17T15:08:19.277192+0000","last_peered":"2023-05-17T15:08:19.277192+0000","last_clean":"2023-05-17T15:08:19.277192+0000","last_became_active":"2023-05-17T15:08:18.902447+0000","last_became_peered":"2023-05-17T15:08:18.902447+0000","last_unstale":"2023-05-17T15:08:19.277192+0000","last_undegraded":"2023-05-17T15:08:19.277192+0000","last_fullsized":"2023-05-17T15:08:19.277192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302838+0000","last_change":"2023-05-17T15:08:19.297573+0000","last_active":"2023-05-17T15:08:19.302838+0000","last_peered":"2023-05-17T15:08:19.302838+0000","last_clean":"2023-05-17T15:08:19.302838+0000","last_became_active":"2023-05-17T15:08:19.297269+0000","last_became_peered":"2023-05-17T15:08:19.297269+0000","last_unstale":"2023-05-17T15:08:19.302838+0000","last_undegraded":"2023-05-17T15:08:19.302838+0000","last_fullsized":"2023-05-17T15:08:19.302838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.281320+0000","last_change":"2023-05-17T15:08:18.896413+0000","last_active":"2023-05-17T15:08:19.281320+0000","last_peered":"2023-05-17T15:08:19.281320+0000","last_clean":"2023-05-17T15:08:19.281320+0000","last_became_active":"2023-05-17T15:08:18.896113+0000","last_became_peered":"2023-05-17T15:08:18.896113+0000","last_unstale":"2023-05-17T15:08:19.281320+0000","last_undegraded":"2023-05-17T15:08:19.281320+0000","last_fullsized":"2023-05-17T15:08:19.281320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.313638+0000","last_change":"2023-05-17T15:08:19.310595+0000","last_active":"2023-05-17T15:08:19.313638+0000","last_peered":"2023-05-17T15:08:19.313638+0000","last_clean":"2023-05-17T15:08:19.313638+0000","last_became_active":"2023-05-17T15:08:19.310327+0000","last_became_peered":"2023-05-17T15:08:19.310327+0000","last_unstale":"2023-05-17T15:08:19.313638+0000","last_undegraded":"2023-05-17T15:08:19.313638+0000","last_fullsized":"2023-05-17T15:08:19.313638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.302024+0000","last_change":"2023-05-17T15:08:18.903669+0000","last_active":"2023-05-17T15:08:19.302024+0000","last_peered":"2023-05-17T15:08:19.302024+0000","last_clean":"2023-05-17T15:08:19.302024+0000","last_became_active":"2023-05-17T15:08:18.903362+0000","last_became_peered":"2023-05-17T15:08:18.903362+0000","last_unstale":"2023-05-17T15:08:19.302024+0000","last_undegraded":"2023-05-17T15:08:19.302024+0000","last_fullsized":"2023-05-17T15:08:19.302024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.282069+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:19.282069+0000","last_peered":"2023-05-17T15:08:19.282069+0000","last_clean":"2023-05-17T15:08:19.282069+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:19.282069+0000","last_undegraded":"2023-05-17T15:08:19.282069+0000","last_fullsized":"2023-05-17T15:08:19.282069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298861+0000","last_change":"2023-05-17T15:08:19.293362+0000","last_active":"2023-05-17T15:08:19.298861+0000","last_peered":"2023-05-17T15:08:19.298861+0000","last_clean":"2023-05-17T15:08:19.298861+0000","last_became_active":"2023-05-17T15:08:19.292870+0000","last_became_peered":"2023-05-17T15:08:19.292870+0000","last_unstale":"2023-05-17T15:08:19.298861+0000","last_undegraded":"2023-05-17T15:08:19.298861+0000","last_fullsized":"2023-05-17T15:08:19.298861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.275800+0000","last_change":"2023-05-17T15:08:18.905697+0000","last_active":"2023-05-17T15:08:19.275800+0000","last_peered":"2023-05-17T15:08:19.275800+0000","last_clean":"2023-05-17T15:08:19.275800+0000","last_became_active":"2023-05-17T15:08:18.905379+0000","last_became_peered":"2023-05-17T15:08:18.905379+0000","last_unstale":"2023-05-17T15:08:19.275800+0000","last_undegraded":"2023-05-17T15:08:19.275800+0000","last_fullsized":"2023-05-17T15:08:19.275800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.287093+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:19.287093+0000","last_peered":"2023-05-17T15:08:19.287093+0000","last_clean":"2023-05-17T15:08:19.287093+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:19.287093+0000","last_undegraded":"2023-05-17T15:08:19.287093+0000","last_fullsized":"2023-05-17T15:08:19.287093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.306678+0000","last_change":"2023-05-17T15:08:19.297249+0000","last_active":"2023-05-17T15:08:19.306678+0000","last_peered":"2023-05-17T15:08:19.306678+0000","last_clean":"2023-05-17T15:08:19.306678+0000","last_became_active":"2023-05-17T15:08:19.296625+0000","last_became_peered":"2023-05-17T15:08:19.296625+0000","last_unstale":"2023-05-17T15:08:19.306678+0000","last_undegraded":"2023-05-17T15:08:19.306678+0000","last_fullsized":"2023-05-17T15:08:19.306678+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.287068+0000","last_change":"2023-05-17T15:08:18.902285+0000","last_active":"2023-05-17T15:08:19.287068+0000","last_peered":"2023-05-17T15:08:19.287068+0000","last_clean":"2023-05-17T15:08:19.287068+0000","last_became_active":"2023-05-17T15:08:18.901984+0000","last_became_peered":"2023-05-17T15:08:18.901984+0000","last_unstale":"2023-05-17T15:08:19.287068+0000","last_undegraded":"2023-05-17T15:08:19.287068+0000","last_fullsized":"2023-05-17T15:08:19.287068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.279484+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:19.279484+0000","last_peered":"2023-05-17T15:08:19.279484+0000","last_clean":"2023-05-17T15:08:19.279484+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:19.279484+0000","last_undegraded":"2023-05-17T15:08:19.279484+0000","last_fullsized":"2023-05-17T15:08:19.279484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.290291+0000","last_change":"2023-05-17T15:08:19.285948+0000","last_active":"2023-05-17T15:08:19.290291+0000","last_peered":"2023-05-17T15:08:19.290291+0000","last_clean":"2023-05-17T15:08:19.290291+0000","last_became_active":"2023-05-17T15:08:19.284428+0000","last_became_peered":"2023-05-17T15:08:19.284428+0000","last_unstale":"2023-05-17T15:08:19.290291+0000","last_undegraded":"2023-05-17T15:08:19.290291+0000","last_fullsized":"2023-05-17T15:08:19.290291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277034+0000","last_change":"2023-05-17T15:08:18.910068+0000","last_active":"2023-05-17T15:08:19.277034+0000","last_peered":"2023-05-17T15:08:19.277034+0000","last_clean":"2023-05-17T15:08:19.277034+0000","last_became_active":"2023-05-17T15:08:18.908009+0000","last_became_peered":"2023-05-17T15:08:18.908009+0000","last_unstale":"2023-05-17T15:08:19.277034+0000","last_undegraded":"2023-05-17T15:08:19.277034+0000","last_fullsized":"2023-05-17T15:08:19.277034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.287416+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:19.287416+0000","last_peered":"2023-05-17T15:08:19.287416+0000","last_clean":"2023-05-17T15:08:19.287416+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:19.287416+0000","last_undegraded":"2023-05-17T15:08:19.287416+0000","last_fullsized":"2023-05-17T15:08:19.287416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.295541+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:19.295541+0000","last_peered":"2023-05-17T15:08:19.295541+0000","last_clean":"2023-05-17T15:08:19.295541+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:19.295541+0000","last_undegraded":"2023-05-17T15:08:19.295541+0000","last_fullsized":"2023-05-17T15:08:19.295541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.288267+0000","last_change":"2023-05-17T15:08:19.286888+0000","last_active":"2023-05-17T15:08:19.288267+0000","last_peered":"2023-05-17T15:08:19.288267+0000","last_clean":"2023-05-17T15:08:19.288267+0000","last_became_active":"2023-05-17T15:08:19.286689+0000","last_became_peered":"2023-05-17T15:08:19.286689+0000","last_unstale":"2023-05-17T15:08:19.288267+0000","last_undegraded":"2023-05-17T15:08:19.288267+0000","last_fullsized":"2023-05-17T15:08:19.288267+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.292540+0000","last_change":"2023-05-17T15:08:18.910475+0000","last_active":"2023-05-17T15:08:19.292540+0000","last_peered":"2023-05-17T15:08:19.292540+0000","last_clean":"2023-05-17T15:08:19.292540+0000","last_became_active":"2023-05-17T15:08:18.910197+0000","last_became_peered":"2023-05-17T15:08:18.910197+0000","last_unstale":"2023-05-17T15:08:19.292540+0000","last_undegraded":"2023-05-17T15:08:19.292540+0000","last_fullsized":"2023-05-17T15:08:19.292540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298119+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:19.298119+0000","last_peered":"2023-05-17T15:08:19.298119+0000","last_clean":"2023-05-17T15:08:19.298119+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:19.298119+0000","last_undegraded":"2023-05-17T15:08:19.298119+0000","last_fullsized":"2023-05-17T15:08:19.298119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.304732+0000","last_change":"2023-05-17T15:08:19.300984+0000","last_active":"2023-05-17T15:08:19.304732+0000","last_peered":"2023-05-17T15:08:19.304732+0000","last_clean":"2023-05-17T15:08:19.304732+0000","last_became_active":"2023-05-17T15:08:19.300659+0000","last_became_peered":"2023-05-17T15:08:19.300659+0000","last_unstale":"2023-05-17T15:08:19.304732+0000","last_undegraded":"2023-05-17T15:08:19.304732+0000","last_fullsized":"2023-05-17T15:08:19.304732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309674+0000","last_change":"2023-05-17T15:08:18.913201+0000","last_active":"2023-05-17T15:08:19.309674+0000","last_peered":"2023-05-17T15:08:19.309674+0000","last_clean":"2023-05-17T15:08:19.309674+0000","last_became_active":"2023-05-17T15:08:18.912907+0000","last_became_peered":"2023-05-17T15:08:18.912907+0000","last_unstale":"2023-05-17T15:08:19.309674+0000","last_undegraded":"2023-05-17T15:08:19.309674+0000","last_fullsized":"2023-05-17T15:08:19.309674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298872+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:19.298872+0000","last_peered":"2023-05-17T15:08:19.298872+0000","last_clean":"2023-05-17T15:08:19.298872+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:19.298872+0000","last_undegraded":"2023-05-17T15:08:19.298872+0000","last_fullsized":"2023-05-17T15:08:19.298872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.309193+0000","last_change":"2023-05-17T15:08:19.295679+0000","last_active":"2023-05-17T15:08:19.309193+0000","last_peered":"2023-05-17T15:08:19.309193+0000","last_clean":"2023-05-17T15:08:19.309193+0000","last_became_active":"2023-05-17T15:08:19.295181+0000","last_became_peered":"2023-05-17T15:08:19.295181+0000","last_unstale":"2023-05-17T15:08:19.309193+0000","last_undegraded":"2023-05-17T15:08:19.309193+0000","last_fullsized":"2023-05-17T15:08:19.309193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.298740+0000","last_change":"2023-05-17T15:08:18.912764+0000","last_active":"2023-05-17T15:08:19.298740+0000","last_peered":"2023-05-17T15:08:19.298740+0000","last_clean":"2023-05-17T15:08:19.298740+0000","last_became_active":"2023-05-17T15:08:18.912413+0000","last_became_peered":"2023-05-17T15:08:18.912413+0000","last_unstale":"2023-05-17T15:08:19.298740+0000","last_undegraded":"2023-05-17T15:08:19.298740+0000","last_fullsized":"2023-05-17T15:08:19.298740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.280814+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:19.280814+0000","last_peered":"2023-05-17T15:08:19.280814+0000","last_clean":"2023-05-17T15:08:19.280814+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:19.280814+0000","last_undegraded":"2023-05-17T15:08:19.280814+0000","last_fullsized":"2023-05-17T15:08:19.280814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.293670+0000","last_change":"2023-05-17T15:08:19.289908+0000","last_active":"2023-05-17T15:08:19.293670+0000","last_peered":"2023-05-17T15:08:19.293670+0000","last_clean":"2023-05-17T15:08:19.293670+0000","last_became_active":"2023-05-17T15:08:19.289473+0000","last_became_peered":"2023-05-17T15:08:19.289473+0000","last_unstale":"2023-05-17T15:08:19.293670+0000","last_undegraded":"2023-05-17T15:08:19.293670+0000","last_fullsized":"2023-05-17T15:08:19.293670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:18.877856+0000","last_clean_scrub_stamp":"2023-05-17T15:08:18.877856+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277787+0000","last_change":"2023-05-17T15:08:18.898040+0000","last_active":"2023-05-17T15:08:19.277787+0000","last_peered":"2023-05-17T15:08:19.277787+0000","last_clean":"2023-05-17T15:08:19.277787+0000","last_became_active":"2023-05-17T15:08:18.897780+0000","last_became_peered":"2023-05-17T15:08:18.897780+0000","last_unstale":"2023-05-17T15:08:19.277787+0000","last_undegraded":"2023-05-17T15:08:19.277787+0000","last_fullsized":"2023-05-17T15:08:19.277787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:17.875951+0000","last_clean_scrub_stamp":"2023-05-17T15:08:17.875951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-17T15:08:19.277302+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:19.277302+0000","last_peered":"2023-05-17T15:08:19.277302+0000","last_clean":"2023-05-17T15:08:19.277302+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:19.277302+0000","last_undegraded":"2023-05-17T15:08:19.277302+0000","last_fullsized":"2023-05-17T15:08:19.277302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575024,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17064,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94354776,"statfs":{"total":96636764160,"available":96619290624,"internally_reserved":0,"allocated":1015808,"data_stored":502899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.75600000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85299999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.81899999999999995}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.90800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575025,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16416,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355424,"statfs":{"total":96636764160,"available":96619954176,"internally_reserved":0,"allocated":1007616,"data_stored":501917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.502}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.629}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575025,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16300,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355540,"statfs":{"total":96636764160,"available":96620072960,"internally_reserved":0,"allocated":1019904,"data_stored":502639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.755,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.65700000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46400000000000002,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":1.956,"15min":1.956},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.64800000000000002,"5min":1.149,"15min":1.149},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.57599999999999996,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":0.76400000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.378},"max":{"1min":0.82299999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":1.103,"15min":1.6100000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.64900000000000002},"min":{"1min":0.54800000000000004,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.54900000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.524,"15min":1.524},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68899999999999995,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834575025,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16092,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355748,"statfs":{"total":96636764160,"available":96620285952,"internally_reserved":0,"allocated":1003520,"data_stored":501883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.309}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.45000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575024,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17444,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94354396,"statfs":{"total":96636764160,"available":96618901504,"internally_reserved":0,"allocated":1011712,"data_stored":502507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.38200000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.31},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34699999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.65000000000000002}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.624}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575025,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20388,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":19392,"kb_avail":94351452,"statfs":{"total":96636764160,"available":96615886848,"internally_reserved":0,"allocated":1011712,"data_stored":502507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19857408},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.29899999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834575024,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16676,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":15680,"kb_avail":94355164,"statfs":{"total":96636764160,"available":96619687936,"internally_reserved":0,"allocated":1011712,"data_stored":502527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16056320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.77600000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.745}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.65000000000000002}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.48899999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.438},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575024,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20004,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94351836,"statfs":{"total":96636764160,"available":96616280064,"internally_reserved":0,"allocated":1011712,"data_stored":502797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.496}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.625},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:28.155 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:08:28.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:08:28.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.307+0000 7feac628b700 1 Processor -- start 2023-05-17T15:08:28.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.307+0000 7feac628b700 1 -- start start 2023-05-17T15:08:28.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feac628b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 0x7feac015f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feac628b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00c0c90 con 0x7feac00c6310 2023-05-17T15:08:28.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feac628b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac0158790 con 0x7feac01543d0 2023-05-17T15:08:28.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feac628b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c1c50 con 0x7feac0069410 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feabf7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7feac00c6310 0x7feac0068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38224/0 (socket says 172.21.15.27:38224) 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feabf7fe700 1 -- 172.21.15.27:0/995217311 learned_addr learned my addr 172.21.15.27:0/995217311 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243482834 0 0) 0x7feac00c0c90 con 0x7feac00c6310 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.308+0000 7feac4828700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 0x7feac015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaac0033f0 con 0x7feac00c6310 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872510631 0 0) 0x7feaac0033f0 con 0x7feac00c6310 2023-05-17T15:08:28.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 msgr2=0x7feac015f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 0x7feac015f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 >> v1:172.21.15.40:6789/0 conn(0x7feac01543d0 legacy=0x7feac00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0157e60 con 0x7feac00c6310 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7feaa8001470 con 0x7feac00c6310 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 >> v1:172.21.15.27:6789/0 conn(0x7feac00c6310 legacy=0x7feac0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 0x7feaac003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac003e00 0x7feaac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac004b80 0x7feaac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac00b8e0 con 0x7feaac004b80 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac00ba20 con 0x7feaac003e00 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac00bbe0 con 0x7feac0069410 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac004b80 0x7feaac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabf7fe700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac003e00 0x7feaac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feabffff700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 0x7feaac003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 -- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 msgr2=0x7feaac003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac0069410 0x7feaac003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 -- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac003e00 msgr2=0x7feaac004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac003e00 0x7feaac004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 -- 172.21.15.27:0/995217311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0033f0 con 0x7feaac004b80 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.309+0000 7feac4828700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac004b80 0x7feaac005000 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7feab800e1c0 tx=0x7feab800b040).ready entity=mon.0 client_cookie=c1aa831dbc65562b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:28.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8009ac0 con 0x7feaac004b80 2023-05-17T15:08:28.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800f040 con 0x7feaac004b80 2023-05-17T15:08:28.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feabeffd700 1 -- 172.21.15.27:0/995217311 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800eca0 con 0x7feaac004b80 2023-05-17T15:08:28.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac628b700 1 -- 172.21.15.27:0/995217311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac004b80 msgr2=0x7feaac005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac628b700 1 --2- 172.21.15.27:0/995217311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feaac004b80 0x7feaac005000 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7feab800e1c0 tx=0x7feab800b040).stop 2023-05-17T15:08:28.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac4828700 1 -- 172.21.15.27:0/995217311 reap_dead start 2023-05-17T15:08:28.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac628b700 1 -- 172.21.15.27:0/995217311 shutdown_connections 2023-05-17T15:08:28.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac628b700 1 -- 172.21.15.27:0/995217311 >> 172.21.15.27:0/995217311 conn(0x7feac00cb7f0 msgr2=0x7feac00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:28.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac628b700 1 -- 172.21.15.27:0/995217311 shutdown_connections 2023-05-17T15:08:28.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.310+0000 7feac628b700 1 -- 172.21.15.27:0/995217311 wait complete. 2023-05-17T15:08:28.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.311+0000 7feac628b700 1 Processor -- start 2023-05-17T15:08:28.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.311+0000 7feac628b700 1 -- start start 2023-05-17T15:08:28.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feac628b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac004b80 0x7feac0168310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feac628b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 0x7feac0144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feac628b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac00afae0 0x7feac00aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feac628b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00aec50 con 0x7feac00af0e0 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feac628b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00b0450 con 0x7feaac004b80 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feac628b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac0168800 con 0x7feac00afae0 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 0x7feac0144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 0x7feac0144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38678/0 (socket says 172.21.15.27:38678) 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 -- 172.21.15.27:0/2907166893 learned_addr learned my addr 172.21.15.27:0/2907166893 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 -- 172.21.15.27:0/2907166893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac00afae0 msgr2=0x7feac00aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac00afae0 0x7feac00aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 -- 172.21.15.27:0/2907166893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac004b80 msgr2=0x7feac0168310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.312+0000 7feabf7fe700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac004b80 0x7feac0168310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feabf7fe700 1 -- 172.21.15.27:0/2907166893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00ae040 con 0x7feac00af0e0 2023-05-17T15:08:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feabf7fe700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 0x7feac0144960 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7feaa8004a40 tx=0x7feaa8001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8000fb0 con 0x7feac00af0e0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800f8d0 con 0x7feac00af0e0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac00ae320 con 0x7feac00af0e0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800fc50 con 0x7feac00af0e0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.313+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac00ae8e0 con 0x7feac00af0e0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.314+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac00aef30 con 0x7feac00af0e0 2023-05-17T15:08:28.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.314+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feaa801b030 con 0x7feac00af0e0 2023-05-17T15:08:28.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.314+0000 7feab7fff700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feaa005ed90 0x7feaa0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.314+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7feaa8079520 con 0x7feac00af0e0 2023-05-17T15:08:28.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.314+0000 7feabffff700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feaa005ed90 0x7feaa0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.315+0000 7feabffff700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feaa005ed90 0x7feaa0061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feab0000c00 tx=0x7feab0007b90).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:28.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.319+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feaa804aa70 con 0x7feac00af0e0 2023-05-17T15:08:28.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.560+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7feac00aed90 con 0x7feac00af0e0 2023-05-17T15:08:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.564+0000 7feab7fff700 1 -- 172.21.15.27:0/2907166893 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7feac00aed90 con 0x7feac00af0e0 2023-05-17T15:08:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feaa005ed90 msgr2=0x7feaa0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feaa005ed90 0x7feaa0061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feab0000c00 tx=0x7feab0007b90).stop 2023-05-17T15:08:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 msgr2=0x7feac0144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 0x7feac0144960 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7feaa8004a40 tx=0x7feaa8001e70).stop 2023-05-17T15:08:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 shutdown_connections 2023-05-17T15:08:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7feaa005ed90 0x7feaa0061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feac00afae0 0x7feac00aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaac004b80 0x7feac0168310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 --2- 172.21.15.27:0/2907166893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feac00af0e0 0x7feac0144960 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 >> 172.21.15.27:0/2907166893 conn(0x7feac00cb7f0 msgr2=0x7feac00bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 shutdown_connections 2023-05-17T15:08:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.566+0000 7feac628b700 1 -- 172.21.15.27:0/2907166893 wait complete. 2023-05-17T15:08:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:08:28.581 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.694+0000 7f4a4fe90700 1 Processor -- start 2023-05-17T15:08:28.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.694+0000 7f4a4fe90700 1 -- start start 2023-05-17T15:08:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4fe90700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4a480c5f30 0x7f4a480c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4fe90700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a48158880 0x7f4a48153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4fe90700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a481541c0 0x7f4a480c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4fe90700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a480bfcd0 con 0x7f4a48158880 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4fe90700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a480c0290 con 0x7f4a480c5f30 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4fe90700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480aa1a0 con 0x7f4a481541c0 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a48158880 0x7f4a48153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a48158880 0x7f4a48153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38686/0 (socket says 172.21.15.27:38686) 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 -- 172.21.15.27:0/1356229968 learned_addr learned my addr 172.21.15.27:0/1356229968 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4e42d700 1 --2- 172.21.15.27:0/1356229968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a481541c0 0x7f4a480c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4dc2c700 1 --2- 172.21.15.27:0/1356229968 >> v2:172.21.15.40:3300/0 conn(0x7f4a480c5f30 0x7f4a480c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 -- 172.21.15.27:0/1356229968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a481541c0 msgr2=0x7f4a480c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:28.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 --2- 172.21.15.27:0/1356229968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a481541c0 0x7f4a480c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 -- 172.21.15.27:0/1356229968 >> v2:172.21.15.40:3300/0 conn(0x7f4a480c5f30 msgr2=0x7f4a480c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:28.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 --2- 172.21.15.27:0/1356229968 >> v2:172.21.15.40:3300/0 conn(0x7f4a480c5f30 0x7f4a480c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.695+0000 7f4a4d42b700 1 -- 172.21.15.27:0/1356229968 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480aa480 con 0x7f4a48158880 2023-05-17T15:08:28.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4d42b700 1 --2- 172.21.15.27:0/1356229968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a48158880 0x7f4a48153cd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f4a48083a50 tx=0x7f4a380090f0).ready entity=mon.0 client_cookie=237935a3c77cd372 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4cc2a700 1 -- 172.21.15.27:0/1356229968 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800f510 con 0x7f4a48158880 2023-05-17T15:08:28.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4cc2a700 1 -- 172.21.15.27:0/1356229968 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3800f670 con 0x7f4a48158880 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4cc2a700 1 -- 172.21.15.27:0/1356229968 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800fa10 con 0x7f4a48158880 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 -- 172.21.15.27:0/1356229968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a48158880 msgr2=0x7f4a48153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/1356229968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a48158880 0x7f4a48153cd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f4a48083a50 tx=0x7f4a380090f0).stop 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 -- 172.21.15.27:0/1356229968 shutdown_connections 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/1356229968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a481541c0 0x7f4a480c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/1356229968 >> v2:172.21.15.40:3300/0 conn(0x7f4a480c5f30 0x7f4a480c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/1356229968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a48158880 0x7f4a48153cd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 -- 172.21.15.27:0/1356229968 >> 172.21.15.27:0/1356229968 conn(0x7f4a48069e70 msgr2=0x7f4a4805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 -- 172.21.15.27:0/1356229968 shutdown_connections 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.696+0000 7f4a4fe90700 1 -- 172.21.15.27:0/1356229968 wait complete. 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.697+0000 7f4a4fe90700 1 Processor -- start 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 -- start start 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a480c5f30 0x7f4a48154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 0x7f4a48155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a48158880 0x7f4a480c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48165380 con 0x7f4a481541c0 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48164800 con 0x7f4a48158880 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4fe90700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48164ae0 con 0x7f4a480c5f30 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4d42b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 0x7f4a48155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4d42b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 0x7f4a48155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38690/0 (socket says 172.21.15.27:38690) 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4d42b700 1 -- 172.21.15.27:0/2449745631 learned_addr learned my addr 172.21.15.27:0/2449745631 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:28.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4e42d700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a48158880 0x7f4a480c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.698+0000 7f4a4dc2c700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a480c5f30 0x7f4a48154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4d42b700 1 -- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a480c5f30 msgr2=0x7f4a48154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4d42b700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a480c5f30 0x7f4a48154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4d42b700 1 -- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a48158880 msgr2=0x7f4a480c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4d42b700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a48158880 0x7f4a480c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4d42b700 1 -- 172.21.15.27:0/2449745631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009370 con 0x7f4a481541c0 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4e42d700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a48158880 0x7f4a480c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:28.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4dc2c700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a480c5f30 0x7f4a48154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:28.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4d42b700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 0x7f4a48155320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f4a38006fd0 tx=0x7f4a38017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:28.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800fea0 con 0x7f4a481541c0 2023-05-17T15:08:28.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38000bc0 con 0x7f4a481541c0 2023-05-17T15:08:28.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a48164dc0 con 0x7f4a481541c0 2023-05-17T15:08:28.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800f7e0 con 0x7f4a481541c0 2023-05-17T15:08:28.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.699+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a48154b40 con 0x7f4a481541c0 2023-05-17T15:08:28.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.700+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a48167a80 con 0x7f4a481541c0 2023-05-17T15:08:28.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.701+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4a3802c070 con 0x7f4a481541c0 2023-05-17T15:08:28.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.701+0000 7f4a3dffb700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a2c05ed90 0x7f4a2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:28.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.701+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f4a3807b3c0 con 0x7f4a481541c0 2023-05-17T15:08:28.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.701+0000 7f4a4dc2c700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a2c05ed90 0x7f4a2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:28.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.701+0000 7f4a4dc2c700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a2c05ed90 0x7f4a2c061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4a44009c00 tx=0x7f4a44008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:28.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.705+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a48167a80 con 0x7f4a481541c0 2023-05-17T15:08:28.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.921+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a48167a80 con 0x7f4a481541c0 2023-05-17T15:08:28.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.921+0000 7f4a3dffb700 1 -- 172.21.15.27:0/2449745631 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f4a48167a80 con 0x7f4a481541c0 2023-05-17T15:08:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:28.927 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:19.270502+0000","modified":"2023-05-17T15:08:22.276979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1785297520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1785297520},{"type":"v1","addr":"172.21.15.40:6835","nonce":1785297520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-17T15:08:28.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a2c05ed90 msgr2=0x7f4a2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a2c05ed90 0x7f4a2c061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4a44009c00 tx=0x7f4a44008040).stop 2023-05-17T15:08:28.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 msgr2=0x7f4a48155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:28.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 0x7f4a48155320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f4a38006fd0 tx=0x7f4a38017000).stop 2023-05-17T15:08:28.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 shutdown_connections 2023-05-17T15:08:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a2c05ed90 0x7f4a2c061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a48158880 0x7f4a480c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a480c5f30 0x7f4a48154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 --2- 172.21.15.27:0/2449745631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a481541c0 0x7f4a48155320 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 >> 172.21.15.27:0/2449745631 conn(0x7f4a48069e70 msgr2=0x7f4a480ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 shutdown_connections 2023-05-17T15:08:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:28.923+0000 7f4a4fe90700 1 -- 172.21.15.27:0/2449745631 wait complete. 2023-05-17T15:08:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2023-05-17T15:08:29.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:08:19.270502+0000', 'modified': '2023-05-17T15:08:22.276979+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6192}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6192': {'gid': 6192, 'name': 'd', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/1785297520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 1785297520}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 1785297520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:08:29.342 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:08:29.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-17T15:08:29.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.457+0000 7ffac55f8700 1 Processor -- start 2023-05-17T15:08:29.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.457+0000 7ffac55f8700 1 -- start start 2023-05-17T15:08:29.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffac55f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 0x7ffac0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffac55f8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffac00cb450 0x7ffac00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffac55f8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac00c5a50 con 0x7ffac0068f00 2023-05-17T15:08:29.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffac55f8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac0069fa0 con 0x7ffac00cb450 2023-05-17T15:08:29.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffac55f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00c04e0 con 0x7ffac0154090 2023-05-17T15:08:29.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffabe7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffac00cb450 0x7ffac00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffabeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 0x7ffac0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffabf7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffac0068f00 0x7ffac0157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:44262/0 (socket says 172.21.15.27:44262) 2023-05-17T15:08:29.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffabe7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffac00cb450 0x7ffac00cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:56628/0 (socket says 172.21.15.27:56628) 2023-05-17T15:08:29.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffabeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 0x7ffac0154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:39806/0 (socket says 172.21.15.27:39806) 2023-05-17T15:08:29.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.458+0000 7ffabe7fc700 1 -- 172.21.15.27:0/3360444409 learned_addr learned my addr 172.21.15.27:0/3360444409 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabdffb700 1 -- 172.21.15.27:0/3360444409 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223587488 0 0) 0x7ffac00c5a50 con 0x7ffac0068f00 2023-05-17T15:08:29.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabeffd700 1 -- 172.21.15.27:0/3360444409 >> v2:172.21.15.40:3300/0 conn(0x7ffac00cb450 msgr2=0x7ffac00cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabeffd700 1 --2- 172.21.15.27:0/3360444409 >> v2:172.21.15.40:3300/0 conn(0x7ffac00cb450 0x7ffac00cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabeffd700 1 -- 172.21.15.27:0/3360444409 >> v1:172.21.15.40:6789/0 conn(0x7ffac0068f00 legacy=0x7ffac0157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabeffd700 1 -- 172.21.15.27:0/3360444409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00c0760 con 0x7ffac0154090 2023-05-17T15:08:29.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabeffd700 1 --2- 172.21.15.27:0/3360444409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 0x7ffac0154470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ffab8009e90 tx=0x7ffab8009780).ready entity=mon.2 client_cookie=71888dffb224870e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabdffb700 1 -- 172.21.15.27:0/3360444409 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800e070 con 0x7ffac0154090 2023-05-17T15:08:29.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabdffb700 1 -- 172.21.15.27:0/3360444409 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab800bb20 con 0x7ffac0154090 2023-05-17T15:08:29.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.459+0000 7ffabdffb700 1 -- 172.21.15.27:0/3360444409 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800bea0 con 0x7ffac0154090 2023-05-17T15:08:29.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 -- 172.21.15.27:0/3360444409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 msgr2=0x7ffac0154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 --2- 172.21.15.27:0/3360444409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 0x7ffac0154470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ffab8009e90 tx=0x7ffab8009780).stop 2023-05-17T15:08:29.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 -- 172.21.15.27:0/3360444409 shutdown_connections 2023-05-17T15:08:29.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 --2- 172.21.15.27:0/3360444409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac0154090 0x7ffac0154470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 --2- 172.21.15.27:0/3360444409 >> v2:172.21.15.40:3300/0 conn(0x7ffac00cb450 0x7ffac00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 -- 172.21.15.27:0/3360444409 >> 172.21.15.27:0/3360444409 conn(0x7ffac005e7e0 msgr2=0x7ffac00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 -- 172.21.15.27:0/3360444409 shutdown_connections 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.460+0000 7ffac55f8700 1 -- 172.21.15.27:0/3360444409 wait complete. 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.461+0000 7ffac55f8700 1 Processor -- start 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.461+0000 7ffac55f8700 1 -- start start 2023-05-17T15:08:29.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffac0068f00 0x7ffac014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac00cb450 0x7ffac00ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 0x7ffac00aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac014d160 con 0x7ffac0154090 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0154910 con 0x7ffac0068f00 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0155490 con 0x7ffac00cb450 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 0x7ffac00aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 0x7ffac00aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38706/0 (socket says 172.21.15.27:38706) 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 -- 172.21.15.27:0/721770197 learned_addr learned my addr 172.21.15.27:0/721770197 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabe7fc700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac00cb450 0x7ffac00ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabeffd700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffac0068f00 0x7ffac014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 -- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac00cb450 msgr2=0x7ffac00ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac00cb450 0x7ffac00ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 -- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffac0068f00 msgr2=0x7ffac014cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffac0068f00 0x7ffac014cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 -- 172.21.15.27:0/721770197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8009a20 con 0x7ffac0154090 2023-05-17T15:08:29.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 0x7ffac00aea50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7ffab000c490 tx=0x7ffab0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffab6ffd700 1 -- 172.21.15.27:0/721770197 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00070d0 con 0x7ffac0154090 2023-05-17T15:08:29.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffab6ffd700 1 -- 172.21.15.27:0/721770197 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0007230 con 0x7ffac0154090 2023-05-17T15:08:29.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.462+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac0154b60 con 0x7ffac0154090 2023-05-17T15:08:29.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.463+0000 7ffab6ffd700 1 -- 172.21.15.27:0/721770197 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00056e0 con 0x7ffac0154090 2023-05-17T15:08:29.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.463+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0155120 con 0x7ffac0154090 2023-05-17T15:08:29.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.464+0000 7ffab6ffd700 1 -- 172.21.15.27:0/721770197 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffab0010070 con 0x7ffac0154090 2023-05-17T15:08:29.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.464+0000 7ffab6ffd700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffaa005ed90 0x7ffaa0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.464+0000 7ffab6ffd700 1 -- 172.21.15.27:0/721770197 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ffab0078f50 con 0x7ffac0154090 2023-05-17T15:08:29.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.464+0000 7ffabeffd700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffaa005ed90 0x7ffaa0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.464+0000 7ffabeffd700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffaa005ed90 0x7ffaa0061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ffab80094d0 tx=0x7ffac00c0650).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.466+0000 7ffad6f8ab80 1 Processor -- start 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.466+0000 7ffad6f8ab80 1 -- start start 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 0x55b6e91fa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e917b5e0 con 0x55b6e91b6300 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e90f28a0 con 0x55b6e91fa560 2023-05-17T15:08:29.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6e9107900 con 0x55b6e91ff480 2023-05-17T15:08:29.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91b0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38714/0 (socket says 172.21.15.27:38714) 2023-05-17T15:08:29.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.467+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1670432249 learned_addr learned my addr 172.21.15.27:0/1670432249 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabeffd700 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 msgr2=0x55b6e91fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 0x55b6e91fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:29.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 msgr2=0x55b6e91ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91ddc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1670432249 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6e917b450 con 0x55b6e91b6300 2023-05-17T15:08:29.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91b0710 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7ffab004df80 tx=0x7ffab000f000).ready entity=mon.0 client_cookie=4d0f06bb76cb3a57 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffa9ffff700 1 -- 172.21.15.27:0/1670432249 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00075b0 con 0x55b6e91b6300 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffa9ffff700 1 -- 172.21.15.27:0/1670432249 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab004c500 con 0x55b6e91b6300 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffa9ffff700 1 -- 172.21.15.27:0/1670432249 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab004d650 con 0x55b6e91b6300 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1670432249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 msgr2=0x55b6e91b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.468+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91b0710 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7ffab004df80 tx=0x7ffab000f000).stop 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1670432249 shutdown_connections 2023-05-17T15:08:29.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91b0710 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1670432249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 0x55b6e91fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1670432249 >> 172.21.15.27:0/1670432249 conn(0x55b6e8f72e40 msgr2=0x55b6e91fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1670432249 shutdown_connections 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1670432249 wait complete. 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 -- start start 2023-05-17T15:08:29.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.469+0000 7ffad6f8ab80 1 Processor -- start 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91fa560 0x55b6e91f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91ff480 0x55b6e920de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e90ceed0 con 0x55b6e91b6300 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91b0500 con 0x55b6e91ff480 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91f74e0 con 0x55b6e91fa560 2023-05-17T15:08:29.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffad6f8ab80 10 client.0 ll_register_callbacks cb 0x55b6e91751f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffabeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffabeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91db310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38716/0 (socket says 172.21.15.27:38716) 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffabeffd700 1 -- 172.21.15.27:0/283778068 learned_addr learned my addr 172.21.15.27:0/283778068 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffabe7fc700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91fa560 0x55b6e91f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.470+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91ff480 0x55b6e920de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffabeffd700 1 -- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91fa560 msgr2=0x55b6e91f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffabeffd700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91fa560 0x55b6e91f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffabeffd700 1 -- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91ff480 msgr2=0x55b6e920de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffabeffd700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91ff480 0x55b6e920de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffabeffd700 1 -- 172.21.15.27:0/283778068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0155120 con 0x55b6e91b6300 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffabeffd700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91db310 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7ffab800b740 tx=0x7ffab801f000).ready entity=mon.0 client_cookie=bf1bd258fab129f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffa9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/283778068 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab801ee00 con 0x55b6e91b6300 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/283778068 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ffab8029470 con 0x55b6e91b6300 2023-05-17T15:08:29.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6e91a9460 con 0x55b6e91b6300 2023-05-17T15:08:29.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/283778068 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab8029840 con 0x55b6e91b6300 2023-05-17T15:08:29.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 10 client.6357 fetch_fsmap learned FSMap version 30 2023-05-17T15:08:29.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55b6e8faa310 con 0x55b6e91b6300 2023-05-17T15:08:29.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/283778068 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6e91a9460 con 0x55b6e91b6300 2023-05-17T15:08:29.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/283778068 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffab80299a0 con 0x55b6e91b6300 2023-05-17T15:08:29.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 10 client.6357 fetch_fsmap finished waiting for FSMap version 30 2023-05-17T15:08:29.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 10 client.6357 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T15:08:29.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 20 client.6357 populate_metadata read hostname 'smithi027' 2023-05-17T15:08:29.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91df560 0x55b6e920a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.471+0000 7ffad6f8ab80 4 client.6357 mds_command: new command op to 6192 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:08:29.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.472+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 --> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6e8f6eca0 con 0x55b6e91df560 2023-05-17T15:08:29.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.472+0000 7ffabe7fc700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91df560 0x55b6e920a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.472+0000 7ffa9d7fa700 10 client.6357 ms_handle_connect on v2:172.21.15.40:6834/1785297520 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.472+0000 7ffabe7fc700 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91df560 0x55b6e920a800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bc223517e3116f1b server_cookie=f27afc050687334e in_seq=0 out_seq=0 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/283778068 <== mds.0 v2:172.21.15.40:6834/1785297520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55b6e8f6eca0 con 0x55b6e91df560 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffa9d7fa700 10 client.6357 handle_command_reply: tid=0 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 client.6357 shutdown 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 msgr2=0x55b6e91db310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91db310 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7ffab800b740 tx=0x7ffab801f000).stop 2023-05-17T15:08:29.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 shutdown_connections 2023-05-17T15:08:29.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91df560 0x55b6e920a800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91ff480 0x55b6e920de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e91db310 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/283778068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91fa560 0x55b6e91f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffa9d7fa700 0 client.6357 ms_handle_reset on v2:172.21.15.40:6834/1785297520 2023-05-17T15:08:29.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 >> 172.21.15.27:0/283778068 conn(0x55b6e8f72e40 msgr2=0x55b6e91fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 shutdown_connections 2023-05-17T15:08:29.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/283778068 wait complete. 2023-05-17T15:08:29.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.473+0000 7ffad6f8ab80 20 client.6357 trim_cache size 0 max 16384 2023-05-17T15:08:29.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 Processor -- start 2023-05-17T15:08:29.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 -- start start 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e92098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e9209da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 0x55b6e91f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91af380 con 0x55b6e91b6300 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91b2460 con 0x55b6e91fa560 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91f7ad0 con 0x55b6e91ff480 2023-05-17T15:08:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.490+0000 7ffabeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e92098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e92098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38724/0 (socket says 172.21.15.27:38724) 2023-05-17T15:08:29.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 -- 172.21.15.27:0/2768245840 learned_addr learned my addr 172.21.15.27:0/2768245840 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 -- 172.21.15.27:0/2768245840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 msgr2=0x55b6e91f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 0x55b6e91f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 -- 172.21.15.27:0/2768245840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 msgr2=0x55b6e9209da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e9209da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 -- 172.21.15.27:0/2768245840 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6e9100880 con 0x55b6e91b6300 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffabeffd700 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e92098b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7ffab8009460 tx=0x7ffab8028000).ready entity=mon.0 client_cookie=4eda54e88493ae6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffab4ff9700 1 -- 172.21.15.27:0/2768245840 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8012410 con 0x55b6e91b6300 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffab4ff9700 1 -- 172.21.15.27:0/2768245840 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab8029840 con 0x55b6e91b6300 2023-05-17T15:08:29.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffab4ff9700 1 -- 172.21.15.27:0/2768245840 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80383f0 con 0x55b6e91b6300 2023-05-17T15:08:29.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/2768245840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 msgr2=0x55b6e92098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e92098b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7ffab8009460 tx=0x7ffab8028000).stop 2023-05-17T15:08:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/2768245840 shutdown_connections 2023-05-17T15:08:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91ff480 0x55b6e91f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91b6300 0x55b6e92098b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.491+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/2768245840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e9209da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.492+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/2768245840 >> 172.21.15.27:0/2768245840 conn(0x55b6e8f72e40 msgr2=0x55b6e91f5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.492+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/2768245840 shutdown_connections 2023-05-17T15:08:29.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.492+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/2768245840 wait complete. 2023-05-17T15:08:29.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.492+0000 7ffad6f8ab80 1 -- start start 2023-05-17T15:08:29.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.492+0000 7ffad6f8ab80 1 Processor -- start 2023-05-17T15:08:29.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91b6300 0x55b6e91af610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 0x55b6e91d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91afff0 con 0x55b6e91ff480 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e9261300 con 0x55b6e91fa560 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6e91e3990 con 0x55b6e91b6300 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffad6f8ab80 10 client.0 ll_register_callbacks cb 0x55b6e91751f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 0x55b6e91d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 0x55b6e91d9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38734/0 (socket says 172.21.15.27:38734) 2023-05-17T15:08:29.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1104194372 learned_addr learned my addr 172.21.15.27:0/1104194372 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabe7fc700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabeffd700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91b6300 0x55b6e91af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91b6300 msgr2=0x55b6e91af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.493+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91b6300 0x55b6e91af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 msgr2=0x55b6e91afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:29.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffabf7fe700 1 -- 172.21.15.27:0/1104194372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6e8faa310 con 0x55b6e91ff480 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffabf7fe700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 0x55b6e91d9ca0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7ffab004e090 tx=0x7ffab0059000).ready entity=mon.0 client_cookie=6442df8833b8e466 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffa9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/1104194372 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0063070 con 0x55b6e91ff480 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6e91b5740 con 0x55b6e91ff480 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/1104194372 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ffab00075b0 con 0x55b6e91ff480 2023-05-17T15:08:29.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/1104194372 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab0005ad0 con 0x55b6e91ff480 2023-05-17T15:08:29.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 10 client.6363 fetch_fsmap learned FSMap version 30 2023-05-17T15:08:29.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55b6e90fc070 con 0x55b6e91ff480 2023-05-17T15:08:29.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/1104194372 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6e91b5740 con 0x55b6e91ff480 2023-05-17T15:08:29.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/1104194372 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffab0005c30 con 0x55b6e91ff480 2023-05-17T15:08:29.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 10 client.6363 fetch_fsmap finished waiting for FSMap version 30 2023-05-17T15:08:29.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 10 client.6363 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T15:08:29.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 20 client.6363 populate_metadata read hostname 'smithi027' 2023-05-17T15:08:29.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91da190 0x55b6e91da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 4 client.6363 mds_command: new command op to 6192 tid=0[{"prefix": "status"}] 2023-05-17T15:08:29.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 --> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ffab004c500 con 0x55b6e91da190 2023-05-17T15:08:29.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.494+0000 7ffabeffd700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91da190 0x55b6e91da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffa9d7fa700 10 client.6363 ms_handle_connect on v2:172.21.15.40:6834/1785297520 2023-05-17T15:08:29.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffabeffd700 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91da190 0x55b6e91da570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3d5cab6fa884a09e server_cookie=be50632ea60088fe in_seq=0 out_seq=0 2023-05-17T15:08:29.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffa9d7fa700 1 -- 172.21.15.27:0/1104194372 <== mds.0 v2:172.21.15.40:6834/1785297520 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x7ffab004c500 con 0x55b6e91da190 2023-05-17T15:08:29.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffa9d7fa700 10 client.6363 handle_command_reply: tid=0 2023-05-17T15:08:29.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 client.6363 shutdown 2023-05-17T15:08:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 msgr2=0x55b6e91d9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 0x55b6e91d9ca0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7ffab004e090 tx=0x7ffab0059000).stop 2023-05-17T15:08:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 shutdown_connections 2023-05-17T15:08:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:6834/1785297520,v1:172.21.15.40:6835/1785297520] conn(0x55b6e91da190 0x55b6e91da570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b6e91ff480 0x55b6e91d9ca0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55b6e91b6300 0x55b6e91af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffa9d7fa700 0 client.6363 ms_handle_reset on v2:172.21.15.40:6834/1785297520 2023-05-17T15:08:29.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 --2- 172.21.15.27:0/1104194372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6e91fa560 0x55b6e91afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 >> 172.21.15.27:0/1104194372 conn(0x55b6e8f72e40 msgr2=0x55b6e91e0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 shutdown_connections 2023-05-17T15:08:29.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 1 -- 172.21.15.27:0/1104194372 wait complete. 2023-05-17T15:08:29.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.495+0000 7ffad6f8ab80 20 client.6363 trim_cache size 0 max 16384 2023-05-17T15:08:29.512 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:08:29.512 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:08:29.512 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:08:29.512 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 6192, 2023-05-17T15:08:29.512 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:08:29.513 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:08:29.513 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:08:29.513 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 10.223687883, 2023-05-17T15:08:29.513 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 30, 2023-05-17T15:08:29.513 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 83, 2023-05-17T15:08:29.514 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 83, 2023-05-17T15:08:29.514 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 14.794103112 2023-05-17T15:08:29.514 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:08:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffaa005ed90 msgr2=0x7ffaa0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffaa005ed90 0x7ffaa0061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ffab80094d0 tx=0x7ffac00c0650).stop 2023-05-17T15:08:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 msgr2=0x7ffac00aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 0x7ffac00aea50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7ffab000c490 tx=0x7ffab0007dc0).stop 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 shutdown_connections 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffaa005ed90 0x7ffaa0061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac0154090 0x7ffac00aea50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffac0068f00 0x7ffac014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 --2- 172.21.15.27:0/721770197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffac00cb450 0x7ffac00ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 >> 172.21.15.27:0/721770197 conn(0x7ffac005e7e0 msgr2=0x7ffac00c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 shutdown_connections 2023-05-17T15:08:29.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.496+0000 7ffac55f8700 1 -- 172.21.15.27:0/721770197 wait complete. 2023-05-17T15:08:29.517 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:08:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.617+0000 7f76e31e0700 1 Processor -- start 2023-05-17T15:08:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.617+0000 7f76e31e0700 1 -- start start 2023-05-17T15:08:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76e31e0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76dc06a5f0 0x7f76dc0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76e31e0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc0c95c0 con 0x7f76dc153c10 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76e31e0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc0cbae0 con 0x7f76dc0c5f60 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76e31e0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0a8100 con 0x7f76dc06a5f0 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76e177d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f76dc153c10 0x7f76dc154040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38302/0 (socket says 172.21.15.27:38302) 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76e177d700 1 -- 172.21.15.27:0/1688267674 learned_addr learned my addr 172.21.15.27:0/1688267674 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76dbfff700 1 --2- 172.21.15.27:0/1688267674 >> v2:172.21.15.40:3300/0 conn(0x7f76dc06a5f0 0x7f76dc0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097274273 0 0) 0x7f76dc0c95c0 con 0x7f76dc153c10 2023-05-17T15:08:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc0033f0 con 0x7f76dc153c10 2023-05-17T15:08:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058623635 0 0) 0x7f76dc0cbae0 con 0x7f76dc0c5f60 2023-05-17T15:08:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.618+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76dc0c95c0 con 0x7f76dc0c5f60 2023-05-17T15:08:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76dbfff700 1 -- 172.21.15.27:0/1688267674 >> v1:172.21.15.40:6789/0 conn(0x7f76dc0c5f60 legacy=0x7f76dc0a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76dbfff700 1 -- 172.21.15.27:0/1688267674 >> v1:172.21.15.27:6789/0 conn(0x7f76dc153c10 legacy=0x7f76dc154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76dbfff700 1 -- 172.21.15.27:0/1688267674 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0c0b90 con 0x7f76dc06a5f0 2023-05-17T15:08:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76dbfff700 1 --2- 172.21.15.27:0/1688267674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c6340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f76c8009760 tx=0x7f76c8009060).ready entity=mon.1 client_cookie=4d4eba1b21fef2b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800d4a0 con 0x7f76dc06a5f0 2023-05-17T15:08:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c800d600 con 0x7f76dc06a5f0 2023-05-17T15:08:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76db7fe700 1 -- 172.21.15.27:0/1688267674 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800d980 con 0x7f76dc06a5f0 2023-05-17T15:08:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76e31e0700 1 -- 172.21.15.27:0/1688267674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 msgr2=0x7f76dc0c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76e31e0700 1 --2- 172.21.15.27:0/1688267674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c6340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f76c8009760 tx=0x7f76c8009060).stop 2023-05-17T15:08:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76e31e0700 1 -- 172.21.15.27:0/1688267674 shutdown_connections 2023-05-17T15:08:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76e31e0700 1 --2- 172.21.15.27:0/1688267674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c6340 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76e31e0700 1 -- 172.21.15.27:0/1688267674 >> 172.21.15.27:0/1688267674 conn(0x7f76dc06a1e0 msgr2=0x7f76dc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.619+0000 7f76e31e0700 1 -- 172.21.15.27:0/1688267674 shutdown_connections 2023-05-17T15:08:29.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.620+0000 7f76e31e0700 1 -- 172.21.15.27:0/1688267674 wait complete. 2023-05-17T15:08:29.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 Processor -- start 2023-05-17T15:08:29.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 -- start start 2023-05-17T15:08:29.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76dc0c5f60 0x7f76dc14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 0x7f76dc0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0af7a0 con 0x7f76dc153c10 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0c3d20 con 0x7f76dc06a5f0 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.621+0000 7f76e31e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0af1e0 con 0x7f76dc0c5f60 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 0x7f76dc0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 0x7f76dc0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38748/0 (socket says 172.21.15.27:38748) 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 -- 172.21.15.27:0/3215670706 learned_addr learned my addr 172.21.15.27:0/3215670706 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e0f7c700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76dbfff700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76dc0c5f60 0x7f76dc14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 -- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76dc0c5f60 msgr2=0x7f76dc14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76dc0c5f60 0x7f76dc14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 -- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 msgr2=0x7f76dc0c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 -- 172.21.15.27:0/3215670706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80092a0 con 0x7f76dc153c10 2023-05-17T15:08:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e177d700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 0x7f76dc0ae990 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f76d4001560 tx=0x7f76d40015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4005d30 con 0x7f76dc153c10 2023-05-17T15:08:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc0af4c0 con 0x7f76dc153c10 2023-05-17T15:08:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4005e90 con 0x7f76dc153c10 2023-05-17T15:08:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40072e0 con 0x7f76dc153c10 2023-05-17T15:08:29.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.622+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc14ed40 con 0x7f76dc153c10 2023-05-17T15:08:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.623+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc0c3e90 con 0x7f76dc153c10 2023-05-17T15:08:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.624+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f76d4010070 con 0x7f76dc153c10 2023-05-17T15:08:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.624+0000 7f76d8ff9700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f76c005ed90 0x7f76c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:29.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.624+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f76d4079410 con 0x7f76dc153c10 2023-05-17T15:08:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.624+0000 7f76e0f7c700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f76c005ed90 0x7f76c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:29.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.624+0000 7f76e0f7c700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f76c005ed90 0x7f76c0061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f76d0001170 tx=0x7f76d0007bb0).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:29.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.628+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76d404a960 con 0x7f76dc153c10 2023-05-17T15:08:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.844+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76dc05e6a0 con 0x7f76dc153c10 2023-05-17T15:08:29.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.845+0000 7f76d8ff9700 1 -- 172.21.15.27:0/3215670706 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76d404df80 con 0x7f76dc153c10 2023-05-17T15:08:29.849 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:08:29.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f76c005ed90 msgr2=0x7f76c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f76c005ed90 0x7f76c0061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f76d0001170 tx=0x7f76d0007bb0).stop 2023-05-17T15:08:29.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 msgr2=0x7f76dc0ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 0x7f76dc0ae990 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f76d4001560 tx=0x7f76d40015b0).stop 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 shutdown_connections 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f76c005ed90 0x7f76c0061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76dc153c10 0x7f76dc0ae990 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76dc06a5f0 0x7f76dc0c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 --2- 172.21.15.27:0/3215670706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76dc0c5f60 0x7f76dc14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 >> 172.21.15.27:0/3215670706 conn(0x7f76dc06a1e0 msgr2=0x7f76dc154040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:29.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.846+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 shutdown_connections 2023-05-17T15:08:29.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:29.847+0000 7f76e31e0700 1 -- 172.21.15.27:0/3215670706 wait complete. 2023-05-17T15:08:29.861 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:08:29.861 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:08:29.862 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:08:29.862 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:08:29.862 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:08:29.863 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:08:29.863 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:08:29.863 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:08:29.863 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:08:29.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:29.864 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:08:29.879 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:08:29.880 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 41403sec preferred_lft 41403sec 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:08:29.881 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:08:29.882 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:08:29.882 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:08:29.882 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:08:29.883 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:08:29.883 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:08:29.883 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.884 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:08:29.884 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.884 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:08:29.884 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:08:29.884 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:08:29.884 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.885 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:08:29.885 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:08:29.885 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:08:29.885 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:08:29.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:29.886 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:08:29.942 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:08:29.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:29.944 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:08:29.999 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:08:29.999 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:08:29.999 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:08:30.000 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:08:30.000 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:08:30.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:30.001 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:08:30.001 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:08:30.001 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:08:30.002 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:08:30.002 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:08:30.003 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:08:30.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:30.100 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:08:30.114 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:08:30.115 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:08:30.115 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:08:30.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:30.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:08:30.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:30.179 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:08:30.234 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:08:30.234 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:08:30.312 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:08:30.313 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:08:30.355 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:08:30.356 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:08:30.358 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:08:30.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:30.359 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:08:30.424 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:08:30.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 Processor -- start 2023-05-17T15:08:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 -- start start 2023-05-17T15:08:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc154090 0x7f5fbc154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fbc0cb450 0x7f5fbc0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc0c5a50 con 0x7f5fbc068f00 2023-05-17T15:08:30.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc069fa0 con 0x7f5fbc0cb450 2023-05-17T15:08:30.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.576+0000 7f5fc2a40700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c04e0 con 0x7f5fbc154090 2023-05-17T15:08:30.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fbc0cb450 0x7f5fbc0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fbc0cb450 0x7f5fbc0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38762/0 (socket says 172.21.15.27:38762) 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fc0fdd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5fbc068f00 0x7f5fbc157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38322/0 (socket says 172.21.15.27:38322) 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 -- 172.21.15.27:0/3926816349 learned_addr learned my addr 172.21.15.27:0/3926816349 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbbfff700 1 --2- 172.21.15.27:0/3926816349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc154090 0x7f5fbc154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 -- 172.21.15.27:0/3926816349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc154090 msgr2=0x7f5fbc154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 --2- 172.21.15.27:0/3926816349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc154090 0x7f5fbc154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 -- 172.21.15.27:0/3926816349 >> v1:172.21.15.27:6789/0 conn(0x7f5fbc068f00 legacy=0x7f5fbc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 -- 172.21.15.27:0/3926816349 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0c0760 con 0x7f5fbc0cb450 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbaffd700 1 -- 172.21.15.27:0/3926816349 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936123643 0 0) 0x7f5fbc0c5a50 con 0x7f5fbc068f00 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbb7fe700 1 --2- 172.21.15.27:0/3926816349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0cb450 0x7f5fbc0cb8d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f5fb0009830 tx=0x7f5fb00090f0).ready entity=mon.0 client_cookie=89e428209c7e93e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbaffd700 1 -- 172.21.15.27:0/3926816349 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000b600 con 0x7f5fbc0cb450 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbaffd700 1 -- 172.21.15.27:0/3926816349 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb000b760 con 0x7f5fbc0cb450 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.577+0000 7f5fbaffd700 1 -- 172.21.15.27:0/3926816349 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000bae0 con 0x7f5fbc0cb450 2023-05-17T15:08:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 -- 172.21.15.27:0/3926816349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0cb450 msgr2=0x7f5fbc0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/3926816349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0cb450 0x7f5fbc0cb8d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f5fb0009830 tx=0x7f5fb00090f0).stop 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 -- 172.21.15.27:0/3926816349 shutdown_connections 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/3926816349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc154090 0x7f5fbc154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/3926816349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc0cb450 0x7f5fbc0cb8d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 -- 172.21.15.27:0/3926816349 >> 172.21.15.27:0/3926816349 conn(0x7f5fbc05e7e0 msgr2=0x7f5fbc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 -- 172.21.15.27:0/3926816349 shutdown_connections 2023-05-17T15:08:30.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.578+0000 7f5fc2a40700 1 -- 172.21.15.27:0/3926816349 wait complete. 2023-05-17T15:08:30.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.579+0000 7f5fc2a40700 1 Processor -- start 2023-05-17T15:08:30.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.579+0000 7f5fc2a40700 1 -- start start 2023-05-17T15:08:30.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc2a40700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc068f00 0x7f5fbc0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc2a40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0cb450 0x7f5fbc14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc2a40700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 0x7f5fbc0aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc2a40700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c4350 con 0x7f5fbc154090 2023-05-17T15:08:30.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc2a40700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c3a20 con 0x7f5fbc068f00 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc2a40700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c3d00 con 0x7f5fbc0cb450 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 0x7f5fbc0aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 0x7f5fbc0aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38768/0 (socket says 172.21.15.27:38768) 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 -- 172.21.15.27:0/1067694275 learned_addr learned my addr 172.21.15.27:0/1067694275 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fbb7fe700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0cb450 0x7f5fbc14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fbbfff700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc068f00 0x7f5fbc0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 -- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0cb450 msgr2=0x7f5fbc14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0cb450 0x7f5fbc14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 -- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc068f00 msgr2=0x7f5fbc0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc068f00 0x7f5fbc0c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 -- 172.21.15.27:0/1067694275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0009370 con 0x7f5fbc154090 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fbb7fe700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0cb450 0x7f5fbc14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fc0fdd700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 0x7f5fbc0aed70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f5fb400c730 tx=0x7f5fb4001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:30.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.580+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4005c70 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.581+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4005dd0 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.581+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4007340 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.581+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0c3fe0 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.581+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc14df00 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.581+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc0c0a40 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.582+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5fb4010030 con 0x7f5fbc154090 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.582+0000 7f5fa3fff700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5fa805ed60 0x7f5fa8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.582+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f5fb4079b60 con 0x7f5fbc154090 2023-05-17T15:08:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.582+0000 7f5fbbfff700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5fa805ed60 0x7f5fa8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.583+0000 7f5fbbfff700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5fa805ed60 0x7f5fa8061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5fac006fd0 tx=0x7f5fac008040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.586+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fb404afa0 con 0x7f5fbc154090 2023-05-17T15:08:30.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.791+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fbc0af680 con 0x7f5fa805ed60 2023-05-17T15:08:30.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.792+0000 7f5fa3fff700 1 -- 172.21.15.27:0/1067694275 <== mgr.6003 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5fbc0af680 con 0x7f5fa805ed60 2023-05-17T15:08:30.796 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:08:30.796 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:30.796 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:08:30.797 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:30.797 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:08:30.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5fa805ed60 msgr2=0x7f5fa8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5fa805ed60 0x7f5fa8061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5fac006fd0 tx=0x7f5fac008040).stop 2023-05-17T15:08:30.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 msgr2=0x7f5fbc0aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 0x7f5fbc0aed70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f5fb400c730 tx=0x7f5fb4001520).stop 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 shutdown_connections 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5fa805ed60 0x7f5fa8061220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fbc154090 0x7f5fbc0aed70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fbc068f00 0x7f5fbc0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 --2- 172.21.15.27:0/1067694275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fbc0cb450 0x7f5fbc14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 >> 172.21.15.27:0/1067694275 conn(0x7f5fbc05e7e0 msgr2=0x7f5fbc14e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:30.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 shutdown_connections 2023-05-17T15:08:30.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.794+0000 7f5fc2a40700 1 -- 172.21.15.27:0/1067694275 wait complete. 2023-05-17T15:08:30.810 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:08:30.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.924+0000 7fec36181700 1 Processor -- start 2023-05-17T15:08:30.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.924+0000 7fec36181700 1 -- start start 2023-05-17T15:08:30.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec36181700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 0x7fec300cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec36181700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec30158010 con 0x7fec30157980 2023-05-17T15:08:30.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec36181700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec301582f0 con 0x7fec300cac00 2023-05-17T15:08:30.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec36181700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec301588b0 con 0x7fec30153ef0 2023-05-17T15:08:30.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec35980700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fec30157980 0x7fec300c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38338/0 (socket says 172.21.15.27:38338) 2023-05-17T15:08:30.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec35980700 1 -- 172.21.15.27:0/3720221316 learned_addr learned my addr 172.21.15.27:0/3720221316 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec3497e700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 0x7fec300cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810566335 0 0) 0x7fec30158010 con 0x7fec30157980 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec180033f0 con 0x7fec30157980 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3191335959 0 0) 0x7fec180033f0 con 0x7fec30157980 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 msgr2=0x7fec300cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 0x7fec300cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 >> v1:172.21.15.40:6789/0 conn(0x7fec300cac00 legacy=0x7fec301537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec301585d0 con 0x7fec30157980 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fec20001470 con 0x7fec30157980 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 >> v1:172.21.15.27:6789/0 conn(0x7fec30157980 legacy=0x7fec300c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec18003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 0x7fec18004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec18004b80 0x7fec18005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec301588b0 con 0x7fec18003910 2023-05-17T15:08:30.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.925+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1800b910 con 0x7fec18004b80 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1800bad0 con 0x7fec30153ef0 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec18003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3497e700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 0x7fec18004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec35980700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec18004b80 0x7fec18005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 -- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 msgr2=0x7fec18004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec30153ef0 0x7fec18004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 -- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec18004b80 msgr2=0x7fec18005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:30.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec18004b80 0x7fec18005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 -- 172.21.15.27:0/3720221316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180033f0 con 0x7fec18003910 2023-05-17T15:08:30.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec3517f700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec18003d30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fec28001730 tx=0x7fec28007bb0).ready entity=mon.0 client_cookie=779c62c119bf11b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:30.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28007020 con 0x7fec18003910 2023-05-17T15:08:30.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28007180 con 0x7fec18003910 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec2ffff700 1 -- 172.21.15.27:0/3720221316 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28007500 con 0x7fec18003910 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.926+0000 7fec36181700 1 -- 172.21.15.27:0/3720221316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 msgr2=0x7fec18003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.927+0000 7fec36181700 1 --2- 172.21.15.27:0/3720221316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec18003d30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fec28001730 tx=0x7fec28007bb0).stop 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.927+0000 7fec35980700 1 -- 172.21.15.27:0/3720221316 reap_dead start 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.927+0000 7fec36181700 1 -- 172.21.15.27:0/3720221316 shutdown_connections 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.927+0000 7fec36181700 1 -- 172.21.15.27:0/3720221316 >> 172.21.15.27:0/3720221316 conn(0x7fec3005dd50 msgr2=0x7fec3005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:30.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.927+0000 7fec36181700 1 -- 172.21.15.27:0/3720221316 shutdown_connections 2023-05-17T15:08:30.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.927+0000 7fec36181700 1 -- 172.21.15.27:0/3720221316 wait complete. 2023-05-17T15:08:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.928+0000 7fec36181700 1 Processor -- start 2023-05-17T15:08:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.928+0000 7fec36181700 1 -- start start 2023-05-17T15:08:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec30151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec300c3be0 0x7fec3014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec301675b0 0x7fec30167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30167f00 con 0x7fec18003910 2023-05-17T15:08:30.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30150a70 con 0x7fec301675b0 2023-05-17T15:08:30.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec30150d50 con 0x7fec300c3be0 2023-05-17T15:08:30.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec30151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec30151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38784/0 (socket says 172.21.15.27:38784) 2023-05-17T15:08:30.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 -- 172.21.15.27:0/3356321121 learned_addr learned my addr 172.21.15.27:0/3356321121 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 -- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec300c3be0 msgr2=0x7fec3014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec35980700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec301675b0 0x7fec30167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3497e700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec300c3be0 0x7fec3014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec300c3be0 0x7fec3014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 -- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec301675b0 msgr2=0x7fec30167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec301675b0 0x7fec30167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:30.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 -- 172.21.15.27:0/3356321121 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30151030 con 0x7fec18003910 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3497e700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec300c3be0 0x7fec3014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec35980700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec301675b0 0x7fec30167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec3517f700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec30151b10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fec1800b8e0 tx=0x7fec28015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280137c0 con 0x7fec18003910 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28013920 con 0x7fec18003910 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec30151310 con 0x7fec18003910 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28013ca0 con 0x7fec18003910 2023-05-17T15:08:30.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.929+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec300b0570 con 0x7fec18003910 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.930+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec30151810 con 0x7fec18003910 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.931+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fec2801d070 con 0x7fec18003910 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.931+0000 7fec2d7fa700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fec1c05ed90 0x7fec1c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.931+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fec2807a7b0 con 0x7fec18003910 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.931+0000 7fec3497e700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fec1c05ed90 0x7fec1c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.931+0000 7fec3497e700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fec1c05ed90 0x7fec1c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fec240099f0 tx=0x7fec2400b040).ready entity=mgr.6003 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:30.935+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec2804bca0 con 0x7fec18003910 2023-05-17T15:08:31.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.153+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fec30047150 con 0x7fec18003910 2023-05-17T15:08:31.666 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.662+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fec28010030 con 0x7fec18003910 2023-05-17T15:08:31.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.663+0000 7fec2d7fa700 1 -- 172.21.15.27:0/3356321121 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7fec28041870 con 0x7fec18003910 2023-05-17T15:08:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.665+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fec1c05ed90 msgr2=0x7fec1c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.665+0000 7fec36181700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fec1c05ed90 0x7fec1c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fec240099f0 tx=0x7fec2400b040).stop 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.665+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 msgr2=0x7fec30151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.665+0000 7fec36181700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec30151b10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fec1800b8e0 tx=0x7fec28015000).stop 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 shutdown_connections 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fec1c05ed90 0x7fec1c061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec301675b0 0x7fec30167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec18003910 0x7fec30151b10 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 --2- 172.21.15.27:0/3356321121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec300c3be0 0x7fec3014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 >> 172.21.15.27:0/3356321121 conn(0x7fec3005dd50 msgr2=0x7fec300ac3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:31.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 shutdown_connections 2023-05-17T15:08:31.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.666+0000 7fec36181700 1 -- 172.21.15.27:0/3356321121 wait complete. 2023-05-17T15:08:31.683 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:08:31.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.803+0000 7f610759e700 1 Processor -- start 2023-05-17T15:08:31.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.803+0000 7f610759e700 1 -- start start 2023-05-17T15:08:31.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f61081521b0 0x7f6108064280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:31.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6108063df0 con 0x7f61080a6cf0 2023-05-17T15:08:31.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61080634c0 con 0x7f6108151dd0 2023-05-17T15:08:31.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610759e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080637a0 con 0x7f61081521b0 2023-05-17T15:08:31.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f6106d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f61080a6cf0 0x7f61080c4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38384/0 (socket says 172.21.15.27:38384) 2023-05-17T15:08:31.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f6106d9d700 1 -- 172.21.15.27:0/3514480721 learned_addr learned my addr 172.21.15.27:0/3514480721 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f6105d9b700 1 --2- 172.21.15.27:0/3514480721 >> v2:172.21.15.40:3300/0 conn(0x7f61081521b0 0x7f6108064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259783963 0 0) 0x7f6108063df0 con 0x7f61080a6cf0 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f00033f0 con 0x7f61080a6cf0 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521937391 0 0) 0x7f61080634c0 con 0x7f6108151dd0 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.804+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6108063df0 con 0x7f6108151dd0 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f6105d9b700 1 -- 172.21.15.27:0/3514480721 >> v1:172.21.15.40:6789/0 conn(0x7f6108151dd0 legacy=0x7f61080bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f6105d9b700 1 -- 172.21.15.27:0/3514480721 >> v1:172.21.15.27:6789/0 conn(0x7f61080a6cf0 legacy=0x7f61080c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265235401 0 0) 0x7f60f00033f0 con 0x7f61080a6cf0 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f6105d9b700 1 -- 172.21.15.27:0/3514480721 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108063a80 con 0x7f61081521b0 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f6105d9b700 1 --2- 172.21.15.27:0/3514480721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081521b0 0x7f6108064280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f60f8009760 tx=0x7f60f8009060).ready entity=mon.1 client_cookie=3858c2b5b54c27b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000017f0 con 0x7f61081521b0 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8011400 con 0x7f61081521b0 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.805+0000 7f610559a700 1 -- 172.21.15.27:0/3514480721 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8011780 con 0x7f61081521b0 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 -- 172.21.15.27:0/3514480721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081521b0 msgr2=0x7f6108064280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 --2- 172.21.15.27:0/3514480721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081521b0 0x7f6108064280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f60f8009760 tx=0x7f60f8009060).stop 2023-05-17T15:08:31.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 -- 172.21.15.27:0/3514480721 shutdown_connections 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 --2- 172.21.15.27:0/3514480721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081521b0 0x7f6108064280 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 -- 172.21.15.27:0/3514480721 >> 172.21.15.27:0/3514480721 conn(0x7f6108067cb0 msgr2=0x7f61080680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 -- 172.21.15.27:0/3514480721 shutdown_connections 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.806+0000 7f610759e700 1 -- 172.21.15.27:0/3514480721 wait complete. 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.807+0000 7f610759e700 1 Processor -- start 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.807+0000 7f610759e700 1 -- start start 2023-05-17T15:08:31.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61080a6cf0 0x7f61080ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 0x7f6108153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61081521b0 0x7f610814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080bfc70 con 0x7f6108151dd0 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61081540d0 con 0x7f61080a6cf0 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6108153830 con 0x7f61081521b0 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 0x7f6108153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:31.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 0x7f6108153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38826/0 (socket says 172.21.15.27:38826) 2023-05-17T15:08:31.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 -- 172.21.15.27:0/1147679058 learned_addr learned my addr 172.21.15.27:0/1147679058 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:31.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610659c700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61080a6cf0 0x7f61080ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:31.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6106d9d700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61081521b0 0x7f610814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:31.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 -- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61081521b0 msgr2=0x7f610814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61081521b0 0x7f610814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 -- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61080a6cf0 msgr2=0x7f61080ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61080a6cf0 0x7f61080ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 -- 172.21.15.27:0/1147679058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80092a0 con 0x7f6108151dd0 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f6105d9b700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 0x7f6108153030 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f610805ee30 tx=0x7f60f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80106c0 con 0x7f6108151dd0 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8010820 con 0x7f6108151dd0 2023-05-17T15:08:31.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6108153b10 con 0x7f6108151dd0 2023-05-17T15:08:31.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8010ba0 con 0x7f6108151dd0 2023-05-17T15:08:31.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.808+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108153520 con 0x7f6108151dd0 2023-05-17T15:08:31.820 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:31.809+0000 7f12eb77c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:08:31.821 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:31.806+0000 7f57ca290680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:08:31.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.809+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61080bfde0 con 0x7f6108151dd0 2023-05-17T15:08:31.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.810+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f60f800f070 con 0x7f6108151dd0 2023-05-17T15:08:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.810+0000 7f60f67fc700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60e805ede0 0x7f60e80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.811+0000 7f610659c700 1 -- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60e805ede0 msgr2=0x7f60e80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.811+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f60f807aed0 con 0x7f6108151dd0 2023-05-17T15:08:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.811+0000 7f610659c700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60e805ede0 0x7f60e80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.815+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60f804c420 con 0x7f6108151dd0 2023-05-17T15:08:31.875 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:31.872+0000 7f57ca290680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:08:31.879 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:31.876+0000 7f12eb77c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:08:31.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.988+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6108064770 con 0x7f6108151dd0 2023-05-17T15:08:31.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.992+0000 7f60f67fc700 1 -- 172.21.15.27:0/1147679058 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60f804fa40 con 0x7f6108151dd0 2023-05-17T15:08:31.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60e805ede0 msgr2=0x7f60e80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:31.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60e805ede0 0x7f60e80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:31.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 msgr2=0x7f6108153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:31.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 0x7f6108153030 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f610805ee30 tx=0x7f60f8016000).stop 2023-05-17T15:08:31.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 shutdown_connections 2023-05-17T15:08:31.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60e805ede0 0x7f60e80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:31.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61081521b0 0x7f610814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61080a6cf0 0x7f61080ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 --2- 172.21.15.27:0/1147679058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6108151dd0 0x7f6108153030 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:31.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 >> 172.21.15.27:0/1147679058 conn(0x7f6108067cb0 msgr2=0x7f61080c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:31.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 shutdown_connections 2023-05-17T15:08:31.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:31.994+0000 7f610759e700 1 -- 172.21.15.27:0/1147679058 wait complete. 2023-05-17T15:08:32.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:32.011 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:08:32.030 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-05-17T15:08:32.161 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:32.157+0000 7f57ca290680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:08:32.168 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:32.165+0000 7f12eb77c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:08:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.188+0000 7fe764f83700 1 Processor -- start 2023-05-17T15:08:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.188+0000 7fe764f83700 1 -- start start 2023-05-17T15:08:32.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe764f83700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe760151c90 0x7fe760152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe764f83700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe764f83700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe7600c0520 0x7fe760081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe764f83700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe760158010 con 0x7fe7600c0520 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe764f83700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe760154f60 con 0x7fe760151c90 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe764f83700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe760155240 con 0x7fe760154980 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe7600c0520 0x7fe760081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:32.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe7600c0520 0x7fe760081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38858/0 (socket says 172.21.15.27:38858) 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 -- 172.21.15.27:0/3049432554 learned_addr learned my addr 172.21.15.27:0/3049432554 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75e59c700 1 --2- 172.21.15.27:0/3049432554 >> v2:172.21.15.40:3300/0 conn(0x7fe760151c90 0x7fe760152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3049432554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 -- 172.21.15.27:0/3049432554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 msgr2=0x7fe7600c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 --2- 172.21.15.27:0/3049432554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 -- 172.21.15.27:0/3049432554 >> v2:172.21.15.40:3300/0 conn(0x7fe760151c90 msgr2=0x7fe760152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 --2- 172.21.15.27:0/3049432554 >> v2:172.21.15.40:3300/0 conn(0x7fe760151c90 0x7fe760152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.189+0000 7fe75ed9d700 1 -- 172.21.15.27:0/3049432554 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760155520 con 0x7fe7600c0520 2023-05-17T15:08:32.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe75ed9d700 1 --2- 172.21.15.27:0/3049432554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760081fd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe760084120 tx=0x7fe758009840).ready entity=mon.0 client_cookie=5a6575888c7a3647 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:32.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe75d59a700 1 -- 172.21.15.27:0/3049432554 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800e070 con 0x7fe7600c0520 2023-05-17T15:08:32.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe75d59a700 1 -- 172.21.15.27:0/3049432554 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800b970 con 0x7fe7600c0520 2023-05-17T15:08:32.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe75d59a700 1 -- 172.21.15.27:0/3049432554 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800bcf0 con 0x7fe7600c0520 2023-05-17T15:08:32.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 -- 172.21.15.27:0/3049432554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 msgr2=0x7fe760081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:32.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 --2- 172.21.15.27:0/3049432554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760081fd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe760084120 tx=0x7fe758009840).stop 2023-05-17T15:08:32.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 -- 172.21.15.27:0/3049432554 shutdown_connections 2023-05-17T15:08:32.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 --2- 172.21.15.27:0/3049432554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760081fd0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 --2- 172.21.15.27:0/3049432554 >> v2:172.21.15.40:3300/0 conn(0x7fe760151c90 0x7fe760152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 --2- 172.21.15.27:0/3049432554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 -- 172.21.15.27:0/3049432554 >> 172.21.15.27:0/3049432554 conn(0x7fe7600cae10 msgr2=0x7fe7600cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 -- 172.21.15.27:0/3049432554 shutdown_connections 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.190+0000 7fe764f83700 1 -- 172.21.15.27:0/3049432554 wait complete. 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.192+0000 7fe764f83700 1 Processor -- start 2023-05-17T15:08:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.192+0000 7fe764f83700 1 -- start start 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe760151c90 0x7fe760150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7601644b0 con 0x7fe7600c0520 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7601653b0 con 0x7fe760151c90 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600ae0a0 con 0x7fe760154980 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760164ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38860/0 (socket says 172.21.15.27:38860) 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 -- 172.21.15.27:0/3027799893 learned_addr learned my addr 172.21.15.27:0/3027799893 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe760151c90 0x7fe760150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75ed9d700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 msgr2=0x7fe7600b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe760154980 0x7fe7600b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe760151c90 msgr2=0x7fe760150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:32.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe760151c90 0x7fe760150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 -- 172.21.15.27:0/3027799893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758009ae0 con 0x7fe7600c0520 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe75e59c700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7600c0520 0x7fe760164ec0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fe74800e930 tx=0x7fe748009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748012600 con 0x7fe7600c0520 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748012760 con 0x7fe7600c0520 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 -- 172.21.15.27:0/3027799893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7600c2fe0 con 0x7fe7600c0520 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748012ae0 con 0x7fe7600c0520 2023-05-17T15:08:32.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.194+0000 7fe764f83700 1 -- 172.21.15.27:0/3027799893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7600c3620 con 0x7fe7600c0520 2023-05-17T15:08:32.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.195+0000 7fe764f83700 1 -- 172.21.15.27:0/3027799893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76006bdf0 con 0x7fe7600c0520 2023-05-17T15:08:32.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.196+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fe748022070 con 0x7fe7600c0520 2023-05-17T15:08:32.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.196+0000 7fe7567fc700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:32.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.196+0000 7fe75dd9b700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 msgr2=0x7fe7400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:32.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.196+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fe748079ec0 con 0x7fe7600c0520 2023-05-17T15:08:32.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.196+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:32.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.201+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe74804b410 con 0x7fe7600c0520 2023-05-17T15:08:32.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:32.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:32.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.397+0000 7fe75dd9b700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 msgr2=0x7fe7400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:32.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.397+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:32.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.401+0000 7fe764f83700 1 -- 172.21.15.27:0/3027799893 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7600bff90 con 0x7fe74005ede0 2023-05-17T15:08:32.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.798+0000 7fe75dd9b700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 msgr2=0x7fe7400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:32.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:32.798+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:08:32.818 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:32.814+0000 7f57ca290680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:08:32.832 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:32.828+0000 7f12eb77c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:08:32.886 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:32.882+0000 7f57ca290680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:08:32.900 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:32.896+0000 7f12eb77c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:08:33.078 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:33.074+0000 7f57ca290680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:08:33.092 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:33.089+0000 7f12eb77c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:08:33.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:33.507+0000 7f57ca290680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:08:33.526 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:33.523+0000 7f12eb77c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:08:33.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:33.599+0000 7fe75dd9b700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 msgr2=0x7fe7400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:33.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:33.599+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:08:33.619 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:33.615+0000 7f57ca290680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:33.634 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:33.630+0000 7f12eb77c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:33.777 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:33.773+0000 7f57ca290680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:33.792 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:33.788+0000 7f12eb77c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:33.854 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:33.850+0000 7f57ca290680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:08:33.869 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:33.866+0000 7f12eb77c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:08:33.923 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:33.920+0000 7f57ca290680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:08:33.939 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:33.935+0000 7f12eb77c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:08:34.192 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:34.188+0000 7f57ca290680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:08:34.207 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:34.203+0000 7f12eb77c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:08:34.380 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:34.377+0000 7f57ca290680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:34.395 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:34.391+0000 7f12eb77c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:35.058 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.054+0000 7f57ca290680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:08:35.071 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.067+0000 7f12eb77c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:08:35.128 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.124+0000 7f57ca290680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:08:35.142 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.138+0000 7f12eb77c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:08:35.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:35.200+0000 7fe75dd9b700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 msgr2=0x7fe7400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:35.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:35.200+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:08:35.205 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.201+0000 7f57ca290680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:08:35.219 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.216+0000 7f12eb77c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:08:35.358 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.354+0000 7f57ca290680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:08:35.372 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.368+0000 7f12eb77c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:08:35.430 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.426+0000 7f57ca290680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:08:35.445 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.441+0000 7f12eb77c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:08:35.548 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.545+0000 7f57ca290680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:08:35.564 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.560+0000 7f12eb77c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:08:35.660 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.656+0000 7f57ca290680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:35.676 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.672+0000 7f12eb77c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:35.959 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:35.955+0000 7f57ca290680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:08:35.974 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:35.970+0000 7f12eb77c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:08:36.031 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:36.028+0000 7f57ca290680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:08:36.047 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.043+0000 7f12eb77c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:08:36.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:36.097+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 26) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fe748077d70 con 0x7fe7600c0520 2023-05-17T15:08:36.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:36.097+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 msgr2=0x7fe7400612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:36.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:36.097+0000 7fe7567fc700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe7400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:36.161 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1269f5e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.161 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1266f58700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1269f5e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1266f58700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1269f5e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1266f58700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1266f58700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1269f5e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1269f5e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:36.163 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:36.157+0000 7f1266f58700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:37.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.113+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 27) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fe7480780f0 con 0x7fe7600c0520 2023-05-17T15:08:37.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.113+0000 7fe7567fc700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe74002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.113+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7600bff90 con 0x7fe74005ede0 2023-05-17T15:08:37.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.116+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe74002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.135+0000 7fe75dd9b700 1 --2- 172.21.15.27:0/3027799893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe74005ede0 0x7fe74002fd40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe7600a9b80 tx=0x7fe750009060).ready entity=mgr.6402 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:37.140 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:37.136+0000 7f1299207700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-05-17T15:08:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.136+0000 7fe7567fc700 1 -- 172.21.15.27:0/3027799893 <== mgr.6402 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fe7600bff90 con 0x7fe74005ede0 2023-05-17T15:08:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-05-17T15:08:37.145 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-17T15:08:37.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:37.147 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-17T15:08:37.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:08:37.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.330+0000 7fe28da94700 1 Processor -- start 2023-05-17T15:08:37.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.330+0000 7fe28da94700 1 -- start start 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe28da94700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2881543d0 0x7fe2880c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe28da94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880c60f0 0x7fe288068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe28da94700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2880c0c90 con 0x7fe2880691f0 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe28da94700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2880c1c50 con 0x7fe2881543d0 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe28da94700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe288158790 con 0x7fe2880c60f0 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe2877fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2881543d0 0x7fe2880c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe2877fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2881543d0 0x7fe2880c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39072/0 (socket says 172.21.15.27:39072) 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.331+0000 7fe2877fe700 1 -- 172.21.15.27:0/1868389643 learned_addr learned my addr 172.21.15.27:0/1868389643 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2877fe700 1 -- 172.21.15.27:0/1868389643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880c60f0 msgr2=0x7fe288068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe286ffd700 1 --2- 172.21.15.27:0/1868389643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880c60f0 0x7fe288068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2877fe700 1 --2- 172.21.15.27:0/1868389643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880c60f0 0x7fe288068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2877fe700 1 -- 172.21.15.27:0/1868389643 >> v1:172.21.15.27:6789/0 conn(0x7fe2880691f0 legacy=0x7fe2881547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2877fe700 1 -- 172.21.15.27:0/1868389643 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2880c6570 con 0x7fe2881543d0 2023-05-17T15:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2877fe700 1 --2- 172.21.15.27:0/1868389643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c5c00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fe278006fd0 tx=0x7fe2780090f0).ready entity=mon.0 client_cookie=527172efe29d648a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:37.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2867fc700 1 -- 172.21.15.27:0/1868389643 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800b600 con 0x7fe2881543d0 2023-05-17T15:08:37.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2867fc700 1 -- 172.21.15.27:0/1868389643 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800b760 con 0x7fe2881543d0 2023-05-17T15:08:37.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.332+0000 7fe2867fc700 1 -- 172.21.15.27:0/1868389643 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800bae0 con 0x7fe2881543d0 2023-05-17T15:08:37.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 -- 172.21.15.27:0/1868389643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 msgr2=0x7fe2880c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:37.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 --2- 172.21.15.27:0/1868389643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c5c00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fe278006fd0 tx=0x7fe2780090f0).stop 2023-05-17T15:08:37.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 -- 172.21.15.27:0/1868389643 shutdown_connections 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 --2- 172.21.15.27:0/1868389643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c5c00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 --2- 172.21.15.27:0/1868389643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880c60f0 0x7fe288068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 -- 172.21.15.27:0/1868389643 >> 172.21.15.27:0/1868389643 conn(0x7fe2880cb7f0 msgr2=0x7fe2880c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 -- 172.21.15.27:0/1868389643 shutdown_connections 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.333+0000 7fe28da94700 1 -- 172.21.15.27:0/1868389643 wait complete. 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.334+0000 7fe28da94700 1 Processor -- start 2023-05-17T15:08:37.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.334+0000 7fe28da94700 1 -- start start 2023-05-17T15:08:37.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880691f0 0x7fe28814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2880c60f0 0x7fe288155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880ae3c0 con 0x7fe2881543d0 2023-05-17T15:08:37.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28814d850 con 0x7fe2880c60f0 2023-05-17T15:08:37.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2881547b0 con 0x7fe2880691f0 2023-05-17T15:08:37.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39080/0 (socket says 172.21.15.27:39080) 2023-05-17T15:08:37.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 -- 172.21.15.27:0/1971523450 learned_addr learned my addr 172.21.15.27:0/1971523450 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:37.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe286ffd700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2880c60f0 0x7fe288155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe2877fe700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880691f0 0x7fe28814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 -- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880691f0 msgr2=0x7fe28814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:37.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880691f0 0x7fe28814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:37.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 -- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2880c60f0 msgr2=0x7fe288155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2880c60f0 0x7fe288155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 -- 172.21.15.27:0/1971523450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009370 con 0x7fe2881543d0 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe287fff700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c3f10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fe280002230 tx=0x7fe2800015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280010510 con 0x7fe2881543d0 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280010670 con 0x7fe2881543d0 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe288154a90 con 0x7fe2881543d0 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800109f0 con 0x7fe2881543d0 2023-05-17T15:08:37.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.335+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2880add70 con 0x7fe2881543d0 2023-05-17T15:08:37.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.336+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2880ae530 con 0x7fe2881543d0 2023-05-17T15:08:37.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.337+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 27) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fe280010070 con 0x7fe2881543d0 2023-05-17T15:08:37.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.337+0000 7fe26f7fe700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe27405ed40 0x7fe274061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:37.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.337+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fe2800797f0 con 0x7fe2881543d0 2023-05-17T15:08:37.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.337+0000 7fe2877fe700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe27405ed40 0x7fe274061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:37.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.337+0000 7fe2877fe700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe27405ed40 0x7fe274061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe278009130 tx=0x7fe278017000).ready entity=mgr.6402 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:37.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.341+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe28004ad40 con 0x7fe2881543d0 2023-05-17T15:08:37.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:37.562+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe288157e60 con 0x7fe2881543d0 2023-05-17T15:08:38.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.120+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe2800776a0 con 0x7fe2881543d0 2023-05-17T15:08:38.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.122+0000 7fe26f7fe700 1 -- 172.21.15.27:0/1971523450 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe280072a40 con 0x7fe2881543d0 2023-05-17T15:08:38.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe27405ed40 msgr2=0x7fe274061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe27405ed40 0x7fe274061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe278009130 tx=0x7fe278017000).stop 2023-05-17T15:08:38.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 msgr2=0x7fe2880c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c3f10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fe280002230 tx=0x7fe2800015e0).stop 2023-05-17T15:08:38.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 shutdown_connections 2023-05-17T15:08:38.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe27405ed40 0x7fe274061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2881543d0 0x7fe2880c3f10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2880691f0 0x7fe28814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 --2- 172.21.15.27:0/1971523450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2880c60f0 0x7fe288155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 >> 172.21.15.27:0/1971523450 conn(0x7fe2880cb7f0 msgr2=0x7fe2880ab200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:38.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 shutdown_connections 2023-05-17T15:08:38.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.124+0000 7fe28da94700 1 -- 172.21.15.27:0/1971523450 wait complete. 2023-05-17T15:08:38.143 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:08:38.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:38.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:38.205 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:08:38.205 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:08:38.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:08:38.206 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:08:38.261 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:08:38.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:08:38.262 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:08:38.272 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:38.268+0000 7f83a1585680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:08:38.272 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:38.269+0000 7f63178b7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:08:38.276 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:38.338 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:38.335+0000 7f83a1585680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:08:38.339 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:38.336+0000 7f63178b7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:08:38.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.431+0000 7f0a969cf700 1 Processor -- start 2023-05-17T15:08:38.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.431+0000 7f0a969cf700 1 -- start start 2023-05-17T15:08:38.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a969cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a900c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a969cf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a900ab8a0 0x7f0a900abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a969cf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a900aa530 con 0x7f0a90154110 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a969cf700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a900aabb0 con 0x7f0a900ab8a0 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a969cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900ab410 con 0x7f0a900826e0 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a94f6c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a900ab8a0 0x7f0a900abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a8ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0a90154110 0x7f0a90081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38698/0 (socket says 172.21.15.27:38698) 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a8ffff700 1 -- 172.21.15.27:0/564277449 learned_addr learned my addr 172.21.15.27:0/564277449 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:38.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a8f7fe700 1 --2- 172.21.15.27:0/564277449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a900c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.432+0000 7f0a8effd700 1 -- 172.21.15.27:0/564277449 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261603132 0 0) 0x7f0a900aa530 con 0x7f0a90154110 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a8effd700 1 -- 172.21.15.27:0/564277449 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a7c0033f0 con 0x7f0a90154110 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a94f6c700 1 -- 172.21.15.27:0/564277449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 msgr2=0x7f0a900c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a94f6c700 1 --2- 172.21.15.27:0/564277449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a900c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a94f6c700 1 -- 172.21.15.27:0/564277449 >> v1:172.21.15.27:6789/0 conn(0x7f0a90154110 legacy=0x7f0a90081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a94f6c700 1 -- 172.21.15.27:0/564277449 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900c7520 con 0x7f0a900ab8a0 2023-05-17T15:08:38.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a94f6c700 1 --2- 172.21.15.27:0/564277449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a900abcd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f0a88009e60 tx=0x7f0a88009780).ready entity=mon.0 client_cookie=59ff8bb4485d2297 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a8effd700 1 -- 172.21.15.27:0/564277449 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800e070 con 0x7f0a900ab8a0 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a8effd700 1 -- 172.21.15.27:0/564277449 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800bab0 con 0x7f0a900ab8a0 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a8effd700 1 -- 172.21.15.27:0/564277449 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800be30 con 0x7f0a900ab8a0 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 -- 172.21.15.27:0/564277449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 msgr2=0x7f0a900abcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 --2- 172.21.15.27:0/564277449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a900abcd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f0a88009e60 tx=0x7f0a88009780).stop 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 -- 172.21.15.27:0/564277449 shutdown_connections 2023-05-17T15:08:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 --2- 172.21.15.27:0/564277449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a900abcd0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 --2- 172.21.15.27:0/564277449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a900c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 -- 172.21.15.27:0/564277449 >> 172.21.15.27:0/564277449 conn(0x7f0a900cb700 msgr2=0x7f0a900c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:38.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.433+0000 7f0a969cf700 1 -- 172.21.15.27:0/564277449 shutdown_connections 2023-05-17T15:08:38.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.434+0000 7f0a969cf700 1 -- 172.21.15.27:0/564277449 wait complete. 2023-05-17T15:08:38.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 Processor -- start 2023-05-17T15:08:38.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 -- start start 2023-05-17T15:08:38.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a9014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a90156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a90154110 0x7f0a90151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900adf50 con 0x7f0a900ab8a0 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.435+0000 7f0a969cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90155c70 con 0x7f0a90154110 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a969cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90155f50 con 0x7f0a900826e0 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a90156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a90156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39144/0 (socket says 172.21.15.27:39144) 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 -- 172.21.15.27:0/3991288486 learned_addr learned my addr 172.21.15.27:0/3991288486 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8ffff700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a9014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a94f6c700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a90154110 0x7f0a90151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 -- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 msgr2=0x7f0a9014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a9014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 -- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a90154110 msgr2=0x7f0a90151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a90154110 0x7f0a90151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 -- 172.21.15.27:0/3991288486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009a20 con 0x7f0a900ab8a0 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a8f7fe700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a90156cf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f0a7800e900 tx=0x7f0a78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:38.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78012600 con 0x7f0a900ab8a0 2023-05-17T15:08:38.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a78012760 con 0x7f0a900ab8a0 2023-05-17T15:08:38.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a90156230 con 0x7f0a900ab8a0 2023-05-17T15:08:38.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78012ae0 con 0x7f0a900ab8a0 2023-05-17T15:08:38.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.436+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a901567f0 con 0x7f0a900ab8a0 2023-05-17T15:08:38.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.437+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74005120 con 0x7f0a900ab8a0 2023-05-17T15:08:38.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.438+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f0a78022070 con 0x7f0a900ab8a0 2023-05-17T15:08:38.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.438+0000 7f0a87fff700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 0x7f0a700612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.438+0000 7f0a8ffff700 1 -- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 msgr2=0x7f0a700612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.438+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f0a7807a080 con 0x7f0a900ab8a0 2023-05-17T15:08:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.438+0000 7f0a8ffff700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 0x7f0a700612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:38.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.446+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a7804b460 con 0x7f0a900ab8a0 2023-05-17T15:08:38.621 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:38.617+0000 7f83a1585680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:08:38.632 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:38.628+0000 7f63178b7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:08:38.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.639+0000 7f0a8ffff700 1 -- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 msgr2=0x7f0a700612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:38.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.639+0000 7f0a8ffff700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 0x7f0a700612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:38.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.660+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a74005d70 con 0x7f0a900ab8a0 2023-05-17T15:08:38.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.661+0000 7f0a87fff700 1 -- 172.21.15.27:0/3991288486 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f0a78016070 con 0x7f0a900ab8a0 2023-05-17T15:08:38.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:38.665 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:19.270502+0000","modified":"2023-05-17T15:08:22.276979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1785297520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1785297520},{"type":"v1","addr":"172.21.15.40:6835","nonce":1785297520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-17T15:08:38.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 msgr2=0x7f0a700612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:38.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 0x7f0a700612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:38.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 msgr2=0x7f0a90156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a90156cf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f0a7800e900 tx=0x7f0a78009060).stop 2023-05-17T15:08:38.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 shutdown_connections 2023-05-17T15:08:38.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0a7005ede0 0x7f0a700612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:38.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a90154110 0x7f0a90151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0a900826e0 0x7f0a9014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 --2- 172.21.15.27:0/3991288486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a900ab8a0 0x7f0a90156cf0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 >> 172.21.15.27:0/3991288486 conn(0x7f0a900cb700 msgr2=0x7f0a900c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:38.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 shutdown_connections 2023-05-17T15:08:38.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.663+0000 7f0a969cf700 1 -- 172.21.15.27:0/3991288486 wait complete. 2023-05-17T15:08:38.670 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2023-05-17T15:08:38.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:38.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.833+0000 7efda93e7700 1 Processor -- start 2023-05-17T15:08:38.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.833+0000 7efda93e7700 1 -- start start 2023-05-17T15:08:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda93e7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efda40c6310 0x7efda4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda93e7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40bfcd0 con 0x7efda40c5f30 2023-05-17T15:08:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda93e7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40c0290 con 0x7efda41541c0 2023-05-17T15:08:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda93e7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40aa1a0 con 0x7efda40c6310 2023-05-17T15:08:38.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efda40c6310 0x7efda4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efda40c6310 0x7efda4153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39170/0 (socket says 172.21.15.27:39170) 2023-05-17T15:08:38.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 -- 172.21.15.27:0/2715895454 learned_addr learned my addr 172.21.15.27:0/2715895454 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:38.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda2ffd700 1 --1- 172.21.15.27:0/2715895454 >> v1:172.21.15.27:6789/0 conn(0x7efda40c5f30 0x7efda4158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38730/0 (socket says 172.21.15.27:38730) 2023-05-17T15:08:38.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 -- 172.21.15.27:0/2715895454 >> v1:172.21.15.40:6789/0 conn(0x7efda41541c0 legacy=0x7efda40c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 -- 172.21.15.27:0/2715895454 >> v1:172.21.15.27:6789/0 conn(0x7efda40c5f30 legacy=0x7efda4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda1ffb700 1 -- 172.21.15.27:0/2715895454 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272805280 0 0) 0x7efda40bfcd0 con 0x7efda40c5f30 2023-05-17T15:08:38.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 -- 172.21.15.27:0/2715895454 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40aa480 con 0x7efda40c6310 2023-05-17T15:08:38.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda27fc700 1 --2- 172.21.15.27:0/2715895454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c6310 0x7efda4153cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7efd98006fd0 tx=0x7efd980090f0).ready entity=mon.0 client_cookie=a5b3af19d88d6107 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:38.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.834+0000 7efda1ffb700 1 -- 172.21.15.27:0/2715895454 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800b600 con 0x7efda40c6310 2023-05-17T15:08:38.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda1ffb700 1 -- 172.21.15.27:0/2715895454 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800b760 con 0x7efda40c6310 2023-05-17T15:08:38.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda1ffb700 1 -- 172.21.15.27:0/2715895454 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800bae0 con 0x7efda40c6310 2023-05-17T15:08:38.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 -- 172.21.15.27:0/2715895454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c6310 msgr2=0x7efda4153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 --2- 172.21.15.27:0/2715895454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c6310 0x7efda4153cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7efd98006fd0 tx=0x7efd980090f0).stop 2023-05-17T15:08:38.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 -- 172.21.15.27:0/2715895454 shutdown_connections 2023-05-17T15:08:38.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 --2- 172.21.15.27:0/2715895454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c6310 0x7efda4153cd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 -- 172.21.15.27:0/2715895454 >> 172.21.15.27:0/2715895454 conn(0x7efda4069e70 msgr2=0x7efda405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:38.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 -- 172.21.15.27:0/2715895454 shutdown_connections 2023-05-17T15:08:38.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.835+0000 7efda93e7700 1 -- 172.21.15.27:0/2715895454 wait complete. 2023-05-17T15:08:38.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.836+0000 7efda93e7700 1 Processor -- start 2023-05-17T15:08:38.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.836+0000 7efda93e7700 1 -- start start 2023-05-17T15:08:38.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda93e7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 0x7efda40c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda93e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c6310 0x7efda414c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda93e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda41541c0 0x7efda40afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda93e7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40c3870 con 0x7efda40c5f30 2023-05-17T15:08:38.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda93e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40cb1c0 con 0x7efda41541c0 2023-05-17T15:08:38.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda93e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda4169070 con 0x7efda40c6310 2023-05-17T15:08:38.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 0x7efda40c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 0x7efda40c3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39174/0 (socket says 172.21.15.27:39174) 2023-05-17T15:08:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda2ffd700 1 -- 172.21.15.27:0/501686997 learned_addr learned my addr 172.21.15.27:0/501686997 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda37fe700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda41541c0 0x7efda40afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.837+0000 7efda27fc700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c6310 0x7efda414c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda2ffd700 1 -- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c6310 msgr2=0x7efda414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda2ffd700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c6310 0x7efda414c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda2ffd700 1 -- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda41541c0 msgr2=0x7efda40afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda2ffd700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda41541c0 0x7efda40afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda2ffd700 1 -- 172.21.15.27:0/501686997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009370 con 0x7efda40c5f30 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda2ffd700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 0x7efda40c3380 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7efd9400c490 tx=0x7efd94007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940070d0 con 0x7efda40c5f30 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd94007250 con 0x7efda40c5f30 2023-05-17T15:08:38.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda40c9270 con 0x7efda40c5f30 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940056e0 con 0x7efda40c5f30 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.838+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda40c8f00 con 0x7efda40c5f30 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.839+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda405f4a0 con 0x7efda40c5f30 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.840+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7efd94010070 con 0x7efda40c5f30 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.840+0000 7efd8affd700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd9005ede0 0x7efd900612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.840+0000 7efda27fc700 1 -- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd9005ede0 msgr2=0x7efd900612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:38.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.840+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7efd940798c0 con 0x7efda40c5f30 2023-05-17T15:08:38.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.840+0000 7efda27fc700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd9005ede0 0x7efd900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:38.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:38.843+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd9404aca0 con 0x7efda40c5f30 2023-05-17T15:08:39.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.017+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda406bdf0 con 0x7efda40c5f30 2023-05-17T15:08:39.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.018+0000 7efd8affd700 1 -- 172.21.15.27:0/501686997 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17287 (secure 0 0 0) 0x7efd9404e2c0 con 0x7efda40c5f30 2023-05-17T15:08:39.022 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:39.023 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":84,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:36.057693+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:17.825758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:18.244928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1766346357":"2023-05-18T15:08:36.057668+0000","172.21.15.27:0/3574246489":"2023-05-18T15:08:36.057668+0000","172.21.15.27:6837/86332":"2023-05-18T15:08:36.057668+0000","172.21.15.27:6836/86332":"2023-05-18T15:08:36.057668+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:39.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.020+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd9005ede0 msgr2=0x7efd900612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.020+0000 7efda93e7700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd9005ede0 0x7efd900612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.020+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 msgr2=0x7efda40c3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.020+0000 7efda93e7700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 0x7efda40c3380 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7efd9400c490 tx=0x7efd94007de0).stop 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 shutdown_connections 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd9005ede0 0x7efd900612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efda41541c0 0x7efda40afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efda40c5f30 0x7efda40c3380 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 --2- 172.21.15.27:0/501686997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efda40c6310 0x7efda414c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 >> 172.21.15.27:0/501686997 conn(0x7efda4069e70 msgr2=0x7efda40ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:39.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 shutdown_connections 2023-05-17T15:08:39.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.021+0000 7efda93e7700 1 -- 172.21.15.27:0/501686997 wait complete. 2023-05-17T15:08:39.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:08:17.825758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:08:18.244928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:08:39.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:08:39.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.156+0000 7fb30115d700 1 Processor -- start 2023-05-17T15:08:39.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.156+0000 7fb30115d700 1 -- start start 2023-05-17T15:08:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb30115d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2fc153e20 0x7fb2fc0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb30115d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc0c7d70 0x7fb2fc0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb30115d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc1589e0 con 0x7fb2fc154200 2023-05-17T15:08:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb30115d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc0c66a0 con 0x7fb2fc153e20 2023-05-17T15:08:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb30115d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc157dd0 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2fc153e20 0x7fb2fc0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2fc153e20 0x7fb2fc0c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39182/0 (socket says 172.21.15.27:39182) 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1106332102 learned_addr learned my addr 172.21.15.27:0/1106332102 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fb59e700 1 --2- 172.21.15.27:0/1106332102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc0c7d70 0x7fb2fc0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1106332102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc0c7d70 msgr2=0x7fb2fc0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 --2- 172.21.15.27:0/1106332102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc0c7d70 0x7fb2fc0c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1106332102 >> v1:172.21.15.40:6789/0 conn(0x7fb2fc154200 legacy=0x7fb2fc0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1106332102 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc1580b0 con 0x7fb2fc153e20 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.157+0000 7fb2fad9d700 1 --2- 172.21.15.27:0/1106332102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc153e20 0x7fb2fc0c5cc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fb2f0006fd0 tx=0x7fb2f00090f0).ready entity=mon.0 client_cookie=474ddb78f3d1abb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb2f9d9b700 1 -- 172.21.15.27:0/1106332102 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000b580 con 0x7fb2fc153e20 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb2f9d9b700 1 -- 172.21.15.27:0/1106332102 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000b6e0 con 0x7fb2fc153e20 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb2f9d9b700 1 -- 172.21.15.27:0/1106332102 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000ba60 con 0x7fb2fc153e20 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 -- 172.21.15.27:0/1106332102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc153e20 msgr2=0x7fb2fc0c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 --2- 172.21.15.27:0/1106332102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc153e20 0x7fb2fc0c5cc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fb2f0006fd0 tx=0x7fb2f00090f0).stop 2023-05-17T15:08:39.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 -- 172.21.15.27:0/1106332102 shutdown_connections 2023-05-17T15:08:39.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 --2- 172.21.15.27:0/1106332102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc0c7d70 0x7fb2fc0c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 --2- 172.21.15.27:0/1106332102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc153e20 0x7fb2fc0c5cc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 -- 172.21.15.27:0/1106332102 >> 172.21.15.27:0/1106332102 conn(0x7fb2fc05dd50 msgr2=0x7fb2fc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:39.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 -- 172.21.15.27:0/1106332102 shutdown_connections 2023-05-17T15:08:39.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.158+0000 7fb30115d700 1 -- 172.21.15.27:0/1106332102 wait complete. 2023-05-17T15:08:39.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.159+0000 7fb30115d700 1 Processor -- start 2023-05-17T15:08:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.159+0000 7fb30115d700 1 -- start start 2023-05-17T15:08:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb30115d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 0x7fb2fc14d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb30115d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc153e20 0x7fb2fc154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb30115d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2fc154200 0x7fb2fc0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb30115d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc165c70 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb30115d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0ae480 con 0x7fb2fc154200 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb30115d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc165990 con 0x7fb2fc153e20 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb2fad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 0x7fb2fc14d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb2fad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 0x7fb2fc14d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39188/0 (socket says 172.21.15.27:39188) 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1306511343 learned_addr learned my addr 172.21.15.27:0/1306511343 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb2fa59c700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc153e20 0x7fb2fc154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.160+0000 7fb2fb59e700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2fc154200 0x7fb2fc0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc153e20 msgr2=0x7fb2fc154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2fad9d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc153e20 0x7fb2fc154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2fc154200 msgr2=0x7fb2fc0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2fad9d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2fc154200 0x7fb2fc0af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2fad9d700 1 -- 172.21.15.27:0/1306511343 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0009370 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2fad9d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 0x7fb2fc14d920 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fb2f0009fd0 tx=0x7fb2f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0000bc0 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000b850 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc0ade30 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0000d20 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.161+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc14de10 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.162+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc06bdf0 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.162+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fb2f002c070 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.163+0000 7fb2e2ffd700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 0x7fb2e80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.163+0000 7fb2fa59c700 1 -- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 msgr2=0x7fb2e80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:39.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.163+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fb2f007b890 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.163+0000 7fb2fa59c700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 0x7fb2e80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:39.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.167+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2f004cc70 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.276 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:39.273+0000 7f83a1585680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:08:39.311 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:39.303+0000 7f63178b7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:08:39.344 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:39.340+0000 7f83a1585680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:08:39.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.364+0000 7fb2fa59c700 1 -- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 msgr2=0x7fb2e80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:39.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.364+0000 7fb2fa59c700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 0x7fb2e80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:39.377 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:39.373+0000 7f63178b7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:08:39.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.398+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb2fc157910 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.399+0000 7fb2e2ffd700 1 -- 172.21.15.27:0/1306511343 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb2f002a020 con 0x7fb2fc0c7d70 2023-05-17T15:08:39.403 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:08:39.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 msgr2=0x7fb2e80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:39.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 0x7fb2e80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:39.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 msgr2=0x7fb2fc14d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 0x7fb2fc14d920 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fb2f0009fd0 tx=0x7fb2f0017000).stop 2023-05-17T15:08:39.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 shutdown_connections 2023-05-17T15:08:39.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb2e805ede0 0x7fb2e80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2fc154200 0x7fb2fc0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2fc0c7d70 0x7fb2fc14d920 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 --2- 172.21.15.27:0/1306511343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2fc153e20 0x7fb2fc154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 >> 172.21.15.27:0/1306511343 conn(0x7fb2fc05dd50 msgr2=0x7fb2fc0ad2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 shutdown_connections 2023-05-17T15:08:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.401+0000 7fb30115d700 1 -- 172.21.15.27:0/1306511343 wait complete. 2023-05-17T15:08:39.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:08:39.536 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:39.532+0000 7f83a1585680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:08:39.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.536+0000 7f81d0087700 1 Processor -- start 2023-05-17T15:08:39.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.536+0000 7f81d0087700 1 -- start start 2023-05-17T15:08:39.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81d0087700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f81c81543d0 0x7f81c80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81d0087700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f81c8069410 0x7f81c80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81d0087700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c8158790 con 0x7f81c80c60f0 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81d0087700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80c1c50 con 0x7f81c81543d0 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81d0087700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80c6570 con 0x7f81c8069410 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cde23700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f81c81543d0 0x7f81c80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cd622700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f81c80c60f0 0x7f81c8068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38760/0 (socket says 172.21.15.27:38760) 2023-05-17T15:08:39.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cd622700 1 -- 172.21.15.27:0/37256733 learned_addr learned my addr 172.21.15.27:0/37256733 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81ce624700 1 --2- 172.21.15.27:0/37256733 >> v2:172.21.15.40:3300/0 conn(0x7f81c8069410 0x7f81c80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cde23700 1 -- 172.21.15.27:0/37256733 >> v2:172.21.15.40:3300/0 conn(0x7f81c8069410 msgr2=0x7f81c80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cde23700 1 --2- 172.21.15.27:0/37256733 >> v2:172.21.15.40:3300/0 conn(0x7f81c8069410 0x7f81c80bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cde23700 1 -- 172.21.15.27:0/37256733 >> v1:172.21.15.27:6789/0 conn(0x7f81c80c60f0 legacy=0x7f81c8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cde23700 1 -- 172.21.15.27:0/37256733 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8157e60 con 0x7f81c81543d0 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.537+0000 7f81cce21700 1 -- 172.21.15.27:0/37256733 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331927925 0 0) 0x7f81c8158790 con 0x7f81c80c60f0 2023-05-17T15:08:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81cde23700 1 --2- 172.21.15.27:0/37256733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c81543d0 0x7f81c80c5c00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f81c8155920 tx=0x7f81c4009060).ready entity=mon.0 client_cookie=53f0500ebc702e09 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81cce21700 1 -- 172.21.15.27:0/37256733 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400f510 con 0x7f81c81543d0 2023-05-17T15:08:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81cce21700 1 -- 172.21.15.27:0/37256733 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400f670 con 0x7f81c81543d0 2023-05-17T15:08:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81cce21700 1 -- 172.21.15.27:0/37256733 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400f9f0 con 0x7f81c81543d0 2023-05-17T15:08:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 -- 172.21.15.27:0/37256733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c81543d0 msgr2=0x7f81c80c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 --2- 172.21.15.27:0/37256733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c81543d0 0x7f81c80c5c00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f81c8155920 tx=0x7f81c4009060).stop 2023-05-17T15:08:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 -- 172.21.15.27:0/37256733 shutdown_connections 2023-05-17T15:08:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 --2- 172.21.15.27:0/37256733 >> v2:172.21.15.40:3300/0 conn(0x7f81c8069410 0x7f81c80bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 --2- 172.21.15.27:0/37256733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c81543d0 0x7f81c80c5c00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 -- 172.21.15.27:0/37256733 >> 172.21.15.27:0/37256733 conn(0x7f81c80cb7f0 msgr2=0x7f81c80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 -- 172.21.15.27:0/37256733 shutdown_connections 2023-05-17T15:08:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.538+0000 7f81d0087700 1 -- 172.21.15.27:0/37256733 wait complete. 2023-05-17T15:08:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.539+0000 7f81d0087700 1 Processor -- start 2023-05-17T15:08:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 -- start start 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c8069410 0x7f81c81529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c80c60f0 0x7f81c80afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f81c81543d0 0x7f81c80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80c3c80 con 0x7f81c80c60f0 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80c2d90 con 0x7f81c8069410 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81d0087700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80c3070 con 0x7f81c81543d0 2023-05-17T15:08:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81cd622700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c80c60f0 0x7f81c80afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81cd622700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c80c60f0 0x7f81c80afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39206/0 (socket says 172.21.15.27:39206) 2023-05-17T15:08:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.540+0000 7f81cd622700 1 -- 172.21.15.27:0/973158152 learned_addr learned my addr 172.21.15.27:0/973158152 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c8069410 0x7f81c81529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81ce624700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f81c81543d0 0x7f81c80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 -- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f81c81543d0 msgr2=0x7f81c80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f81c81543d0 0x7f81c80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 -- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c80c60f0 msgr2=0x7f81c80afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c80c60f0 0x7f81c80afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 -- 172.21.15.27:0/973158152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40092a0 con 0x7f81c8069410 2023-05-17T15:08:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81ce624700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f81c81543d0 0x7f81c80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81cde23700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c8069410 0x7f81c81529b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f81c4014000 tx=0x7f81c4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400fe80 con 0x7f81c8069410 2023-05-17T15:08:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400f7e0 con 0x7f81c8069410 2023-05-17T15:08:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c80c3350 con 0x7f81c8069410 2023-05-17T15:08:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c401a630 con 0x7f81c8069410 2023-05-17T15:08:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.541+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c80c3910 con 0x7f81c8069410 2023-05-17T15:08:39.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.542+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c806bdf0 con 0x7f81c8069410 2023-05-17T15:08:39.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.543+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f81c402b070 con 0x7f81c8069410 2023-05-17T15:08:39.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.543+0000 7f81bdffb700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f81ac05ede0 0x7f81ac0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.543+0000 7f81cd622700 1 -- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f81ac05ede0 msgr2=0x7f81ac0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.543+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f81c407afc0 con 0x7f81c8069410 2023-05-17T15:08:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.543+0000 7f81cd622700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f81ac05ede0 0x7f81ac0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.547+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81c404c3a0 con 0x7f81c8069410 2023-05-17T15:08:39.574 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:39.571+0000 7f63178b7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:08:39.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.725+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81c8069d00 con 0x7f81c8069410 2023-05-17T15:08:39.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.725+0000 7f81bdffb700 1 -- 172.21.15.27:0/973158152 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81c4029020 con 0x7f81c8069410 2023-05-17T15:08:39.729 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:08:39.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f81ac05ede0 msgr2=0x7f81ac0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:39.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f81ac05ede0 0x7f81ac0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c8069410 msgr2=0x7f81c81529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c8069410 0x7f81c81529b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f81c4014000 tx=0x7f81c4017000).stop 2023-05-17T15:08:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 shutdown_connections 2023-05-17T15:08:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f81ac05ede0 0x7f81ac0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f81c81543d0 0x7f81c80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c8069410 0x7f81c81529b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 --2- 172.21.15.27:0/973158152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81c80c60f0 0x7f81c80afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 >> 172.21.15.27:0/973158152 conn(0x7f81c80cb7f0 msgr2=0x7f81c8153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 shutdown_connections 2023-05-17T15:08:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.727+0000 7f81d0087700 1 -- 172.21.15.27:0/973158152 wait complete. 2023-05-17T15:08:39.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:08:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.862+0000 7fecf51e8700 1 Processor -- start 2023-05-17T15:08:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.862+0000 7fecf51e8700 1 -- start start 2023-05-17T15:08:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecf51e8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fecf0150f40 0x7fecf0064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecf51e8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fecf00683c0 0x7fecf00c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecf51e8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf00c28e0 con 0x7fecf0150b60 2023-05-17T15:08:39.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecf51e8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf01558b0 con 0x7fecf0150f40 2023-05-17T15:08:39.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecf51e8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf0065390 con 0x7fecf00683c0 2023-05-17T15:08:39.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecee59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fecf0150f40 0x7fecf0064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecee59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fecf0150f40 0x7fecf0064ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39228/0 (socket says 172.21.15.27:39228) 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.863+0000 7fecee59c700 1 -- 172.21.15.27:0/1246252981 learned_addr learned my addr 172.21.15.27:0/1246252981 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecef59e700 1 --2- 172.21.15.27:0/1246252981 >> v2:172.21.15.40:3300/0 conn(0x7fecf00683c0 0x7fecf00c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecee59c700 1 -- 172.21.15.27:0/1246252981 >> v2:172.21.15.40:3300/0 conn(0x7fecf00683c0 msgr2=0x7fecf00c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecee59c700 1 --2- 172.21.15.27:0/1246252981 >> v2:172.21.15.40:3300/0 conn(0x7fecf00683c0 0x7fecf00c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecee59c700 1 -- 172.21.15.27:0/1246252981 >> v1:172.21.15.40:6789/0 conn(0x7fecf0150b60 legacy=0x7fecf0067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecee59c700 1 -- 172.21.15.27:0/1246252981 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00c4190 con 0x7fecf0150f40 2023-05-17T15:08:39.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecee59c700 1 --2- 172.21.15.27:0/1246252981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150f40 0x7fecf0064ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fecf005fa30 tx=0x7fece40090f0).ready entity=mon.0 client_cookie=9da36b92b14bbebc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:39.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecedd9b700 1 -- 172.21.15.27:0/1246252981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400b520 con 0x7fecf0150f40 2023-05-17T15:08:39.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecedd9b700 1 -- 172.21.15.27:0/1246252981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400b680 con 0x7fecf0150f40 2023-05-17T15:08:39.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.864+0000 7fecedd9b700 1 -- 172.21.15.27:0/1246252981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400ba00 con 0x7fecf0150f40 2023-05-17T15:08:39.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 -- 172.21.15.27:0/1246252981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150f40 msgr2=0x7fecf0064ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 --2- 172.21.15.27:0/1246252981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150f40 0x7fecf0064ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fecf005fa30 tx=0x7fece40090f0).stop 2023-05-17T15:08:39.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 -- 172.21.15.27:0/1246252981 shutdown_connections 2023-05-17T15:08:39.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 --2- 172.21.15.27:0/1246252981 >> v2:172.21.15.40:3300/0 conn(0x7fecf00683c0 0x7fecf00c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 --2- 172.21.15.27:0/1246252981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150f40 0x7fecf0064ea0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 -- 172.21.15.27:0/1246252981 >> 172.21.15.27:0/1246252981 conn(0x7fecf00c7910 msgr2=0x7fecf00c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:39.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 -- 172.21.15.27:0/1246252981 shutdown_connections 2023-05-17T15:08:39.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.865+0000 7fecf51e8700 1 -- 172.21.15.27:0/1246252981 wait complete. 2023-05-17T15:08:39.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.866+0000 7fecf51e8700 1 Processor -- start 2023-05-17T15:08:39.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.866+0000 7fecf51e8700 1 -- start start 2023-05-17T15:08:39.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecf51e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf00683c0 0x7fecf014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecf51e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 0x7fecf00a7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecf51e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf0150f40 0x7fecf00c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecf51e8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0153d00 con 0x7fecf0150b60 2023-05-17T15:08:39.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecf51e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00a75a0 con 0x7fecf00683c0 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecf51e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00a7250 con 0x7fecf0150f40 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 0x7fecf00a7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 0x7fecf00a7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39234/0 (socket says 172.21.15.27:39234) 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 -- 172.21.15.27:0/2052539892 learned_addr learned my addr 172.21.15.27:0/2052539892 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7feceed9d700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf00683c0 0x7fecf014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecef59e700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf0150f40 0x7fecf00c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:39.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 -- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf0150f40 msgr2=0x7fecf00c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf0150f40 0x7fecf00c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 -- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf00683c0 msgr2=0x7fecf014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf00683c0 0x7fecf014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 -- 172.21.15.27:0/2052539892 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4009370 con 0x7fecf0150b60 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.867+0000 7fecee59c700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 0x7fecf00a7a30 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fecf00c8460 tx=0x7fece4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.868+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400be90 con 0x7fecf0150b60 2023-05-17T15:08:39.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.868+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400b7f0 con 0x7fecf0150b60 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.868+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0153f30 con 0x7fecf0150b60 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.868+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece401c670 con 0x7fecf0150b60 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.868+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf01544f0 con 0x7fecf0150b60 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.869+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf006bdf0 con 0x7fecf0150b60 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.869+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fece400f070 con 0x7fecf0150b60 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.870+0000 7fecd6ffd700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecdc05ede0 0x7fecdc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:39.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.870+0000 7feceed9d700 1 -- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecdc05ede0 msgr2=0x7fecdc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:39.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.870+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fece407b3a0 con 0x7fecf0150b60 2023-05-17T15:08:39.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.870+0000 7feceed9d700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecdc05ede0 0x7fecdc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:39.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:39.874+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fece404c780 con 0x7fecf0150b60 2023-05-17T15:08:39.973 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:39.969+0000 7f83a1585680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:08:40.017 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.013+0000 7f63178b7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:08:40.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.047+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fecf00c2d70 con 0x7fecf0150b60 2023-05-17T15:08:40.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.047+0000 7fecd6ffd700 1 -- 172.21.15.27:0/2052539892 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fece40200a0 con 0x7fecf0150b60 2023-05-17T15:08:40.051 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:08:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecdc05ede0 msgr2=0x7fecdc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecdc05ede0 0x7fecdc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 msgr2=0x7fecf00a7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 0x7fecf00a7a30 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fecf00c8460 tx=0x7fece4017000).stop 2023-05-17T15:08:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 shutdown_connections 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecdc05ede0 0x7fecdc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf0150f40 0x7fecf00c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf00683c0 0x7fecf014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 --2- 172.21.15.27:0/2052539892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0150b60 0x7fecf00a7a30 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 >> 172.21.15.27:0/2052539892 conn(0x7fecf00c7910 msgr2=0x7fecf014c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 shutdown_connections 2023-05-17T15:08:40.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.049+0000 7fecf51e8700 1 -- 172.21.15.27:0/2052539892 wait complete. 2023-05-17T15:08:40.065 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:08:40.079 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:40.076+0000 7f83a1585680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:40.127 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.123+0000 7f63178b7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:40.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.182+0000 7ff8c7b9b700 1 Processor -- start 2023-05-17T15:08:40.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.182+0000 7ff8c7b9b700 1 -- start start 2023-05-17T15:08:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c7b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8c00be280 0x7ff8c0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c7b9b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c00a7bf0 con 0x7ff8c005df10 2023-05-17T15:08:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c7b9b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c0155970 con 0x7ff8c005e2f0 2023-05-17T15:08:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c7b9b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c005e750 con 0x7ff8c00be280 2023-05-17T15:08:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c5937700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff8c005df10 0x7ff8c0064220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38804/0 (socket says 172.21.15.27:38804) 2023-05-17T15:08:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c5937700 1 -- 172.21.15.27:0/2966528693 learned_addr learned my addr 172.21.15.27:0/2966528693 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.183+0000 7ff8c6138700 1 --2- 172.21.15.27:0/2966528693 >> v2:172.21.15.40:3300/0 conn(0x7ff8c00be280 0x7ff8c0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200638178 0 0) 0x7ff8c00a7bf0 con 0x7ff8c005df10 2023-05-17T15:08:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac0033f0 con 0x7ff8c005df10 2023-05-17T15:08:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246806711 0 0) 0x7ff8c0155970 con 0x7ff8c005e2f0 2023-05-17T15:08:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c00a7bf0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c6138700 1 -- 172.21.15.27:0/2966528693 >> v1:172.21.15.40:6789/0 conn(0x7ff8c005e2f0 legacy=0x7ff8c01517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c6138700 1 -- 172.21.15.27:0/2966528693 >> v1:172.21.15.27:6789/0 conn(0x7ff8c005df10 legacy=0x7ff8c0064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c6138700 1 -- 172.21.15.27:0/2966528693 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0155c30 con 0x7ff8c00be280 2023-05-17T15:08:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c6138700 1 --2- 172.21.15.27:0/2966528693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c0151ec0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff8b8009e60 tx=0x7ff8b8009780).ready entity=mon.1 client_cookie=2f53cb9c8f6aa495 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800e070 con 0x7ff8c00be280 2023-05-17T15:08:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b800bab0 con 0x7ff8c00be280 2023-05-17T15:08:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.184+0000 7ff8c4935700 1 -- 172.21.15.27:0/2966528693 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800be30 con 0x7ff8c00be280 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/2966528693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 msgr2=0x7ff8c0151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/2966528693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c0151ec0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff8b8009e60 tx=0x7ff8b8009780).stop 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/2966528693 shutdown_connections 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/2966528693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c0151ec0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/2966528693 >> 172.21.15.27:0/2966528693 conn(0x7ff8c00c7910 msgr2=0x7ff8c00c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/2966528693 shutdown_connections 2023-05-17T15:08:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.185+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/2966528693 wait complete. 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.186+0000 7ff8c7b9b700 1 Processor -- start 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.186+0000 7ff8c7b9b700 1 -- start start 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c7b9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8c005df10 0x7ff8c0151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c7b9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 0x7ff8c0165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c7b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c00c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c7b9b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00bfed0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c7b9b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c0156b90 con 0x7ff8c00be280 2023-05-17T15:08:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c7b9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00c17b0 con 0x7ff8c005df10 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 0x7ff8c0165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 0x7ff8c0165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39248/0 (socket says 172.21.15.27:39248) 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 -- 172.21.15.27:0/3309263666 learned_addr learned my addr 172.21.15.27:0/3309263666 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c6138700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c00c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5937700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8c005df10 0x7ff8c0151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 -- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8c005df10 msgr2=0x7ff8c0151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8c005df10 0x7ff8c0151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 -- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 msgr2=0x7ff8c00c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c00c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 -- 172.21.15.27:0/3309263666 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009a20 con 0x7ff8c005e2f0 2023-05-17T15:08:40.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.187+0000 7ff8c5136700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 0x7ff8c0165010 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7ff8bc00c4a0 tx=0x7ff8bc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:40.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.188+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00ce50 con 0x7ff8c005e2f0 2023-05-17T15:08:40.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.188+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00f470 con 0x7ff8c005e2f0 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.188+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c00c0f10 con 0x7ff8c005e2f0 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.188+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00f810 con 0x7ff8c005e2f0 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.188+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c00c14d0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.189+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff8bc019030 con 0x7ff8c005e2f0 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.189+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c0156cd0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.189+0000 7ff8b5ffb700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8a405edb0 0x7ff8a4061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.189+0000 7ff8c5937700 1 -- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8a405edb0 msgr2=0x7ff8a4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:40.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.189+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7ff8bc079200 con 0x7ff8c005e2f0 2023-05-17T15:08:40.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.189+0000 7ff8c5937700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8a405edb0 0x7ff8a4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:40.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.194+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff8c0156cd0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.237 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:40.234+0000 7f83a1585680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:40.288 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.284+0000 7f63178b7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:40.314 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:40.311+0000 7f83a1585680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:08:40.365 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.361+0000 7f63178b7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:08:40.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.369+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8c0156cd0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.369+0000 7ff8b5ffb700 1 -- 172.21.15.27:0/3309263666 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8c0156cd0 con 0x7ff8c005e2f0 2023-05-17T15:08:40.373 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:08:40.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8a405edb0 msgr2=0x7ff8a4061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:40.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8a405edb0 0x7ff8a4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 msgr2=0x7ff8c0165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 0x7ff8c0165010 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7ff8bc00c4a0 tx=0x7ff8bc007c50).stop 2023-05-17T15:08:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 shutdown_connections 2023-05-17T15:08:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8a405edb0 0x7ff8a4061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c00be280 0x7ff8c00c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8c005df10 0x7ff8c0151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 --2- 172.21.15.27:0/3309263666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8c005e2f0 0x7ff8c0165010 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 >> 172.21.15.27:0/3309263666 conn(0x7ff8c00c7910 msgr2=0x7ff8c00c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:40.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 shutdown_connections 2023-05-17T15:08:40.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.371+0000 7ff8c7b9b700 1 -- 172.21.15.27:0/3309263666 wait complete. 2023-05-17T15:08:40.383 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:40.380+0000 7f83a1585680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:08:40.387 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:40.437 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.433+0000 7f63178b7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:08:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.501+0000 7f2a0359e700 1 Processor -- start 2023-05-17T15:08:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.501+0000 7f2a0359e700 1 -- start start 2023-05-17T15:08:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a040c73c0 0x7f2a040bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a04067600 con 0x7f2a040c6fe0 2023-05-17T15:08:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040bd130 con 0x7f2a040bcc10 2023-05-17T15:08:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040bd410 con 0x7f2a040c73c0 2023-05-17T15:08:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a01d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a040c73c0 0x7f2a040bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2a040c6fe0 0x7f2a04066ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38816/0 (socket says 172.21.15.27:38816) 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0259c700 1 -- 172.21.15.27:0/591744100 learned_addr learned my addr 172.21.15.27:0/591744100 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a01d9b700 1 -- 172.21.15.27:0/591744100 >> v1:172.21.15.40:6789/0 conn(0x7f2a040bcc10 legacy=0x7f2a0413d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a01d9b700 1 -- 172.21.15.27:0/591744100 >> v1:172.21.15.27:6789/0 conn(0x7f2a040c6fe0 legacy=0x7f2a04066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a01d9b700 1 -- 172.21.15.27:0/591744100 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04066410 con 0x7f2a040c73c0 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a0159a700 1 -- 172.21.15.27:0/591744100 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054557695 0 0) 0x7f2a04067600 con 0x7f2a040c6fe0 2023-05-17T15:08:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.502+0000 7f2a01d9b700 1 --2- 172.21.15.27:0/591744100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040c73c0 0x7f2a040bc720 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f29f8009760 tx=0x7f29f8009060).ready entity=mon.0 client_cookie=82707b8243b98aeb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0159a700 1 -- 172.21.15.27:0/591744100 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800b580 con 0x7f2a040c73c0 2023-05-17T15:08:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0159a700 1 -- 172.21.15.27:0/591744100 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800b6e0 con 0x7f2a040c73c0 2023-05-17T15:08:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0159a700 1 -- 172.21.15.27:0/591744100 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800ba60 con 0x7f2a040c73c0 2023-05-17T15:08:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 -- 172.21.15.27:0/591744100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040c73c0 msgr2=0x7f2a040bc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 --2- 172.21.15.27:0/591744100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040c73c0 0x7f2a040bc720 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f29f8009760 tx=0x7f29f8009060).stop 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 -- 172.21.15.27:0/591744100 shutdown_connections 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 --2- 172.21.15.27:0/591744100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040c73c0 0x7f2a040bc720 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 -- 172.21.15.27:0/591744100 >> 172.21.15.27:0/591744100 conn(0x7f2a04067cb0 msgr2=0x7f2a040680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 -- 172.21.15.27:0/591744100 shutdown_connections 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.503+0000 7f2a0359e700 1 -- 172.21.15.27:0/591744100 wait complete. 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.504+0000 7f2a0359e700 1 Processor -- start 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.504+0000 7f2a0359e700 1 -- start start 2023-05-17T15:08:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 0x7f2a040a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a040c6fe0 0x7f2a0413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a040c73c0 0x7f2a04167730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04155990 con 0x7f2a040bcc10 2023-05-17T15:08:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040a3da0 con 0x7f2a040c6fe0 2023-05-17T15:08:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040a95d0 con 0x7f2a040c73c0 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 0x7f2a040a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 0x7f2a040a38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39260/0 (socket says 172.21.15.27:39260) 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a0259c700 1 -- 172.21.15.27:0/3252666294 learned_addr learned my addr 172.21.15.27:0/3252666294 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a01d9b700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a040c6fe0 0x7f2a0413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.505+0000 7f2a02d9d700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a040c73c0 0x7f2a04167730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0259c700 1 -- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a040c73c0 msgr2=0x7f2a04167730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0259c700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a040c73c0 0x7f2a04167730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0259c700 1 -- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a040c6fe0 msgr2=0x7f2a0413ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0259c700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a040c6fe0 0x7f2a0413ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0259c700 1 -- 172.21.15.27:0/3252666294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80092a0 con 0x7f2a040bcc10 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0259c700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 0x7f2a040a38b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f29f400c4c0 tx=0x7f29f4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400ce30 con 0x7f2a040bcc10 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f40072e0 con 0x7f2a040bcc10 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a04155000 con 0x7f2a040bcc10 2023-05-17T15:08:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f40057a0 con 0x7f2a040bcc10 2023-05-17T15:08:40.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.506+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a041555c0 con 0x7f2a040bcc10 2023-05-17T15:08:40.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.507+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0406bdf0 con 0x7f2a040bcc10 2023-05-17T15:08:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.507+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f29f4010070 con 0x7f2a040bcc10 2023-05-17T15:08:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.508+0000 7f29f27fc700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 0x7f29e4061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.508+0000 7f2a01d9b700 1 -- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 msgr2=0x7f29e4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.508+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f29f4079380 con 0x7f2a040bcc10 2023-05-17T15:08:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.508+0000 7f2a01d9b700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 0x7f29e4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.512+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29f404a760 con 0x7f2a040bcc10 2023-05-17T15:08:40.652 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:40.648+0000 7f83a1585680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:08:40.709 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.705+0000 7f63178b7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:08:40.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.709+0000 7f2a01d9b700 1 -- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 msgr2=0x7f29e4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:40.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.709+0000 7f2a01d9b700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 0x7f29e4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:40.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.733+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a040c6860 con 0x7f2a040bcc10 2023-05-17T15:08:40.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.733+0000 7f29f27fc700 1 -- 172.21.15.27:0/3252666294 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f29f404dd80 con 0x7f2a040bcc10 2023-05-17T15:08:40.737 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:40.737 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:19.270502+0000","modified":"2023-05-17T15:08:22.276979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1785297520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1785297520},{"type":"v1","addr":"172.21.15.40:6835","nonce":1785297520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-17T15:08:40.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 msgr2=0x7f29e4061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:40.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 0x7f29e4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:40.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 msgr2=0x7f2a040a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 0x7f2a040a38b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f29f400c4c0 tx=0x7f29f4007c10).stop 2023-05-17T15:08:40.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 shutdown_connections 2023-05-17T15:08:40.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f29e405edb0 0x7f29e4061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:40.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a040c73c0 0x7f2a04167730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a040bcc10 0x7f2a040a38b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 --2- 172.21.15.27:0/3252666294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a040c6fe0 0x7f2a0413ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 >> 172.21.15.27:0/3252666294 conn(0x7f2a04067cb0 msgr2=0x7f2a040c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 shutdown_connections 2023-05-17T15:08:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.735+0000 7f2a0359e700 1 -- 172.21.15.27:0/3252666294 wait complete. 2023-05-17T15:08:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2023-05-17T15:08:40.751 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:40.839 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:40.836+0000 7f83a1585680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:40.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.868+0000 7f7432fa2700 1 Processor -- start 2023-05-17T15:08:40.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.868+0000 7f7432fa2700 1 -- start start 2023-05-17T15:08:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f7432fa2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064140 0x7f742c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f7432fa2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f742c0bd780 0x7f742c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f7432fa2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c0bdfd0 con 0x7f742c064520 2023-05-17T15:08:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f7432fa2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c0be2b0 con 0x7f742c0bd780 2023-05-17T15:08:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f7432fa2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0be590 con 0x7f742c064140 2023-05-17T15:08:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f74327a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f742c0bd780 0x7f742c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f7431fa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064140 0x7f742c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f743179f700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f742c064520 0x7f742c0bf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:44834/0 (socket says 172.21.15.27:44834) 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.869+0000 7f743179f700 1 -- 172.21.15.27:0/3088820690 learned_addr learned my addr 172.21.15.27:0/3088820690 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7430f9e700 1 -- 172.21.15.27:0/3088820690 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321138209 0 0) 0x7f742c0bdfd0 con 0x7f742c064520 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7430f9e700 1 -- 172.21.15.27:0/3088820690 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74180033f0 con 0x7f742c064520 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7431fa0700 1 -- 172.21.15.27:0/3088820690 >> v2:172.21.15.40:3300/0 conn(0x7f742c0bd780 msgr2=0x7f742c0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7431fa0700 1 --2- 172.21.15.27:0/3088820690 >> v2:172.21.15.40:3300/0 conn(0x7f742c0bd780 0x7f742c0c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7431fa0700 1 -- 172.21.15.27:0/3088820690 >> v1:172.21.15.40:6789/0 conn(0x7f742c064520 legacy=0x7f742c0bf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7431fa0700 1 -- 172.21.15.27:0/3088820690 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c0be870 con 0x7f742c064140 2023-05-17T15:08:40.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f74327a1700 1 --2- 172.21.15.27:0/3088820690 >> v2:172.21.15.40:3300/0 conn(0x7f742c0bd780 0x7f742c0c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7431fa0700 1 --2- 172.21.15.27:0/3088820690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064140 0x7f742c0c9350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f741c009760 tx=0x7f741c009060).ready entity=mon.2 client_cookie=88514597fe1d3d4f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7430f9e700 1 -- 172.21.15.27:0/3088820690 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c00d4a0 con 0x7f742c064140 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7430f9e700 1 -- 172.21.15.27:0/3088820690 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c00d600 con 0x7f742c064140 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.870+0000 7f7430f9e700 1 -- 172.21.15.27:0/3088820690 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c00d980 con 0x7f742c064140 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 -- 172.21.15.27:0/3088820690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064140 msgr2=0x7f742c0c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3088820690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064140 0x7f742c0c9350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f741c009760 tx=0x7f741c009060).stop 2023-05-17T15:08:40.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 -- 172.21.15.27:0/3088820690 shutdown_connections 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3088820690 >> v2:172.21.15.40:3300/0 conn(0x7f742c0bd780 0x7f742c0c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3088820690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064140 0x7f742c0c9350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 -- 172.21.15.27:0/3088820690 >> 172.21.15.27:0/3088820690 conn(0x7f742c062d50 msgr2=0x7f742c0c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 -- 172.21.15.27:0/3088820690 shutdown_connections 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.871+0000 7f7432fa2700 1 -- 172.21.15.27:0/3088820690 wait complete. 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.872+0000 7f7432fa2700 1 Processor -- start 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.872+0000 7f7432fa2700 1 -- start start 2023-05-17T15:08:40.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 0x7f742c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064520 0x7f742c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742c0bd780 0x7f742c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c1676a0 con 0x7f742c064140 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c067ee0 con 0x7f742c0bd780 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c069cf0 con 0x7f742c064520 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7431fa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 0x7f742c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7431fa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 0x7f742c1671b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39276/0 (socket says 172.21.15.27:39276) 2023-05-17T15:08:40.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7431fa0700 1 -- 172.21.15.27:0/3393989885 learned_addr learned my addr 172.21.15.27:0/3393989885 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:40.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742c0bd780 0x7f742c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f743179f700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064520 0x7f742c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:40.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 -- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064520 msgr2=0x7f742c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064520 0x7f742c069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 -- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 msgr2=0x7f742c1671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 0x7f742c1671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 -- 172.21.15.27:0/3393989885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009a20 con 0x7f742c0bd780 2023-05-17T15:08:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7431fa0700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 0x7f742c1671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f743179f700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064520 0x7f742c069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f74327a1700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742c0bd780 0x7f742c13fe70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f7424009ea0 tx=0x7f742400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400caa0 con 0x7f742c0bd780 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400f040 con 0x7f742c0bd780 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0092a0 con 0x7f742c0bd780 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.873+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400ce10 con 0x7f742c0bd780 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.874+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c167b90 con 0x7f742c0bd780 2023-05-17T15:08:40.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.875+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f7424013610 con 0x7f742c0bd780 2023-05-17T15:08:40.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.875+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c067cb0 con 0x7f742c0bd780 2023-05-17T15:08:40.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.875+0000 7f7421ffb700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f741005ede0 0x7f74100612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:40.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.875+0000 7f7431fa0700 1 -- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f741005ede0 msgr2=0x7f74100612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:40.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.875+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f742407a620 con 0x7f742c0bd780 2023-05-17T15:08:40.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.875+0000 7f7431fa0700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f741005ede0 0x7f74100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:40.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:40.880+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f742c067cb0 con 0x7f742c0bd780 2023-05-17T15:08:40.902 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:40.898+0000 7f63178b7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:08:41.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.057+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f742c067cb0 con 0x7f742c0bd780 2023-05-17T15:08:41.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.058+0000 7f7421ffb700 1 -- 172.21.15.27:0/3393989885 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17287 (secure 0 0 0) 0x7f742c067cb0 con 0x7f742c0bd780 2023-05-17T15:08:41.062 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:41.062 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":84,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:36.057693+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:17.825758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:18.244928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1766346357":"2023-05-18T15:08:36.057668+0000","172.21.15.27:0/3574246489":"2023-05-18T15:08:36.057668+0000","172.21.15.27:6837/86332":"2023-05-18T15:08:36.057668+0000","172.21.15.27:6836/86332":"2023-05-18T15:08:36.057668+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:41.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f741005ede0 msgr2=0x7f74100612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:41.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f741005ede0 0x7f74100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:41.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742c0bd780 msgr2=0x7f742c13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742c0bd780 0x7f742c13fe70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f7424009ea0 tx=0x7f742400b040).stop 2023-05-17T15:08:41.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 shutdown_connections 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f741005ede0 0x7f74100612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742c0bd780 0x7f742c13fe70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f742c064140 0x7f742c1671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 --2- 172.21.15.27:0/3393989885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f742c064520 0x7f742c069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 >> 172.21.15.27:0/3393989885 conn(0x7f742c062d50 msgr2=0x7f742c1502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 shutdown_connections 2023-05-17T15:08:41.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.060+0000 7f7432fa2700 1 -- 172.21.15.27:0/3393989885 wait complete. 2023-05-17T15:08:41.076 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:08:41.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:41.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.190+0000 7f325dcac700 1 Processor -- start 2023-05-17T15:08:41.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.190+0000 7f325dcac700 1 -- start start 2023-05-17T15:08:41.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325dcac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f3258068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325dcac700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3258157be0 con 0x7f3258063340 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325dcac700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32580bd1d0 con 0x7f3258153e20 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325dcac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c2290 con 0x7f3258067cb0 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f3257fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3258063340 0x7f32580bcac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38862/0 (socket says 172.21.15.27:38862) 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f3257fff700 1 -- 172.21.15.27:0/2931812966 learned_addr learned my addr 172.21.15.27:0/2931812966 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325d4ab700 1 --2- 172.21.15.27:0/2931812966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f3258068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f32577fe700 1 -- 172.21.15.27:0/2931812966 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750438220 0 0) 0x7f3258157be0 con 0x7f3258063340 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f32577fe700 1 -- 172.21.15.27:0/2931812966 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32480033f0 con 0x7f3258063340 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f32577fe700 1 -- 172.21.15.27:0/2931812966 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978080816 0 0) 0x7f32580bd1d0 con 0x7f3258153e20 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325d4ab700 1 -- 172.21.15.27:0/2931812966 >> v1:172.21.15.40:6789/0 conn(0x7f3258153e20 legacy=0x7f3258154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325d4ab700 1 -- 172.21.15.27:0/2931812966 >> v1:172.21.15.27:6789/0 conn(0x7f3258063340 legacy=0x7f32580bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.191+0000 7f325d4ab700 1 -- 172.21.15.27:0/2931812966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258068600 con 0x7f3258067cb0 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325d4ab700 1 --2- 172.21.15.27:0/2931812966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f3258068110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3250009e90 tx=0x7f3250009780).ready entity=mon.2 client_cookie=e47cafcf5a057b57 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:41.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f32577fe700 1 -- 172.21.15.27:0/2931812966 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325000e070 con 0x7f3258067cb0 2023-05-17T15:08:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f32577fe700 1 -- 172.21.15.27:0/2931812966 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325000bb60 con 0x7f3258067cb0 2023-05-17T15:08:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f32577fe700 1 -- 172.21.15.27:0/2931812966 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325000bee0 con 0x7f3258067cb0 2023-05-17T15:08:41.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 -- 172.21.15.27:0/2931812966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 msgr2=0x7f3258068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 --2- 172.21.15.27:0/2931812966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f3258068110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3250009e90 tx=0x7f3250009780).stop 2023-05-17T15:08:41.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 -- 172.21.15.27:0/2931812966 shutdown_connections 2023-05-17T15:08:41.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 --2- 172.21.15.27:0/2931812966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f3258068110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 -- 172.21.15.27:0/2931812966 >> 172.21.15.27:0/2931812966 conn(0x7f32580675b0 msgr2=0x7f32580c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:41.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 -- 172.21.15.27:0/2931812966 shutdown_connections 2023-05-17T15:08:41.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.192+0000 7f325dcac700 1 -- 172.21.15.27:0/2931812966 wait complete. 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.193+0000 7f325dcac700 1 Processor -- start 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 -- start start 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 0x7f32580c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f32580c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3258153e20 0x7f32580c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325814af30 con 0x7f3258063340 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c13c0 con 0x7f3258153e20 2023-05-17T15:08:41.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325dcac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580aca50 con 0x7f3258067cb0 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325ccaa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 0x7f32580c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325ccaa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 0x7f32580c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39306/0 (socket says 172.21.15.27:39306) 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.194+0000 7f325ccaa700 1 -- 172.21.15.27:0/3271025683 learned_addr learned my addr 172.21.15.27:0/3271025683 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325d4ab700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3258153e20 0x7f32580c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f3257fff700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f32580c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325ccaa700 1 -- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 msgr2=0x7f32580c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325ccaa700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f32580c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325ccaa700 1 -- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3258153e20 msgr2=0x7f32580c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325ccaa700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3258153e20 0x7f32580c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325ccaa700 1 -- 172.21.15.27:0/3271025683 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250009a20 con 0x7f3258063340 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325ccaa700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 0x7f32580c7ac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f324c00c3c0 tx=0x7f324c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c007020 con 0x7f3258063340 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c0071a0 con 0x7f3258063340 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c007560 con 0x7f3258063340 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580c0840 con 0x7f3258063340 2023-05-17T15:08:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.195+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32580c0e00 con 0x7f3258063340 2023-05-17T15:08:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.197+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32580aa890 con 0x7f3258063340 2023-05-17T15:08:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.197+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f324c010070 con 0x7f3258063340 2023-05-17T15:08:41.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.197+0000 7f3254ff9700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 0x7f323c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.197+0000 7f3257fff700 1 -- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 msgr2=0x7f323c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:41.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.197+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f324c078e30 con 0x7f3258063340 2023-05-17T15:08:41.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.197+0000 7f3257fff700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 0x7f323c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:41.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.201+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f324c0478f0 con 0x7f3258063340 2023-05-17T15:08:41.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.398+0000 7f3257fff700 1 -- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 msgr2=0x7f323c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:41.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.398+0000 7f3257fff700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 0x7f323c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.417+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f325806bdf0 con 0x7f3258063340 2023-05-17T15:08:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.418+0000 7f3254ff9700 1 -- 172.21.15.27:0/3271025683 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f324c04a210 con 0x7f3258063340 2023-05-17T15:08:41.422 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:41.422 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:19.270502+0000","modified":"2023-05-17T15:08:22.276979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1785297520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1785297520},{"type":"v1","addr":"172.21.15.40:6835","nonce":1785297520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 msgr2=0x7f323c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 0x7f323c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 msgr2=0x7f32580c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 0x7f32580c7ac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f324c00c3c0 tx=0x7f324c007e00).stop 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 shutdown_connections 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f323c05ede0 0x7f323c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3258153e20 0x7f32580c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3258063340 0x7f32580c7ac0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 --2- 172.21.15.27:0/3271025683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3258067cb0 0x7f32580c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 >> 172.21.15.27:0/3271025683 conn(0x7f32580675b0 msgr2=0x7f32580c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 shutdown_connections 2023-05-17T15:08:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.420+0000 7f325dcac700 1 -- 172.21.15.27:0/3271025683 wait complete. 2023-05-17T15:08:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2023-05-17T15:08:41.436 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:41.515 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:41.512+0000 7f83a1585680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:08:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.553+0000 7f7a18e71700 1 Processor -- start 2023-05-17T15:08:41.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.553+0000 7f7a18e71700 1 -- start start 2023-05-17T15:08:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a18e71700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7a140c5f30 0x7f7a140c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a18e71700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140bfcd0 con 0x7f7a141543e0 2023-05-17T15:08:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a18e71700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140c0290 con 0x7f7a14158880 2023-05-17T15:08:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a18e71700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140aa1a0 con 0x7f7a140c5f30 2023-05-17T15:08:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a1259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7a140c5f30 0x7f7a140c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a12d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7a141543e0 0x7f7a140c0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38880/0 (socket says 172.21.15.27:38880) 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a1259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7a140c5f30 0x7f7a140c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39316/0 (socket says 172.21.15.27:39316) 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.554+0000 7f7a12d9d700 1 -- 172.21.15.27:0/2279604906 learned_addr learned my addr 172.21.15.27:0/2279604906 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1259c700 1 -- 172.21.15.27:0/2279604906 >> v1:172.21.15.40:6789/0 conn(0x7f7a14158880 legacy=0x7f7a14153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1259c700 1 -- 172.21.15.27:0/2279604906 >> v1:172.21.15.27:6789/0 conn(0x7f7a141543e0 legacy=0x7f7a140c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1159a700 1 -- 172.21.15.27:0/2279604906 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241283132 0 0) 0x7f7a140bfcd0 con 0x7f7a141543e0 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1259c700 1 -- 172.21.15.27:0/2279604906 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140aa480 con 0x7f7a140c5f30 2023-05-17T15:08:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1259c700 1 --2- 172.21.15.27:0/2279604906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a140c5f30 0x7f7a140c6310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f7a04009760 tx=0x7f7a04009060).ready entity=mon.0 client_cookie=a3844b6976d77dea server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:41.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1159a700 1 -- 172.21.15.27:0/2279604906 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400b580 con 0x7f7a140c5f30 2023-05-17T15:08:41.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1159a700 1 -- 172.21.15.27:0/2279604906 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0400b6e0 con 0x7f7a140c5f30 2023-05-17T15:08:41.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a1159a700 1 -- 172.21.15.27:0/2279604906 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400ba60 con 0x7f7a140c5f30 2023-05-17T15:08:41.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a18e71700 1 -- 172.21.15.27:0/2279604906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a140c5f30 msgr2=0x7f7a140c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.555+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2279604906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a140c5f30 0x7f7a140c6310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f7a04009760 tx=0x7f7a04009060).stop 2023-05-17T15:08:41.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.556+0000 7f7a18e71700 1 -- 172.21.15.27:0/2279604906 shutdown_connections 2023-05-17T15:08:41.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.556+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2279604906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a140c5f30 0x7f7a140c6310 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.556+0000 7f7a18e71700 1 -- 172.21.15.27:0/2279604906 >> 172.21.15.27:0/2279604906 conn(0x7f7a14069e70 msgr2=0x7f7a1405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:41.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.556+0000 7f7a18e71700 1 -- 172.21.15.27:0/2279604906 shutdown_connections 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.556+0000 7f7a18e71700 1 -- 172.21.15.27:0/2279604906 wait complete. 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.557+0000 7f7a18e71700 1 Processor -- start 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.557+0000 7f7a18e71700 1 -- start start 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.557+0000 7f7a18e71700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a140c5f30 0x7f7a1414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.557+0000 7f7a18e71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 0x7f7a140c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a18e71700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a14158880 0x7f7a140c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a18e71700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140c4f80 con 0x7f7a141543e0 2023-05-17T15:08:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a18e71700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14165810 con 0x7f7a140c5f30 2023-05-17T15:08:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a18e71700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14164c00 con 0x7f7a14158880 2023-05-17T15:08:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 0x7f7a140c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 0x7f7a140c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39322/0 (socket says 172.21.15.27:39322) 2023-05-17T15:08:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 -- 172.21.15.27:0/2547497966 learned_addr learned my addr 172.21.15.27:0/2547497966 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a1259c700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a140c5f30 0x7f7a1414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a12d9d700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a14158880 0x7f7a140c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 -- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a14158880 msgr2=0x7f7a140c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a14158880 0x7f7a140c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 -- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a140c5f30 msgr2=0x7f7a1414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a140c5f30 0x7f7a1414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 -- 172.21.15.27:0/2547497966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040092a0 con 0x7f7a141543e0 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a11d9b700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 0x7f7a140c45a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f79fc00c440 tx=0x7f79fc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc007020 con 0x7f7a141543e0 2023-05-17T15:08:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc007180 con 0x7f7a141543e0 2023-05-17T15:08:41.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a14164ee0 con 0x7f7a141543e0 2023-05-17T15:08:41.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc007520 con 0x7f7a141543e0 2023-05-17T15:08:41.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.558+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a141654a0 con 0x7f7a141543e0 2023-05-17T15:08:41.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.559+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a14165950 con 0x7f7a141543e0 2023-05-17T15:08:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.560+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f79fc010070 con 0x7f7a141543e0 2023-05-17T15:08:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.561+0000 7f7a0a7fc700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 0x7f79f40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.561+0000 7f7a1259c700 1 -- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 msgr2=0x7f79f40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:41.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.561+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f79fc0795b0 con 0x7f7a141543e0 2023-05-17T15:08:41.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.561+0000 7f7a1259c700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 0x7f79f40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:41.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.564+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79fc04a990 con 0x7f7a141543e0 2023-05-17T15:08:41.585 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:41.582+0000 7f83a1585680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:08:41.595 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:41.592+0000 7f63178b7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:08:41.662 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:41.658+0000 7f83a1585680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:08:41.667 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:41.663+0000 7f63178b7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:08:41.744 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:41.741+0000 7f63178b7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:08:41.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.762+0000 7f7a1259c700 1 -- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 msgr2=0x7f79f40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:41.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.762+0000 7f7a1259c700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 0x7f79f40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:41.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.778+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a14165950 con 0x7f7a141543e0 2023-05-17T15:08:41.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.779+0000 7f7a0a7fc700 1 -- 172.21.15.27:0/2547497966 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f7a14165950 con 0x7f7a141543e0 2023-05-17T15:08:41.783 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:41.783 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:19.270502+0000","modified":"2023-05-17T15:08:22.276979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1785297520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1785297520},{"type":"v1","addr":"172.21.15.40:6835","nonce":1785297520}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 msgr2=0x7f79f40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 0x7f79f40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 msgr2=0x7f7a140c45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 0x7f7a140c45a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f79fc00c440 tx=0x7f79fc007e00).stop 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 shutdown_connections 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f79f405ede0 0x7f79f40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:41.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a14158880 0x7f7a140c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a140c5f30 0x7f7a1414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 --2- 172.21.15.27:0/2547497966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a141543e0 0x7f7a140c45a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 >> 172.21.15.27:0/2547497966 conn(0x7f7a14069e70 msgr2=0x7f7a140c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:41.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 shutdown_connections 2023-05-17T15:08:41.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.781+0000 7f7a18e71700 1 -- 172.21.15.27:0/2547497966 wait complete. 2023-05-17T15:08:41.786 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2023-05-17T15:08:41.797 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:41.811 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:41.808+0000 7f83a1585680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:08:41.883 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:41.880+0000 7f83a1585680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:08:41.900 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:41.897+0000 7f63178b7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:08:41.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.910+0000 7fc452c9e700 1 Processor -- start 2023-05-17T15:08:41.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.910+0000 7fc452c9e700 1 -- start start 2023-05-17T15:08:41.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc452c9e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc44c0c4620 0x7fc44c065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc452c9e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c069000 con 0x7fc44c155410 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc452c9e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c067f60 con 0x7fc44c065550 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc452c9e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44c068240 con 0x7fc44c0c4620 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc45123b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc44c0c4620 0x7fc44c065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc45123b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc44c0c4620 0x7fc44c065930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39332/0 (socket says 172.21.15.27:39332) 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc44bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc44c155410 0x7fc44c153a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:38892/0 (socket says 172.21.15.27:38892) 2023-05-17T15:08:41.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc45123b700 1 -- 172.21.15.27:0/3030153056 learned_addr learned my addr 172.21.15.27:0/3030153056 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.911+0000 7fc45123b700 1 -- 172.21.15.27:0/3030153056 >> v1:172.21.15.40:6789/0 conn(0x7fc44c065550 legacy=0x7fc44c066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc44b7fe700 1 -- 172.21.15.27:0/3030153056 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501193762 0 0) 0x7fc44c069000 con 0x7fc44c155410 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc45123b700 1 -- 172.21.15.27:0/3030153056 >> v1:172.21.15.27:6789/0 conn(0x7fc44c155410 legacy=0x7fc44c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc45123b700 1 -- 172.21.15.27:0/3030153056 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c068520 con 0x7fc44c0c4620 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc45123b700 1 --2- 172.21.15.27:0/3030153056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c065930 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fc444009f20 tx=0x7fc444009840).ready entity=mon.0 client_cookie=fa72f86f3a60b1c4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc44b7fe700 1 -- 172.21.15.27:0/3030153056 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400e070 con 0x7fc44c0c4620 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc44b7fe700 1 -- 172.21.15.27:0/3030153056 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400ba80 con 0x7fc44c0c4620 2023-05-17T15:08:41.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc44b7fe700 1 -- 172.21.15.27:0/3030153056 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400be00 con 0x7fc44c0c4620 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc452c9e700 1 -- 172.21.15.27:0/3030153056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 msgr2=0x7fc44c065930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.912+0000 7fc452c9e700 1 --2- 172.21.15.27:0/3030153056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c065930 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fc444009f20 tx=0x7fc444009840).stop 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.913+0000 7fc452c9e700 1 -- 172.21.15.27:0/3030153056 shutdown_connections 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.913+0000 7fc452c9e700 1 --2- 172.21.15.27:0/3030153056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c065930 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.913+0000 7fc452c9e700 1 -- 172.21.15.27:0/3030153056 >> 172.21.15.27:0/3030153056 conn(0x7fc44c0c94a0 msgr2=0x7fc44c0c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.913+0000 7fc452c9e700 1 -- 172.21.15.27:0/3030153056 shutdown_connections 2023-05-17T15:08:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.913+0000 7fc452c9e700 1 -- 172.21.15.27:0/3030153056 wait complete. 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.914+0000 7fc452c9e700 1 Processor -- start 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.914+0000 7fc452c9e700 1 -- start start 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44c065550 0x7fc44c0c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc44c155410 0x7fc44c1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0ae1a0 con 0x7fc44c0c4620 2023-05-17T15:08:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c146c90 con 0x7fc44c065550 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0ad590 con 0x7fc44c155410 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39336/0 (socket says 172.21.15.27:39336) 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 -- 172.21.15.27:0/1959210744 learned_addr learned my addr 172.21.15.27:0/1959210744 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc450a3a700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44c065550 0x7fc44c0c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc45123b700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc44c155410 0x7fc44c1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 -- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc44c155410 msgr2=0x7fc44c1467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc44c155410 0x7fc44c1467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 -- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44c065550 msgr2=0x7fc44c0c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44c065550 0x7fc44c0c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 -- 172.21.15.27:0/1959210744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009ae0 con 0x7fc44c0c4620 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc44bfff700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c0ae630 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fc43800c490 tx=0x7fc438007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380070d0 con 0x7fc44c0c4620 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438007250 con 0x7fc44c0c4620 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c0ad870 con 0x7fc44c0c4620 2023-05-17T15:08:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380056e0 con 0x7fc44c0c4620 2023-05-17T15:08:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.915+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c0ade30 con 0x7fc44c0c4620 2023-05-17T15:08:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.916+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c06bdf0 con 0x7fc44c0c4620 2023-05-17T15:08:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.917+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc43801a060 con 0x7fc44c0c4620 2023-05-17T15:08:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.917+0000 7fc448ff9700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc43005ede0 0x7fc4300612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.917+0000 7fc450a3a700 1 -- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc43005ede0 msgr2=0x7fc4300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.917+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fc438079550 con 0x7fc44c0c4620 2023-05-17T15:08:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.917+0000 7fc450a3a700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc43005ede0 0x7fc4300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:41.921+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc43804a930 con 0x7fc44c0c4620 2023-05-17T15:08:41.976 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:41.972+0000 7f63178b7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:08:42.003 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:41.999+0000 7f83a1585680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:08:42.096 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:42.092+0000 7f63178b7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:08:42.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.096+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc44c068800 con 0x7fc44c0c4620 2023-05-17T15:08:42.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.097+0000 7fc448ff9700 1 -- 172.21.15.27:0/1959210744 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17287 (secure 0 0 0) 0x7fc438018020 con 0x7fc44c0c4620 2023-05-17T15:08:42.101 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:42.102 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":84,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:36.057693+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:17.825758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:18.244928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1766346357":"2023-05-18T15:08:36.057668+0000","172.21.15.27:0/3574246489":"2023-05-18T15:08:36.057668+0000","172.21.15.27:6837/86332":"2023-05-18T15:08:36.057668+0000","172.21.15.27:6836/86332":"2023-05-18T15:08:36.057668+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:42.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc43005ede0 msgr2=0x7fc4300612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:42.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc43005ede0 0x7fc4300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:42.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 msgr2=0x7fc44c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:42.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c0ae630 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fc43800c490 tx=0x7fc438007db0).stop 2023-05-17T15:08:42.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 shutdown_connections 2023-05-17T15:08:42.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc43005ede0 0x7fc4300612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:42.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc44c155410 0x7fc44c1467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44c065550 0x7fc44c0c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 --2- 172.21.15.27:0/1959210744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc44c0c4620 0x7fc44c0ae630 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 >> 172.21.15.27:0/1959210744 conn(0x7fc44c0c94a0 msgr2=0x7fc44c0be380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:42.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 shutdown_connections 2023-05-17T15:08:42.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.099+0000 7fc452c9e700 1 -- 172.21.15.27:0/1959210744 wait complete. 2023-05-17T15:08:42.114 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:42.109+0000 7f83a1585680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:42.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:08:42.212 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:42.208+0000 7f63178b7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:08:42.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.231+0000 7f9f75e3e700 1 Processor -- start 2023-05-17T15:08:42.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.231+0000 7f9f75e3e700 1 -- start start 2023-05-17T15:08:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.231+0000 7f9f75e3e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f70154090 0x7f9f70154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.231+0000 7f9f75e3e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f70069610 0x7f9f700cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.231+0000 7f9f75e3e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700c5a50 con 0x7f9f700cb450 2023-05-17T15:08:42.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f75e3e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f70069fa0 con 0x7f9f70154090 2023-05-17T15:08:42.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f75e3e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700c04e0 con 0x7f9f70069610 2023-05-17T15:08:42.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f70154090 0x7f9f70154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:42.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f70154090 0x7f9f70154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39342/0 (socket says 172.21.15.27:39342) 2023-05-17T15:08:42.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/2887910749 learned_addr learned my addr 172.21.15.27:0/2887910749 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:42.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6ffff700 1 --2- 172.21.15.27:0/2887910749 >> v2:172.21.15.40:3300/0 conn(0x7f9f70069610 0x7f9f700cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/2887910749 >> v2:172.21.15.40:3300/0 conn(0x7f9f70069610 msgr2=0x7f9f700cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 --2- 172.21.15.27:0/2887910749 >> v2:172.21.15.40:3300/0 conn(0x7f9f70069610 0x7f9f700cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/2887910749 >> v1:172.21.15.40:6789/0 conn(0x7f9f700cb450 legacy=0x7f9f70068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/2887910749 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700c0760 con 0x7f9f70154090 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6f7fe700 1 --2- 172.21.15.27:0/2887910749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70154090 0x7f9f70154470 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f9f700c1000 tx=0x7f9f60009840).ready entity=mon.0 client_cookie=fd8fca34e00d688c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6e7fc700 1 -- 172.21.15.27:0/2887910749 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000e070 con 0x7f9f70154090 2023-05-17T15:08:42.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6e7fc700 1 -- 172.21.15.27:0/2887910749 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000ba50 con 0x7f9f70154090 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.232+0000 7f9f6e7fc700 1 -- 172.21.15.27:0/2887910749 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000bdd0 con 0x7f9f70154090 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 -- 172.21.15.27:0/2887910749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70154090 msgr2=0x7f9f70154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/2887910749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70154090 0x7f9f70154470 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f9f700c1000 tx=0x7f9f60009840).stop 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 -- 172.21.15.27:0/2887910749 shutdown_connections 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/2887910749 >> v2:172.21.15.40:3300/0 conn(0x7f9f70069610 0x7f9f700cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/2887910749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70154090 0x7f9f70154470 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 -- 172.21.15.27:0/2887910749 >> 172.21.15.27:0/2887910749 conn(0x7f9f7005e7e0 msgr2=0x7f9f700cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 -- 172.21.15.27:0/2887910749 shutdown_connections 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.233+0000 7f9f75e3e700 1 -- 172.21.15.27:0/2887910749 wait complete. 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.234+0000 7f9f75e3e700 1 Processor -- start 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.234+0000 7f9f75e3e700 1 -- start start 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f75e3e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 0x7f9f70157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f75e3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f700cb450 0x7f9f70151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f75e3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f70154090 0x7f9f70151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:42.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f75e3e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700aecc0 con 0x7f9f70069610 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f75e3e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700aef80 con 0x7f9f700cb450 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f75e3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700af260 con 0x7f9f70154090 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f6f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 0x7f9f70157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f6f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 0x7f9f70157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39348/0 (socket says 172.21.15.27:39348) 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/1410867107 learned_addr learned my addr 172.21.15.27:0/1410867107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f6effd700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f700cb450 0x7f9f70151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:42.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.235+0000 7f9f6ffff700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f70154090 0x7f9f70151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f70154090 msgr2=0x7f9f70151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6f7fe700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f70154090 0x7f9f70151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f700cb450 msgr2=0x7f9f70151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6f7fe700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f700cb450 0x7f9f70151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6f7fe700 1 -- 172.21.15.27:0/1410867107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009ae0 con 0x7f9f70069610 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6effd700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f700cb450 0x7f9f70151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f6f7fe700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 0x7f9f70157150 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f9f60009fd0 tx=0x7f9f700c1030).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:42.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000bbc0 con 0x7f9f70069610 2023-05-17T15:08:42.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000bd20 con 0x7f9f70069610 2023-05-17T15:08:42.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6001c610 con 0x7f9f70069610 2023-05-17T15:08:42.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f700af540 con 0x7f9f70069610 2023-05-17T15:08:42.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.236+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f70157640 con 0x7f9f70069610 2023-05-17T15:08:42.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.237+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f70157920 con 0x7f9f70069610 2023-05-17T15:08:42.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.238+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9f6001c9c0 con 0x7f9f70069610 2023-05-17T15:08:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.238+0000 7f9f577fe700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 0x7f9f5c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.238+0000 7f9f6effd700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 msgr2=0x7f9f5c0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.238+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f9f6007c160 con 0x7f9f70069610 2023-05-17T15:08:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.238+0000 7f9f6effd700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 0x7f9f5c0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:42.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.242+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f6004d6f0 con 0x7f9f70069610 2023-05-17T15:08:42.413 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:42.409+0000 7f83a1585680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:08:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.439+0000 7f9f6effd700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 msgr2=0x7f9f5c0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:42.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.439+0000 7f9f6effd700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 0x7f9f5c0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:08:42.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.458+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9f700afa60 con 0x7f9f70069610 2023-05-17T15:08:42.487 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:08:42.482+0000 7f83a1585680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:08:42.515 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:42.512+0000 7f63178b7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:08:42.589 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:42.586+0000 7f63178b7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:08:42.608 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:08:42.603+0000 7f0787353700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:42.608 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:08:42.603+0000 7f0787353700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:42.608 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:08:42.603+0000 7f0787353700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:08:42.612 INFO:tasks.ceph.mds.d.smithi040.stderr: -2386> 2023-05-17T15:08:20.653+0000 7f078ab5a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:08:42.615 INFO:tasks.ceph.mds.d.smithi040.stderr: -5> 2023-05-17T15:08:42.603+0000 7f0787353700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:42.615 INFO:tasks.ceph.mds.d.smithi040.stderr: -4> 2023-05-17T15:08:42.603+0000 7f0787353700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:08:42.615 INFO:tasks.ceph.mds.d.smithi040.stderr: -2> 2023-05-17T15:08:42.603+0000 7f0787353700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:08:42.633 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:08:42.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.840+0000 7f9f6effd700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 msgr2=0x7f9f5c0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:42.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:42.840+0000 7f9f6effd700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 0x7f9f5c0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:08:43.124 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:08:43.120+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:08:43.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.129+0000 7f9f577fe700 1 -- 172.21.15.27:0/1410867107 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9f60050c90 con 0x7f9f70069610 2023-05-17T15:08:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 msgr2=0x7f9f5c0612d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 0x7f9f5c0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 msgr2=0x7f9f70157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 0x7f9f70157150 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f9f60009fd0 tx=0x7f9f700c1030).stop 2023-05-17T15:08:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 shutdown_connections 2023-05-17T15:08:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f5c05ee10 0x7f9f5c0612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f70154090 0x7f9f70151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f70069610 0x7f9f70157150 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 --2- 172.21.15.27:0/1410867107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f700cb450 0x7f9f70151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 >> 172.21.15.27:0/1410867107 conn(0x7f9f7005e7e0 msgr2=0x7f9f700ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:43.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 shutdown_connections 2023-05-17T15:08:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.131+0000 7f9f75e3e700 1 -- 172.21.15.27:0/1410867107 wait complete. 2023-05-17T15:08:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:08:43.147 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:08:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.264+0000 7ff62dc78700 1 Processor -- start 2023-05-17T15:08:43.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.264+0000 7ff62dc78700 1 -- start start 2023-05-17T15:08:43.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff62dc78700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6281543d0 0x7ff6280c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff62dc78700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6280c60f0 0x7ff628068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff62dc78700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6280c0c90 con 0x7ff6280691f0 2023-05-17T15:08:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff62dc78700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6280c1c50 con 0x7ff6281543d0 2023-05-17T15:08:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff62dc78700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff628158790 con 0x7ff6280c60f0 2023-05-17T15:08:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6281543d0 0x7ff6280c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6281543d0 0x7ff6280c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39366/0 (socket says 172.21.15.27:39366) 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 -- 172.21.15.27:0/2066124672 learned_addr learned my addr 172.21.15.27:0/2066124672 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff626ffd700 1 --2- 172.21.15.27:0/2066124672 >> v2:172.21.15.40:3300/0 conn(0x7ff6280c60f0 0x7ff628068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 -- 172.21.15.27:0/2066124672 >> v2:172.21.15.40:3300/0 conn(0x7ff6280c60f0 msgr2=0x7ff628068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 --2- 172.21.15.27:0/2066124672 >> v2:172.21.15.40:3300/0 conn(0x7ff6280c60f0 0x7ff628068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 -- 172.21.15.27:0/2066124672 >> v1:172.21.15.40:6789/0 conn(0x7ff6280691f0 legacy=0x7ff6281547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 -- 172.21.15.27:0/2066124672 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280c6570 con 0x7ff6281543d0 2023-05-17T15:08:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6277fe700 1 --2- 172.21.15.27:0/2066124672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6281543d0 0x7ff6280c5c00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7ff6280c5620 tx=0x7ff6180090f0).ready entity=mon.0 client_cookie=7aef99ed2508cd80 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6267fc700 1 -- 172.21.15.27:0/2066124672 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800b520 con 0x7ff6281543d0 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6267fc700 1 -- 172.21.15.27:0/2066124672 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800b680 con 0x7ff6281543d0 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.266+0000 7ff6267fc700 1 -- 172.21.15.27:0/2066124672 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800ba00 con 0x7ff6281543d0 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 -- 172.21.15.27:0/2066124672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6281543d0 msgr2=0x7ff6280c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2066124672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6281543d0 0x7ff6280c5c00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7ff6280c5620 tx=0x7ff6180090f0).stop 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 -- 172.21.15.27:0/2066124672 shutdown_connections 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2066124672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6281543d0 0x7ff6280c5c00 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2066124672 >> v2:172.21.15.40:3300/0 conn(0x7ff6280c60f0 0x7ff628068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 -- 172.21.15.27:0/2066124672 >> 172.21.15.27:0/2066124672 conn(0x7ff6280cb7f0 msgr2=0x7ff6280c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 -- 172.21.15.27:0/2066124672 shutdown_connections 2023-05-17T15:08:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.267+0000 7ff62dc78700 1 -- 172.21.15.27:0/2066124672 wait complete. 2023-05-17T15:08:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.268+0000 7ff62dc78700 1 Processor -- start 2023-05-17T15:08:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.268+0000 7ff62dc78700 1 -- start start 2023-05-17T15:08:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff62dc78700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 0x7ff6280b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff62dc78700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6280c60f0 0x7ff628167be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff62dc78700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6281543d0 0x7ff6281680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff62dc78700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280c4970 con 0x7ff6280691f0 2023-05-17T15:08:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff62dc78700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6281685c0 con 0x7ff6280c60f0 2023-05-17T15:08:43.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff62dc78700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff628165f30 con 0x7ff6281543d0 2023-05-17T15:08:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 0x7ff6280b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 0x7ff6280b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39374/0 (socket says 172.21.15.27:39374) 2023-05-17T15:08:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 -- 172.21.15.27:0/2512574784 learned_addr learned my addr 172.21.15.27:0/2512574784 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:43.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff626ffd700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6280c60f0 0x7ff628167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff627fff700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6281543d0 0x7ff6281680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 -- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6281543d0 msgr2=0x7ff6281680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6281543d0 0x7ff6281680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 -- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6280c60f0 msgr2=0x7ff628167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:43.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6280c60f0 0x7ff628167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:43.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 -- 172.21.15.27:0/2512574784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009370 con 0x7ff6280691f0 2023-05-17T15:08:43.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.269+0000 7ff6277fe700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 0x7ff6280b0510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7ff618009130 tx=0x7ff618017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:43.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.270+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618000bc0 con 0x7ff6280691f0 2023-05-17T15:08:43.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.270+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800b7f0 con 0x7ff6280691f0 2023-05-17T15:08:43.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.270+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6280c4690 con 0x7ff6280691f0 2023-05-17T15:08:43.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.270+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618000d20 con 0x7ff6280691f0 2023-05-17T15:08:43.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.270+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff628165bc0 con 0x7ff6280691f0 2023-05-17T15:08:43.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.271+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff628069ae0 con 0x7ff6280691f0 2023-05-17T15:08:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.271+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff61802b070 con 0x7ff6280691f0 2023-05-17T15:08:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.271+0000 7ff60f7fe700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff61405ede0 0x7ff6140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.271+0000 7ff626ffd700 1 -- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff61405ede0 msgr2=0x7ff6140612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:08:43.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.271+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff61807b5d0 con 0x7ff6280691f0 2023-05-17T15:08:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.271+0000 7ff626ffd700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff61405ede0 0x7ff6140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:08:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.275+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff61804c880 con 0x7ff6280691f0 2023-05-17T15:08:43.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.466+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 29) v1 ==== 75092+0+0 (secure 0 0 0) 0x7ff618021030 con 0x7ff6280691f0 2023-05-17T15:08:43.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.466+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff61405ede0 msgr2=0x7ff6140612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:08:43.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.466+0000 7ff60f7fe700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff61405ede0 0x7ff6140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:43.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:43.506+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff62806bdf0 con 0x7ff6280691f0 2023-05-17T15:08:43.521 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629789c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.521 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629789c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.521 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629789c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629789c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629789c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629a8a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629a8a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629a8a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629a8a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:43.522 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:08:43.517+0000 7f629a8a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:08:44.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.465+0000 7ff60f7fe700 1 -- 172.21.15.27:0/2512574784 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6180548b0 con 0x7ff6280691f0 2023-05-17T15:08:44.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 msgr2=0x7ff6280b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 0x7ff6280b0510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7ff618009130 tx=0x7ff618017000).stop 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 shutdown_connections 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff61405ede0 0x7ff6140612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6281543d0 0x7ff6281680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6280691f0 0x7ff6280b0510 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 --2- 172.21.15.27:0/2512574784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6280c60f0 0x7ff628167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.468+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 >> 172.21.15.27:0/2512574784 conn(0x7ff6280cb7f0 msgr2=0x7ff6280bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:44.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.469+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 shutdown_connections 2023-05-17T15:08:44.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.469+0000 7ff62dc78700 1 -- 172.21.15.27:0/2512574784 wait complete. 2023-05-17T15:08:44.493 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:08:44.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.616+0000 7fd55a5b3700 1 Processor -- start 2023-05-17T15:08:44.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.616+0000 7fd55a5b3700 1 -- start start 2023-05-17T15:08:44.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd55a5b3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5540c1080 0x7fd5540c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:44.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd55a5b3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd554154a50 con 0x7fd5540c5d60 2023-05-17T15:08:44.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd55a5b3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd554154d30 con 0x7fd554154520 2023-05-17T15:08:44.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd55a5b3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd554155010 con 0x7fd5540c1080 2023-05-17T15:08:44.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd5595b1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5540c1080 0x7fd5540c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:44.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd559db2700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd5540c5d60 0x7fd5540a99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39026/0 (socket says 172.21.15.27:39026) 2023-05-17T15:08:44.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd559db2700 1 -- 172.21.15.27:0/933553461 learned_addr learned my addr 172.21.15.27:0/933553461 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:44.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd5595b1700 1 -- 172.21.15.27:0/933553461 >> v1:172.21.15.40:6789/0 conn(0x7fd554154520 legacy=0x7fd5540c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:44.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd5595b1700 1 -- 172.21.15.27:0/933553461 >> v1:172.21.15.27:6789/0 conn(0x7fd5540c5d60 legacy=0x7fd5540a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:44.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd553fff700 1 -- 172.21.15.27:0/933553461 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904050629 0 0) 0x7fd554154a50 con 0x7fd5540c5d60 2023-05-17T15:08:44.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd5595b1700 1 -- 172.21.15.27:0/933553461 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5541552f0 con 0x7fd5540c1080 2023-05-17T15:08:44.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.617+0000 7fd5595b1700 1 --2- 172.21.15.27:0/933553461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd5540c1460 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fd54c009760 tx=0x7fd54c009060).ready entity=mon.0 client_cookie=2818f06f5a3ef983 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:44.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd553fff700 1 -- 172.21.15.27:0/933553461 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00b580 con 0x7fd5540c1080 2023-05-17T15:08:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd553fff700 1 -- 172.21.15.27:0/933553461 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00b6e0 con 0x7fd5540c1080 2023-05-17T15:08:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd553fff700 1 -- 172.21.15.27:0/933553461 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00ba60 con 0x7fd5540c1080 2023-05-17T15:08:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 -- 172.21.15.27:0/933553461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 msgr2=0x7fd5540c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/933553461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd5540c1460 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fd54c009760 tx=0x7fd54c009060).stop 2023-05-17T15:08:44.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 -- 172.21.15.27:0/933553461 shutdown_connections 2023-05-17T15:08:44.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/933553461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd5540c1460 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:44.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 -- 172.21.15.27:0/933553461 >> 172.21.15.27:0/933553461 conn(0x7fd55405dd50 msgr2=0x7fd55405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:44.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 -- 172.21.15.27:0/933553461 shutdown_connections 2023-05-17T15:08:44.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.618+0000 7fd55a5b3700 1 -- 172.21.15.27:0/933553461 wait complete. 2023-05-17T15:08:44.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.619+0000 7fd55a5b3700 1 Processor -- start 2023-05-17T15:08:44.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.619+0000 7fd55a5b3700 1 -- start start 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd55a5b3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd554164a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd55a5b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5540c5d60 0x7fd5540ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd55a5b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd554154520 0x7fd5541508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd55a5b3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540ca3f0 con 0x7fd5540c1080 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd55a5b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540c94f0 con 0x7fd5540c5d60 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd55a5b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540c97d0 con 0x7fd554154520 2023-05-17T15:08:44.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd5595b1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd554164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd5595b1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd554164a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39466/0 (socket says 172.21.15.27:39466) 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.620+0000 7fd5595b1700 1 -- 172.21.15.27:0/229177042 learned_addr learned my addr 172.21.15.27:0/229177042 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd558db0700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5540c5d60 0x7fd5540ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd559db2700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd554154520 0x7fd5541508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5595b1700 1 -- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd554154520 msgr2=0x7fd5541508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5595b1700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd554154520 0x7fd5541508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:44.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5595b1700 1 -- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5540c5d60 msgr2=0x7fd5540ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5595b1700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5540c5d60 0x7fd5540ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5595b1700 1 -- 172.21.15.27:0/229177042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0092a0 con 0x7fd5540c1080 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5595b1700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd554164a60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fd54c009eb0 tx=0x7fd54c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00ba60 con 0x7fd5540c1080 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c000c90 con 0x7fd5540c1080 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5540ca640 con 0x7fd5540c1080 2023-05-17T15:08:44.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c01b640 con 0x7fd5540c1080 2023-05-17T15:08:44.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.621+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5540adf00 con 0x7fd5540c1080 2023-05-17T15:08:44.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.622+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd554047150 con 0x7fd5540c1080 2023-05-17T15:08:44.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.622+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 30) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fd54c00f070 con 0x7fd5540c1080 2023-05-17T15:08:44.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.623+0000 7fd5517fa700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd54005ecf0 0x7fd5400611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:44.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.623+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fd54c07b770 con 0x7fd5540c1080 2023-05-17T15:08:44.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.623+0000 7fd558db0700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd54005ecf0 0x7fd5400611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:44.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.623+0000 7fd558db0700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd54005ecf0 0x7fd5400611b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd548003630 tx=0x7fd548009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:44.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.627+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd54c04cb90 con 0x7fd5540c1080 2023-05-17T15:08:44.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:44.800+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd5540ae0f0 con 0x7fd5540c1080 2023-05-17T15:08:45.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.477+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd54c0794f0 con 0x7fd5540c1080 2023-05-17T15:08:45.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.653+0000 7fd5517fa700 1 -- 172.21.15.27:0/229177042 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd54c042ad0 con 0x7fd5540c1080 2023-05-17T15:08:45.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd54005ecf0 msgr2=0x7fd5400611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:45.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd54005ecf0 0x7fd5400611b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd548003630 tx=0x7fd548009040).stop 2023-05-17T15:08:45.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 msgr2=0x7fd554164a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:45.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd554164a60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fd54c009eb0 tx=0x7fd54c017000).stop 2023-05-17T15:08:45.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 shutdown_connections 2023-05-17T15:08:45.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd54005ecf0 0x7fd5400611b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd554154520 0x7fd5541508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5540c1080 0x7fd554164a60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 --2- 172.21.15.27:0/229177042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5540c5d60 0x7fd5540ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 >> 172.21.15.27:0/229177042 conn(0x7fd55405dd50 msgr2=0x7fd554152170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:45.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 shutdown_connections 2023-05-17T15:08:45.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.657+0000 7fd55a5b3700 1 -- 172.21.15.27:0/229177042 wait complete. 2023-05-17T15:08:45.663 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:08:45.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:08:45.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.797+0000 7f937f557700 1 Processor -- start 2023-05-17T15:08:45.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.797+0000 7f937f557700 1 -- start start 2023-05-17T15:08:45.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.797+0000 7f937f557700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9378154520 0x7f93780c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.797+0000 7f937f557700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 0x7f93780c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937f557700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9378154a50 con 0x7f93780c1080 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937f557700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9378154d30 con 0x7f9378154520 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937f557700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9378155010 con 0x7f93780c5d60 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937e555700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f93780c1080 0x7f93780c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39036/0 (socket says 172.21.15.27:39036) 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937e555700 1 -- 172.21.15.27:0/1704964661 learned_addr learned my addr 172.21.15.27:0/1704964661 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:45.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937ed56700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 0x7f93780c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937dd54700 1 --2- 172.21.15.27:0/1704964661 >> v2:172.21.15.40:3300/0 conn(0x7f9378154520 0x7f93780c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835841589 0 0) 0x7f9378154a50 con 0x7f93780c1080 2023-05-17T15:08:45.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93600033f0 con 0x7f93780c1080 2023-05-17T15:08:45.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410369268 0 0) 0x7f93600033f0 con 0x7f93780c1080 2023-05-17T15:08:45.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 msgr2=0x7f93780c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:45.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 0x7f93780c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 >> v2:172.21.15.40:3300/0 conn(0x7f9378154520 msgr2=0x7f93780c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 --2- 172.21.15.27:0/1704964661 >> v2:172.21.15.40:3300/0 conn(0x7f9378154520 0x7f93780c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93781552f0 con 0x7f93780c1080 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f9370001470 con 0x7f93780c1080 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 >> v1:172.21.15.27:6789/0 conn(0x7f93780c1080 legacy=0x7f93780c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93600038e0 0x7f9360003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9360004690 0x7f9360004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 0x7f9360005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9378154d30 con 0x7f9360004690 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9378155010 con 0x7f93600038e0 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936000b8e0 con 0x7f93780c5d60 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937dd54700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9360004690 0x7f9360004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.798+0000 7f937e555700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93600038e0 0x7f9360003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937ed56700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 0x7f9360005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937dd54700 1 -- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 msgr2=0x7f9360005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937dd54700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93780c5d60 0x7f9360005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937dd54700 1 -- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93600038e0 msgr2=0x7f9360003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937dd54700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93600038e0 0x7f9360003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937dd54700 1 -- 172.21.15.27:0/1704964661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600033f0 con 0x7f9360004690 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937dd54700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9360004690 0x7f9360004b10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f936c009a80 tx=0x7f936c009060).ready entity=mon.0 client_cookie=cf997e798e1a210e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:45.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c009430 con 0x7f9360004690 2023-05-17T15:08:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c00e640 con 0x7f9360004690 2023-05-17T15:08:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937d553700 1 -- 172.21.15.27:0/1704964661 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c00e9c0 con 0x7f9360004690 2023-05-17T15:08:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937f557700 1 -- 172.21.15.27:0/1704964661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9360004690 msgr2=0x7f9360004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937f557700 1 --2- 172.21.15.27:0/1704964661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9360004690 0x7f9360004b10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f936c009a80 tx=0x7f936c009060).stop 2023-05-17T15:08:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937ed56700 1 -- 172.21.15.27:0/1704964661 reap_dead start 2023-05-17T15:08:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937f557700 1 -- 172.21.15.27:0/1704964661 shutdown_connections 2023-05-17T15:08:45.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.799+0000 7f937f557700 1 -- 172.21.15.27:0/1704964661 >> 172.21.15.27:0/1704964661 conn(0x7f937805dd50 msgr2=0x7f937805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:45.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.800+0000 7f937f557700 1 -- 172.21.15.27:0/1704964661 shutdown_connections 2023-05-17T15:08:45.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.800+0000 7f937f557700 1 -- 172.21.15.27:0/1704964661 wait complete. 2023-05-17T15:08:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 Processor -- start 2023-05-17T15:08:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 -- start start 2023-05-17T15:08:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9360004690 0x7f93780c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 0x7f9378164020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f937814f8c0 0x7f9378156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780ae220 con 0x7f93780cb490 2023-05-17T15:08:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780c9250 con 0x7f9360004690 2023-05-17T15:08:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937f557700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93780ada10 con 0x7f937814f8c0 2023-05-17T15:08:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937dd54700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 0x7f9378164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937dd54700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 0x7f9378164020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39488/0 (socket says 172.21.15.27:39488) 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.801+0000 7f937dd54700 1 -- 172.21.15.27:0/3065696314 learned_addr learned my addr 172.21.15.27:0/3065696314 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937e555700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9360004690 0x7f93780c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937ed56700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f937814f8c0 0x7f9378156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937dd54700 1 -- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f937814f8c0 msgr2=0x7f9378156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937dd54700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f937814f8c0 0x7f9378156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937dd54700 1 -- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9360004690 msgr2=0x7f93780c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:45.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937dd54700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9360004690 0x7f93780c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937dd54700 1 -- 172.21.15.27:0/3065696314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378164510 con 0x7f93780cb490 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937dd54700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 0x7f9378164020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f936c00e4b0 tx=0x7f936c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c009ec0 con 0x7f93780cb490 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c00ed30 con 0x7f93780cb490 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c00eea0 con 0x7f93780cb490 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93780adc60 con 0x7f93780cb490 2023-05-17T15:08:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.802+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93780c9490 con 0x7f93780cb490 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.803+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378047150 con 0x7f93780cb490 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.803+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f936c02c020 con 0x7f93780cb490 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.804+0000 7f93767fc700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f936405ed90 0x7f9364061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.804+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6228+0+0 (secure 0 0 0) 0x7f936c07b5b0 con 0x7f93780cb490 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.804+0000 7f937e555700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f936405ed90 0x7f9364061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.804+0000 7f937e555700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f936405ed90 0x7f9364061250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9370000fd0 tx=0x7f9370007040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:45.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.808+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f936c04cae0 con 0x7f93780cb490 2023-05-17T15:08:45.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:45.984+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93780bfb70 con 0x7f93780cb490 2023-05-17T15:08:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.654+0000 7f93767fc700 1 -- 172.21.15.27:0/3065696314 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f936c016020 con 0x7f93780cb490 2023-05-17T15:08:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f936405ed90 msgr2=0x7f9364061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f936405ed90 0x7f9364061250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9370000fd0 tx=0x7f9370007040).stop 2023-05-17T15:08:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 msgr2=0x7f9378164020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 0x7f9378164020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f936c00e4b0 tx=0x7f936c01a000).stop 2023-05-17T15:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 shutdown_connections 2023-05-17T15:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f936405ed90 0x7f9364061250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f937814f8c0 0x7f9378156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9360004690 0x7f93780c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 --2- 172.21.15.27:0/3065696314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93780cb490 0x7f9378164020 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 >> 172.21.15.27:0/3065696314 conn(0x7f937805dd50 msgr2=0x7f9378150180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:46.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 shutdown_connections 2023-05-17T15:08:46.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.656+0000 7f937f557700 1 -- 172.21.15.27:0/3065696314 wait complete. 2023-05-17T15:08:46.662 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:08:46.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:08:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.795+0000 7fa5494ba700 1 Processor -- start 2023-05-17T15:08:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.795+0000 7fa5494ba700 1 -- start start 2023-05-17T15:08:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5494ba700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5441543d0 0x7fa5440c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5494ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5494ba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa544158790 con 0x7fa5440c60f0 2023-05-17T15:08:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5494ba700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440c1c50 con 0x7fa5441543d0 2023-05-17T15:08:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5494ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c6570 con 0x7fa544069410 2023-05-17T15:08:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5441543d0 0x7fa5440c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa5441543d0 0x7fa5440c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39494/0 (socket says 172.21.15.27:39494) 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 -- 172.21.15.27:0/403653711 learned_addr learned my addr 172.21.15.27:0/403653711 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5437fe700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 -- 172.21.15.27:0/403653711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 msgr2=0x7fa5440bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 -- 172.21.15.27:0/403653711 >> v1:172.21.15.40:6789/0 conn(0x7fa5440c60f0 legacy=0x7fa544068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 -- 172.21.15.27:0/403653711 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544157e60 con 0x7fa5441543d0 2023-05-17T15:08:46.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa5437fe700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:46.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa542ffd700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c5c00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fa534006fd0 tx=0x7fa5340090f0).ready entity=mon.0 client_cookie=cbe32101a98eb08f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:46.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.796+0000 7fa541ffb700 1 -- 172.21.15.27:0/403653711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400b600 con 0x7fa5441543d0 2023-05-17T15:08:46.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa541ffb700 1 -- 172.21.15.27:0/403653711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400b760 con 0x7fa5441543d0 2023-05-17T15:08:46.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa541ffb700 1 -- 172.21.15.27:0/403653711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400bae0 con 0x7fa5441543d0 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 -- 172.21.15.27:0/403653711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 msgr2=0x7fa5440c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c5c00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fa534006fd0 tx=0x7fa5340090f0).stop 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 -- 172.21.15.27:0/403653711 shutdown_connections 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 --2- 172.21.15.27:0/403653711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c5c00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 -- 172.21.15.27:0/403653711 >> 172.21.15.27:0/403653711 conn(0x7fa5440cb7f0 msgr2=0x7fa5440c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:46.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 -- 172.21.15.27:0/403653711 shutdown_connections 2023-05-17T15:08:46.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.797+0000 7fa5494ba700 1 -- 172.21.15.27:0/403653711 wait complete. 2023-05-17T15:08:46.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.798+0000 7fa5494ba700 1 Processor -- start 2023-05-17T15:08:46.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.798+0000 7fa5494ba700 1 -- start start 2023-05-17T15:08:46.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5494ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:46.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5494ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5440c60f0 0x7fa5440aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:46.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5494ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5494ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c2b50 con 0x7fa5441543d0 2023-05-17T15:08:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5494ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c1f40 con 0x7fa5440c60f0 2023-05-17T15:08:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5494ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c2220 con 0x7fa544069410 2023-05-17T15:08:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5437fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39500/0 (socket says 172.21.15.27:39500) 2023-05-17T15:08:46.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5437fe700 1 -- 172.21.15.27:0/1239848015 learned_addr learned my addr 172.21.15.27:0/1239848015 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5427fc700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5440c60f0 0x7fa5440aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa542ffd700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5437fe700 1 -- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 msgr2=0x7fa5440a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.799+0000 7fa5437fe700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa5437fe700 1 -- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5440c60f0 msgr2=0x7fa5440aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa5437fe700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5440c60f0 0x7fa5440aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa5437fe700 1 -- 172.21.15.27:0/1239848015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009370 con 0x7fa5441543d0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa5437fe700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c2fe0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fa53c00a380 tx=0x7fa53c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c016470 con 0x7fa5441543d0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c0165d0 con 0x7fa5441543d0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5440c2500 con 0x7fa5441543d0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c016950 con 0x7fa5441543d0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.800+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5440a9cb0 con 0x7fa5441543d0 2023-05-17T15:08:46.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.801+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54406bdf0 con 0x7fa5441543d0 2023-05-17T15:08:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.801+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa53c01d060 con 0x7fa5441543d0 2023-05-17T15:08:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.802+0000 7fa52affd700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa53005ed90 0x7fa530061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.802+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5814+0+0 (secure 0 0 0) 0x7fa53c07a4e0 con 0x7fa5441543d0 2023-05-17T15:08:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.802+0000 7fa542ffd700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa53005ed90 0x7fa530061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:46.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.802+0000 7fa542ffd700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa53005ed90 0x7fa530061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa534009130 tx=0x7fa534017000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:46.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.806+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa53c04bbb0 con 0x7fa5441543d0 2023-05-17T15:08:46.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.979+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa544158140 con 0x7fa5441543d0 2023-05-17T15:08:46.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.983+0000 7fa52affd700 1 -- 172.21.15.27:0/1239848015 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v12) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa53c01b0b0 con 0x7fa5441543d0 2023-05-17T15:08:46.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa53005ed90 msgr2=0x7fa530061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa53005ed90 0x7fa530061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa534009130 tx=0x7fa534017000).stop 2023-05-17T15:08:46.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 msgr2=0x7fa5440c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:46.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c2fe0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fa53c00a380 tx=0x7fa53c007900).stop 2023-05-17T15:08:46.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 shutdown_connections 2023-05-17T15:08:46.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa53005ed90 0x7fa530061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441543d0 0x7fa5440c2fe0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa544069410 0x7fa5440a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 --2- 172.21.15.27:0/1239848015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5440c60f0 0x7fa5440aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:46.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 >> 172.21.15.27:0/1239848015 conn(0x7fa5440cb7f0 msgr2=0x7fa5440ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:46.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 shutdown_connections 2023-05-17T15:08:46.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:46.985+0000 7fa5494ba700 1 -- 172.21.15.27:0/1239848015 wait complete. 2023-05-17T15:08:47.001 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:08:47.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.120+0000 7f435bfff700 1 Processor -- start 2023-05-17T15:08:47.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.120+0000 7f435bfff700 1 -- start start 2023-05-17T15:08:47.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f435c14e290 0x7f435c0a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f435c14e670 0x7f435c0a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c155260 con 0x7f435c0c36c0 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0a64c0 con 0x7f435c14e290 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c154410 con 0x7f435c14e670 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f435c14e290 0x7f435c0a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f435c14e290 0x7f435c0a5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39504/0 (socket says 172.21.15.27:39504) 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 -- 172.21.15.27:0/931481969 learned_addr learned my addr 172.21.15.27:0/931481969 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435a7fc700 1 --2- 172.21.15.27:0/931481969 >> v2:172.21.15.40:3300/0 conn(0x7f435c14e670 0x7f435c0a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 -- 172.21.15.27:0/931481969 >> v2:172.21.15.40:3300/0 conn(0x7f435c14e670 msgr2=0x7f435c0a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 --2- 172.21.15.27:0/931481969 >> v2:172.21.15.40:3300/0 conn(0x7f435c14e670 0x7f435c0a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 -- 172.21.15.27:0/931481969 >> v1:172.21.15.40:6789/0 conn(0x7f435c0c36c0 legacy=0x7f435c0698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 -- 172.21.15.27:0/931481969 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c154650 con 0x7f435c14e290 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435a7fc700 1 --2- 172.21.15.27:0/931481969 >> v2:172.21.15.40:3300/0 conn(0x7f435c14e670 0x7f435c0a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f435affd700 1 --2- 172.21.15.27:0/931481969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e290 0x7f435c0a5ae0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f435c064b00 tx=0x7f4354009840).ready entity=mon.0 client_cookie=2f9fac947979dce server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.121+0000 7f4359ffb700 1 -- 172.21.15.27:0/931481969 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400e070 con 0x7f435c14e290 2023-05-17T15:08:47.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f4359ffb700 1 -- 172.21.15.27:0/931481969 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400ba50 con 0x7f435c14e290 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f4359ffb700 1 -- 172.21.15.27:0/931481969 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400bdd0 con 0x7f435c14e290 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 -- 172.21.15.27:0/931481969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e290 msgr2=0x7f435c0a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 --2- 172.21.15.27:0/931481969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e290 0x7f435c0a5ae0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f435c064b00 tx=0x7f4354009840).stop 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 -- 172.21.15.27:0/931481969 shutdown_connections 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 --2- 172.21.15.27:0/931481969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e290 0x7f435c0a5ae0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 --2- 172.21.15.27:0/931481969 >> v2:172.21.15.40:3300/0 conn(0x7f435c14e670 0x7f435c0a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 -- 172.21.15.27:0/931481969 >> 172.21.15.27:0/931481969 conn(0x7f435c0646f0 msgr2=0x7f435c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:47.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 -- 172.21.15.27:0/931481969 shutdown_connections 2023-05-17T15:08:47.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.122+0000 7f435bfff700 1 -- 172.21.15.27:0/931481969 wait complete. 2023-05-17T15:08:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.123+0000 7f435bfff700 1 Processor -- start 2023-05-17T15:08:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.123+0000 7f435bfff700 1 -- start start 2023-05-17T15:08:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435c0c36c0 0x7f435c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f435c14e290 0x7f435c1441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 0x7f435c167760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0ac170 con 0x7f435c14e670 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0ac450 con 0x7f435c0c36c0 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0ac730 con 0x7f435c14e290 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 0x7f435c167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 0x7f435c167760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39514/0 (socket says 172.21.15.27:39514) 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.124+0000 7f435b7fe700 1 -- 172.21.15.27:0/3231235012 learned_addr learned my addr 172.21.15.27:0/3231235012 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:47.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435affd700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435c0c36c0 0x7f435c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435a7fc700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f435c14e290 0x7f435c1441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435b7fe700 1 -- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f435c14e290 msgr2=0x7f435c1441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435b7fe700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f435c14e290 0x7f435c1441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435b7fe700 1 -- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435c0c36c0 msgr2=0x7f435c0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435b7fe700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435c0c36c0 0x7f435c0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435b7fe700 1 -- 172.21.15.27:0/3231235012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009ae0 con 0x7f435c14e670 2023-05-17T15:08:47.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435affd700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435c0c36c0 0x7f435c0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435b7fe700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 0x7f435c167760 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f434c00c440 tx=0x7f434c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00f470 con 0x7f435c14e670 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c001e90 con 0x7f435c14e670 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0aca10 con 0x7f435c14e670 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00f7e0 con 0x7f435c14e670 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.125+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c0abe20 con 0x7f435c14e670 2023-05-17T15:08:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.126+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c0acc00 con 0x7f435c14e670 2023-05-17T15:08:47.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.126+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f434c010070 con 0x7f435c14e670 2023-05-17T15:08:47.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.127+0000 7f4352ffd700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f433c05ed90 0x7f433c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.127+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f434c078d50 con 0x7f435c14e670 2023-05-17T15:08:47.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.127+0000 7f435affd700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f433c05ed90 0x7f433c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.127+0000 7f435affd700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f433c05ed90 0x7f433c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f435c0a8980 tx=0x7f4354009840).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:47.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.131+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f434c0478f0 con 0x7f435c14e670 2023-05-17T15:08:47.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.305+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f435c05e530 con 0x7f435c14e670 2023-05-17T15:08:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.308+0000 7f4352ffd700 1 -- 172.21.15.27:0/3231235012 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f434c04a420 con 0x7f435c14e670 2023-05-17T15:08:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f433c05ed90 msgr2=0x7f433c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f433c05ed90 0x7f433c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f435c0a8980 tx=0x7f4354009840).stop 2023-05-17T15:08:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 msgr2=0x7f435c167760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 0x7f435c167760 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f434c00c440 tx=0x7f434c007d70).stop 2023-05-17T15:08:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 shutdown_connections 2023-05-17T15:08:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f433c05ed90 0x7f433c061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f435c14e670 0x7f435c167760 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f435c0c36c0 0x7f435c0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 --2- 172.21.15.27:0/3231235012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f435c14e290 0x7f435c1441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 >> 172.21.15.27:0/3231235012 conn(0x7f435c0646f0 msgr2=0x7f435c0c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 shutdown_connections 2023-05-17T15:08:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.310+0000 7f435bfff700 1 -- 172.21.15.27:0/3231235012 wait complete. 2023-05-17T15:08:47.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-05-17T15:08:47.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.438+0000 7fae94950700 1 Processor -- start 2023-05-17T15:08:47.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.438+0000 7fae94950700 1 -- start start 2023-05-17T15:08:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae94950700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90065550 0x7fae90065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae94950700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae90153a60 0x7fae90153f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae94950700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae90069000 con 0x7fae90155410 2023-05-17T15:08:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae94950700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae90066850 con 0x7fae90153a60 2023-05-17T15:08:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae94950700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90067f60 con 0x7fae90065550 2023-05-17T15:08:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae8e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90065550 0x7fae90065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae8ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae90153a60 0x7fae90153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae8ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae90153a60 0x7fae90153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:57452/0 (socket says 172.21.15.27:57452) 2023-05-17T15:08:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae8dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae90155410 0x7fae90066140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:45084/0 (socket says 172.21.15.27:45084) 2023-05-17T15:08:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.439+0000 7fae8ed9d700 1 -- 172.21.15.27:0/1753300589 learned_addr learned my addr 172.21.15.27:0/1753300589 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:47.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8ed9d700 1 -- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90065550 msgr2=0x7fae90065930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:47.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8ed9d700 1 --2- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90065550 0x7fae90065930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8ed9d700 1 -- 172.21.15.27:0/1753300589 >> v1:172.21.15.40:6789/0 conn(0x7fae90155410 legacy=0x7fae90066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8ed9d700 1 -- 172.21.15.27:0/1753300589 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae90068240 con 0x7fae90153a60 2023-05-17T15:08:47.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8d59a700 1 -- 172.21.15.27:0/1753300589 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504458981 0 0) 0x7fae90069000 con 0x7fae90155410 2023-05-17T15:08:47.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8e59c700 1 --2- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90065550 0x7fae90065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:47.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8ed9d700 1 --2- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90153a60 0x7fae90153f10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fae80006fd0 tx=0x7fae800090f0).ready entity=mon.1 client_cookie=ec473e97c1a362ca server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:47.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8d59a700 1 -- 172.21.15.27:0/1753300589 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000b580 con 0x7fae90153a60 2023-05-17T15:08:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8d59a700 1 -- 172.21.15.27:0/1753300589 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8000b6e0 con 0x7fae90153a60 2023-05-17T15:08:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.440+0000 7fae8d59a700 1 -- 172.21.15.27:0/1753300589 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000ba60 con 0x7fae90153a60 2023-05-17T15:08:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 -- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90153a60 msgr2=0x7fae90153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 --2- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90153a60 0x7fae90153f10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fae80006fd0 tx=0x7fae800090f0).stop 2023-05-17T15:08:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 -- 172.21.15.27:0/1753300589 shutdown_connections 2023-05-17T15:08:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 --2- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90153a60 0x7fae90153f10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 --2- 172.21.15.27:0/1753300589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90065550 0x7fae90065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 -- 172.21.15.27:0/1753300589 >> 172.21.15.27:0/1753300589 conn(0x7fae900c94a0 msgr2=0x7fae900c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 -- 172.21.15.27:0/1753300589 shutdown_connections 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.441+0000 7fae94950700 1 -- 172.21.15.27:0/1753300589 wait complete. 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.442+0000 7fae94950700 1 Processor -- start 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.442+0000 7fae94950700 1 -- start start 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90065550 0x7fae9014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 0x7fae900c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90155410 0x7fae90155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900c7560 con 0x7fae90153a60 2023-05-17T15:08:47.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900c7840 con 0x7fae90065550 2023-05-17T15:08:47.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900c7b20 con 0x7fae90155410 2023-05-17T15:08:47.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 0x7fae900c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90065550 0x7fae9014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 0x7fae900c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39526/0 (socket says 172.21.15.27:39526) 2023-05-17T15:08:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 -- 172.21.15.27:0/3342252107 learned_addr learned my addr 172.21.15.27:0/3342252107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8ed9d700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90155410 0x7fae90155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 -- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90155410 msgr2=0x7fae90155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90155410 0x7fae90155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 -- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90065550 msgr2=0x7fae9014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90065550 0x7fae9014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 -- 172.21.15.27:0/3342252107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88009a20 con 0x7fae90153a60 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8e59c700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90065550 0x7fae9014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae8dd9b700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 0x7fae900c6b30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fae7800c440 tx=0x7fae78007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae780070d0 con 0x7fae90153a60 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae78007230 con 0x7fae90153a60 2023-05-17T15:08:47.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae80009370 con 0x7fae90153a60 2023-05-17T15:08:47.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.443+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae780056e0 con 0x7fae90153a60 2023-05-17T15:08:47.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.444+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae900c80e0 con 0x7fae90153a60 2023-05-17T15:08:47.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.444+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90064ea0 con 0x7fae90153a60 2023-05-17T15:08:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.445+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae78010070 con 0x7fae90153a60 2023-05-17T15:08:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.445+0000 7fae867fc700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fae7005ed90 0x7fae70061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.445+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5814+0+0 (secure 0 0 0) 0x7fae78078e50 con 0x7fae90153a60 2023-05-17T15:08:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.445+0000 7fae8e59c700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fae7005ed90 0x7fae70061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.446+0000 7fae8e59c700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fae7005ed90 0x7fae70061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fae8800eae0 tx=0x7fae8800b040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.449+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae7804a520 con 0x7fae90153a60 2023-05-17T15:08:47.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:47.690+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fae9006bdf0 con 0x7fae90153a60 2023-05-17T15:08:48.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.134+0000 7fae867fc700 1 -- 172.21.15.27:0/3342252107 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v539) v1 ==== 156+0+0 (secure 0 0 0) 0x7fae7804db40 con 0x7fae90153a60 2023-05-17T15:08:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fae7005ed90 msgr2=0x7fae70061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fae7005ed90 0x7fae70061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fae8800eae0 tx=0x7fae8800b040).stop 2023-05-17T15:08:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 msgr2=0x7fae900c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 0x7fae900c6b30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fae7800c440 tx=0x7fae78007e30).stop 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 shutdown_connections 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fae7005ed90 0x7fae70061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae90155410 0x7fae90155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae90065550 0x7fae9014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 --2- 172.21.15.27:0/3342252107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae90153a60 0x7fae900c6b30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 >> 172.21.15.27:0/3342252107 conn(0x7fae900c94a0 msgr2=0x7fae900c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:48.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 shutdown_connections 2023-05-17T15:08:48.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.136+0000 7fae94950700 1 -- 172.21.15.27:0/3342252107 wait complete. 2023-05-17T15:08:48.154 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-05-17T15:08:48.155 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-05-17T15:08:48.155 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:08:48.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-05-17T15:08:48.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.268+0000 7fdb6e13c700 1 Processor -- start 2023-05-17T15:08:48.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.268+0000 7fdb6e13c700 1 -- start start 2023-05-17T15:08:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb6e13c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb68153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb6e13c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb680bfcd0 con 0x7fdb680c5f30 2023-05-17T15:08:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb6e13c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb680c0290 con 0x7fdb681541c0 2023-05-17T15:08:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb6e13c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb680aa1a0 con 0x7fdb680c6310 2023-05-17T15:08:48.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb677fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdb680c5f30 0x7fdb68158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39094/0 (socket says 172.21.15.27:39094) 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb677fe700 1 -- 172.21.15.27:0/2120741966 learned_addr learned my addr 172.21.15.27:0/2120741966 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb66ffd700 1 --2- 172.21.15.27:0/2120741966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb68153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539476881 0 0) 0x7fdb680bfcd0 con 0x7fdb680c5f30 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb540033f0 con 0x7fdb680c5f30 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104698464 0 0) 0x7fdb680c0290 con 0x7fdb681541c0 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb680bfcd0 con 0x7fdb681541c0 2023-05-17T15:08:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674969666 0 0) 0x7fdb540033f0 con 0x7fdb680c5f30 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb66ffd700 1 -- 172.21.15.27:0/2120741966 >> v1:172.21.15.40:6789/0 conn(0x7fdb681541c0 legacy=0x7fdb680c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb66ffd700 1 -- 172.21.15.27:0/2120741966 >> v1:172.21.15.27:6789/0 conn(0x7fdb680c5f30 legacy=0x7fdb68158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb66ffd700 1 -- 172.21.15.27:0/2120741966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680aa480 con 0x7fdb680c6310 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.269+0000 7fdb66ffd700 1 --2- 172.21.15.27:0/2120741966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb68153cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fdb58009790 tx=0x7fdb58009060).ready entity=mon.2 client_cookie=5193e43d428ccc8e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50001470 con 0x7fdb680c6310 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb58011400 con 0x7fdb680c6310 2023-05-17T15:08:48.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb667fc700 1 -- 172.21.15.27:0/2120741966 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58011780 con 0x7fdb680c6310 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2120741966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 msgr2=0x7fdb68153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2120741966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb68153cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fdb58009790 tx=0x7fdb58009060).stop 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2120741966 shutdown_connections 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2120741966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb68153cd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2120741966 >> 172.21.15.27:0/2120741966 conn(0x7fdb68069e70 msgr2=0x7fdb6805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2120741966 shutdown_connections 2023-05-17T15:08:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.270+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2120741966 wait complete. 2023-05-17T15:08:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.271+0000 7fdb6e13c700 1 Processor -- start 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.271+0000 7fdb6e13c700 1 -- start start 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb6e13c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb680c5f30 0x7fdb680c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb6e13c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb681679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb6e13c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 0x7fdb68155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb6e13c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb681558f0 con 0x7fdb681541c0 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb6e13c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb680c2870 con 0x7fdb680c5f30 2023-05-17T15:08:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb6e13c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb680c1f40 con 0x7fdb680c6310 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 0x7fdb68155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 0x7fdb68155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39542/0 (socket says 172.21.15.27:39542) 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb67fff700 1 -- 172.21.15.27:0/2625773253 learned_addr learned my addr 172.21.15.27:0/2625773253 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb677fe700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb680c5f30 0x7fdb680c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.272+0000 7fdb66ffd700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb681679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb67fff700 1 -- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 msgr2=0x7fdb681679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb67fff700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb681679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb67fff700 1 -- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb680c5f30 msgr2=0x7fdb680c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb67fff700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb680c5f30 0x7fdb680c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb67fff700 1 -- 172.21.15.27:0/2625773253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580092a0 con 0x7fdb681541c0 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb67fff700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 0x7fdb68155060 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fdb6000c710 tx=0x7fdb6000ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000e4a0 con 0x7fdb681541c0 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000e600 con 0x7fdb681541c0 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb680c2220 con 0x7fdb681541c0 2023-05-17T15:08:48.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000e980 con 0x7fdb681541c0 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.273+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb68155550 con 0x7fdb681541c0 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.274+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb680c29e0 con 0x7fdb681541c0 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.274+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdb60019030 con 0x7fdb681541c0 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.275+0000 7fdb5f7fe700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb4805ed90 0x7fdb48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.275+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5814+0+0 (secure 0 0 0) 0x7fdb60078fb0 con 0x7fdb681541c0 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.275+0000 7fdb677fe700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb4805ed90 0x7fdb48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.275+0000 7fdb677fe700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb4805ed90 0x7fdb48061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdb50001660 tx=0x7fdb500018f0).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.279+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb600488f0 con 0x7fdb681541c0 2023-05-17T15:08:48.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:48.518+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fdb6805f4a0 con 0x7fdb681541c0 2023-05-17T15:08:49.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.136+0000 7fdb5f7fe700 1 -- 172.21.15.27:0/2625773253 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v540) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdb6004a730 con 0x7fdb681541c0 2023-05-17T15:08:49.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb4805ed90 msgr2=0x7fdb48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb4805ed90 0x7fdb48061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdb50001660 tx=0x7fdb500018f0).stop 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 msgr2=0x7fdb68155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 0x7fdb68155060 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fdb6000c710 tx=0x7fdb6000ca20).stop 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 shutdown_connections 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb4805ed90 0x7fdb48061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb681541c0 0x7fdb68155060 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb680c5f30 0x7fdb680c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 --2- 172.21.15.27:0/2625773253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680c6310 0x7fdb681679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.138+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 >> 172.21.15.27:0/2625773253 conn(0x7fdb68069e70 msgr2=0x7fdb680c0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:49.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.139+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 shutdown_connections 2023-05-17T15:08:49.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.139+0000 7fdb6e13c700 1 -- 172.21.15.27:0/2625773253 wait complete. 2023-05-17T15:08:49.158 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:08:49.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.279+0000 7f6924d84700 1 Processor -- start 2023-05-17T15:08:49.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.279+0000 7f6924d84700 1 -- start start 2023-05-17T15:08:49.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f6924d84700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69201543d0 0x7f69200c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f6924d84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 0x7f69200bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f6924d84700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6920158790 con 0x7f69200c60f0 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f6924d84700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69200c1c50 con 0x7f69201543d0 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f6924d84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c6570 con 0x7f6920069410 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f691dd9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f69200c60f0 0x7f6920068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39108/0 (socket says 172.21.15.27:39108) 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f691dd9b700 1 -- 172.21.15.27:0/1241223336 learned_addr learned my addr 172.21.15.27:0/1241223336 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:49.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f691ed9d700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 0x7f69200bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f691e59c700 1 --2- 172.21.15.27:0/1241223336 >> v2:172.21.15.40:3300/0 conn(0x7f69201543d0 0x7f69200c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742873052 0 0) 0x7f6920158790 con 0x7f69200c60f0 2023-05-17T15:08:49.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.280+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f690c0033f0 con 0x7f69200c60f0 2023-05-17T15:08:49.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 141291013 0 0) 0x7f690c0033f0 con 0x7f69200c60f0 2023-05-17T15:08:49.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 msgr2=0x7f69200bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:49.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 0x7f69200bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 >> v2:172.21.15.40:3300/0 conn(0x7f69201543d0 msgr2=0x7f69200c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 --2- 172.21.15.27:0/1241223336 >> v2:172.21.15.40:3300/0 conn(0x7f69201543d0 0x7f69200c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920157e60 con 0x7f69200c60f0 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f6908001470 con 0x7f69200c60f0 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 >> v1:172.21.15.27:6789/0 conn(0x7f69200c60f0 legacy=0x7f6920068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 0x7f690c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f690c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f690c004b80 0x7f690c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c6570 con 0x7f690c003e10 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c00b8e0 con 0x7f690c004b80 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c00ba20 con 0x7f6920069410 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f690c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691e59c700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 0x7f690c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691ed9d700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f690c004b80 0x7f690c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 -- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 msgr2=0x7f690c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6920069410 0x7f690c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 -- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f690c004b80 msgr2=0x7f690c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f690c004b80 0x7f690c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 -- 172.21.15.27:0/1241223336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0033f0 con 0x7f690c003e10 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691dd9b700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f690c004690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f690800c240 tx=0x7f6908001e90).ready entity=mon.0 client_cookie=df6be7c5cccec6e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908007a60 con 0x7f690c003e10 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800cad0 con 0x7f690c003e10 2023-05-17T15:08:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.281+0000 7f691d59a700 1 -- 172.21.15.27:0/1241223336 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800ce50 con 0x7f690c003e10 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f6924d84700 1 -- 172.21.15.27:0/1241223336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 msgr2=0x7f690c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f6924d84700 1 --2- 172.21.15.27:0/1241223336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f690c004690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f690800c240 tx=0x7f6908001e90).stop 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f691ed9d700 1 -- 172.21.15.27:0/1241223336 reap_dead start 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f6924d84700 1 -- 172.21.15.27:0/1241223336 shutdown_connections 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f6924d84700 1 -- 172.21.15.27:0/1241223336 >> 172.21.15.27:0/1241223336 conn(0x7f69200cb7f0 msgr2=0x7f69200c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f6924d84700 1 -- 172.21.15.27:0/1241223336 shutdown_connections 2023-05-17T15:08:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.282+0000 7f6924d84700 1 -- 172.21.15.27:0/1241223336 wait complete. 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.283+0000 7f6924d84700 1 Processor -- start 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.283+0000 7f6924d84700 1 -- start start 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f6920147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69201547b0 0x7f6920154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69200b03c0 0x7f69200b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920163e70 con 0x7f690c003e10 2023-05-17T15:08:49.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200af9c0 con 0x7f69201547b0 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6920155120 con 0x7f69200b03c0 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f6920147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f6920147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39558/0 (socket says 172.21.15.27:39558) 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 -- 172.21.15.27:0/1150263681 learned_addr learned my addr 172.21.15.27:0/1150263681 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 -- 172.21.15.27:0/1150263681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69200b03c0 msgr2=0x7f69200b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69200b03c0 0x7f69200b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 -- 172.21.15.27:0/1150263681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69201547b0 msgr2=0x7f6920154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69201547b0 0x7f6920154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 -- 172.21.15.27:0/1150263681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200aedb0 con 0x7f690c003e10 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f691e59c700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f6920147920 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f6918011a50 tx=0x7f6918009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800f940 con 0x7f690c003e10 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800faa0 con 0x7f690c003e10 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69200af090 con 0x7f690c003e10 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.284+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800fe20 con 0x7f690c003e10 2023-05-17T15:08:49.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.285+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69200af650 con 0x7f690c003e10 2023-05-17T15:08:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.285+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692006bdf0 con 0x7f690c003e10 2023-05-17T15:08:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.286+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6918024070 con 0x7f690c003e10 2023-05-17T15:08:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.286+0000 7f69167fc700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f690005ed90 0x7f6900061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.286+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f691807a6f0 con 0x7f690c003e10 2023-05-17T15:08:49.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.286+0000 7f691dd9b700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f690005ed90 0x7f6900061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.287+0000 7f691dd9b700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f690005ed90 0x7f6900061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6920155d50 tx=0x7f6908015000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:49.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.290+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f691804bcb0 con 0x7f690c003e10 2023-05-17T15:08:49.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.461+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6920158140 con 0x7f690c003e10 2023-05-17T15:08:49.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.467+0000 7f69167fc700 1 -- 172.21.15.27:0/1150263681 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f691804f2d0 con 0x7f690c003e10 2023-05-17T15:08:49.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f690005ed90 msgr2=0x7f6900061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f690005ed90 0x7f6900061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6920155d50 tx=0x7f6908015000).stop 2023-05-17T15:08:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 msgr2=0x7f6920147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f6920147920 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f6918011a50 tx=0x7f6918009060).stop 2023-05-17T15:08:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 shutdown_connections 2023-05-17T15:08:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f690005ed90 0x7f6900061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69200b03c0 0x7f69200b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f690c003e10 0x7f6920147920 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 --2- 172.21.15.27:0/1150263681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69201547b0 0x7f6920154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 >> 172.21.15.27:0/1150263681 conn(0x7f69200cb7f0 msgr2=0x7f6920157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 shutdown_connections 2023-05-17T15:08:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.469+0000 7f6924d84700 1 -- 172.21.15.27:0/1150263681 wait complete. 2023-05-17T15:08:49.486 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:08:49.487 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:49.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:08:49.549 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:08:49.549 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:08:49.550 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:49.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.666+0000 7f61060b0700 1 Processor -- start 2023-05-17T15:08:49.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.666+0000 7f61060b0700 1 -- start start 2023-05-17T15:08:49.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f61060b0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f61000c6310 0x7f6100153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f61060b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61001541c0 0x7f61000c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f61060b0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61000bfcd0 con 0x7f61000c5f30 2023-05-17T15:08:49.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f61060b0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61000c0290 con 0x7f61000c6310 2023-05-17T15:08:49.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f61060b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000aa1a0 con 0x7f61001541c0 2023-05-17T15:08:49.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f60feffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f61000c6310 0x7f6100153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f60ff7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f61000c5f30 0x7f6100158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39128/0 (socket says 172.21.15.27:39128) 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.667+0000 7f60ff7fe700 1 -- 172.21.15.27:0/3655533114 learned_addr learned my addr 172.21.15.27:0/3655533114 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60fffff700 1 --2- 172.21.15.27:0/3655533114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61001541c0 0x7f61000c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60feffd700 1 -- 172.21.15.27:0/3655533114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61001541c0 msgr2=0x7f61000c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60feffd700 1 --2- 172.21.15.27:0/3655533114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61001541c0 0x7f61000c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60feffd700 1 -- 172.21.15.27:0/3655533114 >> v1:172.21.15.27:6789/0 conn(0x7f61000c5f30 legacy=0x7f6100158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60fe7fc700 1 -- 172.21.15.27:0/3655533114 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501140729 0 0) 0x7f61000bfcd0 con 0x7f61000c5f30 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60feffd700 1 -- 172.21.15.27:0/3655533114 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000aa480 con 0x7f61000c6310 2023-05-17T15:08:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60feffd700 1 --2- 172.21.15.27:0/3655533114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f6100153cd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f60f4009760 tx=0x7f60f4009060).ready entity=mon.0 client_cookie=6f66043ae7a92491 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:49.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60fe7fc700 1 -- 172.21.15.27:0/3655533114 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400b580 con 0x7f61000c6310 2023-05-17T15:08:49.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60fe7fc700 1 -- 172.21.15.27:0/3655533114 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f400b6e0 con 0x7f61000c6310 2023-05-17T15:08:49.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f60fe7fc700 1 -- 172.21.15.27:0/3655533114 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400ba60 con 0x7f61000c6310 2023-05-17T15:08:49.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 -- 172.21.15.27:0/3655533114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 msgr2=0x7f6100153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 --2- 172.21.15.27:0/3655533114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f6100153cd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f60f4009760 tx=0x7f60f4009060).stop 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 -- 172.21.15.27:0/3655533114 shutdown_connections 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 --2- 172.21.15.27:0/3655533114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61001541c0 0x7f61000c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 --2- 172.21.15.27:0/3655533114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f6100153cd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 -- 172.21.15.27:0/3655533114 >> 172.21.15.27:0/3655533114 conn(0x7f6100069e70 msgr2=0x7f610005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 -- 172.21.15.27:0/3655533114 shutdown_connections 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.668+0000 7f61060b0700 1 -- 172.21.15.27:0/3655533114 wait complete. 2023-05-17T15:08:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 Processor -- start 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 -- start start 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61000c5f30 0x7f61000cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f61001649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61001541c0 0x7f610014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6100164ea0 con 0x7f61000c6310 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61000c1fd0 con 0x7f61001541c0 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.670+0000 7f61060b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61001532c0 con 0x7f61000c5f30 2023-05-17T15:08:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f61001649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f61001649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39574/0 (socket says 172.21.15.27:39574) 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 -- 172.21.15.27:0/2858986358 learned_addr learned my addr 172.21.15.27:0/2858986358 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60ff7fe700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61000c5f30 0x7f61000cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60fffff700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61001541c0 0x7f610014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 -- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61000c5f30 msgr2=0x7f61000cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61000c5f30 0x7f61000cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 -- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61001541c0 msgr2=0x7f610014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61001541c0 0x7f610014e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 -- 172.21.15.27:0/2858986358 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40092a0 con 0x7f61000c6310 2023-05-17T15:08:49.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60fffff700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61001541c0 0x7f610014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:49.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60feffd700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f61001649b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f6100083770 tx=0x7f60f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:49.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400ba60 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4000c90 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6100165980 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f401b660 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.671+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61001650e0 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.672+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610005f4a0 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.672+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f60f402a070 con 0x7f61000c6310 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.673+0000 7f60e77fe700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60ec05ed90 0x7f60ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:49.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.673+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f60f407b380 con 0x7f61000c6310 2023-05-17T15:08:49.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.673+0000 7f60ff7fe700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60ec05ed90 0x7f60ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:49.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.673+0000 7f60ff7fe700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60ec05ed90 0x7f60ec061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f61000acd90 tx=0x7f60f0009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:49.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.677+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60f404ca50 con 0x7f61000c6310 2023-05-17T15:08:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.891+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61001657e0 con 0x7f61000c6310 2023-05-17T15:08:49.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.892+0000 7f60e77fe700 1 -- 172.21.15.27:0/2858986358 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f61001657e0 con 0x7f61000c6310 2023-05-17T15:08:49.897 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:49.897 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3221596195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3221596195},{"type":"v1","addr":"172.21.15.40:6833","nonce":3221596195}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3232080757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3232080757},{"type":"v1","addr":"172.21.15.40:6835","nonce":3232080757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/695741654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":695741654},{"type":"v1","addr":"172.21.15.27:6834","nonce":695741654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3768585627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3768585627},{"type":"v1","addr":"172.21.15.27:6835","nonce":3768585627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-05-17T15:08:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60ec05ed90 msgr2=0x7f60ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60ec05ed90 0x7f60ec061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f61000acd90 tx=0x7f60f0009040).stop 2023-05-17T15:08:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 msgr2=0x7f61001649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f61001649b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f6100083770 tx=0x7f60f4017000).stop 2023-05-17T15:08:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 shutdown_connections 2023-05-17T15:08:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60ec05ed90 0x7f60ec061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61001541c0 0x7f610014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61000c5f30 0x7f61000cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 --2- 172.21.15.27:0/2858986358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61000c6310 0x7f61001649b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:49.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 >> 172.21.15.27:0/2858986358 conn(0x7f6100069e70 msgr2=0x7f610014f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:49.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 shutdown_connections 2023-05-17T15:08:49.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:49.894+0000 7f61060b0700 1 -- 172.21.15.27:0/2858986358 wait complete. 2023-05-17T15:08:49.901 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 32 2023-05-17T15:08:49.910 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:08:49.911 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:08:49.911 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:08:49.911 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:49.911 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:08:49.912 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:08:49.912 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:08:49.912 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:49.912 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:08:49.913 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:08:49.913 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:08:49.913 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:49.913 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:08:49.913 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:08:49.914 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:08:49.914 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:08:49.919 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:08:49.920 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:08:49.921 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:08:49.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:08:49.923 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:08:49.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:08:49.925 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:08:49.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:08:49.963 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:08:49.964 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:49.965 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:08:49.965 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:49.967 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:08:49.968 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:08:49.968 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:49.969 DEBUG:teuthology.parallel:result is None 2023-05-17T15:08:49.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:08:50.037 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:08:50.037 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:08:50.048 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:08:50.051 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:08:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.092+0000 7f590d32e700 1 Processor -- start 2023-05-17T15:08:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.092+0000 7f590d32e700 1 -- start start 2023-05-17T15:08:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f590d32e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 0x7f59081544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f590d32e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59080c0300 0x7f59080c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f590d32e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5908157c20 con 0x7f59080c5b10 2023-05-17T15:08:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f590d32e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5908154b70 con 0x7f59080c0300 2023-05-17T15:08:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f590d32e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5908154e50 con 0x7f59080c5ef0 2023-05-17T15:08:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f5906ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f59080c5b10 0x7f59080a9dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39164/0 (socket says 172.21.15.27:39164) 2023-05-17T15:08:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f5906ffd700 1 -- 172.21.15.27:0/1591129152 learned_addr learned my addr 172.21.15.27:0/1591129152 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f59077fe700 1 --2- 172.21.15.27:0/1591129152 >> v2:172.21.15.40:3300/0 conn(0x7f59080c0300 0x7f59080c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f59067fc700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 0x7f59081544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446718835 0 0) 0x7f5908157c20 con 0x7f59080c5b10 2023-05-17T15:08:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.093+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58f00033f0 con 0x7f59080c5b10 2023-05-17T15:08:50.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869366313 0 0) 0x7f58f00033f0 con 0x7f59080c5b10 2023-05-17T15:08:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 msgr2=0x7f59081544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 0x7f59081544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 >> v2:172.21.15.40:3300/0 conn(0x7f59080c0300 msgr2=0x7f59080c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 --2- 172.21.15.27:0/1591129152 >> v2:172.21.15.40:3300/0 conn(0x7f59080c0300 0x7f59080c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908155130 con 0x7f59080c5b10 2023-05-17T15:08:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f58fc001470 con 0x7f59080c5b10 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 --2- 172.21.15.27:0/1591129152 >> v2:172.21.15.40:3300/0 conn(0x7f59080c0300 0x7f59080c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 >> v1:172.21.15.27:6789/0 conn(0x7f59080c5b10 legacy=0x7f59080a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 0x7f58f00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f0003e10 0x7f58f0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f0004b80 0x7f58f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5908154b70 con 0x7f58f0004b80 2023-05-17T15:08:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5908154e50 con 0x7f58f0003e10 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f000b8e0 con 0x7f59080c5ef0 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f0004b80 0x7f58f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5906ffd700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 0x7f58f00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59067fc700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f0003e10 0x7f58f0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 -- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 msgr2=0x7f58f00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59080c5ef0 0x7f58f00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 -- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f0003e10 msgr2=0x7f58f0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f0003e10 0x7f58f0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 -- 172.21.15.27:0/1591129152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00033f0 con 0x7f58f0004b80 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f59077fe700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f0004b80 0x7f58f0005000 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f590000e3f0 tx=0x7f590000b040).ready entity=mon.0 client_cookie=34b02420dd680de2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900009c50 con 0x7f58f0004b80 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590000f040 con 0x7f58f0004b80 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.094+0000 7f5905ffb700 1 -- 172.21.15.27:0/1591129152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000eeb0 con 0x7f58f0004b80 2023-05-17T15:08:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f590d32e700 1 -- 172.21.15.27:0/1591129152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f0004b80 msgr2=0x7f58f0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f590d32e700 1 --2- 172.21.15.27:0/1591129152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f0004b80 0x7f58f0005000 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f590000e3f0 tx=0x7f590000b040).stop 2023-05-17T15:08:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f59077fe700 1 -- 172.21.15.27:0/1591129152 reap_dead start 2023-05-17T15:08:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f590d32e700 1 -- 172.21.15.27:0/1591129152 shutdown_connections 2023-05-17T15:08:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f590d32e700 1 -- 172.21.15.27:0/1591129152 >> 172.21.15.27:0/1591129152 conn(0x7f590805dd50 msgr2=0x7f590805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f590d32e700 1 -- 172.21.15.27:0/1591129152 shutdown_connections 2023-05-17T15:08:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.095+0000 7f590d32e700 1 -- 172.21.15.27:0/1591129152 wait complete. 2023-05-17T15:08:50.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.096+0000 7f590d32e700 1 Processor -- start 2023-05-17T15:08:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.096+0000 7f590d32e700 1 -- start start 2023-05-17T15:08:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f590d32e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5908163f80 0x7f59080c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f590d32e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59080b04f0 0x7f5908164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f590d32e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 0x7f5908155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f590d32e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080c40d0 con 0x7f5908164850 2023-05-17T15:08:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f590d32e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59081556d0 con 0x7f59080b04f0 2023-05-17T15:08:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f590d32e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080c42b0 con 0x7f5908163f80 2023-05-17T15:08:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 0x7f5908155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 0x7f5908155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39618/0 (socket says 172.21.15.27:39618) 2023-05-17T15:08:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 -- 172.21.15.27:0/2184502123 learned_addr learned my addr 172.21.15.27:0/2184502123 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f5906ffd700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5908163f80 0x7f59080c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59067fc700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59080b04f0 0x7f5908164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 -- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5908163f80 msgr2=0x7f59080c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5908163f80 0x7f59080c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 -- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59080b04f0 msgr2=0x7f5908164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59080b04f0 0x7f5908164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 -- 172.21.15.27:0/2184502123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080c4590 con 0x7f5908164850 2023-05-17T15:08:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.097+0000 7f59077fe700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 0x7f5908155b20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f5900014000 tx=0x7f590001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.098+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900013e10 con 0x7f5908164850 2023-05-17T15:08:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.098+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900022070 con 0x7f5908164850 2023-05-17T15:08:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.098+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080c4870 con 0x7f5908164850 2023-05-17T15:08:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.098+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900009c50 con 0x7f5908164850 2023-05-17T15:08:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.098+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5908164cd0 con 0x7f5908164850 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.098+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5908155840 con 0x7f5908164850 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.099+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f590001e830 con 0x7f5908164850 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.099+0000 7f58eeffd700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58f405ed90 0x7f58f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.099+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f590007b740 con 0x7f5908164850 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.099+0000 7f5906ffd700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58f405ed90 0x7f58f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.100+0000 7f5906ffd700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58f405ed90 0x7f58f4061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f58fc007860 tx=0x7f58fc001e90).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.104+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5908155840 con 0x7f5908164850 2023-05-17T15:08:50.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:50.289+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5908155840 con 0x7f5908164850 2023-05-17T15:08:51.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.139+0000 7f58eeffd700 1 -- 172.21.15.27:0/2184502123 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v93) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5908155840 con 0x7f5908164850 2023-05-17T15:08:51.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.141+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58f405ed90 msgr2=0x7f58f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.141+0000 7f590d32e700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58f405ed90 0x7f58f4061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f58fc007860 tx=0x7f58fc001e90).stop 2023-05-17T15:08:51.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.141+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 msgr2=0x7f5908155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.141+0000 7f590d32e700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 0x7f5908155b20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f5900014000 tx=0x7f590001a000).stop 2023-05-17T15:08:51.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 shutdown_connections 2023-05-17T15:08:51.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58f405ed90 0x7f58f4061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5908164850 0x7f5908155b20 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5908163f80 0x7f59080c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 --2- 172.21.15.27:0/2184502123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59080b04f0 0x7f5908164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 >> 172.21.15.27:0/2184502123 conn(0x7f590805dd50 msgr2=0x7f5908150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:51.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 shutdown_connections 2023-05-17T15:08:51.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.142+0000 7f590d32e700 1 -- 172.21.15.27:0/2184502123 wait complete. 2023-05-17T15:08:51.148 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:08:51.161 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:08:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.279+0000 7f217818b700 1 Processor -- start 2023-05-17T15:08:51.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.279+0000 7f217818b700 1 -- start start 2023-05-17T15:08:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f217818b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21700c5f30 0x7f21700c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f217818b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2170158880 0x7f2170153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f217818b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700bfcd0 con 0x7f21701541c0 2023-05-17T15:08:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f217818b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700c0290 con 0x7f2170158880 2023-05-17T15:08:51.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f217818b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700aa1a0 con 0x7f21700c5f30 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f2175726700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2170158880 0x7f2170153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f2175726700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2170158880 0x7f2170153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39626/0 (socket says 172.21.15.27:39626) 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f2176728700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f21701541c0 0x7f21700c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39188/0 (socket says 172.21.15.27:39188) 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.280+0000 7f2175726700 1 -- 172.21.15.27:0/248162771 learned_addr learned my addr 172.21.15.27:0/248162771 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175726700 1 -- 172.21.15.27:0/248162771 >> v2:172.21.15.40:3300/0 conn(0x7f21700c5f30 msgr2=0x7f21700c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175f27700 1 --2- 172.21.15.27:0/248162771 >> v2:172.21.15.40:3300/0 conn(0x7f21700c5f30 0x7f21700c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2174f25700 1 -- 172.21.15.27:0/248162771 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261512606 0 0) 0x7f21700bfcd0 con 0x7f21701541c0 2023-05-17T15:08:51.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175726700 1 --2- 172.21.15.27:0/248162771 >> v2:172.21.15.40:3300/0 conn(0x7f21700c5f30 0x7f21700c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175726700 1 -- 172.21.15.27:0/248162771 >> v1:172.21.15.27:6789/0 conn(0x7f21701541c0 legacy=0x7f21700c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175726700 1 -- 172.21.15.27:0/248162771 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700aa480 con 0x7f2170158880 2023-05-17T15:08:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175f27700 1 --2- 172.21.15.27:0/248162771 >> v2:172.21.15.40:3300/0 conn(0x7f21700c5f30 0x7f21700c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2175726700 1 --2- 172.21.15.27:0/248162771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f2170153cd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f2170083a50 tx=0x7f21640090f0).ready entity=mon.0 client_cookie=af6bfbf3f72771a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2174f25700 1 -- 172.21.15.27:0/248162771 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400b600 con 0x7f2170158880 2023-05-17T15:08:51.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2174f25700 1 -- 172.21.15.27:0/248162771 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400b760 con 0x7f2170158880 2023-05-17T15:08:51.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.281+0000 7f2174f25700 1 -- 172.21.15.27:0/248162771 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400bae0 con 0x7f2170158880 2023-05-17T15:08:51.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 -- 172.21.15.27:0/248162771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 msgr2=0x7f2170153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 --2- 172.21.15.27:0/248162771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f2170153cd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f2170083a50 tx=0x7f21640090f0).stop 2023-05-17T15:08:51.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 -- 172.21.15.27:0/248162771 shutdown_connections 2023-05-17T15:08:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 --2- 172.21.15.27:0/248162771 >> v2:172.21.15.40:3300/0 conn(0x7f21700c5f30 0x7f21700c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 --2- 172.21.15.27:0/248162771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f2170153cd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 -- 172.21.15.27:0/248162771 >> 172.21.15.27:0/248162771 conn(0x7f2170069e70 msgr2=0x7f217005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 -- 172.21.15.27:0/248162771 shutdown_connections 2023-05-17T15:08:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.282+0000 7f217818b700 1 -- 172.21.15.27:0/248162771 wait complete. 2023-05-17T15:08:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.283+0000 7f217818b700 1 Processor -- start 2023-05-17T15:08:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.283+0000 7f217818b700 1 -- start start 2023-05-17T15:08:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21700c5f30 0x7f2170147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21701541c0 0x7f2170165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f21700c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c2fa0 con 0x7f2170158880 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2170147f50 con 0x7f21701541c0 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c2390 con 0x7f21700c5f30 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f21700c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f21700c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39634/0 (socket says 172.21.15.27:39634) 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 -- 172.21.15.27:0/2061139218 learned_addr learned my addr 172.21.15.27:0/2061139218 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2175726700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21701541c0 0x7f2170165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2175f27700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21700c5f30 0x7f2170147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 -- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21700c5f30 msgr2=0x7f2170147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21700c5f30 0x7f2170147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 -- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21701541c0 msgr2=0x7f2170165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21701541c0 0x7f2170165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 -- 172.21.15.27:0/2061139218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009370 con 0x7f2170158880 2023-05-17T15:08:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2175726700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21701541c0 0x7f2170165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2175f27700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21700c5f30 0x7f2170147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f2176728700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f21700c3c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f216000c7e0 tx=0x7f2160007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160005c70 con 0x7f2170158880 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2160005dd0 con 0x7f2170158880 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.284+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700c2670 con 0x7f2170158880 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.285+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160007320 con 0x7f2170158880 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.285+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700c2c30 con 0x7f2170158880 2023-05-17T15:08:51.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.286+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700c3150 con 0x7f2170158880 2023-05-17T15:08:51.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.286+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2160010030 con 0x7f2170158880 2023-05-17T15:08:51.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.286+0000 7f216dffb700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f215c05ed90 0x7f215c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.287+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f21600796f0 con 0x7f2170158880 2023-05-17T15:08:51.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.287+0000 7f2175f27700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f215c05ed90 0x7f215c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.287+0000 7f2175f27700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f215c05ed90 0x7f215c061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2168006fd0 tx=0x7f2168008040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:51.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.291+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21700c3150 con 0x7f2170158880 2023-05-17T15:08:51.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.533+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f217005f4a0 con 0x7f2170158880 2023-05-17T15:08:51.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.533+0000 7f216dffb700 1 -- 172.21.15.27:0/2061139218 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f216004afa0 con 0x7f2170158880 2023-05-17T15:08:51.538 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:51.539 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:08:51.539 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:08:51.539 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.539 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:08:51.539 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:08:51.539 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.540 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.541 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:51.542 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:08:51.543 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.544 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.545 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.546 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.547 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:08:51.548 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.549 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.550 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.552 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:08:51.553 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.554 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:08:51.555 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.556 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.556 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:08:51.556 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:08:51.556 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:08:51.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:08:51.557 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.558 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:08:51.559 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:08:51.562 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:08:51.563 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.563 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:51.563 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:08:51.563 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:08:51.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f215c05ed90 msgr2=0x7f215c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f215c05ed90 0x7f215c061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2168006fd0 tx=0x7f2168008040).stop 2023-05-17T15:08:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 msgr2=0x7f21700c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f21700c3c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f216000c7e0 tx=0x7f2160007f60).stop 2023-05-17T15:08:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 shutdown_connections 2023-05-17T15:08:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f215c05ed90 0x7f215c061250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2170158880 0x7f21700c3c40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21700c5f30 0x7f2170147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 --2- 172.21.15.27:0/2061139218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21701541c0 0x7f2170165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 >> 172.21.15.27:0/2061139218 conn(0x7f2170069e70 msgr2=0x7f2170153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 shutdown_connections 2023-05-17T15:08:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.535+0000 7f217818b700 1 -- 172.21.15.27:0/2061139218 wait complete. 2023-05-17T15:08:51.567 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:51.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.678+0000 7f5e0bfff700 1 Processor -- start 2023-05-17T15:08:51.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.678+0000 7f5e0bfff700 1 -- start start 2023-05-17T15:08:51.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5e0c0a7e70 0x7f5e0c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0bfff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0641d0 con 0x7f5e0c0a7a90 2023-05-17T15:08:51.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c064450 con 0x7f5e0c0bead0 2023-05-17T15:08:51.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c064730 con 0x7f5e0c0a7e70 2023-05-17T15:08:51.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0a7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5e0c0a7e70 0x7f5e0c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0affd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5e0c0a7a90 0x7f5e0c157b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39200/0 (socket says 172.21.15.27:39200) 2023-05-17T15:08:51.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0affd700 1 -- 172.21.15.27:0/2404638762 learned_addr learned my addr 172.21.15.27:0/2404638762 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:51.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0a7fc700 1 -- 172.21.15.27:0/2404638762 >> v1:172.21.15.40:6789/0 conn(0x7f5e0c0bead0 legacy=0x7f5e0c0687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:51.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0a7fc700 1 -- 172.21.15.27:0/2404638762 >> v1:172.21.15.27:6789/0 conn(0x7f5e0c0a7a90 legacy=0x7f5e0c157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e09ffb700 1 -- 172.21.15.27:0/2404638762 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78666236 0 0) 0x7f5e0c0641d0 con 0x7f5e0c0a7a90 2023-05-17T15:08:51.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0a7fc700 1 -- 172.21.15.27:0/2404638762 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c064a10 con 0x7f5e0c0a7e70 2023-05-17T15:08:51.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e0a7fc700 1 --2- 172.21.15.27:0/2404638762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c1582a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f5e00006fd0 tx=0x7f5e00006f40).ready entity=mon.0 client_cookie=228b075c20f4db53 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:51.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.679+0000 7f5e09ffb700 1 -- 172.21.15.27:0/2404638762 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00005880 con 0x7f5e0c0a7e70 2023-05-17T15:08:51.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e09ffb700 1 -- 172.21.15.27:0/2404638762 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e000059e0 con 0x7f5e0c0a7e70 2023-05-17T15:08:51.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e09ffb700 1 -- 172.21.15.27:0/2404638762 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00005d60 con 0x7f5e0c0a7e70 2023-05-17T15:08:51.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 -- 172.21.15.27:0/2404638762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0a7e70 msgr2=0x7f5e0c1582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/2404638762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c1582a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f5e00006fd0 tx=0x7f5e00006f40).stop 2023-05-17T15:08:51.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 -- 172.21.15.27:0/2404638762 shutdown_connections 2023-05-17T15:08:51.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/2404638762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c1582a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 -- 172.21.15.27:0/2404638762 >> 172.21.15.27:0/2404638762 conn(0x7f5e0c062a60 msgr2=0x7f5e0c0c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:51.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 -- 172.21.15.27:0/2404638762 shutdown_connections 2023-05-17T15:08:51.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.680+0000 7f5e0bfff700 1 -- 172.21.15.27:0/2404638762 wait complete. 2023-05-17T15:08:51.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.681+0000 7f5e0bfff700 1 Processor -- start 2023-05-17T15:08:51.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.681+0000 7f5e0bfff700 1 -- start start 2023-05-17T15:08:51.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c0a7a90 0x7f5e0c0a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 0x7f5e0c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0bf9a0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a9fe0 con 0x7f5e0c0a7e70 2023-05-17T15:08:51.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c165830 con 0x7f5e0c0a7a90 2023-05-17T15:08:51.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 0x7f5e0c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 0x7f5e0c155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39648/0 (socket says 172.21.15.27:39648) 2023-05-17T15:08:51.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 -- 172.21.15.27:0/455303651 learned_addr learned my addr 172.21.15.27:0/455303651 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:51.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 -- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c0a7a90 msgr2=0x7f5e0c0a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c0a7a90 0x7f5e0c0a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:51.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 -- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0a7e70 msgr2=0x7f5e0c165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0a7fc700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.682+0000 7f5e0b7fe700 1 -- 172.21.15.27:0/455303651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009250 con 0x7f5e0c0bead0 2023-05-17T15:08:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.683+0000 7f5e0b7fe700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 0x7f5e0c155c70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f5dfc00c490 tx=0x7f5dfc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.683+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc002ea0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.683+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00f470 con 0x7f5e0c0bead0 2023-05-17T15:08:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.683+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c168cf0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.683+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00f810 con 0x7f5e0c0bead0 2023-05-17T15:08:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.683+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c167fe0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.684+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c06bdf0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.684+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5dfc010070 con 0x7f5e0c0bead0 2023-05-17T15:08:51.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.684+0000 7f5df2ffd700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5df805ed90 0x7f5df8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:51.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.684+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f5dfc078b40 con 0x7f5e0c0bead0 2023-05-17T15:08:51.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.684+0000 7f5e0affd700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5df805ed90 0x7f5df8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:51.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.685+0000 7f5e0affd700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5df805ed90 0x7f5df8061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5e04001b70 tx=0x7f5e04007c40).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:51.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.688+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5dfc0478f0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.863+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e0c062ec0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.864+0000 7f5df2ffd700 1 -- 172.21.15.27:0/455303651 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+13827 (secure 0 0 0) 0x7f5dfc04a3f0 con 0x7f5e0c0bead0 2023-05-17T15:08:51.869 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:51.869 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":93,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:51.137306+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5df805ed90 msgr2=0x7f5df8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5df805ed90 0x7f5df8061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5e04001b70 tx=0x7f5e04007c40).stop 2023-05-17T15:08:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 msgr2=0x7f5e0c155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 0x7f5e0c155c70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f5dfc00c490 tx=0x7f5dfc007de0).stop 2023-05-17T15:08:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 shutdown_connections 2023-05-17T15:08:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5df805ed90 0x7f5df8061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c0bead0 0x7f5e0c155c70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c0a7a90 0x7f5e0c0a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:08:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 --2- 172.21.15.27:0/455303651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0a7e70 0x7f5e0c165340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 >> 172.21.15.27:0/455303651 conn(0x7f5e0c062a60 msgr2=0x7f5e0c0c5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 shutdown_connections 2023-05-17T15:08:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.866+0000 7f5e0bfff700 1 -- 172.21.15.27:0/455303651 wait complete. 2023-05-17T15:08:51.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:08:51.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:08:52.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.998+0000 7f74e052a700 1 Processor -- start 2023-05-17T15:08:52.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.998+0000 7f74e052a700 1 -- start start 2023-05-17T15:08:52.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74e052a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74d8066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74e052a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74d8068790 0x7f74d80c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74e052a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d8067420 con 0x7f74d80666c0 2023-05-17T15:08:52.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74e052a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d80bd170 con 0x7f74d8068790 2023-05-17T15:08:52.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74e052a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8067700 con 0x7f74d80bdd40 2023-05-17T15:08:52.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74de2c6700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f74d80666c0 0x7f74d80bca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39214/0 (socket says 172.21.15.27:39214) 2023-05-17T15:08:52.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74de2c6700 1 -- 172.21.15.27:0/2521733410 learned_addr learned my addr 172.21.15.27:0/2521733410 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:52.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74deac7700 1 --2- 172.21.15.27:0/2521733410 >> v2:172.21.15.40:3300/0 conn(0x7f74d8068790 0x7f74d80c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74ddac5700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74d8066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441933423 0 0) 0x7f74d8067420 con 0x7f74d80666c0 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c40033f0 con 0x7f74d80666c0 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865456264 0 0) 0x7f74c40033f0 con 0x7f74d80666c0 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 msgr2=0x7f74d8066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74d8066aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 >> v2:172.21.15.40:3300/0 conn(0x7f74d8068790 msgr2=0x7f74d80c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 --2- 172.21.15.27:0/2521733410 >> v2:172.21.15.40:3300/0 conn(0x7f74d8068790 0x7f74d80c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80c1790 con 0x7f74d80666c0 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f74d4001470 con 0x7f74d80666c0 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 >> v1:172.21.15.27:6789/0 conn(0x7f74d80666c0 legacy=0x7f74d80bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:51.999+0000 7f74dd2c4700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74c40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74c4003e10 0x7f74c4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c4004b80 0x7f74c4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80bd170 con 0x7f74c4003e10 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8067700 con 0x7f74c4004b80 2023-05-17T15:08:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c400b8e0 con 0x7f74d80bdd40 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74c4003e10 0x7f74c4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74de2c6700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74c40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74deac7700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c4004b80 0x7f74c4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 -- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 msgr2=0x7f74c40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74c40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 -- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c4004b80 msgr2=0x7f74c4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c4004b80 0x7f74c4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 -- 172.21.15.27:0/2521733410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40033f0 con 0x7f74c4003e10 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74de2c6700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80bdd40 0x7f74c40038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74ddac5700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74c4003e10 0x7f74c4004690 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f74c8009ab0 tx=0x7f74c8009060).ready entity=mon.0 client_cookie=7bdd011565721803 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8009430 con 0x7f74c4003e10 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800e640 con 0x7f74c4003e10 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.000+0000 7f74dd2c4700 1 -- 172.21.15.27:0/2521733410 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800e9c0 con 0x7f74c4003e10 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74e052a700 1 -- 172.21.15.27:0/2521733410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74c4003e10 msgr2=0x7f74c4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74e052a700 1 --2- 172.21.15.27:0/2521733410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74c4003e10 0x7f74c4004690 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f74c8009ab0 tx=0x7f74c8009060).stop 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74deac7700 1 -- 172.21.15.27:0/2521733410 reap_dead start 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74e052a700 1 -- 172.21.15.27:0/2521733410 shutdown_connections 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74e052a700 1 -- 172.21.15.27:0/2521733410 >> 172.21.15.27:0/2521733410 conn(0x7f74d8063dd0 msgr2=0x7f74d8067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74e052a700 1 -- 172.21.15.27:0/2521733410 shutdown_connections 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.001+0000 7f74e052a700 1 -- 172.21.15.27:0/2521733410 wait complete. 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.002+0000 7f74e052a700 1 Processor -- start 2023-05-17T15:08:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.002+0000 7f74e052a700 1 -- start start 2023-05-17T15:08:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74c4003e10 0x7f74d8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 0x7f74d814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8163690 0x7f74d8163b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8150bb0 con 0x7f74d80ab090 2023-05-17T15:08:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8164000 con 0x7f74d8163690 2023-05-17T15:08:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8155530 con 0x7f74c4003e10 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 0x7f74d814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 0x7f74d814ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39666/0 (socket says 172.21.15.27:39666) 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 -- 172.21.15.27:0/3095321259 learned_addr learned my addr 172.21.15.27:0/3095321259 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74de2c6700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74c4003e10 0x7f74d8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74deac7700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8163690 0x7f74d8163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 -- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74c4003e10 msgr2=0x7f74d8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74c4003e10 0x7f74d8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 -- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8163690 msgr2=0x7f74d8163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8163690 0x7f74d8163b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 -- 172.21.15.27:0/3095321259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8153650 con 0x7f74d80ab090 2023-05-17T15:08:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74deac7700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8163690 0x7f74d8163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ddac5700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 0x7f74d814ca80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f74c801afa0 tx=0x7f74c801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c801f070 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800ed70 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800eee0 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d8153930 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.003+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d814cf70 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.004+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d81506a0 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.005+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74c8011660 con 0x7f74d80ab090 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.005+0000 7f74ce7fc700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f74bc05ed60 0x7f74bc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.005+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f74c807c640 con 0x7f74d80ab090 2023-05-17T15:08:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.005+0000 7f74de2c6700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f74bc05ed60 0x7f74bc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.005+0000 7f74de2c6700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f74bc05ed60 0x7f74bc061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f74d80bc5d0 tx=0x7f74d4007040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.009+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74d81506a0 con 0x7f74d80ab090 2023-05-17T15:08:52.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.182+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f74d81506a0 con 0x7f74d80ab090 2023-05-17T15:08:52.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.182+0000 7f74ce7fc700 1 -- 172.21.15.27:0/3095321259 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v93) v1 ==== 110+0+10 (secure 0 0 0) 0x7f74d81506a0 con 0x7f74d80ab090 2023-05-17T15:08:52.187 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:08:52.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f74bc05ed60 msgr2=0x7f74bc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f74bc05ed60 0x7f74bc061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f74d80bc5d0 tx=0x7f74d4007040).stop 2023-05-17T15:08:52.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 msgr2=0x7f74d814ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 0x7f74d814ca80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f74c801afa0 tx=0x7f74c801a000).stop 2023-05-17T15:08:52.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 shutdown_connections 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f74bc05ed60 0x7f74bc061220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8163690 0x7f74d8163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74c4003e10 0x7f74d8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 --2- 172.21.15.27:0/3095321259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74d80ab090 0x7f74d814ca80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 >> 172.21.15.27:0/3095321259 conn(0x7f74d8063dd0 msgr2=0x7f74d814ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 shutdown_connections 2023-05-17T15:08:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.184+0000 7f74e052a700 1 -- 172.21.15.27:0/3095321259 wait complete. 2023-05-17T15:08:52.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:08:52.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.315+0000 7f40681c8700 1 Processor -- start 2023-05-17T15:08:52.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.315+0000 7f40681c8700 1 -- start start 2023-05-17T15:08:52.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f40681c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40600c6310 0x7f4060068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f40681c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f40600bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f40681c8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4060158790 con 0x7f40601543d0 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f40681c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600c1c50 con 0x7f40600c6310 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f40681c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4060157e60 con 0x7f40600691f0 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4065f64700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f40601543d0 0x7f40600c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39234/0 (socket says 172.21.15.27:39234) 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4065f64700 1 -- 172.21.15.27:0/1891517766 learned_addr learned my addr 172.21.15.27:0/1891517766 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4066765700 1 --2- 172.21.15.27:0/1891517766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f40600bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4065763700 1 --2- 172.21.15.27:0/1891517766 >> v2:172.21.15.40:3300/0 conn(0x7f40600c6310 0x7f4060068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4064f62700 1 -- 172.21.15.27:0/1891517766 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645820536 0 0) 0x7f4060158790 con 0x7f40601543d0 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4064f62700 1 -- 172.21.15.27:0/1891517766 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f404c0033f0 con 0x7f40601543d0 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4064f62700 1 -- 172.21.15.27:0/1891517766 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105812704 0 0) 0x7f404c0033f0 con 0x7f40601543d0 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4066765700 1 -- 172.21.15.27:0/1891517766 >> v2:172.21.15.40:3300/0 conn(0x7f40600c6310 msgr2=0x7f4060068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4066765700 1 --2- 172.21.15.27:0/1891517766 >> v2:172.21.15.40:3300/0 conn(0x7f40600c6310 0x7f4060068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4066765700 1 -- 172.21.15.27:0/1891517766 >> v1:172.21.15.27:6789/0 conn(0x7f40601543d0 legacy=0x7f40600c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4066765700 1 -- 172.21.15.27:0/1891517766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060158140 con 0x7f40600691f0 2023-05-17T15:08:52.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.316+0000 7f4065763700 1 --2- 172.21.15.27:0/1891517766 >> v2:172.21.15.40:3300/0 conn(0x7f40600c6310 0x7f4060068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:52.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f4066765700 1 --2- 172.21.15.27:0/1891517766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f40600bfc80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4058009e60 tx=0x7f4058009780).ready entity=mon.2 client_cookie=73708e6e776d7619 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f4064f62700 1 -- 172.21.15.27:0/1891517766 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800e070 con 0x7f40600691f0 2023-05-17T15:08:52.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f4064f62700 1 -- 172.21.15.27:0/1891517766 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405800b7a0 con 0x7f40600691f0 2023-05-17T15:08:52.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f4064f62700 1 -- 172.21.15.27:0/1891517766 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c001470 con 0x7f40600691f0 2023-05-17T15:08:52.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 -- 172.21.15.27:0/1891517766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 msgr2=0x7f40600bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 --2- 172.21.15.27:0/1891517766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f40600bfc80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4058009e60 tx=0x7f4058009780).stop 2023-05-17T15:08:52.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 -- 172.21.15.27:0/1891517766 shutdown_connections 2023-05-17T15:08:52.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 --2- 172.21.15.27:0/1891517766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f40600bfc80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 --2- 172.21.15.27:0/1891517766 >> v2:172.21.15.40:3300/0 conn(0x7f40600c6310 0x7f4060068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 -- 172.21.15.27:0/1891517766 >> 172.21.15.27:0/1891517766 conn(0x7f40600cb7f0 msgr2=0x7f40600c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 -- 172.21.15.27:0/1891517766 shutdown_connections 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.317+0000 7f40681c8700 1 -- 172.21.15.27:0/1891517766 wait complete. 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.318+0000 7f40681c8700 1 Processor -- start 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 -- start start 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f4060167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40600c6310 0x7f40600acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 0x7f4060153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600c1f80 con 0x7f40601543d0 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600ad0e0 con 0x7f40600c6310 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f40681c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40601684b0 con 0x7f40600691f0 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f4066765700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 0x7f4060153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f4066765700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 0x7f4060153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39682/0 (socket says 172.21.15.27:39682) 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.319+0000 7f4066765700 1 -- 172.21.15.27:0/987855893 learned_addr learned my addr 172.21.15.27:0/987855893 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:52.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4065763700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40600c6310 0x7f40600acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4065f64700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f4060167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4066765700 1 -- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 msgr2=0x7f4060167580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4066765700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f4060167580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4066765700 1 -- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40600c6310 msgr2=0x7f40600acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4066765700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40600c6310 0x7f40600acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4066765700 1 -- 172.21.15.27:0/987855893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500092a0 con 0x7f40601543d0 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4065763700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40600c6310 0x7f40600acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4066765700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 0x7f4060153880 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f405800b610 tx=0x7f4058009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800be50 con 0x7f40601543d0 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405801d630 con 0x7f40601543d0 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4058009a20 con 0x7f40601543d0 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405801d9d0 con 0x7f40601543d0 2023-05-17T15:08:52.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.320+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060167ef0 con 0x7f40601543d0 2023-05-17T15:08:52.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.321+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406006bdf0 con 0x7f40601543d0 2023-05-17T15:08:52.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.322+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4058027460 con 0x7f40601543d0 2023-05-17T15:08:52.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.322+0000 7f4055ffb700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f404405ed90 0x7f4044061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.322+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f405807b710 con 0x7f40601543d0 2023-05-17T15:08:52.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.322+0000 7f4065f64700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f404405ed90 0x7f4044061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.322+0000 7f4065f64700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f404405ed90 0x7f4044061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f405c0078e0 tx=0x7f405c009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.326+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f405804cf60 con 0x7f40601543d0 2023-05-17T15:08:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.498+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4060069d00 con 0x7f40601543d0 2023-05-17T15:08:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.498+0000 7f4055ffb700 1 -- 172.21.15.27:0/987855893 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4058050580 con 0x7f40601543d0 2023-05-17T15:08:52.503 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:08:52.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f404405ed90 msgr2=0x7f4044061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f404405ed90 0x7f4044061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f405c0078e0 tx=0x7f405c009040).stop 2023-05-17T15:08:52.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 msgr2=0x7f4060153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 0x7f4060153880 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f405800b610 tx=0x7f4058009780).stop 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 shutdown_connections 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f404405ed90 0x7f4044061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40601543d0 0x7f4060153880 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40600691f0 0x7f4060167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 --2- 172.21.15.27:0/987855893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40600c6310 0x7f40600acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.500+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 >> 172.21.15.27:0/987855893 conn(0x7f40600cb7f0 msgr2=0x7f40600bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.501+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 shutdown_connections 2023-05-17T15:08:52.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.501+0000 7f40681c8700 1 -- 172.21.15.27:0/987855893 wait complete. 2023-05-17T15:08:52.517 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:08:52.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.628+0000 7fbe67d8d700 1 Processor -- start 2023-05-17T15:08:52.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.628+0000 7fbe67d8d700 1 -- start start 2023-05-17T15:08:52.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe67d8d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe60153fa0 0x7fbe600c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe67d8d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600c07a0 con 0x7fbe600aae70 2023-05-17T15:08:52.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe67d8d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600bfe70 con 0x7fbe60069770 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe67d8d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe60069d70 con 0x7fbe60153fa0 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe65b29700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbe60153fa0 0x7fbe600c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe65328700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbe600aae70 0x7fbe60069060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39250/0 (socket says 172.21.15.27:39250) 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.629+0000 7fbe65328700 1 -- 172.21.15.27:0/198469874 learned_addr learned my addr 172.21.15.27:0/198469874 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe65b29700 1 -- 172.21.15.27:0/198469874 >> v1:172.21.15.40:6789/0 conn(0x7fbe60069770 legacy=0x7fbe600c0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe64b27700 1 -- 172.21.15.27:0/198469874 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887241941 0 0) 0x7fbe600c07a0 con 0x7fbe600aae70 2023-05-17T15:08:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe65b29700 1 -- 172.21.15.27:0/198469874 >> v1:172.21.15.27:6789/0 conn(0x7fbe600aae70 legacy=0x7fbe60069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe65b29700 1 -- 172.21.15.27:0/198469874 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600c0150 con 0x7fbe60153fa0 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe65b29700 1 --2- 172.21.15.27:0/198469874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60153fa0 0x7fbe600c5d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fbe58009760 tx=0x7fbe58009060).ready entity=mon.0 client_cookie=560740bf943c14b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe64b27700 1 -- 172.21.15.27:0/198469874 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800b580 con 0x7fbe60153fa0 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe64b27700 1 -- 172.21.15.27:0/198469874 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800b6e0 con 0x7fbe60153fa0 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe64b27700 1 -- 172.21.15.27:0/198469874 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800ba60 con 0x7fbe60153fa0 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.630+0000 7fbe67d8d700 1 -- 172.21.15.27:0/198469874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60153fa0 msgr2=0x7fbe600c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.631+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/198469874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60153fa0 0x7fbe600c5d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fbe58009760 tx=0x7fbe58009060).stop 2023-05-17T15:08:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.631+0000 7fbe67d8d700 1 -- 172.21.15.27:0/198469874 shutdown_connections 2023-05-17T15:08:52.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.631+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/198469874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60153fa0 0x7fbe600c5d80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.631+0000 7fbe67d8d700 1 -- 172.21.15.27:0/198469874 >> 172.21.15.27:0/198469874 conn(0x7fbe600cb810 msgr2=0x7fbe600c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.631+0000 7fbe67d8d700 1 -- 172.21.15.27:0/198469874 shutdown_connections 2023-05-17T15:08:52.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.631+0000 7fbe67d8d700 1 -- 172.21.15.27:0/198469874 wait complete. 2023-05-17T15:08:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 Processor -- start 2023-05-17T15:08:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 -- start start 2023-05-17T15:08:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 0x7fbe600aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe600aae70 0x7fbe600c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe60153fa0 0x7fbe600c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe601569f0 con 0x7fbe60069770 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6014e450 con 0x7fbe600aae70 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.632+0000 7fbe67d8d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600c5100 con 0x7fbe60153fa0 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 0x7fbe600aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 0x7fbe600aa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39692/0 (socket says 172.21.15.27:39692) 2023-05-17T15:08:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 -- 172.21.15.27:0/3818481710 learned_addr learned my addr 172.21.15.27:0/3818481710 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65328700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe600aae70 0x7fbe600c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe6632a700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe60153fa0 0x7fbe600c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 -- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe60153fa0 msgr2=0x7fbe600c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe60153fa0 0x7fbe600c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 -- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe600aae70 msgr2=0x7fbe600c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe600aae70 0x7fbe600c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 -- 172.21.15.27:0/3818481710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580092a0 con 0x7fbe60069770 2023-05-17T15:08:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe65b29700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 0x7fbe600aa280 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fbe580091e0 tx=0x7fbe58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800b850 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800b9b0 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe60156560 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5801b670 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.633+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe60156230 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.634+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe60156840 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.635+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbe5802a070 con 0x7fbe60069770 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.635+0000 7fbe5dffb700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbe4c05ed90 0x7fbe4c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.636+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5341+0+0 (secure 0 0 0) 0x7fbe5807b410 con 0x7fbe60069770 2023-05-17T15:08:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.636+0000 7fbe65328700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbe4c05ed90 0x7fbe4c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.636+0000 7fbe65328700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbe4c05ed90 0x7fbe4c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fbe54007fd0 tx=0x7fbe54009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.639+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe5804cc30 con 0x7fbe60069770 2023-05-17T15:08:52.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.816+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbe600c4ba0 con 0x7fbe60069770 2023-05-17T15:08:52.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.817+0000 7fbe5dffb700 1 -- 172.21.15.27:0/3818481710 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbe58028090 con 0x7fbe60069770 2023-05-17T15:08:52.822 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:52.822 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:08:52.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:08:52.823 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:08:52.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbe4c05ed90 msgr2=0x7fbe4c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbe4c05ed90 0x7fbe4c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fbe54007fd0 tx=0x7fbe54009040).stop 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 msgr2=0x7fbe600aa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 0x7fbe600aa280 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fbe580091e0 tx=0x7fbe58017000).stop 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 shutdown_connections 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbe4c05ed90 0x7fbe4c061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe60153fa0 0x7fbe600c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe60069770 0x7fbe600aa280 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 --2- 172.21.15.27:0/3818481710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe600aae70 0x7fbe600c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 >> 172.21.15.27:0/3818481710 conn(0x7fbe600cb810 msgr2=0x7fbe600abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 shutdown_connections 2023-05-17T15:08:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.819+0000 7fbe67d8d700 1 -- 172.21.15.27:0/3818481710 wait complete. 2023-05-17T15:08:52.835 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:08:52.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:08:52.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.952+0000 7f61b01c5700 1 Processor -- start 2023-05-17T15:08:52.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.952+0000 7f61b01c5700 1 -- start start 2023-05-17T15:08:52.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61b01c5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f61a8153f80 0x7f61a8064cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61b01c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a805e460 0x7f61a80c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61b01c5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a8063f70 con 0x7f61a80c50b0 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61b01c5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a80bdcc0 con 0x7f61a8153f80 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61b01c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a8158980 con 0x7f61a805e460 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f61a8153f80 0x7f61a8064cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f61a8153f80 0x7f61a8064cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39700/0 (socket says 172.21.15.27:39700) 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 -- 172.21.15.27:0/3917969435 learned_addr learned my addr 172.21.15.27:0/3917969435 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 -- 172.21.15.27:0/3917969435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a805e460 msgr2=0x7f61a80c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61ae762700 1 --2- 172.21.15.27:0/3917969435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a805e460 0x7f61a80c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 --2- 172.21.15.27:0/3917969435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a805e460 0x7f61a80c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 -- 172.21.15.27:0/3917969435 >> v1:172.21.15.40:6789/0 conn(0x7f61a80c50b0 legacy=0x7f61a805dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 -- 172.21.15.27:0/3917969435 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8064210 con 0x7f61a8153f80 2023-05-17T15:08:52.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.953+0000 7f61adf61700 1 --2- 172.21.15.27:0/3917969435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a8064cf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f61a0009f20 tx=0x7f61a0009840).ready entity=mon.0 client_cookie=f5903229455d8a85 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61acf5f700 1 -- 172.21.15.27:0/3917969435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000e070 con 0x7f61a8153f80 2023-05-17T15:08:52.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61acf5f700 1 -- 172.21.15.27:0/3917969435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000ba40 con 0x7f61a8153f80 2023-05-17T15:08:52.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61acf5f700 1 -- 172.21.15.27:0/3917969435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000bdc0 con 0x7f61a8153f80 2023-05-17T15:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 -- 172.21.15.27:0/3917969435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 msgr2=0x7f61a8064cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 --2- 172.21.15.27:0/3917969435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a8064cf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f61a0009f20 tx=0x7f61a0009840).stop 2023-05-17T15:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 -- 172.21.15.27:0/3917969435 shutdown_connections 2023-05-17T15:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 --2- 172.21.15.27:0/3917969435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a805e460 0x7f61a80c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 --2- 172.21.15.27:0/3917969435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a8064cf0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 -- 172.21.15.27:0/3917969435 >> 172.21.15.27:0/3917969435 conn(0x7f61a80c84a0 msgr2=0x7f61a80c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:52.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 -- 172.21.15.27:0/3917969435 shutdown_connections 2023-05-17T15:08:52.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.954+0000 7f61b01c5700 1 -- 172.21.15.27:0/3917969435 wait complete. 2023-05-17T15:08:52.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.955+0000 7f61b01c5700 1 Processor -- start 2023-05-17T15:08:52.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.955+0000 7f61b01c5700 1 -- start start 2023-05-17T15:08:52.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61b01c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61a805e460 0x7f61a814b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61b01c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a80c50b0 0x7f61a80a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61b01c5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a80a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61b01c5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a81509d0 con 0x7f61a8153f80 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61b01c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a8168940 con 0x7f61a805e460 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61b01c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80aa150 con 0x7f61a80c50b0 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61ae762700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a80a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61ae762700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a80a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39708/0 (socket says 172.21.15.27:39708) 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61ae762700 1 -- 172.21.15.27:0/2659926324 learned_addr learned my addr 172.21.15.27:0/2659926324 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:52.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61adf61700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61a805e460 0x7f61a814b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.956+0000 7f61ad760700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a80c50b0 0x7f61a80a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61ae762700 1 -- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a80c50b0 msgr2=0x7f61a80a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61ae762700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a80c50b0 0x7f61a80a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61ae762700 1 -- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61a805e460 msgr2=0x7f61a814b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61ae762700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61a805e460 0x7f61a814b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61ae762700 1 -- 172.21.15.27:0/2659926324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009ae0 con 0x7f61a8153f80 2023-05-17T15:08:52.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61adf61700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61a805e460 0x7f61a814b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61ae762700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a80a9ba0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f61a400c500 tx=0x7f61a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4010580 con 0x7f61a8153f80 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40106e0 con 0x7f61a8153f80 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4010a60 con 0x7f61a8153f80 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a8168010 con 0x7f61a8153f80 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.957+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a81685d0 con 0x7f61a8153f80 2023-05-17T15:08:52.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.958+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a8168af0 con 0x7f61a8153f80 2023-05-17T15:08:52.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.958+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f61a401b460 con 0x7f61a8153f80 2023-05-17T15:08:52.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.959+0000 7f619dffb700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f618c05ed90 0x7f618c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:52.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.959+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f61a4079710 con 0x7f61a8153f80 2023-05-17T15:08:52.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.959+0000 7f61adf61700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f618c05ed90 0x7f618c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:52.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.959+0000 7f61adf61700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f618c05ed90 0x7f618c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f61a000c010 tx=0x7f61a0009840).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:52.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:52.963+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61a8168af0 con 0x7f61a8153f80 2023-05-17T15:08:53.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.136+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f61a806bdf0 con 0x7f61a8153f80 2023-05-17T15:08:53.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.228+0000 7f619dffb700 1 -- 172.21.15.27:0/2659926324 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v94) v1 ==== 152+0+0 (secure 0 0 0) 0x7f61a404af60 con 0x7f61a8153f80 2023-05-17T15:08:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f618c05ed90 msgr2=0x7f618c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f618c05ed90 0x7f618c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f61a000c010 tx=0x7f61a0009840).stop 2023-05-17T15:08:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 msgr2=0x7f61a80a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a80a9ba0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f61a400c500 tx=0x7f61a4008040).stop 2023-05-17T15:08:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 shutdown_connections 2023-05-17T15:08:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f618c05ed90 0x7f618c061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61a8153f80 0x7f61a80a9ba0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61a805e460 0x7f61a814b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 --2- 172.21.15.27:0/2659926324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61a80c50b0 0x7f61a80a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 >> 172.21.15.27:0/2659926324 conn(0x7f61a80c84a0 msgr2=0x7f61a80c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 shutdown_connections 2023-05-17T15:08:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.230+0000 7f61b01c5700 1 -- 172.21.15.27:0/2659926324 wait complete. 2023-05-17T15:08:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:08:53.251 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:08:53.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.369+0000 7ff37b183700 1 Processor -- start 2023-05-17T15:08:53.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.369+0000 7ff37b183700 1 -- start start 2023-05-17T15:08:53.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff37b183700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3740c6310 0x7ff374068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff37b183700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff3740bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff37b183700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374158790 con 0x7ff3741543d0 2023-05-17T15:08:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff37b183700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3740c1c50 con 0x7ff3740c6310 2023-05-17T15:08:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff37b183700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff374157e60 con 0x7ff3740691f0 2023-05-17T15:08:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff373fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3740c6310 0x7ff374068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff379720700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff3740bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff378f1f700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3741543d0 0x7ff3740c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:45278/0 (socket says 172.21.15.27:45278) 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff378f1f700 1 -- 172.21.15.27:0/798875480 learned_addr learned my addr 172.21.15.27:0/798875480 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff373fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3740c6310 0x7ff374068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:57646/0 (socket says 172.21.15.27:57646) 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.370+0000 7ff379720700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff3740bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:40826/0 (socket says 172.21.15.27:40826) 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff373fff700 1 -- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 msgr2=0x7ff3740bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff373fff700 1 --2- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff3740bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff373fff700 1 -- 172.21.15.27:0/798875480 >> v1:172.21.15.40:6789/0 conn(0x7ff3741543d0 legacy=0x7ff3740c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff373fff700 1 -- 172.21.15.27:0/798875480 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374158140 con 0x7ff3740c6310 2023-05-17T15:08:53.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff379720700 1 --2- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff3740bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:53.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff373fff700 1 --2- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff374068d00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff364009760 tx=0x7ff364009060).ready entity=mon.1 client_cookie=1fdb567672a6877 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:53.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff3737fe700 1 -- 172.21.15.27:0/798875480 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400f510 con 0x7ff3740c6310 2023-05-17T15:08:53.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff3737fe700 1 -- 172.21.15.27:0/798875480 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36400f670 con 0x7ff3740c6310 2023-05-17T15:08:53.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff3737fe700 1 -- 172.21.15.27:0/798875480 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400f9f0 con 0x7ff3740c6310 2023-05-17T15:08:53.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 -- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 msgr2=0x7ff374068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:53.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 --2- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff374068d00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff364009760 tx=0x7ff364009060).stop 2023-05-17T15:08:53.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 -- 172.21.15.27:0/798875480 shutdown_connections 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 --2- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff3740bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 --2- 172.21.15.27:0/798875480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff374068d00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 -- 172.21.15.27:0/798875480 >> 172.21.15.27:0/798875480 conn(0x7ff3740cb7f0 msgr2=0x7ff3740c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 -- 172.21.15.27:0/798875480 shutdown_connections 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.371+0000 7ff37b183700 1 -- 172.21.15.27:0/798875480 wait complete. 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 Processor -- start 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 -- start start 2023-05-17T15:08:53.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff374142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff3740c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 0x7ff374167e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740af6f0 con 0x7ff3741543d0 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740aeae0 con 0x7ff3740c6310 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.373+0000 7ff37b183700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740aedc0 con 0x7ff3740691f0 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 0x7ff374167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:53.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 0x7ff374167e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39720/0 (socket says 172.21.15.27:39720) 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 -- 172.21.15.27:0/2313904376 learned_addr learned my addr 172.21.15.27:0/2313904376 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff378f1f700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff374142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff373fff700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff3740c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 -- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 msgr2=0x7ff374142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff374142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 -- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 msgr2=0x7ff3740c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff3740c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:53.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 -- 172.21.15.27:0/2313904376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0092a0 con 0x7ff3741543d0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff379720700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 0x7ff374167e90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7ff35c00e980 tx=0x7ff35c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00c610 con 0x7ff3741543d0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00c770 con 0x7ff3741543d0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3640092a0 con 0x7ff3741543d0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00cb10 con 0x7ff3741543d0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.374+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3740af380 con 0x7ff3741543d0 2023-05-17T15:08:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.375+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3740c5000 con 0x7ff3741543d0 2023-05-17T15:08:53.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.376+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff35c022070 con 0x7ff3741543d0 2023-05-17T15:08:53.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.376+0000 7ff370ff9700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff35405ed60 0x7ff354061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.376+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5711+0+0 (secure 0 0 0) 0x7ff35c07a2b0 con 0x7ff3741543d0 2023-05-17T15:08:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.376+0000 7ff378f1f700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff35405ed60 0x7ff354061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.377+0000 7ff378f1f700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff35405ed60 0x7ff354061220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff36c007fd0 tx=0x7ff36c009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.380+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff35c04ba70 con 0x7ff3741543d0 2023-05-17T15:08:53.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:53.553+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff3740c6c10 con 0x7ff3741543d0 2023-05-17T15:08:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.238+0000 7ff370ff9700 1 -- 172.21.15.27:0/2313904376 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v95) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff35c04f090 con 0x7ff3741543d0 2023-05-17T15:08:54.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.243+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff35405ed60 msgr2=0x7ff354061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.243+0000 7ff37b183700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff35405ed60 0x7ff354061220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff36c007fd0 tx=0x7ff36c009040).stop 2023-05-17T15:08:54.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.243+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 msgr2=0x7ff374167e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.243+0000 7ff37b183700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 0x7ff374167e90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7ff35c00e980 tx=0x7ff35c009060).stop 2023-05-17T15:08:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.244+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 shutdown_connections 2023-05-17T15:08:54.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.244+0000 7ff37b183700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff35405ed60 0x7ff354061220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.244+0000 7ff37b183700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3741543d0 0x7ff374167e90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.244+0000 7ff37b183700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3740691f0 0x7ff374142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.244+0000 7ff37b183700 1 --2- 172.21.15.27:0/2313904376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740c6310 0x7ff3740c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.244+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 >> 172.21.15.27:0/2313904376 conn(0x7ff3740cb7f0 msgr2=0x7ff3741547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:54.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.252+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 shutdown_connections 2023-05-17T15:08:54.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.252+0000 7ff37b183700 1 -- 172.21.15.27:0/2313904376 wait complete. 2023-05-17T15:08:54.260 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:08:54.279 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:08:54.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.396+0000 7f6a66b4c700 1 Processor -- start 2023-05-17T15:08:54.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.396+0000 7f6a66b4c700 1 -- start start 2023-05-17T15:08:54.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a66b4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 0x7f6a600ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a66b4c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a60154e90 0x7f6a600c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a66b4c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600c6260 con 0x7f6a600c5db0 2023-05-17T15:08:54.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a66b4c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a60155310 con 0x7f6a60154e90 2023-05-17T15:08:54.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a66b4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60157de0 con 0x7f6a600acdb0 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a6634b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6a600c5db0 0x7f6a600a97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39292/0 (socket says 172.21.15.27:39292) 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a6634b700 1 -- 172.21.15.27:0/1864103899 learned_addr learned my addr 172.21.15.27:0/1864103899 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a65b4a700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 0x7f6a600ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878458207 0 0) 0x7f6a58001490 con 0x7f6a600c5db0 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c0033f0 con 0x7f6a600c5db0 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a65349700 1 --2- 172.21.15.27:0/1864103899 >> v2:172.21.15.40:3300/0 conn(0x7f6a60154e90 0x7f6a600c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223949602 0 0) 0x7f6a4c0033f0 con 0x7f6a600c5db0 2023-05-17T15:08:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 msgr2=0x7f6a600ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 0x7f6a600ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 >> v2:172.21.15.40:3300/0 conn(0x7f6a60154e90 msgr2=0x7f6a600c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 --2- 172.21.15.27:0/1864103899 >> v2:172.21.15.40:3300/0 conn(0x7f6a60154e90 0x7f6a600c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a601580c0 con 0x7f6a600c5db0 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.397+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f6a58001980 con 0x7f6a600c5db0 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 >> v1:172.21.15.27:6789/0 conn(0x7f6a600c5db0 legacy=0x7f6a600a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 0x7f6a4c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a4c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a4c004b80 0x7f6a4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60155310 con 0x7f6a4c003e10 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60157de0 con 0x7f6a4c004b80 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c00b8e0 con 0x7f6a600acdb0 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a4c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65b4a700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 0x7f6a4c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a6634b700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a4c004b80 0x7f6a4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 -- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 msgr2=0x7f6a4c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a600acdb0 0x7f6a4c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 -- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a4c004b80 msgr2=0x7f6a4c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a4c004b80 0x7f6a4c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 -- 172.21.15.27:0/1864103899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0033f0 con 0x7f6a4c003e10 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a6634b700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a4c004b80 0x7f6a4c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:54.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a65349700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a4c004690 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f6a50009a80 tx=0x7f6a50009060).ready entity=mon.0 client_cookie=9c1d187803f0e65d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50009430 con 0x7f6a4c003e10 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000e640 con 0x7f6a4c003e10 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.398+0000 7f6a64b48700 1 -- 172.21.15.27:0/1864103899 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000e9c0 con 0x7f6a4c003e10 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a66b4c700 1 -- 172.21.15.27:0/1864103899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 msgr2=0x7f6a4c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/1864103899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a4c004690 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f6a50009a80 tx=0x7f6a50009060).stop 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a6634b700 1 -- 172.21.15.27:0/1864103899 reap_dead start 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a66b4c700 1 -- 172.21.15.27:0/1864103899 shutdown_connections 2023-05-17T15:08:54.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a66b4c700 1 -- 172.21.15.27:0/1864103899 >> 172.21.15.27:0/1864103899 conn(0x7f6a6005dd50 msgr2=0x7f6a6005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a66b4c700 1 -- 172.21.15.27:0/1864103899 shutdown_connections 2023-05-17T15:08:54.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.399+0000 7f6a66b4c700 1 -- 172.21.15.27:0/1864103899 wait complete. 2023-05-17T15:08:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.400+0000 7f6a66b4c700 1 Processor -- start 2023-05-17T15:08:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.400+0000 7f6a66b4c700 1 -- start start 2023-05-17T15:08:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a66b4c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a60143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a66b4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a60065580 0x7f6a60065a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a66b4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a60168a90 0x7f6a60168f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a66b4c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60168590 con 0x7f6a4c003e10 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a66b4c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600662d0 con 0x7f6a60168a90 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a66b4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600665b0 con 0x7f6a60065580 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a60143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a60143ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39738/0 (socket says 172.21.15.27:39738) 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 -- 172.21.15.27:0/4170620943 learned_addr learned my addr 172.21.15.27:0/4170620943 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:54.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65349700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a60065580 0x7f6a60065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a6634b700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a60168a90 0x7f6a60168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 -- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a60065580 msgr2=0x7f6a60065a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a60065580 0x7f6a60065a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 -- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a60168a90 msgr2=0x7f6a60168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a60168a90 0x7f6a60168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 -- 172.21.15.27:0/4170620943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60066890 con 0x7f6a4c003e10 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a6634b700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a60168a90 0x7f6a60168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:54.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a65b4a700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a60143ca0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6a5c0119f0 tx=0x7f6a5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.401+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00f940 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.402+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00faa0 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.402+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a60066b70 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.402+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00fe20 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.402+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a60144190 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.403+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a601686d0 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.403+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6a5c024070 con 0x7f6a4c003e10 2023-05-17T15:08:54.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.404+0000 7f6a55ffb700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6a4405ed90 0x7f6a44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.404+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6093+0+0 (secure 0 0 0) 0x7f6a5c07ac60 con 0x7f6a4c003e10 2023-05-17T15:08:54.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.404+0000 7f6a65349700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6a4405ed90 0x7f6a44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.404+0000 7f6a65349700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6a4405ed90 0x7f6a44061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a6014ae30 tx=0x7f6a5001a000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:54.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.408+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6a5c04c190 con 0x7f6a4c003e10 2023-05-17T15:08:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.624+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6a60047150 con 0x7f6a4c003e10 2023-05-17T15:08:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.630+0000 7f6a55ffb700 1 -- 172.21.15.27:0/4170620943 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6a5c04f7b0 con 0x7f6a4c003e10 2023-05-17T15:08:54.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6a4405ed90 msgr2=0x7f6a44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6a4405ed90 0x7f6a44061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a6014ae30 tx=0x7f6a5001a000).stop 2023-05-17T15:08:54.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 msgr2=0x7f6a60143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a60143ca0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f6a5c0119f0 tx=0x7f6a5c009060).stop 2023-05-17T15:08:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 shutdown_connections 2023-05-17T15:08:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6a4405ed90 0x7f6a44061250 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a6014ae30 tx=0x7f6a5001a000).stop 2023-05-17T15:08:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a60168a90 0x7f6a60168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a4c003e10 0x7f6a60143ca0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 --2- 172.21.15.27:0/4170620943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a60065580 0x7f6a60065a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 >> 172.21.15.27:0/4170620943 conn(0x7f6a6005dd50 msgr2=0x7f6a600c0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:54.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 shutdown_connections 2023-05-17T15:08:54.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.634+0000 7f6a66b4c700 1 -- 172.21.15.27:0/4170620943 wait complete. 2023-05-17T15:08:54.646 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 11 and data pool 12 2023-05-17T15:08:54.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:54.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.778+0000 7f9f502d8700 1 Processor -- start 2023-05-17T15:08:54.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.778+0000 7f9f502d8700 1 -- start start 2023-05-17T15:08:54.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f502d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 0x7f9f4815f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f502d8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480aa680 con 0x7f9f480c64a0 2023-05-17T15:08:54.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f502d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4805e7e0 con 0x7f9f480c60c0 2023-05-17T15:08:54.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f502d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480c68e0 con 0x7f9f480c1860 2023-05-17T15:08:54.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9f480c64a0 0x7f9f48153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39326/0 (socket says 172.21.15.27:39326) 2023-05-17T15:08:54.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 -- 172.21.15.27:0/1509884691 learned_addr learned my addr 172.21.15.27:0/1509884691 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:54.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4e875700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 0x7f9f4815f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013634983 0 0) 0x7f9f480aa680 con 0x7f9f480c64a0 2023-05-17T15:08:54.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f300033f0 con 0x7f9f480c64a0 2023-05-17T15:08:54.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183140103 0 0) 0x7f9f300033f0 con 0x7f9f480c64a0 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 msgr2=0x7f9f4815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 0x7f9f4815f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 >> v1:172.21.15.40:6789/0 conn(0x7f9f480c60c0 legacy=0x7f9f480a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4805eac0 con 0x7f9f480c64a0 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f9f3c001470 con 0x7f9f480c64a0 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 >> v1:172.21.15.27:6789/0 conn(0x7f9f480c64a0 legacy=0x7f9f48153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f30003910 0x7f9f30003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 0x7f9f30005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480c68e0 con 0x7f9f30004690 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3000b8e0 con 0x7f9f30003910 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3000ba50 con 0x7f9f480c1860 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4e074700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f30003910 0x7f9f30003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4e875700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 0x7f9f30005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 -- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 msgr2=0x7f9f30005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f480c1860 0x7f9f30005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 -- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f30003910 msgr2=0x7f9f30003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f30003910 0x7f9f30003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.780+0000 7f9f4d873700 1 -- 172.21.15.27:0/1509884691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300033f0 con 0x7f9f30004690 2023-05-17T15:08:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f4d873700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f30004b10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f9f3c00c190 tx=0x7f9f3c001e70).ready entity=mon.0 client_cookie=bb3f3102765b3f7b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c007a40 con 0x7f9f30004690 2023-05-17T15:08:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00ca60 con 0x7f9f30004690 2023-05-17T15:08:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f4d072700 1 -- 172.21.15.27:0/1509884691 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00cde0 con 0x7f9f30004690 2023-05-17T15:08:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f502d8700 1 -- 172.21.15.27:0/1509884691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 msgr2=0x7f9f30004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f502d8700 1 --2- 172.21.15.27:0/1509884691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f30004b10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f9f3c00c190 tx=0x7f9f3c001e70).stop 2023-05-17T15:08:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f4e875700 1 -- 172.21.15.27:0/1509884691 reap_dead start 2023-05-17T15:08:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f502d8700 1 -- 172.21.15.27:0/1509884691 shutdown_connections 2023-05-17T15:08:54.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f502d8700 1 -- 172.21.15.27:0/1509884691 >> 172.21.15.27:0/1509884691 conn(0x7f9f48069e70 msgr2=0x7f9f4805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:54.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f502d8700 1 -- 172.21.15.27:0/1509884691 shutdown_connections 2023-05-17T15:08:54.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.781+0000 7f9f502d8700 1 -- 172.21.15.27:0/1509884691 wait complete. 2023-05-17T15:08:54.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.782+0000 7f9f502d8700 1 Processor -- start 2023-05-17T15:08:54.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.782+0000 7f9f502d8700 1 -- start start 2023-05-17T15:08:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f502d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f4814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f502d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f481646c0 0x7f9f4814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f502d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f480c8b80 0x7f9f480c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f502d8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48164b40 con 0x7f9f30004690 2023-05-17T15:08:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f502d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48167df0 con 0x7f9f480c8b80 2023-05-17T15:08:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f502d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4814fbd0 con 0x7f9f481646c0 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f4814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f4814fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39774/0 (socket says 172.21.15.27:39774) 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 -- 172.21.15.27:0/378505676 learned_addr learned my addr 172.21.15.27:0/378505676 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e875700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f480c8b80 0x7f9f480c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4d873700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f481646c0 0x7f9f4814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 -- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f481646c0 msgr2=0x7f9f4814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f481646c0 0x7f9f4814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 -- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f480c8b80 msgr2=0x7f9f480c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f480c8b80 0x7f9f480c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4e074700 1 -- 172.21.15.27:0/378505676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4814f6b0 con 0x7f9f30004690 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.783+0000 7f9f4d873700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f481646c0 0x7f9f4814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.784+0000 7f9f4e074700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f4814fe00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9f4000ec40 tx=0x7f9f40007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.784+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000c8b0 con 0x7f9f30004690 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.784+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000ca10 con 0x7f9f30004690 2023-05-17T15:08:54.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.784+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f48164d40 con 0x7f9f30004690 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.784+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000cdb0 con 0x7f9f30004690 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.784+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f48165300 con 0x7f9f30004690 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.785+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f481680d0 con 0x7f9f30004690 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.785+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9f40014480 con 0x7f9f30004690 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.785+0000 7f9f467fc700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f3405ed90 0x7f9f34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.785+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f9f40079a20 con 0x7f9f30004690 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.785+0000 7f9f4d873700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f3405ed90 0x7f9f34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:54.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.786+0000 7f9f4d873700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f3405ed90 0x7f9f34061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9f480aeae0 tx=0x7f9f3c015000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:54.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.790+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f400498f0 con 0x7f9f30004690 2023-05-17T15:08:54.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.966+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f4805f4a0 con 0x7f9f30004690 2023-05-17T15:08:54.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.967+0000 7f9f467fc700 1 -- 172.21.15.27:0/378505676 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17058 (secure 0 0 0) 0x7f9f40079020 con 0x7f9f30004690 2023-05-17T15:08:54.972 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:54.973 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":96,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:54.627089+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:53.174505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:53.590665+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f3405ed90 msgr2=0x7f9f34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f3405ed90 0x7f9f34061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9f480aeae0 tx=0x7f9f3c015000).stop 2023-05-17T15:08:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 msgr2=0x7f9f4814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f4814fe00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9f4000ec40 tx=0x7f9f40007f10).stop 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 shutdown_connections 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f3405ed90 0x7f9f34061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f480c8b80 0x7f9f480c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f30004690 0x7f9f4814fe00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 --2- 172.21.15.27:0/378505676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f481646c0 0x7f9f4814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 >> 172.21.15.27:0/378505676 conn(0x7f9f48069e70 msgr2=0x7f9f480acc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 shutdown_connections 2023-05-17T15:08:54.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:54.969+0000 7f9f502d8700 1 -- 172.21.15.27:0/378505676 wait complete. 2023-05-17T15:08:54.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:55.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f09349700 1 Processor -- start 2023-05-17T15:08:55.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f09349700 1 -- start start 2023-05-17T15:08:55.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f09349700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4f040cb130 0x7f4f0415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f09349700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040c0120 con 0x7f4f04157970 2023-05-17T15:08:55.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f09349700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f04158880 con 0x7f4f041571b0 2023-05-17T15:08:55.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f09349700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040c6e20 con 0x7f4f040cb130 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f037fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4f04157970 0x7f4f040caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39346/0 (socket says 172.21.15.27:39346) 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f037fe700 1 -- 172.21.15.27:0/1635653453 learned_addr learned my addr 172.21.15.27:0/1635653453 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f08b48700 1 --2- 172.21.15.27:0/1635653453 >> v2:172.21.15.27:3300/0 conn(0x7f4f040cb130 0x7f4f0415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f08b48700 1 -- 172.21.15.27:0/1635653453 >> v1:172.21.15.40:6789/0 conn(0x7f4f041571b0 legacy=0x7f4f040c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f08b48700 1 -- 172.21.15.27:0/1635653453 >> v1:172.21.15.27:6789/0 conn(0x7f4f04157970 legacy=0x7f4f040caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f08b48700 1 -- 172.21.15.27:0/1635653453 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04157fe0 con 0x7f4f040cb130 2023-05-17T15:08:55.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f02ffd700 1 -- 172.21.15.27:0/1635653453 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152046815 0 0) 0x7f4f040c0120 con 0x7f4f04157970 2023-05-17T15:08:55.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f08b48700 1 --2- 172.21.15.27:0/1635653453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040cb130 0x7f4f0415ed10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f4efc009e60 tx=0x7f4efc009780).ready entity=mon.0 client_cookie=78aef533ea0e4111 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f02ffd700 1 -- 172.21.15.27:0/1635653453 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00e070 con 0x7f4f040cb130 2023-05-17T15:08:55.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f02ffd700 1 -- 172.21.15.27:0/1635653453 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00bc30 con 0x7f4f040cb130 2023-05-17T15:08:55.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.098+0000 7f4f02ffd700 1 -- 172.21.15.27:0/1635653453 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc012410 con 0x7f4f040cb130 2023-05-17T15:08:55.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 -- 172.21.15.27:0/1635653453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040cb130 msgr2=0x7f4f0415ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 --2- 172.21.15.27:0/1635653453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040cb130 0x7f4f0415ed10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f4efc009e60 tx=0x7f4efc009780).stop 2023-05-17T15:08:55.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 -- 172.21.15.27:0/1635653453 shutdown_connections 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 --2- 172.21.15.27:0/1635653453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040cb130 0x7f4f0415ed10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 -- 172.21.15.27:0/1635653453 >> 172.21.15.27:0/1635653453 conn(0x7f4f0405dd50 msgr2=0x7f4f0405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 -- 172.21.15.27:0/1635653453 shutdown_connections 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.099+0000 7f4f09349700 1 -- 172.21.15.27:0/1635653453 wait complete. 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.100+0000 7f4f09349700 1 Processor -- start 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.100+0000 7f4f09349700 1 -- start start 2023-05-17T15:08:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f09349700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040cb130 0x7f4f040c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f09349700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f041571b0 0x7f4f0414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f09349700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 0x7f4f040af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f09349700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c2da0 con 0x7f4f04157970 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f09349700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c3230 con 0x7f4f041571b0 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f09349700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c2190 con 0x7f4f040cb130 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 0x7f4f040af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 0x7f4f040af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39792/0 (socket says 172.21.15.27:39792) 2023-05-17T15:08:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 -- 172.21.15.27:0/691236228 learned_addr learned my addr 172.21.15.27:0/691236228 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 -- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040cb130 msgr2=0x7f4f040c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f03fff700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040cb130 0x7f4f040c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f037fe700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f041571b0 0x7f4f0414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040cb130 0x7f4f040c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 -- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f041571b0 msgr2=0x7f4f0414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f041571b0 0x7f4f0414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 -- 172.21.15.27:0/691236228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc009a20 con 0x7f4f04157970 2023-05-17T15:08:55.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f037fe700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f041571b0 0x7f4f0414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.101+0000 7f4f08b48700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 0x7f4f040af910 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f4f040c8590 tx=0x7f4efc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.102+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00b6f0 con 0x7f4f04157970 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.102+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc013e00 con 0x7f4f04157970 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.102+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f040c2470 con 0x7f4f04157970 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.102+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc006af0 con 0x7f4f04157970 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.102+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f040c2a30 con 0x7f4f04157970 2023-05-17T15:08:55.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.103+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f040c2f10 con 0x7f4f04157970 2023-05-17T15:08:55.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.103+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4efc01d630 con 0x7f4f04157970 2023-05-17T15:08:55.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.103+0000 7f4efbfff700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405edc0 0x7f4ee4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.103+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f4efc07c340 con 0x7f4f04157970 2023-05-17T15:08:55.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.103+0000 7f4f03fff700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405edc0 0x7f4ee4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.104+0000 7f4f03fff700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405edc0 0x7f4ee4061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ef4001680 tx=0x7f4ef4009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.108+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4efc04d890 con 0x7f4f04157970 2023-05-17T15:08:55.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.284+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f0406bdf0 con 0x7f4f04157970 2023-05-17T15:08:55.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.285+0000 7f4efbfff700 1 -- 172.21.15.27:0/691236228 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17058 (secure 0 0 0) 0x7f4efc050eb0 con 0x7f4f04157970 2023-05-17T15:08:55.289 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:55.289 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":96,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:54.627089+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:53.174505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:53.590665+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:55.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.286+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405edc0 msgr2=0x7f4ee4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.286+0000 7f4f09349700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405edc0 0x7f4ee4061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ef4001680 tx=0x7f4ef4009040).stop 2023-05-17T15:08:55.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 msgr2=0x7f4f040af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 0x7f4f040af910 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f4f040c8590 tx=0x7f4efc009780).stop 2023-05-17T15:08:55.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 shutdown_connections 2023-05-17T15:08:55.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405edc0 0x7f4ee4061280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04157970 0x7f4f040af910 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040cb130 0x7f4f040c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 --2- 172.21.15.27:0/691236228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f041571b0 0x7f4f0414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 >> 172.21.15.27:0/691236228 conn(0x7f4f0405dd50 msgr2=0x7f4f040aabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:55.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 shutdown_connections 2023-05-17T15:08:55.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.287+0000 7f4f09349700 1 -- 172.21.15.27:0/691236228 wait complete. 2023-05-17T15:08:55.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:08:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.418+0000 7ff7c3810700 1 Processor -- start 2023-05-17T15:08:55.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.418+0000 7ff7c3810700 1 -- start start 2023-05-17T15:08:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c3810700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7bc1543d0 0x7ff7bc0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c3810700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7bc0c60f0 0x7ff7bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c3810700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0c0c90 con 0x7ff7bc0691f0 2023-05-17T15:08:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c3810700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c1c50 con 0x7ff7bc1543d0 2023-05-17T15:08:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c3810700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc158790 con 0x7ff7bc0c60f0 2023-05-17T15:08:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c15ac700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7bc1543d0 0x7ff7bc0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c15ac700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7bc1543d0 0x7ff7bc0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39796/0 (socket says 172.21.15.27:39796) 2023-05-17T15:08:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.419+0000 7ff7c15ac700 1 -- 172.21.15.27:0/2418937527 learned_addr learned my addr 172.21.15.27:0/2418937527 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c0dab700 1 --2- 172.21.15.27:0/2418937527 >> v2:172.21.15.40:3300/0 conn(0x7ff7bc0c60f0 0x7ff7bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c15ac700 1 -- 172.21.15.27:0/2418937527 >> v2:172.21.15.40:3300/0 conn(0x7ff7bc0c60f0 msgr2=0x7ff7bc068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c15ac700 1 --2- 172.21.15.27:0/2418937527 >> v2:172.21.15.40:3300/0 conn(0x7ff7bc0c60f0 0x7ff7bc068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c15ac700 1 -- 172.21.15.27:0/2418937527 >> v1:172.21.15.40:6789/0 conn(0x7ff7bc0691f0 legacy=0x7ff7bc1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c15ac700 1 -- 172.21.15.27:0/2418937527 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0c6570 con 0x7ff7bc1543d0 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c15ac700 1 --2- 172.21.15.27:0/2418937527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0c5c00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ff7bc0c5620 tx=0x7ff7ac009840).ready entity=mon.0 client_cookie=568f9d1c82eb242 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7bbfff700 1 -- 172.21.15.27:0/2418937527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00e070 con 0x7ff7bc1543d0 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7bbfff700 1 -- 172.21.15.27:0/2418937527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00ba10 con 0x7ff7bc1543d0 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7bbfff700 1 -- 172.21.15.27:0/2418937527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00bd90 con 0x7ff7bc1543d0 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c3810700 1 -- 172.21.15.27:0/2418937527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 msgr2=0x7ff7bc0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c3810700 1 --2- 172.21.15.27:0/2418937527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0c5c00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ff7bc0c5620 tx=0x7ff7ac009840).stop 2023-05-17T15:08:55.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c3810700 1 -- 172.21.15.27:0/2418937527 shutdown_connections 2023-05-17T15:08:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c3810700 1 --2- 172.21.15.27:0/2418937527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0c5c00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c3810700 1 --2- 172.21.15.27:0/2418937527 >> v2:172.21.15.40:3300/0 conn(0x7ff7bc0c60f0 0x7ff7bc068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.420+0000 7ff7c3810700 1 -- 172.21.15.27:0/2418937527 >> 172.21.15.27:0/2418937527 conn(0x7ff7bc0cb7f0 msgr2=0x7ff7bc0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.421+0000 7ff7c3810700 1 -- 172.21.15.27:0/2418937527 shutdown_connections 2023-05-17T15:08:55.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.421+0000 7ff7c3810700 1 -- 172.21.15.27:0/2418937527 wait complete. 2023-05-17T15:08:55.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.422+0000 7ff7c3810700 1 Processor -- start 2023-05-17T15:08:55.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.422+0000 7ff7c3810700 1 -- start start 2023-05-17T15:08:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.422+0000 7ff7c3810700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7bc0691f0 0x7ff7bc0adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.422+0000 7ff7c3810700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7bc0c60f0 0x7ff7bc0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c3810700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c3810700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc164f30 con 0x7ff7bc1543d0 2023-05-17T15:08:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c3810700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc153240 con 0x7ff7bc0c60f0 2023-05-17T15:08:55.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c3810700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc164040 con 0x7ff7bc0691f0 2023-05-17T15:08:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39806/0 (socket says 172.21.15.27:39806) 2023-05-17T15:08:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 -- 172.21.15.27:0/1937972280 learned_addr learned my addr 172.21.15.27:0/1937972280 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c0dab700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7bc0c60f0 0x7ff7bc0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c15ac700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7bc0691f0 0x7ff7bc0adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 -- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7bc0691f0 msgr2=0x7ff7bc0adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7bc0691f0 0x7ff7bc0adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 -- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7bc0c60f0 msgr2=0x7ff7bc0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7bc0c60f0 0x7ff7bc0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 -- 172.21.15.27:0/1937972280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009ae0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c1dad700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0afbe0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ff7b400c490 tx=0x7ff7b4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4002ea0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40123f0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4012790 con 0x7ff7bc1543d0 2023-05-17T15:08:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc164320 con 0x7ff7bc1543d0 2023-05-17T15:08:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.423+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1648e0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.424+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc06bdf0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.425+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff7b4010070 con 0x7ff7bc1543d0 2023-05-17T15:08:55.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.425+0000 7ff7b97fa700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff7a805ed90 0x7ff7a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.425+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ff7b4079060 con 0x7ff7bc1543d0 2023-05-17T15:08:55.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.425+0000 7ff7c15ac700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff7a805ed90 0x7ff7a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.426+0000 7ff7c15ac700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff7a805ed90 0x7ff7a8061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff7bc0c4dc0 tx=0x7ff7ac009840).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.429+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7b40478f0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.645+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff7bc157e60 con 0x7ff7bc1543d0 2023-05-17T15:08:55.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.658+0000 7ff7b97fa700 1 -- 172.21.15.27:0/1937972280 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff7b404a4a0 con 0x7ff7bc1543d0 2023-05-17T15:08:55.663 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:08:55.659+0000 7f08b9efa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:08:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff7a805ed90 msgr2=0x7ff7a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff7a805ed90 0x7ff7a8061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff7bc0c4dc0 tx=0x7ff7ac009840).stop 2023-05-17T15:08:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 msgr2=0x7ff7bc0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0afbe0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ff7b400c490 tx=0x7ff7b4007de0).stop 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 shutdown_connections 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff7a805ed90 0x7ff7a8061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7bc1543d0 0x7ff7bc0afbe0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7bc0691f0 0x7ff7bc0adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 --2- 172.21.15.27:0/1937972280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7bc0c60f0 0x7ff7bc0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 >> 172.21.15.27:0/1937972280 conn(0x7ff7bc0cb7f0 msgr2=0x7ff7bc0c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 shutdown_connections 2023-05-17T15:08:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.660+0000 7ff7c3810700 1 -- 172.21.15.27:0/1937972280 wait complete. 2023-05-17T15:08:55.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:08:55.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.791+0000 7fcf572ba700 1 Processor -- start 2023-05-17T15:08:55.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.792+0000 7fcf572ba700 1 -- start start 2023-05-17T15:08:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.792+0000 7fcf572ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcf500c6310 0x7fcf50068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.792+0000 7fcf572ba700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf50158790 con 0x7fcf501543d0 2023-05-17T15:08:55.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.792+0000 7fcf572ba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf50157e60 con 0x7fcf500691f0 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.792+0000 7fcf572ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500c1c50 con 0x7fcf500c6310 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf55056700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcf501543d0 0x7fcf500c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39372/0 (socket says 172.21.15.27:39372) 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf55056700 1 -- 172.21.15.27:0/2828349724 learned_addr learned my addr 172.21.15.27:0/2828349724 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618137526 0 0) 0x7fcf50158790 con 0x7fcf501543d0 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf380033f0 con 0x7fcf501543d0 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf54855700 1 --2- 172.21.15.27:0/2828349724 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c6310 0x7fcf50068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 529483661 0 0) 0x7fcf380033f0 con 0x7fcf501543d0 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c6310 msgr2=0x7fcf50068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/2828349724 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c6310 0x7fcf50068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 >> v1:172.21.15.40:6789/0 conn(0x7fcf500691f0 legacy=0x7fcf500bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50158140 con 0x7fcf501543d0 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fcf48001470 con 0x7fcf501543d0 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf54855700 1 --2- 172.21.15.27:0/2828349724 >> v2:172.21.15.40:3300/0 conn(0x7fcf500c6310 0x7fcf50068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 >> v1:172.21.15.27:6789/0 conn(0x7fcf501543d0 legacy=0x7fcf500c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf380038e0 0x7fcf38003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf38004690 0x7fcf38004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf3800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3800bf00 con 0x7fcf38005050 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3800c070 con 0x7fcf380038e0 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3800c230 con 0x7fcf38004690 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf55857700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf3800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf55056700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf380038e0 0x7fcf38003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.793+0000 7fcf54855700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf38004690 0x7fcf38004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 -- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf38004690 msgr2=0x7fcf38004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf38004690 0x7fcf38004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 -- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf380038e0 msgr2=0x7fcf38003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf380038e0 0x7fcf38003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 -- 172.21.15.27:0/2828349724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380033f0 con 0x7fcf38005050 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 -- 172.21.15.27:0/2828349724 reap_dead start 2023-05-17T15:08:55.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf55857700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf3800b8e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fcf40001e30 tx=0x7fcf40007f30).ready entity=mon.0 client_cookie=83d73ea441485a2f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40006a20 con 0x7fcf38005050 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40006b80 con 0x7fcf38005050 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf4ffff700 1 -- 172.21.15.27:0/2828349724 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000c5d0 con 0x7fcf38005050 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf572ba700 1 -- 172.21.15.27:0/2828349724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 msgr2=0x7fcf3800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf572ba700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf3800b8e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fcf40001e30 tx=0x7fcf40007f30).stop 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf572ba700 1 -- 172.21.15.27:0/2828349724 shutdown_connections 2023-05-17T15:08:55.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf572ba700 1 --2- 172.21.15.27:0/2828349724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf3800b8e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.794+0000 7fcf572ba700 1 -- 172.21.15.27:0/2828349724 >> 172.21.15.27:0/2828349724 conn(0x7fcf500cb7f0 msgr2=0x7fcf500c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:55.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.795+0000 7fcf572ba700 1 -- 172.21.15.27:0/2828349724 shutdown_connections 2023-05-17T15:08:55.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.795+0000 7fcf572ba700 1 -- 172.21.15.27:0/2828349724 wait complete. 2023-05-17T15:08:55.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 Processor -- start 2023-05-17T15:08:55.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 -- start start 2023-05-17T15:08:55.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf50165760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf50165c50 0x7fcf50152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf50153280 0x7fcf500c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500b0d00 con 0x7fcf38005050 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c4cd0 con 0x7fcf50165c50 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.796+0000 7fcf572ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c1f40 con 0x7fcf50153280 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf50165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf50165760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39822/0 (socket says 172.21.15.27:39822) 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 -- 172.21.15.27:0/989629215 learned_addr learned my addr 172.21.15.27:0/989629215 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:55.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf54855700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf50165c50 0x7fcf50152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55857700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf50153280 0x7fcf500c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 -- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf50153280 msgr2=0x7fcf500c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf50153280 0x7fcf500c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 -- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf50165c50 msgr2=0x7fcf50152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf50165c50 0x7fcf50152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 -- 172.21.15.27:0/989629215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500c4710 con 0x7fcf38005050 2023-05-17T15:08:55.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf54855700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf50165c50 0x7fcf50152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf55056700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf50165760 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fcf480049e0 tx=0x7fcf48001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48004e50 con 0x7fcf38005050 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4800f8d0 con 0x7fcf38005050 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500c49f0 con 0x7fcf38005050 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800fc50 con 0x7fcf38005050 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.797+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500c4020 con 0x7fcf38005050 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.798+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf500c1da0 con 0x7fcf38005050 2023-05-17T15:08:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.799+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcf4801b030 con 0x7fcf38005050 2023-05-17T15:08:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.799+0000 7fcf4d7fa700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf3c05ed90 0x7fcf3c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.799+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fcf48079460 con 0x7fcf38005050 2023-05-17T15:08:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.799+0000 7fcf54855700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf3c05ed90 0x7fcf3c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.799+0000 7fcf54855700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf3c05ed90 0x7fcf3c061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcf50166030 tx=0x7fcf44008040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:55.803+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf500c1da0 con 0x7fcf38005050 2023-05-17T15:08:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.024+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcf500c1da0 con 0x7fcf38005050 2023-05-17T15:08:56.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.660+0000 7fcf4d7fa700 1 -- 172.21.15.27:0/989629215 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf500c1da0 con 0x7fcf38005050 2023-05-17T15:08:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf3c05ed90 msgr2=0x7fcf3c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf3c05ed90 0x7fcf3c061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcf50166030 tx=0x7fcf44008040).stop 2023-05-17T15:08:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 msgr2=0x7fcf50165760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf50165760 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fcf480049e0 tx=0x7fcf48001e50).stop 2023-05-17T15:08:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 shutdown_connections 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf3c05ed90 0x7fcf3c061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf50153280 0x7fcf500c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf38005050 0x7fcf50165760 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 --2- 172.21.15.27:0/989629215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf50165c50 0x7fcf50152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 >> 172.21.15.27:0/989629215 conn(0x7fcf500cb7f0 msgr2=0x7fcf500accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 shutdown_connections 2023-05-17T15:08:56.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.663+0000 7fcf572ba700 1 -- 172.21.15.27:0/989629215 wait complete. 2023-05-17T15:08:56.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:08:56.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.801+0000 7f8ead535700 1 Processor -- start 2023-05-17T15:08:56.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.801+0000 7f8ead535700 1 -- start start 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ead535700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8ea8065aa0 0x7f8ea8155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ead535700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea8069020 con 0x7f8ea8067ec0 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ead535700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea8155700 con 0x7f8ea81540d0 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ead535700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80c3610 con 0x7f8ea8065aa0 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ea67fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8ea8065aa0 0x7f8ea8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ea77fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8ea8067ec0 0x7f8ea80c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39396/0 (socket says 172.21.15.27:39396) 2023-05-17T15:08:56.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ea77fe700 1 -- 172.21.15.27:0/910200157 learned_addr learned my addr 172.21.15.27:0/910200157 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.802+0000 7f8ea67fc700 1 -- 172.21.15.27:0/910200157 >> v1:172.21.15.40:6789/0 conn(0x7f8ea81540d0 legacy=0x7f8ea8065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea5ffb700 1 -- 172.21.15.27:0/910200157 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163020611 0 0) 0x7f8ea8069020 con 0x7f8ea8067ec0 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea67fc700 1 -- 172.21.15.27:0/910200157 >> v1:172.21.15.27:6789/0 conn(0x7f8ea8067ec0 legacy=0x7f8ea80c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea67fc700 1 -- 172.21.15.27:0/910200157 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8068410 con 0x7f8ea8065aa0 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea67fc700 1 --2- 172.21.15.27:0/910200157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8065aa0 0x7f8ea8155210 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f8e90009760 tx=0x7f8e90009060).ready entity=mon.0 client_cookie=a04c5995e7ec1754 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea5ffb700 1 -- 172.21.15.27:0/910200157 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000b580 con 0x7f8ea8065aa0 2023-05-17T15:08:56.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea5ffb700 1 -- 172.21.15.27:0/910200157 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000b6e0 con 0x7f8ea8065aa0 2023-05-17T15:08:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ea5ffb700 1 -- 172.21.15.27:0/910200157 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000ba60 con 0x7f8ea8065aa0 2023-05-17T15:08:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 -- 172.21.15.27:0/910200157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8065aa0 msgr2=0x7f8ea8155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 --2- 172.21.15.27:0/910200157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8065aa0 0x7f8ea8155210 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f8e90009760 tx=0x7f8e90009060).stop 2023-05-17T15:08:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 -- 172.21.15.27:0/910200157 shutdown_connections 2023-05-17T15:08:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 --2- 172.21.15.27:0/910200157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8065aa0 0x7f8ea8155210 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 -- 172.21.15.27:0/910200157 >> 172.21.15.27:0/910200157 conn(0x7f8ea80c94a0 msgr2=0x7f8ea80c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 -- 172.21.15.27:0/910200157 shutdown_connections 2023-05-17T15:08:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.803+0000 7f8ead535700 1 -- 172.21.15.27:0/910200157 wait complete. 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 Processor -- start 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 -- start start 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea8065aa0 0x7f8ea80bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 0x7f8ea80aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea81540d0 0x7f8ea80c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81440d0 con 0x7f8ea8067ec0 2023-05-17T15:08:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80bffe0 con 0x7f8ea81540d0 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.805+0000 7f8ead535700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81434c0 con 0x7f8ea8065aa0 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 0x7f8ea80aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 0x7f8ea80aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39838/0 (socket says 172.21.15.27:39838) 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 -- 172.21.15.27:0/3022888258 learned_addr learned my addr 172.21.15.27:0/3022888258 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea6ffd700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea8065aa0 0x7f8ea80bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea77fe700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea81540d0 0x7f8ea80c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 -- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea8065aa0 msgr2=0x7f8ea80bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea8065aa0 0x7f8ea80bfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 -- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea81540d0 msgr2=0x7f8ea80c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea81540d0 0x7f8ea80c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 -- 172.21.15.27:0/3022888258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900092a0 con 0x7f8ea8067ec0 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea6ffd700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea8065aa0 0x7f8ea80bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea77fe700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea81540d0 0x7f8ea80c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ea67fc700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 0x7f8ea80aba00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f8ea8155890 tx=0x7f8e90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000ba60 con 0x7f8ea8067ec0 2023-05-17T15:08:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e90000c90 con 0x7f8ea8067ec0 2023-05-17T15:08:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea81437a0 con 0x7f8ea8067ec0 2023-05-17T15:08:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9001b670 con 0x7f8ea8067ec0 2023-05-17T15:08:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.806+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8143d60 con 0x7f8ea8067ec0 2023-05-17T15:08:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.807+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8144240 con 0x7f8ea8067ec0 2023-05-17T15:08:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.808+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8e9002a070 con 0x7f8ea8067ec0 2023-05-17T15:08:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.808+0000 7f8e9effd700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e8805ed90 0x7f8e88061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.808+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8e9007b8c0 con 0x7f8ea8067ec0 2023-05-17T15:08:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.808+0000 7f8ea6ffd700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e8805ed90 0x7f8e88061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:56.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.809+0000 7f8ea6ffd700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e8805ed90 0x7f8e88061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8ea0001e30 tx=0x7f8ea0009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:56.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:56.812+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e9004cd80 con 0x7f8ea8067ec0 2023-05-17T15:08:57.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.028+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ea8066370 con 0x7f8ea8067ec0 2023-05-17T15:08:57.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.029+0000 7f8e9effd700 1 -- 172.21.15.27:0/3022888258 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f8e90028090 con 0x7f8ea8067ec0 2023-05-17T15:08:57.033 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:57.034 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:54.627419+0000","modified":"2023-05-17T15:08:56.658238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6654":{"gid":6654,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2158310427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2158310427},{"type":"v1","addr":"172.21.15.27:6835","nonce":2158310427}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-17T15:08:57.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e8805ed90 msgr2=0x7f8e88061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e8805ed90 0x7f8e88061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8ea0001e30 tx=0x7f8ea0009040).stop 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 msgr2=0x7f8ea80aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 0x7f8ea80aba00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f8ea8155890 tx=0x7f8e90017000).stop 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 shutdown_connections 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e8805ed90 0x7f8e88061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea81540d0 0x7f8ea80c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea8065aa0 0x7f8ea80bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 --2- 172.21.15.27:0/3022888258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ea8067ec0 0x7f8ea80aba00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 >> 172.21.15.27:0/3022888258 conn(0x7f8ea80c94a0 msgr2=0x7f8ea814e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:57.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 shutdown_connections 2023-05-17T15:08:57.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.031+0000 7f8ead535700 1 -- 172.21.15.27:0/3022888258 wait complete. 2023-05-17T15:08:57.038 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2023-05-17T15:08:57.046 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:08:57.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.159+0000 7f8ab3c0e700 1 Processor -- start 2023-05-17T15:08:57.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.159+0000 7f8ab3c0e700 1 -- start start 2023-05-17T15:08:57.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab3c0e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 0x7f8aac0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab3c0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 0x7f8aac154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab3c0e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0c05f0 con 0x7f8aac0cb470 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab3c0e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac154570 con 0x7f8aac0c5ef0 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab3c0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0aa510 con 0x7f8aac153bf0 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab19aa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 0x7f8aac0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 0x7f8aac154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 0x7f8aac154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:40958/0 (socket says 172.21.15.27:40958) 2023-05-17T15:08:57.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab19aa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 0x7f8aac0c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:57774/0 (socket says 172.21.15.27:57774) 2023-05-17T15:08:57.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab11a9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8aac0cb470 0x7f8aac0a9d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:45408/0 (socket says 172.21.15.27:45408) 2023-05-17T15:08:57.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1059577853 learned_addr learned my addr 172.21.15.27:0/1059577853 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:57.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1059577853 >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 msgr2=0x7f8aac0c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:57.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 --2- 172.21.15.27:0/1059577853 >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 0x7f8aac0c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1059577853 >> v1:172.21.15.40:6789/0 conn(0x7f8aac0cb470 legacy=0x7f8aac0a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1059577853 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0bfcc0 con 0x7f8aac153bf0 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.160+0000 7f8ab19aa700 1 --2- 172.21.15.27:0/1059577853 >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 0x7f8aac0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab21ab700 1 --2- 172.21.15.27:0/1059577853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 0x7f8aac154080 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8a9c009f20 tx=0x7f8a9c009840).ready entity=mon.2 client_cookie=5812ad8284315029 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab09a8700 1 -- 172.21.15.27:0/1059577853 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00e070 con 0x7f8aac153bf0 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab09a8700 1 -- 172.21.15.27:0/1059577853 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00b8d0 con 0x7f8aac153bf0 2023-05-17T15:08:57.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab09a8700 1 -- 172.21.15.27:0/1059577853 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00bc50 con 0x7f8aac153bf0 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1059577853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 msgr2=0x7f8aac154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1059577853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 0x7f8aac154080 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8a9c009f20 tx=0x7f8a9c009840).stop 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1059577853 shutdown_connections 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1059577853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac153bf0 0x7f8aac154080 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1059577853 >> v2:172.21.15.40:3300/0 conn(0x7f8aac0c5ef0 0x7f8aac0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1059577853 >> 172.21.15.27:0/1059577853 conn(0x7f8aac05e810 msgr2=0x7f8aac0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1059577853 shutdown_connections 2023-05-17T15:08:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.161+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1059577853 wait complete. 2023-05-17T15:08:57.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.162+0000 7f8ab3c0e700 1 Processor -- start 2023-05-17T15:08:57.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.162+0000 7f8ab3c0e700 1 -- start start 2023-05-17T15:08:57.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab3c0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac0c5ef0 0x7f8aac158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab3c0e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0cb470 0x7f8aac14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab3c0e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 0x7f8aac0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab3c0e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac157dc0 con 0x7f8aac153bf0 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab3c0e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1681f0 con 0x7f8aac0cb470 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab3c0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac157770 con 0x7f8aac0c5ef0 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab21ab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 0x7f8aac0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab21ab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 0x7f8aac0c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39854/0 (socket says 172.21.15.27:39854) 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.163+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1064241165 learned_addr learned my addr 172.21.15.27:0/1064241165 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab11a9700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0cb470 0x7f8aac14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab19aa700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac0c5ef0 0x7f8aac158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac0c5ef0 msgr2=0x7f8aac158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab21ab700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac0c5ef0 0x7f8aac158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0cb470 msgr2=0x7f8aac14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab21ab700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0cb470 0x7f8aac14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab21ab700 1 -- 172.21.15.27:0/1064241165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40092a0 con 0x7f8aac153bf0 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab21ab700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 0x7f8aac0c9c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f8a9c00b610 tx=0x7f8a9c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0092e0 con 0x7f8aac153bf0 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00be40 con 0x7f8aac153bf0 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c009ae0 con 0x7f8aac153bf0 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c007860 con 0x7f8aac153bf0 2023-05-17T15:08:57.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.164+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac157420 con 0x7f8aac153bf0 2023-05-17T15:08:57.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.165+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac05f4a0 con 0x7f8aac153bf0 2023-05-17T15:08:57.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.166+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8a9c007c50 con 0x7f8aac153bf0 2023-05-17T15:08:57.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.166+0000 7f8aa9ffb700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a9805ed90 0x7f8a98061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.166+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8a9c07b980 con 0x7f8aac153bf0 2023-05-17T15:08:57.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.166+0000 7f8ab19aa700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a9805ed90 0x7f8a98061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.166+0000 7f8ab19aa700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a9805ed90 0x7f8a98061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8aa4009d00 tx=0x7f8aa4009060).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.170+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a9c04cf50 con 0x7f8aac153bf0 2023-05-17T15:08:57.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.342+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8aac06bdf0 con 0x7f8aac153bf0 2023-05-17T15:08:57.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.343+0000 7f8aa9ffb700 1 -- 172.21.15.27:0/1064241165 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17045 (secure 0 0 0) 0x7f8a9c050570 con 0x7f8aac153bf0 2023-05-17T15:08:57.347 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:57.348 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":97,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:08:55.628768+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:53.174505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:53.590665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:08:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a9805ed90 msgr2=0x7f8a98061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a9805ed90 0x7f8a98061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8aa4009d00 tx=0x7f8aa4009060).stop 2023-05-17T15:08:57.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 msgr2=0x7f8aac0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 0x7f8aac0c9c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f8a9c00b610 tx=0x7f8a9c009840).stop 2023-05-17T15:08:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 shutdown_connections 2023-05-17T15:08:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a9805ed90 0x7f8a98061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aac153bf0 0x7f8aac0c9c60 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8aac0c5ef0 0x7f8aac158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 --2- 172.21.15.27:0/1064241165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0cb470 0x7f8aac14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 >> 172.21.15.27:0/1064241165 conn(0x7f8aac05e810 msgr2=0x7f8aac14d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 shutdown_connections 2023-05-17T15:08:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.345+0000 7f8ab3c0e700 1 -- 172.21.15.27:0/1064241165 wait complete. 2023-05-17T15:08:57.361 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:08:57.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:57.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.473+0000 7fd557ea2700 1 Processor -- start 2023-05-17T15:08:57.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.474+0000 7fd557ea2700 1 -- start start 2023-05-17T15:08:57.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd557ea2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5501540d0 0x7fd55005dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd557ea2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd55005e240 0x7fd5500c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd557ea2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500bd6a0 con 0x7fd550153cf0 2023-05-17T15:08:57.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd557ea2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500c31b0 con 0x7fd5501540d0 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd557ea2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500c3490 con 0x7fd55005e240 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55543d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5501540d0 0x7fd55005dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd555c3e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd550153cf0 0x7fd550063d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39420/0 (socket says 172.21.15.27:39420) 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd555c3e700 1 -- 172.21.15.27:0/3765026015 learned_addr learned my addr 172.21.15.27:0/3765026015 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55643f700 1 --2- 172.21.15.27:0/3765026015 >> v2:172.21.15.40:3300/0 conn(0x7fd55005e240 0x7fd5500c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55543d700 1 -- 172.21.15.27:0/3765026015 >> v2:172.21.15.40:3300/0 conn(0x7fd55005e240 msgr2=0x7fd5500c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55543d700 1 --2- 172.21.15.27:0/3765026015 >> v2:172.21.15.40:3300/0 conn(0x7fd55005e240 0x7fd5500c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55543d700 1 -- 172.21.15.27:0/3765026015 >> v1:172.21.15.27:6789/0 conn(0x7fd550153cf0 legacy=0x7fd550063d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55543d700 1 -- 172.21.15.27:0/3765026015 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500c3770 con 0x7fd5501540d0 2023-05-17T15:08:57.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd55543d700 1 --2- 172.21.15.27:0/3765026015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5501540d0 0x7fd55005dd50 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fd5500658d0 tx=0x7fd544009060).ready entity=mon.0 client_cookie=eb5b6521cd2f23bc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd554c3c700 1 -- 172.21.15.27:0/3765026015 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400b580 con 0x7fd5501540d0 2023-05-17T15:08:57.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd554c3c700 1 -- 172.21.15.27:0/3765026015 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400b6e0 con 0x7fd5501540d0 2023-05-17T15:08:57.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.475+0000 7fd554c3c700 1 -- 172.21.15.27:0/3765026015 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400ba60 con 0x7fd5501540d0 2023-05-17T15:08:57.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 -- 172.21.15.27:0/3765026015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5501540d0 msgr2=0x7fd55005dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 --2- 172.21.15.27:0/3765026015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5501540d0 0x7fd55005dd50 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fd5500658d0 tx=0x7fd544009060).stop 2023-05-17T15:08:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 -- 172.21.15.27:0/3765026015 shutdown_connections 2023-05-17T15:08:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 --2- 172.21.15.27:0/3765026015 >> v2:172.21.15.40:3300/0 conn(0x7fd55005e240 0x7fd5500c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 --2- 172.21.15.27:0/3765026015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5501540d0 0x7fd55005dd50 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 -- 172.21.15.27:0/3765026015 >> 172.21.15.27:0/3765026015 conn(0x7fd5500c7920 msgr2=0x7fd5500c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 -- 172.21.15.27:0/3765026015 shutdown_connections 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.476+0000 7fd557ea2700 1 -- 172.21.15.27:0/3765026015 wait complete. 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.477+0000 7fd557ea2700 1 Processor -- start 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.477+0000 7fd557ea2700 1 -- start start 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 0x7fd5500a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd550153cf0 0x7fd550067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5501540d0 0x7fd5500681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500a59b0 con 0x7fd55005e240 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550068690 con 0x7fd5501540d0 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500ac3c0 con 0x7fd550153cf0 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 0x7fd5500a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 0x7fd5500a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39864/0 (socket says 172.21.15.27:39864) 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 -- 172.21.15.27:0/245534081 learned_addr learned my addr 172.21.15.27:0/245534081 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd55543d700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd550153cf0 0x7fd550067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd55643f700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5501540d0 0x7fd5500681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 -- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd550153cf0 msgr2=0x7fd550067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd550153cf0 0x7fd550067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 -- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5501540d0 msgr2=0x7fd5500681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5501540d0 0x7fd5500681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 -- 172.21.15.27:0/245534081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440092a0 con 0x7fd55005e240 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd55543d700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd550153cf0 0x7fd550067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd55643f700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5501540d0 0x7fd5500681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd555c3e700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 0x7fd5500a54c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fd548007fd0 tx=0x7fd548007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480072e0 con 0x7fd55005e240 2023-05-17T15:08:57.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548007440 con 0x7fd55005e240 2023-05-17T15:08:57.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480057a0 con 0x7fd55005e240 2023-05-17T15:08:57.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.478+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5500aa0d0 con 0x7fd55005e240 2023-05-17T15:08:57.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.479+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5500abd70 con 0x7fd55005e240 2023-05-17T15:08:57.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.480+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55006bdf0 con 0x7fd55005e240 2023-05-17T15:08:57.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.480+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd548010070 con 0x7fd55005e240 2023-05-17T15:08:57.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.480+0000 7fd54dffb700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd53c05ed60 0x7fd53c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.480+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fd548079200 con 0x7fd55005e240 2023-05-17T15:08:57.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.480+0000 7fd55543d700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd53c05ed60 0x7fd53c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.481+0000 7fd55543d700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd53c05ed60 0x7fd53c061220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd544009fd0 tx=0x7fd544017000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.484+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd54804a750 con 0x7fd55005e240 2023-05-17T15:08:57.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.652+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5500ac500 con 0x7fd53c05ed60 2023-05-17T15:08:57.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.665+0000 7fd54dffb700 1 -- 172.21.15.27:0/245534081 <== mgr.6462 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358332 (secure 0 0 0) 0x7fd54400b850 con 0x7fd53c05ed60 2023-05-17T15:08:57.672 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:57.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd53c05ed60 msgr2=0x7fd53c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd53c05ed60 0x7fd53c061220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd544009fd0 tx=0x7fd544017000).stop 2023-05-17T15:08:57.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 msgr2=0x7fd5500a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 0x7fd5500a54c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fd548007fd0 tx=0x7fd548007df0).stop 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 shutdown_connections 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd53c05ed60 0x7fd53c061220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5501540d0 0x7fd5500681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd55005e240 0x7fd5500a54c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 --2- 172.21.15.27:0/245534081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd550153cf0 0x7fd550067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 >> 172.21.15.27:0/245534081 conn(0x7fd5500c7920 msgr2=0x7fd5500c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:57.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 shutdown_connections 2023-05-17T15:08:57.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.668+0000 7fd557ea2700 1 -- 172.21.15.27:0/245534081 wait complete. 2023-05-17T15:08:57.676 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:57.684 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:57.475488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":142784,"kb_used_data":8960,"kb_used_omap":0,"kb_used_meta":133760,"kb_avail":754831936,"statfs":{"total":773094113280,"available":772947902464,"internally_reserved":0,"allocated":9175040,"data_stored":4579296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136970240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-60,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.171693"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248385+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270583+0000","last_change":"2023-05-17T15:08:54.270583+0000","last_active":"2023-05-17T15:08:54.270583+0000","last_peered":"2023-05-17T15:08:54.270583+0000","last_clean":"2023-05-17T15:08:54.270583+0000","last_became_active":"2023-05-17T15:08:54.270277+0000","last_became_peered":"2023-05-17T15:08:54.270277+0000","last_unstale":"2023-05-17T15:08:54.270583+0000","last_undegraded":"2023-05-17T15:08:54.270583+0000","last_fullsized":"2023-05-17T15:08:54.270583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250618+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258220+0000","last_change":"2023-05-17T15:08:54.258220+0000","last_active":"2023-05-17T15:08:54.258220+0000","last_peered":"2023-05-17T15:08:54.258220+0000","last_clean":"2023-05-17T15:08:54.258220+0000","last_became_active":"2023-05-17T15:08:54.257897+0000","last_became_peered":"2023-05-17T15:08:54.257897+0000","last_unstale":"2023-05-17T15:08:54.258220+0000","last_undegraded":"2023-05-17T15:08:54.258220+0000","last_fullsized":"2023-05-17T15:08:54.258220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247310+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.250930+0000","last_change":"2023-05-17T15:08:54.250930+0000","last_active":"2023-05-17T15:08:54.250930+0000","last_peered":"2023-05-17T15:08:54.250930+0000","last_clean":"2023-05-17T15:08:54.250930+0000","last_became_active":"2023-05-17T15:08:54.250648+0000","last_became_peered":"2023-05-17T15:08:54.250648+0000","last_unstale":"2023-05-17T15:08:54.250930+0000","last_undegraded":"2023-05-17T15:08:54.250930+0000","last_fullsized":"2023-05-17T15:08:54.250930+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248373+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260661+0000","last_change":"2023-05-17T15:08:54.260661+0000","last_active":"2023-05-17T15:08:54.260661+0000","last_peered":"2023-05-17T15:08:54.260661+0000","last_clean":"2023-05-17T15:08:54.260661+0000","last_became_active":"2023-05-17T15:08:54.260378+0000","last_became_peered":"2023-05-17T15:08:54.260378+0000","last_unstale":"2023-05-17T15:08:54.260661+0000","last_undegraded":"2023-05-17T15:08:54.260661+0000","last_fullsized":"2023-05-17T15:08:54.260661+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249972+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263402+0000","last_change":"2023-05-17T15:08:54.263402+0000","last_active":"2023-05-17T15:08:54.263402+0000","last_peered":"2023-05-17T15:08:54.263402+0000","last_clean":"2023-05-17T15:08:54.263402+0000","last_became_active":"2023-05-17T15:08:54.263067+0000","last_became_peered":"2023-05-17T15:08:54.263067+0000","last_unstale":"2023-05-17T15:08:54.263402+0000","last_undegraded":"2023-05-17T15:08:54.263402+0000","last_fullsized":"2023-05-17T15:08:54.263402+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247630+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258314+0000","last_change":"2023-05-17T15:08:54.258314+0000","last_active":"2023-05-17T15:08:54.258314+0000","last_peered":"2023-05-17T15:08:54.258314+0000","last_clean":"2023-05-17T15:08:54.258314+0000","last_became_active":"2023-05-17T15:08:54.258080+0000","last_became_peered":"2023-05-17T15:08:54.258080+0000","last_unstale":"2023-05-17T15:08:54.258314+0000","last_undegraded":"2023-05-17T15:08:54.258314+0000","last_fullsized":"2023-05-17T15:08:54.258314+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244045+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259205+0000","last_change":"2023-05-17T15:08:54.259205+0000","last_active":"2023-05-17T15:08:54.259205+0000","last_peered":"2023-05-17T15:08:54.259205+0000","last_clean":"2023-05-17T15:08:54.259205+0000","last_became_active":"2023-05-17T15:08:54.258893+0000","last_became_peered":"2023-05-17T15:08:54.258893+0000","last_unstale":"2023-05-17T15:08:54.259205+0000","last_undegraded":"2023-05-17T15:08:54.259205+0000","last_fullsized":"2023-05-17T15:08:54.259205+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255408+0000","last_change":"2023-05-17T15:08:54.255408+0000","last_active":"2023-05-17T15:08:54.255408+0000","last_peered":"2023-05-17T15:08:54.255408+0000","last_clean":"2023-05-17T15:08:54.255408+0000","last_became_active":"2023-05-17T15:08:54.255099+0000","last_became_peered":"2023-05-17T15:08:54.255099+0000","last_unstale":"2023-05-17T15:08:54.255408+0000","last_undegraded":"2023-05-17T15:08:54.255408+0000","last_fullsized":"2023-05-17T15:08:54.255408+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253822+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260817+0000","last_change":"2023-05-17T15:08:54.260817+0000","last_active":"2023-05-17T15:08:54.260817+0000","last_peered":"2023-05-17T15:08:54.260817+0000","last_clean":"2023-05-17T15:08:54.260817+0000","last_became_active":"2023-05-17T15:08:54.260540+0000","last_became_peered":"2023-05-17T15:08:54.260540+0000","last_unstale":"2023-05-17T15:08:54.260817+0000","last_undegraded":"2023-05-17T15:08:54.260817+0000","last_fullsized":"2023-05-17T15:08:54.260817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243736+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259817+0000","last_change":"2023-05-17T15:08:54.259817+0000","last_active":"2023-05-17T15:08:54.259817+0000","last_peered":"2023-05-17T15:08:54.259817+0000","last_clean":"2023-05-17T15:08:54.259817+0000","last_became_active":"2023-05-17T15:08:54.258343+0000","last_became_peered":"2023-05-17T15:08:54.258343+0000","last_unstale":"2023-05-17T15:08:54.259817+0000","last_undegraded":"2023-05-17T15:08:54.259817+0000","last_fullsized":"2023-05-17T15:08:54.259817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245283+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268125+0000","last_change":"2023-05-17T15:08:54.268125+0000","last_active":"2023-05-17T15:08:54.268125+0000","last_peered":"2023-05-17T15:08:54.268125+0000","last_clean":"2023-05-17T15:08:54.268125+0000","last_became_active":"2023-05-17T15:08:54.265254+0000","last_became_peered":"2023-05-17T15:08:54.265254+0000","last_unstale":"2023-05-17T15:08:54.268125+0000","last_undegraded":"2023-05-17T15:08:54.268125+0000","last_fullsized":"2023-05-17T15:08:54.268125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248768+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267294+0000","last_change":"2023-05-17T15:08:54.267294+0000","last_active":"2023-05-17T15:08:54.267294+0000","last_peered":"2023-05-17T15:08:54.267294+0000","last_clean":"2023-05-17T15:08:54.267294+0000","last_became_active":"2023-05-17T15:08:54.266970+0000","last_became_peered":"2023-05-17T15:08:54.266970+0000","last_unstale":"2023-05-17T15:08:54.267294+0000","last_undegraded":"2023-05-17T15:08:54.267294+0000","last_fullsized":"2023-05-17T15:08:54.267294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249466+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.252483+0000","last_change":"2023-05-17T15:08:54.252483+0000","last_active":"2023-05-17T15:08:54.252483+0000","last_peered":"2023-05-17T15:08:54.252483+0000","last_clean":"2023-05-17T15:08:54.252483+0000","last_became_active":"2023-05-17T15:08:54.252178+0000","last_became_peered":"2023-05-17T15:08:54.252178+0000","last_unstale":"2023-05-17T15:08:54.252483+0000","last_undegraded":"2023-05-17T15:08:54.252483+0000","last_fullsized":"2023-05-17T15:08:54.252483+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244419+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267320+0000","last_change":"2023-05-17T15:08:54.267320+0000","last_active":"2023-05-17T15:08:54.267320+0000","last_peered":"2023-05-17T15:08:54.267320+0000","last_clean":"2023-05-17T15:08:54.267320+0000","last_became_active":"2023-05-17T15:08:54.267043+0000","last_became_peered":"2023-05-17T15:08:54.267043+0000","last_unstale":"2023-05-17T15:08:54.267320+0000","last_undegraded":"2023-05-17T15:08:54.267320+0000","last_fullsized":"2023-05-17T15:08:54.267320+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251840+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259020+0000","last_change":"2023-05-17T15:08:54.259020+0000","last_active":"2023-05-17T15:08:54.259020+0000","last_peered":"2023-05-17T15:08:54.259020+0000","last_clean":"2023-05-17T15:08:54.259020+0000","last_became_active":"2023-05-17T15:08:54.258736+0000","last_became_peered":"2023-05-17T15:08:54.258736+0000","last_unstale":"2023-05-17T15:08:54.259020+0000","last_undegraded":"2023-05-17T15:08:54.259020+0000","last_fullsized":"2023-05-17T15:08:54.259020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246074+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264896+0000","last_change":"2023-05-17T15:08:54.264896+0000","last_active":"2023-05-17T15:08:54.264896+0000","last_peered":"2023-05-17T15:08:54.264896+0000","last_clean":"2023-05-17T15:08:54.264896+0000","last_became_active":"2023-05-17T15:08:54.264559+0000","last_became_peered":"2023-05-17T15:08:54.264559+0000","last_unstale":"2023-05-17T15:08:54.264896+0000","last_undegraded":"2023-05-17T15:08:54.264896+0000","last_fullsized":"2023-05-17T15:08:54.264896+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244378+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260860+0000","last_change":"2023-05-17T15:08:54.260860+0000","last_active":"2023-05-17T15:08:54.260860+0000","last_peered":"2023-05-17T15:08:54.260860+0000","last_clean":"2023-05-17T15:08:54.260860+0000","last_became_active":"2023-05-17T15:08:54.260308+0000","last_became_peered":"2023-05-17T15:08:54.260308+0000","last_unstale":"2023-05-17T15:08:54.260860+0000","last_undegraded":"2023-05-17T15:08:54.260860+0000","last_fullsized":"2023-05-17T15:08:54.260860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245789+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260850+0000","last_change":"2023-05-17T15:08:54.260850+0000","last_active":"2023-05-17T15:08:54.260850+0000","last_peered":"2023-05-17T15:08:54.260850+0000","last_clean":"2023-05-17T15:08:54.260850+0000","last_became_active":"2023-05-17T15:08:54.260631+0000","last_became_peered":"2023-05-17T15:08:54.260631+0000","last_unstale":"2023-05-17T15:08:54.260850+0000","last_undegraded":"2023-05-17T15:08:54.260850+0000","last_fullsized":"2023-05-17T15:08:54.260850+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255488+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253863+0000","last_change":"2023-05-17T15:08:54.253863+0000","last_active":"2023-05-17T15:08:54.253863+0000","last_peered":"2023-05-17T15:08:54.253863+0000","last_clean":"2023-05-17T15:08:54.253863+0000","last_became_active":"2023-05-17T15:08:54.253355+0000","last_became_peered":"2023-05-17T15:08:54.253355+0000","last_unstale":"2023-05-17T15:08:54.253863+0000","last_undegraded":"2023-05-17T15:08:54.253863+0000","last_fullsized":"2023-05-17T15:08:54.253863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247517+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.256858+0000","last_change":"2023-05-17T15:08:54.256858+0000","last_active":"2023-05-17T15:08:54.256858+0000","last_peered":"2023-05-17T15:08:54.256858+0000","last_clean":"2023-05-17T15:08:54.256858+0000","last_became_active":"2023-05-17T15:08:54.256602+0000","last_became_peered":"2023-05-17T15:08:54.256602+0000","last_unstale":"2023-05-17T15:08:54.256858+0000","last_undegraded":"2023-05-17T15:08:54.256858+0000","last_fullsized":"2023-05-17T15:08:54.256858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.254981+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251958+0000","last_change":"2023-05-17T15:08:54.251958+0000","last_active":"2023-05-17T15:08:54.251958+0000","last_peered":"2023-05-17T15:08:54.251958+0000","last_clean":"2023-05-17T15:08:54.251958+0000","last_became_active":"2023-05-17T15:08:54.251695+0000","last_became_peered":"2023-05-17T15:08:54.251695+0000","last_unstale":"2023-05-17T15:08:54.251958+0000","last_undegraded":"2023-05-17T15:08:54.251958+0000","last_fullsized":"2023-05-17T15:08:54.251958+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245000+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268177+0000","last_change":"2023-05-17T15:08:54.268177+0000","last_active":"2023-05-17T15:08:54.268177+0000","last_peered":"2023-05-17T15:08:54.268177+0000","last_clean":"2023-05-17T15:08:54.268177+0000","last_became_active":"2023-05-17T15:08:54.267884+0000","last_became_peered":"2023-05-17T15:08:54.267884+0000","last_unstale":"2023-05-17T15:08:54.268177+0000","last_undegraded":"2023-05-17T15:08:54.268177+0000","last_fullsized":"2023-05-17T15:08:54.268177+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247815+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268435+0000","last_change":"2023-05-17T15:08:54.268435+0000","last_active":"2023-05-17T15:08:54.268435+0000","last_peered":"2023-05-17T15:08:54.268435+0000","last_clean":"2023-05-17T15:08:54.268435+0000","last_became_active":"2023-05-17T15:08:54.267475+0000","last_became_peered":"2023-05-17T15:08:54.267475+0000","last_unstale":"2023-05-17T15:08:54.268435+0000","last_undegraded":"2023-05-17T15:08:54.268435+0000","last_fullsized":"2023-05-17T15:08:54.268435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.252484+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265806+0000","last_change":"2023-05-17T15:08:54.265806+0000","last_active":"2023-05-17T15:08:54.265806+0000","last_peered":"2023-05-17T15:08:54.265806+0000","last_clean":"2023-05-17T15:08:54.265806+0000","last_became_active":"2023-05-17T15:08:54.265547+0000","last_became_peered":"2023-05-17T15:08:54.265547+0000","last_unstale":"2023-05-17T15:08:54.265806+0000","last_undegraded":"2023-05-17T15:08:54.265806+0000","last_fullsized":"2023-05-17T15:08:54.265806+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253316+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261359+0000","last_change":"2023-05-17T15:08:54.261359+0000","last_active":"2023-05-17T15:08:54.261359+0000","last_peered":"2023-05-17T15:08:54.261359+0000","last_clean":"2023-05-17T15:08:54.261359+0000","last_became_active":"2023-05-17T15:08:54.261079+0000","last_became_peered":"2023-05-17T15:08:54.261079+0000","last_unstale":"2023-05-17T15:08:54.261359+0000","last_undegraded":"2023-05-17T15:08:54.261359+0000","last_fullsized":"2023-05-17T15:08:54.261359+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246828+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262457+0000","last_change":"2023-05-17T15:08:54.262457+0000","last_active":"2023-05-17T15:08:54.262457+0000","last_peered":"2023-05-17T15:08:54.262457+0000","last_clean":"2023-05-17T15:08:54.262457+0000","last_became_active":"2023-05-17T15:08:54.262186+0000","last_became_peered":"2023-05-17T15:08:54.262186+0000","last_unstale":"2023-05-17T15:08:54.262457+0000","last_undegraded":"2023-05-17T15:08:54.262457+0000","last_fullsized":"2023-05-17T15:08:54.262457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255794+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262152+0000","last_change":"2023-05-17T15:08:54.262152+0000","last_active":"2023-05-17T15:08:54.262152+0000","last_peered":"2023-05-17T15:08:54.262152+0000","last_clean":"2023-05-17T15:08:54.262152+0000","last_became_active":"2023-05-17T15:08:54.261899+0000","last_became_peered":"2023-05-17T15:08:54.261899+0000","last_unstale":"2023-05-17T15:08:54.262152+0000","last_undegraded":"2023-05-17T15:08:54.262152+0000","last_fullsized":"2023-05-17T15:08:54.262152+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243863+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268108+0000","last_change":"2023-05-17T15:08:54.268108+0000","last_active":"2023-05-17T15:08:54.268108+0000","last_peered":"2023-05-17T15:08:54.268108+0000","last_clean":"2023-05-17T15:08:54.268108+0000","last_became_active":"2023-05-17T15:08:54.267836+0000","last_became_peered":"2023-05-17T15:08:54.267836+0000","last_unstale":"2023-05-17T15:08:54.268108+0000","last_undegraded":"2023-05-17T15:08:54.268108+0000","last_fullsized":"2023-05-17T15:08:54.268108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253565+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.249785+0000","last_change":"2023-05-17T15:08:54.249785+0000","last_active":"2023-05-17T15:08:54.249785+0000","last_peered":"2023-05-17T15:08:54.249785+0000","last_clean":"2023-05-17T15:08:54.249785+0000","last_became_active":"2023-05-17T15:08:54.249456+0000","last_became_peered":"2023-05-17T15:08:54.249456+0000","last_unstale":"2023-05-17T15:08:54.249785+0000","last_undegraded":"2023-05-17T15:08:54.249785+0000","last_fullsized":"2023-05-17T15:08:54.249785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.256174+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261281+0000","last_change":"2023-05-17T15:08:54.261281+0000","last_active":"2023-05-17T15:08:54.261281+0000","last_peered":"2023-05-17T15:08:54.261281+0000","last_clean":"2023-05-17T15:08:54.261281+0000","last_became_active":"2023-05-17T15:08:54.260987+0000","last_became_peered":"2023-05-17T15:08:54.260987+0000","last_unstale":"2023-05-17T15:08:54.261281+0000","last_undegraded":"2023-05-17T15:08:54.261281+0000","last_fullsized":"2023-05-17T15:08:54.261281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248102+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258001+0000","last_change":"2023-05-17T15:08:54.258001+0000","last_active":"2023-05-17T15:08:54.258001+0000","last_peered":"2023-05-17T15:08:54.258001+0000","last_clean":"2023-05-17T15:08:54.258001+0000","last_became_active":"2023-05-17T15:08:54.257718+0000","last_became_peered":"2023-05-17T15:08:54.257718+0000","last_unstale":"2023-05-17T15:08:54.258001+0000","last_undegraded":"2023-05-17T15:08:54.258001+0000","last_fullsized":"2023-05-17T15:08:54.258001+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243114+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262074+0000","last_change":"2023-05-17T15:08:54.262074+0000","last_active":"2023-05-17T15:08:54.262074+0000","last_peered":"2023-05-17T15:08:54.262074+0000","last_clean":"2023-05-17T15:08:54.262074+0000","last_became_active":"2023-05-17T15:08:54.261719+0000","last_became_peered":"2023-05-17T15:08:54.261719+0000","last_unstale":"2023-05-17T15:08:54.262074+0000","last_undegraded":"2023-05-17T15:08:54.262074+0000","last_fullsized":"2023-05-17T15:08:54.262074+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245839+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260568+0000","last_change":"2023-05-17T15:08:54.260568+0000","last_active":"2023-05-17T15:08:54.260568+0000","last_peered":"2023-05-17T15:08:54.260568+0000","last_clean":"2023-05-17T15:08:54.260568+0000","last_became_active":"2023-05-17T15:08:54.260238+0000","last_became_peered":"2023-05-17T15:08:54.260238+0000","last_unstale":"2023-05-17T15:08:54.260568+0000","last_undegraded":"2023-05-17T15:08:54.260568+0000","last_fullsized":"2023-05-17T15:08:54.260568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242493+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267741+0000","last_change":"2023-05-17T15:08:54.267741+0000","last_active":"2023-05-17T15:08:54.267741+0000","last_peered":"2023-05-17T15:08:54.267741+0000","last_clean":"2023-05-17T15:08:54.267741+0000","last_became_active":"2023-05-17T15:08:54.267400+0000","last_became_peered":"2023-05-17T15:08:54.267400+0000","last_unstale":"2023-05-17T15:08:54.267741+0000","last_undegraded":"2023-05-17T15:08:54.267741+0000","last_fullsized":"2023-05-17T15:08:54.267741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245350+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267917+0000","last_change":"2023-05-17T15:08:54.267917+0000","last_active":"2023-05-17T15:08:54.267917+0000","last_peered":"2023-05-17T15:08:54.267917+0000","last_clean":"2023-05-17T15:08:54.267917+0000","last_became_active":"2023-05-17T15:08:54.265748+0000","last_became_peered":"2023-05-17T15:08:54.265748+0000","last_unstale":"2023-05-17T15:08:54.267917+0000","last_undegraded":"2023-05-17T15:08:54.267917+0000","last_fullsized":"2023-05-17T15:08:54.267917+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244522+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262729+0000","last_change":"2023-05-17T15:08:54.262729+0000","last_active":"2023-05-17T15:08:54.262729+0000","last_peered":"2023-05-17T15:08:54.262729+0000","last_clean":"2023-05-17T15:08:54.262729+0000","last_became_active":"2023-05-17T15:08:54.261926+0000","last_became_peered":"2023-05-17T15:08:54.261926+0000","last_unstale":"2023-05-17T15:08:54.262729+0000","last_undegraded":"2023-05-17T15:08:54.262729+0000","last_fullsized":"2023-05-17T15:08:54.262729+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242752+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263505+0000","last_change":"2023-05-17T15:08:54.263505+0000","last_active":"2023-05-17T15:08:54.263505+0000","last_peered":"2023-05-17T15:08:54.263505+0000","last_clean":"2023-05-17T15:08:54.263505+0000","last_became_active":"2023-05-17T15:08:54.263203+0000","last_became_peered":"2023-05-17T15:08:54.263203+0000","last_unstale":"2023-05-17T15:08:54.263505+0000","last_undegraded":"2023-05-17T15:08:54.263505+0000","last_fullsized":"2023-05-17T15:08:54.263505+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242759+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254900+0000","last_change":"2023-05-17T15:08:54.254900+0000","last_active":"2023-05-17T15:08:54.254900+0000","last_peered":"2023-05-17T15:08:54.254900+0000","last_clean":"2023-05-17T15:08:54.254900+0000","last_became_active":"2023-05-17T15:08:54.254602+0000","last_became_peered":"2023-05-17T15:08:54.254602+0000","last_unstale":"2023-05-17T15:08:54.254900+0000","last_undegraded":"2023-05-17T15:08:54.254900+0000","last_fullsized":"2023-05-17T15:08:54.254900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245894+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262186+0000","last_change":"2023-05-17T15:08:54.262186+0000","last_active":"2023-05-17T15:08:54.262186+0000","last_peered":"2023-05-17T15:08:54.262186+0000","last_clean":"2023-05-17T15:08:54.262186+0000","last_became_active":"2023-05-17T15:08:54.261879+0000","last_became_peered":"2023-05-17T15:08:54.261879+0000","last_unstale":"2023-05-17T15:08:54.262186+0000","last_undegraded":"2023-05-17T15:08:54.262186+0000","last_fullsized":"2023-05-17T15:08:54.262186+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251525+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257705+0000","last_change":"2023-05-17T15:08:54.257705+0000","last_active":"2023-05-17T15:08:54.257705+0000","last_peered":"2023-05-17T15:08:54.257705+0000","last_clean":"2023-05-17T15:08:54.257705+0000","last_became_active":"2023-05-17T15:08:54.257412+0000","last_became_peered":"2023-05-17T15:08:54.257412+0000","last_unstale":"2023-05-17T15:08:54.257705+0000","last_undegraded":"2023-05-17T15:08:54.257705+0000","last_fullsized":"2023-05-17T15:08:54.257705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242189+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268207+0000","last_change":"2023-05-17T15:08:54.268207+0000","last_active":"2023-05-17T15:08:54.268207+0000","last_peered":"2023-05-17T15:08:54.268207+0000","last_clean":"2023-05-17T15:08:54.268207+0000","last_became_active":"2023-05-17T15:08:54.267927+0000","last_became_peered":"2023-05-17T15:08:54.267927+0000","last_unstale":"2023-05-17T15:08:54.268207+0000","last_undegraded":"2023-05-17T15:08:54.268207+0000","last_fullsized":"2023-05-17T15:08:54.268207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245116+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263854+0000","last_change":"2023-05-17T15:08:54.263854+0000","last_active":"2023-05-17T15:08:54.263854+0000","last_peered":"2023-05-17T15:08:54.263854+0000","last_clean":"2023-05-17T15:08:54.263854+0000","last_became_active":"2023-05-17T15:08:54.263569+0000","last_became_peered":"2023-05-17T15:08:54.263569+0000","last_unstale":"2023-05-17T15:08:54.263854+0000","last_undegraded":"2023-05-17T15:08:54.263854+0000","last_fullsized":"2023-05-17T15:08:54.263854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258048+0000","last_change":"2023-05-17T15:08:54.258048+0000","last_active":"2023-05-17T15:08:54.258048+0000","last_peered":"2023-05-17T15:08:54.258048+0000","last_clean":"2023-05-17T15:08:54.258048+0000","last_became_active":"2023-05-17T15:08:54.257755+0000","last_became_peered":"2023-05-17T15:08:54.257755+0000","last_unstale":"2023-05-17T15:08:54.258048+0000","last_undegraded":"2023-05-17T15:08:54.258048+0000","last_fullsized":"2023-05-17T15:08:54.258048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244846+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258271+0000","last_change":"2023-05-17T15:08:54.258271+0000","last_active":"2023-05-17T15:08:54.258271+0000","last_peered":"2023-05-17T15:08:54.258271+0000","last_clean":"2023-05-17T15:08:54.258271+0000","last_became_active":"2023-05-17T15:08:54.257940+0000","last_became_peered":"2023-05-17T15:08:54.257940+0000","last_unstale":"2023-05-17T15:08:54.258271+0000","last_undegraded":"2023-05-17T15:08:54.258271+0000","last_fullsized":"2023-05-17T15:08:54.258271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249042+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255246+0000","last_change":"2023-05-17T15:08:54.255246+0000","last_active":"2023-05-17T15:08:54.255246+0000","last_peered":"2023-05-17T15:08:54.255246+0000","last_clean":"2023-05-17T15:08:54.255246+0000","last_became_active":"2023-05-17T15:08:54.254774+0000","last_became_peered":"2023-05-17T15:08:54.254774+0000","last_unstale":"2023-05-17T15:08:54.255246+0000","last_undegraded":"2023-05-17T15:08:54.255246+0000","last_fullsized":"2023-05-17T15:08:54.255246+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250241+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270579+0000","last_change":"2023-05-17T15:08:54.270579+0000","last_active":"2023-05-17T15:08:54.270579+0000","last_peered":"2023-05-17T15:08:54.270579+0000","last_clean":"2023-05-17T15:08:54.270579+0000","last_became_active":"2023-05-17T15:08:54.270231+0000","last_became_peered":"2023-05-17T15:08:54.270231+0000","last_unstale":"2023-05-17T15:08:54.270579+0000","last_undegraded":"2023-05-17T15:08:54.270579+0000","last_fullsized":"2023-05-17T15:08:54.270579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250993+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262544+0000","last_change":"2023-05-17T15:08:54.262544+0000","last_active":"2023-05-17T15:08:54.262544+0000","last_peered":"2023-05-17T15:08:54.262544+0000","last_clean":"2023-05-17T15:08:54.262544+0000","last_became_active":"2023-05-17T15:08:54.259695+0000","last_became_peered":"2023-05-17T15:08:54.259695+0000","last_unstale":"2023-05-17T15:08:54.262544+0000","last_undegraded":"2023-05-17T15:08:54.262544+0000","last_fullsized":"2023-05-17T15:08:54.262544+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251077+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251360+0000","last_change":"2023-05-17T15:08:54.251360+0000","last_active":"2023-05-17T15:08:54.251360+0000","last_peered":"2023-05-17T15:08:54.251360+0000","last_clean":"2023-05-17T15:08:54.251360+0000","last_became_active":"2023-05-17T15:08:54.251150+0000","last_became_peered":"2023-05-17T15:08:54.251150+0000","last_unstale":"2023-05-17T15:08:54.251360+0000","last_undegraded":"2023-05-17T15:08:54.251360+0000","last_fullsized":"2023-05-17T15:08:54.251360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243895+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260659+0000","last_change":"2023-05-17T15:08:54.260659+0000","last_active":"2023-05-17T15:08:54.260659+0000","last_peered":"2023-05-17T15:08:54.260659+0000","last_clean":"2023-05-17T15:08:54.260659+0000","last_became_active":"2023-05-17T15:08:54.260371+0000","last_became_peered":"2023-05-17T15:08:54.260371+0000","last_unstale":"2023-05-17T15:08:54.260659+0000","last_undegraded":"2023-05-17T15:08:54.260659+0000","last_fullsized":"2023-05-17T15:08:54.260659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247377+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257883+0000","last_change":"2023-05-17T15:08:54.257883+0000","last_active":"2023-05-17T15:08:54.257883+0000","last_peered":"2023-05-17T15:08:54.257883+0000","last_clean":"2023-05-17T15:08:54.257883+0000","last_became_active":"2023-05-17T15:08:54.257585+0000","last_became_peered":"2023-05-17T15:08:54.257585+0000","last_unstale":"2023-05-17T15:08:54.257883+0000","last_undegraded":"2023-05-17T15:08:54.257883+0000","last_fullsized":"2023-05-17T15:08:54.257883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244773+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268672+0000","last_change":"2023-05-17T15:08:54.268672+0000","last_active":"2023-05-17T15:08:54.268672+0000","last_peered":"2023-05-17T15:08:54.268672+0000","last_clean":"2023-05-17T15:08:54.268672+0000","last_became_active":"2023-05-17T15:08:54.268408+0000","last_became_peered":"2023-05-17T15:08:54.268408+0000","last_unstale":"2023-05-17T15:08:54.268672+0000","last_undegraded":"2023-05-17T15:08:54.268672+0000","last_fullsized":"2023-05-17T15:08:54.268672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242131+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267658+0000","last_change":"2023-05-17T15:08:54.267658+0000","last_active":"2023-05-17T15:08:54.267658+0000","last_peered":"2023-05-17T15:08:54.267658+0000","last_clean":"2023-05-17T15:08:54.267658+0000","last_became_active":"2023-05-17T15:08:54.267287+0000","last_became_peered":"2023-05-17T15:08:54.267287+0000","last_unstale":"2023-05-17T15:08:54.267658+0000","last_undegraded":"2023-05-17T15:08:54.267658+0000","last_fullsized":"2023-05-17T15:08:54.267658+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247963+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264262+0000","last_change":"2023-05-17T15:08:54.264262+0000","last_active":"2023-05-17T15:08:54.264262+0000","last_peered":"2023-05-17T15:08:54.264262+0000","last_clean":"2023-05-17T15:08:54.264262+0000","last_became_active":"2023-05-17T15:08:54.263935+0000","last_became_peered":"2023-05-17T15:08:54.263935+0000","last_unstale":"2023-05-17T15:08:54.264262+0000","last_undegraded":"2023-05-17T15:08:54.264262+0000","last_fullsized":"2023-05-17T15:08:54.264262+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247947+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260215+0000","last_change":"2023-05-17T15:08:54.260215+0000","last_active":"2023-05-17T15:08:54.260215+0000","last_peered":"2023-05-17T15:08:54.260215+0000","last_clean":"2023-05-17T15:08:54.260215+0000","last_became_active":"2023-05-17T15:08:54.259732+0000","last_became_peered":"2023-05-17T15:08:54.259732+0000","last_unstale":"2023-05-17T15:08:54.260215+0000","last_undegraded":"2023-05-17T15:08:54.260215+0000","last_fullsized":"2023-05-17T15:08:54.260215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245968+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253796+0000","last_change":"2023-05-17T15:08:54.253796+0000","last_active":"2023-05-17T15:08:54.253796+0000","last_peered":"2023-05-17T15:08:54.253796+0000","last_clean":"2023-05-17T15:08:54.253796+0000","last_became_active":"2023-05-17T15:08:54.253479+0000","last_became_peered":"2023-05-17T15:08:54.253479+0000","last_unstale":"2023-05-17T15:08:54.253796+0000","last_undegraded":"2023-05-17T15:08:54.253796+0000","last_fullsized":"2023-05-17T15:08:54.253796+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245080+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258128+0000","last_change":"2023-05-17T15:08:54.258128+0000","last_active":"2023-05-17T15:08:54.258128+0000","last_peered":"2023-05-17T15:08:54.258128+0000","last_clean":"2023-05-17T15:08:54.258128+0000","last_became_active":"2023-05-17T15:08:54.256391+0000","last_became_peered":"2023-05-17T15:08:54.256391+0000","last_unstale":"2023-05-17T15:08:54.258128+0000","last_undegraded":"2023-05-17T15:08:54.258128+0000","last_fullsized":"2023-05-17T15:08:54.258128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255076+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257141+0000","last_change":"2023-05-17T15:08:54.257141+0000","last_active":"2023-05-17T15:08:54.257141+0000","last_peered":"2023-05-17T15:08:54.257141+0000","last_clean":"2023-05-17T15:08:54.257141+0000","last_became_active":"2023-05-17T15:08:54.256827+0000","last_became_peered":"2023-05-17T15:08:54.256827+0000","last_unstale":"2023-05-17T15:08:54.257141+0000","last_undegraded":"2023-05-17T15:08:54.257141+0000","last_fullsized":"2023-05-17T15:08:54.257141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237981+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:53.237981+0000","last_peered":"2023-05-17T15:08:53.237981+0000","last_clean":"2023-05-17T15:08:53.237981+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:53.237981+0000","last_undegraded":"2023-05-17T15:08:53.237981+0000","last_fullsized":"2023-05-17T15:08:53.237981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242148+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254126+0000","last_change":"2023-05-17T15:08:54.254126+0000","last_active":"2023-05-17T15:08:54.254126+0000","last_peered":"2023-05-17T15:08:54.254126+0000","last_clean":"2023-05-17T15:08:54.254126+0000","last_became_active":"2023-05-17T15:08:54.253832+0000","last_became_peered":"2023-05-17T15:08:54.253832+0000","last_unstale":"2023-05-17T15:08:54.254126+0000","last_undegraded":"2023-05-17T15:08:54.254126+0000","last_fullsized":"2023-05-17T15:08:54.254126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.235330+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:53.235330+0000","last_peered":"2023-05-17T15:08:53.235330+0000","last_clean":"2023-05-17T15:08:53.235330+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:53.235330+0000","last_undegraded":"2023-05-17T15:08:53.235330+0000","last_fullsized":"2023-05-17T15:08:53.235330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248218+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265101+0000","last_change":"2023-05-17T15:08:54.265101+0000","last_active":"2023-05-17T15:08:54.265101+0000","last_peered":"2023-05-17T15:08:54.265101+0000","last_clean":"2023-05-17T15:08:54.265101+0000","last_became_active":"2023-05-17T15:08:54.264786+0000","last_became_peered":"2023-05-17T15:08:54.264786+0000","last_unstale":"2023-05-17T15:08:54.265101+0000","last_undegraded":"2023-05-17T15:08:54.265101+0000","last_fullsized":"2023-05-17T15:08:54.265101+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237453+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:53.237453+0000","last_peered":"2023-05-17T15:08:53.237453+0000","last_clean":"2023-05-17T15:08:53.237453+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:53.237453+0000","last_undegraded":"2023-05-17T15:08:53.237453+0000","last_fullsized":"2023-05-17T15:08:53.237453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255645+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264062+0000","last_change":"2023-05-17T15:08:54.264062+0000","last_active":"2023-05-17T15:08:54.264062+0000","last_peered":"2023-05-17T15:08:54.264062+0000","last_clean":"2023-05-17T15:08:54.264062+0000","last_became_active":"2023-05-17T15:08:54.263647+0000","last_became_peered":"2023-05-17T15:08:54.263647+0000","last_unstale":"2023-05-17T15:08:54.264062+0000","last_undegraded":"2023-05-17T15:08:54.264062+0000","last_fullsized":"2023-05-17T15:08:54.264062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.233619+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:53.233619+0000","last_peered":"2023-05-17T15:08:53.233619+0000","last_clean":"2023-05-17T15:08:53.233619+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:53.233619+0000","last_undegraded":"2023-05-17T15:08:53.233619+0000","last_fullsized":"2023-05-17T15:08:53.233619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243605+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:53.243605+0000","last_peered":"2023-05-17T15:08:53.243605+0000","last_clean":"2023-05-17T15:08:53.243605+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:53.243605+0000","last_undegraded":"2023-05-17T15:08:53.243605+0000","last_fullsized":"2023-05-17T15:08:53.243605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242477+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265196+0000","last_change":"2023-05-17T15:08:54.265196+0000","last_active":"2023-05-17T15:08:54.265196+0000","last_peered":"2023-05-17T15:08:54.265196+0000","last_clean":"2023-05-17T15:08:54.265196+0000","last_became_active":"2023-05-17T15:08:54.264790+0000","last_became_peered":"2023-05-17T15:08:54.264790+0000","last_unstale":"2023-05-17T15:08:54.265196+0000","last_undegraded":"2023-05-17T15:08:54.265196+0000","last_fullsized":"2023-05-17T15:08:54.265196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243669+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:53.243669+0000","last_peered":"2023-05-17T15:08:53.243669+0000","last_clean":"2023-05-17T15:08:53.243669+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:53.243669+0000","last_undegraded":"2023-05-17T15:08:53.243669+0000","last_fullsized":"2023-05-17T15:08:53.243669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244906+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267147+0000","last_change":"2023-05-17T15:08:54.267147+0000","last_active":"2023-05-17T15:08:54.267147+0000","last_peered":"2023-05-17T15:08:54.267147+0000","last_clean":"2023-05-17T15:08:54.267147+0000","last_became_active":"2023-05-17T15:08:54.266723+0000","last_became_peered":"2023-05-17T15:08:54.266723+0000","last_unstale":"2023-05-17T15:08:54.267147+0000","last_undegraded":"2023-05-17T15:08:54.267147+0000","last_fullsized":"2023-05-17T15:08:54.267147+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243760+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:53.243760+0000","last_peered":"2023-05-17T15:08:53.243760+0000","last_clean":"2023-05-17T15:08:53.243760+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:53.243760+0000","last_undegraded":"2023-05-17T15:08:53.243760+0000","last_fullsized":"2023-05-17T15:08:53.243760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245271+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267545+0000","last_change":"2023-05-17T15:08:54.267545+0000","last_active":"2023-05-17T15:08:54.267545+0000","last_peered":"2023-05-17T15:08:54.267545+0000","last_clean":"2023-05-17T15:08:54.267545+0000","last_became_active":"2023-05-17T15:08:54.267190+0000","last_became_peered":"2023-05-17T15:08:54.267190+0000","last_unstale":"2023-05-17T15:08:54.267545+0000","last_undegraded":"2023-05-17T15:08:54.267545+0000","last_fullsized":"2023-05-17T15:08:54.267545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.238191+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:53.238191+0000","last_peered":"2023-05-17T15:08:53.238191+0000","last_clean":"2023-05-17T15:08:53.238191+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:53.238191+0000","last_undegraded":"2023-05-17T15:08:53.238191+0000","last_fullsized":"2023-05-17T15:08:53.238191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249204+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259933+0000","last_change":"2023-05-17T15:08:54.259933+0000","last_active":"2023-05-17T15:08:54.259933+0000","last_peered":"2023-05-17T15:08:54.259933+0000","last_clean":"2023-05-17T15:08:54.259933+0000","last_became_active":"2023-05-17T15:08:54.259624+0000","last_became_peered":"2023-05-17T15:08:54.259624+0000","last_unstale":"2023-05-17T15:08:54.259933+0000","last_undegraded":"2023-05-17T15:08:54.259933+0000","last_fullsized":"2023-05-17T15:08:54.259933+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237664+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:53.237664+0000","last_peered":"2023-05-17T15:08:53.237664+0000","last_clean":"2023-05-17T15:08:53.237664+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:53.237664+0000","last_undegraded":"2023-05-17T15:08:53.237664+0000","last_fullsized":"2023-05-17T15:08:53.237664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17384,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354456,"statfs":{"total":96636764160,"available":96618962944,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.432}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16744,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355096,"statfs":{"total":96636764160,"available":96619618304,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.621}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16552,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355288,"statfs":{"total":96636764160,"available":96619814912,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.50700000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.318,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.52100000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.20000000000000001},"max":{"1min":0.46300000000000002,"5min":1.956,"15min":1.956},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.48299999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.58899999999999997,"5min":1.149,"15min":1.149},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.02},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88}]},{"osd":5,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.873},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.46600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":1.103,"15min":1.6100000000000001},"last":1.044}]},{"osd":6,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.80400000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":1.524,"15min":1.524},"last":0.98399999999999999}]},{"osd":7,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.01},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.40400000000000003},"max":{"1min":0.76200000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16360,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355480,"statfs":{"total":96636764160,"available":96620011520,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.26700000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.5}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17704,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354136,"statfs":{"total":96636764160,"available":96618635264,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.436},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20648,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351192,"statfs":{"total":96636764160,"available":96615620608,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.248},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.32000000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.376},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17000,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354840,"statfs":{"total":96636764160,"available":96619356160,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.61599999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.84999999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20392,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351448,"statfs":{"total":96636764160,"available":96615882752,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.70799999999999996}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:57.692 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:57.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.835+0000 7f3fdcf9f700 1 Processor -- start 2023-05-17T15:08:57.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.835+0000 7f3fdcf9f700 1 -- start start 2023-05-17T15:08:57.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fdcf9f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3fd80cb0f0 0x7f3fd8153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fdcf9f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd8157a80 con 0x7f3fd80c5870 2023-05-17T15:08:57.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fdcf9f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd8157d60 con 0x7f3fd8153a70 2023-05-17T15:08:57.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fdcf9f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd8158040 con 0x7f3fd80cb0f0 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fd6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3fd80cb0f0 0x7f3fd8153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fd7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3fd80c5870 0x7f3fd80c5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39438/0 (socket says 172.21.15.27:39438) 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.836+0000 7f3fd7fff700 1 -- 172.21.15.27:0/1168645945 learned_addr learned my addr 172.21.15.27:0/1168645945 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/1168645945 >> v1:172.21.15.40:6789/0 conn(0x7f3fd8153a70 legacy=0x7f3fd80ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/1168645945 >> v1:172.21.15.27:6789/0 conn(0x7f3fd80c5870 legacy=0x7f3fd80c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd6ffd700 1 -- 172.21.15.27:0/1168645945 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8158320 con 0x7f3fd80cb0f0 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd6ffd700 1 --2- 172.21.15.27:0/1168645945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd8153e50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f3fcc009760 tx=0x7f3fcc009060).ready entity=mon.0 client_cookie=820801282eea1e7c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd67fc700 1 -- 172.21.15.27:0/1168645945 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00b580 con 0x7f3fd80cb0f0 2023-05-17T15:08:57.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd67fc700 1 -- 172.21.15.27:0/1168645945 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00b6e0 con 0x7f3fd80cb0f0 2023-05-17T15:08:57.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fd67fc700 1 -- 172.21.15.27:0/1168645945 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00ba60 con 0x7f3fd80cb0f0 2023-05-17T15:08:57.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/1168645945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd80cb0f0 msgr2=0x7f3fd8153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/1168645945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd8153e50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f3fcc009760 tx=0x7f3fcc009060).stop 2023-05-17T15:08:57.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/1168645945 shutdown_connections 2023-05-17T15:08:57.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/1168645945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd8153e50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/1168645945 >> 172.21.15.27:0/1168645945 conn(0x7f3fd805dd50 msgr2=0x7f3fd805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/1168645945 shutdown_connections 2023-05-17T15:08:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.837+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/1168645945 wait complete. 2023-05-17T15:08:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 Processor -- start 2023-05-17T15:08:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 -- start start 2023-05-17T15:08:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fd80c5870 0x7f3fd8167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 0x7f3fd8151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8168c00 con 0x7f3fd8153a70 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80c3510 con 0x7f3fd80cb0f0 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fdcf9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80c2990 con 0x7f3fd80c5870 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fd7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 0x7f3fd8151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fd7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 0x7f3fd8151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39882/0 (socket says 172.21.15.27:39882) 2023-05-17T15:08:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.839+0000 7f3fd7fff700 1 -- 172.21.15.27:0/2516512684 learned_addr learned my addr 172.21.15.27:0/2516512684 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd6ffd700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd77fe700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fd80c5870 0x7f3fd8167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd7fff700 1 -- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fd80c5870 msgr2=0x7f3fd8167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd7fff700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fd80c5870 0x7f3fd8167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd7fff700 1 -- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fd80cb0f0 msgr2=0x7f3fd80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd7fff700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd80c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd7fff700 1 -- 172.21.15.27:0/2516512684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0092a0 con 0x7f3fd8153a70 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd6ffd700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd80c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd77fe700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fd80c5870 0x7f3fd8167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fd7fff700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 0x7f3fd8151c60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f3fd000c790 tx=0x7f3fd00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0005d30 con 0x7f3fd8153a70 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0005e90 con 0x7f3fd8153a70 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd8168360 con 0x7f3fd8153a70 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0007320 con 0x7f3fd8153a70 2023-05-17T15:08:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.840+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd8168920 con 0x7f3fd8153a70 2023-05-17T15:08:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.841+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd80c3680 con 0x7f3fd8153a70 2023-05-17T15:08:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.842+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3fd0010030 con 0x7f3fd8153a70 2023-05-17T15:08:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.842+0000 7f3fbf7fe700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3fc405ed90 0x7f3fc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.842+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f3fd0079a70 con 0x7f3fd8153a70 2023-05-17T15:08:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.842+0000 7f3fd77fe700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3fc405ed90 0x7f3fc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.842+0000 7f3fd77fe700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3fc405ed90 0x7f3fc4061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3fc8001690 tx=0x7f3fc8009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:57.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:57.846+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fd004afc0 con 0x7f3fd8153a70 2023-05-17T15:08:58.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.014+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fd806bdf0 con 0x7f3fc405ed90 2023-05-17T15:08:58.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.024+0000 7f3fbf7fe700 1 -- 172.21.15.27:0/2516512684 <== mgr.6462 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358332 (secure 0 0 0) 0x7f3fd806bdf0 con 0x7f3fc405ed90 2023-05-17T15:08:58.032 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:58.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3fc405ed90 msgr2=0x7f3fc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3fc405ed90 0x7f3fc4061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3fc8001690 tx=0x7f3fc8009040).stop 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 msgr2=0x7f3fd8151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 0x7f3fd8151c60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f3fd000c790 tx=0x7f3fd00015e0).stop 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 shutdown_connections 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3fc405ed90 0x7f3fc4061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fd8153a70 0x7f3fd8151c60 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fd80c5870 0x7f3fd8167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 --2- 172.21.15.27:0/2516512684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fd80cb0f0 0x7f3fd80c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 >> 172.21.15.27:0/2516512684 conn(0x7f3fd805dd50 msgr2=0x7f3fd80c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:58.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 shutdown_connections 2023-05-17T15:08:58.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.028+0000 7f3fdcf9f700 1 -- 172.21.15.27:0/2516512684 wait complete. 2023-05-17T15:08:58.036 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:58.044 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:57.475488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":142784,"kb_used_data":8960,"kb_used_omap":0,"kb_used_meta":133760,"kb_avail":754831936,"statfs":{"total":773094113280,"available":772947902464,"internally_reserved":0,"allocated":9175040,"data_stored":4579296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136970240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-60,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.171693"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248385+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270583+0000","last_change":"2023-05-17T15:08:54.270583+0000","last_active":"2023-05-17T15:08:54.270583+0000","last_peered":"2023-05-17T15:08:54.270583+0000","last_clean":"2023-05-17T15:08:54.270583+0000","last_became_active":"2023-05-17T15:08:54.270277+0000","last_became_peered":"2023-05-17T15:08:54.270277+0000","last_unstale":"2023-05-17T15:08:54.270583+0000","last_undegraded":"2023-05-17T15:08:54.270583+0000","last_fullsized":"2023-05-17T15:08:54.270583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250618+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258220+0000","last_change":"2023-05-17T15:08:54.258220+0000","last_active":"2023-05-17T15:08:54.258220+0000","last_peered":"2023-05-17T15:08:54.258220+0000","last_clean":"2023-05-17T15:08:54.258220+0000","last_became_active":"2023-05-17T15:08:54.257897+0000","last_became_peered":"2023-05-17T15:08:54.257897+0000","last_unstale":"2023-05-17T15:08:54.258220+0000","last_undegraded":"2023-05-17T15:08:54.258220+0000","last_fullsized":"2023-05-17T15:08:54.258220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247310+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.250930+0000","last_change":"2023-05-17T15:08:54.250930+0000","last_active":"2023-05-17T15:08:54.250930+0000","last_peered":"2023-05-17T15:08:54.250930+0000","last_clean":"2023-05-17T15:08:54.250930+0000","last_became_active":"2023-05-17T15:08:54.250648+0000","last_became_peered":"2023-05-17T15:08:54.250648+0000","last_unstale":"2023-05-17T15:08:54.250930+0000","last_undegraded":"2023-05-17T15:08:54.250930+0000","last_fullsized":"2023-05-17T15:08:54.250930+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248373+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260661+0000","last_change":"2023-05-17T15:08:54.260661+0000","last_active":"2023-05-17T15:08:54.260661+0000","last_peered":"2023-05-17T15:08:54.260661+0000","last_clean":"2023-05-17T15:08:54.260661+0000","last_became_active":"2023-05-17T15:08:54.260378+0000","last_became_peered":"2023-05-17T15:08:54.260378+0000","last_unstale":"2023-05-17T15:08:54.260661+0000","last_undegraded":"2023-05-17T15:08:54.260661+0000","last_fullsized":"2023-05-17T15:08:54.260661+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249972+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263402+0000","last_change":"2023-05-17T15:08:54.263402+0000","last_active":"2023-05-17T15:08:54.263402+0000","last_peered":"2023-05-17T15:08:54.263402+0000","last_clean":"2023-05-17T15:08:54.263402+0000","last_became_active":"2023-05-17T15:08:54.263067+0000","last_became_peered":"2023-05-17T15:08:54.263067+0000","last_unstale":"2023-05-17T15:08:54.263402+0000","last_undegraded":"2023-05-17T15:08:54.263402+0000","last_fullsized":"2023-05-17T15:08:54.263402+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247630+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258314+0000","last_change":"2023-05-17T15:08:54.258314+0000","last_active":"2023-05-17T15:08:54.258314+0000","last_peered":"2023-05-17T15:08:54.258314+0000","last_clean":"2023-05-17T15:08:54.258314+0000","last_became_active":"2023-05-17T15:08:54.258080+0000","last_became_peered":"2023-05-17T15:08:54.258080+0000","last_unstale":"2023-05-17T15:08:54.258314+0000","last_undegraded":"2023-05-17T15:08:54.258314+0000","last_fullsized":"2023-05-17T15:08:54.258314+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244045+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259205+0000","last_change":"2023-05-17T15:08:54.259205+0000","last_active":"2023-05-17T15:08:54.259205+0000","last_peered":"2023-05-17T15:08:54.259205+0000","last_clean":"2023-05-17T15:08:54.259205+0000","last_became_active":"2023-05-17T15:08:54.258893+0000","last_became_peered":"2023-05-17T15:08:54.258893+0000","last_unstale":"2023-05-17T15:08:54.259205+0000","last_undegraded":"2023-05-17T15:08:54.259205+0000","last_fullsized":"2023-05-17T15:08:54.259205+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255408+0000","last_change":"2023-05-17T15:08:54.255408+0000","last_active":"2023-05-17T15:08:54.255408+0000","last_peered":"2023-05-17T15:08:54.255408+0000","last_clean":"2023-05-17T15:08:54.255408+0000","last_became_active":"2023-05-17T15:08:54.255099+0000","last_became_peered":"2023-05-17T15:08:54.255099+0000","last_unstale":"2023-05-17T15:08:54.255408+0000","last_undegraded":"2023-05-17T15:08:54.255408+0000","last_fullsized":"2023-05-17T15:08:54.255408+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253822+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260817+0000","last_change":"2023-05-17T15:08:54.260817+0000","last_active":"2023-05-17T15:08:54.260817+0000","last_peered":"2023-05-17T15:08:54.260817+0000","last_clean":"2023-05-17T15:08:54.260817+0000","last_became_active":"2023-05-17T15:08:54.260540+0000","last_became_peered":"2023-05-17T15:08:54.260540+0000","last_unstale":"2023-05-17T15:08:54.260817+0000","last_undegraded":"2023-05-17T15:08:54.260817+0000","last_fullsized":"2023-05-17T15:08:54.260817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243736+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259817+0000","last_change":"2023-05-17T15:08:54.259817+0000","last_active":"2023-05-17T15:08:54.259817+0000","last_peered":"2023-05-17T15:08:54.259817+0000","last_clean":"2023-05-17T15:08:54.259817+0000","last_became_active":"2023-05-17T15:08:54.258343+0000","last_became_peered":"2023-05-17T15:08:54.258343+0000","last_unstale":"2023-05-17T15:08:54.259817+0000","last_undegraded":"2023-05-17T15:08:54.259817+0000","last_fullsized":"2023-05-17T15:08:54.259817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245283+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268125+0000","last_change":"2023-05-17T15:08:54.268125+0000","last_active":"2023-05-17T15:08:54.268125+0000","last_peered":"2023-05-17T15:08:54.268125+0000","last_clean":"2023-05-17T15:08:54.268125+0000","last_became_active":"2023-05-17T15:08:54.265254+0000","last_became_peered":"2023-05-17T15:08:54.265254+0000","last_unstale":"2023-05-17T15:08:54.268125+0000","last_undegraded":"2023-05-17T15:08:54.268125+0000","last_fullsized":"2023-05-17T15:08:54.268125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248768+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267294+0000","last_change":"2023-05-17T15:08:54.267294+0000","last_active":"2023-05-17T15:08:54.267294+0000","last_peered":"2023-05-17T15:08:54.267294+0000","last_clean":"2023-05-17T15:08:54.267294+0000","last_became_active":"2023-05-17T15:08:54.266970+0000","last_became_peered":"2023-05-17T15:08:54.266970+0000","last_unstale":"2023-05-17T15:08:54.267294+0000","last_undegraded":"2023-05-17T15:08:54.267294+0000","last_fullsized":"2023-05-17T15:08:54.267294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249466+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.252483+0000","last_change":"2023-05-17T15:08:54.252483+0000","last_active":"2023-05-17T15:08:54.252483+0000","last_peered":"2023-05-17T15:08:54.252483+0000","last_clean":"2023-05-17T15:08:54.252483+0000","last_became_active":"2023-05-17T15:08:54.252178+0000","last_became_peered":"2023-05-17T15:08:54.252178+0000","last_unstale":"2023-05-17T15:08:54.252483+0000","last_undegraded":"2023-05-17T15:08:54.252483+0000","last_fullsized":"2023-05-17T15:08:54.252483+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244419+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267320+0000","last_change":"2023-05-17T15:08:54.267320+0000","last_active":"2023-05-17T15:08:54.267320+0000","last_peered":"2023-05-17T15:08:54.267320+0000","last_clean":"2023-05-17T15:08:54.267320+0000","last_became_active":"2023-05-17T15:08:54.267043+0000","last_became_peered":"2023-05-17T15:08:54.267043+0000","last_unstale":"2023-05-17T15:08:54.267320+0000","last_undegraded":"2023-05-17T15:08:54.267320+0000","last_fullsized":"2023-05-17T15:08:54.267320+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251840+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259020+0000","last_change":"2023-05-17T15:08:54.259020+0000","last_active":"2023-05-17T15:08:54.259020+0000","last_peered":"2023-05-17T15:08:54.259020+0000","last_clean":"2023-05-17T15:08:54.259020+0000","last_became_active":"2023-05-17T15:08:54.258736+0000","last_became_peered":"2023-05-17T15:08:54.258736+0000","last_unstale":"2023-05-17T15:08:54.259020+0000","last_undegraded":"2023-05-17T15:08:54.259020+0000","last_fullsized":"2023-05-17T15:08:54.259020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246074+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264896+0000","last_change":"2023-05-17T15:08:54.264896+0000","last_active":"2023-05-17T15:08:54.264896+0000","last_peered":"2023-05-17T15:08:54.264896+0000","last_clean":"2023-05-17T15:08:54.264896+0000","last_became_active":"2023-05-17T15:08:54.264559+0000","last_became_peered":"2023-05-17T15:08:54.264559+0000","last_unstale":"2023-05-17T15:08:54.264896+0000","last_undegraded":"2023-05-17T15:08:54.264896+0000","last_fullsized":"2023-05-17T15:08:54.264896+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244378+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260860+0000","last_change":"2023-05-17T15:08:54.260860+0000","last_active":"2023-05-17T15:08:54.260860+0000","last_peered":"2023-05-17T15:08:54.260860+0000","last_clean":"2023-05-17T15:08:54.260860+0000","last_became_active":"2023-05-17T15:08:54.260308+0000","last_became_peered":"2023-05-17T15:08:54.260308+0000","last_unstale":"2023-05-17T15:08:54.260860+0000","last_undegraded":"2023-05-17T15:08:54.260860+0000","last_fullsized":"2023-05-17T15:08:54.260860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245789+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260850+0000","last_change":"2023-05-17T15:08:54.260850+0000","last_active":"2023-05-17T15:08:54.260850+0000","last_peered":"2023-05-17T15:08:54.260850+0000","last_clean":"2023-05-17T15:08:54.260850+0000","last_became_active":"2023-05-17T15:08:54.260631+0000","last_became_peered":"2023-05-17T15:08:54.260631+0000","last_unstale":"2023-05-17T15:08:54.260850+0000","last_undegraded":"2023-05-17T15:08:54.260850+0000","last_fullsized":"2023-05-17T15:08:54.260850+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255488+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253863+0000","last_change":"2023-05-17T15:08:54.253863+0000","last_active":"2023-05-17T15:08:54.253863+0000","last_peered":"2023-05-17T15:08:54.253863+0000","last_clean":"2023-05-17T15:08:54.253863+0000","last_became_active":"2023-05-17T15:08:54.253355+0000","last_became_peered":"2023-05-17T15:08:54.253355+0000","last_unstale":"2023-05-17T15:08:54.253863+0000","last_undegraded":"2023-05-17T15:08:54.253863+0000","last_fullsized":"2023-05-17T15:08:54.253863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247517+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.256858+0000","last_change":"2023-05-17T15:08:54.256858+0000","last_active":"2023-05-17T15:08:54.256858+0000","last_peered":"2023-05-17T15:08:54.256858+0000","last_clean":"2023-05-17T15:08:54.256858+0000","last_became_active":"2023-05-17T15:08:54.256602+0000","last_became_peered":"2023-05-17T15:08:54.256602+0000","last_unstale":"2023-05-17T15:08:54.256858+0000","last_undegraded":"2023-05-17T15:08:54.256858+0000","last_fullsized":"2023-05-17T15:08:54.256858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.254981+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251958+0000","last_change":"2023-05-17T15:08:54.251958+0000","last_active":"2023-05-17T15:08:54.251958+0000","last_peered":"2023-05-17T15:08:54.251958+0000","last_clean":"2023-05-17T15:08:54.251958+0000","last_became_active":"2023-05-17T15:08:54.251695+0000","last_became_peered":"2023-05-17T15:08:54.251695+0000","last_unstale":"2023-05-17T15:08:54.251958+0000","last_undegraded":"2023-05-17T15:08:54.251958+0000","last_fullsized":"2023-05-17T15:08:54.251958+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245000+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268177+0000","last_change":"2023-05-17T15:08:54.268177+0000","last_active":"2023-05-17T15:08:54.268177+0000","last_peered":"2023-05-17T15:08:54.268177+0000","last_clean":"2023-05-17T15:08:54.268177+0000","last_became_active":"2023-05-17T15:08:54.267884+0000","last_became_peered":"2023-05-17T15:08:54.267884+0000","last_unstale":"2023-05-17T15:08:54.268177+0000","last_undegraded":"2023-05-17T15:08:54.268177+0000","last_fullsized":"2023-05-17T15:08:54.268177+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247815+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268435+0000","last_change":"2023-05-17T15:08:54.268435+0000","last_active":"2023-05-17T15:08:54.268435+0000","last_peered":"2023-05-17T15:08:54.268435+0000","last_clean":"2023-05-17T15:08:54.268435+0000","last_became_active":"2023-05-17T15:08:54.267475+0000","last_became_peered":"2023-05-17T15:08:54.267475+0000","last_unstale":"2023-05-17T15:08:54.268435+0000","last_undegraded":"2023-05-17T15:08:54.268435+0000","last_fullsized":"2023-05-17T15:08:54.268435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.252484+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265806+0000","last_change":"2023-05-17T15:08:54.265806+0000","last_active":"2023-05-17T15:08:54.265806+0000","last_peered":"2023-05-17T15:08:54.265806+0000","last_clean":"2023-05-17T15:08:54.265806+0000","last_became_active":"2023-05-17T15:08:54.265547+0000","last_became_peered":"2023-05-17T15:08:54.265547+0000","last_unstale":"2023-05-17T15:08:54.265806+0000","last_undegraded":"2023-05-17T15:08:54.265806+0000","last_fullsized":"2023-05-17T15:08:54.265806+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253316+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261359+0000","last_change":"2023-05-17T15:08:54.261359+0000","last_active":"2023-05-17T15:08:54.261359+0000","last_peered":"2023-05-17T15:08:54.261359+0000","last_clean":"2023-05-17T15:08:54.261359+0000","last_became_active":"2023-05-17T15:08:54.261079+0000","last_became_peered":"2023-05-17T15:08:54.261079+0000","last_unstale":"2023-05-17T15:08:54.261359+0000","last_undegraded":"2023-05-17T15:08:54.261359+0000","last_fullsized":"2023-05-17T15:08:54.261359+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246828+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262457+0000","last_change":"2023-05-17T15:08:54.262457+0000","last_active":"2023-05-17T15:08:54.262457+0000","last_peered":"2023-05-17T15:08:54.262457+0000","last_clean":"2023-05-17T15:08:54.262457+0000","last_became_active":"2023-05-17T15:08:54.262186+0000","last_became_peered":"2023-05-17T15:08:54.262186+0000","last_unstale":"2023-05-17T15:08:54.262457+0000","last_undegraded":"2023-05-17T15:08:54.262457+0000","last_fullsized":"2023-05-17T15:08:54.262457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255794+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262152+0000","last_change":"2023-05-17T15:08:54.262152+0000","last_active":"2023-05-17T15:08:54.262152+0000","last_peered":"2023-05-17T15:08:54.262152+0000","last_clean":"2023-05-17T15:08:54.262152+0000","last_became_active":"2023-05-17T15:08:54.261899+0000","last_became_peered":"2023-05-17T15:08:54.261899+0000","last_unstale":"2023-05-17T15:08:54.262152+0000","last_undegraded":"2023-05-17T15:08:54.262152+0000","last_fullsized":"2023-05-17T15:08:54.262152+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243863+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268108+0000","last_change":"2023-05-17T15:08:54.268108+0000","last_active":"2023-05-17T15:08:54.268108+0000","last_peered":"2023-05-17T15:08:54.268108+0000","last_clean":"2023-05-17T15:08:54.268108+0000","last_became_active":"2023-05-17T15:08:54.267836+0000","last_became_peered":"2023-05-17T15:08:54.267836+0000","last_unstale":"2023-05-17T15:08:54.268108+0000","last_undegraded":"2023-05-17T15:08:54.268108+0000","last_fullsized":"2023-05-17T15:08:54.268108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253565+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.249785+0000","last_change":"2023-05-17T15:08:54.249785+0000","last_active":"2023-05-17T15:08:54.249785+0000","last_peered":"2023-05-17T15:08:54.249785+0000","last_clean":"2023-05-17T15:08:54.249785+0000","last_became_active":"2023-05-17T15:08:54.249456+0000","last_became_peered":"2023-05-17T15:08:54.249456+0000","last_unstale":"2023-05-17T15:08:54.249785+0000","last_undegraded":"2023-05-17T15:08:54.249785+0000","last_fullsized":"2023-05-17T15:08:54.249785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.256174+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261281+0000","last_change":"2023-05-17T15:08:54.261281+0000","last_active":"2023-05-17T15:08:54.261281+0000","last_peered":"2023-05-17T15:08:54.261281+0000","last_clean":"2023-05-17T15:08:54.261281+0000","last_became_active":"2023-05-17T15:08:54.260987+0000","last_became_peered":"2023-05-17T15:08:54.260987+0000","last_unstale":"2023-05-17T15:08:54.261281+0000","last_undegraded":"2023-05-17T15:08:54.261281+0000","last_fullsized":"2023-05-17T15:08:54.261281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248102+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258001+0000","last_change":"2023-05-17T15:08:54.258001+0000","last_active":"2023-05-17T15:08:54.258001+0000","last_peered":"2023-05-17T15:08:54.258001+0000","last_clean":"2023-05-17T15:08:54.258001+0000","last_became_active":"2023-05-17T15:08:54.257718+0000","last_became_peered":"2023-05-17T15:08:54.257718+0000","last_unstale":"2023-05-17T15:08:54.258001+0000","last_undegraded":"2023-05-17T15:08:54.258001+0000","last_fullsized":"2023-05-17T15:08:54.258001+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243114+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262074+0000","last_change":"2023-05-17T15:08:54.262074+0000","last_active":"2023-05-17T15:08:54.262074+0000","last_peered":"2023-05-17T15:08:54.262074+0000","last_clean":"2023-05-17T15:08:54.262074+0000","last_became_active":"2023-05-17T15:08:54.261719+0000","last_became_peered":"2023-05-17T15:08:54.261719+0000","last_unstale":"2023-05-17T15:08:54.262074+0000","last_undegraded":"2023-05-17T15:08:54.262074+0000","last_fullsized":"2023-05-17T15:08:54.262074+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245839+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260568+0000","last_change":"2023-05-17T15:08:54.260568+0000","last_active":"2023-05-17T15:08:54.260568+0000","last_peered":"2023-05-17T15:08:54.260568+0000","last_clean":"2023-05-17T15:08:54.260568+0000","last_became_active":"2023-05-17T15:08:54.260238+0000","last_became_peered":"2023-05-17T15:08:54.260238+0000","last_unstale":"2023-05-17T15:08:54.260568+0000","last_undegraded":"2023-05-17T15:08:54.260568+0000","last_fullsized":"2023-05-17T15:08:54.260568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242493+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267741+0000","last_change":"2023-05-17T15:08:54.267741+0000","last_active":"2023-05-17T15:08:54.267741+0000","last_peered":"2023-05-17T15:08:54.267741+0000","last_clean":"2023-05-17T15:08:54.267741+0000","last_became_active":"2023-05-17T15:08:54.267400+0000","last_became_peered":"2023-05-17T15:08:54.267400+0000","last_unstale":"2023-05-17T15:08:54.267741+0000","last_undegraded":"2023-05-17T15:08:54.267741+0000","last_fullsized":"2023-05-17T15:08:54.267741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245350+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267917+0000","last_change":"2023-05-17T15:08:54.267917+0000","last_active":"2023-05-17T15:08:54.267917+0000","last_peered":"2023-05-17T15:08:54.267917+0000","last_clean":"2023-05-17T15:08:54.267917+0000","last_became_active":"2023-05-17T15:08:54.265748+0000","last_became_peered":"2023-05-17T15:08:54.265748+0000","last_unstale":"2023-05-17T15:08:54.267917+0000","last_undegraded":"2023-05-17T15:08:54.267917+0000","last_fullsized":"2023-05-17T15:08:54.267917+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244522+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262729+0000","last_change":"2023-05-17T15:08:54.262729+0000","last_active":"2023-05-17T15:08:54.262729+0000","last_peered":"2023-05-17T15:08:54.262729+0000","last_clean":"2023-05-17T15:08:54.262729+0000","last_became_active":"2023-05-17T15:08:54.261926+0000","last_became_peered":"2023-05-17T15:08:54.261926+0000","last_unstale":"2023-05-17T15:08:54.262729+0000","last_undegraded":"2023-05-17T15:08:54.262729+0000","last_fullsized":"2023-05-17T15:08:54.262729+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242752+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263505+0000","last_change":"2023-05-17T15:08:54.263505+0000","last_active":"2023-05-17T15:08:54.263505+0000","last_peered":"2023-05-17T15:08:54.263505+0000","last_clean":"2023-05-17T15:08:54.263505+0000","last_became_active":"2023-05-17T15:08:54.263203+0000","last_became_peered":"2023-05-17T15:08:54.263203+0000","last_unstale":"2023-05-17T15:08:54.263505+0000","last_undegraded":"2023-05-17T15:08:54.263505+0000","last_fullsized":"2023-05-17T15:08:54.263505+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242759+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254900+0000","last_change":"2023-05-17T15:08:54.254900+0000","last_active":"2023-05-17T15:08:54.254900+0000","last_peered":"2023-05-17T15:08:54.254900+0000","last_clean":"2023-05-17T15:08:54.254900+0000","last_became_active":"2023-05-17T15:08:54.254602+0000","last_became_peered":"2023-05-17T15:08:54.254602+0000","last_unstale":"2023-05-17T15:08:54.254900+0000","last_undegraded":"2023-05-17T15:08:54.254900+0000","last_fullsized":"2023-05-17T15:08:54.254900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245894+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262186+0000","last_change":"2023-05-17T15:08:54.262186+0000","last_active":"2023-05-17T15:08:54.262186+0000","last_peered":"2023-05-17T15:08:54.262186+0000","last_clean":"2023-05-17T15:08:54.262186+0000","last_became_active":"2023-05-17T15:08:54.261879+0000","last_became_peered":"2023-05-17T15:08:54.261879+0000","last_unstale":"2023-05-17T15:08:54.262186+0000","last_undegraded":"2023-05-17T15:08:54.262186+0000","last_fullsized":"2023-05-17T15:08:54.262186+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251525+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257705+0000","last_change":"2023-05-17T15:08:54.257705+0000","last_active":"2023-05-17T15:08:54.257705+0000","last_peered":"2023-05-17T15:08:54.257705+0000","last_clean":"2023-05-17T15:08:54.257705+0000","last_became_active":"2023-05-17T15:08:54.257412+0000","last_became_peered":"2023-05-17T15:08:54.257412+0000","last_unstale":"2023-05-17T15:08:54.257705+0000","last_undegraded":"2023-05-17T15:08:54.257705+0000","last_fullsized":"2023-05-17T15:08:54.257705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242189+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268207+0000","last_change":"2023-05-17T15:08:54.268207+0000","last_active":"2023-05-17T15:08:54.268207+0000","last_peered":"2023-05-17T15:08:54.268207+0000","last_clean":"2023-05-17T15:08:54.268207+0000","last_became_active":"2023-05-17T15:08:54.267927+0000","last_became_peered":"2023-05-17T15:08:54.267927+0000","last_unstale":"2023-05-17T15:08:54.268207+0000","last_undegraded":"2023-05-17T15:08:54.268207+0000","last_fullsized":"2023-05-17T15:08:54.268207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245116+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263854+0000","last_change":"2023-05-17T15:08:54.263854+0000","last_active":"2023-05-17T15:08:54.263854+0000","last_peered":"2023-05-17T15:08:54.263854+0000","last_clean":"2023-05-17T15:08:54.263854+0000","last_became_active":"2023-05-17T15:08:54.263569+0000","last_became_peered":"2023-05-17T15:08:54.263569+0000","last_unstale":"2023-05-17T15:08:54.263854+0000","last_undegraded":"2023-05-17T15:08:54.263854+0000","last_fullsized":"2023-05-17T15:08:54.263854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258048+0000","last_change":"2023-05-17T15:08:54.258048+0000","last_active":"2023-05-17T15:08:54.258048+0000","last_peered":"2023-05-17T15:08:54.258048+0000","last_clean":"2023-05-17T15:08:54.258048+0000","last_became_active":"2023-05-17T15:08:54.257755+0000","last_became_peered":"2023-05-17T15:08:54.257755+0000","last_unstale":"2023-05-17T15:08:54.258048+0000","last_undegraded":"2023-05-17T15:08:54.258048+0000","last_fullsized":"2023-05-17T15:08:54.258048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244846+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258271+0000","last_change":"2023-05-17T15:08:54.258271+0000","last_active":"2023-05-17T15:08:54.258271+0000","last_peered":"2023-05-17T15:08:54.258271+0000","last_clean":"2023-05-17T15:08:54.258271+0000","last_became_active":"2023-05-17T15:08:54.257940+0000","last_became_peered":"2023-05-17T15:08:54.257940+0000","last_unstale":"2023-05-17T15:08:54.258271+0000","last_undegraded":"2023-05-17T15:08:54.258271+0000","last_fullsized":"2023-05-17T15:08:54.258271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249042+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255246+0000","last_change":"2023-05-17T15:08:54.255246+0000","last_active":"2023-05-17T15:08:54.255246+0000","last_peered":"2023-05-17T15:08:54.255246+0000","last_clean":"2023-05-17T15:08:54.255246+0000","last_became_active":"2023-05-17T15:08:54.254774+0000","last_became_peered":"2023-05-17T15:08:54.254774+0000","last_unstale":"2023-05-17T15:08:54.255246+0000","last_undegraded":"2023-05-17T15:08:54.255246+0000","last_fullsized":"2023-05-17T15:08:54.255246+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250241+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270579+0000","last_change":"2023-05-17T15:08:54.270579+0000","last_active":"2023-05-17T15:08:54.270579+0000","last_peered":"2023-05-17T15:08:54.270579+0000","last_clean":"2023-05-17T15:08:54.270579+0000","last_became_active":"2023-05-17T15:08:54.270231+0000","last_became_peered":"2023-05-17T15:08:54.270231+0000","last_unstale":"2023-05-17T15:08:54.270579+0000","last_undegraded":"2023-05-17T15:08:54.270579+0000","last_fullsized":"2023-05-17T15:08:54.270579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250993+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262544+0000","last_change":"2023-05-17T15:08:54.262544+0000","last_active":"2023-05-17T15:08:54.262544+0000","last_peered":"2023-05-17T15:08:54.262544+0000","last_clean":"2023-05-17T15:08:54.262544+0000","last_became_active":"2023-05-17T15:08:54.259695+0000","last_became_peered":"2023-05-17T15:08:54.259695+0000","last_unstale":"2023-05-17T15:08:54.262544+0000","last_undegraded":"2023-05-17T15:08:54.262544+0000","last_fullsized":"2023-05-17T15:08:54.262544+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251077+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251360+0000","last_change":"2023-05-17T15:08:54.251360+0000","last_active":"2023-05-17T15:08:54.251360+0000","last_peered":"2023-05-17T15:08:54.251360+0000","last_clean":"2023-05-17T15:08:54.251360+0000","last_became_active":"2023-05-17T15:08:54.251150+0000","last_became_peered":"2023-05-17T15:08:54.251150+0000","last_unstale":"2023-05-17T15:08:54.251360+0000","last_undegraded":"2023-05-17T15:08:54.251360+0000","last_fullsized":"2023-05-17T15:08:54.251360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243895+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260659+0000","last_change":"2023-05-17T15:08:54.260659+0000","last_active":"2023-05-17T15:08:54.260659+0000","last_peered":"2023-05-17T15:08:54.260659+0000","last_clean":"2023-05-17T15:08:54.260659+0000","last_became_active":"2023-05-17T15:08:54.260371+0000","last_became_peered":"2023-05-17T15:08:54.260371+0000","last_unstale":"2023-05-17T15:08:54.260659+0000","last_undegraded":"2023-05-17T15:08:54.260659+0000","last_fullsized":"2023-05-17T15:08:54.260659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247377+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257883+0000","last_change":"2023-05-17T15:08:54.257883+0000","last_active":"2023-05-17T15:08:54.257883+0000","last_peered":"2023-05-17T15:08:54.257883+0000","last_clean":"2023-05-17T15:08:54.257883+0000","last_became_active":"2023-05-17T15:08:54.257585+0000","last_became_peered":"2023-05-17T15:08:54.257585+0000","last_unstale":"2023-05-17T15:08:54.257883+0000","last_undegraded":"2023-05-17T15:08:54.257883+0000","last_fullsized":"2023-05-17T15:08:54.257883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244773+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268672+0000","last_change":"2023-05-17T15:08:54.268672+0000","last_active":"2023-05-17T15:08:54.268672+0000","last_peered":"2023-05-17T15:08:54.268672+0000","last_clean":"2023-05-17T15:08:54.268672+0000","last_became_active":"2023-05-17T15:08:54.268408+0000","last_became_peered":"2023-05-17T15:08:54.268408+0000","last_unstale":"2023-05-17T15:08:54.268672+0000","last_undegraded":"2023-05-17T15:08:54.268672+0000","last_fullsized":"2023-05-17T15:08:54.268672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242131+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267658+0000","last_change":"2023-05-17T15:08:54.267658+0000","last_active":"2023-05-17T15:08:54.267658+0000","last_peered":"2023-05-17T15:08:54.267658+0000","last_clean":"2023-05-17T15:08:54.267658+0000","last_became_active":"2023-05-17T15:08:54.267287+0000","last_became_peered":"2023-05-17T15:08:54.267287+0000","last_unstale":"2023-05-17T15:08:54.267658+0000","last_undegraded":"2023-05-17T15:08:54.267658+0000","last_fullsized":"2023-05-17T15:08:54.267658+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247963+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264262+0000","last_change":"2023-05-17T15:08:54.264262+0000","last_active":"2023-05-17T15:08:54.264262+0000","last_peered":"2023-05-17T15:08:54.264262+0000","last_clean":"2023-05-17T15:08:54.264262+0000","last_became_active":"2023-05-17T15:08:54.263935+0000","last_became_peered":"2023-05-17T15:08:54.263935+0000","last_unstale":"2023-05-17T15:08:54.264262+0000","last_undegraded":"2023-05-17T15:08:54.264262+0000","last_fullsized":"2023-05-17T15:08:54.264262+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247947+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260215+0000","last_change":"2023-05-17T15:08:54.260215+0000","last_active":"2023-05-17T15:08:54.260215+0000","last_peered":"2023-05-17T15:08:54.260215+0000","last_clean":"2023-05-17T15:08:54.260215+0000","last_became_active":"2023-05-17T15:08:54.259732+0000","last_became_peered":"2023-05-17T15:08:54.259732+0000","last_unstale":"2023-05-17T15:08:54.260215+0000","last_undegraded":"2023-05-17T15:08:54.260215+0000","last_fullsized":"2023-05-17T15:08:54.260215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245968+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253796+0000","last_change":"2023-05-17T15:08:54.253796+0000","last_active":"2023-05-17T15:08:54.253796+0000","last_peered":"2023-05-17T15:08:54.253796+0000","last_clean":"2023-05-17T15:08:54.253796+0000","last_became_active":"2023-05-17T15:08:54.253479+0000","last_became_peered":"2023-05-17T15:08:54.253479+0000","last_unstale":"2023-05-17T15:08:54.253796+0000","last_undegraded":"2023-05-17T15:08:54.253796+0000","last_fullsized":"2023-05-17T15:08:54.253796+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245080+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258128+0000","last_change":"2023-05-17T15:08:54.258128+0000","last_active":"2023-05-17T15:08:54.258128+0000","last_peered":"2023-05-17T15:08:54.258128+0000","last_clean":"2023-05-17T15:08:54.258128+0000","last_became_active":"2023-05-17T15:08:54.256391+0000","last_became_peered":"2023-05-17T15:08:54.256391+0000","last_unstale":"2023-05-17T15:08:54.258128+0000","last_undegraded":"2023-05-17T15:08:54.258128+0000","last_fullsized":"2023-05-17T15:08:54.258128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255076+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257141+0000","last_change":"2023-05-17T15:08:54.257141+0000","last_active":"2023-05-17T15:08:54.257141+0000","last_peered":"2023-05-17T15:08:54.257141+0000","last_clean":"2023-05-17T15:08:54.257141+0000","last_became_active":"2023-05-17T15:08:54.256827+0000","last_became_peered":"2023-05-17T15:08:54.256827+0000","last_unstale":"2023-05-17T15:08:54.257141+0000","last_undegraded":"2023-05-17T15:08:54.257141+0000","last_fullsized":"2023-05-17T15:08:54.257141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237981+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:53.237981+0000","last_peered":"2023-05-17T15:08:53.237981+0000","last_clean":"2023-05-17T15:08:53.237981+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:53.237981+0000","last_undegraded":"2023-05-17T15:08:53.237981+0000","last_fullsized":"2023-05-17T15:08:53.237981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242148+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254126+0000","last_change":"2023-05-17T15:08:54.254126+0000","last_active":"2023-05-17T15:08:54.254126+0000","last_peered":"2023-05-17T15:08:54.254126+0000","last_clean":"2023-05-17T15:08:54.254126+0000","last_became_active":"2023-05-17T15:08:54.253832+0000","last_became_peered":"2023-05-17T15:08:54.253832+0000","last_unstale":"2023-05-17T15:08:54.254126+0000","last_undegraded":"2023-05-17T15:08:54.254126+0000","last_fullsized":"2023-05-17T15:08:54.254126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.235330+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:53.235330+0000","last_peered":"2023-05-17T15:08:53.235330+0000","last_clean":"2023-05-17T15:08:53.235330+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:53.235330+0000","last_undegraded":"2023-05-17T15:08:53.235330+0000","last_fullsized":"2023-05-17T15:08:53.235330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248218+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265101+0000","last_change":"2023-05-17T15:08:54.265101+0000","last_active":"2023-05-17T15:08:54.265101+0000","last_peered":"2023-05-17T15:08:54.265101+0000","last_clean":"2023-05-17T15:08:54.265101+0000","last_became_active":"2023-05-17T15:08:54.264786+0000","last_became_peered":"2023-05-17T15:08:54.264786+0000","last_unstale":"2023-05-17T15:08:54.265101+0000","last_undegraded":"2023-05-17T15:08:54.265101+0000","last_fullsized":"2023-05-17T15:08:54.265101+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237453+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:53.237453+0000","last_peered":"2023-05-17T15:08:53.237453+0000","last_clean":"2023-05-17T15:08:53.237453+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:53.237453+0000","last_undegraded":"2023-05-17T15:08:53.237453+0000","last_fullsized":"2023-05-17T15:08:53.237453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255645+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264062+0000","last_change":"2023-05-17T15:08:54.264062+0000","last_active":"2023-05-17T15:08:54.264062+0000","last_peered":"2023-05-17T15:08:54.264062+0000","last_clean":"2023-05-17T15:08:54.264062+0000","last_became_active":"2023-05-17T15:08:54.263647+0000","last_became_peered":"2023-05-17T15:08:54.263647+0000","last_unstale":"2023-05-17T15:08:54.264062+0000","last_undegraded":"2023-05-17T15:08:54.264062+0000","last_fullsized":"2023-05-17T15:08:54.264062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.233619+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:53.233619+0000","last_peered":"2023-05-17T15:08:53.233619+0000","last_clean":"2023-05-17T15:08:53.233619+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:53.233619+0000","last_undegraded":"2023-05-17T15:08:53.233619+0000","last_fullsized":"2023-05-17T15:08:53.233619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243605+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:53.243605+0000","last_peered":"2023-05-17T15:08:53.243605+0000","last_clean":"2023-05-17T15:08:53.243605+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:53.243605+0000","last_undegraded":"2023-05-17T15:08:53.243605+0000","last_fullsized":"2023-05-17T15:08:53.243605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242477+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265196+0000","last_change":"2023-05-17T15:08:54.265196+0000","last_active":"2023-05-17T15:08:54.265196+0000","last_peered":"2023-05-17T15:08:54.265196+0000","last_clean":"2023-05-17T15:08:54.265196+0000","last_became_active":"2023-05-17T15:08:54.264790+0000","last_became_peered":"2023-05-17T15:08:54.264790+0000","last_unstale":"2023-05-17T15:08:54.265196+0000","last_undegraded":"2023-05-17T15:08:54.265196+0000","last_fullsized":"2023-05-17T15:08:54.265196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243669+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:53.243669+0000","last_peered":"2023-05-17T15:08:53.243669+0000","last_clean":"2023-05-17T15:08:53.243669+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:53.243669+0000","last_undegraded":"2023-05-17T15:08:53.243669+0000","last_fullsized":"2023-05-17T15:08:53.243669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244906+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267147+0000","last_change":"2023-05-17T15:08:54.267147+0000","last_active":"2023-05-17T15:08:54.267147+0000","last_peered":"2023-05-17T15:08:54.267147+0000","last_clean":"2023-05-17T15:08:54.267147+0000","last_became_active":"2023-05-17T15:08:54.266723+0000","last_became_peered":"2023-05-17T15:08:54.266723+0000","last_unstale":"2023-05-17T15:08:54.267147+0000","last_undegraded":"2023-05-17T15:08:54.267147+0000","last_fullsized":"2023-05-17T15:08:54.267147+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243760+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:53.243760+0000","last_peered":"2023-05-17T15:08:53.243760+0000","last_clean":"2023-05-17T15:08:53.243760+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:53.243760+0000","last_undegraded":"2023-05-17T15:08:53.243760+0000","last_fullsized":"2023-05-17T15:08:53.243760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245271+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267545+0000","last_change":"2023-05-17T15:08:54.267545+0000","last_active":"2023-05-17T15:08:54.267545+0000","last_peered":"2023-05-17T15:08:54.267545+0000","last_clean":"2023-05-17T15:08:54.267545+0000","last_became_active":"2023-05-17T15:08:54.267190+0000","last_became_peered":"2023-05-17T15:08:54.267190+0000","last_unstale":"2023-05-17T15:08:54.267545+0000","last_undegraded":"2023-05-17T15:08:54.267545+0000","last_fullsized":"2023-05-17T15:08:54.267545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.238191+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:53.238191+0000","last_peered":"2023-05-17T15:08:53.238191+0000","last_clean":"2023-05-17T15:08:53.238191+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:53.238191+0000","last_undegraded":"2023-05-17T15:08:53.238191+0000","last_fullsized":"2023-05-17T15:08:53.238191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249204+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259933+0000","last_change":"2023-05-17T15:08:54.259933+0000","last_active":"2023-05-17T15:08:54.259933+0000","last_peered":"2023-05-17T15:08:54.259933+0000","last_clean":"2023-05-17T15:08:54.259933+0000","last_became_active":"2023-05-17T15:08:54.259624+0000","last_became_peered":"2023-05-17T15:08:54.259624+0000","last_unstale":"2023-05-17T15:08:54.259933+0000","last_undegraded":"2023-05-17T15:08:54.259933+0000","last_fullsized":"2023-05-17T15:08:54.259933+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237664+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:53.237664+0000","last_peered":"2023-05-17T15:08:53.237664+0000","last_clean":"2023-05-17T15:08:53.237664+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:53.237664+0000","last_undegraded":"2023-05-17T15:08:53.237664+0000","last_fullsized":"2023-05-17T15:08:53.237664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17384,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354456,"statfs":{"total":96636764160,"available":96618962944,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.432}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16744,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355096,"statfs":{"total":96636764160,"available":96619618304,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.621}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16552,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355288,"statfs":{"total":96636764160,"available":96619814912,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.50700000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.318,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.52100000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.20000000000000001},"max":{"1min":0.46300000000000002,"5min":1.956,"15min":1.956},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.48299999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.58899999999999997,"5min":1.149,"15min":1.149},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.02},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88}]},{"osd":5,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.873},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.46600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":1.103,"15min":1.6100000000000001},"last":1.044}]},{"osd":6,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.80400000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":1.524,"15min":1.524},"last":0.98399999999999999}]},{"osd":7,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.01},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.40400000000000003},"max":{"1min":0.76200000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16360,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355480,"statfs":{"total":96636764160,"available":96620011520,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.26700000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.5}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17704,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354136,"statfs":{"total":96636764160,"available":96618635264,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.436},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20648,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351192,"statfs":{"total":96636764160,"available":96615620608,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.248},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.32000000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.376},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17000,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354840,"statfs":{"total":96636764160,"available":96619356160,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.61599999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.84999999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20392,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351448,"statfs":{"total":96636764160,"available":96615882752,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.70799999999999996}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:58.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:58.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.196+0000 7f75d6fdb700 1 Processor -- start 2023-05-17T15:08:58.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.196+0000 7f75d6fdb700 1 -- start start 2023-05-17T15:08:58.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d6fdb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 0x7f75d0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d6fdb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 0x7f75d00c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d6fdb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d00bfcd0 con 0x7f75d00c5f30 2023-05-17T15:08:58.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d6fdb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d00c0290 con 0x7f75d00c6310 2023-05-17T15:08:58.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d6fdb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00aa1a0 con 0x7f75d01541c0 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75cffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 0x7f75d0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 0x7f75d00c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 0x7f75d00c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:40996/0 (socket says 172.21.15.27:40996) 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d4d77700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f75d00c5f30 0x7f75d0158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:45450/0 (socket says 172.21.15.27:45450) 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75cffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 0x7f75d0153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:57816/0 (socket says 172.21.15.27:57816) 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 -- 172.21.15.27:0/3805360366 learned_addr learned my addr 172.21.15.27:0/3805360366 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 -- 172.21.15.27:0/3805360366 >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 msgr2=0x7f75d0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 --2- 172.21.15.27:0/3805360366 >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 0x7f75d0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 -- 172.21.15.27:0/3805360366 >> v1:172.21.15.40:6789/0 conn(0x7f75d00c5f30 legacy=0x7f75d0158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75d5578700 1 -- 172.21.15.27:0/3805360366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00aa480 con 0x7f75d01541c0 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.197+0000 7f75cffff700 1 --2- 172.21.15.27:0/3805360366 >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 0x7f75d0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d5578700 1 --2- 172.21.15.27:0/3805360366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 0x7f75d00c0720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f75b8006fd0 tx=0x7f75b80090f0).ready entity=mon.2 client_cookie=7d511afbba4289a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75cf7fe700 1 -- 172.21.15.27:0/3805360366 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800b580 con 0x7f75d01541c0 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75cf7fe700 1 -- 172.21.15.27:0/3805360366 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800b6e0 con 0x7f75d01541c0 2023-05-17T15:08:58.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75cf7fe700 1 -- 172.21.15.27:0/3805360366 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800ba60 con 0x7f75d01541c0 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 -- 172.21.15.27:0/3805360366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 msgr2=0x7f75d00c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/3805360366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 0x7f75d00c0720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f75b8006fd0 tx=0x7f75b80090f0).stop 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 -- 172.21.15.27:0/3805360366 shutdown_connections 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/3805360366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d01541c0 0x7f75d00c0720 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/3805360366 >> v2:172.21.15.40:3300/0 conn(0x7f75d00c6310 0x7f75d0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 -- 172.21.15.27:0/3805360366 >> 172.21.15.27:0/3805360366 conn(0x7f75d0069e70 msgr2=0x7f75d005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:58.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 -- 172.21.15.27:0/3805360366 shutdown_connections 2023-05-17T15:08:58.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.198+0000 7f75d6fdb700 1 -- 172.21.15.27:0/3805360366 wait complete. 2023-05-17T15:08:58.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.199+0000 7f75d6fdb700 1 Processor -- start 2023-05-17T15:08:58.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 -- start start 2023-05-17T15:08:58.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 0x7f75d00a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d00c6310 0x7f75d0167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 0x7f75d01682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01687a0 con 0x7f75d01541c0 2023-05-17T15:08:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01423f0 con 0x7f75d00c5f30 2023-05-17T15:08:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d6fdb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01426d0 con 0x7f75d00c6310 2023-05-17T15:08:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d4d77700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 0x7f75d00a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d5578700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 0x7f75d01682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d4d77700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 0x7f75d00a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:57820/0 (socket says 172.21.15.27:57820) 2023-05-17T15:08:58.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d5578700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 0x7f75d01682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39894/0 (socket says 172.21.15.27:39894) 2023-05-17T15:08:58.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.200+0000 7f75d4d77700 1 -- 172.21.15.27:0/183738130 learned_addr learned my addr 172.21.15.27:0/183738130 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:58.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75cffff700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d00c6310 0x7f75d0167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d5578700 1 -- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d00c6310 msgr2=0x7f75d0167dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d5578700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d00c6310 0x7f75d0167dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d5578700 1 -- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 msgr2=0x7f75d00a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d5578700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 0x7f75d00a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d5578700 1 -- 172.21.15.27:0/183738130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c0009a20 con 0x7f75d01541c0 2023-05-17T15:08:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d4d77700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 0x7f75d00a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:58.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75cffff700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d00c6310 0x7f75d0167dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d5578700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 0x7f75d01682b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f75b8014000 tx=0x7f75b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800b850 con 0x7f75d01541c0 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800b9b0 con 0x7f75d01541c0 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b801c670 con 0x7f75d01541c0 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b8009370 con 0x7f75d01541c0 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.201+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0142c90 con 0x7f75d01541c0 2023-05-17T15:08:58.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.202+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d005f4a0 con 0x7f75d01541c0 2023-05-17T15:08:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.203+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f75b800f070 con 0x7f75d01541c0 2023-05-17T15:08:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.203+0000 7f75ccff9700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b005ed90 0x7f75b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.203+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f75b807aae0 con 0x7f75d01541c0 2023-05-17T15:08:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.203+0000 7f75d4d77700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b005ed90 0x7f75b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.203+0000 7f75d4d77700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b005ed90 0x7f75b0061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f75c8007fd0 tx=0x7f75c8007df0).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.207+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75b804fb10 con 0x7f75d01541c0 2023-05-17T15:08:58.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.375+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75d006bdf0 con 0x7f75b005ed90 2023-05-17T15:08:58.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.385+0000 7f75ccff9700 1 -- 172.21.15.27:0/183738130 <== mgr.6462 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358332 (secure 0 0 0) 0x7f75d006bdf0 con 0x7f75b005ed90 2023-05-17T15:08:58.392 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:58.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b005ed90 msgr2=0x7f75b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b005ed90 0x7f75b0061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f75c8007fd0 tx=0x7f75c8007df0).stop 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 msgr2=0x7f75d01682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 0x7f75d01682b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f75b8014000 tx=0x7f75b8017000).stop 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 shutdown_connections 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b005ed90 0x7f75b0061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d01541c0 0x7f75d01682b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d00c5f30 0x7f75d00a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 --2- 172.21.15.27:0/183738130 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d00c6310 0x7f75d0167dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 >> 172.21.15.27:0/183738130 conn(0x7f75d0069e70 msgr2=0x7f75d0153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:58.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 shutdown_connections 2023-05-17T15:08:58.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.388+0000 7f75d6fdb700 1 -- 172.21.15.27:0/183738130 wait complete. 2023-05-17T15:08:58.396 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:58.403 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:57.475488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":142784,"kb_used_data":8960,"kb_used_omap":0,"kb_used_meta":133760,"kb_avail":754831936,"statfs":{"total":773094113280,"available":772947902464,"internally_reserved":0,"allocated":9175040,"data_stored":4579296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136970240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-60,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.171693"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248385+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270583+0000","last_change":"2023-05-17T15:08:54.270583+0000","last_active":"2023-05-17T15:08:54.270583+0000","last_peered":"2023-05-17T15:08:54.270583+0000","last_clean":"2023-05-17T15:08:54.270583+0000","last_became_active":"2023-05-17T15:08:54.270277+0000","last_became_peered":"2023-05-17T15:08:54.270277+0000","last_unstale":"2023-05-17T15:08:54.270583+0000","last_undegraded":"2023-05-17T15:08:54.270583+0000","last_fullsized":"2023-05-17T15:08:54.270583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250618+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258220+0000","last_change":"2023-05-17T15:08:54.258220+0000","last_active":"2023-05-17T15:08:54.258220+0000","last_peered":"2023-05-17T15:08:54.258220+0000","last_clean":"2023-05-17T15:08:54.258220+0000","last_became_active":"2023-05-17T15:08:54.257897+0000","last_became_peered":"2023-05-17T15:08:54.257897+0000","last_unstale":"2023-05-17T15:08:54.258220+0000","last_undegraded":"2023-05-17T15:08:54.258220+0000","last_fullsized":"2023-05-17T15:08:54.258220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247310+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.250930+0000","last_change":"2023-05-17T15:08:54.250930+0000","last_active":"2023-05-17T15:08:54.250930+0000","last_peered":"2023-05-17T15:08:54.250930+0000","last_clean":"2023-05-17T15:08:54.250930+0000","last_became_active":"2023-05-17T15:08:54.250648+0000","last_became_peered":"2023-05-17T15:08:54.250648+0000","last_unstale":"2023-05-17T15:08:54.250930+0000","last_undegraded":"2023-05-17T15:08:54.250930+0000","last_fullsized":"2023-05-17T15:08:54.250930+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248373+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260661+0000","last_change":"2023-05-17T15:08:54.260661+0000","last_active":"2023-05-17T15:08:54.260661+0000","last_peered":"2023-05-17T15:08:54.260661+0000","last_clean":"2023-05-17T15:08:54.260661+0000","last_became_active":"2023-05-17T15:08:54.260378+0000","last_became_peered":"2023-05-17T15:08:54.260378+0000","last_unstale":"2023-05-17T15:08:54.260661+0000","last_undegraded":"2023-05-17T15:08:54.260661+0000","last_fullsized":"2023-05-17T15:08:54.260661+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249972+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263402+0000","last_change":"2023-05-17T15:08:54.263402+0000","last_active":"2023-05-17T15:08:54.263402+0000","last_peered":"2023-05-17T15:08:54.263402+0000","last_clean":"2023-05-17T15:08:54.263402+0000","last_became_active":"2023-05-17T15:08:54.263067+0000","last_became_peered":"2023-05-17T15:08:54.263067+0000","last_unstale":"2023-05-17T15:08:54.263402+0000","last_undegraded":"2023-05-17T15:08:54.263402+0000","last_fullsized":"2023-05-17T15:08:54.263402+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247630+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258314+0000","last_change":"2023-05-17T15:08:54.258314+0000","last_active":"2023-05-17T15:08:54.258314+0000","last_peered":"2023-05-17T15:08:54.258314+0000","last_clean":"2023-05-17T15:08:54.258314+0000","last_became_active":"2023-05-17T15:08:54.258080+0000","last_became_peered":"2023-05-17T15:08:54.258080+0000","last_unstale":"2023-05-17T15:08:54.258314+0000","last_undegraded":"2023-05-17T15:08:54.258314+0000","last_fullsized":"2023-05-17T15:08:54.258314+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244045+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259205+0000","last_change":"2023-05-17T15:08:54.259205+0000","last_active":"2023-05-17T15:08:54.259205+0000","last_peered":"2023-05-17T15:08:54.259205+0000","last_clean":"2023-05-17T15:08:54.259205+0000","last_became_active":"2023-05-17T15:08:54.258893+0000","last_became_peered":"2023-05-17T15:08:54.258893+0000","last_unstale":"2023-05-17T15:08:54.259205+0000","last_undegraded":"2023-05-17T15:08:54.259205+0000","last_fullsized":"2023-05-17T15:08:54.259205+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255408+0000","last_change":"2023-05-17T15:08:54.255408+0000","last_active":"2023-05-17T15:08:54.255408+0000","last_peered":"2023-05-17T15:08:54.255408+0000","last_clean":"2023-05-17T15:08:54.255408+0000","last_became_active":"2023-05-17T15:08:54.255099+0000","last_became_peered":"2023-05-17T15:08:54.255099+0000","last_unstale":"2023-05-17T15:08:54.255408+0000","last_undegraded":"2023-05-17T15:08:54.255408+0000","last_fullsized":"2023-05-17T15:08:54.255408+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253822+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260817+0000","last_change":"2023-05-17T15:08:54.260817+0000","last_active":"2023-05-17T15:08:54.260817+0000","last_peered":"2023-05-17T15:08:54.260817+0000","last_clean":"2023-05-17T15:08:54.260817+0000","last_became_active":"2023-05-17T15:08:54.260540+0000","last_became_peered":"2023-05-17T15:08:54.260540+0000","last_unstale":"2023-05-17T15:08:54.260817+0000","last_undegraded":"2023-05-17T15:08:54.260817+0000","last_fullsized":"2023-05-17T15:08:54.260817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243736+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259817+0000","last_change":"2023-05-17T15:08:54.259817+0000","last_active":"2023-05-17T15:08:54.259817+0000","last_peered":"2023-05-17T15:08:54.259817+0000","last_clean":"2023-05-17T15:08:54.259817+0000","last_became_active":"2023-05-17T15:08:54.258343+0000","last_became_peered":"2023-05-17T15:08:54.258343+0000","last_unstale":"2023-05-17T15:08:54.259817+0000","last_undegraded":"2023-05-17T15:08:54.259817+0000","last_fullsized":"2023-05-17T15:08:54.259817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245283+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268125+0000","last_change":"2023-05-17T15:08:54.268125+0000","last_active":"2023-05-17T15:08:54.268125+0000","last_peered":"2023-05-17T15:08:54.268125+0000","last_clean":"2023-05-17T15:08:54.268125+0000","last_became_active":"2023-05-17T15:08:54.265254+0000","last_became_peered":"2023-05-17T15:08:54.265254+0000","last_unstale":"2023-05-17T15:08:54.268125+0000","last_undegraded":"2023-05-17T15:08:54.268125+0000","last_fullsized":"2023-05-17T15:08:54.268125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248768+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267294+0000","last_change":"2023-05-17T15:08:54.267294+0000","last_active":"2023-05-17T15:08:54.267294+0000","last_peered":"2023-05-17T15:08:54.267294+0000","last_clean":"2023-05-17T15:08:54.267294+0000","last_became_active":"2023-05-17T15:08:54.266970+0000","last_became_peered":"2023-05-17T15:08:54.266970+0000","last_unstale":"2023-05-17T15:08:54.267294+0000","last_undegraded":"2023-05-17T15:08:54.267294+0000","last_fullsized":"2023-05-17T15:08:54.267294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249466+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.252483+0000","last_change":"2023-05-17T15:08:54.252483+0000","last_active":"2023-05-17T15:08:54.252483+0000","last_peered":"2023-05-17T15:08:54.252483+0000","last_clean":"2023-05-17T15:08:54.252483+0000","last_became_active":"2023-05-17T15:08:54.252178+0000","last_became_peered":"2023-05-17T15:08:54.252178+0000","last_unstale":"2023-05-17T15:08:54.252483+0000","last_undegraded":"2023-05-17T15:08:54.252483+0000","last_fullsized":"2023-05-17T15:08:54.252483+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244419+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267320+0000","last_change":"2023-05-17T15:08:54.267320+0000","last_active":"2023-05-17T15:08:54.267320+0000","last_peered":"2023-05-17T15:08:54.267320+0000","last_clean":"2023-05-17T15:08:54.267320+0000","last_became_active":"2023-05-17T15:08:54.267043+0000","last_became_peered":"2023-05-17T15:08:54.267043+0000","last_unstale":"2023-05-17T15:08:54.267320+0000","last_undegraded":"2023-05-17T15:08:54.267320+0000","last_fullsized":"2023-05-17T15:08:54.267320+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251840+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259020+0000","last_change":"2023-05-17T15:08:54.259020+0000","last_active":"2023-05-17T15:08:54.259020+0000","last_peered":"2023-05-17T15:08:54.259020+0000","last_clean":"2023-05-17T15:08:54.259020+0000","last_became_active":"2023-05-17T15:08:54.258736+0000","last_became_peered":"2023-05-17T15:08:54.258736+0000","last_unstale":"2023-05-17T15:08:54.259020+0000","last_undegraded":"2023-05-17T15:08:54.259020+0000","last_fullsized":"2023-05-17T15:08:54.259020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246074+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264896+0000","last_change":"2023-05-17T15:08:54.264896+0000","last_active":"2023-05-17T15:08:54.264896+0000","last_peered":"2023-05-17T15:08:54.264896+0000","last_clean":"2023-05-17T15:08:54.264896+0000","last_became_active":"2023-05-17T15:08:54.264559+0000","last_became_peered":"2023-05-17T15:08:54.264559+0000","last_unstale":"2023-05-17T15:08:54.264896+0000","last_undegraded":"2023-05-17T15:08:54.264896+0000","last_fullsized":"2023-05-17T15:08:54.264896+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244378+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260860+0000","last_change":"2023-05-17T15:08:54.260860+0000","last_active":"2023-05-17T15:08:54.260860+0000","last_peered":"2023-05-17T15:08:54.260860+0000","last_clean":"2023-05-17T15:08:54.260860+0000","last_became_active":"2023-05-17T15:08:54.260308+0000","last_became_peered":"2023-05-17T15:08:54.260308+0000","last_unstale":"2023-05-17T15:08:54.260860+0000","last_undegraded":"2023-05-17T15:08:54.260860+0000","last_fullsized":"2023-05-17T15:08:54.260860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245789+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260850+0000","last_change":"2023-05-17T15:08:54.260850+0000","last_active":"2023-05-17T15:08:54.260850+0000","last_peered":"2023-05-17T15:08:54.260850+0000","last_clean":"2023-05-17T15:08:54.260850+0000","last_became_active":"2023-05-17T15:08:54.260631+0000","last_became_peered":"2023-05-17T15:08:54.260631+0000","last_unstale":"2023-05-17T15:08:54.260850+0000","last_undegraded":"2023-05-17T15:08:54.260850+0000","last_fullsized":"2023-05-17T15:08:54.260850+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255488+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253863+0000","last_change":"2023-05-17T15:08:54.253863+0000","last_active":"2023-05-17T15:08:54.253863+0000","last_peered":"2023-05-17T15:08:54.253863+0000","last_clean":"2023-05-17T15:08:54.253863+0000","last_became_active":"2023-05-17T15:08:54.253355+0000","last_became_peered":"2023-05-17T15:08:54.253355+0000","last_unstale":"2023-05-17T15:08:54.253863+0000","last_undegraded":"2023-05-17T15:08:54.253863+0000","last_fullsized":"2023-05-17T15:08:54.253863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247517+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.256858+0000","last_change":"2023-05-17T15:08:54.256858+0000","last_active":"2023-05-17T15:08:54.256858+0000","last_peered":"2023-05-17T15:08:54.256858+0000","last_clean":"2023-05-17T15:08:54.256858+0000","last_became_active":"2023-05-17T15:08:54.256602+0000","last_became_peered":"2023-05-17T15:08:54.256602+0000","last_unstale":"2023-05-17T15:08:54.256858+0000","last_undegraded":"2023-05-17T15:08:54.256858+0000","last_fullsized":"2023-05-17T15:08:54.256858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.254981+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251958+0000","last_change":"2023-05-17T15:08:54.251958+0000","last_active":"2023-05-17T15:08:54.251958+0000","last_peered":"2023-05-17T15:08:54.251958+0000","last_clean":"2023-05-17T15:08:54.251958+0000","last_became_active":"2023-05-17T15:08:54.251695+0000","last_became_peered":"2023-05-17T15:08:54.251695+0000","last_unstale":"2023-05-17T15:08:54.251958+0000","last_undegraded":"2023-05-17T15:08:54.251958+0000","last_fullsized":"2023-05-17T15:08:54.251958+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245000+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268177+0000","last_change":"2023-05-17T15:08:54.268177+0000","last_active":"2023-05-17T15:08:54.268177+0000","last_peered":"2023-05-17T15:08:54.268177+0000","last_clean":"2023-05-17T15:08:54.268177+0000","last_became_active":"2023-05-17T15:08:54.267884+0000","last_became_peered":"2023-05-17T15:08:54.267884+0000","last_unstale":"2023-05-17T15:08:54.268177+0000","last_undegraded":"2023-05-17T15:08:54.268177+0000","last_fullsized":"2023-05-17T15:08:54.268177+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247815+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268435+0000","last_change":"2023-05-17T15:08:54.268435+0000","last_active":"2023-05-17T15:08:54.268435+0000","last_peered":"2023-05-17T15:08:54.268435+0000","last_clean":"2023-05-17T15:08:54.268435+0000","last_became_active":"2023-05-17T15:08:54.267475+0000","last_became_peered":"2023-05-17T15:08:54.267475+0000","last_unstale":"2023-05-17T15:08:54.268435+0000","last_undegraded":"2023-05-17T15:08:54.268435+0000","last_fullsized":"2023-05-17T15:08:54.268435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.252484+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265806+0000","last_change":"2023-05-17T15:08:54.265806+0000","last_active":"2023-05-17T15:08:54.265806+0000","last_peered":"2023-05-17T15:08:54.265806+0000","last_clean":"2023-05-17T15:08:54.265806+0000","last_became_active":"2023-05-17T15:08:54.265547+0000","last_became_peered":"2023-05-17T15:08:54.265547+0000","last_unstale":"2023-05-17T15:08:54.265806+0000","last_undegraded":"2023-05-17T15:08:54.265806+0000","last_fullsized":"2023-05-17T15:08:54.265806+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253316+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261359+0000","last_change":"2023-05-17T15:08:54.261359+0000","last_active":"2023-05-17T15:08:54.261359+0000","last_peered":"2023-05-17T15:08:54.261359+0000","last_clean":"2023-05-17T15:08:54.261359+0000","last_became_active":"2023-05-17T15:08:54.261079+0000","last_became_peered":"2023-05-17T15:08:54.261079+0000","last_unstale":"2023-05-17T15:08:54.261359+0000","last_undegraded":"2023-05-17T15:08:54.261359+0000","last_fullsized":"2023-05-17T15:08:54.261359+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246828+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262457+0000","last_change":"2023-05-17T15:08:54.262457+0000","last_active":"2023-05-17T15:08:54.262457+0000","last_peered":"2023-05-17T15:08:54.262457+0000","last_clean":"2023-05-17T15:08:54.262457+0000","last_became_active":"2023-05-17T15:08:54.262186+0000","last_became_peered":"2023-05-17T15:08:54.262186+0000","last_unstale":"2023-05-17T15:08:54.262457+0000","last_undegraded":"2023-05-17T15:08:54.262457+0000","last_fullsized":"2023-05-17T15:08:54.262457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255794+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262152+0000","last_change":"2023-05-17T15:08:54.262152+0000","last_active":"2023-05-17T15:08:54.262152+0000","last_peered":"2023-05-17T15:08:54.262152+0000","last_clean":"2023-05-17T15:08:54.262152+0000","last_became_active":"2023-05-17T15:08:54.261899+0000","last_became_peered":"2023-05-17T15:08:54.261899+0000","last_unstale":"2023-05-17T15:08:54.262152+0000","last_undegraded":"2023-05-17T15:08:54.262152+0000","last_fullsized":"2023-05-17T15:08:54.262152+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243863+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268108+0000","last_change":"2023-05-17T15:08:54.268108+0000","last_active":"2023-05-17T15:08:54.268108+0000","last_peered":"2023-05-17T15:08:54.268108+0000","last_clean":"2023-05-17T15:08:54.268108+0000","last_became_active":"2023-05-17T15:08:54.267836+0000","last_became_peered":"2023-05-17T15:08:54.267836+0000","last_unstale":"2023-05-17T15:08:54.268108+0000","last_undegraded":"2023-05-17T15:08:54.268108+0000","last_fullsized":"2023-05-17T15:08:54.268108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253565+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.249785+0000","last_change":"2023-05-17T15:08:54.249785+0000","last_active":"2023-05-17T15:08:54.249785+0000","last_peered":"2023-05-17T15:08:54.249785+0000","last_clean":"2023-05-17T15:08:54.249785+0000","last_became_active":"2023-05-17T15:08:54.249456+0000","last_became_peered":"2023-05-17T15:08:54.249456+0000","last_unstale":"2023-05-17T15:08:54.249785+0000","last_undegraded":"2023-05-17T15:08:54.249785+0000","last_fullsized":"2023-05-17T15:08:54.249785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.256174+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261281+0000","last_change":"2023-05-17T15:08:54.261281+0000","last_active":"2023-05-17T15:08:54.261281+0000","last_peered":"2023-05-17T15:08:54.261281+0000","last_clean":"2023-05-17T15:08:54.261281+0000","last_became_active":"2023-05-17T15:08:54.260987+0000","last_became_peered":"2023-05-17T15:08:54.260987+0000","last_unstale":"2023-05-17T15:08:54.261281+0000","last_undegraded":"2023-05-17T15:08:54.261281+0000","last_fullsized":"2023-05-17T15:08:54.261281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248102+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258001+0000","last_change":"2023-05-17T15:08:54.258001+0000","last_active":"2023-05-17T15:08:54.258001+0000","last_peered":"2023-05-17T15:08:54.258001+0000","last_clean":"2023-05-17T15:08:54.258001+0000","last_became_active":"2023-05-17T15:08:54.257718+0000","last_became_peered":"2023-05-17T15:08:54.257718+0000","last_unstale":"2023-05-17T15:08:54.258001+0000","last_undegraded":"2023-05-17T15:08:54.258001+0000","last_fullsized":"2023-05-17T15:08:54.258001+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243114+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262074+0000","last_change":"2023-05-17T15:08:54.262074+0000","last_active":"2023-05-17T15:08:54.262074+0000","last_peered":"2023-05-17T15:08:54.262074+0000","last_clean":"2023-05-17T15:08:54.262074+0000","last_became_active":"2023-05-17T15:08:54.261719+0000","last_became_peered":"2023-05-17T15:08:54.261719+0000","last_unstale":"2023-05-17T15:08:54.262074+0000","last_undegraded":"2023-05-17T15:08:54.262074+0000","last_fullsized":"2023-05-17T15:08:54.262074+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245839+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260568+0000","last_change":"2023-05-17T15:08:54.260568+0000","last_active":"2023-05-17T15:08:54.260568+0000","last_peered":"2023-05-17T15:08:54.260568+0000","last_clean":"2023-05-17T15:08:54.260568+0000","last_became_active":"2023-05-17T15:08:54.260238+0000","last_became_peered":"2023-05-17T15:08:54.260238+0000","last_unstale":"2023-05-17T15:08:54.260568+0000","last_undegraded":"2023-05-17T15:08:54.260568+0000","last_fullsized":"2023-05-17T15:08:54.260568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242493+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267741+0000","last_change":"2023-05-17T15:08:54.267741+0000","last_active":"2023-05-17T15:08:54.267741+0000","last_peered":"2023-05-17T15:08:54.267741+0000","last_clean":"2023-05-17T15:08:54.267741+0000","last_became_active":"2023-05-17T15:08:54.267400+0000","last_became_peered":"2023-05-17T15:08:54.267400+0000","last_unstale":"2023-05-17T15:08:54.267741+0000","last_undegraded":"2023-05-17T15:08:54.267741+0000","last_fullsized":"2023-05-17T15:08:54.267741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245350+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267917+0000","last_change":"2023-05-17T15:08:54.267917+0000","last_active":"2023-05-17T15:08:54.267917+0000","last_peered":"2023-05-17T15:08:54.267917+0000","last_clean":"2023-05-17T15:08:54.267917+0000","last_became_active":"2023-05-17T15:08:54.265748+0000","last_became_peered":"2023-05-17T15:08:54.265748+0000","last_unstale":"2023-05-17T15:08:54.267917+0000","last_undegraded":"2023-05-17T15:08:54.267917+0000","last_fullsized":"2023-05-17T15:08:54.267917+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244522+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262729+0000","last_change":"2023-05-17T15:08:54.262729+0000","last_active":"2023-05-17T15:08:54.262729+0000","last_peered":"2023-05-17T15:08:54.262729+0000","last_clean":"2023-05-17T15:08:54.262729+0000","last_became_active":"2023-05-17T15:08:54.261926+0000","last_became_peered":"2023-05-17T15:08:54.261926+0000","last_unstale":"2023-05-17T15:08:54.262729+0000","last_undegraded":"2023-05-17T15:08:54.262729+0000","last_fullsized":"2023-05-17T15:08:54.262729+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242752+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263505+0000","last_change":"2023-05-17T15:08:54.263505+0000","last_active":"2023-05-17T15:08:54.263505+0000","last_peered":"2023-05-17T15:08:54.263505+0000","last_clean":"2023-05-17T15:08:54.263505+0000","last_became_active":"2023-05-17T15:08:54.263203+0000","last_became_peered":"2023-05-17T15:08:54.263203+0000","last_unstale":"2023-05-17T15:08:54.263505+0000","last_undegraded":"2023-05-17T15:08:54.263505+0000","last_fullsized":"2023-05-17T15:08:54.263505+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242759+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254900+0000","last_change":"2023-05-17T15:08:54.254900+0000","last_active":"2023-05-17T15:08:54.254900+0000","last_peered":"2023-05-17T15:08:54.254900+0000","last_clean":"2023-05-17T15:08:54.254900+0000","last_became_active":"2023-05-17T15:08:54.254602+0000","last_became_peered":"2023-05-17T15:08:54.254602+0000","last_unstale":"2023-05-17T15:08:54.254900+0000","last_undegraded":"2023-05-17T15:08:54.254900+0000","last_fullsized":"2023-05-17T15:08:54.254900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245894+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262186+0000","last_change":"2023-05-17T15:08:54.262186+0000","last_active":"2023-05-17T15:08:54.262186+0000","last_peered":"2023-05-17T15:08:54.262186+0000","last_clean":"2023-05-17T15:08:54.262186+0000","last_became_active":"2023-05-17T15:08:54.261879+0000","last_became_peered":"2023-05-17T15:08:54.261879+0000","last_unstale":"2023-05-17T15:08:54.262186+0000","last_undegraded":"2023-05-17T15:08:54.262186+0000","last_fullsized":"2023-05-17T15:08:54.262186+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251525+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257705+0000","last_change":"2023-05-17T15:08:54.257705+0000","last_active":"2023-05-17T15:08:54.257705+0000","last_peered":"2023-05-17T15:08:54.257705+0000","last_clean":"2023-05-17T15:08:54.257705+0000","last_became_active":"2023-05-17T15:08:54.257412+0000","last_became_peered":"2023-05-17T15:08:54.257412+0000","last_unstale":"2023-05-17T15:08:54.257705+0000","last_undegraded":"2023-05-17T15:08:54.257705+0000","last_fullsized":"2023-05-17T15:08:54.257705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242189+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268207+0000","last_change":"2023-05-17T15:08:54.268207+0000","last_active":"2023-05-17T15:08:54.268207+0000","last_peered":"2023-05-17T15:08:54.268207+0000","last_clean":"2023-05-17T15:08:54.268207+0000","last_became_active":"2023-05-17T15:08:54.267927+0000","last_became_peered":"2023-05-17T15:08:54.267927+0000","last_unstale":"2023-05-17T15:08:54.268207+0000","last_undegraded":"2023-05-17T15:08:54.268207+0000","last_fullsized":"2023-05-17T15:08:54.268207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245116+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263854+0000","last_change":"2023-05-17T15:08:54.263854+0000","last_active":"2023-05-17T15:08:54.263854+0000","last_peered":"2023-05-17T15:08:54.263854+0000","last_clean":"2023-05-17T15:08:54.263854+0000","last_became_active":"2023-05-17T15:08:54.263569+0000","last_became_peered":"2023-05-17T15:08:54.263569+0000","last_unstale":"2023-05-17T15:08:54.263854+0000","last_undegraded":"2023-05-17T15:08:54.263854+0000","last_fullsized":"2023-05-17T15:08:54.263854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258048+0000","last_change":"2023-05-17T15:08:54.258048+0000","last_active":"2023-05-17T15:08:54.258048+0000","last_peered":"2023-05-17T15:08:54.258048+0000","last_clean":"2023-05-17T15:08:54.258048+0000","last_became_active":"2023-05-17T15:08:54.257755+0000","last_became_peered":"2023-05-17T15:08:54.257755+0000","last_unstale":"2023-05-17T15:08:54.258048+0000","last_undegraded":"2023-05-17T15:08:54.258048+0000","last_fullsized":"2023-05-17T15:08:54.258048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244846+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258271+0000","last_change":"2023-05-17T15:08:54.258271+0000","last_active":"2023-05-17T15:08:54.258271+0000","last_peered":"2023-05-17T15:08:54.258271+0000","last_clean":"2023-05-17T15:08:54.258271+0000","last_became_active":"2023-05-17T15:08:54.257940+0000","last_became_peered":"2023-05-17T15:08:54.257940+0000","last_unstale":"2023-05-17T15:08:54.258271+0000","last_undegraded":"2023-05-17T15:08:54.258271+0000","last_fullsized":"2023-05-17T15:08:54.258271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249042+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255246+0000","last_change":"2023-05-17T15:08:54.255246+0000","last_active":"2023-05-17T15:08:54.255246+0000","last_peered":"2023-05-17T15:08:54.255246+0000","last_clean":"2023-05-17T15:08:54.255246+0000","last_became_active":"2023-05-17T15:08:54.254774+0000","last_became_peered":"2023-05-17T15:08:54.254774+0000","last_unstale":"2023-05-17T15:08:54.255246+0000","last_undegraded":"2023-05-17T15:08:54.255246+0000","last_fullsized":"2023-05-17T15:08:54.255246+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250241+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270579+0000","last_change":"2023-05-17T15:08:54.270579+0000","last_active":"2023-05-17T15:08:54.270579+0000","last_peered":"2023-05-17T15:08:54.270579+0000","last_clean":"2023-05-17T15:08:54.270579+0000","last_became_active":"2023-05-17T15:08:54.270231+0000","last_became_peered":"2023-05-17T15:08:54.270231+0000","last_unstale":"2023-05-17T15:08:54.270579+0000","last_undegraded":"2023-05-17T15:08:54.270579+0000","last_fullsized":"2023-05-17T15:08:54.270579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250993+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262544+0000","last_change":"2023-05-17T15:08:54.262544+0000","last_active":"2023-05-17T15:08:54.262544+0000","last_peered":"2023-05-17T15:08:54.262544+0000","last_clean":"2023-05-17T15:08:54.262544+0000","last_became_active":"2023-05-17T15:08:54.259695+0000","last_became_peered":"2023-05-17T15:08:54.259695+0000","last_unstale":"2023-05-17T15:08:54.262544+0000","last_undegraded":"2023-05-17T15:08:54.262544+0000","last_fullsized":"2023-05-17T15:08:54.262544+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251077+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251360+0000","last_change":"2023-05-17T15:08:54.251360+0000","last_active":"2023-05-17T15:08:54.251360+0000","last_peered":"2023-05-17T15:08:54.251360+0000","last_clean":"2023-05-17T15:08:54.251360+0000","last_became_active":"2023-05-17T15:08:54.251150+0000","last_became_peered":"2023-05-17T15:08:54.251150+0000","last_unstale":"2023-05-17T15:08:54.251360+0000","last_undegraded":"2023-05-17T15:08:54.251360+0000","last_fullsized":"2023-05-17T15:08:54.251360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243895+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260659+0000","last_change":"2023-05-17T15:08:54.260659+0000","last_active":"2023-05-17T15:08:54.260659+0000","last_peered":"2023-05-17T15:08:54.260659+0000","last_clean":"2023-05-17T15:08:54.260659+0000","last_became_active":"2023-05-17T15:08:54.260371+0000","last_became_peered":"2023-05-17T15:08:54.260371+0000","last_unstale":"2023-05-17T15:08:54.260659+0000","last_undegraded":"2023-05-17T15:08:54.260659+0000","last_fullsized":"2023-05-17T15:08:54.260659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247377+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257883+0000","last_change":"2023-05-17T15:08:54.257883+0000","last_active":"2023-05-17T15:08:54.257883+0000","last_peered":"2023-05-17T15:08:54.257883+0000","last_clean":"2023-05-17T15:08:54.257883+0000","last_became_active":"2023-05-17T15:08:54.257585+0000","last_became_peered":"2023-05-17T15:08:54.257585+0000","last_unstale":"2023-05-17T15:08:54.257883+0000","last_undegraded":"2023-05-17T15:08:54.257883+0000","last_fullsized":"2023-05-17T15:08:54.257883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244773+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268672+0000","last_change":"2023-05-17T15:08:54.268672+0000","last_active":"2023-05-17T15:08:54.268672+0000","last_peered":"2023-05-17T15:08:54.268672+0000","last_clean":"2023-05-17T15:08:54.268672+0000","last_became_active":"2023-05-17T15:08:54.268408+0000","last_became_peered":"2023-05-17T15:08:54.268408+0000","last_unstale":"2023-05-17T15:08:54.268672+0000","last_undegraded":"2023-05-17T15:08:54.268672+0000","last_fullsized":"2023-05-17T15:08:54.268672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242131+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267658+0000","last_change":"2023-05-17T15:08:54.267658+0000","last_active":"2023-05-17T15:08:54.267658+0000","last_peered":"2023-05-17T15:08:54.267658+0000","last_clean":"2023-05-17T15:08:54.267658+0000","last_became_active":"2023-05-17T15:08:54.267287+0000","last_became_peered":"2023-05-17T15:08:54.267287+0000","last_unstale":"2023-05-17T15:08:54.267658+0000","last_undegraded":"2023-05-17T15:08:54.267658+0000","last_fullsized":"2023-05-17T15:08:54.267658+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247963+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264262+0000","last_change":"2023-05-17T15:08:54.264262+0000","last_active":"2023-05-17T15:08:54.264262+0000","last_peered":"2023-05-17T15:08:54.264262+0000","last_clean":"2023-05-17T15:08:54.264262+0000","last_became_active":"2023-05-17T15:08:54.263935+0000","last_became_peered":"2023-05-17T15:08:54.263935+0000","last_unstale":"2023-05-17T15:08:54.264262+0000","last_undegraded":"2023-05-17T15:08:54.264262+0000","last_fullsized":"2023-05-17T15:08:54.264262+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247947+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260215+0000","last_change":"2023-05-17T15:08:54.260215+0000","last_active":"2023-05-17T15:08:54.260215+0000","last_peered":"2023-05-17T15:08:54.260215+0000","last_clean":"2023-05-17T15:08:54.260215+0000","last_became_active":"2023-05-17T15:08:54.259732+0000","last_became_peered":"2023-05-17T15:08:54.259732+0000","last_unstale":"2023-05-17T15:08:54.260215+0000","last_undegraded":"2023-05-17T15:08:54.260215+0000","last_fullsized":"2023-05-17T15:08:54.260215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245968+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253796+0000","last_change":"2023-05-17T15:08:54.253796+0000","last_active":"2023-05-17T15:08:54.253796+0000","last_peered":"2023-05-17T15:08:54.253796+0000","last_clean":"2023-05-17T15:08:54.253796+0000","last_became_active":"2023-05-17T15:08:54.253479+0000","last_became_peered":"2023-05-17T15:08:54.253479+0000","last_unstale":"2023-05-17T15:08:54.253796+0000","last_undegraded":"2023-05-17T15:08:54.253796+0000","last_fullsized":"2023-05-17T15:08:54.253796+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245080+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258128+0000","last_change":"2023-05-17T15:08:54.258128+0000","last_active":"2023-05-17T15:08:54.258128+0000","last_peered":"2023-05-17T15:08:54.258128+0000","last_clean":"2023-05-17T15:08:54.258128+0000","last_became_active":"2023-05-17T15:08:54.256391+0000","last_became_peered":"2023-05-17T15:08:54.256391+0000","last_unstale":"2023-05-17T15:08:54.258128+0000","last_undegraded":"2023-05-17T15:08:54.258128+0000","last_fullsized":"2023-05-17T15:08:54.258128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255076+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257141+0000","last_change":"2023-05-17T15:08:54.257141+0000","last_active":"2023-05-17T15:08:54.257141+0000","last_peered":"2023-05-17T15:08:54.257141+0000","last_clean":"2023-05-17T15:08:54.257141+0000","last_became_active":"2023-05-17T15:08:54.256827+0000","last_became_peered":"2023-05-17T15:08:54.256827+0000","last_unstale":"2023-05-17T15:08:54.257141+0000","last_undegraded":"2023-05-17T15:08:54.257141+0000","last_fullsized":"2023-05-17T15:08:54.257141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237981+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:53.237981+0000","last_peered":"2023-05-17T15:08:53.237981+0000","last_clean":"2023-05-17T15:08:53.237981+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:53.237981+0000","last_undegraded":"2023-05-17T15:08:53.237981+0000","last_fullsized":"2023-05-17T15:08:53.237981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242148+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254126+0000","last_change":"2023-05-17T15:08:54.254126+0000","last_active":"2023-05-17T15:08:54.254126+0000","last_peered":"2023-05-17T15:08:54.254126+0000","last_clean":"2023-05-17T15:08:54.254126+0000","last_became_active":"2023-05-17T15:08:54.253832+0000","last_became_peered":"2023-05-17T15:08:54.253832+0000","last_unstale":"2023-05-17T15:08:54.254126+0000","last_undegraded":"2023-05-17T15:08:54.254126+0000","last_fullsized":"2023-05-17T15:08:54.254126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.235330+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:53.235330+0000","last_peered":"2023-05-17T15:08:53.235330+0000","last_clean":"2023-05-17T15:08:53.235330+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:53.235330+0000","last_undegraded":"2023-05-17T15:08:53.235330+0000","last_fullsized":"2023-05-17T15:08:53.235330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248218+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265101+0000","last_change":"2023-05-17T15:08:54.265101+0000","last_active":"2023-05-17T15:08:54.265101+0000","last_peered":"2023-05-17T15:08:54.265101+0000","last_clean":"2023-05-17T15:08:54.265101+0000","last_became_active":"2023-05-17T15:08:54.264786+0000","last_became_peered":"2023-05-17T15:08:54.264786+0000","last_unstale":"2023-05-17T15:08:54.265101+0000","last_undegraded":"2023-05-17T15:08:54.265101+0000","last_fullsized":"2023-05-17T15:08:54.265101+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237453+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:53.237453+0000","last_peered":"2023-05-17T15:08:53.237453+0000","last_clean":"2023-05-17T15:08:53.237453+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:53.237453+0000","last_undegraded":"2023-05-17T15:08:53.237453+0000","last_fullsized":"2023-05-17T15:08:53.237453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255645+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264062+0000","last_change":"2023-05-17T15:08:54.264062+0000","last_active":"2023-05-17T15:08:54.264062+0000","last_peered":"2023-05-17T15:08:54.264062+0000","last_clean":"2023-05-17T15:08:54.264062+0000","last_became_active":"2023-05-17T15:08:54.263647+0000","last_became_peered":"2023-05-17T15:08:54.263647+0000","last_unstale":"2023-05-17T15:08:54.264062+0000","last_undegraded":"2023-05-17T15:08:54.264062+0000","last_fullsized":"2023-05-17T15:08:54.264062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.233619+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:53.233619+0000","last_peered":"2023-05-17T15:08:53.233619+0000","last_clean":"2023-05-17T15:08:53.233619+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:53.233619+0000","last_undegraded":"2023-05-17T15:08:53.233619+0000","last_fullsized":"2023-05-17T15:08:53.233619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243605+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:53.243605+0000","last_peered":"2023-05-17T15:08:53.243605+0000","last_clean":"2023-05-17T15:08:53.243605+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:53.243605+0000","last_undegraded":"2023-05-17T15:08:53.243605+0000","last_fullsized":"2023-05-17T15:08:53.243605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242477+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265196+0000","last_change":"2023-05-17T15:08:54.265196+0000","last_active":"2023-05-17T15:08:54.265196+0000","last_peered":"2023-05-17T15:08:54.265196+0000","last_clean":"2023-05-17T15:08:54.265196+0000","last_became_active":"2023-05-17T15:08:54.264790+0000","last_became_peered":"2023-05-17T15:08:54.264790+0000","last_unstale":"2023-05-17T15:08:54.265196+0000","last_undegraded":"2023-05-17T15:08:54.265196+0000","last_fullsized":"2023-05-17T15:08:54.265196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243669+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:53.243669+0000","last_peered":"2023-05-17T15:08:53.243669+0000","last_clean":"2023-05-17T15:08:53.243669+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:53.243669+0000","last_undegraded":"2023-05-17T15:08:53.243669+0000","last_fullsized":"2023-05-17T15:08:53.243669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244906+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267147+0000","last_change":"2023-05-17T15:08:54.267147+0000","last_active":"2023-05-17T15:08:54.267147+0000","last_peered":"2023-05-17T15:08:54.267147+0000","last_clean":"2023-05-17T15:08:54.267147+0000","last_became_active":"2023-05-17T15:08:54.266723+0000","last_became_peered":"2023-05-17T15:08:54.266723+0000","last_unstale":"2023-05-17T15:08:54.267147+0000","last_undegraded":"2023-05-17T15:08:54.267147+0000","last_fullsized":"2023-05-17T15:08:54.267147+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243760+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:53.243760+0000","last_peered":"2023-05-17T15:08:53.243760+0000","last_clean":"2023-05-17T15:08:53.243760+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:53.243760+0000","last_undegraded":"2023-05-17T15:08:53.243760+0000","last_fullsized":"2023-05-17T15:08:53.243760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245271+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267545+0000","last_change":"2023-05-17T15:08:54.267545+0000","last_active":"2023-05-17T15:08:54.267545+0000","last_peered":"2023-05-17T15:08:54.267545+0000","last_clean":"2023-05-17T15:08:54.267545+0000","last_became_active":"2023-05-17T15:08:54.267190+0000","last_became_peered":"2023-05-17T15:08:54.267190+0000","last_unstale":"2023-05-17T15:08:54.267545+0000","last_undegraded":"2023-05-17T15:08:54.267545+0000","last_fullsized":"2023-05-17T15:08:54.267545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.238191+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:53.238191+0000","last_peered":"2023-05-17T15:08:53.238191+0000","last_clean":"2023-05-17T15:08:53.238191+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:53.238191+0000","last_undegraded":"2023-05-17T15:08:53.238191+0000","last_fullsized":"2023-05-17T15:08:53.238191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249204+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259933+0000","last_change":"2023-05-17T15:08:54.259933+0000","last_active":"2023-05-17T15:08:54.259933+0000","last_peered":"2023-05-17T15:08:54.259933+0000","last_clean":"2023-05-17T15:08:54.259933+0000","last_became_active":"2023-05-17T15:08:54.259624+0000","last_became_peered":"2023-05-17T15:08:54.259624+0000","last_unstale":"2023-05-17T15:08:54.259933+0000","last_undegraded":"2023-05-17T15:08:54.259933+0000","last_fullsized":"2023-05-17T15:08:54.259933+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237664+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:53.237664+0000","last_peered":"2023-05-17T15:08:53.237664+0000","last_clean":"2023-05-17T15:08:53.237664+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:53.237664+0000","last_undegraded":"2023-05-17T15:08:53.237664+0000","last_fullsized":"2023-05-17T15:08:53.237664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17384,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354456,"statfs":{"total":96636764160,"available":96618962944,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.432}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16744,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355096,"statfs":{"total":96636764160,"available":96619618304,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.621}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16552,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355288,"statfs":{"total":96636764160,"available":96619814912,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.50700000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.318,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.52100000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.20000000000000001},"max":{"1min":0.46300000000000002,"5min":1.956,"15min":1.956},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.48299999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.58899999999999997,"5min":1.149,"15min":1.149},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.02},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88}]},{"osd":5,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.873},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.46600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":1.103,"15min":1.6100000000000001},"last":1.044}]},{"osd":6,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.80400000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":1.524,"15min":1.524},"last":0.98399999999999999}]},{"osd":7,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.01},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.40400000000000003},"max":{"1min":0.76200000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16360,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355480,"statfs":{"total":96636764160,"available":96620011520,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.26700000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.5}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17704,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354136,"statfs":{"total":96636764160,"available":96618635264,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.436},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20648,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351192,"statfs":{"total":96636764160,"available":96615620608,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.248},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.32000000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.376},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17000,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354840,"statfs":{"total":96636764160,"available":96619356160,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.61599999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.84999999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20392,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351448,"statfs":{"total":96636764160,"available":96615882752,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.70799999999999996}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:08:58.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-05-17T15:08:58.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.248385+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-05-17T15:08:58.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.250618+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-05-17T15:08:58.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247310+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:58.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-05-17T15:08:58.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.248373+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-05-17T15:08:58.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.249972+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:58.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-05-17T15:08:58.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247630+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-05-17T15:08:58.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244045+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-05-17T15:08:58.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.255819+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:58.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-05-17T15:08:58.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.253822+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:58.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-05-17T15:08:58.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.243736+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-05-17T15:08:58.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245283+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:58.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-05-17T15:08:58.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.248768+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-05-17T15:08:58.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.249466+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:58.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-05-17T15:08:58.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244419+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-05-17T15:08:58.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.251840+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:58.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-05-17T15:08:58.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.246074+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-05-17T15:08:58.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244378+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-05-17T15:08:58.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245789+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-05-17T15:08:58.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.255488+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-05-17T15:08:58.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247517+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-05-17T15:08:58.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.254981+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-05-17T15:08:58.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245000+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:58.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-05-17T15:08:58.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247815+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-05-17T15:08:58.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.252484+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-05-17T15:08:58.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.253316+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:58.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-05-17T15:08:58.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.246828+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-05-17T15:08:58.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.255794+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:58.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-05-17T15:08:58.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.243863+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-05-17T15:08:58.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.253565+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-05-17T15:08:58.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.256174+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:58.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-05-17T15:08:58.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.248102+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:58.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-05-17T15:08:58.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.243114+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-05-17T15:08:58.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245839+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-05-17T15:08:58.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242493+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-05-17T15:08:58.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245350+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-05-17T15:08:58.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244522+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-05-17T15:08:58.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242752+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-05-17T15:08:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242759+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-05-17T15:08:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245894+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-05-17T15:08:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.251525+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-05-17T15:08:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242189+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-05-17T15:08:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245116+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-05-17T15:08:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244819+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-05-17T15:08:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244846+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-05-17T15:08:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.249042+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:08:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-05-17T15:08:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.250241+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-05-17T15:08:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.250993+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-05-17T15:08:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.251077+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-05-17T15:08:58.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.243895+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-05-17T15:08:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247377+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-05-17T15:08:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244773+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:08:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-05-17T15:08:58.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242131+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-05-17T15:08:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247963+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-05-17T15:08:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.247947+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-05-17T15:08:58.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245968+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-05-17T15:08:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245080+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:08:58.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-05-17T15:08:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.255076+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-05-17T15:08:58.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242148+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-05-17T15:08:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.248218+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:08:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-05-17T15:08:58.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.255645+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:08:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-05-17T15:08:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.242477+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:08:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-05-17T15:08:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.244906+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-05-17T15:08:58.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.245271+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:08:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-05-17T15:08:58.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:08:54.228544+0000', 'last_change': '2023-05-17T15:08:54.249204+0000', 'last_active': '2023-05-17T15:08:54.228544+0000', 'last_peered': '2023-05-17T15:08:54.228544+0000', 'last_clean': '2023-05-17T15:08:54.228544+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:08:54.228544+0000', 'last_undegraded': '2023-05-17T15:08:54.228544+0000', 'last_fullsized': '2023-05-17T15:08:54.228544+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'last_clean_scrub_stamp': '2023-05-17T15:08:54.228544+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:08:58.456 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-17T15:08:58.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.568+0000 7fac69952700 1 Processor -- start 2023-05-17T15:08:58.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.568+0000 7fac69952700 1 -- start start 2023-05-17T15:08:58.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac69952700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1320 0x7fac641544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac69952700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fac640c1700 0x7fac64158170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac69952700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac64158660 0x7fac640c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac69952700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac641554b0 con 0x7fac640c1700 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac69952700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac64151ee0 con 0x7fac64158660 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac69952700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac640c8070 con 0x7fac640c1320 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fac640c1700 0x7fac64158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fac640c1700 0x7fac64158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39900/0 (socket says 172.21.15.27:39900) 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 -- 172.21.15.27:0/2090123630 learned_addr learned my addr 172.21.15.27:0/2090123630 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac62ffd700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1320 0x7fac641544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac637fe700 1 --2- 172.21.15.27:0/2090123630 >> v2:172.21.15.40:3300/0 conn(0x7fac64158660 0x7fac640c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 -- 172.21.15.27:0/2090123630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1320 msgr2=0x7fac641544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1320 0x7fac641544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 -- 172.21.15.27:0/2090123630 >> v2:172.21.15.40:3300/0 conn(0x7fac64158660 msgr2=0x7fac640c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:58.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 --2- 172.21.15.27:0/2090123630 >> v2:172.21.15.40:3300/0 conn(0x7fac64158660 0x7fac640c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 -- 172.21.15.27:0/2090123630 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64157ce0 con 0x7fac640c1700 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac62ffd700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1320 0x7fac641544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.569+0000 7fac627fc700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac640c1700 0x7fac64158170 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fac640c5300 tx=0x7fac4c0090f0).ready entity=mon.0 client_cookie=1615896ee78ddf64 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac61ffb700 1 -- 172.21.15.27:0/2090123630 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00b600 con 0x7fac640c1700 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac61ffb700 1 -- 172.21.15.27:0/2090123630 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00b760 con 0x7fac640c1700 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac61ffb700 1 -- 172.21.15.27:0/2090123630 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00bae0 con 0x7fac640c1700 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 -- 172.21.15.27:0/2090123630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac640c1700 msgr2=0x7fac64158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac640c1700 0x7fac64158170 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fac640c5300 tx=0x7fac4c0090f0).stop 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 -- 172.21.15.27:0/2090123630 shutdown_connections 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 --2- 172.21.15.27:0/2090123630 >> v2:172.21.15.40:3300/0 conn(0x7fac64158660 0x7fac640c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1320 0x7fac641544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 --2- 172.21.15.27:0/2090123630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac640c1700 0x7fac64158170 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 -- 172.21.15.27:0/2090123630 >> 172.21.15.27:0/2090123630 conn(0x7fac6405dd50 msgr2=0x7fac6405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 -- 172.21.15.27:0/2090123630 shutdown_connections 2023-05-17T15:08:58.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.570+0000 7fac69952700 1 -- 172.21.15.27:0/2090123630 wait complete. 2023-05-17T15:08:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.571+0000 7fac69952700 1 Processor -- start 2023-05-17T15:08:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.571+0000 7fac69952700 1 -- start start 2023-05-17T15:08:58.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac69952700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac640c1320 0x7fac640c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac69952700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1700 0x7fac641555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac69952700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 0x7fac641455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac69952700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac64156a50 con 0x7fac64158660 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac69952700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac64156ee0 con 0x7fac640c1320 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac69952700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac64155e40 con 0x7fac640c1700 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 0x7fac641455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 0x7fac641455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39908/0 (socket says 172.21.15.27:39908) 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 -- 172.21.15.27:0/1254914635 learned_addr learned my addr 172.21.15.27:0/1254914635 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac62ffd700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac640c1320 0x7fac640c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac627fc700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1700 0x7fac641555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 -- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1700 msgr2=0x7fac641555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1700 0x7fac641555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 -- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac640c1320 msgr2=0x7fac640c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac640c1320 0x7fac640c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.572+0000 7fac637fe700 1 -- 172.21.15.27:0/1254914635 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009370 con 0x7fac64158660 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.573+0000 7fac637fe700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 0x7fac641455b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fac5400ceb0 tx=0x7fac54007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.573+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400ae40 con 0x7fac64158660 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.573+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54016400 con 0x7fac64158660 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.573+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac64156120 con 0x7fac64158660 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.573+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540167a0 con 0x7fac64158660 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.573+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac641566e0 con 0x7fac64158660 2023-05-17T15:08:58.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.574+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac640689d0 con 0x7fac64158660 2023-05-17T15:08:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.574+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fac5401d060 con 0x7fac64158660 2023-05-17T15:08:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.574+0000 7fac5affd700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac4405ed90 0x7fac44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.574+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fac5407a1e0 con 0x7fac64158660 2023-05-17T15:08:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.575+0000 7fac62ffd700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac4405ed90 0x7fac44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.575+0000 7fac62ffd700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac4405ed90 0x7fac44061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fac5c00a9d0 tx=0x7fac5c008040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.579+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac5404b730 con 0x7fac64158660 2023-05-17T15:08:58.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.823+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fac640bfd20 con 0x7fac64158660 2023-05-17T15:08:58.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.823+0000 7fac5affd700 1 -- 172.21.15.27:0/1254914635 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1032 (secure 0 0 0) 0x7fac5401b080 con 0x7fac64158660 2023-05-17T15:08:58.827 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:58.828 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":924,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":97,"num_osds":8,"num_up_osds":8,"osd_up_since":1684335223,"num_in_osds":8,"osd_in_since":1684335217,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":64}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":146210816,"bytes_avail":772947902464,"bytes_total":773094113280,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":36,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6654}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-05-17T15:07:12.655393+0000","services":{}},"progress_events":{}} 2023-05-17T15:08:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac4405ed90 msgr2=0x7fac44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac4405ed90 0x7fac44061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fac5c00a9d0 tx=0x7fac5c008040).stop 2023-05-17T15:08:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 msgr2=0x7fac641455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 0x7fac641455b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fac5400ceb0 tx=0x7fac54007870).stop 2023-05-17T15:08:58.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 shutdown_connections 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac4405ed90 0x7fac44061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac64158660 0x7fac641455b0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac640c1320 0x7fac640c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 --2- 172.21.15.27:0/1254914635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac640c1700 0x7fac641555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 >> 172.21.15.27:0/1254914635 conn(0x7fac6405dd50 msgr2=0x7fac64151650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 shutdown_connections 2023-05-17T15:08:58.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.825+0000 7fac69952700 1 -- 172.21.15.27:0/1254914635 wait complete. 2023-05-17T15:08:58.841 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-17T15:08:58.841 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:08:58.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.953+0000 7f06b15b6700 1 Processor -- start 2023-05-17T15:08:58.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.953+0000 7f06b15b6700 1 -- start start 2023-05-17T15:08:58.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06b15b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06ac0c5ef0 0x7f06ac0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06b15b6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06ac0cb470 0x7f06ac0a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06b15b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac153bf0 0x7f06ac154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06b15b6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0c05f0 con 0x7f06ac0cb470 2023-05-17T15:08:58.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06b15b6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0aa240 con 0x7f06ac0c5ef0 2023-05-17T15:08:58.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06b15b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac154570 con 0x7f06ac153bf0 2023-05-17T15:08:58.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06aa7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06ac0cb470 0x7f06ac0a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06aa7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06ac0cb470 0x7f06ac0a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39914/0 (socket says 172.21.15.27:39914) 2023-05-17T15:08:58.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06aa7fc700 1 -- 172.21.15.27:0/4126168739 learned_addr learned my addr 172.21.15.27:0/4126168739 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06ab7fe700 1 --2- 172.21.15.27:0/4126168739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac153bf0 0x7f06ac154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.954+0000 7f06aaffd700 1 --2- 172.21.15.27:0/4126168739 >> v2:172.21.15.40:3300/0 conn(0x7f06ac0c5ef0 0x7f06ac0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06aa7fc700 1 -- 172.21.15.27:0/4126168739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac153bf0 msgr2=0x7f06ac154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06aa7fc700 1 --2- 172.21.15.27:0/4126168739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac153bf0 0x7f06ac154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06aa7fc700 1 -- 172.21.15.27:0/4126168739 >> v2:172.21.15.40:3300/0 conn(0x7f06ac0c5ef0 msgr2=0x7f06ac0c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06aa7fc700 1 --2- 172.21.15.27:0/4126168739 >> v2:172.21.15.40:3300/0 conn(0x7f06ac0c5ef0 0x7f06ac0c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06aa7fc700 1 -- 172.21.15.27:0/4126168739 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0aa510 con 0x7f06ac0cb470 2023-05-17T15:08:58.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06aa7fc700 1 --2- 172.21.15.27:0/4126168739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac0cb470 0x7f06ac0a9d50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f06ac05ec50 tx=0x7f06940090f0).ready entity=mon.0 client_cookie=fb652edb723db1f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06a9ffb700 1 -- 172.21.15.27:0/4126168739 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400b600 con 0x7f06ac0cb470 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06a9ffb700 1 -- 172.21.15.27:0/4126168739 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400b760 con 0x7f06ac0cb470 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06a9ffb700 1 -- 172.21.15.27:0/4126168739 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400bae0 con 0x7f06ac0cb470 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 -- 172.21.15.27:0/4126168739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac0cb470 msgr2=0x7f06ac0a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 --2- 172.21.15.27:0/4126168739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac0cb470 0x7f06ac0a9d50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f06ac05ec50 tx=0x7f06940090f0).stop 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 -- 172.21.15.27:0/4126168739 shutdown_connections 2023-05-17T15:08:58.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 --2- 172.21.15.27:0/4126168739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac153bf0 0x7f06ac154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 --2- 172.21.15.27:0/4126168739 >> v2:172.21.15.40:3300/0 conn(0x7f06ac0c5ef0 0x7f06ac0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 --2- 172.21.15.27:0/4126168739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac0cb470 0x7f06ac0a9d50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 -- 172.21.15.27:0/4126168739 >> 172.21.15.27:0/4126168739 conn(0x7f06ac05e810 msgr2=0x7f06ac0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 -- 172.21.15.27:0/4126168739 shutdown_connections 2023-05-17T15:08:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.955+0000 7f06b15b6700 1 -- 172.21.15.27:0/4126168739 wait complete. 2023-05-17T15:08:58.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 Processor -- start 2023-05-17T15:08:58.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 -- start start 2023-05-17T15:08:58.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac0c5ef0 0x7f06ac144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06ac0cb470 0x7f06ac1690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 0x7f06ac0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac144d80 con 0x7f06ac153bf0 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac147590 con 0x7f06ac0cb470 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.957+0000 7f06b15b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac147a20 con 0x7f06ac0c5ef0 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 0x7f06ac0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 0x7f06ac0c0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39920/0 (socket says 172.21.15.27:39920) 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 -- 172.21.15.27:0/802050376 learned_addr learned my addr 172.21.15.27:0/802050376 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06aaffd700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac0c5ef0 0x7f06ac144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06aa7fc700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06ac0cb470 0x7f06ac1690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 -- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac0c5ef0 msgr2=0x7f06ac144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac0c5ef0 0x7f06ac144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 -- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06ac0cb470 msgr2=0x7f06ac1690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06ac0cb470 0x7f06ac1690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 -- 172.21.15.27:0/802050376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009370 con 0x7f06ac153bf0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06ab7fe700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 0x7f06ac0c0a80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f069c007f80 tx=0x7f069c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00ebf0 con 0x7f06ac153bf0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00ed50 con 0x7f06ac153bf0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c014610 con 0x7f06ac153bf0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac1695e0 con 0x7f06ac153bf0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.958+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac146c60 con 0x7f06ac153bf0 2023-05-17T15:08:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.959+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac05f4a0 con 0x7f06ac153bf0 2023-05-17T15:08:58.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.960+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f069c01b030 con 0x7f06ac153bf0 2023-05-17T15:08:58.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.960+0000 7f06a2ffd700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f068c05ed90 0x7f068c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:08:58.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.960+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f069c079d70 con 0x7f06ac153bf0 2023-05-17T15:08:58.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.960+0000 7f06aaffd700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f068c05ed90 0x7f068c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:08:58.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.960+0000 7f06aaffd700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f068c05ed90 0x7f068c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f06a400bbc0 tx=0x7f06a4008040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:08:58.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:58.964+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f069c04b260 con 0x7f06ac153bf0 2023-05-17T15:08:59.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.132+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06ac06be60 con 0x7f068c05ed90 2023-05-17T15:08:59.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.142+0000 7f06a2ffd700 1 -- 172.21.15.27:0/802050376 <== mgr.6462 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358332 (secure 0 0 0) 0x7f06ac06be60 con 0x7f068c05ed90 2023-05-17T15:08:59.149 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:08:59.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.145+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f068c05ed90 msgr2=0x7f068c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:59.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.145+0000 7f06b15b6700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f068c05ed90 0x7f068c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f06a400bbc0 tx=0x7f06a4008040).stop 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.145+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 msgr2=0x7f06ac0c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.145+0000 7f06b15b6700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 0x7f06ac0c0a80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f069c007f80 tx=0x7f069c009860).stop 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.145+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 shutdown_connections 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.145+0000 7f06b15b6700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f068c05ed90 0x7f068c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.146+0000 7f06b15b6700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac153bf0 0x7f06ac0c0a80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.146+0000 7f06b15b6700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06ac0c5ef0 0x7f06ac144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.146+0000 7f06b15b6700 1 --2- 172.21.15.27:0/802050376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06ac0cb470 0x7f06ac1690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:08:59.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.146+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 >> 172.21.15.27:0/802050376 conn(0x7f06ac05e810 msgr2=0x7f06ac0ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:08:59.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.146+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 shutdown_connections 2023-05-17T15:08:59.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:08:59.146+0000 7f06b15b6700 1 -- 172.21.15.27:0/802050376 wait complete. 2023-05-17T15:08:59.153 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:08:59.161 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:08:57.475488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":142784,"kb_used_data":8960,"kb_used_omap":0,"kb_used_meta":133760,"kb_avail":754831936,"statfs":{"total":773094113280,"available":772947902464,"internally_reserved":0,"allocated":9175040,"data_stored":4579296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136970240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10154,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-60,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.171693"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248385+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270583+0000","last_change":"2023-05-17T15:08:54.270583+0000","last_active":"2023-05-17T15:08:54.270583+0000","last_peered":"2023-05-17T15:08:54.270583+0000","last_clean":"2023-05-17T15:08:54.270583+0000","last_became_active":"2023-05-17T15:08:54.270277+0000","last_became_peered":"2023-05-17T15:08:54.270277+0000","last_unstale":"2023-05-17T15:08:54.270583+0000","last_undegraded":"2023-05-17T15:08:54.270583+0000","last_fullsized":"2023-05-17T15:08:54.270583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250618+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258220+0000","last_change":"2023-05-17T15:08:54.258220+0000","last_active":"2023-05-17T15:08:54.258220+0000","last_peered":"2023-05-17T15:08:54.258220+0000","last_clean":"2023-05-17T15:08:54.258220+0000","last_became_active":"2023-05-17T15:08:54.257897+0000","last_became_peered":"2023-05-17T15:08:54.257897+0000","last_unstale":"2023-05-17T15:08:54.258220+0000","last_undegraded":"2023-05-17T15:08:54.258220+0000","last_fullsized":"2023-05-17T15:08:54.258220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247310+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.250930+0000","last_change":"2023-05-17T15:08:54.250930+0000","last_active":"2023-05-17T15:08:54.250930+0000","last_peered":"2023-05-17T15:08:54.250930+0000","last_clean":"2023-05-17T15:08:54.250930+0000","last_became_active":"2023-05-17T15:08:54.250648+0000","last_became_peered":"2023-05-17T15:08:54.250648+0000","last_unstale":"2023-05-17T15:08:54.250930+0000","last_undegraded":"2023-05-17T15:08:54.250930+0000","last_fullsized":"2023-05-17T15:08:54.250930+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248373+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260661+0000","last_change":"2023-05-17T15:08:54.260661+0000","last_active":"2023-05-17T15:08:54.260661+0000","last_peered":"2023-05-17T15:08:54.260661+0000","last_clean":"2023-05-17T15:08:54.260661+0000","last_became_active":"2023-05-17T15:08:54.260378+0000","last_became_peered":"2023-05-17T15:08:54.260378+0000","last_unstale":"2023-05-17T15:08:54.260661+0000","last_undegraded":"2023-05-17T15:08:54.260661+0000","last_fullsized":"2023-05-17T15:08:54.260661+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249972+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263402+0000","last_change":"2023-05-17T15:08:54.263402+0000","last_active":"2023-05-17T15:08:54.263402+0000","last_peered":"2023-05-17T15:08:54.263402+0000","last_clean":"2023-05-17T15:08:54.263402+0000","last_became_active":"2023-05-17T15:08:54.263067+0000","last_became_peered":"2023-05-17T15:08:54.263067+0000","last_unstale":"2023-05-17T15:08:54.263402+0000","last_undegraded":"2023-05-17T15:08:54.263402+0000","last_fullsized":"2023-05-17T15:08:54.263402+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247630+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258314+0000","last_change":"2023-05-17T15:08:54.258314+0000","last_active":"2023-05-17T15:08:54.258314+0000","last_peered":"2023-05-17T15:08:54.258314+0000","last_clean":"2023-05-17T15:08:54.258314+0000","last_became_active":"2023-05-17T15:08:54.258080+0000","last_became_peered":"2023-05-17T15:08:54.258080+0000","last_unstale":"2023-05-17T15:08:54.258314+0000","last_undegraded":"2023-05-17T15:08:54.258314+0000","last_fullsized":"2023-05-17T15:08:54.258314+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244045+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259205+0000","last_change":"2023-05-17T15:08:54.259205+0000","last_active":"2023-05-17T15:08:54.259205+0000","last_peered":"2023-05-17T15:08:54.259205+0000","last_clean":"2023-05-17T15:08:54.259205+0000","last_became_active":"2023-05-17T15:08:54.258893+0000","last_became_peered":"2023-05-17T15:08:54.258893+0000","last_unstale":"2023-05-17T15:08:54.259205+0000","last_undegraded":"2023-05-17T15:08:54.259205+0000","last_fullsized":"2023-05-17T15:08:54.259205+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255408+0000","last_change":"2023-05-17T15:08:54.255408+0000","last_active":"2023-05-17T15:08:54.255408+0000","last_peered":"2023-05-17T15:08:54.255408+0000","last_clean":"2023-05-17T15:08:54.255408+0000","last_became_active":"2023-05-17T15:08:54.255099+0000","last_became_peered":"2023-05-17T15:08:54.255099+0000","last_unstale":"2023-05-17T15:08:54.255408+0000","last_undegraded":"2023-05-17T15:08:54.255408+0000","last_fullsized":"2023-05-17T15:08:54.255408+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253822+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260817+0000","last_change":"2023-05-17T15:08:54.260817+0000","last_active":"2023-05-17T15:08:54.260817+0000","last_peered":"2023-05-17T15:08:54.260817+0000","last_clean":"2023-05-17T15:08:54.260817+0000","last_became_active":"2023-05-17T15:08:54.260540+0000","last_became_peered":"2023-05-17T15:08:54.260540+0000","last_unstale":"2023-05-17T15:08:54.260817+0000","last_undegraded":"2023-05-17T15:08:54.260817+0000","last_fullsized":"2023-05-17T15:08:54.260817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243736+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259817+0000","last_change":"2023-05-17T15:08:54.259817+0000","last_active":"2023-05-17T15:08:54.259817+0000","last_peered":"2023-05-17T15:08:54.259817+0000","last_clean":"2023-05-17T15:08:54.259817+0000","last_became_active":"2023-05-17T15:08:54.258343+0000","last_became_peered":"2023-05-17T15:08:54.258343+0000","last_unstale":"2023-05-17T15:08:54.259817+0000","last_undegraded":"2023-05-17T15:08:54.259817+0000","last_fullsized":"2023-05-17T15:08:54.259817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245283+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268125+0000","last_change":"2023-05-17T15:08:54.268125+0000","last_active":"2023-05-17T15:08:54.268125+0000","last_peered":"2023-05-17T15:08:54.268125+0000","last_clean":"2023-05-17T15:08:54.268125+0000","last_became_active":"2023-05-17T15:08:54.265254+0000","last_became_peered":"2023-05-17T15:08:54.265254+0000","last_unstale":"2023-05-17T15:08:54.268125+0000","last_undegraded":"2023-05-17T15:08:54.268125+0000","last_fullsized":"2023-05-17T15:08:54.268125+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248768+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267294+0000","last_change":"2023-05-17T15:08:54.267294+0000","last_active":"2023-05-17T15:08:54.267294+0000","last_peered":"2023-05-17T15:08:54.267294+0000","last_clean":"2023-05-17T15:08:54.267294+0000","last_became_active":"2023-05-17T15:08:54.266970+0000","last_became_peered":"2023-05-17T15:08:54.266970+0000","last_unstale":"2023-05-17T15:08:54.267294+0000","last_undegraded":"2023-05-17T15:08:54.267294+0000","last_fullsized":"2023-05-17T15:08:54.267294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249466+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.252483+0000","last_change":"2023-05-17T15:08:54.252483+0000","last_active":"2023-05-17T15:08:54.252483+0000","last_peered":"2023-05-17T15:08:54.252483+0000","last_clean":"2023-05-17T15:08:54.252483+0000","last_became_active":"2023-05-17T15:08:54.252178+0000","last_became_peered":"2023-05-17T15:08:54.252178+0000","last_unstale":"2023-05-17T15:08:54.252483+0000","last_undegraded":"2023-05-17T15:08:54.252483+0000","last_fullsized":"2023-05-17T15:08:54.252483+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244419+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267320+0000","last_change":"2023-05-17T15:08:54.267320+0000","last_active":"2023-05-17T15:08:54.267320+0000","last_peered":"2023-05-17T15:08:54.267320+0000","last_clean":"2023-05-17T15:08:54.267320+0000","last_became_active":"2023-05-17T15:08:54.267043+0000","last_became_peered":"2023-05-17T15:08:54.267043+0000","last_unstale":"2023-05-17T15:08:54.267320+0000","last_undegraded":"2023-05-17T15:08:54.267320+0000","last_fullsized":"2023-05-17T15:08:54.267320+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251840+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259020+0000","last_change":"2023-05-17T15:08:54.259020+0000","last_active":"2023-05-17T15:08:54.259020+0000","last_peered":"2023-05-17T15:08:54.259020+0000","last_clean":"2023-05-17T15:08:54.259020+0000","last_became_active":"2023-05-17T15:08:54.258736+0000","last_became_peered":"2023-05-17T15:08:54.258736+0000","last_unstale":"2023-05-17T15:08:54.259020+0000","last_undegraded":"2023-05-17T15:08:54.259020+0000","last_fullsized":"2023-05-17T15:08:54.259020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246074+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264896+0000","last_change":"2023-05-17T15:08:54.264896+0000","last_active":"2023-05-17T15:08:54.264896+0000","last_peered":"2023-05-17T15:08:54.264896+0000","last_clean":"2023-05-17T15:08:54.264896+0000","last_became_active":"2023-05-17T15:08:54.264559+0000","last_became_peered":"2023-05-17T15:08:54.264559+0000","last_unstale":"2023-05-17T15:08:54.264896+0000","last_undegraded":"2023-05-17T15:08:54.264896+0000","last_fullsized":"2023-05-17T15:08:54.264896+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244378+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260860+0000","last_change":"2023-05-17T15:08:54.260860+0000","last_active":"2023-05-17T15:08:54.260860+0000","last_peered":"2023-05-17T15:08:54.260860+0000","last_clean":"2023-05-17T15:08:54.260860+0000","last_became_active":"2023-05-17T15:08:54.260308+0000","last_became_peered":"2023-05-17T15:08:54.260308+0000","last_unstale":"2023-05-17T15:08:54.260860+0000","last_undegraded":"2023-05-17T15:08:54.260860+0000","last_fullsized":"2023-05-17T15:08:54.260860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245789+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260850+0000","last_change":"2023-05-17T15:08:54.260850+0000","last_active":"2023-05-17T15:08:54.260850+0000","last_peered":"2023-05-17T15:08:54.260850+0000","last_clean":"2023-05-17T15:08:54.260850+0000","last_became_active":"2023-05-17T15:08:54.260631+0000","last_became_peered":"2023-05-17T15:08:54.260631+0000","last_unstale":"2023-05-17T15:08:54.260850+0000","last_undegraded":"2023-05-17T15:08:54.260850+0000","last_fullsized":"2023-05-17T15:08:54.260850+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255488+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253863+0000","last_change":"2023-05-17T15:08:54.253863+0000","last_active":"2023-05-17T15:08:54.253863+0000","last_peered":"2023-05-17T15:08:54.253863+0000","last_clean":"2023-05-17T15:08:54.253863+0000","last_became_active":"2023-05-17T15:08:54.253355+0000","last_became_peered":"2023-05-17T15:08:54.253355+0000","last_unstale":"2023-05-17T15:08:54.253863+0000","last_undegraded":"2023-05-17T15:08:54.253863+0000","last_fullsized":"2023-05-17T15:08:54.253863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247517+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.256858+0000","last_change":"2023-05-17T15:08:54.256858+0000","last_active":"2023-05-17T15:08:54.256858+0000","last_peered":"2023-05-17T15:08:54.256858+0000","last_clean":"2023-05-17T15:08:54.256858+0000","last_became_active":"2023-05-17T15:08:54.256602+0000","last_became_peered":"2023-05-17T15:08:54.256602+0000","last_unstale":"2023-05-17T15:08:54.256858+0000","last_undegraded":"2023-05-17T15:08:54.256858+0000","last_fullsized":"2023-05-17T15:08:54.256858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.254981+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251958+0000","last_change":"2023-05-17T15:08:54.251958+0000","last_active":"2023-05-17T15:08:54.251958+0000","last_peered":"2023-05-17T15:08:54.251958+0000","last_clean":"2023-05-17T15:08:54.251958+0000","last_became_active":"2023-05-17T15:08:54.251695+0000","last_became_peered":"2023-05-17T15:08:54.251695+0000","last_unstale":"2023-05-17T15:08:54.251958+0000","last_undegraded":"2023-05-17T15:08:54.251958+0000","last_fullsized":"2023-05-17T15:08:54.251958+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245000+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268177+0000","last_change":"2023-05-17T15:08:54.268177+0000","last_active":"2023-05-17T15:08:54.268177+0000","last_peered":"2023-05-17T15:08:54.268177+0000","last_clean":"2023-05-17T15:08:54.268177+0000","last_became_active":"2023-05-17T15:08:54.267884+0000","last_became_peered":"2023-05-17T15:08:54.267884+0000","last_unstale":"2023-05-17T15:08:54.268177+0000","last_undegraded":"2023-05-17T15:08:54.268177+0000","last_fullsized":"2023-05-17T15:08:54.268177+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247815+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268435+0000","last_change":"2023-05-17T15:08:54.268435+0000","last_active":"2023-05-17T15:08:54.268435+0000","last_peered":"2023-05-17T15:08:54.268435+0000","last_clean":"2023-05-17T15:08:54.268435+0000","last_became_active":"2023-05-17T15:08:54.267475+0000","last_became_peered":"2023-05-17T15:08:54.267475+0000","last_unstale":"2023-05-17T15:08:54.268435+0000","last_undegraded":"2023-05-17T15:08:54.268435+0000","last_fullsized":"2023-05-17T15:08:54.268435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.252484+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265806+0000","last_change":"2023-05-17T15:08:54.265806+0000","last_active":"2023-05-17T15:08:54.265806+0000","last_peered":"2023-05-17T15:08:54.265806+0000","last_clean":"2023-05-17T15:08:54.265806+0000","last_became_active":"2023-05-17T15:08:54.265547+0000","last_became_peered":"2023-05-17T15:08:54.265547+0000","last_unstale":"2023-05-17T15:08:54.265806+0000","last_undegraded":"2023-05-17T15:08:54.265806+0000","last_fullsized":"2023-05-17T15:08:54.265806+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253316+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261359+0000","last_change":"2023-05-17T15:08:54.261359+0000","last_active":"2023-05-17T15:08:54.261359+0000","last_peered":"2023-05-17T15:08:54.261359+0000","last_clean":"2023-05-17T15:08:54.261359+0000","last_became_active":"2023-05-17T15:08:54.261079+0000","last_became_peered":"2023-05-17T15:08:54.261079+0000","last_unstale":"2023-05-17T15:08:54.261359+0000","last_undegraded":"2023-05-17T15:08:54.261359+0000","last_fullsized":"2023-05-17T15:08:54.261359+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.246828+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262457+0000","last_change":"2023-05-17T15:08:54.262457+0000","last_active":"2023-05-17T15:08:54.262457+0000","last_peered":"2023-05-17T15:08:54.262457+0000","last_clean":"2023-05-17T15:08:54.262457+0000","last_became_active":"2023-05-17T15:08:54.262186+0000","last_became_peered":"2023-05-17T15:08:54.262186+0000","last_unstale":"2023-05-17T15:08:54.262457+0000","last_undegraded":"2023-05-17T15:08:54.262457+0000","last_fullsized":"2023-05-17T15:08:54.262457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255794+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262152+0000","last_change":"2023-05-17T15:08:54.262152+0000","last_active":"2023-05-17T15:08:54.262152+0000","last_peered":"2023-05-17T15:08:54.262152+0000","last_clean":"2023-05-17T15:08:54.262152+0000","last_became_active":"2023-05-17T15:08:54.261899+0000","last_became_peered":"2023-05-17T15:08:54.261899+0000","last_unstale":"2023-05-17T15:08:54.262152+0000","last_undegraded":"2023-05-17T15:08:54.262152+0000","last_fullsized":"2023-05-17T15:08:54.262152+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243863+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268108+0000","last_change":"2023-05-17T15:08:54.268108+0000","last_active":"2023-05-17T15:08:54.268108+0000","last_peered":"2023-05-17T15:08:54.268108+0000","last_clean":"2023-05-17T15:08:54.268108+0000","last_became_active":"2023-05-17T15:08:54.267836+0000","last_became_peered":"2023-05-17T15:08:54.267836+0000","last_unstale":"2023-05-17T15:08:54.268108+0000","last_undegraded":"2023-05-17T15:08:54.268108+0000","last_fullsized":"2023-05-17T15:08:54.268108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.253565+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.249785+0000","last_change":"2023-05-17T15:08:54.249785+0000","last_active":"2023-05-17T15:08:54.249785+0000","last_peered":"2023-05-17T15:08:54.249785+0000","last_clean":"2023-05-17T15:08:54.249785+0000","last_became_active":"2023-05-17T15:08:54.249456+0000","last_became_peered":"2023-05-17T15:08:54.249456+0000","last_unstale":"2023-05-17T15:08:54.249785+0000","last_undegraded":"2023-05-17T15:08:54.249785+0000","last_fullsized":"2023-05-17T15:08:54.249785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.256174+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.261281+0000","last_change":"2023-05-17T15:08:54.261281+0000","last_active":"2023-05-17T15:08:54.261281+0000","last_peered":"2023-05-17T15:08:54.261281+0000","last_clean":"2023-05-17T15:08:54.261281+0000","last_became_active":"2023-05-17T15:08:54.260987+0000","last_became_peered":"2023-05-17T15:08:54.260987+0000","last_unstale":"2023-05-17T15:08:54.261281+0000","last_undegraded":"2023-05-17T15:08:54.261281+0000","last_fullsized":"2023-05-17T15:08:54.261281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248102+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258001+0000","last_change":"2023-05-17T15:08:54.258001+0000","last_active":"2023-05-17T15:08:54.258001+0000","last_peered":"2023-05-17T15:08:54.258001+0000","last_clean":"2023-05-17T15:08:54.258001+0000","last_became_active":"2023-05-17T15:08:54.257718+0000","last_became_peered":"2023-05-17T15:08:54.257718+0000","last_unstale":"2023-05-17T15:08:54.258001+0000","last_undegraded":"2023-05-17T15:08:54.258001+0000","last_fullsized":"2023-05-17T15:08:54.258001+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243114+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262074+0000","last_change":"2023-05-17T15:08:54.262074+0000","last_active":"2023-05-17T15:08:54.262074+0000","last_peered":"2023-05-17T15:08:54.262074+0000","last_clean":"2023-05-17T15:08:54.262074+0000","last_became_active":"2023-05-17T15:08:54.261719+0000","last_became_peered":"2023-05-17T15:08:54.261719+0000","last_unstale":"2023-05-17T15:08:54.262074+0000","last_undegraded":"2023-05-17T15:08:54.262074+0000","last_fullsized":"2023-05-17T15:08:54.262074+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245839+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260568+0000","last_change":"2023-05-17T15:08:54.260568+0000","last_active":"2023-05-17T15:08:54.260568+0000","last_peered":"2023-05-17T15:08:54.260568+0000","last_clean":"2023-05-17T15:08:54.260568+0000","last_became_active":"2023-05-17T15:08:54.260238+0000","last_became_peered":"2023-05-17T15:08:54.260238+0000","last_unstale":"2023-05-17T15:08:54.260568+0000","last_undegraded":"2023-05-17T15:08:54.260568+0000","last_fullsized":"2023-05-17T15:08:54.260568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242493+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267741+0000","last_change":"2023-05-17T15:08:54.267741+0000","last_active":"2023-05-17T15:08:54.267741+0000","last_peered":"2023-05-17T15:08:54.267741+0000","last_clean":"2023-05-17T15:08:54.267741+0000","last_became_active":"2023-05-17T15:08:54.267400+0000","last_became_peered":"2023-05-17T15:08:54.267400+0000","last_unstale":"2023-05-17T15:08:54.267741+0000","last_undegraded":"2023-05-17T15:08:54.267741+0000","last_fullsized":"2023-05-17T15:08:54.267741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245350+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267917+0000","last_change":"2023-05-17T15:08:54.267917+0000","last_active":"2023-05-17T15:08:54.267917+0000","last_peered":"2023-05-17T15:08:54.267917+0000","last_clean":"2023-05-17T15:08:54.267917+0000","last_became_active":"2023-05-17T15:08:54.265748+0000","last_became_peered":"2023-05-17T15:08:54.265748+0000","last_unstale":"2023-05-17T15:08:54.267917+0000","last_undegraded":"2023-05-17T15:08:54.267917+0000","last_fullsized":"2023-05-17T15:08:54.267917+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244522+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262729+0000","last_change":"2023-05-17T15:08:54.262729+0000","last_active":"2023-05-17T15:08:54.262729+0000","last_peered":"2023-05-17T15:08:54.262729+0000","last_clean":"2023-05-17T15:08:54.262729+0000","last_became_active":"2023-05-17T15:08:54.261926+0000","last_became_peered":"2023-05-17T15:08:54.261926+0000","last_unstale":"2023-05-17T15:08:54.262729+0000","last_undegraded":"2023-05-17T15:08:54.262729+0000","last_fullsized":"2023-05-17T15:08:54.262729+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242752+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263505+0000","last_change":"2023-05-17T15:08:54.263505+0000","last_active":"2023-05-17T15:08:54.263505+0000","last_peered":"2023-05-17T15:08:54.263505+0000","last_clean":"2023-05-17T15:08:54.263505+0000","last_became_active":"2023-05-17T15:08:54.263203+0000","last_became_peered":"2023-05-17T15:08:54.263203+0000","last_unstale":"2023-05-17T15:08:54.263505+0000","last_undegraded":"2023-05-17T15:08:54.263505+0000","last_fullsized":"2023-05-17T15:08:54.263505+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242759+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254900+0000","last_change":"2023-05-17T15:08:54.254900+0000","last_active":"2023-05-17T15:08:54.254900+0000","last_peered":"2023-05-17T15:08:54.254900+0000","last_clean":"2023-05-17T15:08:54.254900+0000","last_became_active":"2023-05-17T15:08:54.254602+0000","last_became_peered":"2023-05-17T15:08:54.254602+0000","last_unstale":"2023-05-17T15:08:54.254900+0000","last_undegraded":"2023-05-17T15:08:54.254900+0000","last_fullsized":"2023-05-17T15:08:54.254900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245894+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262186+0000","last_change":"2023-05-17T15:08:54.262186+0000","last_active":"2023-05-17T15:08:54.262186+0000","last_peered":"2023-05-17T15:08:54.262186+0000","last_clean":"2023-05-17T15:08:54.262186+0000","last_became_active":"2023-05-17T15:08:54.261879+0000","last_became_peered":"2023-05-17T15:08:54.261879+0000","last_unstale":"2023-05-17T15:08:54.262186+0000","last_undegraded":"2023-05-17T15:08:54.262186+0000","last_fullsized":"2023-05-17T15:08:54.262186+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251525+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257705+0000","last_change":"2023-05-17T15:08:54.257705+0000","last_active":"2023-05-17T15:08:54.257705+0000","last_peered":"2023-05-17T15:08:54.257705+0000","last_clean":"2023-05-17T15:08:54.257705+0000","last_became_active":"2023-05-17T15:08:54.257412+0000","last_became_peered":"2023-05-17T15:08:54.257412+0000","last_unstale":"2023-05-17T15:08:54.257705+0000","last_undegraded":"2023-05-17T15:08:54.257705+0000","last_fullsized":"2023-05-17T15:08:54.257705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242189+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268207+0000","last_change":"2023-05-17T15:08:54.268207+0000","last_active":"2023-05-17T15:08:54.268207+0000","last_peered":"2023-05-17T15:08:54.268207+0000","last_clean":"2023-05-17T15:08:54.268207+0000","last_became_active":"2023-05-17T15:08:54.267927+0000","last_became_peered":"2023-05-17T15:08:54.267927+0000","last_unstale":"2023-05-17T15:08:54.268207+0000","last_undegraded":"2023-05-17T15:08:54.268207+0000","last_fullsized":"2023-05-17T15:08:54.268207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245116+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.263854+0000","last_change":"2023-05-17T15:08:54.263854+0000","last_active":"2023-05-17T15:08:54.263854+0000","last_peered":"2023-05-17T15:08:54.263854+0000","last_clean":"2023-05-17T15:08:54.263854+0000","last_became_active":"2023-05-17T15:08:54.263569+0000","last_became_peered":"2023-05-17T15:08:54.263569+0000","last_unstale":"2023-05-17T15:08:54.263854+0000","last_undegraded":"2023-05-17T15:08:54.263854+0000","last_fullsized":"2023-05-17T15:08:54.263854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244819+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258048+0000","last_change":"2023-05-17T15:08:54.258048+0000","last_active":"2023-05-17T15:08:54.258048+0000","last_peered":"2023-05-17T15:08:54.258048+0000","last_clean":"2023-05-17T15:08:54.258048+0000","last_became_active":"2023-05-17T15:08:54.257755+0000","last_became_peered":"2023-05-17T15:08:54.257755+0000","last_unstale":"2023-05-17T15:08:54.258048+0000","last_undegraded":"2023-05-17T15:08:54.258048+0000","last_fullsized":"2023-05-17T15:08:54.258048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244846+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258271+0000","last_change":"2023-05-17T15:08:54.258271+0000","last_active":"2023-05-17T15:08:54.258271+0000","last_peered":"2023-05-17T15:08:54.258271+0000","last_clean":"2023-05-17T15:08:54.258271+0000","last_became_active":"2023-05-17T15:08:54.257940+0000","last_became_peered":"2023-05-17T15:08:54.257940+0000","last_unstale":"2023-05-17T15:08:54.258271+0000","last_undegraded":"2023-05-17T15:08:54.258271+0000","last_fullsized":"2023-05-17T15:08:54.258271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249042+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.255246+0000","last_change":"2023-05-17T15:08:54.255246+0000","last_active":"2023-05-17T15:08:54.255246+0000","last_peered":"2023-05-17T15:08:54.255246+0000","last_clean":"2023-05-17T15:08:54.255246+0000","last_became_active":"2023-05-17T15:08:54.254774+0000","last_became_peered":"2023-05-17T15:08:54.254774+0000","last_unstale":"2023-05-17T15:08:54.255246+0000","last_undegraded":"2023-05-17T15:08:54.255246+0000","last_fullsized":"2023-05-17T15:08:54.255246+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250241+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.270579+0000","last_change":"2023-05-17T15:08:54.270579+0000","last_active":"2023-05-17T15:08:54.270579+0000","last_peered":"2023-05-17T15:08:54.270579+0000","last_clean":"2023-05-17T15:08:54.270579+0000","last_became_active":"2023-05-17T15:08:54.270231+0000","last_became_peered":"2023-05-17T15:08:54.270231+0000","last_unstale":"2023-05-17T15:08:54.270579+0000","last_undegraded":"2023-05-17T15:08:54.270579+0000","last_fullsized":"2023-05-17T15:08:54.270579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.250993+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.262544+0000","last_change":"2023-05-17T15:08:54.262544+0000","last_active":"2023-05-17T15:08:54.262544+0000","last_peered":"2023-05-17T15:08:54.262544+0000","last_clean":"2023-05-17T15:08:54.262544+0000","last_became_active":"2023-05-17T15:08:54.259695+0000","last_became_peered":"2023-05-17T15:08:54.259695+0000","last_unstale":"2023-05-17T15:08:54.262544+0000","last_undegraded":"2023-05-17T15:08:54.262544+0000","last_fullsized":"2023-05-17T15:08:54.262544+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.251077+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.251360+0000","last_change":"2023-05-17T15:08:54.251360+0000","last_active":"2023-05-17T15:08:54.251360+0000","last_peered":"2023-05-17T15:08:54.251360+0000","last_clean":"2023-05-17T15:08:54.251360+0000","last_became_active":"2023-05-17T15:08:54.251150+0000","last_became_peered":"2023-05-17T15:08:54.251150+0000","last_unstale":"2023-05-17T15:08:54.251360+0000","last_undegraded":"2023-05-17T15:08:54.251360+0000","last_fullsized":"2023-05-17T15:08:54.251360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.243895+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260659+0000","last_change":"2023-05-17T15:08:54.260659+0000","last_active":"2023-05-17T15:08:54.260659+0000","last_peered":"2023-05-17T15:08:54.260659+0000","last_clean":"2023-05-17T15:08:54.260659+0000","last_became_active":"2023-05-17T15:08:54.260371+0000","last_became_peered":"2023-05-17T15:08:54.260371+0000","last_unstale":"2023-05-17T15:08:54.260659+0000","last_undegraded":"2023-05-17T15:08:54.260659+0000","last_fullsized":"2023-05-17T15:08:54.260659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247377+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257883+0000","last_change":"2023-05-17T15:08:54.257883+0000","last_active":"2023-05-17T15:08:54.257883+0000","last_peered":"2023-05-17T15:08:54.257883+0000","last_clean":"2023-05-17T15:08:54.257883+0000","last_became_active":"2023-05-17T15:08:54.257585+0000","last_became_peered":"2023-05-17T15:08:54.257585+0000","last_unstale":"2023-05-17T15:08:54.257883+0000","last_undegraded":"2023-05-17T15:08:54.257883+0000","last_fullsized":"2023-05-17T15:08:54.257883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244773+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.268672+0000","last_change":"2023-05-17T15:08:54.268672+0000","last_active":"2023-05-17T15:08:54.268672+0000","last_peered":"2023-05-17T15:08:54.268672+0000","last_clean":"2023-05-17T15:08:54.268672+0000","last_became_active":"2023-05-17T15:08:54.268408+0000","last_became_peered":"2023-05-17T15:08:54.268408+0000","last_unstale":"2023-05-17T15:08:54.268672+0000","last_undegraded":"2023-05-17T15:08:54.268672+0000","last_fullsized":"2023-05-17T15:08:54.268672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242131+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267658+0000","last_change":"2023-05-17T15:08:54.267658+0000","last_active":"2023-05-17T15:08:54.267658+0000","last_peered":"2023-05-17T15:08:54.267658+0000","last_clean":"2023-05-17T15:08:54.267658+0000","last_became_active":"2023-05-17T15:08:54.267287+0000","last_became_peered":"2023-05-17T15:08:54.267287+0000","last_unstale":"2023-05-17T15:08:54.267658+0000","last_undegraded":"2023-05-17T15:08:54.267658+0000","last_fullsized":"2023-05-17T15:08:54.267658+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247963+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264262+0000","last_change":"2023-05-17T15:08:54.264262+0000","last_active":"2023-05-17T15:08:54.264262+0000","last_peered":"2023-05-17T15:08:54.264262+0000","last_clean":"2023-05-17T15:08:54.264262+0000","last_became_active":"2023-05-17T15:08:54.263935+0000","last_became_peered":"2023-05-17T15:08:54.263935+0000","last_unstale":"2023-05-17T15:08:54.264262+0000","last_undegraded":"2023-05-17T15:08:54.264262+0000","last_fullsized":"2023-05-17T15:08:54.264262+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.247947+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.260215+0000","last_change":"2023-05-17T15:08:54.260215+0000","last_active":"2023-05-17T15:08:54.260215+0000","last_peered":"2023-05-17T15:08:54.260215+0000","last_clean":"2023-05-17T15:08:54.260215+0000","last_became_active":"2023-05-17T15:08:54.259732+0000","last_became_peered":"2023-05-17T15:08:54.259732+0000","last_unstale":"2023-05-17T15:08:54.260215+0000","last_undegraded":"2023-05-17T15:08:54.260215+0000","last_fullsized":"2023-05-17T15:08:54.260215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245968+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.253796+0000","last_change":"2023-05-17T15:08:54.253796+0000","last_active":"2023-05-17T15:08:54.253796+0000","last_peered":"2023-05-17T15:08:54.253796+0000","last_clean":"2023-05-17T15:08:54.253796+0000","last_became_active":"2023-05-17T15:08:54.253479+0000","last_became_peered":"2023-05-17T15:08:54.253479+0000","last_unstale":"2023-05-17T15:08:54.253796+0000","last_undegraded":"2023-05-17T15:08:54.253796+0000","last_fullsized":"2023-05-17T15:08:54.253796+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245080+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.258128+0000","last_change":"2023-05-17T15:08:54.258128+0000","last_active":"2023-05-17T15:08:54.258128+0000","last_peered":"2023-05-17T15:08:54.258128+0000","last_clean":"2023-05-17T15:08:54.258128+0000","last_became_active":"2023-05-17T15:08:54.256391+0000","last_became_peered":"2023-05-17T15:08:54.256391+0000","last_unstale":"2023-05-17T15:08:54.258128+0000","last_undegraded":"2023-05-17T15:08:54.258128+0000","last_fullsized":"2023-05-17T15:08:54.258128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255076+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.257141+0000","last_change":"2023-05-17T15:08:54.257141+0000","last_active":"2023-05-17T15:08:54.257141+0000","last_peered":"2023-05-17T15:08:54.257141+0000","last_clean":"2023-05-17T15:08:54.257141+0000","last_became_active":"2023-05-17T15:08:54.256827+0000","last_became_peered":"2023-05-17T15:08:54.256827+0000","last_unstale":"2023-05-17T15:08:54.257141+0000","last_undegraded":"2023-05-17T15:08:54.257141+0000","last_fullsized":"2023-05-17T15:08:54.257141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237981+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:53.237981+0000","last_peered":"2023-05-17T15:08:53.237981+0000","last_clean":"2023-05-17T15:08:53.237981+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:53.237981+0000","last_undegraded":"2023-05-17T15:08:53.237981+0000","last_fullsized":"2023-05-17T15:08:53.237981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242148+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.254126+0000","last_change":"2023-05-17T15:08:54.254126+0000","last_active":"2023-05-17T15:08:54.254126+0000","last_peered":"2023-05-17T15:08:54.254126+0000","last_clean":"2023-05-17T15:08:54.254126+0000","last_became_active":"2023-05-17T15:08:54.253832+0000","last_became_peered":"2023-05-17T15:08:54.253832+0000","last_unstale":"2023-05-17T15:08:54.254126+0000","last_undegraded":"2023-05-17T15:08:54.254126+0000","last_fullsized":"2023-05-17T15:08:54.254126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.235330+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:53.235330+0000","last_peered":"2023-05-17T15:08:53.235330+0000","last_clean":"2023-05-17T15:08:53.235330+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:53.235330+0000","last_undegraded":"2023-05-17T15:08:53.235330+0000","last_fullsized":"2023-05-17T15:08:53.235330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.248218+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265101+0000","last_change":"2023-05-17T15:08:54.265101+0000","last_active":"2023-05-17T15:08:54.265101+0000","last_peered":"2023-05-17T15:08:54.265101+0000","last_clean":"2023-05-17T15:08:54.265101+0000","last_became_active":"2023-05-17T15:08:54.264786+0000","last_became_peered":"2023-05-17T15:08:54.264786+0000","last_unstale":"2023-05-17T15:08:54.265101+0000","last_undegraded":"2023-05-17T15:08:54.265101+0000","last_fullsized":"2023-05-17T15:08:54.265101+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237453+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:53.237453+0000","last_peered":"2023-05-17T15:08:53.237453+0000","last_clean":"2023-05-17T15:08:53.237453+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:53.237453+0000","last_undegraded":"2023-05-17T15:08:53.237453+0000","last_fullsized":"2023-05-17T15:08:53.237453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.255645+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.264062+0000","last_change":"2023-05-17T15:08:54.264062+0000","last_active":"2023-05-17T15:08:54.264062+0000","last_peered":"2023-05-17T15:08:54.264062+0000","last_clean":"2023-05-17T15:08:54.264062+0000","last_became_active":"2023-05-17T15:08:54.263647+0000","last_became_peered":"2023-05-17T15:08:54.263647+0000","last_unstale":"2023-05-17T15:08:54.264062+0000","last_undegraded":"2023-05-17T15:08:54.264062+0000","last_fullsized":"2023-05-17T15:08:54.264062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.233619+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:53.233619+0000","last_peered":"2023-05-17T15:08:53.233619+0000","last_clean":"2023-05-17T15:08:53.233619+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:53.233619+0000","last_undegraded":"2023-05-17T15:08:53.233619+0000","last_fullsized":"2023-05-17T15:08:53.233619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243605+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:53.243605+0000","last_peered":"2023-05-17T15:08:53.243605+0000","last_clean":"2023-05-17T15:08:53.243605+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:53.243605+0000","last_undegraded":"2023-05-17T15:08:53.243605+0000","last_fullsized":"2023-05-17T15:08:53.243605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.242477+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.265196+0000","last_change":"2023-05-17T15:08:54.265196+0000","last_active":"2023-05-17T15:08:54.265196+0000","last_peered":"2023-05-17T15:08:54.265196+0000","last_clean":"2023-05-17T15:08:54.265196+0000","last_became_active":"2023-05-17T15:08:54.264790+0000","last_became_peered":"2023-05-17T15:08:54.264790+0000","last_unstale":"2023-05-17T15:08:54.265196+0000","last_undegraded":"2023-05-17T15:08:54.265196+0000","last_fullsized":"2023-05-17T15:08:54.265196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243669+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:53.243669+0000","last_peered":"2023-05-17T15:08:53.243669+0000","last_clean":"2023-05-17T15:08:53.243669+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:53.243669+0000","last_undegraded":"2023-05-17T15:08:53.243669+0000","last_fullsized":"2023-05-17T15:08:53.243669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.244906+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267147+0000","last_change":"2023-05-17T15:08:54.267147+0000","last_active":"2023-05-17T15:08:54.267147+0000","last_peered":"2023-05-17T15:08:54.267147+0000","last_clean":"2023-05-17T15:08:54.267147+0000","last_became_active":"2023-05-17T15:08:54.266723+0000","last_became_peered":"2023-05-17T15:08:54.266723+0000","last_unstale":"2023-05-17T15:08:54.267147+0000","last_undegraded":"2023-05-17T15:08:54.267147+0000","last_fullsized":"2023-05-17T15:08:54.267147+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.243760+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:53.243760+0000","last_peered":"2023-05-17T15:08:53.243760+0000","last_clean":"2023-05-17T15:08:53.243760+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:53.243760+0000","last_undegraded":"2023-05-17T15:08:53.243760+0000","last_fullsized":"2023-05-17T15:08:53.243760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.245271+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.267545+0000","last_change":"2023-05-17T15:08:54.267545+0000","last_active":"2023-05-17T15:08:54.267545+0000","last_peered":"2023-05-17T15:08:54.267545+0000","last_clean":"2023-05-17T15:08:54.267545+0000","last_became_active":"2023-05-17T15:08:54.267190+0000","last_became_peered":"2023-05-17T15:08:54.267190+0000","last_unstale":"2023-05-17T15:08:54.267545+0000","last_undegraded":"2023-05-17T15:08:54.267545+0000","last_fullsized":"2023-05-17T15:08:54.267545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.238191+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:53.238191+0000","last_peered":"2023-05-17T15:08:53.238191+0000","last_clean":"2023-05-17T15:08:53.238191+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:53.238191+0000","last_undegraded":"2023-05-17T15:08:53.238191+0000","last_fullsized":"2023-05-17T15:08:53.238191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:08:54.228544+0000","last_change":"2023-05-17T15:08:54.249204+0000","last_active":"2023-05-17T15:08:54.228544+0000","last_peered":"2023-05-17T15:08:54.228544+0000","last_clean":"2023-05-17T15:08:54.228544+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:08:54.228544+0000","last_undegraded":"2023-05-17T15:08:54.228544+0000","last_fullsized":"2023-05-17T15:08:54.228544+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.259933+0000","last_change":"2023-05-17T15:08:54.259933+0000","last_active":"2023-05-17T15:08:54.259933+0000","last_peered":"2023-05-17T15:08:54.259933+0000","last_clean":"2023-05-17T15:08:54.259933+0000","last_became_active":"2023-05-17T15:08:54.259624+0000","last_became_peered":"2023-05-17T15:08:54.259624+0000","last_unstale":"2023-05-17T15:08:54.259933+0000","last_undegraded":"2023-05-17T15:08:54.259933+0000","last_fullsized":"2023-05-17T15:08:54.259933+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-05-17T15:08:53.237664+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:53.237664+0000","last_peered":"2023-05-17T15:08:53.237664+0000","last_clean":"2023-05-17T15:08:53.237664+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:53.237664+0000","last_undegraded":"2023-05-17T15:08:53.237664+0000","last_fullsized":"2023-05-17T15:08:53.237664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17384,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354456,"statfs":{"total":96636764160,"available":96618962944,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.629},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.432}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16744,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355096,"statfs":{"total":96636764160,"available":96619618304,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.621}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16552,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355288,"statfs":{"total":96636764160,"available":96619814912,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.50700000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.318,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.52100000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.20000000000000001},"max":{"1min":0.46300000000000002,"5min":1.956,"15min":1.956},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.48299999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.58899999999999997,"5min":1.149,"15min":1.149},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.02},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88}]},{"osd":5,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.873},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.46600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":1.103,"15min":1.6100000000000001},"last":1.044}]},{"osd":6,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.80400000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":1.524,"15min":1.524},"last":0.98399999999999999}]},{"osd":7,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.01},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.40400000000000003},"max":{"1min":0.76200000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16360,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355480,"statfs":{"total":96636764160,"available":96620011520,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.26700000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.5}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17704,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354136,"statfs":{"total":96636764160,"available":96618635264,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.436},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20648,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351192,"statfs":{"total":96636764160,"available":96615620608,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.248},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.32000000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.376},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17000,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354840,"statfs":{"total":96636764160,"available":96619356160,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.61599999999999999}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.84999999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20392,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94351448,"statfs":{"total":96636764160,"available":96615882752,"internally_reserved":0,"allocated":1146880,"data_stored":572412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.748},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.70799999999999996}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:02.175 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:09:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.304+0000 7f82326d8700 1 Processor -- start 2023-05-17T15:09:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.304+0000 7f82326d8700 1 -- start start 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f82326d8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f822c0c60c0 0x7f822c0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f82326d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f82326d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822c05e7e0 con 0x7f822c0aa3b0 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f82326d8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822c05eac0 con 0x7f822c0c60c0 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f82326d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c0bfd70 con 0x7f822c0a9f70 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f822bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f822c0c60c0 0x7f822c0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f822bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f822c0c60c0 0x7f822c0c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39924/0 (socket says 172.21.15.27:39924) 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f822bfff700 1 -- 172.21.15.27:0/2569107802 learned_addr learned my addr 172.21.15.27:0/2569107802 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.305+0000 7f822b7fe700 1 --2- 172.21.15.27:0/2569107802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822bfff700 1 -- 172.21.15.27:0/2569107802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 msgr2=0x7f822c153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822bfff700 1 --2- 172.21.15.27:0/2569107802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822bfff700 1 -- 172.21.15.27:0/2569107802 >> v1:172.21.15.40:6789/0 conn(0x7f822c0aa3b0 legacy=0x7f822c157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822bfff700 1 -- 172.21.15.27:0/2569107802 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c0c0050 con 0x7f822c0c60c0 2023-05-17T15:09:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822bfff700 1 --2- 172.21.15.27:0/2569107802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0c60c0 0x7f822c0c64a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f821c006fd0 tx=0x7f821c0090f0).ready entity=mon.0 client_cookie=8289cec1c0a519e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:02.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822affd700 1 -- 172.21.15.27:0/2569107802 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c00b600 con 0x7f822c0c60c0 2023-05-17T15:09:02.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822affd700 1 -- 172.21.15.27:0/2569107802 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c00b760 con 0x7f822c0c60c0 2023-05-17T15:09:02.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f822affd700 1 -- 172.21.15.27:0/2569107802 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c00bae0 con 0x7f822c0c60c0 2023-05-17T15:09:02.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f82326d8700 1 -- 172.21.15.27:0/2569107802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0c60c0 msgr2=0x7f822c0c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f82326d8700 1 --2- 172.21.15.27:0/2569107802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0c60c0 0x7f822c0c64a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f821c006fd0 tx=0x7f821c0090f0).stop 2023-05-17T15:09:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f82326d8700 1 -- 172.21.15.27:0/2569107802 shutdown_connections 2023-05-17T15:09:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f82326d8700 1 --2- 172.21.15.27:0/2569107802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0c60c0 0x7f822c0c64a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f82326d8700 1 --2- 172.21.15.27:0/2569107802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.306+0000 7f82326d8700 1 -- 172.21.15.27:0/2569107802 >> 172.21.15.27:0/2569107802 conn(0x7f822c069e70 msgr2=0x7f822c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.307+0000 7f82326d8700 1 -- 172.21.15.27:0/2569107802 shutdown_connections 2023-05-17T15:09:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.307+0000 7f82326d8700 1 -- 172.21.15.27:0/2569107802 wait complete. 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.308+0000 7f82326d8700 1 Processor -- start 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.308+0000 7f82326d8700 1 -- start start 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c14c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 0x7f822c165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c0c60c0 0x7f822c156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c14c680 con 0x7f822c0aa3b0 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c165a20 con 0x7f822c0c60c0 2023-05-17T15:09:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c0c9760 con 0x7f822c0a9f70 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 0x7f822c165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 0x7f822c165530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39932/0 (socket says 172.21.15.27:39932) 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 -- 172.21.15.27:0/2517548960 learned_addr learned my addr 172.21.15.27:0/2517548960 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822bfff700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c14c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f8230c75700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c0c60c0 0x7f822c156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 -- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 msgr2=0x7f822c14c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c14c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 -- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c0c60c0 msgr2=0x7f822c156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c0c60c0 0x7f822c156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 -- 172.21.15.27:0/2517548960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c009370 con 0x7f822c0aa3b0 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f8230c75700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c0c60c0 0x7f822c156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822bfff700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c14c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f822b7fe700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 0x7f822c165530 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f822000d8c0 tx=0x7f8220008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:02.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200095b0 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220009710 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220009a90 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c1545c0 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.309+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c154b80 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.310+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c0c64a0 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.311+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8220013480 con 0x7f822c0aa3b0 2023-05-17T15:09:02.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.311+0000 7f8213fff700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f821805ed90 0x7f8218061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.311+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8220079a70 con 0x7f822c0aa3b0 2023-05-17T15:09:02.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.311+0000 7f822bfff700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f821805ed90 0x7f8218061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.312+0000 7f822bfff700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f821805ed90 0x7f8218061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f821c006fd0 tx=0x7f821c017000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:02.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.315+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f822004af60 con 0x7f822c0aa3b0 2023-05-17T15:09:02.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:02.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:02.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.483+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f822c05f4a0 con 0x7f821805ed90 2023-05-17T15:09:02.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.493+0000 7f8213fff700 1 -- 172.21.15.27:0/2517548960 <== mgr.6462 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361308 (secure 0 0 0) 0x7f822c05f4a0 con 0x7f821805ed90 2023-05-17T15:09:02.500 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.496+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f821805ed90 msgr2=0x7f8218061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f821805ed90 0x7f8218061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f821c006fd0 tx=0x7f821c017000).stop 2023-05-17T15:09:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 msgr2=0x7f822c165530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 0x7f822c165530 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f822000d8c0 tx=0x7f8220008040).stop 2023-05-17T15:09:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 shutdown_connections 2023-05-17T15:09:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f821805ed90 0x7f8218061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c0c60c0 0x7f822c156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822c0a9f70 0x7f822c14c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 --2- 172.21.15.27:0/2517548960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f822c0aa3b0 0x7f822c165530 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 >> 172.21.15.27:0/2517548960 conn(0x7f822c069e70 msgr2=0x7f822c0b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 shutdown_connections 2023-05-17T15:09:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.497+0000 7f82326d8700 1 -- 172.21.15.27:0/2517548960 wait complete. 2023-05-17T15:09:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:09:02.512 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-17T15:09:01.476295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":144672,"kb_used_data":9312,"kb_used_omap":0,"kb_used_meta":135296,"kb_avail":754830048,"statfs":{"total":773094113280,"available":772945969152,"internally_reserved":0,"allocated":9535488,"data_stored":4750132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":138543104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7848,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-24,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.172140"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661809+0000","last_change":"2023-05-17T15:08:54.648990+0000","last_active":"2023-05-17T15:08:54.661809+0000","last_peered":"2023-05-17T15:08:54.661809+0000","last_clean":"2023-05-17T15:08:54.661809+0000","last_became_active":"2023-05-17T15:08:54.648702+0000","last_became_peered":"2023-05-17T15:08:54.648702+0000","last_unstale":"2023-05-17T15:08:54.661809+0000","last_undegraded":"2023-05-17T15:08:54.661809+0000","last_fullsized":"2023-05-17T15:08:54.661809+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"96'3","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.662661+0000","last_change":"2023-05-17T15:08:54.270583+0000","last_active":"2023-05-17T15:08:54.662661+0000","last_peered":"2023-05-17T15:08:54.662661+0000","last_clean":"2023-05-17T15:08:54.662661+0000","last_became_active":"2023-05-17T15:08:54.270277+0000","last_became_peered":"2023-05-17T15:08:54.270277+0000","last_unstale":"2023-05-17T15:08:54.662661+0000","last_undegraded":"2023-05-17T15:08:54.662661+0000","last_fullsized":"2023-05-17T15:08:54.662661+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.643774+0000","last_change":"2023-05-17T15:08:54.642183+0000","last_active":"2023-05-17T15:08:54.643774+0000","last_peered":"2023-05-17T15:08:54.643774+0000","last_clean":"2023-05-17T15:08:54.643774+0000","last_became_active":"2023-05-17T15:08:54.641244+0000","last_became_peered":"2023-05-17T15:08:54.641244+0000","last_unstale":"2023-05-17T15:08:54.643774+0000","last_undegraded":"2023-05-17T15:08:54.643774+0000","last_fullsized":"2023-05-17T15:08:54.643774+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633365+0000","last_change":"2023-05-17T15:08:54.258220+0000","last_active":"2023-05-17T15:08:54.633365+0000","last_peered":"2023-05-17T15:08:54.633365+0000","last_clean":"2023-05-17T15:08:54.633365+0000","last_became_active":"2023-05-17T15:08:54.257897+0000","last_became_peered":"2023-05-17T15:08:54.257897+0000","last_unstale":"2023-05-17T15:08:54.633365+0000","last_undegraded":"2023-05-17T15:08:54.633365+0000","last_fullsized":"2023-05-17T15:08:54.633365+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653654+0000","last_change":"2023-05-17T15:08:54.649604+0000","last_active":"2023-05-17T15:08:54.653654+0000","last_peered":"2023-05-17T15:08:54.653654+0000","last_clean":"2023-05-17T15:08:54.653654+0000","last_became_active":"2023-05-17T15:08:54.648880+0000","last_became_peered":"2023-05-17T15:08:54.648880+0000","last_unstale":"2023-05-17T15:08:54.653654+0000","last_undegraded":"2023-05-17T15:08:54.653654+0000","last_fullsized":"2023-05-17T15:08:54.653654+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633427+0000","last_change":"2023-05-17T15:08:54.250930+0000","last_active":"2023-05-17T15:08:54.633427+0000","last_peered":"2023-05-17T15:08:54.633427+0000","last_clean":"2023-05-17T15:08:54.633427+0000","last_became_active":"2023-05-17T15:08:54.250648+0000","last_became_peered":"2023-05-17T15:08:54.250648+0000","last_unstale":"2023-05-17T15:08:54.633427+0000","last_undegraded":"2023-05-17T15:08:54.633427+0000","last_fullsized":"2023-05-17T15:08:54.633427+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661426+0000","last_change":"2023-05-17T15:08:54.648131+0000","last_active":"2023-05-17T15:08:54.661426+0000","last_peered":"2023-05-17T15:08:54.661426+0000","last_clean":"2023-05-17T15:08:54.661426+0000","last_became_active":"2023-05-17T15:08:54.647445+0000","last_became_peered":"2023-05-17T15:08:54.647445+0000","last_unstale":"2023-05-17T15:08:54.661426+0000","last_undegraded":"2023-05-17T15:08:54.661426+0000","last_fullsized":"2023-05-17T15:08:54.661426+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"96'2","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661043+0000","last_change":"2023-05-17T15:08:54.260661+0000","last_active":"2023-05-17T15:08:54.661043+0000","last_peered":"2023-05-17T15:08:54.661043+0000","last_clean":"2023-05-17T15:08:54.661043+0000","last_became_active":"2023-05-17T15:08:54.260378+0000","last_became_peered":"2023-05-17T15:08:54.260378+0000","last_unstale":"2023-05-17T15:08:54.661043+0000","last_undegraded":"2023-05-17T15:08:54.661043+0000","last_fullsized":"2023-05-17T15:08:54.661043+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.646205+0000","last_change":"2023-05-17T15:08:54.640261+0000","last_active":"2023-05-17T15:08:54.646205+0000","last_peered":"2023-05-17T15:08:54.646205+0000","last_clean":"2023-05-17T15:08:54.646205+0000","last_became_active":"2023-05-17T15:08:54.639985+0000","last_became_peered":"2023-05-17T15:08:54.639985+0000","last_unstale":"2023-05-17T15:08:54.646205+0000","last_undegraded":"2023-05-17T15:08:54.646205+0000","last_fullsized":"2023-05-17T15:08:54.646205+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661347+0000","last_change":"2023-05-17T15:08:54.263402+0000","last_active":"2023-05-17T15:08:54.661347+0000","last_peered":"2023-05-17T15:08:54.661347+0000","last_clean":"2023-05-17T15:08:54.661347+0000","last_became_active":"2023-05-17T15:08:54.263067+0000","last_became_peered":"2023-05-17T15:08:54.263067+0000","last_unstale":"2023-05-17T15:08:54.661347+0000","last_undegraded":"2023-05-17T15:08:54.661347+0000","last_fullsized":"2023-05-17T15:08:54.661347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658766+0000","last_change":"2023-05-17T15:08:54.657605+0000","last_active":"2023-05-17T15:08:54.658766+0000","last_peered":"2023-05-17T15:08:54.658766+0000","last_clean":"2023-05-17T15:08:54.658766+0000","last_became_active":"2023-05-17T15:08:54.657141+0000","last_became_peered":"2023-05-17T15:08:54.657141+0000","last_unstale":"2023-05-17T15:08:54.658766+0000","last_undegraded":"2023-05-17T15:08:54.658766+0000","last_fullsized":"2023-05-17T15:08:54.658766+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.648318+0000","last_change":"2023-05-17T15:08:54.258314+0000","last_active":"2023-05-17T15:08:54.648318+0000","last_peered":"2023-05-17T15:08:54.648318+0000","last_clean":"2023-05-17T15:08:54.648318+0000","last_became_active":"2023-05-17T15:08:54.258080+0000","last_became_peered":"2023-05-17T15:08:54.258080+0000","last_unstale":"2023-05-17T15:08:54.648318+0000","last_undegraded":"2023-05-17T15:08:54.648318+0000","last_fullsized":"2023-05-17T15:08:54.648318+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661223+0000","last_change":"2023-05-17T15:08:54.650832+0000","last_active":"2023-05-17T15:08:54.661223+0000","last_peered":"2023-05-17T15:08:54.661223+0000","last_clean":"2023-05-17T15:08:54.661223+0000","last_became_active":"2023-05-17T15:08:54.650399+0000","last_became_peered":"2023-05-17T15:08:54.650399+0000","last_unstale":"2023-05-17T15:08:54.661223+0000","last_undegraded":"2023-05-17T15:08:54.661223+0000","last_fullsized":"2023-05-17T15:08:54.661223+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.634887+0000","last_change":"2023-05-17T15:08:54.259205+0000","last_active":"2023-05-17T15:08:54.634887+0000","last_peered":"2023-05-17T15:08:54.634887+0000","last_clean":"2023-05-17T15:08:54.634887+0000","last_became_active":"2023-05-17T15:08:54.258893+0000","last_became_peered":"2023-05-17T15:08:54.258893+0000","last_unstale":"2023-05-17T15:08:54.634887+0000","last_undegraded":"2023-05-17T15:08:54.634887+0000","last_fullsized":"2023-05-17T15:08:54.634887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653275+0000","last_change":"2023-05-17T15:08:54.648738+0000","last_active":"2023-05-17T15:08:54.653275+0000","last_peered":"2023-05-17T15:08:54.653275+0000","last_clean":"2023-05-17T15:08:54.653275+0000","last_became_active":"2023-05-17T15:08:54.648451+0000","last_became_peered":"2023-05-17T15:08:54.648451+0000","last_unstale":"2023-05-17T15:08:54.653275+0000","last_undegraded":"2023-05-17T15:08:54.653275+0000","last_fullsized":"2023-05-17T15:08:54.653275+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.631842+0000","last_change":"2023-05-17T15:08:54.255408+0000","last_active":"2023-05-17T15:08:54.631842+0000","last_peered":"2023-05-17T15:08:54.631842+0000","last_clean":"2023-05-17T15:08:54.631842+0000","last_became_active":"2023-05-17T15:08:54.255099+0000","last_became_peered":"2023-05-17T15:08:54.255099+0000","last_unstale":"2023-05-17T15:08:54.631842+0000","last_undegraded":"2023-05-17T15:08:54.631842+0000","last_fullsized":"2023-05-17T15:08:54.631842+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652955+0000","last_change":"2023-05-17T15:08:54.648126+0000","last_active":"2023-05-17T15:08:54.652955+0000","last_peered":"2023-05-17T15:08:54.652955+0000","last_clean":"2023-05-17T15:08:54.652955+0000","last_became_active":"2023-05-17T15:08:54.647847+0000","last_became_peered":"2023-05-17T15:08:54.647847+0000","last_unstale":"2023-05-17T15:08:54.652955+0000","last_undegraded":"2023-05-17T15:08:54.652955+0000","last_fullsized":"2023-05-17T15:08:54.652955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635531+0000","last_change":"2023-05-17T15:08:54.260817+0000","last_active":"2023-05-17T15:08:54.635531+0000","last_peered":"2023-05-17T15:08:54.635531+0000","last_clean":"2023-05-17T15:08:54.635531+0000","last_became_active":"2023-05-17T15:08:54.260540+0000","last_became_peered":"2023-05-17T15:08:54.260540+0000","last_unstale":"2023-05-17T15:08:54.635531+0000","last_undegraded":"2023-05-17T15:08:54.635531+0000","last_fullsized":"2023-05-17T15:08:54.635531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.663915+0000","last_change":"2023-05-17T15:08:54.658852+0000","last_active":"2023-05-17T15:08:54.663915+0000","last_peered":"2023-05-17T15:08:54.663915+0000","last_clean":"2023-05-17T15:08:54.663915+0000","last_became_active":"2023-05-17T15:08:54.658458+0000","last_became_peered":"2023-05-17T15:08:54.658458+0000","last_unstale":"2023-05-17T15:08:54.663915+0000","last_undegraded":"2023-05-17T15:08:54.663915+0000","last_fullsized":"2023-05-17T15:08:54.663915+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635209+0000","last_change":"2023-05-17T15:08:54.259817+0000","last_active":"2023-05-17T15:08:54.635209+0000","last_peered":"2023-05-17T15:08:54.635209+0000","last_clean":"2023-05-17T15:08:54.635209+0000","last_became_active":"2023-05-17T15:08:54.258343+0000","last_became_peered":"2023-05-17T15:08:54.258343+0000","last_unstale":"2023-05-17T15:08:54.635209+0000","last_undegraded":"2023-05-17T15:08:54.635209+0000","last_fullsized":"2023-05-17T15:08:54.635209+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653676+0000","last_change":"2023-05-17T15:08:54.649771+0000","last_active":"2023-05-17T15:08:54.653676+0000","last_peered":"2023-05-17T15:08:54.653676+0000","last_clean":"2023-05-17T15:08:54.653676+0000","last_became_active":"2023-05-17T15:08:54.649049+0000","last_became_peered":"2023-05-17T15:08:54.649049+0000","last_unstale":"2023-05-17T15:08:54.653676+0000","last_undegraded":"2023-05-17T15:08:54.653676+0000","last_fullsized":"2023-05-17T15:08:54.653676+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.640899+0000","last_change":"2023-05-17T15:08:54.268125+0000","last_active":"2023-05-17T15:08:54.640899+0000","last_peered":"2023-05-17T15:08:54.640899+0000","last_clean":"2023-05-17T15:08:54.640899+0000","last_became_active":"2023-05-17T15:08:54.265254+0000","last_became_peered":"2023-05-17T15:08:54.265254+0000","last_unstale":"2023-05-17T15:08:54.640899+0000","last_undegraded":"2023-05-17T15:08:54.640899+0000","last_fullsized":"2023-05-17T15:08:54.640899+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.662147+0000","last_change":"2023-05-17T15:08:54.649138+0000","last_active":"2023-05-17T15:08:54.662147+0000","last_peered":"2023-05-17T15:08:54.662147+0000","last_clean":"2023-05-17T15:08:54.662147+0000","last_became_active":"2023-05-17T15:08:54.648874+0000","last_became_peered":"2023-05-17T15:08:54.648874+0000","last_unstale":"2023-05-17T15:08:54.662147+0000","last_undegraded":"2023-05-17T15:08:54.662147+0000","last_fullsized":"2023-05-17T15:08:54.662147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"96'4","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.666758+0000","last_change":"2023-05-17T15:08:54.267294+0000","last_active":"2023-05-17T15:08:54.666758+0000","last_peered":"2023-05-17T15:08:54.666758+0000","last_clean":"2023-05-17T15:08:54.666758+0000","last_became_active":"2023-05-17T15:08:54.266970+0000","last_became_peered":"2023-05-17T15:08:54.266970+0000","last_unstale":"2023-05-17T15:08:54.666758+0000","last_undegraded":"2023-05-17T15:08:54.666758+0000","last_fullsized":"2023-05-17T15:08:54.666758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658258+0000","last_change":"2023-05-17T15:08:54.656049+0000","last_active":"2023-05-17T15:08:54.658258+0000","last_peered":"2023-05-17T15:08:54.658258+0000","last_clean":"2023-05-17T15:08:54.658258+0000","last_became_active":"2023-05-17T15:08:54.655737+0000","last_became_peered":"2023-05-17T15:08:54.655737+0000","last_unstale":"2023-05-17T15:08:54.658258+0000","last_undegraded":"2023-05-17T15:08:54.658258+0000","last_fullsized":"2023-05-17T15:08:54.658258+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653908+0000","last_change":"2023-05-17T15:08:54.252483+0000","last_active":"2023-05-17T15:08:54.653908+0000","last_peered":"2023-05-17T15:08:54.653908+0000","last_clean":"2023-05-17T15:08:54.653908+0000","last_became_active":"2023-05-17T15:08:54.252178+0000","last_became_peered":"2023-05-17T15:08:54.252178+0000","last_unstale":"2023-05-17T15:08:54.653908+0000","last_undegraded":"2023-05-17T15:08:54.653908+0000","last_fullsized":"2023-05-17T15:08:54.653908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.655910+0000","last_change":"2023-05-17T15:08:54.650174+0000","last_active":"2023-05-17T15:08:54.655910+0000","last_peered":"2023-05-17T15:08:54.655910+0000","last_clean":"2023-05-17T15:08:54.655910+0000","last_became_active":"2023-05-17T15:08:54.649737+0000","last_became_peered":"2023-05-17T15:08:54.649737+0000","last_unstale":"2023-05-17T15:08:54.655910+0000","last_undegraded":"2023-05-17T15:08:54.655910+0000","last_fullsized":"2023-05-17T15:08:54.655910+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635755+0000","last_change":"2023-05-17T15:08:54.267320+0000","last_active":"2023-05-17T15:08:54.635755+0000","last_peered":"2023-05-17T15:08:54.635755+0000","last_clean":"2023-05-17T15:08:54.635755+0000","last_became_active":"2023-05-17T15:08:54.267043+0000","last_became_peered":"2023-05-17T15:08:54.267043+0000","last_unstale":"2023-05-17T15:08:54.635755+0000","last_undegraded":"2023-05-17T15:08:54.635755+0000","last_fullsized":"2023-05-17T15:08:54.635755+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.646176+0000","last_change":"2023-05-17T15:08:54.640895+0000","last_active":"2023-05-17T15:08:54.646176+0000","last_peered":"2023-05-17T15:08:54.646176+0000","last_clean":"2023-05-17T15:08:54.646176+0000","last_became_active":"2023-05-17T15:08:54.640598+0000","last_became_peered":"2023-05-17T15:08:54.640598+0000","last_unstale":"2023-05-17T15:08:54.646176+0000","last_undegraded":"2023-05-17T15:08:54.646176+0000","last_fullsized":"2023-05-17T15:08:54.646176+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.637549+0000","last_change":"2023-05-17T15:08:54.259020+0000","last_active":"2023-05-17T15:08:54.637549+0000","last_peered":"2023-05-17T15:08:54.637549+0000","last_clean":"2023-05-17T15:08:54.637549+0000","last_became_active":"2023-05-17T15:08:54.258736+0000","last_became_peered":"2023-05-17T15:08:54.258736+0000","last_unstale":"2023-05-17T15:08:54.637549+0000","last_undegraded":"2023-05-17T15:08:54.637549+0000","last_fullsized":"2023-05-17T15:08:54.637549+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.660507+0000","last_change":"2023-05-17T15:08:54.655700+0000","last_active":"2023-05-17T15:08:54.660507+0000","last_peered":"2023-05-17T15:08:54.660507+0000","last_clean":"2023-05-17T15:08:54.660507+0000","last_became_active":"2023-05-17T15:08:54.655421+0000","last_became_peered":"2023-05-17T15:08:54.655421+0000","last_unstale":"2023-05-17T15:08:54.660507+0000","last_undegraded":"2023-05-17T15:08:54.660507+0000","last_fullsized":"2023-05-17T15:08:54.660507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"96'4","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.655143+0000","last_change":"2023-05-17T15:08:54.264896+0000","last_active":"2023-05-17T15:08:54.655143+0000","last_peered":"2023-05-17T15:08:54.655143+0000","last_clean":"2023-05-17T15:08:54.655143+0000","last_became_active":"2023-05-17T15:08:54.264559+0000","last_became_peered":"2023-05-17T15:08:54.264559+0000","last_unstale":"2023-05-17T15:08:54.655143+0000","last_undegraded":"2023-05-17T15:08:54.655143+0000","last_fullsized":"2023-05-17T15:08:54.655143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652690+0000","last_change":"2023-05-17T15:08:54.648706+0000","last_active":"2023-05-17T15:08:54.652690+0000","last_peered":"2023-05-17T15:08:54.652690+0000","last_clean":"2023-05-17T15:08:54.652690+0000","last_became_active":"2023-05-17T15:08:54.648403+0000","last_became_peered":"2023-05-17T15:08:54.648403+0000","last_unstale":"2023-05-17T15:08:54.652690+0000","last_undegraded":"2023-05-17T15:08:54.652690+0000","last_fullsized":"2023-05-17T15:08:54.652690+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635607+0000","last_change":"2023-05-17T15:08:54.260860+0000","last_active":"2023-05-17T15:08:54.635607+0000","last_peered":"2023-05-17T15:08:54.635607+0000","last_clean":"2023-05-17T15:08:54.635607+0000","last_became_active":"2023-05-17T15:08:54.260308+0000","last_became_peered":"2023-05-17T15:08:54.260308+0000","last_unstale":"2023-05-17T15:08:54.635607+0000","last_undegraded":"2023-05-17T15:08:54.635607+0000","last_fullsized":"2023-05-17T15:08:54.635607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.647584+0000","last_change":"2023-05-17T15:08:54.639910+0000","last_active":"2023-05-17T15:08:54.647584+0000","last_peered":"2023-05-17T15:08:54.647584+0000","last_clean":"2023-05-17T15:08:54.647584+0000","last_became_active":"2023-05-17T15:08:54.639622+0000","last_became_peered":"2023-05-17T15:08:54.639622+0000","last_unstale":"2023-05-17T15:08:54.647584+0000","last_undegraded":"2023-05-17T15:08:54.647584+0000","last_fullsized":"2023-05-17T15:08:54.647584+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653020+0000","last_change":"2023-05-17T15:08:54.260850+0000","last_active":"2023-05-17T15:08:54.653020+0000","last_peered":"2023-05-17T15:08:54.653020+0000","last_clean":"2023-05-17T15:08:54.653020+0000","last_became_active":"2023-05-17T15:08:54.260631+0000","last_became_peered":"2023-05-17T15:08:54.260631+0000","last_unstale":"2023-05-17T15:08:54.653020+0000","last_undegraded":"2023-05-17T15:08:54.653020+0000","last_fullsized":"2023-05-17T15:08:54.653020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.662106+0000","last_change":"2023-05-17T15:08:54.653313+0000","last_active":"2023-05-17T15:08:54.662106+0000","last_peered":"2023-05-17T15:08:54.662106+0000","last_clean":"2023-05-17T15:08:54.662106+0000","last_became_active":"2023-05-17T15:08:54.653011+0000","last_became_peered":"2023-05-17T15:08:54.653011+0000","last_unstale":"2023-05-17T15:08:54.662106+0000","last_undegraded":"2023-05-17T15:08:54.662106+0000","last_fullsized":"2023-05-17T15:08:54.662106+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.659278+0000","last_change":"2023-05-17T15:08:54.253863+0000","last_active":"2023-05-17T15:08:54.659278+0000","last_peered":"2023-05-17T15:08:54.659278+0000","last_clean":"2023-05-17T15:08:54.659278+0000","last_became_active":"2023-05-17T15:08:54.253355+0000","last_became_peered":"2023-05-17T15:08:54.253355+0000","last_unstale":"2023-05-17T15:08:54.659278+0000","last_undegraded":"2023-05-17T15:08:54.659278+0000","last_fullsized":"2023-05-17T15:08:54.659278+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.663180+0000","last_change":"2023-05-17T15:08:54.659688+0000","last_active":"2023-05-17T15:08:54.663180+0000","last_peered":"2023-05-17T15:08:54.663180+0000","last_clean":"2023-05-17T15:08:54.663180+0000","last_became_active":"2023-05-17T15:08:54.659394+0000","last_became_peered":"2023-05-17T15:08:54.659394+0000","last_unstale":"2023-05-17T15:08:54.663180+0000","last_undegraded":"2023-05-17T15:08:54.663180+0000","last_fullsized":"2023-05-17T15:08:54.663180+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.644303+0000","last_change":"2023-05-17T15:08:54.256858+0000","last_active":"2023-05-17T15:08:54.644303+0000","last_peered":"2023-05-17T15:08:54.644303+0000","last_clean":"2023-05-17T15:08:54.644303+0000","last_became_active":"2023-05-17T15:08:54.256602+0000","last_became_peered":"2023-05-17T15:08:54.256602+0000","last_unstale":"2023-05-17T15:08:54.644303+0000","last_undegraded":"2023-05-17T15:08:54.644303+0000","last_fullsized":"2023-05-17T15:08:54.644303+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.662160+0000","last_change":"2023-05-17T15:08:54.659922+0000","last_active":"2023-05-17T15:08:54.662160+0000","last_peered":"2023-05-17T15:08:54.662160+0000","last_clean":"2023-05-17T15:08:54.662160+0000","last_became_active":"2023-05-17T15:08:54.653776+0000","last_became_peered":"2023-05-17T15:08:54.653776+0000","last_unstale":"2023-05-17T15:08:54.662160+0000","last_undegraded":"2023-05-17T15:08:54.662160+0000","last_fullsized":"2023-05-17T15:08:54.662160+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.654505+0000","last_change":"2023-05-17T15:08:54.251958+0000","last_active":"2023-05-17T15:08:54.654505+0000","last_peered":"2023-05-17T15:08:54.654505+0000","last_clean":"2023-05-17T15:08:54.654505+0000","last_became_active":"2023-05-17T15:08:54.251695+0000","last_became_peered":"2023-05-17T15:08:54.251695+0000","last_unstale":"2023-05-17T15:08:54.654505+0000","last_undegraded":"2023-05-17T15:08:54.654505+0000","last_fullsized":"2023-05-17T15:08:54.654505+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652352+0000","last_change":"2023-05-17T15:08:54.649846+0000","last_active":"2023-05-17T15:08:54.652352+0000","last_peered":"2023-05-17T15:08:54.652352+0000","last_clean":"2023-05-17T15:08:54.652352+0000","last_became_active":"2023-05-17T15:08:54.649549+0000","last_became_peered":"2023-05-17T15:08:54.649549+0000","last_unstale":"2023-05-17T15:08:54.652352+0000","last_undegraded":"2023-05-17T15:08:54.652352+0000","last_fullsized":"2023-05-17T15:08:54.652352+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.638265+0000","last_change":"2023-05-17T15:08:54.268177+0000","last_active":"2023-05-17T15:08:54.638265+0000","last_peered":"2023-05-17T15:08:54.638265+0000","last_clean":"2023-05-17T15:08:54.638265+0000","last_became_active":"2023-05-17T15:08:54.267884+0000","last_became_peered":"2023-05-17T15:08:54.267884+0000","last_unstale":"2023-05-17T15:08:54.638265+0000","last_undegraded":"2023-05-17T15:08:54.638265+0000","last_fullsized":"2023-05-17T15:08:54.638265+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658017+0000","last_change":"2023-05-17T15:08:54.652463+0000","last_active":"2023-05-17T15:08:54.658017+0000","last_peered":"2023-05-17T15:08:54.658017+0000","last_clean":"2023-05-17T15:08:54.658017+0000","last_became_active":"2023-05-17T15:08:54.652219+0000","last_became_peered":"2023-05-17T15:08:54.652219+0000","last_unstale":"2023-05-17T15:08:54.658017+0000","last_undegraded":"2023-05-17T15:08:54.658017+0000","last_fullsized":"2023-05-17T15:08:54.658017+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.638924+0000","last_change":"2023-05-17T15:08:54.268435+0000","last_active":"2023-05-17T15:08:54.638924+0000","last_peered":"2023-05-17T15:08:54.638924+0000","last_clean":"2023-05-17T15:08:54.638924+0000","last_became_active":"2023-05-17T15:08:54.267475+0000","last_became_peered":"2023-05-17T15:08:54.267475+0000","last_unstale":"2023-05-17T15:08:54.638924+0000","last_undegraded":"2023-05-17T15:08:54.638924+0000","last_fullsized":"2023-05-17T15:08:54.638924+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661084+0000","last_change":"2023-05-17T15:08:54.643016+0000","last_active":"2023-05-17T15:08:54.661084+0000","last_peered":"2023-05-17T15:08:54.661084+0000","last_clean":"2023-05-17T15:08:54.661084+0000","last_became_active":"2023-05-17T15:08:54.642818+0000","last_became_peered":"2023-05-17T15:08:54.642818+0000","last_unstale":"2023-05-17T15:08:54.661084+0000","last_undegraded":"2023-05-17T15:08:54.661084+0000","last_fullsized":"2023-05-17T15:08:54.661084+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.639604+0000","last_change":"2023-05-17T15:08:54.265806+0000","last_active":"2023-05-17T15:08:54.639604+0000","last_peered":"2023-05-17T15:08:54.639604+0000","last_clean":"2023-05-17T15:08:54.639604+0000","last_became_active":"2023-05-17T15:08:54.265547+0000","last_became_peered":"2023-05-17T15:08:54.265547+0000","last_unstale":"2023-05-17T15:08:54.639604+0000","last_undegraded":"2023-05-17T15:08:54.639604+0000","last_fullsized":"2023-05-17T15:08:54.639604+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652978+0000","last_change":"2023-05-17T15:08:54.649223+0000","last_active":"2023-05-17T15:08:54.652978+0000","last_peered":"2023-05-17T15:08:54.652978+0000","last_clean":"2023-05-17T15:08:54.652978+0000","last_became_active":"2023-05-17T15:08:54.648922+0000","last_became_peered":"2023-05-17T15:08:54.648922+0000","last_unstale":"2023-05-17T15:08:54.652978+0000","last_undegraded":"2023-05-17T15:08:54.652978+0000","last_fullsized":"2023-05-17T15:08:54.652978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635171+0000","last_change":"2023-05-17T15:08:54.261359+0000","last_active":"2023-05-17T15:08:54.635171+0000","last_peered":"2023-05-17T15:08:54.635171+0000","last_clean":"2023-05-17T15:08:54.635171+0000","last_became_active":"2023-05-17T15:08:54.261079+0000","last_became_peered":"2023-05-17T15:08:54.261079+0000","last_unstale":"2023-05-17T15:08:54.635171+0000","last_undegraded":"2023-05-17T15:08:54.635171+0000","last_fullsized":"2023-05-17T15:08:54.635171+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657505+0000","last_change":"2023-05-17T15:08:54.651750+0000","last_active":"2023-05-17T15:08:54.657505+0000","last_peered":"2023-05-17T15:08:54.657505+0000","last_clean":"2023-05-17T15:08:54.657505+0000","last_became_active":"2023-05-17T15:08:54.646177+0000","last_became_peered":"2023-05-17T15:08:54.646177+0000","last_unstale":"2023-05-17T15:08:54.657505+0000","last_undegraded":"2023-05-17T15:08:54.657505+0000","last_fullsized":"2023-05-17T15:08:54.657505+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.634026+0000","last_change":"2023-05-17T15:08:54.262457+0000","last_active":"2023-05-17T15:08:54.634026+0000","last_peered":"2023-05-17T15:08:54.634026+0000","last_clean":"2023-05-17T15:08:54.634026+0000","last_became_active":"2023-05-17T15:08:54.262186+0000","last_became_peered":"2023-05-17T15:08:54.262186+0000","last_unstale":"2023-05-17T15:08:54.634026+0000","last_undegraded":"2023-05-17T15:08:54.634026+0000","last_fullsized":"2023-05-17T15:08:54.634026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.655660+0000","last_change":"2023-05-17T15:08:54.654357+0000","last_active":"2023-05-17T15:08:54.655660+0000","last_peered":"2023-05-17T15:08:54.655660+0000","last_clean":"2023-05-17T15:08:54.655660+0000","last_became_active":"2023-05-17T15:08:54.653995+0000","last_became_peered":"2023-05-17T15:08:54.653995+0000","last_unstale":"2023-05-17T15:08:54.655660+0000","last_undegraded":"2023-05-17T15:08:54.655660+0000","last_fullsized":"2023-05-17T15:08:54.655660+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633736+0000","last_change":"2023-05-17T15:08:54.262152+0000","last_active":"2023-05-17T15:08:54.633736+0000","last_peered":"2023-05-17T15:08:54.633736+0000","last_clean":"2023-05-17T15:08:54.633736+0000","last_became_active":"2023-05-17T15:08:54.261899+0000","last_became_peered":"2023-05-17T15:08:54.261899+0000","last_unstale":"2023-05-17T15:08:54.633736+0000","last_undegraded":"2023-05-17T15:08:54.633736+0000","last_fullsized":"2023-05-17T15:08:54.633736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657221+0000","last_change":"2023-05-17T15:08:54.653749+0000","last_active":"2023-05-17T15:08:54.657221+0000","last_peered":"2023-05-17T15:08:54.657221+0000","last_clean":"2023-05-17T15:08:54.657221+0000","last_became_active":"2023-05-17T15:08:54.653492+0000","last_became_peered":"2023-05-17T15:08:54.653492+0000","last_unstale":"2023-05-17T15:08:54.657221+0000","last_undegraded":"2023-05-17T15:08:54.657221+0000","last_fullsized":"2023-05-17T15:08:54.657221+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635144+0000","last_change":"2023-05-17T15:08:54.268108+0000","last_active":"2023-05-17T15:08:54.635144+0000","last_peered":"2023-05-17T15:08:54.635144+0000","last_clean":"2023-05-17T15:08:54.635144+0000","last_became_active":"2023-05-17T15:08:54.267836+0000","last_became_peered":"2023-05-17T15:08:54.267836+0000","last_unstale":"2023-05-17T15:08:54.635144+0000","last_undegraded":"2023-05-17T15:08:54.635144+0000","last_fullsized":"2023-05-17T15:08:54.635144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.660802+0000","last_change":"2023-05-17T15:08:54.639587+0000","last_active":"2023-05-17T15:08:54.660802+0000","last_peered":"2023-05-17T15:08:54.660802+0000","last_clean":"2023-05-17T15:08:54.660802+0000","last_became_active":"2023-05-17T15:08:54.639316+0000","last_became_peered":"2023-05-17T15:08:54.639316+0000","last_unstale":"2023-05-17T15:08:54.660802+0000","last_undegraded":"2023-05-17T15:08:54.660802+0000","last_fullsized":"2023-05-17T15:08:54.660802+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633554+0000","last_change":"2023-05-17T15:08:54.249785+0000","last_active":"2023-05-17T15:08:54.633554+0000","last_peered":"2023-05-17T15:08:54.633554+0000","last_clean":"2023-05-17T15:08:54.633554+0000","last_became_active":"2023-05-17T15:08:54.249456+0000","last_became_peered":"2023-05-17T15:08:54.249456+0000","last_unstale":"2023-05-17T15:08:54.633554+0000","last_undegraded":"2023-05-17T15:08:54.633554+0000","last_fullsized":"2023-05-17T15:08:54.633554+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653206+0000","last_change":"2023-05-17T15:08:54.647406+0000","last_active":"2023-05-17T15:08:54.653206+0000","last_peered":"2023-05-17T15:08:54.653206+0000","last_clean":"2023-05-17T15:08:54.653206+0000","last_became_active":"2023-05-17T15:08:54.647081+0000","last_became_peered":"2023-05-17T15:08:54.647081+0000","last_unstale":"2023-05-17T15:08:54.653206+0000","last_undegraded":"2023-05-17T15:08:54.653206+0000","last_fullsized":"2023-05-17T15:08:54.653206+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.632942+0000","last_change":"2023-05-17T15:08:54.261281+0000","last_active":"2023-05-17T15:08:54.632942+0000","last_peered":"2023-05-17T15:08:54.632942+0000","last_clean":"2023-05-17T15:08:54.632942+0000","last_became_active":"2023-05-17T15:08:54.260987+0000","last_became_peered":"2023-05-17T15:08:54.260987+0000","last_unstale":"2023-05-17T15:08:54.632942+0000","last_undegraded":"2023-05-17T15:08:54.632942+0000","last_fullsized":"2023-05-17T15:08:54.632942+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652366+0000","last_change":"2023-05-17T15:08:54.650618+0000","last_active":"2023-05-17T15:08:54.652366+0000","last_peered":"2023-05-17T15:08:54.652366+0000","last_clean":"2023-05-17T15:08:54.652366+0000","last_became_active":"2023-05-17T15:08:54.650226+0000","last_became_peered":"2023-05-17T15:08:54.650226+0000","last_unstale":"2023-05-17T15:08:54.652366+0000","last_undegraded":"2023-05-17T15:08:54.652366+0000","last_fullsized":"2023-05-17T15:08:54.652366+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635000+0000","last_change":"2023-05-17T15:08:54.258001+0000","last_active":"2023-05-17T15:08:54.635000+0000","last_peered":"2023-05-17T15:08:54.635000+0000","last_clean":"2023-05-17T15:08:54.635000+0000","last_became_active":"2023-05-17T15:08:54.257718+0000","last_became_peered":"2023-05-17T15:08:54.257718+0000","last_unstale":"2023-05-17T15:08:54.635000+0000","last_undegraded":"2023-05-17T15:08:54.635000+0000","last_fullsized":"2023-05-17T15:08:54.635000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.656929+0000","last_change":"2023-05-17T15:08:54.652272+0000","last_active":"2023-05-17T15:08:54.656929+0000","last_peered":"2023-05-17T15:08:54.656929+0000","last_clean":"2023-05-17T15:08:54.656929+0000","last_became_active":"2023-05-17T15:08:54.652020+0000","last_became_peered":"2023-05-17T15:08:54.652020+0000","last_unstale":"2023-05-17T15:08:54.656929+0000","last_undegraded":"2023-05-17T15:08:54.656929+0000","last_fullsized":"2023-05-17T15:08:54.656929+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.631691+0000","last_change":"2023-05-17T15:08:54.262074+0000","last_active":"2023-05-17T15:08:54.631691+0000","last_peered":"2023-05-17T15:08:54.631691+0000","last_clean":"2023-05-17T15:08:54.631691+0000","last_became_active":"2023-05-17T15:08:54.261719+0000","last_became_peered":"2023-05-17T15:08:54.261719+0000","last_unstale":"2023-05-17T15:08:54.631691+0000","last_undegraded":"2023-05-17T15:08:54.631691+0000","last_fullsized":"2023-05-17T15:08:54.631691+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657288+0000","last_change":"2023-05-17T15:08:54.651949+0000","last_active":"2023-05-17T15:08:54.657288+0000","last_peered":"2023-05-17T15:08:54.657288+0000","last_clean":"2023-05-17T15:08:54.657288+0000","last_became_active":"2023-05-17T15:08:54.651671+0000","last_became_peered":"2023-05-17T15:08:54.651671+0000","last_unstale":"2023-05-17T15:08:54.657288+0000","last_undegraded":"2023-05-17T15:08:54.657288+0000","last_fullsized":"2023-05-17T15:08:54.657288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661403+0000","last_change":"2023-05-17T15:08:54.260568+0000","last_active":"2023-05-17T15:08:54.661403+0000","last_peered":"2023-05-17T15:08:54.661403+0000","last_clean":"2023-05-17T15:08:54.661403+0000","last_became_active":"2023-05-17T15:08:54.260238+0000","last_became_peered":"2023-05-17T15:08:54.260238+0000","last_unstale":"2023-05-17T15:08:54.661403+0000","last_undegraded":"2023-05-17T15:08:54.661403+0000","last_fullsized":"2023-05-17T15:08:54.661403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653342+0000","last_change":"2023-05-17T15:08:54.648244+0000","last_active":"2023-05-17T15:08:54.653342+0000","last_peered":"2023-05-17T15:08:54.653342+0000","last_clean":"2023-05-17T15:08:54.653342+0000","last_became_active":"2023-05-17T15:08:54.647929+0000","last_became_peered":"2023-05-17T15:08:54.647929+0000","last_unstale":"2023-05-17T15:08:54.653342+0000","last_undegraded":"2023-05-17T15:08:54.653342+0000","last_fullsized":"2023-05-17T15:08:54.653342+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653868+0000","last_change":"2023-05-17T15:08:54.267741+0000","last_active":"2023-05-17T15:08:54.653868+0000","last_peered":"2023-05-17T15:08:54.653868+0000","last_clean":"2023-05-17T15:08:54.653868+0000","last_became_active":"2023-05-17T15:08:54.267400+0000","last_became_peered":"2023-05-17T15:08:54.267400+0000","last_unstale":"2023-05-17T15:08:54.653868+0000","last_undegraded":"2023-05-17T15:08:54.653868+0000","last_fullsized":"2023-05-17T15:08:54.653868+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.654920+0000","last_change":"2023-05-17T15:08:54.651597+0000","last_active":"2023-05-17T15:08:54.654920+0000","last_peered":"2023-05-17T15:08:54.654920+0000","last_clean":"2023-05-17T15:08:54.654920+0000","last_became_active":"2023-05-17T15:08:54.651318+0000","last_became_peered":"2023-05-17T15:08:54.651318+0000","last_unstale":"2023-05-17T15:08:54.654920+0000","last_undegraded":"2023-05-17T15:08:54.654920+0000","last_fullsized":"2023-05-17T15:08:54.654920+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"96'2","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658619+0000","last_change":"2023-05-17T15:08:54.267917+0000","last_active":"2023-05-17T15:08:54.658619+0000","last_peered":"2023-05-17T15:08:54.658619+0000","last_clean":"2023-05-17T15:08:54.658619+0000","last_became_active":"2023-05-17T15:08:54.265748+0000","last_became_peered":"2023-05-17T15:08:54.265748+0000","last_unstale":"2023-05-17T15:08:54.658619+0000","last_undegraded":"2023-05-17T15:08:54.658619+0000","last_fullsized":"2023-05-17T15:08:54.658619+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.655276+0000","last_change":"2023-05-17T15:08:54.653959+0000","last_active":"2023-05-17T15:08:54.655276+0000","last_peered":"2023-05-17T15:08:54.655276+0000","last_clean":"2023-05-17T15:08:54.655276+0000","last_became_active":"2023-05-17T15:08:54.653426+0000","last_became_peered":"2023-05-17T15:08:54.653426+0000","last_unstale":"2023-05-17T15:08:54.655276+0000","last_undegraded":"2023-05-17T15:08:54.655276+0000","last_fullsized":"2023-05-17T15:08:54.655276+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.632693+0000","last_change":"2023-05-17T15:08:54.262729+0000","last_active":"2023-05-17T15:08:54.632693+0000","last_peered":"2023-05-17T15:08:54.632693+0000","last_clean":"2023-05-17T15:08:54.632693+0000","last_became_active":"2023-05-17T15:08:54.261926+0000","last_became_peered":"2023-05-17T15:08:54.261926+0000","last_unstale":"2023-05-17T15:08:54.632693+0000","last_undegraded":"2023-05-17T15:08:54.632693+0000","last_fullsized":"2023-05-17T15:08:54.632693+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.666392+0000","last_change":"2023-05-17T15:08:54.662132+0000","last_active":"2023-05-17T15:08:54.666392+0000","last_peered":"2023-05-17T15:08:54.666392+0000","last_clean":"2023-05-17T15:08:54.666392+0000","last_became_active":"2023-05-17T15:08:54.661544+0000","last_became_peered":"2023-05-17T15:08:54.661544+0000","last_unstale":"2023-05-17T15:08:54.666392+0000","last_undegraded":"2023-05-17T15:08:54.666392+0000","last_fullsized":"2023-05-17T15:08:54.666392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635286+0000","last_change":"2023-05-17T15:08:54.263505+0000","last_active":"2023-05-17T15:08:54.635286+0000","last_peered":"2023-05-17T15:08:54.635286+0000","last_clean":"2023-05-17T15:08:54.635286+0000","last_became_active":"2023-05-17T15:08:54.263203+0000","last_became_peered":"2023-05-17T15:08:54.263203+0000","last_unstale":"2023-05-17T15:08:54.635286+0000","last_undegraded":"2023-05-17T15:08:54.635286+0000","last_fullsized":"2023-05-17T15:08:54.635286+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.656982+0000","last_change":"2023-05-17T15:08:54.649993+0000","last_active":"2023-05-17T15:08:54.656982+0000","last_peered":"2023-05-17T15:08:54.656982+0000","last_clean":"2023-05-17T15:08:54.656982+0000","last_became_active":"2023-05-17T15:08:54.649402+0000","last_became_peered":"2023-05-17T15:08:54.649402+0000","last_unstale":"2023-05-17T15:08:54.656982+0000","last_undegraded":"2023-05-17T15:08:54.656982+0000","last_fullsized":"2023-05-17T15:08:54.656982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633061+0000","last_change":"2023-05-17T15:08:54.254900+0000","last_active":"2023-05-17T15:08:54.633061+0000","last_peered":"2023-05-17T15:08:54.633061+0000","last_clean":"2023-05-17T15:08:54.633061+0000","last_became_active":"2023-05-17T15:08:54.254602+0000","last_became_peered":"2023-05-17T15:08:54.254602+0000","last_unstale":"2023-05-17T15:08:54.633061+0000","last_undegraded":"2023-05-17T15:08:54.633061+0000","last_fullsized":"2023-05-17T15:08:54.633061+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.649815+0000","last_change":"2023-05-17T15:08:54.648451+0000","last_active":"2023-05-17T15:08:54.649815+0000","last_peered":"2023-05-17T15:08:54.649815+0000","last_clean":"2023-05-17T15:08:54.649815+0000","last_became_active":"2023-05-17T15:08:54.648156+0000","last_became_peered":"2023-05-17T15:08:54.648156+0000","last_unstale":"2023-05-17T15:08:54.649815+0000","last_undegraded":"2023-05-17T15:08:54.649815+0000","last_fullsized":"2023-05-17T15:08:54.649815+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.637711+0000","last_change":"2023-05-17T15:08:54.262186+0000","last_active":"2023-05-17T15:08:54.637711+0000","last_peered":"2023-05-17T15:08:54.637711+0000","last_clean":"2023-05-17T15:08:54.637711+0000","last_became_active":"2023-05-17T15:08:54.261879+0000","last_became_peered":"2023-05-17T15:08:54.261879+0000","last_unstale":"2023-05-17T15:08:54.637711+0000","last_undegraded":"2023-05-17T15:08:54.637711+0000","last_fullsized":"2023-05-17T15:08:54.637711+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.665804+0000","last_change":"2023-05-17T15:08:54.661416+0000","last_active":"2023-05-17T15:08:54.665804+0000","last_peered":"2023-05-17T15:08:54.665804+0000","last_clean":"2023-05-17T15:08:54.665804+0000","last_became_active":"2023-05-17T15:08:54.661198+0000","last_became_peered":"2023-05-17T15:08:54.661198+0000","last_unstale":"2023-05-17T15:08:54.665804+0000","last_undegraded":"2023-05-17T15:08:54.665804+0000","last_fullsized":"2023-05-17T15:08:54.665804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635717+0000","last_change":"2023-05-17T15:08:54.257705+0000","last_active":"2023-05-17T15:08:54.635717+0000","last_peered":"2023-05-17T15:08:54.635717+0000","last_clean":"2023-05-17T15:08:54.635717+0000","last_became_active":"2023-05-17T15:08:54.257412+0000","last_became_peered":"2023-05-17T15:08:54.257412+0000","last_unstale":"2023-05-17T15:08:54.635717+0000","last_undegraded":"2023-05-17T15:08:54.635717+0000","last_fullsized":"2023-05-17T15:08:54.635717+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652659+0000","last_change":"2023-05-17T15:08:54.644489+0000","last_active":"2023-05-17T15:08:54.652659+0000","last_peered":"2023-05-17T15:08:54.652659+0000","last_clean":"2023-05-17T15:08:54.652659+0000","last_became_active":"2023-05-17T15:08:54.644135+0000","last_became_peered":"2023-05-17T15:08:54.644135+0000","last_unstale":"2023-05-17T15:08:54.652659+0000","last_undegraded":"2023-05-17T15:08:54.652659+0000","last_fullsized":"2023-05-17T15:08:54.652659+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.639705+0000","last_change":"2023-05-17T15:08:54.268207+0000","last_active":"2023-05-17T15:08:54.639705+0000","last_peered":"2023-05-17T15:08:54.639705+0000","last_clean":"2023-05-17T15:08:54.639705+0000","last_became_active":"2023-05-17T15:08:54.267927+0000","last_became_peered":"2023-05-17T15:08:54.267927+0000","last_unstale":"2023-05-17T15:08:54.639705+0000","last_undegraded":"2023-05-17T15:08:54.639705+0000","last_fullsized":"2023-05-17T15:08:54.639705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.646234+0000","last_change":"2023-05-17T15:08:54.640168+0000","last_active":"2023-05-17T15:08:54.646234+0000","last_peered":"2023-05-17T15:08:54.646234+0000","last_clean":"2023-05-17T15:08:54.646234+0000","last_became_active":"2023-05-17T15:08:54.639874+0000","last_became_peered":"2023-05-17T15:08:54.639874+0000","last_unstale":"2023-05-17T15:08:54.646234+0000","last_undegraded":"2023-05-17T15:08:54.646234+0000","last_fullsized":"2023-05-17T15:08:54.646234+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.634135+0000","last_change":"2023-05-17T15:08:54.263854+0000","last_active":"2023-05-17T15:08:54.634135+0000","last_peered":"2023-05-17T15:08:54.634135+0000","last_clean":"2023-05-17T15:08:54.634135+0000","last_became_active":"2023-05-17T15:08:54.263569+0000","last_became_peered":"2023-05-17T15:08:54.263569+0000","last_unstale":"2023-05-17T15:08:54.634135+0000","last_undegraded":"2023-05-17T15:08:54.634135+0000","last_fullsized":"2023-05-17T15:08:54.634135+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653694+0000","last_change":"2023-05-17T15:08:54.649927+0000","last_active":"2023-05-17T15:08:54.653694+0000","last_peered":"2023-05-17T15:08:54.653694+0000","last_clean":"2023-05-17T15:08:54.653694+0000","last_became_active":"2023-05-17T15:08:54.649299+0000","last_became_peered":"2023-05-17T15:08:54.649299+0000","last_unstale":"2023-05-17T15:08:54.653694+0000","last_undegraded":"2023-05-17T15:08:54.653694+0000","last_fullsized":"2023-05-17T15:08:54.653694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"96'3","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.662439+0000","last_change":"2023-05-17T15:08:54.258048+0000","last_active":"2023-05-17T15:08:54.662439+0000","last_peered":"2023-05-17T15:08:54.662439+0000","last_clean":"2023-05-17T15:08:54.662439+0000","last_became_active":"2023-05-17T15:08:54.257755+0000","last_became_peered":"2023-05-17T15:08:54.257755+0000","last_unstale":"2023-05-17T15:08:54.662439+0000","last_undegraded":"2023-05-17T15:08:54.662439+0000","last_fullsized":"2023-05-17T15:08:54.662439+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658770+0000","last_change":"2023-05-17T15:08:54.657776+0000","last_active":"2023-05-17T15:08:54.658770+0000","last_peered":"2023-05-17T15:08:54.658770+0000","last_clean":"2023-05-17T15:08:54.658770+0000","last_became_active":"2023-05-17T15:08:54.656736+0000","last_became_peered":"2023-05-17T15:08:54.656736+0000","last_unstale":"2023-05-17T15:08:54.658770+0000","last_undegraded":"2023-05-17T15:08:54.658770+0000","last_fullsized":"2023-05-17T15:08:54.658770+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"96'2","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.650325+0000","last_change":"2023-05-17T15:08:54.258271+0000","last_active":"2023-05-17T15:08:54.650325+0000","last_peered":"2023-05-17T15:08:54.650325+0000","last_clean":"2023-05-17T15:08:54.650325+0000","last_became_active":"2023-05-17T15:08:54.257940+0000","last_became_peered":"2023-05-17T15:08:54.257940+0000","last_unstale":"2023-05-17T15:08:54.650325+0000","last_undegraded":"2023-05-17T15:08:54.650325+0000","last_fullsized":"2023-05-17T15:08:54.650325+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.649217+0000","last_change":"2023-05-17T15:08:54.648319+0000","last_active":"2023-05-17T15:08:54.649217+0000","last_peered":"2023-05-17T15:08:54.649217+0000","last_clean":"2023-05-17T15:08:54.649217+0000","last_became_active":"2023-05-17T15:08:54.648030+0000","last_became_peered":"2023-05-17T15:08:54.648030+0000","last_unstale":"2023-05-17T15:08:54.649217+0000","last_undegraded":"2023-05-17T15:08:54.649217+0000","last_fullsized":"2023-05-17T15:08:54.649217+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652416+0000","last_change":"2023-05-17T15:08:54.255246+0000","last_active":"2023-05-17T15:08:54.652416+0000","last_peered":"2023-05-17T15:08:54.652416+0000","last_clean":"2023-05-17T15:08:54.652416+0000","last_became_active":"2023-05-17T15:08:54.254774+0000","last_became_peered":"2023-05-17T15:08:54.254774+0000","last_unstale":"2023-05-17T15:08:54.652416+0000","last_undegraded":"2023-05-17T15:08:54.652416+0000","last_fullsized":"2023-05-17T15:08:54.652416+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.660409+0000","last_change":"2023-05-17T15:08:54.659683+0000","last_active":"2023-05-17T15:08:54.660409+0000","last_peered":"2023-05-17T15:08:54.660409+0000","last_clean":"2023-05-17T15:08:54.660409+0000","last_became_active":"2023-05-17T15:08:54.659373+0000","last_became_peered":"2023-05-17T15:08:54.659373+0000","last_unstale":"2023-05-17T15:08:54.660409+0000","last_undegraded":"2023-05-17T15:08:54.660409+0000","last_fullsized":"2023-05-17T15:08:54.660409+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.638910+0000","last_change":"2023-05-17T15:08:54.270579+0000","last_active":"2023-05-17T15:08:54.638910+0000","last_peered":"2023-05-17T15:08:54.638910+0000","last_clean":"2023-05-17T15:08:54.638910+0000","last_became_active":"2023-05-17T15:08:54.270231+0000","last_became_peered":"2023-05-17T15:08:54.270231+0000","last_unstale":"2023-05-17T15:08:54.638910+0000","last_undegraded":"2023-05-17T15:08:54.638910+0000","last_fullsized":"2023-05-17T15:08:54.638910+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653186+0000","last_change":"2023-05-17T15:08:54.648958+0000","last_active":"2023-05-17T15:08:54.653186+0000","last_peered":"2023-05-17T15:08:54.653186+0000","last_clean":"2023-05-17T15:08:54.653186+0000","last_became_active":"2023-05-17T15:08:54.648477+0000","last_became_peered":"2023-05-17T15:08:54.648477+0000","last_unstale":"2023-05-17T15:08:54.653186+0000","last_undegraded":"2023-05-17T15:08:54.653186+0000","last_fullsized":"2023-05-17T15:08:54.653186+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.636851+0000","last_change":"2023-05-17T15:08:54.262544+0000","last_active":"2023-05-17T15:08:54.636851+0000","last_peered":"2023-05-17T15:08:54.636851+0000","last_clean":"2023-05-17T15:08:54.636851+0000","last_became_active":"2023-05-17T15:08:54.259695+0000","last_became_peered":"2023-05-17T15:08:54.259695+0000","last_unstale":"2023-05-17T15:08:54.636851+0000","last_undegraded":"2023-05-17T15:08:54.636851+0000","last_fullsized":"2023-05-17T15:08:54.636851+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657974+0000","last_change":"2023-05-17T15:08:54.655612+0000","last_active":"2023-05-17T15:08:54.657974+0000","last_peered":"2023-05-17T15:08:54.657974+0000","last_clean":"2023-05-17T15:08:54.657974+0000","last_became_active":"2023-05-17T15:08:54.655259+0000","last_became_peered":"2023-05-17T15:08:54.655259+0000","last_unstale":"2023-05-17T15:08:54.657974+0000","last_undegraded":"2023-05-17T15:08:54.657974+0000","last_fullsized":"2023-05-17T15:08:54.657974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"96'4","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.656029+0000","last_change":"2023-05-17T15:08:54.251360+0000","last_active":"2023-05-17T15:08:54.656029+0000","last_peered":"2023-05-17T15:08:54.656029+0000","last_clean":"2023-05-17T15:08:54.656029+0000","last_became_active":"2023-05-17T15:08:54.251150+0000","last_became_peered":"2023-05-17T15:08:54.251150+0000","last_unstale":"2023-05-17T15:08:54.656029+0000","last_undegraded":"2023-05-17T15:08:54.656029+0000","last_fullsized":"2023-05-17T15:08:54.656029+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.647345+0000","last_change":"2023-05-17T15:08:54.642588+0000","last_active":"2023-05-17T15:08:54.647345+0000","last_peered":"2023-05-17T15:08:54.647345+0000","last_clean":"2023-05-17T15:08:54.647345+0000","last_became_active":"2023-05-17T15:08:54.642318+0000","last_became_peered":"2023-05-17T15:08:54.642318+0000","last_unstale":"2023-05-17T15:08:54.647345+0000","last_undegraded":"2023-05-17T15:08:54.647345+0000","last_fullsized":"2023-05-17T15:08:54.647345+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"96'2","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658059+0000","last_change":"2023-05-17T15:08:54.260659+0000","last_active":"2023-05-17T15:08:54.658059+0000","last_peered":"2023-05-17T15:08:54.658059+0000","last_clean":"2023-05-17T15:08:54.658059+0000","last_became_active":"2023-05-17T15:08:54.260371+0000","last_became_peered":"2023-05-17T15:08:54.260371+0000","last_unstale":"2023-05-17T15:08:54.658059+0000","last_undegraded":"2023-05-17T15:08:54.658059+0000","last_fullsized":"2023-05-17T15:08:54.658059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653104+0000","last_change":"2023-05-17T15:08:54.648457+0000","last_active":"2023-05-17T15:08:54.653104+0000","last_peered":"2023-05-17T15:08:54.653104+0000","last_clean":"2023-05-17T15:08:54.653104+0000","last_became_active":"2023-05-17T15:08:54.647901+0000","last_became_peered":"2023-05-17T15:08:54.647901+0000","last_unstale":"2023-05-17T15:08:54.653104+0000","last_undegraded":"2023-05-17T15:08:54.653104+0000","last_fullsized":"2023-05-17T15:08:54.653104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.641995+0000","last_change":"2023-05-17T15:08:54.257883+0000","last_active":"2023-05-17T15:08:54.641995+0000","last_peered":"2023-05-17T15:08:54.641995+0000","last_clean":"2023-05-17T15:08:54.641995+0000","last_became_active":"2023-05-17T15:08:54.257585+0000","last_became_peered":"2023-05-17T15:08:54.257585+0000","last_unstale":"2023-05-17T15:08:54.641995+0000","last_undegraded":"2023-05-17T15:08:54.641995+0000","last_fullsized":"2023-05-17T15:08:54.641995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.654898+0000","last_change":"2023-05-17T15:08:54.651289+0000","last_active":"2023-05-17T15:08:54.654898+0000","last_peered":"2023-05-17T15:08:54.654898+0000","last_clean":"2023-05-17T15:08:54.654898+0000","last_became_active":"2023-05-17T15:08:54.650809+0000","last_became_peered":"2023-05-17T15:08:54.650809+0000","last_unstale":"2023-05-17T15:08:54.654898+0000","last_undegraded":"2023-05-17T15:08:54.654898+0000","last_fullsized":"2023-05-17T15:08:54.654898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.640361+0000","last_change":"2023-05-17T15:08:54.268672+0000","last_active":"2023-05-17T15:08:54.640361+0000","last_peered":"2023-05-17T15:08:54.640361+0000","last_clean":"2023-05-17T15:08:54.640361+0000","last_became_active":"2023-05-17T15:08:54.268408+0000","last_became_peered":"2023-05-17T15:08:54.268408+0000","last_unstale":"2023-05-17T15:08:54.640361+0000","last_undegraded":"2023-05-17T15:08:54.640361+0000","last_fullsized":"2023-05-17T15:08:54.640361+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657203+0000","last_change":"2023-05-17T15:08:54.653230+0000","last_active":"2023-05-17T15:08:54.657203+0000","last_peered":"2023-05-17T15:08:54.657203+0000","last_clean":"2023-05-17T15:08:54.657203+0000","last_became_active":"2023-05-17T15:08:54.652849+0000","last_became_peered":"2023-05-17T15:08:54.652849+0000","last_unstale":"2023-05-17T15:08:54.657203+0000","last_undegraded":"2023-05-17T15:08:54.657203+0000","last_fullsized":"2023-05-17T15:08:54.657203+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.639162+0000","last_change":"2023-05-17T15:08:54.267658+0000","last_active":"2023-05-17T15:08:54.639162+0000","last_peered":"2023-05-17T15:08:54.639162+0000","last_clean":"2023-05-17T15:08:54.639162+0000","last_became_active":"2023-05-17T15:08:54.267287+0000","last_became_peered":"2023-05-17T15:08:54.267287+0000","last_unstale":"2023-05-17T15:08:54.639162+0000","last_undegraded":"2023-05-17T15:08:54.639162+0000","last_fullsized":"2023-05-17T15:08:54.639162+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652880+0000","last_change":"2023-05-17T15:08:54.648179+0000","last_active":"2023-05-17T15:08:54.652880+0000","last_peered":"2023-05-17T15:08:54.652880+0000","last_clean":"2023-05-17T15:08:54.652880+0000","last_became_active":"2023-05-17T15:08:54.647847+0000","last_became_peered":"2023-05-17T15:08:54.647847+0000","last_unstale":"2023-05-17T15:08:54.652880+0000","last_undegraded":"2023-05-17T15:08:54.652880+0000","last_fullsized":"2023-05-17T15:08:54.652880+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.632193+0000","last_change":"2023-05-17T15:08:54.264262+0000","last_active":"2023-05-17T15:08:54.632193+0000","last_peered":"2023-05-17T15:08:54.632193+0000","last_clean":"2023-05-17T15:08:54.632193+0000","last_became_active":"2023-05-17T15:08:54.263935+0000","last_became_peered":"2023-05-17T15:08:54.263935+0000","last_unstale":"2023-05-17T15:08:54.632193+0000","last_undegraded":"2023-05-17T15:08:54.632193+0000","last_fullsized":"2023-05-17T15:08:54.632193+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.644581+0000","last_change":"2023-05-17T15:08:54.641095+0000","last_active":"2023-05-17T15:08:54.644581+0000","last_peered":"2023-05-17T15:08:54.644581+0000","last_clean":"2023-05-17T15:08:54.644581+0000","last_became_active":"2023-05-17T15:08:54.640793+0000","last_became_peered":"2023-05-17T15:08:54.640793+0000","last_unstale":"2023-05-17T15:08:54.644581+0000","last_undegraded":"2023-05-17T15:08:54.644581+0000","last_fullsized":"2023-05-17T15:08:54.644581+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.635861+0000","last_change":"2023-05-17T15:08:54.260215+0000","last_active":"2023-05-17T15:08:54.635861+0000","last_peered":"2023-05-17T15:08:54.635861+0000","last_clean":"2023-05-17T15:08:54.635861+0000","last_became_active":"2023-05-17T15:08:54.259732+0000","last_became_peered":"2023-05-17T15:08:54.259732+0000","last_unstale":"2023-05-17T15:08:54.635861+0000","last_undegraded":"2023-05-17T15:08:54.635861+0000","last_fullsized":"2023-05-17T15:08:54.635861+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.659026+0000","last_change":"2023-05-17T15:08:54.657585+0000","last_active":"2023-05-17T15:08:54.659026+0000","last_peered":"2023-05-17T15:08:54.659026+0000","last_clean":"2023-05-17T15:08:54.659026+0000","last_became_active":"2023-05-17T15:08:54.656803+0000","last_became_peered":"2023-05-17T15:08:54.656803+0000","last_unstale":"2023-05-17T15:08:54.659026+0000","last_undegraded":"2023-05-17T15:08:54.659026+0000","last_fullsized":"2023-05-17T15:08:54.659026+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.632613+0000","last_change":"2023-05-17T15:08:54.253796+0000","last_active":"2023-05-17T15:08:54.632613+0000","last_peered":"2023-05-17T15:08:54.632613+0000","last_clean":"2023-05-17T15:08:54.632613+0000","last_became_active":"2023-05-17T15:08:54.253479+0000","last_became_peered":"2023-05-17T15:08:54.253479+0000","last_unstale":"2023-05-17T15:08:54.632613+0000","last_undegraded":"2023-05-17T15:08:54.632613+0000","last_fullsized":"2023-05-17T15:08:54.632613+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658966+0000","last_change":"2023-05-17T15:08:54.657429+0000","last_active":"2023-05-17T15:08:54.658966+0000","last_peered":"2023-05-17T15:08:54.658966+0000","last_clean":"2023-05-17T15:08:54.658966+0000","last_became_active":"2023-05-17T15:08:54.656988+0000","last_became_peered":"2023-05-17T15:08:54.656988+0000","last_unstale":"2023-05-17T15:08:54.658966+0000","last_undegraded":"2023-05-17T15:08:54.658966+0000","last_fullsized":"2023-05-17T15:08:54.658966+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.655473+0000","last_change":"2023-05-17T15:08:54.258128+0000","last_active":"2023-05-17T15:08:54.655473+0000","last_peered":"2023-05-17T15:08:54.655473+0000","last_clean":"2023-05-17T15:08:54.655473+0000","last_became_active":"2023-05-17T15:08:54.256391+0000","last_became_peered":"2023-05-17T15:08:54.256391+0000","last_unstale":"2023-05-17T15:08:54.655473+0000","last_undegraded":"2023-05-17T15:08:54.655473+0000","last_fullsized":"2023-05-17T15:08:54.655473+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.662124+0000","last_change":"2023-05-17T15:08:54.659788+0000","last_active":"2023-05-17T15:08:54.662124+0000","last_peered":"2023-05-17T15:08:54.662124+0000","last_clean":"2023-05-17T15:08:54.662124+0000","last_became_active":"2023-05-17T15:08:54.659479+0000","last_became_peered":"2023-05-17T15:08:54.659479+0000","last_unstale":"2023-05-17T15:08:54.662124+0000","last_undegraded":"2023-05-17T15:08:54.662124+0000","last_fullsized":"2023-05-17T15:08:54.662124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.637486+0000","last_change":"2023-05-17T15:08:54.257141+0000","last_active":"2023-05-17T15:08:54.637486+0000","last_peered":"2023-05-17T15:08:54.637486+0000","last_clean":"2023-05-17T15:08:54.637486+0000","last_became_active":"2023-05-17T15:08:54.256827+0000","last_became_peered":"2023-05-17T15:08:54.256827+0000","last_unstale":"2023-05-17T15:08:54.637486+0000","last_undegraded":"2023-05-17T15:08:54.637486+0000","last_fullsized":"2023-05-17T15:08:54.637486+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653375+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:08:54.653375+0000","last_peered":"2023-05-17T15:08:54.653375+0000","last_clean":"2023-05-17T15:08:54.653375+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:08:54.653375+0000","last_undegraded":"2023-05-17T15:08:54.653375+0000","last_fullsized":"2023-05-17T15:08:54.653375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657180+0000","last_change":"2023-05-17T15:08:54.653508+0000","last_active":"2023-05-17T15:08:54.657180+0000","last_peered":"2023-05-17T15:08:54.657180+0000","last_clean":"2023-05-17T15:08:54.657180+0000","last_became_active":"2023-05-17T15:08:54.650866+0000","last_became_peered":"2023-05-17T15:08:54.650866+0000","last_unstale":"2023-05-17T15:08:54.657180+0000","last_undegraded":"2023-05-17T15:08:54.657180+0000","last_fullsized":"2023-05-17T15:08:54.657180+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.657729+0000","last_change":"2023-05-17T15:08:54.254126+0000","last_active":"2023-05-17T15:08:54.657729+0000","last_peered":"2023-05-17T15:08:54.657729+0000","last_clean":"2023-05-17T15:08:54.657729+0000","last_became_active":"2023-05-17T15:08:54.253832+0000","last_became_peered":"2023-05-17T15:08:54.253832+0000","last_unstale":"2023-05-17T15:08:54.657729+0000","last_undegraded":"2023-05-17T15:08:54.657729+0000","last_fullsized":"2023-05-17T15:08:54.657729+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633082+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:08:54.633082+0000","last_peered":"2023-05-17T15:08:54.633082+0000","last_clean":"2023-05-17T15:08:54.633082+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:08:54.633082+0000","last_undegraded":"2023-05-17T15:08:54.633082+0000","last_fullsized":"2023-05-17T15:08:54.633082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652025+0000","last_change":"2023-05-17T15:08:54.645181+0000","last_active":"2023-05-17T15:08:54.652025+0000","last_peered":"2023-05-17T15:08:54.652025+0000","last_clean":"2023-05-17T15:08:54.652025+0000","last_became_active":"2023-05-17T15:08:54.644889+0000","last_became_peered":"2023-05-17T15:08:54.644889+0000","last_unstale":"2023-05-17T15:08:54.652025+0000","last_undegraded":"2023-05-17T15:08:54.652025+0000","last_fullsized":"2023-05-17T15:08:54.652025+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633758+0000","last_change":"2023-05-17T15:08:54.265101+0000","last_active":"2023-05-17T15:08:54.633758+0000","last_peered":"2023-05-17T15:08:54.633758+0000","last_clean":"2023-05-17T15:08:54.633758+0000","last_became_active":"2023-05-17T15:08:54.264786+0000","last_became_peered":"2023-05-17T15:08:54.264786+0000","last_unstale":"2023-05-17T15:08:54.633758+0000","last_undegraded":"2023-05-17T15:08:54.633758+0000","last_fullsized":"2023-05-17T15:08:54.633758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":77,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.636928+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:08:54.636928+0000","last_peered":"2023-05-17T15:08:54.636928+0000","last_clean":"2023-05-17T15:08:54.636928+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:08:54.636928+0000","last_undegraded":"2023-05-17T15:08:54.636928+0000","last_fullsized":"2023-05-17T15:08:54.636928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.663133+0000","last_change":"2023-05-17T15:08:54.658900+0000","last_active":"2023-05-17T15:08:54.663133+0000","last_peered":"2023-05-17T15:08:54.663133+0000","last_clean":"2023-05-17T15:08:54.663133+0000","last_became_active":"2023-05-17T15:08:54.658636+0000","last_became_peered":"2023-05-17T15:08:54.658636+0000","last_unstale":"2023-05-17T15:08:54.663133+0000","last_undegraded":"2023-05-17T15:08:54.663133+0000","last_fullsized":"2023-05-17T15:08:54.663133+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.634414+0000","last_change":"2023-05-17T15:08:54.264062+0000","last_active":"2023-05-17T15:08:54.634414+0000","last_peered":"2023-05-17T15:08:54.634414+0000","last_clean":"2023-05-17T15:08:54.634414+0000","last_became_active":"2023-05-17T15:08:54.263647+0000","last_became_peered":"2023-05-17T15:08:54.263647+0000","last_unstale":"2023-05-17T15:08:54.634414+0000","last_undegraded":"2023-05-17T15:08:54.634414+0000","last_fullsized":"2023-05-17T15:08:54.634414+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633430+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:08:54.633430+0000","last_peered":"2023-05-17T15:08:54.633430+0000","last_clean":"2023-05-17T15:08:54.633430+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:08:54.633430+0000","last_undegraded":"2023-05-17T15:08:54.633430+0000","last_fullsized":"2023-05-17T15:08:54.633430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.639696+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:08:54.639696+0000","last_peered":"2023-05-17T15:08:54.639696+0000","last_clean":"2023-05-17T15:08:54.639696+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:08:54.639696+0000","last_undegraded":"2023-05-17T15:08:54.639696+0000","last_fullsized":"2023-05-17T15:08:54.639696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.656314+0000","last_change":"2023-05-17T15:08:54.650877+0000","last_active":"2023-05-17T15:08:54.656314+0000","last_peered":"2023-05-17T15:08:54.656314+0000","last_clean":"2023-05-17T15:08:54.656314+0000","last_became_active":"2023-05-17T15:08:54.650583+0000","last_became_peered":"2023-05-17T15:08:54.650583+0000","last_unstale":"2023-05-17T15:08:54.656314+0000","last_undegraded":"2023-05-17T15:08:54.656314+0000","last_fullsized":"2023-05-17T15:08:54.656314+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.633429+0000","last_change":"2023-05-17T15:08:54.265196+0000","last_active":"2023-05-17T15:08:54.633429+0000","last_peered":"2023-05-17T15:08:54.633429+0000","last_clean":"2023-05-17T15:08:54.633429+0000","last_became_active":"2023-05-17T15:08:54.264790+0000","last_became_peered":"2023-05-17T15:08:54.264790+0000","last_unstale":"2023-05-17T15:08:54.633429+0000","last_undegraded":"2023-05-17T15:08:54.633429+0000","last_fullsized":"2023-05-17T15:08:54.633429+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.639786+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:08:54.639786+0000","last_peered":"2023-05-17T15:08:54.639786+0000","last_clean":"2023-05-17T15:08:54.639786+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:08:54.639786+0000","last_undegraded":"2023-05-17T15:08:54.639786+0000","last_fullsized":"2023-05-17T15:08:54.639786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.652343+0000","last_change":"2023-05-17T15:08:54.649924+0000","last_active":"2023-05-17T15:08:54.652343+0000","last_peered":"2023-05-17T15:08:54.652343+0000","last_clean":"2023-05-17T15:08:54.652343+0000","last_became_active":"2023-05-17T15:08:54.649646+0000","last_became_peered":"2023-05-17T15:08:54.649646+0000","last_unstale":"2023-05-17T15:08:54.652343+0000","last_undegraded":"2023-05-17T15:08:54.652343+0000","last_fullsized":"2023-05-17T15:08:54.652343+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653295+0000","last_change":"2023-05-17T15:08:54.267147+0000","last_active":"2023-05-17T15:08:54.653295+0000","last_peered":"2023-05-17T15:08:54.653295+0000","last_clean":"2023-05-17T15:08:54.653295+0000","last_became_active":"2023-05-17T15:08:54.266723+0000","last_became_peered":"2023-05-17T15:08:54.266723+0000","last_unstale":"2023-05-17T15:08:54.653295+0000","last_undegraded":"2023-05-17T15:08:54.653295+0000","last_fullsized":"2023-05-17T15:08:54.653295+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.639627+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:08:54.639627+0000","last_peered":"2023-05-17T15:08:54.639627+0000","last_clean":"2023-05-17T15:08:54.639627+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:08:54.639627+0000","last_undegraded":"2023-05-17T15:08:54.639627+0000","last_fullsized":"2023-05-17T15:08:54.639627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.648581+0000","last_change":"2023-05-17T15:08:54.643180+0000","last_active":"2023-05-17T15:08:54.648581+0000","last_peered":"2023-05-17T15:08:54.648581+0000","last_clean":"2023-05-17T15:08:54.648581+0000","last_became_active":"2023-05-17T15:08:54.642033+0000","last_became_peered":"2023-05-17T15:08:54.642033+0000","last_unstale":"2023-05-17T15:08:54.648581+0000","last_undegraded":"2023-05-17T15:08:54.648581+0000","last_fullsized":"2023-05-17T15:08:54.648581+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"96'1","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.658502+0000","last_change":"2023-05-17T15:08:54.267545+0000","last_active":"2023-05-17T15:08:54.658502+0000","last_peered":"2023-05-17T15:08:54.658502+0000","last_clean":"2023-05-17T15:08:54.658502+0000","last_became_active":"2023-05-17T15:08:54.267190+0000","last_became_peered":"2023-05-17T15:08:54.267190+0000","last_unstale":"2023-05-17T15:08:54.658502+0000","last_undegraded":"2023-05-17T15:08:54.658502+0000","last_fullsized":"2023-05-17T15:08:54.658502+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.653102+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:08:54.653102+0000","last_peered":"2023-05-17T15:08:54.653102+0000","last_clean":"2023-05-17T15:08:54.653102+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:08:54.653102+0000","last_undegraded":"2023-05-17T15:08:54.653102+0000","last_fullsized":"2023-05-17T15:08:54.653102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.661046+0000","last_change":"2023-05-17T15:08:54.644776+0000","last_active":"2023-05-17T15:08:54.661046+0000","last_peered":"2023-05-17T15:08:54.661046+0000","last_clean":"2023-05-17T15:08:54.661046+0000","last_became_active":"2023-05-17T15:08:54.643785+0000","last_became_peered":"2023-05-17T15:08:54.643785+0000","last_unstale":"2023-05-17T15:08:54.661046+0000","last_undegraded":"2023-05-17T15:08:54.661046+0000","last_fullsized":"2023-05-17T15:08:54.661046+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:54.228544+0000","last_clean_scrub_stamp":"2023-05-17T15:08:54.228544+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"96'2","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.659560+0000","last_change":"2023-05-17T15:08:54.259933+0000","last_active":"2023-05-17T15:08:54.659560+0000","last_peered":"2023-05-17T15:08:54.659560+0000","last_clean":"2023-05-17T15:08:54.659560+0000","last_became_active":"2023-05-17T15:08:54.259624+0000","last_became_peered":"2023-05-17T15:08:54.259624+0000","last_unstale":"2023-05-17T15:08:54.659560+0000","last_undegraded":"2023-05-17T15:08:54.659560+0000","last_fullsized":"2023-05-17T15:08:54.659560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:08:53.224666+0000","last_clean_scrub_stamp":"2023-05-17T15:08:53.224666+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-05-17T15:08:54.634345+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:08:54.634345+0000","last_peered":"2023-05-17T15:08:54.634345+0000","last_clean":"2023-05-17T15:08:54.634345+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:08:54.634345+0000","last_undegraded":"2023-05-17T15:08:54.634345+0000","last_fullsized":"2023-05-17T15:08:54.634345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17620,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94354220,"statfs":{"total":96636764160,"available":96618721280,"internally_reserved":0,"allocated":1191936,"data_stored":593766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84599999999999997},"last":0.437},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.66000000000000003}]},{"osd":1,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.89000000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":1.0740000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.82399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.627},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":1.042},"last":0.72099999999999997}]},{"osd":6,"last update":"Wed May 17 15:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.99199999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16984,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354856,"statfs":{"total":96636764160,"available":96619372544,"internally_reserved":0,"allocated":1196032,"data_stored":593904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.85399999999999998,"15min":0.85799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":1.04,"15min":1.04},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.79600000000000004}]},{"osd":3,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.89700000000000002,"5min":1.159,"15min":1.159},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":1.609,"15min":1.609},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.34899999999999998},"max":{"1min":0.99399999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Wed May 17 15:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.89500000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.90400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16796,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355044,"statfs":{"total":96636764160,"available":96619565056,"internally_reserved":0,"allocated":1200128,"data_stored":594264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.50700000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.318,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.52100000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.20000000000000001},"max":{"1min":0.46300000000000002,"5min":1.956,"15min":1.956},"last":0.33300000000000002}]},{"osd":3,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47799999999999998,"15min":0.46500000000000002},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.27100000000000002},"max":{"1min":0.48299999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.372},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.58899999999999997,"5min":1.149,"15min":1.149},"last":0.52000000000000002}]},{"osd":4,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77800000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.46600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":1.103,"15min":1.6100000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.35999999999999999},"max":{"1min":0.80400000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":1.524,"15min":1.524},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 17 15:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.40400000000000003},"max":{"1min":0.76200000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16588,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355252,"statfs":{"total":96636764160,"available":96619778048,"internally_reserved":0,"allocated":1183744,"data_stored":593190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.26700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69599999999999995},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":1.087,"15min":1.087},"last":0.27200000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29299999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.627,"5min":0.68200000000000005,"15min":0.70899999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.79800000000000004},"last":0.42499999999999999}]},{"osd":3,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.309,"5min":0.245,"15min":0.214},"max":{"1min":0.57899999999999996,"5min":0.64600000000000002,"15min":0.81299999999999994},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68400000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.98699999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0720000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.874,"5min":1.008,"15min":1.1739999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.35499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45200000000000001,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":0.94799999999999995,"15min":1.087},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed May 17 15:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.82199999999999995,"5min":1.03,"15min":1.0569999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":1.0740000000000001},"last":0.46300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18008,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353832,"statfs":{"total":96636764160,"available":96618323968,"internally_reserved":0,"allocated":1196032,"data_stored":594726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.379,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.27800000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.27400000000000002}]},{"osd":1,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.378,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32500000000000001}]},{"osd":3,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.443,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.309}]},{"osd":4,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.78100000000000003,"5min":1.056,"15min":1.056},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.046},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.50600000000000001,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.50700000000000001,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.84699999999999998,"5min":1.016,"15min":1.016},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":1.0860000000000001},"last":0.626},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.036,"15min":1.036},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed May 17 15:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51100000000000001,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.03},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.44400000000000001},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.60499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20876,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":19712,"kb_avail":94350964,"statfs":{"total":96636764160,"available":96615387136,"internally_reserved":0,"allocated":1183744,"data_stored":593190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20185088},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.748,"15min":0.748},"last":0.255},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.19,"15min":0.19},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.222}]},{"osd":1,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.39900000000000002},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.318},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.99099999999999999,"5min":1.0049999999999999,"15min":1.034},"last":0.503},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":1.04,"15min":3.4590000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.155,"15min":3.4289999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.70999999999999996},"min":{"1min":0.48199999999999998,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.772,"15min":3.4049999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed May 17 15:08:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.65600000000000003},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.1519999999999999,"15min":3.391},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17240,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94354600,"statfs":{"total":96636764160,"available":96619110400,"internally_reserved":0,"allocated":1196032,"data_stored":593868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.378,"5min":0.313,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.59099999999999997,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.29799999999999999},"max":{"1min":0.81499999999999995,"5min":0.878,"15min":0.878},"last":0.59299999999999997}]},{"osd":1,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":1.292,"15min":1.292},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77300000000000002,"5min":1.637,"15min":1.637},"last":0.496}]},{"osd":5,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.318},"max":{"1min":0.75,"5min":0.995,"15min":0.995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84799999999999998,"5min":1.329,"15min":1.329},"last":0.45800000000000002}]},{"osd":6,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86299999999999999,"5min":1.151,"15min":1.151},"last":0.622}]},{"osd":7,"last update":"Wed May 17 15:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.34699999999999998},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.39100000000000001},"max":{"1min":0.97099999999999997,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":19392,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":1187840,"data_stored":593224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19857408},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.41799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.876},"last":0.752},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88100000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.62,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63,"15min":0.62},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.995},"last":0.71399999999999997}]},{"osd":2,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81599999999999995},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.58799999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80900000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"last":0.70399999999999996}]},{"osd":3,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.96199999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65100000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.82399999999999995,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.28199999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84899999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed May 17 15:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:02.521 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:09:02.521 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:09:02.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.673+0000 7f043b6e3700 1 Processor -- start 2023-05-17T15:09:02.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.673+0000 7f043b6e3700 1 -- start start 2023-05-17T15:09:02.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043b6e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 0x7f043405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043b6e3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f043405e240 0x7f04340c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043b6e3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04340c2b80 con 0x7f0434153fb0 2023-05-17T15:09:02.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043b6e3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043405e6d0 con 0x7f043405e240 2023-05-17T15:09:02.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043b6e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04340be580 con 0x7f04340644d0 2023-05-17T15:09:02.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043947f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0434153fb0 0x7f0434063dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39500/0 (socket says 172.21.15.27:39500) 2023-05-17T15:09:02.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f043947f700 1 -- 172.21.15.27:0/4265954176 learned_addr learned my addr 172.21.15.27:0/4265954176 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:02.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f0438c7e700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 0x7f043405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.674+0000 7f0439c80700 1 --2- 172.21.15.27:0/4265954176 >> v2:172.21.15.40:3300/0 conn(0x7f043405e240 0x7f04340c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220707884 0 0) 0x7f04340c2b80 con 0x7f0434153fb0 2023-05-17T15:09:02.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04200033f0 con 0x7f0434153fb0 2023-05-17T15:09:02.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4028507241 0 0) 0x7f04200033f0 con 0x7f0434153fb0 2023-05-17T15:09:02.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 msgr2=0x7f043405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:02.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 0x7f043405dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 >> v2:172.21.15.40:3300/0 conn(0x7f043405e240 msgr2=0x7f04340c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:02.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 --2- 172.21.15.27:0/4265954176 >> v2:172.21.15.40:3300/0 conn(0x7f043405e240 0x7f04340c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340c2530 con 0x7f0434153fb0 2023-05-17T15:09:02.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f042c0017f0 con 0x7f0434153fb0 2023-05-17T15:09:02.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 >> v1:172.21.15.27:6789/0 conn(0x7f0434153fb0 legacy=0x7f0434063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200038e0 0x7f0420003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 0x7f0420004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0420004b80 0x7f0420005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043405e6d0 con 0x7f04200038e0 2023-05-17T15:09:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04340be580 con 0x7f0420004b80 2023-05-17T15:09:02.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042000b8e0 con 0x7f04340644d0 2023-05-17T15:09:02.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f0439c80700 1 --2- 172.21.15.27:0/4265954176 >> v2:172.21.15.40:3300/0 conn(0x7f043405e240 0x7f04340c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:02.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200038e0 0x7f0420003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f0438c7e700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 0x7f0420004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f0439c80700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0420004b80 0x7f0420005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 -- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 msgr2=0x7f0420004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:02.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04340644d0 0x7f0420004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 -- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0420004b80 msgr2=0x7f0420005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:02.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0420004b80 0x7f0420005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 -- 172.21.15.27:0/4265954176 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200033f0 con 0x7f04200038e0 2023-05-17T15:09:02.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.675+0000 7f043947f700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200038e0 0x7f0420003d00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f042c00c530 tx=0x7f042c002210).ready entity=mon.0 client_cookie=44c920064d87a0e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:02.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c007de0 con 0x7f04200038e0 2023-05-17T15:09:02.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00ce60 con 0x7f04200038e0 2023-05-17T15:09:02.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f042bfff700 1 -- 172.21.15.27:0/4265954176 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c005d70 con 0x7f04200038e0 2023-05-17T15:09:02.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f043b6e3700 1 -- 172.21.15.27:0/4265954176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200038e0 msgr2=0x7f0420003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f043b6e3700 1 --2- 172.21.15.27:0/4265954176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04200038e0 0x7f0420003d00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f042c00c530 tx=0x7f042c002210).stop 2023-05-17T15:09:02.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f0439c80700 1 -- 172.21.15.27:0/4265954176 reap_dead start 2023-05-17T15:09:02.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f043b6e3700 1 -- 172.21.15.27:0/4265954176 shutdown_connections 2023-05-17T15:09:02.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f043b6e3700 1 -- 172.21.15.27:0/4265954176 >> 172.21.15.27:0/4265954176 conn(0x7f04340c7910 msgr2=0x7f04340c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:02.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f043b6e3700 1 -- 172.21.15.27:0/4265954176 shutdown_connections 2023-05-17T15:09:02.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.676+0000 7f043b6e3700 1 -- 172.21.15.27:0/4265954176 wait complete. 2023-05-17T15:09:02.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.677+0000 7f043b6e3700 1 Processor -- start 2023-05-17T15:09:02.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.677+0000 7f043b6e3700 1 -- start start 2023-05-17T15:09:02.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.678+0000 7f043b6e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04200038e0 0x7f043414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.678+0000 7f043b6e3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434156d40 0x7f04340a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.678+0000 7f043b6e3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 0x7f04341647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.678+0000 7f043b6e3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0434155a90 con 0x7f0434164380 2023-05-17T15:09:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.678+0000 7f043b6e3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04340ad210 con 0x7f0434156d40 2023-05-17T15:09:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.678+0000 7f043b6e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04341568b0 con 0x7f04200038e0 2023-05-17T15:09:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 0x7f04341647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 0x7f04341647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39952/0 (socket says 172.21.15.27:39952) 2023-05-17T15:09:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 -- 172.21.15.27:0/2870090917 learned_addr learned my addr 172.21.15.27:0/2870090917 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f043947f700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04200038e0 0x7f043414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0438c7e700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434156d40 0x7f04340a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 -- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04200038e0 msgr2=0x7f043414bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04200038e0 0x7f043414bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 -- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434156d40 msgr2=0x7f04340a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434156d40 0x7f04340a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 -- 172.21.15.27:0/2870090917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434155ca0 con 0x7f0434164380 2023-05-17T15:09:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.679+0000 7f0439c80700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 0x7f04341647c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f04340c8520 tx=0x7f0430008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.680+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011e60 con 0x7f0434164380 2023-05-17T15:09:02.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.680+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430013550 con 0x7f0434164380 2023-05-17T15:09:02.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.680+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0434155f80 con 0x7f0434164380 2023-05-17T15:09:02.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.680+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04300138d0 con 0x7f0434164380 2023-05-17T15:09:02.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.680+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0434156540 con 0x7f0434164380 2023-05-17T15:09:02.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.681+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0434156a40 con 0x7f0434164380 2023-05-17T15:09:02.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.682+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f043001d030 con 0x7f0434164380 2023-05-17T15:09:02.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.682+0000 7f04297fa700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f041805ed60 0x7f0418061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:02.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.682+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f0430079550 con 0x7f0434164380 2023-05-17T15:09:02.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.682+0000 7f043947f700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f041805ed60 0x7f0418061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:02.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.682+0000 7f043947f700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f041805ed60 0x7f0418061220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f042c002250 tx=0x7f042c015000).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:02.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.686+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f043004ab50 con 0x7f0434164380 2023-05-17T15:09:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.935+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f04340c2810 con 0x7f0434164380 2023-05-17T15:09:02.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.938+0000 7f04297fa700 1 -- 172.21.15.27:0/2870090917 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f043004e170 con 0x7f0434164380 2023-05-17T15:09:02.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.940+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f041805ed60 msgr2=0x7f0418061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.940+0000 7f043b6e3700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f041805ed60 0x7f0418061220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f042c002250 tx=0x7f042c015000).stop 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.940+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 msgr2=0x7f04341647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.940+0000 7f043b6e3700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 0x7f04341647c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f04340c8520 tx=0x7f0430008040).stop 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 shutdown_connections 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f041805ed60 0x7f0418061220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0434164380 0x7f04341647c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04200038e0 0x7f043414bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 --2- 172.21.15.27:0/2870090917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434156d40 0x7f04340a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 >> 172.21.15.27:0/2870090917 conn(0x7f04340c7910 msgr2=0x7f0434067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 shutdown_connections 2023-05-17T15:09:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:02.941+0000 7f043b6e3700 1 -- 172.21.15.27:0/2870090917 wait complete. 2023-05-17T15:09:02.946 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:09:02.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.068+0000 7f3b50ec2700 1 Processor -- start 2023-05-17T15:09:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.068+0000 7f3b50ec2700 1 -- start start 2023-05-17T15:09:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b50ec2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3b4c1376a0 0x7f3b4c0c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b50ec2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b4c0c22d0 0x7f3b4c1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b50ec2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c0c34a0 con 0x7f3b4c1372c0 2023-05-17T15:09:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b50ec2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c064be0 con 0x7f3b4c1376a0 2023-05-17T15:09:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b50ec2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c0c26b0 con 0x7f3b4c0c22d0 2023-05-17T15:09:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b49d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3b4c1376a0 0x7f3b4c0c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b4a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3b4c1372c0 0x7f3b4c0650d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39518/0 (socket says 172.21.15.27:39518) 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.069+0000 7f3b4a59c700 1 -- 172.21.15.27:0/822881487 learned_addr learned my addr 172.21.15.27:0/822881487 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b49d9b700 1 -- 172.21.15.27:0/822881487 >> v2:172.21.15.40:3300/0 conn(0x7f3b4c0c22d0 msgr2=0x7f3b4c1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b4ad9d700 1 --2- 172.21.15.27:0/822881487 >> v2:172.21.15.40:3300/0 conn(0x7f3b4c0c22d0 0x7f3b4c1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b49d9b700 1 --2- 172.21.15.27:0/822881487 >> v2:172.21.15.40:3300/0 conn(0x7f3b4c0c22d0 0x7f3b4c1548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b49d9b700 1 -- 172.21.15.27:0/822881487 >> v1:172.21.15.27:6789/0 conn(0x7f3b4c1372c0 legacy=0x7f3b4c0650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b4959a700 1 -- 172.21.15.27:0/822881487 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774176687 0 0) 0x7f3b4c0c34a0 con 0x7f3b4c1372c0 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b49d9b700 1 -- 172.21.15.27:0/822881487 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0c2890 con 0x7f3b4c1376a0 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b49d9b700 1 --2- 172.21.15.27:0/822881487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c3930 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f3b4c0c57d0 tx=0x7f3b34009060).ready entity=mon.0 client_cookie=c86ab3bd88d54b58 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b4959a700 1 -- 172.21.15.27:0/822881487 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400b580 con 0x7f3b4c1376a0 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b4959a700 1 -- 172.21.15.27:0/822881487 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3400b6e0 con 0x7f3b4c1376a0 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b4959a700 1 -- 172.21.15.27:0/822881487 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400ba60 con 0x7f3b4c1376a0 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b50ec2700 1 -- 172.21.15.27:0/822881487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 msgr2=0x7f3b4c0c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.070+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/822881487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c3930 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f3b4c0c57d0 tx=0x7f3b34009060).stop 2023-05-17T15:09:03.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.071+0000 7f3b50ec2700 1 -- 172.21.15.27:0/822881487 shutdown_connections 2023-05-17T15:09:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.071+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/822881487 >> v2:172.21.15.40:3300/0 conn(0x7f3b4c0c22d0 0x7f3b4c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.071+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/822881487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c3930 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.071+0000 7f3b50ec2700 1 -- 172.21.15.27:0/822881487 >> 172.21.15.27:0/822881487 conn(0x7f3b4c0c8400 msgr2=0x7f3b4c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.071+0000 7f3b50ec2700 1 -- 172.21.15.27:0/822881487 shutdown_connections 2023-05-17T15:09:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.071+0000 7f3b50ec2700 1 -- 172.21.15.27:0/822881487 wait complete. 2023-05-17T15:09:03.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 Processor -- start 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 -- start start 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b4c0c22d0 0x7f3b4c0ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4c1372c0 0x7f3b4c135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0a8e90 con 0x7f3b4c1376a0 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c161550 con 0x7f3b4c1372c0 2023-05-17T15:09:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.072+0000 7f3b50ec2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0ac4a0 con 0x7f3b4c0c22d0 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39966/0 (socket says 172.21.15.27:39966) 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 -- 172.21.15.27:0/3964570667 learned_addr learned my addr 172.21.15.27:0/3964570667 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b49d9b700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4c1372c0 0x7f3b4c135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 -- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b4c0c22d0 msgr2=0x7f3b4c0ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b4c0c22d0 0x7f3b4c0ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 -- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4c1372c0 msgr2=0x7f3b4c135600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4c1372c0 0x7f3b4c135600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 -- 172.21.15.27:0/3964570667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340092a0 con 0x7f3b4c1376a0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b4ad9d700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c5800 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f3b3c00c650 tx=0x7f3b3c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c010580 con 0x7f3b4c1376a0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0106e0 con 0x7f3b4c1376a0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c0abc00 con 0x7f3b4c1376a0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c010a60 con 0x7f3b4c1376a0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.073+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c0ac1c0 con 0x7f3b4c1376a0 2023-05-17T15:09:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.074+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c0a8c60 con 0x7f3b4c1376a0 2023-05-17T15:09:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.074+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b3c01b460 con 0x7f3b4c1376a0 2023-05-17T15:09:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.075+0000 7f3b427fc700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b2c05ed90 0x7f3b2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.075+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f3b3c079c80 con 0x7f3b4c1376a0 2023-05-17T15:09:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.075+0000 7f3b4a59c700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b2c05ed90 0x7f3b2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.075+0000 7f3b4a59c700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b2c05ed90 0x7f3b2c061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3b44007fd0 tx=0x7f3b44007bd0).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.079+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b4c0a8c60 con 0x7f3b4c1376a0 2023-05-17T15:09:03.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.297+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b4c0a8c60 con 0x7f3b4c1376a0 2023-05-17T15:09:03.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.297+0000 7f3b427fc700 1 -- 172.21.15.27:0/3964570667 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f3b4c0a8c60 con 0x7f3b4c1376a0 2023-05-17T15:09:03.302 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:03.302 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:54.627419+0000","modified":"2023-05-17T15:08:56.658238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6654":{"gid":6654,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2158310427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2158310427},{"type":"v1","addr":"172.21.15.27:6835","nonce":2158310427}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-17T15:09:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b2c05ed90 msgr2=0x7f3b2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b2c05ed90 0x7f3b2c061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3b44007fd0 tx=0x7f3b44007bd0).stop 2023-05-17T15:09:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 msgr2=0x7f3b4c0c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c5800 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f3b3c00c650 tx=0x7f3b3c008040).stop 2023-05-17T15:09:03.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 shutdown_connections 2023-05-17T15:09:03.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b2c05ed90 0x7f3b2c061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b4c1376a0 0x7f3b4c0c5800 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b4c0c22d0 0x7f3b4c0ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 --2- 172.21.15.27:0/3964570667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b4c1372c0 0x7f3b4c135600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 >> 172.21.15.27:0/3964570667 conn(0x7f3b4c0c8400 msgr2=0x7f3b4c1501b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 shutdown_connections 2023-05-17T15:09:03.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.299+0000 7f3b50ec2700 1 -- 172.21.15.27:0/3964570667 wait complete. 2023-05-17T15:09:03.305 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2023-05-17T15:09:03.718 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:08:54.627419+0000', 'modified': '2023-05-17T15:08:56.658238+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6654}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6654': {'gid': 6654, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/2158310427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 2158310427}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 2158310427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:09:03.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:09:03.719 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-17T15:09:03.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.834+0000 7fae18ab2700 1 Processor -- start 2023-05-17T15:09:03.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.834+0000 7fae18ab2700 1 -- start start 2023-05-17T15:09:03.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.835+0000 7fae18ab2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae140c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.835+0000 7fae18ab2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae14152180 0x7fae140a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.835+0000 7fae18ab2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae140a7930 con 0x7fae140625c0 2023-05-17T15:09:03.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.835+0000 7fae18ab2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae140c4760 con 0x7fae14152180 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.835+0000 7fae18ab2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140bcdb0 con 0x7fae140c3c80 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae12d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae14152180 0x7fae140a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae11d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fae140625c0 0x7fae14151a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39532/0 (socket says 172.21.15.27:39532) 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae11d9b700 1 -- 172.21.15.27:0/2642287204 learned_addr learned my addr 172.21.15.27:0/2642287204 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae1259c700 1 --2- 172.21.15.27:0/2642287204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae140c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae12d9d700 1 -- 172.21.15.27:0/2642287204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 msgr2=0x7fae140c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae12d9d700 1 --2- 172.21.15.27:0/2642287204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae140c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae12d9d700 1 -- 172.21.15.27:0/2642287204 >> v1:172.21.15.27:6789/0 conn(0x7fae140625c0 legacy=0x7fae14151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae12d9d700 1 -- 172.21.15.27:0/2642287204 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140bd090 con 0x7fae14152180 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae1159a700 1 -- 172.21.15.27:0/2642287204 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443966309 0 0) 0x7fae140a7930 con 0x7fae140625c0 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae12d9d700 1 --2- 172.21.15.27:0/2642287204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14152180 0x7fae140a7dc0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fae04009760 tx=0x7fae04009060).ready entity=mon.0 client_cookie=86c6d6a23551469e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae1159a700 1 -- 172.21.15.27:0/2642287204 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400b610 con 0x7fae14152180 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae1159a700 1 -- 172.21.15.27:0/2642287204 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0400b770 con 0x7fae14152180 2023-05-17T15:09:03.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.836+0000 7fae1159a700 1 -- 172.21.15.27:0/2642287204 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400baf0 con 0x7fae14152180 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 -- 172.21.15.27:0/2642287204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14152180 msgr2=0x7fae140a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 --2- 172.21.15.27:0/2642287204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14152180 0x7fae140a7dc0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fae04009760 tx=0x7fae04009060).stop 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 -- 172.21.15.27:0/2642287204 shutdown_connections 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 --2- 172.21.15.27:0/2642287204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14152180 0x7fae140a7dc0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 --2- 172.21.15.27:0/2642287204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae140c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 -- 172.21.15.27:0/2642287204 >> 172.21.15.27:0/2642287204 conn(0x7fae14063dd0 msgr2=0x7fae14067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 -- 172.21.15.27:0/2642287204 shutdown_connections 2023-05-17T15:09:03.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.837+0000 7fae18ab2700 1 -- 172.21.15.27:0/2642287204 wait complete. 2023-05-17T15:09:03.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.838+0000 7fae18ab2700 1 Processor -- start 2023-05-17T15:09:03.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.838+0000 7fae18ab2700 1 -- start start 2023-05-17T15:09:03.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 0x7fae140c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae14155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae14152180 0x7fae14156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14156950 con 0x7fae140625c0 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141573d0 con 0x7fae14152180 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140bf250 con 0x7fae140c3c80 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 0x7fae140c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 0x7fae140c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39972/0 (socket says 172.21.15.27:39972) 2023-05-17T15:09:03.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 -- 172.21.15.27:0/1666777286 learned_addr learned my addr 172.21.15.27:0/1666777286 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae11d9b700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae14155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae12d9d700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae14152180 0x7fae14156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 -- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 msgr2=0x7fae14155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae14155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 -- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae14152180 msgr2=0x7fae14156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae14152180 0x7fae14156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 -- 172.21.15.27:0/1666777286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040092a0 con 0x7fae140625c0 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae12d9d700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae14152180 0x7fae14156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae1259c700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 0x7fae140c6600 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fae0c00cfc0 tx=0x7fae0c007890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae0a7fc700 1 -- 172.21.15.27:0/1666777286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00ae90 con 0x7fae140625c0 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae0a7fc700 1 -- 172.21.15.27:0/1666777286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c016400 con 0x7fae140625c0 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae0a7fc700 1 -- 172.21.15.27:0/1666777286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c016780 con 0x7fae140625c0 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae140c0bb0 con 0x7fae140625c0 2023-05-17T15:09:03.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.839+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae141570f0 con 0x7fae140625c0 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.841+0000 7fae0a7fc700 1 -- 172.21.15.27:0/1666777286 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae0c016bb0 con 0x7fae140625c0 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.841+0000 7fae0a7fc700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fadf405ed90 0x7fadf4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.841+0000 7fae0a7fc700 1 -- 172.21.15.27:0/1666777286 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fae0c07a690 con 0x7fae140625c0 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.841+0000 7fae11d9b700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fadf405ed90 0x7fadf4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.841+0000 7fae11d9b700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fadf405ed90 0x7fadf4061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fae141514e0 tx=0x7fadfc009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.843+0000 7fae2a444b80 1 Processor -- start 2023-05-17T15:09:03.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.843+0000 7fae2a444b80 1 -- start start 2023-05-17T15:09:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be587a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae2a444b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be58455e0 con 0x555be58c9480 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be57bc8a0 con 0x555be5880300 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x555be57d1900 con 0x555be58c4560 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39982/0 (socket says 172.21.15.27:39982) 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 -- 172.21.15.27:0/4158936970 learned_addr learned my addr 172.21.15.27:0/4158936970 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 -- 172.21.15.27:0/4158936970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 msgr2=0x555be58a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 -- 172.21.15.27:0/4158936970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 msgr2=0x555be587a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be587a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 -- 172.21.15.27:0/4158936970 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be5845450 con 0x555be58c9480 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fae11d9b700 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58c4940 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fadfc007330 tx=0x7fadfc007000).ready entity=mon.0 client_cookie=709c2bb87785c896 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fadf37fe700 1 -- 172.21.15.27:0/4158936970 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc015410 con 0x555be58c9480 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fadf37fe700 1 -- 172.21.15.27:0/4158936970 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc015570 con 0x555be58c9480 2023-05-17T15:09:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.844+0000 7fadf37fe700 1 -- 172.21.15.27:0/4158936970 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc015930 con 0x555be58c9480 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 -- 172.21.15.27:0/4158936970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 msgr2=0x555be58c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58c4940 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fadfc007330 tx=0x7fadfc007000).stop 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 -- 172.21.15.27:0/4158936970 shutdown_connections 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be587a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4158936970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58c4940 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 -- 172.21.15.27:0/4158936970 >> 172.21.15.27:0/4158936970 conn(0x555be563ce40 msgr2=0x555be58c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 -- 172.21.15.27:0/4158936970 shutdown_connections 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.845+0000 7fae2a444b80 1 -- 172.21.15.27:0/4158936970 wait complete. 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.846+0000 7fae2a444b80 1 -- start start 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.846+0000 7fae2a444b80 1 Processor -- start 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be5880300 0x555be587a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58d4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5798ed0 con 0x555be58c9480 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be58d75d0 con 0x555be58c4560 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x555be58d5760 con 0x555be5880300 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 10 client.0 ll_register_callbacks cb 0x555be583f1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58a2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39990/0 (socket says 172.21.15.27:39990) 2023-05-17T15:09:03.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 -- 172.21.15.27:0/4067391366 learned_addr learned my addr 172.21.15.27:0/4067391366 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae1259c700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be5880300 0x555be587a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae11d9b700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58d4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 -- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be5880300 msgr2=0x555be587a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be5880300 0x555be587a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 -- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 msgr2=0x555be58d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58d4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 -- 172.21.15.27:0/4067391366 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc00f040 con 0x555be58c9480 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae1259c700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be5880300 0x555be587a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae11d9b700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae12d9d700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58a2890 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7fae14065c30 tx=0x7fae04017000).ready entity=mon.0 client_cookie=dd8456e8c0bdce10 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fadf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:09:03.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4067391366 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400beb0 con 0x555be58c9480 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4067391366 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fae04011ba0 con 0x555be58c9480 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.847+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555be5873460 con 0x555be58c9480 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4067391366 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0401b410 con 0x555be58c9480 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 10 client.6831 fetch_fsmap learned FSMap version 36 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x555be5674310 con 0x555be58c9480 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4067391366 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555be5873460 con 0x555be58c9480 2023-05-17T15:09:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4067391366 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae04009840 con 0x555be58c9480 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 10 client.6831 fetch_fsmap finished waiting for FSMap version 36 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 10 client.6831 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 20 client.6831 populate_metadata read hostname 'smithi027' 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d4c80 0x555be58c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 4 client.6831 mds_command: new command op to 6654 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 --> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555be5638ca0 con 0x555be58d4c80 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae1259c700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d4c80 0x555be58c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fadf0ff9700 10 client.6831 ms_handle_connect on v2:172.21.15.27:6833/2158310427 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.848+0000 7fae1259c700 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d4c80 0x555be58c2250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=efeb1a60a878c9a0 server_cookie=7f497e4fe6e33def in_seq=0 out_seq=0 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4067391366 <== mds.0 v2:172.21.15.27:6833/2158310427 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x555be5638ca0 con 0x555be58d4c80 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fadf0ff9700 10 client.6831 handle_command_reply: tid=0 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 client.6831 shutdown 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 msgr2=0x555be58a2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58a2890 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7fae14065c30 tx=0x7fae04017000).stop 2023-05-17T15:09:03.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 shutdown_connections 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d4c80 0x555be58c2250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be58a2890 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be5880300 0x555be587a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4067391366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 >> 172.21.15.27:0/4067391366 conn(0x555be563ce40 msgr2=0x555be58c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fadf0ff9700 0 client.6831 ms_handle_reset on v2:172.21.15.27:6833/2158310427 2023-05-17T15:09:03.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 shutdown_connections 2023-05-17T15:09:03.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 1 -- 172.21.15.27:0/4067391366 wait complete. 2023-05-17T15:09:03.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.849+0000 7fae2a444b80 20 client.6831 trim_cache size 0 max 16384 2023-05-17T15:09:03.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.866+0000 7fae2a444b80 1 Processor -- start 2023-05-17T15:09:03.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.866+0000 7fae2a444b80 1 -- start start 2023-05-17T15:09:03.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 0x555be58a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c9480 0x555be58ac550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae2a444b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be58adae0 con 0x555be5880300 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be5879f60 con 0x555be58c4560 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x555be5872f80 con 0x555be58c9480 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 0x555be58a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 0x555be58a2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39994/0 (socket says 172.21.15.27:39994) 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 -- 172.21.15.27:0/3290938059 learned_addr learned my addr 172.21.15.27:0/3290938059 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:03.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 -- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c9480 msgr2=0x555be58ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c9480 0x555be58ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae11d9b700 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 -- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 msgr2=0x555be58bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 -- 172.21.15.27:0/3290938059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be57ca880 con 0x555be5880300 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae11d9b700 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.867+0000 7fae1259c700 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 0x555be58a2890 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fae0c007580 tx=0x7fae0c053040).ready entity=mon.0 client_cookie=1f13c28e18458a39 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fadf3fff700 1 -- 172.21.15.27:0/3290938059 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c04d980 con 0x555be5880300 2023-05-17T15:09:03.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fadf3fff700 1 -- 172.21.15.27:0/3290938059 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c04dbe0 con 0x555be5880300 2023-05-17T15:09:03.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fadf3fff700 1 -- 172.21.15.27:0/3290938059 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c04bf50 con 0x555be5880300 2023-05-17T15:09:03.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 -- 172.21.15.27:0/3290938059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 msgr2=0x555be58a2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 0x555be58a2890 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fae0c007580 tx=0x7fae0c053040).stop 2023-05-17T15:09:03.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 -- 172.21.15.27:0/3290938059 shutdown_connections 2023-05-17T15:09:03.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c9480 0x555be58ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:03.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be5880300 0x555be58a2890 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 --2- 172.21.15.27:0/3290938059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be58c4560 0x555be58bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 -- 172.21.15.27:0/3290938059 >> 172.21.15.27:0/3290938059 conn(0x555be563ce40 msgr2=0x555be5876b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 -- 172.21.15.27:0/3290938059 shutdown_connections 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.868+0000 7fae2a444b80 1 -- 172.21.15.27:0/3290938059 wait complete. 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.869+0000 7fae2a444b80 1 -- start start 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.869+0000 7fae2a444b80 1 Processor -- start 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be58c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be592a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be58c3300 con 0x555be58c9480 2023-05-17T15:09:03.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be58c40e0 con 0x555be5880300 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x555be58c5c00 con 0x555be58c4560 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 10 client.0 ll_register_callbacks cb 0x555be583f1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be592a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be592a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40004/0 (socket says 172.21.15.27:40004) 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 -- 172.21.15.27:0/4135749549 learned_addr learned my addr 172.21.15.27:0/4135749549 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae1259c700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be58c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae11d9b700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 -- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 msgr2=0x555be58d6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58d6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 -- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 msgr2=0x555be58c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:03.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be58c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 -- 172.21.15.27:0/4135749549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae141570f0 con 0x555be58c9480 2023-05-17T15:09:03.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae12d9d700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be592a440 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fae04006a10 tx=0x7fae0401c000).ready entity=mon.0 client_cookie=c37f65c1b3e8c774 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fadf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4135749549 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400beb0 con 0x555be58c9480 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4135749549 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fae04000e40 con 0x555be58c9480 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadfc015570 con 0x555be58c9480 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4135749549 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0400b140 con 0x555be58c9480 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.870+0000 7fae2a444b80 10 client.6837 fetch_fsmap learned FSMap version 36 2023-05-17T15:09:03.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x555be57c6070 con 0x555be58c9480 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4135749549 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc015570 con 0x555be58c9480 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4135749549 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae04009840 con 0x555be58c9480 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 10 client.6837 fetch_fsmap finished waiting for FSMap version 36 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 10 client.6837 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 20 client.6837 populate_metadata read hostname 'smithi027' 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d2ea0 0x555be58d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:03.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 4 client.6837 mds_command: new command op to 6654 tid=0[{"prefix": "status"}] 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 --> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555be566fca0 con 0x555be58d2ea0 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae1259c700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d2ea0 0x555be58d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fadf0ff9700 10 client.6837 ms_handle_connect on v2:172.21.15.27:6833/2158310427 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae1259c700 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d2ea0 0x555be58d3280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d545c24bd89a7939 server_cookie=2352c7a11215bf12 in_seq=0 out_seq=0 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fadf0ff9700 1 -- 172.21.15.27:0/4135749549 <== mds.0 v2:172.21.15.27:6833/2158310427 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555be566fca0 con 0x555be58d2ea0 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fadf0ff9700 10 client.6837 handle_command_reply: tid=0 2023-05-17T15:09:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 client.6837 shutdown 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 msgr2=0x555be592a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be592a440 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fae04006a10 tx=0x7fae0401c000).stop 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 shutdown_connections 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.871+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:6833/2158310427,v1:172.21.15.27:6835/2158310427] conn(0x555be58d2ea0 0x555be58d3280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555be58c9480 0x555be592a440 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fadf0ff9700 0 client.6837 ms_handle_reset on v2:172.21.15.27:6833/2158310427 2023-05-17T15:09:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555be5880300 0x555be58c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 1 --2- 172.21.15.27:0/4135749549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x555be58c4560 0x555be58d6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 >> 172.21.15.27:0/4135749549 conn(0x555be563ce40 msgr2=0x555be5879610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 shutdown_connections 2023-05-17T15:09:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 1 -- 172.21.15.27:0/4135749549 wait complete. 2023-05-17T15:09:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae2a444b80 20 client.6837 trim_cache size 0 max 16384 2023-05-17T15:09:03.887 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:09:03.887 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:09:03.887 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:09:03.887 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 6654, 2023-05-17T15:09:03.887 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:09:03.887 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:09:03.888 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:09:03.888 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 9.2433768599999997, 2023-05-17T15:09:03.888 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 36, 2023-05-17T15:09:03.888 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 97, 2023-05-17T15:09:03.888 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 97, 2023-05-17T15:09:03.889 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 13.836406455000001 2023-05-17T15:09:03.889 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:09:03.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fadf405ed90 msgr2=0x7fadf4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fadf405ed90 0x7fadf4061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fae141514e0 tx=0x7fadfc009040).stop 2023-05-17T15:09:03.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 msgr2=0x7fae140c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 0x7fae140c6600 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fae0c00cfc0 tx=0x7fae0c007890).stop 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 shutdown_connections 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fadf405ed90 0x7fadf4061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae14152180 0x7fae14156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae140625c0 0x7fae140c6600 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 --2- 172.21.15.27:0/1666777286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae140c3c80 0x7fae14155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:03.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 >> 172.21.15.27:0/1666777286 conn(0x7fae14063dd0 msgr2=0x7fae14067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:03.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 shutdown_connections 2023-05-17T15:09:03.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.872+0000 7fae18ab2700 1 -- 172.21.15.27:0/1666777286 wait complete. 2023-05-17T15:09:03.892 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:09:03.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.994+0000 7fce35fa9700 1 Processor -- start 2023-05-17T15:09:03.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.994+0000 7fce35fa9700 1 -- start start 2023-05-17T15:09:04.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce35fa9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce300697a0 0x7fce30068c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce35fa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300bc860 0x7fce300bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce35fa9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300bd1e0 con 0x7fce30069b80 2023-05-17T15:09:04.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce35fa9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce300c7440 con 0x7fce300697a0 2023-05-17T15:09:04.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce35fa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce301543d0 con 0x7fce300bc860 2023-05-17T15:09:04.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300bc860 0x7fce300bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce300697a0 0x7fce30068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fce30069b80 0x7fce300c5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:45574/0 (socket says 172.21.15.27:45574) 2023-05-17T15:09:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2effd700 1 -- 172.21.15.27:0/1549105403 learned_addr learned my addr 172.21.15.27:0/1549105403 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce300697a0 0x7fce30068c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:57938/0 (socket says 172.21.15.27:57938) 2023-05-17T15:09:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300bc860 0x7fce300bccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41122/0 (socket says 172.21.15.27:41122) 2023-05-17T15:09:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2f7fe700 1 -- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300bc860 msgr2=0x7fce300bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2f7fe700 1 --2- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300bc860 0x7fce300bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2f7fe700 1 -- 172.21.15.27:0/1549105403 >> v1:172.21.15.40:6789/0 conn(0x7fce30069b80 legacy=0x7fce300c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2f7fe700 1 -- 172.21.15.27:0/1549105403 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30154690 con 0x7fce300697a0 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.995+0000 7fce2e7fc700 1 -- 172.21.15.27:0/1549105403 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261081399 0 0) 0x7fce300bd1e0 con 0x7fce30069b80 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce2f7fe700 1 --2- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300697a0 0x7fce30068c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fce28009e60 tx=0x7fce28009780).ready entity=mon.1 client_cookie=22d3459badb15878 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce2e7fc700 1 -- 172.21.15.27:0/1549105403 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800e070 con 0x7fce300697a0 2023-05-17T15:09:04.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce2e7fc700 1 -- 172.21.15.27:0/1549105403 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800bb60 con 0x7fce300697a0 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce2e7fc700 1 -- 172.21.15.27:0/1549105403 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28012410 con 0x7fce300697a0 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 -- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300697a0 msgr2=0x7fce30068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 --2- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300697a0 0x7fce30068c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fce28009e60 tx=0x7fce28009780).stop 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 -- 172.21.15.27:0/1549105403 shutdown_connections 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 --2- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300bc860 0x7fce300bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 --2- 172.21.15.27:0/1549105403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300697a0 0x7fce30068c30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 -- 172.21.15.27:0/1549105403 >> 172.21.15.27:0/1549105403 conn(0x7fce300c7900 msgr2=0x7fce300c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:04.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 -- 172.21.15.27:0/1549105403 shutdown_connections 2023-05-17T15:09:04.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.996+0000 7fce35fa9700 1 -- 172.21.15.27:0/1549105403 wait complete. 2023-05-17T15:09:04.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 Processor -- start 2023-05-17T15:09:04.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 -- start start 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300697a0 0x7fce300aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 0x7fce301531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300bc860 0x7fce30153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300aba80 con 0x7fce30069b80 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30153b80 con 0x7fce300bc860 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.998+0000 7fce35fa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce300aae70 con 0x7fce300697a0 2023-05-17T15:09:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 0x7fce301531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 0x7fce301531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40016/0 (socket says 172.21.15.27:40016) 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 -- 172.21.15.27:0/4039558107 learned_addr learned my addr 172.21.15.27:0/4039558107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2ffff700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300bc860 0x7fce30153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2f7fe700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300697a0 0x7fce300aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 -- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300697a0 msgr2=0x7fce300aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300697a0 0x7fce300aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 -- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300bc860 msgr2=0x7fce30153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300bc860 0x7fce30153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 -- 172.21.15.27:0/4039558107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28009a20 con 0x7fce30069b80 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2f7fe700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300697a0 0x7fce300aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce2effd700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 0x7fce301531a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fce1800c4a0 tx=0x7fce18007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180072e0 con 0x7fce30069b80 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18007440 con 0x7fce30069b80 2023-05-17T15:09:04.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce300ab150 con 0x7fce30069b80 2023-05-17T15:09:04.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180057a0 con 0x7fce30069b80 2023-05-17T15:09:04.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:03.999+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce300ab710 con 0x7fce30069b80 2023-05-17T15:09:04.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.000+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3005e6a0 con 0x7fce30069b80 2023-05-17T15:09:04.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.001+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fce1801a060 con 0x7fce30069b80 2023-05-17T15:09:04.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.001+0000 7fce277fe700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fce1005ed90 0x7fce10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.001+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fce18079370 con 0x7fce30069b80 2023-05-17T15:09:04.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.001+0000 7fce2f7fe700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fce1005ed90 0x7fce10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.001+0000 7fce2f7fe700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fce1005ed90 0x7fce10061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fce30066d60 tx=0x7fce28009780).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:04.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.005+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce1804a8c0 con 0x7fce30069b80 2023-05-17T15:09:04.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.225+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce30154970 con 0x7fce30069b80 2023-05-17T15:09:04.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.226+0000 7fce277fe700 1 -- 172.21.15.27:0/4039558107 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce18018020 con 0x7fce30069b80 2023-05-17T15:09:04.230 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:09:04.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fce1005ed90 msgr2=0x7fce10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fce1005ed90 0x7fce10061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fce30066d60 tx=0x7fce28009780).stop 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 msgr2=0x7fce301531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 0x7fce301531a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fce1800c4a0 tx=0x7fce18007c30).stop 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 shutdown_connections 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fce1005ed90 0x7fce10061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce300bc860 0x7fce30153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce300697a0 0x7fce300aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 --2- 172.21.15.27:0/4039558107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30069b80 0x7fce301531a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 >> 172.21.15.27:0/4039558107 conn(0x7fce300c7900 msgr2=0x7fce301511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 shutdown_connections 2023-05-17T15:09:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.227+0000 7fce35fa9700 1 -- 172.21.15.27:0/4039558107 wait complete. 2023-05-17T15:09:04.242 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:09:04.242 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:09:04.242 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:09:04.242 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:09:04.243 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:04.243 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:09:04.243 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:09:04.243 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:09:04.244 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:09:04.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.244 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:09:04.259 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:09:04.260 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 41368sec preferred_lft 41368sec 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.261 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.262 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:09:04.263 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:09:04.264 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:04.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.264 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:09:04.322 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:09:04.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.324 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:09:04.383 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:09:04.384 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:09:04.384 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:09:04.384 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:09:04.384 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:09:04.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.385 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:09:04.385 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:09:04.386 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:09:04.386 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:09:04.386 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:09:04.386 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:09:04.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.484 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:09:04.499 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:09:04.499 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:09:04.499 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:09:04.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.500 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:09:04.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.565 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:04.619 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:09:04.620 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:09:04.698 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:09:04.699 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:09:04.740 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:09:04.741 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:09:04.742 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:09:04.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:04.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:04.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:09:04.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.962+0000 7ff901005700 1 Processor -- start 2023-05-17T15:09:04.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.962+0000 7ff901005700 1 -- start start 2023-05-17T15:09:04.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff901005700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8fc153ef0 0x7ff8fc0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff901005700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc158010 con 0x7ff8fc157980 2023-05-17T15:09:04.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff901005700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc1582f0 con 0x7ff8fc0cac00 2023-05-17T15:09:04.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff901005700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc1588b0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8fc153ef0 0x7ff8fc0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8fc153ef0 0x7ff8fc0cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40030/0 (socket says 172.21.15.27:40030) 2023-05-17T15:09:04.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/2273410572 learned_addr learned my addr 172.21.15.27:0/2273410572 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:04.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/2273410572 >> v1:172.21.15.40:6789/0 conn(0x7ff8fc0cac00 legacy=0x7ff8fc1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/2273410572 >> v1:172.21.15.27:6789/0 conn(0x7ff8fc157980 legacy=0x7ff8fc0c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/2273410572 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc1585d0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8faffd700 1 -- 172.21.15.27:0/2273410572 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337084857 0 0) 0x7ff8fc158010 con 0x7ff8fc157980 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8fb7fe700 1 --2- 172.21.15.27:0/2273410572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0cafe0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7ff8f0006fd0 tx=0x7ff8f00090f0).ready entity=mon.0 client_cookie=d3fc563a67144658 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8faffd700 1 -- 172.21.15.27:0/2273410572 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000b600 con 0x7ff8fc153ef0 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8faffd700 1 -- 172.21.15.27:0/2273410572 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f000b760 con 0x7ff8fc153ef0 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.963+0000 7ff8faffd700 1 -- 172.21.15.27:0/2273410572 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000bae0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 -- 172.21.15.27:0/2273410572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 msgr2=0x7ff8fc0cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 --2- 172.21.15.27:0/2273410572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0cafe0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7ff8f0006fd0 tx=0x7ff8f00090f0).stop 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 -- 172.21.15.27:0/2273410572 shutdown_connections 2023-05-17T15:09:04.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 --2- 172.21.15.27:0/2273410572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0cafe0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 -- 172.21.15.27:0/2273410572 >> 172.21.15.27:0/2273410572 conn(0x7ff8fc05dd50 msgr2=0x7ff8fc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:04.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 -- 172.21.15.27:0/2273410572 shutdown_connections 2023-05-17T15:09:04.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.964+0000 7ff901005700 1 -- 172.21.15.27:0/2273410572 wait complete. 2023-05-17T15:09:04.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.965+0000 7ff901005700 1 Processor -- start 2023-05-17T15:09:04.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.965+0000 7ff901005700 1 -- start start 2023-05-17T15:09:04.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff901005700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8fc0cac00 0x7ff8fc13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff901005700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff901005700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc157980 0x7ff8fc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff901005700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0c9c30 con 0x7ff8fc153ef0 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff901005700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0addd0 con 0x7ff8fc157980 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff901005700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc13c170 con 0x7ff8fc0cac00 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40036/0 (socket says 172.21.15.27:40036) 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/3110452969 learned_addr learned my addr 172.21.15.27:0/3110452969 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:04.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fbfff700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8fc0cac00 0x7ff8fc13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8fc0cac00 msgr2=0x7ff8fc13bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8fc0cac00 0x7ff8fc13bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff900804700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc157980 0x7ff8fc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc157980 msgr2=0x7ff8fc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc157980 0x7ff8fc0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.966+0000 7ff8fb7fe700 1 -- 172.21.15.27:0/3110452969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0009370 con 0x7ff8fc153ef0 2023-05-17T15:09:04.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.967+0000 7ff8fb7fe700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0c9250 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7ff8fc0c85c0 tx=0x7ff8f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.967+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000bae0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.967+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0000c90 con 0x7ff8fc153ef0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.967+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc156be0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.967+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f001c650 con 0x7ff8fc153ef0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.967+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc1571a0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.968+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc0adf60 con 0x7ff8fc153ef0 2023-05-17T15:09:04.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.968+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff8f000f070 con 0x7ff8fc153ef0 2023-05-17T15:09:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.968+0000 7ff8e3fff700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8e805ed90 0x7ff8e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.968+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ff8f007b7a0 con 0x7ff8fc153ef0 2023-05-17T15:09:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.968+0000 7ff8fbfff700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8e805ed90 0x7ff8e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.969+0000 7ff8fbfff700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8e805ed90 0x7ff8e8061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8ec001680 tx=0x7ff8ec009040).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:04.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:04.973+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff8f004ccf0 con 0x7ff8fc153ef0 2023-05-17T15:09:05.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.173+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8fc047150 con 0x7ff8e805ed90 2023-05-17T15:09:05.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.175+0000 7ff8e3fff700 1 -- 172.21.15.27:0/3110452969 <== mgr.6462 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff8fc047150 con 0x7ff8e805ed90 2023-05-17T15:09:05.178 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:09:05.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:05.179 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:09:05.179 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:05.179 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:09:05.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8e805ed90 msgr2=0x7ff8e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8e805ed90 0x7ff8e8061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8ec001680 tx=0x7ff8ec009040).stop 2023-05-17T15:09:05.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 msgr2=0x7ff8fc0c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0c9250 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7ff8fc0c85c0 tx=0x7ff8f0017000).stop 2023-05-17T15:09:05.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 shutdown_connections 2023-05-17T15:09:05.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff8e805ed90 0x7ff8e8061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc157980 0x7ff8fc0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8fc0cac00 0x7ff8fc13bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 --2- 172.21.15.27:0/3110452969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8fc153ef0 0x7ff8fc0c9250 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 >> 172.21.15.27:0/3110452969 conn(0x7ff8fc05dd50 msgr2=0x7ff8fc0c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:05.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 shutdown_connections 2023-05-17T15:09:05.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.177+0000 7ff901005700 1 -- 172.21.15.27:0/3110452969 wait complete. 2023-05-17T15:09:05.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:09:05.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.307+0000 7fe1293a2700 1 Processor -- start 2023-05-17T15:09:05.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.307+0000 7fe1293a2700 1 -- start start 2023-05-17T15:09:05.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.308+0000 7fe1293a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1240cafe0 0x7fe124157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.308+0000 7fe1293a2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe124158010 con 0x7fe124153ef0 2023-05-17T15:09:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.308+0000 7fe1293a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1241582f0 con 0x7fe1240cac00 2023-05-17T15:09:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.308+0000 7fe1293a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1241588b0 con 0x7fe1240cafe0 2023-05-17T15:09:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.308+0000 7fe1237fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe124153ef0 0x7fe1240c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39606/0 (socket says 172.21.15.27:39606) 2023-05-17T15:09:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.308+0000 7fe1237fe700 1 -- 172.21.15.27:0/1647413859 learned_addr learned my addr 172.21.15.27:0/1647413859 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe128ba1700 1 --2- 172.21.15.27:0/1647413859 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cafe0 0x7fe124157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748865240 0 0) 0x7fe124158010 con 0x7fe124153ef0 2023-05-17T15:09:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10c0033f0 con 0x7fe124153ef0 2023-05-17T15:09:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3103360777 0 0) 0x7fe10c0033f0 con 0x7fe124153ef0 2023-05-17T15:09:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cafe0 msgr2=0x7fe124157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 --2- 172.21.15.27:0/1647413859 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cafe0 0x7fe124157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 >> v1:172.21.15.40:6789/0 conn(0x7fe1240cac00 legacy=0x7fe1241537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1241585d0 con 0x7fe124153ef0 2023-05-17T15:09:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fe118001470 con 0x7fe124153ef0 2023-05-17T15:09:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe128ba1700 1 --2- 172.21.15.27:0/1647413859 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cafe0 0x7fe124157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 >> v1:172.21.15.27:6789/0 conn(0x7fe124153ef0 legacy=0x7fe1240c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c0038e0 0x7fe10c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe10c004690 0x7fe10c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c005000 0x7fe10c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1241588b0 con 0x7fe10c004690 2023-05-17T15:09:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c00beb0 con 0x7fe10c0038e0 2023-05-17T15:09:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c00c070 con 0x7fe10c005000 2023-05-17T15:09:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe1237fe700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe10c004690 0x7fe10c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe123fff700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c0038e0 0x7fe10c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe128ba1700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c005000 0x7fe10c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe1237fe700 1 -- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c005000 msgr2=0x7fe10c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.309+0000 7fe1237fe700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c005000 0x7fe10c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1237fe700 1 -- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c0038e0 msgr2=0x7fe10c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1237fe700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c0038e0 0x7fe10c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1237fe700 1 -- 172.21.15.27:0/1647413859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0033f0 con 0x7fe10c004690 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe128ba1700 1 -- 172.21.15.27:0/1647413859 reap_dead start 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1237fe700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe10c004690 0x7fe10c004b10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fe11800c190 tx=0x7fe118001e50).ready entity=mon.0 client_cookie=d2428927d36e85ba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118007a20 con 0x7fe10c004690 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11800ca40 con 0x7fe10c004690 2023-05-17T15:09:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe122ffd700 1 -- 172.21.15.27:0/1647413859 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11800cdc0 con 0x7fe10c004690 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 -- 172.21.15.27:0/1647413859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe10c004690 msgr2=0x7fe10c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe10c004690 0x7fe10c004b10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fe11800c190 tx=0x7fe118001e50).stop 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 -- 172.21.15.27:0/1647413859 shutdown_connections 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 --2- 172.21.15.27:0/1647413859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe10c004690 0x7fe10c004b10 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 -- 172.21.15.27:0/1647413859 >> 172.21.15.27:0/1647413859 conn(0x7fe12405dd50 msgr2=0x7fe12405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 -- 172.21.15.27:0/1647413859 shutdown_connections 2023-05-17T15:09:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.310+0000 7fe1293a2700 1 -- 172.21.15.27:0/1647413859 wait complete. 2023-05-17T15:09:05.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.311+0000 7fe1293a2700 1 Processor -- start 2023-05-17T15:09:05.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 -- start start 2023-05-17T15:09:05.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c004690 0x7fe124165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 0x7fe1240aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1240ab210 0x7fe12414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe124165a20 con 0x7fe1240c3bc0 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe124151230 con 0x7fe10c004690 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1293a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240ab690 con 0x7fe1240ab210 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 0x7fe1240aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 0x7fe1240aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40056/0 (socket says 172.21.15.27:40056) 2023-05-17T15:09:05.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe1237fe700 1 -- 172.21.15.27:0/300182851 learned_addr learned my addr 172.21.15.27:0/300182851 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.312+0000 7fe123fff700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c004690 0x7fe124165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe128ba1700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1240ab210 0x7fe12414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1237fe700 1 -- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1240ab210 msgr2=0x7fe12414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1237fe700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1240ab210 0x7fe12414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1237fe700 1 -- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c004690 msgr2=0x7fe124165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1237fe700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c004690 0x7fe124165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1237fe700 1 -- 172.21.15.27:0/300182851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124150f00 con 0x7fe1240c3bc0 2023-05-17T15:09:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe128ba1700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1240ab210 0x7fe12414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1237fe700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 0x7fe1240aad20 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fe10c00be80 tx=0x7fe118015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118001430 con 0x7fe1240c3bc0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1180046b0 con 0x7fe1240c3bc0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118004a50 con 0x7fe1240c3bc0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1241500b0 con 0x7fe1240c3bc0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.313+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe124150670 con 0x7fe1240c3bc0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.314+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1241513c0 con 0x7fe1240c3bc0 2023-05-17T15:09:05.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.314+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe118026070 con 0x7fe1240c3bc0 2023-05-17T15:09:05.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.315+0000 7fe10bfff700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe11005ed90 0x7fe110061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:05.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.315+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fe11807a2b0 con 0x7fe1240c3bc0 2023-05-17T15:09:05.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.315+0000 7fe123fff700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe11005ed90 0x7fe110061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:05.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.315+0000 7fe123fff700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe11005ed90 0x7fe110061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe114007fd0 tx=0x7fe114007bb0).ready entity=mgr.6462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:05.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.319+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe11804b880 con 0x7fe1240c3bc0 2023-05-17T15:09:05.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.539+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe1241574b0 con 0x7fe1240c3bc0 2023-05-17T15:09:05.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.952+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fe118010070 con 0x7fe1240c3bc0 2023-05-17T15:09:05.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.953+0000 7fe10bfff700 1 -- 172.21.15.27:0/300182851 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v32) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe118040da0 con 0x7fe1240c3bc0 2023-05-17T15:09:05.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe11005ed90 msgr2=0x7fe110061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe11005ed90 0x7fe110061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe114007fd0 tx=0x7fe114007bb0).stop 2023-05-17T15:09:05.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 msgr2=0x7fe1240aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:05.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 0x7fe1240aad20 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fe10c00be80 tx=0x7fe118015000).stop 2023-05-17T15:09:05.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 shutdown_connections 2023-05-17T15:09:05.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe11005ed90 0x7fe110061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1240ab210 0x7fe12414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c004690 0x7fe124165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 --2- 172.21.15.27:0/300182851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1240c3bc0 0x7fe1240aad20 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:05.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 >> 172.21.15.27:0/300182851 conn(0x7fe12405dd50 msgr2=0x7fe1240c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:05.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 shutdown_connections 2023-05-17T15:09:05.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:05.956+0000 7fe1293a2700 1 -- 172.21.15.27:0/300182851 wait complete. 2023-05-17T15:09:05.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:09:06.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.096+0000 7ffa8359e700 1 Processor -- start 2023-05-17T15:09:06.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.096+0000 7ffa8359e700 1 -- start start 2023-05-17T15:09:06.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841584e0 0x7ffa840c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840bcd40 con 0x7ffa840c4290 2023-05-17T15:09:06.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840bd5e0 con 0x7ffa841554b0 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84158b00 con 0x7ffa841584e0 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ffa840c4290 0x7ffa84154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39650/0 (socket says 172.21.15.27:39650) 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8259c700 1 -- 172.21.15.27:0/1502288549 learned_addr learned my addr 172.21.15.27:0/1502288549 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa82d9d700 1 --2- 172.21.15.27:0/1502288549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841584e0 0x7ffa840c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016401824 0 0) 0x7ffa840bcd40 con 0x7ffa840c4290 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.097+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa6c0033f0 con 0x7ffa840c4290 2023-05-17T15:09:06.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281171989 0 0) 0x7ffa840bd5e0 con 0x7ffa841554b0 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa840bcd40 con 0x7ffa841554b0 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1502288549 >> v1:172.21.15.40:6789/0 conn(0x7ffa841554b0 legacy=0x7ffa84157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1502288549 >> v1:172.21.15.27:6789/0 conn(0x7ffa840c4290 legacy=0x7ffa84154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1502288549 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840bcf90 con 0x7ffa841584e0 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa82d9d700 1 --2- 172.21.15.27:0/1502288549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841584e0 0x7ffa840c4670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ffa7c009e90 tx=0x7ffa7c009780).ready entity=mon.2 client_cookie=f6bc1e3d15ddc3db server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00e070 con 0x7ffa841584e0 2023-05-17T15:09:06.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00bab0 con 0x7ffa841584e0 2023-05-17T15:09:06.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa8159a700 1 -- 172.21.15.27:0/1502288549 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00be30 con 0x7ffa841584e0 2023-05-17T15:09:06.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.098+0000 7ffa8359e700 1 -- 172.21.15.27:0/1502288549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841584e0 msgr2=0x7ffa840c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.099+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1502288549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841584e0 0x7ffa840c4670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ffa7c009e90 tx=0x7ffa7c009780).stop 2023-05-17T15:09:06.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.099+0000 7ffa8359e700 1 -- 172.21.15.27:0/1502288549 shutdown_connections 2023-05-17T15:09:06.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.099+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1502288549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841584e0 0x7ffa840c4670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.099+0000 7ffa8359e700 1 -- 172.21.15.27:0/1502288549 >> 172.21.15.27:0/1502288549 conn(0x7ffa84067cb0 msgr2=0x7ffa840680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:06.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.099+0000 7ffa8359e700 1 -- 172.21.15.27:0/1502288549 shutdown_connections 2023-05-17T15:09:06.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.099+0000 7ffa8359e700 1 -- 172.21.15.27:0/1502288549 wait complete. 2023-05-17T15:09:06.107 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:06.097+0000 7f13070c7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:09:06.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.100+0000 7ffa8359e700 1 Processor -- start 2023-05-17T15:09:06.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.100+0000 7ffa8359e700 1 -- start start 2023-05-17T15:09:06.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.100+0000 7ffa8359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa840c4290 0x7ffa840a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.100+0000 7ffa8359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841554b0 0x7ffa8414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.100+0000 7ffa8359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 0x7ffa840c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa8359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840bfaf0 con 0x7ffa841584e0 2023-05-17T15:09:06.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa8359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84165c50 con 0x7ffa840c4290 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa8359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840a7670 con 0x7ffa841554b0 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 0x7ffa840c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 0x7ffa840c0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40098/0 (socket says 172.21.15.27:40098) 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1209939607 learned_addr learned my addr 172.21.15.27:0/1209939607 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa8259c700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa840c4290 0x7ffa840a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa81d9b700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841554b0 0x7ffa8414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841554b0 msgr2=0x7ffa8414d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841554b0 0x7ffa8414d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa840c4290 msgr2=0x7ffa840a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa840c4290 0x7ffa840a7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 -- 172.21.15.27:0/1209939607 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009a20 con 0x7ffa841584e0 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa82d9d700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 0x7ffa840c0200 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ffa7c00b610 tx=0x7ffa7c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c013e80 con 0x7ffa841584e0 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c01d630 con 0x7ffa841584e0 2023-05-17T15:09:06.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8414da30 con 0x7ffa841584e0 2023-05-17T15:09:06.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c01d9d0 con 0x7ffa841584e0 2023-05-17T15:09:06.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.101+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84166140 con 0x7ffa841584e0 2023-05-17T15:09:06.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.102+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa840c1af0 con 0x7ffa841584e0 2023-05-17T15:09:06.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:06.102+0000 7f09eefa3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:09:06.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.103+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7ffa7c027460 con 0x7ffa841584e0 2023-05-17T15:09:06.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.103+0000 7ffa727fc700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffa6405ede0 0x7ffa640612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.103+0000 7ffa8259c700 1 -- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffa6405ede0 msgr2=0x7ffa640612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:06.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.103+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ffa7c07bc30 con 0x7ffa841584e0 2023-05-17T15:09:06.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.103+0000 7ffa8259c700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffa6405ede0 0x7ffa640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:06.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.111+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa7c04d120 con 0x7ffa841584e0 2023-05-17T15:09:06.167 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:06.163+0000 7f13070c7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:09:06.175 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:06.171+0000 7f09eefa3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:09:06.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.289+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ffa84047150 con 0x7ffa841584e0 2023-05-17T15:09:06.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.292+0000 7ffa727fc700 1 -- 172.21.15.27:0/1209939607 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa7c050740 con 0x7ffa841584e0 2023-05-17T15:09:06.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffa6405ede0 msgr2=0x7ffa640612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:06.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffa6405ede0 0x7ffa640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:06.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 msgr2=0x7ffa840c0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 0x7ffa840c0200 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ffa7c00b610 tx=0x7ffa7c009780).stop 2023-05-17T15:09:06.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 shutdown_connections 2023-05-17T15:09:06.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffa6405ede0 0x7ffa640612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:06.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa841584e0 0x7ffa840c0200 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa840c4290 0x7ffa840a7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 --2- 172.21.15.27:0/1209939607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa841554b0 0x7ffa8414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 >> 172.21.15.27:0/1209939607 conn(0x7ffa84067cb0 msgr2=0x7ffa84156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:06.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 shutdown_connections 2023-05-17T15:09:06.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.294+0000 7ffa8359e700 1 -- 172.21.15.27:0/1209939607 wait complete. 2023-05-17T15:09:06.311 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-05-17T15:09:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.429+0000 7fe04939a700 1 Processor -- start 2023-05-17T15:09:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.429+0000 7fe04939a700 1 -- start start 2023-05-17T15:09:06.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe04939a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440c5310 0x7fe0440be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe04939a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe0440bea40 0x7fe0440c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe04939a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe044069c20 con 0x7fe0440a7fa0 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe04939a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe044154570 con 0x7fe0440bea40 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe04939a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440beed0 con 0x7fe0440c5310 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe0440bea40 0x7fe0440c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe0440bea40 0x7fe0440c3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40122/0 (socket says 172.21.15.27:40122) 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 -- 172.21.15.27:0/4143525028 learned_addr learned my addr 172.21.15.27:0/4143525028 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0427fc700 1 --2- 172.21.15.27:0/4143525028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440c5310 0x7fe0440be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 -- 172.21.15.27:0/4143525028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440c5310 msgr2=0x7fe0440be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 --2- 172.21.15.27:0/4143525028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440c5310 0x7fe0440be550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe041ffb700 1 -- 172.21.15.27:0/4143525028 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541926925 0 0) 0x7fe044069c20 con 0x7fe0440a7fa0 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 -- 172.21.15.27:0/4143525028 >> v1:172.21.15.40:6789/0 conn(0x7fe0440a7fa0 legacy=0x7fe044068730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 -- 172.21.15.27:0/4143525028 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440a8380 con 0x7fe0440bea40 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.430+0000 7fe0437fe700 1 --2- 172.21.15.27:0/4143525028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440bea40 0x7fe0440c3320 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fe03c009f20 tx=0x7fe03c009840).ready entity=mon.0 client_cookie=c3974dfcf6a85b40 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe041ffb700 1 -- 172.21.15.27:0/4143525028 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00e070 con 0x7fe0440bea40 2023-05-17T15:09:06.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe041ffb700 1 -- 172.21.15.27:0/4143525028 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00b9d0 con 0x7fe0440bea40 2023-05-17T15:09:06.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe041ffb700 1 -- 172.21.15.27:0/4143525028 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00bd50 con 0x7fe0440bea40 2023-05-17T15:09:06.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 -- 172.21.15.27:0/4143525028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440bea40 msgr2=0x7fe0440c3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 --2- 172.21.15.27:0/4143525028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440bea40 0x7fe0440c3320 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fe03c009f20 tx=0x7fe03c009840).stop 2023-05-17T15:09:06.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 -- 172.21.15.27:0/4143525028 shutdown_connections 2023-05-17T15:09:06.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 --2- 172.21.15.27:0/4143525028 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440bea40 0x7fe0440c3320 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 --2- 172.21.15.27:0/4143525028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440c5310 0x7fe0440be550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 -- 172.21.15.27:0/4143525028 >> 172.21.15.27:0/4143525028 conn(0x7fe044092160 msgr2=0x7fe044062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 -- 172.21.15.27:0/4143525028 shutdown_connections 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.431+0000 7fe04939a700 1 -- 172.21.15.27:0/4143525028 wait complete. 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 Processor -- start 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 -- start start 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440a7fa0 0x7fe0440c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440bea40 0x7fe0440c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0440c5310 0x7fe044143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440c6ad0 con 0x7fe0440a7fa0 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe044150f40 con 0x7fe0440c5310 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe04939a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441647e0 con 0x7fe0440bea40 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe042ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440a7fa0 0x7fe0440c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe042ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440a7fa0 0x7fe0440c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40124/0 (socket says 172.21.15.27:40124) 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe042ffd700 1 -- 172.21.15.27:0/1156007864 learned_addr learned my addr 172.21.15.27:0/1156007864 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440bea40 0x7fe0440c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.433+0000 7fe0437fe700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0440c5310 0x7fe044143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe042ffd700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440bea40 msgr2=0x7fe0440c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe042ffd700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0440bea40 0x7fe0440c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe042ffd700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0440c5310 msgr2=0x7fe044143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe042ffd700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0440c5310 0x7fe044143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe042ffd700 1 -- 172.21.15.27:0/1156007864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009ae0 con 0x7fe0440a7fa0 2023-05-17T15:09:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe042ffd700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0440a7fa0 0x7fe0440c9090 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7fe03800c440 tx=0x7fe038007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038007020 con 0x7fe0440a7fa0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0380071a0 con 0x7fe0440a7fa0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe04939a700 1 -- 172.21.15.27:0/1156007864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0440c6cc0 con 0x7fe0440a7fa0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038007560 con 0x7fe0440a7fa0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.434+0000 7fe04939a700 1 -- 172.21.15.27:0/1156007864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe044143e30 con 0x7fe0440a7fa0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.435+0000 7fe04939a700 1 -- 172.21.15.27:0/1156007864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04406bdf0 con 0x7fe0440a7fa0 2023-05-17T15:09:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.435+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fe038010070 con 0x7fe0440a7fa0 2023-05-17T15:09:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.436+0000 7fe02affd700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.436+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fe038078d90 con 0x7fe0440a7fa0 2023-05-17T15:09:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.436+0000 7fe0427fc700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 msgr2=0x7fe0300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:06.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.436+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:06.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.440+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe0380478f0 con 0x7fe0440a7fa0 2023-05-17T15:09:06.453 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:06.450+0000 7f13070c7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:09:06.465 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:06.462+0000 7f09eefa3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:09:06.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.637+0000 7fe0427fc700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 msgr2=0x7fe0300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:06.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.637+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:06.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:06.638+0000 7fe04939a700 1 -- 172.21.15.27:0/1156007864 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe044096910 con 0x7fe03005ede0 2023-05-17T15:09:07.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:07.038+0000 7fe0427fc700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 msgr2=0x7fe0300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:07.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:07.038+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:09:07.112 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:07.109+0000 7f13070c7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:09:07.122 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:07.118+0000 7f09eefa3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:09:07.180 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:07.177+0000 7f13070c7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:09:07.189 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:07.186+0000 7f09eefa3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:09:07.373 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:07.369+0000 7f13070c7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:09:07.382 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:07.379+0000 7f09eefa3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:09:07.809 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:07.805+0000 7f13070c7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:09:07.817 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:07.813+0000 7f09eefa3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:09:07.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:07.839+0000 7fe0427fc700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 msgr2=0x7fe0300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:07.839+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:09:07.917 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:07.913+0000 7f13070c7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:07.924 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:07.920+0000 7f09eefa3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:08.075 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:08.071+0000 7f13070c7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:08.082 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:08.079+0000 7f09eefa3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:08.152 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:08.149+0000 7f13070c7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:09:08.159 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:08.156+0000 7f09eefa3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:09:08.222 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:08.218+0000 7f13070c7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:09:08.229 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:08.226+0000 7f09eefa3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:09:08.492 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:08.488+0000 7f13070c7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:09:08.496 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:08.493+0000 7f09eefa3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:09:08.681 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:08.677+0000 7f13070c7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:08.688 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:08.685+0000 7f09eefa3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:09.360 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.356+0000 7f13070c7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:09:09.371 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.368+0000 7f09eefa3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:09:09.430 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.427+0000 7f13070c7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:09:09.442 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.439+0000 7f09eefa3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:09:09.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:09.440+0000 7fe0427fc700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 msgr2=0x7fe0300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:09.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:09.440+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:09:09.507 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.504+0000 7f13070c7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:09:09.519 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.516+0000 7f09eefa3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:09:09.658 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.654+0000 7f13070c7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:09:09.671 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.668+0000 7f09eefa3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:09:09.731 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.727+0000 7f13070c7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:09:09.744 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.740+0000 7f09eefa3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:09:09.855 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.847+0000 7f13070c7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:09:09.864 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.860+0000 7f09eefa3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:09:09.962 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:09.958+0000 7f13070c7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:09.976 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:09.973+0000 7f09eefa3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:10.262 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:10.259+0000 7f13070c7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:09:10.280 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.276+0000 7f09eefa3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:09:10.337 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:10.333+0000 7f13070c7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:09:10.353 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.349+0000 7f09eefa3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:09:10.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:10.664+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 33) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fe03807d070 con 0x7fe0440a7fa0 2023-05-17T15:09:10.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:10.664+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 msgr2=0x7fe0300612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:10.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:10.664+0000 7fe02affd700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe0300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:10.721 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096d785700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.721 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096d785700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096d785700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096d785700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096d785700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096a77f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096a77f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096a77f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.722 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096a77f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:10.723 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:10.717+0000 7f096a77f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:11.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.669+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 34) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fe038076fc0 con 0x7fe0440a7fa0 2023-05-17T15:09:11.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.670+0000 7fe02affd700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe03002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.670+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe044096910 con 0x7fe03005ede0 2023-05-17T15:09:11.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.672+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe03002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.673+0000 7fe0427fc700 1 --2- 172.21.15.27:0/1156007864 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe03005ede0 0x7fe03002fd40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe044153980 tx=0x7fe034009060).ready entity=mgr.6873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:11.679 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:11.675+0000 7f099ca2e700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-05-17T15:09:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.675+0000 7fe02affd700 1 -- 172.21.15.27:0/1156007864 <== mgr.6873 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fe044096910 con 0x7fe03005ede0 2023-05-17T15:09:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-05-17T15:09:11.684 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-17T15:09:11.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:09:11.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.802+0000 7fcb53f0b700 1 Processor -- start 2023-05-17T15:09:11.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb53f0b700 1 -- start start 2023-05-17T15:09:11.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb53f0b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcb4c14b050 0x7fcb4c067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb53f0b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb4c1550c0 0x7fcb4c0653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb53f0b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c069160 con 0x7fcb4c0658d0 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb53f0b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c068e80 con 0x7fcb4c14b050 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb53f0b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c065d40 con 0x7fcb4c1550c0 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb51ca7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcb4c14b050 0x7fcb4c067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.803+0000 7fcb524a8700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcb4c0658d0 0x7fcb4c157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39866/0 (socket says 172.21.15.27:39866) 2023-05-17T15:09:11.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb524a8700 1 -- 172.21.15.27:0/3996465505 learned_addr learned my addr 172.21.15.27:0/3996465505 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb514a6700 1 --2- 172.21.15.27:0/3996465505 >> v2:172.21.15.40:3300/0 conn(0x7fcb4c1550c0 0x7fcb4c0653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb51ca7700 1 -- 172.21.15.27:0/3996465505 >> v2:172.21.15.40:3300/0 conn(0x7fcb4c1550c0 msgr2=0x7fcb4c0653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb51ca7700 1 --2- 172.21.15.27:0/3996465505 >> v2:172.21.15.40:3300/0 conn(0x7fcb4c1550c0 0x7fcb4c0653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb51ca7700 1 -- 172.21.15.27:0/3996465505 >> v1:172.21.15.27:6789/0 conn(0x7fcb4c0658d0 legacy=0x7fcb4c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb50ca5700 1 -- 172.21.15.27:0/3996465505 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995617974 0 0) 0x7fcb4c069160 con 0x7fcb4c0658d0 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb51ca7700 1 -- 172.21.15.27:0/3996465505 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c155540 con 0x7fcb4c14b050 2023-05-17T15:09:11.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb51ca7700 1 --2- 172.21.15.27:0/3996465505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c067ec0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fcb4c0c5460 tx=0x7fcb44009780).ready entity=mon.0 client_cookie=8e52ec2312d088a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb50ca5700 1 -- 172.21.15.27:0/3996465505 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400e070 con 0x7fcb4c14b050 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb50ca5700 1 -- 172.21.15.27:0/3996465505 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400bc30 con 0x7fcb4c14b050 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.804+0000 7fcb50ca5700 1 -- 172.21.15.27:0/3996465505 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44012410 con 0x7fcb4c14b050 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 -- 172.21.15.27:0/3996465505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 msgr2=0x7fcb4c067ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/3996465505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c067ec0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fcb4c0c5460 tx=0x7fcb44009780).stop 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 -- 172.21.15.27:0/3996465505 shutdown_connections 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/3996465505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c067ec0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:11.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/3996465505 >> v2:172.21.15.40:3300/0 conn(0x7fcb4c1550c0 0x7fcb4c0653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 -- 172.21.15.27:0/3996465505 >> 172.21.15.27:0/3996465505 conn(0x7fcb4c0c9490 msgr2=0x7fcb4c0c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 -- 172.21.15.27:0/3996465505 shutdown_connections 2023-05-17T15:09:11.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.805+0000 7fcb53f0b700 1 -- 172.21.15.27:0/3996465505 wait complete. 2023-05-17T15:09:11.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.806+0000 7fcb53f0b700 1 Processor -- start 2023-05-17T15:09:11.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.806+0000 7fcb53f0b700 1 -- start start 2023-05-17T15:09:11.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb4c0658d0 0x7fcb4c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c0c0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb4c1550c0 0x7fcb4c0c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0c1380 con 0x7fcb4c14b050 2023-05-17T15:09:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0ad4d0 con 0x7fcb4c0658d0 2023-05-17T15:09:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0c0dc0 con 0x7fcb4c1550c0 2023-05-17T15:09:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c0c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c0c0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40308/0 (socket says 172.21.15.27:40308) 2023-05-17T15:09:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 -- 172.21.15.27:0/1961893914 learned_addr learned my addr 172.21.15.27:0/1961893914 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb51ca7700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb4c0658d0 0x7fcb4c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb524a8700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb4c1550c0 0x7fcb4c0c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 -- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb4c1550c0 msgr2=0x7fcb4c0c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb4c1550c0 0x7fcb4c0c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:11.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 -- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb4c0658d0 msgr2=0x7fcb4c0a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb4c0658d0 0x7fcb4c0a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 -- 172.21.15.27:0/1961893914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44009a20 con 0x7fcb4c14b050 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb524a8700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb4c1550c0 0x7fcb4c0c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb514a6700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c0c0300 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fcb4000d860 tx=0x7fcb40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011590 con 0x7fcb4c14b050 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb400116f0 con 0x7fcb4c14b050 2023-05-17T15:09:11.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0c10a0 con 0x7fcb4c14b050 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011a70 con 0x7fcb4c14b050 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.807+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c0c2ad0 con 0x7fcb4c14b050 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.808+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c0acfc0 con 0x7fcb4c14b050 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.809+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 34) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fcb40012420 con 0x7fcb4c14b050 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.809+0000 7fcb49ffb700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcb3805ed40 0x7fcb38061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.809+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fcb40079690 con 0x7fcb4c14b050 2023-05-17T15:09:11.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.809+0000 7fcb51ca7700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcb3805ed40 0x7fcb38061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:11.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.809+0000 7fcb51ca7700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcb3805ed40 0x7fcb38061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcb44009f90 tx=0x7fcb44009780).ready entity=mgr.6873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:11.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:11.813+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb4c0acfc0 con 0x7fcb4c14b050 2023-05-17T15:09:12.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.030+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcb4c0acfc0 con 0x7fcb4c14b050 2023-05-17T15:09:12.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.689+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fcb40077540 con 0x7fcb4c14b050 2023-05-17T15:09:12.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.690+0000 7fcb49ffb700 1 -- 172.21.15.27:0/1961893914 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcb40072ce0 con 0x7fcb4c14b050 2023-05-17T15:09:12.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcb3805ed40 msgr2=0x7fcb38061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:12.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcb3805ed40 0x7fcb38061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcb44009f90 tx=0x7fcb44009780).stop 2023-05-17T15:09:12.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 msgr2=0x7fcb4c0c0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:12.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c0c0300 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fcb4000d860 tx=0x7fcb40008040).stop 2023-05-17T15:09:12.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 shutdown_connections 2023-05-17T15:09:12.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcb3805ed40 0x7fcb38061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:12.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb4c1550c0 0x7fcb4c0c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:12.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb4c0658d0 0x7fcb4c0a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:12.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 --2- 172.21.15.27:0/1961893914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcb4c14b050 0x7fcb4c0c0300 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:12.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 >> 172.21.15.27:0/1961893914 conn(0x7fcb4c0c9490 msgr2=0x7fcb4c0c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:12.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 shutdown_connections 2023-05-17T15:09:12.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:12.693+0000 7fcb53f0b700 1 -- 172.21.15.27:0/1961893914 wait complete. 2023-05-17T15:09:12.713 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:09:12.713 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:09:12.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:09:12.775 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:09:12.775 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:09:12.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:12.776 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:12.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:09:12.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:12.830 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:09:12.839 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:12.835+0000 7fa19d044680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:09:12.843 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:12.840+0000 7fe3cafca680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:09:12.857 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:12.904 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:12.901+0000 7fa19d044680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:09:12.909 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:12.905+0000 7fe3cafca680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:09:13.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.012+0000 7f897232a700 1 Processor -- start 2023-05-17T15:09:13.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.012+0000 7f897232a700 1 -- start start 2023-05-17T15:09:13.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f897232a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c153fa0 0x7f896c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f897232a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f896c0aae70 0x7f896c0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f897232a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0c07a0 con 0x7f896c069060 2023-05-17T15:09:13.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f897232a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c069d70 con 0x7f896c0aae70 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f897232a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0c6760 con 0x7f896c153fa0 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f89708c7700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f896c069060 0x7f896c0694f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39928/0 (socket says 172.21.15.27:39928) 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f89708c7700 1 -- 172.21.15.27:0/1166099040 learned_addr learned my addr 172.21.15.27:0/1166099040 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f896b7fe700 1 --2- 172.21.15.27:0/1166099040 >> v2:172.21.15.40:3300/0 conn(0x7f896c0aae70 0x7f896c0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.013+0000 7f896bfff700 1 --2- 172.21.15.27:0/1166099040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c153fa0 0x7f896c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896affd700 1 -- 172.21.15.27:0/1166099040 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340438126 0 0) 0x7f896c0c07a0 con 0x7f896c069060 2023-05-17T15:09:13.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896affd700 1 -- 172.21.15.27:0/1166099040 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89580033f0 con 0x7f896c069060 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896bfff700 1 -- 172.21.15.27:0/1166099040 >> v2:172.21.15.40:3300/0 conn(0x7f896c0aae70 msgr2=0x7f896c0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896bfff700 1 --2- 172.21.15.27:0/1166099040 >> v2:172.21.15.40:3300/0 conn(0x7f896c0aae70 0x7f896c0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896bfff700 1 -- 172.21.15.27:0/1166099040 >> v1:172.21.15.27:6789/0 conn(0x7f896c069060 legacy=0x7f896c0694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896bfff700 1 -- 172.21.15.27:0/1166099040 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0c1c40 con 0x7f896c153fa0 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896b7fe700 1 --2- 172.21.15.27:0/1166099040 >> v2:172.21.15.40:3300/0 conn(0x7f896c0aae70 0x7f896c0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896bfff700 1 --2- 172.21.15.27:0/1166099040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c153fa0 0x7f896c0c5d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f895c009760 tx=0x7f895c009060).ready entity=mon.2 client_cookie=15901fe07bf9702a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896affd700 1 -- 172.21.15.27:0/1166099040 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00d4a0 con 0x7f896c153fa0 2023-05-17T15:09:13.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896affd700 1 -- 172.21.15.27:0/1166099040 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00d600 con 0x7f896c153fa0 2023-05-17T15:09:13.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.014+0000 7f896affd700 1 -- 172.21.15.27:0/1166099040 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00d980 con 0x7f896c153fa0 2023-05-17T15:09:13.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 -- 172.21.15.27:0/1166099040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c153fa0 msgr2=0x7f896c0c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 --2- 172.21.15.27:0/1166099040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c153fa0 0x7f896c0c5d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f895c009760 tx=0x7f895c009060).stop 2023-05-17T15:09:13.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 -- 172.21.15.27:0/1166099040 shutdown_connections 2023-05-17T15:09:13.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 --2- 172.21.15.27:0/1166099040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c153fa0 0x7f896c0c5d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 --2- 172.21.15.27:0/1166099040 >> v2:172.21.15.40:3300/0 conn(0x7f896c0aae70 0x7f896c0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 -- 172.21.15.27:0/1166099040 >> 172.21.15.27:0/1166099040 conn(0x7f896c0cb810 msgr2=0x7f896c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:13.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 -- 172.21.15.27:0/1166099040 shutdown_connections 2023-05-17T15:09:13.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.015+0000 7f897232a700 1 -- 172.21.15.27:0/1166099040 wait complete. 2023-05-17T15:09:13.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.016+0000 7f897232a700 1 Processor -- start 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.016+0000 7f897232a700 1 -- start start 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f897232a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 0x7f896c14e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f897232a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c0aae70 0x7f896c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f897232a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896c153fa0 0x7f896c0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f897232a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c167860 con 0x7f896c069060 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f897232a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c151690 con 0x7f896c153fa0 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f897232a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c150da0 con 0x7f896c0aae70 2023-05-17T15:09:13.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 0x7f896c14e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 0x7f896c14e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40368/0 (socket says 172.21.15.27:40368) 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 -- 172.21.15.27:0/3502634503 learned_addr learned my addr 172.21.15.27:0/3502634503 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f89708c7700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896c153fa0 0x7f896c0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896b7fe700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c0aae70 0x7f896c0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 -- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c0aae70 msgr2=0x7f896c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c0aae70 0x7f896c0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 -- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896c153fa0 msgr2=0x7f896c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896c153fa0 0x7f896c0c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 -- 172.21.15.27:0/3502634503 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954009250 con 0x7f896c069060 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f896bfff700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 0x7f896c14e3e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f896c0aac40 tx=0x7f895c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.017+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00dd30 con 0x7f896c069060 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.018+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00de90 con 0x7f896c069060 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.018+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c0092a0 con 0x7f896c069060 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.018+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00d980 con 0x7f896c069060 2023-05-17T15:09:13.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.018+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c151320 con 0x7f896c069060 2023-05-17T15:09:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.019+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c06bdf0 con 0x7f896c069060 2023-05-17T15:09:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.019+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f895c00f070 con 0x7f896c069060 2023-05-17T15:09:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.019+0000 7f8963fff700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 0x7f894c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.019+0000 7f896b7fe700 1 -- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 msgr2=0x7f894c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.020+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f895c07b3b0 con 0x7f896c069060 2023-05-17T15:09:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.020+0000 7f896b7fe700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 0x7f894c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.023+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f895c04c790 con 0x7f896c069060 2023-05-17T15:09:13.189 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:13.185+0000 7fa19d044680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:09:13.213 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:13.209+0000 7fe3cafca680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:09:13.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.221+0000 7f896b7fe700 1 -- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 msgr2=0x7f894c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:13.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.221+0000 7f896b7fe700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 0x7f894c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:13.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.258+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f896c0bfe70 con 0x7f896c069060 2023-05-17T15:09:13.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.259+0000 7f8963fff700 1 -- 172.21.15.27:0/3502634503 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f895c04fdb0 con 0x7f896c069060 2023-05-17T15:09:13.264 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:13.265 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:54.627419+0000","modified":"2023-05-17T15:08:56.658238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6654":{"gid":6654,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2158310427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2158310427},{"type":"v1","addr":"172.21.15.27:6835","nonce":2158310427}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-17T15:09:13.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 msgr2=0x7f894c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:13.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 0x7f894c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:13.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 msgr2=0x7f896c14e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 0x7f896c14e3e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f896c0aac40 tx=0x7f895c016000).stop 2023-05-17T15:09:13.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 shutdown_connections 2023-05-17T15:09:13.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f894c05ede0 0x7f894c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:13.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896c153fa0 0x7f896c0c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f896c069060 0x7f896c14e3e0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 --2- 172.21.15.27:0/3502634503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896c0aae70 0x7f896c0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 >> 172.21.15.27:0/3502634503 conn(0x7f896c0cb810 msgr2=0x7f896c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:13.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 shutdown_connections 2023-05-17T15:09:13.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.261+0000 7f897232a700 1 -- 172.21.15.27:0/3502634503 wait complete. 2023-05-17T15:09:13.270 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2023-05-17T15:09:13.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:13.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.430+0000 7f2854fd1700 1 Processor -- start 2023-05-17T15:09:13.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.430+0000 7f2854fd1700 1 -- start start 2023-05-17T15:09:13.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.431+0000 7f2854fd1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2850154ff0 0x7f28500c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.431+0000 7f2854fd1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28500c34a0 con 0x7f28501372c0 2023-05-17T15:09:13.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.431+0000 7f2854fd1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28500c2890 con 0x7f28501376a0 2023-05-17T15:09:13.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.431+0000 7f2854fd1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2850064be0 con 0x7f2850154ff0 2023-05-17T15:09:13.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284e59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f28501372c0 0x7f28500650d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:39958/0 (socket says 172.21.15.27:39958) 2023-05-17T15:09:13.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284e59c700 1 -- 172.21.15.27:0/3175852111 learned_addr learned my addr 172.21.15.27:0/3175852111 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:13.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284ed9d700 1 --2- 172.21.15.27:0/3175852111 >> v2:172.21.15.40:3300/0 conn(0x7f2850154ff0 0x7f28500c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844098625 0 0) 0x7f28500c34a0 con 0x7f28501372c0 2023-05-17T15:09:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28380033f0 con 0x7f28501372c0 2023-05-17T15:09:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856512625 0 0) 0x7f28500c2890 con 0x7f28501376a0 2023-05-17T15:09:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28500c34a0 con 0x7f28501376a0 2023-05-17T15:09:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284ed9d700 1 -- 172.21.15.27:0/3175852111 >> v1:172.21.15.40:6789/0 conn(0x7f28501376a0 legacy=0x7f28501548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284ed9d700 1 -- 172.21.15.27:0/3175852111 >> v1:172.21.15.27:6789/0 conn(0x7f28501372c0 legacy=0x7f28500650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284ed9d700 1 -- 172.21.15.27:0/3175852111 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500c2b70 con 0x7f2850154ff0 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284ed9d700 1 --2- 172.21.15.27:0/3175852111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2850154ff0 0x7f28500c3930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f2848009e60 tx=0x7f2848009780).ready entity=mon.1 client_cookie=f4dc8cb3a3c453b0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800e070 con 0x7f2850154ff0 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800ba70 con 0x7f2850154ff0 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.432+0000 7f284d59a700 1 -- 172.21.15.27:0/3175852111 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800bdf0 con 0x7f2850154ff0 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 -- 172.21.15.27:0/3175852111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2850154ff0 msgr2=0x7f28500c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3175852111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2850154ff0 0x7f28500c3930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f2848009e60 tx=0x7f2848009780).stop 2023-05-17T15:09:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 -- 172.21.15.27:0/3175852111 shutdown_connections 2023-05-17T15:09:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3175852111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2850154ff0 0x7f28500c3930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 -- 172.21.15.27:0/3175852111 >> 172.21.15.27:0/3175852111 conn(0x7f28500c8400 msgr2=0x7f28500c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 -- 172.21.15.27:0/3175852111 shutdown_connections 2023-05-17T15:09:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.433+0000 7f2854fd1700 1 -- 172.21.15.27:0/3175852111 wait complete. 2023-05-17T15:09:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.434+0000 7f2854fd1700 1 Processor -- start 2023-05-17T15:09:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.434+0000 7f2854fd1700 1 -- start start 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f2854fd1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28501372c0 0x7f2850151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f2854fd1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28501376a0 0x7f28500bee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f2854fd1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2850154ff0 0x7f28500bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f2854fd1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2850151b40 con 0x7f2850154ff0 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f2854fd1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500ab0f0 con 0x7f28501372c0 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f2854fd1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28500bf9a0 con 0x7f28501376a0 2023-05-17T15:09:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2850154ff0 0x7f28500bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28501372c0 0x7f2850151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2850154ff0 0x7f28500bf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40406/0 (socket says 172.21.15.27:40406) 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284ed9d700 1 -- 172.21.15.27:0/3750872651 learned_addr learned my addr 172.21.15.27:0/3750872651 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284dd9b700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28501376a0 0x7f28500bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284e59c700 1 -- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28501376a0 msgr2=0x7f28500bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284e59c700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28501376a0 0x7f28500bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284e59c700 1 -- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2850154ff0 msgr2=0x7f28500bf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284e59c700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2850154ff0 0x7f28500bf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.435+0000 7f284e59c700 1 -- 172.21.15.27:0/3750872651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009a20 con 0x7f28501372c0 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.436+0000 7f284e59c700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28501372c0 0x7f2850151650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f2840001ed0 tx=0x7f2840007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.436+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400070d0 con 0x7f28501372c0 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.436+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840007230 con 0x7f28501372c0 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.436+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400075f0 con 0x7f28501372c0 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.436+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28500bfc80 con 0x7f28501372c0 2023-05-17T15:09:13.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.436+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28500c1720 con 0x7f28501372c0 2023-05-17T15:09:13.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.437+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28500aabe0 con 0x7f28501372c0 2023-05-17T15:09:13.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.437+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2840010070 con 0x7f28501372c0 2023-05-17T15:09:13.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.437+0000 7f283e7fc700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f283005ede0 0x7f28300612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.438+0000 7f284dd9b700 1 -- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f283005ede0 msgr2=0x7f28300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:13.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.438+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f2840079210 con 0x7f28501372c0 2023-05-17T15:09:13.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.438+0000 7f284dd9b700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f283005ede0 0x7f28300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:13.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.442+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28500aabe0 con 0x7f28501372c0 2023-05-17T15:09:13.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.616+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28500aabe0 con 0x7f28501372c0 2023-05-17T15:09:13.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.617+0000 7f283e7fc700 1 -- 172.21.15.27:0/3750872651 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+17287 (secure 0 0 0) 0x7f28500aabe0 con 0x7f28501372c0 2023-05-17T15:09:13.621 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:13.622 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":98,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:10.363584+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:53.174505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:53.590665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3028931537":"2023-05-18T15:09:10.363556+0000","172.21.15.27:0/275166806":"2023-05-18T15:09:10.363556+0000","172.21.15.27:6837/86332":"2023-05-18T15:09:10.363556+0000","172.21.15.27:6836/86332":"2023-05-18T15:09:10.363556+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.619+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f283005ede0 msgr2=0x7f28300612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f283005ede0 0x7f28300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28501372c0 msgr2=0x7f2850151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28501372c0 0x7f2850151650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f2840001ed0 tx=0x7f2840007bd0).stop 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 shutdown_connections 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f283005ede0 0x7f28300612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2850154ff0 0x7f28500bf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28501372c0 0x7f2850151650 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 --2- 172.21.15.27:0/3750872651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28501376a0 0x7f28500bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 >> 172.21.15.27:0/3750872651 conn(0x7f28500c8400 msgr2=0x7f2850154810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:13.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 shutdown_connections 2023-05-17T15:09:13.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.620+0000 7f2854fd1700 1 -- 172.21.15.27:0/3750872651 wait complete. 2023-05-17T15:09:13.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:08:53.174505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:08:53.590665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:09:13.637 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:09:13.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.755+0000 7f493f59e700 1 Processor -- start 2023-05-17T15:09:13.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.755+0000 7f493f59e700 1 -- start start 2023-05-17T15:09:13.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 0x7f4940154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493f59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49400bbe60 0x7f4940066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493f59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4940154970 con 0x7f49400667f0 2023-05-17T15:09:13.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493f59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4940063340 con 0x7f49400bbe60 2023-05-17T15:09:13.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940066c60 con 0x7f49401540a0 2023-05-17T15:09:13.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 0x7f4940154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 0x7f4940154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41520/0 (socket says 172.21.15.27:41520) 2023-05-17T15:09:13.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49400bbe60 0x7f4940066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493e59c700 1 -- 172.21.15.27:0/983226095 learned_addr learned my addr 172.21.15.27:0/983226095 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:13.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493dd9b700 1 -- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 msgr2=0x7f4940154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:13.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493dd9b700 1 --2- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 0x7f4940154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493dd9b700 1 -- 172.21.15.27:0/983226095 >> v1:172.21.15.40:6789/0 conn(0x7f49400667f0 legacy=0x7f4940157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493dd9b700 1 -- 172.21.15.27:0/983226095 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940154ba0 con 0x7f49400bbe60 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493d59a700 1 -- 172.21.15.27:0/983226095 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578578235 0 0) 0x7f4940154970 con 0x7f49400667f0 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.756+0000 7f493e59c700 1 --2- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 0x7f4940154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493dd9b700 1 --2- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49400bbe60 0x7f4940066300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f4934009760 tx=0x7f4934009060).ready entity=mon.1 client_cookie=311b9c1452da5119 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493d59a700 1 -- 172.21.15.27:0/983226095 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400f510 con 0x7f49400bbe60 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493d59a700 1 -- 172.21.15.27:0/983226095 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400f670 con 0x7f49400bbe60 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493d59a700 1 -- 172.21.15.27:0/983226095 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400f9f0 con 0x7f49400bbe60 2023-05-17T15:09:13.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 -- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49400bbe60 msgr2=0x7f4940066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 --2- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49400bbe60 0x7f4940066300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f4934009760 tx=0x7f4934009060).stop 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 -- 172.21.15.27:0/983226095 shutdown_connections 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 --2- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49401540a0 0x7f4940154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 --2- 172.21.15.27:0/983226095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49400bbe60 0x7f4940066300 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 -- 172.21.15.27:0/983226095 >> 172.21.15.27:0/983226095 conn(0x7f4940068780 msgr2=0x7f49400c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 -- 172.21.15.27:0/983226095 shutdown_connections 2023-05-17T15:09:13.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.757+0000 7f493f59e700 1 -- 172.21.15.27:0/983226095 wait complete. 2023-05-17T15:09:13.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.758+0000 7f493f59e700 1 Processor -- start 2023-05-17T15:09:13.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 -- start start 2023-05-17T15:09:13.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49400667f0 0x7f49400c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 0x7f494014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49401540a0 0x7f49400be020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940165750 con 0x7f49400bbe60 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49400c0370 con 0x7f49401540a0 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49400bfa40 con 0x7f49400667f0 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 0x7f494014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 0x7f494014dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40416/0 (socket says 172.21.15.27:40416) 2023-05-17T15:09:13.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493dd9b700 1 -- 172.21.15.27:0/3799773501 learned_addr learned my addr 172.21.15.27:0/3799773501 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:13.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493ed9d700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49401540a0 0x7f49400be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.759+0000 7f493e59c700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49400667f0 0x7f49400c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:13.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493dd9b700 1 -- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49400667f0 msgr2=0x7f49400c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493dd9b700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49400667f0 0x7f49400c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493dd9b700 1 -- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49401540a0 msgr2=0x7f49400be020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493dd9b700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49401540a0 0x7f49400be020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493dd9b700 1 -- 172.21.15.27:0/3799773501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930009370 con 0x7f49400bbe60 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493ed9d700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49401540a0 0x7f49400be020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493dd9b700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 0x7f494014dba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f4934009e00 tx=0x7f4934017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400fe80 con 0x7f49400bbe60 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49340092a0 con 0x7f49400bbe60 2023-05-17T15:09:13.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400f7e0 con 0x7f49400bbe60 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493401b640 con 0x7f49400bbe60 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.760+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49400c0000 con 0x7f49400bbe60 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.761+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49400c0500 con 0x7f49400bbe60 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.762+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f493400f070 con 0x7f49400bbe60 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.762+0000 7f492e7fc700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 0x7f49200612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.762+0000 7f493e59c700 1 -- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 msgr2=0x7f49200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:13.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.762+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f493407b640 con 0x7f49400bbe60 2023-05-17T15:09:13.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.762+0000 7f493e59c700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 0x7f49200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:13.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.766+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f493404ca20 con 0x7f49400bbe60 2023-05-17T15:09:13.844 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:13.841+0000 7fa19d044680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:09:13.870 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:13.866+0000 7fe3cafca680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:09:13.913 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:13.909+0000 7fa19d044680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:09:13.952 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:13.949+0000 7fe3cafca680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:09:13.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.963+0000 7f493e59c700 1 -- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 msgr2=0x7f49200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:13.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.963+0000 7f493e59c700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 0x7f49200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:13.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.993+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4940154e80 con 0x7f49400bbe60 2023-05-17T15:09:13.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.993+0000 7f492e7fc700 1 -- 172.21.15.27:0/3799773501 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4934050040 con 0x7f49400bbe60 2023-05-17T15:09:13.997 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:09:13.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 msgr2=0x7f49200612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:13.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 0x7f49200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:13.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 msgr2=0x7f494014dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 0x7f494014dba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f4934009e00 tx=0x7f4934017000).stop 2023-05-17T15:09:14.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 shutdown_connections 2023-05-17T15:09:14.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f492005ede0 0x7f49200612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49401540a0 0x7f49400be020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49400667f0 0x7f49400c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 --2- 172.21.15.27:0/3799773501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49400bbe60 0x7f494014dba0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 >> 172.21.15.27:0/3799773501 conn(0x7f4940068780 msgr2=0x7f4940151190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 shutdown_connections 2023-05-17T15:09:14.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:13.995+0000 7f493f59e700 1 -- 172.21.15.27:0/3799773501 wait complete. 2023-05-17T15:09:14.013 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:09:14.105 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:14.101+0000 7fa19d044680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:09:14.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.131+0000 7f3ceffff700 1 Processor -- start 2023-05-17T15:09:14.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.131+0000 7f3ceffff700 1 -- start start 2023-05-17T15:09:14.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cf00c3880 0x7f3cf00c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00bf180 0x7f3cf0154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf00bdce0 con 0x7f3cf0065c40 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf0066750 con 0x7f3cf00c3880 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00c47e0 con 0x7f3cf00bf180 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3cef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00bf180 0x7f3cf0154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cf00c3880 0x7f3cf00c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cf00c3880 0x7f3cf00c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:58370/0 (socket says 172.21.15.27:58370) 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 -- 172.21.15.27:0/1968755760 learned_addr learned my addr 172.21.15.27:0/1968755760 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:14.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3cef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00bf180 0x7f3cf0154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41554/0 (socket says 172.21.15.27:41554) 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3cee7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3cf0065c40 0x7f3cf00a7ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46006/0 (socket says 172.21.15.27:46006) 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 -- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00bf180 msgr2=0x7f3cf0154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 --2- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00bf180 0x7f3cf0154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 -- 172.21.15.27:0/1968755760 >> v1:172.21.15.40:6789/0 conn(0x7f3cf0065c40 legacy=0x7f3cf00a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3ceeffd700 1 -- 172.21.15.27:0/1968755760 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0066190 con 0x7f3cf00c3880 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.132+0000 7f3cedffb700 1 -- 172.21.15.27:0/1968755760 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643590584 0 0) 0x7f3cf00bdce0 con 0x7f3cf0065c40 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceeffd700 1 --2- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00c3880 0x7f3cf00c3c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f3ce4006fd0 tx=0x7f3ce40090f0).ready entity=mon.1 client_cookie=eec32577e09903bc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:14.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3cedffb700 1 -- 172.21.15.27:0/1968755760 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400b580 con 0x7f3cf00c3880 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3cedffb700 1 -- 172.21.15.27:0/1968755760 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400b6e0 con 0x7f3cf00c3880 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3cedffb700 1 -- 172.21.15.27:0/1968755760 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400ba60 con 0x7f3cf00c3880 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 -- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00c3880 msgr2=0x7f3cf00c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 --2- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00c3880 0x7f3cf00c3c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f3ce4006fd0 tx=0x7f3ce40090f0).stop 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 -- 172.21.15.27:0/1968755760 shutdown_connections 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 --2- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00bf180 0x7f3cf0154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 --2- 172.21.15.27:0/1968755760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00c3880 0x7f3cf00c3c60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 -- 172.21.15.27:0/1968755760 >> 172.21.15.27:0/1968755760 conn(0x7f3cf00c9340 msgr2=0x7f3cf00c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 -- 172.21.15.27:0/1968755760 shutdown_connections 2023-05-17T15:09:14.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.133+0000 7f3ceffff700 1 -- 172.21.15.27:0/1968755760 wait complete. 2023-05-17T15:09:14.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.134+0000 7f3ceffff700 1 Processor -- start 2023-05-17T15:09:14.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 -- start start 2023-05-17T15:09:14.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 0x7f3cf01432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00bf180 0x7f3cf0150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00c3880 0x7f3cf01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0150ae0 con 0x7f3cf0065c40 2023-05-17T15:09:14.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0154570 con 0x7f3cf00bf180 2023-05-17T15:09:14.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00c14d0 con 0x7f3cf00c3880 2023-05-17T15:09:14.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 0x7f3cf01432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 0x7f3cf01432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40446/0 (socket says 172.21.15.27:40446) 2023-05-17T15:09:14.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3ceeffd700 1 -- 172.21.15.27:0/2290985548 learned_addr learned my addr 172.21.15.27:0/2290985548 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:14.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3cef7fe700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00c3880 0x7f3cf01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.135+0000 7f3cee7fc700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00bf180 0x7f3cf0150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceeffd700 1 -- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00c3880 msgr2=0x7f3cf01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceeffd700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00c3880 0x7f3cf01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceeffd700 1 -- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00bf180 msgr2=0x7f3cf0150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceeffd700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00bf180 0x7f3cf0150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceeffd700 1 -- 172.21.15.27:0/2290985548 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009370 con 0x7f3cf0065c40 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceeffd700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 0x7f3cf01432b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f3ce4009ea0 tx=0x7f3ce4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4000bc0 con 0x7f3cf0065c40 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400b850 con 0x7f3cf0065c40 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf00c0ba0 con 0x7f3cf0065c40 2023-05-17T15:09:14.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4000d20 con 0x7f3cf0065c40 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.136+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf00c1160 con 0x7f3cf0065c40 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.137+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf0047150 con 0x7f3cf0065c40 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.138+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f3ce4023020 con 0x7f3cf0065c40 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.138+0000 7f3cd6ffd700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3cdc05ede0 0x7f3cdc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.138+0000 7f3cee7fc700 1 -- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3cdc05ede0 msgr2=0x7f3cdc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.138+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f3ce407b960 con 0x7f3cf0065c40 2023-05-17T15:09:14.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.138+0000 7f3cee7fc700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3cdc05ede0 0x7f3cdc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:14.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.146+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ce404cd40 con 0x7f3cf0065c40 2023-05-17T15:09:14.154 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:14.150+0000 7fe3cafca680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:09:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.317+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3cf005e1c0 con 0x7f3cf0065c40 2023-05-17T15:09:14.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.318+0000 7f3cd6ffd700 1 -- 172.21.15.27:0/2290985548 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ce4050360 con 0x7f3cf0065c40 2023-05-17T15:09:14.322 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:09:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3cdc05ede0 msgr2=0x7f3cdc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3cdc05ede0 0x7f3cdc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 msgr2=0x7f3cf01432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 0x7f3cf01432b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f3ce4009ea0 tx=0x7f3ce4017000).stop 2023-05-17T15:09:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 shutdown_connections 2023-05-17T15:09:14.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3cdc05ede0 0x7f3cdc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cf00c3880 0x7f3cf01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf0065c40 0x7f3cf01432b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 --2- 172.21.15.27:0/2290985548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf00bf180 0x7f3cf0150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 >> 172.21.15.27:0/2290985548 conn(0x7f3cf00c9340 msgr2=0x7f3cf00a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 shutdown_connections 2023-05-17T15:09:14.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.320+0000 7f3ceffff700 1 -- 172.21.15.27:0/2290985548 wait complete. 2023-05-17T15:09:14.336 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:09:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.455+0000 7f9c59181700 1 Processor -- start 2023-05-17T15:09:14.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.455+0000 7f9c59181700 1 -- start start 2023-05-17T15:09:14.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c59181700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 0x7f9c54067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c59181700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c54066c10 0x7f9c540bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c59181700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540c1bf0 con 0x7f9c540c1790 2023-05-17T15:09:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c59181700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540678e0 con 0x7f9c54066c10 2023-05-17T15:09:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c59181700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540c3300 con 0x7f9c54150c20 2023-05-17T15:09:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 0x7f9c54067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c5359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c54066c10 0x7f9c540bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 0x7f9c54067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41564/0 (socket says 172.21.15.27:41564) 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c52d9d700 1 -- 172.21.15.27:0/2779668768 learned_addr learned my addr 172.21.15.27:0/2779668768 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.456+0000 7f9c5259c700 1 --1- 172.21.15.27:0/2779668768 >> v1:172.21.15.40:6789/0 conn(0x7f9c540c1790 0x7f9c54066500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46020/0 (socket says 172.21.15.27:46020) 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c52d9d700 1 -- 172.21.15.27:0/2779668768 >> v2:172.21.15.40:3300/0 conn(0x7f9c54066c10 msgr2=0x7f9c540bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c52d9d700 1 --2- 172.21.15.27:0/2779668768 >> v2:172.21.15.40:3300/0 conn(0x7f9c54066c10 0x7f9c540bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c52d9d700 1 -- 172.21.15.27:0/2779668768 >> v1:172.21.15.40:6789/0 conn(0x7f9c540c1790 legacy=0x7f9c54066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c52d9d700 1 -- 172.21.15.27:0/2779668768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540c35e0 con 0x7f9c54150c20 2023-05-17T15:09:14.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c51d9b700 1 -- 172.21.15.27:0/2779668768 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113738720 0 0) 0x7f9c540c1bf0 con 0x7f9c540c1790 2023-05-17T15:09:14.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c5359e700 1 --2- 172.21.15.27:0/2779668768 >> v2:172.21.15.40:3300/0 conn(0x7f9c54066c10 0x7f9c540bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:14.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c52d9d700 1 --2- 172.21.15.27:0/2779668768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 0x7f9c54067250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9c44006fd0 tx=0x7f9c440090f0).ready entity=mon.2 client_cookie=eeb4f267985ccf68 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:14.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c51d9b700 1 -- 172.21.15.27:0/2779668768 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400b580 con 0x7f9c54150c20 2023-05-17T15:09:14.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c51d9b700 1 -- 172.21.15.27:0/2779668768 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400b6e0 con 0x7f9c54150c20 2023-05-17T15:09:14.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.457+0000 7f9c51d9b700 1 -- 172.21.15.27:0/2779668768 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400ba60 con 0x7f9c54150c20 2023-05-17T15:09:14.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 -- 172.21.15.27:0/2779668768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 msgr2=0x7f9c54067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 --2- 172.21.15.27:0/2779668768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 0x7f9c54067250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9c44006fd0 tx=0x7f9c440090f0).stop 2023-05-17T15:09:14.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 -- 172.21.15.27:0/2779668768 shutdown_connections 2023-05-17T15:09:14.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 --2- 172.21.15.27:0/2779668768 >> v2:172.21.15.40:3300/0 conn(0x7f9c54066c10 0x7f9c540bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 --2- 172.21.15.27:0/2779668768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c54150c20 0x7f9c54067250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 -- 172.21.15.27:0/2779668768 >> 172.21.15.27:0/2779668768 conn(0x7f9c54063dd0 msgr2=0x7f9c54067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 -- 172.21.15.27:0/2779668768 shutdown_connections 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.458+0000 7f9c59181700 1 -- 172.21.15.27:0/2779668768 wait complete. 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.459+0000 7f9c59181700 1 Processor -- start 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.459+0000 7f9c59181700 1 -- start start 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c59181700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 0x7f9c54148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c59181700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c540c1790 0x7f9c54151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c59181700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 0x7f9c541534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c59181700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54152660 con 0x7f9c54150c20 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c59181700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541519e0 con 0x7f9c54066c10 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c59181700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54151cc0 con 0x7f9c540c1790 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c5359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 0x7f9c541534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 0x7f9c54148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c5259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c540c1790 0x7f9c54151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 0x7f9c54148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:58390/0 (socket says 172.21.15.27:58390) 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c5359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 0x7f9c541534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40464/0 (socket says 172.21.15.27:40464) 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 -- 172.21.15.27:0/3808122240 learned_addr learned my addr 172.21.15.27:0/3808122240 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 -- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c540c1790 msgr2=0x7f9c54151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c540c1790 0x7f9c54151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 -- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 msgr2=0x7f9c541534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 0x7f9c541534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 -- 172.21.15.27:0/3808122240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009a20 con 0x7f9c54066c10 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c5359e700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 0x7f9c541534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.460+0000 7f9c52d9d700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 0x7f9c54148a70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9c540c3440 tx=0x7f9c44017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.461+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44000bc0 con 0x7f9c54066c10 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.461+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400b850 con 0x7f9c54066c10 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.461+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44009370 con 0x7f9c54066c10 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.461+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44000d20 con 0x7f9c54066c10 2023-05-17T15:09:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.461+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54152280 con 0x7f9c54066c10 2023-05-17T15:09:14.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.462+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c541528d0 con 0x7f9c54066c10 2023-05-17T15:09:14.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.462+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9c4400f070 con 0x7f9c54066c10 2023-05-17T15:09:14.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.462+0000 7f9c3affd700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9c4005ede0 0x7f9c400612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.462+0000 7f9c5259c700 1 -- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9c4005ede0 msgr2=0x7f9c400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:14.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.462+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f9c4407b650 con 0x7f9c54066c10 2023-05-17T15:09:14.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.462+0000 7f9c5259c700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9c4005ede0 0x7f9c400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:14.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.466+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c4404ca30 con 0x7f9c54066c10 2023-05-17T15:09:14.540 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:14.536+0000 7fa19d044680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:09:14.598 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:14.594+0000 7fe3cafca680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:09:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.641+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c5406bdf0 con 0x7f9c54066c10 2023-05-17T15:09:14.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.642+0000 7f9c3affd700 1 -- 172.21.15.27:0/3808122240 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c44050050 con 0x7f9c54066c10 2023-05-17T15:09:14.646 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:09:14.647 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:14.644+0000 7fa19d044680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9c4005ede0 msgr2=0x7f9c400612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9c4005ede0 0x7f9c400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 msgr2=0x7f9c54148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 0x7f9c54148a70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9c540c3440 tx=0x7f9c44017000).stop 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 shutdown_connections 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9c4005ede0 0x7f9c400612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c54150c20 0x7f9c541534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c54066c10 0x7f9c54148a70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 --2- 172.21.15.27:0/3808122240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c540c1790 0x7f9c54151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 >> 172.21.15.27:0/3808122240 conn(0x7f9c54063dd0 msgr2=0x7f9c540c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 shutdown_connections 2023-05-17T15:09:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.644+0000 7f9c59181700 1 -- 172.21.15.27:0/3808122240 wait complete. 2023-05-17T15:09:14.664 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:09:14.714 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:14.710+0000 7fe3cafca680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:14.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.781+0000 7fc100c99700 1 Processor -- start 2023-05-17T15:09:14.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.782+0000 7fc100c99700 1 -- start start 2023-05-17T15:09:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc100c99700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0fc0a7e90 0x7fc0fc0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc100c99700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc0fc0c3f20 0x7fc0fc155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc100c99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc155f50 0x7fc0fc152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc100c99700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0fc0bdab0 con 0x7fc0fc0c3f20 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc100c99700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0fc1563c0 con 0x7fc0fc0a7e90 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc100c99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc156830 con 0x7fc0fc155f50 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc0f9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc0fc0c3f20 0x7fc0fc155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc0f9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc0fc0c3f20 0x7fc0fc155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40468/0 (socket says 172.21.15.27:40468) 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc0f9d9b700 1 -- 172.21.15.27:0/2679643344 learned_addr learned my addr 172.21.15.27:0/2679643344 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc0fad9d700 1 --2- 172.21.15.27:0/2679643344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc155f50 0x7fc0fc152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.783+0000 7fc0fa59c700 1 --2- 172.21.15.27:0/2679643344 >> v2:172.21.15.40:3300/0 conn(0x7fc0fc0a7e90 0x7fc0fc0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f9d9b700 1 -- 172.21.15.27:0/2679643344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc155f50 msgr2=0x7fc0fc152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f9d9b700 1 --2- 172.21.15.27:0/2679643344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc155f50 0x7fc0fc152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f9d9b700 1 -- 172.21.15.27:0/2679643344 >> v2:172.21.15.40:3300/0 conn(0x7fc0fc0a7e90 msgr2=0x7fc0fc0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f9d9b700 1 --2- 172.21.15.27:0/2679643344 >> v2:172.21.15.40:3300/0 conn(0x7fc0fc0a7e90 0x7fc0fc0c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f9d9b700 1 -- 172.21.15.27:0/2679643344 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc065e90 con 0x7fc0fc0c3f20 2023-05-17T15:09:14.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f9d9b700 1 --2- 172.21.15.27:0/2679643344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc0c3f20 0x7fc0fc155a60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fc0fc063a50 tx=0x7fc0f00090f0).ready entity=mon.0 client_cookie=e9a12af00192fb28 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:14.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f959a700 1 -- 172.21.15.27:0/2679643344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000f510 con 0x7fc0fc0c3f20 2023-05-17T15:09:14.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f959a700 1 -- 172.21.15.27:0/2679643344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000f670 con 0x7fc0fc0c3f20 2023-05-17T15:09:14.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.784+0000 7fc0f959a700 1 -- 172.21.15.27:0/2679643344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000f9f0 con 0x7fc0fc0c3f20 2023-05-17T15:09:14.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 -- 172.21.15.27:0/2679643344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc0c3f20 msgr2=0x7fc0fc155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 --2- 172.21.15.27:0/2679643344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc0c3f20 0x7fc0fc155a60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fc0fc063a50 tx=0x7fc0f00090f0).stop 2023-05-17T15:09:14.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 -- 172.21.15.27:0/2679643344 shutdown_connections 2023-05-17T15:09:14.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 --2- 172.21.15.27:0/2679643344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc155f50 0x7fc0fc152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 --2- 172.21.15.27:0/2679643344 >> v2:172.21.15.40:3300/0 conn(0x7fc0fc0a7e90 0x7fc0fc0c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 --2- 172.21.15.27:0/2679643344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc0c3f20 0x7fc0fc155a60 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 -- 172.21.15.27:0/2679643344 >> 172.21.15.27:0/2679643344 conn(0x7fc0fc0c94b0 msgr2=0x7fc0fc0c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 -- 172.21.15.27:0/2679643344 shutdown_connections 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.785+0000 7fc100c99700 1 -- 172.21.15.27:0/2679643344 wait complete. 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.786+0000 7fc100c99700 1 Processor -- start 2023-05-17T15:09:14.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.786+0000 7fc100c99700 1 -- start start 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc100c99700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0fc0a7e90 0x7fc0fc0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc100c99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc0c3f20 0x7fc0fc0ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc100c99700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 0x7fc0fc13f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc100c99700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0ad9e0 con 0x7fc0fc155f50 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc100c99700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0bfd60 con 0x7fc0fc0a7e90 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc100c99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0ace90 con 0x7fc0fc0c3f20 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 0x7fc0fc13f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 0x7fc0fc13f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40478/0 (socket says 172.21.15.27:40478) 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 -- 172.21.15.27:0/3768496731 learned_addr learned my addr 172.21.15.27:0/3768496731 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0f9d9b700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc0c3f20 0x7fc0fc0ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fa59c700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0fc0a7e90 0x7fc0fc0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 -- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc0c3f20 msgr2=0x7fc0fc0ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc0c3f20 0x7fc0fc0ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 -- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0fc0a7e90 msgr2=0x7fc0fc0ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0fc0a7e90 0x7fc0fc0ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 -- 172.21.15.27:0/3768496731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0009370 con 0x7fc0fc155f50 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.787+0000 7fc0fad9d700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 0x7fc0fc13f530 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fc0f4009df0 tx=0x7fc0f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.788+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400caa0 con 0x7fc0fc155f50 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.788+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400f040 con 0x7fc0fc155f50 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.788+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc0ad140 con 0x7fc0fc155f50 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.788+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400ce10 con 0x7fc0fc155f50 2023-05-17T15:09:14.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.788+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc0ad700 con 0x7fc0fc155f50 2023-05-17T15:09:14.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.789+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc0bfac0 con 0x7fc0fc155f50 2023-05-17T15:09:14.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.790+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc0f4013610 con 0x7fc0fc155f50 2023-05-17T15:09:14.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.790+0000 7fc0ea7fc700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc0dc05ede0 0x7fc0dc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:14.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.790+0000 7fc0fa59c700 1 -- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc0dc05ede0 msgr2=0x7fc0dc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:14.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.790+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fc0f407afe0 con 0x7fc0fc155f50 2023-05-17T15:09:14.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.790+0000 7fc0fa59c700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc0dc05ede0 0x7fc0dc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:14.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.794+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0f404c2d0 con 0x7fc0fc155f50 2023-05-17T15:09:14.806 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:14.802+0000 7fa19d044680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:14.876 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:14.873+0000 7fe3cafca680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:14.883 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:14.880+0000 7fa19d044680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:09:14.953 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:14.949+0000 7fa19d044680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:09:14.954 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:14.950+0000 7fe3cafca680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:09:14.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.973+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0fc0bfac0 con 0x7fc0fc155f50 2023-05-17T15:09:14.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.973+0000 7fc0ea7fc700 1 -- 172.21.15.27:0/3768496731 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0fc0bfac0 con 0x7fc0fc155f50 2023-05-17T15:09:14.977 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:09:14.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc0dc05ede0 msgr2=0x7fc0dc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:14.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc0dc05ede0 0x7fc0dc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 msgr2=0x7fc0fc13f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:14.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 0x7fc0fc13f530 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fc0f4009df0 tx=0x7fc0f400b040).stop 2023-05-17T15:09:14.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 shutdown_connections 2023-05-17T15:09:14.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc0dc05ede0 0x7fc0dc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:14.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc0fc155f50 0x7fc0fc13f530 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0fc0a7e90 0x7fc0fc0ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 --2- 172.21.15.27:0/3768496731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0fc0c3f20 0x7fc0fc0ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:14.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 >> 172.21.15.27:0/3768496731 conn(0x7fc0fc0c94b0 msgr2=0x7fc0fc14e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:14.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.975+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 shutdown_connections 2023-05-17T15:09:14.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:14.976+0000 7fc100c99700 1 -- 172.21.15.27:0/3768496731 wait complete. 2023-05-17T15:09:14.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:15.026 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:15.023+0000 7fe3cafca680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:09:15.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.105+0000 7effc1f76700 1 Processor -- start 2023-05-17T15:09:15.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.105+0000 7effc1f76700 1 -- start start 2023-05-17T15:09:15.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effc1f76700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7effbc0c5f30 0x7effbc0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effc1f76700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effbc158880 0x7effbc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effc1f76700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0bfcd0 con 0x7effbc1541c0 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effc1f76700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0c0290 con 0x7effbc0c5f30 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effc1f76700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0aa1a0 con 0x7effbc158880 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7effbc0c5f30 0x7effbc0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbbfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7effbc1541c0 0x7effbc0c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40048/0 (socket says 172.21.15.27:40048) 2023-05-17T15:09:15.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7effbc0c5f30 0x7effbc0c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40482/0 (socket says 172.21.15.27:40482) 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbbfff700 1 -- 172.21.15.27:0/2916075582 learned_addr learned my addr 172.21.15.27:0/2916075582 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbaffd700 1 --2- 172.21.15.27:0/2916075582 >> v2:172.21.15.40:3300/0 conn(0x7effbc158880 0x7effbc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 -- 172.21.15.27:0/2916075582 >> v2:172.21.15.40:3300/0 conn(0x7effbc158880 msgr2=0x7effbc153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 --2- 172.21.15.27:0/2916075582 >> v2:172.21.15.40:3300/0 conn(0x7effbc158880 0x7effbc153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 -- 172.21.15.27:0/2916075582 >> v1:172.21.15.27:6789/0 conn(0x7effbc1541c0 legacy=0x7effbc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effba7fc700 1 -- 172.21.15.27:0/2916075582 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826512185 0 0) 0x7effbc0bfcd0 con 0x7effbc1541c0 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 -- 172.21.15.27:0/2916075582 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0aa480 con 0x7effbc0c5f30 2023-05-17T15:09:15.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbaffd700 1 --2- 172.21.15.27:0/2916075582 >> v2:172.21.15.40:3300/0 conn(0x7effbc158880 0x7effbc153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effbb7fe700 1 --2- 172.21.15.27:0/2916075582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc0c5f30 0x7effbc0c6310 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7effbc0c57b0 tx=0x7effb4009060).ready entity=mon.0 client_cookie=5f0a3ce0b61e2420 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effba7fc700 1 -- 172.21.15.27:0/2916075582 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400b580 con 0x7effbc0c5f30 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.106+0000 7effba7fc700 1 -- 172.21.15.27:0/2916075582 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400b6e0 con 0x7effbc0c5f30 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effba7fc700 1 -- 172.21.15.27:0/2916075582 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400ba60 con 0x7effbc0c5f30 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 -- 172.21.15.27:0/2916075582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc0c5f30 msgr2=0x7effbc0c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 --2- 172.21.15.27:0/2916075582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc0c5f30 0x7effbc0c6310 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7effbc0c57b0 tx=0x7effb4009060).stop 2023-05-17T15:09:15.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 -- 172.21.15.27:0/2916075582 shutdown_connections 2023-05-17T15:09:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 --2- 172.21.15.27:0/2916075582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc0c5f30 0x7effbc0c6310 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 --2- 172.21.15.27:0/2916075582 >> v2:172.21.15.40:3300/0 conn(0x7effbc158880 0x7effbc153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 -- 172.21.15.27:0/2916075582 >> 172.21.15.27:0/2916075582 conn(0x7effbc069e70 msgr2=0x7effbc05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 -- 172.21.15.27:0/2916075582 shutdown_connections 2023-05-17T15:09:15.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.107+0000 7effc1f76700 1 -- 172.21.15.27:0/2916075582 wait complete. 2023-05-17T15:09:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.108+0000 7effc1f76700 1 Processor -- start 2023-05-17T15:09:15.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.108+0000 7effc1f76700 1 -- start start 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effc1f76700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effbc0c5f30 0x7effbc1448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effc1f76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effbc1541c0 0x7effbc157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effc1f76700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 0x7effbc157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effc1f76700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc157e40 con 0x7effbc158880 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effc1f76700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc165b20 con 0x7effbc0c5f30 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effc1f76700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc144d90 con 0x7effbc1541c0 2023-05-17T15:09:15.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effbbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 0x7effbc157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effbc0c5f30 0x7effbc1448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effbbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 0x7effbc157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40492/0 (socket says 172.21.15.27:40492) 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effbbfff700 1 -- 172.21.15.27:0/3516153275 learned_addr learned my addr 172.21.15.27:0/3516153275 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.109+0000 7effbaffd700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effbc1541c0 0x7effbc157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effbbfff700 1 -- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effbc1541c0 msgr2=0x7effbc157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effbbfff700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effbc1541c0 0x7effbc157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effbbfff700 1 -- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effbc0c5f30 msgr2=0x7effbc1448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effbbfff700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effbc0c5f30 0x7effbc1448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effbbfff700 1 -- 172.21.15.27:0/3516153275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40092a0 con 0x7effbc158880 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effbbfff700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 0x7effbc157950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7effac00c4c0 tx=0x7effac007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0070d0 con 0x7effbc158880 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac007230 con 0x7effbc158880 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0c3cf0 con 0x7effbc158880 2023-05-17T15:09:15.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0075b0 con 0x7effbc158880 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.110+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0c42b0 con 0x7effbc158880 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.111+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc165cd0 con 0x7effbc158880 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.111+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7effac01a060 con 0x7effbc158880 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.112+0000 7effb37fe700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 0x7eff9c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.112+0000 7effbb7fe700 1 -- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 msgr2=0x7eff9c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.112+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7effac079360 con 0x7effbc158880 2023-05-17T15:09:15.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.112+0000 7effbb7fe700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 0x7eff9c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:15.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.116+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7effbc165cd0 con 0x7effbc158880 2023-05-17T15:09:15.223 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:15.220+0000 7fa19d044680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:09:15.301 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:15.297+0000 7fe3cafca680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:09:15.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.313+0000 7effbb7fe700 1 -- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 msgr2=0x7eff9c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:15.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.313+0000 7effbb7fe700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 0x7eff9c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:15.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.333+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effbc165cd0 con 0x7effbc158880 2023-05-17T15:09:15.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.334+0000 7effb37fe700 1 -- 172.21.15.27:0/3516153275 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4488 (secure 0 0 0) 0x7effbc165cd0 con 0x7effbc158880 2023-05-17T15:09:15.339 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:15.339 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:54.627419+0000","modified":"2023-05-17T15:08:56.658238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6654":{"gid":6654,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2158310427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2158310427},{"type":"v1","addr":"172.21.15.27:6835","nonce":2158310427}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-17T15:09:15.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 msgr2=0x7eff9c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:15.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 0x7eff9c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:15.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 msgr2=0x7effbc157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 0x7effbc157950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7effac00c4c0 tx=0x7effac007c10).stop 2023-05-17T15:09:15.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 shutdown_connections 2023-05-17T15:09:15.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7eff9c05ede0 0x7eff9c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:15.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effbc158880 0x7effbc157950 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effbc0c5f30 0x7effbc1448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 --2- 172.21.15.27:0/3516153275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effbc1541c0 0x7effbc157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 >> 172.21.15.27:0/3516153275 conn(0x7effbc069e70 msgr2=0x7effbc0aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:15.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 shutdown_connections 2023-05-17T15:09:15.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.336+0000 7effc1f76700 1 -- 172.21.15.27:0/3516153275 wait complete. 2023-05-17T15:09:15.344 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2023-05-17T15:09:15.352 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:15.412 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:15.408+0000 7fa19d044680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:15.494 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:15.490+0000 7fe3cafca680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.509+0000 7fc4a7fff700 1 Processor -- start 2023-05-17T15:09:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.509+0000 7fc4a7fff700 1 -- start start 2023-05-17T15:09:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 0x7fc4a80a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4a80aa070 0x7fc4a80c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a7fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a81549b0 con 0x7fc4a80c1180 2023-05-17T15:09:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a7fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a8154c90 con 0x7fc4a80aa070 2023-05-17T15:09:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8154f70 con 0x7fc4a81544f0 2023-05-17T15:09:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a67fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 0x7fc4a80a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc4a80c1180 0x7fc4a80c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46062/0 (socket says 172.21.15.27:46062) 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4a80aa070 0x7fc4a80c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a67fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 0x7fc4a80a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41610/0 (socket says 172.21.15.27:41610) 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a6ffd700 1 -- 172.21.15.27:0/1685888473 learned_addr learned my addr 172.21.15.27:0/1685888473 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a5ffb700 1 -- 172.21.15.27:0/1685888473 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142005018 0 0) 0x7fc4a81549b0 con 0x7fc4a80c1180 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a5ffb700 1 -- 172.21.15.27:0/1685888473 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4940033f0 con 0x7fc4a80c1180 2023-05-17T15:09:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a77fe700 1 -- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 msgr2=0x7fc4a80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a77fe700 1 --2- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 0x7fc4a80a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.510+0000 7fc4a77fe700 1 -- 172.21.15.27:0/1685888473 >> v1:172.21.15.40:6789/0 conn(0x7fc4a80c1180 legacy=0x7fc4a80c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a77fe700 1 -- 172.21.15.27:0/1685888473 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a8155250 con 0x7fc4a80aa070 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a67fc700 1 --2- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 0x7fc4a80a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a77fe700 1 --2- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a80aa070 0x7fc4a80c74a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fc4a0009e60 tx=0x7fc4a0009780).ready entity=mon.1 client_cookie=2d7271b0b342e06f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a5ffb700 1 -- 172.21.15.27:0/1685888473 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000e070 con 0x7fc4a80aa070 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a5ffb700 1 -- 172.21.15.27:0/1685888473 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a000bab0 con 0x7fc4a80aa070 2023-05-17T15:09:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a5ffb700 1 -- 172.21.15.27:0/1685888473 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000be30 con 0x7fc4a80aa070 2023-05-17T15:09:15.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a80aa070 msgr2=0x7fc4a80c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a80aa070 0x7fc4a80c74a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fc4a0009e60 tx=0x7fc4a0009780).stop 2023-05-17T15:09:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1685888473 shutdown_connections 2023-05-17T15:09:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a80aa070 0x7fc4a80c74a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1685888473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a81544f0 0x7fc4a80a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1685888473 >> 172.21.15.27:0/1685888473 conn(0x7fc4a805dd50 msgr2=0x7fc4a805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1685888473 shutdown_connections 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.511+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1685888473 wait complete. 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 Processor -- start 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 -- start start 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 0x7fc4a8148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a80c1180 0x7fc4a8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a81544f0 0x7fc4a8158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8158b40 con 0x7fc4a80aa070 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80c26a0 con 0x7fc4a81544f0 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.513+0000 7fc4a7fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80c2980 con 0x7fc4a80c1180 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 0x7fc4a8148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 0x7fc4a8148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40504/0 (socket says 172.21.15.27:40504) 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a81544f0 0x7fc4a8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 -- 172.21.15.27:0/1200962225 learned_addr learned my addr 172.21.15.27:0/1200962225 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:15.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a67fc700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a80c1180 0x7fc4a8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 -- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a80c1180 msgr2=0x7fc4a8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a80c1180 0x7fc4a8158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 -- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a81544f0 msgr2=0x7fc4a8158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a81544f0 0x7fc4a8158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 -- 172.21.15.27:0/1200962225 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980092a0 con 0x7fc4a80aa070 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a6ffd700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 0x7fc4a8148b90 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fc49000c590 tx=0x7fc490007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4900072e0 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc490007440 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a0009a20 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4900057a0 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.514+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a80c2f40 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.515+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a806bdf0 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.516+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc490010070 con 0x7fc4a80aa070 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.516+0000 7fc49effd700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc48805ede0 0x7fc4880612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.516+0000 7fc4a67fc700 1 -- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc48805ede0 msgr2=0x7fc4880612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.516+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fc4900793f0 con 0x7fc4a80aa070 2023-05-17T15:09:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.516+0000 7fc4a67fc700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc48805ede0 0x7fc4880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.520+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc49004a7d0 con 0x7fc4a80aa070 2023-05-17T15:09:15.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.695+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4a8149480 con 0x7fc4a80aa070 2023-05-17T15:09:15.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.695+0000 7fc49effd700 1 -- 172.21.15.27:0/1200962225 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+17287 (secure 0 0 0) 0x7fc49004ddf0 con 0x7fc4a80aa070 2023-05-17T15:09:15.699 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:15.700 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":98,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:10.363584+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:53.174505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:53.590665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3028931537":"2023-05-18T15:09:10.363556+0000","172.21.15.27:0/275166806":"2023-05-18T15:09:10.363556+0000","172.21.15.27:6837/86332":"2023-05-18T15:09:10.363556+0000","172.21.15.27:6836/86332":"2023-05-18T15:09:10.363556+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc48805ede0 msgr2=0x7fc4880612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc48805ede0 0x7fc4880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 msgr2=0x7fc4a8148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 0x7fc4a8148b90 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fc49000c590 tx=0x7fc490007c80).stop 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 shutdown_connections 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc48805ede0 0x7fc4880612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4a81544f0 0x7fc4a8158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4a80aa070 0x7fc4a8148b90 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 --2- 172.21.15.27:0/1200962225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4a80c1180 0x7fc4a8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 >> 172.21.15.27:0/1200962225 conn(0x7fc4a805dd50 msgr2=0x7fc4a80ac2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:15.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 shutdown_connections 2023-05-17T15:09:15.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.697+0000 7fc4a7fff700 1 -- 172.21.15.27:0/1200962225 wait complete. 2023-05-17T15:09:15.714 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:09:15.715 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:15.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 Processor -- start 2023-05-17T15:09:15.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 -- start start 2023-05-17T15:09:15.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc00c5f30 0x7f1bc00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1bc0158880 0x7f1bc0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1bc01541c0 0x7f1bc00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00bfcd0 con 0x7f1bc0158880 2023-05-17T15:09:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00c0290 con 0x7f1bc01541c0 2023-05-17T15:09:15.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.828+0000 7f1bc574e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00aa1a0 con 0x7f1bc00c5f30 2023-05-17T15:09:15.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1bc0158880 0x7f1bc0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1bc0158880 0x7f1bc0153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40532/0 (socket says 172.21.15.27:40532) 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/601125645 learned_addr learned my addr 172.21.15.27:0/601125645 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbf7fe700 1 --2- 172.21.15.27:0/601125645 >> v2:172.21.15.40:3300/0 conn(0x7f1bc01541c0 0x7f1bc00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbeffd700 1 --2- 172.21.15.27:0/601125645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc00c5f30 0x7f1bc00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/601125645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc00c5f30 msgr2=0x7f1bc00c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 --2- 172.21.15.27:0/601125645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc00c5f30 0x7f1bc00c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/601125645 >> v2:172.21.15.40:3300/0 conn(0x7f1bc01541c0 msgr2=0x7f1bc00c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:15.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 --2- 172.21.15.27:0/601125645 >> v2:172.21.15.40:3300/0 conn(0x7f1bc01541c0 0x7f1bc00c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/601125645 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00aa480 con 0x7f1bc0158880 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbe7fc700 1 --2- 172.21.15.27:0/601125645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc0158880 0x7f1bc0153cd0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f1bc00c6830 tx=0x7f1bb40090f0).ready entity=mon.0 client_cookie=ff159efc4c9f0247 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbdffb700 1 -- 172.21.15.27:0/601125645 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400f510 con 0x7f1bc0158880 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbdffb700 1 -- 172.21.15.27:0/601125645 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb400f670 con 0x7f1bc0158880 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.829+0000 7f1bbdffb700 1 -- 172.21.15.27:0/601125645 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400fa10 con 0x7f1bc0158880 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 -- 172.21.15.27:0/601125645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc0158880 msgr2=0x7f1bc0153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 --2- 172.21.15.27:0/601125645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc0158880 0x7f1bc0153cd0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f1bc00c6830 tx=0x7f1bb40090f0).stop 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 -- 172.21.15.27:0/601125645 shutdown_connections 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 --2- 172.21.15.27:0/601125645 >> v2:172.21.15.40:3300/0 conn(0x7f1bc01541c0 0x7f1bc00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 --2- 172.21.15.27:0/601125645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc00c5f30 0x7f1bc00c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 --2- 172.21.15.27:0/601125645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc0158880 0x7f1bc0153cd0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 -- 172.21.15.27:0/601125645 >> 172.21.15.27:0/601125645 conn(0x7f1bc0069e70 msgr2=0x7f1bc005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 -- 172.21.15.27:0/601125645 shutdown_connections 2023-05-17T15:09:15.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.830+0000 7f1bc574e700 1 -- 172.21.15.27:0/601125645 wait complete. 2023-05-17T15:09:15.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.831+0000 7f1bc574e700 1 Processor -- start 2023-05-17T15:09:15.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.831+0000 7f1bc574e700 1 -- start start 2023-05-17T15:09:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bc574e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc00c5f30 0x7f1bc014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bc574e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 0x7f1bc00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bc574e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc0158880 0x7f1bc00b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bc574e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0157520 con 0x7f1bc01541c0 2023-05-17T15:09:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bc574e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00b09b0 con 0x7f1bc00c5f30 2023-05-17T15:09:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bc574e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc014ce40 con 0x7f1bc0158880 2023-05-17T15:09:15.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 0x7f1bc00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 0x7f1bc00affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40540/0 (socket says 172.21.15.27:40540) 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/340830396 learned_addr learned my addr 172.21.15.27:0/340830396 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbeffd700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc00c5f30 0x7f1bc014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbf7fe700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc0158880 0x7f1bc00b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc0158880 msgr2=0x7f1bc00b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc0158880 0x7f1bc00b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc00c5f30 msgr2=0x7f1bc014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.832+0000 7f1bbe7fc700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc00c5f30 0x7f1bc014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1bbe7fc700 1 -- 172.21.15.27:0/340830396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb4009370 con 0x7f1bc01541c0 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1bbe7fc700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 0x7f1bc00affd0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f1bc0083770 tx=0x7f1bb4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4006d90 con 0x7f1bc01541c0 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4000bc0 con 0x7f1bc01541c0 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400f7e0 con 0x7f1bc01541c0 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc0150fb0 con 0x7f1bc01541c0 2023-05-17T15:09:15.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.833+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0151570 con 0x7f1bc01541c0 2023-05-17T15:09:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.834+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc005f4a0 con 0x7f1bc01541c0 2023-05-17T15:09:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.834+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1bb402c070 con 0x7f1bc01541c0 2023-05-17T15:09:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.835+0000 7f1ba6ffd700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 0x7f1bac0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.835+0000 7f1bbeffd700 1 -- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 msgr2=0x7f1bac0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.835+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f1bb407b5a0 con 0x7f1bc01541c0 2023-05-17T15:09:15.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.835+0000 7f1bbeffd700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 0x7f1bac0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:15.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:15.839+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1bb404c980 con 0x7f1bc01541c0 2023-05-17T15:09:16.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.036+0000 7f1bbeffd700 1 -- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 msgr2=0x7f1bac0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:16.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.036+0000 7f1bbeffd700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 0x7f1bac0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:16.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.058+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bc006bdf0 con 0x7f1bc01541c0 2023-05-17T15:09:16.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.059+0000 7f1ba6ffd700 1 -- 172.21.15.27:0/340830396 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f1bb402a070 con 0x7f1bc01541c0 2023-05-17T15:09:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:16.063 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:54.627419+0000","modified":"2023-05-17T15:08:56.658238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6654":{"gid":6654,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2158310427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2158310427},{"type":"v1","addr":"172.21.15.27:6835","nonce":2158310427}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-17T15:09:16.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 msgr2=0x7f1bac0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:16.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 0x7f1bac0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:16.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 msgr2=0x7f1bc00affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 0x7f1bc00affd0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f1bc0083770 tx=0x7f1bb4017000).stop 2023-05-17T15:09:16.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 shutdown_connections 2023-05-17T15:09:16.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bac05ede0 0x7f1bac0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:16.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc0158880 0x7f1bc00b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc00c5f30 0x7f1bc014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 --2- 172.21.15.27:0/340830396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bc01541c0 0x7f1bc00affd0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 >> 172.21.15.27:0/340830396 conn(0x7f1bc0069e70 msgr2=0x7f1bc0153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:16.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 shutdown_connections 2023-05-17T15:09:16.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.061+0000 7f1bc574e700 1 -- 172.21.15.27:0/340830396 wait complete. 2023-05-17T15:09:16.066 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2023-05-17T15:09:16.078 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:16.089 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.085+0000 7fa19d044680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:09:16.159 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.156+0000 7fa19d044680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:09:16.194 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.191+0000 7fe3cafca680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:09:16.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.193+0000 7f922c0c6700 1 Processor -- start 2023-05-17T15:09:16.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.193+0000 7f922c0c6700 1 -- start start 2023-05-17T15:09:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.194+0000 7f922c0c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224153f80 0x7f9224154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.194+0000 7f922c0c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9224066a60 0x7f92240c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.194+0000 7f922c0c6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92240bd5a0 con 0x7f92240bd120 2023-05-17T15:09:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.194+0000 7f922c0c6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240c2430 con 0x7f9224066a60 2023-05-17T15:09:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.194+0000 7f922c0c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92240c36c0 con 0x7f9224153f80 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9229e62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224153f80 0x7f9224154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9229661700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92240bd120 0x7f9224066350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46114/0 (socket says 172.21.15.27:46114) 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f922a663700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9224066a60 0x7f92240c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9229661700 1 -- 172.21.15.27:0/990254710 learned_addr learned my addr 172.21.15.27:0/990254710 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9228e60700 1 -- 172.21.15.27:0/990254710 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998704410 0 0) 0x7f9214001110 con 0x7f92240bd120 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9228e60700 1 -- 172.21.15.27:0/990254710 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92100033f0 con 0x7f92240bd120 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f922a663700 1 -- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224153f80 msgr2=0x7f9224154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:16.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f922a663700 1 --2- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224153f80 0x7f9224154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f922a663700 1 -- 172.21.15.27:0/990254710 >> v1:172.21.15.40:6789/0 conn(0x7f92240bd120 legacy=0x7f9224066350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f922a663700 1 -- 172.21.15.27:0/990254710 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240c3230 con 0x7f9224066a60 2023-05-17T15:09:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f922a663700 1 --2- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224066a60 0x7f92240c1f40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f921c009e90 tx=0x7f921c009780).ready entity=mon.1 client_cookie=dbe5a0dc11b4c74a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9228e60700 1 -- 172.21.15.27:0/990254710 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00e070 con 0x7f9224066a60 2023-05-17T15:09:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9228e60700 1 -- 172.21.15.27:0/990254710 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c00ba70 con 0x7f9224066a60 2023-05-17T15:09:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.195+0000 7f9228e60700 1 -- 172.21.15.27:0/990254710 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00bdf0 con 0x7f9224066a60 2023-05-17T15:09:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 -- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224066a60 msgr2=0x7f92240c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 --2- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224066a60 0x7f92240c1f40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f921c009e90 tx=0x7f921c009780).stop 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 -- 172.21.15.27:0/990254710 shutdown_connections 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 --2- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224066a60 0x7f92240c1f40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 --2- 172.21.15.27:0/990254710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224153f80 0x7f9224154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 -- 172.21.15.27:0/990254710 >> 172.21.15.27:0/990254710 conn(0x7f9224068750 msgr2=0x7f92240c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 -- 172.21.15.27:0/990254710 shutdown_connections 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.196+0000 7f922c0c6700 1 -- 172.21.15.27:0/990254710 wait complete. 2023-05-17T15:09:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.197+0000 7f922c0c6700 1 Processor -- start 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.197+0000 7f922c0c6700 1 -- start start 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922c0c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224066a60 0x7f92240a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922c0c6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 0x7f92240a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922c0c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224153f80 0x7f9224165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922c0c6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92240a6080 con 0x7f92240bd120 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922c0c6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9224164640 con 0x7f9224153f80 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922c0c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9224164bf0 con 0x7f9224066a60 2023-05-17T15:09:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f9229661700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 0x7f92240a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f9229661700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 0x7f92240a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40556/0 (socket says 172.21.15.27:40556) 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f9229661700 1 -- 172.21.15.27:0/1917790189 learned_addr learned my addr 172.21.15.27:0/1917790189 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224153f80 0x7f9224165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f9229e62700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224066a60 0x7f92240a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 -- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224066a60 msgr2=0x7f92240a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224066a60 0x7f92240a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 -- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 msgr2=0x7f92240a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 0x7f92240a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 -- 172.21.15.27:0/1917790189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c009a20 con 0x7f9224153f80 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f9229661700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 0x7f92240a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f9229e62700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224066a60 0x7f92240a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.198+0000 7f922a663700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224153f80 0x7f9224165080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f92240c4ea0 tx=0x7f921c009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.199+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c01d630 con 0x7f9224153f80 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.199+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c01d790 con 0x7f9224153f80 2023-05-17T15:09:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.199+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92240a5ac0 con 0x7f9224153f80 2023-05-17T15:09:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.199+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c01db50 con 0x7f9224153f80 2023-05-17T15:09:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.199+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9224164880 con 0x7f9224153f80 2023-05-17T15:09:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.200+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922406bdf0 con 0x7f9224153f80 2023-05-17T15:09:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.200+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f921c0083a0 con 0x7f9224153f80 2023-05-17T15:09:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.200+0000 7f9219ffb700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 0x7f9208061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.201+0000 7f9229e62700 1 -- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 msgr2=0x7f9208061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.201+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f921c07be00 con 0x7f9224153f80 2023-05-17T15:09:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.201+0000 7f9229e62700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 0x7f9208061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.205+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f921c04d160 con 0x7f9224153f80 2023-05-17T15:09:16.237 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.233+0000 7fa19d044680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:09:16.268 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.265+0000 7fe3cafca680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:09:16.346 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.343+0000 7fe3cafca680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:09:16.387 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.384+0000 7fa19d044680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:09:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.402+0000 7f9229e62700 1 -- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 msgr2=0x7f9208061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.402+0000 7f9229e62700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 0x7f9208061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:16.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.424+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92240c7a10 con 0x7f9224153f80 2023-05-17T15:09:16.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.425+0000 7f9219ffb700 1 -- 172.21.15.27:0/1917790189 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f921c050780 con 0x7f9224153f80 2023-05-17T15:09:16.429 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:16.429 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:08:54.627419+0000","modified":"2023-05-17T15:08:56.658238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6654":{"gid":6654,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2158310427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2158310427},{"type":"v1","addr":"172.21.15.27:6835","nonce":2158310427}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-17T15:09:16.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 msgr2=0x7f9208061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:16.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 0x7f9208061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:16.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224153f80 msgr2=0x7f9224165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224153f80 0x7f9224165080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f92240c4ea0 tx=0x7f921c009780).stop 2023-05-17T15:09:16.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 shutdown_connections 2023-05-17T15:09:16.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f920805edb0 0x7f9208061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:16.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9224153f80 0x7f9224165080 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9224066a60 0x7f92240a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 --2- 172.21.15.27:0/1917790189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92240bd120 0x7f92240a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 >> 172.21.15.27:0/1917790189 conn(0x7f9224068750 msgr2=0x7f9224150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:16.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 shutdown_connections 2023-05-17T15:09:16.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.427+0000 7f922c0c6700 1 -- 172.21.15.27:0/1917790189 wait complete. 2023-05-17T15:09:16.433 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2023-05-17T15:09:16.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:16.460 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.456+0000 7fa19d044680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:09:16.502 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.498+0000 7fe3cafca680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:09:16.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.557+0000 7f85da8ca700 1 Processor -- start 2023-05-17T15:09:16.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.557+0000 7f85da8ca700 1 -- start start 2023-05-17T15:09:16.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85da8ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 0x7f85d4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85da8ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85d41541c0 0x7f85d40c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85da8ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40bfcd0 con 0x7f85d40c5f30 2023-05-17T15:09:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85da8ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d40c0290 con 0x7f85d41541c0 2023-05-17T15:09:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85da8ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40aa1a0 con 0x7f85d40c6310 2023-05-17T15:09:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85d37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 0x7f85d4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85d8e67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85d41541c0 0x7f85d40c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85d3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f85d40c5f30 0x7f85d4158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46128/0 (socket says 172.21.15.27:46128) 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85d37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 0x7f85d4153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41674/0 (socket says 172.21.15.27:41674) 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85d8e67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85d41541c0 0x7f85d40c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:58498/0 (socket says 172.21.15.27:58498) 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.558+0000 7f85d3fff700 1 -- 172.21.15.27:0/4137120722 learned_addr learned my addr 172.21.15.27:0/4137120722 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d2ffd700 1 -- 172.21.15.27:0/4137120722 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806142254 0 0) 0x7f85d40bfcd0 con 0x7f85d40c5f30 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d2ffd700 1 -- 172.21.15.27:0/4137120722 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85bc0033f0 con 0x7f85d40c5f30 2023-05-17T15:09:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d8e67700 1 -- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 msgr2=0x7f85d4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d8e67700 1 --2- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 0x7f85d4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d8e67700 1 -- 172.21.15.27:0/4137120722 >> v1:172.21.15.40:6789/0 conn(0x7f85d40c5f30 legacy=0x7f85d4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d8e67700 1 -- 172.21.15.27:0/4137120722 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40aa480 con 0x7f85d41541c0 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d37fe700 1 --2- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 0x7f85d4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d8e67700 1 --2- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d41541c0 0x7f85d40c0720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f85cc009e60 tx=0x7f85cc009780).ready entity=mon.1 client_cookie=e29a6715036545a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d2ffd700 1 -- 172.21.15.27:0/4137120722 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00e070 con 0x7f85d41541c0 2023-05-17T15:09:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d2ffd700 1 -- 172.21.15.27:0/4137120722 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00bab0 con 0x7f85d41541c0 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.559+0000 7f85d2ffd700 1 -- 172.21.15.27:0/4137120722 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00be30 con 0x7f85d41541c0 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 -- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d41541c0 msgr2=0x7f85d40c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 --2- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d41541c0 0x7f85d40c0720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f85cc009e60 tx=0x7f85cc009780).stop 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 -- 172.21.15.27:0/4137120722 shutdown_connections 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 --2- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d41541c0 0x7f85d40c0720 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 --2- 172.21.15.27:0/4137120722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c6310 0x7f85d4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 -- 172.21.15.27:0/4137120722 >> 172.21.15.27:0/4137120722 conn(0x7f85d4069e70 msgr2=0x7f85d405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:16.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 -- 172.21.15.27:0/4137120722 shutdown_connections 2023-05-17T15:09:16.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.560+0000 7f85da8ca700 1 -- 172.21.15.27:0/4137120722 wait complete. 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.561+0000 7f85da8ca700 1 Processor -- start 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.561+0000 7f85da8ca700 1 -- start start 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85da8ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c5f30 0x7f85d414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85da8ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d40c6310 0x7f85d40c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85da8ca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 0x7f85d40c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85da8ca700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41536f0 con 0x7f85d41541c0 2023-05-17T15:09:16.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85da8ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4156030 con 0x7f85d40c6310 2023-05-17T15:09:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85da8ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4155d30 con 0x7f85d40c5f30 2023-05-17T15:09:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d8e67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 0x7f85d40c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d40c6310 0x7f85d40c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d8e67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 0x7f85d40c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40574/0 (socket says 172.21.15.27:40574) 2023-05-17T15:09:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d8e67700 1 -- 172.21.15.27:0/2183718871 learned_addr learned my addr 172.21.15.27:0/2183718871 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d3fff700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c5f30 0x7f85d414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d37fe700 1 -- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c5f30 msgr2=0x7f85d414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d37fe700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c5f30 0x7f85d414ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d37fe700 1 -- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 msgr2=0x7f85d40c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d37fe700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 0x7f85d40c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d37fe700 1 -- 172.21.15.27:0/2183718871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40092a0 con 0x7f85d40c6310 2023-05-17T15:09:16.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d8e67700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 0x7f85d40c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.562+0000 7f85d3fff700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c5f30 0x7f85d414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.563+0000 7f85d37fe700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d40c6310 0x7f85d40c37b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f85c400e9b0 tx=0x7f85c4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.563+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4012600 con 0x7f85d40c6310 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.563+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4012760 con 0x7f85d40c6310 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.563+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc009a20 con 0x7f85d40c6310 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.563+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4012ae0 con 0x7f85d40c6310 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.563+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d40c4640 con 0x7f85d40c6310 2023-05-17T15:09:16.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.564+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d41561e0 con 0x7f85d40c6310 2023-05-17T15:09:16.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.564+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f85c4022070 con 0x7f85d40c6310 2023-05-17T15:09:16.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.564+0000 7f85bbfff700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f85c005ede0 0x7f85c00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.564+0000 7f85d3fff700 1 -- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f85c005ede0 msgr2=0x7f85c00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:16.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.564+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f85c407a050 con 0x7f85d40c6310 2023-05-17T15:09:16.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.564+0000 7f85d3fff700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f85c005ede0 0x7f85c00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:16.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.569+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f85d41561e0 con 0x7f85d40c6310 2023-05-17T15:09:16.577 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.574+0000 7fe3cafca680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:09:16.579 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.575+0000 7fa19d044680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:09:16.690 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.687+0000 7fa19d044680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:16.701 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.697+0000 7fe3cafca680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:09:16.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.743+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85d41561e0 con 0x7f85d40c6310 2023-05-17T15:09:16.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.744+0000 7f85bbfff700 1 -- 172.21.15.27:0/2183718871 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+17287 (secure 0 0 0) 0x7f85d41561e0 con 0x7f85d40c6310 2023-05-17T15:09:16.748 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:16.749 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":98,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:10.363584+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:08:53.174505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-17T15:08:53.590665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3028931537":"2023-05-18T15:09:10.363556+0000","172.21.15.27:0/275166806":"2023-05-18T15:09:10.363556+0000","172.21.15.27:6837/86332":"2023-05-18T15:09:10.363556+0000","172.21.15.27:6836/86332":"2023-05-18T15:09:10.363556+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:16.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.746+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f85c005ede0 msgr2=0x7f85c00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:16.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.746+0000 7f85da8ca700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f85c005ede0 0x7f85c00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.746+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d40c6310 msgr2=0x7f85d40c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.746+0000 7f85da8ca700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d40c6310 0x7f85d40c37b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f85c400e9b0 tx=0x7f85c4009060).stop 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 shutdown_connections 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f85c005ede0 0x7f85c00612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85d41541c0 0x7f85d40c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85d40c5f30 0x7f85d414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 --2- 172.21.15.27:0/2183718871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d40c6310 0x7f85d40c37b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 >> 172.21.15.27:0/2183718871 conn(0x7f85d4069e70 msgr2=0x7f85d414f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:16.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 shutdown_connections 2023-05-17T15:09:16.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.747+0000 7f85da8ca700 1 -- 172.21.15.27:0/2183718871 wait complete. 2023-05-17T15:09:16.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:09:16.816 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:16.812+0000 7fe3cafca680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:16.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.880+0000 7fc16ae3a700 1 Processor -- start 2023-05-17T15:09:16.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.880+0000 7fc16ae3a700 1 -- start start 2023-05-17T15:09:16.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc16ae3a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc16415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc16ae3a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640c01c0 con 0x7fc164153f10 2023-05-17T15:09:16.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc16ae3a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640698b0 con 0x7fc1640cb920 2023-05-17T15:09:16.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc16ae3a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc164069b90 con 0x7fc1640c63c0 2023-05-17T15:09:16.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc168bd6700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc164153f10 0x7fc164069060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40140/0 (socket says 172.21.15.27:40140) 2023-05-17T15:09:16.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc168bd6700 1 -- 172.21.15.27:0/2628366788 learned_addr learned my addr 172.21.15.27:0/2628366788 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc1693d7700 1 --2- 172.21.15.27:0/2628366788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc16415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670527101 0 0) 0x7fc1640c01c0 con 0x7fc164153f10 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1540033f0 con 0x7fc164153f10 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686247694 0 0) 0x7fc1640698b0 con 0x7fc1640cb920 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.881+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1640c01c0 con 0x7fc1640cb920 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1693d7700 1 -- 172.21.15.27:0/2628366788 >> v1:172.21.15.40:6789/0 conn(0x7fc1640cb920 legacy=0x7fc1640c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1693d7700 1 -- 172.21.15.27:0/2628366788 >> v1:172.21.15.27:6789/0 conn(0x7fc164153f10 legacy=0x7fc164069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1693d7700 1 -- 172.21.15.27:0/2628366788 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640bfe50 con 0x7fc1640c63c0 2023-05-17T15:09:16.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1693d7700 1 --2- 172.21.15.27:0/2628366788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc16415efb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc15c009e90 tx=0x7fc15c009780).ready entity=mon.2 client_cookie=f62d4581d3ab6c3b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:16.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00e070 con 0x7fc1640c63c0 2023-05-17T15:09:16.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c00bab0 con 0x7fc1640c63c0 2023-05-17T15:09:16.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.882+0000 7fc1637fe700 1 -- 172.21.15.27:0/2628366788 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00be30 con 0x7fc1640c63c0 2023-05-17T15:09:16.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 -- 172.21.15.27:0/2628366788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 msgr2=0x7fc16415efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/2628366788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc16415efb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc15c009e90 tx=0x7fc15c009780).stop 2023-05-17T15:09:16.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 -- 172.21.15.27:0/2628366788 shutdown_connections 2023-05-17T15:09:16.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/2628366788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc16415efb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 -- 172.21.15.27:0/2628366788 >> 172.21.15.27:0/2628366788 conn(0x7fc16405e820 msgr2=0x7fc1640cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 -- 172.21.15.27:0/2628366788 shutdown_connections 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.883+0000 7fc16ae3a700 1 -- 172.21.15.27:0/2628366788 wait complete. 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.884+0000 7fc16ae3a700 1 Processor -- start 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.884+0000 7fc16ae3a700 1 -- start start 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc16ae3a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc1640b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc16ae3a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 0x7fc164167d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc16ae3a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc164153f10 0x7fc164168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc16ae3a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc164168720 con 0x7fc1640cb920 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc16ae3a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641579c0 con 0x7fc164153f10 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc16ae3a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640b0e50 con 0x7fc1640c63c0 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 0x7fc164167d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc1693d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc164153f10 0x7fc164168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 0x7fc164167d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40586/0 (socket says 172.21.15.27:40586) 2023-05-17T15:09:16.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 -- 172.21.15.27:0/819922253 learned_addr learned my addr 172.21.15.27:0/819922253 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc168bd6700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc1640b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 msgr2=0x7fc1640b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc1640b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc164153f10 msgr2=0x7fc164168230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc164153f10 0x7fc164168230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 -- 172.21.15.27:0/819922253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c009a20 con 0x7fc1640cb920 2023-05-17T15:09:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.885+0000 7fc163fff700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 0x7fc164167d40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fc15000c4a0 tx=0x7fc150007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:16.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.886+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000ce50 con 0x7fc1640cb920 2023-05-17T15:09:16.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.886+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000f470 con 0x7fc1640cb920 2023-05-17T15:09:16.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.886+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc164157120 con 0x7fc1640cb920 2023-05-17T15:09:16.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.886+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000f830 con 0x7fc1640cb920 2023-05-17T15:09:16.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.886+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1641576e0 con 0x7fc1640cb920 2023-05-17T15:09:16.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.887+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1640832c0 con 0x7fc1640cb920 2023-05-17T15:09:16.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.887+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc150019030 con 0x7fc1640cb920 2023-05-17T15:09:16.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.887+0000 7fc160ff9700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 0x7fc1480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:16.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.887+0000 7fc168bd6700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 msgr2=0x7fc1480612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:16.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.887+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fc1500790c0 con 0x7fc1640cb920 2023-05-17T15:09:16.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.887+0000 7fc168bd6700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 0x7fc1480612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:16.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:16.892+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc15004a4a0 con 0x7fc1640cb920 2023-05-17T15:09:16.990 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:16.987+0000 7fa19d044680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:09:17.063 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:17.059+0000 7fa19d044680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:09:17.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.088+0000 7fc168bd6700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 msgr2=0x7fc1480612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:17.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.088+0000 7fc168bd6700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 0x7fc1480612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.110+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1640c1b20 con 0x7fc1640cb920 2023-05-17T15:09:17.121 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.118+0000 7fe3cafca680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:09:17.195 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.192+0000 7fe3cafca680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:09:17.213 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:09:17.209+0000 7f08b66f3700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:09:17.214 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:09:17.209+0000 7f08b66f3700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:09:17.214 INFO:tasks.ceph.mds.c.smithi027.stderr:2023-05-17T15:09:17.209+0000 7f08b66f3700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:09:17.215 INFO:tasks.ceph.mds.c.smithi027.stderr: -1176> 2023-05-17T15:08:55.659+0000 7f08b9efa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:09:17.217 INFO:tasks.ceph.mds.c.smithi027.stderr: -5> 2023-05-17T15:09:17.209+0000 7f08b66f3700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:09:17.218 INFO:tasks.ceph.mds.c.smithi027.stderr: -4> 2023-05-17T15:09:17.209+0000 7f08b66f3700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:09:17.218 INFO:tasks.ceph.mds.c.smithi027.stderr: -2> 2023-05-17T15:09:17.209+0000 7f08b66f3700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:09:17.235 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:09:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.489+0000 7fc168bd6700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 msgr2=0x7fc1480612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.489+0000 7fc168bd6700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 0x7fc1480612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:09:17.694 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:09:17.691+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:09:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.698+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 36) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fc150010070 con 0x7fc1640cb920 2023-05-17T15:09:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.699+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 msgr2=0x7fc1480612d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.699+0000 7fc160ff9700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 0x7fc1480612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:17.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.706+0000 7fc160ff9700 1 -- 172.21.15.27:0/819922253 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc15006e170 con 0x7fc1640cb920 2023-05-17T15:09:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 msgr2=0x7fc164167d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 0x7fc164167d40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fc15000c4a0 tx=0x7fc150007c50).stop 2023-05-17T15:09:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 shutdown_connections 2023-05-17T15:09:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc14805ee10 0x7fc1480612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc164153f10 0x7fc164168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1640c63c0 0x7fc1640b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 --2- 172.21.15.27:0/819922253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1640cb920 0x7fc164167d40 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 >> 172.21.15.27:0/819922253 conn(0x7fc16405e820 msgr2=0x7fc1640c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 shutdown_connections 2023-05-17T15:09:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.709+0000 7fc16ae3a700 1 -- 172.21.15.27:0/819922253 wait complete. 2023-05-17T15:09:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:09:17.730 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:09:17.761 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34afaf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.762 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34afaf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.762 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34afaf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.762 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34afaf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.762 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34afaf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.762 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34dfb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.763 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34dfb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.763 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34dfb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.763 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34dfb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.763 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:17.757+0000 7fe34dfb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:17.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.850+0000 7fb5f46c6700 1 Processor -- start 2023-05-17T15:09:17.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.851+0000 7fb5f46c6700 1 -- start start 2023-05-17T15:09:17.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f46c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec1543d0 0x7fb5ec0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:17.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f46c6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5ec069410 0x7fb5ec0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:17.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f46c6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec158790 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f46c6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0c1c50 con 0x7fb5ec069410 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f46c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0c6570 con 0x7fb5ec1543d0 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5ec069410 0x7fb5ec0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f1c61700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb5ec0c60f0 0x7fb5ec068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40236/0 (socket says 172.21.15.27:40236) 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5ec069410 0x7fb5ec0bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40676/0 (socket says 172.21.15.27:40676) 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f1c61700 1 -- 172.21.15.27:0/1654910929 learned_addr learned my addr 172.21.15.27:0/1654910929 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2462700 1 --2- 172.21.15.27:0/1654910929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec1543d0 0x7fb5ec0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:17.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 -- 172.21.15.27:0/1654910929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec1543d0 msgr2=0x7fb5ec0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 --2- 172.21.15.27:0/1654910929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec1543d0 0x7fb5ec0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 -- 172.21.15.27:0/1654910929 >> v1:172.21.15.27:6789/0 conn(0x7fb5ec0c60f0 legacy=0x7fb5ec068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 -- 172.21.15.27:0/1654910929 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec157e60 con 0x7fb5ec069410 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f1460700 1 -- 172.21.15.27:0/1654910929 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007013935 0 0) 0x7fb5ec158790 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f2c63700 1 --2- 172.21.15.27:0/1654910929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec069410 0x7fb5ec0bfc80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fb5e4009e60 tx=0x7fb5e4009780).ready entity=mon.0 client_cookie=44d2db184b11ea21 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f1460700 1 -- 172.21.15.27:0/1654910929 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400e070 con 0x7fb5ec069410 2023-05-17T15:09:17.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f1460700 1 -- 172.21.15.27:0/1654910929 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e400bb60 con 0x7fb5ec069410 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.852+0000 7fb5f1460700 1 -- 172.21.15.27:0/1654910929 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4012410 con 0x7fb5ec069410 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 -- 172.21.15.27:0/1654910929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec069410 msgr2=0x7fb5ec0bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/1654910929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec069410 0x7fb5ec0bfc80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fb5e4009e60 tx=0x7fb5e4009780).stop 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 -- 172.21.15.27:0/1654910929 shutdown_connections 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/1654910929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec069410 0x7fb5ec0bfc80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/1654910929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec1543d0 0x7fb5ec0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 -- 172.21.15.27:0/1654910929 >> 172.21.15.27:0/1654910929 conn(0x7fb5ec0cb7f0 msgr2=0x7fb5ec0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:17.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 -- 172.21.15.27:0/1654910929 shutdown_connections 2023-05-17T15:09:17.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.853+0000 7fb5f46c6700 1 -- 172.21.15.27:0/1654910929 wait complete. 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.854+0000 7fb5f46c6700 1 Processor -- start 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.854+0000 7fb5f46c6700 1 -- start start 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f46c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec069410 0x7fb5ec147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f46c6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 0x7fb5ec0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f46c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec1543d0 0x7fb5ec0aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f46c6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec164150 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f46c6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0af1c0 con 0x7fb5ec1543d0 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f46c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0aa840 con 0x7fb5ec069410 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 0x7fb5ec0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 0x7fb5ec0c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40680/0 (socket says 172.21.15.27:40680) 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 -- 172.21.15.27:0/2432352192 learned_addr learned my addr 172.21.15.27:0/2432352192 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f2c63700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec1543d0 0x7fb5ec0aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f2462700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec069410 0x7fb5ec147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:17.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 -- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec069410 msgr2=0x7fb5ec147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec069410 0x7fb5ec147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 -- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec1543d0 msgr2=0x7fb5ec0aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec1543d0 0x7fb5ec0aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 -- 172.21.15.27:0/2432352192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4009a20 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f2462700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec069410 0x7fb5ec147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.855+0000 7fb5f1c61700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 0x7fb5ec0c2790 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fb5dc00c4a0 tx=0x7fb5dc007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.856+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0072e0 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.856+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc007440 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.856+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec0c2d90 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.856+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0057a0 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.856+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec0c3350 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.857+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec06bdf0 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.857+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 36) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fb5dc01a060 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.857+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6666+0+0 (secure 0 0 0) 0x7fb5dc079340 con 0x7fb5ec0c60f0 2023-05-17T15:09:17.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:17.861+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5dc04a760 con 0x7fb5ec0c60f0 2023-05-17T15:09:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.076+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5ec153140 con 0x7fb5ec0c60f0 2023-05-17T15:09:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.716+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fb5dc010070 con 0x7fb5ec0c60f0 2023-05-17T15:09:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.716+0000 7fb5e27fc700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb5d00301b0 0x7fb5d0067870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.717+0000 7fb5f2462700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb5d00301b0 0x7fb5d0067870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.718+0000 7fb5e27fc700 1 -- 172.21.15.27:0/2432352192 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5dc0727c0 con 0x7fb5ec0c60f0 2023-05-17T15:09:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.719+0000 7fb5f2462700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb5d00301b0 0x7fb5d0067870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb5e8009b60 tx=0x7fb5e8008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb5d00301b0 msgr2=0x7fb5d0067870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb5d00301b0 0x7fb5d0067870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb5e8009b60 tx=0x7fb5e8008040).stop 2023-05-17T15:09:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 msgr2=0x7fb5ec0c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 0x7fb5ec0c2790 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fb5dc00c4a0 tx=0x7fb5dc007c30).stop 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 shutdown_connections 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb5d00301b0 0x7fb5d0067870 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec1543d0 0x7fb5ec0aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5ec069410 0x7fb5ec147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 --2- 172.21.15.27:0/2432352192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ec0c60f0 0x7fb5ec0c2790 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 >> 172.21.15.27:0/2432352192 conn(0x7fb5ec0cb7f0 msgr2=0x7fb5ec1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:18.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 shutdown_connections 2023-05-17T15:09:18.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.721+0000 7fb5f46c6700 1 -- 172.21.15.27:0/2432352192 wait complete. 2023-05-17T15:09:18.738 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:09:18.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.898+0000 7ff4f86b7700 1 Processor -- start 2023-05-17T15:09:18.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.898+0000 7ff4f86b7700 1 -- start start 2023-05-17T15:09:18.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f86b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f86b7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4f00aa130 0x7ff4f0081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f86b7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00c1610 con 0x7ff4f00824c0 2023-05-17T15:09:18.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f86b7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f0082930 con 0x7ff4f00aa130 2023-05-17T15:09:18.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f86b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00abe60 con 0x7ff4f0153fa0 2023-05-17T15:09:18.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f5c52700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4f00aa130 0x7ff4f0081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f5c52700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4f00aa130 0x7ff4f0081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40708/0 (socket says 172.21.15.27:40708) 2023-05-17T15:09:18.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f6c54700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff4f00824c0 0x7ff4f0068de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40272/0 (socket says 172.21.15.27:40272) 2023-05-17T15:09:18.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.899+0000 7ff4f5c52700 1 -- 172.21.15.27:0/2638119485 learned_addr learned my addr 172.21.15.27:0/2638119485 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:18.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f6453700 1 --2- 172.21.15.27:0/2638119485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5c52700 1 -- 172.21.15.27:0/2638119485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 msgr2=0x7ff4f00c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:18.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5c52700 1 --2- 172.21.15.27:0/2638119485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5c52700 1 -- 172.21.15.27:0/2638119485 >> v1:172.21.15.27:6789/0 conn(0x7ff4f00824c0 legacy=0x7ff4f0068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5c52700 1 -- 172.21.15.27:0/2638119485 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00c0a00 con 0x7ff4f00aa130 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5451700 1 -- 172.21.15.27:0/2638119485 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740516138 0 0) 0x7ff4f00c1610 con 0x7ff4f00824c0 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5c52700 1 --2- 172.21.15.27:0/2638119485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f0081fd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7ff4e4006fd0 tx=0x7ff4e40090f0).ready entity=mon.0 client_cookie=5d374d24be77a1e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5451700 1 -- 172.21.15.27:0/2638119485 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400b600 con 0x7ff4f00aa130 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5451700 1 -- 172.21.15.27:0/2638119485 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400b760 con 0x7ff4f00aa130 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f5451700 1 -- 172.21.15.27:0/2638119485 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400bae0 con 0x7ff4f00aa130 2023-05-17T15:09:18.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f86b7700 1 -- 172.21.15.27:0/2638119485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 msgr2=0x7ff4f0081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/2638119485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f0081fd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7ff4e4006fd0 tx=0x7ff4e40090f0).stop 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f86b7700 1 -- 172.21.15.27:0/2638119485 shutdown_connections 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/2638119485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.900+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/2638119485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f0081fd0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.901+0000 7ff4f86b7700 1 -- 172.21.15.27:0/2638119485 >> 172.21.15.27:0/2638119485 conn(0x7ff4f005e820 msgr2=0x7ff4f00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.901+0000 7ff4f86b7700 1 -- 172.21.15.27:0/2638119485 shutdown_connections 2023-05-17T15:09:18.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.901+0000 7ff4f86b7700 1 -- 172.21.15.27:0/2638119485 wait complete. 2023-05-17T15:09:18.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 Processor -- start 2023-05-17T15:09:18.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 -- start start 2023-05-17T15:09:18.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f00824c0 0x7ff4f01654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c1e80 con 0x7ff4f00aa130 2023-05-17T15:09:18.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c2990 con 0x7ff4f00824c0 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.902+0000 7ff4f86b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c2060 con 0x7ff4f0153fa0 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f014ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40714/0 (socket says 172.21.15.27:40714) 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 -- 172.21.15.27:0/4120566279 learned_addr learned my addr 172.21.15.27:0/4120566279 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f6453700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f00824c0 0x7ff4f01654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f6c54700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 -- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 msgr2=0x7ff4f00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 -- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f00824c0 msgr2=0x7ff4f01654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f00824c0 0x7ff4f01654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 -- 172.21.15.27:0/4120566279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009370 con 0x7ff4f00aa130 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f6453700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f00824c0 0x7ff4f01654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f5c52700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f014ac80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7ff4e4011000 tx=0x7ff4e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400b8d0 con 0x7ff4f00aa130 2023-05-17T15:09:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400ba30 con 0x7ff4f00aa130 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00c2340 con 0x7ff4f00aa130 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e401c670 con 0x7ff4f00aa130 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.903+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f01659e0 con 0x7ff4f00aa130 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.904+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f00c2b20 con 0x7ff4f00aa130 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.904+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7ff4e402c070 con 0x7ff4f00aa130 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.905+0000 7ff4ee7fc700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff4dc05ecf0 0x7ff4dc0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.905+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6666+0+0 (secure 0 0 0) 0x7ff4e407b8a0 con 0x7ff4f00aa130 2023-05-17T15:09:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.905+0000 7ff4f6453700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff4dc05ecf0 0x7ff4dc0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.905+0000 7ff4f6453700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff4dc05ecf0 0x7ff4dc0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff4e8006fd0 tx=0x7ff4e8008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:18.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:18.909+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4e404ccc0 con 0x7ff4f00aa130 2023-05-17T15:09:19.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.083+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4f00c0ce0 con 0x7ff4f00aa130 2023-05-17T15:09:19.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.725+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff4e4022030 con 0x7ff4f00aa130 2023-05-17T15:09:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.726+0000 7ff4ee7fc700 1 -- 172.21.15.27:0/4120566279 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff4e4042600 con 0x7ff4f00aa130 2023-05-17T15:09:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff4dc05ecf0 msgr2=0x7ff4dc0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff4dc05ecf0 0x7ff4dc0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff4e8006fd0 tx=0x7ff4e8008040).stop 2023-05-17T15:09:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 msgr2=0x7ff4f014ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f014ac80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7ff4e4011000 tx=0x7ff4e4017000).stop 2023-05-17T15:09:19.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 shutdown_connections 2023-05-17T15:09:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff4dc05ecf0 0x7ff4dc0611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f0153fa0 0x7ff4f00af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f00824c0 0x7ff4f01654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 --2- 172.21.15.27:0/4120566279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f00aa130 0x7ff4f014ac80 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 >> 172.21.15.27:0/4120566279 conn(0x7ff4f005e820 msgr2=0x7ff4f0153130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 shutdown_connections 2023-05-17T15:09:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.730+0000 7ff4f86b7700 1 -- 172.21.15.27:0/4120566279 wait complete. 2023-05-17T15:09:19.736 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:09:19.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:09:19.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.871+0000 7f75d8ed6700 1 Processor -- start 2023-05-17T15:09:19.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.871+0000 7f75d8ed6700 1 -- start start 2023-05-17T15:09:19.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d8ed6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f75d40c1080 0x7f75d40c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:19.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d8ed6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75d4154520 0x7f75d40c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:19.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d8ed6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d4154a50 con 0x7f75d40c5d60 2023-05-17T15:09:19.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d8ed6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d4154d30 con 0x7f75d40c1080 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d8ed6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d4155010 con 0x7f75d4154520 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f75d40c1080 0x7f75d40c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f75d40c1080 0x7f75d40c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40720/0 (socket says 172.21.15.27:40720) 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 -- 172.21.15.27:0/879205840 learned_addr learned my addr 172.21.15.27:0/879205840 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d2ffd700 1 --2- 172.21.15.27:0/879205840 >> v2:172.21.15.40:3300/0 conn(0x7f75d4154520 0x7f75d40c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 -- 172.21.15.27:0/879205840 >> v2:172.21.15.40:3300/0 conn(0x7f75d4154520 msgr2=0x7f75d40c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:19.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 --2- 172.21.15.27:0/879205840 >> v2:172.21.15.40:3300/0 conn(0x7f75d4154520 0x7f75d40c02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 -- 172.21.15.27:0/879205840 >> v1:172.21.15.40:6789/0 conn(0x7f75d40c5d60 legacy=0x7f75d40a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 -- 172.21.15.27:0/879205840 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d41552f0 con 0x7f75d40c1080 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d37fe700 1 --2- 172.21.15.27:0/879205840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d40c1460 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f75d4067d20 tx=0x7f75bc0090f0).ready entity=mon.0 client_cookie=3aa55aad11337c76 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d27fc700 1 -- 172.21.15.27:0/879205840 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00b520 con 0x7f75d40c1080 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d27fc700 1 -- 172.21.15.27:0/879205840 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00b680 con 0x7f75d40c1080 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.872+0000 7f75d27fc700 1 -- 172.21.15.27:0/879205840 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00ba00 con 0x7f75d40c1080 2023-05-17T15:09:19.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 -- 172.21.15.27:0/879205840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 msgr2=0x7f75d40c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/879205840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d40c1460 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f75d4067d20 tx=0x7f75bc0090f0).stop 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 -- 172.21.15.27:0/879205840 shutdown_connections 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/879205840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d40c1460 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/879205840 >> v2:172.21.15.40:3300/0 conn(0x7f75d4154520 0x7f75d40c02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 -- 172.21.15.27:0/879205840 >> 172.21.15.27:0/879205840 conn(0x7f75d405dd50 msgr2=0x7f75d405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 -- 172.21.15.27:0/879205840 shutdown_connections 2023-05-17T15:09:19.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.873+0000 7f75d8ed6700 1 -- 172.21.15.27:0/879205840 wait complete. 2023-05-17T15:09:19.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.874+0000 7f75d8ed6700 1 Processor -- start 2023-05-17T15:09:19.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.874+0000 7f75d8ed6700 1 -- start start 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d8ed6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d4151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d8ed6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40c5d60 0x7f75d40af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d8ed6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d4154520 0x7f75d40afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d8ed6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4161c10 con 0x7f75d40c1080 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d8ed6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40b0390 con 0x7f75d40c5d60 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d8ed6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4165170 con 0x7f75d4154520 2023-05-17T15:09:19.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d4151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40726/0 (socket says 172.21.15.27:40726) 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 -- 172.21.15.27:0/2691547592 learned_addr learned my addr 172.21.15.27:0/2691547592 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d2ffd700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40c5d60 0x7f75d40af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d3fff700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d4154520 0x7f75d40afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 -- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d4154520 msgr2=0x7f75d40afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d4154520 0x7f75d40afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 -- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40c5d60 msgr2=0x7f75d40af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40c5d60 0x7f75d40af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 -- 172.21.15.27:0/2691547592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009370 con 0x7f75d40c1080 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75d37fe700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d4151770 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f75bc009130 tx=0x7f75bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.875+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00be90 con 0x7f75d40c1080 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.876+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00b7f0 con 0x7f75d40c1080 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.876+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d41653c0 con 0x7f75d40c1080 2023-05-17T15:09:19.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.876+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc01c670 con 0x7f75d40c1080 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.876+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d4165980 con 0x7f75d40c1080 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.877+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d4047150 con 0x7f75d40c1080 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.877+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f75bc02c070 con 0x7f75d40c1080 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.877+0000 7f75cb7fe700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b405ed60 0x7f75b4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.877+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6228+0+0 (secure 0 0 0) 0x7f75bc07b650 con 0x7f75d40c1080 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.877+0000 7f75d2ffd700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b405ed60 0x7f75b4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:19.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.878+0000 7f75d2ffd700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b405ed60 0x7f75b4061220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f75d40af060 tx=0x7f75c4008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:19.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:19.882+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75bc04cb80 con 0x7f75d40c1080 2023-05-17T15:09:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.053+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75d4165fc0 con 0x7f75d40c1080 2023-05-17T15:09:20.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.723+0000 7f75cb7fe700 1 -- 172.21.15.27:0/2691547592 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 169+0+0 (secure 0 0 0) 0x7f75d4165fc0 con 0x7f75d40c1080 2023-05-17T15:09:20.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.725+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b405ed60 msgr2=0x7f75b4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:20.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.725+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b405ed60 0x7f75b4061220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f75d40af060 tx=0x7f75c4008040).stop 2023-05-17T15:09:20.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.725+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 msgr2=0x7f75d4151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:20.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.725+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d4151770 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f75bc009130 tx=0x7f75bc017000).stop 2023-05-17T15:09:20.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 shutdown_connections 2023-05-17T15:09:20.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f75b405ed60 0x7f75b4061220 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d4154520 0x7f75d40afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75d40c1080 0x7f75d4151770 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 --2- 172.21.15.27:0/2691547592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40c5d60 0x7f75d40af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 >> 172.21.15.27:0/2691547592 conn(0x7f75d405dd50 msgr2=0x7f75d40c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:20.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 shutdown_connections 2023-05-17T15:09:20.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.726+0000 7f75d8ed6700 1 -- 172.21.15.27:0/2691547592 wait complete. 2023-05-17T15:09:20.736 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:09:20.745 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:09:20.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.865+0000 7f824e033700 1 Processor -- start 2023-05-17T15:09:20.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.865+0000 7f824e033700 1 -- start start 2023-05-17T15:09:20.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f824e033700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82481543d0 0x7f82480c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f824e033700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82480c60f0 0x7f8248068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f824e033700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82480691f0 0x7f82481547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f824e033700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82480c1c50 con 0x7f82481543d0 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f824e033700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8248158790 con 0x7f82480c60f0 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f824e033700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c6570 con 0x7f82480691f0 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f82477fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82481543d0 0x7f82480c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f82477fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82481543d0 0x7f82480c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40734/0 (socket says 172.21.15.27:40734) 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.866+0000 7f82477fe700 1 -- 172.21.15.27:0/192806270 learned_addr learned my addr 172.21.15.27:0/192806270 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82477fe700 1 -- 172.21.15.27:0/192806270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82480691f0 msgr2=0x7f82481547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f8247fff700 1 --2- 172.21.15.27:0/192806270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82480691f0 0x7f82481547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f8246ffd700 1 --2- 172.21.15.27:0/192806270 >> v2:172.21.15.40:3300/0 conn(0x7f82480c60f0 0x7f8248068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82477fe700 1 --2- 172.21.15.27:0/192806270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82480691f0 0x7f82481547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82477fe700 1 -- 172.21.15.27:0/192806270 >> v2:172.21.15.40:3300/0 conn(0x7f82480c60f0 msgr2=0x7f8248068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:20.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82477fe700 1 --2- 172.21.15.27:0/192806270 >> v2:172.21.15.40:3300/0 conn(0x7f82480c60f0 0x7f8248068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82477fe700 1 -- 172.21.15.27:0/192806270 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248157e60 con 0x7f82481543d0 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82477fe700 1 --2- 172.21.15.27:0/192806270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82481543d0 0x7f82480c5c00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f82480c5620 tx=0x7f82380090f0).ready entity=mon.0 client_cookie=a78e62c34bb50e6d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82467fc700 1 -- 172.21.15.27:0/192806270 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823800b600 con 0x7f82481543d0 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82467fc700 1 -- 172.21.15.27:0/192806270 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823800b760 con 0x7f82481543d0 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f82467fc700 1 -- 172.21.15.27:0/192806270 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823800bae0 con 0x7f82481543d0 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 -- 172.21.15.27:0/192806270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82481543d0 msgr2=0x7f82480c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 --2- 172.21.15.27:0/192806270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82481543d0 0x7f82480c5c00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f82480c5620 tx=0x7f82380090f0).stop 2023-05-17T15:09:20.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 -- 172.21.15.27:0/192806270 shutdown_connections 2023-05-17T15:09:20.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 --2- 172.21.15.27:0/192806270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82481543d0 0x7f82480c5c00 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 --2- 172.21.15.27:0/192806270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82480691f0 0x7f82481547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 --2- 172.21.15.27:0/192806270 >> v2:172.21.15.40:3300/0 conn(0x7f82480c60f0 0x7f8248068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.867+0000 7f824e033700 1 -- 172.21.15.27:0/192806270 >> 172.21.15.27:0/192806270 conn(0x7f82480cb7f0 msgr2=0x7f82480c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:20.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.868+0000 7f824e033700 1 -- 172.21.15.27:0/192806270 shutdown_connections 2023-05-17T15:09:20.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.868+0000 7f824e033700 1 -- 172.21.15.27:0/192806270 wait complete. 2023-05-17T15:09:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.869+0000 7f824e033700 1 Processor -- start 2023-05-17T15:09:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.869+0000 7f824e033700 1 -- start start 2023-05-17T15:09:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.869+0000 7f824e033700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82480691f0 0x7f82480c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 0x7f8248147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82481543d0 0x7f82481547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c2e60 con 0x7f82480c60f0 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c2250 con 0x7f82480691f0 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c2530 con 0x7f82481543d0 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 0x7f8248147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 0x7f8248147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40742/0 (socket says 172.21.15.27:40742) 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 -- 172.21.15.27:0/2209201615 learned_addr learned my addr 172.21.15.27:0/2209201615 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:20.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f82477fe700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82480691f0 0x7f82480c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8247fff700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82481543d0 0x7f82481547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 -- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82481543d0 msgr2=0x7f82481547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82481543d0 0x7f82481547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 -- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82480691f0 msgr2=0x7f82480c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82480691f0 0x7f82480c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 -- 172.21.15.27:0/2209201615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8238009370 con 0x7f82480c60f0 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f82477fe700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82480691f0 0x7f82480c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:20.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f8246ffd700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 0x7f8248147990 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f823c00c850 tx=0x7f823c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c010580 con 0x7f82480c60f0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c0106e0 con 0x7f82480c60f0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82480c2810 con 0x7f82480c60f0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c010a60 con 0x7f82480c60f0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.870+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82480c41f0 con 0x7f82480c60f0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.871+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82480c3010 con 0x7f82480c60f0 2023-05-17T15:09:20.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.872+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f823c01b460 con 0x7f82480c60f0 2023-05-17T15:09:20.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.872+0000 7f822f7fe700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f823405ed90 0x7f8234061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:20.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.872+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f823c079ac0 con 0x7f82480c60f0 2023-05-17T15:09:20.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.872+0000 7f82477fe700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f823405ed90 0x7f8234061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:20.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.872+0000 7f82477fe700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f823405ed90 0x7f8234061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8238009130 tx=0x7f8238017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:20.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:20.876+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82480c3010 con 0x7f82480c60f0 2023-05-17T15:09:21.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.051+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f824806bdf0 con 0x7f82480c60f0 2023-05-17T15:09:21.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.054+0000 7f822f7fe700 1 -- 172.21.15.27:0/2209201615 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v16) v1 ==== 120+0+0 (secure 0 0 0) 0x7f823c04b130 con 0x7f82480c60f0 2023-05-17T15:09:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f823405ed90 msgr2=0x7f8234061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f823405ed90 0x7f8234061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8238009130 tx=0x7f8238017000).stop 2023-05-17T15:09:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 msgr2=0x7f8248147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 0x7f8248147990 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f823c00c850 tx=0x7f823c008040).stop 2023-05-17T15:09:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 shutdown_connections 2023-05-17T15:09:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f823405ed90 0x7f8234061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82481543d0 0x7f82481547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82480691f0 0x7f82480c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 --2- 172.21.15.27:0/2209201615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82480c60f0 0x7f8248147990 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 >> 172.21.15.27:0/2209201615 conn(0x7f82480cb7f0 msgr2=0x7f8248153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 shutdown_connections 2023-05-17T15:09:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.056+0000 7f824e033700 1 -- 172.21.15.27:0/2209201615 wait complete. 2023-05-17T15:09:21.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:09:21.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.188+0000 7f9950c6e700 1 Processor -- start 2023-05-17T15:09:21.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.188+0000 7f9950c6e700 1 -- start start 2023-05-17T15:09:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f9950c6e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f994c155a60 0x7f994c155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f9950c6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0bdf00 0x7f994c0be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f9950c6e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c1563d0 con 0x7f994c0a7e90 2023-05-17T15:09:21.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f9950c6e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994c0bdab0 con 0x7f994c155a60 2023-05-17T15:09:21.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f9950c6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c156830 con 0x7f994c0bdf00 2023-05-17T15:09:21.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f9949d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f994c155a60 0x7f994c155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f994a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f994c0a7e90 0x7f994c0c3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40310/0 (socket says 172.21.15.27:40310) 2023-05-17T15:09:21.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.189+0000 7f994a59c700 1 -- 172.21.15.27:0/1943495896 learned_addr learned my addr 172.21.15.27:0/1943495896 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:21.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f994ad9d700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0bdf00 0x7f994c0be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9949d9b700 1 -- 172.21.15.27:0/1943495896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0bdf00 msgr2=0x7f994c0be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:21.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9949d9b700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0bdf00 0x7f994c0be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9949d9b700 1 -- 172.21.15.27:0/1943495896 >> v1:172.21.15.27:6789/0 conn(0x7f994c0a7e90 legacy=0x7f994c0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9949d9b700 1 -- 172.21.15.27:0/1943495896 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c065e90 con 0x7f994c155a60 2023-05-17T15:09:21.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f994ad9d700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0bdf00 0x7f994c0be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:21.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f994959a700 1 -- 172.21.15.27:0/1943495896 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210224133 0 0) 0x7f994c1563d0 con 0x7f994c0a7e90 2023-05-17T15:09:21.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9949d9b700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c155ee0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f9940009760 tx=0x7f9940009060).ready entity=mon.0 client_cookie=2fcc8c42fce788b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:21.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f994959a700 1 -- 172.21.15.27:0/1943495896 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000b580 con 0x7f994c155a60 2023-05-17T15:09:21.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f994959a700 1 -- 172.21.15.27:0/1943495896 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000b6e0 con 0x7f994c155a60 2023-05-17T15:09:21.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f994959a700 1 -- 172.21.15.27:0/1943495896 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000ba60 con 0x7f994c155a60 2023-05-17T15:09:21.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9950c6e700 1 -- 172.21.15.27:0/1943495896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 msgr2=0x7f994c155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9950c6e700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c155ee0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f9940009760 tx=0x7f9940009060).stop 2023-05-17T15:09:21.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9950c6e700 1 -- 172.21.15.27:0/1943495896 shutdown_connections 2023-05-17T15:09:21.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9950c6e700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0bdf00 0x7f994c0be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9950c6e700 1 --2- 172.21.15.27:0/1943495896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c155ee0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.190+0000 7f9950c6e700 1 -- 172.21.15.27:0/1943495896 >> 172.21.15.27:0/1943495896 conn(0x7f994c0c94b0 msgr2=0x7f994c0c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:21.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.191+0000 7f9950c6e700 1 -- 172.21.15.27:0/1943495896 shutdown_connections 2023-05-17T15:09:21.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.191+0000 7f9950c6e700 1 -- 172.21.15.27:0/1943495896 wait complete. 2023-05-17T15:09:21.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 Processor -- start 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 -- start start 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0a7e90 0x7f994c0c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f994c0bdf00 0x7f994c0a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0c0750 con 0x7f994c155a60 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c151180 con 0x7f994c0bdf00 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f9950c6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0aa560 con 0x7f994c0a7e90 2023-05-17T15:09:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f994ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f994ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c13f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40756/0 (socket says 172.21.15.27:40756) 2023-05-17T15:09:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.192+0000 7f994ad9d700 1 -- 172.21.15.27:0/843032368 learned_addr learned my addr 172.21.15.27:0/843032368 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994a59c700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0a7e90 0x7f994c0c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f9949d9b700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f994c0bdf00 0x7f994c0a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994ad9d700 1 -- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0a7e90 msgr2=0x7f994c0c0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994ad9d700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0a7e90 0x7f994c0c0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994ad9d700 1 -- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f994c0bdf00 msgr2=0x7f994c0a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994ad9d700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f994c0bdf00 0x7f994c0a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994ad9d700 1 -- 172.21.15.27:0/843032368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400092a0 con 0x7f994c155a60 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f9949d9b700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f994c0bdf00 0x7f994c0a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f994ad9d700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c13f5c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f993c00cef0 tx=0x7f993c007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00ae00 con 0x7f994c155a60 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c016400 con 0x7f994c155a60 2023-05-17T15:09:21.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c150570 con 0x7f994c155a60 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c016780 con 0x7f994c155a60 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.193+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c150b30 con 0x7f994c155a60 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.194+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c1512f0 con 0x7f994c155a60 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.194+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f993c0203f0 con 0x7f994c155a60 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.195+0000 7f993a7fc700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f992c05ed90 0x7f992c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.195+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f993c07a5a0 con 0x7f994c155a60 2023-05-17T15:09:21.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.195+0000 7f994a59c700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f992c05ed90 0x7f992c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.195+0000 7f994a59c700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f992c05ed90 0x7f992c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f994400c7d0 tx=0x7f9944009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:21.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.199+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f993c04bc10 con 0x7f994c155a60 2023-05-17T15:09:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.371+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f994c06bdf0 con 0x7f994c155a60 2023-05-17T15:09:21.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.375+0000 7f993a7fc700 1 -- 172.21.15.27:0/843032368 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f993c04f230 con 0x7f994c155a60 2023-05-17T15:09:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f992c05ed90 msgr2=0x7f992c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f992c05ed90 0x7f992c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f994400c7d0 tx=0x7f9944009040).stop 2023-05-17T15:09:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 msgr2=0x7f994c13f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c13f5c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f993c00cef0 tx=0x7f993c007860).stop 2023-05-17T15:09:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 shutdown_connections 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f992c05ed90 0x7f992c061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f994c155a60 0x7f994c13f5c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f994c0a7e90 0x7f994c0c0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 --2- 172.21.15.27:0/843032368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f994c0bdf00 0x7f994c0a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 >> 172.21.15.27:0/843032368 conn(0x7f994c0c94b0 msgr2=0x7f994c0c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 shutdown_connections 2023-05-17T15:09:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.377+0000 7f9950c6e700 1 -- 172.21.15.27:0/843032368 wait complete. 2023-05-17T15:09:21.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-05-17T15:09:21.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.506+0000 7f1d6a654700 1 Processor -- start 2023-05-17T15:09:21.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.506+0000 7f1d6a654700 1 -- start start 2023-05-17T15:09:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d6a654700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 0x7f1d640c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d6a654700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 0x7f1d640c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d6a654700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640bfcd0 con 0x7f1d64158880 2023-05-17T15:09:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d6a654700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640c0290 con 0x7f1d640c5f30 2023-05-17T15:09:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d6a654700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640aa1a0 con 0x7f1d641543e0 2023-05-17T15:09:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d68bf1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 0x7f1d640c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d63fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 0x7f1d640c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d5bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1d64158880 0x7f1d64153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46326/0 (socket says 172.21.15.27:46326) 2023-05-17T15:09:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d5bfff700 1 -- 172.21.15.27:0/2615792533 learned_addr learned my addr 172.21.15.27:0/2615792533 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d68bf1700 1 --2- 172.21.15.27:0/2615792533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 0x7f1d640c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41872/0 (socket says 172.21.15.27:41872) 2023-05-17T15:09:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.507+0000 7f1d63fff700 1 --2- 172.21.15.27:0/2615792533 >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 0x7f1d640c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:58692/0 (socket says 172.21.15.27:58692) 2023-05-17T15:09:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d68bf1700 1 -- 172.21.15.27:0/2615792533 >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 msgr2=0x7f1d640c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d68bf1700 1 --2- 172.21.15.27:0/2615792533 >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 0x7f1d640c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d68bf1700 1 -- 172.21.15.27:0/2615792533 >> v1:172.21.15.40:6789/0 conn(0x7f1d64158880 legacy=0x7f1d64153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d68bf1700 1 -- 172.21.15.27:0/2615792533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640aa480 con 0x7f1d641543e0 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d63fff700 1 --2- 172.21.15.27:0/2615792533 >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 0x7f1d640c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d68bf1700 1 --2- 172.21.15.27:0/2615792533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 0x7f1d640c0720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1d5c009e60 tx=0x7f1d5c009780).ready entity=mon.2 client_cookie=fbe8ba5be8a6c720 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d637fe700 1 -- 172.21.15.27:0/2615792533 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00e070 con 0x7f1d641543e0 2023-05-17T15:09:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d637fe700 1 -- 172.21.15.27:0/2615792533 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00bb60 con 0x7f1d641543e0 2023-05-17T15:09:21.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d637fe700 1 -- 172.21.15.27:0/2615792533 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c012410 con 0x7f1d641543e0 2023-05-17T15:09:21.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d6a654700 1 -- 172.21.15.27:0/2615792533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 msgr2=0x7f1d640c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.508+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2615792533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 0x7f1d640c0720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1d5c009e60 tx=0x7f1d5c009780).stop 2023-05-17T15:09:21.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.509+0000 7f1d6a654700 1 -- 172.21.15.27:0/2615792533 shutdown_connections 2023-05-17T15:09:21.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.509+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2615792533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d641543e0 0x7f1d640c0720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.509+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2615792533 >> v2:172.21.15.40:3300/0 conn(0x7f1d640c5f30 0x7f1d640c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.509+0000 7f1d6a654700 1 -- 172.21.15.27:0/2615792533 >> 172.21.15.27:0/2615792533 conn(0x7f1d64069e70 msgr2=0x7f1d6405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:21.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.509+0000 7f1d6a654700 1 -- 172.21.15.27:0/2615792533 shutdown_connections 2023-05-17T15:09:21.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.509+0000 7f1d6a654700 1 -- 172.21.15.27:0/2615792533 wait complete. 2023-05-17T15:09:21.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.510+0000 7f1d6a654700 1 Processor -- start 2023-05-17T15:09:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.510+0000 7f1d6a654700 1 -- start start 2023-05-17T15:09:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.510+0000 7f1d6a654700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d640c5f30 0x7f1d64156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.510+0000 7f1d6a654700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 0x7f1d64155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d6a654700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d64158880 0x7f1d640a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d6a654700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d641529c0 con 0x7f1d641543e0 2023-05-17T15:09:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d6a654700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d64157100 con 0x7f1d64158880 2023-05-17T15:09:21.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d6a654700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640c1f40 con 0x7f1d640c5f30 2023-05-17T15:09:21.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d5bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 0x7f1d64155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d5bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 0x7f1d64155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40766/0 (socket says 172.21.15.27:40766) 2023-05-17T15:09:21.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d5bfff700 1 -- 172.21.15.27:0/2489352648 learned_addr learned my addr 172.21.15.27:0/2489352648 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:21.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d640c5f30 0x7f1d64156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d68bf1700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d64158880 0x7f1d640a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 -- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d64158880 msgr2=0x7f1d640a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d64158880 0x7f1d640a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 -- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 msgr2=0x7f1d64155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 0x7f1d64155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 -- 172.21.15.27:0/2489352648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540092a0 con 0x7f1d640c5f30 2023-05-17T15:09:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d5bfff700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 0x7f1d64155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d63fff700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d640c5f30 0x7f1d64156c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1d5400e9b0 tx=0x7f1d54009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:21.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54012600 con 0x7f1d640c5f30 2023-05-17T15:09:21.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d54012760 con 0x7f1d640c5f30 2023-05-17T15:09:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c009a20 con 0x7f1d640c5f30 2023-05-17T15:09:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54012ae0 con 0x7f1d640c5f30 2023-05-17T15:09:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.511+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d64155dc0 con 0x7f1d640c5f30 2023-05-17T15:09:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.512+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d640c21e0 con 0x7f1d640c5f30 2023-05-17T15:09:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.513+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1d54022070 con 0x7f1d640c5f30 2023-05-17T15:09:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.513+0000 7f1d60ff9700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1d4405ed90 0x7f1d44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.513+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f1d54079f20 con 0x7f1d640c5f30 2023-05-17T15:09:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.513+0000 7f1d5bfff700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1d4405ed90 0x7f1d44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.514+0000 7f1d5bfff700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1d4405ed90 0x7f1d44061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1d640c5170 tx=0x7f1d4c007e50).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:21.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.517+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d5404b670 con 0x7f1d640c5f30 2023-05-17T15:09:21.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:21.757+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f1d6405f4a0 con 0x7f1d640c5f30 2023-05-17T15:09:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.737+0000 7f1d60ff9700 1 -- 172.21.15.27:0/2489352648 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v569) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1d540160e0 con 0x7f1d640c5f30 2023-05-17T15:09:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1d4405ed90 msgr2=0x7f1d44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1d4405ed90 0x7f1d44061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1d640c5170 tx=0x7f1d4c007e50).stop 2023-05-17T15:09:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d640c5f30 msgr2=0x7f1d64156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d640c5f30 0x7f1d64156c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1d5400e9b0 tx=0x7f1d54009060).stop 2023-05-17T15:09:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 shutdown_connections 2023-05-17T15:09:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1d4405ed90 0x7f1d44061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d64158880 0x7f1d640a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d640c5f30 0x7f1d64156c10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 --2- 172.21.15.27:0/2489352648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d641543e0 0x7f1d64155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 >> 172.21.15.27:0/2489352648 conn(0x7f1d64069e70 msgr2=0x7f1d640cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:22.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 shutdown_connections 2023-05-17T15:09:22.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.740+0000 7f1d6a654700 1 -- 172.21.15.27:0/2489352648 wait complete. 2023-05-17T15:09:22.759 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-05-17T15:09:22.759 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-05-17T15:09:22.760 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:09:22.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-05-17T15:09:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.879+0000 7f1867c8d700 1 Processor -- start 2023-05-17T15:09:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.879+0000 7f1867c8d700 1 -- start start 2023-05-17T15:09:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1867c8d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 0x7f1860095630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1867c8d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18600c81f0 con 0x7f18600c30b0 2023-05-17T15:09:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1867c8d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1860095b20 con 0x7f18601540d0 2023-05-17T15:09:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1867c8d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1860069760 con 0x7f18600951b0 2023-05-17T15:09:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f186622a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f18600c30b0 0x7f18600c3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40340/0 (socket says 172.21.15.27:40340) 2023-05-17T15:09:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f186622a700 1 -- 172.21.15.27:0/4116435419 learned_addr learned my addr 172.21.15.27:0/4116435419 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1865228700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 0x7f1860095630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640190079 0 0) 0x7f18600c81f0 con 0x7f18600c30b0 2023-05-17T15:09:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f184c0033f0 con 0x7f18600c30b0 2023-05-17T15:09:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894815225 0 0) 0x7f184c0033f0 con 0x7f18600c30b0 2023-05-17T15:09:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 msgr2=0x7f1860095630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 0x7f1860095630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 >> v1:172.21.15.40:6789/0 conn(0x7f18601540d0 legacy=0x7f1860069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18601544b0 con 0x7f18600c30b0 2023-05-17T15:09:22.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.880+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f18580017f0 con 0x7f18600c30b0 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 >> v1:172.21.15.27:6789/0 conn(0x7f18600c30b0 legacy=0x7f18600c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f184c003910 0x7f184c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 0x7f184c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f184c004b80 0x7f184c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860069760 con 0x7f184c004b80 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c00b910 con 0x7f184c003910 2023-05-17T15:09:22.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c00bad0 con 0x7f18600951b0 2023-05-17T15:09:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f184c004b80 0x7f184c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1865228700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 0x7f184c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1865a29700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f184c003910 0x7f184c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 -- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 msgr2=0x7f184c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:22.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18600951b0 0x7f184c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 -- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f184c003910 msgr2=0x7f184c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f184c003910 0x7f184c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 -- 172.21.15.27:0/4116435419 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0033f0 con 0x7f184c004b80 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f186622a700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f184c004b80 0x7f184c005000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f185800c480 tx=0x7f185800c790).ready entity=mon.0 client_cookie=fc484918ea50c124 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858002030 con 0x7f184c004b80 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800ce20 con 0x7f184c004b80 2023-05-17T15:09:22.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.881+0000 7f1864a27700 1 -- 172.21.15.27:0/4116435419 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858005d30 con 0x7f184c004b80 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f1867c8d700 1 -- 172.21.15.27:0/4116435419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f184c004b80 msgr2=0x7f184c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f1867c8d700 1 --2- 172.21.15.27:0/4116435419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f184c004b80 0x7f184c005000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f185800c480 tx=0x7f185800c790).stop 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f186622a700 1 -- 172.21.15.27:0/4116435419 reap_dead start 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f1867c8d700 1 -- 172.21.15.27:0/4116435419 shutdown_connections 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f1867c8d700 1 -- 172.21.15.27:0/4116435419 >> 172.21.15.27:0/4116435419 conn(0x7f18600c8a10 msgr2=0x7f18600c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f1867c8d700 1 -- 172.21.15.27:0/4116435419 shutdown_connections 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.882+0000 7f1867c8d700 1 -- 172.21.15.27:0/4116435419 wait complete. 2023-05-17T15:09:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.883+0000 7f1867c8d700 1 Processor -- start 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.883+0000 7f1867c8d700 1 -- start start 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186013fcb0 0x7f18600a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18600a9090 0x7f18600ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 0x7f1860167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600ac990 con 0x7f18600ade90 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600ad510 con 0x7f18600a9090 2023-05-17T15:09:22.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18600ae310 con 0x7f186013fcb0 2023-05-17T15:09:22.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 0x7f1860167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 0x7f1860167490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40790/0 (socket says 172.21.15.27:40790) 2023-05-17T15:09:22.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 -- 172.21.15.27:0/50893277 learned_addr learned my addr 172.21.15.27:0/50893277 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:22.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1865a29700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186013fcb0 0x7f18600a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1865228700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18600a9090 0x7f18600ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 -- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186013fcb0 msgr2=0x7f18600a8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186013fcb0 0x7f18600a8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 -- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18600a9090 msgr2=0x7f18600ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18600a9090 0x7f18600ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 -- 172.21.15.27:0/50893277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600acbe0 con 0x7f18600ade90 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1865a29700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186013fcb0 0x7f18600a8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f186622a700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 0x7f1860167490 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f185800cae0 tx=0x7f1858015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858018030 con 0x7f18600ade90 2023-05-17T15:09:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580017b0 con 0x7f18600ade90 2023-05-17T15:09:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18600acec0 con 0x7f18600ade90 2023-05-17T15:09:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.884+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858002030 con 0x7f18600ade90 2023-05-17T15:09:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.885+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1860140090 con 0x7f18600ade90 2023-05-17T15:09:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.886+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186006bdf0 con 0x7f18600ade90 2023-05-17T15:09:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.886+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f185801d070 con 0x7f18600ade90 2023-05-17T15:09:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.886+0000 7f1855ffb700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f184405ed90 0x7f1844061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.886+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f185807a6a0 con 0x7f18600ade90 2023-05-17T15:09:22.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.886+0000 7f1865a29700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f184405ed90 0x7f1844061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.887+0000 7f1865a29700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f184405ed90 0x7f1844061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f18600ae690 tx=0x7f185c009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:22.890+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f185804bd70 con 0x7f18600ade90 2023-05-17T15:09:23.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.135+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f18600c75e0 con 0x7f18600ade90 2023-05-17T15:09:23.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.742+0000 7f1855ffb700 1 -- 172.21.15.27:0/50893277 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v570) v1 ==== 151+0+0 (secure 0 0 0) 0x7f1858024070 con 0x7f18600ade90 2023-05-17T15:09:23.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f184405ed90 msgr2=0x7f1844061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:23.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f184405ed90 0x7f1844061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f18600ae690 tx=0x7f185c009040).stop 2023-05-17T15:09:23.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 msgr2=0x7f1860167490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:23.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 0x7f1860167490 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f185800cae0 tx=0x7f1858015000).stop 2023-05-17T15:09:23.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 shutdown_connections 2023-05-17T15:09:23.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f184405ed90 0x7f1844061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18600ade90 0x7f1860167490 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186013fcb0 0x7f18600a8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 --2- 172.21.15.27:0/50893277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18600a9090 0x7f18600ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 >> 172.21.15.27:0/50893277 conn(0x7f18600c8a10 msgr2=0x7f18600653d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:23.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 shutdown_connections 2023-05-17T15:09:23.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.744+0000 7f1867c8d700 1 -- 172.21.15.27:0/50893277 wait complete. 2023-05-17T15:09:23.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:09:23.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.883+0000 7f8fd0adb700 1 Processor -- start 2023-05-17T15:09:23.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.883+0000 7f8fd0adb700 1 -- start start 2023-05-17T15:09:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fd0adb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fcc0acdb0 0x7f8fcc0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fd0adb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 0x7f8fcc0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fd0adb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc155310 con 0x7f8fcc154e90 2023-05-17T15:09:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fd0adb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc157de0 con 0x7f8fcc0acdb0 2023-05-17T15:09:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fd0adb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc1580c0 con 0x7f8fcc0c5fd0 2023-05-17T15:09:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fcaffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8fcc154e90 0x7f8fcc0c58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40358/0 (socket says 172.21.15.27:40358) 2023-05-17T15:09:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fcaffd700 1 -- 172.21.15.27:0/1536895622 learned_addr learned my addr 172.21.15.27:0/1536895622 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fcbfff700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 0x7f8fcc0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/1536895622 >> v2:172.21.15.40:3300/0 conn(0x7f8fcc0acdb0 0x7f8fcc0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449994819 0 0) 0x7f8fcc155310 con 0x7f8fcc154e90 2023-05-17T15:09:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb40033f0 con 0x7f8fcc154e90 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313005339 0 0) 0x7f8fb40033f0 con 0x7f8fcc154e90 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 msgr2=0x7f8fcc0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 0x7f8fcc0a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 >> v2:172.21.15.40:3300/0 conn(0x7f8fcc0acdb0 msgr2=0x7f8fcc0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 --2- 172.21.15.27:0/1536895622 >> v2:172.21.15.40:3300/0 conn(0x7f8fcc0acdb0 0x7f8fcc0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc1583a0 con 0x7f8fcc154e90 2023-05-17T15:09:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f8fc0001470 con 0x7f8fcc154e90 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.884+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 >> v1:172.21.15.27:6789/0 conn(0x7f8fcc154e90 legacy=0x7f8fcc0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fb40038e0 0x7f8fb4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb4004690 0x7f8fb4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 0x7f8fb4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc157de0 con 0x7f8fb40038e0 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc1580c0 con 0x7f8fb4004690 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb400b8e0 con 0x7f8fcc0c5fd0 2023-05-17T15:09:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fb40038e0 0x7f8fb4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcaffd700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb4004690 0x7f8fb4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcbfff700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 0x7f8fb4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 -- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 msgr2=0x7f8fb4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc0c5fd0 0x7f8fb4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 -- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb4004690 msgr2=0x7f8fb4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb4004690 0x7f8fb4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 -- 172.21.15.27:0/1536895622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40033f0 con 0x7f8fb40038e0 2023-05-17T15:09:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fb40038e0 0x7f8fb4003d00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f8fbc009a80 tx=0x7f8fbc009060).ready entity=mon.0 client_cookie=a9fb6fa04ccfdfcc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc009430 con 0x7f8fb40038e0 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00e640 con 0x7f8fb40038e0 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.885+0000 7f8fca7fc700 1 -- 172.21.15.27:0/1536895622 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00e9c0 con 0x7f8fb40038e0 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fd0adb700 1 -- 172.21.15.27:0/1536895622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fb40038e0 msgr2=0x7f8fb4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/1536895622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fb40038e0 0x7f8fb4003d00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f8fbc009a80 tx=0x7f8fbc009060).stop 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fcbfff700 1 -- 172.21.15.27:0/1536895622 reap_dead start 2023-05-17T15:09:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fd0adb700 1 -- 172.21.15.27:0/1536895622 shutdown_connections 2023-05-17T15:09:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fd0adb700 1 -- 172.21.15.27:0/1536895622 >> 172.21.15.27:0/1536895622 conn(0x7f8fcc05dd50 msgr2=0x7f8fcc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fd0adb700 1 -- 172.21.15.27:0/1536895622 shutdown_connections 2023-05-17T15:09:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.886+0000 7f8fd0adb700 1 -- 172.21.15.27:0/1536895622 wait complete. 2023-05-17T15:09:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.887+0000 7f8fd0adb700 1 Processor -- start 2023-05-17T15:09:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.887+0000 7f8fd0adb700 1 -- start start 2023-05-17T15:09:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fd0adb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb40038e0 0x7f8fcc0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fd0adb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc163f90 0x7f8fcc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fd0adb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 0x7f8fcc168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fd0adb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc168c40 con 0x7f8fcc164410 2023-05-17T15:09:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fd0adb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc168750 con 0x7f8fb40038e0 2023-05-17T15:09:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fd0adb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc13cf40 con 0x7f8fcc163f90 2023-05-17T15:09:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 0x7f8fcc168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 0x7f8fcc168260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40810/0 (socket says 172.21.15.27:40810) 2023-05-17T15:09:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 -- 172.21.15.27:0/2379012601 learned_addr learned my addr 172.21.15.27:0/2379012601 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb40038e0 0x7f8fcc0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcaffd700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc163f90 0x7f8fcc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 -- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc163f90 msgr2=0x7f8fcc167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc163f90 0x7f8fcc167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 -- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb40038e0 msgr2=0x7f8fcc0adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb40038e0 0x7f8fcc0adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.888+0000 7f8fcbfff700 1 -- 172.21.15.27:0/2379012601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc13d450 con 0x7f8fcc164410 2023-05-17T15:09:23.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.889+0000 7f8fcbfff700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 0x7f8fcc168260 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f8fcc05f280 tx=0x7f8fc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:23.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.889+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400e070 con 0x7f8fcc164410 2023-05-17T15:09:23.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.889+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4011b80 con 0x7f8fcc164410 2023-05-17T15:09:23.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.889+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4016450 con 0x7f8fcc164410 2023-05-17T15:09:23.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.889+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc0af370 con 0x7f8fcc164410 2023-05-17T15:09:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.889+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc0aea40 con 0x7f8fcc164410 2023-05-17T15:09:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.890+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc0af500 con 0x7f8fcc164410 2023-05-17T15:09:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.890+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8fc401d030 con 0x7f8fcc164410 2023-05-17T15:09:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.890+0000 7f8fb37fe700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fb805ed90 0x7f8fb8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.890+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f8fc4079cf0 con 0x7f8fcc164410 2023-05-17T15:09:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.890+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fb805ed90 0x7f8fb8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.891+0000 7f8fcb7fe700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fb805ed90 0x7f8fb8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8fbc009a80 tx=0x7f8fbc01a000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:23.894+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fc404b410 con 0x7f8fcc164410 2023-05-17T15:09:24.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.067+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8fcc047150 con 0x7f8fcc164410 2023-05-17T15:09:24.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.072+0000 7f8fb37fe700 1 -- 172.21.15.27:0/2379012601 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8fc404ea30 con 0x7f8fcc164410 2023-05-17T15:09:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fb805ed90 msgr2=0x7f8fb8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fb805ed90 0x7f8fb8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8fbc009a80 tx=0x7f8fbc01a000).stop 2023-05-17T15:09:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 msgr2=0x7f8fcc168260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 0x7f8fcc168260 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f8fcc05f280 tx=0x7f8fc400b040).stop 2023-05-17T15:09:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 shutdown_connections 2023-05-17T15:09:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fb805ed90 0x7f8fb8061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fcc164410 0x7f8fcc168260 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb40038e0 0x7f8fcc0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 --2- 172.21.15.27:0/2379012601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fcc163f90 0x7f8fcc167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 >> 172.21.15.27:0/2379012601 conn(0x7f8fcc05dd50 msgr2=0x7f8fcc068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:24.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 shutdown_connections 2023-05-17T15:09:24.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.074+0000 7f8fd0adb700 1 -- 172.21.15.27:0/2379012601 wait complete. 2023-05-17T15:09:24.089 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:09:24.090 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:09:24.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:09:24.151 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:09:24.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:09:24.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:24.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.271+0000 7f7529c8c700 1 Processor -- start 2023-05-17T15:09:24.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.271+0000 7f7529c8c700 1 -- start start 2023-05-17T15:09:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f7529c8c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 0x7f75240c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f7529c8c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75240cb470 0x7f75240a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f7529c8c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240c05f0 con 0x7f7524153bf0 2023-05-17T15:09:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f7529c8c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240aa240 con 0x7f75240cb470 2023-05-17T15:09:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f7529c8c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240aa510 con 0x7f75240c5ef0 2023-05-17T15:09:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f75237fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 0x7f75240c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.272+0000 7f7522ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75240cb470 0x7f75240a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75237fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 0x7f75240c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:41924/0 (socket says 172.21.15.27:41924) 2023-05-17T15:09:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f7523fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7524153bf0 0x7f7524157c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46378/0 (socket says 172.21.15.27:46378) 2023-05-17T15:09:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75237fe700 1 -- 172.21.15.27:0/1307798040 learned_addr learned my addr 172.21.15.27:0/1307798040 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f7522ffd700 1 -- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 msgr2=0x7f75240c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f7522ffd700 1 --2- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 0x7f75240c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f7522ffd700 1 -- 172.21.15.27:0/1307798040 >> v1:172.21.15.40:6789/0 conn(0x7f7524153bf0 legacy=0x7f7524157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75227fc700 1 -- 172.21.15.27:0/1307798040 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761071761 0 0) 0x7f75240c05f0 con 0x7f7524153bf0 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f7522ffd700 1 -- 172.21.15.27:0/1307798040 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240bfcc0 con 0x7f75240cb470 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75237fe700 1 --2- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 0x7f75240c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f7522ffd700 1 --2- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f75240a9d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f7518009760 tx=0x7f7518009060).ready entity=mon.1 client_cookie=a1ef8861e20a03fa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75227fc700 1 -- 172.21.15.27:0/1307798040 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800f510 con 0x7f75240cb470 2023-05-17T15:09:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75227fc700 1 -- 172.21.15.27:0/1307798040 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800f670 con 0x7f75240cb470 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.273+0000 7f75227fc700 1 -- 172.21.15.27:0/1307798040 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800f9f0 con 0x7f75240cb470 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 -- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 msgr2=0x7f75240a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 --2- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f75240a9d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f7518009760 tx=0x7f7518009060).stop 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 -- 172.21.15.27:0/1307798040 shutdown_connections 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 --2- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75240c5ef0 0x7f75240c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 --2- 172.21.15.27:0/1307798040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f75240a9d50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 -- 172.21.15.27:0/1307798040 >> 172.21.15.27:0/1307798040 conn(0x7f752405e810 msgr2=0x7f75240cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 -- 172.21.15.27:0/1307798040 shutdown_connections 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.274+0000 7f7529c8c700 1 -- 172.21.15.27:0/1307798040 wait complete. 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.275+0000 7f7529c8c700 1 Processor -- start 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.275+0000 7f7529c8c700 1 -- start start 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7529c8c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 0x7f7524167880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7529c8c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f7524150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7529c8c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7524153bf0 0x7f7524141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7529c8c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241687e0 con 0x7f75240c5ef0 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7529c8c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c2030 con 0x7f75240cb470 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7529c8c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7524151270 con 0x7f7524153bf0 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 0x7f7524167880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 0x7f7524167880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40818/0 (socket says 172.21.15.27:40818) 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 -- 172.21.15.27:0/2295540712 learned_addr learned my addr 172.21.15.27:0/2295540712 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7523fff700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7524153bf0 0x7f7524141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7522ffd700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f7524150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 -- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7524153bf0 msgr2=0x7f7524141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7524153bf0 0x7f7524141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 -- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 msgr2=0x7f7524150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f7524150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 -- 172.21.15.27:0/2295540712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009370 con 0x7f75240c5ef0 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f7523fff700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7524153bf0 0x7f7524141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.276+0000 7f75237fe700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 0x7f7524167880 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f751400ea20 tx=0x7f75140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.277+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400c850 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.277+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400c9b0 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.277+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400cd30 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.277+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75180092a0 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.277+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524168220 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.278+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75240c1e60 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.278+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7514022070 con 0x7f75240c5ef0 2023-05-17T15:09:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.278+0000 7f750b7fe700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f751005ed90 0x7f7510061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.278+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f7514079f40 con 0x7f75240c5ef0 2023-05-17T15:09:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.279+0000 7f7522ffd700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f751005ed90 0x7f7510061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.279+0000 7f7522ffd700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f751005ed90 0x7f7510061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7518009760 tx=0x7f7518017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.283+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75140a88f0 con 0x7f75240c5ef0 2023-05-17T15:09:24.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.499+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f752405f4a0 con 0x7f75240c5ef0 2023-05-17T15:09:24.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.500+0000 7f750b7fe700 1 -- 172.21.15.27:0/2295540712 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f7514016070 con 0x7f75240c5ef0 2023-05-17T15:09:24.504 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:24.504 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1927606128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1927606128},{"type":"v1","addr":"172.21.15.40:6835","nonce":1927606128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1856819468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1856819468},{"type":"v1","addr":"172.21.15.40:6833","nonce":1856819468}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/640168921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":640168921},{"type":"v1","addr":"172.21.15.27:6834","nonce":640168921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3295904342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3295904342},{"type":"v1","addr":"172.21.15.27:6835","nonce":3295904342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-05-17T15:09:24.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f751005ed90 msgr2=0x7f7510061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f751005ed90 0x7f7510061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7518009760 tx=0x7f7518017000).stop 2023-05-17T15:09:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 msgr2=0x7f7524167880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 0x7f7524167880 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f751400ea20 tx=0x7f75140090f0).stop 2023-05-17T15:09:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 shutdown_connections 2023-05-17T15:09:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f751005ed90 0x7f7510061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7524153bf0 0x7f7524141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75240c5ef0 0x7f7524167880 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 --2- 172.21.15.27:0/2295540712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75240cb470 0x7f7524150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 >> 172.21.15.27:0/2295540712 conn(0x7f752405e810 msgr2=0x7f75240acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 shutdown_connections 2023-05-17T15:09:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.501+0000 7f7529c8c700 1 -- 172.21.15.27:0/2295540712 wait complete. 2023-05-17T15:09:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 38 2023-05-17T15:09:24.517 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:09:24.518 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:09:24.518 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:09:24.518 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:09:24.518 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:09:24.518 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:09:24.519 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:09:24.519 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:09:24.519 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:09:24.519 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:09:24.520 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:09:24.520 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:09:24.520 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:09:24.521 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:09:24.521 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:09:24.521 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:09:24.526 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:09:24.526 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:09:24.527 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:09:24.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:09:24.531 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:09:24.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:09:24.532 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:09:24.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:09:24.568 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:09:24.569 DEBUG:teuthology.parallel:result is None 2023-05-17T15:09:24.570 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:09:24.570 DEBUG:teuthology.parallel:result is None 2023-05-17T15:09:24.572 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:09:24.573 DEBUG:teuthology.parallel:result is None 2023-05-17T15:09:24.573 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:09:24.574 DEBUG:teuthology.parallel:result is None 2023-05-17T15:09:24.574 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:09:24.641 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:09:24.642 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:09:24.659 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:09:24.660 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:09:24.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.693+0000 7f80060d4700 1 Processor -- start 2023-05-17T15:09:24.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.693+0000 7f80060d4700 1 -- start start 2023-05-17T15:09:24.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f80060d4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8000154090 0x7f8000154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f80060d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f80000cb450 0x7f80000cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f80060d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f80060d4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8000069fa0 con 0x7f8000154090 2023-05-17T15:09:24.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f80060d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000c5a50 con 0x7f80000cb450 2023-05-17T15:09:24.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f80060d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000069880 con 0x7f8000068f00 2023-05-17T15:09:24.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8000154090 0x7f8000154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8000154090 0x7f8000154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40846/0 (socket says 172.21.15.27:40846) 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 -- 172.21.15.27:0/388529953 learned_addr learned my addr 172.21.15.27:0/388529953 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 -- 172.21.15.27:0/388529953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 msgr2=0x7f8000069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7ffffff700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7ffeffd700 1 --2- 172.21.15.27:0/388529953 >> v2:172.21.15.40:3300/0 conn(0x7f80000cb450 0x7f80000cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000069390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 -- 172.21.15.27:0/388529953 >> v2:172.21.15.40:3300/0 conn(0x7f80000cb450 msgr2=0x7f80000cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:24.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 --2- 172.21.15.27:0/388529953 >> v2:172.21.15.40:3300/0 conn(0x7f80000cb450 0x7f80000cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 -- 172.21.15.27:0/388529953 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000c04e0 con 0x7f8000154090 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7ffffff700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7ffeffd700 1 --2- 172.21.15.27:0/388529953 >> v2:172.21.15.40:3300/0 conn(0x7f80000cb450 0x7f80000cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.694+0000 7f7fff7fe700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8000154090 0x7f8000154470 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f80000bff40 tx=0x7f7ff00090f0).ready entity=mon.0 client_cookie=3bbbc517da230182 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f7ffe7fc700 1 -- 172.21.15.27:0/388529953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000b600 con 0x7f8000154090 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f7ffe7fc700 1 -- 172.21.15.27:0/388529953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000b760 con 0x7f8000154090 2023-05-17T15:09:24.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f7ffe7fc700 1 -- 172.21.15.27:0/388529953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000bae0 con 0x7f8000154090 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 -- 172.21.15.27:0/388529953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8000154090 msgr2=0x7f8000154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8000154090 0x7f8000154470 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f80000bff40 tx=0x7f7ff00090f0).stop 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 -- 172.21.15.27:0/388529953 shutdown_connections 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8000154090 0x7f8000154470 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 --2- 172.21.15.27:0/388529953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 --2- 172.21.15.27:0/388529953 >> v2:172.21.15.40:3300/0 conn(0x7f80000cb450 0x7f80000cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 -- 172.21.15.27:0/388529953 >> 172.21.15.27:0/388529953 conn(0x7f800005e7e0 msgr2=0x7f80000cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:24.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 -- 172.21.15.27:0/388529953 shutdown_connections 2023-05-17T15:09:24.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.695+0000 7f80060d4700 1 -- 172.21.15.27:0/388529953 wait complete. 2023-05-17T15:09:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.696+0000 7f80060d4700 1 Processor -- start 2023-05-17T15:09:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.696+0000 7f80060d4700 1 -- start start 2023-05-17T15:09:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f80060d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f80060d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 0x7f80000c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f80060d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8000154090 0x7f800014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f80060d4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b0e00 con 0x7f80000cb450 2023-05-17T15:09:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f80060d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000155f70 con 0x7f8000154090 2023-05-17T15:09:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f80060d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800014dd50 con 0x7f8000068f00 2023-05-17T15:09:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f7ffeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 0x7f80000c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f7ffeffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 0x7f80000c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40854/0 (socket says 172.21.15.27:40854) 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.697+0000 7f7ffeffd700 1 -- 172.21.15.27:0/3834018917 learned_addr learned my addr 172.21.15.27:0/3834018917 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffeffd700 1 -- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 msgr2=0x7f8000155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffeffd700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffeffd700 1 -- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8000154090 msgr2=0x7f800014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffffff700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8000154090 0x7f800014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffeffd700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8000154090 0x7f800014d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:24.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffeffd700 1 -- 172.21.15.27:0/3834018917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0009370 con 0x7f80000cb450 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffffff700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8000154090 0x7f800014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7ffeffd700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 0x7f80000c1de0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f7ff400c8b0 tx=0x7f7ff4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4010580 con 0x7f80000cb450 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff40106e0 con 0x7f80000cb450 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800014d870 con 0x7f80000cb450 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4010a60 con 0x7f80000cb450 2023-05-17T15:09:24.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.698+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80001567d0 con 0x7f80000cb450 2023-05-17T15:09:24.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.699+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80000c0760 con 0x7f80000cb450 2023-05-17T15:09:24.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.699+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ff401b460 con 0x7f80000cb450 2023-05-17T15:09:24.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.700+0000 7f7fe77fe700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7fec05ed90 0x7f7fec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:24.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.700+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5814+0+0 (secure 0 0 0) 0x7f7ff40798d0 con 0x7f80000cb450 2023-05-17T15:09:24.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.700+0000 7f7fff7fe700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7fec05ed90 0x7f7fec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:24.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.700+0000 7f7fff7fe700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7fec05ed90 0x7f7fec061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7ff0009fd0 tx=0x7f7ff0017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:24.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.704+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ff404af40 con 0x7f80000cb450 2023-05-17T15:09:24.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-05-17T15:09:24.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-05-17T15:09:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:24.894+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f800014d870 con 0x7f80000cb450 2023-05-17T15:09:25.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.755+0000 7f7fe77fe700 1 -- 172.21.15.27:0/3834018917 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v107) v1 ==== 97+0+0 (secure 0 0 0) 0x7f800014d870 con 0x7f80000cb450 2023-05-17T15:09:25.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7fec05ed90 msgr2=0x7f7fec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:25.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7fec05ed90 0x7f7fec061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7ff0009fd0 tx=0x7f7ff0017000).stop 2023-05-17T15:09:25.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 msgr2=0x7f80000c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:25.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 0x7f80000c1de0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f7ff400c8b0 tx=0x7f7ff4008040).stop 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 shutdown_connections 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7fec05ed90 0x7f7fec061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8000154090 0x7f800014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8000068f00 0x7f8000155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 --2- 172.21.15.27:0/3834018917 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80000cb450 0x7f80000c1de0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 >> 172.21.15.27:0/3834018917 conn(0x7f800005e7e0 msgr2=0x7f80000ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:25.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 shutdown_connections 2023-05-17T15:09:25.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.757+0000 7f80060d4700 1 -- 172.21.15.27:0/3834018917 wait complete. 2023-05-17T15:09:25.763 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:09:25.776 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:09:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.895+0000 7fac2eefb700 1 Processor -- start 2023-05-17T15:09:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.895+0000 7fac2eefb700 1 -- start start 2023-05-17T15:09:25.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2eefb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac280c64a0 0x7fac28153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2eefb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 0x7fac280c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2eefb700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac280aa680 con 0x7fac280c60c0 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2eefb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280c68e0 con 0x7fac280c64a0 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2eefb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2805e7e0 con 0x7fac28154260 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2cc97700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fac280c60c0 0x7fac280a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40426/0 (socket says 172.21.15.27:40426) 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2cc97700 1 -- 172.21.15.27:0/3021666719 learned_addr learned my addr 172.21.15.27:0/3021666719 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:25.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac2d498700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 0x7fac280c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac27fff700 1 --2- 172.21.15.27:0/3021666719 >> v2:172.21.15.40:3300/0 conn(0x7fac280c64a0 0x7fac28153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874437485 0 0) 0x7fac280aa680 con 0x7fac280c60c0 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac140033f0 con 0x7fac280c60c0 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918614298 0 0) 0x7fac140033f0 con 0x7fac280c60c0 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 msgr2=0x7fac280c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 0x7fac280c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 >> v2:172.21.15.40:3300/0 conn(0x7fac280c64a0 msgr2=0x7fac28153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.896+0000 7fac277fe700 1 --2- 172.21.15.27:0/3021666719 >> v2:172.21.15.40:3300/0 conn(0x7fac280c64a0 0x7fac28153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2805eac0 con 0x7fac280c60c0 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fac200017f0 con 0x7fac280c60c0 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 >> v1:172.21.15.27:6789/0 conn(0x7fac280c60c0 legacy=0x7fac280a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac140038e0 0x7fac14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 0x7fac14004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac14004b80 0x7fac14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac280c68e0 con 0x7fac140038e0 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2805e7e0 con 0x7fac14004b80 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1400b8e0 con 0x7fac28154260 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac140038e0 0x7fac14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac27fff700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 0x7fac14004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2d498700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac14004b80 0x7fac14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 -- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 msgr2=0x7fac14004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac28154260 0x7fac14004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 -- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac14004b80 msgr2=0x7fac14005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac14004b80 0x7fac14005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 -- 172.21.15.27:0/3021666719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140033f0 con 0x7fac140038e0 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2d498700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac14004b80 0x7fac14005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac2cc97700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac140038e0 0x7fac14003d00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fac2000c530 tx=0x7fac20002210).ready entity=mon.0 client_cookie=ddfcc0b581b00928 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20007de0 con 0x7fac140038e0 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000ce60 con 0x7fac140038e0 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.897+0000 7fac277fe700 1 -- 172.21.15.27:0/3021666719 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20005d50 con 0x7fac140038e0 2023-05-17T15:09:25.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2eefb700 1 -- 172.21.15.27:0/3021666719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac140038e0 msgr2=0x7fac14003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2eefb700 1 --2- 172.21.15.27:0/3021666719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac140038e0 0x7fac14003d00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fac2000c530 tx=0x7fac20002210).stop 2023-05-17T15:09:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2d498700 1 -- 172.21.15.27:0/3021666719 reap_dead start 2023-05-17T15:09:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2eefb700 1 -- 172.21.15.27:0/3021666719 shutdown_connections 2023-05-17T15:09:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2eefb700 1 -- 172.21.15.27:0/3021666719 >> 172.21.15.27:0/3021666719 conn(0x7fac28069e70 msgr2=0x7fac2805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2eefb700 1 -- 172.21.15.27:0/3021666719 shutdown_connections 2023-05-17T15:09:25.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.898+0000 7fac2eefb700 1 -- 172.21.15.27:0/3021666719 wait complete. 2023-05-17T15:09:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.899+0000 7fac2eefb700 1 Processor -- start 2023-05-17T15:09:25.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.899+0000 7fac2eefb700 1 -- start start 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2eefb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac140038e0 0x7fac280c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2eefb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280ca2f0 0x7fac28155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2eefb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 0x7fac28155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2eefb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28156480 con 0x7fac28155b30 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2eefb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac280cbb10 con 0x7fac280ca2f0 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2eefb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2814ee40 con 0x7fac140038e0 2023-05-17T15:09:25.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 0x7fac28155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 0x7fac28155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40878/0 (socket says 172.21.15.27:40878) 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 -- 172.21.15.27:0/472340550 learned_addr learned my addr 172.21.15.27:0/472340550 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2cc97700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac140038e0 0x7fac280c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac27fff700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280ca2f0 0x7fac28155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 -- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac140038e0 msgr2=0x7fac280c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac140038e0 0x7fac280c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 -- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280ca2f0 msgr2=0x7fac28155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:25.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280ca2f0 0x7fac28155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 -- 172.21.15.27:0/472340550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28152da0 con 0x7fac28155b30 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac27fff700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280ca2f0 0x7fac28155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.900+0000 7fac2d498700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 0x7fac28155f90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fac28157dc0 tx=0x7fac10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.901+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10009360 con 0x7fac28155b30 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.901+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac10013580 con 0x7fac28155b30 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.901+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10013900 con 0x7fac28155b30 2023-05-17T15:09:25.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.901+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac280caa70 con 0x7fac28155b30 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.901+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac280cb030 con 0x7fac28155b30 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.902+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2805f4a0 con 0x7fac28155b30 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.902+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fac10012040 con 0x7fac28155b30 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.902+0000 7fac24ff9700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac0805ed90 0x7fac08061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.902+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5341+0+0 (secure 0 0 0) 0x7fac100796c0 con 0x7fac28155b30 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.902+0000 7fac2cc97700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac0805ed90 0x7fac08061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:25.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.903+0000 7fac2cc97700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac0805ed90 0x7fac08061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fac20002250 tx=0x7fac20015000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:25.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:25.907+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac1004af70 con 0x7fac28155b30 2023-05-17T15:09:26.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.146+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fac2806bdf0 con 0x7fac28155b30 2023-05-17T15:09:26.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.146+0000 7fac24ff9700 1 -- 172.21.15.27:0/472340550 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fac1004ee60 con 0x7fac28155b30 2023-05-17T15:09:26.152 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:26.153 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:09:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:09:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.153 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:09:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:09:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.154 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:09:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:09:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.155 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.156 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:09:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:09:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.157 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:09:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:09:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.158 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.159 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:09:26.160 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:09:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:09:26.161 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:09:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.162 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:09:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:09:26.163 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:09:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:09:26.164 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:09:26.166 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.167 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:09:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:09:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.168 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.169 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:09:26.170 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.171 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:09:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:09:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.173 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:09:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:09:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.175 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:09:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:09:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.176 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:09:26.177 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:09:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:09:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:09:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.179 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:09:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:09:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.180 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:09:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:09:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:09:26.181 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:09:26.182 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:09:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:09:26.183 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:09:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:09:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:09:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:09:26.185 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:09:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:09:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:09:26.186 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:09:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:09:26.187 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:09:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:09:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:09:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:09:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.188 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:09:26.189 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:09:26.190 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:09:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:09:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:09:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:26.191 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:09:26.191 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:09:26.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac0805ed90 msgr2=0x7fac08061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac0805ed90 0x7fac08061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fac20002250 tx=0x7fac20015000).stop 2023-05-17T15:09:26.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 msgr2=0x7fac28155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 0x7fac28155f90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fac28157dc0 tx=0x7fac10008040).stop 2023-05-17T15:09:26.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 shutdown_connections 2023-05-17T15:09:26.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fac0805ed90 0x7fac08061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac28155b30 0x7fac28155f90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac140038e0 0x7fac280c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 --2- 172.21.15.27:0/472340550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280ca2f0 0x7fac28155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 >> 172.21.15.27:0/472340550 conn(0x7fac28069e70 msgr2=0x7fac280ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 shutdown_connections 2023-05-17T15:09:26.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.149+0000 7fac2eefb700 1 -- 172.21.15.27:0/472340550 wait complete. 2023-05-17T15:09:26.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.307+0000 7f4440c98700 1 Processor -- start 2023-05-17T15:09:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.307+0000 7f4440c98700 1 -- start start 2023-05-17T15:09:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f4440c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 0x7f443c069060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f4440c98700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0c07a0 con 0x7f443c153fa0 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f4440c98700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0c1c40 con 0x7f443c0c6490 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f4440c98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c069d70 con 0x7f443c0aae70 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f443a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f443c153fa0 0x7f443c0c5d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40444/0 (socket says 172.21.15.27:40444) 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f443a59c700 1 -- 172.21.15.27:0/2047011708 learned_addr learned my addr 172.21.15.27:0/2047011708 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f4439d9b700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 0x7f443c069060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170956247 0 0) 0x7f443c0c07a0 con 0x7f443c153fa0 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.308+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44280033f0 con 0x7f443c153fa0 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913598931 0 0) 0x7f443c0c1c40 con 0x7f443c0c6490 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443c0c07a0 con 0x7f443c0c6490 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2354540065 0 0) 0x7f44280033f0 con 0x7f443c153fa0 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 msgr2=0x7f443c069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 0x7f443c069060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 >> v1:172.21.15.40:6789/0 conn(0x7f443c0c6490 legacy=0x7f443c069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0bfe70 con 0x7f443c153fa0 2023-05-17T15:09:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f44340017f0 con 0x7f443c153fa0 2023-05-17T15:09:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 >> v1:172.21.15.27:6789/0 conn(0x7f443c153fa0 legacy=0x7f443c0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4428003aa0 0x7f4428003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 0x7f4428004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f4428005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c069d70 con 0x7f4428004b80 2023-05-17T15:09:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442800b910 con 0x7f4428003aa0 2023-05-17T15:09:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442800bad0 con 0x7f443c0aae70 2023-05-17T15:09:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f4428005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443a59c700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4428003aa0 0x7f4428003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f4439d9b700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 0x7f4428004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 -- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 msgr2=0x7f4428004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c0aae70 0x7f4428004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 -- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4428003aa0 msgr2=0x7f4428003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4428003aa0 0x7f4428003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 -- 172.21.15.27:0/2047011708 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280033f0 con 0x7f4428004b80 2023-05-17T15:09:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.309+0000 7f443ad9d700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f4428005000 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f443c0cad40 tx=0x7f442c007bb0).ready entity=mon.0 client_cookie=3af13fb2fd55c280 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c007020 con 0x7f4428004b80 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c007180 con 0x7f4428004b80 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f443959a700 1 -- 172.21.15.27:0/2047011708 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c007500 con 0x7f4428004b80 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f4440c98700 1 -- 172.21.15.27:0/2047011708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 msgr2=0x7f4428005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f4440c98700 1 --2- 172.21.15.27:0/2047011708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f4428005000 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f443c0cad40 tx=0x7f442c007bb0).stop 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f443ad9d700 1 -- 172.21.15.27:0/2047011708 reap_dead start 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f4440c98700 1 -- 172.21.15.27:0/2047011708 shutdown_connections 2023-05-17T15:09:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f4440c98700 1 -- 172.21.15.27:0/2047011708 >> 172.21.15.27:0/2047011708 conn(0x7f443c0cb810 msgr2=0x7f443c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:26.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f4440c98700 1 -- 172.21.15.27:0/2047011708 shutdown_connections 2023-05-17T15:09:26.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.310+0000 7f4440c98700 1 -- 172.21.15.27:0/2047011708 wait complete. 2023-05-17T15:09:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.311+0000 7f4440c98700 1 Processor -- start 2023-05-17T15:09:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.311+0000 7f4440c98700 1 -- start start 2023-05-17T15:09:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4440c98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f443c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4440c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c165090 0x7f443c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4440c98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c14fc10 0x7f443c150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4440c98700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c157570 con 0x7f4428004b80 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4440c98700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c150580 con 0x7f443c14fc10 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4440c98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c152460 con 0x7f443c165090 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f443c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f443c151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40894/0 (socket says 172.21.15.27:40894) 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 -- 172.21.15.27:0/4066323229 learned_addr learned my addr 172.21.15.27:0/4066323229 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f4439d9b700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c165090 0x7f443c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443ad9d700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c14fc10 0x7f443c150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 -- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c165090 msgr2=0x7f443c0c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c165090 0x7f443c0c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 -- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c14fc10 msgr2=0x7f443c150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c14fc10 0x7f443c150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 -- 172.21.15.27:0/4066323229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c152740 con 0x7f4428004b80 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443ad9d700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c14fc10 0x7f443c150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:26.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.312+0000 7f443a59c700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f443c151e30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f4434007710 tx=0x7f4434007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.313+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400f870 con 0x7f4428004b80 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.313+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400f9d0 con 0x7f4428004b80 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.313+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c152a20 con 0x7f4428004b80 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.313+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400fd90 con 0x7f4428004b80 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.313+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c165510 con 0x7f4428004b80 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.313+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c153070 con 0x7f4428004b80 2023-05-17T15:09:26.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.314+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4434012560 con 0x7f4428004b80 2023-05-17T15:09:26.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.314+0000 7f44327fc700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f441c05ed90 0x7f441c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.314+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f4434079340 con 0x7f4428004b80 2023-05-17T15:09:26.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.314+0000 7f4439d9b700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f441c05ed90 0x7f441c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.315+0000 7f4439d9b700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f441c05ed90 0x7f441c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f443c154fb0 tx=0x7f4424006f40).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.318+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f443404aa80 con 0x7f4428004b80 2023-05-17T15:09:26.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.492+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443c0c0150 con 0x7f4428004b80 2023-05-17T15:09:26.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.493+0000 7f44327fc700 1 -- 172.21.15.27:0/4066323229 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+13829 (secure 0 0 0) 0x7f4434019020 con 0x7f4428004b80 2023-05-17T15:09:26.498 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:26.499 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":107,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:25.745053+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:26.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f441c05ed90 msgr2=0x7f441c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f441c05ed90 0x7f441c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f443c154fb0 tx=0x7f4424006f40).stop 2023-05-17T15:09:26.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 msgr2=0x7f443c151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f443c151e30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f4434007710 tx=0x7f4434007f20).stop 2023-05-17T15:09:26.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 shutdown_connections 2023-05-17T15:09:26.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f441c05ed90 0x7f441c061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c14fc10 0x7f443c150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4428004b80 0x7f443c151e30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 --2- 172.21.15.27:0/4066323229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c165090 0x7f443c0c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.495+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 >> 172.21.15.27:0/4066323229 conn(0x7f443c0cb810 msgr2=0x7f443c0ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.496+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 shutdown_connections 2023-05-17T15:09:26.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.496+0000 7f4440c98700 1 -- 172.21.15.27:0/4066323229 wait complete. 2023-05-17T15:09:26.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:09:26.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:09:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.627+0000 7f428add0700 1 Processor -- start 2023-05-17T15:09:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.627+0000 7f428add0700 1 -- start start 2023-05-17T15:09:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428add0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42841543d0 0x7f42840c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428add0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 0x7f4284068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428add0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840c0c90 con 0x7f42840691f0 2023-05-17T15:09:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428add0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840c1c50 con 0x7f42841543d0 2023-05-17T15:09:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428add0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4284158790 con 0x7f42840c60f0 2023-05-17T15:09:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428936d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f42840691f0 0x7f42841547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40466/0 (socket says 172.21.15.27:40466) 2023-05-17T15:09:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.628+0000 7f428936d700 1 -- 172.21.15.27:0/3652197307 learned_addr learned my addr 172.21.15.27:0/3652197307 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f4288b6c700 1 --2- 172.21.15.27:0/3652197307 >> v2:172.21.15.40:3300/0 conn(0x7f42841543d0 0x7f42840c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f4283fff700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 0x7f4284068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495501321 0 0) 0x7f42840c0c90 con 0x7f42840691f0 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42700033f0 con 0x7f42840691f0 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520402406 0 0) 0x7f42700033f0 con 0x7f42840691f0 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 msgr2=0x7f4284068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 0x7f4284068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 >> v2:172.21.15.40:3300/0 conn(0x7f42841543d0 msgr2=0x7f42840c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 --2- 172.21.15.27:0/3652197307 >> v2:172.21.15.40:3300/0 conn(0x7f42841543d0 0x7f42840c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840c6570 con 0x7f42840691f0 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f4274001470 con 0x7f42840691f0 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 >> v1:172.21.15.27:6789/0 conn(0x7f42840691f0 legacy=0x7f42841547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42700038e0 0x7f4270003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 0x7f4270004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4270004b80 0x7f4270005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284158790 con 0x7f4270004b80 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42700044c0 con 0x7f42700038e0 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427000b930 con 0x7f42840c60f0 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f4288b6c700 1 --2- 172.21.15.27:0/3652197307 >> v2:172.21.15.40:3300/0 conn(0x7f42841543d0 0x7f42840c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f428936d700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4270004b80 0x7f4270005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f4283fff700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 0x7f4270004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.629+0000 7f4288b6c700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42700038e0 0x7f4270003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 -- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 msgr2=0x7f4270004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42840c60f0 0x7f4270004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 -- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42700038e0 msgr2=0x7f4270003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42700038e0 0x7f4270003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 -- 172.21.15.27:0/3652197307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700033f0 con 0x7f4270004b80 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4270004b80 0x7f4270005000 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f427400c240 tx=0x7f4274001e90).ready entity=mon.0 client_cookie=41fc9e0b57e69a76 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274007a60 con 0x7f4270004b80 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427400cad0 con 0x7f4270004b80 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f42837fe700 1 -- 172.21.15.27:0/3652197307 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400ce70 con 0x7f4270004b80 2023-05-17T15:09:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428add0700 1 -- 172.21.15.27:0/3652197307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4270004b80 msgr2=0x7f4270005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428add0700 1 --2- 172.21.15.27:0/3652197307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4270004b80 0x7f4270005000 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f427400c240 tx=0x7f4274001e90).stop 2023-05-17T15:09:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428936d700 1 -- 172.21.15.27:0/3652197307 reap_dead start 2023-05-17T15:09:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428add0700 1 -- 172.21.15.27:0/3652197307 shutdown_connections 2023-05-17T15:09:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428add0700 1 -- 172.21.15.27:0/3652197307 >> 172.21.15.27:0/3652197307 conn(0x7f42840cb7f0 msgr2=0x7f42840c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428add0700 1 -- 172.21.15.27:0/3652197307 shutdown_connections 2023-05-17T15:09:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.630+0000 7f428add0700 1 -- 172.21.15.27:0/3652197307 wait complete. 2023-05-17T15:09:26.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.631+0000 7f428add0700 1 Processor -- start 2023-05-17T15:09:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 -- start start 2023-05-17T15:09:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4270004b80 0x7f4284163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4284166ec0 0x7f42841547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 0x7f42840af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284155d80 con 0x7f4284154ca0 2023-05-17T15:09:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284167340 con 0x7f4270004b80 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428add0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4284155170 con 0x7f4284166ec0 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.632+0000 7f428936d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 0x7f42840af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 0x7f42840af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40918/0 (socket says 172.21.15.27:40918) 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 -- 172.21.15.27:0/1162836305 learned_addr learned my addr 172.21.15.27:0/1162836305 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f4288b6c700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4270004b80 0x7f4284163fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f4283fff700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4284166ec0 0x7f42841547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 -- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4284166ec0 msgr2=0x7f42841547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4284166ec0 0x7f42841547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 -- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4270004b80 msgr2=0x7f4284163fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4270004b80 0x7f4284163fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 -- 172.21.15.27:0/1162836305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284155450 con 0x7f4284154ca0 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428936d700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 0x7f42840af140 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f4270004490 tx=0x7f4274015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400ce70 con 0x7f4284154ca0 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274019030 con 0x7f4284154ca0 2023-05-17T15:09:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4284155730 con 0x7f4284154ca0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740048e0 con 0x7f4284154ca0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.633+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42840aea60 con 0x7f4284154ca0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.634+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42840aec50 con 0x7f4284154ca0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.634+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4274027070 con 0x7f4284154ca0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.635+0000 7f4280ff9700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f426405ed90 0x7f4264061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.635+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f427401c040 con 0x7f4284154ca0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.635+0000 7f4288b6c700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f426405ed90 0x7f4264061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.635+0000 7f4288b6c700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f426405ed90 0x7f4264061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f427c006f70 tx=0x7f427c008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.639+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42840aec50 con 0x7f4284154ca0 2023-05-17T15:09:26.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.811+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4284155f30 con 0x7f4284154ca0 2023-05-17T15:09:26.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.812+0000 7f4280ff9700 1 -- 172.21.15.27:0/1162836305 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v107) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4284155f30 con 0x7f4284154ca0 2023-05-17T15:09:26.818 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:09:26.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.813+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f426405ed90 msgr2=0x7f4264061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.813+0000 7f428add0700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f426405ed90 0x7f4264061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f427c006f70 tx=0x7f427c008040).stop 2023-05-17T15:09:26.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.813+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 msgr2=0x7f42840af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.813+0000 7f428add0700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 0x7f42840af140 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f4270004490 tx=0x7f4274015000).stop 2023-05-17T15:09:26.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 shutdown_connections 2023-05-17T15:09:26.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f426405ed90 0x7f4264061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4284154ca0 0x7f42840af140 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4270004b80 0x7f4284163fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 --2- 172.21.15.27:0/1162836305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4284166ec0 0x7f42841547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 >> 172.21.15.27:0/1162836305 conn(0x7f42840cb7f0 msgr2=0x7f42840c0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:26.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 shutdown_connections 2023-05-17T15:09:26.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.814+0000 7f428add0700 1 -- 172.21.15.27:0/1162836305 wait complete. 2023-05-17T15:09:26.831 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:09:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.947+0000 7f4a362f3700 1 Processor -- start 2023-05-17T15:09:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.947+0000 7f4a362f3700 1 -- start start 2023-05-17T15:09:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a362f3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a300cac00 0x7f4a300cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a362f3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a30158010 con 0x7f4a30157980 2023-05-17T15:09:26.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a362f3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a301582f0 con 0x7f4a30153ef0 2023-05-17T15:09:26.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a362f3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a301588b0 con 0x7f4a300cac00 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a34af0700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4a30157980 0x7f4a301537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40486/0 (socket says 172.21.15.27:40486) 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a34af0700 1 -- 172.21.15.27:0/2459792904 learned_addr learned my addr 172.21.15.27:0/2459792904 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.948+0000 7f4a352f1700 1 --2- 172.21.15.27:0/2459792904 >> v2:172.21.15.27:3300/0 conn(0x7f4a300cac00 0x7f4a300cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a2ffff700 1 -- 172.21.15.27:0/2459792904 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882781073 0 0) 0x7f4a30158010 con 0x7f4a30157980 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a2ffff700 1 -- 172.21.15.27:0/2459792904 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a180033f0 con 0x7f4a30157980 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a352f1700 1 -- 172.21.15.27:0/2459792904 >> v1:172.21.15.40:6789/0 conn(0x7f4a30153ef0 legacy=0x7f4a300c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a352f1700 1 -- 172.21.15.27:0/2459792904 >> v1:172.21.15.27:6789/0 conn(0x7f4a30157980 legacy=0x7f4a301537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a352f1700 1 -- 172.21.15.27:0/2459792904 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a301585d0 con 0x7f4a300cac00 2023-05-17T15:09:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a352f1700 1 --2- 172.21.15.27:0/2459792904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a300cafe0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f4a28009760 tx=0x7f4a28009060).ready entity=mon.0 client_cookie=117d4e002d26b86 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a2ffff700 1 -- 172.21.15.27:0/2459792904 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800f510 con 0x7f4a300cac00 2023-05-17T15:09:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a2ffff700 1 -- 172.21.15.27:0/2459792904 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2800f670 con 0x7f4a300cac00 2023-05-17T15:09:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a2ffff700 1 -- 172.21.15.27:0/2459792904 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800f9f0 con 0x7f4a300cac00 2023-05-17T15:09:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a362f3700 1 -- 172.21.15.27:0/2459792904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 msgr2=0x7f4a300cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2459792904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a300cafe0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f4a28009760 tx=0x7f4a28009060).stop 2023-05-17T15:09:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a362f3700 1 -- 172.21.15.27:0/2459792904 shutdown_connections 2023-05-17T15:09:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2459792904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a300cafe0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.949+0000 7f4a362f3700 1 -- 172.21.15.27:0/2459792904 >> 172.21.15.27:0/2459792904 conn(0x7f4a3005dd50 msgr2=0x7f4a3005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.950+0000 7f4a362f3700 1 -- 172.21.15.27:0/2459792904 shutdown_connections 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.950+0000 7f4a362f3700 1 -- 172.21.15.27:0/2459792904 wait complete. 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.951+0000 7f4a362f3700 1 Processor -- start 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.951+0000 7f4a362f3700 1 -- start start 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a30165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a30153ef0 0x7f4a300a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a30157980 0x7f4a30164be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30157090 con 0x7f4a300cac00 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301557a0 con 0x7f4a30157980 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30155a80 con 0x7f4a30153ef0 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a30165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a30165370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40928/0 (socket says 172.21.15.27:40928) 2023-05-17T15:09:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 -- 172.21.15.27:0/2585405429 learned_addr learned my addr 172.21.15.27:0/2585405429 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a34af0700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a30153ef0 0x7f4a300a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a35af2700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a30157980 0x7f4a30164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 -- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a30153ef0 msgr2=0x7f4a300a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a30153ef0 0x7f4a300a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 -- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a30157980 msgr2=0x7f4a30164be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a30157980 0x7f4a30164be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 -- 172.21.15.27:0/2585405429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280092a0 con 0x7f4a300cac00 2023-05-17T15:09:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a352f1700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a30165370 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f4a28009e00 tx=0x7f4a28017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28011bc0 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28011d20 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a30155d60 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2801b660 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.952+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a301650d0 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.953+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300a9750 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.954+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4a2802b070 con 0x7f4a300cac00 2023-05-17T15:09:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.954+0000 7f4a2d7fa700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a1c05ed90 0x7f4a1c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.954+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f4a2807af30 con 0x7f4a300cac00 2023-05-17T15:09:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.954+0000 7f4a34af0700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a1c05ed90 0x7f4a1c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.955+0000 7f4a34af0700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a1c05ed90 0x7f4a1c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4a300c18c0 tx=0x7f4a24009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:26.958+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a280a98f0 con 0x7f4a300cac00 2023-05-17T15:09:27.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.131+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a300c1e80 con 0x7f4a300cac00 2023-05-17T15:09:27.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.131+0000 7f4a2d7fa700 1 -- 172.21.15.27:0/2585405429 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a28029020 con 0x7f4a300cac00 2023-05-17T15:09:27.137 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:09:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a1c05ed90 msgr2=0x7f4a1c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a1c05ed90 0x7f4a1c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4a300c18c0 tx=0x7f4a24009040).stop 2023-05-17T15:09:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 msgr2=0x7f4a30165370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a30165370 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f4a28009e00 tx=0x7f4a28017000).stop 2023-05-17T15:09:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 shutdown_connections 2023-05-17T15:09:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4a1c05ed90 0x7f4a1c061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a30157980 0x7f4a30164be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a300cac00 0x7f4a30165370 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 --2- 172.21.15.27:0/2585405429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a30153ef0 0x7f4a300a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 >> 172.21.15.27:0/2585405429 conn(0x7f4a3005dd50 msgr2=0x7f4a300ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 shutdown_connections 2023-05-17T15:09:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.133+0000 7f4a362f3700 1 -- 172.21.15.27:0/2585405429 wait complete. 2023-05-17T15:09:27.150 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:09:27.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.262+0000 7f28fffff700 1 Processor -- start 2023-05-17T15:09:27.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.262+0000 7f28fffff700 1 -- start start 2023-05-17T15:09:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29000c1180 0x7f29000c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29001544f0 0x7f29000a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000c07e0 con 0x7f29000aa070 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29001549b0 con 0x7f29001544f0 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2900154c90 con 0x7f29000c1180 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29001544f0 0x7f29000a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29001544f0 0x7f29000a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40936/0 (socket says 172.21.15.27:40936) 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 -- 172.21.15.27:0/2837602108 learned_addr learned my addr 172.21.15.27:0/2837602108 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28feffd700 1 --2- 172.21.15.27:0/2837602108 >> v2:172.21.15.40:3300/0 conn(0x7f29000c1180 0x7f29000c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 -- 172.21.15.27:0/2837602108 >> v2:172.21.15.40:3300/0 conn(0x7f29000c1180 msgr2=0x7f29000c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/2837602108 >> v2:172.21.15.40:3300/0 conn(0x7f29000c1180 0x7f29000c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 -- 172.21.15.27:0/2837602108 >> v1:172.21.15.40:6789/0 conn(0x7f29000aa070 legacy=0x7f29000c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.263+0000 7f28fe7fc700 1 -- 172.21.15.27:0/2837602108 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2900154f70 con 0x7f29001544f0 2023-05-17T15:09:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/2837602108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29001544f0 0x7f29000a9b80 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f2900062c80 tx=0x7f28f40090f0).ready entity=mon.0 client_cookie=b165e336eabb960e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fdffb700 1 -- 172.21.15.27:0/2837602108 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400b520 con 0x7f29001544f0 2023-05-17T15:09:27.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fdffb700 1 -- 172.21.15.27:0/2837602108 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400b680 con 0x7f29001544f0 2023-05-17T15:09:27.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fdffb700 1 -- 172.21.15.27:0/2837602108 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400ba20 con 0x7f29001544f0 2023-05-17T15:09:27.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 -- 172.21.15.27:0/2837602108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29001544f0 msgr2=0x7f29000a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 --2- 172.21.15.27:0/2837602108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29001544f0 0x7f29000a9b80 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f2900062c80 tx=0x7f28f40090f0).stop 2023-05-17T15:09:27.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 -- 172.21.15.27:0/2837602108 shutdown_connections 2023-05-17T15:09:27.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 --2- 172.21.15.27:0/2837602108 >> v2:172.21.15.40:3300/0 conn(0x7f29000c1180 0x7f29000c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 --2- 172.21.15.27:0/2837602108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29001544f0 0x7f29000a9b80 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 -- 172.21.15.27:0/2837602108 >> 172.21.15.27:0/2837602108 conn(0x7f290005dd50 msgr2=0x7f290005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:27.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 -- 172.21.15.27:0/2837602108 shutdown_connections 2023-05-17T15:09:27.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.264+0000 7f28fffff700 1 -- 172.21.15.27:0/2837602108 wait complete. 2023-05-17T15:09:27.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.265+0000 7f28fffff700 1 Processor -- start 2023-05-17T15:09:27.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.265+0000 7f28fffff700 1 -- start start 2023-05-17T15:09:27.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29000aa070 0x7f29000c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 0x7f29000c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29001544f0 0x7f290014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900155d70 con 0x7f29000c1180 2023-05-17T15:09:27.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900155790 con 0x7f29000aa070 2023-05-17T15:09:27.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000ca290 con 0x7f29001544f0 2023-05-17T15:09:27.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fe7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 0x7f29000c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fe7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 0x7f29000c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40942/0 (socket says 172.21.15.27:40942) 2023-05-17T15:09:27.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28fe7fc700 1 -- 172.21.15.27:0/3790280574 learned_addr learned my addr 172.21.15.27:0/3790280574 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:27.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28feffd700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29000aa070 0x7f29000c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.266+0000 7f28ff7fe700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29001544f0 0x7f290014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fe7fc700 1 -- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29001544f0 msgr2=0x7f290014c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29001544f0 0x7f290014c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fe7fc700 1 -- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29000aa070 msgr2=0x7f29000c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29000aa070 0x7f29000c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fe7fc700 1 -- 172.21.15.27:0/3790280574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4009370 con 0x7f29000c1180 2023-05-17T15:09:27.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fe7fc700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 0x7f29000c9da0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f28f4002f30 tx=0x7f28f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:27.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4006d90 con 0x7f29000c1180 2023-05-17T15:09:27.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f4000bc0 con 0x7f29000c1180 2023-05-17T15:09:27.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000ca510 con 0x7f29000c1180 2023-05-17T15:09:27.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400ba00 con 0x7f29000c1180 2023-05-17T15:09:27.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.267+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290014cd10 con 0x7f29000c1180 2023-05-17T15:09:27.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.268+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290006bdf0 con 0x7f29000c1180 2023-05-17T15:09:27.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.268+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f28f400f070 con 0x7f29000c1180 2023-05-17T15:09:27.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.269+0000 7f28e6ffd700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f28ec05ed60 0x7f28ec061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.269+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5341+0+0 (secure 0 0 0) 0x7f28f407b1d0 con 0x7f29000c1180 2023-05-17T15:09:27.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.269+0000 7f28feffd700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f28ec05ed60 0x7f28ec061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.269+0000 7f28feffd700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f28ec05ed60 0x7f28ec061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f28f8009c30 tx=0x7f28f8009060).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:27.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.273+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28f404ca20 con 0x7f29000c1180 2023-05-17T15:09:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.447+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f290005ead0 con 0x7f29000c1180 2023-05-17T15:09:27.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.448+0000 7f28e6ffd700 1 -- 172.21.15.27:0/3790280574 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) v1 ==== 84+0+143 (secure 0 0 0) 0x7f28f4050040 con 0x7f29000c1180 2023-05-17T15:09:27.453 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:27.453 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:09:27.454 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:09:27.455 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:27.455 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.449+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f28ec05ed60 msgr2=0x7f28ec061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.449+0000 7f28fffff700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f28ec05ed60 0x7f28ec061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f28f8009c30 tx=0x7f28f8009060).stop 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.449+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 msgr2=0x7f29000c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.449+0000 7f28fffff700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 0x7f29000c9da0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f28f4002f30 tx=0x7f28f4017000).stop 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 shutdown_connections 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f28ec05ed60 0x7f28ec061220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29001544f0 0x7f290014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29000aa070 0x7f29000c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 --2- 172.21.15.27:0/3790280574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29000c1180 0x7f29000c9da0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 >> 172.21.15.27:0/3790280574 conn(0x7f290005dd50 msgr2=0x7f29000abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 shutdown_connections 2023-05-17T15:09:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.450+0000 7f28fffff700 1 -- 172.21.15.27:0/3790280574 wait complete. 2023-05-17T15:09:27.468 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:09:27.469 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:09:27.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.585+0000 7fd3f89e5700 1 Processor -- start 2023-05-17T15:09:27.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.585+0000 7fd3f89e5700 1 -- start start 2023-05-17T15:09:27.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f89e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f4151c90 0x7fd3f4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f89e5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3f4154980 0x7fd3f40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f89e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3f40c0520 0x7fd3f4081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f89e5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f4158010 con 0x7fd3f4154980 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f89e5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f4154f60 con 0x7fd3f40c0520 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f89e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4155240 con 0x7fd3f4151c90 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3f4154980 0x7fd3f40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3f4154980 0x7fd3f40c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40948/0 (socket says 172.21.15.27:40948) 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3524527146 learned_addr learned my addr 172.21.15.27:0/3524527146 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:27.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f259c700 1 --2- 172.21.15.27:0/3524527146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f4151c90 0x7fd3f4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f2d9d700 1 --2- 172.21.15.27:0/3524527146 >> v2:172.21.15.40:3300/0 conn(0x7fd3f40c0520 0x7fd3f4081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3524527146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f4151c90 msgr2=0x7fd3f4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 --2- 172.21.15.27:0/3524527146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f4151c90 0x7fd3f4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3524527146 >> v2:172.21.15.40:3300/0 conn(0x7fd3f40c0520 msgr2=0x7fd3f4081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 --2- 172.21.15.27:0/3524527146 >> v2:172.21.15.40:3300/0 conn(0x7fd3f40c0520 0x7fd3f4081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3524527146 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4155520 con 0x7fd3f4154980 2023-05-17T15:09:27.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f2d9d700 1 --2- 172.21.15.27:0/3524527146 >> v2:172.21.15.40:3300/0 conn(0x7fd3f40c0520 0x7fd3f4081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:27.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.586+0000 7fd3f1d9b700 1 --2- 172.21.15.27:0/3524527146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4154980 0x7fd3f40c6150 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fd3f405fcf0 tx=0x7fd3dc009840).ready entity=mon.0 client_cookie=38f03f4365d45d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:27.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f159a700 1 -- 172.21.15.27:0/3524527146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00e070 con 0x7fd3f4154980 2023-05-17T15:09:27.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f159a700 1 -- 172.21.15.27:0/3524527146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc00ba50 con 0x7fd3f4154980 2023-05-17T15:09:27.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f159a700 1 -- 172.21.15.27:0/3524527146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00bdd0 con 0x7fd3f4154980 2023-05-17T15:09:27.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3524527146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4154980 msgr2=0x7fd3f40c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3524527146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4154980 0x7fd3f40c6150 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fd3f405fcf0 tx=0x7fd3dc009840).stop 2023-05-17T15:09:27.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3524527146 shutdown_connections 2023-05-17T15:09:27.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3524527146 >> v2:172.21.15.40:3300/0 conn(0x7fd3f40c0520 0x7fd3f4081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3524527146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f4151c90 0x7fd3f4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3524527146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4154980 0x7fd3f40c6150 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3524527146 >> 172.21.15.27:0/3524527146 conn(0x7fd3f40cae10 msgr2=0x7fd3f40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:27.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3524527146 shutdown_connections 2023-05-17T15:09:27.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.587+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3524527146 wait complete. 2023-05-17T15:09:27.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.588+0000 7fd3f89e5700 1 Processor -- start 2023-05-17T15:09:27.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.588+0000 7fd3f89e5700 1 -- start start 2023-05-17T15:09:27.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f89e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f40c0520 0x7fd3f4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f89e5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 0x7fd3f41583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f89e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f4154980 0x7fd3f4153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f89e5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4151360 con 0x7fd3f4151c90 2023-05-17T15:09:27.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f89e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41649f0 con 0x7fd3f4154980 2023-05-17T15:09:27.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f89e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41643c0 con 0x7fd3f40c0520 2023-05-17T15:09:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 0x7fd3f41583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 0x7fd3f41583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40954/0 (socket says 172.21.15.27:40954) 2023-05-17T15:09:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3540740468 learned_addr learned my addr 172.21.15.27:0/3540740468 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f259c700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f40c0520 0x7fd3f4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f2d9d700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f4154980 0x7fd3f4153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f40c0520 msgr2=0x7fd3f4150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f40c0520 0x7fd3f4150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f4154980 msgr2=0x7fd3f4153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:27.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.589+0000 7fd3f1d9b700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f4154980 0x7fd3f4153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:27.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3f1d9b700 1 -- 172.21.15.27:0/3540740468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc009ae0 con 0x7fd3f4151c90 2023-05-17T15:09:27.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3f1d9b700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 0x7fd3f41583a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fd3f4062d90 tx=0x7fd3dc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0092e0 con 0x7fd3f4151c90 2023-05-17T15:09:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc00bbc0 con 0x7fd3f4151c90 2023-05-17T15:09:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4158df0 con 0x7fd3f4151c90 2023-05-17T15:09:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc01e470 con 0x7fd3f4151c90 2023-05-17T15:09:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.590+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f4164680 con 0x7fd3f4151c90 2023-05-17T15:09:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.591+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f406bdf0 con 0x7fd3f4151c90 2023-05-17T15:09:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.591+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd3dc025030 con 0x7fd3f4151c90 2023-05-17T15:09:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.591+0000 7fd3ea7fc700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3d405ed90 0x7fd3d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:27.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.592+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5341+0+0 (secure 0 0 0) 0x7fd3dc07acb0 con 0x7fd3f4151c90 2023-05-17T15:09:27.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.592+0000 7fd3f259c700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3d405ed90 0x7fd3d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:27.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.592+0000 7fd3f259c700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3d405ed90 0x7fd3d4061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd3ec00bb10 tx=0x7fd3ec008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:27.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.595+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3dc04c610 con 0x7fd3f4151c90 2023-05-17T15:09:27.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:27.773+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd3f4068c30 con 0x7fd3f4151c90 2023-05-17T15:09:28.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.767+0000 7fd3ea7fc700 1 -- 172.21.15.27:0/3540740468 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v108) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd3dc023030 con 0x7fd3f4151c90 2023-05-17T15:09:28.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.770+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3d405ed90 msgr2=0x7fd3d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:28.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.770+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3d405ed90 0x7fd3d4061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd3ec00bb10 tx=0x7fd3ec008040).stop 2023-05-17T15:09:28.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.770+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 msgr2=0x7fd3f41583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:28.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.770+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 0x7fd3f41583a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fd3f4062d90 tx=0x7fd3dc009840).stop 2023-05-17T15:09:28.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.770+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 shutdown_connections 2023-05-17T15:09:28.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3d405ed90 0x7fd3d4061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f4154980 0x7fd3f4153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3f40c0520 0x7fd3f4150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 --2- 172.21.15.27:0/3540740468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3f4151c90 0x7fd3f41583a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 >> 172.21.15.27:0/3540740468 conn(0x7fd3f40cae10 msgr2=0x7fd3f40c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:28.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 shutdown_connections 2023-05-17T15:09:28.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.771+0000 7fd3f89e5700 1 -- 172.21.15.27:0/3540740468 wait complete. 2023-05-17T15:09:28.781 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:09:28.796 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:09:28.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.921+0000 7f3a0d527700 1 Processor -- start 2023-05-17T15:09:28.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.921+0000 7f3a0d527700 1 -- start start 2023-05-17T15:09:28.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a0d527700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 0x7f3a08068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a0d527700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a080691f0 0x7f3a080bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a0d527700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a08158790 con 0x7f3a081543d0 2023-05-17T15:09:28.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a0d527700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080c1c50 con 0x7f3a080691f0 2023-05-17T15:09:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a0d527700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08157e60 con 0x7f3a080c6310 2023-05-17T15:09:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a06ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3a081543d0 0x7f3a080c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40522/0 (socket says 172.21.15.27:40522) 2023-05-17T15:09:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a06ffd700 1 -- 172.21.15.27:0/3350573512 learned_addr learned my addr 172.21.15.27:0/3350573512 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.922+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175416738 0 0) 0x7f3a08158790 con 0x7f3a081543d0 2023-05-17T15:09:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f40033f0 con 0x7f3a081543d0 2023-05-17T15:09:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 0x7f3a08068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a077fe700 1 --2- 172.21.15.27:0/3350573512 >> v2:172.21.15.40:3300/0 conn(0x7f3a080691f0 0x7f3a080bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481348650 0 0) 0x7f39f40033f0 con 0x7f3a081543d0 2023-05-17T15:09:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 msgr2=0x7f3a08068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 0x7f3a08068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 >> v2:172.21.15.40:3300/0 conn(0x7f3a080691f0 msgr2=0x7f3a080bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:28.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 --2- 172.21.15.27:0/3350573512 >> v2:172.21.15.40:3300/0 conn(0x7f3a080691f0 0x7f3a080bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08158140 con 0x7f3a081543d0 2023-05-17T15:09:28.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f3a000017f0 con 0x7f3a081543d0 2023-05-17T15:09:28.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 >> v1:172.21.15.27:6789/0 conn(0x7f3a081543d0 legacy=0x7f3a080c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:28.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f40038e0 0x7f39f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39f4004690 0x7f39f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 0x7f39f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08157e60 con 0x7f39f4004690 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400b8e0 con 0x7f39f40038e0 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400ba70 con 0x7f3a080c6310 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39f4004690 0x7f39f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a06ffd700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f40038e0 0x7f39f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a077fe700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 0x7f39f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 -- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 msgr2=0x7f39f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080c6310 0x7f39f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 -- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f40038e0 msgr2=0x7f39f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f40038e0 0x7f39f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 -- 172.21.15.27:0/3350573512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40033f0 con 0x7f39f4004690 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a067fc700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39f4004690 0x7f39f4004b10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f39f000b9d0 tx=0x7f39f0008040).ready entity=mon.0 client_cookie=6b5055cf21237128 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.923+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f000b340 con 0x7f39f4004690 2023-05-17T15:09:28.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0013480 con 0x7f39f4004690 2023-05-17T15:09:28.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a05ffb700 1 -- 172.21.15.27:0/3350573512 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0013800 con 0x7f39f4004690 2023-05-17T15:09:28.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a0d527700 1 -- 172.21.15.27:0/3350573512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39f4004690 msgr2=0x7f39f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:28.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a0d527700 1 --2- 172.21.15.27:0/3350573512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39f4004690 0x7f39f4004b10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f39f000b9d0 tx=0x7f39f0008040).stop 2023-05-17T15:09:28.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a077fe700 1 -- 172.21.15.27:0/3350573512 reap_dead start 2023-05-17T15:09:28.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a0d527700 1 -- 172.21.15.27:0/3350573512 shutdown_connections 2023-05-17T15:09:28.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a0d527700 1 -- 172.21.15.27:0/3350573512 >> 172.21.15.27:0/3350573512 conn(0x7f3a080cb7f0 msgr2=0x7f3a080c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:28.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a0d527700 1 -- 172.21.15.27:0/3350573512 shutdown_connections 2023-05-17T15:09:28.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.924+0000 7f3a0d527700 1 -- 172.21.15.27:0/3350573512 wait complete. 2023-05-17T15:09:28.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.925+0000 7f3a0d527700 1 Processor -- start 2023-05-17T15:09:28.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.925+0000 7f3a0d527700 1 -- start start 2023-05-17T15:09:28.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a0d527700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f4004690 0x7f3a08152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a0d527700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 0x7f3a080c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a0d527700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080a9be0 0x7f3a080aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a0d527700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08165400 con 0x7f3a080adcb0 2023-05-17T15:09:28.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a0d527700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080aa550 con 0x7f39f4004690 2023-05-17T15:09:28.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a0d527700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080a96d0 con 0x7f3a080a9be0 2023-05-17T15:09:28.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a067fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 0x7f3a080c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a067fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 0x7f3a080c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40974/0 (socket says 172.21.15.27:40974) 2023-05-17T15:09:28.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a067fc700 1 -- 172.21.15.27:0/2159595814 learned_addr learned my addr 172.21.15.27:0/2159595814 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:28.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a077fe700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080a9be0 0x7f3a080aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.926+0000 7f3a06ffd700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f4004690 0x7f3a08152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a067fc700 1 -- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080a9be0 msgr2=0x7f3a080aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:28.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a067fc700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080a9be0 0x7f3a080aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a067fc700 1 -- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f4004690 msgr2=0x7f3a08152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a067fc700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f4004690 0x7f3a08152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a067fc700 1 -- 172.21.15.27:0/2159595814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08164880 con 0x7f3a080adcb0 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a067fc700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 0x7f3a080c4320 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f39f000d3f0 tx=0x7f39f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0012870 con 0x7f3a080adcb0 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f00129d0 con 0x7f3a080adcb0 2023-05-17T15:09:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a08164b60 con 0x7f3a080adcb0 2023-05-17T15:09:28.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0012d90 con 0x7f3a080adcb0 2023-05-17T15:09:28.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.927+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a08165120 con 0x7f3a080adcb0 2023-05-17T15:09:28.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.928+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0806bdf0 con 0x7f3a080adcb0 2023-05-17T15:09:28.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.928+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f39f001e630 con 0x7f3a080adcb0 2023-05-17T15:09:28.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.929+0000 7f39feffd700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f39e805edc0 0x7f39e8061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:28.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.929+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5711+0+0 (secure 0 0 0) 0x7f39f007a910 con 0x7f3a080adcb0 2023-05-17T15:09:28.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.929+0000 7f3a06ffd700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f39e805edc0 0x7f39e8061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:28.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.929+0000 7f3a06ffd700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f39e805edc0 0x7f39e8061280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3a00007e50 tx=0x7f3a00009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:28.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:28.933+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39f004c050 con 0x7f3a080adcb0 2023-05-17T15:09:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.107+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3a08158420 con 0x7f3a080adcb0 2023-05-17T15:09:29.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.778+0000 7f39feffd700 1 -- 172.21.15.27:0/2159595814 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v109) v1 ==== 170+0+0 (secure 0 0 0) 0x7f39f004f670 con 0x7f3a080adcb0 2023-05-17T15:09:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.786+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f39e805edc0 msgr2=0x7f39e8061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.786+0000 7f3a0d527700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f39e805edc0 0x7f39e8061280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3a00007e50 tx=0x7f3a00009040).stop 2023-05-17T15:09:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.786+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 msgr2=0x7f3a080c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.786+0000 7f3a0d527700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 0x7f3a080c4320 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f39f000d3f0 tx=0x7f39f0008040).stop 2023-05-17T15:09:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.790+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 shutdown_connections 2023-05-17T15:09:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.790+0000 7f3a0d527700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f39e805edc0 0x7f39e8061280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.790+0000 7f3a0d527700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a080a9be0 0x7f3a080aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.790+0000 7f3a0d527700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39f4004690 0x7f3a08152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.790+0000 7f3a0d527700 1 --2- 172.21.15.27:0/2159595814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a080adcb0 0x7f3a080c4320 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.790+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 >> 172.21.15.27:0/2159595814 conn(0x7f3a080cb7f0 msgr2=0x7f3a080ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.793+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 shutdown_connections 2023-05-17T15:09:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.794+0000 7f3a0d527700 1 -- 172.21.15.27:0/2159595814 wait complete. 2023-05-17T15:09:29.804 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:09:29.818 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:09:29.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.933+0000 7f620b34e700 1 Processor -- start 2023-05-17T15:09:29.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.933+0000 7f620b34e700 1 -- start start 2023-05-17T15:09:29.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.933+0000 7f620b34e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6204154330 0x7f62040c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:29.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620b34e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6204067060 con 0x7f62040bbdf0 2023-05-17T15:09:29.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620b34e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6204062320 con 0x7f62040c6fe0 2023-05-17T15:09:29.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620b34e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62040bce80 con 0x7f6204154330 2023-05-17T15:09:29.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620ab4d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6204154330 0x7f62040c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:29.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f6209b4b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f62040bbdf0 0x7f6204153c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40544/0 (socket says 172.21.15.27:40544) 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f6209b4b700 1 -- 172.21.15.27:0/2893262346 learned_addr learned my addr 172.21.15.27:0/2893262346 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620ab4d700 1 -- 172.21.15.27:0/2893262346 >> v1:172.21.15.40:6789/0 conn(0x7f62040c6fe0 legacy=0x7f62040bc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620ab4d700 1 -- 172.21.15.27:0/2893262346 >> v1:172.21.15.27:6789/0 conn(0x7f62040bbdf0 legacy=0x7f6204153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620ab4d700 1 -- 172.21.15.27:0/2893262346 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040c43a0 con 0x7f6204154330 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620934a700 1 -- 172.21.15.27:0/2893262346 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915991627 0 0) 0x7f6204067060 con 0x7f62040bbdf0 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620ab4d700 1 --2- 172.21.15.27:0/2893262346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204154330 0x7f62040c73c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f61f4009760 tx=0x7f61f4009060).ready entity=mon.0 client_cookie=f5ab97fc5263f29f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:29.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620934a700 1 -- 172.21.15.27:0/2893262346 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400b580 con 0x7f6204154330 2023-05-17T15:09:29.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620934a700 1 -- 172.21.15.27:0/2893262346 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400b6e0 con 0x7f6204154330 2023-05-17T15:09:29.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.934+0000 7f620934a700 1 -- 172.21.15.27:0/2893262346 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400ba60 con 0x7f6204154330 2023-05-17T15:09:29.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 -- 172.21.15.27:0/2893262346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204154330 msgr2=0x7f62040c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 --2- 172.21.15.27:0/2893262346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204154330 0x7f62040c73c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f61f4009760 tx=0x7f61f4009060).stop 2023-05-17T15:09:29.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 -- 172.21.15.27:0/2893262346 shutdown_connections 2023-05-17T15:09:29.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 --2- 172.21.15.27:0/2893262346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204154330 0x7f62040c73c0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 -- 172.21.15.27:0/2893262346 >> 172.21.15.27:0/2893262346 conn(0x7f6204069810 msgr2=0x7f6204069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:29.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 -- 172.21.15.27:0/2893262346 shutdown_connections 2023-05-17T15:09:29.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.935+0000 7f620b34e700 1 -- 172.21.15.27:0/2893262346 wait complete. 2023-05-17T15:09:29.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.936+0000 7f620b34e700 1 Processor -- start 2023-05-17T15:09:29.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.936+0000 7f620b34e700 1 -- start start 2023-05-17T15:09:29.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 0x7f62040ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62040c6fe0 0x7f6204144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6204154330 0x7f62041590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62040ac6f0 con 0x7f62040bbdf0 2023-05-17T15:09:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6204158c60 con 0x7f62040c6fe0 2023-05-17T15:09:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62041450e0 con 0x7f6204154330 2023-05-17T15:09:29.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 0x7f62040ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:29.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 0x7f62040ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40986/0 (socket says 172.21.15.27:40986) 2023-05-17T15:09:29.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 -- 172.21.15.27:0/4031410369 learned_addr learned my addr 172.21.15.27:0/4031410369 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:29.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f6209b4b700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62040c6fe0 0x7f6204144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:29.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620ab4d700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6204154330 0x7f62041590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:29.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 -- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6204154330 msgr2=0x7f62041590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6204154330 0x7f62041590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 -- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62040c6fe0 msgr2=0x7f6204144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:29.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62040c6fe0 0x7f6204144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:29.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 -- 172.21.15.27:0/4031410369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40092a0 con 0x7f62040bbdf0 2023-05-17T15:09:29.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620ab4d700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6204154330 0x7f62041590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f6209b4b700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62040c6fe0 0x7f6204144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620a34c700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 0x7f62040ac0f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f61fc00c840 tx=0x7f61fc001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc006a20 con 0x7f62040bbdf0 2023-05-17T15:09:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc006b80 con 0x7f62040bbdf0 2023-05-17T15:09:29.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6204158090 con 0x7f62040bbdf0 2023-05-17T15:09:29.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc007020 con 0x7f62040bbdf0 2023-05-17T15:09:29.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.937+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6204158610 con 0x7f62040bbdf0 2023-05-17T15:09:29.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.938+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6204158f40 con 0x7f62040bbdf0 2023-05-17T15:09:29.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.939+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f61fc018020 con 0x7f62040bbdf0 2023-05-17T15:09:29.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.939+0000 7f62027fc700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f61f005ed90 0x7f61f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:29.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.939+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6093+0+0 (secure 0 0 0) 0x7f61fc0796e0 con 0x7f62040bbdf0 2023-05-17T15:09:29.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.939+0000 7f6209b4b700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f61f005ed90 0x7f61f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:29.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.940+0000 7f6209b4b700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f61f005ed90 0x7f61f0061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f62040acf30 tx=0x7f61f8009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:29.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:29.944+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61fc04aca0 con 0x7f62040bbdf0 2023-05-17T15:09:30.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.162+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f62040625c0 con 0x7f62040bbdf0 2023-05-17T15:09:30.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.170+0000 7f62027fc700 1 -- 172.21.15.27:0/4031410369 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f61fc04e2c0 con 0x7f62040bbdf0 2023-05-17T15:09:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.181+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f61f005ed90 msgr2=0x7f61f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.181+0000 7f620b34e700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f61f005ed90 0x7f61f0061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f62040acf30 tx=0x7f61f8009040).stop 2023-05-17T15:09:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.181+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 msgr2=0x7f62040ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.181+0000 7f620b34e700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 0x7f62040ac0f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f61fc00c840 tx=0x7f61fc001660).stop 2023-05-17T15:09:30.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 shutdown_connections 2023-05-17T15:09:30.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f61f005ed90 0x7f61f0061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6204154330 0x7f62041590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62040bbdf0 0x7f62040ac0f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 --2- 172.21.15.27:0/4031410369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62040c6fe0 0x7f6204144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 >> 172.21.15.27:0/4031410369 conn(0x7f6204069810 msgr2=0x7f62040c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:30.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.182+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 shutdown_connections 2023-05-17T15:09:30.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.183+0000 7f620b34e700 1 -- 172.21.15.27:0/4031410369 wait complete. 2023-05-17T15:09:30.189 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 13 and data pool 14 2023-05-17T15:09:30.208 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:30.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.320+0000 7f42feaa2700 1 Processor -- start 2023-05-17T15:09:30.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.320+0000 7f42feaa2700 1 -- start start 2023-05-17T15:09:30.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42feaa2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f42f80c1180 0x7f42f80c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42feaa2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f80c1560 0x7f42f80c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42feaa2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f80c07e0 con 0x7f42f81544f0 2023-05-17T15:09:30.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42feaa2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f81549b0 con 0x7f42f80c1180 2023-05-17T15:09:30.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42feaa2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8154c90 con 0x7f42f80c1560 2023-05-17T15:09:30.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f42f80c1180 0x7f42f80c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f42f80c1180 0x7f42f80c02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41008/0 (socket says 172.21.15.27:41008) 2023-05-17T15:09:30.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 -- 172.21.15.27:0/1735791679 learned_addr learned my addr 172.21.15.27:0/1735791679 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fe2a1700 1 --2- 172.21.15.27:0/1735791679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f80c1560 0x7f42f80c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 -- 172.21.15.27:0/1735791679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f80c1560 msgr2=0x7f42f80c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 --2- 172.21.15.27:0/1735791679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f80c1560 0x7f42f80c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 -- 172.21.15.27:0/1735791679 >> v1:172.21.15.40:6789/0 conn(0x7f42f81544f0 legacy=0x7f42f80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 -- 172.21.15.27:0/1735791679 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8154f70 con 0x7f42f80c1180 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.321+0000 7f42fdaa0700 1 --2- 172.21.15.27:0/1735791679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f80c02f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f42f0006fd0 tx=0x7f42f00090f0).ready entity=mon.0 client_cookie=520e44dd055e59a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42fca9e700 1 -- 172.21.15.27:0/1735791679 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000b600 con 0x7f42f80c1180 2023-05-17T15:09:30.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42fca9e700 1 -- 172.21.15.27:0/1735791679 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f000b760 con 0x7f42f80c1180 2023-05-17T15:09:30.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42fca9e700 1 -- 172.21.15.27:0/1735791679 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000bb00 con 0x7f42f80c1180 2023-05-17T15:09:30.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 -- 172.21.15.27:0/1735791679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 msgr2=0x7f42f80c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 --2- 172.21.15.27:0/1735791679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f80c02f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f42f0006fd0 tx=0x7f42f00090f0).stop 2023-05-17T15:09:30.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 -- 172.21.15.27:0/1735791679 shutdown_connections 2023-05-17T15:09:30.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 --2- 172.21.15.27:0/1735791679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f80c1560 0x7f42f80c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 --2- 172.21.15.27:0/1735791679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f80c02f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 -- 172.21.15.27:0/1735791679 >> 172.21.15.27:0/1735791679 conn(0x7f42f805dd50 msgr2=0x7f42f805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:30.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 -- 172.21.15.27:0/1735791679 shutdown_connections 2023-05-17T15:09:30.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.322+0000 7f42feaa2700 1 -- 172.21.15.27:0/1735791679 wait complete. 2023-05-17T15:09:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.323+0000 7f42feaa2700 1 Processor -- start 2023-05-17T15:09:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.323+0000 7f42feaa2700 1 -- start start 2023-05-17T15:09:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42feaa2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f8167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42feaa2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42f80c1560 0x7f42f814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42feaa2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f81544f0 0x7f42f814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42feaa2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c8bf0 con 0x7f42f80c1180 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42feaa2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8168340 con 0x7f42f80c1560 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42feaa2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8168620 con 0x7f42f81544f0 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fdaa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f8167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fdaa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f8167af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41014/0 (socket says 172.21.15.27:41014) 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fdaa0700 1 -- 172.21.15.27:0/779626869 learned_addr learned my addr 172.21.15.27:0/779626869 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:30.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fe2a1700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f81544f0 0x7f42f814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fd29f700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42f80c1560 0x7f42f814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fdaa0700 1 -- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f81544f0 msgr2=0x7f42f814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fdaa0700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f81544f0 0x7f42f814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.324+0000 7f42fdaa0700 1 -- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42f80c1560 msgr2=0x7f42f814bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42fdaa0700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42f80c1560 0x7f42f814bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42fdaa0700 1 -- 172.21.15.27:0/779626869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009370 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42fdaa0700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f8167af0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f42f8068b00 tx=0x7f42f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0006d90 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f000bec0 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f8168900 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0006930 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.325+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f814db60 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.326+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f806bdf0 con 0x7f42f80c1180 2023-05-17T15:09:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.326+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f42f000f070 con 0x7f42f80c1180 2023-05-17T15:09:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.327+0000 7f42f5ffb700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f42e405ed90 0x7f42e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.327+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f42f007b750 con 0x7f42f80c1180 2023-05-17T15:09:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.327+0000 7f42fd29f700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f42e405ed90 0x7f42e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.327+0000 7f42fd29f700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f42e405ed90 0x7f42e4061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f42f81521c0 tx=0x7f42ec009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.331+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42f004cb90 con 0x7f42f80c1180 2023-05-17T15:09:30.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.504+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42f80bfb80 con 0x7f42f80c1180 2023-05-17T15:09:30.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.505+0000 7f42f5ffb700 1 -- 172.21.15.27:0/779626869 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17070 (secure 0 0 0) 0x7f42f00501b0 con 0x7f42f80c1180 2023-05-17T15:09:30.512 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:30.514 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":110,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:30.164711+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:09:27.811071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-17T15:09:29.145474+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:30.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f42e405ed90 msgr2=0x7f42e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f42e405ed90 0x7f42e4061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f42f81521c0 tx=0x7f42ec009040).stop 2023-05-17T15:09:30.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 msgr2=0x7f42f8167af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f8167af0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f42f8068b00 tx=0x7f42f0017000).stop 2023-05-17T15:09:30.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 shutdown_connections 2023-05-17T15:09:30.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f42e405ed90 0x7f42e4061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42f81544f0 0x7f42f814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42f80c1180 0x7f42f8167af0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 --2- 172.21.15.27:0/779626869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42f80c1560 0x7f42f814bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 >> 172.21.15.27:0/779626869 conn(0x7f42f805dd50 msgr2=0x7f42f80afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:30.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 shutdown_connections 2023-05-17T15:09:30.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.507+0000 7f42feaa2700 1 -- 172.21.15.27:0/779626869 wait complete. 2023-05-17T15:09:30.525 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:30.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.636+0000 7fcfa1706700 1 Processor -- start 2023-05-17T15:09:30.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.636+0000 7fcfa1706700 1 -- start start 2023-05-17T15:09:30.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcfa1706700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf9c0c1730 0x7fcf9c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcfa1706700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c0bfcd0 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcfa1706700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c0c0290 con 0x7fcf9c0c6310 2023-05-17T15:09:30.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcfa1706700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c0aa1a0 con 0x7fcf9c0c1730 2023-05-17T15:09:30.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf9b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf9c0c1730 0x7fcf9c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf9affd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcf9c0c5f30 0x7fcf9c158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40584/0 (socket says 172.21.15.27:40584) 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf9affd700 1 -- 172.21.15.27:0/3973356401 learned_addr learned my addr 172.21.15.27:0/3973356401 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf9b7fe700 1 -- 172.21.15.27:0/3973356401 >> v1:172.21.15.40:6789/0 conn(0x7fcf9c0c6310 legacy=0x7fcf9c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf9b7fe700 1 -- 172.21.15.27:0/3973356401 >> v1:172.21.15.27:6789/0 conn(0x7fcf9c0c5f30 legacy=0x7fcf9c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf9b7fe700 1 -- 172.21.15.27:0/3973356401 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0aa480 con 0x7fcf9c0c1730 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.637+0000 7fcf99ffb700 1 -- 172.21.15.27:0/3973356401 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676318154 0 0) 0x7fcf9c0bfcd0 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcf9b7fe700 1 --2- 172.21.15.27:0/3973356401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c1730 0x7fcf9c1543e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fcf8c009e60 tx=0x7fcf8c009780).ready entity=mon.0 client_cookie=ccc683c9c6d59748 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcf99ffb700 1 -- 172.21.15.27:0/3973356401 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00e070 con 0x7fcf9c0c1730 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcf99ffb700 1 -- 172.21.15.27:0/3973356401 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c00bbf0 con 0x7fcf9c0c1730 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcf99ffb700 1 -- 172.21.15.27:0/3973356401 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c012410 con 0x7fcf9c0c1730 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 -- 172.21.15.27:0/3973356401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c1730 msgr2=0x7fcf9c1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 --2- 172.21.15.27:0/3973356401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c1730 0x7fcf9c1543e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fcf8c009e60 tx=0x7fcf8c009780).stop 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 -- 172.21.15.27:0/3973356401 shutdown_connections 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 --2- 172.21.15.27:0/3973356401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c1730 0x7fcf9c1543e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 -- 172.21.15.27:0/3973356401 >> 172.21.15.27:0/3973356401 conn(0x7fcf9c069e70 msgr2=0x7fcf9c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:30.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 -- 172.21.15.27:0/3973356401 shutdown_connections 2023-05-17T15:09:30.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.638+0000 7fcfa1706700 1 -- 172.21.15.27:0/3973356401 wait complete. 2023-05-17T15:09:30.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.639+0000 7fcfa1706700 1 Processor -- start 2023-05-17T15:09:30.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 -- start start 2023-05-17T15:09:30.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf9c0c1730 0x7fcf9c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 0x7fcf9c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf9c0c6310 0x7fcf9c0c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c1654a0 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c164b90 con 0x7fcf9c0c6310 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcfa1706700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0ca200 con 0x7fcf9c0c1730 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcf9a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 0x7fcf9c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcf9a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 0x7fcf9c1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41030/0 (socket says 172.21.15.27:41030) 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcf9a7fc700 1 -- 172.21.15.27:0/2709360082 learned_addr learned my addr 172.21.15.27:0/2709360082 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:30.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.640+0000 7fcf9affd700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf9c0c1730 0x7fcf9c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9b7fe700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf9c0c6310 0x7fcf9c0c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9a7fc700 1 -- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf9c0c1730 msgr2=0x7fcf9c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9a7fc700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf9c0c1730 0x7fcf9c0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9a7fc700 1 -- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf9c0c6310 msgr2=0x7fcf9c0c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9a7fc700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf9c0c6310 0x7fcf9c0c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9a7fc700 1 -- 172.21.15.27:0/2709360082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c009a20 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9b7fe700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf9c0c6310 0x7fcf9c0c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf9a7fc700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 0x7fcf9c1554e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fcf8400b460 tx=0x7fcf84006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400be60 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84012410 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c164e50 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840127b0 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.641+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c157e60 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.642+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c165650 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.642+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcf8400f030 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.643+0000 7fcf92ffd700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf7c05ed90 0x7fcf7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.643+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fcf840796e0 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.643+0000 7fcf9affd700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf7c05ed90 0x7fcf7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.643+0000 7fcf9affd700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf7c05ed90 0x7fcf7c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcf940011e0 tx=0x7fcf94007bb0).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.647+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf9c165650 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.821+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf9c05f4a0 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.822+0000 7fcf92ffd700 1 -- 172.21.15.27:0/2709360082 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17070 (secure 0 0 0) 0x7fcf8404ac30 con 0x7fcf9c0c5f30 2023-05-17T15:09:30.827 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":110,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:30.164711+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:09:27.811071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-17T15:09:29.145474+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf7c05ed90 msgr2=0x7fcf7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf7c05ed90 0x7fcf7c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcf940011e0 tx=0x7fcf94007bb0).stop 2023-05-17T15:09:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 msgr2=0x7fcf9c1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 0x7fcf9c1554e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fcf8400b460 tx=0x7fcf84006f20).stop 2023-05-17T15:09:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 shutdown_connections 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcf7c05ed90 0x7fcf7c061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf9c0c6310 0x7fcf9c0c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf9c0c1730 0x7fcf9c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 --2- 172.21.15.27:0/2709360082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf9c0c5f30 0x7fcf9c1554e0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 >> 172.21.15.27:0/2709360082 conn(0x7fcf9c069e70 msgr2=0x7fcf9c0ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 shutdown_connections 2023-05-17T15:09:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.823+0000 7fcfa1706700 1 -- 172.21.15.27:0/2709360082 wait complete. 2023-05-17T15:09:30.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:09:30.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.954+0000 7fc8445d0700 1 Processor -- start 2023-05-17T15:09:30.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.954+0000 7fc8445d0700 1 -- start start 2023-05-17T15:09:30.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.955+0000 7fc8445d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.955+0000 7fc8445d0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc83c0691f0 0x7fc83c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.955+0000 7fc8445d0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c158790 con 0x7fc83c1543d0 2023-05-17T15:09:30.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.955+0000 7fc8445d0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0c1c50 con 0x7fc83c0691f0 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.955+0000 7fc8445d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c157e60 con 0x7fc83c0c6310 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.955+0000 7fc842b6d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc83c0691f0 0x7fc83c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc83c0691f0 0x7fc83c0bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41036/0 (socket says 172.21.15.27:41036) 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 -- 172.21.15.27:0/1602936441 learned_addr learned my addr 172.21.15.27:0/1602936441 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc841b6b700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 -- 172.21.15.27:0/1602936441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 msgr2=0x7fc83c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 -- 172.21.15.27:0/1602936441 >> v1:172.21.15.40:6789/0 conn(0x7fc83c1543d0 legacy=0x7fc83c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:30.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 -- 172.21.15.27:0/1602936441 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c158140 con 0x7fc83c0691f0 2023-05-17T15:09:30.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc841b6b700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:30.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc842b6d700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c0691f0 0x7fc83c0bfc80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fc82c009f20 tx=0x7fc82c009840).ready entity=mon.0 client_cookie=54478186f3f4e312 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc84136a700 1 -- 172.21.15.27:0/1602936441 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e070 con 0x7fc83c0691f0 2023-05-17T15:09:30.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc84136a700 1 -- 172.21.15.27:0/1602936441 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00ba40 con 0x7fc83c0691f0 2023-05-17T15:09:30.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.956+0000 7fc84136a700 1 -- 172.21.15.27:0/1602936441 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00bdc0 con 0x7fc83c0691f0 2023-05-17T15:09:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 -- 172.21.15.27:0/1602936441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c0691f0 msgr2=0x7fc83c0bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c0691f0 0x7fc83c0bfc80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fc82c009f20 tx=0x7fc82c009840).stop 2023-05-17T15:09:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 -- 172.21.15.27:0/1602936441 shutdown_connections 2023-05-17T15:09:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c0691f0 0x7fc83c0bfc80 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 --2- 172.21.15.27:0/1602936441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 -- 172.21.15.27:0/1602936441 >> 172.21.15.27:0/1602936441 conn(0x7fc83c0cb7f0 msgr2=0x7fc83c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 -- 172.21.15.27:0/1602936441 shutdown_connections 2023-05-17T15:09:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.957+0000 7fc8445d0700 1 -- 172.21.15.27:0/1602936441 wait complete. 2023-05-17T15:09:30.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.958+0000 7fc8445d0700 1 Processor -- start 2023-05-17T15:09:30.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.958+0000 7fc8445d0700 1 -- start start 2023-05-17T15:09:30.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.958+0000 7fc8445d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc83c0691f0 0x7fc83c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 0x7fc83c149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c2960 con 0x7fc83c1543d0 2023-05-17T15:09:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c31c0 con 0x7fc83c0691f0 2023-05-17T15:09:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c4a60 con 0x7fc83c0c6310 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 0x7fc83c149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 0x7fc83c149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41044/0 (socket says 172.21.15.27:41044) 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 -- 172.21.15.27:0/3063026663 learned_addr learned my addr 172.21.15.27:0/3063026663 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc84236c700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc83c0691f0 0x7fc83c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc841b6b700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 -- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 msgr2=0x7fc83c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 -- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc83c0691f0 msgr2=0x7fc83c0c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:30.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc83c0691f0 0x7fc83c0c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:30.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 -- 172.21.15.27:0/3063026663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c009ae0 con 0x7fc83c1543d0 2023-05-17T15:09:30.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc842b6d700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 0x7fc83c149aa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fc83c083d00 tx=0x7fc82c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c01e470 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c01e5d0 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0c2b70 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c01e990 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.959+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0c41c0 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.960+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0af350 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.961+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc82c025030 con 0x7fc83c1543d0 2023-05-17T15:09:30.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.961+0000 7fc83a7fc700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc82805ed60 0x7fc828061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:30.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.961+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fc82c07b400 con 0x7fc83c1543d0 2023-05-17T15:09:30.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.961+0000 7fc84236c700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc82805ed60 0x7fc828061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:30.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.962+0000 7fc84236c700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc82805ed60 0x7fc828061220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc83400b7f0 tx=0x7fc834008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:30.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:30.965+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc82c04ca00 con 0x7fc83c1543d0 2023-05-17T15:09:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:31.184+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc83c158420 con 0x7fc83c1543d0 2023-05-17T15:09:31.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-05-17T15:09:31.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-05-17T15:09:32.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.178+0000 7fc83a7fc700 1 -- 172.21.15.27:0/3063026663 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc82c023070 con 0x7fc83c1543d0 2023-05-17T15:09:32.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc82805ed60 msgr2=0x7fc828061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:32.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc82805ed60 0x7fc828061220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc83400b7f0 tx=0x7fc834008040).stop 2023-05-17T15:09:32.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 msgr2=0x7fc83c149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:32.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 0x7fc83c149aa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fc83c083d00 tx=0x7fc82c009840).stop 2023-05-17T15:09:32.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 shutdown_connections 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc82805ed60 0x7fc828061220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc83c1543d0 0x7fc83c149aa0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc83c0691f0 0x7fc83c0c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 --2- 172.21.15.27:0/3063026663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc83c0c6310 0x7fc83c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 >> 172.21.15.27:0/3063026663 conn(0x7fc83c0cb7f0 msgr2=0x7fc83c0c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 shutdown_connections 2023-05-17T15:09:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.181+0000 7fc8445d0700 1 -- 172.21.15.27:0/3063026663 wait complete. 2023-05-17T15:09:32.200 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:09:32.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.321+0000 7fa388cd9700 1 Processor -- start 2023-05-17T15:09:32.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.321+0000 7fa388cd9700 1 -- start start 2023-05-17T15:09:32.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa388cd9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa384063940 0x7fa38405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:32.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa388cd9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa384063da0 0x7fa38405e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:32.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa388cd9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3840bc830 con 0x7fa384152a80 2023-05-17T15:09:32.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa388cd9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38405e730 con 0x7fa384063940 2023-05-17T15:09:32.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa388cd9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384064320 con 0x7fa384063da0 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa381d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa384063940 0x7fa38405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa38259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa384152a80 0x7fa384152e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40610/0 (socket says 172.21.15.27:40610) 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.322+0000 7fa38259c700 1 -- 172.21.15.27:0/2428356791 learned_addr learned my addr 172.21.15.27:0/2428356791 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa382d9d700 1 --2- 172.21.15.27:0/2428356791 >> v2:172.21.15.40:3300/0 conn(0x7fa384063da0 0x7fa38405e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa381d9b700 1 -- 172.21.15.27:0/2428356791 >> v2:172.21.15.40:3300/0 conn(0x7fa384063da0 msgr2=0x7fa38405e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa381d9b700 1 --2- 172.21.15.27:0/2428356791 >> v2:172.21.15.40:3300/0 conn(0x7fa384063da0 0x7fa38405e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa381d9b700 1 -- 172.21.15.27:0/2428356791 >> v1:172.21.15.27:6789/0 conn(0x7fa384152a80 legacy=0x7fa384152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:32.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa38159a700 1 -- 172.21.15.27:0/2428356791 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333300908 0 0) 0x7fa3840bc830 con 0x7fa384152a80 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa381d9b700 1 -- 172.21.15.27:0/2428356791 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384064600 con 0x7fa384063940 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa382d9d700 1 --2- 172.21.15.27:0/2428356791 >> v2:172.21.15.40:3300/0 conn(0x7fa384063da0 0x7fa38405e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa381d9b700 1 --2- 172.21.15.27:0/2428356791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa38405dd50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fa384069af0 tx=0x7fa36c009060).ready entity=mon.0 client_cookie=6a425772a9ee93d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa38159a700 1 -- 172.21.15.27:0/2428356791 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00b580 con 0x7fa384063940 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa38159a700 1 -- 172.21.15.27:0/2428356791 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00b6e0 con 0x7fa384063940 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa38159a700 1 -- 172.21.15.27:0/2428356791 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00ba60 con 0x7fa384063940 2023-05-17T15:09:32.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.323+0000 7fa388cd9700 1 -- 172.21.15.27:0/2428356791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 msgr2=0x7fa38405dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 --2- 172.21.15.27:0/2428356791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa38405dd50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fa384069af0 tx=0x7fa36c009060).stop 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 -- 172.21.15.27:0/2428356791 shutdown_connections 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 --2- 172.21.15.27:0/2428356791 >> v2:172.21.15.40:3300/0 conn(0x7fa384063da0 0x7fa38405e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 --2- 172.21.15.27:0/2428356791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa38405dd50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 -- 172.21.15.27:0/2428356791 >> 172.21.15.27:0/2428356791 conn(0x7fa3840c83a0 msgr2=0x7fa3840c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 -- 172.21.15.27:0/2428356791 shutdown_connections 2023-05-17T15:09:32.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.324+0000 7fa388cd9700 1 -- 172.21.15.27:0/2428356791 wait complete. 2023-05-17T15:09:32.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.325+0000 7fa388cd9700 1 Processor -- start 2023-05-17T15:09:32.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.325+0000 7fa388cd9700 1 -- start start 2023-05-17T15:09:32.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.325+0000 7fa388cd9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa384142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:32.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384063da0 0x7fa384151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:32.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa384152a80 0x7fa3841545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840bf630 con 0x7fa384063940 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841664e0 con 0x7fa384063da0 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa384165960 con 0x7fa384152a80 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa384142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa384142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41054/0 (socket says 172.21.15.27:41054) 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 -- 172.21.15.27:0/1958502385 learned_addr learned my addr 172.21.15.27:0/1958502385 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:32.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa382d9d700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa384152a80 0x7fa3841545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa381d9b700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384063da0 0x7fa384151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 -- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa384152a80 msgr2=0x7fa3841545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa384152a80 0x7fa3841545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 -- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384063da0 msgr2=0x7fa384151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384063da0 0x7fa384151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 -- 172.21.15.27:0/1958502385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0092a0 con 0x7fa384063940 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa382d9d700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa384152a80 0x7fa3841545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa381d9b700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384063da0 0x7fa384151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa38259c700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa384142310 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fa37c00c810 tx=0x7fa37c001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c005d30 con 0x7fa384063940 2023-05-17T15:09:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c005e90 con 0x7fa384063940 2023-05-17T15:09:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c007320 con 0x7fa384063940 2023-05-17T15:09:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa384165c40 con 0x7fa384063940 2023-05-17T15:09:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.326+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa384166200 con 0x7fa384063940 2023-05-17T15:09:32.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.327+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38406bdf0 con 0x7fa384063940 2023-05-17T15:09:32.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.328+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa37c010030 con 0x7fa384063940 2023-05-17T15:09:32.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.328+0000 7fa37a7fc700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa36405ed90 0x7fa364061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:32.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.328+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fa37c079a90 con 0x7fa384063940 2023-05-17T15:09:32.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.328+0000 7fa381d9b700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa36405ed90 0x7fa364061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:32.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.328+0000 7fa381d9b700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa36405ed90 0x7fa364061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa384155130 tx=0x7fa36c017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:32.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.332+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa37c04afe0 con 0x7fa384063940 2023-05-17T15:09:32.497 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:32.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:32.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:32.553+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa3840648e0 con 0x7fa384063940 2023-05-17T15:09:33.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.186+0000 7fa37a7fc700 1 -- 172.21.15.27:0/1958502385 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa37c0016b0 con 0x7fa384063940 2023-05-17T15:09:33.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa36405ed90 msgr2=0x7fa364061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa36405ed90 0x7fa364061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa384155130 tx=0x7fa36c017000).stop 2023-05-17T15:09:33.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 msgr2=0x7fa384142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa384142310 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fa37c00c810 tx=0x7fa37c001570).stop 2023-05-17T15:09:33.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 shutdown_connections 2023-05-17T15:09:33.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa36405ed90 0x7fa364061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa384152a80 0x7fa3841545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa384063940 0x7fa384142310 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 --2- 172.21.15.27:0/1958502385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384063da0 0x7fa384151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 >> 172.21.15.27:0/1958502385 conn(0x7fa3840c83a0 msgr2=0x7fa38414e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:33.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 shutdown_connections 2023-05-17T15:09:33.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.188+0000 7fa388cd9700 1 -- 172.21.15.27:0/1958502385 wait complete. 2023-05-17T15:09:33.206 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:33.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.361+0000 7efcc84dd700 1 Processor -- start 2023-05-17T15:09:33.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.361+0000 7efcc84dd700 1 -- start start 2023-05-17T15:09:33.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc84dd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efcc0065af0 0x7efcc00bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc84dd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00c4540 con 0x7efcc0154220 2023-05-17T15:09:33.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc84dd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00c36b0 con 0x7efcc0153e40 2023-05-17T15:09:33.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc84dd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc01546a0 con 0x7efcc0065af0 2023-05-17T15:09:33.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5a78700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efcc0154220 0x7efcc00653e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40626/0 (socket says 172.21.15.27:40626) 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5a78700 1 -- 172.21.15.27:0/33607251 learned_addr learned my addr 172.21.15.27:0/33607251 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144915484 0 0) 0x7efcc00c4540 con 0x7efcc0154220 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/33607251 >> v2:172.21.15.40:3300/0 conn(0x7efcc0065af0 0x7efcc00bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca80033f0 con 0x7efcc0154220 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1926738045 0 0) 0x7efca80033f0 con 0x7efcc0154220 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 >> v2:172.21.15.40:3300/0 conn(0x7efcc0065af0 msgr2=0x7efcc00bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 --2- 172.21.15.27:0/33607251 >> v2:172.21.15.40:3300/0 conn(0x7efcc0065af0 0x7efcc00bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 >> v1:172.21.15.40:6789/0 conn(0x7efcc0153e40 legacy=0x7efcc00c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00c3930 con 0x7efcc0154220 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.362+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7efcb4001470 con 0x7efcc0154220 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 >> v1:172.21.15.27:6789/0 conn(0x7efcc0154220 legacy=0x7efcc00653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca80038e0 0x7efca8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8004690 0x7efca8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efca8005000 0x7efca800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01546a0 con 0x7efca8005000 2023-05-17T15:09:33.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca800bf60 con 0x7efca80038e0 2023-05-17T15:09:33.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca800c0f0 con 0x7efca8004690 2023-05-17T15:09:33.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efca8005000 0x7efca800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6279700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca80038e0 0x7efca8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5a78700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8004690 0x7efca8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 -- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8004690 msgr2=0x7efca8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8004690 0x7efca8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 -- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca80038e0 msgr2=0x7efca8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca80038e0 0x7efca8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 -- 172.21.15.27:0/33607251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80033f0 con 0x7efca8005000 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 -- 172.21.15.27:0/33607251 reap_dead start 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efca8005000 0x7efca800b8e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7efcc0065ef0 tx=0x7efcb000b040).ready entity=mon.0 client_cookie=8167aaa1f44a4776 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:33.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0017070 con 0x7efca8005000 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb000f040 con 0x7efca8005000 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.363+0000 7efcc5277700 1 -- 172.21.15.27:0/33607251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000ece0 con 0x7efca8005000 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 -- 172.21.15.27:0/33607251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efca8005000 msgr2=0x7efca800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efca8005000 0x7efca800b8e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7efcc0065ef0 tx=0x7efcb000b040).stop 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 -- 172.21.15.27:0/33607251 shutdown_connections 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 --2- 172.21.15.27:0/33607251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efca8005000 0x7efca800b8e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 -- 172.21.15.27:0/33607251 >> 172.21.15.27:0/33607251 conn(0x7efcc00c9560 msgr2=0x7efcc00c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 -- 172.21.15.27:0/33607251 shutdown_connections 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.364+0000 7efcc84dd700 1 -- 172.21.15.27:0/33607251 wait complete. 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.365+0000 7efcc84dd700 1 Processor -- start 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.365+0000 7efcc84dd700 1 -- start start 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8005000 0x7efcc00a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 0x7efcc00c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc01490a0 0x7efcc00c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00c25f0 con 0x7efcc0148c20 2023-05-17T15:09:33.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00a79e0 con 0x7efcc01490a0 2023-05-17T15:09:33.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00a3bb0 con 0x7efca8005000 2023-05-17T15:09:33.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 0x7efcc00c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 0x7efcc00c1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41074/0 (socket says 172.21.15.27:41074) 2023-05-17T15:09:33.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 -- 172.21.15.27:0/2547586527 learned_addr learned my addr 172.21.15.27:0/2547586527 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:33.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc01490a0 0x7efcc00c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc6279700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8005000 0x7efcc00a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 -- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8005000 msgr2=0x7efcc00a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8005000 0x7efcc00a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 -- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc01490a0 msgr2=0x7efcc00c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc01490a0 0x7efcc00c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 -- 172.21.15.27:0/2547586527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00a8310 con 0x7efcc0148c20 2023-05-17T15:09:33.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc6a7a700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc01490a0 0x7efcc00c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc6279700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8005000 0x7efcc00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc5a78700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 0x7efcc00c1c10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7efcb4004710 tx=0x7efcc0069d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4011590 con 0x7efcc0148c20 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40116f0 con 0x7efcc0148c20 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc00a85f0 con 0x7efcc0148c20 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.366+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4011a70 con 0x7efcc0148c20 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.367+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc00a8bb0 con 0x7efcc0148c20 2023-05-17T15:09:33.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.367+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc006bdf0 con 0x7efcc0148c20 2023-05-17T15:09:33.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.368+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efcb4015410 con 0x7efcc0148c20 2023-05-17T15:09:33.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.368+0000 7efcbe7fc700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efcac05ed90 0x7efcac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.368+0000 7efcc6279700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efcac05ed90 0x7efcac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.368+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7efcb4079f20 con 0x7efcc0148c20 2023-05-17T15:09:33.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.369+0000 7efcc6279700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efcac05ed90 0x7efcac061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efcb8007cc0 tx=0x7efcb8009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:33.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.372+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efcb404b410 con 0x7efcc0148c20 2023-05-17T15:09:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.586+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcc00c6280 con 0x7efcc0148c20 2023-05-17T15:09:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.587+0000 7efcbe7fc700 1 -- 172.21.15.27:0/2547586527 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4485 (secure 0 0 0) 0x7efcb4011e60 con 0x7efcc0148c20 2023-05-17T15:09:33.592 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:33.592 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:09:30.165063+0000","modified":"2023-05-17T15:09:33.179511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7092":{"gid":7092,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6834/1597094051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1597094051},{"type":"v1","addr":"172.21.15.27:6834","nonce":1597094051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-17T15:09:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.588+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efcac05ed90 msgr2=0x7efcac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.588+0000 7efcc84dd700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efcac05ed90 0x7efcac061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efcb8007cc0 tx=0x7efcb8009040).stop 2023-05-17T15:09:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 msgr2=0x7efcc00c1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 0x7efcc00c1c10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7efcb4004710 tx=0x7efcc0069d50).stop 2023-05-17T15:09:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 shutdown_connections 2023-05-17T15:09:33.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efcac05ed90 0x7efcac061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc01490a0 0x7efcc00c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efca8005000 0x7efcc00a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 --2- 172.21.15.27:0/2547586527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcc0148c20 0x7efcc00c1c10 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 >> 172.21.15.27:0/2547586527 conn(0x7efcc00c9560 msgr2=0x7efcc00c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:33.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 shutdown_connections 2023-05-17T15:09:33.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.589+0000 7efcc84dd700 1 -- 172.21.15.27:0/2547586527 wait complete. 2023-05-17T15:09:33.596 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 44 2023-05-17T15:09:33.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:09:33.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.717+0000 7f7069696700 1 Processor -- start 2023-05-17T15:09:33.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.717+0000 7f7069696700 1 -- start start 2023-05-17T15:09:33.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f7069696700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f706414faa0 0x7f7064063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f7069696700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70640a6ff0 con 0x7f7064067cb0 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f7069696700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7064063830 con 0x7f7064152440 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f7069696700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706414fe80 con 0x7f706414faa0 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f70637fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7064067cb0 0x7f7064155db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40646/0 (socket says 172.21.15.27:40646) 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f70637fe700 1 -- 172.21.15.27:0/1613256286 learned_addr learned my addr 172.21.15.27:0/1613256286 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.718+0000 7f7062ffd700 1 --2- 172.21.15.27:0/1613256286 >> v2:172.21.15.27:3300/0 conn(0x7f706414faa0 0x7f7064063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7062ffd700 1 -- 172.21.15.27:0/1613256286 >> v1:172.21.15.40:6789/0 conn(0x7f7064152440 legacy=0x7f70640a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:33.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7062ffd700 1 -- 172.21.15.27:0/1613256286 >> v1:172.21.15.27:6789/0 conn(0x7f7064067cb0 legacy=0x7f7064155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7061ffb700 1 -- 172.21.15.27:0/1613256286 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256306820 0 0) 0x7f70640a6ff0 con 0x7f7064067cb0 2023-05-17T15:09:33.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7062ffd700 1 -- 172.21.15.27:0/1613256286 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70641528c0 con 0x7f706414faa0 2023-05-17T15:09:33.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7062ffd700 1 --2- 172.21.15.27:0/1613256286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f7064063340 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f7054009e60 tx=0x7f7054009780).ready entity=mon.0 client_cookie=772ea6aed2c97e15 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:33.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7061ffb700 1 -- 172.21.15.27:0/1613256286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400e070 con 0x7f706414faa0 2023-05-17T15:09:33.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7061ffb700 1 -- 172.21.15.27:0/1613256286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400bbf0 con 0x7f706414faa0 2023-05-17T15:09:33.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.719+0000 7f7061ffb700 1 -- 172.21.15.27:0/1613256286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054012410 con 0x7f706414faa0 2023-05-17T15:09:33.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 -- 172.21.15.27:0/1613256286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 msgr2=0x7f7064063340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 --2- 172.21.15.27:0/1613256286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f7064063340 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f7054009e60 tx=0x7f7054009780).stop 2023-05-17T15:09:33.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 -- 172.21.15.27:0/1613256286 shutdown_connections 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 --2- 172.21.15.27:0/1613256286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f7064063340 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 -- 172.21.15.27:0/1613256286 >> 172.21.15.27:0/1613256286 conn(0x7f70640676b0 msgr2=0x7f70640c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 -- 172.21.15.27:0/1613256286 shutdown_connections 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.720+0000 7f7069696700 1 -- 172.21.15.27:0/1613256286 wait complete. 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.721+0000 7f7069696700 1 Processor -- start 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.721+0000 7f7069696700 1 -- start start 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7069696700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7064067cb0 0x7f70640c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7069696700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f70641536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7069696700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7064152440 0x7f70640bf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7069696700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064162830 con 0x7f706414faa0 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7069696700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064166380 con 0x7f7064152440 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7069696700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7064166660 con 0x7f7064067cb0 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f70641536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f70641536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41088/0 (socket says 172.21.15.27:41088) 2023-05-17T15:09:33.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 -- 172.21.15.27:0/2695053384 learned_addr learned my addr 172.21.15.27:0/2695053384 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f7062ffd700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7064067cb0 0x7f70640c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70637fe700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7064152440 0x7f70640bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 -- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7064067cb0 msgr2=0x7f70640c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7064067cb0 0x7f70640c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 -- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7064152440 msgr2=0x7f70640bf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7064152440 0x7f70640bf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 -- 172.21.15.27:0/2695053384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054009a20 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.722+0000 7f70627fc700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f70641536a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f705800c440 tx=0x7f7058007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.723+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058012400 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.723+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7058012580 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.723+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064166940 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.723+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058012940 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.723+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70640c16f0 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.724+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706406bdf0 con 0x7f706414faa0 2023-05-17T15:09:33.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.724+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7058019030 con 0x7f706414faa0 2023-05-17T15:09:33.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.724+0000 7f704affd700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f705005ed90 0x7f7050061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:33.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.724+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f7058078d70 con 0x7f706414faa0 2023-05-17T15:09:33.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.724+0000 7f7062ffd700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f705005ed90 0x7f7050061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:33.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.725+0000 7f7062ffd700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f705005ed90 0x7f7050061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7064151a50 tx=0x7f7054009780).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:33.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.729+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f70580488f0 con 0x7f706414faa0 2023-05-17T15:09:33.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.906+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70640c7470 con 0x7f706414faa0 2023-05-17T15:09:33.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.907+0000 7f704affd700 1 -- 172.21.15.27:0/2695053384 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17057 (secure 0 0 0) 0x7f705804a370 con 0x7f706414faa0 2023-05-17T15:09:33.912 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:33.913 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":111,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:31.168384+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:09:27.811071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-17T15:09:29.145474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:09:33.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f705005ed90 msgr2=0x7f7050061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f705005ed90 0x7f7050061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7064151a50 tx=0x7f7054009780).stop 2023-05-17T15:09:33.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 msgr2=0x7f70641536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:33.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f70641536a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f705800c440 tx=0x7f7058007de0).stop 2023-05-17T15:09:33.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 shutdown_connections 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f705005ed90 0x7f7050061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7064152440 0x7f70640bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7064067cb0 0x7f70640c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 --2- 172.21.15.27:0/2695053384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f706414faa0 0x7f70641536a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 >> 172.21.15.27:0/2695053384 conn(0x7f70640676b0 msgr2=0x7f706414a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 shutdown_connections 2023-05-17T15:09:33.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:33.909+0000 7f7069696700 1 -- 172.21.15.27:0/2695053384 wait complete. 2023-05-17T15:09:33.926 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:09:33.926 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:09:34.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.038+0000 7fb1c9692700 1 Processor -- start 2023-05-17T15:09:34.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.038+0000 7fb1c9692700 1 -- start start 2023-05-17T15:09:34.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c9692700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c40c6490 0x7fb1c4069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c9692700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c40c07a0 con 0x7fb1c4153fa0 2023-05-17T15:09:34.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c9692700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c40c1c40 con 0x7fb1c40aae70 2023-05-17T15:09:34.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c9692700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4069d70 con 0x7fb1c40c6490 2023-05-17T15:09:34.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c2ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb1c4153fa0 0x7fb1c40c5d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40656/0 (socket says 172.21.15.27:40656) 2023-05-17T15:09:34.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c2ffd700 1 -- 172.21.15.27:0/1631148326 learned_addr learned my addr 172.21.15.27:0/1631148326 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c37fe700 1 --2- 172.21.15.27:0/1631148326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c40c6490 0x7fb1c4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648063718 0 0) 0x7fb1c40c07a0 con 0x7fb1c4153fa0 2023-05-17T15:09:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.039+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b00033f0 con 0x7fb1c4153fa0 2023-05-17T15:09:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885926314 0 0) 0x7fb1c40c1c40 con 0x7fb1c40aae70 2023-05-17T15:09:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c40c07a0 con 0x7fb1c40aae70 2023-05-17T15:09:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171384508 0 0) 0x7fb1b00033f0 con 0x7fb1c4153fa0 2023-05-17T15:09:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c37fe700 1 -- 172.21.15.27:0/1631148326 >> v1:172.21.15.40:6789/0 conn(0x7fb1c40aae70 legacy=0x7fb1c4069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c37fe700 1 -- 172.21.15.27:0/1631148326 >> v1:172.21.15.27:6789/0 conn(0x7fb1c4153fa0 legacy=0x7fb1c40c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c37fe700 1 -- 172.21.15.27:0/1631148326 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40bfe70 con 0x7fb1c40c6490 2023-05-17T15:09:34.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c37fe700 1 --2- 172.21.15.27:0/1631148326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c40c6490 0x7fb1c4069770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb1b4009790 tx=0x7fb1b4009060).ready entity=mon.2 client_cookie=230a22ef50cf0d53 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0017f0 con 0x7fb1c40c6490 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b4011400 con 0x7fb1c40c6490 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c1ffb700 1 -- 172.21.15.27:0/1631148326 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4011780 con 0x7fb1c40c6490 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c9692700 1 -- 172.21.15.27:0/1631148326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c40c6490 msgr2=0x7fb1c4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.040+0000 7fb1c9692700 1 --2- 172.21.15.27:0/1631148326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c40c6490 0x7fb1c4069770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb1b4009790 tx=0x7fb1b4009060).stop 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.041+0000 7fb1c9692700 1 -- 172.21.15.27:0/1631148326 shutdown_connections 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.041+0000 7fb1c9692700 1 --2- 172.21.15.27:0/1631148326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c40c6490 0x7fb1c4069770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.041+0000 7fb1c9692700 1 -- 172.21.15.27:0/1631148326 >> 172.21.15.27:0/1631148326 conn(0x7fb1c40cb810 msgr2=0x7fb1c40c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.041+0000 7fb1c9692700 1 -- 172.21.15.27:0/1631148326 shutdown_connections 2023-05-17T15:09:34.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.041+0000 7fb1c9692700 1 -- 172.21.15.27:0/1631148326 wait complete. 2023-05-17T15:09:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.042+0000 7fb1c9692700 1 Processor -- start 2023-05-17T15:09:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.042+0000 7fb1c9692700 1 -- start start 2023-05-17T15:09:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c40aae70 0x7fb1c41449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 0x7fb1c4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c4153fa0 0x7fb1c40c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4152240 con 0x7fb1c40c6490 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4157180 con 0x7fb1c40aae70 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c41531a0 con 0x7fb1c4153fa0 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 0x7fb1c4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 0x7fb1c4156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41102/0 (socket says 172.21.15.27:41102) 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c4153fa0 0x7fb1c40c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 -- 172.21.15.27:0/270329195 learned_addr learned my addr 172.21.15.27:0/270329195 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:34.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c2ffd700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c40aae70 0x7fb1c41449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 -- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c4153fa0 msgr2=0x7fb1c40c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c4153fa0 0x7fb1c40c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 -- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c40aae70 msgr2=0x7fb1c41449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c40aae70 0x7fb1c41449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 -- 172.21.15.27:0/270329195 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40092a0 con 0x7fb1c40c6490 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c27fc700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 0x7fb1c4156930 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fb1ac00c4c0 tx=0x7fb1ac007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac012400 con 0x7fb1c40c6490 2023-05-17T15:09:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac012560 con 0x7fb1c40c6490 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c4152d10 con 0x7fb1c40c6490 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.043+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0128e0 con 0x7fb1c40c6490 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.044+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c4152470 con 0x7fb1c40c6490 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.044+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c4152ea0 con 0x7fb1c40c6490 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.045+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb1ac019030 con 0x7fb1c40c6490 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.045+0000 7fb1baffd700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb1a405ed90 0x7fb1a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.045+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fb1ac078d50 con 0x7fb1c40c6490 2023-05-17T15:09:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.045+0000 7fb1c2ffd700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb1a405ed90 0x7fb1a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.046+0000 7fb1c2ffd700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb1a405ed90 0x7fb1a4061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb1c4157af0 tx=0x7fb1bc0019a0).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.049+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1ac0488f0 con 0x7fb1c40c6490 2023-05-17T15:09:34.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.218+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1c406bdf0 con 0x7fb1a405ed90 2023-05-17T15:09:34.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.228+0000 7fb1baffd700 1 -- 172.21.15.27:0/270329195 <== mgr.6933 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349547 (secure 0 0 0) 0x7fb1c406bdf0 con 0x7fb1a405ed90 2023-05-17T15:09:34.235 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:34.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb1a405ed90 msgr2=0x7fb1a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb1a405ed90 0x7fb1a4061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb1c4157af0 tx=0x7fb1bc0019a0).stop 2023-05-17T15:09:34.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 msgr2=0x7fb1c4156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 0x7fb1c4156930 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fb1ac00c4c0 tx=0x7fb1ac007c40).stop 2023-05-17T15:09:34.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 shutdown_connections 2023-05-17T15:09:34.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb1a405ed90 0x7fb1a4061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c4153fa0 0x7fb1c40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c40aae70 0x7fb1c41449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 --2- 172.21.15.27:0/270329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1c40c6490 0x7fb1c4156930 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 >> 172.21.15.27:0/270329195 conn(0x7fb1c40cb810 msgr2=0x7fb1c40c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:34.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 shutdown_connections 2023-05-17T15:09:34.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.231+0000 7fb1c9692700 1 -- 172.21.15.27:0/270329195 wait complete. 2023-05-17T15:09:34.239 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:09:34.247 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:09:33.709453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":146656,"kb_used_data":10272,"kb_used_omap":0,"kb_used_meta":136320,"kb_avail":754828064,"statfs":{"total":773094113280,"available":772943937536,"internally_reserved":0,"allocated":10518528,"data_stored":5259408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139591680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4469,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.997739"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767922+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:09:24.767922+0000","last_peered":"2023-05-17T15:09:24.767922+0000","last_clean":"2023-05-17T15:09:24.767922+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:09:24.767922+0000","last_undegraded":"2023-05-17T15:09:24.767922+0000","last_fullsized":"2023-05-17T15:09:24.767922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.687552+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:09:24.687552+0000","last_peered":"2023-05-17T15:09:24.687552+0000","last_clean":"2023-05-17T15:09:24.687552+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:09:24.687552+0000","last_undegraded":"2023-05-17T15:09:24.687552+0000","last_fullsized":"2023-05-17T15:09:24.687552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767579+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:09:24.767579+0000","last_peered":"2023-05-17T15:09:24.767579+0000","last_clean":"2023-05-17T15:09:24.767579+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:09:24.767579+0000","last_undegraded":"2023-05-17T15:09:24.767579+0000","last_fullsized":"2023-05-17T15:09:24.767579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.687532+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:09:24.687532+0000","last_peered":"2023-05-17T15:09:24.687532+0000","last_clean":"2023-05-17T15:09:24.687532+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:09:24.687532+0000","last_undegraded":"2023-05-17T15:09:24.687532+0000","last_fullsized":"2023-05-17T15:09:24.687532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767961+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:09:24.767961+0000","last_peered":"2023-05-17T15:09:24.767961+0000","last_clean":"2023-05-17T15:09:24.767961+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:09:24.767961+0000","last_undegraded":"2023-05-17T15:09:24.767961+0000","last_fullsized":"2023-05-17T15:09:24.767961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767957+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:09:24.767957+0000","last_peered":"2023-05-17T15:09:24.767957+0000","last_clean":"2023-05-17T15:09:24.767957+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:09:24.767957+0000","last_undegraded":"2023-05-17T15:09:24.767957+0000","last_fullsized":"2023-05-17T15:09:24.767957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767900+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:09:24.767900+0000","last_peered":"2023-05-17T15:09:24.767900+0000","last_clean":"2023-05-17T15:09:24.767900+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:09:24.767900+0000","last_undegraded":"2023-05-17T15:09:24.767900+0000","last_fullsized":"2023-05-17T15:09:24.767900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767942+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:09:24.767942+0000","last_peered":"2023-05-17T15:09:24.767942+0000","last_clean":"2023-05-17T15:09:24.767942+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:09:24.767942+0000","last_undegraded":"2023-05-17T15:09:24.767942+0000","last_fullsized":"2023-05-17T15:09:24.767942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767316+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:09:24.767316+0000","last_peered":"2023-05-17T15:09:24.767316+0000","last_clean":"2023-05-17T15:09:24.767316+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:09:24.767316+0000","last_undegraded":"2023-05-17T15:09:24.767316+0000","last_fullsized":"2023-05-17T15:09:24.767316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17868,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353972,"statfs":{"total":96636764160,"available":96618467328,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.36499999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.79200000000000004,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.81999999999999995,"15min":0.89000000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.042},"last":0.624}]},{"osd":6,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.90800000000000003,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17228,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94354612,"statfs":{"total":96636764160,"available":96619122688,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74299999999999999,"5min":1.04,"15min":1.04},"last":0.623}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":1.087,"15min":1.087},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77800000000000002,"5min":1.159,"15min":1.159},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83099999999999996,"5min":1.609,"15min":1.609},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86799999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80700000000000005,"5min":0.879,"15min":0.89500000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17036,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94354804,"statfs":{"total":96636764160,"available":96619319296,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.34899999999999998}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.30199999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.497}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.377,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40600000000000003,"15min":0.41299999999999998},"min":{"1min":0.26000000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.214},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.40400000000000003}]},{"osd":4,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.67700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34899999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0720000000000001},"last":0.63100000000000001}]},{"osd":5,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65300000000000002},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.66500000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.087},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0740000000000001},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18252,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16960,"kb_avail":94353588,"statfs":{"total":96636764160,"available":96618074112,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17367040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.378,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.628,"15min":0.628},"last":0.248},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41999999999999998,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.311}]},{"osd":3,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.056,"15min":1.056},"last":0.497},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.995,"15min":1.046},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":6,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75900000000000001,"5min":0.92200000000000004,"15min":1.0860000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.441,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.88500000000000001,"5min":1.036,"15min":1.036},"last":0.51700000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.76100000000000001,"5min":0.97499999999999998,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21132,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":19840,"kb_avail":94350708,"statfs":{"total":96636764160,"available":96615124992,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20316160},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.748,"15min":0.748},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.498,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.372,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53700000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.60999999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.86199999999999999,"5min":0.99099999999999999,"15min":1.034},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":3.4590000000000001},"last":0.622}]},{"osd":5,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86699999999999999,"5min":1.155,"15min":3.4289999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.69999999999999996},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.99399999999999999,"5min":1.772,"15min":3.4049999999999998},"last":0.627},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.024,"15min":3.391},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":17484,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354356,"statfs":{"total":96636764160,"available":96618860544,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77600000000000002,"5min":1.292,"15min":1.292},"last":0.624}]},{"osd":2,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64100000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.75900000000000001,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65700000000000003,"5min":1.637,"15min":1.637},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.502},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83899999999999997,"5min":0.995,"15min":0.995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80700000000000005,"5min":1.329,"15min":1.329},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.151,"15min":1.151},"last":0.70299999999999996}]},{"osd":7,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20812,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351028,"statfs":{"total":96636764160,"available":96615452672,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82399999999999995,"5min":0.83599999999999997,"15min":0.876},"last":0.627},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.34499999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.995},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.82299999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.046,"5min":1.107,"15min":1.107},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:34.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:09:34.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.400+0000 7fde22a07700 1 Processor -- start 2023-05-17T15:09:34.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.400+0000 7fde22a07700 1 -- start start 2023-05-17T15:09:34.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde22a07700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde1c1544f0 0x7fde1c0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde22a07700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c1549b0 con 0x7fde1c0aa070 2023-05-17T15:09:34.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde22a07700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c154c90 con 0x7fde1c0c1180 2023-05-17T15:09:34.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde22a07700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c154f70 con 0x7fde1c1544f0 2023-05-17T15:09:34.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde22206700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fde1c0aa070 0x7fde1c0c74a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40674/0 (socket says 172.21.15.27:40674) 2023-05-17T15:09:34.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde22206700 1 -- 172.21.15.27:0/1792479154 learned_addr learned my addr 172.21.15.27:0/1792479154 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde21204700 1 --2- 172.21.15.27:0/1792479154 >> v2:172.21.15.40:3300/0 conn(0x7fde1c1544f0 0x7fde1c0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055514941 0 0) 0x7fde1c1549b0 con 0x7fde1c0aa070 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde080033f0 con 0x7fde1c0aa070 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597010647 0 0) 0x7fde080033f0 con 0x7fde1c0aa070 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 >> v2:172.21.15.40:3300/0 conn(0x7fde1c1544f0 msgr2=0x7fde1c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 --2- 172.21.15.27:0/1792479154 >> v2:172.21.15.40:3300/0 conn(0x7fde1c1544f0 0x7fde1c0a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 >> v1:172.21.15.40:6789/0 conn(0x7fde1c0c1180 legacy=0x7fde1c0c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.401+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c155250 con 0x7fde1c0aa070 2023-05-17T15:09:34.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fde18001470 con 0x7fde1c0aa070 2023-05-17T15:09:34.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 >> v1:172.21.15.27:6789/0 conn(0x7fde1c0aa070 legacy=0x7fde1c0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde080038e0 0x7fde08003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde08004690 0x7fde08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde0800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c154f70 con 0x7fde08005000 2023-05-17T15:09:34.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0800bf30 con 0x7fde080038e0 2023-05-17T15:09:34.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0800c0f0 con 0x7fde08004690 2023-05-17T15:09:34.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde0800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde21204700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde08004690 0x7fde08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde21a05700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde080038e0 0x7fde08003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 -- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde08004690 msgr2=0x7fde08004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:34.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde08004690 0x7fde08004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 -- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde080038e0 msgr2=0x7fde08003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:34.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde080038e0 0x7fde08003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 -- 172.21.15.27:0/1792479154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080033f0 con 0x7fde08005000 2023-05-17T15:09:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde21a05700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde080038e0 0x7fde08003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 -- 172.21.15.27:0/1792479154 reap_dead start 2023-05-17T15:09:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde22206700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde0800b8e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fde1800c110 tx=0x7fde18001df0).ready entity=mon.0 client_cookie=c7a5fcd3a65eacea server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800ca40 con 0x7fde08005000 2023-05-17T15:09:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800cba0 con 0x7fde08005000 2023-05-17T15:09:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.402+0000 7fde20a03700 1 -- 172.21.15.27:0/1792479154 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180070d0 con 0x7fde08005000 2023-05-17T15:09:34.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 -- 172.21.15.27:0/1792479154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 msgr2=0x7fde0800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde0800b8e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fde1800c110 tx=0x7fde18001df0).stop 2023-05-17T15:09:34.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 -- 172.21.15.27:0/1792479154 shutdown_connections 2023-05-17T15:09:34.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 --2- 172.21.15.27:0/1792479154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde0800b8e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 -- 172.21.15.27:0/1792479154 >> 172.21.15.27:0/1792479154 conn(0x7fde1c05dd50 msgr2=0x7fde1c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:34.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 -- 172.21.15.27:0/1792479154 shutdown_connections 2023-05-17T15:09:34.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.403+0000 7fde22a07700 1 -- 172.21.15.27:0/1792479154 wait complete. 2023-05-17T15:09:34.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.404+0000 7fde22a07700 1 Processor -- start 2023-05-17T15:09:34.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.404+0000 7fde22a07700 1 -- start start 2023-05-17T15:09:34.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22a07700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde1c143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22a07700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c0c2b90 0x7fde1c0c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22a07700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c0ca9d0 0x7fde1c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22a07700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c143d00 con 0x7fde08005000 2023-05-17T15:09:34.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22a07700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c164610 con 0x7fde1c0ca9d0 2023-05-17T15:09:34.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22a07700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0ada20 con 0x7fde1c0c2b90 2023-05-17T15:09:34.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde21a05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde1c143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde21a05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde1c143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41120/0 (socket says 172.21.15.27:41120) 2023-05-17T15:09:34.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde21a05700 1 -- 172.21.15.27:0/3300125986 learned_addr learned my addr 172.21.15.27:0/3300125986 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:34.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde22206700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c0ca9d0 0x7fde1c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.405+0000 7fde21204700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c0c2b90 0x7fde1c0c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde21a05700 1 -- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c0c2b90 msgr2=0x7fde1c0c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde21a05700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c0c2b90 0x7fde1c0c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde21a05700 1 -- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c0ca9d0 msgr2=0x7fde1c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde21a05700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c0ca9d0 0x7fde1c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde21a05700 1 -- 172.21.15.27:0/3300125986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0cb320 con 0x7fde08005000 2023-05-17T15:09:34.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde21a05700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde1c143810 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fde1400e970 tx=0x7fde14009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400a7c0 con 0x7fde08005000 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14010040 con 0x7fde08005000 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400ab30 con 0x7fde08005000 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c163ce0 con 0x7fde08005000 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.406+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c1642a0 con 0x7fde08005000 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.407+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c06bdf0 con 0x7fde08005000 2023-05-17T15:09:34.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.407+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fde1401b030 con 0x7fde08005000 2023-05-17T15:09:34.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.408+0000 7fde11ffb700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fde0005ed90 0x7fde00061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.408+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fde14079420 con 0x7fde08005000 2023-05-17T15:09:34.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.408+0000 7fde21204700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fde0005ed90 0x7fde00061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.408+0000 7fde21204700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fde0005ed90 0x7fde00061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fde0c006d50 tx=0x7fde0c008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.412+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde1404aa20 con 0x7fde08005000 2023-05-17T15:09:34.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.581+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde1c0bfb80 con 0x7fde0005ed90 2023-05-17T15:09:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.590+0000 7fde11ffb700 1 -- 172.21.15.27:0/3300125986 <== mgr.6933 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349547 (secure 0 0 0) 0x7fde1c0bfb80 con 0x7fde0005ed90 2023-05-17T15:09:34.597 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:34.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fde0005ed90 msgr2=0x7fde00061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fde0005ed90 0x7fde00061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fde0c006d50 tx=0x7fde0c008040).stop 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 msgr2=0x7fde1c143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde1c143810 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fde1400e970 tx=0x7fde14009040).stop 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 shutdown_connections 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fde0005ed90 0x7fde00061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c0ca9d0 0x7fde1c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde08005000 0x7fde1c143810 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 --2- 172.21.15.27:0/3300125986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c0c2b90 0x7fde1c0c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 >> 172.21.15.27:0/3300125986 conn(0x7fde1c05dd50 msgr2=0x7fde1c0aac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:34.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 shutdown_connections 2023-05-17T15:09:34.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.594+0000 7fde22a07700 1 -- 172.21.15.27:0/3300125986 wait complete. 2023-05-17T15:09:34.601 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:09:34.610 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:09:33.709453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":146656,"kb_used_data":10272,"kb_used_omap":0,"kb_used_meta":136320,"kb_avail":754828064,"statfs":{"total":773094113280,"available":772943937536,"internally_reserved":0,"allocated":10518528,"data_stored":5259408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139591680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4469,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.997739"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767922+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:09:24.767922+0000","last_peered":"2023-05-17T15:09:24.767922+0000","last_clean":"2023-05-17T15:09:24.767922+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:09:24.767922+0000","last_undegraded":"2023-05-17T15:09:24.767922+0000","last_fullsized":"2023-05-17T15:09:24.767922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.687552+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:09:24.687552+0000","last_peered":"2023-05-17T15:09:24.687552+0000","last_clean":"2023-05-17T15:09:24.687552+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:09:24.687552+0000","last_undegraded":"2023-05-17T15:09:24.687552+0000","last_fullsized":"2023-05-17T15:09:24.687552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767579+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:09:24.767579+0000","last_peered":"2023-05-17T15:09:24.767579+0000","last_clean":"2023-05-17T15:09:24.767579+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:09:24.767579+0000","last_undegraded":"2023-05-17T15:09:24.767579+0000","last_fullsized":"2023-05-17T15:09:24.767579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.687532+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:09:24.687532+0000","last_peered":"2023-05-17T15:09:24.687532+0000","last_clean":"2023-05-17T15:09:24.687532+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:09:24.687532+0000","last_undegraded":"2023-05-17T15:09:24.687532+0000","last_fullsized":"2023-05-17T15:09:24.687532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767961+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:09:24.767961+0000","last_peered":"2023-05-17T15:09:24.767961+0000","last_clean":"2023-05-17T15:09:24.767961+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:09:24.767961+0000","last_undegraded":"2023-05-17T15:09:24.767961+0000","last_fullsized":"2023-05-17T15:09:24.767961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767957+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:09:24.767957+0000","last_peered":"2023-05-17T15:09:24.767957+0000","last_clean":"2023-05-17T15:09:24.767957+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:09:24.767957+0000","last_undegraded":"2023-05-17T15:09:24.767957+0000","last_fullsized":"2023-05-17T15:09:24.767957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767900+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:09:24.767900+0000","last_peered":"2023-05-17T15:09:24.767900+0000","last_clean":"2023-05-17T15:09:24.767900+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:09:24.767900+0000","last_undegraded":"2023-05-17T15:09:24.767900+0000","last_fullsized":"2023-05-17T15:09:24.767900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767942+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:09:24.767942+0000","last_peered":"2023-05-17T15:09:24.767942+0000","last_clean":"2023-05-17T15:09:24.767942+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:09:24.767942+0000","last_undegraded":"2023-05-17T15:09:24.767942+0000","last_fullsized":"2023-05-17T15:09:24.767942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767316+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:09:24.767316+0000","last_peered":"2023-05-17T15:09:24.767316+0000","last_clean":"2023-05-17T15:09:24.767316+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:09:24.767316+0000","last_undegraded":"2023-05-17T15:09:24.767316+0000","last_fullsized":"2023-05-17T15:09:24.767316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17868,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353972,"statfs":{"total":96636764160,"available":96618467328,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.36499999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.79200000000000004,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.81999999999999995,"15min":0.89000000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.042},"last":0.624}]},{"osd":6,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.90800000000000003,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17228,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94354612,"statfs":{"total":96636764160,"available":96619122688,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74299999999999999,"5min":1.04,"15min":1.04},"last":0.623}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":1.087,"15min":1.087},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77800000000000002,"5min":1.159,"15min":1.159},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83099999999999996,"5min":1.609,"15min":1.609},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86799999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80700000000000005,"5min":0.879,"15min":0.89500000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17036,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94354804,"statfs":{"total":96636764160,"available":96619319296,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.34899999999999998}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.30199999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.497}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.377,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40600000000000003,"15min":0.41299999999999998},"min":{"1min":0.26000000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.214},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.40400000000000003}]},{"osd":4,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.67700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34899999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0720000000000001},"last":0.63100000000000001}]},{"osd":5,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65300000000000002},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.66500000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.087},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0740000000000001},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18252,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16960,"kb_avail":94353588,"statfs":{"total":96636764160,"available":96618074112,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17367040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.378,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.628,"15min":0.628},"last":0.248},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41999999999999998,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.311}]},{"osd":3,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.056,"15min":1.056},"last":0.497},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.995,"15min":1.046},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":6,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75900000000000001,"5min":0.92200000000000004,"15min":1.0860000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.441,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.88500000000000001,"5min":1.036,"15min":1.036},"last":0.51700000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.76100000000000001,"5min":0.97499999999999998,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21132,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":19840,"kb_avail":94350708,"statfs":{"total":96636764160,"available":96615124992,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20316160},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.748,"15min":0.748},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.498,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.372,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53700000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.60999999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.86199999999999999,"5min":0.99099999999999999,"15min":1.034},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":3.4590000000000001},"last":0.622}]},{"osd":5,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86699999999999999,"5min":1.155,"15min":3.4289999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.69999999999999996},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.99399999999999999,"5min":1.772,"15min":3.4049999999999998},"last":0.627},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.024,"15min":3.391},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":17484,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354356,"statfs":{"total":96636764160,"available":96618860544,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77600000000000002,"5min":1.292,"15min":1.292},"last":0.624}]},{"osd":2,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64100000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.75900000000000001,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65700000000000003,"5min":1.637,"15min":1.637},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.502},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83899999999999997,"5min":0.995,"15min":0.995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80700000000000005,"5min":1.329,"15min":1.329},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.151,"15min":1.151},"last":0.70299999999999996}]},{"osd":7,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20812,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351028,"statfs":{"total":96636764160,"available":96615452672,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82399999999999995,"5min":0.83599999999999997,"15min":0.876},"last":0.627},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.34499999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.995},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.82299999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.046,"5min":1.107,"15min":1.107},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:34.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:09:34.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.762+0000 7fdebe073700 1 Processor -- start 2023-05-17T15:09:34.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.762+0000 7fdebe073700 1 -- start start 2023-05-17T15:09:34.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdebe073700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdeb80c5f30 0x7fdeb80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdebe073700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdeb8158880 0x7fdeb8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdebe073700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb81541c0 0x7fdeb80c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdebe073700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb80bfcd0 con 0x7fdeb80c5f30 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdebe073700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb80c0290 con 0x7fdeb8158880 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdebe073700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80aa1a0 con 0x7fdeb81541c0 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdeb80c5f30 0x7fdeb80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdeb80c5f30 0x7fdeb80c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41128/0 (socket says 172.21.15.27:41128) 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 -- 172.21.15.27:0/4180489112 learned_addr learned my addr 172.21.15.27:0/4180489112 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb7fff700 1 --2- 172.21.15.27:0/4180489112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb81541c0 0x7fdeb80c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb6ffd700 1 --2- 172.21.15.27:0/4180489112 >> v2:172.21.15.40:3300/0 conn(0x7fdeb8158880 0x7fdeb8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 -- 172.21.15.27:0/4180489112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb81541c0 msgr2=0x7fdeb80c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/4180489112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb81541c0 0x7fdeb80c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 -- 172.21.15.27:0/4180489112 >> v2:172.21.15.40:3300/0 conn(0x7fdeb8158880 msgr2=0x7fdeb8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/4180489112 >> v2:172.21.15.40:3300/0 conn(0x7fdeb8158880 0x7fdeb8153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 -- 172.21.15.27:0/4180489112 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80aa480 con 0x7fdeb80c5f30 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/4180489112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb80c5f30 0x7fdeb80c6310 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fdeb80c57b0 tx=0x7fdeac0090f0).ready entity=mon.0 client_cookie=4aeeb6e9509b6dcf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb67fc700 1 -- 172.21.15.27:0/4180489112 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00b600 con 0x7fdeb80c5f30 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb67fc700 1 -- 172.21.15.27:0/4180489112 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac00b760 con 0x7fdeb80c5f30 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.763+0000 7fdeb67fc700 1 -- 172.21.15.27:0/4180489112 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00bae0 con 0x7fdeb80c5f30 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 -- 172.21.15.27:0/4180489112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb80c5f30 msgr2=0x7fdeb80c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 --2- 172.21.15.27:0/4180489112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb80c5f30 0x7fdeb80c6310 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fdeb80c57b0 tx=0x7fdeac0090f0).stop 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 -- 172.21.15.27:0/4180489112 shutdown_connections 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 --2- 172.21.15.27:0/4180489112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb80c5f30 0x7fdeb80c6310 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 --2- 172.21.15.27:0/4180489112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb81541c0 0x7fdeb80c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 --2- 172.21.15.27:0/4180489112 >> v2:172.21.15.40:3300/0 conn(0x7fdeb8158880 0x7fdeb8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 -- 172.21.15.27:0/4180489112 >> 172.21.15.27:0/4180489112 conn(0x7fdeb8069e70 msgr2=0x7fdeb805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:34.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 -- 172.21.15.27:0/4180489112 shutdown_connections 2023-05-17T15:09:34.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.764+0000 7fdebe073700 1 -- 172.21.15.27:0/4180489112 wait complete. 2023-05-17T15:09:34.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.765+0000 7fdebe073700 1 Processor -- start 2023-05-17T15:09:34.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.765+0000 7fdebe073700 1 -- start start 2023-05-17T15:09:34.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdebe073700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeb80c5f30 0x7fdeb81413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdebe073700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 0x7fdeb80add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdebe073700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb8158880 0x7fdeb80ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdebe073700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80ae6e0 con 0x7fdeb81541c0 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdebe073700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8144ae0 con 0x7fdeb80c5f30 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdebe073700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8143ed0 con 0x7fdeb8158880 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 0x7fdeb80add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 0x7fdeb80add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41136/0 (socket says 172.21.15.27:41136) 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 -- 172.21.15.27:0/2082532120 learned_addr learned my addr 172.21.15.27:0/2082532120 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:34.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeb80c5f30 0x7fdeb81413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb7fff700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb8158880 0x7fdeb80ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 -- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb8158880 msgr2=0x7fdeb80ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb8158880 0x7fdeb80ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 -- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeb80c5f30 msgr2=0x7fdeb81413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeb80c5f30 0x7fdeb81413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 -- 172.21.15.27:0/2082532120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009370 con 0x7fdeb81541c0 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeb80c5f30 0x7fdeb81413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:34.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.766+0000 7fdeb6ffd700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 0x7fdeb80add00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fdea800d890 tx=0x7fdea8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.767+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea80125f0 con 0x7fdeb81541c0 2023-05-17T15:09:34.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.767+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea8012750 con 0x7fdeb81541c0 2023-05-17T15:09:34.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.767+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb81441b0 con 0x7fdeb81541c0 2023-05-17T15:09:34.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.767+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8012ad0 con 0x7fdeb81541c0 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.767+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb8144770 con 0x7fdeb81541c0 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.768+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb805f4a0 con 0x7fdeb81541c0 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.768+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdea8013480 con 0x7fdeb81541c0 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.768+0000 7fde9f7fe700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdea405ed90 0x7fdea4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.769+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fdea8079a50 con 0x7fdeb81541c0 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.769+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdea405ed90 0x7fdea4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.769+0000 7fdeb77fe700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdea405ed90 0x7fdea4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdeb80a9e00 tx=0x7fdeac017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:34.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.773+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdea804af40 con 0x7fdeb81541c0 2023-05-17T15:09:34.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.943+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdeb806bdf0 con 0x7fdea405ed90 2023-05-17T15:09:34.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.952+0000 7fde9f7fe700 1 -- 172.21.15.27:0/2082532120 <== mgr.6933 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349547 (secure 0 0 0) 0x7fdeb806bdf0 con 0x7fdea405ed90 2023-05-17T15:09:34.959 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:34.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdea405ed90 msgr2=0x7fdea4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdea405ed90 0x7fdea4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdeb80a9e00 tx=0x7fdeac017000).stop 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 msgr2=0x7fdeb80add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 0x7fdeb80add00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fdea800d890 tx=0x7fdea8008040).stop 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 shutdown_connections 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdea405ed90 0x7fdea4061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdeb8158880 0x7fdeb80ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeb80c5f30 0x7fdeb81413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 --2- 172.21.15.27:0/2082532120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdeb81541c0 0x7fdeb80add00 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:34.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 >> 172.21.15.27:0/2082532120 conn(0x7fdeb8069e70 msgr2=0x7fdeb80acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:34.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 shutdown_connections 2023-05-17T15:09:34.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:34.956+0000 7fdebe073700 1 -- 172.21.15.27:0/2082532120 wait complete. 2023-05-17T15:09:34.964 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:09:34.972 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:09:33.709453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":146656,"kb_used_data":10272,"kb_used_omap":0,"kb_used_meta":136320,"kb_avail":754828064,"statfs":{"total":773094113280,"available":772943937536,"internally_reserved":0,"allocated":10518528,"data_stored":5259408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139591680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4469,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.997739"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767922+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:09:24.767922+0000","last_peered":"2023-05-17T15:09:24.767922+0000","last_clean":"2023-05-17T15:09:24.767922+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:09:24.767922+0000","last_undegraded":"2023-05-17T15:09:24.767922+0000","last_fullsized":"2023-05-17T15:09:24.767922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.687552+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:09:24.687552+0000","last_peered":"2023-05-17T15:09:24.687552+0000","last_clean":"2023-05-17T15:09:24.687552+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:09:24.687552+0000","last_undegraded":"2023-05-17T15:09:24.687552+0000","last_fullsized":"2023-05-17T15:09:24.687552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767579+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:09:24.767579+0000","last_peered":"2023-05-17T15:09:24.767579+0000","last_clean":"2023-05-17T15:09:24.767579+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:09:24.767579+0000","last_undegraded":"2023-05-17T15:09:24.767579+0000","last_fullsized":"2023-05-17T15:09:24.767579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.687532+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:09:24.687532+0000","last_peered":"2023-05-17T15:09:24.687532+0000","last_clean":"2023-05-17T15:09:24.687532+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:09:24.687532+0000","last_undegraded":"2023-05-17T15:09:24.687532+0000","last_fullsized":"2023-05-17T15:09:24.687532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767961+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:09:24.767961+0000","last_peered":"2023-05-17T15:09:24.767961+0000","last_clean":"2023-05-17T15:09:24.767961+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:09:24.767961+0000","last_undegraded":"2023-05-17T15:09:24.767961+0000","last_fullsized":"2023-05-17T15:09:24.767961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767957+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:09:24.767957+0000","last_peered":"2023-05-17T15:09:24.767957+0000","last_clean":"2023-05-17T15:09:24.767957+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:09:24.767957+0000","last_undegraded":"2023-05-17T15:09:24.767957+0000","last_fullsized":"2023-05-17T15:09:24.767957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767900+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:09:24.767900+0000","last_peered":"2023-05-17T15:09:24.767900+0000","last_clean":"2023-05-17T15:09:24.767900+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:09:24.767900+0000","last_undegraded":"2023-05-17T15:09:24.767900+0000","last_fullsized":"2023-05-17T15:09:24.767900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767942+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:09:24.767942+0000","last_peered":"2023-05-17T15:09:24.767942+0000","last_clean":"2023-05-17T15:09:24.767942+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:09:24.767942+0000","last_undegraded":"2023-05-17T15:09:24.767942+0000","last_fullsized":"2023-05-17T15:09:24.767942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:29.767746+0000","last_change":"2023-05-17T15:09:29.767746+0000","last_active":"2023-05-17T15:09:29.767746+0000","last_peered":"2023-05-17T15:09:29.767746+0000","last_clean":"2023-05-17T15:09:29.767746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:29.767746+0000","last_undegraded":"2023-05-17T15:09:29.767746+0000","last_fullsized":"2023-05-17T15:09:29.767746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:09:28.760411+0000","last_change":"2023-05-17T15:09:28.760411+0000","last_active":"2023-05-17T15:09:28.760411+0000","last_peered":"2023-05-17T15:09:28.760411+0000","last_clean":"2023-05-17T15:09:28.760411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:09:28.760411+0000","last_undegraded":"2023-05-17T15:09:28.760411+0000","last_fullsized":"2023-05-17T15:09:28.760411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-05-17T15:09:24.767316+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:09:24.767316+0000","last_peered":"2023-05-17T15:09:24.767316+0000","last_clean":"2023-05-17T15:09:24.767316+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:09:24.767316+0000","last_undegraded":"2023-05-17T15:09:24.767316+0000","last_fullsized":"2023-05-17T15:09:24.767316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17868,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353972,"statfs":{"total":96636764160,"available":96618467328,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.36499999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.79200000000000004,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.81999999999999995,"15min":0.89000000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.042},"last":0.624}]},{"osd":6,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.90800000000000003,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17228,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94354612,"statfs":{"total":96636764160,"available":96619122688,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74299999999999999,"5min":1.04,"15min":1.04},"last":0.623}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":1.087,"15min":1.087},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77800000000000002,"5min":1.159,"15min":1.159},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83099999999999996,"5min":1.609,"15min":1.609},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86799999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80700000000000005,"5min":0.879,"15min":0.89500000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17036,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94354804,"statfs":{"total":96636764160,"available":96619319296,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.34899999999999998}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.30199999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.497}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.377,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40600000000000003,"15min":0.41299999999999998},"min":{"1min":0.26000000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.214},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.40400000000000003}]},{"osd":4,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.67700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34899999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0720000000000001},"last":0.63100000000000001}]},{"osd":5,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65300000000000002},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.66500000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.087},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0740000000000001},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18252,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16960,"kb_avail":94353588,"statfs":{"total":96636764160,"available":96618074112,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17367040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.378,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.628,"15min":0.628},"last":0.248},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41999999999999998,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.311}]},{"osd":3,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.056,"15min":1.056},"last":0.497},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.995,"15min":1.046},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":6,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75900000000000001,"5min":0.92200000000000004,"15min":1.0860000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.441,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.88500000000000001,"5min":1.036,"15min":1.036},"last":0.51700000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.76100000000000001,"5min":0.97499999999999998,"15min":1.03},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21132,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":19840,"kb_avail":94350708,"statfs":{"total":96636764160,"available":96615124992,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20316160},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.748,"15min":0.748},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.498,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.372,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53700000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.60999999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.86199999999999999,"5min":0.99099999999999999,"15min":1.034},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":3.4590000000000001},"last":0.622}]},{"osd":5,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86699999999999999,"5min":1.155,"15min":3.4289999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.69999999999999996},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.99399999999999999,"5min":1.772,"15min":3.4049999999999998},"last":0.627},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.024,"15min":3.391},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":17484,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354356,"statfs":{"total":96636764160,"available":96618860544,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77600000000000002,"5min":1.292,"15min":1.292},"last":0.624}]},{"osd":2,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64100000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.75900000000000001,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65700000000000003,"5min":1.637,"15min":1.637},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.502},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83899999999999997,"5min":0.995,"15min":0.995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80700000000000005,"5min":1.329,"15min":1.329},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.151,"15min":1.151},"last":0.70299999999999996}]},{"osd":7,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20812,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351028,"statfs":{"total":96636764160,"available":96615452672,"internally_reserved":0,"allocated":1314816,"data_stored":657426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82399999999999995,"5min":0.83599999999999997,"15min":0.876},"last":0.627},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.34499999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.995},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.82299999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.046,"5min":1.107,"15min":1.107},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:34.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-05-17T15:09:34.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-05-17T15:09:34.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-05-17T15:09:34.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-05-17T15:09:34.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-05-17T15:09:34.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-05-17T15:09:34.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-05-17T15:09:34.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-05-17T15:09:34.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-05-17T15:09:34.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-05-17T15:09:34.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-05-17T15:09:34.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-05-17T15:09:34.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-05-17T15:09:34.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-05-17T15:09:34.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-05-17T15:09:34.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-05-17T15:09:34.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-05-17T15:09:34.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-05-17T15:09:34.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-05-17T15:09:34.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-05-17T15:09:34.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-05-17T15:09:34.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-05-17T15:09:34.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-05-17T15:09:34.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:34.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-05-17T15:09:34.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-05-17T15:09:35.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-05-17T15:09:35.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-05-17T15:09:35.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-05-17T15:09:35.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-05-17T15:09:35.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-05-17T15:09:35.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-05-17T15:09:35.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-05-17T15:09:35.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-05-17T15:09:35.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-05-17T15:09:35.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-05-17T15:09:35.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-05-17T15:09:35.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-05-17T15:09:35.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-05-17T15:09:35.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-05-17T15:09:35.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-05-17T15:09:35.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-05-17T15:09:35.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-05-17T15:09:35.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-05-17T15:09:35.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-05-17T15:09:35.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-05-17T15:09:35.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-05-17T15:09:35.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-05-17T15:09:35.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-05-17T15:09:35.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-05-17T15:09:35.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-05-17T15:09:35.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-05-17T15:09:35.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-05-17T15:09:35.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-05-17T15:09:35.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-05-17T15:09:35.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-05-17T15:09:35.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-05-17T15:09:35.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-05-17T15:09:35.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-05-17T15:09:35.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-05-17T15:09:35.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-05-17T15:09:35.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-05-17T15:09:35.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-05-17T15:09:35.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-05-17T15:09:35.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-05-17T15:09:35.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-05-17T15:09:35.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-05-17T15:09:35.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-05-17T15:09:35.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-05-17T15:09:35.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-05-17T15:09:35.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-05-17T15:09:35.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-05-17T15:09:35.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-05-17T15:09:35.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-05-17T15:09:35.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-05-17T15:09:35.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-05-17T15:09:35.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-05-17T15:09:35.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-05-17T15:09:35.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-05-17T15:09:35.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-05-17T15:09:35.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-05-17T15:09:35.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-05-17T15:09:35.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-05-17T15:09:35.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-05-17T15:09:35.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-05-17T15:09:35.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-05-17T15:09:35.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-05-17T15:09:35.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-05-17T15:09:35.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-05-17T15:09:35.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-05-17T15:09:35.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-05-17T15:09:35.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-05-17T15:09:35.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-05-17T15:09:35.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-05-17T15:09:35.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-05-17T15:09:35.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-05-17T15:09:35.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-05-17T15:09:35.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-05-17T15:09:35.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-05-17T15:09:35.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-05-17T15:09:35.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-05-17T15:09:35.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-05-17T15:09:35.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-05-17T15:09:35.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-05-17T15:09:35.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-05-17T15:09:35.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-05-17T15:09:35.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-05-17T15:09:35.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-05-17T15:09:35.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-05-17T15:09:35.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-05-17T15:09:35.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-05-17T15:09:35.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-05-17T15:09:35.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-05-17T15:09:35.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-05-17T15:09:35.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-05-17T15:09:35.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-05-17T15:09:35.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-05-17T15:09:35.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-05-17T15:09:35.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-05-17T15:09:35.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-05-17T15:09:35.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-05-17T15:09:35.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-05-17T15:09:35.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-05-17T15:09:35.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-05-17T15:09:35.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-05-17T15:09:35.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-05-17T15:09:35.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-05-17T15:09:35.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-05-17T15:09:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:29.767746+0000', 'last_change': '2023-05-17T15:09:29.767746+0000', 'last_active': '2023-05-17T15:09:29.767746+0000', 'last_peered': '2023-05-17T15:09:29.767746+0000', 'last_clean': '2023-05-17T15:09:29.767746+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:29.767746+0000', 'last_undegraded': '2023-05-17T15:09:29.767746+0000', 'last_fullsized': '2023-05-17T15:09:29.767746+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:29.767746+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-05-17T15:09:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:09:28.760411+0000', 'last_change': '2023-05-17T15:09:28.760411+0000', 'last_active': '2023-05-17T15:09:28.760411+0000', 'last_peered': '2023-05-17T15:09:28.760411+0000', 'last_clean': '2023-05-17T15:09:28.760411+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:09:28.760411+0000', 'last_undegraded': '2023-05-17T15:09:28.760411+0000', 'last_fullsized': '2023-05-17T15:09:28.760411+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'last_clean_scrub_stamp': '2023-05-17T15:09:28.760411+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:09:35.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-17T15:09:35.083 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:09:35.079+0000 7fa5c544d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:09:35.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.189+0000 7f749ece0700 1 Processor -- start 2023-05-17T15:09:35.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.189+0000 7f749ece0700 1 -- start start 2023-05-17T15:09:35.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ece0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f74980c6310 0x7f7498153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ece0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74981541c0 0x7f74980c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ece0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980bfcd0 con 0x7f74980c5f30 2023-05-17T15:09:35.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ece0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980c0290 con 0x7f74980c6310 2023-05-17T15:09:35.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ece0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980aa1a0 con 0x7f74981541c0 2023-05-17T15:09:35.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f74980c6310 0x7f7498153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ca7c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f74980c5f30 0x7f7498158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40704/0 (socket says 172.21.15.27:40704) 2023-05-17T15:09:35.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f74980c6310 0x7f7498153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41144/0 (socket says 172.21.15.27:41144) 2023-05-17T15:09:35.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749ca7c700 1 -- 172.21.15.27:0/215096245 learned_addr learned my addr 172.21.15.27:0/215096245 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:35.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f749d27d700 1 --2- 172.21.15.27:0/215096245 >> v2:172.21.15.40:3300/0 conn(0x7f74981541c0 0x7f74980c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 -- 172.21.15.27:0/215096245 >> v2:172.21.15.40:3300/0 conn(0x7f74981541c0 msgr2=0x7f74980c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:35.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 --2- 172.21.15.27:0/215096245 >> v2:172.21.15.40:3300/0 conn(0x7f74981541c0 0x7f74980c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f74977fe700 1 -- 172.21.15.27:0/215096245 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004493917 0 0) 0x7f74980bfcd0 con 0x7f74980c5f30 2023-05-17T15:09:35.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 -- 172.21.15.27:0/215096245 >> v1:172.21.15.27:6789/0 conn(0x7f74980c5f30 legacy=0x7f7498158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 -- 172.21.15.27:0/215096245 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980aa480 con 0x7f74980c6310 2023-05-17T15:09:35.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f7497fff700 1 --2- 172.21.15.27:0/215096245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c6310 0x7f7498153cd0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f7498158fc0 tx=0x7f7484009060).ready entity=mon.0 client_cookie=1a3a3b3b6124ee41 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:35.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f74977fe700 1 -- 172.21.15.27:0/215096245 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748400b580 con 0x7f74980c6310 2023-05-17T15:09:35.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f74977fe700 1 -- 172.21.15.27:0/215096245 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748400b6e0 con 0x7f74980c6310 2023-05-17T15:09:35.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.190+0000 7f74977fe700 1 -- 172.21.15.27:0/215096245 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748400ba60 con 0x7f74980c6310 2023-05-17T15:09:35.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 -- 172.21.15.27:0/215096245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c6310 msgr2=0x7f7498153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 --2- 172.21.15.27:0/215096245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c6310 0x7f7498153cd0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f7498158fc0 tx=0x7f7484009060).stop 2023-05-17T15:09:35.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 -- 172.21.15.27:0/215096245 shutdown_connections 2023-05-17T15:09:35.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 --2- 172.21.15.27:0/215096245 >> v2:172.21.15.40:3300/0 conn(0x7f74981541c0 0x7f74980c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 --2- 172.21.15.27:0/215096245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c6310 0x7f7498153cd0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 -- 172.21.15.27:0/215096245 >> 172.21.15.27:0/215096245 conn(0x7f7498069e70 msgr2=0x7f749805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:35.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 -- 172.21.15.27:0/215096245 shutdown_connections 2023-05-17T15:09:35.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.191+0000 7f749ece0700 1 -- 172.21.15.27:0/215096245 wait complete. 2023-05-17T15:09:35.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.192+0000 7f749ece0700 1 Processor -- start 2023-05-17T15:09:35.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.192+0000 7f749ece0700 1 -- start start 2023-05-17T15:09:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ece0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 0x7f7498155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ece0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74980c6310 0x7f749814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ece0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74981541c0 0x7f74980c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ece0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980c3b20 con 0x7f74980c5f30 2023-05-17T15:09:35.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ece0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980cb7a0 con 0x7f74981541c0 2023-05-17T15:09:35.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ece0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74980cba80 con 0x7f74980c6310 2023-05-17T15:09:35.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 0x7f7498155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 0x7f7498155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41148/0 (socket says 172.21.15.27:41148) 2023-05-17T15:09:35.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 -- 172.21.15.27:0/3759302165 learned_addr learned my addr 172.21.15.27:0/3759302165 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:35.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 -- 172.21.15.27:0/3759302165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74980c6310 msgr2=0x7f749814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74980c6310 0x7f749814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:35.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 -- 172.21.15.27:0/3759302165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74981541c0 msgr2=0x7f74980c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74981541c0 0x7f74980c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 -- 172.21.15.27:0/3759302165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840092a0 con 0x7f74980c5f30 2023-05-17T15:09:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.193+0000 7f749ca7c700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 0x7f7498155600 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f748c00c4e0 tx=0x7f748c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.194+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0072e0 con 0x7f74980c5f30 2023-05-17T15:09:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.194+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c007440 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.194+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74980c37b0 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.194+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0057a0 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.194+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74980c33d0 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.195+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749805f4a0 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.195+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f748c010070 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.195+0000 7f7494ff9700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f747c05ed90 0x7f747c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.195+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f748c079380 con 0x7f74980c5f30 2023-05-17T15:09:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.195+0000 7f7497fff700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f747c05ed90 0x7f747c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.196+0000 7f7497fff700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f747c05ed90 0x7f747c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f748400b340 tx=0x7f7484017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.199+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f748c04a8d0 con 0x7f74980c5f30 2023-05-17T15:09:35.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.438+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f749806bdf0 con 0x7f74980c5f30 2023-05-17T15:09:35.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.439+0000 7f7494ff9700 1 -- 172.21.15.27:0/3759302165 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1022 (secure 0 0 0) 0x7f748c04def0 con 0x7f74980c5f30 2023-05-17T15:09:35.443 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:35.443 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":960,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1684335223,"num_in_osds":8,"osd_in_since":1684335217,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":150175744,"bytes_avail":772943937536,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":44,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7092}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-05-17T15:07:12.655393+0000","services":{}},"progress_events":{}} 2023-05-17T15:09:35.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f747c05ed90 msgr2=0x7f747c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f747c05ed90 0x7f747c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f748400b340 tx=0x7f7484017000).stop 2023-05-17T15:09:35.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 msgr2=0x7f7498155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 0x7f7498155600 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f748c00c4e0 tx=0x7f748c007c70).stop 2023-05-17T15:09:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 shutdown_connections 2023-05-17T15:09:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f747c05ed90 0x7f747c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74981541c0 0x7f74980c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:35.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74980c5f30 0x7f7498155600 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 --2- 172.21.15.27:0/3759302165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74980c6310 0x7f749814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:35.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.440+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 >> 172.21.15.27:0/3759302165 conn(0x7f7498069e70 msgr2=0x7f74980c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:35.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.441+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 shutdown_connections 2023-05-17T15:09:35.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.441+0000 7f749ece0700 1 -- 172.21.15.27:0/3759302165 wait complete. 2023-05-17T15:09:35.456 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-17T15:09:35.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:09:35.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.608+0000 7f486761e700 1 Processor -- start 2023-05-17T15:09:35.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.608+0000 7f486761e700 1 -- start start 2023-05-17T15:09:35.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f486761e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48600c5ef0 0x7f48600c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f486761e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f486761e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4860153bf0 0x7f4860154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f486761e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600c05f0 con 0x7f4860153bf0 2023-05-17T15:09:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f486761e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600aa240 con 0x7f48600c5ef0 2023-05-17T15:09:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f486761e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4860154570 con 0x7f48600cb470 2023-05-17T15:09:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f4865bbb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4860153bf0 0x7f4860154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f4865bbb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4860153bf0 0x7f4860154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41158/0 (socket says 172.21.15.27:41158) 2023-05-17T15:09:35.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.609+0000 7f4865bbb700 1 -- 172.21.15.27:0/4093854447 learned_addr learned my addr 172.21.15.27:0/4093854447 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:35.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4864bb9700 1 --2- 172.21.15.27:0/4093854447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f48653ba700 1 --2- 172.21.15.27:0/4093854447 >> v2:172.21.15.40:3300/0 conn(0x7f48600c5ef0 0x7f48600c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4865bbb700 1 -- 172.21.15.27:0/4093854447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 msgr2=0x7f48600a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4865bbb700 1 --2- 172.21.15.27:0/4093854447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4865bbb700 1 -- 172.21.15.27:0/4093854447 >> v2:172.21.15.40:3300/0 conn(0x7f48600c5ef0 msgr2=0x7f48600c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4865bbb700 1 --2- 172.21.15.27:0/4093854447 >> v2:172.21.15.40:3300/0 conn(0x7f48600c5ef0 0x7f48600c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4865bbb700 1 -- 172.21.15.27:0/4093854447 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600aa510 con 0x7f4860153bf0 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f4865bbb700 1 --2- 172.21.15.27:0/4093854447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4860153bf0 0x7f4860154080 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f486005ec50 tx=0x7f4850009840).ready entity=mon.0 client_cookie=444516561667c37c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f485ffff700 1 -- 172.21.15.27:0/4093854447 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000e070 con 0x7f4860153bf0 2023-05-17T15:09:35.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f485ffff700 1 -- 172.21.15.27:0/4093854447 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000ba50 con 0x7f4860153bf0 2023-05-17T15:09:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f485ffff700 1 -- 172.21.15.27:0/4093854447 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bdd0 con 0x7f4860153bf0 2023-05-17T15:09:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 -- 172.21.15.27:0/4093854447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4860153bf0 msgr2=0x7f4860154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 --2- 172.21.15.27:0/4093854447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4860153bf0 0x7f4860154080 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f486005ec50 tx=0x7f4850009840).stop 2023-05-17T15:09:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 -- 172.21.15.27:0/4093854447 shutdown_connections 2023-05-17T15:09:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 --2- 172.21.15.27:0/4093854447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4860153bf0 0x7f4860154080 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 --2- 172.21.15.27:0/4093854447 >> v2:172.21.15.40:3300/0 conn(0x7f48600c5ef0 0x7f48600c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 --2- 172.21.15.27:0/4093854447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 -- 172.21.15.27:0/4093854447 >> 172.21.15.27:0/4093854447 conn(0x7f486005e810 msgr2=0x7f48600cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.610+0000 7f486761e700 1 -- 172.21.15.27:0/4093854447 shutdown_connections 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.611+0000 7f486761e700 1 -- 172.21.15.27:0/4093854447 wait complete. 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.612+0000 7f486761e700 1 Processor -- start 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.612+0000 7f486761e700 1 -- start start 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.612+0000 7f486761e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 0x7f4860150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.612+0000 7f486761e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.612+0000 7f486761e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860153bf0 0x7f48600c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f486761e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601512d0 con 0x7f48600c5ef0 2023-05-17T15:09:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f486761e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860154c00 con 0x7f4860153bf0 2023-05-17T15:09:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f486761e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600ae300 con 0x7f48600cb470 2023-05-17T15:09:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 0x7f4860150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 0x7f4860150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41160/0 (socket says 172.21.15.27:41160) 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 -- 172.21.15.27:0/3006825011 learned_addr learned my addr 172.21.15.27:0/3006825011 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f4864bb9700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f4865bbb700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860153bf0 0x7f48600c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 -- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 msgr2=0x7f48600c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 -- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860153bf0 msgr2=0x7f48600c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860153bf0 0x7f48600c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 -- 172.21.15.27:0/3006825011 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009ae0 con 0x7f48600c5ef0 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f4864bb9700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f4865bbb700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860153bf0 0x7f48600c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f48653ba700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 0x7f4860150de0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f485800d8c0 tx=0x7f4858008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580095b0 con 0x7f48600c5ef0 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858009710 con 0x7f48600c5ef0 2023-05-17T15:09:35.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858009a90 con 0x7f48600c5ef0 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48600adfb0 con 0x7f48600c5ef0 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.613+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600b0c60 con 0x7f48600c5ef0 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.614+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486005f4a0 con 0x7f48600c5ef0 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.615+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4858013480 con 0x7f48600c5ef0 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.615+0000 7f485d7fa700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f484c05edc0 0x7f484c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.615+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f4858079ac0 con 0x7f48600c5ef0 2023-05-17T15:09:35.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.615+0000 7f4864bb9700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f484c05edc0 0x7f484c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:35.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.615+0000 7f4864bb9700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f484c05edc0 0x7f484c061280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f48600ab170 tx=0x7f4854008040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:35.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.619+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f485804afb0 con 0x7f48600c5ef0 2023-05-17T15:09:35.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.788+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48600ae440 con 0x7f484c05edc0 2023-05-17T15:09:35.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.797+0000 7f485d7fa700 1 -- 172.21.15.27:0/3006825011 <== mgr.6933 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361379 (secure 0 0 0) 0x7f485400f710 con 0x7f484c05edc0 2023-05-17T15:09:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f484c05edc0 msgr2=0x7f484c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f484c05edc0 0x7f484c061280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f48600ab170 tx=0x7f4854008040).stop 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 msgr2=0x7f4860150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 0x7f4860150de0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f485800d8c0 tx=0x7f4858008040).stop 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 shutdown_connections 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f484c05edc0 0x7f484c061280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860153bf0 0x7f48600c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48600c5ef0 0x7f4860150de0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 --2- 172.21.15.27:0/3006825011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48600cb470 0x7f48600c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 >> 172.21.15.27:0/3006825011 conn(0x7f486005e810 msgr2=0x7f48600c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 shutdown_connections 2023-05-17T15:09:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:35.801+0000 7f486761e700 1 -- 172.21.15.27:0/3006825011 wait complete. 2023-05-17T15:09:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:09:35.817 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-17T15:09:35.709818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":269,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":148704,"kb_used_data":10720,"kb_used_omap":0,"kb_used_meta":137920,"kb_avail":754826016,"statfs":{"total":773094113280,"available":772941840384,"internally_reserved":0,"allocated":10977280,"data_stored":5480588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":141230080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4469,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.997739"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201205+0000","last_change":"2023-05-17T15:09:30.198262+0000","last_active":"2023-05-17T15:09:30.201205+0000","last_peered":"2023-05-17T15:09:30.201205+0000","last_clean":"2023-05-17T15:09:30.201205+0000","last_became_active":"2023-05-17T15:09:30.197977+0000","last_became_peered":"2023-05-17T15:09:30.197977+0000","last_unstale":"2023-05-17T15:09:30.201205+0000","last_undegraded":"2023-05-17T15:09:30.201205+0000","last_fullsized":"2023-05-17T15:09:30.201205+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196103+0000","last_change":"2023-05-17T15:09:29.795451+0000","last_active":"2023-05-17T15:09:30.196103+0000","last_peered":"2023-05-17T15:09:30.196103+0000","last_clean":"2023-05-17T15:09:30.196103+0000","last_became_active":"2023-05-17T15:09:29.794951+0000","last_became_peered":"2023-05-17T15:09:29.794951+0000","last_unstale":"2023-05-17T15:09:30.196103+0000","last_undegraded":"2023-05-17T15:09:30.196103+0000","last_fullsized":"2023-05-17T15:09:30.196103+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199585+0000","last_change":"2023-05-17T15:09:30.194120+0000","last_active":"2023-05-17T15:09:30.199585+0000","last_peered":"2023-05-17T15:09:30.199585+0000","last_clean":"2023-05-17T15:09:30.199585+0000","last_became_active":"2023-05-17T15:09:30.193856+0000","last_became_peered":"2023-05-17T15:09:30.193856+0000","last_unstale":"2023-05-17T15:09:30.199585+0000","last_undegraded":"2023-05-17T15:09:30.199585+0000","last_fullsized":"2023-05-17T15:09:30.199585+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192066+0000","last_change":"2023-05-17T15:09:29.802113+0000","last_active":"2023-05-17T15:09:30.192066+0000","last_peered":"2023-05-17T15:09:30.192066+0000","last_clean":"2023-05-17T15:09:30.192066+0000","last_became_active":"2023-05-17T15:09:29.801466+0000","last_became_peered":"2023-05-17T15:09:29.801466+0000","last_unstale":"2023-05-17T15:09:30.192066+0000","last_undegraded":"2023-05-17T15:09:30.192066+0000","last_fullsized":"2023-05-17T15:09:30.192066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.191947+0000","last_change":"2023-05-17T15:09:30.187478+0000","last_active":"2023-05-17T15:09:30.191947+0000","last_peered":"2023-05-17T15:09:30.191947+0000","last_clean":"2023-05-17T15:09:30.191947+0000","last_became_active":"2023-05-17T15:09:30.186940+0000","last_became_peered":"2023-05-17T15:09:30.186940+0000","last_unstale":"2023-05-17T15:09:30.191947+0000","last_undegraded":"2023-05-17T15:09:30.191947+0000","last_fullsized":"2023-05-17T15:09:30.191947+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.172748+0000","last_change":"2023-05-17T15:09:29.791492+0000","last_active":"2023-05-17T15:09:30.172748+0000","last_peered":"2023-05-17T15:09:30.172748+0000","last_clean":"2023-05-17T15:09:30.172748+0000","last_became_active":"2023-05-17T15:09:29.791200+0000","last_became_peered":"2023-05-17T15:09:29.791200+0000","last_unstale":"2023-05-17T15:09:30.172748+0000","last_undegraded":"2023-05-17T15:09:30.172748+0000","last_fullsized":"2023-05-17T15:09:30.172748+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194368+0000","last_change":"2023-05-17T15:09:30.189712+0000","last_active":"2023-05-17T15:09:30.194368+0000","last_peered":"2023-05-17T15:09:30.194368+0000","last_clean":"2023-05-17T15:09:30.194368+0000","last_became_active":"2023-05-17T15:09:30.189434+0000","last_became_peered":"2023-05-17T15:09:30.189434+0000","last_unstale":"2023-05-17T15:09:30.194368+0000","last_undegraded":"2023-05-17T15:09:30.194368+0000","last_fullsized":"2023-05-17T15:09:30.194368+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195486+0000","last_change":"2023-05-17T15:09:29.803185+0000","last_active":"2023-05-17T15:09:30.195486+0000","last_peered":"2023-05-17T15:09:30.195486+0000","last_clean":"2023-05-17T15:09:30.195486+0000","last_became_active":"2023-05-17T15:09:29.802908+0000","last_became_peered":"2023-05-17T15:09:29.802908+0000","last_unstale":"2023-05-17T15:09:30.195486+0000","last_undegraded":"2023-05-17T15:09:30.195486+0000","last_fullsized":"2023-05-17T15:09:30.195486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200696+0000","last_change":"2023-05-17T15:09:30.195165+0000","last_active":"2023-05-17T15:09:30.200696+0000","last_peered":"2023-05-17T15:09:30.200696+0000","last_clean":"2023-05-17T15:09:30.200696+0000","last_became_active":"2023-05-17T15:09:30.194609+0000","last_became_peered":"2023-05-17T15:09:30.194609+0000","last_unstale":"2023-05-17T15:09:30.200696+0000","last_undegraded":"2023-05-17T15:09:30.200696+0000","last_fullsized":"2023-05-17T15:09:30.200696+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.190316+0000","last_change":"2023-05-17T15:09:29.801395+0000","last_active":"2023-05-17T15:09:30.190316+0000","last_peered":"2023-05-17T15:09:30.190316+0000","last_clean":"2023-05-17T15:09:30.190316+0000","last_became_active":"2023-05-17T15:09:29.801114+0000","last_became_peered":"2023-05-17T15:09:29.801114+0000","last_unstale":"2023-05-17T15:09:30.190316+0000","last_undegraded":"2023-05-17T15:09:30.190316+0000","last_fullsized":"2023-05-17T15:09:30.190316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192884+0000","last_change":"2023-05-17T15:09:30.186625+0000","last_active":"2023-05-17T15:09:30.192884+0000","last_peered":"2023-05-17T15:09:30.192884+0000","last_clean":"2023-05-17T15:09:30.192884+0000","last_became_active":"2023-05-17T15:09:30.186340+0000","last_became_peered":"2023-05-17T15:09:30.186340+0000","last_unstale":"2023-05-17T15:09:30.192884+0000","last_undegraded":"2023-05-17T15:09:30.192884+0000","last_fullsized":"2023-05-17T15:09:30.192884+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.184544+0000","last_change":"2023-05-17T15:09:29.805553+0000","last_active":"2023-05-17T15:09:30.184544+0000","last_peered":"2023-05-17T15:09:30.184544+0000","last_clean":"2023-05-17T15:09:30.184544+0000","last_became_active":"2023-05-17T15:09:29.805227+0000","last_became_peered":"2023-05-17T15:09:29.805227+0000","last_unstale":"2023-05-17T15:09:30.184544+0000","last_undegraded":"2023-05-17T15:09:30.184544+0000","last_fullsized":"2023-05-17T15:09:30.184544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198934+0000","last_change":"2023-05-17T15:09:30.196126+0000","last_active":"2023-05-17T15:09:30.198934+0000","last_peered":"2023-05-17T15:09:30.198934+0000","last_clean":"2023-05-17T15:09:30.198934+0000","last_became_active":"2023-05-17T15:09:30.195533+0000","last_became_peered":"2023-05-17T15:09:30.195533+0000","last_unstale":"2023-05-17T15:09:30.198934+0000","last_undegraded":"2023-05-17T15:09:30.198934+0000","last_fullsized":"2023-05-17T15:09:30.198934+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.176572+0000","last_change":"2023-05-17T15:09:29.801153+0000","last_active":"2023-05-17T15:09:30.176572+0000","last_peered":"2023-05-17T15:09:30.176572+0000","last_clean":"2023-05-17T15:09:30.176572+0000","last_became_active":"2023-05-17T15:09:29.800885+0000","last_became_peered":"2023-05-17T15:09:29.800885+0000","last_unstale":"2023-05-17T15:09:30.176572+0000","last_undegraded":"2023-05-17T15:09:30.176572+0000","last_fullsized":"2023-05-17T15:09:30.176572+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194411+0000","last_change":"2023-05-17T15:09:30.189314+0000","last_active":"2023-05-17T15:09:30.194411+0000","last_peered":"2023-05-17T15:09:30.194411+0000","last_clean":"2023-05-17T15:09:30.194411+0000","last_became_active":"2023-05-17T15:09:30.189099+0000","last_became_peered":"2023-05-17T15:09:30.189099+0000","last_unstale":"2023-05-17T15:09:30.194411+0000","last_undegraded":"2023-05-17T15:09:30.194411+0000","last_fullsized":"2023-05-17T15:09:30.194411+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173775+0000","last_change":"2023-05-17T15:09:29.801144+0000","last_active":"2023-05-17T15:09:30.173775+0000","last_peered":"2023-05-17T15:09:30.173775+0000","last_clean":"2023-05-17T15:09:30.173775+0000","last_became_active":"2023-05-17T15:09:29.800875+0000","last_became_peered":"2023-05-17T15:09:29.800875+0000","last_unstale":"2023-05-17T15:09:30.173775+0000","last_undegraded":"2023-05-17T15:09:30.173775+0000","last_fullsized":"2023-05-17T15:09:30.173775+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198397+0000","last_change":"2023-05-17T15:09:30.190406+0000","last_active":"2023-05-17T15:09:30.198397+0000","last_peered":"2023-05-17T15:09:30.198397+0000","last_clean":"2023-05-17T15:09:30.198397+0000","last_became_active":"2023-05-17T15:09:30.190120+0000","last_became_peered":"2023-05-17T15:09:30.190120+0000","last_unstale":"2023-05-17T15:09:30.198397+0000","last_undegraded":"2023-05-17T15:09:30.198397+0000","last_fullsized":"2023-05-17T15:09:30.198397+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174651+0000","last_change":"2023-05-17T15:09:29.795343+0000","last_active":"2023-05-17T15:09:30.174651+0000","last_peered":"2023-05-17T15:09:30.174651+0000","last_clean":"2023-05-17T15:09:30.174651+0000","last_became_active":"2023-05-17T15:09:29.795056+0000","last_became_peered":"2023-05-17T15:09:29.795056+0000","last_unstale":"2023-05-17T15:09:30.174651+0000","last_undegraded":"2023-05-17T15:09:30.174651+0000","last_fullsized":"2023-05-17T15:09:30.174651+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195504+0000","last_change":"2023-05-17T15:09:30.191243+0000","last_active":"2023-05-17T15:09:30.195504+0000","last_peered":"2023-05-17T15:09:30.195504+0000","last_clean":"2023-05-17T15:09:30.195504+0000","last_became_active":"2023-05-17T15:09:30.190954+0000","last_became_peered":"2023-05-17T15:09:30.190954+0000","last_unstale":"2023-05-17T15:09:30.195504+0000","last_undegraded":"2023-05-17T15:09:30.195504+0000","last_fullsized":"2023-05-17T15:09:30.195504+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.180257+0000","last_change":"2023-05-17T15:09:29.794534+0000","last_active":"2023-05-17T15:09:30.180257+0000","last_peered":"2023-05-17T15:09:30.180257+0000","last_clean":"2023-05-17T15:09:30.180257+0000","last_became_active":"2023-05-17T15:09:29.794179+0000","last_became_peered":"2023-05-17T15:09:29.794179+0000","last_unstale":"2023-05-17T15:09:30.180257+0000","last_undegraded":"2023-05-17T15:09:30.180257+0000","last_fullsized":"2023-05-17T15:09:30.180257+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200881+0000","last_change":"2023-05-17T15:09:30.193199+0000","last_active":"2023-05-17T15:09:30.200881+0000","last_peered":"2023-05-17T15:09:30.200881+0000","last_clean":"2023-05-17T15:09:30.200881+0000","last_became_active":"2023-05-17T15:09:30.192878+0000","last_became_peered":"2023-05-17T15:09:30.192878+0000","last_unstale":"2023-05-17T15:09:30.200881+0000","last_undegraded":"2023-05-17T15:09:30.200881+0000","last_fullsized":"2023-05-17T15:09:30.200881+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185262+0000","last_change":"2023-05-17T15:09:29.794583+0000","last_active":"2023-05-17T15:09:30.185262+0000","last_peered":"2023-05-17T15:09:30.185262+0000","last_clean":"2023-05-17T15:09:30.185262+0000","last_became_active":"2023-05-17T15:09:29.794323+0000","last_became_peered":"2023-05-17T15:09:29.794323+0000","last_unstale":"2023-05-17T15:09:30.185262+0000","last_undegraded":"2023-05-17T15:09:30.185262+0000","last_fullsized":"2023-05-17T15:09:30.185262+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192211+0000","last_change":"2023-05-17T15:09:30.188695+0000","last_active":"2023-05-17T15:09:30.192211+0000","last_peered":"2023-05-17T15:09:30.192211+0000","last_clean":"2023-05-17T15:09:30.192211+0000","last_became_active":"2023-05-17T15:09:30.188171+0000","last_became_peered":"2023-05-17T15:09:30.188171+0000","last_unstale":"2023-05-17T15:09:30.192211+0000","last_undegraded":"2023-05-17T15:09:30.192211+0000","last_fullsized":"2023-05-17T15:09:30.192211+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201011+0000","last_change":"2023-05-17T15:09:29.792312+0000","last_active":"2023-05-17T15:09:30.201011+0000","last_peered":"2023-05-17T15:09:30.201011+0000","last_clean":"2023-05-17T15:09:30.201011+0000","last_became_active":"2023-05-17T15:09:29.791909+0000","last_became_peered":"2023-05-17T15:09:29.791909+0000","last_unstale":"2023-05-17T15:09:30.201011+0000","last_undegraded":"2023-05-17T15:09:30.201011+0000","last_fullsized":"2023-05-17T15:09:30.201011+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199626+0000","last_change":"2023-05-17T15:09:30.196898+0000","last_active":"2023-05-17T15:09:30.199626+0000","last_peered":"2023-05-17T15:09:30.199626+0000","last_clean":"2023-05-17T15:09:30.199626+0000","last_became_active":"2023-05-17T15:09:30.196172+0000","last_became_peered":"2023-05-17T15:09:30.196172+0000","last_unstale":"2023-05-17T15:09:30.199626+0000","last_undegraded":"2023-05-17T15:09:30.199626+0000","last_fullsized":"2023-05-17T15:09:30.199626+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196078+0000","last_change":"2023-05-17T15:09:29.800468+0000","last_active":"2023-05-17T15:09:30.196078+0000","last_peered":"2023-05-17T15:09:30.196078+0000","last_clean":"2023-05-17T15:09:30.196078+0000","last_became_active":"2023-05-17T15:09:29.800132+0000","last_became_peered":"2023-05-17T15:09:29.800132+0000","last_unstale":"2023-05-17T15:09:30.196078+0000","last_undegraded":"2023-05-17T15:09:30.196078+0000","last_fullsized":"2023-05-17T15:09:30.196078+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201093+0000","last_change":"2023-05-17T15:09:30.196876+0000","last_active":"2023-05-17T15:09:30.201093+0000","last_peered":"2023-05-17T15:09:30.201093+0000","last_clean":"2023-05-17T15:09:30.201093+0000","last_became_active":"2023-05-17T15:09:30.196618+0000","last_became_peered":"2023-05-17T15:09:30.196618+0000","last_unstale":"2023-05-17T15:09:30.201093+0000","last_undegraded":"2023-05-17T15:09:30.201093+0000","last_fullsized":"2023-05-17T15:09:30.201093+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178333+0000","last_change":"2023-05-17T15:09:29.801862+0000","last_active":"2023-05-17T15:09:30.178333+0000","last_peered":"2023-05-17T15:09:30.178333+0000","last_clean":"2023-05-17T15:09:30.178333+0000","last_became_active":"2023-05-17T15:09:29.801533+0000","last_became_peered":"2023-05-17T15:09:29.801533+0000","last_unstale":"2023-05-17T15:09:30.178333+0000","last_undegraded":"2023-05-17T15:09:30.178333+0000","last_fullsized":"2023-05-17T15:09:30.178333+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196258+0000","last_change":"2023-05-17T15:09:30.194643+0000","last_active":"2023-05-17T15:09:30.196258+0000","last_peered":"2023-05-17T15:09:30.196258+0000","last_clean":"2023-05-17T15:09:30.196258+0000","last_became_active":"2023-05-17T15:09:30.194215+0000","last_became_peered":"2023-05-17T15:09:30.194215+0000","last_unstale":"2023-05-17T15:09:30.196258+0000","last_undegraded":"2023-05-17T15:09:30.196258+0000","last_fullsized":"2023-05-17T15:09:30.196258+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178392+0000","last_change":"2023-05-17T15:09:29.794106+0000","last_active":"2023-05-17T15:09:30.178392+0000","last_peered":"2023-05-17T15:09:30.178392+0000","last_clean":"2023-05-17T15:09:30.178392+0000","last_became_active":"2023-05-17T15:09:29.793843+0000","last_became_peered":"2023-05-17T15:09:29.793843+0000","last_unstale":"2023-05-17T15:09:30.178392+0000","last_undegraded":"2023-05-17T15:09:30.178392+0000","last_fullsized":"2023-05-17T15:09:30.178392+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200684+0000","last_change":"2023-05-17T15:09:30.194883+0000","last_active":"2023-05-17T15:09:30.200684+0000","last_peered":"2023-05-17T15:09:30.200684+0000","last_clean":"2023-05-17T15:09:30.200684+0000","last_became_active":"2023-05-17T15:09:30.194599+0000","last_became_peered":"2023-05-17T15:09:30.194599+0000","last_unstale":"2023-05-17T15:09:30.200684+0000","last_undegraded":"2023-05-17T15:09:30.200684+0000","last_fullsized":"2023-05-17T15:09:30.200684+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198644+0000","last_change":"2023-05-17T15:09:29.792948+0000","last_active":"2023-05-17T15:09:30.198644+0000","last_peered":"2023-05-17T15:09:30.198644+0000","last_clean":"2023-05-17T15:09:30.198644+0000","last_became_active":"2023-05-17T15:09:29.791544+0000","last_became_peered":"2023-05-17T15:09:29.791544+0000","last_unstale":"2023-05-17T15:09:30.198644+0000","last_undegraded":"2023-05-17T15:09:30.198644+0000","last_fullsized":"2023-05-17T15:09:30.198644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200771+0000","last_change":"2023-05-17T15:09:30.195461+0000","last_active":"2023-05-17T15:09:30.200771+0000","last_peered":"2023-05-17T15:09:30.200771+0000","last_clean":"2023-05-17T15:09:30.200771+0000","last_became_active":"2023-05-17T15:09:30.195198+0000","last_became_peered":"2023-05-17T15:09:30.195198+0000","last_unstale":"2023-05-17T15:09:30.200771+0000","last_undegraded":"2023-05-17T15:09:30.200771+0000","last_fullsized":"2023-05-17T15:09:30.200771+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178248+0000","last_change":"2023-05-17T15:09:29.798784+0000","last_active":"2023-05-17T15:09:30.178248+0000","last_peered":"2023-05-17T15:09:30.178248+0000","last_clean":"2023-05-17T15:09:30.178248+0000","last_became_active":"2023-05-17T15:09:29.798245+0000","last_became_peered":"2023-05-17T15:09:29.798245+0000","last_unstale":"2023-05-17T15:09:30.178248+0000","last_undegraded":"2023-05-17T15:09:30.178248+0000","last_fullsized":"2023-05-17T15:09:30.178248+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197520+0000","last_change":"2023-05-17T15:09:30.195057+0000","last_active":"2023-05-17T15:09:30.197520+0000","last_peered":"2023-05-17T15:09:30.197520+0000","last_clean":"2023-05-17T15:09:30.197520+0000","last_became_active":"2023-05-17T15:09:30.194706+0000","last_became_peered":"2023-05-17T15:09:30.194706+0000","last_unstale":"2023-05-17T15:09:30.197520+0000","last_undegraded":"2023-05-17T15:09:30.197520+0000","last_fullsized":"2023-05-17T15:09:30.197520+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177283+0000","last_change":"2023-05-17T15:09:29.804300+0000","last_active":"2023-05-17T15:09:30.177283+0000","last_peered":"2023-05-17T15:09:30.177283+0000","last_clean":"2023-05-17T15:09:30.177283+0000","last_became_active":"2023-05-17T15:09:29.804013+0000","last_became_peered":"2023-05-17T15:09:29.804013+0000","last_unstale":"2023-05-17T15:09:30.177283+0000","last_undegraded":"2023-05-17T15:09:30.177283+0000","last_fullsized":"2023-05-17T15:09:30.177283+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192408+0000","last_change":"2023-05-17T15:09:30.185432+0000","last_active":"2023-05-17T15:09:30.192408+0000","last_peered":"2023-05-17T15:09:30.192408+0000","last_clean":"2023-05-17T15:09:30.192408+0000","last_became_active":"2023-05-17T15:09:30.185151+0000","last_became_peered":"2023-05-17T15:09:30.185151+0000","last_unstale":"2023-05-17T15:09:30.192408+0000","last_undegraded":"2023-05-17T15:09:30.192408+0000","last_fullsized":"2023-05-17T15:09:30.192408+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196720+0000","last_change":"2023-05-17T15:09:29.794244+0000","last_active":"2023-05-17T15:09:30.196720+0000","last_peered":"2023-05-17T15:09:30.196720+0000","last_clean":"2023-05-17T15:09:30.196720+0000","last_became_active":"2023-05-17T15:09:29.793952+0000","last_became_peered":"2023-05-17T15:09:29.793952+0000","last_unstale":"2023-05-17T15:09:30.196720+0000","last_undegraded":"2023-05-17T15:09:30.196720+0000","last_fullsized":"2023-05-17T15:09:30.196720+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196016+0000","last_change":"2023-05-17T15:09:30.190605+0000","last_active":"2023-05-17T15:09:30.196016+0000","last_peered":"2023-05-17T15:09:30.196016+0000","last_clean":"2023-05-17T15:09:30.196016+0000","last_became_active":"2023-05-17T15:09:30.190056+0000","last_became_peered":"2023-05-17T15:09:30.190056+0000","last_unstale":"2023-05-17T15:09:30.196016+0000","last_undegraded":"2023-05-17T15:09:30.196016+0000","last_fullsized":"2023-05-17T15:09:30.196016+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177537+0000","last_change":"2023-05-17T15:09:29.800094+0000","last_active":"2023-05-17T15:09:30.177537+0000","last_peered":"2023-05-17T15:09:30.177537+0000","last_clean":"2023-05-17T15:09:30.177537+0000","last_became_active":"2023-05-17T15:09:29.799762+0000","last_became_peered":"2023-05-17T15:09:29.799762+0000","last_unstale":"2023-05-17T15:09:30.177537+0000","last_undegraded":"2023-05-17T15:09:30.177537+0000","last_fullsized":"2023-05-17T15:09:30.177537+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199835+0000","last_change":"2023-05-17T15:09:30.194120+0000","last_active":"2023-05-17T15:09:30.199835+0000","last_peered":"2023-05-17T15:09:30.199835+0000","last_clean":"2023-05-17T15:09:30.199835+0000","last_became_active":"2023-05-17T15:09:30.193811+0000","last_became_peered":"2023-05-17T15:09:30.193811+0000","last_unstale":"2023-05-17T15:09:30.199835+0000","last_undegraded":"2023-05-17T15:09:30.199835+0000","last_fullsized":"2023-05-17T15:09:30.199835+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.186331+0000","last_change":"2023-05-17T15:09:29.801096+0000","last_active":"2023-05-17T15:09:30.186331+0000","last_peered":"2023-05-17T15:09:30.186331+0000","last_clean":"2023-05-17T15:09:30.186331+0000","last_became_active":"2023-05-17T15:09:29.800814+0000","last_became_peered":"2023-05-17T15:09:29.800814+0000","last_unstale":"2023-05-17T15:09:30.186331+0000","last_undegraded":"2023-05-17T15:09:30.186331+0000","last_fullsized":"2023-05-17T15:09:30.186331+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198051+0000","last_change":"2023-05-17T15:09:30.196898+0000","last_active":"2023-05-17T15:09:30.198051+0000","last_peered":"2023-05-17T15:09:30.198051+0000","last_clean":"2023-05-17T15:09:30.198051+0000","last_became_active":"2023-05-17T15:09:30.196572+0000","last_became_peered":"2023-05-17T15:09:30.196572+0000","last_unstale":"2023-05-17T15:09:30.198051+0000","last_undegraded":"2023-05-17T15:09:30.198051+0000","last_fullsized":"2023-05-17T15:09:30.198051+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185256+0000","last_change":"2023-05-17T15:09:29.795163+0000","last_active":"2023-05-17T15:09:30.185256+0000","last_peered":"2023-05-17T15:09:30.185256+0000","last_clean":"2023-05-17T15:09:30.185256+0000","last_became_active":"2023-05-17T15:09:29.794893+0000","last_became_peered":"2023-05-17T15:09:29.794893+0000","last_unstale":"2023-05-17T15:09:30.185256+0000","last_undegraded":"2023-05-17T15:09:30.185256+0000","last_fullsized":"2023-05-17T15:09:30.185256+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.202277+0000","last_change":"2023-05-17T15:09:30.200912+0000","last_active":"2023-05-17T15:09:30.202277+0000","last_peered":"2023-05-17T15:09:30.202277+0000","last_clean":"2023-05-17T15:09:30.202277+0000","last_became_active":"2023-05-17T15:09:30.200616+0000","last_became_peered":"2023-05-17T15:09:30.200616+0000","last_unstale":"2023-05-17T15:09:30.202277+0000","last_undegraded":"2023-05-17T15:09:30.202277+0000","last_fullsized":"2023-05-17T15:09:30.202277+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.181163+0000","last_change":"2023-05-17T15:09:29.794669+0000","last_active":"2023-05-17T15:09:30.181163+0000","last_peered":"2023-05-17T15:09:30.181163+0000","last_clean":"2023-05-17T15:09:30.181163+0000","last_became_active":"2023-05-17T15:09:29.792475+0000","last_became_peered":"2023-05-17T15:09:29.792475+0000","last_unstale":"2023-05-17T15:09:30.181163+0000","last_undegraded":"2023-05-17T15:09:30.181163+0000","last_fullsized":"2023-05-17T15:09:30.181163+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.186594+0000","last_change":"2023-05-17T15:09:30.179938+0000","last_active":"2023-05-17T15:09:30.186594+0000","last_peered":"2023-05-17T15:09:30.186594+0000","last_clean":"2023-05-17T15:09:30.186594+0000","last_became_active":"2023-05-17T15:09:30.179579+0000","last_became_peered":"2023-05-17T15:09:30.179579+0000","last_unstale":"2023-05-17T15:09:30.186594+0000","last_undegraded":"2023-05-17T15:09:30.186594+0000","last_fullsized":"2023-05-17T15:09:30.186594+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.179339+0000","last_change":"2023-05-17T15:09:29.801542+0000","last_active":"2023-05-17T15:09:30.179339+0000","last_peered":"2023-05-17T15:09:30.179339+0000","last_clean":"2023-05-17T15:09:30.179339+0000","last_became_active":"2023-05-17T15:09:29.801262+0000","last_became_peered":"2023-05-17T15:09:29.801262+0000","last_unstale":"2023-05-17T15:09:30.179339+0000","last_undegraded":"2023-05-17T15:09:30.179339+0000","last_fullsized":"2023-05-17T15:09:30.179339+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199447+0000","last_change":"2023-05-17T15:09:30.192621+0000","last_active":"2023-05-17T15:09:30.199447+0000","last_peered":"2023-05-17T15:09:30.199447+0000","last_clean":"2023-05-17T15:09:30.199447+0000","last_became_active":"2023-05-17T15:09:30.192379+0000","last_became_peered":"2023-05-17T15:09:30.192379+0000","last_unstale":"2023-05-17T15:09:30.199447+0000","last_undegraded":"2023-05-17T15:09:30.199447+0000","last_fullsized":"2023-05-17T15:09:30.199447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188530+0000","last_change":"2023-05-17T15:09:29.801179+0000","last_active":"2023-05-17T15:09:30.188530+0000","last_peered":"2023-05-17T15:09:30.188530+0000","last_clean":"2023-05-17T15:09:30.188530+0000","last_became_active":"2023-05-17T15:09:29.800908+0000","last_became_peered":"2023-05-17T15:09:29.800908+0000","last_unstale":"2023-05-17T15:09:30.188530+0000","last_undegraded":"2023-05-17T15:09:30.188530+0000","last_fullsized":"2023-05-17T15:09:30.188530+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201305+0000","last_change":"2023-05-17T15:09:30.197679+0000","last_active":"2023-05-17T15:09:30.201305+0000","last_peered":"2023-05-17T15:09:30.201305+0000","last_clean":"2023-05-17T15:09:30.201305+0000","last_became_active":"2023-05-17T15:09:30.197398+0000","last_became_peered":"2023-05-17T15:09:30.197398+0000","last_unstale":"2023-05-17T15:09:30.201305+0000","last_undegraded":"2023-05-17T15:09:30.201305+0000","last_fullsized":"2023-05-17T15:09:30.201305+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173176+0000","last_change":"2023-05-17T15:09:29.801319+0000","last_active":"2023-05-17T15:09:30.173176+0000","last_peered":"2023-05-17T15:09:30.173176+0000","last_clean":"2023-05-17T15:09:30.173176+0000","last_became_active":"2023-05-17T15:09:29.800978+0000","last_became_peered":"2023-05-17T15:09:29.800978+0000","last_unstale":"2023-05-17T15:09:30.173176+0000","last_undegraded":"2023-05-17T15:09:30.173176+0000","last_fullsized":"2023-05-17T15:09:30.173176+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195475+0000","last_change":"2023-05-17T15:09:30.193675+0000","last_active":"2023-05-17T15:09:30.195475+0000","last_peered":"2023-05-17T15:09:30.195475+0000","last_clean":"2023-05-17T15:09:30.195475+0000","last_became_active":"2023-05-17T15:09:30.193391+0000","last_became_peered":"2023-05-17T15:09:30.193391+0000","last_unstale":"2023-05-17T15:09:30.195475+0000","last_undegraded":"2023-05-17T15:09:30.195475+0000","last_fullsized":"2023-05-17T15:09:30.195475+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178611+0000","last_change":"2023-05-17T15:09:29.799398+0000","last_active":"2023-05-17T15:09:30.178611+0000","last_peered":"2023-05-17T15:09:30.178611+0000","last_clean":"2023-05-17T15:09:30.178611+0000","last_became_active":"2023-05-17T15:09:29.799105+0000","last_became_peered":"2023-05-17T15:09:29.799105+0000","last_unstale":"2023-05-17T15:09:30.178611+0000","last_undegraded":"2023-05-17T15:09:30.178611+0000","last_fullsized":"2023-05-17T15:09:30.178611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193075+0000","last_change":"2023-05-17T15:09:30.190060+0000","last_active":"2023-05-17T15:09:30.193075+0000","last_peered":"2023-05-17T15:09:30.193075+0000","last_clean":"2023-05-17T15:09:30.193075+0000","last_became_active":"2023-05-17T15:09:30.189389+0000","last_became_peered":"2023-05-17T15:09:30.189389+0000","last_unstale":"2023-05-17T15:09:30.193075+0000","last_undegraded":"2023-05-17T15:09:30.193075+0000","last_fullsized":"2023-05-17T15:09:30.193075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.180391+0000","last_change":"2023-05-17T15:09:29.800312+0000","last_active":"2023-05-17T15:09:30.180391+0000","last_peered":"2023-05-17T15:09:30.180391+0000","last_clean":"2023-05-17T15:09:30.180391+0000","last_became_active":"2023-05-17T15:09:29.799484+0000","last_became_peered":"2023-05-17T15:09:29.799484+0000","last_unstale":"2023-05-17T15:09:30.180391+0000","last_undegraded":"2023-05-17T15:09:30.180391+0000","last_fullsized":"2023-05-17T15:09:30.180391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198700+0000","last_change":"2023-05-17T15:09:30.196201+0000","last_active":"2023-05-17T15:09:30.198700+0000","last_peered":"2023-05-17T15:09:30.198700+0000","last_clean":"2023-05-17T15:09:30.198700+0000","last_became_active":"2023-05-17T15:09:30.195770+0000","last_became_peered":"2023-05-17T15:09:30.195770+0000","last_unstale":"2023-05-17T15:09:30.198700+0000","last_undegraded":"2023-05-17T15:09:30.198700+0000","last_fullsized":"2023-05-17T15:09:30.198700+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185316+0000","last_change":"2023-05-17T15:09:29.794551+0000","last_active":"2023-05-17T15:09:30.185316+0000","last_peered":"2023-05-17T15:09:30.185316+0000","last_clean":"2023-05-17T15:09:30.185316+0000","last_became_active":"2023-05-17T15:09:29.794289+0000","last_became_peered":"2023-05-17T15:09:29.794289+0000","last_unstale":"2023-05-17T15:09:30.185316+0000","last_undegraded":"2023-05-17T15:09:30.185316+0000","last_fullsized":"2023-05-17T15:09:30.185316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185444+0000","last_change":"2023-05-17T15:09:30.183309+0000","last_active":"2023-05-17T15:09:30.185444+0000","last_peered":"2023-05-17T15:09:30.185444+0000","last_clean":"2023-05-17T15:09:30.185444+0000","last_became_active":"2023-05-17T15:09:30.182977+0000","last_became_peered":"2023-05-17T15:09:30.182977+0000","last_unstale":"2023-05-17T15:09:30.185444+0000","last_undegraded":"2023-05-17T15:09:30.185444+0000","last_fullsized":"2023-05-17T15:09:30.185444+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185312+0000","last_change":"2023-05-17T15:09:29.806084+0000","last_active":"2023-05-17T15:09:30.185312+0000","last_peered":"2023-05-17T15:09:30.185312+0000","last_clean":"2023-05-17T15:09:30.185312+0000","last_became_active":"2023-05-17T15:09:29.805583+0000","last_became_peered":"2023-05-17T15:09:29.805583+0000","last_unstale":"2023-05-17T15:09:30.185312+0000","last_undegraded":"2023-05-17T15:09:30.185312+0000","last_fullsized":"2023-05-17T15:09:30.185312+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192601+0000","last_change":"2023-05-17T15:09:30.188888+0000","last_active":"2023-05-17T15:09:30.192601+0000","last_peered":"2023-05-17T15:09:30.192601+0000","last_clean":"2023-05-17T15:09:30.192601+0000","last_became_active":"2023-05-17T15:09:30.187192+0000","last_became_peered":"2023-05-17T15:09:30.187192+0000","last_unstale":"2023-05-17T15:09:30.192601+0000","last_undegraded":"2023-05-17T15:09:30.192601+0000","last_fullsized":"2023-05-17T15:09:30.192601+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177657+0000","last_change":"2023-05-17T15:09:29.796753+0000","last_active":"2023-05-17T15:09:30.177657+0000","last_peered":"2023-05-17T15:09:30.177657+0000","last_clean":"2023-05-17T15:09:30.177657+0000","last_became_active":"2023-05-17T15:09:29.796169+0000","last_became_peered":"2023-05-17T15:09:29.796169+0000","last_unstale":"2023-05-17T15:09:30.177657+0000","last_undegraded":"2023-05-17T15:09:30.177657+0000","last_fullsized":"2023-05-17T15:09:30.177657+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192790+0000","last_change":"2023-05-17T15:09:30.186012+0000","last_active":"2023-05-17T15:09:30.192790+0000","last_peered":"2023-05-17T15:09:30.192790+0000","last_clean":"2023-05-17T15:09:30.192790+0000","last_became_active":"2023-05-17T15:09:30.185679+0000","last_became_peered":"2023-05-17T15:09:30.185679+0000","last_unstale":"2023-05-17T15:09:30.192790+0000","last_undegraded":"2023-05-17T15:09:30.192790+0000","last_fullsized":"2023-05-17T15:09:30.192790+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178484+0000","last_change":"2023-05-17T15:09:29.798167+0000","last_active":"2023-05-17T15:09:30.178484+0000","last_peered":"2023-05-17T15:09:30.178484+0000","last_clean":"2023-05-17T15:09:30.178484+0000","last_became_active":"2023-05-17T15:09:29.797848+0000","last_became_peered":"2023-05-17T15:09:29.797848+0000","last_unstale":"2023-05-17T15:09:30.178484+0000","last_undegraded":"2023-05-17T15:09:30.178484+0000","last_fullsized":"2023-05-17T15:09:30.178484+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194830+0000","last_change":"2023-05-17T15:09:30.191146+0000","last_active":"2023-05-17T15:09:30.194830+0000","last_peered":"2023-05-17T15:09:30.194830+0000","last_clean":"2023-05-17T15:09:30.194830+0000","last_became_active":"2023-05-17T15:09:30.190874+0000","last_became_peered":"2023-05-17T15:09:30.190874+0000","last_unstale":"2023-05-17T15:09:30.194830+0000","last_undegraded":"2023-05-17T15:09:30.194830+0000","last_fullsized":"2023-05-17T15:09:30.194830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195865+0000","last_change":"2023-05-17T15:09:29.795247+0000","last_active":"2023-05-17T15:09:30.195865+0000","last_peered":"2023-05-17T15:09:30.195865+0000","last_clean":"2023-05-17T15:09:30.195865+0000","last_became_active":"2023-05-17T15:09:29.794553+0000","last_became_peered":"2023-05-17T15:09:29.794553+0000","last_unstale":"2023-05-17T15:09:30.195865+0000","last_undegraded":"2023-05-17T15:09:30.195865+0000","last_fullsized":"2023-05-17T15:09:30.195865+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188694+0000","last_change":"2023-05-17T15:09:30.186855+0000","last_active":"2023-05-17T15:09:30.188694+0000","last_peered":"2023-05-17T15:09:30.188694+0000","last_clean":"2023-05-17T15:09:30.188694+0000","last_became_active":"2023-05-17T15:09:30.186533+0000","last_became_peered":"2023-05-17T15:09:30.186533+0000","last_unstale":"2023-05-17T15:09:30.188694+0000","last_undegraded":"2023-05-17T15:09:30.188694+0000","last_fullsized":"2023-05-17T15:09:30.188694+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188621+0000","last_change":"2023-05-17T15:09:29.792747+0000","last_active":"2023-05-17T15:09:30.188621+0000","last_peered":"2023-05-17T15:09:30.188621+0000","last_clean":"2023-05-17T15:09:30.188621+0000","last_became_active":"2023-05-17T15:09:29.792459+0000","last_became_peered":"2023-05-17T15:09:29.792459+0000","last_unstale":"2023-05-17T15:09:30.188621+0000","last_undegraded":"2023-05-17T15:09:30.188621+0000","last_fullsized":"2023-05-17T15:09:30.188621+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192742+0000","last_change":"2023-05-17T15:09:30.183767+0000","last_active":"2023-05-17T15:09:30.192742+0000","last_peered":"2023-05-17T15:09:30.192742+0000","last_clean":"2023-05-17T15:09:30.192742+0000","last_became_active":"2023-05-17T15:09:30.183488+0000","last_became_peered":"2023-05-17T15:09:30.183488+0000","last_unstale":"2023-05-17T15:09:30.192742+0000","last_undegraded":"2023-05-17T15:09:30.192742+0000","last_fullsized":"2023-05-17T15:09:30.192742+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.190362+0000","last_change":"2023-05-17T15:09:29.797826+0000","last_active":"2023-05-17T15:09:30.190362+0000","last_peered":"2023-05-17T15:09:30.190362+0000","last_clean":"2023-05-17T15:09:30.190362+0000","last_became_active":"2023-05-17T15:09:29.797300+0000","last_became_peered":"2023-05-17T15:09:29.797300+0000","last_unstale":"2023-05-17T15:09:30.190362+0000","last_undegraded":"2023-05-17T15:09:30.190362+0000","last_fullsized":"2023-05-17T15:09:30.190362+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199936+0000","last_change":"2023-05-17T15:09:30.197347+0000","last_active":"2023-05-17T15:09:30.199936+0000","last_peered":"2023-05-17T15:09:30.199936+0000","last_clean":"2023-05-17T15:09:30.199936+0000","last_became_active":"2023-05-17T15:09:30.197005+0000","last_became_peered":"2023-05-17T15:09:30.197005+0000","last_unstale":"2023-05-17T15:09:30.199936+0000","last_undegraded":"2023-05-17T15:09:30.199936+0000","last_fullsized":"2023-05-17T15:09:30.199936+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178039+0000","last_change":"2023-05-17T15:09:29.803762+0000","last_active":"2023-05-17T15:09:30.178039+0000","last_peered":"2023-05-17T15:09:30.178039+0000","last_clean":"2023-05-17T15:09:30.178039+0000","last_became_active":"2023-05-17T15:09:29.803327+0000","last_became_peered":"2023-05-17T15:09:29.803327+0000","last_unstale":"2023-05-17T15:09:30.178039+0000","last_undegraded":"2023-05-17T15:09:30.178039+0000","last_fullsized":"2023-05-17T15:09:30.178039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200826+0000","last_change":"2023-05-17T15:09:30.195859+0000","last_active":"2023-05-17T15:09:30.200826+0000","last_peered":"2023-05-17T15:09:30.200826+0000","last_clean":"2023-05-17T15:09:30.200826+0000","last_became_active":"2023-05-17T15:09:30.195549+0000","last_became_peered":"2023-05-17T15:09:30.195549+0000","last_unstale":"2023-05-17T15:09:30.200826+0000","last_undegraded":"2023-05-17T15:09:30.200826+0000","last_fullsized":"2023-05-17T15:09:30.200826+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177038+0000","last_change":"2023-05-17T15:09:29.805564+0000","last_active":"2023-05-17T15:09:30.177038+0000","last_peered":"2023-05-17T15:09:30.177038+0000","last_clean":"2023-05-17T15:09:30.177038+0000","last_became_active":"2023-05-17T15:09:29.805171+0000","last_became_peered":"2023-05-17T15:09:29.805171+0000","last_unstale":"2023-05-17T15:09:30.177038+0000","last_undegraded":"2023-05-17T15:09:30.177038+0000","last_fullsized":"2023-05-17T15:09:30.177038+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197292+0000","last_change":"2023-05-17T15:09:30.189187+0000","last_active":"2023-05-17T15:09:30.197292+0000","last_peered":"2023-05-17T15:09:30.197292+0000","last_clean":"2023-05-17T15:09:30.197292+0000","last_became_active":"2023-05-17T15:09:30.188685+0000","last_became_peered":"2023-05-17T15:09:30.188685+0000","last_unstale":"2023-05-17T15:09:30.197292+0000","last_undegraded":"2023-05-17T15:09:30.197292+0000","last_fullsized":"2023-05-17T15:09:30.197292+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185414+0000","last_change":"2023-05-17T15:09:29.805864+0000","last_active":"2023-05-17T15:09:30.185414+0000","last_peered":"2023-05-17T15:09:30.185414+0000","last_clean":"2023-05-17T15:09:30.185414+0000","last_became_active":"2023-05-17T15:09:29.805216+0000","last_became_peered":"2023-05-17T15:09:29.805216+0000","last_unstale":"2023-05-17T15:09:30.185414+0000","last_undegraded":"2023-05-17T15:09:30.185414+0000","last_fullsized":"2023-05-17T15:09:30.185414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198957+0000","last_change":"2023-05-17T15:09:30.196273+0000","last_active":"2023-05-17T15:09:30.198957+0000","last_peered":"2023-05-17T15:09:30.198957+0000","last_clean":"2023-05-17T15:09:30.198957+0000","last_became_active":"2023-05-17T15:09:30.195171+0000","last_became_peered":"2023-05-17T15:09:30.195171+0000","last_unstale":"2023-05-17T15:09:30.198957+0000","last_undegraded":"2023-05-17T15:09:30.198957+0000","last_fullsized":"2023-05-17T15:09:30.198957+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178444+0000","last_change":"2023-05-17T15:09:29.793293+0000","last_active":"2023-05-17T15:09:30.178444+0000","last_peered":"2023-05-17T15:09:30.178444+0000","last_clean":"2023-05-17T15:09:30.178444+0000","last_became_active":"2023-05-17T15:09:29.792947+0000","last_became_peered":"2023-05-17T15:09:29.792947+0000","last_unstale":"2023-05-17T15:09:30.178444+0000","last_undegraded":"2023-05-17T15:09:30.178444+0000","last_fullsized":"2023-05-17T15:09:30.178444+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201180+0000","last_change":"2023-05-17T15:09:30.198189+0000","last_active":"2023-05-17T15:09:30.201180+0000","last_peered":"2023-05-17T15:09:30.201180+0000","last_clean":"2023-05-17T15:09:30.201180+0000","last_became_active":"2023-05-17T15:09:30.197894+0000","last_became_peered":"2023-05-17T15:09:30.197894+0000","last_unstale":"2023-05-17T15:09:30.201180+0000","last_undegraded":"2023-05-17T15:09:30.201180+0000","last_fullsized":"2023-05-17T15:09:30.201180+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171619+0000","last_change":"2023-05-17T15:09:29.797128+0000","last_active":"2023-05-17T15:09:30.171619+0000","last_peered":"2023-05-17T15:09:30.171619+0000","last_clean":"2023-05-17T15:09:30.171619+0000","last_became_active":"2023-05-17T15:09:29.796798+0000","last_became_peered":"2023-05-17T15:09:29.796798+0000","last_unstale":"2023-05-17T15:09:30.171619+0000","last_undegraded":"2023-05-17T15:09:30.171619+0000","last_fullsized":"2023-05-17T15:09:30.171619+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194931+0000","last_change":"2023-05-17T15:09:30.191085+0000","last_active":"2023-05-17T15:09:30.194931+0000","last_peered":"2023-05-17T15:09:30.194931+0000","last_clean":"2023-05-17T15:09:30.194931+0000","last_became_active":"2023-05-17T15:09:30.190666+0000","last_became_peered":"2023-05-17T15:09:30.190666+0000","last_unstale":"2023-05-17T15:09:30.194931+0000","last_undegraded":"2023-05-17T15:09:30.194931+0000","last_fullsized":"2023-05-17T15:09:30.194931+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174760+0000","last_change":"2023-05-17T15:09:29.797829+0000","last_active":"2023-05-17T15:09:30.174760+0000","last_peered":"2023-05-17T15:09:30.174760+0000","last_clean":"2023-05-17T15:09:30.174760+0000","last_became_active":"2023-05-17T15:09:29.797541+0000","last_became_peered":"2023-05-17T15:09:29.797541+0000","last_unstale":"2023-05-17T15:09:30.174760+0000","last_undegraded":"2023-05-17T15:09:30.174760+0000","last_fullsized":"2023-05-17T15:09:30.174760+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194093+0000","last_change":"2023-05-17T15:09:30.191323+0000","last_active":"2023-05-17T15:09:30.194093+0000","last_peered":"2023-05-17T15:09:30.194093+0000","last_clean":"2023-05-17T15:09:30.194093+0000","last_became_active":"2023-05-17T15:09:30.191038+0000","last_became_peered":"2023-05-17T15:09:30.191038+0000","last_unstale":"2023-05-17T15:09:30.194093+0000","last_undegraded":"2023-05-17T15:09:30.194093+0000","last_fullsized":"2023-05-17T15:09:30.194093+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177718+0000","last_change":"2023-05-17T15:09:29.801178+0000","last_active":"2023-05-17T15:09:30.177718+0000","last_peered":"2023-05-17T15:09:30.177718+0000","last_clean":"2023-05-17T15:09:30.177718+0000","last_became_active":"2023-05-17T15:09:29.800901+0000","last_became_peered":"2023-05-17T15:09:29.800901+0000","last_unstale":"2023-05-17T15:09:30.177718+0000","last_undegraded":"2023-05-17T15:09:30.177718+0000","last_fullsized":"2023-05-17T15:09:30.177718+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192429+0000","last_change":"2023-05-17T15:09:30.187155+0000","last_active":"2023-05-17T15:09:30.192429+0000","last_peered":"2023-05-17T15:09:30.192429+0000","last_clean":"2023-05-17T15:09:30.192429+0000","last_became_active":"2023-05-17T15:09:30.186883+0000","last_became_peered":"2023-05-17T15:09:30.186883+0000","last_unstale":"2023-05-17T15:09:30.192429+0000","last_undegraded":"2023-05-17T15:09:30.192429+0000","last_fullsized":"2023-05-17T15:09:30.192429+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198700+0000","last_change":"2023-05-17T15:09:29.799623+0000","last_active":"2023-05-17T15:09:30.198700+0000","last_peered":"2023-05-17T15:09:30.198700+0000","last_clean":"2023-05-17T15:09:30.198700+0000","last_became_active":"2023-05-17T15:09:29.799274+0000","last_became_peered":"2023-05-17T15:09:29.799274+0000","last_unstale":"2023-05-17T15:09:30.198700+0000","last_undegraded":"2023-05-17T15:09:30.198700+0000","last_fullsized":"2023-05-17T15:09:30.198700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193499+0000","last_change":"2023-05-17T15:09:30.188661+0000","last_active":"2023-05-17T15:09:30.193499+0000","last_peered":"2023-05-17T15:09:30.193499+0000","last_clean":"2023-05-17T15:09:30.193499+0000","last_became_active":"2023-05-17T15:09:30.188334+0000","last_became_peered":"2023-05-17T15:09:30.188334+0000","last_unstale":"2023-05-17T15:09:30.193499+0000","last_undegraded":"2023-05-17T15:09:30.193499+0000","last_fullsized":"2023-05-17T15:09:30.193499+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198742+0000","last_change":"2023-05-17T15:09:29.795770+0000","last_active":"2023-05-17T15:09:30.198742+0000","last_peered":"2023-05-17T15:09:30.198742+0000","last_clean":"2023-05-17T15:09:30.198742+0000","last_became_active":"2023-05-17T15:09:29.795487+0000","last_became_peered":"2023-05-17T15:09:29.795487+0000","last_unstale":"2023-05-17T15:09:30.198742+0000","last_undegraded":"2023-05-17T15:09:30.198742+0000","last_fullsized":"2023-05-17T15:09:30.198742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200661+0000","last_change":"2023-05-17T15:09:30.194960+0000","last_active":"2023-05-17T15:09:30.200661+0000","last_peered":"2023-05-17T15:09:30.200661+0000","last_clean":"2023-05-17T15:09:30.200661+0000","last_became_active":"2023-05-17T15:09:30.194578+0000","last_became_peered":"2023-05-17T15:09:30.194578+0000","last_unstale":"2023-05-17T15:09:30.200661+0000","last_undegraded":"2023-05-17T15:09:30.200661+0000","last_fullsized":"2023-05-17T15:09:30.200661+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188816+0000","last_change":"2023-05-17T15:09:29.793843+0000","last_active":"2023-05-17T15:09:30.188816+0000","last_peered":"2023-05-17T15:09:30.188816+0000","last_clean":"2023-05-17T15:09:30.188816+0000","last_became_active":"2023-05-17T15:09:29.793564+0000","last_became_peered":"2023-05-17T15:09:29.793564+0000","last_unstale":"2023-05-17T15:09:30.188816+0000","last_undegraded":"2023-05-17T15:09:30.188816+0000","last_fullsized":"2023-05-17T15:09:30.188816+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.190965+0000","last_change":"2023-05-17T15:09:30.186732+0000","last_active":"2023-05-17T15:09:30.190965+0000","last_peered":"2023-05-17T15:09:30.190965+0000","last_clean":"2023-05-17T15:09:30.190965+0000","last_became_active":"2023-05-17T15:09:30.186381+0000","last_became_peered":"2023-05-17T15:09:30.186381+0000","last_unstale":"2023-05-17T15:09:30.190965+0000","last_undegraded":"2023-05-17T15:09:30.190965+0000","last_fullsized":"2023-05-17T15:09:30.190965+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.175605+0000","last_change":"2023-05-17T15:09:29.799398+0000","last_active":"2023-05-17T15:09:30.175605+0000","last_peered":"2023-05-17T15:09:30.175605+0000","last_clean":"2023-05-17T15:09:30.175605+0000","last_became_active":"2023-05-17T15:09:29.799127+0000","last_became_peered":"2023-05-17T15:09:29.799127+0000","last_unstale":"2023-05-17T15:09:30.175605+0000","last_undegraded":"2023-05-17T15:09:30.175605+0000","last_fullsized":"2023-05-17T15:09:30.175605+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200967+0000","last_change":"2023-05-17T15:09:30.193512+0000","last_active":"2023-05-17T15:09:30.200967+0000","last_peered":"2023-05-17T15:09:30.200967+0000","last_clean":"2023-05-17T15:09:30.200967+0000","last_became_active":"2023-05-17T15:09:30.192934+0000","last_became_peered":"2023-05-17T15:09:30.192934+0000","last_unstale":"2023-05-17T15:09:30.200967+0000","last_undegraded":"2023-05-17T15:09:30.200967+0000","last_fullsized":"2023-05-17T15:09:30.200967+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188460+0000","last_change":"2023-05-17T15:09:29.795949+0000","last_active":"2023-05-17T15:09:30.188460+0000","last_peered":"2023-05-17T15:09:30.188460+0000","last_clean":"2023-05-17T15:09:30.188460+0000","last_became_active":"2023-05-17T15:09:29.795671+0000","last_became_peered":"2023-05-17T15:09:29.795671+0000","last_unstale":"2023-05-17T15:09:30.188460+0000","last_undegraded":"2023-05-17T15:09:30.188460+0000","last_fullsized":"2023-05-17T15:09:30.188460+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.189406+0000","last_change":"2023-05-17T15:09:30.187976+0000","last_active":"2023-05-17T15:09:30.189406+0000","last_peered":"2023-05-17T15:09:30.189406+0000","last_clean":"2023-05-17T15:09:30.189406+0000","last_became_active":"2023-05-17T15:09:30.187691+0000","last_became_peered":"2023-05-17T15:09:30.187691+0000","last_unstale":"2023-05-17T15:09:30.189406+0000","last_undegraded":"2023-05-17T15:09:30.189406+0000","last_fullsized":"2023-05-17T15:09:30.189406+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201540+0000","last_change":"2023-05-17T15:09:29.796670+0000","last_active":"2023-05-17T15:09:30.201540+0000","last_peered":"2023-05-17T15:09:30.201540+0000","last_clean":"2023-05-17T15:09:30.201540+0000","last_became_active":"2023-05-17T15:09:29.796320+0000","last_became_peered":"2023-05-17T15:09:29.796320+0000","last_unstale":"2023-05-17T15:09:30.201540+0000","last_undegraded":"2023-05-17T15:09:30.201540+0000","last_fullsized":"2023-05-17T15:09:30.201540+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197418+0000","last_change":"2023-05-17T15:09:30.190017+0000","last_active":"2023-05-17T15:09:30.197418+0000","last_peered":"2023-05-17T15:09:30.197418+0000","last_clean":"2023-05-17T15:09:30.197418+0000","last_became_active":"2023-05-17T15:09:30.189713+0000","last_became_peered":"2023-05-17T15:09:30.189713+0000","last_unstale":"2023-05-17T15:09:30.197418+0000","last_undegraded":"2023-05-17T15:09:30.197418+0000","last_fullsized":"2023-05-17T15:09:30.197418+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196540+0000","last_change":"2023-05-17T15:09:29.795937+0000","last_active":"2023-05-17T15:09:30.196540+0000","last_peered":"2023-05-17T15:09:30.196540+0000","last_clean":"2023-05-17T15:09:30.196540+0000","last_became_active":"2023-05-17T15:09:29.795606+0000","last_became_peered":"2023-05-17T15:09:29.795606+0000","last_unstale":"2023-05-17T15:09:30.196540+0000","last_undegraded":"2023-05-17T15:09:30.196540+0000","last_fullsized":"2023-05-17T15:09:30.196540+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198785+0000","last_change":"2023-05-17T15:09:30.196559+0000","last_active":"2023-05-17T15:09:30.198785+0000","last_peered":"2023-05-17T15:09:30.198785+0000","last_clean":"2023-05-17T15:09:30.198785+0000","last_became_active":"2023-05-17T15:09:30.196224+0000","last_became_peered":"2023-05-17T15:09:30.196224+0000","last_unstale":"2023-05-17T15:09:30.198785+0000","last_undegraded":"2023-05-17T15:09:30.198785+0000","last_fullsized":"2023-05-17T15:09:30.198785+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177557+0000","last_change":"2023-05-17T15:09:29.795249+0000","last_active":"2023-05-17T15:09:30.177557+0000","last_peered":"2023-05-17T15:09:30.177557+0000","last_clean":"2023-05-17T15:09:30.177557+0000","last_became_active":"2023-05-17T15:09:29.794973+0000","last_became_peered":"2023-05-17T15:09:29.794973+0000","last_unstale":"2023-05-17T15:09:30.177557+0000","last_undegraded":"2023-05-17T15:09:30.177557+0000","last_fullsized":"2023-05-17T15:09:30.177557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.191320+0000","last_change":"2023-05-17T15:09:30.187422+0000","last_active":"2023-05-17T15:09:30.191320+0000","last_peered":"2023-05-17T15:09:30.191320+0000","last_clean":"2023-05-17T15:09:30.191320+0000","last_became_active":"2023-05-17T15:09:30.187105+0000","last_became_peered":"2023-05-17T15:09:30.187105+0000","last_unstale":"2023-05-17T15:09:30.191320+0000","last_undegraded":"2023-05-17T15:09:30.191320+0000","last_fullsized":"2023-05-17T15:09:30.191320+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178533+0000","last_change":"2023-05-17T15:09:29.796804+0000","last_active":"2023-05-17T15:09:30.178533+0000","last_peered":"2023-05-17T15:09:30.178533+0000","last_clean":"2023-05-17T15:09:30.178533+0000","last_became_active":"2023-05-17T15:09:29.796509+0000","last_became_peered":"2023-05-17T15:09:29.796509+0000","last_unstale":"2023-05-17T15:09:30.178533+0000","last_undegraded":"2023-05-17T15:09:30.178533+0000","last_fullsized":"2023-05-17T15:09:30.178533+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192577+0000","last_change":"2023-05-17T15:09:30.187821+0000","last_active":"2023-05-17T15:09:30.192577+0000","last_peered":"2023-05-17T15:09:30.192577+0000","last_clean":"2023-05-17T15:09:30.192577+0000","last_became_active":"2023-05-17T15:09:30.187528+0000","last_became_peered":"2023-05-17T15:09:30.187528+0000","last_unstale":"2023-05-17T15:09:30.192577+0000","last_undegraded":"2023-05-17T15:09:30.192577+0000","last_fullsized":"2023-05-17T15:09:30.192577+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.180311+0000","last_change":"2023-05-17T15:09:29.800216+0000","last_active":"2023-05-17T15:09:30.180311+0000","last_peered":"2023-05-17T15:09:30.180311+0000","last_clean":"2023-05-17T15:09:30.180311+0000","last_became_active":"2023-05-17T15:09:29.799153+0000","last_became_peered":"2023-05-17T15:09:29.799153+0000","last_unstale":"2023-05-17T15:09:30.180311+0000","last_undegraded":"2023-05-17T15:09:30.180311+0000","last_fullsized":"2023-05-17T15:09:30.180311+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.189066+0000","last_change":"2023-05-17T15:09:30.186817+0000","last_active":"2023-05-17T15:09:30.189066+0000","last_peered":"2023-05-17T15:09:30.189066+0000","last_clean":"2023-05-17T15:09:30.189066+0000","last_became_active":"2023-05-17T15:09:30.186577+0000","last_became_peered":"2023-05-17T15:09:30.186577+0000","last_unstale":"2023-05-17T15:09:30.189066+0000","last_undegraded":"2023-05-17T15:09:30.189066+0000","last_fullsized":"2023-05-17T15:09:30.189066+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.175203+0000","last_change":"2023-05-17T15:09:29.800050+0000","last_active":"2023-05-17T15:09:30.175203+0000","last_peered":"2023-05-17T15:09:30.175203+0000","last_clean":"2023-05-17T15:09:30.175203+0000","last_became_active":"2023-05-17T15:09:29.799766+0000","last_became_peered":"2023-05-17T15:09:29.799766+0000","last_unstale":"2023-05-17T15:09:30.175203+0000","last_undegraded":"2023-05-17T15:09:30.175203+0000","last_fullsized":"2023-05-17T15:09:30.175203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197466+0000","last_change":"2023-05-17T15:09:30.192507+0000","last_active":"2023-05-17T15:09:30.197466+0000","last_peered":"2023-05-17T15:09:30.197466+0000","last_clean":"2023-05-17T15:09:30.197466+0000","last_became_active":"2023-05-17T15:09:30.192130+0000","last_became_peered":"2023-05-17T15:09:30.192130+0000","last_unstale":"2023-05-17T15:09:30.197466+0000","last_undegraded":"2023-05-17T15:09:30.197466+0000","last_fullsized":"2023-05-17T15:09:30.197466+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174265+0000","last_change":"2023-05-17T15:09:29.793131+0000","last_active":"2023-05-17T15:09:30.174265+0000","last_peered":"2023-05-17T15:09:30.174265+0000","last_clean":"2023-05-17T15:09:30.174265+0000","last_became_active":"2023-05-17T15:09:29.792862+0000","last_became_peered":"2023-05-17T15:09:29.792862+0000","last_unstale":"2023-05-17T15:09:30.174265+0000","last_undegraded":"2023-05-17T15:09:30.174265+0000","last_fullsized":"2023-05-17T15:09:30.174265+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197511+0000","last_change":"2023-05-17T15:09:30.195388+0000","last_active":"2023-05-17T15:09:30.197511+0000","last_peered":"2023-05-17T15:09:30.197511+0000","last_clean":"2023-05-17T15:09:30.197511+0000","last_became_active":"2023-05-17T15:09:30.195085+0000","last_became_peered":"2023-05-17T15:09:30.195085+0000","last_unstale":"2023-05-17T15:09:30.197511+0000","last_undegraded":"2023-05-17T15:09:30.197511+0000","last_fullsized":"2023-05-17T15:09:30.197511+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.181279+0000","last_change":"2023-05-17T15:09:29.799086+0000","last_active":"2023-05-17T15:09:30.181279+0000","last_peered":"2023-05-17T15:09:30.181279+0000","last_clean":"2023-05-17T15:09:30.181279+0000","last_became_active":"2023-05-17T15:09:29.798744+0000","last_became_peered":"2023-05-17T15:09:29.798744+0000","last_unstale":"2023-05-17T15:09:30.181279+0000","last_undegraded":"2023-05-17T15:09:30.181279+0000","last_fullsized":"2023-05-17T15:09:30.181279+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193541+0000","last_change":"2023-05-17T15:09:30.190436+0000","last_active":"2023-05-17T15:09:30.193541+0000","last_peered":"2023-05-17T15:09:30.193541+0000","last_clean":"2023-05-17T15:09:30.193541+0000","last_became_active":"2023-05-17T15:09:30.190159+0000","last_became_peered":"2023-05-17T15:09:30.190159+0000","last_unstale":"2023-05-17T15:09:30.193541+0000","last_undegraded":"2023-05-17T15:09:30.193541+0000","last_fullsized":"2023-05-17T15:09:30.193541+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171574+0000","last_change":"2023-05-17T15:09:29.797754+0000","last_active":"2023-05-17T15:09:30.171574+0000","last_peered":"2023-05-17T15:09:30.171574+0000","last_clean":"2023-05-17T15:09:30.171574+0000","last_became_active":"2023-05-17T15:09:29.797471+0000","last_became_peered":"2023-05-17T15:09:29.797471+0000","last_unstale":"2023-05-17T15:09:30.171574+0000","last_undegraded":"2023-05-17T15:09:30.171574+0000","last_fullsized":"2023-05-17T15:09:30.171574+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195427+0000","last_change":"2023-05-17T15:09:30.190676+0000","last_active":"2023-05-17T15:09:30.195427+0000","last_peered":"2023-05-17T15:09:30.195427+0000","last_clean":"2023-05-17T15:09:30.195427+0000","last_became_active":"2023-05-17T15:09:30.190388+0000","last_became_peered":"2023-05-17T15:09:30.190388+0000","last_unstale":"2023-05-17T15:09:30.195427+0000","last_undegraded":"2023-05-17T15:09:30.195427+0000","last_fullsized":"2023-05-17T15:09:30.195427+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.186562+0000","last_change":"2023-05-17T15:09:29.793961+0000","last_active":"2023-05-17T15:09:30.186562+0000","last_peered":"2023-05-17T15:09:30.186562+0000","last_clean":"2023-05-17T15:09:30.186562+0000","last_became_active":"2023-05-17T15:09:29.793424+0000","last_became_peered":"2023-05-17T15:09:29.793424+0000","last_unstale":"2023-05-17T15:09:30.186562+0000","last_undegraded":"2023-05-17T15:09:30.186562+0000","last_fullsized":"2023-05-17T15:09:30.186562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188871+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:09:30.188871+0000","last_peered":"2023-05-17T15:09:30.188871+0000","last_clean":"2023-05-17T15:09:30.188871+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:09:30.188871+0000","last_undegraded":"2023-05-17T15:09:30.188871+0000","last_fullsized":"2023-05-17T15:09:30.188871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194499+0000","last_change":"2023-05-17T15:09:30.187289+0000","last_active":"2023-05-17T15:09:30.194499+0000","last_peered":"2023-05-17T15:09:30.194499+0000","last_clean":"2023-05-17T15:09:30.194499+0000","last_became_active":"2023-05-17T15:09:30.186838+0000","last_became_peered":"2023-05-17T15:09:30.186838+0000","last_unstale":"2023-05-17T15:09:30.194499+0000","last_undegraded":"2023-05-17T15:09:30.194499+0000","last_fullsized":"2023-05-17T15:09:30.194499+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178388+0000","last_change":"2023-05-17T15:09:29.801179+0000","last_active":"2023-05-17T15:09:30.178388+0000","last_peered":"2023-05-17T15:09:30.178388+0000","last_clean":"2023-05-17T15:09:30.178388+0000","last_became_active":"2023-05-17T15:09:29.800885+0000","last_became_peered":"2023-05-17T15:09:29.800885+0000","last_unstale":"2023-05-17T15:09:30.178388+0000","last_undegraded":"2023-05-17T15:09:30.178388+0000","last_fullsized":"2023-05-17T15:09:30.178388+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174363+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:09:30.174363+0000","last_peered":"2023-05-17T15:09:30.174363+0000","last_clean":"2023-05-17T15:09:30.174363+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:09:30.174363+0000","last_undegraded":"2023-05-17T15:09:30.174363+0000","last_fullsized":"2023-05-17T15:09:30.174363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197231+0000","last_change":"2023-05-17T15:09:30.188394+0000","last_active":"2023-05-17T15:09:30.197231+0000","last_peered":"2023-05-17T15:09:30.197231+0000","last_clean":"2023-05-17T15:09:30.197231+0000","last_became_active":"2023-05-17T15:09:30.186287+0000","last_became_peered":"2023-05-17T15:09:30.186287+0000","last_unstale":"2023-05-17T15:09:30.197231+0000","last_undegraded":"2023-05-17T15:09:30.197231+0000","last_fullsized":"2023-05-17T15:09:30.197231+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185819+0000","last_change":"2023-05-17T15:09:29.794586+0000","last_active":"2023-05-17T15:09:30.185819+0000","last_peered":"2023-05-17T15:09:30.185819+0000","last_clean":"2023-05-17T15:09:30.185819+0000","last_became_active":"2023-05-17T15:09:29.794273+0000","last_became_peered":"2023-05-17T15:09:29.794273+0000","last_unstale":"2023-05-17T15:09:30.185819+0000","last_undegraded":"2023-05-17T15:09:30.185819+0000","last_fullsized":"2023-05-17T15:09:30.185819+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.176652+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:09:30.176652+0000","last_peered":"2023-05-17T15:09:30.176652+0000","last_clean":"2023-05-17T15:09:30.176652+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:09:30.176652+0000","last_undegraded":"2023-05-17T15:09:30.176652+0000","last_fullsized":"2023-05-17T15:09:30.176652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193337+0000","last_change":"2023-05-17T15:09:30.190757+0000","last_active":"2023-05-17T15:09:30.193337+0000","last_peered":"2023-05-17T15:09:30.193337+0000","last_clean":"2023-05-17T15:09:30.193337+0000","last_became_active":"2023-05-17T15:09:30.190458+0000","last_became_peered":"2023-05-17T15:09:30.190458+0000","last_unstale":"2023-05-17T15:09:30.193337+0000","last_undegraded":"2023-05-17T15:09:30.193337+0000","last_fullsized":"2023-05-17T15:09:30.193337+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188437+0000","last_change":"2023-05-17T15:09:29.803602+0000","last_active":"2023-05-17T15:09:30.188437+0000","last_peered":"2023-05-17T15:09:30.188437+0000","last_clean":"2023-05-17T15:09:30.188437+0000","last_became_active":"2023-05-17T15:09:29.802307+0000","last_became_peered":"2023-05-17T15:09:29.802307+0000","last_unstale":"2023-05-17T15:09:30.188437+0000","last_undegraded":"2023-05-17T15:09:30.188437+0000","last_fullsized":"2023-05-17T15:09:30.188437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173663+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:09:30.173663+0000","last_peered":"2023-05-17T15:09:30.173663+0000","last_clean":"2023-05-17T15:09:30.173663+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:09:30.173663+0000","last_undegraded":"2023-05-17T15:09:30.173663+0000","last_fullsized":"2023-05-17T15:09:30.173663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171685+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:09:30.171685+0000","last_peered":"2023-05-17T15:09:30.171685+0000","last_clean":"2023-05-17T15:09:30.171685+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:09:30.171685+0000","last_undegraded":"2023-05-17T15:09:30.171685+0000","last_fullsized":"2023-05-17T15:09:30.171685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198660+0000","last_change":"2023-05-17T15:09:30.192369+0000","last_active":"2023-05-17T15:09:30.198660+0000","last_peered":"2023-05-17T15:09:30.198660+0000","last_clean":"2023-05-17T15:09:30.198660+0000","last_became_active":"2023-05-17T15:09:30.192090+0000","last_became_peered":"2023-05-17T15:09:30.192090+0000","last_unstale":"2023-05-17T15:09:30.198660+0000","last_undegraded":"2023-05-17T15:09:30.198660+0000","last_fullsized":"2023-05-17T15:09:30.198660+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195997+0000","last_change":"2023-05-17T15:09:29.792426+0000","last_active":"2023-05-17T15:09:30.195997+0000","last_peered":"2023-05-17T15:09:30.195997+0000","last_clean":"2023-05-17T15:09:30.195997+0000","last_became_active":"2023-05-17T15:09:29.791393+0000","last_became_peered":"2023-05-17T15:09:29.791393+0000","last_unstale":"2023-05-17T15:09:30.195997+0000","last_undegraded":"2023-05-17T15:09:30.195997+0000","last_fullsized":"2023-05-17T15:09:30.195997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171730+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:09:30.171730+0000","last_peered":"2023-05-17T15:09:30.171730+0000","last_clean":"2023-05-17T15:09:30.171730+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:09:30.171730+0000","last_undegraded":"2023-05-17T15:09:30.171730+0000","last_fullsized":"2023-05-17T15:09:30.171730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196776+0000","last_change":"2023-05-17T15:09:30.193799+0000","last_active":"2023-05-17T15:09:30.196776+0000","last_peered":"2023-05-17T15:09:30.196776+0000","last_clean":"2023-05-17T15:09:30.196776+0000","last_became_active":"2023-05-17T15:09:30.193387+0000","last_became_peered":"2023-05-17T15:09:30.193387+0000","last_unstale":"2023-05-17T15:09:30.196776+0000","last_undegraded":"2023-05-17T15:09:30.196776+0000","last_fullsized":"2023-05-17T15:09:30.196776+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178426+0000","last_change":"2023-05-17T15:09:29.801490+0000","last_active":"2023-05-17T15:09:30.178426+0000","last_peered":"2023-05-17T15:09:30.178426+0000","last_clean":"2023-05-17T15:09:30.178426+0000","last_became_active":"2023-05-17T15:09:29.801213+0000","last_became_peered":"2023-05-17T15:09:29.801213+0000","last_unstale":"2023-05-17T15:09:30.178426+0000","last_undegraded":"2023-05-17T15:09:30.178426+0000","last_fullsized":"2023-05-17T15:09:30.178426+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173035+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:09:30.173035+0000","last_peered":"2023-05-17T15:09:30.173035+0000","last_clean":"2023-05-17T15:09:30.173035+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:09:30.173035+0000","last_undegraded":"2023-05-17T15:09:30.173035+0000","last_fullsized":"2023-05-17T15:09:30.173035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196994+0000","last_change":"2023-05-17T15:09:30.194469+0000","last_active":"2023-05-17T15:09:30.196994+0000","last_peered":"2023-05-17T15:09:30.196994+0000","last_clean":"2023-05-17T15:09:30.196994+0000","last_became_active":"2023-05-17T15:09:30.194139+0000","last_became_peered":"2023-05-17T15:09:30.194139+0000","last_unstale":"2023-05-17T15:09:30.196994+0000","last_undegraded":"2023-05-17T15:09:30.196994+0000","last_fullsized":"2023-05-17T15:09:30.196994+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.175696+0000","last_change":"2023-05-17T15:09:29.800009+0000","last_active":"2023-05-17T15:09:30.175696+0000","last_peered":"2023-05-17T15:09:30.175696+0000","last_clean":"2023-05-17T15:09:30.175696+0000","last_became_active":"2023-05-17T15:09:29.799669+0000","last_became_peered":"2023-05-17T15:09:29.799669+0000","last_unstale":"2023-05-17T15:09:30.175696+0000","last_undegraded":"2023-05-17T15:09:30.175696+0000","last_fullsized":"2023-05-17T15:09:30.175696+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188846+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:09:30.188846+0000","last_peered":"2023-05-17T15:09:30.188846+0000","last_clean":"2023-05-17T15:09:30.188846+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:09:30.188846+0000","last_undegraded":"2023-05-17T15:09:30.188846+0000","last_fullsized":"2023-05-17T15:09:30.188846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188597+0000","last_change":"2023-05-17T15:09:30.186828+0000","last_active":"2023-05-17T15:09:30.188597+0000","last_peered":"2023-05-17T15:09:30.188597+0000","last_clean":"2023-05-17T15:09:30.188597+0000","last_became_active":"2023-05-17T15:09:30.186494+0000","last_became_peered":"2023-05-17T15:09:30.186494+0000","last_unstale":"2023-05-17T15:09:30.188597+0000","last_undegraded":"2023-05-17T15:09:30.188597+0000","last_fullsized":"2023-05-17T15:09:30.188597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.179429+0000","last_change":"2023-05-17T15:09:29.804334+0000","last_active":"2023-05-17T15:09:30.179429+0000","last_peered":"2023-05-17T15:09:30.179429+0000","last_clean":"2023-05-17T15:09:30.179429+0000","last_became_active":"2023-05-17T15:09:29.803113+0000","last_became_peered":"2023-05-17T15:09:29.803113+0000","last_unstale":"2023-05-17T15:09:30.179429+0000","last_undegraded":"2023-05-17T15:09:30.179429+0000","last_fullsized":"2023-05-17T15:09:30.179429+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.181253+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:09:30.181253+0000","last_peered":"2023-05-17T15:09:30.181253+0000","last_clean":"2023-05-17T15:09:30.181253+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:09:30.181253+0000","last_undegraded":"2023-05-17T15:09:30.181253+0000","last_fullsized":"2023-05-17T15:09:30.181253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18052,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":16704,"kb_avail":94353788,"statfs":{"total":96636764160,"available":96618278912,"internally_reserved":0,"allocated":1372160,"data_stored":684553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17104896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.36499999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.79200000000000004,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.441}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.81999999999999995,"15min":0.89000000000000001},"last":0.502}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.042},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.90800000000000003,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17552,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354288,"statfs":{"total":96636764160,"available":96618790912,"internally_reserved":0,"allocated":1384448,"data_stored":686609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.438},{"interface":"front","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74299999999999999,"5min":1.04,"15min":1.04},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":1.087,"15min":1.087},"last":0.373}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77800000000000002,"5min":1.159,"15min":1.159},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83099999999999996,"5min":1.609,"15min":1.609},"last":0.747},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86799999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80700000000000005,"5min":0.879,"15min":0.89500000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17340,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94354500,"statfs":{"total":96636764160,"available":96619008000,"internally_reserved":0,"allocated":1363968,"data_stored":684497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.29299999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17104,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94354736,"statfs":{"total":96636764160,"available":96619249664,"internally_reserved":0,"allocated":1384448,"data_stored":685335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.377,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40600000000000003,"15min":0.41299999999999998},"min":{"1min":0.26000000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.214},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.67700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34899999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0720000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65300000000000002},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66500000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.087},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0740000000000001},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18492,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353348,"statfs":{"total":96636764160,"available":96617828352,"internally_reserved":0,"allocated":1363968,"data_stored":684497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.378,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.628,"15min":0.628},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.33500000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41999999999999998,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.056,"15min":1.056},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.995,"15min":1.046},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75900000000000001,"5min":0.92200000000000004,"15min":1.0860000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.441,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.88500000000000001,"5min":1.036,"15min":1.036},"last":0.54900000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.76100000000000001,"5min":0.97499999999999998,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21380,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350460,"statfs":{"total":96636764160,"available":96614871040,"internally_reserved":0,"allocated":1372160,"data_stored":685459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.748,"15min":0.748},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.498,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53700000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.60999999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.86199999999999999,"5min":0.99099999999999999,"15min":1.034},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":3.4590000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86699999999999999,"5min":1.155,"15min":3.4289999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.69999999999999996},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.99399999999999999,"5min":1.772,"15min":3.4049999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.80700000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.024,"15min":3.391},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17796,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94354044,"statfs":{"total":96636764160,"available":96618541056,"internally_reserved":0,"allocated":1372160,"data_stored":685141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77600000000000002,"5min":1.292,"15min":1.292},"last":0.45000000000000001}]},{"osd":2,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.75900000000000001,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65700000000000003,"5min":1.637,"15min":1.637},"last":0.60999999999999999}]},{"osd":5,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.502},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83899999999999997,"5min":0.995,"15min":0.995},"last":0.624},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80700000000000005,"5min":1.329,"15min":1.329},"last":0.67800000000000005}]},{"osd":6,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.151,"15min":1.151},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20988,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":19648,"kb_avail":94350852,"statfs":{"total":96636764160,"available":96615272448,"internally_reserved":0,"allocated":1363968,"data_stored":684497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20119552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82399999999999995,"5min":0.83599999999999997,"15min":0.876},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.34499999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73099999999999998}]},{"osd":1,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.995},"last":0.628}]},{"osd":2,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66900000000000004}]},{"osd":3,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.82299999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.74399999999999999}]},{"osd":6,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.046,"5min":1.107,"15min":1.107},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:38.825 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:09:38.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.951+0000 7f865ab96700 1 Processor -- start 2023-05-17T15:09:38.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.951+0000 7f865ab96700 1 -- start start 2023-05-17T15:09:38.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f865ab96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86540c5f30 0x7f86540c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:38.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f865ab96700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f86541543e0 0x7f86540c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:38.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f865ab96700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540bfcd0 con 0x7f8654158880 2023-05-17T15:09:38.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f865ab96700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86540c0290 con 0x7f86541543e0 2023-05-17T15:09:38.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f865ab96700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86540aa1a0 con 0x7f86540c5f30 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8659133700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f86541543e0 0x7f86540c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8653fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8654158880 0x7f8654153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40732/0 (socket says 172.21.15.27:40732) 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8653fff700 1 -- 172.21.15.27:0/3658481432 learned_addr learned my addr 172.21.15.27:0/3658481432 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8658932700 1 --2- 172.21.15.27:0/3658481432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86540c5f30 0x7f86540c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8659133700 1 -- 172.21.15.27:0/3658481432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86540c5f30 msgr2=0x7f86540c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8659133700 1 --2- 172.21.15.27:0/3658481432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86540c5f30 0x7f86540c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:38.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8659133700 1 -- 172.21.15.27:0/3658481432 >> v1:172.21.15.27:6789/0 conn(0x7f8654158880 legacy=0x7f8654153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:38.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f86537fe700 1 -- 172.21.15.27:0/3658481432 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804173313 0 0) 0x7f86540bfcd0 con 0x7f8654158880 2023-05-17T15:09:38.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8659133700 1 -- 172.21.15.27:0/3658481432 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540aa480 con 0x7f86541543e0 2023-05-17T15:09:38.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.952+0000 7f8659133700 1 --2- 172.21.15.27:0/3658481432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86541543e0 0x7f86540c0720 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f864c009760 tx=0x7f864c009060).ready entity=mon.0 client_cookie=6343c3605e951a0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:38.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f86537fe700 1 -- 172.21.15.27:0/3658481432 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00f510 con 0x7f86541543e0 2023-05-17T15:09:38.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f86537fe700 1 -- 172.21.15.27:0/3658481432 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00f670 con 0x7f86541543e0 2023-05-17T15:09:38.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f86537fe700 1 -- 172.21.15.27:0/3658481432 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00f9f0 con 0x7f86541543e0 2023-05-17T15:09:38.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 -- 172.21.15.27:0/3658481432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86541543e0 msgr2=0x7f86540c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:38.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 --2- 172.21.15.27:0/3658481432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86541543e0 0x7f86540c0720 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f864c009760 tx=0x7f864c009060).stop 2023-05-17T15:09:38.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 -- 172.21.15.27:0/3658481432 shutdown_connections 2023-05-17T15:09:38.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 --2- 172.21.15.27:0/3658481432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f86541543e0 0x7f86540c0720 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:38.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 --2- 172.21.15.27:0/3658481432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86540c5f30 0x7f86540c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:38.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 -- 172.21.15.27:0/3658481432 >> 172.21.15.27:0/3658481432 conn(0x7f8654069e70 msgr2=0x7f865405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:38.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 -- 172.21.15.27:0/3658481432 shutdown_connections 2023-05-17T15:09:38.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.953+0000 7f865ab96700 1 -- 172.21.15.27:0/3658481432 wait complete. 2023-05-17T15:09:38.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.954+0000 7f865ab96700 1 Processor -- start 2023-05-17T15:09:38.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 -- start start 2023-05-17T15:09:38.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86540c5f30 0x7f86540c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:38.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86541543e0 0x7f86540c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:38.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 0x7f86541500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:38.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540c1100 con 0x7f8654158880 2023-05-17T15:09:38.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654151980 con 0x7f86540c5f30 2023-05-17T15:09:38.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f865ab96700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8654151e10 con 0x7f86541543e0 2023-05-17T15:09:38.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f8659133700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 0x7f86541500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:38.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f8659133700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 0x7f86541500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41178/0 (socket says 172.21.15.27:41178) 2023-05-17T15:09:38.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f8659133700 1 -- 172.21.15.27:0/2370054618 learned_addr learned my addr 172.21.15.27:0/2370054618 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:38.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f8653fff700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86541543e0 0x7f86540c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:38.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.955+0000 7f8658932700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86540c5f30 0x7f86540c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:38.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8659133700 1 -- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86541543e0 msgr2=0x7f86540c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:38.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8659133700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86541543e0 0x7f86540c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:38.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8659133700 1 -- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86540c5f30 msgr2=0x7f86540c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:38.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8659133700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86540c5f30 0x7f86540c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:38.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8659133700 1 -- 172.21.15.27:0/2370054618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0092a0 con 0x7f8654158880 2023-05-17T15:09:38.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8659133700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 0x7f86541500b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f8654083770 tx=0x7f864c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:38.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00f7e0 con 0x7f8654158880 2023-05-17T15:09:38.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00f940 con 0x7f8654158880 2023-05-17T15:09:38.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8654150d70 con 0x7f8654158880 2023-05-17T15:09:38.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c01b660 con 0x7f8654158880 2023-05-17T15:09:38.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.956+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8654151330 con 0x7f8654158880 2023-05-17T15:09:38.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.957+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8654151b10 con 0x7f8654158880 2023-05-17T15:09:38.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.957+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f864c00f070 con 0x7f8654158880 2023-05-17T15:09:38.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.958+0000 7f8650ff9700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f863405ed90 0x7f8634061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:38.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.958+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f864c07b630 con 0x7f8654158880 2023-05-17T15:09:38.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.958+0000 7f8658932700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f863405ed90 0x7f8634061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:38.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.958+0000 7f8658932700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f863405ed90 0x7f8634061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8654155560 tx=0x7f863c009060).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:38.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:38.962+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f864c04cb80 con 0x7f8654158880 2023-05-17T15:09:39.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.133+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f865405f4a0 con 0x7f863405ed90 2023-05-17T15:09:39.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.143+0000 7f8650ff9700 1 -- 172.21.15.27:0/2370054618 <== mgr.6933 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361379 (secure 0 0 0) 0x7f865405f4a0 con 0x7f863405ed90 2023-05-17T15:09:39.168 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:39.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.146+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f863405ed90 msgr2=0x7f8634061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.146+0000 7f865ab96700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f863405ed90 0x7f8634061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8654155560 tx=0x7f863c009060).stop 2023-05-17T15:09:39.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.146+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 msgr2=0x7f86541500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.146+0000 7f865ab96700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 0x7f86541500b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f8654083770 tx=0x7f864c017000).stop 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 shutdown_connections 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f863405ed90 0x7f8634061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8654158880 0x7f86541500b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86540c5f30 0x7f86540c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 --2- 172.21.15.27:0/2370054618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86541543e0 0x7f86540c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 >> 172.21.15.27:0/2370054618 conn(0x7f8654069e70 msgr2=0x7f86540cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:39.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 shutdown_connections 2023-05-17T15:09:39.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.147+0000 7f865ab96700 1 -- 172.21.15.27:0/2370054618 wait complete. 2023-05-17T15:09:39.182 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:09:39.182 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-17T15:09:37.710355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":269,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":148704,"kb_used_data":10720,"kb_used_omap":0,"kb_used_meta":137920,"kb_avail":754826016,"statfs":{"total":773094113280,"available":772941840384,"internally_reserved":0,"allocated":10977280,"data_stored":5480588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":141230080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4469,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.998277"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201205+0000","last_change":"2023-05-17T15:09:30.198262+0000","last_active":"2023-05-17T15:09:30.201205+0000","last_peered":"2023-05-17T15:09:30.201205+0000","last_clean":"2023-05-17T15:09:30.201205+0000","last_became_active":"2023-05-17T15:09:30.197977+0000","last_became_peered":"2023-05-17T15:09:30.197977+0000","last_unstale":"2023-05-17T15:09:30.201205+0000","last_undegraded":"2023-05-17T15:09:30.201205+0000","last_fullsized":"2023-05-17T15:09:30.201205+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196103+0000","last_change":"2023-05-17T15:09:29.795451+0000","last_active":"2023-05-17T15:09:30.196103+0000","last_peered":"2023-05-17T15:09:30.196103+0000","last_clean":"2023-05-17T15:09:30.196103+0000","last_became_active":"2023-05-17T15:09:29.794951+0000","last_became_peered":"2023-05-17T15:09:29.794951+0000","last_unstale":"2023-05-17T15:09:30.196103+0000","last_undegraded":"2023-05-17T15:09:30.196103+0000","last_fullsized":"2023-05-17T15:09:30.196103+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199585+0000","last_change":"2023-05-17T15:09:30.194120+0000","last_active":"2023-05-17T15:09:30.199585+0000","last_peered":"2023-05-17T15:09:30.199585+0000","last_clean":"2023-05-17T15:09:30.199585+0000","last_became_active":"2023-05-17T15:09:30.193856+0000","last_became_peered":"2023-05-17T15:09:30.193856+0000","last_unstale":"2023-05-17T15:09:30.199585+0000","last_undegraded":"2023-05-17T15:09:30.199585+0000","last_fullsized":"2023-05-17T15:09:30.199585+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192066+0000","last_change":"2023-05-17T15:09:29.802113+0000","last_active":"2023-05-17T15:09:30.192066+0000","last_peered":"2023-05-17T15:09:30.192066+0000","last_clean":"2023-05-17T15:09:30.192066+0000","last_became_active":"2023-05-17T15:09:29.801466+0000","last_became_peered":"2023-05-17T15:09:29.801466+0000","last_unstale":"2023-05-17T15:09:30.192066+0000","last_undegraded":"2023-05-17T15:09:30.192066+0000","last_fullsized":"2023-05-17T15:09:30.192066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.191947+0000","last_change":"2023-05-17T15:09:30.187478+0000","last_active":"2023-05-17T15:09:30.191947+0000","last_peered":"2023-05-17T15:09:30.191947+0000","last_clean":"2023-05-17T15:09:30.191947+0000","last_became_active":"2023-05-17T15:09:30.186940+0000","last_became_peered":"2023-05-17T15:09:30.186940+0000","last_unstale":"2023-05-17T15:09:30.191947+0000","last_undegraded":"2023-05-17T15:09:30.191947+0000","last_fullsized":"2023-05-17T15:09:30.191947+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.172748+0000","last_change":"2023-05-17T15:09:29.791492+0000","last_active":"2023-05-17T15:09:30.172748+0000","last_peered":"2023-05-17T15:09:30.172748+0000","last_clean":"2023-05-17T15:09:30.172748+0000","last_became_active":"2023-05-17T15:09:29.791200+0000","last_became_peered":"2023-05-17T15:09:29.791200+0000","last_unstale":"2023-05-17T15:09:30.172748+0000","last_undegraded":"2023-05-17T15:09:30.172748+0000","last_fullsized":"2023-05-17T15:09:30.172748+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194368+0000","last_change":"2023-05-17T15:09:30.189712+0000","last_active":"2023-05-17T15:09:30.194368+0000","last_peered":"2023-05-17T15:09:30.194368+0000","last_clean":"2023-05-17T15:09:30.194368+0000","last_became_active":"2023-05-17T15:09:30.189434+0000","last_became_peered":"2023-05-17T15:09:30.189434+0000","last_unstale":"2023-05-17T15:09:30.194368+0000","last_undegraded":"2023-05-17T15:09:30.194368+0000","last_fullsized":"2023-05-17T15:09:30.194368+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195486+0000","last_change":"2023-05-17T15:09:29.803185+0000","last_active":"2023-05-17T15:09:30.195486+0000","last_peered":"2023-05-17T15:09:30.195486+0000","last_clean":"2023-05-17T15:09:30.195486+0000","last_became_active":"2023-05-17T15:09:29.802908+0000","last_became_peered":"2023-05-17T15:09:29.802908+0000","last_unstale":"2023-05-17T15:09:30.195486+0000","last_undegraded":"2023-05-17T15:09:30.195486+0000","last_fullsized":"2023-05-17T15:09:30.195486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200696+0000","last_change":"2023-05-17T15:09:30.195165+0000","last_active":"2023-05-17T15:09:30.200696+0000","last_peered":"2023-05-17T15:09:30.200696+0000","last_clean":"2023-05-17T15:09:30.200696+0000","last_became_active":"2023-05-17T15:09:30.194609+0000","last_became_peered":"2023-05-17T15:09:30.194609+0000","last_unstale":"2023-05-17T15:09:30.200696+0000","last_undegraded":"2023-05-17T15:09:30.200696+0000","last_fullsized":"2023-05-17T15:09:30.200696+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.190316+0000","last_change":"2023-05-17T15:09:29.801395+0000","last_active":"2023-05-17T15:09:30.190316+0000","last_peered":"2023-05-17T15:09:30.190316+0000","last_clean":"2023-05-17T15:09:30.190316+0000","last_became_active":"2023-05-17T15:09:29.801114+0000","last_became_peered":"2023-05-17T15:09:29.801114+0000","last_unstale":"2023-05-17T15:09:30.190316+0000","last_undegraded":"2023-05-17T15:09:30.190316+0000","last_fullsized":"2023-05-17T15:09:30.190316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192884+0000","last_change":"2023-05-17T15:09:30.186625+0000","last_active":"2023-05-17T15:09:30.192884+0000","last_peered":"2023-05-17T15:09:30.192884+0000","last_clean":"2023-05-17T15:09:30.192884+0000","last_became_active":"2023-05-17T15:09:30.186340+0000","last_became_peered":"2023-05-17T15:09:30.186340+0000","last_unstale":"2023-05-17T15:09:30.192884+0000","last_undegraded":"2023-05-17T15:09:30.192884+0000","last_fullsized":"2023-05-17T15:09:30.192884+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.184544+0000","last_change":"2023-05-17T15:09:29.805553+0000","last_active":"2023-05-17T15:09:30.184544+0000","last_peered":"2023-05-17T15:09:30.184544+0000","last_clean":"2023-05-17T15:09:30.184544+0000","last_became_active":"2023-05-17T15:09:29.805227+0000","last_became_peered":"2023-05-17T15:09:29.805227+0000","last_unstale":"2023-05-17T15:09:30.184544+0000","last_undegraded":"2023-05-17T15:09:30.184544+0000","last_fullsized":"2023-05-17T15:09:30.184544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198934+0000","last_change":"2023-05-17T15:09:30.196126+0000","last_active":"2023-05-17T15:09:30.198934+0000","last_peered":"2023-05-17T15:09:30.198934+0000","last_clean":"2023-05-17T15:09:30.198934+0000","last_became_active":"2023-05-17T15:09:30.195533+0000","last_became_peered":"2023-05-17T15:09:30.195533+0000","last_unstale":"2023-05-17T15:09:30.198934+0000","last_undegraded":"2023-05-17T15:09:30.198934+0000","last_fullsized":"2023-05-17T15:09:30.198934+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.176572+0000","last_change":"2023-05-17T15:09:29.801153+0000","last_active":"2023-05-17T15:09:30.176572+0000","last_peered":"2023-05-17T15:09:30.176572+0000","last_clean":"2023-05-17T15:09:30.176572+0000","last_became_active":"2023-05-17T15:09:29.800885+0000","last_became_peered":"2023-05-17T15:09:29.800885+0000","last_unstale":"2023-05-17T15:09:30.176572+0000","last_undegraded":"2023-05-17T15:09:30.176572+0000","last_fullsized":"2023-05-17T15:09:30.176572+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194411+0000","last_change":"2023-05-17T15:09:30.189314+0000","last_active":"2023-05-17T15:09:30.194411+0000","last_peered":"2023-05-17T15:09:30.194411+0000","last_clean":"2023-05-17T15:09:30.194411+0000","last_became_active":"2023-05-17T15:09:30.189099+0000","last_became_peered":"2023-05-17T15:09:30.189099+0000","last_unstale":"2023-05-17T15:09:30.194411+0000","last_undegraded":"2023-05-17T15:09:30.194411+0000","last_fullsized":"2023-05-17T15:09:30.194411+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173775+0000","last_change":"2023-05-17T15:09:29.801144+0000","last_active":"2023-05-17T15:09:30.173775+0000","last_peered":"2023-05-17T15:09:30.173775+0000","last_clean":"2023-05-17T15:09:30.173775+0000","last_became_active":"2023-05-17T15:09:29.800875+0000","last_became_peered":"2023-05-17T15:09:29.800875+0000","last_unstale":"2023-05-17T15:09:30.173775+0000","last_undegraded":"2023-05-17T15:09:30.173775+0000","last_fullsized":"2023-05-17T15:09:30.173775+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198397+0000","last_change":"2023-05-17T15:09:30.190406+0000","last_active":"2023-05-17T15:09:30.198397+0000","last_peered":"2023-05-17T15:09:30.198397+0000","last_clean":"2023-05-17T15:09:30.198397+0000","last_became_active":"2023-05-17T15:09:30.190120+0000","last_became_peered":"2023-05-17T15:09:30.190120+0000","last_unstale":"2023-05-17T15:09:30.198397+0000","last_undegraded":"2023-05-17T15:09:30.198397+0000","last_fullsized":"2023-05-17T15:09:30.198397+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174651+0000","last_change":"2023-05-17T15:09:29.795343+0000","last_active":"2023-05-17T15:09:30.174651+0000","last_peered":"2023-05-17T15:09:30.174651+0000","last_clean":"2023-05-17T15:09:30.174651+0000","last_became_active":"2023-05-17T15:09:29.795056+0000","last_became_peered":"2023-05-17T15:09:29.795056+0000","last_unstale":"2023-05-17T15:09:30.174651+0000","last_undegraded":"2023-05-17T15:09:30.174651+0000","last_fullsized":"2023-05-17T15:09:30.174651+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195504+0000","last_change":"2023-05-17T15:09:30.191243+0000","last_active":"2023-05-17T15:09:30.195504+0000","last_peered":"2023-05-17T15:09:30.195504+0000","last_clean":"2023-05-17T15:09:30.195504+0000","last_became_active":"2023-05-17T15:09:30.190954+0000","last_became_peered":"2023-05-17T15:09:30.190954+0000","last_unstale":"2023-05-17T15:09:30.195504+0000","last_undegraded":"2023-05-17T15:09:30.195504+0000","last_fullsized":"2023-05-17T15:09:30.195504+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.180257+0000","last_change":"2023-05-17T15:09:29.794534+0000","last_active":"2023-05-17T15:09:30.180257+0000","last_peered":"2023-05-17T15:09:30.180257+0000","last_clean":"2023-05-17T15:09:30.180257+0000","last_became_active":"2023-05-17T15:09:29.794179+0000","last_became_peered":"2023-05-17T15:09:29.794179+0000","last_unstale":"2023-05-17T15:09:30.180257+0000","last_undegraded":"2023-05-17T15:09:30.180257+0000","last_fullsized":"2023-05-17T15:09:30.180257+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200881+0000","last_change":"2023-05-17T15:09:30.193199+0000","last_active":"2023-05-17T15:09:30.200881+0000","last_peered":"2023-05-17T15:09:30.200881+0000","last_clean":"2023-05-17T15:09:30.200881+0000","last_became_active":"2023-05-17T15:09:30.192878+0000","last_became_peered":"2023-05-17T15:09:30.192878+0000","last_unstale":"2023-05-17T15:09:30.200881+0000","last_undegraded":"2023-05-17T15:09:30.200881+0000","last_fullsized":"2023-05-17T15:09:30.200881+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185262+0000","last_change":"2023-05-17T15:09:29.794583+0000","last_active":"2023-05-17T15:09:30.185262+0000","last_peered":"2023-05-17T15:09:30.185262+0000","last_clean":"2023-05-17T15:09:30.185262+0000","last_became_active":"2023-05-17T15:09:29.794323+0000","last_became_peered":"2023-05-17T15:09:29.794323+0000","last_unstale":"2023-05-17T15:09:30.185262+0000","last_undegraded":"2023-05-17T15:09:30.185262+0000","last_fullsized":"2023-05-17T15:09:30.185262+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192211+0000","last_change":"2023-05-17T15:09:30.188695+0000","last_active":"2023-05-17T15:09:30.192211+0000","last_peered":"2023-05-17T15:09:30.192211+0000","last_clean":"2023-05-17T15:09:30.192211+0000","last_became_active":"2023-05-17T15:09:30.188171+0000","last_became_peered":"2023-05-17T15:09:30.188171+0000","last_unstale":"2023-05-17T15:09:30.192211+0000","last_undegraded":"2023-05-17T15:09:30.192211+0000","last_fullsized":"2023-05-17T15:09:30.192211+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201011+0000","last_change":"2023-05-17T15:09:29.792312+0000","last_active":"2023-05-17T15:09:30.201011+0000","last_peered":"2023-05-17T15:09:30.201011+0000","last_clean":"2023-05-17T15:09:30.201011+0000","last_became_active":"2023-05-17T15:09:29.791909+0000","last_became_peered":"2023-05-17T15:09:29.791909+0000","last_unstale":"2023-05-17T15:09:30.201011+0000","last_undegraded":"2023-05-17T15:09:30.201011+0000","last_fullsized":"2023-05-17T15:09:30.201011+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199626+0000","last_change":"2023-05-17T15:09:30.196898+0000","last_active":"2023-05-17T15:09:30.199626+0000","last_peered":"2023-05-17T15:09:30.199626+0000","last_clean":"2023-05-17T15:09:30.199626+0000","last_became_active":"2023-05-17T15:09:30.196172+0000","last_became_peered":"2023-05-17T15:09:30.196172+0000","last_unstale":"2023-05-17T15:09:30.199626+0000","last_undegraded":"2023-05-17T15:09:30.199626+0000","last_fullsized":"2023-05-17T15:09:30.199626+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196078+0000","last_change":"2023-05-17T15:09:29.800468+0000","last_active":"2023-05-17T15:09:30.196078+0000","last_peered":"2023-05-17T15:09:30.196078+0000","last_clean":"2023-05-17T15:09:30.196078+0000","last_became_active":"2023-05-17T15:09:29.800132+0000","last_became_peered":"2023-05-17T15:09:29.800132+0000","last_unstale":"2023-05-17T15:09:30.196078+0000","last_undegraded":"2023-05-17T15:09:30.196078+0000","last_fullsized":"2023-05-17T15:09:30.196078+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201093+0000","last_change":"2023-05-17T15:09:30.196876+0000","last_active":"2023-05-17T15:09:30.201093+0000","last_peered":"2023-05-17T15:09:30.201093+0000","last_clean":"2023-05-17T15:09:30.201093+0000","last_became_active":"2023-05-17T15:09:30.196618+0000","last_became_peered":"2023-05-17T15:09:30.196618+0000","last_unstale":"2023-05-17T15:09:30.201093+0000","last_undegraded":"2023-05-17T15:09:30.201093+0000","last_fullsized":"2023-05-17T15:09:30.201093+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178333+0000","last_change":"2023-05-17T15:09:29.801862+0000","last_active":"2023-05-17T15:09:30.178333+0000","last_peered":"2023-05-17T15:09:30.178333+0000","last_clean":"2023-05-17T15:09:30.178333+0000","last_became_active":"2023-05-17T15:09:29.801533+0000","last_became_peered":"2023-05-17T15:09:29.801533+0000","last_unstale":"2023-05-17T15:09:30.178333+0000","last_undegraded":"2023-05-17T15:09:30.178333+0000","last_fullsized":"2023-05-17T15:09:30.178333+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196258+0000","last_change":"2023-05-17T15:09:30.194643+0000","last_active":"2023-05-17T15:09:30.196258+0000","last_peered":"2023-05-17T15:09:30.196258+0000","last_clean":"2023-05-17T15:09:30.196258+0000","last_became_active":"2023-05-17T15:09:30.194215+0000","last_became_peered":"2023-05-17T15:09:30.194215+0000","last_unstale":"2023-05-17T15:09:30.196258+0000","last_undegraded":"2023-05-17T15:09:30.196258+0000","last_fullsized":"2023-05-17T15:09:30.196258+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178392+0000","last_change":"2023-05-17T15:09:29.794106+0000","last_active":"2023-05-17T15:09:30.178392+0000","last_peered":"2023-05-17T15:09:30.178392+0000","last_clean":"2023-05-17T15:09:30.178392+0000","last_became_active":"2023-05-17T15:09:29.793843+0000","last_became_peered":"2023-05-17T15:09:29.793843+0000","last_unstale":"2023-05-17T15:09:30.178392+0000","last_undegraded":"2023-05-17T15:09:30.178392+0000","last_fullsized":"2023-05-17T15:09:30.178392+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200684+0000","last_change":"2023-05-17T15:09:30.194883+0000","last_active":"2023-05-17T15:09:30.200684+0000","last_peered":"2023-05-17T15:09:30.200684+0000","last_clean":"2023-05-17T15:09:30.200684+0000","last_became_active":"2023-05-17T15:09:30.194599+0000","last_became_peered":"2023-05-17T15:09:30.194599+0000","last_unstale":"2023-05-17T15:09:30.200684+0000","last_undegraded":"2023-05-17T15:09:30.200684+0000","last_fullsized":"2023-05-17T15:09:30.200684+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198644+0000","last_change":"2023-05-17T15:09:29.792948+0000","last_active":"2023-05-17T15:09:30.198644+0000","last_peered":"2023-05-17T15:09:30.198644+0000","last_clean":"2023-05-17T15:09:30.198644+0000","last_became_active":"2023-05-17T15:09:29.791544+0000","last_became_peered":"2023-05-17T15:09:29.791544+0000","last_unstale":"2023-05-17T15:09:30.198644+0000","last_undegraded":"2023-05-17T15:09:30.198644+0000","last_fullsized":"2023-05-17T15:09:30.198644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200771+0000","last_change":"2023-05-17T15:09:30.195461+0000","last_active":"2023-05-17T15:09:30.200771+0000","last_peered":"2023-05-17T15:09:30.200771+0000","last_clean":"2023-05-17T15:09:30.200771+0000","last_became_active":"2023-05-17T15:09:30.195198+0000","last_became_peered":"2023-05-17T15:09:30.195198+0000","last_unstale":"2023-05-17T15:09:30.200771+0000","last_undegraded":"2023-05-17T15:09:30.200771+0000","last_fullsized":"2023-05-17T15:09:30.200771+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178248+0000","last_change":"2023-05-17T15:09:29.798784+0000","last_active":"2023-05-17T15:09:30.178248+0000","last_peered":"2023-05-17T15:09:30.178248+0000","last_clean":"2023-05-17T15:09:30.178248+0000","last_became_active":"2023-05-17T15:09:29.798245+0000","last_became_peered":"2023-05-17T15:09:29.798245+0000","last_unstale":"2023-05-17T15:09:30.178248+0000","last_undegraded":"2023-05-17T15:09:30.178248+0000","last_fullsized":"2023-05-17T15:09:30.178248+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197520+0000","last_change":"2023-05-17T15:09:30.195057+0000","last_active":"2023-05-17T15:09:30.197520+0000","last_peered":"2023-05-17T15:09:30.197520+0000","last_clean":"2023-05-17T15:09:30.197520+0000","last_became_active":"2023-05-17T15:09:30.194706+0000","last_became_peered":"2023-05-17T15:09:30.194706+0000","last_unstale":"2023-05-17T15:09:30.197520+0000","last_undegraded":"2023-05-17T15:09:30.197520+0000","last_fullsized":"2023-05-17T15:09:30.197520+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177283+0000","last_change":"2023-05-17T15:09:29.804300+0000","last_active":"2023-05-17T15:09:30.177283+0000","last_peered":"2023-05-17T15:09:30.177283+0000","last_clean":"2023-05-17T15:09:30.177283+0000","last_became_active":"2023-05-17T15:09:29.804013+0000","last_became_peered":"2023-05-17T15:09:29.804013+0000","last_unstale":"2023-05-17T15:09:30.177283+0000","last_undegraded":"2023-05-17T15:09:30.177283+0000","last_fullsized":"2023-05-17T15:09:30.177283+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192408+0000","last_change":"2023-05-17T15:09:30.185432+0000","last_active":"2023-05-17T15:09:30.192408+0000","last_peered":"2023-05-17T15:09:30.192408+0000","last_clean":"2023-05-17T15:09:30.192408+0000","last_became_active":"2023-05-17T15:09:30.185151+0000","last_became_peered":"2023-05-17T15:09:30.185151+0000","last_unstale":"2023-05-17T15:09:30.192408+0000","last_undegraded":"2023-05-17T15:09:30.192408+0000","last_fullsized":"2023-05-17T15:09:30.192408+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196720+0000","last_change":"2023-05-17T15:09:29.794244+0000","last_active":"2023-05-17T15:09:30.196720+0000","last_peered":"2023-05-17T15:09:30.196720+0000","last_clean":"2023-05-17T15:09:30.196720+0000","last_became_active":"2023-05-17T15:09:29.793952+0000","last_became_peered":"2023-05-17T15:09:29.793952+0000","last_unstale":"2023-05-17T15:09:30.196720+0000","last_undegraded":"2023-05-17T15:09:30.196720+0000","last_fullsized":"2023-05-17T15:09:30.196720+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196016+0000","last_change":"2023-05-17T15:09:30.190605+0000","last_active":"2023-05-17T15:09:30.196016+0000","last_peered":"2023-05-17T15:09:30.196016+0000","last_clean":"2023-05-17T15:09:30.196016+0000","last_became_active":"2023-05-17T15:09:30.190056+0000","last_became_peered":"2023-05-17T15:09:30.190056+0000","last_unstale":"2023-05-17T15:09:30.196016+0000","last_undegraded":"2023-05-17T15:09:30.196016+0000","last_fullsized":"2023-05-17T15:09:30.196016+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177537+0000","last_change":"2023-05-17T15:09:29.800094+0000","last_active":"2023-05-17T15:09:30.177537+0000","last_peered":"2023-05-17T15:09:30.177537+0000","last_clean":"2023-05-17T15:09:30.177537+0000","last_became_active":"2023-05-17T15:09:29.799762+0000","last_became_peered":"2023-05-17T15:09:29.799762+0000","last_unstale":"2023-05-17T15:09:30.177537+0000","last_undegraded":"2023-05-17T15:09:30.177537+0000","last_fullsized":"2023-05-17T15:09:30.177537+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199835+0000","last_change":"2023-05-17T15:09:30.194120+0000","last_active":"2023-05-17T15:09:30.199835+0000","last_peered":"2023-05-17T15:09:30.199835+0000","last_clean":"2023-05-17T15:09:30.199835+0000","last_became_active":"2023-05-17T15:09:30.193811+0000","last_became_peered":"2023-05-17T15:09:30.193811+0000","last_unstale":"2023-05-17T15:09:30.199835+0000","last_undegraded":"2023-05-17T15:09:30.199835+0000","last_fullsized":"2023-05-17T15:09:30.199835+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.186331+0000","last_change":"2023-05-17T15:09:29.801096+0000","last_active":"2023-05-17T15:09:30.186331+0000","last_peered":"2023-05-17T15:09:30.186331+0000","last_clean":"2023-05-17T15:09:30.186331+0000","last_became_active":"2023-05-17T15:09:29.800814+0000","last_became_peered":"2023-05-17T15:09:29.800814+0000","last_unstale":"2023-05-17T15:09:30.186331+0000","last_undegraded":"2023-05-17T15:09:30.186331+0000","last_fullsized":"2023-05-17T15:09:30.186331+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198051+0000","last_change":"2023-05-17T15:09:30.196898+0000","last_active":"2023-05-17T15:09:30.198051+0000","last_peered":"2023-05-17T15:09:30.198051+0000","last_clean":"2023-05-17T15:09:30.198051+0000","last_became_active":"2023-05-17T15:09:30.196572+0000","last_became_peered":"2023-05-17T15:09:30.196572+0000","last_unstale":"2023-05-17T15:09:30.198051+0000","last_undegraded":"2023-05-17T15:09:30.198051+0000","last_fullsized":"2023-05-17T15:09:30.198051+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185256+0000","last_change":"2023-05-17T15:09:29.795163+0000","last_active":"2023-05-17T15:09:30.185256+0000","last_peered":"2023-05-17T15:09:30.185256+0000","last_clean":"2023-05-17T15:09:30.185256+0000","last_became_active":"2023-05-17T15:09:29.794893+0000","last_became_peered":"2023-05-17T15:09:29.794893+0000","last_unstale":"2023-05-17T15:09:30.185256+0000","last_undegraded":"2023-05-17T15:09:30.185256+0000","last_fullsized":"2023-05-17T15:09:30.185256+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.202277+0000","last_change":"2023-05-17T15:09:30.200912+0000","last_active":"2023-05-17T15:09:30.202277+0000","last_peered":"2023-05-17T15:09:30.202277+0000","last_clean":"2023-05-17T15:09:30.202277+0000","last_became_active":"2023-05-17T15:09:30.200616+0000","last_became_peered":"2023-05-17T15:09:30.200616+0000","last_unstale":"2023-05-17T15:09:30.202277+0000","last_undegraded":"2023-05-17T15:09:30.202277+0000","last_fullsized":"2023-05-17T15:09:30.202277+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.181163+0000","last_change":"2023-05-17T15:09:29.794669+0000","last_active":"2023-05-17T15:09:30.181163+0000","last_peered":"2023-05-17T15:09:30.181163+0000","last_clean":"2023-05-17T15:09:30.181163+0000","last_became_active":"2023-05-17T15:09:29.792475+0000","last_became_peered":"2023-05-17T15:09:29.792475+0000","last_unstale":"2023-05-17T15:09:30.181163+0000","last_undegraded":"2023-05-17T15:09:30.181163+0000","last_fullsized":"2023-05-17T15:09:30.181163+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.186594+0000","last_change":"2023-05-17T15:09:30.179938+0000","last_active":"2023-05-17T15:09:30.186594+0000","last_peered":"2023-05-17T15:09:30.186594+0000","last_clean":"2023-05-17T15:09:30.186594+0000","last_became_active":"2023-05-17T15:09:30.179579+0000","last_became_peered":"2023-05-17T15:09:30.179579+0000","last_unstale":"2023-05-17T15:09:30.186594+0000","last_undegraded":"2023-05-17T15:09:30.186594+0000","last_fullsized":"2023-05-17T15:09:30.186594+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.179339+0000","last_change":"2023-05-17T15:09:29.801542+0000","last_active":"2023-05-17T15:09:30.179339+0000","last_peered":"2023-05-17T15:09:30.179339+0000","last_clean":"2023-05-17T15:09:30.179339+0000","last_became_active":"2023-05-17T15:09:29.801262+0000","last_became_peered":"2023-05-17T15:09:29.801262+0000","last_unstale":"2023-05-17T15:09:30.179339+0000","last_undegraded":"2023-05-17T15:09:30.179339+0000","last_fullsized":"2023-05-17T15:09:30.179339+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199447+0000","last_change":"2023-05-17T15:09:30.192621+0000","last_active":"2023-05-17T15:09:30.199447+0000","last_peered":"2023-05-17T15:09:30.199447+0000","last_clean":"2023-05-17T15:09:30.199447+0000","last_became_active":"2023-05-17T15:09:30.192379+0000","last_became_peered":"2023-05-17T15:09:30.192379+0000","last_unstale":"2023-05-17T15:09:30.199447+0000","last_undegraded":"2023-05-17T15:09:30.199447+0000","last_fullsized":"2023-05-17T15:09:30.199447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188530+0000","last_change":"2023-05-17T15:09:29.801179+0000","last_active":"2023-05-17T15:09:30.188530+0000","last_peered":"2023-05-17T15:09:30.188530+0000","last_clean":"2023-05-17T15:09:30.188530+0000","last_became_active":"2023-05-17T15:09:29.800908+0000","last_became_peered":"2023-05-17T15:09:29.800908+0000","last_unstale":"2023-05-17T15:09:30.188530+0000","last_undegraded":"2023-05-17T15:09:30.188530+0000","last_fullsized":"2023-05-17T15:09:30.188530+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201305+0000","last_change":"2023-05-17T15:09:30.197679+0000","last_active":"2023-05-17T15:09:30.201305+0000","last_peered":"2023-05-17T15:09:30.201305+0000","last_clean":"2023-05-17T15:09:30.201305+0000","last_became_active":"2023-05-17T15:09:30.197398+0000","last_became_peered":"2023-05-17T15:09:30.197398+0000","last_unstale":"2023-05-17T15:09:30.201305+0000","last_undegraded":"2023-05-17T15:09:30.201305+0000","last_fullsized":"2023-05-17T15:09:30.201305+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173176+0000","last_change":"2023-05-17T15:09:29.801319+0000","last_active":"2023-05-17T15:09:30.173176+0000","last_peered":"2023-05-17T15:09:30.173176+0000","last_clean":"2023-05-17T15:09:30.173176+0000","last_became_active":"2023-05-17T15:09:29.800978+0000","last_became_peered":"2023-05-17T15:09:29.800978+0000","last_unstale":"2023-05-17T15:09:30.173176+0000","last_undegraded":"2023-05-17T15:09:30.173176+0000","last_fullsized":"2023-05-17T15:09:30.173176+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195475+0000","last_change":"2023-05-17T15:09:30.193675+0000","last_active":"2023-05-17T15:09:30.195475+0000","last_peered":"2023-05-17T15:09:30.195475+0000","last_clean":"2023-05-17T15:09:30.195475+0000","last_became_active":"2023-05-17T15:09:30.193391+0000","last_became_peered":"2023-05-17T15:09:30.193391+0000","last_unstale":"2023-05-17T15:09:30.195475+0000","last_undegraded":"2023-05-17T15:09:30.195475+0000","last_fullsized":"2023-05-17T15:09:30.195475+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178611+0000","last_change":"2023-05-17T15:09:29.799398+0000","last_active":"2023-05-17T15:09:30.178611+0000","last_peered":"2023-05-17T15:09:30.178611+0000","last_clean":"2023-05-17T15:09:30.178611+0000","last_became_active":"2023-05-17T15:09:29.799105+0000","last_became_peered":"2023-05-17T15:09:29.799105+0000","last_unstale":"2023-05-17T15:09:30.178611+0000","last_undegraded":"2023-05-17T15:09:30.178611+0000","last_fullsized":"2023-05-17T15:09:30.178611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193075+0000","last_change":"2023-05-17T15:09:30.190060+0000","last_active":"2023-05-17T15:09:30.193075+0000","last_peered":"2023-05-17T15:09:30.193075+0000","last_clean":"2023-05-17T15:09:30.193075+0000","last_became_active":"2023-05-17T15:09:30.189389+0000","last_became_peered":"2023-05-17T15:09:30.189389+0000","last_unstale":"2023-05-17T15:09:30.193075+0000","last_undegraded":"2023-05-17T15:09:30.193075+0000","last_fullsized":"2023-05-17T15:09:30.193075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.180391+0000","last_change":"2023-05-17T15:09:29.800312+0000","last_active":"2023-05-17T15:09:30.180391+0000","last_peered":"2023-05-17T15:09:30.180391+0000","last_clean":"2023-05-17T15:09:30.180391+0000","last_became_active":"2023-05-17T15:09:29.799484+0000","last_became_peered":"2023-05-17T15:09:29.799484+0000","last_unstale":"2023-05-17T15:09:30.180391+0000","last_undegraded":"2023-05-17T15:09:30.180391+0000","last_fullsized":"2023-05-17T15:09:30.180391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198700+0000","last_change":"2023-05-17T15:09:30.196201+0000","last_active":"2023-05-17T15:09:30.198700+0000","last_peered":"2023-05-17T15:09:30.198700+0000","last_clean":"2023-05-17T15:09:30.198700+0000","last_became_active":"2023-05-17T15:09:30.195770+0000","last_became_peered":"2023-05-17T15:09:30.195770+0000","last_unstale":"2023-05-17T15:09:30.198700+0000","last_undegraded":"2023-05-17T15:09:30.198700+0000","last_fullsized":"2023-05-17T15:09:30.198700+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185316+0000","last_change":"2023-05-17T15:09:29.794551+0000","last_active":"2023-05-17T15:09:30.185316+0000","last_peered":"2023-05-17T15:09:30.185316+0000","last_clean":"2023-05-17T15:09:30.185316+0000","last_became_active":"2023-05-17T15:09:29.794289+0000","last_became_peered":"2023-05-17T15:09:29.794289+0000","last_unstale":"2023-05-17T15:09:30.185316+0000","last_undegraded":"2023-05-17T15:09:30.185316+0000","last_fullsized":"2023-05-17T15:09:30.185316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185444+0000","last_change":"2023-05-17T15:09:30.183309+0000","last_active":"2023-05-17T15:09:30.185444+0000","last_peered":"2023-05-17T15:09:30.185444+0000","last_clean":"2023-05-17T15:09:30.185444+0000","last_became_active":"2023-05-17T15:09:30.182977+0000","last_became_peered":"2023-05-17T15:09:30.182977+0000","last_unstale":"2023-05-17T15:09:30.185444+0000","last_undegraded":"2023-05-17T15:09:30.185444+0000","last_fullsized":"2023-05-17T15:09:30.185444+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185312+0000","last_change":"2023-05-17T15:09:29.806084+0000","last_active":"2023-05-17T15:09:30.185312+0000","last_peered":"2023-05-17T15:09:30.185312+0000","last_clean":"2023-05-17T15:09:30.185312+0000","last_became_active":"2023-05-17T15:09:29.805583+0000","last_became_peered":"2023-05-17T15:09:29.805583+0000","last_unstale":"2023-05-17T15:09:30.185312+0000","last_undegraded":"2023-05-17T15:09:30.185312+0000","last_fullsized":"2023-05-17T15:09:30.185312+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192601+0000","last_change":"2023-05-17T15:09:30.188888+0000","last_active":"2023-05-17T15:09:30.192601+0000","last_peered":"2023-05-17T15:09:30.192601+0000","last_clean":"2023-05-17T15:09:30.192601+0000","last_became_active":"2023-05-17T15:09:30.187192+0000","last_became_peered":"2023-05-17T15:09:30.187192+0000","last_unstale":"2023-05-17T15:09:30.192601+0000","last_undegraded":"2023-05-17T15:09:30.192601+0000","last_fullsized":"2023-05-17T15:09:30.192601+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177657+0000","last_change":"2023-05-17T15:09:29.796753+0000","last_active":"2023-05-17T15:09:30.177657+0000","last_peered":"2023-05-17T15:09:30.177657+0000","last_clean":"2023-05-17T15:09:30.177657+0000","last_became_active":"2023-05-17T15:09:29.796169+0000","last_became_peered":"2023-05-17T15:09:29.796169+0000","last_unstale":"2023-05-17T15:09:30.177657+0000","last_undegraded":"2023-05-17T15:09:30.177657+0000","last_fullsized":"2023-05-17T15:09:30.177657+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192790+0000","last_change":"2023-05-17T15:09:30.186012+0000","last_active":"2023-05-17T15:09:30.192790+0000","last_peered":"2023-05-17T15:09:30.192790+0000","last_clean":"2023-05-17T15:09:30.192790+0000","last_became_active":"2023-05-17T15:09:30.185679+0000","last_became_peered":"2023-05-17T15:09:30.185679+0000","last_unstale":"2023-05-17T15:09:30.192790+0000","last_undegraded":"2023-05-17T15:09:30.192790+0000","last_fullsized":"2023-05-17T15:09:30.192790+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178484+0000","last_change":"2023-05-17T15:09:29.798167+0000","last_active":"2023-05-17T15:09:30.178484+0000","last_peered":"2023-05-17T15:09:30.178484+0000","last_clean":"2023-05-17T15:09:30.178484+0000","last_became_active":"2023-05-17T15:09:29.797848+0000","last_became_peered":"2023-05-17T15:09:29.797848+0000","last_unstale":"2023-05-17T15:09:30.178484+0000","last_undegraded":"2023-05-17T15:09:30.178484+0000","last_fullsized":"2023-05-17T15:09:30.178484+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194830+0000","last_change":"2023-05-17T15:09:30.191146+0000","last_active":"2023-05-17T15:09:30.194830+0000","last_peered":"2023-05-17T15:09:30.194830+0000","last_clean":"2023-05-17T15:09:30.194830+0000","last_became_active":"2023-05-17T15:09:30.190874+0000","last_became_peered":"2023-05-17T15:09:30.190874+0000","last_unstale":"2023-05-17T15:09:30.194830+0000","last_undegraded":"2023-05-17T15:09:30.194830+0000","last_fullsized":"2023-05-17T15:09:30.194830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195865+0000","last_change":"2023-05-17T15:09:29.795247+0000","last_active":"2023-05-17T15:09:30.195865+0000","last_peered":"2023-05-17T15:09:30.195865+0000","last_clean":"2023-05-17T15:09:30.195865+0000","last_became_active":"2023-05-17T15:09:29.794553+0000","last_became_peered":"2023-05-17T15:09:29.794553+0000","last_unstale":"2023-05-17T15:09:30.195865+0000","last_undegraded":"2023-05-17T15:09:30.195865+0000","last_fullsized":"2023-05-17T15:09:30.195865+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188694+0000","last_change":"2023-05-17T15:09:30.186855+0000","last_active":"2023-05-17T15:09:30.188694+0000","last_peered":"2023-05-17T15:09:30.188694+0000","last_clean":"2023-05-17T15:09:30.188694+0000","last_became_active":"2023-05-17T15:09:30.186533+0000","last_became_peered":"2023-05-17T15:09:30.186533+0000","last_unstale":"2023-05-17T15:09:30.188694+0000","last_undegraded":"2023-05-17T15:09:30.188694+0000","last_fullsized":"2023-05-17T15:09:30.188694+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188621+0000","last_change":"2023-05-17T15:09:29.792747+0000","last_active":"2023-05-17T15:09:30.188621+0000","last_peered":"2023-05-17T15:09:30.188621+0000","last_clean":"2023-05-17T15:09:30.188621+0000","last_became_active":"2023-05-17T15:09:29.792459+0000","last_became_peered":"2023-05-17T15:09:29.792459+0000","last_unstale":"2023-05-17T15:09:30.188621+0000","last_undegraded":"2023-05-17T15:09:30.188621+0000","last_fullsized":"2023-05-17T15:09:30.188621+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192742+0000","last_change":"2023-05-17T15:09:30.183767+0000","last_active":"2023-05-17T15:09:30.192742+0000","last_peered":"2023-05-17T15:09:30.192742+0000","last_clean":"2023-05-17T15:09:30.192742+0000","last_became_active":"2023-05-17T15:09:30.183488+0000","last_became_peered":"2023-05-17T15:09:30.183488+0000","last_unstale":"2023-05-17T15:09:30.192742+0000","last_undegraded":"2023-05-17T15:09:30.192742+0000","last_fullsized":"2023-05-17T15:09:30.192742+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.190362+0000","last_change":"2023-05-17T15:09:29.797826+0000","last_active":"2023-05-17T15:09:30.190362+0000","last_peered":"2023-05-17T15:09:30.190362+0000","last_clean":"2023-05-17T15:09:30.190362+0000","last_became_active":"2023-05-17T15:09:29.797300+0000","last_became_peered":"2023-05-17T15:09:29.797300+0000","last_unstale":"2023-05-17T15:09:30.190362+0000","last_undegraded":"2023-05-17T15:09:30.190362+0000","last_fullsized":"2023-05-17T15:09:30.190362+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.199936+0000","last_change":"2023-05-17T15:09:30.197347+0000","last_active":"2023-05-17T15:09:30.199936+0000","last_peered":"2023-05-17T15:09:30.199936+0000","last_clean":"2023-05-17T15:09:30.199936+0000","last_became_active":"2023-05-17T15:09:30.197005+0000","last_became_peered":"2023-05-17T15:09:30.197005+0000","last_unstale":"2023-05-17T15:09:30.199936+0000","last_undegraded":"2023-05-17T15:09:30.199936+0000","last_fullsized":"2023-05-17T15:09:30.199936+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178039+0000","last_change":"2023-05-17T15:09:29.803762+0000","last_active":"2023-05-17T15:09:30.178039+0000","last_peered":"2023-05-17T15:09:30.178039+0000","last_clean":"2023-05-17T15:09:30.178039+0000","last_became_active":"2023-05-17T15:09:29.803327+0000","last_became_peered":"2023-05-17T15:09:29.803327+0000","last_unstale":"2023-05-17T15:09:30.178039+0000","last_undegraded":"2023-05-17T15:09:30.178039+0000","last_fullsized":"2023-05-17T15:09:30.178039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200826+0000","last_change":"2023-05-17T15:09:30.195859+0000","last_active":"2023-05-17T15:09:30.200826+0000","last_peered":"2023-05-17T15:09:30.200826+0000","last_clean":"2023-05-17T15:09:30.200826+0000","last_became_active":"2023-05-17T15:09:30.195549+0000","last_became_peered":"2023-05-17T15:09:30.195549+0000","last_unstale":"2023-05-17T15:09:30.200826+0000","last_undegraded":"2023-05-17T15:09:30.200826+0000","last_fullsized":"2023-05-17T15:09:30.200826+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177038+0000","last_change":"2023-05-17T15:09:29.805564+0000","last_active":"2023-05-17T15:09:30.177038+0000","last_peered":"2023-05-17T15:09:30.177038+0000","last_clean":"2023-05-17T15:09:30.177038+0000","last_became_active":"2023-05-17T15:09:29.805171+0000","last_became_peered":"2023-05-17T15:09:29.805171+0000","last_unstale":"2023-05-17T15:09:30.177038+0000","last_undegraded":"2023-05-17T15:09:30.177038+0000","last_fullsized":"2023-05-17T15:09:30.177038+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197292+0000","last_change":"2023-05-17T15:09:30.189187+0000","last_active":"2023-05-17T15:09:30.197292+0000","last_peered":"2023-05-17T15:09:30.197292+0000","last_clean":"2023-05-17T15:09:30.197292+0000","last_became_active":"2023-05-17T15:09:30.188685+0000","last_became_peered":"2023-05-17T15:09:30.188685+0000","last_unstale":"2023-05-17T15:09:30.197292+0000","last_undegraded":"2023-05-17T15:09:30.197292+0000","last_fullsized":"2023-05-17T15:09:30.197292+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185414+0000","last_change":"2023-05-17T15:09:29.805864+0000","last_active":"2023-05-17T15:09:30.185414+0000","last_peered":"2023-05-17T15:09:30.185414+0000","last_clean":"2023-05-17T15:09:30.185414+0000","last_became_active":"2023-05-17T15:09:29.805216+0000","last_became_peered":"2023-05-17T15:09:29.805216+0000","last_unstale":"2023-05-17T15:09:30.185414+0000","last_undegraded":"2023-05-17T15:09:30.185414+0000","last_fullsized":"2023-05-17T15:09:30.185414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198957+0000","last_change":"2023-05-17T15:09:30.196273+0000","last_active":"2023-05-17T15:09:30.198957+0000","last_peered":"2023-05-17T15:09:30.198957+0000","last_clean":"2023-05-17T15:09:30.198957+0000","last_became_active":"2023-05-17T15:09:30.195171+0000","last_became_peered":"2023-05-17T15:09:30.195171+0000","last_unstale":"2023-05-17T15:09:30.198957+0000","last_undegraded":"2023-05-17T15:09:30.198957+0000","last_fullsized":"2023-05-17T15:09:30.198957+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178444+0000","last_change":"2023-05-17T15:09:29.793293+0000","last_active":"2023-05-17T15:09:30.178444+0000","last_peered":"2023-05-17T15:09:30.178444+0000","last_clean":"2023-05-17T15:09:30.178444+0000","last_became_active":"2023-05-17T15:09:29.792947+0000","last_became_peered":"2023-05-17T15:09:29.792947+0000","last_unstale":"2023-05-17T15:09:30.178444+0000","last_undegraded":"2023-05-17T15:09:30.178444+0000","last_fullsized":"2023-05-17T15:09:30.178444+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201180+0000","last_change":"2023-05-17T15:09:30.198189+0000","last_active":"2023-05-17T15:09:30.201180+0000","last_peered":"2023-05-17T15:09:30.201180+0000","last_clean":"2023-05-17T15:09:30.201180+0000","last_became_active":"2023-05-17T15:09:30.197894+0000","last_became_peered":"2023-05-17T15:09:30.197894+0000","last_unstale":"2023-05-17T15:09:30.201180+0000","last_undegraded":"2023-05-17T15:09:30.201180+0000","last_fullsized":"2023-05-17T15:09:30.201180+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171619+0000","last_change":"2023-05-17T15:09:29.797128+0000","last_active":"2023-05-17T15:09:30.171619+0000","last_peered":"2023-05-17T15:09:30.171619+0000","last_clean":"2023-05-17T15:09:30.171619+0000","last_became_active":"2023-05-17T15:09:29.796798+0000","last_became_peered":"2023-05-17T15:09:29.796798+0000","last_unstale":"2023-05-17T15:09:30.171619+0000","last_undegraded":"2023-05-17T15:09:30.171619+0000","last_fullsized":"2023-05-17T15:09:30.171619+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194931+0000","last_change":"2023-05-17T15:09:30.191085+0000","last_active":"2023-05-17T15:09:30.194931+0000","last_peered":"2023-05-17T15:09:30.194931+0000","last_clean":"2023-05-17T15:09:30.194931+0000","last_became_active":"2023-05-17T15:09:30.190666+0000","last_became_peered":"2023-05-17T15:09:30.190666+0000","last_unstale":"2023-05-17T15:09:30.194931+0000","last_undegraded":"2023-05-17T15:09:30.194931+0000","last_fullsized":"2023-05-17T15:09:30.194931+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174760+0000","last_change":"2023-05-17T15:09:29.797829+0000","last_active":"2023-05-17T15:09:30.174760+0000","last_peered":"2023-05-17T15:09:30.174760+0000","last_clean":"2023-05-17T15:09:30.174760+0000","last_became_active":"2023-05-17T15:09:29.797541+0000","last_became_peered":"2023-05-17T15:09:29.797541+0000","last_unstale":"2023-05-17T15:09:30.174760+0000","last_undegraded":"2023-05-17T15:09:30.174760+0000","last_fullsized":"2023-05-17T15:09:30.174760+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194093+0000","last_change":"2023-05-17T15:09:30.191323+0000","last_active":"2023-05-17T15:09:30.194093+0000","last_peered":"2023-05-17T15:09:30.194093+0000","last_clean":"2023-05-17T15:09:30.194093+0000","last_became_active":"2023-05-17T15:09:30.191038+0000","last_became_peered":"2023-05-17T15:09:30.191038+0000","last_unstale":"2023-05-17T15:09:30.194093+0000","last_undegraded":"2023-05-17T15:09:30.194093+0000","last_fullsized":"2023-05-17T15:09:30.194093+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177718+0000","last_change":"2023-05-17T15:09:29.801178+0000","last_active":"2023-05-17T15:09:30.177718+0000","last_peered":"2023-05-17T15:09:30.177718+0000","last_clean":"2023-05-17T15:09:30.177718+0000","last_became_active":"2023-05-17T15:09:29.800901+0000","last_became_peered":"2023-05-17T15:09:29.800901+0000","last_unstale":"2023-05-17T15:09:30.177718+0000","last_undegraded":"2023-05-17T15:09:30.177718+0000","last_fullsized":"2023-05-17T15:09:30.177718+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192429+0000","last_change":"2023-05-17T15:09:30.187155+0000","last_active":"2023-05-17T15:09:30.192429+0000","last_peered":"2023-05-17T15:09:30.192429+0000","last_clean":"2023-05-17T15:09:30.192429+0000","last_became_active":"2023-05-17T15:09:30.186883+0000","last_became_peered":"2023-05-17T15:09:30.186883+0000","last_unstale":"2023-05-17T15:09:30.192429+0000","last_undegraded":"2023-05-17T15:09:30.192429+0000","last_fullsized":"2023-05-17T15:09:30.192429+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198700+0000","last_change":"2023-05-17T15:09:29.799623+0000","last_active":"2023-05-17T15:09:30.198700+0000","last_peered":"2023-05-17T15:09:30.198700+0000","last_clean":"2023-05-17T15:09:30.198700+0000","last_became_active":"2023-05-17T15:09:29.799274+0000","last_became_peered":"2023-05-17T15:09:29.799274+0000","last_unstale":"2023-05-17T15:09:30.198700+0000","last_undegraded":"2023-05-17T15:09:30.198700+0000","last_fullsized":"2023-05-17T15:09:30.198700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193499+0000","last_change":"2023-05-17T15:09:30.188661+0000","last_active":"2023-05-17T15:09:30.193499+0000","last_peered":"2023-05-17T15:09:30.193499+0000","last_clean":"2023-05-17T15:09:30.193499+0000","last_became_active":"2023-05-17T15:09:30.188334+0000","last_became_peered":"2023-05-17T15:09:30.188334+0000","last_unstale":"2023-05-17T15:09:30.193499+0000","last_undegraded":"2023-05-17T15:09:30.193499+0000","last_fullsized":"2023-05-17T15:09:30.193499+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198742+0000","last_change":"2023-05-17T15:09:29.795770+0000","last_active":"2023-05-17T15:09:30.198742+0000","last_peered":"2023-05-17T15:09:30.198742+0000","last_clean":"2023-05-17T15:09:30.198742+0000","last_became_active":"2023-05-17T15:09:29.795487+0000","last_became_peered":"2023-05-17T15:09:29.795487+0000","last_unstale":"2023-05-17T15:09:30.198742+0000","last_undegraded":"2023-05-17T15:09:30.198742+0000","last_fullsized":"2023-05-17T15:09:30.198742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200661+0000","last_change":"2023-05-17T15:09:30.194960+0000","last_active":"2023-05-17T15:09:30.200661+0000","last_peered":"2023-05-17T15:09:30.200661+0000","last_clean":"2023-05-17T15:09:30.200661+0000","last_became_active":"2023-05-17T15:09:30.194578+0000","last_became_peered":"2023-05-17T15:09:30.194578+0000","last_unstale":"2023-05-17T15:09:30.200661+0000","last_undegraded":"2023-05-17T15:09:30.200661+0000","last_fullsized":"2023-05-17T15:09:30.200661+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188816+0000","last_change":"2023-05-17T15:09:29.793843+0000","last_active":"2023-05-17T15:09:30.188816+0000","last_peered":"2023-05-17T15:09:30.188816+0000","last_clean":"2023-05-17T15:09:30.188816+0000","last_became_active":"2023-05-17T15:09:29.793564+0000","last_became_peered":"2023-05-17T15:09:29.793564+0000","last_unstale":"2023-05-17T15:09:30.188816+0000","last_undegraded":"2023-05-17T15:09:30.188816+0000","last_fullsized":"2023-05-17T15:09:30.188816+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.190965+0000","last_change":"2023-05-17T15:09:30.186732+0000","last_active":"2023-05-17T15:09:30.190965+0000","last_peered":"2023-05-17T15:09:30.190965+0000","last_clean":"2023-05-17T15:09:30.190965+0000","last_became_active":"2023-05-17T15:09:30.186381+0000","last_became_peered":"2023-05-17T15:09:30.186381+0000","last_unstale":"2023-05-17T15:09:30.190965+0000","last_undegraded":"2023-05-17T15:09:30.190965+0000","last_fullsized":"2023-05-17T15:09:30.190965+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.175605+0000","last_change":"2023-05-17T15:09:29.799398+0000","last_active":"2023-05-17T15:09:30.175605+0000","last_peered":"2023-05-17T15:09:30.175605+0000","last_clean":"2023-05-17T15:09:30.175605+0000","last_became_active":"2023-05-17T15:09:29.799127+0000","last_became_peered":"2023-05-17T15:09:29.799127+0000","last_unstale":"2023-05-17T15:09:30.175605+0000","last_undegraded":"2023-05-17T15:09:30.175605+0000","last_fullsized":"2023-05-17T15:09:30.175605+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.200967+0000","last_change":"2023-05-17T15:09:30.193512+0000","last_active":"2023-05-17T15:09:30.200967+0000","last_peered":"2023-05-17T15:09:30.200967+0000","last_clean":"2023-05-17T15:09:30.200967+0000","last_became_active":"2023-05-17T15:09:30.192934+0000","last_became_peered":"2023-05-17T15:09:30.192934+0000","last_unstale":"2023-05-17T15:09:30.200967+0000","last_undegraded":"2023-05-17T15:09:30.200967+0000","last_fullsized":"2023-05-17T15:09:30.200967+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188460+0000","last_change":"2023-05-17T15:09:29.795949+0000","last_active":"2023-05-17T15:09:30.188460+0000","last_peered":"2023-05-17T15:09:30.188460+0000","last_clean":"2023-05-17T15:09:30.188460+0000","last_became_active":"2023-05-17T15:09:29.795671+0000","last_became_peered":"2023-05-17T15:09:29.795671+0000","last_unstale":"2023-05-17T15:09:30.188460+0000","last_undegraded":"2023-05-17T15:09:30.188460+0000","last_fullsized":"2023-05-17T15:09:30.188460+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.189406+0000","last_change":"2023-05-17T15:09:30.187976+0000","last_active":"2023-05-17T15:09:30.189406+0000","last_peered":"2023-05-17T15:09:30.189406+0000","last_clean":"2023-05-17T15:09:30.189406+0000","last_became_active":"2023-05-17T15:09:30.187691+0000","last_became_peered":"2023-05-17T15:09:30.187691+0000","last_unstale":"2023-05-17T15:09:30.189406+0000","last_undegraded":"2023-05-17T15:09:30.189406+0000","last_fullsized":"2023-05-17T15:09:30.189406+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.201540+0000","last_change":"2023-05-17T15:09:29.796670+0000","last_active":"2023-05-17T15:09:30.201540+0000","last_peered":"2023-05-17T15:09:30.201540+0000","last_clean":"2023-05-17T15:09:30.201540+0000","last_became_active":"2023-05-17T15:09:29.796320+0000","last_became_peered":"2023-05-17T15:09:29.796320+0000","last_unstale":"2023-05-17T15:09:30.201540+0000","last_undegraded":"2023-05-17T15:09:30.201540+0000","last_fullsized":"2023-05-17T15:09:30.201540+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197418+0000","last_change":"2023-05-17T15:09:30.190017+0000","last_active":"2023-05-17T15:09:30.197418+0000","last_peered":"2023-05-17T15:09:30.197418+0000","last_clean":"2023-05-17T15:09:30.197418+0000","last_became_active":"2023-05-17T15:09:30.189713+0000","last_became_peered":"2023-05-17T15:09:30.189713+0000","last_unstale":"2023-05-17T15:09:30.197418+0000","last_undegraded":"2023-05-17T15:09:30.197418+0000","last_fullsized":"2023-05-17T15:09:30.197418+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196540+0000","last_change":"2023-05-17T15:09:29.795937+0000","last_active":"2023-05-17T15:09:30.196540+0000","last_peered":"2023-05-17T15:09:30.196540+0000","last_clean":"2023-05-17T15:09:30.196540+0000","last_became_active":"2023-05-17T15:09:29.795606+0000","last_became_peered":"2023-05-17T15:09:29.795606+0000","last_unstale":"2023-05-17T15:09:30.196540+0000","last_undegraded":"2023-05-17T15:09:30.196540+0000","last_fullsized":"2023-05-17T15:09:30.196540+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198785+0000","last_change":"2023-05-17T15:09:30.196559+0000","last_active":"2023-05-17T15:09:30.198785+0000","last_peered":"2023-05-17T15:09:30.198785+0000","last_clean":"2023-05-17T15:09:30.198785+0000","last_became_active":"2023-05-17T15:09:30.196224+0000","last_became_peered":"2023-05-17T15:09:30.196224+0000","last_unstale":"2023-05-17T15:09:30.198785+0000","last_undegraded":"2023-05-17T15:09:30.198785+0000","last_fullsized":"2023-05-17T15:09:30.198785+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.177557+0000","last_change":"2023-05-17T15:09:29.795249+0000","last_active":"2023-05-17T15:09:30.177557+0000","last_peered":"2023-05-17T15:09:30.177557+0000","last_clean":"2023-05-17T15:09:30.177557+0000","last_became_active":"2023-05-17T15:09:29.794973+0000","last_became_peered":"2023-05-17T15:09:29.794973+0000","last_unstale":"2023-05-17T15:09:30.177557+0000","last_undegraded":"2023-05-17T15:09:30.177557+0000","last_fullsized":"2023-05-17T15:09:30.177557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.191320+0000","last_change":"2023-05-17T15:09:30.187422+0000","last_active":"2023-05-17T15:09:30.191320+0000","last_peered":"2023-05-17T15:09:30.191320+0000","last_clean":"2023-05-17T15:09:30.191320+0000","last_became_active":"2023-05-17T15:09:30.187105+0000","last_became_peered":"2023-05-17T15:09:30.187105+0000","last_unstale":"2023-05-17T15:09:30.191320+0000","last_undegraded":"2023-05-17T15:09:30.191320+0000","last_fullsized":"2023-05-17T15:09:30.191320+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178533+0000","last_change":"2023-05-17T15:09:29.796804+0000","last_active":"2023-05-17T15:09:30.178533+0000","last_peered":"2023-05-17T15:09:30.178533+0000","last_clean":"2023-05-17T15:09:30.178533+0000","last_became_active":"2023-05-17T15:09:29.796509+0000","last_became_peered":"2023-05-17T15:09:29.796509+0000","last_unstale":"2023-05-17T15:09:30.178533+0000","last_undegraded":"2023-05-17T15:09:30.178533+0000","last_fullsized":"2023-05-17T15:09:30.178533+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.192577+0000","last_change":"2023-05-17T15:09:30.187821+0000","last_active":"2023-05-17T15:09:30.192577+0000","last_peered":"2023-05-17T15:09:30.192577+0000","last_clean":"2023-05-17T15:09:30.192577+0000","last_became_active":"2023-05-17T15:09:30.187528+0000","last_became_peered":"2023-05-17T15:09:30.187528+0000","last_unstale":"2023-05-17T15:09:30.192577+0000","last_undegraded":"2023-05-17T15:09:30.192577+0000","last_fullsized":"2023-05-17T15:09:30.192577+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.180311+0000","last_change":"2023-05-17T15:09:29.800216+0000","last_active":"2023-05-17T15:09:30.180311+0000","last_peered":"2023-05-17T15:09:30.180311+0000","last_clean":"2023-05-17T15:09:30.180311+0000","last_became_active":"2023-05-17T15:09:29.799153+0000","last_became_peered":"2023-05-17T15:09:29.799153+0000","last_unstale":"2023-05-17T15:09:30.180311+0000","last_undegraded":"2023-05-17T15:09:30.180311+0000","last_fullsized":"2023-05-17T15:09:30.180311+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.189066+0000","last_change":"2023-05-17T15:09:30.186817+0000","last_active":"2023-05-17T15:09:30.189066+0000","last_peered":"2023-05-17T15:09:30.189066+0000","last_clean":"2023-05-17T15:09:30.189066+0000","last_became_active":"2023-05-17T15:09:30.186577+0000","last_became_peered":"2023-05-17T15:09:30.186577+0000","last_unstale":"2023-05-17T15:09:30.189066+0000","last_undegraded":"2023-05-17T15:09:30.189066+0000","last_fullsized":"2023-05-17T15:09:30.189066+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.175203+0000","last_change":"2023-05-17T15:09:29.800050+0000","last_active":"2023-05-17T15:09:30.175203+0000","last_peered":"2023-05-17T15:09:30.175203+0000","last_clean":"2023-05-17T15:09:30.175203+0000","last_became_active":"2023-05-17T15:09:29.799766+0000","last_became_peered":"2023-05-17T15:09:29.799766+0000","last_unstale":"2023-05-17T15:09:30.175203+0000","last_undegraded":"2023-05-17T15:09:30.175203+0000","last_fullsized":"2023-05-17T15:09:30.175203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197466+0000","last_change":"2023-05-17T15:09:30.192507+0000","last_active":"2023-05-17T15:09:30.197466+0000","last_peered":"2023-05-17T15:09:30.197466+0000","last_clean":"2023-05-17T15:09:30.197466+0000","last_became_active":"2023-05-17T15:09:30.192130+0000","last_became_peered":"2023-05-17T15:09:30.192130+0000","last_unstale":"2023-05-17T15:09:30.197466+0000","last_undegraded":"2023-05-17T15:09:30.197466+0000","last_fullsized":"2023-05-17T15:09:30.197466+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174265+0000","last_change":"2023-05-17T15:09:29.793131+0000","last_active":"2023-05-17T15:09:30.174265+0000","last_peered":"2023-05-17T15:09:30.174265+0000","last_clean":"2023-05-17T15:09:30.174265+0000","last_became_active":"2023-05-17T15:09:29.792862+0000","last_became_peered":"2023-05-17T15:09:29.792862+0000","last_unstale":"2023-05-17T15:09:30.174265+0000","last_undegraded":"2023-05-17T15:09:30.174265+0000","last_fullsized":"2023-05-17T15:09:30.174265+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197511+0000","last_change":"2023-05-17T15:09:30.195388+0000","last_active":"2023-05-17T15:09:30.197511+0000","last_peered":"2023-05-17T15:09:30.197511+0000","last_clean":"2023-05-17T15:09:30.197511+0000","last_became_active":"2023-05-17T15:09:30.195085+0000","last_became_peered":"2023-05-17T15:09:30.195085+0000","last_unstale":"2023-05-17T15:09:30.197511+0000","last_undegraded":"2023-05-17T15:09:30.197511+0000","last_fullsized":"2023-05-17T15:09:30.197511+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.181279+0000","last_change":"2023-05-17T15:09:29.799086+0000","last_active":"2023-05-17T15:09:30.181279+0000","last_peered":"2023-05-17T15:09:30.181279+0000","last_clean":"2023-05-17T15:09:30.181279+0000","last_became_active":"2023-05-17T15:09:29.798744+0000","last_became_peered":"2023-05-17T15:09:29.798744+0000","last_unstale":"2023-05-17T15:09:30.181279+0000","last_undegraded":"2023-05-17T15:09:30.181279+0000","last_fullsized":"2023-05-17T15:09:30.181279+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193541+0000","last_change":"2023-05-17T15:09:30.190436+0000","last_active":"2023-05-17T15:09:30.193541+0000","last_peered":"2023-05-17T15:09:30.193541+0000","last_clean":"2023-05-17T15:09:30.193541+0000","last_became_active":"2023-05-17T15:09:30.190159+0000","last_became_peered":"2023-05-17T15:09:30.190159+0000","last_unstale":"2023-05-17T15:09:30.193541+0000","last_undegraded":"2023-05-17T15:09:30.193541+0000","last_fullsized":"2023-05-17T15:09:30.193541+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171574+0000","last_change":"2023-05-17T15:09:29.797754+0000","last_active":"2023-05-17T15:09:30.171574+0000","last_peered":"2023-05-17T15:09:30.171574+0000","last_clean":"2023-05-17T15:09:30.171574+0000","last_became_active":"2023-05-17T15:09:29.797471+0000","last_became_peered":"2023-05-17T15:09:29.797471+0000","last_unstale":"2023-05-17T15:09:30.171574+0000","last_undegraded":"2023-05-17T15:09:30.171574+0000","last_fullsized":"2023-05-17T15:09:30.171574+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195427+0000","last_change":"2023-05-17T15:09:30.190676+0000","last_active":"2023-05-17T15:09:30.195427+0000","last_peered":"2023-05-17T15:09:30.195427+0000","last_clean":"2023-05-17T15:09:30.195427+0000","last_became_active":"2023-05-17T15:09:30.190388+0000","last_became_peered":"2023-05-17T15:09:30.190388+0000","last_unstale":"2023-05-17T15:09:30.195427+0000","last_undegraded":"2023-05-17T15:09:30.195427+0000","last_fullsized":"2023-05-17T15:09:30.195427+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.186562+0000","last_change":"2023-05-17T15:09:29.793961+0000","last_active":"2023-05-17T15:09:30.186562+0000","last_peered":"2023-05-17T15:09:30.186562+0000","last_clean":"2023-05-17T15:09:30.186562+0000","last_became_active":"2023-05-17T15:09:29.793424+0000","last_became_peered":"2023-05-17T15:09:29.793424+0000","last_unstale":"2023-05-17T15:09:30.186562+0000","last_undegraded":"2023-05-17T15:09:30.186562+0000","last_fullsized":"2023-05-17T15:09:30.186562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188871+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:09:30.188871+0000","last_peered":"2023-05-17T15:09:30.188871+0000","last_clean":"2023-05-17T15:09:30.188871+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:09:30.188871+0000","last_undegraded":"2023-05-17T15:09:30.188871+0000","last_fullsized":"2023-05-17T15:09:30.188871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.194499+0000","last_change":"2023-05-17T15:09:30.187289+0000","last_active":"2023-05-17T15:09:30.194499+0000","last_peered":"2023-05-17T15:09:30.194499+0000","last_clean":"2023-05-17T15:09:30.194499+0000","last_became_active":"2023-05-17T15:09:30.186838+0000","last_became_peered":"2023-05-17T15:09:30.186838+0000","last_unstale":"2023-05-17T15:09:30.194499+0000","last_undegraded":"2023-05-17T15:09:30.194499+0000","last_fullsized":"2023-05-17T15:09:30.194499+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178388+0000","last_change":"2023-05-17T15:09:29.801179+0000","last_active":"2023-05-17T15:09:30.178388+0000","last_peered":"2023-05-17T15:09:30.178388+0000","last_clean":"2023-05-17T15:09:30.178388+0000","last_became_active":"2023-05-17T15:09:29.800885+0000","last_became_peered":"2023-05-17T15:09:29.800885+0000","last_unstale":"2023-05-17T15:09:30.178388+0000","last_undegraded":"2023-05-17T15:09:30.178388+0000","last_fullsized":"2023-05-17T15:09:30.178388+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.174363+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:09:30.174363+0000","last_peered":"2023-05-17T15:09:30.174363+0000","last_clean":"2023-05-17T15:09:30.174363+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:09:30.174363+0000","last_undegraded":"2023-05-17T15:09:30.174363+0000","last_fullsized":"2023-05-17T15:09:30.174363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.197231+0000","last_change":"2023-05-17T15:09:30.188394+0000","last_active":"2023-05-17T15:09:30.197231+0000","last_peered":"2023-05-17T15:09:30.197231+0000","last_clean":"2023-05-17T15:09:30.197231+0000","last_became_active":"2023-05-17T15:09:30.186287+0000","last_became_peered":"2023-05-17T15:09:30.186287+0000","last_unstale":"2023-05-17T15:09:30.197231+0000","last_undegraded":"2023-05-17T15:09:30.197231+0000","last_fullsized":"2023-05-17T15:09:30.197231+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.185819+0000","last_change":"2023-05-17T15:09:29.794586+0000","last_active":"2023-05-17T15:09:30.185819+0000","last_peered":"2023-05-17T15:09:30.185819+0000","last_clean":"2023-05-17T15:09:30.185819+0000","last_became_active":"2023-05-17T15:09:29.794273+0000","last_became_peered":"2023-05-17T15:09:29.794273+0000","last_unstale":"2023-05-17T15:09:30.185819+0000","last_undegraded":"2023-05-17T15:09:30.185819+0000","last_fullsized":"2023-05-17T15:09:30.185819+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.176652+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:09:30.176652+0000","last_peered":"2023-05-17T15:09:30.176652+0000","last_clean":"2023-05-17T15:09:30.176652+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:09:30.176652+0000","last_undegraded":"2023-05-17T15:09:30.176652+0000","last_fullsized":"2023-05-17T15:09:30.176652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.193337+0000","last_change":"2023-05-17T15:09:30.190757+0000","last_active":"2023-05-17T15:09:30.193337+0000","last_peered":"2023-05-17T15:09:30.193337+0000","last_clean":"2023-05-17T15:09:30.193337+0000","last_became_active":"2023-05-17T15:09:30.190458+0000","last_became_peered":"2023-05-17T15:09:30.190458+0000","last_unstale":"2023-05-17T15:09:30.193337+0000","last_undegraded":"2023-05-17T15:09:30.193337+0000","last_fullsized":"2023-05-17T15:09:30.193337+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188437+0000","last_change":"2023-05-17T15:09:29.803602+0000","last_active":"2023-05-17T15:09:30.188437+0000","last_peered":"2023-05-17T15:09:30.188437+0000","last_clean":"2023-05-17T15:09:30.188437+0000","last_became_active":"2023-05-17T15:09:29.802307+0000","last_became_peered":"2023-05-17T15:09:29.802307+0000","last_unstale":"2023-05-17T15:09:30.188437+0000","last_undegraded":"2023-05-17T15:09:30.188437+0000","last_fullsized":"2023-05-17T15:09:30.188437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173663+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:09:30.173663+0000","last_peered":"2023-05-17T15:09:30.173663+0000","last_clean":"2023-05-17T15:09:30.173663+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:09:30.173663+0000","last_undegraded":"2023-05-17T15:09:30.173663+0000","last_fullsized":"2023-05-17T15:09:30.173663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171685+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:09:30.171685+0000","last_peered":"2023-05-17T15:09:30.171685+0000","last_clean":"2023-05-17T15:09:30.171685+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:09:30.171685+0000","last_undegraded":"2023-05-17T15:09:30.171685+0000","last_fullsized":"2023-05-17T15:09:30.171685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.198660+0000","last_change":"2023-05-17T15:09:30.192369+0000","last_active":"2023-05-17T15:09:30.198660+0000","last_peered":"2023-05-17T15:09:30.198660+0000","last_clean":"2023-05-17T15:09:30.198660+0000","last_became_active":"2023-05-17T15:09:30.192090+0000","last_became_peered":"2023-05-17T15:09:30.192090+0000","last_unstale":"2023-05-17T15:09:30.198660+0000","last_undegraded":"2023-05-17T15:09:30.198660+0000","last_fullsized":"2023-05-17T15:09:30.198660+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.195997+0000","last_change":"2023-05-17T15:09:29.792426+0000","last_active":"2023-05-17T15:09:30.195997+0000","last_peered":"2023-05-17T15:09:30.195997+0000","last_clean":"2023-05-17T15:09:30.195997+0000","last_became_active":"2023-05-17T15:09:29.791393+0000","last_became_peered":"2023-05-17T15:09:29.791393+0000","last_unstale":"2023-05-17T15:09:30.195997+0000","last_undegraded":"2023-05-17T15:09:30.195997+0000","last_fullsized":"2023-05-17T15:09:30.195997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.171730+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:09:30.171730+0000","last_peered":"2023-05-17T15:09:30.171730+0000","last_clean":"2023-05-17T15:09:30.171730+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:09:30.171730+0000","last_undegraded":"2023-05-17T15:09:30.171730+0000","last_fullsized":"2023-05-17T15:09:30.171730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196776+0000","last_change":"2023-05-17T15:09:30.193799+0000","last_active":"2023-05-17T15:09:30.196776+0000","last_peered":"2023-05-17T15:09:30.196776+0000","last_clean":"2023-05-17T15:09:30.196776+0000","last_became_active":"2023-05-17T15:09:30.193387+0000","last_became_peered":"2023-05-17T15:09:30.193387+0000","last_unstale":"2023-05-17T15:09:30.196776+0000","last_undegraded":"2023-05-17T15:09:30.196776+0000","last_fullsized":"2023-05-17T15:09:30.196776+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.178426+0000","last_change":"2023-05-17T15:09:29.801490+0000","last_active":"2023-05-17T15:09:30.178426+0000","last_peered":"2023-05-17T15:09:30.178426+0000","last_clean":"2023-05-17T15:09:30.178426+0000","last_became_active":"2023-05-17T15:09:29.801213+0000","last_became_peered":"2023-05-17T15:09:29.801213+0000","last_unstale":"2023-05-17T15:09:30.178426+0000","last_undegraded":"2023-05-17T15:09:30.178426+0000","last_fullsized":"2023-05-17T15:09:30.178426+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.173035+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:09:30.173035+0000","last_peered":"2023-05-17T15:09:30.173035+0000","last_clean":"2023-05-17T15:09:30.173035+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:09:30.173035+0000","last_undegraded":"2023-05-17T15:09:30.173035+0000","last_fullsized":"2023-05-17T15:09:30.173035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.196994+0000","last_change":"2023-05-17T15:09:30.194469+0000","last_active":"2023-05-17T15:09:30.196994+0000","last_peered":"2023-05-17T15:09:30.196994+0000","last_clean":"2023-05-17T15:09:30.196994+0000","last_became_active":"2023-05-17T15:09:30.194139+0000","last_became_peered":"2023-05-17T15:09:30.194139+0000","last_unstale":"2023-05-17T15:09:30.196994+0000","last_undegraded":"2023-05-17T15:09:30.196994+0000","last_fullsized":"2023-05-17T15:09:30.196994+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.175696+0000","last_change":"2023-05-17T15:09:29.800009+0000","last_active":"2023-05-17T15:09:30.175696+0000","last_peered":"2023-05-17T15:09:30.175696+0000","last_clean":"2023-05-17T15:09:30.175696+0000","last_became_active":"2023-05-17T15:09:29.799669+0000","last_became_peered":"2023-05-17T15:09:29.799669+0000","last_unstale":"2023-05-17T15:09:30.175696+0000","last_undegraded":"2023-05-17T15:09:30.175696+0000","last_fullsized":"2023-05-17T15:09:30.175696+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188846+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:09:30.188846+0000","last_peered":"2023-05-17T15:09:30.188846+0000","last_clean":"2023-05-17T15:09:30.188846+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:09:30.188846+0000","last_undegraded":"2023-05-17T15:09:30.188846+0000","last_fullsized":"2023-05-17T15:09:30.188846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.188597+0000","last_change":"2023-05-17T15:09:30.186828+0000","last_active":"2023-05-17T15:09:30.188597+0000","last_peered":"2023-05-17T15:09:30.188597+0000","last_clean":"2023-05-17T15:09:30.188597+0000","last_became_active":"2023-05-17T15:09:30.186494+0000","last_became_peered":"2023-05-17T15:09:30.186494+0000","last_unstale":"2023-05-17T15:09:30.188597+0000","last_undegraded":"2023-05-17T15:09:30.188597+0000","last_fullsized":"2023-05-17T15:09:30.188597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:29.767746+0000","last_clean_scrub_stamp":"2023-05-17T15:09:29.767746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.179429+0000","last_change":"2023-05-17T15:09:29.804334+0000","last_active":"2023-05-17T15:09:30.179429+0000","last_peered":"2023-05-17T15:09:30.179429+0000","last_clean":"2023-05-17T15:09:30.179429+0000","last_became_active":"2023-05-17T15:09:29.803113+0000","last_became_peered":"2023-05-17T15:09:29.803113+0000","last_unstale":"2023-05-17T15:09:30.179429+0000","last_undegraded":"2023-05-17T15:09:30.179429+0000","last_fullsized":"2023-05-17T15:09:30.179429+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:09:28.760411+0000","last_clean_scrub_stamp":"2023-05-17T15:09:28.760411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-05-17T15:09:30.181253+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:09:30.181253+0000","last_peered":"2023-05-17T15:09:30.181253+0000","last_clean":"2023-05-17T15:09:30.181253+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:09:30.181253+0000","last_undegraded":"2023-05-17T15:09:30.181253+0000","last_fullsized":"2023-05-17T15:09:30.181253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18052,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":16704,"kb_avail":94353788,"statfs":{"total":96636764160,"available":96618278912,"internally_reserved":0,"allocated":1372160,"data_stored":684553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17104896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.36499999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.79200000000000004,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.441}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.81999999999999995,"15min":0.89000000000000001},"last":0.502}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.042},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.90800000000000003,"5min":0.92800000000000005,"15min":0.94099999999999995},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17552,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354288,"statfs":{"total":96636764160,"available":96618790912,"internally_reserved":0,"allocated":1384448,"data_stored":686609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.438},{"interface":"front","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74299999999999999,"5min":1.04,"15min":1.04},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56399999999999995,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":0.69799999999999995,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79600000000000004,"5min":1.087,"15min":1.087},"last":0.373}]},{"osd":3,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77800000000000002,"5min":1.159,"15min":1.159},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.77000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83099999999999996,"5min":1.609,"15min":1.609},"last":0.747},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86799999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Wed May 17 15:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80700000000000005,"5min":0.879,"15min":0.89500000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17340,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94354500,"statfs":{"total":96636764160,"available":96619008000,"internally_reserved":0,"allocated":1363968,"data_stored":684497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.29299999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.495},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17104,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94354736,"statfs":{"total":96636764160,"available":96619249664,"internally_reserved":0,"allocated":1384448,"data_stored":685335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.377,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40600000000000003,"15min":0.41299999999999998},"min":{"1min":0.26000000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.214},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.67700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34899999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0720000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.96999999999999997,"15min":1.0129999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65300000000000002},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.119},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66500000000000004,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.087},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.0740000000000001},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18492,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353348,"statfs":{"total":96636764160,"available":96617828352,"internally_reserved":0,"allocated":1363968,"data_stored":684497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.378,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":0.628,"15min":0.628},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38200000000000001,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57999999999999996,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.33500000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41999999999999998,"5min":0.65300000000000002,"15min":0.73999999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.46800000000000003,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.056,"15min":1.056},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.995,"15min":1.046},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.98799999999999999,"15min":1.014},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75900000000000001,"5min":0.92200000000000004,"15min":1.0860000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.441,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":0.88500000000000001,"5min":1.036,"15min":1.036},"last":0.54900000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.38200000000000001},"max":{"1min":0.76100000000000001,"5min":0.97499999999999998,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21380,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350460,"statfs":{"total":96636764160,"available":96614871040,"internally_reserved":0,"allocated":1372160,"data_stored":685459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.433,"5min":0.748,"15min":0.748},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.498,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57099999999999995,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53700000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.60999999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.86199999999999999,"5min":0.99099999999999999,"15min":1.034},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":3.4590000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86699999999999999,"5min":1.155,"15min":3.4289999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71099999999999997,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.69999999999999996},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.99399999999999999,"5min":1.772,"15min":3.4049999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.80700000000000005}]},{"osd":7,"last update":"Wed May 17 15:09:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":0.99099999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.93700000000000006,"5min":1.024,"15min":3.391},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17796,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94354044,"statfs":{"total":96636764160,"available":96618541056,"internally_reserved":0,"allocated":1372160,"data_stored":685141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77600000000000002,"5min":1.292,"15min":1.292},"last":0.45000000000000001}]},{"osd":2,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.75900000000000001,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65700000000000003,"5min":1.637,"15min":1.637},"last":0.60999999999999999}]},{"osd":5,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.502},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83899999999999997,"5min":0.995,"15min":0.995},"last":0.624},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80700000000000005,"5min":1.329,"15min":1.329},"last":0.67800000000000005}]},{"osd":6,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82899999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.151,"15min":1.151},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 17 15:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20988,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":19648,"kb_avail":94350852,"statfs":{"total":96636764160,"available":96615272448,"internally_reserved":0,"allocated":1363968,"data_stored":684497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20119552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82399999999999995,"5min":0.83599999999999997,"15min":0.876},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.34499999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73099999999999998}]},{"osd":1,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.79900000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.995},"last":0.628}]},{"osd":2,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66900000000000004}]},{"osd":3,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.39800000000000002,"15min":0.35999999999999999},"max":{"1min":0.82299999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.88,"15min":0.91700000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.85399999999999998,"15min":0.92700000000000005},"last":0.74399999999999999}]},{"osd":6,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 17 15:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":1.046,"5min":1.107,"15min":1.107},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:09:39.190 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:09:39.191 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:09:39.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.310+0000 7f5a6e73f700 1 Processor -- start 2023-05-17T15:09:39.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.310+0000 7f5a6e73f700 1 -- start start 2023-05-17T15:09:39.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a6e73f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a68158390 0x7f5a68066360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a6e73f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a68065350 con 0x7f5a68153f10 2023-05-17T15:09:39.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a6e73f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a68065ed0 con 0x7f5a681542f0 2023-05-17T15:09:39.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a6e73f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a680655a0 con 0x7f5a68158390 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a67fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5a68153f10 0x7f5a680c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40744/0 (socket says 172.21.15.27:40744) 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a67fff700 1 -- 172.21.15.27:0/2965134021 learned_addr learned my addr 172.21.15.27:0/2965134021 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a6ccdc700 1 --2- 172.21.15.27:0/2965134021 >> v2:172.21.15.40:3300/0 conn(0x7f5a68158390 0x7f5a68066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247559718 0 0) 0x7f5a68065350 con 0x7f5a68153f10 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.311+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a500033f0 con 0x7f5a68153f10 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933943954 0 0) 0x7f5a68065ed0 con 0x7f5a681542f0 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a68065350 con 0x7f5a681542f0 2023-05-17T15:09:39.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398847820 0 0) 0x7f5a500033f0 con 0x7f5a68153f10 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 >> v2:172.21.15.40:3300/0 conn(0x7f5a68158390 msgr2=0x7f5a68066360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 --2- 172.21.15.27:0/2965134021 >> v2:172.21.15.40:3300/0 conn(0x7f5a68158390 0x7f5a68066360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 >> v1:172.21.15.40:6789/0 conn(0x7f5a681542f0 legacy=0x7f5a68157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68065880 con 0x7f5a68153f10 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5a58001470 con 0x7f5a68153f10 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a6ccdc700 1 --2- 172.21.15.27:0/2965134021 >> v2:172.21.15.40:3300/0 conn(0x7f5a68158390 0x7f5a68066360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:39.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 >> v1:172.21.15.27:6789/0 conn(0x7f5a68153f10 legacy=0x7f5a680c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50003ac0 0x7f5a50003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a50005000 0x7f5a5000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680655a0 con 0x7f5a50004690 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5000bf60 con 0x7f5a50003ac0 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5000c120 con 0x7f5a50005000 2023-05-17T15:09:39.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a67fff700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50003ac0 0x7f5a50003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a6ccdc700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a50005000 0x7f5a5000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 -- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a50005000 msgr2=0x7f5a5000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a50005000 0x7f5a5000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 -- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50003ac0 msgr2=0x7f5a50003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50003ac0 0x7f5a50003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 -- 172.21.15.27:0/2965134021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500033f0 con 0x7f5a50004690 2023-05-17T15:09:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a67fff700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50003ac0 0x7f5a50003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a6ccdc700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a50005000 0x7f5a5000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a6ccdc700 1 -- 172.21.15.27:0/2965134021 reap_dead start 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a50004b10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f5a5c001860 tx=0x7f5a5c007bb0).ready entity=mon.0 client_cookie=455845ebb74d064d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c007020 con 0x7f5a50004690 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c007180 con 0x7f5a50004690 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.312+0000 7f5a66ffd700 1 -- 172.21.15.27:0/2965134021 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c007520 con 0x7f5a50004690 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2965134021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 msgr2=0x7f5a50004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a50004b10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f5a5c001860 tx=0x7f5a5c007bb0).stop 2023-05-17T15:09:39.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2965134021 shutdown_connections 2023-05-17T15:09:39.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2965134021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a50004b10 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2965134021 >> 172.21.15.27:0/2965134021 conn(0x7f5a680c94b0 msgr2=0x7f5a680c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:39.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2965134021 shutdown_connections 2023-05-17T15:09:39.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.313+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2965134021 wait complete. 2023-05-17T15:09:39.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.314+0000 7f5a6e73f700 1 Processor -- start 2023-05-17T15:09:39.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 -- start start 2023-05-17T15:09:39.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a68164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a680ae510 0x7f5a6814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a6814df00 0x7f5a68165410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a681651b0 con 0x7f5a50004690 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680ac5e0 con 0x7f5a680ae510 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a6e73f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680ae990 con 0x7f5a6814df00 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a68164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a68164cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41194/0 (socket says 172.21.15.27:41194) 2023-05-17T15:09:39.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.315+0000 7f5a67fff700 1 -- 172.21.15.27:0/2567609399 learned_addr learned my addr 172.21.15.27:0/2567609399 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a6ccdc700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a6814df00 0x7f5a68165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a67fff700 1 -- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a6814df00 msgr2=0x7f5a68165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a67fff700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a6814df00 0x7f5a68165410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a680ae510 0x7f5a6814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a67fff700 1 -- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a680ae510 msgr2=0x7f5a6814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a67fff700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a680ae510 0x7f5a6814da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a67fff700 1 -- 172.21.15.27:0/2567609399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680ab9d0 con 0x7f5a50004690 2023-05-17T15:09:39.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a67fff700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a68164cc0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f5a5800e790 tx=0x7f5a58000bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58010520 con 0x7f5a50004690 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58010680 con 0x7f5a50004690 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58010a00 con 0x7f5a50004690 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a680abcb0 con 0x7f5a50004690 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.316+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680ac270 con 0x7f5a50004690 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.317+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6806bdf0 con 0x7f5a50004690 2023-05-17T15:09:39.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.317+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5a5801a020 con 0x7f5a50004690 2023-05-17T15:09:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.318+0000 7f5a4ffff700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a5405ed90 0x7f5a54061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.318+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f5a58079590 con 0x7f5a50004690 2023-05-17T15:09:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.318+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a5405ed90 0x7f5a54061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.318+0000 7f5a677fe700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a5405ed90 0x7f5a54061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5a5c000c00 tx=0x7f5a5c015000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.322+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a5804aae0 con 0x7f5a50004690 2023-05-17T15:09:39.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.562+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f5a68065b60 con 0x7f5a50004690 2023-05-17T15:09:39.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.565+0000 7f5a4ffff700 1 -- 172.21.15.27:0/2567609399 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5a5804e100 con 0x7f5a50004690 2023-05-17T15:09:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a5405ed90 msgr2=0x7f5a54061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a5405ed90 0x7f5a54061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5a5c000c00 tx=0x7f5a5c015000).stop 2023-05-17T15:09:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 msgr2=0x7f5a68164cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a68164cc0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f5a5800e790 tx=0x7f5a58000bc0).stop 2023-05-17T15:09:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 shutdown_connections 2023-05-17T15:09:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5a5405ed90 0x7f5a54061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a6814df00 0x7f5a68165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a50004690 0x7f5a68164cc0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 --2- 172.21.15.27:0/2567609399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a680ae510 0x7f5a6814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 >> 172.21.15.27:0/2567609399 conn(0x7f5a680c94b0 msgr2=0x7f5a680c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 shutdown_connections 2023-05-17T15:09:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.568+0000 7f5a6e73f700 1 -- 172.21.15.27:0/2567609399 wait complete. 2023-05-17T15:09:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:09:39.584 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:09:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.697+0000 7f8eb58d6700 1 Processor -- start 2023-05-17T15:09:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.697+0000 7f8eb58d6700 1 -- start start 2023-05-17T15:09:39.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eb58d6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8eb00c5f30 0x7f8eb00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eb58d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 0x7f8eb0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eb58d6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb00bfcd0 con 0x7f8eb01541c0 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eb58d6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb00c0290 con 0x7f8eb00c5f30 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eb58d6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00aa1a0 con 0x7f8eb0158880 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eaf7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8eb01541c0 0x7f8eb00c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40766/0 (socket says 172.21.15.27:40766) 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eaf7fe700 1 -- 172.21.15.27:0/1078321577 learned_addr learned my addr 172.21.15.27:0/1078321577 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eae7fc700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 0x7f8eb0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/1078321577 >> v2:172.21.15.40:3300/0 conn(0x7f8eb00c5f30 0x7f8eb00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441026972 0 0) 0x7f8eb00bfcd0 con 0x7f8eb01541c0 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e9c0033f0 con 0x7f8eb01541c0 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358613078 0 0) 0x7f8e9c0033f0 con 0x7f8eb01541c0 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 msgr2=0x7f8eb0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 0x7f8eb0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 >> v2:172.21.15.40:3300/0 conn(0x7f8eb00c5f30 msgr2=0x7f8eb00c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.698+0000 7f8eadffb700 1 --2- 172.21.15.27:0/1078321577 >> v2:172.21.15.40:3300/0 conn(0x7f8eb00c5f30 0x7f8eb00c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb00aa480 con 0x7f8eb01541c0 2023-05-17T15:09:39.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f8ea00017f0 con 0x7f8eb01541c0 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 >> v1:172.21.15.27:6789/0 conn(0x7f8eb01541c0 legacy=0x7f8eb00c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e9c0038e0 0x7f8e9c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e9c004690 0x7f8e9c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 0x7f8e9c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00c0290 con 0x7f8e9c0038e0 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00aa1a0 con 0x7f8e9c004690 2023-05-17T15:09:39.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c00b8e0 con 0x7f8eb0158880 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e9c0038e0 0x7f8e9c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eae7fc700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e9c004690 0x7f8e9c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaf7fe700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 0x7f8e9c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 -- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 msgr2=0x7f8e9c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8eb0158880 0x7f8e9c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 -- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e9c004690 msgr2=0x7f8e9c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e9c004690 0x7f8e9c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 -- 172.21.15.27:0/1078321577 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0033f0 con 0x7f8e9c0038e0 2023-05-17T15:09:39.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eae7fc700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e9c004690 0x7f8e9c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:39.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e9c0038e0 0x7f8e9c003d00 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8ea8009a80 tx=0x7f8ea8009060).ready entity=mon.0 client_cookie=34f0016c1e1b66d1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:39.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8009430 con 0x7f8e9c0038e0 2023-05-17T15:09:39.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800e640 con 0x7f8e9c0038e0 2023-05-17T15:09:39.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.699+0000 7f8eadffb700 1 -- 172.21.15.27:0/1078321577 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800e9c0 con 0x7f8e9c0038e0 2023-05-17T15:09:39.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eb58d6700 1 -- 172.21.15.27:0/1078321577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e9c0038e0 msgr2=0x7f8e9c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/1078321577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e9c0038e0 0x7f8e9c003d00 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8ea8009a80 tx=0x7f8ea8009060).stop 2023-05-17T15:09:39.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eaf7fe700 1 -- 172.21.15.27:0/1078321577 reap_dead start 2023-05-17T15:09:39.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eb58d6700 1 -- 172.21.15.27:0/1078321577 shutdown_connections 2023-05-17T15:09:39.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eb58d6700 1 -- 172.21.15.27:0/1078321577 >> 172.21.15.27:0/1078321577 conn(0x7f8eb0069e70 msgr2=0x7f8eb005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:39.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eb58d6700 1 -- 172.21.15.27:0/1078321577 shutdown_connections 2023-05-17T15:09:39.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.700+0000 7f8eb58d6700 1 -- 172.21.15.27:0/1078321577 wait complete. 2023-05-17T15:09:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.701+0000 7f8eb58d6700 1 Processor -- start 2023-05-17T15:09:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.701+0000 7f8eb58d6700 1 -- start start 2023-05-17T15:09:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eb58d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e9c0038e0 0x7f8eb00c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eb58d6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb0154630 0x7f8eb0152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eb58d6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 0x7f8eb0157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eb58d6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01557b0 con 0x7f8eb01577a0 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eb58d6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0158110 con 0x7f8eb0154630 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eb58d6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0154ba0 con 0x7f8e9c0038e0 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 0x7f8eb0157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 0x7f8eb0157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41218/0 (socket says 172.21.15.27:41218) 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 -- 172.21.15.27:0/3953334268 learned_addr learned my addr 172.21.15.27:0/3953334268 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e9c0038e0 0x7f8eb00c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eae7fc700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb0154630 0x7f8eb0152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 -- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e9c0038e0 msgr2=0x7f8eb00c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e9c0038e0 0x7f8eb00c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 -- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb0154630 msgr2=0x7f8eb0152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb0154630 0x7f8eb0152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 -- 172.21.15.27:0/3953334268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0154e80 con 0x7f8eb01577a0 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eae7fc700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb0154630 0x7f8eb0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:39.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8eaf7fe700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 0x7f8eb0157c20 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f8ea0000f80 tx=0x7f8ea00017b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:39.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.702+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000e7b0 con 0x7f8eb01577a0 2023-05-17T15:09:39.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.703+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000e910 con 0x7f8eb01577a0 2023-05-17T15:09:39.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.703+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000ecb0 con 0x7f8eb01577a0 2023-05-17T15:09:39.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.703+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0155160 con 0x7f8eb01577a0 2023-05-17T15:09:39.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.703+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb00c5460 con 0x7f8eb01577a0 2023-05-17T15:09:39.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.703+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb005f4a0 con 0x7f8eb01577a0 2023-05-17T15:09:39.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.704+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ea001e070 con 0x7f8eb01577a0 2023-05-17T15:09:39.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.704+0000 7f8ea6ffd700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e9005ed90 0x7f8e90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:39.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.704+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8ea00792a0 con 0x7f8eb01577a0 2023-05-17T15:09:39.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.704+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e9005ed90 0x7f8e90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:39.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.705+0000 7f8eaeffd700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e9005ed90 0x7f8e90061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8ea8006d50 tx=0x7f8ea801a000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:39.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.708+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ea004a840 con 0x7f8eb01577a0 2023-05-17T15:09:39.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.922+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8eb006bdf0 con 0x7f8eb01577a0 2023-05-17T15:09:39.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.922+0000 7f8ea6ffd700 1 -- 172.21.15.27:0/3953334268 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4485 (secure 0 0 0) 0x7f8ea001c090 con 0x7f8eb01577a0 2023-05-17T15:09:39.927 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:39.927 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:09:30.165063+0000","modified":"2023-05-17T15:09:33.179511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7092":{"gid":7092,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6834/1597094051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1597094051},{"type":"v1","addr":"172.21.15.27:6834","nonce":1597094051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-17T15:09:39.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e9005ed90 msgr2=0x7f8e90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e9005ed90 0x7f8e90061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8ea8006d50 tx=0x7f8ea801a000).stop 2023-05-17T15:09:39.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 msgr2=0x7f8eb0157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:39.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 0x7f8eb0157c20 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f8ea0000f80 tx=0x7f8ea00017b0).stop 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 shutdown_connections 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8e9005ed90 0x7f8e90061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8eb01577a0 0x7f8eb0157c20 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e9c0038e0 0x7f8eb00c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 --2- 172.21.15.27:0/3953334268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb0154630 0x7f8eb0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 >> 172.21.15.27:0/3953334268 conn(0x7f8eb0069e70 msgr2=0x7f8eb00acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:39.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 shutdown_connections 2023-05-17T15:09:39.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:39.924+0000 7f8eb58d6700 1 -- 172.21.15.27:0/3953334268 wait complete. 2023-05-17T15:09:39.930 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 44 2023-05-17T15:09:40.343 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:09:30.165063+0000', 'modified': '2023-05-17T15:09:33.179511+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7092}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7092': {'gid': 7092, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6834/1597094051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 1597094051}, {'type': 'v1', 'addr': '172.21.15.27:6834', 'nonce': 1597094051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:09:40.343 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:09:40.344 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-17T15:09:40.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.459+0000 7f8fe511d700 1 Processor -- start 2023-05-17T15:09:40.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.459+0000 7f8fe511d700 1 -- start start 2023-05-17T15:09:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe511d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8fe00bfcd0 0x7f8fe0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe511d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe511d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00c0e50 con 0x7f8fe01539c0 2023-05-17T15:09:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe511d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe00c0240 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe511d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00c0520 con 0x7f8fe00c12e0 2023-05-17T15:09:40.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8fe00bfcd0 0x7f8fe0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8fe01539c0 0x7f8fe0158280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40784/0 (socket says 172.21.15.27:40784) 2023-05-17T15:09:40.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdffff700 1 -- 172.21.15.27:0/447304915 learned_addr learned my addr 172.21.15.27:0/447304915 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:40.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe491c700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/447304915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 msgr2=0x7f8fe00c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/447304915 >> v1:172.21.15.27:6789/0 conn(0x7f8fe01539c0 legacy=0x7f8fe0158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdeffd700 1 -- 172.21.15.27:0/447304915 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074162062 0 0) 0x7f8fe00c0e50 con 0x7f8fe01539c0 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/447304915 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00c0800 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fe491c700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe0153da0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f8fc8009760 tx=0x7f8fc8009060).ready entity=mon.0 client_cookie=a546566d4491793a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdeffd700 1 -- 172.21.15.27:0/447304915 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800b580 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdeffd700 1 -- 172.21.15.27:0/447304915 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc800b6e0 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.460+0000 7f8fdeffd700 1 -- 172.21.15.27:0/447304915 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800ba60 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 -- 172.21.15.27:0/447304915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 msgr2=0x7f8fe0153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe0153da0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f8fc8009760 tx=0x7f8fc8009060).stop 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 -- 172.21.15.27:0/447304915 shutdown_connections 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 --2- 172.21.15.27:0/447304915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe0153da0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 -- 172.21.15.27:0/447304915 >> 172.21.15.27:0/447304915 conn(0x7f8fe005dd50 msgr2=0x7f8fe005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 -- 172.21.15.27:0/447304915 shutdown_connections 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.461+0000 7f8fe511d700 1 -- 172.21.15.27:0/447304915 wait complete. 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.462+0000 7f8fe511d700 1 Processor -- start 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.462+0000 7f8fe511d700 1 -- start start 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe511d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe511d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe511d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe01539c0 0x7f8fe0143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe511d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00ae8b0 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe511d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00c3690 con 0x7f8fe01539c0 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe511d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00c3f00 con 0x7f8fe00c12e0 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe00ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41228/0 (socket says 172.21.15.27:41228) 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 -- 172.21.15.27:0/3822307649 learned_addr learned my addr 172.21.15.27:0/3822307649 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fe491c700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe01539c0 0x7f8fe0143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 -- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 msgr2=0x7f8fe00c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 -- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe01539c0 msgr2=0x7f8fe0143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe01539c0 0x7f8fe0143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.463+0000 7f8fdffff700 1 -- 172.21.15.27:0/3822307649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80092a0 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.464+0000 7f8fdffff700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe00ada30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f8fd0001eb0 tx=0x7f8fd0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.464+0000 7f8fd7fff700 1 -- 172.21.15.27:0/3822307649 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00072e0 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.464+0000 7f8fd7fff700 1 -- 172.21.15.27:0/3822307649 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0007440 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.464+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe0164410 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.464+0000 7f8fd7fff700 1 -- 172.21.15.27:0/3822307649 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00057a0 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.464+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00ae010 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.465+0000 7f8fd7fff700 1 -- 172.21.15.27:0/3822307649 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8fd001a060 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.465+0000 7f8fd7fff700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fc005ed90 0x7f8fc0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.466+0000 7f8fd7fff700 1 -- 172.21.15.27:0/3822307649 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8fd00792a0 con 0x7f8fe00bfcd0 2023-05-17T15:09:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.466+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fc005ed90 0x7f8fc0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.466+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fc005ed90 0x7f8fc0061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8fc800b340 tx=0x7f8fc8017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.467+0000 7f8ff7d11b80 1 Processor -- start 2023-05-17T15:09:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.467+0000 7f8ff7d11b80 1 -- start start 2023-05-17T15:09:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5eb6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5e8ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5e89ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5e545e0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5dcb8a0 con 0x564ee5ed7350 2023-05-17T15:09:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee5de0900 con 0x564ee5e89660 2023-05-17T15:09:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8fdffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5eb6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8fdffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5eb6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41236/0 (socket says 172.21.15.27:41236) 2023-05-17T15:09:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.468+0000 7f8fdffff700 1 -- 172.21.15.27:0/978288285 learned_addr learned my addr 172.21.15.27:0/978288285 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fe491c700 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5e89ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5e8ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdffff700 1 -- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 msgr2=0x564ee5e89ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdffff700 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5e89ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdffff700 1 -- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 msgr2=0x564ee5e8ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdffff700 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5e8ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdffff700 1 -- 172.21.15.27:0/978288285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ee5c83310 con 0x564ee5e8e6b0 2023-05-17T15:09:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5e8ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fdffff700 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5eb6a90 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f8fd004dff0 tx=0x7f8fd000f000).ready entity=mon.0 client_cookie=f6f8962e98b90468 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fd57fa700 1 -- 172.21.15.27:0/978288285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00790d0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fd57fa700 1 -- 172.21.15.27:0/978288285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd004e450 con 0x564ee5e8e6b0 2023-05-17T15:09:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.469+0000 7f8fd57fa700 1 -- 172.21.15.27:0/978288285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd004abc0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/978288285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 msgr2=0x564ee5eb6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5eb6a90 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f8fd004dff0 tx=0x7f8fd000f000).stop 2023-05-17T15:09:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/978288285 shutdown_connections 2023-05-17T15:09:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5e89ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5eb6a90 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/978288285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5e8ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/978288285 >> 172.21.15.27:0/978288285 conn(0x564ee5c4be40 msgr2=0x564ee5ed77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/978288285 shutdown_connections 2023-05-17T15:09:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/978288285 wait complete. 2023-05-17T15:09:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 -- start start 2023-05-17T15:09:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.470+0000 7f8ff7d11b80 1 Processor -- start 2023-05-17T15:09:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5eb69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5ed8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5ed4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5da7ed0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5edba60 con 0x564ee5ed7350 2023-05-17T15:09:40.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee5ebb120 con 0x564ee5e89660 2023-05-17T15:09:40.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8ff7d11b80 10 client.0 ll_register_callbacks cb 0x564ee5e4e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:09:40.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8fdf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5ed8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8fdf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5ed8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41244/0 (socket says 172.21.15.27:41244) 2023-05-17T15:09:40.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.471+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/3120232879 learned_addr learned my addr 172.21.15.27:0/3120232879 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:40.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdffff700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5eb69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 msgr2=0x564ee5eb69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5eb69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fe491c700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5ed4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 msgr2=0x564ee5ed4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5ed4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdf7fe700 1 -- 172.21.15.27:0/3120232879 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00ae010 con 0x564ee5e8e6b0 2023-05-17T15:09:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5ed8b50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f8fc8011000 tx=0x7f8fc801e070).ready entity=mon.0 client_cookie=8b65fef67cf63149 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fbe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/3120232879 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800bed0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/3120232879 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8fc80276f0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ee5e86a40 con 0x564ee5e8e6b0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/3120232879 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc80278b0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 10 client.7275 fetch_fsmap learned FSMap version 44 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x564ee5dd9880 con 0x564ee5e8e6b0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/3120232879 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ee5e86a40 con 0x564ee5e8e6b0 2023-05-17T15:09:40.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/3120232879 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8fc8027a10 con 0x564ee5e8e6b0 2023-05-17T15:09:40.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 10 client.7275 fetch_fsmap finished waiting for FSMap version 44 2023-05-17T15:09:40.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 10 client.7275 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T15:09:40.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 20 client.7275 populate_metadata read hostname 'smithi027' 2023-05-17T15:09:40.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb87d0 0x564ee5eda720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 4 client.7275 mds_command: new command op to 7092 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:09:40.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 --> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ee5c47ca0 con 0x564ee5eb87d0 2023-05-17T15:09:40.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.472+0000 7f8fdffff700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb87d0 0x564ee5eda720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8fbe7fc700 10 client.7275 ms_handle_connect on v2:172.21.15.27:6833/1597094051 2023-05-17T15:09:40.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8fdffff700 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb87d0 0x564ee5eda720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=376b17a2520db89e server_cookie=d789130bf262130b in_seq=0 out_seq=0 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/3120232879 <== mds.0 v2:172.21.15.27:6833/1597094051 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x564ee5c47ca0 con 0x564ee5eb87d0 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8fbe7fc700 10 client.7275 handle_command_reply: tid=0 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 client.7275 shutdown 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 msgr2=0x564ee5ed8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5ed8b50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f8fc8011000 tx=0x7f8fc801e070).stop 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 shutdown_connections 2023-05-17T15:09:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb87d0 0x564ee5eda720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5ed7350 0x564ee5ed4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5eb69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8fbe7fc700 0 client.7275 ms_handle_reset on v2:172.21.15.27:6833/1597094051 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.473+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/3120232879 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5e8e6b0 0x564ee5ed8b50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.474+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 >> 172.21.15.27:0/3120232879 conn(0x564ee5c4be40 msgr2=0x564ee5e8c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.474+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 shutdown_connections 2023-05-17T15:09:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.474+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/3120232879 wait complete. 2023-05-17T15:09:40.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.474+0000 7f8ff7d11b80 20 client.7275 trim_cache size 0 max 16384 2023-05-17T15:09:40.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.490+0000 7f8ff7d11b80 1 Processor -- start 2023-05-17T15:09:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.490+0000 7f8ff7d11b80 1 -- start start 2023-05-17T15:09:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e89660 0x564ee5eba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e8e6b0 0x564ee5e90950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5ebc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5ee60c0 con 0x564ee5ed7350 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5e83070 con 0x564ee5e89660 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee5ed11b0 con 0x564ee5e8e6b0 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5ebc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5ebc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41252/0 (socket says 172.21.15.27:41252) 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 -- 172.21.15.27:0/1274564106 learned_addr learned my addr 172.21.15.27:0/1274564106 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e8e6b0 0x564ee5e90950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fdffff700 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e89660 0x564ee5eba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 -- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e8e6b0 msgr2=0x564ee5e90950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e8e6b0 0x564ee5e90950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 -- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e89660 msgr2=0x564ee5eba7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e89660 0x564ee5eba7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 -- 172.21.15.27:0/1274564106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ee5dd5070 con 0x564ee5ed7350 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e8e6b0 0x564ee5e90950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:09:40.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.491+0000 7f8fe491c700 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5ebc740 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f8fd800d710 tx=0x7f8fd8007a30).ready entity=mon.0 client_cookie=f3e0fa6a9f30ae94 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8fd5ffb700 1 -- 172.21.15.27:0/1274564106 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8007d50 con 0x564ee5ed7350 2023-05-17T15:09:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8fd5ffb700 1 -- 172.21.15.27:0/1274564106 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd8014040 con 0x564ee5ed7350 2023-05-17T15:09:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8fd5ffb700 1 -- 172.21.15.27:0/1274564106 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800a850 con 0x564ee5ed7350 2023-05-17T15:09:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1274564106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 msgr2=0x564ee5ebc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5ebc740 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f8fd800d710 tx=0x7f8fd8007a30).stop 2023-05-17T15:09:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1274564106 shutdown_connections 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5ebc740 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e89660 0x564ee5eba7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1274564106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e8e6b0 0x564ee5e90950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1274564106 >> 172.21.15.27:0/1274564106 conn(0x564ee5c4be40 msgr2=0x564ee5e83230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1274564106 shutdown_connections 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.492+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1274564106 wait complete. 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.493+0000 7f8ff7d11b80 1 -- start start 2023-05-17T15:09:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.493+0000 7f8ff7d11b80 1 Processor -- start 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5f32df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e8e6b0 0x564ee5eecd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5e89a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5f38d90 con 0x564ee5ed7350 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee5e8fc70 con 0x564ee5e8e6b0 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee5eb6af0 con 0x564ee5e89660 2023-05-17T15:09:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 10 client.0 ll_register_callbacks cb 0x564ee5e4e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5e89a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5e89a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41260/0 (socket says 172.21.15.27:41260) 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 -- 172.21.15.27:0/1466983082 learned_addr learned my addr 172.21.15.27:0/1466983082 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fdffff700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5f32df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fdf7fe700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e8e6b0 0x564ee5eecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 -- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 msgr2=0x564ee5f32df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5f32df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 -- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e8e6b0 msgr2=0x564ee5eecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e8e6b0 0x564ee5eecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 -- 172.21.15.27:0/1466983082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd800d440 con 0x564ee5ed7350 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fe491c700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5e89a40 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f8fd8007c30 tx=0x7f8fd801c000).ready entity=mon.0 client_cookie=b10d4da77c97ebb8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fbe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/1466983082 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800a620 con 0x564ee5ed7350 2023-05-17T15:09:40.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/1466983082 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8fd800a780 con 0x564ee5ed7350 2023-05-17T15:09:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fd004e450 con 0x564ee5ed7350 2023-05-17T15:09:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/1466983082 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd8023620 con 0x564ee5ed7350 2023-05-17T15:09:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 10 client.7281 fetch_fsmap learned FSMap version 44 2023-05-17T15:09:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.494+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x564ee5dd4dc0 con 0x564ee5ed7350 2023-05-17T15:09:40.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/1466983082 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd004e450 con 0x564ee5ed7350 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/1466983082 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8fd8017070 con 0x564ee5ed7350 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 10 client.7281 fetch_fsmap finished waiting for FSMap version 44 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 10 client.7281 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 20 client.7281 populate_metadata read hostname 'smithi027' 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb72b0 0x564ee5eb7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 4 client.7281 mds_command: new command op to 7092 tid=0[{"prefix": "status"}] 2023-05-17T15:09:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 --> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564ee5c7eca0 con 0x564ee5eb72b0 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fdffff700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb72b0 0x564ee5eb7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fbe7fc700 10 client.7281 ms_handle_connect on v2:172.21.15.27:6833/1597094051 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fdffff700 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb72b0 0x564ee5eb7690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=39c317a4877ec199 server_cookie=7003acba4275188e in_seq=0 out_seq=0 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fbe7fc700 1 -- 172.21.15.27:0/1466983082 <== mds.0 v2:172.21.15.27:6833/1597094051 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564ee5c7eca0 con 0x564ee5eb72b0 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fbe7fc700 10 client.7281 handle_command_reply: tid=0 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 client.7281 shutdown 2023-05-17T15:09:40.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 msgr2=0x564ee5e89a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5e89a40 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f8fd8007c30 tx=0x7f8fd801c000).stop 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 shutdown_connections 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:6833/1597094051,v1:172.21.15.27:6834/1597094051] conn(0x564ee5eb72b0 0x564ee5eb7690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ee5ed7350 0x564ee5e89a40 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x564ee5e89660 0x564ee5f32df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8fbe7fc700 0 client.7281 ms_handle_reset on v2:172.21.15.27:6833/1597094051 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 --2- 172.21.15.27:0/1466983082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ee5e8e6b0 0x564ee5eecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.495+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 >> 172.21.15.27:0/1466983082 conn(0x564ee5c4be40 msgr2=0x564ee5eba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 shutdown_connections 2023-05-17T15:09:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8ff7d11b80 1 -- 172.21.15.27:0/1466983082 wait complete. 2023-05-17T15:09:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8ff7d11b80 20 client.7281 trim_cache size 0 max 16384 2023-05-17T15:09:40.514 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 7092, 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:09:40.515 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 10.328082322, 2023-05-17T15:09:40.516 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 44, 2023-05-17T15:09:40.516 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 111, 2023-05-17T15:09:40.516 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 111, 2023-05-17T15:09:40.516 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 15.856189347999999 2023-05-17T15:09:40.516 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:09:40.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fc005ed90 msgr2=0x7f8fc0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fc005ed90 0x7f8fc0061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8fc800b340 tx=0x7f8fc8017000).stop 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 msgr2=0x7f8fe00ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe00ada30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f8fd0001eb0 tx=0x7f8fd0007e90).stop 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 shutdown_connections 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8fc005ed90 0x7f8fc0061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe01539c0 0x7f8fe0143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe00bfcd0 0x7f8fe00ada30 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 --2- 172.21.15.27:0/3822307649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe00c12e0 0x7f8fe00c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 >> 172.21.15.27:0/3822307649 conn(0x7f8fe005dd50 msgr2=0x7f8fe00a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 shutdown_connections 2023-05-17T15:09:40.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.496+0000 7f8fe511d700 1 -- 172.21.15.27:0/3822307649 wait complete. 2023-05-17T15:09:40.520 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:09:40.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.619+0000 7f2d15df0700 1 Processor -- start 2023-05-17T15:09:40.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.619+0000 7f2d15df0700 1 -- start start 2023-05-17T15:09:40.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d15df0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d15df0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2d100c8570 0x7f2d100c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d15df0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d10154f20 con 0x7f2d10153eb0 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d15df0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d101553b0 con 0x7f2d100c8570 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d15df0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10064820 con 0x7f2d10063eb0 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d14dee700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2d10153eb0 0x7f2d100c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40826/0 (socket says 172.21.15.27:40826) 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d14dee700 1 -- 172.21.15.27:0/3029551317 learned_addr learned my addr 172.21.15.27:0/3029551317 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d155ef700 1 --2- 172.21.15.27:0/3029551317 >> v2:172.21.15.27:3300/0 conn(0x7f2d100c8570 0x7f2d100c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d0ffff700 1 --2- 172.21.15.27:0/3029551317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d0f7fe700 1 -- 172.21.15.27:0/3029551317 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401568807 0 0) 0x7f2d10154f20 con 0x7f2d10153eb0 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d0f7fe700 1 -- 172.21.15.27:0/3029551317 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cfc0033f0 con 0x7f2d10153eb0 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d155ef700 1 -- 172.21.15.27:0/3029551317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 msgr2=0x7f2d10064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d155ef700 1 --2- 172.21.15.27:0/3029551317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10064330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d155ef700 1 -- 172.21.15.27:0/3029551317 >> v1:172.21.15.27:6789/0 conn(0x7f2d10153eb0 legacy=0x7f2d100c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.620+0000 7f2d155ef700 1 -- 172.21.15.27:0/3029551317 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d101545f0 con 0x7f2d100c8570 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d155ef700 1 --2- 172.21.15.27:0/3029551317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d100c8a00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f2cf8009760 tx=0x7f2cf8009060).ready entity=mon.0 client_cookie=3fd37783a949dced server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d0f7fe700 1 -- 172.21.15.27:0/3029551317 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800d4a0 con 0x7f2d100c8570 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d0f7fe700 1 -- 172.21.15.27:0/3029551317 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800d600 con 0x7f2d100c8570 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d0f7fe700 1 -- 172.21.15.27:0/3029551317 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800d980 con 0x7f2d100c8570 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 -- 172.21.15.27:0/3029551317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 msgr2=0x7f2d100c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 --2- 172.21.15.27:0/3029551317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d100c8a00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f2cf8009760 tx=0x7f2cf8009060).stop 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 -- 172.21.15.27:0/3029551317 shutdown_connections 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 --2- 172.21.15.27:0/3029551317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d100c8a00 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 --2- 172.21.15.27:0/3029551317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10064330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 -- 172.21.15.27:0/3029551317 >> 172.21.15.27:0/3029551317 conn(0x7f2d100cb490 msgr2=0x7f2d100c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 -- 172.21.15.27:0/3029551317 shutdown_connections 2023-05-17T15:09:40.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.621+0000 7f2d15df0700 1 -- 172.21.15.27:0/3029551317 wait complete. 2023-05-17T15:09:40.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.622+0000 7f2d15df0700 1 Processor -- start 2023-05-17T15:09:40.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 -- start start 2023-05-17T15:09:40.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d10156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d10153eb0 0x7f2d100c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10167000 con 0x7f2d100c8570 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10167e60 con 0x7f2d10153eb0 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d15df0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10167250 con 0x7f2d10063eb0 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d0ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d10156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d0ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d10156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41272/0 (socket says 172.21.15.27:41272) 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.623+0000 7f2d0ffff700 1 -- 172.21.15.27:0/1024267242 learned_addr learned my addr 172.21.15.27:0/1024267242 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d14dee700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d155ef700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d10153eb0 0x7f2d100c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0ffff700 1 -- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 msgr2=0x7f2d10159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0ffff700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0ffff700 1 -- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d10153eb0 msgr2=0x7f2d100c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0ffff700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d10153eb0 0x7f2d100c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0ffff700 1 -- 172.21.15.27:0/1024267242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80092a0 con 0x7f2d100c8570 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d14dee700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:40.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d155ef700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d10153eb0 0x7f2d100c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0ffff700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d10156a30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f2d00009ef0 tx=0x7f2d0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000cc50 con 0x7f2d100c8570 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000f040 con 0x7f2d100c8570 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10167530 con 0x7f2d100c8570 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00013400 con 0x7f2d100c8570 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.624+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d10167af0 con 0x7f2d100c8570 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.625+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1005e6a0 con 0x7f2d100c8570 2023-05-17T15:09:40.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.626+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2d00013770 con 0x7f2d100c8570 2023-05-17T15:09:40.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.626+0000 7f2d0cff9700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2cf005ed90 0x7f2cf0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:40.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.626+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f2d0007a640 con 0x7f2d100c8570 2023-05-17T15:09:40.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.626+0000 7f2d14dee700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2cf005ed90 0x7f2cf0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:40.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.626+0000 7f2d14dee700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2cf005ed90 0x7f2cf0061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2d101573d0 tx=0x7f2d08009040).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:40.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.630+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d0004bb90 con 0x7f2d100c8570 2023-05-17T15:09:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.848+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d10064b30 con 0x7f2d100c8570 2023-05-17T15:09:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.849+0000 7f2d0cff9700 1 -- 172.21.15.27:0/1024267242 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d0004f1b0 con 0x7f2d100c8570 2023-05-17T15:09:40.853 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:09:40.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2cf005ed90 msgr2=0x7f2cf0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2cf005ed90 0x7f2cf0061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2d101573d0 tx=0x7f2d08009040).stop 2023-05-17T15:09:40.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 msgr2=0x7f2d10156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:40.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d10156a30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f2d00009ef0 tx=0x7f2d0000b040).stop 2023-05-17T15:09:40.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 shutdown_connections 2023-05-17T15:09:40.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2cf005ed90 0x7f2cf0061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d10153eb0 0x7f2d100c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d10063eb0 0x7f2d10159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 --2- 172.21.15.27:0/1024267242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d100c8570 0x7f2d10156a30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:40.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 >> 172.21.15.27:0/1024267242 conn(0x7f2d100cb490 msgr2=0x7f2d10155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:40.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 shutdown_connections 2023-05-17T15:09:40.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:40.851+0000 7f2d15df0700 1 -- 172.21.15.27:0/1024267242 wait complete. 2023-05-17T15:09:40.865 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:09:40.866 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:09:40.866 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:09:40.866 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:09:40.866 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:40.867 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:09:40.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:09:40.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:09:40.868 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:09:40.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:40.870 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:09:40.887 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:09:40.887 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:09:40.887 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:09:40.887 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.887 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:09:40.888 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.888 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:09:40.888 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:40.888 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:09:40.888 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:40.888 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:09:40.889 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 41332sec preferred_lft 41332sec 2023-05-17T15:09:40.889 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:09:40.889 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.889 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:09:40.889 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:40.890 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:09:40.890 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:40.890 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:09:40.890 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:09:40.890 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:09:40.890 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.891 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:09:40.892 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:09:40.892 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:09:40.892 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:09:40.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:40.893 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:09:40.949 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:09:40.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:40.951 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:09:41.006 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:09:41.006 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:09:41.007 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:09:41.007 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:09:41.007 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:09:41.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:41.008 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:09:41.008 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:09:41.008 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:09:41.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:09:41.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:09:41.009 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:09:41.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:41.113 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:09:41.127 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:09:41.128 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:09:41.128 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:09:41.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:41.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:09:41.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:41.192 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:41.246 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:09:41.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:09:41.326 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:09:41.326 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:09:41.371 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:09:41.371 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:09:41.372 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:09:41.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:09:41.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:09:41.438 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:09:41.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.591+0000 7fc5d48ab700 1 Processor -- start 2023-05-17T15:09:41.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.591+0000 7fc5d48ab700 1 -- start start 2023-05-17T15:09:41.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5d48ab700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5d0154090 0x7fc5d0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5d48ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5d48ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5d0068f00 0x7fc5d00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5d48ab700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d0069fa0 con 0x7fc5d0154090 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5d48ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00698a0 con 0x7fc5d0068f00 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5d48ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c5a50 con 0x7fc5d00cb450 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5ce59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5d0154090 0x7fc5d0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5ce59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5d0154090 0x7fc5d0154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41284/0 (socket says 172.21.15.27:41284) 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.592+0000 7fc5ce59c700 1 -- 172.21.15.27:0/4144087817 learned_addr learned my addr 172.21.15.27:0/4144087817 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5cdd9b700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ced9d700 1 --2- 172.21.15.27:0/4144087817 >> v2:172.21.15.40:3300/0 conn(0x7fc5d0068f00 0x7fc5d00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ce59c700 1 -- 172.21.15.27:0/4144087817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 msgr2=0x7fc5d00cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ce59c700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ce59c700 1 -- 172.21.15.27:0/4144087817 >> v2:172.21.15.40:3300/0 conn(0x7fc5d0068f00 msgr2=0x7fc5d00693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ce59c700 1 --2- 172.21.15.27:0/4144087817 >> v2:172.21.15.40:3300/0 conn(0x7fc5d0068f00 0x7fc5d00693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ce59c700 1 -- 172.21.15.27:0/4144087817 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00c04e0 con 0x7fc5d0154090 2023-05-17T15:09:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5cdd9b700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ced9d700 1 --2- 172.21.15.27:0/4144087817 >> v2:172.21.15.40:3300/0 conn(0x7fc5d0068f00 0x7fc5d00693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5ce59c700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d0154470 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fc5c8006fd0 tx=0x7fc5c80090f0).ready entity=mon.0 client_cookie=9816f6f737067198 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5cd59a700 1 -- 172.21.15.27:0/4144087817 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800b600 con 0x7fc5d0154090 2023-05-17T15:09:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5cd59a700 1 -- 172.21.15.27:0/4144087817 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c800b760 con 0x7fc5d0154090 2023-05-17T15:09:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5cd59a700 1 -- 172.21.15.27:0/4144087817 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800bae0 con 0x7fc5d0154090 2023-05-17T15:09:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5d48ab700 1 -- 172.21.15.27:0/4144087817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 msgr2=0x7fc5d0154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.593+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d0154470 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fc5c8006fd0 tx=0x7fc5c80090f0).stop 2023-05-17T15:09:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 -- 172.21.15.27:0/4144087817 shutdown_connections 2023-05-17T15:09:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d0154470 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/4144087817 >> v2:172.21.15.40:3300/0 conn(0x7fc5d0068f00 0x7fc5d00693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/4144087817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 -- 172.21.15.27:0/4144087817 >> 172.21.15.27:0/4144087817 conn(0x7fc5d005e7e0 msgr2=0x7fc5d00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 -- 172.21.15.27:0/4144087817 shutdown_connections 2023-05-17T15:09:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.594+0000 7fc5d48ab700 1 -- 172.21.15.27:0/4144087817 wait complete. 2023-05-17T15:09:41.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.595+0000 7fc5d48ab700 1 Processor -- start 2023-05-17T15:09:41.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.595+0000 7fc5d48ab700 1 -- start start 2023-05-17T15:09:41.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.595+0000 7fc5d48ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d0068f00 0x7fc5d014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.595+0000 7fc5d48ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5d48ab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d00b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5d48ab700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d014cef0 con 0x7fc5d0154090 2023-05-17T15:09:41.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5d48ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0155740 con 0x7fc5d0068f00 2023-05-17T15:09:41.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5d48ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0154b30 con 0x7fc5d00cb450 2023-05-17T15:09:41.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d00b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d00b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41294/0 (socket says 172.21.15.27:41294) 2023-05-17T15:09:41.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 -- 172.21.15.27:0/266189870 learned_addr learned my addr 172.21.15.27:0/266189870 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:41.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ce59c700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d0068f00 0x7fc5d014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5cdd9b700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 -- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 msgr2=0x7fc5d00b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 -- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d0068f00 msgr2=0x7fc5d014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d0068f00 0x7fc5d014ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 -- 172.21.15.27:0/266189870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009370 con 0x7fc5d0154090 2023-05-17T15:09:41.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5ced9d700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d00b09d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fc5c000d1b0 tx=0x7fc5c0009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:41.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000dcf0 con 0x7fc5d0154090 2023-05-17T15:09:41.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000f040 con 0x7fc5d0154090 2023-05-17T15:09:41.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d0154e10 con 0x7fc5d0154090 2023-05-17T15:09:41.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0013600 con 0x7fc5d0154090 2023-05-17T15:09:41.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.596+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01553d0 con 0x7fc5d0154090 2023-05-17T15:09:41.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.597+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d01558d0 con 0x7fc5d0154090 2023-05-17T15:09:41.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.598+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc5c00139b0 con 0x7fc5d0154090 2023-05-17T15:09:41.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.598+0000 7fc5c67fc700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5b005ed60 0x7fc5b0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.598+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fc5c007a2a0 con 0x7fc5d0154090 2023-05-17T15:09:41.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.598+0000 7fc5ce59c700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5b005ed60 0x7fc5b0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.598+0000 7fc5ce59c700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5b005ed60 0x7fc5b0061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5c8009130 tx=0x7fc5c8017000).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:41.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.602+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5c004b7f0 con 0x7fc5d0154090 2023-05-17T15:09:41.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.801+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d006c350 con 0x7fc5b005ed60 2023-05-17T15:09:41.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.802+0000 7fc5c67fc700 1 -- 172.21.15.27:0/266189870 <== mgr.6933 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc5d006c350 con 0x7fc5b005ed60 2023-05-17T15:09:41.806 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:09:41.806 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:09:41.806 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:09:41.806 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:09:41.807 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:09:41.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5b005ed60 msgr2=0x7fc5b0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5b005ed60 0x7fc5b0061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5c8009130 tx=0x7fc5c8017000).stop 2023-05-17T15:09:41.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 msgr2=0x7fc5d00b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d00b09d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fc5c000d1b0 tx=0x7fc5c0009a50).stop 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 shutdown_connections 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5b005ed60 0x7fc5b0061220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5d0154090 0x7fc5d00b09d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d0068f00 0x7fc5d014ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 --2- 172.21.15.27:0/266189870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5d00cb450 0x7fc5d00b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 >> 172.21.15.27:0/266189870 conn(0x7fc5d005e7e0 msgr2=0x7fc5d014d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 shutdown_connections 2023-05-17T15:09:41.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.804+0000 7fc5d48ab700 1 -- 172.21.15.27:0/266189870 wait complete. 2023-05-17T15:09:41.820 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:09:41.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.934+0000 7f7ca759e700 1 Processor -- start 2023-05-17T15:09:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.934+0000 7f7ca759e700 1 -- start start 2023-05-17T15:09:41.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 0x7f7ca80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca8158010 con 0x7f7ca8157980 2023-05-17T15:09:41.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca81582f0 con 0x7f7ca80cac00 2023-05-17T15:09:41.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca81588b0 con 0x7f7ca8153ef0 2023-05-17T15:09:41.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca6d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7ca8157980 0x7f7ca80c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40864/0 (socket says 172.21.15.27:40864) 2023-05-17T15:09:41.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1067565162 learned_addr learned my addr 172.21.15.27:0/1067565162 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca5d9b700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 0x7f7ca80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588263584 0 0) 0x7f7ca8158010 con 0x7f7ca8157980 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c940033f0 con 0x7f7ca8157980 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281943538 0 0) 0x7f7ca81582f0 con 0x7f7ca80cac00 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca8158010 con 0x7f7ca80cac00 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909451544 0 0) 0x7f7c940033f0 con 0x7f7ca8157980 2023-05-17T15:09:41.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 msgr2=0x7f7ca80cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 0x7f7ca80cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 >> v1:172.21.15.40:6789/0 conn(0x7f7ca80cac00 legacy=0x7f7ca81537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca81585d0 con 0x7f7ca8157980 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f7c980017f0 con 0x7f7ca8157980 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 >> v1:172.21.15.27:6789/0 conn(0x7f7ca8157980 legacy=0x7f7ca80c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94003aa0 0x7f7c94003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 0x7f7c94004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c94004b80 0x7f7c94005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca81588b0 con 0x7f7c94004b80 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9400b990 con 0x7f7c94003aa0 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.935+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9400bb00 con 0x7f7ca8153ef0 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c94004b80 0x7f7c94005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca5d9b700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 0x7f7c94004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca659c700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94003aa0 0x7f7c94003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 msgr2=0x7f7c94004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8153ef0 0x7f7c94004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94003aa0 msgr2=0x7f7c94003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94003aa0 0x7f7c94003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1067565162 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940033f0 con 0x7f7c94004b80 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c94004b80 0x7f7c94005000 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f7c9800c410 tx=0x7f7c98007f40).ready entity=mon.0 client_cookie=7f7699ab08ecf911 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800cce0 con 0x7f7c94004b80 2023-05-17T15:09:41.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800ce40 con 0x7f7c94004b80 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.936+0000 7f7ca559a700 1 -- 172.21.15.27:0/1067565162 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005d70 con 0x7f7c94004b80 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca759e700 1 -- 172.21.15.27:0/1067565162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c94004b80 msgr2=0x7f7c94005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1067565162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c94004b80 0x7f7c94005000 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f7c9800c410 tx=0x7f7c98007f40).stop 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1067565162 reap_dead start 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca759e700 1 -- 172.21.15.27:0/1067565162 shutdown_connections 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca759e700 1 -- 172.21.15.27:0/1067565162 >> 172.21.15.27:0/1067565162 conn(0x7f7ca805dd50 msgr2=0x7f7ca805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:41.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca759e700 1 -- 172.21.15.27:0/1067565162 shutdown_connections 2023-05-17T15:09:41.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.937+0000 7f7ca759e700 1 -- 172.21.15.27:0/1067565162 wait complete. 2023-05-17T15:09:41.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.938+0000 7f7ca759e700 1 Processor -- start 2023-05-17T15:09:41.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.938+0000 7f7ca759e700 1 -- start start 2023-05-17T15:09:41.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94004b80 0x7f7ca80c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8166d60 0x7f7ca8165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 0x7f7ca80ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca81668d0 con 0x7f7ca8165730 2023-05-17T15:09:41.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca8165cc0 con 0x7f7c94004b80 2023-05-17T15:09:41.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca8165fa0 con 0x7f7ca8166d60 2023-05-17T15:09:41.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 0x7f7ca80ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 0x7f7ca80ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41314/0 (socket says 172.21.15.27:41314) 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1853542559 learned_addr learned my addr 172.21.15.27:0/1853542559 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca659c700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94004b80 0x7f7ca80c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca5d9b700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8166d60 0x7f7ca8165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8166d60 msgr2=0x7f7ca8165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8166d60 0x7f7ca8165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94004b80 msgr2=0x7f7ca80c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94004b80 0x7f7ca80c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 -- 172.21.15.27:0/1853542559 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8166280 con 0x7f7ca8165730 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca6d9d700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 0x7f7ca80ac380 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f7c98002250 tx=0x7f7c98015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c980016f0 con 0x7f7ca8165730 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98004a30 con 0x7f7ca8165730 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98004df0 con 0x7f7ca8165730 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca8166560 con 0x7f7ca8165730 2023-05-17T15:09:41.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.939+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81671e0 con 0x7f7ca8165730 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.940+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca81673d0 con 0x7f7ca8165730 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.941+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7c9801d070 con 0x7f7ca8165730 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.941+0000 7f7c9e7fc700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7c8805ed90 0x7f7c88061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.941+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f7c9807a2e0 con 0x7f7ca8165730 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.941+0000 7f7ca659c700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7c8805ed90 0x7f7c88061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.942+0000 7f7ca659c700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7c8805ed90 0x7f7c88061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7ca0000c00 tx=0x7f7ca0007bb0).ready entity=mgr.6933 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:41.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:41.945+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ca81673d0 con 0x7f7ca8165730 2023-05-17T15:09:42.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.166+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f7ca81673d0 con 0x7f7ca8165730 2023-05-17T15:09:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.700+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f7c98010070 con 0x7f7ca8165730 2023-05-17T15:09:42.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.702+0000 7f7c9e7fc700 1 -- 172.21.15.27:0/1853542559 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7f7c980403a0 con 0x7f7ca8165730 2023-05-17T15:09:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7c8805ed90 msgr2=0x7f7c88061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:42.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7c8805ed90 0x7f7c88061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7ca0000c00 tx=0x7f7ca0007bb0).stop 2023-05-17T15:09:42.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 msgr2=0x7f7ca80ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:42.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 0x7f7ca80ac380 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f7c98002250 tx=0x7f7c98015000).stop 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 shutdown_connections 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7c8805ed90 0x7f7c88061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ca8165730 0x7f7ca80ac380 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c94004b80 0x7f7ca80c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 --2- 172.21.15.27:0/1853542559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ca8166d60 0x7f7ca8165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 >> 172.21.15.27:0/1853542559 conn(0x7f7ca805dd50 msgr2=0x7f7ca80c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 shutdown_connections 2023-05-17T15:09:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.704+0000 7f7ca759e700 1 -- 172.21.15.27:0/1853542559 wait complete. 2023-05-17T15:09:42.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:09:42.849 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:42.845+0000 7f5b70e58680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:09:42.854 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:42.851+0000 7fc9c5ff6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:09:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.852+0000 7f302d344700 1 Processor -- start 2023-05-17T15:09:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.852+0000 7f302d344700 1 -- start start 2023-05-17T15:09:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f302d344700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30281543d0 0x7f30280c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f302d344700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3028069410 0x7f30280bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f302d344700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3028158790 con 0x7f30280c60f0 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f302d344700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280c1c50 con 0x7f30281543d0 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f302d344700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280c6570 con 0x7f3028069410 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30281543d0 0x7f30280c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f30281543d0 0x7f30280c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41344/0 (socket says 172.21.15.27:41344) 2023-05-17T15:09:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 -- 172.21.15.27:0/3663709856 learned_addr learned my addr 172.21.15.27:0/3663709856 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:42.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f30277fe700 1 --2- 172.21.15.27:0/3663709856 >> v2:172.21.15.40:3300/0 conn(0x7f3028069410 0x7f30280bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:42.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 -- 172.21.15.27:0/3663709856 >> v2:172.21.15.40:3300/0 conn(0x7f3028069410 msgr2=0x7f30280bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:42.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 --2- 172.21.15.27:0/3663709856 >> v2:172.21.15.40:3300/0 conn(0x7f3028069410 0x7f30280bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 -- 172.21.15.27:0/3663709856 >> v1:172.21.15.40:6789/0 conn(0x7f30280c60f0 legacy=0x7f3028068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:42.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.853+0000 7f3026ffd700 1 -- 172.21.15.27:0/3663709856 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028157e60 con 0x7f30281543d0 2023-05-17T15:09:42.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f3026ffd700 1 --2- 172.21.15.27:0/3663709856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30281543d0 0x7f30280c5c00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f3028155920 tx=0x7f30180090f0).ready entity=mon.0 client_cookie=233d19ce73dec8a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f3025ffb700 1 -- 172.21.15.27:0/3663709856 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800b520 con 0x7f30281543d0 2023-05-17T15:09:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f3025ffb700 1 -- 172.21.15.27:0/3663709856 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301800b680 con 0x7f30281543d0 2023-05-17T15:09:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f3025ffb700 1 -- 172.21.15.27:0/3663709856 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800ba00 con 0x7f30281543d0 2023-05-17T15:09:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 -- 172.21.15.27:0/3663709856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30281543d0 msgr2=0x7f30280c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 --2- 172.21.15.27:0/3663709856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30281543d0 0x7f30280c5c00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f3028155920 tx=0x7f30180090f0).stop 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 -- 172.21.15.27:0/3663709856 shutdown_connections 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 --2- 172.21.15.27:0/3663709856 >> v2:172.21.15.40:3300/0 conn(0x7f3028069410 0x7f30280bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 --2- 172.21.15.27:0/3663709856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30281543d0 0x7f30280c5c00 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 -- 172.21.15.27:0/3663709856 >> 172.21.15.27:0/3663709856 conn(0x7f30280cb7f0 msgr2=0x7f30280c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 -- 172.21.15.27:0/3663709856 shutdown_connections 2023-05-17T15:09:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.854+0000 7f302d344700 1 -- 172.21.15.27:0/3663709856 wait complete. 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 Processor -- start 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 -- start start 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 0x7f30280c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280c60f0 0x7f30280affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30281543d0 0x7f30280ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280afb20 con 0x7f3028069410 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280aef10 con 0x7f30280c60f0 2023-05-17T15:09:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f302d344700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30280af1f0 con 0x7f30281543d0 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.856+0000 7f3026ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 0x7f30280c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 0x7f30280c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41350/0 (socket says 172.21.15.27:41350) 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 -- 172.21.15.27:0/1943865318 learned_addr learned my addr 172.21.15.27:0/1943865318 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f30277fe700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30281543d0 0x7f30280ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f30267fc700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280c60f0 0x7f30280affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 -- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30281543d0 msgr2=0x7f30280ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30281543d0 0x7f30280ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 -- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280c60f0 msgr2=0x7f30280affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280c60f0 0x7f30280affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 -- 172.21.15.27:0/1943865318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009370 con 0x7f3028069410 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f3026ffd700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 0x7f30280c4920 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f3028083d00 tx=0x7f3018017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018000bc0 con 0x7f3028069410 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301800b7f0 con 0x7f3028069410 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018000d20 con 0x7f3028069410 2023-05-17T15:09:42.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30280af4d0 con 0x7f3028069410 2023-05-17T15:09:42.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.857+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30280b04a0 con 0x7f3028069410 2023-05-17T15:09:42.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.858+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f3018023030 con 0x7f3028069410 2023-05-17T15:09:42.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.858+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30280afe00 con 0x7f3028069410 2023-05-17T15:09:42.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.859+0000 7f301effd700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f300805ede0 0x7f30080612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:42.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.859+0000 7f30267fc700 1 -- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f300805ede0 msgr2=0x7f30080612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:42.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.859+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f301807a830 con 0x7f3028069410 2023-05-17T15:09:42.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.859+0000 7f30267fc700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f300805ede0 0x7f30080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:42.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:42.863+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f301804be30 con 0x7f3028069410 2023-05-17T15:09:42.914 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:42.911+0000 7f5b70e58680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:09:42.930 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:42.926+0000 7fc9c5ff6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:09:43.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.047+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f302806bdf0 con 0x7f3028069410 2023-05-17T15:09:43.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.050+0000 7f301effd700 1 -- 172.21.15.27:0/1943865318 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3018021070 con 0x7f3028069410 2023-05-17T15:09:43.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f300805ede0 msgr2=0x7f30080612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:43.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f300805ede0 0x7f30080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:43.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 msgr2=0x7f30280c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:43.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 0x7f30280c4920 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f3028083d00 tx=0x7f3018017000).stop 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 shutdown_connections 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f300805ede0 0x7f30080612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30281543d0 0x7f30280ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3028069410 0x7f30280c4920 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 --2- 172.21.15.27:0/1943865318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280c60f0 0x7f30280affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 >> 172.21.15.27:0/1943865318 conn(0x7f30280cb7f0 msgr2=0x7f30280bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 shutdown_connections 2023-05-17T15:09:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.052+0000 7f302d344700 1 -- 172.21.15.27:0/1943865318 wait complete. 2023-05-17T15:09:43.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:43.069 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:09:43.088 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-17T15:09:43.199 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:43.195+0000 7f5b70e58680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:09:43.220 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:43.216+0000 7fc9c5ff6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:09:43.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.249+0000 7f21fda65700 1 Processor -- start 2023-05-17T15:09:43.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.249+0000 7f21fda65700 1 -- start start 2023-05-17T15:09:43.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fda65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f80c1080 0x7f21f80c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:43.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fda65700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21f80c5d60 0x7f21f80c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:43.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fda65700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8154a50 con 0x7f21f8154520 2023-05-17T15:09:43.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fda65700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f8154d30 con 0x7f21f80c5d60 2023-05-17T15:09:43.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fda65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8155010 con 0x7f21f80c1080 2023-05-17T15:09:43.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21f80c5d60 0x7f21f80c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:43.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fca63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f80c1080 0x7f21f80c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21f80c5d60 0x7f21f80c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:59310/0 (socket says 172.21.15.27:59310) 2023-05-17T15:09:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 -- 172.21.15.27:0/3650997140 learned_addr learned my addr 172.21.15.27:0/3650997140 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21f7fff700 1 --1- 172.21.15.27:0/3650997140 >> v1:172.21.15.40:6789/0 conn(0x7f21f8154520 0x7f21f80c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:46942/0 (socket says 172.21.15.27:46942) 2023-05-17T15:09:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 -- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f80c1080 msgr2=0x7f21f80c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 --2- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f80c1080 0x7f21f80c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 -- 172.21.15.27:0/3650997140 >> v1:172.21.15.40:6789/0 conn(0x7f21f8154520 legacy=0x7f21f80c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:43.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 -- 172.21.15.27:0/3650997140 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f81552f0 con 0x7f21f80c5d60 2023-05-17T15:09:43.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fca63700 1 --2- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f80c1080 0x7f21f80c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:43.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.250+0000 7f21fd264700 1 --2- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c5d60 0x7f21f80c61f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f21f0009f20 tx=0x7f21f0009840).ready entity=mon.1 client_cookie=2115745c8abf9d79 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:43.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21f77fe700 1 -- 172.21.15.27:0/3650997140 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000e070 con 0x7f21f80c5d60 2023-05-17T15:09:43.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21f77fe700 1 -- 172.21.15.27:0/3650997140 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f000b9d0 con 0x7f21f80c5d60 2023-05-17T15:09:43.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21f77fe700 1 -- 172.21.15.27:0/3650997140 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000bd50 con 0x7f21f80c5d60 2023-05-17T15:09:43.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 -- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c5d60 msgr2=0x7f21f80c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:43.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 --2- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c5d60 0x7f21f80c61f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f21f0009f20 tx=0x7f21f0009840).stop 2023-05-17T15:09:43.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 -- 172.21.15.27:0/3650997140 shutdown_connections 2023-05-17T15:09:43.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 --2- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c5d60 0x7f21f80c61f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 --2- 172.21.15.27:0/3650997140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f80c1080 0x7f21f80c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 -- 172.21.15.27:0/3650997140 >> 172.21.15.27:0/3650997140 conn(0x7f21f805dd50 msgr2=0x7f21f805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:43.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 -- 172.21.15.27:0/3650997140 shutdown_connections 2023-05-17T15:09:43.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.251+0000 7f21fda65700 1 -- 172.21.15.27:0/3650997140 wait complete. 2023-05-17T15:09:43.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.252+0000 7f21fda65700 1 Processor -- start 2023-05-17T15:09:43.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.252+0000 7f21fda65700 1 -- start start 2023-05-17T15:09:43.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fda65700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c1080 0x7f21f80ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:43.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fda65700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 0x7f21f814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:43.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fda65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f8154520 0x7f21f80ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:43.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fda65700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80adf00 con 0x7f21f80c5d60 2023-05-17T15:09:43.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fda65700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8165340 con 0x7f21f80c1080 2023-05-17T15:09:43.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fda65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cb8b0 con 0x7f21f8154520 2023-05-17T15:09:43.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 0x7f21f814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:43.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 0x7f21f814d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41384/0 (socket says 172.21.15.27:41384) 2023-05-17T15:09:43.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21f7fff700 1 -- 172.21.15.27:0/554055642 learned_addr learned my addr 172.21.15.27:0/554055642 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:43.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c1080 0x7f21f80ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:43.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.253+0000 7f21fd264700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f8154520 0x7f21f80ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:43.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f7fff700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f8154520 msgr2=0x7f21f80ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:43.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f7fff700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f8154520 0x7f21f80ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f7fff700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c1080 msgr2=0x7f21f80ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:43.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f7fff700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c1080 0x7f21f80ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:43.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f7fff700 1 -- 172.21.15.27:0/554055642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec0092a0 con 0x7f21f80c5d60 2023-05-17T15:09:43.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c1080 0x7f21f80ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:09:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f7fff700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 0x7f21f814d0a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f21e400c440 tx=0x7f21e4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40070d0 con 0x7f21f80c5d60 2023-05-17T15:09:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4007230 con 0x7f21f80c5d60 2023-05-17T15:09:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f0009ae0 con 0x7f21f80c5d60 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40075b0 con 0x7f21f80c5d60 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.254+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8164730 con 0x7f21f80c5d60 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.255+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8047150 con 0x7f21f80c5d60 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.255+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f21e401a060 con 0x7f21f80c5d60 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.256+0000 7f21f4ff9700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.256+0000 7f21fca63700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.256+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f21e4079100 con 0x7f21f80c5d60 2023-05-17T15:09:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.256+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:09:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.260+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21e404a650 con 0x7f21f80c5d60 2023-05-17T15:09:43.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.457+0000 7f21fca63700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:43.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.457+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:09:43.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.459+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f21f8068800 con 0x7f21dc05ee10 2023-05-17T15:09:43.853 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:43.850+0000 7f5b70e58680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:09:43.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.858+0000 7f21fca63700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:43.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:43.858+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:09:43.885 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:43.881+0000 7fc9c5ff6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:09:43.921 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:43.918+0000 7f5b70e58680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:09:43.953 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:43.950+0000 7fc9c5ff6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:09:44.113 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:44.110+0000 7f5b70e58680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:09:44.146 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:44.142+0000 7fc9c5ff6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:09:44.546 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:44.543+0000 7f5b70e58680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:09:44.582 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:44.579+0000 7fc9c5ff6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:09:44.654 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:44.650+0000 7f5b70e58680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:44.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:44.659+0000 7f21fca63700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:44.659+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:09:44.691 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:44.687+0000 7fc9c5ff6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:44.812 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:44.809+0000 7f5b70e58680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:44.849 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:44.846+0000 7fc9c5ff6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:44.890 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:44.886+0000 7f5b70e58680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:09:44.927 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:44.923+0000 7fc9c5ff6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:09:44.959 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:44.956+0000 7f5b70e58680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:09:44.996 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:44.993+0000 7fc9c5ff6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:09:45.228 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:45.224+0000 7f5b70e58680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:09:45.267 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:45.263+0000 7fc9c5ff6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:09:45.418 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:45.414+0000 7f5b70e58680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:45.456 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:45.453+0000 7fc9c5ff6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:09:46.095 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.091+0000 7f5b70e58680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:09:46.140 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.136+0000 7fc9c5ff6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:09:46.165 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.161+0000 7f5b70e58680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:09:46.213 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.209+0000 7fc9c5ff6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:09:46.243 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.240+0000 7f5b70e58680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:09:46.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:46.260+0000 7f21fca63700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:09:46.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:46.260+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:09:46.291 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.287+0000 7fc9c5ff6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:09:46.394 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.390+0000 7f5b70e58680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:09:46.443 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.439+0000 7fc9c5ff6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:09:46.466 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.462+0000 7f5b70e58680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:09:46.516 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.512+0000 7fc9c5ff6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:09:46.584 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.580+0000 7f5b70e58680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:09:46.636 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.632+0000 7fc9c5ff6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:09:46.695 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.691+0000 7f5b70e58680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:46.748 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:46.745+0000 7fc9c5ff6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:09:46.993 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:46.989+0000 7f5b70e58680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:09:47.049 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:47.045+0000 7fc9c5ff6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:09:47.066 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:09:47.062+0000 7f5b70e58680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:09:47.122 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:47.119+0000 7fc9c5ff6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:09:47.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:47.131+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 40) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f21e4010070 con 0x7f21f80c5d60 2023-05-17T15:09:48.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:48.135+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 41) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f21e4077330 con 0x7f21f80c5d60 2023-05-17T15:09:48.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:48.135+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc0612d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:09:48.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:48.135+0000 7f21f4ff9700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:09:48.215 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc9447d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.216 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc9447d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.216 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc9447d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.216 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc9447d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.216 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc9447d8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.216 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc940fd1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.217 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc940fd1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.217 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc940fd1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.217 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc940fd1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:48.217 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:09:48.211+0000 7fc940fd1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:09:49.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.148+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mon.0 v2:172.21.15.27:3300/0 9 ==== mgrmap(e 42) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f21e40459d0 con 0x7f21f80c5d60 2023-05-17T15:09:49.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.149+0000 7f21f4ff9700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.149+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f21f8068800 con 0x7f21dc05ee10 2023-05-17T15:09:49.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.150+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.151+0000 7f21fca63700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc061250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f21ec009b00 tx=0x7f21ec009060).ready entity=mgr.7317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:49.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.162+0000 7f21f4ff9700 1 -- 172.21.15.27:0/554055642 <== mgr.7317 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f21f8068800 con 0x7f21dc05ee10 2023-05-17T15:09:49.166 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path snap_test_dir1 2023-05-17T15:09:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.164+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 msgr2=0x7f21dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.164+0000 7f21fda65700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc061250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f21ec009b00 tx=0x7f21ec009060).stop 2023-05-17T15:09:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.164+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 msgr2=0x7f21f814d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.164+0000 7f21fda65700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 0x7f21f814d0a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f21e400c440 tx=0x7f21e4007d90).stop 2023-05-17T15:09:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 shutdown_connections 2023-05-17T15:09:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f21dc05ee10 0x7f21dc061250 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21f8154520 0x7f21f80ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21f80c1080 0x7f21f80ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 --2- 172.21.15.27:0/554055642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21f80c5d60 0x7f21f814d0a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 >> 172.21.15.27:0/554055642 conn(0x7f21f805dd50 msgr2=0x7f21f8155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 shutdown_connections 2023-05-17T15:09:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.165+0000 7f21fda65700 1 -- 172.21.15.27:0/554055642 wait complete. 2023-05-17T15:09:49.183 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-17T15:09:49.183 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-17-15_10_00 in ~11s... 2023-05-17T15:09:49.184 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-05-17T15:09:49.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-17T15:09:49.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.307+0000 7f4de9cf3700 1 Processor -- start 2023-05-17T15:09:49.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.307+0000 7f4de9cf3700 1 -- start start 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de9cf3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 0x7f4de40a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de9cf3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de4154a50 con 0x7f4de40c1080 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de9cf3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de4154d30 con 0x7f4de4154520 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de9cf3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4155010 con 0x7f4de40c1460 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de8cf1700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4de40c1080 0x7f4de40c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41124/0 (socket says 172.21.15.27:41124) 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de8cf1700 1 -- 172.21.15.27:0/1579950399 learned_addr learned my addr 172.21.15.27:0/1579950399 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:09:49.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de94f2700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 0x7f4de40a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368133100 0 0) 0x7f4de4154a50 con 0x7f4de40c1080 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd40033f0 con 0x7f4de40c1080 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 546923940 0 0) 0x7f4dd40033f0 con 0x7f4de40c1080 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 msgr2=0x7f4de40a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 0x7f4de40a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 >> v1:172.21.15.40:6789/0 conn(0x7f4de4154520 legacy=0x7f4de40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de41552f0 con 0x7f4de40c1080 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f4dd8001470 con 0x7f4de40c1080 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 >> v1:172.21.15.27:6789/0 conn(0x7f4de40c1080 legacy=0x7f4de40c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4003910 0x7f4dd4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dd4004690 0x7f4dd4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 0x7f4dd4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4155010 con 0x7f4dd4004690 2023-05-17T15:09:49.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd400b910 con 0x7f4dd4003910 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.308+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd400bad0 con 0x7f4de40c1460 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dd4004690 0x7f4dd4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de8cf1700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4003910 0x7f4dd4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de94f2700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 0x7f4dd4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 -- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 msgr2=0x7f4dd4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40c1460 0x7f4dd4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 -- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4003910 msgr2=0x7f4dd4003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:09:49.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4003910 0x7f4dd4003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 -- 172.21.15.27:0/1579950399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40033f0 con 0x7f4dd4004690 2023-05-17T15:09:49.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de3fff700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dd4004690 0x7f4dd4004b10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f4dd0001730 tx=0x7f4dd0007bb0).ready entity=mon.0 client_cookie=b24a15a2727f2c8b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:49.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0007020 con 0x7f4dd4004690 2023-05-17T15:09:49.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0007180 con 0x7f4dd4004690 2023-05-17T15:09:49.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de37fe700 1 -- 172.21.15.27:0/1579950399 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0007500 con 0x7f4dd4004690 2023-05-17T15:09:49.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de9cf3700 1 -- 172.21.15.27:0/1579950399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dd4004690 msgr2=0x7f4dd4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/1579950399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dd4004690 0x7f4dd4004b10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f4dd0001730 tx=0x7f4dd0007bb0).stop 2023-05-17T15:09:49.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.309+0000 7f4de94f2700 1 -- 172.21.15.27:0/1579950399 reap_dead start 2023-05-17T15:09:49.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.310+0000 7f4de9cf3700 1 -- 172.21.15.27:0/1579950399 shutdown_connections 2023-05-17T15:09:49.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.310+0000 7f4de9cf3700 1 -- 172.21.15.27:0/1579950399 >> 172.21.15.27:0/1579950399 conn(0x7f4de405dd50 msgr2=0x7f4de405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:49.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.310+0000 7f4de9cf3700 1 -- 172.21.15.27:0/1579950399 shutdown_connections 2023-05-17T15:09:49.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.310+0000 7f4de9cf3700 1 -- 172.21.15.27:0/1579950399 wait complete. 2023-05-17T15:09:49.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.311+0000 7f4de9cf3700 1 Processor -- start 2023-05-17T15:09:49.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.311+0000 7f4de9cf3700 1 -- start start 2023-05-17T15:09:49.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4004690 0x7f4de40cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 0x7f4de41466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40ada10 0x7f4de41470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40abdb0 con 0x7f4de40aac30 2023-05-17T15:09:49.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40ab1a0 con 0x7f4dd4004690 2023-05-17T15:09:49.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40ab480 con 0x7f4de40ada10 2023-05-17T15:09:49.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 0x7f4de41466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 0x7f4de41466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41576/0 (socket says 172.21.15.27:41576) 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 -- 172.21.15.27:0/3816842218 learned_addr learned my addr 172.21.15.27:0/3816842218 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de94f2700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40ada10 0x7f4de41470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de8cf1700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4004690 0x7f4de40cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 -- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40ada10 msgr2=0x7f4de41470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40ada10 0x7f4de41470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 -- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4004690 msgr2=0x7f4de40cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4004690 0x7f4de40cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 -- 172.21.15.27:0/3816842218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40ab760 con 0x7f4de40aac30 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de94f2700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40ada10 0x7f4de41470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de3fff700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 0x7f4de41466c0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f4dd400b8e0 tx=0x7f4dd0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0006ff0 con 0x7f4de40aac30 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0013670 con 0x7f4de40aac30 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0013a30 con 0x7f4de40aac30 2023-05-17T15:09:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de40aba40 con 0x7f4de40aac30 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.312+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de4146bb0 con 0x7f4de40aac30 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.313+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de4047150 con 0x7f4de40aac30 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.314+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 42) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f4dd001d070 con 0x7f4de40aac30 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.314+0000 7f4de0ff9700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4dc805ee30 0x7f4dc80612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.314+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f4dd007a750 con 0x7f4de40aac30 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.314+0000 7f4de8cf1700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4dc805ee30 0x7f4dc80612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:09:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.314+0000 7f4de8cf1700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4dc805ee30 0x7f4dc80612f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4dd8001200 tx=0x7f4dd8009040).ready entity=mgr.7317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:09:49.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.318+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4dd004bb30 con 0x7f4de40aac30 2023-05-17T15:09:49.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.515+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4de4153490 con 0x7f4dc805ee30 2023-05-17T15:09:49.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.518+0000 7f4de0ff9700 1 -- 172.21.15.27:0/3816842218 <== mgr.7317 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f4de4153490 con 0x7f4dc805ee30 2023-05-17T15:09:49.522 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:09:49.522 INFO:teuthology.orchestra.run.smithi027.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-05-17T15:09:49.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.519+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4dc805ee30 msgr2=0x7f4dc80612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.519+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4dc805ee30 0x7f4dc80612f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4dd8001200 tx=0x7f4dd8009040).stop 2023-05-17T15:09:49.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.519+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 msgr2=0x7f4de41466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:09:49.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.519+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 0x7f4de41466c0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f4dd400b8e0 tx=0x7f4dd0015000).stop 2023-05-17T15:09:49.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 shutdown_connections 2023-05-17T15:09:49.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4dc805ee30 0x7f4dc80612f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de40ada10 0x7f4de41470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dd4004690 0x7f4de40cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 --2- 172.21.15.27:0/3816842218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4de40aac30 0x7f4de41466c0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:09:49.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 >> 172.21.15.27:0/3816842218 conn(0x7f4de405dd50 msgr2=0x7f4de41514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:09:49.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 shutdown_connections 2023-05-17T15:09:49.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:09:49.520+0000 7f4de9cf3700 1 -- 172.21.15.27:0/3816842218 wait complete. 2023-05-17T15:09:49.535 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-05-17T15:09:49.536 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-05-17T15:09:49.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:49.536 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:50.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:50.553 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:51.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:51.574 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:52.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:52.595 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:53.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:53.615 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:54.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:54.637 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:55.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:55.658 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:56.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:56.679 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:57.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:57.699 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:58.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:58.720 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:09:59.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:09:59.741 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:10:00.170 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:00.167+0000 7fc9347b8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:00.171 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:00.167+0000 7fc9347b8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:00.171 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:00.167+0000 7fc9347b8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:00.171 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:00.167+0000 7fc9347b8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:00.171 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:00.167+0000 7fc9347b8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:00.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:00.763 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:10:00.781 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_10_00_UTC 2023-05-17T15:10:00.782 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-17-15_10_00_UTC'] 2023-05-17T15:10:00.783 DEBUG:tasks.cephfs.test_snap_schedules:exec=1684336189.18388, now = 1684336200.7830596, timo = 11 2023-05-17T15:10:01.784 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-17T15:10:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.915+0000 7f8a84f0d700 1 Processor -- start 2023-05-17T15:10:01.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.915+0000 7f8a84f0d700 1 -- start start 2023-05-17T15:10:01.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.915+0000 7f8a84f0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a80066220 0x7f8a800c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.915+0000 7f8a84f0d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a800c3360 con 0x7f8a800a5d20 2023-05-17T15:10:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.915+0000 7f8a84f0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a800c3640 con 0x7f8a800bca60 2023-05-17T15:10:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.915+0000 7f8a84f0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a800c3fe0 con 0x7f8a80066220 2023-05-17T15:10:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8a800a5d20 0x7f8a80065b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41160/0 (socket says 172.21.15.27:41160) 2023-05-17T15:10:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7f7fe700 1 -- 172.21.15.27:0/589269338 learned_addr learned my addr 172.21.15.27:0/589269338 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:01.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7effd700 1 --2- 172.21.15.27:0/589269338 >> v2:172.21.15.40:3300/0 conn(0x7f8a80066220 0x7f8a800c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425940467 0 0) 0x7f8a800c3360 con 0x7f8a800a5d20 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a6c004500 con 0x7f8a800a5d20 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588990144 0 0) 0x7f8a800c3640 con 0x7f8a800bca60 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a800c3360 con 0x7f8a800bca60 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2922106300 0 0) 0x7f8a6c004500 con 0x7f8a800a5d20 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 >> v2:172.21.15.40:3300/0 conn(0x7f8a80066220 msgr2=0x7f8a800c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:01.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 --2- 172.21.15.27:0/589269338 >> v2:172.21.15.40:3300/0 conn(0x7f8a80066220 0x7f8a800c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 >> v1:172.21.15.40:6789/0 conn(0x7f8a800bca60 legacy=0x7f8a8015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800c3920 con 0x7f8a800a5d20 2023-05-17T15:10:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f8a78001470 con 0x7f8a800a5d20 2023-05-17T15:10:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 >> v1:172.21.15.27:6789/0 conn(0x7f8a800a5d20 legacy=0x7f8a80065b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a6c004b80 0x7f8a6c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c0057a0 0x7f8a6c005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a6c006110 0x7f8a6c00c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c00d070 con 0x7f8a6c004b80 2023-05-17T15:10:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c00d1b0 con 0x7f8a6c0057a0 2023-05-17T15:10:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c00d320 con 0x7f8a6c006110 2023-05-17T15:10:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.916+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a6c004b80 0x7f8a6c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7effd700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c0057a0 0x7f8a6c005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7ffff700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a6c006110 0x7f8a6c00c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7f7fe700 1 -- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a6c006110 msgr2=0x7f8a6c00c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a6c006110 0x7f8a6c00c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:01.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7f7fe700 1 -- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c0057a0 msgr2=0x7f8a6c005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:01.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c0057a0 0x7f8a6c005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:01.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7f7fe700 1 -- 172.21.15.27:0/589269338 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c004500 con 0x7f8a6c004b80 2023-05-17T15:10:01.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7ffff700 1 -- 172.21.15.27:0/589269338 reap_dead start 2023-05-17T15:10:01.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7effd700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c0057a0 0x7f8a6c005c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:01.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a6c004b80 0x7f8a6c004f80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f8a7800c190 tx=0x7f8a800c3ee0).ready entity=mon.0 client_cookie=d771ab9571af596 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:01.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800ca60 con 0x7f8a6c004b80 2023-05-17T15:10:01.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7800cbc0 con 0x7f8a6c004b80 2023-05-17T15:10:01.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a7e7fc700 1 -- 172.21.15.27:0/589269338 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a780070d0 con 0x7f8a6c004b80 2023-05-17T15:10:01.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a84f0d700 1 -- 172.21.15.27:0/589269338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a6c004b80 msgr2=0x7f8a6c004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:01.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.917+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a6c004b80 0x7f8a6c004f80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f8a7800c190 tx=0x7f8a800c3ee0).stop 2023-05-17T15:10:01.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.918+0000 7f8a84f0d700 1 -- 172.21.15.27:0/589269338 shutdown_connections 2023-05-17T15:10:01.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.918+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/589269338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a6c004b80 0x7f8a6c004f80 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:01.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.918+0000 7f8a84f0d700 1 -- 172.21.15.27:0/589269338 >> 172.21.15.27:0/589269338 conn(0x7f8a800694b0 msgr2=0x7f8a800698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:01.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.918+0000 7f8a84f0d700 1 -- 172.21.15.27:0/589269338 shutdown_connections 2023-05-17T15:10:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.918+0000 7f8a84f0d700 1 -- 172.21.15.27:0/589269338 wait complete. 2023-05-17T15:10:01.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.919+0000 7f8a84f0d700 1 Processor -- start 2023-05-17T15:10:01.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.919+0000 7f8a84f0d700 1 -- start start 2023-05-17T15:10:01.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a84f0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c004b80 0x7f8a800a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a84f0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a800abf70 0x7f8a80166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a84f0d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 0x7f8a801489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a84f0d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800ab380 con 0x7f8a801674c0 2023-05-17T15:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a84f0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80167940 con 0x7f8a6c004b80 2023-05-17T15:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a84f0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800ac3f0 con 0x7f8a800abf70 2023-05-17T15:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 0x7f8a801489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 0x7f8a801489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41610/0 (socket says 172.21.15.27:41610) 2023-05-17T15:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 -- 172.21.15.27:0/217656856 learned_addr learned my addr 172.21.15.27:0/217656856 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c004b80 0x7f8a800a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7effd700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a800abf70 0x7f8a80166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 -- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a800abf70 msgr2=0x7f8a80166fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a800abf70 0x7f8a80166fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:01.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 -- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c004b80 msgr2=0x7f8a800a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c004b80 0x7f8a800a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 -- 172.21.15.27:0/217656856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800ac670 con 0x7f8a801674c0 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7effd700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a800abf70 0x7f8a80166fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.920+0000 7f8a7ffff700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 0x7f8a801489d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f8a7000e810 tx=0x7f8a70009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.921+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70003280 con 0x7f8a801674c0 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.921+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a700033e0 con 0x7f8a801674c0 2023-05-17T15:10:01.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.921+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700018f0 con 0x7f8a801674c0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.921+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a800aa9e0 con 0x7f8a801674c0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.921+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a800aafa0 con 0x7f8a801674c0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.922+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a800ab4c0 con 0x7f8a801674c0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.922+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 43) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f8a70001ca0 con 0x7f8a801674c0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.922+0000 7f8a777fe700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a6005ef00 0x7f8a600613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.923+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f8a70079890 con 0x7f8a801674c0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.923+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a6005ef00 0x7f8a600613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:01.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.923+0000 7f8a7f7fe700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a6005ef00 0x7f8a600613c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8a7800c190 tx=0x7f8a78015000).ready entity=mgr.7317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:01.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:01.927+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a700498f0 con 0x7f8a801674c0 2023-05-17T15:10:02.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.125+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a80047150 con 0x7f8a6005ef00 2023-05-17T15:10:02.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.129+0000 7f8a777fe700 1 -- 172.21.15.27:0/217656856 <== mgr.7317 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8a80047150 con 0x7f8a6005ef00 2023-05-17T15:10:02.133 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path snap_test_dir1 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a6005ef00 msgr2=0x7f8a600613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a6005ef00 0x7f8a600613c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8a7800c190 tx=0x7f8a78015000).stop 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 msgr2=0x7f8a801489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 0x7f8a801489d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f8a7000e810 tx=0x7f8a70009040).stop 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 shutdown_connections 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f8a6005ef00 0x7f8a600613c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a801674c0 0x7f8a801489d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6c004b80 0x7f8a800a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 --2- 172.21.15.27:0/217656856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a800abf70 0x7f8a80166fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 >> 172.21.15.27:0/217656856 conn(0x7f8a800694b0 msgr2=0x7f8a800c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 shutdown_connections 2023-05-17T15:10:02.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.131+0000 7f8a84f0d700 1 -- 172.21.15.27:0/217656856 wait complete. 2023-05-17T15:10:02.146 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-17T15:10:02.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:02.147 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:10:02.163 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_10_00_UTC 2023-05-17T15:10:02.164 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-17-15_10_00_UTC 2023-05-17T15:10:02.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:02.165 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-17-15_10_00_UTC) 2023-05-17T15:10:02.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:02.225 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-17T15:10:02.281 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:10:02.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.438+0000 7fd3d3075700 1 Processor -- start 2023-05-17T15:10:02.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.439+0000 7fd3d3075700 1 -- start start 2023-05-17T15:10:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.439+0000 7fd3d3075700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3cc0c3460 0x7fd3cc0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.439+0000 7fd3d3075700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3cc0bb710 0x7fd3cc0bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.439+0000 7fd3d3075700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc0c2fd0 con 0x7fd3cc150aa0 2023-05-17T15:10:02.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.439+0000 7fd3d3075700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c14c0 con 0x7fd3cc0c3460 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.439+0000 7fd3d3075700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0bd5a0 con 0x7fd3cc0bb710 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cbfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3cc0c3460 0x7fd3cc0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3d0e11700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd3cc150aa0 0x7fd3cc0c0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41176/0 (socket says 172.21.15.27:41176) 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3d0e11700 1 -- 172.21.15.27:0/1511344524 learned_addr learned my addr 172.21.15.27:0/1511344524 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3d1612700 1 --2- 172.21.15.27:0/1511344524 >> v2:172.21.15.40:3300/0 conn(0x7fd3cc0bb710 0x7fd3cc0bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cbfff700 1 -- 172.21.15.27:0/1511344524 >> v2:172.21.15.40:3300/0 conn(0x7fd3cc0bb710 msgr2=0x7fd3cc0bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:02.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cbfff700 1 --2- 172.21.15.27:0/1511344524 >> v2:172.21.15.40:3300/0 conn(0x7fd3cc0bb710 0x7fd3cc0bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cbfff700 1 -- 172.21.15.27:0/1511344524 >> v1:172.21.15.27:6789/0 conn(0x7fd3cc150aa0 legacy=0x7fd3cc0c0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cb7fe700 1 -- 172.21.15.27:0/1511344524 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063907436 0 0) 0x7fd3cc0c2fd0 con 0x7fd3cc150aa0 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cbfff700 1 -- 172.21.15.27:0/1511344524 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc0667f0 con 0x7fd3cc0c3460 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3d1612700 1 --2- 172.21.15.27:0/1511344524 >> v2:172.21.15.40:3300/0 conn(0x7fd3cc0bb710 0x7fd3cc0bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cbfff700 1 --2- 172.21.15.27:0/1511344524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c38f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fd3cc0c42a0 tx=0x7fd3b8009060).ready entity=mon.0 client_cookie=5a6a9aa92ff6d4d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cb7fe700 1 -- 172.21.15.27:0/1511344524 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800b580 con 0x7fd3cc0c3460 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cb7fe700 1 -- 172.21.15.27:0/1511344524 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800b6e0 con 0x7fd3cc0c3460 2023-05-17T15:10:02.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.440+0000 7fd3cb7fe700 1 -- 172.21.15.27:0/1511344524 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800ba60 con 0x7fd3cc0c3460 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 -- 172.21.15.27:0/1511344524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 msgr2=0x7fd3cc0c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 --2- 172.21.15.27:0/1511344524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c38f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fd3cc0c42a0 tx=0x7fd3b8009060).stop 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 -- 172.21.15.27:0/1511344524 shutdown_connections 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 --2- 172.21.15.27:0/1511344524 >> v2:172.21.15.40:3300/0 conn(0x7fd3cc0bb710 0x7fd3cc0bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 --2- 172.21.15.27:0/1511344524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c38f0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 -- 172.21.15.27:0/1511344524 >> 172.21.15.27:0/1511344524 conn(0x7fd3cc05dd50 msgr2=0x7fd3cc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:02.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 -- 172.21.15.27:0/1511344524 shutdown_connections 2023-05-17T15:10:02.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.441+0000 7fd3d3075700 1 -- 172.21.15.27:0/1511344524 wait complete. 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.442+0000 7fd3d3075700 1 Processor -- start 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.442+0000 7fd3d3075700 1 -- start start 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d3075700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3cc0bb710 0x7fd3cc09f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d3075700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d3075700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3cc150aa0 0x7fd3cc0a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d3075700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c04e0 con 0x7fd3cc0c3460 2023-05-17T15:10:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d3075700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1620d0 con 0x7fd3cc150aa0 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d3075700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1623b0 con 0x7fd3cc0bb710 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41622/0 (socket says 172.21.15.27:41622) 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 -- 172.21.15.27:0/963502701 learned_addr learned my addr 172.21.15.27:0/963502701 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d1612700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3cc150aa0 0x7fd3cc0a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3d0e11700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3cc0bb710 0x7fd3cc09f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 -- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3cc0bb710 msgr2=0x7fd3cc09f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3cc0bb710 0x7fd3cc09f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 -- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3cc150aa0 msgr2=0x7fd3cc0a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3cc150aa0 0x7fd3cc0a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 -- 172.21.15.27:0/963502701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80092a0 con 0x7fd3cc0c3460 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3cbfff700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c0730 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fd3cc0655c0 tx=0x7fd3b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.443+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800b850 con 0x7fd3cc0c3460 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.444+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800b9b0 con 0x7fd3cc0c3460 2023-05-17T15:10:02.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.444+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc162690 con 0x7fd3cc0c3460 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.444+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b801b620 con 0x7fd3cc0c3460 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.444+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc09f990 con 0x7fd3cc0c3460 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.445+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 43) v1 ==== 75419+0+0 (secure 0 0 0) 0x7fd3b802b070 con 0x7fd3cc0c3460 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.445+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc165300 con 0x7fd3cc0c3460 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.445+0000 7fd3c8ff9700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3b005eed0 0x7fd3b0061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.445+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fd3b807b810 con 0x7fd3cc0c3460 2023-05-17T15:10:02.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.445+0000 7fd3d0e11700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3b005eed0 0x7fd3b0061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:02.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.446+0000 7fd3d0e11700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3b005eed0 0x7fd3b0061390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd3c0001650 tx=0x7fd3c0009040).ready entity=mgr.7317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:02.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.449+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3b804cc40 con 0x7fd3cc0c3460 2023-05-17T15:10:02.564 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:02.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:02.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:02.695+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fd3cc06bdf0 con 0x7fd3cc0c3460 2023-05-17T15:10:03.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.701+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fd3b8021030 con 0x7fd3cc0c3460 2023-05-17T15:10:03.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.702+0000 7fd3c8ff9700 1 -- 172.21.15.27:0/963502701 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v44) v1 ==== 93+0+0 (secure 0 0 0) 0x7fd3b80429c0 con 0x7fd3cc0c3460 2023-05-17T15:10:03.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.704+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3b005eed0 msgr2=0x7fd3b0061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:03.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3b005eed0 0x7fd3b0061390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd3c0001650 tx=0x7fd3c0009040).stop 2023-05-17T15:10:03.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 msgr2=0x7fd3cc0c0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c0730 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fd3cc0655c0 tx=0x7fd3b8017000).stop 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 shutdown_connections 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd3b005eed0 0x7fd3b0061390 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3cc150aa0 0x7fd3cc0a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3cc0bb710 0x7fd3cc09f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 --2- 172.21.15.27:0/963502701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3cc0c3460 0x7fd3cc0c0730 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:03.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 >> 172.21.15.27:0/963502701 conn(0x7fd3cc05dd50 msgr2=0x7fd3cc0c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:03.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 shutdown_connections 2023-05-17T15:10:03.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:03.705+0000 7fd3d3075700 1 -- 172.21.15.27:0/963502701 wait complete. 2023-05-17T15:10:03.725 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:10:03.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:03.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:03.790 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:10:03.791 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:10:03.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:03.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:10:03.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:10:03.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:03.839 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:10:03.852 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:03.848+0000 7fa304075680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:10:03.859 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:03.855+0000 7f542efd8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:10:03.874 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:03.917 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:03.913+0000 7fa304075680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:10:03.925 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:03.921+0000 7f542efd8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:10:04.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.030+0000 7f9554911700 1 Processor -- start 2023-05-17T15:10:04.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.030+0000 7f9554911700 1 -- start start 2023-05-17T15:10:04.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.030+0000 7f9554911700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95500bce70 0x7f9550150740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f9554911700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95500664f0 0x7f95500a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f9554911700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95500c2bc0 con 0x7f9550150360 2023-05-17T15:10:04.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f9554911700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9550066a20 con 0x7f95500bce70 2023-05-17T15:10:04.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f9554911700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95500c2290 con 0x7f95500664f0 2023-05-17T15:10:04.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95500bce70 0x7f9550150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95500bce70 0x7f9550150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41688/0 (socket says 172.21.15.27:41688) 2023-05-17T15:10:04.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 -- 172.21.15.27:0/3231667778 learned_addr learned my addr 172.21.15.27:0/3231667778 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:04.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954f59e700 1 --2- 172.21.15.27:0/3231667778 >> v2:172.21.15.40:3300/0 conn(0x7f95500664f0 0x7f95500a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 -- 172.21.15.27:0/3231667778 >> v2:172.21.15.40:3300/0 conn(0x7f95500664f0 msgr2=0x7f95500a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:04.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 --2- 172.21.15.27:0/3231667778 >> v2:172.21.15.40:3300/0 conn(0x7f95500664f0 0x7f95500a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 -- 172.21.15.27:0/3231667778 >> v1:172.21.15.27:6789/0 conn(0x7f9550150360 legacy=0x7f95500bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954dd9b700 1 -- 172.21.15.27:0/3231667778 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626721623 0 0) 0x7f95500c2bc0 con 0x7f9550150360 2023-05-17T15:10:04.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 -- 172.21.15.27:0/3231667778 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500c2570 con 0x7f95500bce70 2023-05-17T15:10:04.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954e59c700 1 --2- 172.21.15.27:0/3231667778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f9550150740 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f9550068a80 tx=0x7f95440090f0).ready entity=mon.0 client_cookie=f9d4e58f29069c62 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:04.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954dd9b700 1 -- 172.21.15.27:0/3231667778 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400b520 con 0x7f95500bce70 2023-05-17T15:10:04.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954dd9b700 1 -- 172.21.15.27:0/3231667778 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400b680 con 0x7f95500bce70 2023-05-17T15:10:04.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.031+0000 7f954dd9b700 1 -- 172.21.15.27:0/3231667778 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400ba00 con 0x7f95500bce70 2023-05-17T15:10:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 -- 172.21.15.27:0/3231667778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 msgr2=0x7f9550150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 --2- 172.21.15.27:0/3231667778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f9550150740 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f9550068a80 tx=0x7f95440090f0).stop 2023-05-17T15:10:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 -- 172.21.15.27:0/3231667778 shutdown_connections 2023-05-17T15:10:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 --2- 172.21.15.27:0/3231667778 >> v2:172.21.15.40:3300/0 conn(0x7f95500664f0 0x7f95500a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 --2- 172.21.15.27:0/3231667778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f9550150740 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 -- 172.21.15.27:0/3231667778 >> 172.21.15.27:0/3231667778 conn(0x7f9550069e70 msgr2=0x7f955005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 -- 172.21.15.27:0/3231667778 shutdown_connections 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.032+0000 7f9554911700 1 -- 172.21.15.27:0/3231667778 wait complete. 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.033+0000 7f9554911700 1 Processor -- start 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.033+0000 7f9554911700 1 -- start start 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f9554911700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95500664f0 0x7f9550153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f9554911700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f95500bb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f9554911700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9550150360 0x7f95500c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f9554911700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95501514f0 con 0x7f95500bce70 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f9554911700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500bbff0 con 0x7f95500664f0 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f9554911700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95500bc2d0 con 0x7f9550150360 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f954e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f95500bb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f954e59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f95500bb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41694/0 (socket says 172.21.15.27:41694) 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f954e59c700 1 -- 172.21.15.27:0/1499621901 learned_addr learned my addr 172.21.15.27:0/1499621901 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:04.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f954ed9d700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95500664f0 0x7f9550153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.034+0000 7f954f59e700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9550150360 0x7f95500c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954e59c700 1 -- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9550150360 msgr2=0x7f95500c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954e59c700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9550150360 0x7f95500c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954e59c700 1 -- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95500664f0 msgr2=0x7f9550153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954e59c700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95500664f0 0x7f9550153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954e59c700 1 -- 172.21.15.27:0/1499621901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009370 con 0x7f95500bce70 2023-05-17T15:10:04.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954ed9d700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95500664f0 0x7f9550153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:04.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f954e59c700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f95500bb630 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f9544009130 tx=0x7f9544017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:04.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400b980 con 0x7f95500bce70 2023-05-17T15:10:04.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95500bc5b0 con 0x7f95500bce70 2023-05-17T15:10:04.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544011610 con 0x7f95500bce70 2023-05-17T15:10:04.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440119d0 con 0x7f95500bce70 2023-05-17T15:10:04.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.035+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9550154070 con 0x7f95500bce70 2023-05-17T15:10:04.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.036+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955006bdf0 con 0x7f95500bce70 2023-05-17T15:10:04.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.037+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f9544031020 con 0x7f95500bce70 2023-05-17T15:10:04.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.037+0000 7f9536ffd700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 0x7f953c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.037+0000 7f954ed9d700 1 -- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 msgr2=0x7f953c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:04.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.037+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f9544083b50 con 0x7f95500bce70 2023-05-17T15:10:04.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.037+0000 7f954ed9d700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 0x7f953c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:04.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.045+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9544055000 con 0x7f95500bce70 2023-05-17T15:10:04.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:04.194+0000 7fa304075680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:10:04.221 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:04.217+0000 7f542efd8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:10:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.238+0000 7f954ed9d700 1 -- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 msgr2=0x7f953c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.238+0000 7f954ed9d700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 0x7f953c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:04.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.263+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9550063b30 con 0x7f95500bce70 2023-05-17T15:10:04.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.263+0000 7f9536ffd700 1 -- 172.21.15.27:0/1499621901 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4485 (secure 0 0 0) 0x7f9544058620 con 0x7f95500bce70 2023-05-17T15:10:04.267 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:04.268 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:09:30.165063+0000","modified":"2023-05-17T15:09:33.179511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7092":{"gid":7092,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6834/1597094051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1597094051},{"type":"v1","addr":"172.21.15.27:6834","nonce":1597094051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-17T15:10:04.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 msgr2=0x7f953c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:04.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 0x7f953c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:04.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 msgr2=0x7f95500bb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f95500bb630 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f9544009130 tx=0x7f9544017000).stop 2023-05-17T15:10:04.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 shutdown_connections 2023-05-17T15:10:04.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f953c05eeb0 0x7f953c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:04.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9550150360 0x7f95500c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95500664f0 0x7f9550153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 --2- 172.21.15.27:0/1499621901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95500bce70 0x7f95500bb630 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 >> 172.21.15.27:0/1499621901 conn(0x7f9550069e70 msgr2=0x7f95500c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:04.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 shutdown_connections 2023-05-17T15:10:04.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.265+0000 7f9554911700 1 -- 172.21.15.27:0/1499621901 wait complete. 2023-05-17T15:10:04.272 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 44 2023-05-17T15:10:04.282 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.437+0000 7f25a0a6d700 1 Processor -- start 2023-05-17T15:10:04.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.437+0000 7f25a0a6d700 1 -- start start 2023-05-17T15:10:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.438+0000 7f25a0a6d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f259c154160 0x7f259c0653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.438+0000 7f25a0a6d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c064f20 con 0x7f259c05dd50 2023-05-17T15:10:04.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.438+0000 7f25a0a6d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c064310 con 0x7f259c153d80 2023-05-17T15:10:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.438+0000 7f25a0a6d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c0645f0 con 0x7f259c154160 2023-05-17T15:10:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.438+0000 7f2599d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f259c154160 0x7f259c0653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f259ad9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f259c05dd50 0x7f259c0c22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41284/0 (socket says 172.21.15.27:41284) 2023-05-17T15:10:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f259ad9d700 1 -- 172.21.15.27:0/1601552870 learned_addr learned my addr 172.21.15.27:0/1601552870 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f2599d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f259c154160 0x7f259c0653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41720/0 (socket says 172.21.15.27:41720) 2023-05-17T15:10:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f2599d9b700 1 -- 172.21.15.27:0/1601552870 >> v1:172.21.15.40:6789/0 conn(0x7f259c153d80 legacy=0x7f259c0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f2599d9b700 1 -- 172.21.15.27:0/1601552870 >> v1:172.21.15.27:6789/0 conn(0x7f259c05dd50 legacy=0x7f259c0c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f2599d9b700 1 -- 172.21.15.27:0/1601552870 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0648d0 con 0x7f259c154160 2023-05-17T15:10:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f2599d9b700 1 --2- 172.21.15.27:0/1601552870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c154160 0x7f259c0653b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f2590009760 tx=0x7f2590009060).ready entity=mon.0 client_cookie=eaad6a9c13b267f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f259959a700 1 -- 172.21.15.27:0/1601552870 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000b580 con 0x7f259c154160 2023-05-17T15:10:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f259959a700 1 -- 172.21.15.27:0/1601552870 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000b6e0 con 0x7f259c154160 2023-05-17T15:10:04.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.439+0000 7f259959a700 1 -- 172.21.15.27:0/1601552870 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000ba60 con 0x7f259c154160 2023-05-17T15:10:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 -- 172.21.15.27:0/1601552870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c154160 msgr2=0x7f259c0653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/1601552870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c154160 0x7f259c0653b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f2590009760 tx=0x7f2590009060).stop 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 -- 172.21.15.27:0/1601552870 shutdown_connections 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/1601552870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c154160 0x7f259c0653b0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 -- 172.21.15.27:0/1601552870 >> 172.21.15.27:0/1601552870 conn(0x7f259c0c8400 msgr2=0x7f259c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 -- 172.21.15.27:0/1601552870 shutdown_connections 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.440+0000 7f25a0a6d700 1 -- 172.21.15.27:0/1601552870 wait complete. 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.441+0000 7f25a0a6d700 1 Processor -- start 2023-05-17T15:10:04.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.441+0000 7f25a0a6d700 1 -- start start 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f25a0a6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f259c05dd50 0x7f259c140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f25a0a6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 0x7f259c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f25a0a6d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259c154160 0x7f259c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f25a0a6d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c164d20 con 0x7f259c153d80 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f25a0a6d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c164fe0 con 0x7f259c154160 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f25a0a6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1652c0 con 0x7f259c05dd50 2023-05-17T15:10:04.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 0x7f259c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 0x7f259c14ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41726/0 (socket says 172.21.15.27:41726) 2023-05-17T15:10:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 -- 172.21.15.27:0/3801595079 learned_addr learned my addr 172.21.15.27:0/3801595079 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f259ad9d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259c154160 0x7f259c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f259a59c700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f259c05dd50 0x7f259c140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 -- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f259c05dd50 msgr2=0x7f259c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f259c05dd50 0x7f259c140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 -- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259c154160 msgr2=0x7f259c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259c154160 0x7f259c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 -- 172.21.15.27:0/3801595079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25900092a0 con 0x7f259c153d80 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.442+0000 7f2599d9b700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 0x7f259c14ff70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f259000b340 tx=0x7f2590017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.443+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000b850 con 0x7f259c153d80 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.443+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000b9b0 con 0x7f259c153d80 2023-05-17T15:10:04.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.443+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259001b620 con 0x7f259c153d80 2023-05-17T15:10:04.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.443+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c1655a0 con 0x7f259c153d80 2023-05-17T15:10:04.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.443+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c150460 con 0x7f259c153d80 2023-05-17T15:10:04.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.444+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c165ac0 con 0x7f259c153d80 2023-05-17T15:10:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.444+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f259000f070 con 0x7f259c153d80 2023-05-17T15:10:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.445+0000 7f258a7fc700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f257c05eeb0 0x7f257c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.445+0000 7f259a59c700 1 -- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f257c05eeb0 msgr2=0x7f257c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.445+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f259007b560 con 0x7f259c153d80 2023-05-17T15:10:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.445+0000 7f259a59c700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f257c05eeb0 0x7f257c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.449+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f259c165ac0 con 0x7f259c153d80 2023-05-17T15:10:04.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.626+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f259c165ac0 con 0x7f259c153d80 2023-05-17T15:10:04.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.627+0000 7f258a7fc700 1 -- 172.21.15.27:0/3801595079 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+17297 (secure 0 0 0) 0x7f259c165ac0 con 0x7f259c153d80 2023-05-17T15:10:04.631 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:04.631 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":112,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:09:47.133578+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:09:27.811071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-17T15:09:29.145474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/791897745":"2023-05-18T15:09:47.133550+0000","172.21.15.27:0/18151258":"2023-05-18T15:09:47.133550+0000","172.21.15.27:6837/86332":"2023-05-18T15:09:47.133550+0000","172.21.15.27:6836/86332":"2023-05-18T15:09:47.133550+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:04.634 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f257c05eeb0 msgr2=0x7f257c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:04.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f257c05eeb0 0x7f257c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:04.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 msgr2=0x7f259c14ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 0x7f259c14ff70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f259000b340 tx=0x7f2590017000).stop 2023-05-17T15:10:04.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 shutdown_connections 2023-05-17T15:10:04.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f257c05eeb0 0x7f257c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:04.635 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259c154160 0x7f259c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f259c05dd50 0x7f259c140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 --2- 172.21.15.27:0/3801595079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f259c153d80 0x7f259c14ff70 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 >> 172.21.15.27:0/3801595079 conn(0x7f259c0c8400 msgr2=0x7f259c0c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:04.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 shutdown_connections 2023-05-17T15:10:04.636 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.629+0000 7f25a0a6d700 1 -- 172.21.15.27:0/3801595079 wait complete. 2023-05-17T15:10:04.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:09:27.811071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:09:29.145474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:10:04.646 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:10:04.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.771+0000 7f50ea892700 1 Processor -- start 2023-05-17T15:10:04.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.771+0000 7f50ea892700 1 -- start start 2023-05-17T15:10:04.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50ea892700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50e40a9990 0x7f50e40bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50ea892700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50ea892700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50e40c3350 0x7f50e40c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50ea892700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e40c3cd0 con 0x7f50e40a9990 2023-05-17T15:10:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50ea892700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e4065690 con 0x7f50e40c3350 2023-05-17T15:10:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50ea892700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4152160 con 0x7f50e40a9d70 2023-05-17T15:10:04.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50e3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50e40a9990 0x7f50e40bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50e3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50e40a9990 0x7f50e40bc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41732/0 (socket says 172.21.15.27:41732) 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.772+0000 7f50e3fff700 1 -- 172.21.15.27:0/3892556107 learned_addr learned my addr 172.21.15.27:0/3892556107 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e37fe700 1 --2- 172.21.15.27:0/3892556107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e8e2f700 1 --2- 172.21.15.27:0/3892556107 >> v2:172.21.15.40:3300/0 conn(0x7f50e40c3350 0x7f50e40c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e3fff700 1 -- 172.21.15.27:0/3892556107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 msgr2=0x7f50e4151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e3fff700 1 --2- 172.21.15.27:0/3892556107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e3fff700 1 -- 172.21.15.27:0/3892556107 >> v2:172.21.15.40:3300/0 conn(0x7f50e40c3350 msgr2=0x7f50e40c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e3fff700 1 --2- 172.21.15.27:0/3892556107 >> v2:172.21.15.40:3300/0 conn(0x7f50e40c3350 0x7f50e40c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e3fff700 1 -- 172.21.15.27:0/3892556107 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40653b0 con 0x7f50e40a9990 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e3fff700 1 --2- 172.21.15.27:0/3892556107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40bc860 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f50e40644c0 tx=0x7f50d8009060).ready entity=mon.0 client_cookie=a32dabbf0a1916c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e2ffd700 1 -- 172.21.15.27:0/3892556107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8005880 con 0x7f50e40a9990 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e2ffd700 1 -- 172.21.15.27:0/3892556107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d80059e0 con 0x7f50e40a9990 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.773+0000 7f50e2ffd700 1 -- 172.21.15.27:0/3892556107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8005d60 con 0x7f50e40a9990 2023-05-17T15:10:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 -- 172.21.15.27:0/3892556107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 msgr2=0x7f50e40bc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 --2- 172.21.15.27:0/3892556107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40bc860 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f50e40644c0 tx=0x7f50d8009060).stop 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 -- 172.21.15.27:0/3892556107 shutdown_connections 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 --2- 172.21.15.27:0/3892556107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40bc860 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 --2- 172.21.15.27:0/3892556107 >> v2:172.21.15.40:3300/0 conn(0x7f50e40c3350 0x7f50e40c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 --2- 172.21.15.27:0/3892556107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 -- 172.21.15.27:0/3892556107 >> 172.21.15.27:0/3892556107 conn(0x7f50e40c83d0 msgr2=0x7f50e40c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:04.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 -- 172.21.15.27:0/3892556107 shutdown_connections 2023-05-17T15:10:04.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.774+0000 7f50ea892700 1 -- 172.21.15.27:0/3892556107 wait complete. 2023-05-17T15:10:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.776+0000 7f50ea892700 1 Processor -- start 2023-05-17T15:10:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.776+0000 7f50ea892700 1 -- start start 2023-05-17T15:10:04.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50ea892700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50ea892700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50ea892700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e40c3350 0x7f50e40bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50ea892700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40bfa20 con 0x7f50e40a9990 2023-05-17T15:10:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50ea892700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40bee10 con 0x7f50e40c3350 2023-05-17T15:10:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50ea892700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40bf0f0 con 0x7f50e40a9d70 2023-05-17T15:10:04.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41738/0 (socket says 172.21.15.27:41738) 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 -- 172.21.15.27:0/2844804603 learned_addr learned my addr 172.21.15.27:0/2844804603 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e37fe700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e8e2f700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e40c3350 0x7f50e40bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 -- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 msgr2=0x7f50e4160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 -- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e40c3350 msgr2=0x7f50e40bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e40c3350 0x7f50e40bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e3fff700 1 -- 172.21.15.27:0/2844804603 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8009300 con 0x7f50e40a9990 2023-05-17T15:10:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.777+0000 7f50e8e2f700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e40c3350 0x7f50e40bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.778+0000 7f50e3fff700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40abd50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f50d8009dd0 tx=0x7f50d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:04.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.778+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d801d070 con 0x7f50e40a9990 2023-05-17T15:10:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.778+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d80067e0 con 0x7f50e40a9990 2023-05-17T15:10:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.778+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e40bf3d0 con 0x7f50e40a9990 2023-05-17T15:10:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.778+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800f970 con 0x7f50e40a9990 2023-05-17T15:10:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.778+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e40ac240 con 0x7f50e40a9990 2023-05-17T15:10:04.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.779+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e40bfd00 con 0x7f50e40a9990 2023-05-17T15:10:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.779+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f50d800f070 con 0x7f50e40a9990 2023-05-17T15:10:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.780+0000 7f50cbfff700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 0x7f50d00613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.780+0000 7f50e37fe700 1 -- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 msgr2=0x7f50d00613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.780+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f50d807ba10 con 0x7f50e40a9990 2023-05-17T15:10:04.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.780+0000 7f50e37fe700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 0x7f50d00613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.787+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50d804ce00 con 0x7f50e40a9990 2023-05-17T15:10:04.860 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:04.855+0000 7fa304075680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:10:04.913 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:04.908+0000 7f542efd8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:10:04.929 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:04.925+0000 7fa304075680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:10:04.982 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:04.977+0000 7f542efd8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:10:04.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.980+0000 7f50e37fe700 1 -- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 msgr2=0x7f50d00613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:04.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:04.980+0000 7f50e37fe700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 0x7f50d00613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:05.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.008+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f50e406bdf0 con 0x7f50e40a9990 2023-05-17T15:10:05.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.009+0000 7f50cbfff700 1 -- 172.21.15.27:0/2844804603 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7f50d8006b90 con 0x7f50e40a9990 2023-05-17T15:10:05.014 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:10:05.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 msgr2=0x7f50d00613a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:05.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 0x7f50d00613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 msgr2=0x7f50e40abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40abd50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f50d8009dd0 tx=0x7f50d8016000).stop 2023-05-17T15:10:05.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 shutdown_connections 2023-05-17T15:10:05.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f50d005eee0 0x7f50d00613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e40c3350 0x7f50e40bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50e40a9990 0x7f50e40abd50 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 --2- 172.21.15.27:0/2844804603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50e40a9d70 0x7f50e4160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 >> 172.21.15.27:0/2844804603 conn(0x7f50e40c83d0 msgr2=0x7f50e41507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 shutdown_connections 2023-05-17T15:10:05.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.011+0000 7f50ea892700 1 -- 172.21.15.27:0/2844804603 wait complete. 2023-05-17T15:10:05.028 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:10:05.121 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:05.117+0000 7fa304075680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:10:05.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.145+0000 7fa00bb56700 1 Processor -- start 2023-05-17T15:10:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.145+0000 7fa00bb56700 1 -- start start 2023-05-17T15:10:05.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa00bb56700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0040644d0 0x7fa00405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa00bb56700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040c2b80 con 0x7fa00405e240 2023-05-17T15:10:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa00bb56700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00405e670 con 0x7fa004153fb0 2023-05-17T15:10:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa00bb56700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040be580 con 0x7fa0040644d0 2023-05-17T15:10:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa0090f1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0040644d0 0x7fa00405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa0090f1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0040644d0 0x7fa00405dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41776/0 (socket says 172.21.15.27:41776) 2023-05-17T15:10:05.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa00a0f3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa00405e240 0x7fa0040c3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41340/0 (socket says 172.21.15.27:41340) 2023-05-17T15:10:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.146+0000 7fa0090f1700 1 -- 172.21.15.27:0/636673535 learned_addr learned my addr 172.21.15.27:0/636673535 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0090f1700 1 -- 172.21.15.27:0/636673535 >> v1:172.21.15.40:6789/0 conn(0x7fa004153fb0 legacy=0x7fa004063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0090f1700 1 -- 172.21.15.27:0/636673535 >> v1:172.21.15.27:6789/0 conn(0x7fa00405e240 legacy=0x7fa0040c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0090f1700 1 -- 172.21.15.27:0/636673535 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040c2530 con 0x7fa0040644d0 2023-05-17T15:10:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0090f1700 1 --2- 172.21.15.27:0/636673535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0040644d0 0x7fa00405dd50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa000006fd0 tx=0x7fa0000090f0).ready entity=mon.0 client_cookie=fd33c94f30ffb557 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:05.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0088f0700 1 -- 172.21.15.27:0/636673535 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000b600 con 0x7fa0040644d0 2023-05-17T15:10:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0088f0700 1 -- 172.21.15.27:0/636673535 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000b760 con 0x7fa0040644d0 2023-05-17T15:10:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.147+0000 7fa0088f0700 1 -- 172.21.15.27:0/636673535 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000bae0 con 0x7fa0040644d0 2023-05-17T15:10:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 -- 172.21.15.27:0/636673535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0040644d0 msgr2=0x7fa00405dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 --2- 172.21.15.27:0/636673535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0040644d0 0x7fa00405dd50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa000006fd0 tx=0x7fa0000090f0).stop 2023-05-17T15:10:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 -- 172.21.15.27:0/636673535 shutdown_connections 2023-05-17T15:10:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 --2- 172.21.15.27:0/636673535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0040644d0 0x7fa00405dd50 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 -- 172.21.15.27:0/636673535 >> 172.21.15.27:0/636673535 conn(0x7fa0040c7910 msgr2=0x7fa0040c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 -- 172.21.15.27:0/636673535 shutdown_connections 2023-05-17T15:10:05.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.148+0000 7fa00bb56700 1 -- 172.21.15.27:0/636673535 wait complete. 2023-05-17T15:10:05.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.149+0000 7fa00bb56700 1 Processor -- start 2023-05-17T15:10:05.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.149+0000 7fa00bb56700 1 -- start start 2023-05-17T15:10:05.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 0x7fa0040a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0040644d0 0x7fa0040acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa004153fb0 0x7fa0040ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040a9600 con 0x7fa00405e240 2023-05-17T15:10:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040a89f0 con 0x7fa004153fb0 2023-05-17T15:10:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040a8cd0 con 0x7fa0040644d0 2023-05-17T15:10:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 0x7fa0040a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 0x7fa0040a9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41780/0 (socket says 172.21.15.27:41780) 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 -- 172.21.15.27:0/3750103173 learned_addr learned my addr 172.21.15.27:0/3750103173 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0090f1700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0040644d0 0x7fa0040acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00a0f3700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa004153fb0 0x7fa0040ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 -- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0040644d0 msgr2=0x7fa0040acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0040644d0 0x7fa0040acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 -- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa004153fb0 msgr2=0x7fa0040ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa004153fb0 0x7fa0040ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 -- 172.21.15.27:0/3750103173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000009370 con 0x7fa00405e240 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa0098f2700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 0x7fa0040a9a90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f9ff400c440 tx=0x7f9ff4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4007020 con 0x7fa00405e240 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4007180 con 0x7fa00405e240 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040a8fb0 con 0x7fa00405e240 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.150+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4007520 con 0x7fa00405e240 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.151+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0040ad710 con 0x7fa00405e240 2023-05-17T15:10:05.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.151+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0040c7f00 con 0x7fa00405e240 2023-05-17T15:10:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.152+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f9ff4010070 con 0x7fa00405e240 2023-05-17T15:10:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.152+0000 7f9ff9ffb700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9fe805eeb0 0x7f9fe8061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.152+0000 7fa0090f1700 1 -- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9fe805eeb0 msgr2=0x7f9fe8061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.152+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f9ff4078f80 con 0x7fa00405e240 2023-05-17T15:10:05.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.152+0000 7fa0090f1700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9fe805eeb0 0x7f9fe8061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:05.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.156+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ff40478f0 con 0x7fa00405e240 2023-05-17T15:10:05.182 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:05.177+0000 7f542efd8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:10:05.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.330+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa00406bdf0 con 0x7fa00405e240 2023-05-17T15:10:05.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.331+0000 7f9ff9ffb700 1 -- 172.21.15.27:0/3750103173 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ff404a260 con 0x7fa00405e240 2023-05-17T15:10:05.336 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9fe805eeb0 msgr2=0x7f9fe8061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9fe805eeb0 0x7f9fe8061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 msgr2=0x7fa0040a9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 0x7fa0040a9a90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f9ff400c440 tx=0x7f9ff4007e00).stop 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 shutdown_connections 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9fe805eeb0 0x7f9fe8061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa004153fb0 0x7fa0040ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa00405e240 0x7fa0040a9a90 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 --2- 172.21.15.27:0/3750103173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0040644d0 0x7fa0040acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 >> 172.21.15.27:0/3750103173 conn(0x7fa0040c7910 msgr2=0x7fa0040c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 shutdown_connections 2023-05-17T15:10:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.333+0000 7fa00bb56700 1 -- 172.21.15.27:0/3750103173 wait complete. 2023-05-17T15:10:05.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:10:05.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.469+0000 7f4c7f59e700 1 Processor -- start 2023-05-17T15:10:05.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.469+0000 7f4c7f59e700 1 -- start start 2023-05-17T15:10:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c80137200 0x7f4c800c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c801375e0 0x7f4c800c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7f59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c800bc6d0 con 0x7f4c80063340 2023-05-17T15:10:05.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7f59e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c80151470 con 0x7f4c80137200 2023-05-17T15:10:05.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800c2260 con 0x7f4c801375e0 2023-05-17T15:10:05.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7e59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c80137200 0x7f4c800c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7ed9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4c80063340 0x7f4c80154ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41354/0 (socket says 172.21.15.27:41354) 2023-05-17T15:10:05.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7ed9d700 1 -- 172.21.15.27:0/1410503080 learned_addr learned my addr 172.21.15.27:0/1410503080 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:05.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7dd9b700 1 --2- 172.21.15.27:0/1410503080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c801375e0 0x7f4c800c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7e59c700 1 -- 172.21.15.27:0/1410503080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c801375e0 msgr2=0x7f4c800c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7e59c700 1 --2- 172.21.15.27:0/1410503080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c801375e0 0x7f4c800c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7e59c700 1 -- 172.21.15.27:0/1410503080 >> v1:172.21.15.27:6789/0 conn(0x7f4c80063340 legacy=0x7f4c80154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7e59c700 1 -- 172.21.15.27:0/1410503080 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800bcf70 con 0x7f4c80137200 2023-05-17T15:10:05.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.470+0000 7f4c7e59c700 1 --2- 172.21.15.27:0/1410503080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c80137200 0x7f4c800c1d70 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f4c70009760 tx=0x7f4c70009060).ready entity=mon.0 client_cookie=1e254b954c75ba4a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7d59a700 1 -- 172.21.15.27:0/1410503080 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000f510 con 0x7f4c80137200 2023-05-17T15:10:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7d59a700 1 -- 172.21.15.27:0/1410503080 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7000f670 con 0x7f4c80137200 2023-05-17T15:10:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7d59a700 1 -- 172.21.15.27:0/1410503080 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000f9f0 con 0x7f4c80137200 2023-05-17T15:10:05.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 -- 172.21.15.27:0/1410503080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c80137200 msgr2=0x7f4c800c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/1410503080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c80137200 0x7f4c800c1d70 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f4c70009760 tx=0x7f4c70009060).stop 2023-05-17T15:10:05.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 -- 172.21.15.27:0/1410503080 shutdown_connections 2023-05-17T15:10:05.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/1410503080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c80137200 0x7f4c800c1d70 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/1410503080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c801375e0 0x7f4c800c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 -- 172.21.15.27:0/1410503080 >> 172.21.15.27:0/1410503080 conn(0x7f4c80067cb0 msgr2=0x7f4c800680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 -- 172.21.15.27:0/1410503080 shutdown_connections 2023-05-17T15:10:05.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.471+0000 7f4c7f59e700 1 -- 172.21.15.27:0/1410503080 wait complete. 2023-05-17T15:10:05.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.472+0000 7f4c7f59e700 1 Processor -- start 2023-05-17T15:10:05.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 -- start start 2023-05-17T15:10:05.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 0x7f4c800c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c80137200 0x7f4c801655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 0x7f4c80165ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800bed20 con 0x7f4c801375e0 2023-05-17T15:10:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80164eb0 con 0x7f4c80137200 2023-05-17T15:10:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80165190 con 0x7f4c80063340 2023-05-17T15:10:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 0x7f4c80165ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 0x7f4c800c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 0x7f4c800c0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:42904/0 (socket says 172.21.15.27:42904) 2023-05-17T15:10:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 0x7f4c80165ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41798/0 (socket says 172.21.15.27:41798) 2023-05-17T15:10:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.473+0000 7f4c7e59c700 1 -- 172.21.15.27:0/4099177312 learned_addr learned my addr 172.21.15.27:0/4099177312 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7dd9b700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c80137200 0x7f4c801655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7e59c700 1 -- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c80137200 msgr2=0x7f4c801655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7e59c700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c80137200 0x7f4c801655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7e59c700 1 -- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 msgr2=0x7f4c80165ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7e59c700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 0x7f4c80165ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7e59c700 1 -- 172.21.15.27:0/4099177312 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c700092a0 con 0x7f4c80063340 2023-05-17T15:10:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7ed9d700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 0x7f4c80165ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7e59c700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 0x7f4c800c0360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4c80068d00 tx=0x7f4c70017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000f7e0 con 0x7f4c80063340 2023-05-17T15:10:05.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7000f940 con 0x7f4c80063340 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c800be9b0 con 0x7f4c80063340 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7001b660 con 0x7f4c80063340 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.474+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c800c0850 con 0x7f4c80063340 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.475+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800bf000 con 0x7f4c80063340 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.475+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f4c7000f070 con 0x7f4c80063340 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.476+0000 7f4c6e7fc700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4c6005eeb0 0x7f4c60061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.476+0000 7f4c7dd9b700 1 -- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4c6005eeb0 msgr2=0x7f4c60061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.476+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f4c7007b5d0 con 0x7f4c80063340 2023-05-17T15:10:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.476+0000 7f4c7dd9b700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4c6005eeb0 0x7f4c60061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.480+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c7004c9c0 con 0x7f4c80063340 2023-05-17T15:10:05.553 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:05.549+0000 7fa304075680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:10:05.625 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:05.620+0000 7f542efd8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:10:05.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.655+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c801653b0 con 0x7f4c80063340 2023-05-17T15:10:05.661 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:05.655+0000 7fa304075680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:05.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.656+0000 7f4c6e7fc700 1 -- 172.21.15.27:0/4099177312 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c70006b30 con 0x7f4c80063340 2023-05-17T15:10:05.661 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:10:05.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4c6005eeb0 msgr2=0x7f4c60061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:05.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4c6005eeb0 0x7f4c60061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 msgr2=0x7f4c800c0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 0x7f4c800c0360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4c80068d00 tx=0x7f4c70017000).stop 2023-05-17T15:10:05.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 shutdown_connections 2023-05-17T15:10:05.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4c6005eeb0 0x7f4c60061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c801375e0 0x7f4c80165ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c80063340 0x7f4c800c0360 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.664 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 --2- 172.21.15.27:0/4099177312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c80137200 0x7f4c801655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 >> 172.21.15.27:0/4099177312 conn(0x7f4c80067cb0 msgr2=0x7f4c800c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 shutdown_connections 2023-05-17T15:10:05.665 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.658+0000 7f4c7f59e700 1 -- 172.21.15.27:0/4099177312 wait complete. 2023-05-17T15:10:05.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:10:05.736 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:05.731+0000 7f542efd8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:05.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.798+0000 7f65353bc700 1 Processor -- start 2023-05-17T15:10:05.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.798+0000 7f65353bc700 1 -- start start 2023-05-17T15:10:05.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f65353bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f653015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f65353bc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65301588b0 con 0x7f65300c58c0 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f65353bc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6530157ca0 con 0x7f65300c5ca0 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f65353bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6530157f80 con 0x7f65300c1380 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f652ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f65300c58c0 0x7f65300a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41364/0 (socket says 172.21.15.27:41364) 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f652ffff700 1 -- 172.21.15.27:0/959841795 learned_addr learned my addr 172.21.15.27:0/959841795 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f6534bbb700 1 --2- 172.21.15.27:0/959841795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f653015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366988318 0 0) 0x7f65301588b0 con 0x7f65300c58c0 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65180033f0 con 0x7f65300c58c0 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933564902 0 0) 0x7f6530157ca0 con 0x7f65300c5ca0 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65301588b0 con 0x7f65300c5ca0 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f6534bbb700 1 -- 172.21.15.27:0/959841795 >> v1:172.21.15.40:6789/0 conn(0x7f65300c5ca0 legacy=0x7f65301537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f6534bbb700 1 -- 172.21.15.27:0/959841795 >> v1:172.21.15.27:6789/0 conn(0x7f65300c58c0 legacy=0x7f65300a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f6534bbb700 1 -- 172.21.15.27:0/959841795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530158260 con 0x7f65300c1380 2023-05-17T15:10:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.799+0000 7f6534bbb700 1 --2- 172.21.15.27:0/959841795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f653015eca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6528009e90 tx=0x7f6528009780).ready entity=mon.2 client_cookie=1ba333b800a47930 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800e070 con 0x7f65300c1380 2023-05-17T15:10:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652800bab0 con 0x7f65300c1380 2023-05-17T15:10:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f652effd700 1 -- 172.21.15.27:0/959841795 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800be30 con 0x7f65300c1380 2023-05-17T15:10:05.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 -- 172.21.15.27:0/959841795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 msgr2=0x7f653015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 --2- 172.21.15.27:0/959841795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f653015eca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6528009e90 tx=0x7f6528009780).stop 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 -- 172.21.15.27:0/959841795 shutdown_connections 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 --2- 172.21.15.27:0/959841795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f653015eca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 -- 172.21.15.27:0/959841795 >> 172.21.15.27:0/959841795 conn(0x7f653005dd50 msgr2=0x7f653005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 -- 172.21.15.27:0/959841795 shutdown_connections 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.800+0000 7f65353bc700 1 -- 172.21.15.27:0/959841795 wait complete. 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.801+0000 7f65353bc700 1 Processor -- start 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 -- start start 2023-05-17T15:10:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f6530147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65300c58c0 0x7f6530151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 0x7f653014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300c88b0 con 0x7f65300c5ca0 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300c1d50 con 0x7f65300c58c0 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.802+0000 7f65353bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65300c2030 con 0x7f65300c1380 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 0x7f653014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f652ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f6530147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f652f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65300c58c0 0x7f6530151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 0x7f653014db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41812/0 (socket says 172.21.15.27:41812) 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 -- 172.21.15.27:0/549806054 learned_addr learned my addr 172.21.15.27:0/549806054 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 -- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 msgr2=0x7f6530147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f6530147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 -- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65300c58c0 msgr2=0x7f6530151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65300c58c0 0x7f6530151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 -- 172.21.15.27:0/549806054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009a20 con 0x7f65300c5ca0 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f652ffff700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f6530147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6534bbb700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 0x7f653014db00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f65300aa6e0 tx=0x7f6530158820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528013e40 con 0x7f65300c5ca0 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652801d630 con 0x7f65300c5ca0 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6530152610 con 0x7f65300c5ca0 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652801d9f0 con 0x7f65300c5ca0 2023-05-17T15:10:05.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.803+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6530152bd0 con 0x7f65300c5ca0 2023-05-17T15:10:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.804+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6510005120 con 0x7f65300c5ca0 2023-05-17T15:10:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.805+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f6528027460 con 0x7f65300c5ca0 2023-05-17T15:10:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.805+0000 7f6517fff700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f651c05eeb0 0x7f651c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.805+0000 7f652ffff700 1 -- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f651c05eeb0 msgr2=0x7f651c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.805+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f652807bed0 con 0x7f65300c5ca0 2023-05-17T15:10:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.805+0000 7f652ffff700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f651c05eeb0 0x7f651c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:05.818 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:05.813+0000 7fa304075680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.812+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f652804d260 con 0x7f65300c5ca0 2023-05-17T15:10:05.894 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:05.890+0000 7fa304075680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:10:05.899 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:05.894+0000 7f542efd8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:05.963 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:05.958+0000 7fa304075680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:10:05.977 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:05.972+0000 7f542efd8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:10:05.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.987+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6510005d70 con 0x7f65300c5ca0 2023-05-17T15:10:05.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.988+0000 7f6517fff700 1 -- 172.21.15.27:0/549806054 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6528050880 con 0x7f65300c5ca0 2023-05-17T15:10:05.994 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:10:05.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.989+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f651c05eeb0 msgr2=0x7f651c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:05.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.989+0000 7f65353bc700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f651c05eeb0 0x7f651c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 msgr2=0x7f653014db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:05.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 0x7f653014db00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f65300aa6e0 tx=0x7f6530158820).stop 2023-05-17T15:10:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 shutdown_connections 2023-05-17T15:10:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f651c05eeb0 0x7f651c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65300c5ca0 0x7f653014db00 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65300c1380 0x7f6530147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 --2- 172.21.15.27:0/549806054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65300c58c0 0x7f6530151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 >> 172.21.15.27:0/549806054 conn(0x7f653005dd50 msgr2=0x7f653014f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:05.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 shutdown_connections 2023-05-17T15:10:05.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:05.990+0000 7f65353bc700 1 -- 172.21.15.27:0/549806054 wait complete. 2023-05-17T15:10:06.007 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:06.049 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:06.045+0000 7f542efd8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:10:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.120+0000 7f615431c700 1 Processor -- start 2023-05-17T15:10:06.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.120+0000 7f615431c700 1 -- start start 2023-05-17T15:10:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f615431c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f614c0a7010 0x7f614c05dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f615431c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c05e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f615431c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c153160 con 0x7f614c14c1d0 2023-05-17T15:10:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f615431c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c05e730 con 0x7f614c0a7010 2023-05-17T15:10:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f615431c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c152290 con 0x7f614c14c5b0 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f61518b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f614c0a7010 0x7f614c05dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f61528b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c05e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f61518b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f614c0a7010 0x7f614c05dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:59746/0 (socket says 172.21.15.27:59746) 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f61528b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c05e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:42928/0 (socket says 172.21.15.27:42928) 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f61518b7700 1 -- 172.21.15.27:0/1594616645 learned_addr learned my addr 172.21.15.27:0/1594616645 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.121+0000 7f61520b8700 1 --1- 172.21.15.27:0/1594616645 >> v1:172.21.15.40:6789/0 conn(0x7f614c14c1d0 0x7f614c0a6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:47380/0 (socket says 172.21.15.27:47380) 2023-05-17T15:10:06.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61528b9700 1 -- 172.21.15.27:0/1594616645 >> v2:172.21.15.40:3300/0 conn(0x7f614c0a7010 msgr2=0x7f614c05dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61528b9700 1 --2- 172.21.15.27:0/1594616645 >> v2:172.21.15.40:3300/0 conn(0x7f614c0a7010 0x7f614c05dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61528b9700 1 -- 172.21.15.27:0/1594616645 >> v1:172.21.15.40:6789/0 conn(0x7f614c14c1d0 legacy=0x7f614c0a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61528b9700 1 -- 172.21.15.27:0/1594616645 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c152550 con 0x7f614c14c5b0 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61528b9700 1 --2- 172.21.15.27:0/1594616645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c05e240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6144009e60 tx=0x7f6144009780).ready entity=mon.2 client_cookie=6188fa8bc9cf7b1d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61510b6700 1 -- 172.21.15.27:0/1594616645 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400e070 con 0x7f614c14c5b0 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61510b6700 1 -- 172.21.15.27:0/1594616645 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400bb60 con 0x7f614c14c5b0 2023-05-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.122+0000 7f61510b6700 1 -- 172.21.15.27:0/1594616645 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144012410 con 0x7f614c14c5b0 2023-05-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 -- 172.21.15.27:0/1594616645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 msgr2=0x7f614c05e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 --2- 172.21.15.27:0/1594616645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c05e240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6144009e60 tx=0x7f6144009780).stop 2023-05-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 -- 172.21.15.27:0/1594616645 shutdown_connections 2023-05-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 --2- 172.21.15.27:0/1594616645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c05e240 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 --2- 172.21.15.27:0/1594616645 >> v2:172.21.15.40:3300/0 conn(0x7f614c0a7010 0x7f614c05dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 -- 172.21.15.27:0/1594616645 >> 172.21.15.27:0/1594616645 conn(0x7f614c0c7920 msgr2=0x7f614c0c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 -- 172.21.15.27:0/1594616645 shutdown_connections 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.123+0000 7f615431c700 1 -- 172.21.15.27:0/1594616645 wait complete. 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.124+0000 7f615431c700 1 Processor -- start 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.124+0000 7f615431c700 1 -- start start 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f615431c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 0x7f614c14a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f615431c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f615431c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f614c14f590 0x7f614c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f615431c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0bfb10 con 0x7f614c14c1d0 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f615431c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0a6a60 con 0x7f614c14f590 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f615431c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0bf550 con 0x7f614c14c5b0 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61520b8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 0x7f614c14a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61520b8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 0x7f614c14a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41820/0 (socket says 172.21.15.27:41820) 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61520b8700 1 -- 172.21.15.27:0/620957756 learned_addr learned my addr 172.21.15.27:0/620957756 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61528b9700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f614c14f590 0x7f614c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 -- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f614c14f590 msgr2=0x7f614c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f614c14f590 0x7f614c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 -- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 msgr2=0x7f614c14a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 0x7f614c14a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 -- 172.21.15.27:0/620957756 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009a20 con 0x7f614c14c5b0 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61520b8700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 0x7f614c14a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.125+0000 7f61518b7700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c14f0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6148006fd0 tx=0x7f61480090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.126+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148012600 con 0x7f614c14c5b0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.126+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6148012760 con 0x7f614c14c5b0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.126+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c0bf830 con 0x7f614c14c5b0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.126+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148012ae0 con 0x7f614c14c5b0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.126+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c14db60 con 0x7f614c14c5b0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.126+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c05df60 con 0x7f614c14c5b0 2023-05-17T15:10:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.127+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f6148022070 con 0x7f614c14c5b0 2023-05-17T15:10:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.127+0000 7f61427fc700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 0x7f6130061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.127+0000 7f61520b8700 1 -- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 msgr2=0x7f6130061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.127+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f6148079ee0 con 0x7f614c14c5b0 2023-05-17T15:10:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.127+0000 7f61520b8700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 0x7f6130061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.131+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f614804b2d0 con 0x7f614c14c5b0 2023-05-17T15:10:06.232 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:06.227+0000 7fa304075680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:10:06.323 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:06.318+0000 7f542efd8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:10:06.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.328+0000 7f61520b8700 1 -- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 msgr2=0x7f6130061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.328+0000 7f61520b8700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 0x7f6130061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:06.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.347+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f614c14ded0 con 0x7f614c14c5b0 2023-05-17T15:10:06.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.348+0000 7f61427fc700 1 -- 172.21.15.27:0/620957756 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4485 (secure 0 0 0) 0x7f6148016070 con 0x7f614c14c5b0 2023-05-17T15:10:06.353 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:06.353 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:09:30.165063+0000","modified":"2023-05-17T15:09:33.179511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7092":{"gid":7092,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6834/1597094051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1597094051},{"type":"v1","addr":"172.21.15.27:6834","nonce":1597094051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-17T15:10:06.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 msgr2=0x7f6130061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:06.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 0x7f6130061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:06.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 msgr2=0x7f614c14f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c14f0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6148006fd0 tx=0x7f61480090f0).stop 2023-05-17T15:10:06.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 shutdown_connections 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f613005eeb0 0x7f6130061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f614c14f590 0x7f614c153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f614c14c1d0 0x7f614c14a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 --2- 172.21.15.27:0/620957756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f614c14c5b0 0x7f614c14f0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 >> 172.21.15.27:0/620957756 conn(0x7f614c0c7920 msgr2=0x7f614c154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 shutdown_connections 2023-05-17T15:10:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.350+0000 7f615431c700 1 -- 172.21.15.27:0/620957756 wait complete. 2023-05-17T15:10:06.357 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 44 2023-05-17T15:10:06.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:06.422 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:06.418+0000 7fa304075680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:06.516 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:06.511+0000 7f542efd8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:06.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.523+0000 7fc4ca584700 1 Processor -- start 2023-05-17T15:10:06.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.523+0000 7fc4ca584700 1 -- start start 2023-05-17T15:10:06.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4ca584700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4ca584700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4c405e240 0x7fc4c40c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4ca584700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c40bd6a0 con 0x7fc4c4153cf0 2023-05-17T15:10:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4ca584700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c405e670 con 0x7fc4c405e240 2023-05-17T15:10:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4ca584700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40c31b0 con 0x7fc4c41540d0 2023-05-17T15:10:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4c8b21700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4c405e240 0x7fc4c40c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4c8b21700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc4c405e240 0x7fc4c40c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41834/0 (socket says 172.21.15.27:41834) 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4c8b21700 1 -- 172.21.15.27:0/723394370 learned_addr learned my addr 172.21.15.27:0/723394370 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.524+0000 7fc4c37fe700 1 --2- 172.21.15.27:0/723394370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c8b21700 1 -- 172.21.15.27:0/723394370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 msgr2=0x7fc4c405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c8b21700 1 --2- 172.21.15.27:0/723394370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c405dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c8b21700 1 -- 172.21.15.27:0/723394370 >> v1:172.21.15.40:6789/0 conn(0x7fc4c4153cf0 legacy=0x7fc4c4063d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c2ffd700 1 -- 172.21.15.27:0/723394370 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880428774 0 0) 0x7fc4c40bd6a0 con 0x7fc4c4153cf0 2023-05-17T15:10:06.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c8b21700 1 -- 172.21.15.27:0/723394370 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40c3490 con 0x7fc4c405e240 2023-05-17T15:10:06.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c8b21700 1 --2- 172.21.15.27:0/723394370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40c23f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fc4bc009f20 tx=0x7fc4bc009840).ready entity=mon.0 client_cookie=c5ae225ebfefa613 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:06.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c2ffd700 1 -- 172.21.15.27:0/723394370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00e070 con 0x7fc4c405e240 2023-05-17T15:10:06.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c2ffd700 1 -- 172.21.15.27:0/723394370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00b9d0 con 0x7fc4c405e240 2023-05-17T15:10:06.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4c2ffd700 1 -- 172.21.15.27:0/723394370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00bd50 con 0x7fc4c405e240 2023-05-17T15:10:06.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4ca584700 1 -- 172.21.15.27:0/723394370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 msgr2=0x7fc4c40c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.525+0000 7fc4ca584700 1 --2- 172.21.15.27:0/723394370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40c23f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fc4bc009f20 tx=0x7fc4bc009840).stop 2023-05-17T15:10:06.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.526+0000 7fc4ca584700 1 -- 172.21.15.27:0/723394370 shutdown_connections 2023-05-17T15:10:06.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.526+0000 7fc4ca584700 1 --2- 172.21.15.27:0/723394370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40c23f0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.526+0000 7fc4ca584700 1 --2- 172.21.15.27:0/723394370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c405dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.526+0000 7fc4ca584700 1 -- 172.21.15.27:0/723394370 >> 172.21.15.27:0/723394370 conn(0x7fc4c40c7920 msgr2=0x7fc4c40c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.526+0000 7fc4ca584700 1 -- 172.21.15.27:0/723394370 shutdown_connections 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.526+0000 7fc4ca584700 1 -- 172.21.15.27:0/723394370 wait complete. 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.527+0000 7fc4ca584700 1 Processor -- start 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.527+0000 7fc4ca584700 1 -- start start 2023-05-17T15:10:06.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c4153cf0 0x7fc4c40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c40a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40ab360 con 0x7fc4c405e240 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40ac180 con 0x7fc4c4153cf0 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40ab570 con 0x7fc4c41540d0 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41836/0 (socket says 172.21.15.27:41836) 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 -- 172.21.15.27:0/418875041 learned_addr learned my addr 172.21.15.27:0/418875041 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c8b21700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c40a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c37fe700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c4153cf0 0x7fc4c40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 -- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 msgr2=0x7fc4c40a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c40a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 -- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c4153cf0 msgr2=0x7fc4c40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c4153cf0 0x7fc4c40aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 -- 172.21.15.27:0/418875041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc009ae0 con 0x7fc4c405e240 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4c3fff700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40aa8d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fc4ac001eb0 tx=0x7fc4ac007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00ce60 con 0x7fc4c405e240 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00f470 con 0x7fc4c405e240 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.528+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c40ab850 con 0x7fc4c405e240 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.529+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00f810 con 0x7fc4c405e240 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.529+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c40abe10 con 0x7fc4c405e240 2023-05-17T15:10:06.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.529+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c406bdf0 con 0x7fc4c405e240 2023-05-17T15:10:06.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.530+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fc4ac019030 con 0x7fc4c405e240 2023-05-17T15:10:06.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.530+0000 7fc4bbfff700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc4a405eeb0 0x7fc4a4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.530+0000 7fc4c37fe700 1 -- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc4a405eeb0 msgr2=0x7fc4a4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:06.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.530+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fc4ac079110 con 0x7fc4c405e240 2023-05-17T15:10:06.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.530+0000 7fc4c37fe700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc4a405eeb0 0x7fc4a4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:06.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.534+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4ac04a500 con 0x7fc4c405e240 2023-05-17T15:10:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.713+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4c40bd070 con 0x7fc4c405e240 2023-05-17T15:10:06.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.714+0000 7fc4bbfff700 1 -- 172.21.15.27:0/418875041 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17409 (secure 0 0 0) 0x7fc4ac04db20 con 0x7fc4c405e240 2023-05-17T15:10:06.719 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:06.719 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":113,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:04.697499+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:09:27.811071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-17T15:09:29.145474+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":113,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/791897745":"2023-05-18T15:09:47.133550+0000","172.21.15.27:0/18151258":"2023-05-18T15:09:47.133550+0000","172.21.15.27:6837/86332":"2023-05-18T15:09:47.133550+0000","172.21.15.27:6836/86332":"2023-05-18T15:09:47.133550+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc4a405eeb0 msgr2=0x7fc4a4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc4a405eeb0 0x7fc4a4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 msgr2=0x7fc4c40aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40aa8d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fc4ac001eb0 tx=0x7fc4ac007c70).stop 2023-05-17T15:10:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 shutdown_connections 2023-05-17T15:10:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc4a405eeb0 0x7fc4a4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4c41540d0 0x7fc4c40a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4c405e240 0x7fc4c40aa8d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 --2- 172.21.15.27:0/418875041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c4153cf0 0x7fc4c40aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 >> 172.21.15.27:0/418875041 conn(0x7fc4c40c7920 msgr2=0x7fc4c40c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 shutdown_connections 2023-05-17T15:10:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.716+0000 7fc4ca584700 1 -- 172.21.15.27:0/418875041 wait complete. 2023-05-17T15:10:06.734 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:10:06.734 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:06.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.847+0000 7f35b0cb7700 1 Processor -- start 2023-05-17T15:10:06.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.847+0000 7f35b0cb7700 1 -- start start 2023-05-17T15:10:06.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35b0cb7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35ac066a60 0x7f35ac154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35b0cb7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac0bd120 0x7f35ac0c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35b0cb7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0bd5b0 con 0x7f35ac153f80 2023-05-17T15:10:06.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35b0cb7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0c2430 con 0x7f35ac066a60 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35b0cb7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0c36c0 con 0x7f35ac0bd120 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35ac066a60 0x7f35ac154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35ac066a60 0x7f35ac154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41864/0 (socket says 172.21.15.27:41864) 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35aa59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f35ac153f80 0x7f35ac066350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41426/0 (socket says 172.21.15.27:41426) 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 -- 172.21.15.27:0/947461925 learned_addr learned my addr 172.21.15.27:0/947461925 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35aad9d700 1 --2- 172.21.15.27:0/947461925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac0bd120 0x7f35ac0c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 -- 172.21.15.27:0/947461925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac0bd120 msgr2=0x7f35ac0c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:06.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 --2- 172.21.15.27:0/947461925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac0bd120 0x7f35ac0c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 -- 172.21.15.27:0/947461925 >> v1:172.21.15.27:6789/0 conn(0x7f35ac153f80 legacy=0x7f35ac066350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a959a700 1 -- 172.21.15.27:0/947461925 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100554715 0 0) 0x7f35ac0bd5b0 con 0x7f35ac153f80 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 -- 172.21.15.27:0/947461925 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0c3230 con 0x7f35ac066a60 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.848+0000 7f35a9d9b700 1 --2- 172.21.15.27:0/947461925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac154360 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f35a0006fd0 tx=0x7f35a00090f0).ready entity=mon.0 client_cookie=331b012b976850cb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35a959a700 1 -- 172.21.15.27:0/947461925 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000b580 con 0x7f35ac066a60 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35a959a700 1 -- 172.21.15.27:0/947461925 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000b6e0 con 0x7f35ac066a60 2023-05-17T15:10:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35a959a700 1 -- 172.21.15.27:0/947461925 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000ba60 con 0x7f35ac066a60 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 -- 172.21.15.27:0/947461925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 msgr2=0x7f35ac154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/947461925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac154360 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f35a0006fd0 tx=0x7f35a00090f0).stop 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 -- 172.21.15.27:0/947461925 shutdown_connections 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/947461925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac0bd120 0x7f35ac0c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/947461925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac154360 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 -- 172.21.15.27:0/947461925 >> 172.21.15.27:0/947461925 conn(0x7f35ac068750 msgr2=0x7f35ac0c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 -- 172.21.15.27:0/947461925 shutdown_connections 2023-05-17T15:10:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.849+0000 7f35b0cb7700 1 -- 172.21.15.27:0/947461925 wait complete. 2023-05-17T15:10:06.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.850+0000 7f35b0cb7700 1 Processor -- start 2023-05-17T15:10:06.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.850+0000 7f35b0cb7700 1 -- start start 2023-05-17T15:10:06.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35b0cb7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac0be140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35b0cb7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0bd120 0x7f35ac154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35b0cb7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac153f80 0x7f35ac0c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35b0cb7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0bfa60 con 0x7f35ac066a60 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35b0cb7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0c05a0 con 0x7f35ac0bd120 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35b0cb7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0be630 con 0x7f35ac153f80 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35aa59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac0be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35aa59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac0be140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41870/0 (socket says 172.21.15.27:41870) 2023-05-17T15:10:06.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35aa59c700 1 -- 172.21.15.27:0/658640777 learned_addr learned my addr 172.21.15.27:0/658640777 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35aad9d700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac153f80 0x7f35ac0c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.851+0000 7f35a9d9b700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0bd120 0x7f35ac154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35aa59c700 1 -- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac153f80 msgr2=0x7f35ac0c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35aa59c700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac153f80 0x7f35ac0c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35aa59c700 1 -- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0bd120 msgr2=0x7f35ac154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35aa59c700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0bd120 0x7f35ac154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:06.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35aa59c700 1 -- 172.21.15.27:0/658640777 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0009370 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35aa59c700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac0be140 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f359c00c440 tx=0x7f359c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0070d0 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c007230 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac157c00 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0056e0 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.852+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac0bff50 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.853+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac06bdf0 con 0x7f35ac066a60 2023-05-17T15:10:06.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.853+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f359c010070 con 0x7f35ac066a60 2023-05-17T15:10:06.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.854+0000 7f359a7fc700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 0x7f358c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:06.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.854+0000 7f35a9d9b700 1 -- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 msgr2=0x7f358c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:06.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.854+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f359c0791d0 con 0x7f35ac066a60 2023-05-17T15:10:06.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.854+0000 7f35a9d9b700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 0x7f358c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:06.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:06.858+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f359c04a5c0 con 0x7f35ac066a60 2023-05-17T15:10:07.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.055+0000 7f35a9d9b700 1 -- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 msgr2=0x7f358c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:07.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.055+0000 7f35a9d9b700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 0x7f358c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:07.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.076+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35ac0695d0 con 0x7f35ac066a60 2023-05-17T15:10:07.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.076+0000 7f359a7fc700 1 -- 172.21.15.27:0/658640777 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4485 (secure 0 0 0) 0x7f359c04dbe0 con 0x7f35ac066a60 2023-05-17T15:10:07.081 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:09:30.165063+0000","modified":"2023-05-17T15:09:33.179511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7092":{"gid":7092,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6834/1597094051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1597094051},{"type":"v1","addr":"172.21.15.27:6834","nonce":1597094051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-17T15:10:07.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 msgr2=0x7f358c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:07.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 0x7f358c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 msgr2=0x7f35ac0be140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac0be140 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f359c00c440 tx=0x7f359c007e30).stop 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 shutdown_connections 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f358c05eeb0 0x7f358c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35ac153f80 0x7f35ac0c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35ac066a60 0x7f35ac0be140 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 --2- 172.21.15.27:0/658640777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0bd120 0x7f35ac154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 >> 172.21.15.27:0/658640777 conn(0x7f35ac068750 msgr2=0x7f35ac066350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:07.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 shutdown_connections 2023-05-17T15:10:07.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.078+0000 7f35b0cb7700 1 -- 172.21.15.27:0/658640777 wait complete. 2023-05-17T15:10:07.086 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 44 2023-05-17T15:10:07.096 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.091+0000 7fa304075680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:10:07.097 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:07.166 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.161+0000 7fa304075680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:10:07.209 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.205+0000 7f542efd8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:10:07.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.211+0000 7f2329912700 1 Processor -- start 2023-05-17T15:10:07.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.211+0000 7f2329912700 1 -- start start 2023-05-17T15:10:07.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f2329912700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23240c6310 0x7f2324153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f2329912700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240bfcd0 con 0x7f23240c5f30 2023-05-17T15:10:07.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f2329912700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240c0290 con 0x7f23241541c0 2023-05-17T15:10:07.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f2329912700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240aa1a0 con 0x7f23240c6310 2023-05-17T15:10:07.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f2322ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f23240c5f30 0x7f2324158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41442/0 (socket says 172.21.15.27:41442) 2023-05-17T15:10:07.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f2322ffd700 1 -- 172.21.15.27:0/1789826110 learned_addr learned my addr 172.21.15.27:0/1789826110 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:07.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.212+0000 7f23227fc700 1 --2- 172.21.15.27:0/1789826110 >> v2:172.21.15.40:3300/0 conn(0x7f23240c6310 0x7f2324153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f2321ffb700 1 -- 172.21.15.27:0/1789826110 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793844810 0 0) 0x7f23240bfcd0 con 0x7f23240c5f30 2023-05-17T15:10:07.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f2321ffb700 1 -- 172.21.15.27:0/1789826110 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230c0033f0 con 0x7f23240c5f30 2023-05-17T15:10:07.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f2321ffb700 1 -- 172.21.15.27:0/1789826110 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3960018355 0 0) 0x7f230c0033f0 con 0x7f23240c5f30 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f23227fc700 1 -- 172.21.15.27:0/1789826110 >> v1:172.21.15.40:6789/0 conn(0x7f23241541c0 legacy=0x7f23240c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f23227fc700 1 -- 172.21.15.27:0/1789826110 >> v1:172.21.15.27:6789/0 conn(0x7f23240c5f30 legacy=0x7f2324158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f23227fc700 1 -- 172.21.15.27:0/1789826110 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240aa480 con 0x7f23240c6310 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f23227fc700 1 --2- 172.21.15.27:0/1789826110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23240c6310 0x7f2324153cd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f2318009760 tx=0x7f2318009060).ready entity=mon.1 client_cookie=c99d1f352e66839d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f2321ffb700 1 -- 172.21.15.27:0/1789826110 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314001470 con 0x7f23240c6310 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f2321ffb700 1 -- 172.21.15.27:0/1789826110 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318011400 con 0x7f23240c6310 2023-05-17T15:10:07.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.213+0000 7f2321ffb700 1 -- 172.21.15.27:0/1789826110 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318011780 con 0x7f23240c6310 2023-05-17T15:10:07.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 -- 172.21.15.27:0/1789826110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23240c6310 msgr2=0x7f2324153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 --2- 172.21.15.27:0/1789826110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23240c6310 0x7f2324153cd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f2318009760 tx=0x7f2318009060).stop 2023-05-17T15:10:07.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 -- 172.21.15.27:0/1789826110 shutdown_connections 2023-05-17T15:10:07.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 --2- 172.21.15.27:0/1789826110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23240c6310 0x7f2324153cd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 -- 172.21.15.27:0/1789826110 >> 172.21.15.27:0/1789826110 conn(0x7f2324069e70 msgr2=0x7f232405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:07.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 -- 172.21.15.27:0/1789826110 shutdown_connections 2023-05-17T15:10:07.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.214+0000 7f2329912700 1 -- 172.21.15.27:0/1789826110 wait complete. 2023-05-17T15:10:07.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.215+0000 7f2329912700 1 Processor -- start 2023-05-17T15:10:07.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.215+0000 7f2329912700 1 -- start start 2023-05-17T15:10:07.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2329912700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23240c5f30 0x7f232414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2329912700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 0x7f23240cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2329912700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23241541c0 0x7f23240c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2329912700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324168d10 con 0x7f23240c6310 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2329912700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324168140 con 0x7f23241541c0 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2329912700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23241683e0 con 0x7f23240c5f30 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 0x7f23240cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 0x7f23240cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41888/0 (socket says 172.21.15.27:41888) 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 -- 172.21.15.27:0/4216755436 learned_addr learned my addr 172.21.15.27:0/4216755436 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f2322ffd700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23240c5f30 0x7f232414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23237fe700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23241541c0 0x7f23240c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 -- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23240c5f30 msgr2=0x7f232414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23240c5f30 0x7f232414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 -- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23241541c0 msgr2=0x7f23240c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23241541c0 0x7f23240c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 -- 172.21.15.27:0/4216755436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180092a0 con 0x7f23240c6310 2023-05-17T15:10:07.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.216+0000 7f23227fc700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 0x7f23240cad80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f2318009e00 tx=0x7f2318014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:07.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.217+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318010800 con 0x7f23240c6310 2023-05-17T15:10:07.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.217+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318010960 con 0x7f23240c6310 2023-05-17T15:10:07.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.217+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23241686c0 con 0x7f23240c6310 2023-05-17T15:10:07.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.217+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318010d20 con 0x7f23240c6310 2023-05-17T15:10:07.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.217+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232414f160 con 0x7f23240c6310 2023-05-17T15:10:07.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.218+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232405f4a0 con 0x7f23240c6310 2023-05-17T15:10:07.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.218+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f231800f070 con 0x7f23240c6310 2023-05-17T15:10:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.218+0000 7f230affd700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 0x7f2310061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.219+0000 7f2322ffd700 1 -- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 msgr2=0x7f2310061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.219+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f231807b030 con 0x7f23240c6310 2023-05-17T15:10:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.219+0000 7f2322ffd700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 0x7f2310061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.223+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f231804c420 con 0x7f23240c6310 2023-05-17T15:10:07.242 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.238+0000 7fa304075680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:10:07.283 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.279+0000 7f542efd8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:10:07.362 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.357+0000 7f542efd8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:10:07.392 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.387+0000 7fa304075680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:10:07.668 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.458+0000 7fa304075680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:10:07.668 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.576+0000 7fa304075680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:10:07.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.420+0000 7f2322ffd700 1 -- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 msgr2=0x7f2310061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:07.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.420+0000 7f2322ffd700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 0x7f2310061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:07.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.440+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f232406bdf0 con 0x7f23240c6310 2023-05-17T15:10:07.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.441+0000 7f230affd700 1 -- 172.21.15.27:0/4216755436 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4485 (secure 0 0 0) 0x7f2318016030 con 0x7f23240c6310 2023-05-17T15:10:07.670 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:07.670 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:09:30.165063+0000","modified":"2023-05-17T15:09:33.179511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7092},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7092":{"gid":7092,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6834/1597094051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1597094051},{"type":"v1","addr":"172.21.15.27:6834","nonce":1597094051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-17T15:10:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 msgr2=0x7f2310061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 0x7f2310061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 msgr2=0x7f23240cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 0x7f23240cad80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f2318009e00 tx=0x7f2318014000).stop 2023-05-17T15:10:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 shutdown_connections 2023-05-17T15:10:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f231005eeb0 0x7f2310061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23241541c0 0x7f23240c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23240c5f30 0x7f232414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 --2- 172.21.15.27:0/4216755436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23240c6310 0x7f23240cad80 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 >> 172.21.15.27:0/4216755436 conn(0x7f2324069e70 msgr2=0x7f23240ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:07.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 shutdown_connections 2023-05-17T15:10:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.443+0000 7f2329912700 1 -- 172.21.15.27:0/4216755436 wait complete. 2023-05-17T15:10:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 44 2023-05-17T15:10:07.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:07.677 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.511+0000 7f542efd8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:10:07.677 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.585+0000 7f542efd8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:10:07.691 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.686+0000 7fa304075680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:07.710 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.706+0000 7f542efd8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:10:07.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.791+0000 7f49827ca700 1 Processor -- start 2023-05-17T15:10:07.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.791+0000 7f49827ca700 1 -- start start 2023-05-17T15:10:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f49827ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f49827ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f497c067cb0 0x7f497c068160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f49827ca700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c068650 con 0x7f497c0c3dd0 2023-05-17T15:10:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f49827ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0c4250 con 0x7f497c067cb0 2023-05-17T15:10:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f49827ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c065710 con 0x7f497c150970 2023-05-17T15:10:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f497b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f497c0c3dd0 0x7f497c064ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41458/0 (socket says 172.21.15.27:41458) 2023-05-17T15:10:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f497b7fe700 1 -- 172.21.15.27:0/1220346720 learned_addr learned my addr 172.21.15.27:0/1220346720 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:07.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f4980d67700 1 --2- 172.21.15.27:0/1220346720 >> v2:172.21.15.40:3300/0 conn(0x7f497c067cb0 0x7f497c068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f497bfff700 1 --2- 172.21.15.27:0/1220346720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f497affd700 1 -- 172.21.15.27:0/1220346720 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170908523 0 0) 0x7f496c001110 con 0x7f497c0c3dd0 2023-05-17T15:10:07.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.793+0000 7f497affd700 1 -- 172.21.15.27:0/1220346720 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49640033f0 con 0x7f497c0c3dd0 2023-05-17T15:10:07.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497affd700 1 -- 172.21.15.27:0/1220346720 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3907666083 0 0) 0x7f49640033f0 con 0x7f497c0c3dd0 2023-05-17T15:10:07.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497bfff700 1 -- 172.21.15.27:0/1220346720 >> v2:172.21.15.40:3300/0 conn(0x7f497c067cb0 msgr2=0x7f497c068160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:07.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497bfff700 1 --2- 172.21.15.27:0/1220346720 >> v2:172.21.15.40:3300/0 conn(0x7f497c067cb0 0x7f497c068160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497bfff700 1 -- 172.21.15.27:0/1220346720 >> v1:172.21.15.27:6789/0 conn(0x7f497c0c3dd0 legacy=0x7f497c064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497bfff700 1 -- 172.21.15.27:0/1220346720 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0bc9b0 con 0x7f497c150970 2023-05-17T15:10:07.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f4980d67700 1 --2- 172.21.15.27:0/1220346720 >> v2:172.21.15.40:3300/0 conn(0x7f497c067cb0 0x7f497c068160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:07.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497bfff700 1 --2- 172.21.15.27:0/1220346720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c150d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4970009760 tx=0x7f4970009060).ready entity=mon.2 client_cookie=ebe9856c30ca9957 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:07.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497affd700 1 -- 172.21.15.27:0/1220346720 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c001600 con 0x7f497c150970 2023-05-17T15:10:07.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497affd700 1 -- 172.21.15.27:0/1220346720 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970011400 con 0x7f497c150970 2023-05-17T15:10:07.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f497affd700 1 -- 172.21.15.27:0/1220346720 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011780 con 0x7f497c150970 2023-05-17T15:10:07.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f49827ca700 1 -- 172.21.15.27:0/1220346720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 msgr2=0x7f497c150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.794+0000 7f49827ca700 1 --2- 172.21.15.27:0/1220346720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c150d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4970009760 tx=0x7f4970009060).stop 2023-05-17T15:10:07.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.795+0000 7f49827ca700 1 -- 172.21.15.27:0/1220346720 shutdown_connections 2023-05-17T15:10:07.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.795+0000 7f49827ca700 1 --2- 172.21.15.27:0/1220346720 >> v2:172.21.15.40:3300/0 conn(0x7f497c067cb0 0x7f497c068160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.795+0000 7f49827ca700 1 --2- 172.21.15.27:0/1220346720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c150d50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.795+0000 7f49827ca700 1 -- 172.21.15.27:0/1220346720 >> 172.21.15.27:0/1220346720 conn(0x7f497c0c7920 msgr2=0x7f497c0c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:07.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.795+0000 7f49827ca700 1 -- 172.21.15.27:0/1220346720 shutdown_connections 2023-05-17T15:10:07.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.795+0000 7f49827ca700 1 -- 172.21.15.27:0/1220346720 wait complete. 2023-05-17T15:10:07.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.796+0000 7f49827ca700 1 Processor -- start 2023-05-17T15:10:07.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.796+0000 7f49827ca700 1 -- start start 2023-05-17T15:10:07.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 0x7f497c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f497c0c3dd0 0x7f497c0a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c05dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c161db0 con 0x7f497c067cb0 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c162020 con 0x7f497c0c3dd0 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c162300 con 0x7f497c150970 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 0x7f497c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 0x7f497c14f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41902/0 (socket says 172.21.15.27:41902) 2023-05-17T15:10:07.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 -- 172.21.15.27:0/2145763044 learned_addr learned my addr 172.21.15.27:0/2145763044 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497b7fe700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f497c0c3dd0 0x7f497c0a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f4980d67700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c05dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 -- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 msgr2=0x7f497c05dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c05dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 -- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f497c0c3dd0 msgr2=0x7f497c0a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f497c0c3dd0 0x7f497c0a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 -- 172.21.15.27:0/2145763044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009a20 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f497bfff700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 0x7f497c14f960 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f4970009d50 tx=0x7f4970016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970021070 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49700107c0 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49700092a0 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.797+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970010b40 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.798+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c1628c0 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.798+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c06bdf0 con 0x7f497c067cb0 2023-05-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.799+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f497000f070 con 0x7f497c067cb0 2023-05-17T15:10:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.799+0000 7f4963fff700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f496805eeb0 0x7f4968061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.799+0000 7f497b7fe700 1 -- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f496805eeb0 msgr2=0x7f4968061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.799+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f497007ae60 con 0x7f497c067cb0 2023-05-17T15:10:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.799+0000 7f497b7fe700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f496805eeb0 0x7f4968061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.803+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f497004c250 con 0x7f497c067cb0 2023-05-17T15:10:07.829 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:07.824+0000 7f542efd8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:07.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.978+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f497c0bcc90 con 0x7f497c067cb0 2023-05-17T15:10:07.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.979+0000 7f4963fff700 1 -- 172.21.15.27:0/2145763044 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17409 (secure 0 0 0) 0x7f497004f870 con 0x7f497c067cb0 2023-05-17T15:10:07.984 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:07.985 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":113,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:04.697499+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:09:27.811071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-17T15:09:29.145474+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":113,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/791897745":"2023-05-18T15:09:47.133550+0000","172.21.15.27:0/18151258":"2023-05-18T15:09:47.133550+0000","172.21.15.27:6837/86332":"2023-05-18T15:09:47.133550+0000","172.21.15.27:6836/86332":"2023-05-18T15:09:47.133550+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f496805eeb0 msgr2=0x7f4968061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f496805eeb0 0x7f4968061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:07.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 msgr2=0x7f497c14f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 0x7f497c14f960 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f4970009d50 tx=0x7f4970016000).stop 2023-05-17T15:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 shutdown_connections 2023-05-17T15:10:07.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f496805eeb0 0x7f4968061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f497c150970 0x7f497c05dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f497c067cb0 0x7f497c14f960 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 --2- 172.21.15.27:0/2145763044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f497c0c3dd0 0x7f497c0a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.981+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 >> 172.21.15.27:0/2145763044 conn(0x7f497c0c7920 msgr2=0x7f497c152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:07.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.982+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 shutdown_connections 2023-05-17T15:10:07.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:07.982+0000 7f49827ca700 1 -- 172.21.15.27:0/2145763044 wait complete. 2023-05-17T15:10:07.990 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:07.985+0000 7fa304075680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:10:07.999 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:10:08.062 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:08.057+0000 7fa304075680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:10:08.135 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.130+0000 7f542efd8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:10:08.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.152+0000 7fba98241700 1 Processor -- start 2023-05-17T15:10:08.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.152+0000 7fba98241700 1 -- start start 2023-05-17T15:10:08.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba98241700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 0x7fba90154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:08.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba98241700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 0x7fba900cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:08.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba98241700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900c5a50 con 0x7fba900cb450 2023-05-17T15:10:08.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba98241700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba90069fa0 con 0x7fba90069610 2023-05-17T15:10:08.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba98241700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900c04e0 con 0x7fba90154090 2023-05-17T15:10:08.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba95fdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 0x7fba90154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:08.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba967de700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 0x7fba900cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:08.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba95fdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 0x7fba90154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:43020/0 (socket says 172.21.15.27:43020) 2023-05-17T15:10:08.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba967de700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 0x7fba900cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:59842/0 (socket says 172.21.15.27:59842) 2023-05-17T15:10:08.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.153+0000 7fba95fdd700 1 -- 172.21.15.27:0/1512941072 learned_addr learned my addr 172.21.15.27:0/1512941072 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba95fdd700 1 -- 172.21.15.27:0/1512941072 >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 msgr2=0x7fba900cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba95fdd700 1 --2- 172.21.15.27:0/1512941072 >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 0x7fba900cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba95fdd700 1 -- 172.21.15.27:0/1512941072 >> v1:172.21.15.40:6789/0 conn(0x7fba900cb450 legacy=0x7fba90068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba94fdb700 1 -- 172.21.15.27:0/1512941072 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419539266 0 0) 0x7fba900c5a50 con 0x7fba900cb450 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba95fdd700 1 -- 172.21.15.27:0/1512941072 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900c0760 con 0x7fba90154090 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba967de700 1 --2- 172.21.15.27:0/1512941072 >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 0x7fba900cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba95fdd700 1 --2- 172.21.15.27:0/1512941072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 0x7fba90154470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fba80006fd0 tx=0x7fba800090f0).ready entity=mon.2 client_cookie=981f1b4c63f87132 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba94fdb700 1 -- 172.21.15.27:0/1512941072 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000b580 con 0x7fba90154090 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba94fdb700 1 -- 172.21.15.27:0/1512941072 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000b6e0 con 0x7fba90154090 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.154+0000 7fba94fdb700 1 -- 172.21.15.27:0/1512941072 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000ba60 con 0x7fba90154090 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 -- 172.21.15.27:0/1512941072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 msgr2=0x7fba90154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 --2- 172.21.15.27:0/1512941072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 0x7fba90154470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fba80006fd0 tx=0x7fba800090f0).stop 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 -- 172.21.15.27:0/1512941072 shutdown_connections 2023-05-17T15:10:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 --2- 172.21.15.27:0/1512941072 >> v2:172.21.15.40:3300/0 conn(0x7fba90069610 0x7fba900cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 --2- 172.21.15.27:0/1512941072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba90154090 0x7fba90154470 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 -- 172.21.15.27:0/1512941072 >> 172.21.15.27:0/1512941072 conn(0x7fba9005e7e0 msgr2=0x7fba900cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 -- 172.21.15.27:0/1512941072 shutdown_connections 2023-05-17T15:10:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.155+0000 7fba98241700 1 -- 172.21.15.27:0/1512941072 wait complete. 2023-05-17T15:10:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.156+0000 7fba98241700 1 Processor -- start 2023-05-17T15:10:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.156+0000 7fba98241700 1 -- start start 2023-05-17T15:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 0x7fba90157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba900cb450 0x7fba901505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba90154090 0x7fba9014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90154e00 con 0x7fba90069610 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90155910 con 0x7fba90154090 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba90150a90 con 0x7fba900cb450 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 0x7fba90157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 0x7fba90157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41914/0 (socket says 172.21.15.27:41914) 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 -- 172.21.15.27:0/1892838710 learned_addr learned my addr 172.21.15.27:0/1892838710 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba967de700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba90154090 0x7fba9014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba957dc700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba900cb450 0x7fba901505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 -- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba900cb450 msgr2=0x7fba901505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba900cb450 0x7fba901505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 -- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba90154090 msgr2=0x7fba9014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba90154090 0x7fba9014f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 -- 172.21.15.27:0/1892838710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009a20 con 0x7fba90069610 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba95fdd700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 0x7fba90157730 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fba80009130 tx=0x7fba80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000b850 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000b9b0 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.157+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba80009370 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.158+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8001c670 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.158+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba90154fe0 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.159+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba900c0a40 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.159+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fba8000f070 con 0x7fba90069610 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.159+0000 7fba85ffb700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 0x7fba74061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:08.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.159+0000 7fba957dc700 1 -- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 msgr2=0x7fba74061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:08.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.159+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fba8007b420 con 0x7fba90069610 2023-05-17T15:10:08.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.160+0000 7fba957dc700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 0x7fba74061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:08.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.164+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba8004c810 con 0x7fba90069610 2023-05-17T15:10:08.212 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.208+0000 7f542efd8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:10:08.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.361+0000 7fba957dc700 1 -- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 msgr2=0x7fba74061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:08.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.361+0000 7fba957dc700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 0x7fba74061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:08.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.381+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba900cbb70 con 0x7fba90069610 2023-05-17T15:10:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.718+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 45) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fba80079170 con 0x7fba90069610 2023-05-17T15:10:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.718+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 msgr2=0x7fba74061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:08.719+0000 7fba85ffb700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 0x7fba74061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:08.774 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53aefbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.774 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53aefbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53aefbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53aefbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53aefbd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53b1fc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53b1fc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53b1fc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53b1fc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:08.769+0000 7f53b1fc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:08.779 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:10:08.775+0000 7fa5c1c46700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:08.779 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:10:08.775+0000 7fa5c1c46700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:08.780 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:10:08.775+0000 7fa5c1c46700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:10:08.784 INFO:tasks.ceph.mds.a.smithi027.stderr: -4830> 2023-05-17T15:09:35.079+0000 7fa5c544d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:10:08.790 INFO:tasks.ceph.mds.a.smithi027.stderr: -5> 2023-05-17T15:10:08.775+0000 7fa5c1c46700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:08.790 INFO:tasks.ceph.mds.a.smithi027.stderr: -4> 2023-05-17T15:10:08.775+0000 7fa5c1c46700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:08.791 INFO:tasks.ceph.mds.a.smithi027.stderr: -2> 2023-05-17T15:10:08.775+0000 7fa5c1c46700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:10:08.809 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:10:09.227 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:10:09.222+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:10:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.227+0000 7fba85ffb700 1 -- 172.21.15.27:0/1892838710 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7fba800551f0 con 0x7fba90069610 2023-05-17T15:10:09.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 msgr2=0x7fba90157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:09.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 0x7fba90157730 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fba80009130 tx=0x7fba80017000).stop 2023-05-17T15:10:09.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 shutdown_connections 2023-05-17T15:10:09.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fba7405eeb0 0x7fba74061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba90154090 0x7fba9014f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba90069610 0x7fba90157730 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 --2- 172.21.15.27:0/1892838710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba900cb450 0x7fba901505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 >> 172.21.15.27:0/1892838710 conn(0x7fba9005e7e0 msgr2=0x7fba900c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:09.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 shutdown_connections 2023-05-17T15:10:09.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.229+0000 7fba98241700 1 -- 172.21.15.27:0/1892838710 wait complete. 2023-05-17T15:10:09.238 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:10:09.247 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:10:09.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.362+0000 7f592cae9700 1 Processor -- start 2023-05-17T15:10:09.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.362+0000 7f592cae9700 1 -- start start 2023-05-17T15:10:09.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592cae9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59280c6310 0x7f5928068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:09.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592cae9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59280691f0 0x7f59280bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:09.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592cae9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5928158790 con 0x7f59281543d0 2023-05-17T15:10:09.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592cae9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280c1c50 con 0x7f59280691f0 2023-05-17T15:10:09.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592cae9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5928157e60 con 0x7f59280c6310 2023-05-17T15:10:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f59281543d0 0x7f59280c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41594/0 (socket says 172.21.15.27:41594) 2023-05-17T15:10:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592659c700 1 -- 172.21.15.27:0/1048108463 learned_addr learned my addr 172.21.15.27:0/1048108463 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:09.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5926d9d700 1 --2- 172.21.15.27:0/1048108463 >> v2:172.21.15.27:3300/0 conn(0x7f59280691f0 0x7f59280bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:09.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5925d9b700 1 --2- 172.21.15.27:0/1048108463 >> v2:172.21.15.40:3300/0 conn(0x7f59280c6310 0x7f5928068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:09.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5926d9d700 1 -- 172.21.15.27:0/1048108463 >> v2:172.21.15.40:3300/0 conn(0x7f59280c6310 msgr2=0x7f5928068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:09.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5926d9d700 1 --2- 172.21.15.27:0/1048108463 >> v2:172.21.15.40:3300/0 conn(0x7f59280c6310 0x7f5928068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592559a700 1 -- 172.21.15.27:0/1048108463 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390799859 0 0) 0x7f5928158790 con 0x7f59281543d0 2023-05-17T15:10:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5926d9d700 1 -- 172.21.15.27:0/1048108463 >> v1:172.21.15.27:6789/0 conn(0x7f59281543d0 legacy=0x7f59280c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5926d9d700 1 -- 172.21.15.27:0/1048108463 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928158140 con 0x7f59280691f0 2023-05-17T15:10:09.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5925d9b700 1 --2- 172.21.15.27:0/1048108463 >> v2:172.21.15.40:3300/0 conn(0x7f59280c6310 0x7f5928068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f5926d9d700 1 --2- 172.21.15.27:0/1048108463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59280691f0 0x7f59280bfc80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f59280c5620 tx=0x7f5918009060).ready entity=mon.0 client_cookie=4280ecaeb26300c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592559a700 1 -- 172.21.15.27:0/1048108463 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800b580 con 0x7f59280691f0 2023-05-17T15:10:09.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592559a700 1 -- 172.21.15.27:0/1048108463 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800b6e0 con 0x7f59280691f0 2023-05-17T15:10:09.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.363+0000 7f592559a700 1 -- 172.21.15.27:0/1048108463 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800ba60 con 0x7f59280691f0 2023-05-17T15:10:09.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 -- 172.21.15.27:0/1048108463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59280691f0 msgr2=0x7f59280bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:09.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 --2- 172.21.15.27:0/1048108463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59280691f0 0x7f59280bfc80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f59280c5620 tx=0x7f5918009060).stop 2023-05-17T15:10:09.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 -- 172.21.15.27:0/1048108463 shutdown_connections 2023-05-17T15:10:09.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 --2- 172.21.15.27:0/1048108463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59280691f0 0x7f59280bfc80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 --2- 172.21.15.27:0/1048108463 >> v2:172.21.15.40:3300/0 conn(0x7f59280c6310 0x7f5928068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 -- 172.21.15.27:0/1048108463 >> 172.21.15.27:0/1048108463 conn(0x7f59280cb7f0 msgr2=0x7f59280c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:09.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 -- 172.21.15.27:0/1048108463 shutdown_connections 2023-05-17T15:10:09.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.364+0000 7f592cae9700 1 -- 172.21.15.27:0/1048108463 wait complete. 2023-05-17T15:10:09.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.365+0000 7f592cae9700 1 Processor -- start 2023-05-17T15:10:09.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.365+0000 7f592cae9700 1 -- start start 2023-05-17T15:10:09.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592cae9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59280691f0 0x7f5928152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:09.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592cae9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59280c6310 0x7f59280aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:09.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592cae9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 0x7f59280c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:09.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592cae9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280c3a20 con 0x7f59281543d0 2023-05-17T15:10:09.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592cae9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280ab690 con 0x7f59280691f0 2023-05-17T15:10:09.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592cae9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280ab970 con 0x7f59280c6310 2023-05-17T15:10:09.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 0x7f59280c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:09.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 0x7f59280c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42042/0 (socket says 172.21.15.27:42042) 2023-05-17T15:10:09.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 -- 172.21.15.27:0/1894259811 learned_addr learned my addr 172.21.15.27:0/1894259811 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:09.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5925d9b700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59280c6310 0x7f59280aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:09.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 -- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59280c6310 msgr2=0x7f59280aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:09.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592659c700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59280691f0 0x7f5928152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:09.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59280c6310 0x7f59280aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 -- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59280691f0 msgr2=0x7f5928152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:09.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59280691f0 0x7f5928152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:09.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 -- 172.21.15.27:0/1894259811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180092a0 con 0x7f59281543d0 2023-05-17T15:10:09.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5925d9b700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59280c6310 0x7f59280aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:09.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f592659c700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59280691f0 0x7f5928152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:09.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.366+0000 7f5926d9d700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 0x7f59280c3eb0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f5928083d00 tx=0x7f5918017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:09.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.367+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800ba60 con 0x7f59281543d0 2023-05-17T15:10:09.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.367+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591801b410 con 0x7f59281543d0 2023-05-17T15:10:09.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.367+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59280abc50 con 0x7f59281543d0 2023-05-17T15:10:09.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.367+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591801b7d0 con 0x7f59281543d0 2023-05-17T15:10:09.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.367+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59280aca80 con 0x7f59281543d0 2023-05-17T15:10:09.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.368+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59280c3b90 con 0x7f59281543d0 2023-05-17T15:10:09.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.368+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 45) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f591800f070 con 0x7f59281543d0 2023-05-17T15:10:09.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.368+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6737+0+0 (secure 0 0 0) 0x7f591807ba20 con 0x7f59281543d0 2023-05-17T15:10:09.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.372+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f591804cdf0 con 0x7f59281543d0 2023-05-17T15:10:09.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.587+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f592806bdf0 con 0x7f59281543d0 2023-05-17T15:10:09.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.723+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 46) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5918079750 con 0x7f59281543d0 2023-05-17T15:10:09.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.723+0000 7f591e7fc700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5908030180 0x7f5908067940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:09.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.723+0000 7f592659c700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5908030180 0x7f5908067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:09.730 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:09.724+0000 7f592659c700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5908030180 0x7f5908067940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f59200016f0 tx=0x7f5920009040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.228+0000 7f591e7fc700 1 -- 172.21.15.27:0/1894259811 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7f591803fca0 con 0x7f59281543d0 2023-05-17T15:10:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5908030180 msgr2=0x7f5908067940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5908030180 0x7f5908067940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f59200016f0 tx=0x7f5920009040).stop 2023-05-17T15:10:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 msgr2=0x7f59280c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 0x7f59280c3eb0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f5928083d00 tx=0x7f5918017000).stop 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 shutdown_connections 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f5908030180 0x7f5908067940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59281543d0 0x7f59280c3eb0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59280691f0 0x7f5928152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 --2- 172.21.15.27:0/1894259811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59280c6310 0x7f59280aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 >> 172.21.15.27:0/1894259811 conn(0x7f59280cb7f0 msgr2=0x7f59281547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 shutdown_connections 2023-05-17T15:10:10.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.230+0000 7f592cae9700 1 -- 172.21.15.27:0/1894259811 wait complete. 2023-05-17T15:10:10.248 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:10:10.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.365+0000 7f5772698700 1 Processor -- start 2023-05-17T15:10:10.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.365+0000 7f5772698700 1 -- start start 2023-05-17T15:10:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5772698700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f576c151c90 0x7f576c152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5772698700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f576c154980 0x7f576c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5772698700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c158010 con 0x7f576c0c0520 2023-05-17T15:10:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5772698700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c154f60 con 0x7f576c154980 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5772698700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c155240 con 0x7f576c151c90 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f576c154980 0x7f576c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5770c35700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f576c0c0520 0x7f576c081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41632/0 (socket says 172.21.15.27:41632) 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f5770c35700 1 -- 172.21.15.27:0/2383405817 learned_addr learned my addr 172.21.15.27:0/2383405817 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576bfff700 1 --2- 172.21.15.27:0/2383405817 >> v2:172.21.15.40:3300/0 conn(0x7f576c151c90 0x7f576c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576b7fe700 1 -- 172.21.15.27:0/2383405817 >> v2:172.21.15.40:3300/0 conn(0x7f576c151c90 msgr2=0x7f576c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576b7fe700 1 --2- 172.21.15.27:0/2383405817 >> v2:172.21.15.40:3300/0 conn(0x7f576c151c90 0x7f576c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576b7fe700 1 -- 172.21.15.27:0/2383405817 >> v1:172.21.15.27:6789/0 conn(0x7f576c0c0520 legacy=0x7f576c081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576b7fe700 1 -- 172.21.15.27:0/2383405817 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c155520 con 0x7f576c154980 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576affd700 1 -- 172.21.15.27:0/2383405817 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408868066 0 0) 0x7f576c158010 con 0x7f576c0c0520 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.366+0000 7f576b7fe700 1 --2- 172.21.15.27:0/2383405817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c154980 0x7f576c0c6150 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f576c084120 tx=0x7f575c009060).ready entity=mon.0 client_cookie=423d1173e596706d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f576affd700 1 -- 172.21.15.27:0/2383405817 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00b580 con 0x7f576c154980 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f576affd700 1 -- 172.21.15.27:0/2383405817 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c00b6e0 con 0x7f576c154980 2023-05-17T15:10:10.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f576affd700 1 -- 172.21.15.27:0/2383405817 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00ba60 con 0x7f576c154980 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 -- 172.21.15.27:0/2383405817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c154980 msgr2=0x7f576c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 --2- 172.21.15.27:0/2383405817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c154980 0x7f576c0c6150 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f576c084120 tx=0x7f575c009060).stop 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 -- 172.21.15.27:0/2383405817 shutdown_connections 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 --2- 172.21.15.27:0/2383405817 >> v2:172.21.15.40:3300/0 conn(0x7f576c151c90 0x7f576c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 --2- 172.21.15.27:0/2383405817 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c154980 0x7f576c0c6150 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 -- 172.21.15.27:0/2383405817 >> 172.21.15.27:0/2383405817 conn(0x7f576c0cae10 msgr2=0x7f576c0cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 -- 172.21.15.27:0/2383405817 shutdown_connections 2023-05-17T15:10:10.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.367+0000 7f5772698700 1 -- 172.21.15.27:0/2383405817 wait complete. 2023-05-17T15:10:10.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.368+0000 7f5772698700 1 Processor -- start 2023-05-17T15:10:10.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.368+0000 7f5772698700 1 -- start start 2023-05-17T15:10:10.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5772698700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 0x7f576c146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:10.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5772698700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f576c151c90 0x7f576c164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:10.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5772698700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f576c154980 0x7f576c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:10.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5772698700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0c3dc0 con 0x7f576c0c0520 2023-05-17T15:10:10.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5772698700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0c31b0 con 0x7f576c151c90 2023-05-17T15:10:10.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5772698700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0c3490 con 0x7f576c154980 2023-05-17T15:10:10.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 0x7f576c146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 0x7f576c146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42074/0 (socket says 172.21.15.27:42074) 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 -- 172.21.15.27:0/1545647461 learned_addr learned my addr 172.21.15.27:0/1545647461 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576b7fe700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f576c151c90 0x7f576c164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 -- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f576c154980 msgr2=0x7f576c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f5770c35700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f576c154980 0x7f576c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f576c154980 0x7f576c0b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 -- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f576c151c90 msgr2=0x7f576c164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:10.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.369+0000 7f576bfff700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f576c151c90 0x7f576c164860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:10.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f576bfff700 1 -- 172.21.15.27:0/1545647461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0092a0 con 0x7f576c0c0520 2023-05-17T15:10:10.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f576bfff700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 0x7f576c146ad0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f576000d890 tx=0x7f5760008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:10.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600125f0 con 0x7f576c0c0520 2023-05-17T15:10:10.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760012750 con 0x7f576c0c0520 2023-05-17T15:10:10.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c0c3770 con 0x7f576c0c0520 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760012ad0 con 0x7f576c0c0520 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.370+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c1511c0 con 0x7f576c0c0520 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.371+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c06bdf0 con 0x7f576c0c0520 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.371+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 46) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5760013480 con 0x7f576c0c0520 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.372+0000 7f5753fff700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f575805ecf0 0x7f57580611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.372+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6737+0+0 (secure 0 0 0) 0x7f5760079bf0 con 0x7f576c0c0520 2023-05-17T15:10:10.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.372+0000 7f576b7fe700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f575805ecf0 0x7f57580611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:10.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.372+0000 7f576b7fe700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f575805ecf0 0x7f57580611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f576c0ae2a0 tx=0x7f575c017000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:10.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.376+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f576004af60 con 0x7f576c0c0520 2023-05-17T15:10:10.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:10.549+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f576c155800 con 0x7f576c0c0520 2023-05-17T15:10:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.233+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f57600a88f0 con 0x7f576c0c0520 2023-05-17T15:10:11.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.237+0000 7f5753fff700 1 -- 172.21.15.27:0/1545647461 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5760070e80 con 0x7f576c0c0520 2023-05-17T15:10:11.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f575805ecf0 msgr2=0x7f57580611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:11.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f575805ecf0 0x7f57580611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f576c0ae2a0 tx=0x7f575c017000).stop 2023-05-17T15:10:11.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 msgr2=0x7f576c146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 0x7f576c146ad0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f576000d890 tx=0x7f5760008040).stop 2023-05-17T15:10:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 shutdown_connections 2023-05-17T15:10:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f575805ecf0 0x7f57580611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f576c154980 0x7f576c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f576c0c0520 0x7f576c146ad0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 --2- 172.21.15.27:0/1545647461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f576c151c90 0x7f576c164860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 >> 172.21.15.27:0/1545647461 conn(0x7f576c0cae10 msgr2=0x7f576c154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 shutdown_connections 2023-05-17T15:10:11.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.241+0000 7f5772698700 1 -- 172.21.15.27:0/1545647461 wait complete. 2023-05-17T15:10:11.249 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:10:11.261 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:10:11.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.382+0000 7f37f09d8700 1 Processor -- start 2023-05-17T15:10:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.382+0000 7f37f09d8700 1 -- start start 2023-05-17T15:10:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37f09d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec151c90 0x7f37ec152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37f09d8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37ec0c0520 0x7f37ec081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37f09d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec158010 con 0x7f37ec154980 2023-05-17T15:10:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37f09d8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec154f60 con 0x7f37ec0c0520 2023-05-17T15:10:11.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37f09d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec155240 con 0x7f37ec151c90 2023-05-17T15:10:11.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ea59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec151c90 0x7f37ec152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:11.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37ec0c0520 0x7f37ec081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:11.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ea59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec151c90 0x7f37ec152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:43190/0 (socket says 172.21.15.27:43190) 2023-05-17T15:10:11.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37ec0c0520 0x7f37ec081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:60014/0 (socket says 172.21.15.27:60014) 2023-05-17T15:10:11.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ea59c700 1 -- 172.21.15.27:0/2422426777 learned_addr learned my addr 172.21.15.27:0/2422426777 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 -- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec151c90 msgr2=0x7f37ec152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 --2- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec151c90 0x7f37ec152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 -- 172.21.15.27:0/2422426777 >> v1:172.21.15.40:6789/0 conn(0x7f37ec154980 legacy=0x7f37ec0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 -- 172.21.15.27:0/2422426777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec155520 con 0x7f37ec0c0520 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.383+0000 7f37ead9d700 1 --2- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec081fd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f37e4009760 tx=0x7f37e4009060).ready entity=mon.1 client_cookie=a5d62685059fe8be server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37e959a700 1 -- 172.21.15.27:0/2422426777 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400f510 con 0x7f37ec0c0520 2023-05-17T15:10:11.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37e959a700 1 -- 172.21.15.27:0/2422426777 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400f670 con 0x7f37ec0c0520 2023-05-17T15:10:11.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37e959a700 1 -- 172.21.15.27:0/2422426777 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400f9f0 con 0x7f37ec0c0520 2023-05-17T15:10:11.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 -- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 msgr2=0x7f37ec081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:11.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 --2- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec081fd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f37e4009760 tx=0x7f37e4009060).stop 2023-05-17T15:10:11.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 -- 172.21.15.27:0/2422426777 shutdown_connections 2023-05-17T15:10:11.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 --2- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec081fd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 --2- 172.21.15.27:0/2422426777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec151c90 0x7f37ec152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 -- 172.21.15.27:0/2422426777 >> 172.21.15.27:0/2422426777 conn(0x7f37ec0cae10 msgr2=0x7f37ec0cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:11.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 -- 172.21.15.27:0/2422426777 shutdown_connections 2023-05-17T15:10:11.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.384+0000 7f37f09d8700 1 -- 172.21.15.27:0/2422426777 wait complete. 2023-05-17T15:10:11.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.385+0000 7f37f09d8700 1 Processor -- start 2023-05-17T15:10:11.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.385+0000 7f37f09d8700 1 -- start start 2023-05-17T15:10:11.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37f09d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:11.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37f09d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 0x7f37ec0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:11.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37f09d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec154980 0x7f37ec150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:11.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37f09d8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c1fe0 con 0x7f37ec151c90 2023-05-17T15:10:11.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37f09d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0ace60 con 0x7f37ec0c0520 2023-05-17T15:10:11.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37f09d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0ad140 con 0x7f37ec154980 2023-05-17T15:10:11.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37e9d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 0x7f37ec0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:11.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37e9d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 0x7f37ec0b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42088/0 (socket says 172.21.15.27:42088) 2023-05-17T15:10:11.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37e9d9b700 1 -- 172.21.15.27:0/4198578134 learned_addr learned my addr 172.21.15.27:0/4198578134 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:11.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37ea59c700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.386+0000 7f37ead9d700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec154980 0x7f37ec150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37e9d9b700 1 -- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec154980 msgr2=0x7f37ec150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec154980 0x7f37ec150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37e9d9b700 1 -- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 msgr2=0x7f37ec0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec0ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37e9d9b700 1 -- 172.21.15.27:0/4198578134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e40092a0 con 0x7f37ec151c90 2023-05-17T15:10:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37e9d9b700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 0x7f37ec0b06d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f37e000c4c0 tx=0x7f37e0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000ce10 con 0x7f37ec151c90 2023-05-17T15:10:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0007020 con 0x7f37ec151c90 2023-05-17T15:10:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00073c0 con 0x7f37ec151c90 2023-05-17T15:10:11.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec0ad420 con 0x7f37ec151c90 2023-05-17T15:10:11.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.387+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec0b0bc0 con 0x7f37ec151c90 2023-05-17T15:10:11.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.388+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec06bdf0 con 0x7f37ec151c90 2023-05-17T15:10:11.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.388+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f37e0010070 con 0x7f37ec151c90 2023-05-17T15:10:11.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.389+0000 7f37da7fc700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f37cc05ed90 0x7f37cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:11.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.389+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6299+0+0 (secure 0 0 0) 0x7f37e0078d20 con 0x7f37ec151c90 2023-05-17T15:10:11.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.389+0000 7f37ea59c700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f37cc05ed90 0x7f37cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:11.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.389+0000 7f37ea59c700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f37cc05ed90 0x7f37cc061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f37dc00f570 tx=0x7f37dc00b040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:11.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.393+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37e00478f0 con 0x7f37ec151c90 2023-05-17T15:10:11.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:11.567+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37ec155800 con 0x7f37ec151c90 2023-05-17T15:10:12.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.239+0000 7f37da7fc700 1 -- 172.21.15.27:0/4198578134 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 169+0+0 (secure 0 0 0) 0x7f37e004a210 con 0x7f37ec151c90 2023-05-17T15:10:12.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f37cc05ed90 msgr2=0x7f37cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f37cc05ed90 0x7f37cc061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f37dc00f570 tx=0x7f37dc00b040).stop 2023-05-17T15:10:12.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 msgr2=0x7f37ec0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 0x7f37ec0b06d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f37e000c4c0 tx=0x7f37e0007dd0).stop 2023-05-17T15:10:12.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 shutdown_connections 2023-05-17T15:10:12.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f37cc05ed90 0x7f37cc061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37ec154980 0x7f37ec150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37ec0c0520 0x7f37ec0ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 --2- 172.21.15.27:0/4198578134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37ec151c90 0x7f37ec0b06d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 >> 172.21.15.27:0/4198578134 conn(0x7f37ec0cae10 msgr2=0x7f37ec155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:12.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 shutdown_connections 2023-05-17T15:10:12.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.242+0000 7f37f09d8700 1 -- 172.21.15.27:0/4198578134 wait complete. 2023-05-17T15:10:12.249 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:10:12.260 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:10:12.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.386+0000 7f6ed5db9700 1 Processor -- start 2023-05-17T15:10:12.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.387+0000 7f6ed5db9700 1 -- start start 2023-05-17T15:10:12.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.388+0000 7f6ed5db9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed00669c0 0x7f6ed0066da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.388+0000 7f6ed5db9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed0154680 con 0x7f6ed00a90a0 2023-05-17T15:10:12.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.388+0000 7f6ed5db9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed0157eb0 con 0x7f6ed0157a20 2023-05-17T15:10:12.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.388+0000 7f6ed5db9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed01589a0 con 0x7f6ed00669c0 2023-05-17T15:10:12.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.388+0000 7f6eceffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6ed00a90a0 0x7f6ed0065ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41660/0 (socket says 172.21.15.27:41660) 2023-05-17T15:10:12.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.388+0000 7f6eceffd700 1 -- 172.21.15.27:0/2833975434 learned_addr learned my addr 172.21.15.27:0/2833975434 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:12.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ecf7fe700 1 --2- 172.21.15.27:0/2833975434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed00669c0 0x7f6ed0066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256909727 0 0) 0x7f6ed0154680 con 0x7f6ed00a90a0 2023-05-17T15:10:12.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb80033f0 con 0x7f6ed00a90a0 2023-05-17T15:10:12.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153660794 0 0) 0x7f6ed0157eb0 con 0x7f6ed0157a20 2023-05-17T15:10:12.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed0154680 con 0x7f6ed0157a20 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/2833975434 >> v1:172.21.15.40:6789/0 conn(0x7f6ed0157a20 legacy=0x7f6ed0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/2833975434 >> v1:172.21.15.27:6789/0 conn(0x7f6ed00a90a0 legacy=0x7f6ed0065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/2833975434 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00a8ea0 con 0x7f6ed00669c0 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.389+0000 7f6ecf7fe700 1 --2- 172.21.15.27:0/2833975434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed00669c0 0x7f6ed0066da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6ec0009790 tx=0x7f6ec0009060).ready entity=mon.2 client_cookie=9973cb7a9c9bf08 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.390+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000d4a0 con 0x7f6ed00669c0 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.390+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000d600 con 0x7f6ed00669c0 2023-05-17T15:10:12.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.390+0000 7f6ece7fc700 1 -- 172.21.15.27:0/2833975434 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000d980 con 0x7f6ed00669c0 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 -- 172.21.15.27:0/2833975434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed00669c0 msgr2=0x7f6ed0066da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/2833975434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed00669c0 0x7f6ed0066da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6ec0009790 tx=0x7f6ec0009060).stop 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 -- 172.21.15.27:0/2833975434 shutdown_connections 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/2833975434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed00669c0 0x7f6ed0066da0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 -- 172.21.15.27:0/2833975434 >> 172.21.15.27:0/2833975434 conn(0x7f6ed00c67b0 msgr2=0x7f6ed00c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 -- 172.21.15.27:0/2833975434 shutdown_connections 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.391+0000 7f6ed5db9700 1 -- 172.21.15.27:0/2833975434 wait complete. 2023-05-17T15:10:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.392+0000 7f6ed5db9700 1 Processor -- start 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.393+0000 7f6ed5db9700 1 -- start start 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ed5db9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 0x7f6ed00a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ed5db9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed00a90a0 0x7f6ed0156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ed5db9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed0157a20 0x7f6ed0148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ed5db9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00abb60 con 0x7f6ed00669c0 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ed5db9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00ac0b0 con 0x7f6ed00a90a0 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ed5db9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00a8a40 con 0x7f6ed0157a20 2023-05-17T15:10:12.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 0x7f6ed00a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 0x7f6ed00a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42100/0 (socket says 172.21.15.27:42100) 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/3022351277 learned_addr learned my addr 172.21.15.27:0/3022351277 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6eceffd700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed00a90a0 0x7f6ed0156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecffff700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed0157a20 0x7f6ed0148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed0157a20 msgr2=0x7f6ed0148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed0157a20 0x7f6ed0148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed00a90a0 msgr2=0x7f6ed0156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed00a90a0 0x7f6ed0156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 -- 172.21.15.27:0/3022351277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00092a0 con 0x7f6ed00669c0 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecffff700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed0157a20 0x7f6ed0148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6ecf7fe700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 0x7f6ed00a97c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f6ed0063200 tx=0x7f6ec0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.394+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0000c90 con 0x7f6ed00669c0 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.395+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed00c0270 con 0x7f6ed00669c0 2023-05-17T15:10:12.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.395+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000d770 con 0x7f6ed00669c0 2023-05-17T15:10:12.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.395+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec001d660 con 0x7f6ed00669c0 2023-05-17T15:10:12.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.395+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed00abd40 con 0x7f6ed00669c0 2023-05-17T15:10:12.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.396+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed00c0770 con 0x7f6ed00669c0 2023-05-17T15:10:12.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.396+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6ec000f070 con 0x7f6ed00669c0 2023-05-17T15:10:12.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.396+0000 7f6eb77fe700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ebc05ed90 0x7f6ebc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.396+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f6ec007b270 con 0x7f6ed00669c0 2023-05-17T15:10:12.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.396+0000 7f6eceffd700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ebc05ed90 0x7f6ebc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.397+0000 7f6eceffd700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ebc05ed90 0x7f6ebc061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6ed0066f10 tx=0x7f6ec4007bd0).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:12.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.401+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ec004c900 con 0x7f6ed00669c0 2023-05-17T15:10:12.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.573+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6ed006bdf0 con 0x7f6ed00669c0 2023-05-17T15:10:12.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.577+0000 7f6eb77fe700 1 -- 172.21.15.27:0/3022351277 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6ec004ff20 con 0x7f6ed00669c0 2023-05-17T15:10:12.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ebc05ed90 msgr2=0x7f6ebc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ebc05ed90 0x7f6ebc061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6ed0066f10 tx=0x7f6ec4007bd0).stop 2023-05-17T15:10:12.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 msgr2=0x7f6ed00a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 0x7f6ed00a97c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f6ed0063200 tx=0x7f6ec0016000).stop 2023-05-17T15:10:12.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 shutdown_connections 2023-05-17T15:10:12.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ebc05ed90 0x7f6ebc061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed0157a20 0x7f6ed0148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ed00669c0 0x7f6ed00a97c0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 --2- 172.21.15.27:0/3022351277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed00a90a0 0x7f6ed0156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 >> 172.21.15.27:0/3022351277 conn(0x7f6ed00c67b0 msgr2=0x7f6ed0152440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:12.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 shutdown_connections 2023-05-17T15:10:12.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.579+0000 7f6ed5db9700 1 -- 172.21.15.27:0/3022351277 wait complete. 2023-05-17T15:10:12.598 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:10:12.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.714+0000 7ff3f3c98700 1 Processor -- start 2023-05-17T15:10:12.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.714+0000 7ff3f3c98700 1 -- start start 2023-05-17T15:10:12.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f3c98700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3ec1543d0 0x7ff3ec0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f3c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 0x7ff3ec0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f3c98700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec158790 con 0x7ff3ec0c60f0 2023-05-17T15:10:12.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f3c98700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ec0c1c50 con 0x7ff3ec1543d0 2023-05-17T15:10:12.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f3c98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0c6570 con 0x7ff3ec069410 2023-05-17T15:10:12.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f1233700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff3ec0c60f0 0x7ff3ec068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41672/0 (socket says 172.21.15.27:41672) 2023-05-17T15:10:12.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f1233700 1 -- 172.21.15.27:0/1441928614 learned_addr learned my addr 172.21.15.27:0/1441928614 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:12.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f2235700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 0x7ff3ec0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.715+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189172185 0 0) 0x7ff3ec158790 con 0x7ff3ec0c60f0 2023-05-17T15:10:12.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d80033f0 con 0x7ff3ec0c60f0 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f1a34700 1 --2- 172.21.15.27:0/1441928614 >> v2:172.21.15.40:3300/0 conn(0x7ff3ec1543d0 0x7ff3ec0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3763127444 0 0) 0x7ff3d80033f0 con 0x7ff3ec0c60f0 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 msgr2=0x7ff3ec0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 0x7ff3ec0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 >> v2:172.21.15.40:3300/0 conn(0x7ff3ec1543d0 msgr2=0x7ff3ec0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 --2- 172.21.15.27:0/1441928614 >> v2:172.21.15.40:3300/0 conn(0x7ff3ec1543d0 0x7ff3ec0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec157e60 con 0x7ff3ec0c60f0 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7ff3e8001470 con 0x7ff3ec0c60f0 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 >> v1:172.21.15.27:6789/0 conn(0x7ff3ec0c60f0 legacy=0x7ff3ec068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 0x7ff3d80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d8003e10 0x7ff3d8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3d8004b80 0x7ff3d8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0c6570 con 0x7ff3d8004b80 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d800b8e0 con 0x7ff3d8003e10 2023-05-17T15:10:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d800ba20 con 0x7ff3ec069410 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3d8004b80 0x7ff3d8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f1233700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d8003e10 0x7ff3d8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f1a34700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 0x7ff3d80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 -- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 msgr2=0x7ff3d80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec069410 0x7ff3d80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 -- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d8003e10 msgr2=0x7ff3d8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d8003e10 0x7ff3d8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 -- 172.21.15.27:0/1441928614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d80033f0 con 0x7ff3d8004b80 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.716+0000 7ff3f2235700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3d8004b80 0x7ff3d8005000 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7ff3e400e1f0 tx=0x7ff3e400b040).ready entity=mon.0 client_cookie=93d1fce7af1ff496 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4009ac0 con 0x7ff3d8004b80 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400f040 con 0x7ff3d8004b80 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f0a32700 1 -- 172.21.15.27:0/1441928614 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400ecd0 con 0x7ff3d8004b80 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f3c98700 1 -- 172.21.15.27:0/1441928614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3d8004b80 msgr2=0x7ff3d8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/1441928614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3d8004b80 0x7ff3d8005000 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7ff3e400e1f0 tx=0x7ff3e400b040).stop 2023-05-17T15:10:12.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f2235700 1 -- 172.21.15.27:0/1441928614 reap_dead start 2023-05-17T15:10:12.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f3c98700 1 -- 172.21.15.27:0/1441928614 shutdown_connections 2023-05-17T15:10:12.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f3c98700 1 -- 172.21.15.27:0/1441928614 >> 172.21.15.27:0/1441928614 conn(0x7ff3ec0cb7f0 msgr2=0x7ff3ec0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:12.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f3c98700 1 -- 172.21.15.27:0/1441928614 shutdown_connections 2023-05-17T15:10:12.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.717+0000 7ff3f3c98700 1 -- 172.21.15.27:0/1441928614 wait complete. 2023-05-17T15:10:12.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.718+0000 7ff3f3c98700 1 Processor -- start 2023-05-17T15:10:12.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.718+0000 7ff3f3c98700 1 -- start start 2023-05-17T15:10:12.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f3c98700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 0x7ff3ec0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f3c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec0c3a10 0x7ff3ec0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f3c98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3ec0adcb0 0x7ff3ec0ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f3c98700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0ab7b0 con 0x7ff3ec0c3630 2023-05-17T15:10:12.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f3c98700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0aba90 con 0x7ff3ec0adcb0 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f3c98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0abd70 con 0x7ff3ec0c3a10 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 0x7ff3ec0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 0x7ff3ec0b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42118/0 (socket says 172.21.15.27:42118) 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 -- 172.21.15.27:0/971730027 learned_addr learned my addr 172.21.15.27:0/971730027 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1233700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec0c3a10 0x7ff3ec0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f2235700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3ec0adcb0 0x7ff3ec0ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 -- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec0c3a10 msgr2=0x7ff3ec0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec0c3a10 0x7ff3ec0c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 -- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3ec0adcb0 msgr2=0x7ff3ec0ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3ec0adcb0 0x7ff3ec0ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.719+0000 7ff3f1a34700 1 -- 172.21.15.27:0/971730027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0ac050 con 0x7ff3ec0c3630 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.720+0000 7ff3f1a34700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 0x7ff3ec0b0420 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7ff3dc0119c0 tx=0x7ff3dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.720+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc013680 con 0x7ff3ec0c3630 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.720+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0137e0 con 0x7ff3ec0c3630 2023-05-17T15:10:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.720+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec0ac330 con 0x7ff3ec0c3630 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.720+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc013b60 con 0x7ff3ec0c3630 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.720+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec0c4790 con 0x7ff3ec0c3630 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.721+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec06bdf0 con 0x7ff3ec0c3630 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.721+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff3dc024070 con 0x7ff3ec0c3630 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.722+0000 7ff3e1ffb700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff3d005edc0 0x7ff3d0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.722+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5885+0+0 (secure 0 0 0) 0x7ff3dc07a320 con 0x7ff3ec0c3630 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.722+0000 7ff3f1233700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff3d005edc0 0x7ff3d0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.722+0000 7ff3f1233700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff3d005edc0 0x7ff3d0061280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff3ec1537f0 tx=0x7ff3e8001e90).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:12.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.726+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3dc04b9b0 con 0x7ff3ec0c3630 2023-05-17T15:10:12.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.903+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff3ec158140 con 0x7ff3ec0c3630 2023-05-17T15:10:12.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.906+0000 7ff3e1ffb700 1 -- 172.21.15.27:0/971730027 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff3dc04efd0 con 0x7ff3ec0c3630 2023-05-17T15:10:12.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff3d005edc0 msgr2=0x7ff3d0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff3d005edc0 0x7ff3d0061280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff3ec1537f0 tx=0x7ff3e8001e90).stop 2023-05-17T15:10:12.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 msgr2=0x7ff3ec0b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:12.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 0x7ff3ec0b0420 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7ff3dc0119c0 tx=0x7ff3dc009060).stop 2023-05-17T15:10:12.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 shutdown_connections 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff3d005edc0 0x7ff3d0061280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3ec0adcb0 0x7ff3ec0ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3ec0c3630 0x7ff3ec0b0420 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 --2- 172.21.15.27:0/971730027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3ec0c3a10 0x7ff3ec0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 >> 172.21.15.27:0/971730027 conn(0x7ff3ec0cb7f0 msgr2=0x7ff3ec0bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 shutdown_connections 2023-05-17T15:10:12.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:12.908+0000 7ff3f3c98700 1 -- 172.21.15.27:0/971730027 wait complete. 2023-05-17T15:10:12.925 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-05-17T15:10:13.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.042+0000 7ff8a6ca4700 1 Processor -- start 2023-05-17T15:10:13.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.042+0000 7ff8a6ca4700 1 -- start start 2023-05-17T15:10:13.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a6ca4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a6ca4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 0x7ff8a00c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a6ca4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00c07a0 con 0x7ff8a0069060 2023-05-17T15:10:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a6ca4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a0069d70 con 0x7ff8a00aae70 2023-05-17T15:10:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a6ca4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00c6760 con 0x7ff8a0153fa0 2023-05-17T15:10:13.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff89ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 0x7ff8a00c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:13.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a4a40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:13.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff89ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 0x7ff8a00c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:60058/0 (socket says 172.21.15.27:60058) 2023-05-17T15:10:13.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a4a40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:43236/0 (socket says 172.21.15.27:43236) 2023-05-17T15:10:13.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff89ffff700 1 -- 172.21.15.27:0/3435699367 learned_addr learned my addr 172.21.15.27:0/3435699367 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a4a40700 1 -- 172.21.15.27:0/3435699367 >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 msgr2=0x7ff8a00c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a4a40700 1 --2- 172.21.15.27:0/3435699367 >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 0x7ff8a00c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a4a40700 1 -- 172.21.15.27:0/3435699367 >> v1:172.21.15.40:6789/0 conn(0x7ff8a0069060 legacy=0x7ff8a00694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff8a4a40700 1 -- 172.21.15.27:0/3435699367 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00c1c40 con 0x7ff8a0153fa0 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.043+0000 7ff89ffff700 1 --2- 172.21.15.27:0/3435699367 >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 0x7ff8a00c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a4a40700 1 --2- 172.21.15.27:0/3435699367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00c5d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff898009e60 tx=0x7ff898009780).ready entity=mon.2 client_cookie=636584d5ae53546a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:13.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff89f7fe700 1 -- 172.21.15.27:0/3435699367 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800e070 con 0x7ff8a0153fa0 2023-05-17T15:10:13.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff89f7fe700 1 -- 172.21.15.27:0/3435699367 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89800bb60 con 0x7ff8a0153fa0 2023-05-17T15:10:13.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff89f7fe700 1 -- 172.21.15.27:0/3435699367 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898012410 con 0x7ff8a0153fa0 2023-05-17T15:10:13.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/3435699367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 msgr2=0x7ff8a00c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:13.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/3435699367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00c5d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff898009e60 tx=0x7ff898009780).stop 2023-05-17T15:10:13.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/3435699367 shutdown_connections 2023-05-17T15:10:13.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/3435699367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00c5d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/3435699367 >> v2:172.21.15.40:3300/0 conn(0x7ff8a00aae70 0x7ff8a00c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/3435699367 >> 172.21.15.27:0/3435699367 conn(0x7ff8a00cb810 msgr2=0x7ff8a00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/3435699367 shutdown_connections 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.044+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/3435699367 wait complete. 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.045+0000 7ff8a6ca4700 1 Processor -- start 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 -- start start 2023-05-17T15:10:13.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 0x7ff8a0141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a00aae70 0x7ff8a00a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a0152e70 con 0x7ff8a0069060 2023-05-17T15:10:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00c38b0 con 0x7ff8a00aae70 2023-05-17T15:10:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a6ca4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00a2490 con 0x7ff8a0153fa0 2023-05-17T15:10:13.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a4a40700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 0x7ff8a0141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a4a40700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 0x7ff8a0141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42132/0 (socket says 172.21.15.27:42132) 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.046+0000 7ff8a4a40700 1 -- 172.21.15.27:0/4170674510 learned_addr learned my addr 172.21.15.27:0/4170674510 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff89ffff700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a00aae70 0x7ff8a00a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a5241700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a4a40700 1 -- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 msgr2=0x7ff8a00a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a4a40700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a4a40700 1 -- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a00aae70 msgr2=0x7ff8a00a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:13.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a4a40700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a00aae70 0x7ff8a00a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a4a40700 1 -- 172.21.15.27:0/4170674510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009300 con 0x7ff8a0069060 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a4a40700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 0x7ff8a0141f30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7ff89800b6c0 tx=0x7ff8a00c8510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800bee0 con 0x7ff8a0069060 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89801d420 con 0x7ff8a0069060 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff898009a20 con 0x7ff8a0069060 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89801d7c0 con 0x7ff8a0069060 2023-05-17T15:10:13.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.047+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a00c3260 con 0x7ff8a0069060 2023-05-17T15:10:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.048+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a006bdf0 con 0x7ff8a0069060 2023-05-17T15:10:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.048+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff89801dbb0 con 0x7ff8a0069060 2023-05-17T15:10:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.049+0000 7ff89cff9700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff88c05ed90 0x7ff88c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.049+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5885+0+0 (secure 0 0 0) 0x7ff89807b830 con 0x7ff8a0069060 2023-05-17T15:10:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.049+0000 7ff89ffff700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff88c05ed90 0x7ff88c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:13.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.049+0000 7ff89ffff700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff88c05ed90 0x7ff88c061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff894006b40 tx=0x7ff894009060).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:13.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.053+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff89804cec0 con 0x7ff8a0069060 2023-05-17T15:10:13.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:13.294+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7ff8a00ab280 con 0x7ff8a0069060 2023-05-17T15:10:14.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.244+0000 7ff89cff9700 1 -- 172.21.15.27:0/4170674510 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v612) v1 ==== 148+0+0 (secure 0 0 0) 0x7ff8980504e0 con 0x7ff8a0069060 2023-05-17T15:10:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff88c05ed90 msgr2=0x7ff88c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff88c05ed90 0x7ff88c061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff894006b40 tx=0x7ff894009060).stop 2023-05-17T15:10:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 msgr2=0x7ff8a0141f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 0x7ff8a0141f30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7ff89800b6c0 tx=0x7ff8a00c8510).stop 2023-05-17T15:10:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 shutdown_connections 2023-05-17T15:10:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff88c05ed90 0x7ff88c061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a0153fa0 0x7ff8a00a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8a0069060 0x7ff8a0141f30 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 --2- 172.21.15.27:0/4170674510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a00aae70 0x7ff8a00a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 >> 172.21.15.27:0/4170674510 conn(0x7ff8a00cb810 msgr2=0x7ff8a00c0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:14.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 shutdown_connections 2023-05-17T15:10:14.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.246+0000 7ff8a6ca4700 1 -- 172.21.15.27:0/4170674510 wait complete. 2023-05-17T15:10:14.265 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-05-17T15:10:14.266 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-05-17T15:10:14.266 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:10:14.267 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-05-17T15:10:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.387+0000 7f118759e700 1 Processor -- start 2023-05-17T15:10:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.387+0000 7f118759e700 1 -- start start 2023-05-17T15:10:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f118759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f1188153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f118759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11880c5f80 0x7f11880cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f118759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11880cb350 con 0x7f11880ca9e0 2023-05-17T15:10:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f118759e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1188157a80 con 0x7f11880c5f80 2023-05-17T15:10:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f118759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1188157d60 con 0x7f1188153a70 2023-05-17T15:10:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f1186d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11880c5f80 0x7f11880cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f1186d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11880c5f80 0x7f11880cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42144/0 (socket says 172.21.15.27:42144) 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.388+0000 7f1186d9d700 1 -- 172.21.15.27:0/816859120 learned_addr learned my addr 172.21.15.27:0/816859120 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f118659c700 1 --2- 172.21.15.27:0/816859120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f1188153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f1186d9d700 1 -- 172.21.15.27:0/816859120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 msgr2=0x7f1188153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f1186d9d700 1 --2- 172.21.15.27:0/816859120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f1188153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f1186d9d700 1 -- 172.21.15.27:0/816859120 >> v1:172.21.15.40:6789/0 conn(0x7f11880ca9e0 legacy=0x7f11880c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f1186d9d700 1 -- 172.21.15.27:0/816859120 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188158040 con 0x7f11880c5f80 2023-05-17T15:10:14.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f1186d9d700 1 --2- 172.21.15.27:0/816859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f11880cae60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f1178006fd0 tx=0x7f11780090f0).ready entity=mon.0 client_cookie=ca500ea1f2a480d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:14.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f118559a700 1 -- 172.21.15.27:0/816859120 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117800b580 con 0x7f11880c5f80 2023-05-17T15:10:14.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f118559a700 1 -- 172.21.15.27:0/816859120 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117800b6e0 con 0x7f11880c5f80 2023-05-17T15:10:14.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f118559a700 1 -- 172.21.15.27:0/816859120 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117800ba60 con 0x7f11880c5f80 2023-05-17T15:10:14.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f118759e700 1 -- 172.21.15.27:0/816859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 msgr2=0x7f11880cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:14.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.389+0000 7f118759e700 1 --2- 172.21.15.27:0/816859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f11880cae60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f1178006fd0 tx=0x7f11780090f0).stop 2023-05-17T15:10:14.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.390+0000 7f118759e700 1 -- 172.21.15.27:0/816859120 shutdown_connections 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.390+0000 7f118759e700 1 --2- 172.21.15.27:0/816859120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f11880cae60 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.390+0000 7f118759e700 1 --2- 172.21.15.27:0/816859120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f1188153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.390+0000 7f118759e700 1 -- 172.21.15.27:0/816859120 >> 172.21.15.27:0/816859120 conn(0x7f118805dd50 msgr2=0x7f118805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.390+0000 7f118759e700 1 -- 172.21.15.27:0/816859120 shutdown_connections 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.390+0000 7f118759e700 1 -- 172.21.15.27:0/816859120 wait complete. 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.391+0000 7f118759e700 1 Processor -- start 2023-05-17T15:10:14.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.391+0000 7f118759e700 1 -- start start 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.391+0000 7f118759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f118814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.391+0000 7f118759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11880ca9e0 0x7f118814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.391+0000 7f118759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f11880c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118814fc90 con 0x7f11880c5f80 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118814f530 con 0x7f11880ca9e0 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11881559c0 con 0x7f1188153a70 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f118814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:14.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f118814f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42146/0 (socket says 172.21.15.27:42146) 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 -- 172.21.15.27:0/1573422882 learned_addr learned my addr 172.21.15.27:0/1573422882 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f1185d9b700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11880ca9e0 0x7f118814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f1186d9d700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f11880c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 -- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 msgr2=0x7f11880c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f11880c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 -- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11880ca9e0 msgr2=0x7f118814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:14.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11880ca9e0 0x7f118814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:14.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 -- 172.21.15.27:0/1573422882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178009370 con 0x7f11880c5f80 2023-05-17T15:10:14.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118659c700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f118814f7a0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f1180009e70 tx=0x7f118000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:14.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000ca40 con 0x7f11880c5f80 2023-05-17T15:10:14.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000f040 con 0x7f11880c5f80 2023-05-17T15:10:14.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118814fe80 con 0x7f11880c5f80 2023-05-17T15:10:14.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000cdb0 con 0x7f11880c5f80 2023-05-17T15:10:14.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.392+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1188155370 con 0x7f11880c5f80 2023-05-17T15:10:14.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.393+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118806bdf0 con 0x7f11880c5f80 2023-05-17T15:10:14.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.394+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1180013610 con 0x7f11880c5f80 2023-05-17T15:10:14.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.394+0000 7f117e7fc700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f116805ed90 0x7f1168061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:14.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.394+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f118007a280 con 0x7f11880c5f80 2023-05-17T15:10:14.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.394+0000 7f1185d9b700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f116805ed90 0x7f1168061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:14.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.394+0000 7f1185d9b700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f116805ed90 0x7f1168061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f11880c4ba0 tx=0x7f1170009040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:14.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.398+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f118004b910 con 0x7f11880c5f80 2023-05-17T15:10:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:14.639+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f11880bfb60 con 0x7f11880c5f80 2023-05-17T15:10:15.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.245+0000 7f117e7fc700 1 -- 172.21.15.27:0/1573422882 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v613) v1 ==== 177+0+0 (secure 0 0 0) 0x7f118004ef30 con 0x7f11880c5f80 2023-05-17T15:10:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f116805ed90 msgr2=0x7f1168061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f116805ed90 0x7f1168061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f11880c4ba0 tx=0x7f1170009040).stop 2023-05-17T15:10:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 msgr2=0x7f118814f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f118814f7a0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f1180009e70 tx=0x7f118000b040).stop 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 shutdown_connections 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f116805ed90 0x7f1168061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1188153a70 0x7f11880c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11880c5f80 0x7f118814f7a0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 --2- 172.21.15.27:0/1573422882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11880ca9e0 0x7f118814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 >> 172.21.15.27:0/1573422882 conn(0x7f118805dd50 msgr2=0x7f118814d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:15.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 shutdown_connections 2023-05-17T15:10:15.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.247+0000 7f118759e700 1 -- 172.21.15.27:0/1573422882 wait complete. 2023-05-17T15:10:15.266 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:10:15.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.387+0000 7fecf6c6e700 1 Processor -- start 2023-05-17T15:10:15.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.387+0000 7fecf6c6e700 1 -- start start 2023-05-17T15:10:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf6c6e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fecf0153ef0 0x7fecf00cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf6c6e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf0158010 con 0x7fecf0157980 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf6c6e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf01582f0 con 0x7fecf00cac00 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf6c6e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf01588b0 con 0x7fecf0153ef0 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fecf0153ef0 0x7fecf00cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fecf0153ef0 0x7fecf00cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42156/0 (socket says 172.21.15.27:42156) 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf646d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fecf0157980 0x7fecf00c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41720/0 (socket says 172.21.15.27:41720) 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 -- 172.21.15.27:0/2384404775 learned_addr learned my addr 172.21.15.27:0/2384404775 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 -- 172.21.15.27:0/2384404775 >> v1:172.21.15.40:6789/0 conn(0x7fecf00cac00 legacy=0x7fecf01537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 -- 172.21.15.27:0/2384404775 >> v1:172.21.15.27:6789/0 conn(0x7fecf0157980 legacy=0x7fecf00c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf4c6a700 1 -- 172.21.15.27:0/2384404775 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754942575 0 0) 0x7fecf0158010 con 0x7fecf0157980 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 -- 172.21.15.27:0/2384404775 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf01585d0 con 0x7fecf0153ef0 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.388+0000 7fecf546b700 1 --2- 172.21.15.27:0/2384404775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0153ef0 0x7fecf00cafe0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fece0006fd0 tx=0x7fece00090f0).ready entity=mon.0 client_cookie=703ffe6331aded00 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf4c6a700 1 -- 172.21.15.27:0/2384404775 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000b600 con 0x7fecf0153ef0 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf4c6a700 1 -- 172.21.15.27:0/2384404775 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece000b760 con 0x7fecf0153ef0 2023-05-17T15:10:15.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf4c6a700 1 -- 172.21.15.27:0/2384404775 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000bae0 con 0x7fecf0153ef0 2023-05-17T15:10:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2384404775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0153ef0 msgr2=0x7fecf00cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2384404775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0153ef0 0x7fecf00cafe0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fece0006fd0 tx=0x7fece00090f0).stop 2023-05-17T15:10:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2384404775 shutdown_connections 2023-05-17T15:10:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2384404775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0153ef0 0x7fecf00cafe0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2384404775 >> 172.21.15.27:0/2384404775 conn(0x7fecf005dd50 msgr2=0x7fecf005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2384404775 shutdown_connections 2023-05-17T15:10:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.389+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2384404775 wait complete. 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.390+0000 7fecf6c6e700 1 Processor -- start 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.390+0000 7fecf6c6e700 1 -- start start 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf6c6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf00cac00 0x7fecf013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf6c6e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf0153ef0 0x7fecf00c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf6c6e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 0x7fecf00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf6c6e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00c9c30 con 0x7fecf0157980 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf6c6e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00addd0 con 0x7fecf0153ef0 2023-05-17T15:10:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf6c6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf013c170 con 0x7fecf00cac00 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf646d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 0x7fecf00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf646d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 0x7fecf00c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42164/0 (socket says 172.21.15.27:42164) 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf646d700 1 -- 172.21.15.27:0/2126942413 learned_addr learned my addr 172.21.15.27:0/2126942413 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf546b700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf0153ef0 0x7fecf00c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.391+0000 7fecf5c6c700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf00cac00 0x7fecf013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf646d700 1 -- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf00cac00 msgr2=0x7fecf013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf646d700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf00cac00 0x7fecf013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf646d700 1 -- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf0153ef0 msgr2=0x7fecf00c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf646d700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf0153ef0 0x7fecf00c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf646d700 1 -- 172.21.15.27:0/2126942413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0009370 con 0x7fecf0157980 2023-05-17T15:10:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf646d700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 0x7fecf00c9740 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fece800c730 tx=0x7fece8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8005c70 con 0x7fecf0157980 2023-05-17T15:10:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8005dd0 con 0x7fecf0157980 2023-05-17T15:10:15.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0156be0 con 0x7fecf0157980 2023-05-17T15:10:15.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8007320 con 0x7fecf0157980 2023-05-17T15:10:15.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.392+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf01571a0 con 0x7fecf0157980 2023-05-17T15:10:15.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.393+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0047150 con 0x7fecf0157980 2023-05-17T15:10:15.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.393+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fece8010030 con 0x7fecf0157980 2023-05-17T15:10:15.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.394+0000 7fece5ffb700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecd405ed90 0x7fecd4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.394+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fece8079840 con 0x7fecf0157980 2023-05-17T15:10:15.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.394+0000 7fecf5c6c700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecd405ed90 0x7fecd4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.394+0000 7fecf5c6c700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecd405ed90 0x7fecd4061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fecec0038e0 tx=0x7fecec007d40).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:15.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.398+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fece804aed0 con 0x7fecf0157980 2023-05-17T15:10:15.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.571+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fecf005f310 con 0x7fecf0157980 2023-05-17T15:10:15.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.575+0000 7fece5ffb700 1 -- 172.21.15.27:0/2126942413 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fece804e4f0 con 0x7fecf0157980 2023-05-17T15:10:15.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecd405ed90 msgr2=0x7fecd4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecd405ed90 0x7fecd4061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fecec0038e0 tx=0x7fecec007d40).stop 2023-05-17T15:10:15.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 msgr2=0x7fecf00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 0x7fecf00c9740 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fece800c730 tx=0x7fece8001520).stop 2023-05-17T15:10:15.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 shutdown_connections 2023-05-17T15:10:15.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fecd405ed90 0x7fecd4061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fecf0157980 0x7fecf00c9740 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fecf00cac00 0x7fecf013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 --2- 172.21.15.27:0/2126942413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecf0153ef0 0x7fecf00c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 >> 172.21.15.27:0/2126942413 conn(0x7fecf005dd50 msgr2=0x7fecf00c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:15.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 shutdown_connections 2023-05-17T15:10:15.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.577+0000 7fecf6c6e700 1 -- 172.21.15.27:0/2126942413 wait complete. 2023-05-17T15:10:15.593 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:10:15.593 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:15.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:15.655 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:10:15.656 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:10:15.657 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:15.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.772+0000 7f35767e8700 1 Processor -- start 2023-05-17T15:10:15.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.772+0000 7f35767e8700 1 -- start start 2023-05-17T15:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.773+0000 7f35767e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 0x7f357015f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.773+0000 7f35767e8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700aa680 con 0x7f35700c60c0 2023-05-17T15:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.773+0000 7f35767e8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357005e7e0 con 0x7f35700c64a0 2023-05-17T15:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.773+0000 7f35767e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c68e0 con 0x7f35700c1860 2023-05-17T15:10:15.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.773+0000 7f356ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f35700c60c0 0x7f35700a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41730/0 (socket says 172.21.15.27:41730) 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.773+0000 7f356ffff700 1 -- 172.21.15.27:0/1728958757 learned_addr learned my addr 172.21.15.27:0/1728958757 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069520639 0 0) 0x7f35700aa680 con 0x7f35700c60c0 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c0033f0 con 0x7f35700c60c0 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 0x7f357015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1269717493 0 0) 0x7f355c0033f0 con 0x7f35700c60c0 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 msgr2=0x7f357015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 0x7f357015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 >> v1:172.21.15.40:6789/0 conn(0x7f35700c64a0 legacy=0x7f3570153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357005eac0 con 0x7f35700c60c0 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f3560001470 con 0x7f35700c60c0 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 >> v1:172.21.15.27:6789/0 conn(0x7f35700c60c0 legacy=0x7f35700a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 0x7f355c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355c003e40 0x7f355c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f355c004b80 0x7f355c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c68e0 con 0x7f355c004b80 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c00b990 con 0x7f355c003e40 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c00bb50 con 0x7f35700c1860 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f355c004b80 0x7f355c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f356ffff700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 0x7f355c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3567fff700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355c003e40 0x7f355c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 -- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 msgr2=0x7f355c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35700c1860 0x7f355c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 -- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355c003e40 msgr2=0x7f355c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355c003e40 0x7f355c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 -- 172.21.15.27:0/1728958757 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0033f0 con 0x7f355c004b80 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.774+0000 7f3574d85700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f355c004b80 0x7f355c005000 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f356800e1c0 tx=0x7f356800b040).ready entity=mon.0 client_cookie=ce76ed9289f649d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568009ac0 con 0x7f355c004b80 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356800f040 con 0x7f355c004b80 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f356f7fe700 1 -- 172.21.15.27:0/1728958757 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800eca0 con 0x7f355c004b80 2023-05-17T15:10:15.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f35767e8700 1 -- 172.21.15.27:0/1728958757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f355c004b80 msgr2=0x7f355c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f35767e8700 1 --2- 172.21.15.27:0/1728958757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f355c004b80 0x7f355c005000 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f356800e1c0 tx=0x7f356800b040).stop 2023-05-17T15:10:15.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f3574d85700 1 -- 172.21.15.27:0/1728958757 reap_dead start 2023-05-17T15:10:15.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f35767e8700 1 -- 172.21.15.27:0/1728958757 shutdown_connections 2023-05-17T15:10:15.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f35767e8700 1 -- 172.21.15.27:0/1728958757 >> 172.21.15.27:0/1728958757 conn(0x7f3570069e70 msgr2=0x7f357005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:15.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f35767e8700 1 -- 172.21.15.27:0/1728958757 shutdown_connections 2023-05-17T15:10:15.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.775+0000 7f35767e8700 1 -- 172.21.15.27:0/1728958757 wait complete. 2023-05-17T15:10:15.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.776+0000 7f35767e8700 1 Processor -- start 2023-05-17T15:10:15.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.776+0000 7f35767e8700 1 -- start start 2023-05-17T15:10:15.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f35767e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f355c004b80 0x7f357014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f35767e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35700c2d00 0x7f35700c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f35767e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 0x7f3570164be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f35767e8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c4e60 con 0x7f35700c97f0 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f35767e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35701555b0 con 0x7f35700c2d00 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f35767e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c9c70 con 0x7f355c004b80 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3574d85700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 0x7f3570164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3574d85700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 0x7f3570164be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42184/0 (socket says 172.21.15.27:42184) 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3574d85700 1 -- 172.21.15.27:0/1516184403 learned_addr learned my addr 172.21.15.27:0/1516184403 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3567fff700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35700c2d00 0x7f35700c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f356ffff700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f355c004b80 0x7f357014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3574d85700 1 -- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f355c004b80 msgr2=0x7f357014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3574d85700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f355c004b80 0x7f357014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.777+0000 7f3574d85700 1 -- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35700c2d00 msgr2=0x7f35700c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f3574d85700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35700c2d00 0x7f35700c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f3574d85700 1 -- 172.21.15.27:0/1516184403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570165940 con 0x7f35700c97f0 2023-05-17T15:10:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f3574d85700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 0x7f3570164be0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f3568002230 tx=0x7f356801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568013af0 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568013c50 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570154c80 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356801c620 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.778+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3570155240 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.779+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357005f4a0 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.779+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f356801ca50 con 0x7f35700c97f0 2023-05-17T15:10:15.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.780+0000 7f356cff9700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f355005ed90 0x7f3550061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:15.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.780+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f356807b2e0 con 0x7f35700c97f0 2023-05-17T15:10:15.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.780+0000 7f356ffff700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f355005ed90 0x7f3550061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:15.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.780+0000 7f356ffff700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f355005ed90 0x7f3550061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3560001ce0 tx=0x7f3560001e50).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:15.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.784+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f356804c970 con 0x7f35700c97f0 2023-05-17T15:10:16.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.996+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f357006bdf0 con 0x7f35700c97f0 2023-05-17T15:10:16.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.997+0000 7f356cff9700 1 -- 172.21.15.27:0/1516184403 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f356804ff90 con 0x7f35700c97f0 2023-05-17T15:10:16.001 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:16.001 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/293556725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":293556725},{"type":"v1","addr":"172.21.15.40:6834","nonce":293556725}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/979931331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":979931331},{"type":"v1","addr":"172.21.15.40:6835","nonce":979931331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2934036422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2934036422},{"type":"v1","addr":"172.21.15.27:6835","nonce":2934036422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1459834403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1459834403},{"type":"v1","addr":"172.21.15.27:6834","nonce":1459834403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[]} 2023-05-17T15:10:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f355005ed90 msgr2=0x7f3550061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f355005ed90 0x7f3550061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3560001ce0 tx=0x7f3560001e50).stop 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 msgr2=0x7f3570164be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 0x7f3570164be0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f3568002230 tx=0x7f356801a000).stop 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 shutdown_connections 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f355005ed90 0x7f3550061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35700c97f0 0x7f3570164be0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f355c004b80 0x7f357014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 --2- 172.21.15.27:0/1516184403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35700c2d00 0x7f35700c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.998+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 >> 172.21.15.27:0/1516184403 conn(0x7f3570069e70 msgr2=0x7f3570152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.999+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 shutdown_connections 2023-05-17T15:10:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:15.999+0000 7f35767e8700 1 -- 172.21.15.27:0/1516184403 wait complete. 2023-05-17T15:10:16.004 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 46 2023-05-17T15:10:16.015 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:10:16.015 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:10:16.015 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:10:16.015 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:16.016 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:10:16.016 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:10:16.016 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:10:16.016 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:16.017 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:10:16.017 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:10:16.017 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:10:16.017 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:16.017 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:10:16.018 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:10:16.018 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:10:16.018 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:16.024 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:10:16.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:10:16.025 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:10:16.025 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:10:16.032 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:10:16.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:10:16.033 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:10:16.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:10:16.067 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:10:16.067 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:16.068 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:10:16.068 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:16.075 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:10:16.075 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:16.076 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:10:16.076 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:16.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:10:16.141 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:10:16.142 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:10:16.163 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:10:16.163 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:10:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.197+0000 7f6792cbc700 1 Processor -- start 2023-05-17T15:10:16.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.197+0000 7f6792cbc700 1 -- start start 2023-05-17T15:10:16.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6792cbc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f678c0bbe60 0x7f678c154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6792cbc700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c154970 con 0x7f678c066a10 2023-05-17T15:10:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6792cbc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c063340 con 0x7f678c1540a0 2023-05-17T15:10:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6792cbc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c154ba0 con 0x7f678c0bbe60 2023-05-17T15:10:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f67914b9700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f678c066a10 0x7f678c0637d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41776/0 (socket says 172.21.15.27:41776) 2023-05-17T15:10:16.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f67914b9700 1 -- 172.21.15.27:0/442281489 learned_addr learned my addr 172.21.15.27:0/442281489 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f67924bb700 1 --2- 172.21.15.27:0/442281489 >> v2:172.21.15.40:3300/0 conn(0x7f678c0bbe60 0x7f678c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817055452 0 0) 0x7f678c154970 con 0x7f678c066a10 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67740033f0 con 0x7f678c066a10 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1321185548 0 0) 0x7f67740033f0 con 0x7f678c066a10 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 >> v2:172.21.15.40:3300/0 conn(0x7f678c0bbe60 msgr2=0x7f678c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 --2- 172.21.15.27:0/442281489 >> v2:172.21.15.40:3300/0 conn(0x7f678c0bbe60 0x7f678c154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 >> v1:172.21.15.40:6789/0 conn(0x7f678c1540a0 legacy=0x7f678c066300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c154e80 con 0x7f678c066a10 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f67800017f0 con 0x7f678c066a10 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 >> v1:172.21.15.27:6789/0 conn(0x7f678c066a10 legacy=0x7f678c0637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67740038e0 0x7f6774003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6774004690 0x7f6774004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.198+0000 7f6790cb8700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6774005000 0x7f677400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c154ba0 con 0x7f6774004690 2023-05-17T15:10:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677400beb0 con 0x7f6774005000 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677400c070 con 0x7f67740038e0 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6774004690 0x7f6774004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6791cba700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67740038e0 0x7f6774003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67924bb700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6774005000 0x7f677400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 -- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67740038e0 msgr2=0x7f6774003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67740038e0 0x7f6774003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 -- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6774005000 msgr2=0x7f677400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:16.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6774005000 0x7f677400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 -- 172.21.15.27:0/442281489 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740033f0 con 0x7f6774004690 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67924bb700 1 -- 172.21.15.27:0/442281489 reap_dead start 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f67914b9700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6774004690 0x7f6774004b10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f678000c450 tx=0x7f678000c760).ready entity=mon.0 client_cookie=3a79e537478867d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780002030 con 0x7f6774004690 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000cd70 con 0x7f6774004690 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.199+0000 7f6790cb8700 1 -- 172.21.15.27:0/442281489 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780005d30 con 0x7f6774004690 2023-05-17T15:10:16.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 -- 172.21.15.27:0/442281489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6774004690 msgr2=0x7f6774004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6774004690 0x7f6774004b10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f678000c450 tx=0x7f678000c760).stop 2023-05-17T15:10:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 -- 172.21.15.27:0/442281489 shutdown_connections 2023-05-17T15:10:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 --2- 172.21.15.27:0/442281489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6774004690 0x7f6774004b10 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 -- 172.21.15.27:0/442281489 >> 172.21.15.27:0/442281489 conn(0x7f678c068780 msgr2=0x7f678c0c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 -- 172.21.15.27:0/442281489 shutdown_connections 2023-05-17T15:10:16.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.200+0000 7f6792cbc700 1 -- 172.21.15.27:0/442281489 wait complete. 2023-05-17T15:10:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 Processor -- start 2023-05-17T15:10:16.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 -- start start 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6774004690 0x7f678c164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 0x7f678c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678c064250 0x7f678c0646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c151ce0 con 0x7f678c0c0e20 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c064ba0 con 0x7f678c064250 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.201+0000 7f6792cbc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c167d00 con 0x7f6774004690 2023-05-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 0x7f678c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 0x7f678c156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42226/0 (socket says 172.21.15.27:42226) 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 -- 172.21.15.27:0/3045710632 learned_addr learned my addr 172.21.15.27:0/3045710632 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6791cba700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6774004690 0x7f678c164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67924bb700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678c064250 0x7f678c0646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 -- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6774004690 msgr2=0x7f678c164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6774004690 0x7f678c164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 -- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678c064250 msgr2=0x7f678c0646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678c064250 0x7f678c0646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 -- 172.21.15.27:0/3045710632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c164f60 con 0x7f678c0c0e20 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6791cba700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6774004690 0x7f678c164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67924bb700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678c064250 0x7f678c0646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f67914b9700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 0x7f678c156df0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f677400be80 tx=0x7f6780015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800017b0 con 0x7f678c0c0e20 2023-05-17T15:10:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800074f0 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c165240 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800078b0 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.202+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c167fa0 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.203+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c1681c0 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.204+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6780010070 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.204+0000 7f6789ffb700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f677805ed90 0x7f6778061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.204+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f678007aca0 con 0x7f678c0c0e20 2023-05-17T15:10:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.205+0000 7f6791cba700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f677805ed90 0x7f6778061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.205+0000 7f6791cba700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f677805ed90 0x7f6778061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6784007fd0 tx=0x7f6784007bb0).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.208+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f678004c3b0 con 0x7f678c0c0e20 2023-05-17T15:10:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:16.400+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f678c047150 con 0x7f678c0c0e20 2023-05-17T15:10:17.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.256+0000 7f6789ffb700 1 -- 172.21.15.27:0/3045710632 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v122) v1 ==== 97+0+0 (secure 0 0 0) 0x7f678004f9d0 con 0x7f678c0c0e20 2023-05-17T15:10:17.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f677805ed90 msgr2=0x7f6778061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f677805ed90 0x7f6778061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6784007fd0 tx=0x7f6784007bb0).stop 2023-05-17T15:10:17.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 msgr2=0x7f678c156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 0x7f678c156df0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f677400be80 tx=0x7f6780015000).stop 2023-05-17T15:10:17.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 shutdown_connections 2023-05-17T15:10:17.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f677805ed90 0x7f6778061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678c064250 0x7f678c0646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6774004690 0x7f678c164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 --2- 172.21.15.27:0/3045710632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f678c0c0e20 0x7f678c156df0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 >> 172.21.15.27:0/3045710632 conn(0x7f678c068780 msgr2=0x7f678c066300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:17.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.258+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 shutdown_connections 2023-05-17T15:10:17.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.259+0000 7f6792cbc700 1 -- 172.21.15.27:0/3045710632 wait complete. 2023-05-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:10:17.277 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:10:17.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.402+0000 7f98a995e700 1 Processor -- start 2023-05-17T15:10:17.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.402+0000 7f98a995e700 1 -- start start 2023-05-17T15:10:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a995e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a4095630 0x7f98a40c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a995e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40c81f0 con 0x7f98a41540d0 2023-05-17T15:10:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a995e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a41544b0 con 0x7f98a40951b0 2023-05-17T15:10:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a995e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a4069760 con 0x7f98a4095630 2023-05-17T15:10:17.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a2ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f98a41540d0 0x7f98a4069050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41798/0 (socket says 172.21.15.27:41798) 2023-05-17T15:10:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a2ffd700 1 -- 172.21.15.27:0/3525386010 learned_addr learned my addr 172.21.15.27:0/3525386010 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a37fe700 1 --2- 172.21.15.27:0/3525386010 >> v2:172.21.15.40:3300/0 conn(0x7f98a4095630 0x7f98a40c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796498023 0 0) 0x7f98a40c81f0 con 0x7f98a41540d0 2023-05-17T15:10:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98900033f0 con 0x7f98a41540d0 2023-05-17T15:10:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575730136 0 0) 0x7f98900033f0 con 0x7f98a41540d0 2023-05-17T15:10:17.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 >> v2:172.21.15.40:3300/0 conn(0x7f98a4095630 msgr2=0x7f98a40c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a27fc700 1 --2- 172.21.15.27:0/3525386010 >> v2:172.21.15.40:3300/0 conn(0x7f98a4095630 0x7f98a40c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.403+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 >> v1:172.21.15.40:6789/0 conn(0x7f98a40951b0 legacy=0x7f98a40c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40c75e0 con 0x7f98a41540d0 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f98940015f0 con 0x7f98a41540d0 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 >> v1:172.21.15.27:6789/0 conn(0x7f98a41540d0 legacy=0x7f98a4069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98900038e0 0x7f9890003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890004690 0x7f9890004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9890005000 0x7f989000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4069760 con 0x7f9890005000 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989000bf60 con 0x7f98900038e0 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989000c0f0 con 0x7f9890004690 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9890005000 0x7f989000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a2ffd700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98900038e0 0x7f9890003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f989bfff700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890004690 0x7f9890004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 -- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890004690 msgr2=0x7f9890004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890004690 0x7f9890004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 -- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98900038e0 msgr2=0x7f9890003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98900038e0 0x7f9890003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 -- 172.21.15.27:0/3525386010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900033f0 con 0x7f9890005000 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 -- 172.21.15.27:0/3525386010 reap_dead start 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a37fe700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9890005000 0x7f989000b8e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f989c00e210 tx=0x7f989c00b040).ready entity=mon.0 client_cookie=b680624bf36c165c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:17.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c009ac0 con 0x7f9890005000 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c00f040 con 0x7f9890005000 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.404+0000 7f98a27fc700 1 -- 172.21.15.27:0/3525386010 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00ed10 con 0x7f9890005000 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 -- 172.21.15.27:0/3525386010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9890005000 msgr2=0x7f989000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9890005000 0x7f989000b8e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f989c00e210 tx=0x7f989c00b040).stop 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 -- 172.21.15.27:0/3525386010 shutdown_connections 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 --2- 172.21.15.27:0/3525386010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9890005000 0x7f989000b8e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 -- 172.21.15.27:0/3525386010 >> 172.21.15.27:0/3525386010 conn(0x7f98a40c8a10 msgr2=0x7f98a40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 -- 172.21.15.27:0/3525386010 shutdown_connections 2023-05-17T15:10:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.405+0000 7f98a995e700 1 -- 172.21.15.27:0/3525386010 wait complete. 2023-05-17T15:10:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.406+0000 7f98a995e700 1 Processor -- start 2023-05-17T15:10:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.406+0000 7f98a995e700 1 -- start start 2023-05-17T15:10:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890005000 0x7f98a40a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a41510d0 0x7f98a4151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 0x7f98a40ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40ae520 con 0x7f98a40acb80 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4151a40 con 0x7f98a41510d0 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40ad910 con 0x7f9890005000 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 0x7f98a40ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 0x7f98a40ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42252/0 (socket says 172.21.15.27:42252) 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 -- 172.21.15.27:0/4038662478 learned_addr learned my addr 172.21.15.27:0/4038662478 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:17.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a2ffd700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890005000 0x7f98a40a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f989bfff700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a41510d0 0x7f98a4151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 -- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890005000 msgr2=0x7f98a40a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890005000 0x7f98a40a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 -- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a41510d0 msgr2=0x7f98a4151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a41510d0 0x7f98a4151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 -- 172.21.15.27:0/4038662478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40adbf0 con 0x7f98a40acb80 2023-05-17T15:10:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f989bfff700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a41510d0 0x7f98a4151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a2ffd700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890005000 0x7f98a40a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a37fe700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 0x7f98a40ad000 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f98a40c70a0 tx=0x7f989c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c01d460 con 0x7f98a40acb80 2023-05-17T15:10:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c01d5e0 con 0x7f98a40acb80 2023-05-17T15:10:17.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a40aded0 con 0x7f98a40acb80 2023-05-17T15:10:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.407+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c01d9a0 con 0x7f98a40acb80 2023-05-17T15:10:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.408+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a40a9a60 con 0x7f98a40acb80 2023-05-17T15:10:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.408+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a406bdf0 con 0x7f98a40acb80 2023-05-17T15:10:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.409+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f989c019040 con 0x7f98a40acb80 2023-05-17T15:10:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.409+0000 7f989affd700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f988405edc0 0x7f9884061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.409+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f989c07b980 con 0x7f98a40acb80 2023-05-17T15:10:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.409+0000 7f98a2ffd700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f988405edc0 0x7f9884061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.410+0000 7f98a2ffd700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f988405edc0 0x7f9884061280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9894002e70 tx=0x7f9894009040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.413+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f989c04d210 con 0x7f98a40acb80 2023-05-17T15:10:17.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.650+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f98a40c78c0 con 0x7f98a40acb80 2023-05-17T15:10:17.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.650+0000 7f989affd700 1 -- 172.21.15.27:0/4038662478 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f989c017030 con 0x7f98a40acb80 2023-05-17T15:10:17.654 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.655 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.656 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.657 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.658 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:10:17.659 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:10:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:10:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.661 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:10:17.663 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.664 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.665 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:10:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:10:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.667 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.668 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:10:17.669 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.671 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:10:17.672 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.673 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:10:17.674 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.675 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.676 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:10:17.677 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:17.678 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:10:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:10:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:17.679 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:10:17.679 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:10:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f988405edc0 msgr2=0x7f9884061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f988405edc0 0x7f9884061280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9894002e70 tx=0x7f9894009040).stop 2023-05-17T15:10:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 msgr2=0x7f98a40ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 0x7f98a40ad000 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f98a40c70a0 tx=0x7f989c018000).stop 2023-05-17T15:10:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 shutdown_connections 2023-05-17T15:10:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f988405edc0 0x7f9884061280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a40acb80 0x7f98a40ad000 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9890005000 0x7f98a40a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 --2- 172.21.15.27:0/4038662478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a41510d0 0x7f98a4151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 >> 172.21.15.27:0/4038662478 conn(0x7f98a40c8a10 msgr2=0x7f98a4068200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 shutdown_connections 2023-05-17T15:10:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.652+0000 7f98a995e700 1 -- 172.21.15.27:0/4038662478 wait complete. 2023-05-17T15:10:17.683 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:17.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.795+0000 7fd5121fa700 1 Processor -- start 2023-05-17T15:10:17.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.795+0000 7fd5121fa700 1 -- start start 2023-05-17T15:10:17.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd5121fa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd50c0c6310 0x7fd50c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd5121fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c1541c0 0x7fd50c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd5121fa700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c0bfcd0 con 0x7fd50c0c5f30 2023-05-17T15:10:17.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd5121fa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c0c0290 con 0x7fd50c0c6310 2023-05-17T15:10:17.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd5121fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0aa1a0 con 0x7fd50c1541c0 2023-05-17T15:10:17.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd50affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd50c0c6310 0x7fd50c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd50b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd50c0c5f30 0x7fd50c158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41818/0 (socket says 172.21.15.27:41818) 2023-05-17T15:10:17.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd50affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd50c0c6310 0x7fd50c153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42258/0 (socket says 172.21.15.27:42258) 2023-05-17T15:10:17.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd50b7fe700 1 -- 172.21.15.27:0/1931303973 learned_addr learned my addr 172.21.15.27:0/1931303973 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:17.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.796+0000 7fd50bfff700 1 --2- 172.21.15.27:0/1931303973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c1541c0 0x7fd50c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50affd700 1 -- 172.21.15.27:0/1931303973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c1541c0 msgr2=0x7fd50c0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:17.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50affd700 1 --2- 172.21.15.27:0/1931303973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c1541c0 0x7fd50c0c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50affd700 1 -- 172.21.15.27:0/1931303973 >> v1:172.21.15.27:6789/0 conn(0x7fd50c0c5f30 legacy=0x7fd50c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50affd700 1 -- 172.21.15.27:0/1931303973 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0aa480 con 0x7fd50c0c6310 2023-05-17T15:10:17.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50affd700 1 --2- 172.21.15.27:0/1931303973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c153cd0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fd500009760 tx=0x7fd500009060).ready entity=mon.0 client_cookie=5e51759972baf237 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:17.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50a7fc700 1 -- 172.21.15.27:0/1931303973 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000f510 con 0x7fd50c0c6310 2023-05-17T15:10:17.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50a7fc700 1 -- 172.21.15.27:0/1931303973 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000f670 con 0x7fd50c0c6310 2023-05-17T15:10:17.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd50a7fc700 1 -- 172.21.15.27:0/1931303973 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000f9f0 con 0x7fd50c0c6310 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 -- 172.21.15.27:0/1931303973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 msgr2=0x7fd50c153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 --2- 172.21.15.27:0/1931303973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c153cd0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fd500009760 tx=0x7fd500009060).stop 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 -- 172.21.15.27:0/1931303973 shutdown_connections 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 --2- 172.21.15.27:0/1931303973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c1541c0 0x7fd50c0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 --2- 172.21.15.27:0/1931303973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c153cd0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 -- 172.21.15.27:0/1931303973 >> 172.21.15.27:0/1931303973 conn(0x7fd50c069e70 msgr2=0x7fd50c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 -- 172.21.15.27:0/1931303973 shutdown_connections 2023-05-17T15:10:17.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.797+0000 7fd5121fa700 1 -- 172.21.15.27:0/1931303973 wait complete. 2023-05-17T15:10:17.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 Processor -- start 2023-05-17T15:10:17.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 -- start start 2023-05-17T15:10:17.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c0c5f30 0x7fd50c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd50c1541c0 0x7fd50c157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c1557d0 con 0x7fd50c0c6310 2023-05-17T15:10:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c157570 con 0x7fd50c1541c0 2023-05-17T15:10:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd5121fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0c8cb0 con 0x7fd50c0c5f30 2023-05-17T15:10:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd50affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd50affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c0cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42264/0 (socket says 172.21.15.27:42264) 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.799+0000 7fd50affd700 1 -- 172.21.15.27:0/2382006148 learned_addr learned my addr 172.21.15.27:0/2382006148 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50b7fe700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c0c5f30 0x7fd50c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50bfff700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd50c1541c0 0x7fd50c157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50affd700 1 -- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c0c5f30 msgr2=0x7fd50c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50affd700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c0c5f30 0x7fd50c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50affd700 1 -- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd50c1541c0 msgr2=0x7fd50c157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50affd700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd50c1541c0 0x7fd50c157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50affd700 1 -- 172.21.15.27:0/2382006148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5000092a0 con 0x7fd50c0c6310 2023-05-17T15:10:17.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50bfff700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd50c1541c0 0x7fd50c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:17.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd50affd700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c0cb820 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fd50c083770 tx=0x7fd500017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:17.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000f7e0 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000f940 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c0c8f90 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50001b660 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.800+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c155c90 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.801+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c05f4a0 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.802+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd50002b070 con 0x7fd50c0c6310 2023-05-17T15:10:17.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.802+0000 7fd4f37fe700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd4f805ed90 0x7fd4f8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:17.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.802+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5369+0+0 (secure 0 0 0) 0x7fd50007af80 con 0x7fd50c0c6310 2023-05-17T15:10:17.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.802+0000 7fd50b7fe700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd4f805ed90 0x7fd4f8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:17.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.802+0000 7fd50b7fe700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd4f805ed90 0x7fd4f8061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd4fc007fd0 tx=0x7fd4fc007d30).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:17.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.806+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd50004c810 con 0x7fd50c0c6310 2023-05-17T15:10:17.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.984+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd50c06bdf0 con 0x7fd50c0c6310 2023-05-17T15:10:17.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.985+0000 7fd4f37fe700 1 -- 172.21.15.27:0/2382006148 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+13882 (secure 0 0 0) 0x7fd50001f020 con 0x7fd50c0c6310 2023-05-17T15:10:17.989 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:17.990 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":122,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:17.245573+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:17.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd4f805ed90 msgr2=0x7fd4f8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd4f805ed90 0x7fd4f8061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd4fc007fd0 tx=0x7fd4fc007d30).stop 2023-05-17T15:10:17.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 msgr2=0x7fd50c0cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:17.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c0cb820 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fd50c083770 tx=0x7fd500017000).stop 2023-05-17T15:10:17.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 shutdown_connections 2023-05-17T15:10:17.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd4f805ed90 0x7fd4f8061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd50c1541c0 0x7fd50c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd50c0c5f30 0x7fd50c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 --2- 172.21.15.27:0/2382006148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd50c0c6310 0x7fd50c0cb820 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:17.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 >> 172.21.15.27:0/2382006148 conn(0x7fd50c069e70 msgr2=0x7fd50c0ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:17.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 shutdown_connections 2023-05-17T15:10:17.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:17.987+0000 7fd5121fa700 1 -- 172.21.15.27:0/2382006148 wait complete. 2023-05-17T15:10:18.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:10:18.004 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:10:18.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 Processor -- start 2023-05-17T15:10:18.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 -- start start 2023-05-17T15:10:18.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 0x7f3b980c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b98069410 0x7f3b980bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b98158790 con 0x7f3b980c60f0 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980c1c50 con 0x7f3b98069410 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.120+0000 7f3b9d5f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c6570 con 0x7f3b981543d0 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 0x7f3b980c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b98069410 0x7f3b980bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b98069410 0x7f3b980bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:60200/0 (socket says 172.21.15.27:60200) 2023-05-17T15:10:18.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 0x7f3b980c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:43380/0 (socket says 172.21.15.27:43380) 2023-05-17T15:10:18.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b977fe700 1 -- 172.21.15.27:0/226435209 learned_addr learned my addr 172.21.15.27:0/226435209 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:18.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 -- 172.21.15.27:0/226435209 >> v2:172.21.15.40:3300/0 conn(0x7f3b98069410 msgr2=0x7f3b980bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:18.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 --2- 172.21.15.27:0/226435209 >> v2:172.21.15.40:3300/0 conn(0x7f3b98069410 0x7f3b980bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 -- 172.21.15.27:0/226435209 >> v1:172.21.15.40:6789/0 conn(0x7f3b980c60f0 legacy=0x7f3b98068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 -- 172.21.15.27:0/226435209 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98157e60 con 0x7f3b981543d0 2023-05-17T15:10:18.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b96ffd700 1 --2- 172.21.15.27:0/226435209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 0x7f3b980c5c00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3b88009e60 tx=0x7f3b88009780).ready entity=mon.2 client_cookie=cb89866db58e456b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b95ffb700 1 -- 172.21.15.27:0/226435209 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800e070 con 0x7f3b981543d0 2023-05-17T15:10:18.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b95ffb700 1 -- 172.21.15.27:0/226435209 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8800bb60 con 0x7f3b981543d0 2023-05-17T15:10:18.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.121+0000 7f3b95ffb700 1 -- 172.21.15.27:0/226435209 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88012410 con 0x7f3b981543d0 2023-05-17T15:10:18.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/226435209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 msgr2=0x7f3b980c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/226435209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 0x7f3b980c5c00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3b88009e60 tx=0x7f3b88009780).stop 2023-05-17T15:10:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/226435209 shutdown_connections 2023-05-17T15:10:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/226435209 >> v2:172.21.15.40:3300/0 conn(0x7f3b98069410 0x7f3b980bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/226435209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b981543d0 0x7f3b980c5c00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/226435209 >> 172.21.15.27:0/226435209 conn(0x7f3b980cb7f0 msgr2=0x7f3b980c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/226435209 shutdown_connections 2023-05-17T15:10:18.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.122+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/226435209 wait complete. 2023-05-17T15:10:18.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.123+0000 7f3b9d5f2700 1 Processor -- start 2023-05-17T15:10:18.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.123+0000 7f3b9d5f2700 1 -- start start 2023-05-17T15:10:18.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b9d5f2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 0x7f3b98152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b9d5f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b980c60f0 0x7f3b981644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b9d5f2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b981543d0 0x7f3b981656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b9d5f2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981533e0 con 0x7f3b98069410 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b9d5f2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98164e40 con 0x7f3b981543d0 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b9d5f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98165120 con 0x7f3b980c60f0 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 0x7f3b98152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 0x7f3b98152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42276/0 (socket says 172.21.15.27:42276) 2023-05-17T15:10:18.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 -- 172.21.15.27:0/3165971102 learned_addr learned my addr 172.21.15.27:0/3165971102 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b977fe700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b981543d0 0x7f3b981656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b967fc700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b980c60f0 0x7f3b981644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 -- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b980c60f0 msgr2=0x7f3b981644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b980c60f0 0x7f3b981644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 -- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b981543d0 msgr2=0x7f3b981656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b981543d0 0x7f3b981656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b96ffd700 1 -- 172.21.15.27:0/3165971102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88009a20 con 0x7f3b98069410 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.124+0000 7f3b977fe700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b981543d0 0x7f3b981656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.125+0000 7f3b96ffd700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 0x7f3b98152ef0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f3b8800b6c0 tx=0x7f3b88009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.125+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8801d420 con 0x7f3b98069410 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.125+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8801d5c0 con 0x7f3b98069410 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.125+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980c3b60 con 0x7f3b98069410 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.125+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8801d980 con 0x7f3b98069410 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.125+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b98165400 con 0x7f3b98069410 2023-05-17T15:10:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.126+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b980c4000 con 0x7f3b98069410 2023-05-17T15:10:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.126+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b88026410 con 0x7f3b98069410 2023-05-17T15:10:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.126+0000 7f3b8effd700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b7805ed90 0x7f3b78061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.127+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f3b8807baa0 con 0x7f3b98069410 2023-05-17T15:10:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.127+0000 7f3b967fc700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b7805ed90 0x7f3b78061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.127+0000 7f3b967fc700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b7805ed90 0x7f3b78061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3b98153590 tx=0x7f3b80009040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.131+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b8804d1c0 con 0x7f3b98069410 2023-05-17T15:10:18.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.308+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3b980c41b0 con 0x7f3b98069410 2023-05-17T15:10:18.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.309+0000 7f3b8effd700 1 -- 172.21.15.27:0/3165971102 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3b880507e0 con 0x7f3b98069410 2023-05-17T15:10:18.313 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b7805ed90 msgr2=0x7f3b78061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b7805ed90 0x7f3b78061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3b98153590 tx=0x7f3b80009040).stop 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 msgr2=0x7f3b98152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 0x7f3b98152ef0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f3b8800b6c0 tx=0x7f3b88009780).stop 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 shutdown_connections 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3b7805ed90 0x7f3b78061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b981543d0 0x7f3b981656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b98069410 0x7f3b98152ef0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 --2- 172.21.15.27:0/3165971102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b980c60f0 0x7f3b981644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 >> 172.21.15.27:0/3165971102 conn(0x7f3b980cb7f0 msgr2=0x7f3b981573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 shutdown_connections 2023-05-17T15:10:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.311+0000 7f3b9d5f2700 1 -- 172.21.15.27:0/3165971102 wait complete. 2023-05-17T15:10:18.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:10:18.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.441+0000 7f009f02d700 1 Processor -- start 2023-05-17T15:10:18.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.441+0000 7f009f02d700 1 -- start start 2023-05-17T15:10:18.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009f02d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0098153fa0 0x7f00980c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009f02d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0098068890 0x7f0098068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009f02d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0098066500 con 0x7f0098065420 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009f02d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0098069200 con 0x7f0098153fa0 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009f02d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980c37a0 con 0x7f0098068890 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009cdc9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0098153fa0 0x7f00980c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009d5ca700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0098065420 0x7f00980bd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41850/0 (socket says 172.21.15.27:41850) 2023-05-17T15:10:18.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009cdc9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0098153fa0 0x7f00980c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42284/0 (socket says 172.21.15.27:42284) 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.442+0000 7f009d5ca700 1 -- 172.21.15.27:0/1023830669 learned_addr learned my addr 172.21.15.27:0/1023830669 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f009cdc9700 1 -- 172.21.15.27:0/1023830669 >> v2:172.21.15.40:3300/0 conn(0x7f0098068890 msgr2=0x7f0098068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f0097fff700 1 --2- 172.21.15.27:0/1023830669 >> v2:172.21.15.40:3300/0 conn(0x7f0098068890 0x7f0098068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f00977fe700 1 -- 172.21.15.27:0/1023830669 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033105455 0 0) 0x7f0098066500 con 0x7f0098065420 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f009cdc9700 1 --2- 172.21.15.27:0/1023830669 >> v2:172.21.15.40:3300/0 conn(0x7f0098068890 0x7f0098068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f009cdc9700 1 -- 172.21.15.27:0/1023830669 >> v1:172.21.15.27:6789/0 conn(0x7f0098065420 legacy=0x7f00980bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f009cdc9700 1 -- 172.21.15.27:0/1023830669 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980c3a40 con 0x7f0098153fa0 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f0097fff700 1 --2- 172.21.15.27:0/1023830669 >> v2:172.21.15.40:3300/0 conn(0x7f0098068890 0x7f0098068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f009cdc9700 1 --2- 172.21.15.27:0/1023830669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098153fa0 0x7f00980c4aa0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f00980822b0 tx=0x7f0090009780).ready entity=mon.0 client_cookie=4779eb170c8c0990 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f00977fe700 1 -- 172.21.15.27:0/1023830669 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000e070 con 0x7f0098153fa0 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f00977fe700 1 -- 172.21.15.27:0/1023830669 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000bc30 con 0x7f0098153fa0 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.443+0000 7f00977fe700 1 -- 172.21.15.27:0/1023830669 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090012410 con 0x7f0098153fa0 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 -- 172.21.15.27:0/1023830669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098153fa0 msgr2=0x7f00980c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 --2- 172.21.15.27:0/1023830669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098153fa0 0x7f00980c4aa0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f00980822b0 tx=0x7f0090009780).stop 2023-05-17T15:10:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 -- 172.21.15.27:0/1023830669 shutdown_connections 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 --2- 172.21.15.27:0/1023830669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098153fa0 0x7f00980c4aa0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 --2- 172.21.15.27:0/1023830669 >> v2:172.21.15.40:3300/0 conn(0x7f0098068890 0x7f0098068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 -- 172.21.15.27:0/1023830669 >> 172.21.15.27:0/1023830669 conn(0x7f00980c9470 msgr2=0x7f00980c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 -- 172.21.15.27:0/1023830669 shutdown_connections 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.444+0000 7f009f02d700 1 -- 172.21.15.27:0/1023830669 wait complete. 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.445+0000 7f009f02d700 1 Processor -- start 2023-05-17T15:10:18.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.445+0000 7f009f02d700 1 -- start start 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009f02d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 0x7f00981516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009f02d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0098068890 0x7f009814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009f02d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0098153fa0 0x7f00980adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009f02d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098151250 con 0x7f0098065420 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009f02d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098150920 con 0x7f0098153fa0 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009f02d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0098150c00 con 0x7f0098068890 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 0x7f00981516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 0x7f00981516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42290/0 (socket says 172.21.15.27:42290) 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 -- 172.21.15.27:0/235094659 learned_addr learned my addr 172.21.15.27:0/235094659 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 -- 172.21.15.27:0/235094659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0098068890 msgr2=0x7f009814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0098068890 0x7f009814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 -- 172.21.15.27:0/235094659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0098153fa0 msgr2=0x7f00980adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0098153fa0 0x7f00980adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 -- 172.21.15.27:0/235094659 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090009a20 con 0x7f0098065420 2023-05-17T15:10:18.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.446+0000 7f009cdc9700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 0x7f00981516e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f0098067840 tx=0x7f0090009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.447+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009001c660 con 0x7f0098065420 2023-05-17T15:10:18.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.447+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009001c7e0 con 0x7f0098065420 2023-05-17T15:10:18.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.447+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0098150ee0 con 0x7f0098065420 2023-05-17T15:10:18.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.447+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009001cba0 con 0x7f0098065420 2023-05-17T15:10:18.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.447+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00980ae0c0 con 0x7f0098065420 2023-05-17T15:10:18.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.448+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0098063970 con 0x7f0098065420 2023-05-17T15:10:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.448+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f009001d420 con 0x7f0098065420 2023-05-17T15:10:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.448+0000 7f0094ff9700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f007805ed90 0x7f0078061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.448+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f009007bb90 con 0x7f0098065420 2023-05-17T15:10:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.448+0000 7f0097fff700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f007805ed90 0x7f0078061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.449+0000 7f0097fff700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f007805ed90 0x7f0078061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f00980c7fa0 tx=0x7f0088008040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.453+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f009004d470 con 0x7f0098065420 2023-05-17T15:10:18.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.624+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f009806bdf0 con 0x7f0098065420 2023-05-17T15:10:18.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.625+0000 7f0094ff9700 1 -- 172.21.15.27:0/235094659 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0090050a90 con 0x7f0098065420 2023-05-17T15:10:18.629 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f007805ed90 msgr2=0x7f0078061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f007805ed90 0x7f0078061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f00980c7fa0 tx=0x7f0088008040).stop 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 msgr2=0x7f00981516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 0x7f00981516e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f0098067840 tx=0x7f0090009780).stop 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 shutdown_connections 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f007805ed90 0x7f0078061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0098153fa0 0x7f00980adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:18.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0098065420 0x7f00981516e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 --2- 172.21.15.27:0/235094659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0098068890 0x7f009814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:18.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 >> 172.21.15.27:0/235094659 conn(0x7f00980c9470 msgr2=0x7f009814f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:18.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 shutdown_connections 2023-05-17T15:10:18.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.627+0000 7f009f02d700 1 -- 172.21.15.27:0/235094659 wait complete. 2023-05-17T15:10:18.643 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:10:18.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.755+0000 7f597ffff700 1 Processor -- start 2023-05-17T15:10:18.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.755+0000 7f597ffff700 1 -- start start 2023-05-17T15:10:18.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59801544f0 0x7f59800a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597ffff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59801549b0 con 0x7f59800c1180 2023-05-17T15:10:18.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597ffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5980154c90 con 0x7f59800aa070 2023-05-17T15:10:18.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5980154f70 con 0x7f59801544f0 2023-05-17T15:10:18.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597effd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f59800c1180 0x7f59800c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41860/0 (socket says 172.21.15.27:41860) 2023-05-17T15:10:18.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597effd700 1 -- 172.21.15.27:0/3789056117 learned_addr learned my addr 172.21.15.27:0/3789056117 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597e7fc700 1 --2- 172.21.15.27:0/3789056117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59801544f0 0x7f59800a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11328336 0 0) 0x7f59801549b0 con 0x7f59800c1180 2023-05-17T15:10:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f596c0033f0 con 0x7f59800c1180 2023-05-17T15:10:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250173478 0 0) 0x7f5980154c90 con 0x7f59800aa070 2023-05-17T15:10:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59801549b0 con 0x7f59800aa070 2023-05-17T15:10:18.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.756+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2416441767 0 0) 0x7f596c0033f0 con 0x7f59800c1180 2023-05-17T15:10:18.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597e7fc700 1 -- 172.21.15.27:0/3789056117 >> v1:172.21.15.40:6789/0 conn(0x7f59800aa070 legacy=0x7f59800c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597e7fc700 1 -- 172.21.15.27:0/3789056117 >> v1:172.21.15.27:6789/0 conn(0x7f59800c1180 legacy=0x7f59800c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597e7fc700 1 -- 172.21.15.27:0/3789056117 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980155250 con 0x7f59801544f0 2023-05-17T15:10:18.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597e7fc700 1 --2- 172.21.15.27:0/3789056117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59801544f0 0x7f59800a9b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5968009790 tx=0x7f5968009060).ready entity=mon.2 client_cookie=1408d9bfd1fc87b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978001470 con 0x7f59801544f0 2023-05-17T15:10:18.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680090d0 con 0x7f59801544f0 2023-05-17T15:10:18.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597dffb700 1 -- 172.21.15.27:0/3789056117 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968011610 con 0x7f59801544f0 2023-05-17T15:10:18.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 -- 172.21.15.27:0/3789056117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59801544f0 msgr2=0x7f59800a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 --2- 172.21.15.27:0/3789056117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59801544f0 0x7f59800a9b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5968009790 tx=0x7f5968009060).stop 2023-05-17T15:10:18.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 -- 172.21.15.27:0/3789056117 shutdown_connections 2023-05-17T15:10:18.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 --2- 172.21.15.27:0/3789056117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59801544f0 0x7f59800a9b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 -- 172.21.15.27:0/3789056117 >> 172.21.15.27:0/3789056117 conn(0x7f598005dd50 msgr2=0x7f598005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 -- 172.21.15.27:0/3789056117 shutdown_connections 2023-05-17T15:10:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.757+0000 7f597ffff700 1 -- 172.21.15.27:0/3789056117 wait complete. 2023-05-17T15:10:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 Processor -- start 2023-05-17T15:10:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 -- start start 2023-05-17T15:10:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59800aa070 0x7f59800c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 0x7f59800c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59801544f0 0x7f59800c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980159050 con 0x7f59800c1180 2023-05-17T15:10:18.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980158860 con 0x7f59801544f0 2023-05-17T15:10:18.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.759+0000 7f597ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5980153d30 con 0x7f59800aa070 2023-05-17T15:10:18.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 0x7f59800c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 0x7f59800c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42306/0 (socket says 172.21.15.27:42306) 2023-05-17T15:10:18.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 -- 172.21.15.27:0/1791066982 learned_addr learned my addr 172.21.15.27:0/1791066982 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597effd700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59800aa070 0x7f59800c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597f7fe700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59801544f0 0x7f59800c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 -- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59800aa070 msgr2=0x7f59800c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59800aa070 0x7f59800c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 -- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59801544f0 msgr2=0x7f59800c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59801544f0 0x7f59800c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 -- 172.21.15.27:0/1791066982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680092a0 con 0x7f59800c1180 2023-05-17T15:10:18.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597e7fc700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 0x7f59800c3260 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f5968009d80 tx=0x7f5968016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968010740 con 0x7f59800c1180 2023-05-17T15:10:18.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680108a0 con 0x7f59800c1180 2023-05-17T15:10:18.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968010c20 con 0x7f59800c1180 2023-05-17T15:10:18.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59800c9fa0 con 0x7f59800c1180 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.760+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5980158d70 con 0x7f59800c1180 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.761+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598006bdf0 con 0x7f59800c1180 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.762+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5968024030 con 0x7f59800c1180 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.762+0000 7f5976ffd700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f596005ed90 0x7f5960061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.762+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f596807a1c0 con 0x7f59800c1180 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.762+0000 7f597effd700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f596005ed90 0x7f5960061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:18.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.762+0000 7f597effd700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f596005ed90 0x7f5960061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f59780015a0 tx=0x7f5978000bc0).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:18.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.766+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f596804bb00 con 0x7f59800c1180 2023-05-17T15:10:18.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.941+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f59800a9e50 con 0x7f59800c1180 2023-05-17T15:10:18.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.941+0000 7f5976ffd700 1 -- 172.21.15.27:0/1791066982 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v122) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5968022070 con 0x7f59800c1180 2023-05-17T15:10:18.945 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:10:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f596005ed90 msgr2=0x7f5960061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f596005ed90 0x7f5960061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f59780015a0 tx=0x7f5978000bc0).stop 2023-05-17T15:10:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 msgr2=0x7f59800c3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 0x7f59800c3260 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f5968009d80 tx=0x7f5968016000).stop 2023-05-17T15:10:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 shutdown_connections 2023-05-17T15:10:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f596005ed90 0x7f5960061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59801544f0 0x7f59800c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59800aa070 0x7f59800c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 --2- 172.21.15.27:0/1791066982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59800c1180 0x7f59800c3260 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:18.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 >> 172.21.15.27:0/1791066982 conn(0x7f598005dd50 msgr2=0x7f59800c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:18.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 shutdown_connections 2023-05-17T15:10:18.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:18.943+0000 7f597ffff700 1 -- 172.21.15.27:0/1791066982 wait complete. 2023-05-17T15:10:18.959 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:10:18.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:10:19.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.076+0000 7f7186c7e700 1 Processor -- start 2023-05-17T15:10:19.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.076+0000 7f7186c7e700 1 -- start start 2023-05-17T15:10:19.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.077+0000 7f7186c7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f71801564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:19.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.077+0000 7f7186c7e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f71800c6070 0x7f71800a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:19.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.077+0000 7f7186c7e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71800c6490 con 0x7f71800be490 2023-05-17T15:10:19.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.077+0000 7f7186c7e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71800c5340 con 0x7f71800c6070 2023-05-17T15:10:19.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.077+0000 7f7186c7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71800c5be0 con 0x7f7180151c10 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.077+0000 7f717ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f71800c6070 0x7f71800a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f718521b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f71800be490 0x7f71800c3b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41876/0 (socket says 172.21.15.27:41876) 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f718521b700 1 -- 172.21.15.27:0/172986053 learned_addr learned my addr 172.21.15.27:0/172986053 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f71800c6070 0x7f71800a7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42312/0 (socket says 172.21.15.27:42312) 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f7184a1a700 1 --2- 172.21.15.27:0/172986053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f71801564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717ffff700 1 -- 172.21.15.27:0/172986053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 msgr2=0x7f71801564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:19.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717ffff700 1 --2- 172.21.15.27:0/172986053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f71801564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:19.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717ffff700 1 -- 172.21.15.27:0/172986053 >> v1:172.21.15.27:6789/0 conn(0x7f71800be490 legacy=0x7f71800c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:19.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717ffff700 1 -- 172.21.15.27:0/172986053 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800a7fb0 con 0x7f71800c6070 2023-05-17T15:10:19.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717ffff700 1 --2- 172.21.15.27:0/172986053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800a7ac0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f7170009e60 tx=0x7f7170009780).ready entity=mon.0 client_cookie=e27814dde9671af6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:19.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717f7fe700 1 -- 172.21.15.27:0/172986053 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000e070 con 0x7f71800c6070 2023-05-17T15:10:19.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717f7fe700 1 -- 172.21.15.27:0/172986053 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000bb60 con 0x7f71800c6070 2023-05-17T15:10:19.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.078+0000 7f717f7fe700 1 -- 172.21.15.27:0/172986053 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170012410 con 0x7f71800c6070 2023-05-17T15:10:19.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 -- 172.21.15.27:0/172986053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 msgr2=0x7f71800a7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 --2- 172.21.15.27:0/172986053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800a7ac0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f7170009e60 tx=0x7f7170009780).stop 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 -- 172.21.15.27:0/172986053 shutdown_connections 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 --2- 172.21.15.27:0/172986053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f71801564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 --2- 172.21.15.27:0/172986053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800a7ac0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 -- 172.21.15.27:0/172986053 >> 172.21.15.27:0/172986053 conn(0x7f7180092160 msgr2=0x7f7180062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 -- 172.21.15.27:0/172986053 shutdown_connections 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.079+0000 7f7186c7e700 1 -- 172.21.15.27:0/172986053 wait complete. 2023-05-17T15:10:19.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.080+0000 7f7186c7e700 1 Processor -- start 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.080+0000 7f7186c7e700 1 -- start start 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7186c7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71800be490 0x7f718014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7186c7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7186c7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f7180153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7186c7e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800c7900 con 0x7f71800c6070 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7186c7e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800c6cf0 con 0x7f71800be490 2023-05-17T15:10:19.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7186c7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71800c6fd0 con 0x7f7180151c10 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42318/0 (socket says 172.21.15.27:42318) 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 -- 172.21.15.27:0/1672202926 learned_addr learned my addr 172.21.15.27:0/1672202926 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f7184a1a700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71800be490 0x7f718014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f718521b700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f7180153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 -- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 msgr2=0x7f7180153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f7180153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:19.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 -- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71800be490 msgr2=0x7f718014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71800be490 0x7f718014b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 -- 172.21.15.27:0/1672202926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170009a20 con 0x7f71800c6070 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717ffff700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800aa350 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f7180067550 tx=0x7f7170009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.081+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717001d420 con 0x7f71800c6070 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.082+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717001d580 con 0x7f71800c6070 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.082+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71800c72b0 con 0x7f71800c6070 2023-05-17T15:10:19.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.082+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717001d920 con 0x7f71800c6070 2023-05-17T15:10:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.082+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718014bb50 con 0x7f71800c6070 2023-05-17T15:10:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.082+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718006bdf0 con 0x7f71800c6070 2023-05-17T15:10:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.083+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f717001dd10 con 0x7f71800c6070 2023-05-17T15:10:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.083+0000 7f717cff9700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f716005ed90 0x7f7160061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.083+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f717007b930 con 0x7f71800c6070 2023-05-17T15:10:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.083+0000 7f7184a1a700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f716005ed90 0x7f7160061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.084+0000 7f7184a1a700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f716005ed90 0x7f7160061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7178009b00 tx=0x7f7178009060).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.087+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f717004d1c0 con 0x7f71800c6070 2023-05-17T15:10:19.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:19.262+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f71800c7750 con 0x7f71800c6070 2023-05-17T15:10:20.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.269+0000 7f717cff9700 1 -- 172.21.15.27:0/1672202926 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v123) v1 ==== 152+0+0 (secure 0 0 0) 0x7f71700507e0 con 0x7f71800c6070 2023-05-17T15:10:20.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.274+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f716005ed90 msgr2=0x7f7160061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.274+0000 7f7186c7e700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f716005ed90 0x7f7160061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7178009b00 tx=0x7f7178009060).stop 2023-05-17T15:10:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.274+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 msgr2=0x7f71800aa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:20.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.274+0000 7f7186c7e700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800aa350 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f7180067550 tx=0x7f7170009780).stop 2023-05-17T15:10:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 shutdown_connections 2023-05-17T15:10:20.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f716005ed90 0x7f7160061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7180151c10 0x7f7180153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71800be490 0x7f718014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 --2- 172.21.15.27:0/1672202926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71800c6070 0x7f71800aa350 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 >> 172.21.15.27:0/1672202926 conn(0x7f7180092160 msgr2=0x7f71800a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:20.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.277+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 shutdown_connections 2023-05-17T15:10:20.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.278+0000 7f7186c7e700 1 -- 172.21.15.27:0/1672202926 wait complete. 2023-05-17T15:10:20.284 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:10:20.298 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:10:20.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.422+0000 7fa05830d700 1 Processor -- start 2023-05-17T15:10:20.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.422+0000 7fa05830d700 1 -- start start 2023-05-17T15:10:20.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa05830d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0500c6310 0x7fa050068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:20.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa05830d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0500691f0 0x7fa0500bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:20.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa05830d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa050158790 con 0x7fa0501543d0 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa05830d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500c1c50 con 0x7fa0500c6310 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa05830d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa050157e60 con 0x7fa0500691f0 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa0558a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0500c6310 0x7fa050068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa0558a8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0500c6310 0x7fa050068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42328/0 (socket says 172.21.15.27:42328) 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa0558a8700 1 -- 172.21.15.27:0/548571083 learned_addr learned my addr 172.21.15.27:0/548571083 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.423+0000 7fa0568aa700 1 --2- 172.21.15.27:0/548571083 >> v2:172.21.15.40:3300/0 conn(0x7fa0500691f0 0x7fa0500bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:20.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0558a8700 1 -- 172.21.15.27:0/548571083 >> v2:172.21.15.40:3300/0 conn(0x7fa0500691f0 msgr2=0x7fa0500bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:20.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0558a8700 1 --2- 172.21.15.27:0/548571083 >> v2:172.21.15.40:3300/0 conn(0x7fa0500691f0 0x7fa0500bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0558a8700 1 -- 172.21.15.27:0/548571083 >> v1:172.21.15.40:6789/0 conn(0x7fa0501543d0 legacy=0x7fa0500c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:20.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0558a8700 1 -- 172.21.15.27:0/548571083 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050158140 con 0x7fa0500c6310 2023-05-17T15:10:20.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0558a8700 1 --2- 172.21.15.27:0/548571083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0500c6310 0x7fa050068d00 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa050083a00 tx=0x7fa0440090f0).ready entity=mon.0 client_cookie=30ce1d03946de2df server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:20.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0550a7700 1 -- 172.21.15.27:0/548571083 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400b520 con 0x7fa0500c6310 2023-05-17T15:10:20.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0550a7700 1 -- 172.21.15.27:0/548571083 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400b680 con 0x7fa0500c6310 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa0550a7700 1 -- 172.21.15.27:0/548571083 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400ba00 con 0x7fa0500c6310 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa05830d700 1 -- 172.21.15.27:0/548571083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0500c6310 msgr2=0x7fa050068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa05830d700 1 --2- 172.21.15.27:0/548571083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0500c6310 0x7fa050068d00 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa050083a00 tx=0x7fa0440090f0).stop 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa05830d700 1 -- 172.21.15.27:0/548571083 shutdown_connections 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa05830d700 1 --2- 172.21.15.27:0/548571083 >> v2:172.21.15.40:3300/0 conn(0x7fa0500691f0 0x7fa0500bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa05830d700 1 --2- 172.21.15.27:0/548571083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0500c6310 0x7fa050068d00 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.424+0000 7fa05830d700 1 -- 172.21.15.27:0/548571083 >> 172.21.15.27:0/548571083 conn(0x7fa0500cb7f0 msgr2=0x7fa0500c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:20.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.425+0000 7fa05830d700 1 -- 172.21.15.27:0/548571083 shutdown_connections 2023-05-17T15:10:20.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.425+0000 7fa05830d700 1 -- 172.21.15.27:0/548571083 wait complete. 2023-05-17T15:10:20.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 Processor -- start 2023-05-17T15:10:20.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 -- start start 2023-05-17T15:10:20.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0500691f0 0x7fa05013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0500c6310 0x7fa050152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 0x7fa0500c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500ae630 con 0x7fa0501543d0 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05013fca0 con 0x7fa0500691f0 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa05830d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500afeb0 con 0x7fa0500c6310 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.426+0000 7fa0568aa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 0x7fa0500c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 0x7fa0500c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42334/0 (socket says 172.21.15.27:42334) 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 -- 172.21.15.27:0/202344771 learned_addr learned my addr 172.21.15.27:0/202344771 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0560a9700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0500691f0 0x7fa05013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0558a8700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0500c6310 0x7fa050152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 -- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0500c6310 msgr2=0x7fa050152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0500c6310 0x7fa050152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 -- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0500691f0 msgr2=0x7fa05013f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0500691f0 0x7fa05013f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 -- 172.21.15.27:0/202344771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009370 con 0x7fa0501543d0 2023-05-17T15:10:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa0568aa700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 0x7fa0500c9e30 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fa040009e90 tx=0x7fa04000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000caa0 con 0x7fa0501543d0 2023-05-17T15:10:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000f040 con 0x7fa0501543d0 2023-05-17T15:10:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0500b0190 con 0x7fa0501543d0 2023-05-17T15:10:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000ce10 con 0x7fa0501543d0 2023-05-17T15:10:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.427+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0500b0750 con 0x7fa0501543d0 2023-05-17T15:10:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.428+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05006bdf0 con 0x7fa0501543d0 2023-05-17T15:10:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.429+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa040013610 con 0x7fa0501543d0 2023-05-17T15:10:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.429+0000 7fa04e7fc700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa03c05ed90 0x7fa03c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.429+0000 7fa0560a9700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa03c05ed90 0x7fa03c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.429+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fa04007a330 con 0x7fa0501543d0 2023-05-17T15:10:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.430+0000 7fa0560a9700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa03c05ed90 0x7fa03c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa048003860 tx=0x7fa048007d40).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.434+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa04004ba50 con 0x7fa0501543d0 2023-05-17T15:10:20.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:20.607+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa050069d00 con 0x7fa0501543d0 2023-05-17T15:10:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.274+0000 7fa04e7fc700 1 -- 172.21.15.27:0/202344771 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v124) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa04004f070 con 0x7fa0501543d0 2023-05-17T15:10:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.278+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa03c05ed90 msgr2=0x7fa03c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.278+0000 7fa05830d700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa03c05ed90 0x7fa03c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa048003860 tx=0x7fa048007d40).stop 2023-05-17T15:10:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.278+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 msgr2=0x7fa0500c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.278+0000 7fa05830d700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 0x7fa0500c9e30 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fa040009e90 tx=0x7fa04000b040).stop 2023-05-17T15:10:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.281+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 shutdown_connections 2023-05-17T15:10:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.281+0000 7fa05830d700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa03c05ed90 0x7fa03c061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.281+0000 7fa05830d700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0501543d0 0x7fa0500c9e30 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.281+0000 7fa05830d700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0500691f0 0x7fa05013f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.281+0000 7fa05830d700 1 --2- 172.21.15.27:0/202344771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0500c6310 0x7fa050152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.281+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 >> 172.21.15.27:0/202344771 conn(0x7fa0500cb7f0 msgr2=0x7fa0500c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.283+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 shutdown_connections 2023-05-17T15:10:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.283+0000 7fa05830d700 1 -- 172.21.15.27:0/202344771 wait complete. 2023-05-17T15:10:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:10:21.315 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:10:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.433+0000 7f08299e4700 1 Processor -- start 2023-05-17T15:10:21.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.433+0000 7f08299e4700 1 -- start start 2023-05-17T15:10:21.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f08299e4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0824153fb0 0x7f0824063dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f08299e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082405e460 0x7f08240c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f08299e4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240c2b80 con 0x7f08240642b0 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f08299e4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0824064730 con 0x7f0824153fb0 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f08299e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08240be580 con 0x7f082405e460 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f0822ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0824153fb0 0x7f0824063dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f0822ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0824153fb0 0x7f0824063dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42338/0 (socket says 172.21.15.27:42338) 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f0822ffd700 1 -- 172.21.15.27:0/1714928818 learned_addr learned my addr 172.21.15.27:0/1714928818 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.434+0000 7f08227fc700 1 --1- 172.21.15.27:0/1714928818 >> v1:172.21.15.27:6789/0 conn(0x7f08240642b0 0x7f082405dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41900/0 (socket says 172.21.15.27:41900) 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0822ffd700 1 -- 172.21.15.27:0/1714928818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082405e460 msgr2=0x7f08240c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08237fe700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082405e460 0x7f08240c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0821ffb700 1 -- 172.21.15.27:0/1714928818 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306747534 0 0) 0x7f08240c2b80 con 0x7f08240642b0 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0822ffd700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082405e460 0x7f08240c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0822ffd700 1 -- 172.21.15.27:0/1714928818 >> v1:172.21.15.27:6789/0 conn(0x7f08240642b0 legacy=0x7f082405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0822ffd700 1 -- 172.21.15.27:0/1714928818 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240c2530 con 0x7f0824153fb0 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08237fe700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082405e460 0x7f08240c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:21.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0822ffd700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0824153fb0 0x7f0824063dc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f081c006fd0 tx=0x7f081c0090f0).ready entity=mon.0 client_cookie=6add03b97cccb5fb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0821ffb700 1 -- 172.21.15.27:0/1714928818 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00b600 con 0x7f0824153fb0 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0821ffb700 1 -- 172.21.15.27:0/1714928818 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c00b760 con 0x7f0824153fb0 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f0821ffb700 1 -- 172.21.15.27:0/1714928818 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00bae0 con 0x7f0824153fb0 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08299e4700 1 -- 172.21.15.27:0/1714928818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0824153fb0 msgr2=0x7f0824063dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08299e4700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0824153fb0 0x7f0824063dc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f081c006fd0 tx=0x7f081c0090f0).stop 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08299e4700 1 -- 172.21.15.27:0/1714928818 shutdown_connections 2023-05-17T15:10:21.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08299e4700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082405e460 0x7f08240c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08299e4700 1 --2- 172.21.15.27:0/1714928818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0824153fb0 0x7f0824063dc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.435+0000 7f08299e4700 1 -- 172.21.15.27:0/1714928818 >> 172.21.15.27:0/1714928818 conn(0x7f08240c7910 msgr2=0x7f08240c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.436+0000 7f08299e4700 1 -- 172.21.15.27:0/1714928818 shutdown_connections 2023-05-17T15:10:21.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.436+0000 7f08299e4700 1 -- 172.21.15.27:0/1714928818 wait complete. 2023-05-17T15:10:21.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.437+0000 7f08299e4700 1 Processor -- start 2023-05-17T15:10:21.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.437+0000 7f08299e4700 1 -- start start 2023-05-17T15:10:21.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082405e460 0x7f0824164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 0x7f08240a8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0824153fb0 0x7f082414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240a8820 con 0x7f08240642b0 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08241642d0 con 0x7f082405e460 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0824164b30 con 0x7f0824153fb0 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 0x7f08240a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 0x7f08240a8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42346/0 (socket says 172.21.15.27:42346) 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 -- 172.21.15.27:0/1717174168 learned_addr learned my addr 172.21.15.27:0/1717174168 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08237fe700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0824153fb0 0x7f082414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f0822ffd700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082405e460 0x7f0824164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 -- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0824153fb0 msgr2=0x7f082414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0824153fb0 0x7f082414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 -- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082405e460 msgr2=0x7f0824164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082405e460 0x7f0824164fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 -- 172.21.15.27:0/1717174168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c009370 con 0x7f08240642b0 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08237fe700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0824153fb0 0x7f082414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f0822ffd700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082405e460 0x7f0824164fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08227fc700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 0x7f08240a8330 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f080c00c560 tx=0x7f080c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c0072e0 con 0x7f08240642b0 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c007440 con 0x7f08240642b0 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08240aa110 con 0x7f08240642b0 2023-05-17T15:10:21.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c0058f0 con 0x7f08240642b0 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.438+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082414b630 con 0x7f08240642b0 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.439+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082406bdf0 con 0x7f08240642b0 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.440+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f080c01a060 con 0x7f08240642b0 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.440+0000 7f081affd700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f080405ed90 0x7f0804061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.440+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f080c079950 con 0x7f08240642b0 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.440+0000 7f0822ffd700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f080405ed90 0x7f0804061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.441+0000 7f0822ffd700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f080405ed90 0x7f0804061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0824153a60 tx=0x7f081c017000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:21.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.444+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f080c04af70 con 0x7f08240642b0 2023-05-17T15:10:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.663+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f08240c1cd0 con 0x7f08240642b0 2023-05-17T15:10:21.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.671+0000 7f081affd700 1 -- 172.21.15.27:0/1717174168 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7f080c018070 con 0x7f08240642b0 2023-05-17T15:10:21.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.678+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f080405ed90 msgr2=0x7f0804061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.678+0000 7f08299e4700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f080405ed90 0x7f0804061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0824153a60 tx=0x7f081c017000).stop 2023-05-17T15:10:21.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.678+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 msgr2=0x7f08240a8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.678+0000 7f08299e4700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 0x7f08240a8330 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f080c00c560 tx=0x7f080c007c90).stop 2023-05-17T15:10:21.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.679+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 shutdown_connections 2023-05-17T15:10:21.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.679+0000 7f08299e4700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f080405ed90 0x7f0804061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.679+0000 7f08299e4700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0824153fb0 0x7f082414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.679+0000 7f08299e4700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082405e460 0x7f0824164fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.679+0000 7f08299e4700 1 --2- 172.21.15.27:0/1717174168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08240642b0 0x7f08240a8330 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.679+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 >> 172.21.15.27:0/1717174168 conn(0x7f08240c7910 msgr2=0x7f08240c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:21.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.680+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 shutdown_connections 2023-05-17T15:10:21.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.681+0000 7f08299e4700 1 -- 172.21.15.27:0/1717174168 wait complete. 2023-05-17T15:10:21.699 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 15 and data pool 16 2023-05-17T15:10:21.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.820+0000 7fc6af84d700 1 Processor -- start 2023-05-17T15:10:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.820+0000 7fc6af84d700 1 -- start start 2023-05-17T15:10:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6af84d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8150cc0 0x7fc6a80bb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6af84d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6a80c3900 0x7fc6a80bd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6af84d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80a93d0 con 0x7fc6a8066b10 2023-05-17T15:10:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6af84d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80c2f00 con 0x7fc6a80c3900 2023-05-17T15:10:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6af84d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80bbd50 con 0x7fc6a8150cc0 2023-05-17T15:10:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6addea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6a80c3900 0x7fc6a80bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6acde8700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc6a8066b10 0x7fc6a80c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41916/0 (socket says 172.21.15.27:41916) 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6addea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6a80c3900 0x7fc6a80bd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42356/0 (socket says 172.21.15.27:42356) 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.821+0000 7fc6acde8700 1 -- 172.21.15.27:0/2799770679 learned_addr learned my addr 172.21.15.27:0/2799770679 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6ad5e9700 1 --2- 172.21.15.27:0/2799770679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8150cc0 0x7fc6a80bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6addea700 1 -- 172.21.15.27:0/2799770679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8150cc0 msgr2=0x7fc6a80bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6addea700 1 --2- 172.21.15.27:0/2799770679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8150cc0 0x7fc6a80bb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6addea700 1 -- 172.21.15.27:0/2799770679 >> v1:172.21.15.27:6789/0 conn(0x7fc6a8066b10 legacy=0x7fc6a80c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6addea700 1 -- 172.21.15.27:0/2799770679 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8066680 con 0x7fc6a80c3900 2023-05-17T15:10:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6a7fff700 1 -- 172.21.15.27:0/2799770679 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577631932 0 0) 0x7fc6a80a93d0 con 0x7fc6a8066b10 2023-05-17T15:10:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6addea700 1 --2- 172.21.15.27:0/2799770679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80bd140 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fc698009e60 tx=0x7fc698009780).ready entity=mon.0 client_cookie=9b568f963281efe3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6a7fff700 1 -- 172.21.15.27:0/2799770679 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800e070 con 0x7fc6a80c3900 2023-05-17T15:10:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6a7fff700 1 -- 172.21.15.27:0/2799770679 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69800bc30 con 0x7fc6a80c3900 2023-05-17T15:10:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6a7fff700 1 -- 172.21.15.27:0/2799770679 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698012410 con 0x7fc6a80c3900 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6af84d700 1 -- 172.21.15.27:0/2799770679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 msgr2=0x7fc6a80bd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.822+0000 7fc6af84d700 1 --2- 172.21.15.27:0/2799770679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80bd140 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fc698009e60 tx=0x7fc698009780).stop 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.823+0000 7fc6af84d700 1 -- 172.21.15.27:0/2799770679 shutdown_connections 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.823+0000 7fc6af84d700 1 --2- 172.21.15.27:0/2799770679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80bd140 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.823+0000 7fc6af84d700 1 --2- 172.21.15.27:0/2799770679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8150cc0 0x7fc6a80bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.823+0000 7fc6af84d700 1 -- 172.21.15.27:0/2799770679 >> 172.21.15.27:0/2799770679 conn(0x7fc6a805dd50 msgr2=0x7fc6a805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.823+0000 7fc6af84d700 1 -- 172.21.15.27:0/2799770679 shutdown_connections 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.823+0000 7fc6af84d700 1 -- 172.21.15.27:0/2799770679 wait complete. 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.824+0000 7fc6af84d700 1 Processor -- start 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.824+0000 7fc6af84d700 1 -- start start 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8066b10 0x7fc6a814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80becb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a8150cc0 0x7fc6a8160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81529e0 con 0x7fc6a80c3900 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81606f0 con 0x7fc6a8150cc0 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8152140 con 0x7fc6a8066b10 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80becb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42360/0 (socket says 172.21.15.27:42360) 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 -- 172.21.15.27:0/906128000 learned_addr learned my addr 172.21.15.27:0/906128000 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6ad5e9700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8066b10 0x7fc6a814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6addea700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a8150cc0 0x7fc6a8160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 -- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8066b10 msgr2=0x7fc6a814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8066b10 0x7fc6a814dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 -- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a8150cc0 msgr2=0x7fc6a8160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a8150cc0 0x7fc6a8160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 -- 172.21.15.27:0/906128000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009a20 con 0x7fc6a80c3900 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6acde8700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80becb0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7fc69c00c4a0 tx=0x7fc69c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00ce50 con 0x7fc6a80c3900 2023-05-17T15:10:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c0072e0 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.825+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a8152420 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.826+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c007660 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.826+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a8160970 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.826+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a806bdf0 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.827+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc69c01a060 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.827+0000 7fc6a57fa700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc69405ed90 0x7fc694061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.827+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fc69c0791d0 con 0x7fc6a80c3900 2023-05-17T15:10:21.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.827+0000 7fc6ad5e9700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc69405ed90 0x7fc694061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:21.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.828+0000 7fc6ad5e9700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc69405ed90 0x7fc694061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6a0006090 tx=0x7fc6a0008040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:21.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:21.831+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc69c04a710 con 0x7fc6a80c3900 2023-05-17T15:10:22.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.005+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a80ac520 con 0x7fc6a80c3900 2023-05-17T15:10:22.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.006+0000 7fc6a57fa700 1 -- 172.21.15.27:0/906128000 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17115 (secure 0 0 0) 0x7fc69c018070 con 0x7fc6a80c3900 2023-05-17T15:10:22.010 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:22.011 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":125,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:21.664663+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:19.299248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:20.644965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:22.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc69405ed90 msgr2=0x7fc694061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc69405ed90 0x7fc694061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6a0006090 tx=0x7fc6a0008040).stop 2023-05-17T15:10:22.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 msgr2=0x7fc6a80becb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80becb0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7fc69c00c4a0 tx=0x7fc69c007c30).stop 2023-05-17T15:10:22.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 shutdown_connections 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc69405ed90 0x7fc694061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a8150cc0 0x7fc6a8160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a8066b10 0x7fc6a814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 --2- 172.21.15.27:0/906128000 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6a80c3900 0x7fc6a80becb0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 >> 172.21.15.27:0/906128000 conn(0x7fc6a805dd50 msgr2=0x7fc6a80c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 shutdown_connections 2023-05-17T15:10:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.008+0000 7fc6af84d700 1 -- 172.21.15.27:0/906128000 wait complete. 2023-05-17T15:10:22.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:22.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.136+0000 7f2c21fb0700 1 Processor -- start 2023-05-17T15:10:22.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.136+0000 7f2c21fb0700 1 -- start start 2023-05-17T15:10:22.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c21fb0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c1c0c6310 0x7f2c1c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c21fb0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2c1c1541c0 0x7f2c1c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c21fb0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c0bfcd0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c21fb0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0c0290 con 0x7f2c1c1541c0 2023-05-17T15:10:22.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c21fb0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0aa1a0 con 0x7f2c1c0c6310 2023-05-17T15:10:22.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2c1c1541c0 0x7f2c1c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2c1c0c5f30 0x7f2c1c158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41928/0 (socket says 172.21.15.27:41928) 2023-05-17T15:10:22.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1b7fe700 1 -- 172.21.15.27:0/70160953 learned_addr learned my addr 172.21.15.27:0/70160953 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:22.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1affd700 1 --2- 172.21.15.27:0/70160953 >> v2:172.21.15.40:3300/0 conn(0x7f2c1c0c6310 0x7f2c1c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1bfff700 1 -- 172.21.15.27:0/70160953 >> v2:172.21.15.40:3300/0 conn(0x7f2c1c0c6310 msgr2=0x7f2c1c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:22.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1bfff700 1 --2- 172.21.15.27:0/70160953 >> v2:172.21.15.40:3300/0 conn(0x7f2c1c0c6310 0x7f2c1c153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1bfff700 1 -- 172.21.15.27:0/70160953 >> v1:172.21.15.27:6789/0 conn(0x7f2c1c0c5f30 legacy=0x7f2c1c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1bfff700 1 -- 172.21.15.27:0/70160953 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0aa480 con 0x7f2c1c1541c0 2023-05-17T15:10:22.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1a7fc700 1 -- 172.21.15.27:0/70160953 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817942107 0 0) 0x7f2c1c0bfcd0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.137+0000 7f2c1affd700 1 --2- 172.21.15.27:0/70160953 >> v2:172.21.15.40:3300/0 conn(0x7f2c1c0c6310 0x7f2c1c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c1bfff700 1 --2- 172.21.15.27:0/70160953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c0c0720 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f2c1c0c57b0 tx=0x7f2c0c009780).ready entity=mon.0 client_cookie=4752ad0fec768662 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c1a7fc700 1 -- 172.21.15.27:0/70160953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00e070 con 0x7f2c1c1541c0 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c1a7fc700 1 -- 172.21.15.27:0/70160953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00bc30 con 0x7f2c1c1541c0 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c1a7fc700 1 -- 172.21.15.27:0/70160953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c012410 con 0x7f2c1c1541c0 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 -- 172.21.15.27:0/70160953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c1541c0 msgr2=0x7f2c1c0c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/70160953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c0c0720 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f2c1c0c57b0 tx=0x7f2c0c009780).stop 2023-05-17T15:10:22.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 -- 172.21.15.27:0/70160953 shutdown_connections 2023-05-17T15:10:22.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/70160953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c0c0720 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/70160953 >> v2:172.21.15.40:3300/0 conn(0x7f2c1c0c6310 0x7f2c1c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 -- 172.21.15.27:0/70160953 >> 172.21.15.27:0/70160953 conn(0x7f2c1c069e70 msgr2=0x7f2c1c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:22.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 -- 172.21.15.27:0/70160953 shutdown_connections 2023-05-17T15:10:22.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.138+0000 7f2c21fb0700 1 -- 172.21.15.27:0/70160953 wait complete. 2023-05-17T15:10:22.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.139+0000 7f2c21fb0700 1 Processor -- start 2023-05-17T15:10:22.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 -- start start 2023-05-17T15:10:22.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 0x7f2c1c1406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1c0c6310 0x7f2c1c167910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c14f250 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c168480 con 0x7f2c1c1541c0 2023-05-17T15:10:22.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c21fb0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c168760 con 0x7f2c1c0c6310 2023-05-17T15:10:22.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 0x7f2c1c1406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 0x7f2c1c1406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42372/0 (socket says 172.21.15.27:42372) 2023-05-17T15:10:22.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.140+0000 7f2c1b7fe700 1 -- 172.21.15.27:0/3595330858 learned_addr learned my addr 172.21.15.27:0/3595330858 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:22.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1bfff700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1affd700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1c0c6310 0x7f2c1c167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1b7fe700 1 -- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1c0c6310 msgr2=0x7f2c1c167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1b7fe700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1c0c6310 0x7f2c1c167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1b7fe700 1 -- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1c1541c0 msgr2=0x7f2c1c167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1b7fe700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1b7fe700 1 -- 172.21.15.27:0/3595330858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009a20 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1affd700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1c0c6310 0x7f2c1c167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:22.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c1b7fe700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 0x7f2c1c1406f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f2c1400c4e0 tx=0x7f2c14007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:22.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140072e0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14007440 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c150320 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140057a0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.141+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c1508e0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.142+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c150b00 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.143+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2c1401a060 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.143+0000 7f2c137fe700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2bfc05ed60 0x7f2bfc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.143+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f2c14079490 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.143+0000 7f2c1affd700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2bfc05ed60 0x7f2bfc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.143+0000 7f2c1affd700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2bfc05ed60 0x7f2bfc061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2c1c0ad610 tx=0x7f2c04008040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:22.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.147+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c1404a9d0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.322+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c1c05f4a0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.323+0000 7f2c137fe700 1 -- 172.21.15.27:0/3595330858 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17115 (secure 0 0 0) 0x7f2c1404dff0 con 0x7f2c1c0c5f30 2023-05-17T15:10:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:22.328 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":125,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:21.664663+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:19.299248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:20.644965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2bfc05ed60 msgr2=0x7f2bfc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2bfc05ed60 0x7f2bfc061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2c1c0ad610 tx=0x7f2c04008040).stop 2023-05-17T15:10:22.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 msgr2=0x7f2c1c1406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 0x7f2c1c1406f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f2c1400c4e0 tx=0x7f2c14007c70).stop 2023-05-17T15:10:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 shutdown_connections 2023-05-17T15:10:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f2bfc05ed60 0x7f2bfc061220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1c1541c0 0x7f2c1c167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c1c0c5f30 0x7f2c1c1406f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 --2- 172.21.15.27:0/3595330858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1c0c6310 0x7f2c1c167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 >> 172.21.15.27:0/3595330858 conn(0x7f2c1c069e70 msgr2=0x7f2c1c0aba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 shutdown_connections 2023-05-17T15:10:22.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.325+0000 7f2c21fb0700 1 -- 172.21.15.27:0/3595330858 wait complete. 2023-05-17T15:10:22.341 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:10:22.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.457+0000 7f7b0e1e8700 1 Processor -- start 2023-05-17T15:10:22.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.457+0000 7f7b0e1e8700 1 -- start start 2023-05-17T15:10:22.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b0e1e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08153fa0 0x7f7b080c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b0e1e8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b08065b30 0x7f7b08068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b0e1e8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b08066500 con 0x7f7b08068890 2023-05-17T15:10:22.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b0e1e8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b08069200 con 0x7f7b08065b30 2023-05-17T15:10:22.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b0e1e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080c37a0 con 0x7f7b08153fa0 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b08065b30 0x7f7b08068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08153fa0 0x7f7b080c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b08065b30 0x7f7b08068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:60314/0 (socket says 172.21.15.27:60314) 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 -- 172.21.15.27:0/881888946 learned_addr learned my addr 172.21.15.27:0/881888946 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 -- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08153fa0 msgr2=0x7f7b080c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 --2- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08153fa0 0x7f7b080c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 -- 172.21.15.27:0/881888946 >> v1:172.21.15.40:6789/0 conn(0x7f7b08068890 legacy=0x7f7b08065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b07fff700 1 -- 172.21.15.27:0/881888946 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b080c3a40 con 0x7f7b08065b30 2023-05-17T15:10:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.458+0000 7f7b077fe700 1 --2- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08153fa0 0x7f7b080c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:22.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b07fff700 1 --2- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b08068d10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f7b00009f20 tx=0x7f7b00009840).ready entity=mon.1 client_cookie=a34a5f284233ae3f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b067fc700 1 -- 172.21.15.27:0/881888946 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000e070 con 0x7f7b08065b30 2023-05-17T15:10:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b067fc700 1 -- 172.21.15.27:0/881888946 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000b9d0 con 0x7f7b08065b30 2023-05-17T15:10:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b067fc700 1 -- 172.21.15.27:0/881888946 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000bd50 con 0x7f7b08065b30 2023-05-17T15:10:22.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 msgr2=0x7f7b08068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b08068d10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f7b00009f20 tx=0x7f7b00009840).stop 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/881888946 shutdown_connections 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b08068d10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/881888946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08153fa0 0x7f7b080c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/881888946 >> 172.21.15.27:0/881888946 conn(0x7f7b080c9470 msgr2=0x7f7b080c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/881888946 shutdown_connections 2023-05-17T15:10:22.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.459+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/881888946 wait complete. 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 Processor -- start 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 -- start start 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b0814a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08068890 0x7f7b08149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 0x7f7b081640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0814ad80 con 0x7f7b08153fa0 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0814fe40 con 0x7f7b08065b30 2023-05-17T15:10:22.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b0e1e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0814a310 con 0x7f7b08068890 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.461+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 0x7f7b081640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 0x7f7b081640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42388/0 (socket says 172.21.15.27:42388) 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 -- 172.21.15.27:0/3004791786 learned_addr learned my addr 172.21.15.27:0/3004791786 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b077fe700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b0814a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b06ffd700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08068890 0x7f7b08149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 -- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08068890 msgr2=0x7f7b08149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08068890 0x7f7b08149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 -- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 msgr2=0x7f7b0814a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b0814a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 -- 172.21.15.27:0/3004791786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af00092a0 con 0x7f7b08153fa0 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b07fff700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 0x7f7b081640d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f7b0000b610 tx=0x7f7b00009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b000092e0 con 0x7f7b08153fa0 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0001e470 con 0x7f7b08153fa0 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b00009ae0 con 0x7f7b08153fa0 2023-05-17T15:10:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0001e830 con 0x7f7b08153fa0 2023-05-17T15:10:22.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.462+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0814f510 con 0x7f7b08153fa0 2023-05-17T15:10:22.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.463+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08069d00 con 0x7f7b08153fa0 2023-05-17T15:10:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.463+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7b00025030 con 0x7f7b08153fa0 2023-05-17T15:10:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.464+0000 7f7aff7fe700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7ae805edc0 0x7f7ae8061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.464+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f7b0007b0f0 con 0x7f7b08153fa0 2023-05-17T15:10:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.464+0000 7f7b077fe700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7ae805edc0 0x7f7ae8061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.464+0000 7f7b077fe700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7ae805edc0 0x7f7ae8061280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7af0009d20 tx=0x7f7af0009060).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.468+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b0004c6e0 con 0x7f7b08153fa0 2023-05-17T15:10:22.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:22.682+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b08063970 con 0x7f7b08153fa0 2023-05-17T15:10:23.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.678+0000 7f7aff7fe700 1 -- 172.21.15.27:0/3004791786 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b00023070 con 0x7f7b08153fa0 2023-05-17T15:10:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7ae805edc0 msgr2=0x7f7ae8061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7ae805edc0 0x7f7ae8061280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7af0009d20 tx=0x7f7af0009060).stop 2023-05-17T15:10:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 msgr2=0x7f7b081640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 0x7f7b081640d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f7b0000b610 tx=0x7f7b00009840).stop 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 shutdown_connections 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7ae805edc0 0x7f7ae8061280 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b08153fa0 0x7f7b081640d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08065b30 0x7f7b0814a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 --2- 172.21.15.27:0/3004791786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08068890 0x7f7b08149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 >> 172.21.15.27:0/3004791786 conn(0x7f7b080c9470 msgr2=0x7f7b0814b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 shutdown_connections 2023-05-17T15:10:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.681+0000 7f7b0e1e8700 1 -- 172.21.15.27:0/3004791786 wait complete. 2023-05-17T15:10:23.699 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:10:23.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.822+0000 7f1060fa0700 1 Processor -- start 2023-05-17T15:10:23.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.822+0000 7f1060fa0700 1 -- start start 2023-05-17T15:10:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.823+0000 7f1060fa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 0x7f105c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.823+0000 7f1060fa0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f105c0c60f0 0x7f105c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.823+0000 7f1060fa0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0c0c90 con 0x7f105c0691f0 2023-05-17T15:10:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.823+0000 7f1060fa0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c0c1c50 con 0x7f105c0c60f0 2023-05-17T15:10:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.823+0000 7f1060fa0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c158790 con 0x7f105c1543d0 2023-05-17T15:10:23.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f105c0c60f0 0x7f105c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:23.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f105a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 0x7f105c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:23.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f105a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 0x7f105c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:43504/0 (socket says 172.21.15.27:43504) 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f105c0c60f0 0x7f105c068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:60324/0 (socket says 172.21.15.27:60324) 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f105a59c700 1 -- 172.21.15.27:0/534551173 learned_addr learned my addr 172.21.15.27:0/534551173 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 -- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 msgr2=0x7f105c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 --2- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 0x7f105c0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 -- 172.21.15.27:0/534551173 >> v1:172.21.15.40:6789/0 conn(0x7f105c0691f0 legacy=0x7f105c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 -- 172.21.15.27:0/534551173 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0c6570 con 0x7f105c0c60f0 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f105a59c700 1 --2- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 0x7f105c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.824+0000 7f1059d9b700 1 --2- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c0c60f0 0x7f105c068d00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f1044009760 tx=0x7f1044009060).ready entity=mon.1 client_cookie=64c4ccc1d5abe40a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f105959a700 1 -- 172.21.15.27:0/534551173 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104400f510 con 0x7f105c0c60f0 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f105959a700 1 -- 172.21.15.27:0/534551173 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104400f670 con 0x7f105c0c60f0 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f105959a700 1 -- 172.21.15.27:0/534551173 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104400f9f0 con 0x7f105c0c60f0 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 -- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c0c60f0 msgr2=0x7f105c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 --2- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c0c60f0 0x7f105c068d00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f1044009760 tx=0x7f1044009060).stop 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 -- 172.21.15.27:0/534551173 shutdown_connections 2023-05-17T15:10:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 --2- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c1543d0 0x7f105c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 --2- 172.21.15.27:0/534551173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c0c60f0 0x7f105c068d00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 -- 172.21.15.27:0/534551173 >> 172.21.15.27:0/534551173 conn(0x7f105c0cb7f0 msgr2=0x7f105c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 -- 172.21.15.27:0/534551173 shutdown_connections 2023-05-17T15:10:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.825+0000 7f1060fa0700 1 -- 172.21.15.27:0/534551173 wait complete. 2023-05-17T15:10:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.826+0000 7f1060fa0700 1 Processor -- start 2023-05-17T15:10:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.826+0000 7f1060fa0700 1 -- start start 2023-05-17T15:10:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1060fa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c0691f0 0x7f105c168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1060fa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 0x7f105c0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1060fa0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c1543d0 0x7f105c1646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:23.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1060fa0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1681a0 con 0x7f105c0c60f0 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1060fa0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c168b20 con 0x7f105c1543d0 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1060fa0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c165130 con 0x7f105c0691f0 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 0x7f105c0c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 0x7f105c0c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42400/0 (socket says 172.21.15.27:42400) 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 -- 172.21.15.27:0/1178523187 learned_addr learned my addr 172.21.15.27:0/1178523187 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f105a59c700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c0691f0 0x7f105c168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f105ad9d700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c1543d0 0x7f105c1646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 -- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c0691f0 msgr2=0x7f105c168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c0691f0 0x7f105c168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 -- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c1543d0 msgr2=0x7f105c1646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c1543d0 0x7f105c1646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.827+0000 7f1059d9b700 1 -- 172.21.15.27:0/1178523187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009370 con 0x7f105c0c60f0 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.828+0000 7f1059d9b700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 0x7f105c0c3910 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f105c083d00 tx=0x7f1044017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.828+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044011760 con 0x7f105c0c60f0 2023-05-17T15:10:23.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.828+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10440118e0 con 0x7f105c0c60f0 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.828+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044011ca0 con 0x7f105c0c60f0 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.828+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10440092a0 con 0x7f105c0c60f0 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.828+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c167e30 con 0x7f105c0c60f0 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.829+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c06bdf0 con 0x7f105c0c60f0 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.829+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f104400f070 con 0x7f105c0c60f0 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.829+0000 7f10527fc700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f103c05ed90 0x7f103c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:23.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.829+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f104407adb0 con 0x7f105c0c60f0 2023-05-17T15:10:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.829+0000 7f105a59c700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f103c05ed90 0x7f103c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.830+0000 7f105a59c700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f103c05ed90 0x7f103c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1054009340 tx=0x7f1054008040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:23.834+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f104404c2f0 con 0x7f105c0c60f0 2023-05-17T15:10:24.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.051+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f105c157e60 con 0x7f105c0c60f0 2023-05-17T15:10:24.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.684+0000 7f10527fc700 1 -- 172.21.15.27:0/1178523187 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1044027070 con 0x7f105c0c60f0 2023-05-17T15:10:24.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f103c05ed90 msgr2=0x7f103c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:24.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f103c05ed90 0x7f103c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1054009340 tx=0x7f1054008040).stop 2023-05-17T15:10:24.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 msgr2=0x7f105c0c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:24.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 0x7f105c0c3910 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f105c083d00 tx=0x7f1044017000).stop 2023-05-17T15:10:24.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 shutdown_connections 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f103c05ed90 0x7f103c061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f105c1543d0 0x7f105c1646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105c0691f0 0x7f105c168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 --2- 172.21.15.27:0/1178523187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f105c0c60f0 0x7f105c0c3910 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 >> 172.21.15.27:0/1178523187 conn(0x7f105c0cb7f0 msgr2=0x7f105c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 shutdown_connections 2023-05-17T15:10:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.687+0000 7f1060fa0700 1 -- 172.21.15.27:0/1178523187 wait complete. 2023-05-17T15:10:24.706 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.825+0000 7f74ab6ca700 1 Processor -- start 2023-05-17T15:10:24.829 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.826+0000 7f74ab6ca700 1 -- start start 2023-05-17T15:10:24.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.826+0000 7f74ab6ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74a414dec0 0x7f74a4151510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:24.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.826+0000 7f74ab6ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c3b40 0x7f74a40bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:24.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.826+0000 7f74ab6ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a4154d60 con 0x7f74a414e2a0 2023-05-17T15:10:24.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.826+0000 7f74ab6ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40c2f80 con 0x7f74a414dec0 2023-05-17T15:10:24.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.826+0000 7f74ab6ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4066ac0 con 0x7f74a40c3b40 2023-05-17T15:10:24.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74a414dec0 0x7f74a4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:24.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74a414dec0 0x7f74a4151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:60336/0 (socket says 172.21.15.27:60336) 2023-05-17T15:10:24.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 -- 172.21.15.27:0/1667047318 learned_addr learned my addr 172.21.15.27:0/1667047318 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:24.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9c67700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c3b40 0x7f74a40bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 -- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c3b40 msgr2=0x7f74a40bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c3b40 0x7f74a40bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 -- 172.21.15.27:0/1667047318 >> v1:172.21.15.40:6789/0 conn(0x7f74a414e2a0 legacy=0x7f74a40bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 -- 172.21.15.27:0/1667047318 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4151a00 con 0x7f74a414dec0 2023-05-17T15:10:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9c67700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c3b40 0x7f74a40bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.827+0000 7f74a9466700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a414dec0 0x7f74a4151510 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f749c009810 tx=0x7f749c009060).ready entity=mon.1 client_cookie=9a7a74f6d1429e66 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:24.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74a3fff700 1 -- 172.21.15.27:0/1667047318 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c005880 con 0x7f74a414dec0 2023-05-17T15:10:24.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74a3fff700 1 -- 172.21.15.27:0/1667047318 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c0059e0 con 0x7f74a414dec0 2023-05-17T15:10:24.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74a3fff700 1 -- 172.21.15.27:0/1667047318 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c005d60 con 0x7f74a414dec0 2023-05-17T15:10:24.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a414dec0 msgr2=0x7f74a4151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:24.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a414dec0 0x7f74a4151510 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f749c009810 tx=0x7f749c009060).stop 2023-05-17T15:10:24.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1667047318 shutdown_connections 2023-05-17T15:10:24.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c3b40 0x7f74a40bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1667047318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a414dec0 0x7f74a4151510 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1667047318 >> 172.21.15.27:0/1667047318 conn(0x7f74a405dd50 msgr2=0x7f74a405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:24.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1667047318 shutdown_connections 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.828+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1667047318 wait complete. 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.829+0000 7f74ab6ca700 1 Processor -- start 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 -- start start 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a40c3b40 0x7f74a40c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 0x7f74a413f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a414e2a0 0x7f74a4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:24.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c0040 con 0x7f74a414dec0 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a414ca80 con 0x7f74a40c3b40 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.830+0000 7f74ab6ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40bf430 con 0x7f74a414e2a0 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 0x7f74a413f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 0x7f74a413f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42412/0 (socket says 172.21.15.27:42412) 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 -- 172.21.15.27:0/1165050177 learned_addr learned my addr 172.21.15.27:0/1165050177 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a9c67700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a414e2a0 0x7f74a4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:24.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a9466700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a40c3b40 0x7f74a40c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:24.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 -- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a414e2a0 msgr2=0x7f74a4153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:24.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a414e2a0 0x7f74a4153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 -- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a40c3b40 msgr2=0x7f74a40c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:24.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a40c3b40 0x7f74a40c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:24.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 -- 172.21.15.27:0/1165050177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009a20 con 0x7f74a414dec0 2023-05-17T15:10:24.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a8c65700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 0x7f74a413f230 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f749800c440 tx=0x7f7498007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:24.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800ce40 con 0x7f74a414dec0 2023-05-17T15:10:24.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498007020 con 0x7f74a414dec0 2023-05-17T15:10:24.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c009300 con 0x7f74a414dec0 2023-05-17T15:10:24.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980073c0 con 0x7f74a414dec0 2023-05-17T15:10:24.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.831+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40bf9f0 con 0x7f74a414dec0 2023-05-17T15:10:24.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.832+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a40c01b0 con 0x7f74a414dec0 2023-05-17T15:10:24.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.833+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7498010070 con 0x7f74a414dec0 2023-05-17T15:10:24.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.833+0000 7f74a17fa700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f749005ed90 0x7f7490061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:24.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.833+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f74980793d0 con 0x7f74a414dec0 2023-05-17T15:10:24.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.833+0000 7f74a9466700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f749005ed90 0x7f7490061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:24.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.834+0000 7f74a9466700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f749005ed90 0x7f7490061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f749c00b340 tx=0x7f749c016000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:24.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:24.837+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f749804a910 con 0x7f74a414dec0 2023-05-17T15:10:25.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.053+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74a406bdf0 con 0x7f74a414dec0 2023-05-17T15:10:25.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.054+0000 7f74a17fa700 1 -- 172.21.15.27:0/1165050177 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f749804df30 con 0x7f74a414dec0 2023-05-17T15:10:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:25.058 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:21.665012+0000","modified":"2023-05-17T15:10:24.678553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2675320429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2675320429},{"type":"v1","addr":"172.21.15.40:6834","nonce":2675320429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-17T15:10:25.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f749005ed90 msgr2=0x7f7490061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f749005ed90 0x7f7490061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f749c00b340 tx=0x7f749c016000).stop 2023-05-17T15:10:25.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 msgr2=0x7f74a413f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 0x7f74a413f230 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f749800c440 tx=0x7f7498007dd0).stop 2023-05-17T15:10:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 shutdown_connections 2023-05-17T15:10:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f749005ed90 0x7f7490061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a414e2a0 0x7f74a4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a40c3b40 0x7f74a40c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 --2- 172.21.15.27:0/1165050177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f74a414dec0 0x7f74a413f230 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 >> 172.21.15.27:0/1165050177 conn(0x7f74a405dd50 msgr2=0x7f74a4069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 shutdown_connections 2023-05-17T15:10:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.056+0000 7f74ab6ca700 1 -- 172.21.15.27:0/1165050177 wait complete. 2023-05-17T15:10:25.062 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 52 2023-05-17T15:10:25.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:25.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.184+0000 7f916e8a5700 1 Processor -- start 2023-05-17T15:10:25.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.184+0000 7f916e8a5700 1 -- start start 2023-05-17T15:10:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916e8a5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9168067cb0 0x7f9168068140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916e8a5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9168157be0 con 0x7f9168153e20 2023-05-17T15:10:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916e8a5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91680bd1d0 con 0x7f9168063340 2023-05-17T15:10:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916e8a5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91680c2290 con 0x7f9168067cb0 2023-05-17T15:10:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916d8a3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9168153e20 0x7f9168154200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41980/0 (socket says 172.21.15.27:41980) 2023-05-17T15:10:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916d8a3700 1 -- 172.21.15.27:0/1354469808 learned_addr learned my addr 172.21.15.27:0/1354469808 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916e0a4700 1 --2- 172.21.15.27:0/1354469808 >> v2:172.21.15.40:3300/0 conn(0x7f9168067cb0 0x7f9168068140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349837269 0 0) 0x7f9168157be0 con 0x7f9168153e20 2023-05-17T15:10:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.185+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91540033f0 con 0x7f9168153e20 2023-05-17T15:10:25.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1238645173 0 0) 0x7f91540033f0 con 0x7f9168153e20 2023-05-17T15:10:25.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 >> v2:172.21.15.40:3300/0 conn(0x7f9168067cb0 msgr2=0x7f9168068140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 --2- 172.21.15.27:0/1354469808 >> v2:172.21.15.40:3300/0 conn(0x7f9168067cb0 0x7f9168068140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 >> v1:172.21.15.40:6789/0 conn(0x7f9168063340 legacy=0x7f91680bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9168068630 con 0x7f9168153e20 2023-05-17T15:10:25.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f91600017f0 con 0x7f9168153e20 2023-05-17T15:10:25.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 >> v1:172.21.15.27:6789/0 conn(0x7f9168153e20 legacy=0x7f9168154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91540038e0 0x7f9154003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9154004690 0x7f9154004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9154005000 0x7f915400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680c2290 con 0x7f91540038e0 2023-05-17T15:10:25.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915400beb0 con 0x7f9154004690 2023-05-17T15:10:25.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915400c070 con 0x7f9154005000 2023-05-17T15:10:25.200 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91540038e0 0x7f9154003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d0a2700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9154004690 0x7f9154004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916e0a4700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9154005000 0x7f915400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 -- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9154005000 msgr2=0x7f915400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9154005000 0x7f915400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 -- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9154004690 msgr2=0x7f9154004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9154004690 0x7f9154004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 -- 172.21.15.27:0/1354469808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540033f0 con 0x7f91540038e0 2023-05-17T15:10:25.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916e0a4700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9154005000 0x7f915400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:25.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d0a2700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9154004690 0x7f9154004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:25.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916e0a4700 1 -- 172.21.15.27:0/1354469808 reap_dead start 2023-05-17T15:10:25.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916d8a3700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91540038e0 0x7f9154003d00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f916000c480 tx=0x7f916000c790).ready entity=mon.0 client_cookie=9cfb6ab388491ef4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160002030 con 0x7f91540038e0 2023-05-17T15:10:25.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000ce20 con 0x7f91540038e0 2023-05-17T15:10:25.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.186+0000 7f916c8a1700 1 -- 172.21.15.27:0/1354469808 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160005d30 con 0x7f91540038e0 2023-05-17T15:10:25.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 -- 172.21.15.27:0/1354469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91540038e0 msgr2=0x7f9154003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91540038e0 0x7f9154003d00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f916000c480 tx=0x7f916000c790).stop 2023-05-17T15:10:25.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 -- 172.21.15.27:0/1354469808 shutdown_connections 2023-05-17T15:10:25.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 --2- 172.21.15.27:0/1354469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91540038e0 0x7f9154003d00 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 -- 172.21.15.27:0/1354469808 >> 172.21.15.27:0/1354469808 conn(0x7f91680675b0 msgr2=0x7f91680c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:25.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 -- 172.21.15.27:0/1354469808 shutdown_connections 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.187+0000 7f916e8a5700 1 -- 172.21.15.27:0/1354469808 wait complete. 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.188+0000 7f916e8a5700 1 Processor -- start 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.188+0000 7f916e8a5700 1 -- start start 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91540038e0 0x7f916813d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 0x7f91680aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91680acb10 0x7f91680acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680bfaf0 con 0x7f91680aa6d0 2023-05-17T15:10:25.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680ab040 con 0x7f91540038e0 2023-05-17T15:10:25.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91680bef20 con 0x7f91680acb10 2023-05-17T15:10:25.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 0x7f91680aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 0x7f91680aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42432/0 (socket says 172.21.15.27:42432) 2023-05-17T15:10:25.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 -- 172.21.15.27:0/833325744 learned_addr learned my addr 172.21.15.27:0/833325744 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d8a3700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91540038e0 0x7f916813d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e0a4700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91680acb10 0x7f91680acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 -- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91680acb10 msgr2=0x7f91680acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91680acb10 0x7f91680acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 -- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91540038e0 msgr2=0x7f916813d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91540038e0 0x7f916813d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 -- 172.21.15.27:0/833325744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680bf1c0 con 0x7f91680aa6d0 2023-05-17T15:10:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916d0a2700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 0x7f91680aab50 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f915800e560 tx=0x7f9158009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158010450 con 0x7f91680aa6d0 2023-05-17T15:10:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91580105b0 con 0x7f91680aa6d0 2023-05-17T15:10:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91680bf4a0 con 0x7f91680aa6d0 2023-05-17T15:10:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.189+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158010930 con 0x7f91680aa6d0 2023-05-17T15:10:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.190+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91680ad480 con 0x7f91680aa6d0 2023-05-17T15:10:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.190+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9168065560 con 0x7f91680aa6d0 2023-05-17T15:10:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.191+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9158010ce0 con 0x7f91680aa6d0 2023-05-17T15:10:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.191+0000 7f915dffb700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f914c05edc0 0x7f914c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.191+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f9158079c30 con 0x7f91680aa6d0 2023-05-17T15:10:25.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.191+0000 7f916d8a3700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f914c05edc0 0x7f914c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.192+0000 7f916d8a3700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f914c05edc0 0x7f914c061280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f916000c7d0 tx=0x7f9160015000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.195+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f915804b110 con 0x7f91680aa6d0 2023-05-17T15:10:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.369+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f916806bdf0 con 0x7f91680aa6d0 2023-05-17T15:10:25.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.370+0000 7f915dffb700 1 -- 172.21.15.27:0/833325744 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17102 (secure 0 0 0) 0x7f915804e730 con 0x7f91680aa6d0 2023-05-17T15:10:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:25.375 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":126,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:22.666771+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:19.299248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:20.644965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:25.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f914c05edc0 msgr2=0x7f914c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f914c05edc0 0x7f914c061280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f916000c7d0 tx=0x7f9160015000).stop 2023-05-17T15:10:25.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 msgr2=0x7f91680aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 0x7f91680aab50 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f915800e560 tx=0x7f9158009040).stop 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 shutdown_connections 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f914c05edc0 0x7f914c061280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91680acb10 0x7f91680acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91540038e0 0x7f916813d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 --2- 172.21.15.27:0/833325744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91680aa6d0 0x7f91680aab50 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 >> 172.21.15.27:0/833325744 conn(0x7f91680675b0 msgr2=0x7f91680c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:25.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 shutdown_connections 2023-05-17T15:10:25.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.372+0000 7f916e8a5700 1 -- 172.21.15.27:0/833325744 wait complete. 2023-05-17T15:10:25.388 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:10:25.389 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:10:25.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.502+0000 7f3558ce9700 1 Processor -- start 2023-05-17T15:10:25.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.502+0000 7f3558ce9700 1 -- start start 2023-05-17T15:10:25.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f3558ce9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35540c5e00 0x7f35540c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f3558ce9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540aad00 con 0x7f3554068d00 2023-05-17T15:10:25.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f3558ce9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540698e0 con 0x7f3554154350 2023-05-17T15:10:25.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f3558ce9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35541547a0 con 0x7f35540c5e00 2023-05-17T15:10:25.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f3551d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3554068d00 0x7f3554153c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42004/0 (socket says 172.21.15.27:42004) 2023-05-17T15:10:25.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f3551d9b700 1 -- 172.21.15.27:0/2170591860 learned_addr learned my addr 172.21.15.27:0/2170591860 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:25.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355259c700 1 --2- 172.21.15.27:0/2170591860 >> v2:172.21.15.40:3300/0 conn(0x7f35540c5e00 0x7f35540c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355159a700 1 -- 172.21.15.27:0/2170591860 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872899835 0 0) 0x7f35540aad00 con 0x7f3554068d00 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355159a700 1 -- 172.21.15.27:0/2170591860 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35400033f0 con 0x7f3554068d00 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355259c700 1 -- 172.21.15.27:0/2170591860 >> v1:172.21.15.40:6789/0 conn(0x7f3554154350 legacy=0x7f35540c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355159a700 1 -- 172.21.15.27:0/2170591860 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548982979 0 0) 0x7f35400033f0 con 0x7f3554068d00 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355259c700 1 -- 172.21.15.27:0/2170591860 >> v1:172.21.15.27:6789/0 conn(0x7f3554068d00 legacy=0x7f3554153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.503+0000 7f355259c700 1 -- 172.21.15.27:0/2170591860 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540bfe70 con 0x7f35540c5e00 2023-05-17T15:10:25.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f355259c700 1 --2- 172.21.15.27:0/2170591860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540c5e00 0x7f35540c61e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f354c009760 tx=0x7f354c009060).ready entity=mon.1 client_cookie=8cd301c4aee86c4b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f355159a700 1 -- 172.21.15.27:0/2170591860 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0017f0 con 0x7f35540c5e00 2023-05-17T15:10:25.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f355159a700 1 -- 172.21.15.27:0/2170591860 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0090d0 con 0x7f35540c5e00 2023-05-17T15:10:25.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f355159a700 1 -- 172.21.15.27:0/2170591860 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c012620 con 0x7f35540c5e00 2023-05-17T15:10:25.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 -- 172.21.15.27:0/2170591860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540c5e00 msgr2=0x7f35540c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 --2- 172.21.15.27:0/2170591860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540c5e00 0x7f35540c61e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f354c009760 tx=0x7f354c009060).stop 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 -- 172.21.15.27:0/2170591860 shutdown_connections 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 --2- 172.21.15.27:0/2170591860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540c5e00 0x7f35540c61e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 -- 172.21.15.27:0/2170591860 >> 172.21.15.27:0/2170591860 conn(0x7f35540cb7a0 msgr2=0x7f35540c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 -- 172.21.15.27:0/2170591860 shutdown_connections 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.504+0000 7f3558ce9700 1 -- 172.21.15.27:0/2170591860 wait complete. 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.505+0000 7f3558ce9700 1 Processor -- start 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.505+0000 7f3558ce9700 1 -- start start 2023-05-17T15:10:25.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3558ce9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3554068d00 0x7f3554168770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3558ce9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 0x7f3554152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3558ce9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3554154350 0x7f3554167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3558ce9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35541532d0 con 0x7f35540c5e00 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3558ce9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540ade50 con 0x7f3554154350 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3558ce9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540ae130 con 0x7f3554068d00 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3551d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 0x7f3554152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3551d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 0x7f3554152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42446/0 (socket says 172.21.15.27:42446) 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3551d9b700 1 -- 172.21.15.27:0/944848146 learned_addr learned my addr 172.21.15.27:0/944848146 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.506+0000 7f3552d9d700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3554154350 0x7f3554167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3551d9b700 1 -- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3554068d00 msgr2=0x7f3554168770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f355259c700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3554068d00 0x7f3554168770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3551d9b700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3554068d00 0x7f3554168770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3551d9b700 1 -- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3554154350 msgr2=0x7f3554167d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3551d9b700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3554154350 0x7f3554167d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3551d9b700 1 -- 172.21.15.27:0/944848146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0092a0 con 0x7f35540c5e00 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3552d9d700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3554154350 0x7f3554167d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f355259c700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3554068d00 0x7f3554168770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3551d9b700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 0x7f3554152af0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f353c00cb60 tx=0x7f353c001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c004c40 con 0x7f35540c5e00 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c004dc0 con 0x7f35540c5e00 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35540ae410 con 0x7f35540c5e00 2023-05-17T15:10:25.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0073c0 con 0x7f35540c5e00 2023-05-17T15:10:25.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.507+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3554152fe0 con 0x7f35540c5e00 2023-05-17T15:10:25.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.508+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35540ae930 con 0x7f35540c5e00 2023-05-17T15:10:25.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.508+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f353c01b060 con 0x7f35540c5e00 2023-05-17T15:10:25.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.508+0000 7f354a7fc700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f353405ed90 0x7f3534061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.509+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f353c079ae0 con 0x7f35540c5e00 2023-05-17T15:10:25.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.509+0000 7f355259c700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f353405ed90 0x7f3534061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.509+0000 7f355259c700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f353405ed90 0x7f3534061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f354c006f70 tx=0x7f354c015000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.513+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35540ae930 con 0x7f35540c5e00 2023-05-17T15:10:25.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.680+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35540ae930 con 0x7f353405ed90 2023-05-17T15:10:25.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.691+0000 7f354a7fc700 1 -- 172.21.15.27:0/944848146 <== mgr.7389 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357173 (secure 0 0 0) 0x7f35540ae930 con 0x7f353405ed90 2023-05-17T15:10:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:25.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f353405ed90 msgr2=0x7f3534061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f353405ed90 0x7f3534061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f354c006f70 tx=0x7f354c015000).stop 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 msgr2=0x7f3554152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 0x7f3554152af0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f353c00cb60 tx=0x7f353c001e50).stop 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 shutdown_connections 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f353405ed90 0x7f3534061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3554154350 0x7f3554167d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3554068d00 0x7f3554168770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 --2- 172.21.15.27:0/944848146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540c5e00 0x7f3554152af0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 >> 172.21.15.27:0/944848146 conn(0x7f35540cb7a0 msgr2=0x7f355414f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:25.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 shutdown_connections 2023-05-17T15:10:25.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.694+0000 7f3558ce9700 1 -- 172.21.15.27:0/944848146 wait complete. 2023-05-17T15:10:25.702 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:10:25.710 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:10:24.729968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":152728,"kb_used_data":12056,"kb_used_omap":0,"kb_used_meta":140608,"kb_avail":754821992,"statfs":{"total":773094113280,"available":772937719808,"internally_reserved":0,"allocated":12345344,"data_stored":6191401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":143982592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.507476"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689060+0000","last_change":"2023-05-17T15:10:21.683295+0000","last_active":"2023-05-17T15:10:21.689060+0000","last_peered":"2023-05-17T15:10:21.689060+0000","last_clean":"2023-05-17T15:10:21.689060+0000","last_became_active":"2023-05-17T15:10:21.682915+0000","last_became_peered":"2023-05-17T15:10:21.682915+0000","last_unstale":"2023-05-17T15:10:21.689060+0000","last_undegraded":"2023-05-17T15:10:21.689060+0000","last_fullsized":"2023-05-17T15:10:21.689060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697693+0000","last_change":"2023-05-17T15:10:21.299521+0000","last_active":"2023-05-17T15:10:21.697693+0000","last_peered":"2023-05-17T15:10:21.697693+0000","last_clean":"2023-05-17T15:10:21.697693+0000","last_became_active":"2023-05-17T15:10:21.299249+0000","last_became_peered":"2023-05-17T15:10:21.299249+0000","last_unstale":"2023-05-17T15:10:21.697693+0000","last_undegraded":"2023-05-17T15:10:21.697693+0000","last_fullsized":"2023-05-17T15:10:21.697693+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681030+0000","last_change":"2023-05-17T15:10:21.292372+0000","last_active":"2023-05-17T15:10:21.681030+0000","last_peered":"2023-05-17T15:10:21.681030+0000","last_clean":"2023-05-17T15:10:21.681030+0000","last_became_active":"2023-05-17T15:10:21.291668+0000","last_became_peered":"2023-05-17T15:10:21.291668+0000","last_unstale":"2023-05-17T15:10:21.681030+0000","last_undegraded":"2023-05-17T15:10:21.681030+0000","last_fullsized":"2023-05-17T15:10:21.681030+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685863+0000","last_change":"2023-05-17T15:10:21.299601+0000","last_active":"2023-05-17T15:10:21.685863+0000","last_peered":"2023-05-17T15:10:21.685863+0000","last_clean":"2023-05-17T15:10:21.685863+0000","last_became_active":"2023-05-17T15:10:21.299304+0000","last_became_peered":"2023-05-17T15:10:21.299304+0000","last_unstale":"2023-05-17T15:10:21.685863+0000","last_undegraded":"2023-05-17T15:10:21.685863+0000","last_fullsized":"2023-05-17T15:10:21.685863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689518+0000","last_change":"2023-05-17T15:10:21.682112+0000","last_active":"2023-05-17T15:10:21.689518+0000","last_peered":"2023-05-17T15:10:21.689518+0000","last_clean":"2023-05-17T15:10:21.689518+0000","last_became_active":"2023-05-17T15:10:21.681845+0000","last_became_peered":"2023-05-17T15:10:21.681845+0000","last_unstale":"2023-05-17T15:10:21.689518+0000","last_undegraded":"2023-05-17T15:10:21.689518+0000","last_fullsized":"2023-05-17T15:10:21.689518+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693301+0000","last_change":"2023-05-17T15:10:21.292923+0000","last_active":"2023-05-17T15:10:21.693301+0000","last_peered":"2023-05-17T15:10:21.693301+0000","last_clean":"2023-05-17T15:10:21.693301+0000","last_became_active":"2023-05-17T15:10:21.292654+0000","last_became_peered":"2023-05-17T15:10:21.292654+0000","last_unstale":"2023-05-17T15:10:21.693301+0000","last_undegraded":"2023-05-17T15:10:21.693301+0000","last_fullsized":"2023-05-17T15:10:21.693301+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696983+0000","last_change":"2023-05-17T15:10:21.688215+0000","last_active":"2023-05-17T15:10:21.696983+0000","last_peered":"2023-05-17T15:10:21.696983+0000","last_clean":"2023-05-17T15:10:21.696983+0000","last_became_active":"2023-05-17T15:10:21.687921+0000","last_became_peered":"2023-05-17T15:10:21.687921+0000","last_unstale":"2023-05-17T15:10:21.696983+0000","last_undegraded":"2023-05-17T15:10:21.696983+0000","last_fullsized":"2023-05-17T15:10:21.696983+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681289+0000","last_change":"2023-05-17T15:10:21.294570+0000","last_active":"2023-05-17T15:10:21.681289+0000","last_peered":"2023-05-17T15:10:21.681289+0000","last_clean":"2023-05-17T15:10:21.681289+0000","last_became_active":"2023-05-17T15:10:21.293467+0000","last_became_peered":"2023-05-17T15:10:21.293467+0000","last_unstale":"2023-05-17T15:10:21.681289+0000","last_undegraded":"2023-05-17T15:10:21.681289+0000","last_fullsized":"2023-05-17T15:10:21.681289+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688641+0000","last_change":"2023-05-17T15:10:21.682283+0000","last_active":"2023-05-17T15:10:21.688641+0000","last_peered":"2023-05-17T15:10:21.688641+0000","last_clean":"2023-05-17T15:10:21.688641+0000","last_became_active":"2023-05-17T15:10:21.682017+0000","last_became_peered":"2023-05-17T15:10:21.682017+0000","last_unstale":"2023-05-17T15:10:21.688641+0000","last_undegraded":"2023-05-17T15:10:21.688641+0000","last_fullsized":"2023-05-17T15:10:21.688641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699575+0000","last_change":"2023-05-17T15:10:21.698224+0000","last_active":"2023-05-17T15:10:21.699575+0000","last_peered":"2023-05-17T15:10:21.699575+0000","last_clean":"2023-05-17T15:10:21.699575+0000","last_became_active":"2023-05-17T15:10:21.697946+0000","last_became_peered":"2023-05-17T15:10:21.697946+0000","last_unstale":"2023-05-17T15:10:21.699575+0000","last_undegraded":"2023-05-17T15:10:21.699575+0000","last_fullsized":"2023-05-17T15:10:21.699575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692164+0000","last_change":"2023-05-17T15:10:21.689824+0000","last_active":"2023-05-17T15:10:21.692164+0000","last_peered":"2023-05-17T15:10:21.692164+0000","last_clean":"2023-05-17T15:10:21.692164+0000","last_became_active":"2023-05-17T15:10:21.689431+0000","last_became_peered":"2023-05-17T15:10:21.689431+0000","last_unstale":"2023-05-17T15:10:21.692164+0000","last_undegraded":"2023-05-17T15:10:21.692164+0000","last_fullsized":"2023-05-17T15:10:21.692164+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694262+0000","last_change":"2023-05-17T15:10:21.689351+0000","last_active":"2023-05-17T15:10:21.694262+0000","last_peered":"2023-05-17T15:10:21.694262+0000","last_clean":"2023-05-17T15:10:21.694262+0000","last_became_active":"2023-05-17T15:10:21.689089+0000","last_became_peered":"2023-05-17T15:10:21.689089+0000","last_unstale":"2023-05-17T15:10:21.694262+0000","last_undegraded":"2023-05-17T15:10:21.694262+0000","last_fullsized":"2023-05-17T15:10:21.694262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692633+0000","last_change":"2023-05-17T15:10:21.298019+0000","last_active":"2023-05-17T15:10:21.692633+0000","last_peered":"2023-05-17T15:10:21.692633+0000","last_clean":"2023-05-17T15:10:21.692633+0000","last_became_active":"2023-05-17T15:10:21.294051+0000","last_became_peered":"2023-05-17T15:10:21.294051+0000","last_unstale":"2023-05-17T15:10:21.692633+0000","last_undegraded":"2023-05-17T15:10:21.692633+0000","last_fullsized":"2023-05-17T15:10:21.692633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.695998+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.695779+0000","last_became_peered":"2023-05-17T15:10:21.695779+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670675+0000","last_change":"2023-05-17T15:10:21.298810+0000","last_active":"2023-05-17T15:10:21.670675+0000","last_peered":"2023-05-17T15:10:21.670675+0000","last_clean":"2023-05-17T15:10:21.670675+0000","last_became_active":"2023-05-17T15:10:21.298535+0000","last_became_peered":"2023-05-17T15:10:21.298535+0000","last_unstale":"2023-05-17T15:10:21.670675+0000","last_undegraded":"2023-05-17T15:10:21.670675+0000","last_fullsized":"2023-05-17T15:10:21.670675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675380+0000","last_change":"2023-05-17T15:10:21.291603+0000","last_active":"2023-05-17T15:10:21.675380+0000","last_peered":"2023-05-17T15:10:21.675380+0000","last_clean":"2023-05-17T15:10:21.675380+0000","last_became_active":"2023-05-17T15:10:21.289948+0000","last_became_peered":"2023-05-17T15:10:21.289948+0000","last_unstale":"2023-05-17T15:10:21.675380+0000","last_undegraded":"2023-05-17T15:10:21.675380+0000","last_fullsized":"2023-05-17T15:10:21.675380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699525+0000","last_change":"2023-05-17T15:10:21.697668+0000","last_active":"2023-05-17T15:10:21.699525+0000","last_peered":"2023-05-17T15:10:21.699525+0000","last_clean":"2023-05-17T15:10:21.699525+0000","last_became_active":"2023-05-17T15:10:21.697419+0000","last_became_peered":"2023-05-17T15:10:21.697419+0000","last_unstale":"2023-05-17T15:10:21.699525+0000","last_undegraded":"2023-05-17T15:10:21.699525+0000","last_fullsized":"2023-05-17T15:10:21.699525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681170+0000","last_change":"2023-05-17T15:10:21.288238+0000","last_active":"2023-05-17T15:10:21.681170+0000","last_peered":"2023-05-17T15:10:21.681170+0000","last_clean":"2023-05-17T15:10:21.681170+0000","last_became_active":"2023-05-17T15:10:21.287952+0000","last_became_peered":"2023-05-17T15:10:21.287952+0000","last_unstale":"2023-05-17T15:10:21.681170+0000","last_undegraded":"2023-05-17T15:10:21.681170+0000","last_fullsized":"2023-05-17T15:10:21.681170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.676011+0000","last_change":"2023-05-17T15:10:21.293333+0000","last_active":"2023-05-17T15:10:21.676011+0000","last_peered":"2023-05-17T15:10:21.676011+0000","last_clean":"2023-05-17T15:10:21.676011+0000","last_became_active":"2023-05-17T15:10:21.291969+0000","last_became_peered":"2023-05-17T15:10:21.291969+0000","last_unstale":"2023-05-17T15:10:21.676011+0000","last_undegraded":"2023-05-17T15:10:21.676011+0000","last_fullsized":"2023-05-17T15:10:21.676011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693914+0000","last_change":"2023-05-17T15:10:21.290304+0000","last_active":"2023-05-17T15:10:21.693914+0000","last_peered":"2023-05-17T15:10:21.693914+0000","last_clean":"2023-05-17T15:10:21.693914+0000","last_became_active":"2023-05-17T15:10:21.290023+0000","last_became_peered":"2023-05-17T15:10:21.290023+0000","last_unstale":"2023-05-17T15:10:21.693914+0000","last_undegraded":"2023-05-17T15:10:21.693914+0000","last_fullsized":"2023-05-17T15:10:21.693914+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693819+0000","last_change":"2023-05-17T15:10:21.687930+0000","last_active":"2023-05-17T15:10:21.693819+0000","last_peered":"2023-05-17T15:10:21.693819+0000","last_clean":"2023-05-17T15:10:21.693819+0000","last_became_active":"2023-05-17T15:10:21.687700+0000","last_became_peered":"2023-05-17T15:10:21.687700+0000","last_unstale":"2023-05-17T15:10:21.693819+0000","last_undegraded":"2023-05-17T15:10:21.693819+0000","last_fullsized":"2023-05-17T15:10:21.693819+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697136+0000","last_change":"2023-05-17T15:10:21.298512+0000","last_active":"2023-05-17T15:10:21.697136+0000","last_peered":"2023-05-17T15:10:21.697136+0000","last_clean":"2023-05-17T15:10:21.697136+0000","last_became_active":"2023-05-17T15:10:21.298105+0000","last_became_peered":"2023-05-17T15:10:21.298105+0000","last_unstale":"2023-05-17T15:10:21.697136+0000","last_undegraded":"2023-05-17T15:10:21.697136+0000","last_fullsized":"2023-05-17T15:10:21.697136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698112+0000","last_change":"2023-05-17T15:10:21.695099+0000","last_active":"2023-05-17T15:10:21.698112+0000","last_peered":"2023-05-17T15:10:21.698112+0000","last_clean":"2023-05-17T15:10:21.698112+0000","last_became_active":"2023-05-17T15:10:21.694788+0000","last_became_peered":"2023-05-17T15:10:21.694788+0000","last_unstale":"2023-05-17T15:10:21.698112+0000","last_undegraded":"2023-05-17T15:10:21.698112+0000","last_fullsized":"2023-05-17T15:10:21.698112+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679296+0000","last_change":"2023-05-17T15:10:21.297458+0000","last_active":"2023-05-17T15:10:21.679296+0000","last_peered":"2023-05-17T15:10:21.679296+0000","last_clean":"2023-05-17T15:10:21.679296+0000","last_became_active":"2023-05-17T15:10:21.297156+0000","last_became_peered":"2023-05-17T15:10:21.297156+0000","last_unstale":"2023-05-17T15:10:21.679296+0000","last_undegraded":"2023-05-17T15:10:21.679296+0000","last_fullsized":"2023-05-17T15:10:21.679296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690230+0000","last_change":"2023-05-17T15:10:21.686606+0000","last_active":"2023-05-17T15:10:21.690230+0000","last_peered":"2023-05-17T15:10:21.690230+0000","last_clean":"2023-05-17T15:10:21.690230+0000","last_became_active":"2023-05-17T15:10:21.686335+0000","last_became_peered":"2023-05-17T15:10:21.686335+0000","last_unstale":"2023-05-17T15:10:21.690230+0000","last_undegraded":"2023-05-17T15:10:21.690230+0000","last_fullsized":"2023-05-17T15:10:21.690230+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679535+0000","last_change":"2023-05-17T15:10:21.288322+0000","last_active":"2023-05-17T15:10:21.679535+0000","last_peered":"2023-05-17T15:10:21.679535+0000","last_clean":"2023-05-17T15:10:21.679535+0000","last_became_active":"2023-05-17T15:10:21.288046+0000","last_became_peered":"2023-05-17T15:10:21.288046+0000","last_unstale":"2023-05-17T15:10:21.679535+0000","last_undegraded":"2023-05-17T15:10:21.679535+0000","last_fullsized":"2023-05-17T15:10:21.679535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686781+0000","last_change":"2023-05-17T15:10:21.678612+0000","last_active":"2023-05-17T15:10:21.686781+0000","last_peered":"2023-05-17T15:10:21.686781+0000","last_clean":"2023-05-17T15:10:21.686781+0000","last_became_active":"2023-05-17T15:10:21.678335+0000","last_became_peered":"2023-05-17T15:10:21.678335+0000","last_unstale":"2023-05-17T15:10:21.686781+0000","last_undegraded":"2023-05-17T15:10:21.686781+0000","last_fullsized":"2023-05-17T15:10:21.686781+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681138+0000","last_change":"2023-05-17T15:10:21.297023+0000","last_active":"2023-05-17T15:10:21.681138+0000","last_peered":"2023-05-17T15:10:21.681138+0000","last_clean":"2023-05-17T15:10:21.681138+0000","last_became_active":"2023-05-17T15:10:21.296741+0000","last_became_peered":"2023-05-17T15:10:21.296741+0000","last_unstale":"2023-05-17T15:10:21.681138+0000","last_undegraded":"2023-05-17T15:10:21.681138+0000","last_fullsized":"2023-05-17T15:10:21.681138+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692213+0000","last_change":"2023-05-17T15:10:21.689525+0000","last_active":"2023-05-17T15:10:21.692213+0000","last_peered":"2023-05-17T15:10:21.692213+0000","last_clean":"2023-05-17T15:10:21.692213+0000","last_became_active":"2023-05-17T15:10:21.688968+0000","last_became_peered":"2023-05-17T15:10:21.688968+0000","last_unstale":"2023-05-17T15:10:21.692213+0000","last_undegraded":"2023-05-17T15:10:21.692213+0000","last_fullsized":"2023-05-17T15:10:21.692213+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693855+0000","last_change":"2023-05-17T15:10:21.686284+0000","last_active":"2023-05-17T15:10:21.693855+0000","last_peered":"2023-05-17T15:10:21.693855+0000","last_clean":"2023-05-17T15:10:21.693855+0000","last_became_active":"2023-05-17T15:10:21.684239+0000","last_became_peered":"2023-05-17T15:10:21.684239+0000","last_unstale":"2023-05-17T15:10:21.693855+0000","last_undegraded":"2023-05-17T15:10:21.693855+0000","last_fullsized":"2023-05-17T15:10:21.693855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679410+0000","last_change":"2023-05-17T15:10:21.297089+0000","last_active":"2023-05-17T15:10:21.679410+0000","last_peered":"2023-05-17T15:10:21.679410+0000","last_clean":"2023-05-17T15:10:21.679410+0000","last_became_active":"2023-05-17T15:10:21.296773+0000","last_became_peered":"2023-05-17T15:10:21.296773+0000","last_unstale":"2023-05-17T15:10:21.679410+0000","last_undegraded":"2023-05-17T15:10:21.679410+0000","last_fullsized":"2023-05-17T15:10:21.679410+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699232+0000","last_change":"2023-05-17T15:10:21.697475+0000","last_active":"2023-05-17T15:10:21.699232+0000","last_peered":"2023-05-17T15:10:21.699232+0000","last_clean":"2023-05-17T15:10:21.699232+0000","last_became_active":"2023-05-17T15:10:21.697193+0000","last_became_peered":"2023-05-17T15:10:21.697193+0000","last_unstale":"2023-05-17T15:10:21.699232+0000","last_undegraded":"2023-05-17T15:10:21.699232+0000","last_fullsized":"2023-05-17T15:10:21.699232+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671010+0000","last_change":"2023-05-17T15:10:21.296684+0000","last_active":"2023-05-17T15:10:21.671010+0000","last_peered":"2023-05-17T15:10:21.671010+0000","last_clean":"2023-05-17T15:10:21.671010+0000","last_became_active":"2023-05-17T15:10:21.290716+0000","last_became_peered":"2023-05-17T15:10:21.290716+0000","last_unstale":"2023-05-17T15:10:21.671010+0000","last_undegraded":"2023-05-17T15:10:21.671010+0000","last_fullsized":"2023-05-17T15:10:21.671010+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675476+0000","last_change":"2023-05-17T15:10:21.285520+0000","last_active":"2023-05-17T15:10:21.675476+0000","last_peered":"2023-05-17T15:10:21.675476+0000","last_clean":"2023-05-17T15:10:21.675476+0000","last_became_active":"2023-05-17T15:10:21.285201+0000","last_became_peered":"2023-05-17T15:10:21.285201+0000","last_unstale":"2023-05-17T15:10:21.675476+0000","last_undegraded":"2023-05-17T15:10:21.675476+0000","last_fullsized":"2023-05-17T15:10:21.675476+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694439+0000","last_change":"2023-05-17T15:10:21.693273+0000","last_active":"2023-05-17T15:10:21.694439+0000","last_peered":"2023-05-17T15:10:21.694439+0000","last_clean":"2023-05-17T15:10:21.694439+0000","last_became_active":"2023-05-17T15:10:21.692975+0000","last_became_peered":"2023-05-17T15:10:21.692975+0000","last_unstale":"2023-05-17T15:10:21.694439+0000","last_undegraded":"2023-05-17T15:10:21.694439+0000","last_fullsized":"2023-05-17T15:10:21.694439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681548+0000","last_change":"2023-05-17T15:10:21.298675+0000","last_active":"2023-05-17T15:10:21.681548+0000","last_peered":"2023-05-17T15:10:21.681548+0000","last_clean":"2023-05-17T15:10:21.681548+0000","last_became_active":"2023-05-17T15:10:21.298404+0000","last_became_peered":"2023-05-17T15:10:21.298404+0000","last_unstale":"2023-05-17T15:10:21.681548+0000","last_undegraded":"2023-05-17T15:10:21.681548+0000","last_fullsized":"2023-05-17T15:10:21.681548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696504+0000","last_change":"2023-05-17T15:10:21.694697+0000","last_active":"2023-05-17T15:10:21.696504+0000","last_peered":"2023-05-17T15:10:21.696504+0000","last_clean":"2023-05-17T15:10:21.696504+0000","last_became_active":"2023-05-17T15:10:21.694445+0000","last_became_peered":"2023-05-17T15:10:21.694445+0000","last_unstale":"2023-05-17T15:10:21.696504+0000","last_undegraded":"2023-05-17T15:10:21.696504+0000","last_fullsized":"2023-05-17T15:10:21.696504+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693885+0000","last_change":"2023-05-17T15:10:21.288608+0000","last_active":"2023-05-17T15:10:21.693885+0000","last_peered":"2023-05-17T15:10:21.693885+0000","last_clean":"2023-05-17T15:10:21.693885+0000","last_became_active":"2023-05-17T15:10:21.288281+0000","last_became_peered":"2023-05-17T15:10:21.288281+0000","last_unstale":"2023-05-17T15:10:21.693885+0000","last_undegraded":"2023-05-17T15:10:21.693885+0000","last_fullsized":"2023-05-17T15:10:21.693885+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688927+0000","last_change":"2023-05-17T15:10:21.683486+0000","last_active":"2023-05-17T15:10:21.688927+0000","last_peered":"2023-05-17T15:10:21.688927+0000","last_clean":"2023-05-17T15:10:21.688927+0000","last_became_active":"2023-05-17T15:10:21.683229+0000","last_became_peered":"2023-05-17T15:10:21.683229+0000","last_unstale":"2023-05-17T15:10:21.688927+0000","last_undegraded":"2023-05-17T15:10:21.688927+0000","last_fullsized":"2023-05-17T15:10:21.688927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693732+0000","last_change":"2023-05-17T15:10:21.295144+0000","last_active":"2023-05-17T15:10:21.693732+0000","last_peered":"2023-05-17T15:10:21.693732+0000","last_clean":"2023-05-17T15:10:21.693732+0000","last_became_active":"2023-05-17T15:10:21.294535+0000","last_became_peered":"2023-05-17T15:10:21.294535+0000","last_unstale":"2023-05-17T15:10:21.693732+0000","last_undegraded":"2023-05-17T15:10:21.693732+0000","last_fullsized":"2023-05-17T15:10:21.693732+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697058+0000","last_change":"2023-05-17T15:10:21.693852+0000","last_active":"2023-05-17T15:10:21.697058+0000","last_peered":"2023-05-17T15:10:21.697058+0000","last_clean":"2023-05-17T15:10:21.697058+0000","last_became_active":"2023-05-17T15:10:21.693190+0000","last_became_peered":"2023-05-17T15:10:21.693190+0000","last_unstale":"2023-05-17T15:10:21.697058+0000","last_undegraded":"2023-05-17T15:10:21.697058+0000","last_fullsized":"2023-05-17T15:10:21.697058+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682018+0000","last_change":"2023-05-17T15:10:21.294898+0000","last_active":"2023-05-17T15:10:21.682018+0000","last_peered":"2023-05-17T15:10:21.682018+0000","last_clean":"2023-05-17T15:10:21.682018+0000","last_became_active":"2023-05-17T15:10:21.294622+0000","last_became_peered":"2023-05-17T15:10:21.294622+0000","last_unstale":"2023-05-17T15:10:21.682018+0000","last_undegraded":"2023-05-17T15:10:21.682018+0000","last_fullsized":"2023-05-17T15:10:21.682018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693870+0000","last_change":"2023-05-17T15:10:21.691292+0000","last_active":"2023-05-17T15:10:21.693870+0000","last_peered":"2023-05-17T15:10:21.693870+0000","last_clean":"2023-05-17T15:10:21.693870+0000","last_became_active":"2023-05-17T15:10:21.691037+0000","last_became_peered":"2023-05-17T15:10:21.691037+0000","last_unstale":"2023-05-17T15:10:21.693870+0000","last_undegraded":"2023-05-17T15:10:21.693870+0000","last_fullsized":"2023-05-17T15:10:21.693870+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696614+0000","last_change":"2023-05-17T15:10:21.694755+0000","last_active":"2023-05-17T15:10:21.696614+0000","last_peered":"2023-05-17T15:10:21.696614+0000","last_clean":"2023-05-17T15:10:21.696614+0000","last_became_active":"2023-05-17T15:10:21.694471+0000","last_became_peered":"2023-05-17T15:10:21.694471+0000","last_unstale":"2023-05-17T15:10:21.696614+0000","last_undegraded":"2023-05-17T15:10:21.696614+0000","last_fullsized":"2023-05-17T15:10:21.696614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673474+0000","last_change":"2023-05-17T15:10:21.293702+0000","last_active":"2023-05-17T15:10:21.673474+0000","last_peered":"2023-05-17T15:10:21.673474+0000","last_clean":"2023-05-17T15:10:21.673474+0000","last_became_active":"2023-05-17T15:10:21.293422+0000","last_became_peered":"2023-05-17T15:10:21.293422+0000","last_unstale":"2023-05-17T15:10:21.673474+0000","last_undegraded":"2023-05-17T15:10:21.673474+0000","last_fullsized":"2023-05-17T15:10:21.673474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693266+0000","last_change":"2023-05-17T15:10:21.682997+0000","last_active":"2023-05-17T15:10:21.693266+0000","last_peered":"2023-05-17T15:10:21.693266+0000","last_clean":"2023-05-17T15:10:21.693266+0000","last_became_active":"2023-05-17T15:10:21.682798+0000","last_became_peered":"2023-05-17T15:10:21.682798+0000","last_unstale":"2023-05-17T15:10:21.693266+0000","last_undegraded":"2023-05-17T15:10:21.693266+0000","last_fullsized":"2023-05-17T15:10:21.693266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675239+0000","last_change":"2023-05-17T15:10:21.292338+0000","last_active":"2023-05-17T15:10:21.675239+0000","last_peered":"2023-05-17T15:10:21.675239+0000","last_clean":"2023-05-17T15:10:21.675239+0000","last_became_active":"2023-05-17T15:10:21.289967+0000","last_became_peered":"2023-05-17T15:10:21.289967+0000","last_unstale":"2023-05-17T15:10:21.675239+0000","last_undegraded":"2023-05-17T15:10:21.675239+0000","last_fullsized":"2023-05-17T15:10:21.675239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696914+0000","last_change":"2023-05-17T15:10:21.696004+0000","last_active":"2023-05-17T15:10:21.696914+0000","last_peered":"2023-05-17T15:10:21.696914+0000","last_clean":"2023-05-17T15:10:21.696914+0000","last_became_active":"2023-05-17T15:10:21.695768+0000","last_became_peered":"2023-05-17T15:10:21.695768+0000","last_unstale":"2023-05-17T15:10:21.696914+0000","last_undegraded":"2023-05-17T15:10:21.696914+0000","last_fullsized":"2023-05-17T15:10:21.696914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690654+0000","last_change":"2023-05-17T15:10:21.689154+0000","last_active":"2023-05-17T15:10:21.690654+0000","last_peered":"2023-05-17T15:10:21.690654+0000","last_clean":"2023-05-17T15:10:21.690654+0000","last_became_active":"2023-05-17T15:10:21.688888+0000","last_became_peered":"2023-05-17T15:10:21.688888+0000","last_unstale":"2023-05-17T15:10:21.690654+0000","last_undegraded":"2023-05-17T15:10:21.690654+0000","last_fullsized":"2023-05-17T15:10:21.690654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681341+0000","last_change":"2023-05-17T15:10:21.292560+0000","last_active":"2023-05-17T15:10:21.681341+0000","last_peered":"2023-05-17T15:10:21.681341+0000","last_clean":"2023-05-17T15:10:21.681341+0000","last_became_active":"2023-05-17T15:10:21.292093+0000","last_became_peered":"2023-05-17T15:10:21.292093+0000","last_unstale":"2023-05-17T15:10:21.681341+0000","last_undegraded":"2023-05-17T15:10:21.681341+0000","last_fullsized":"2023-05-17T15:10:21.681341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694968+0000","last_change":"2023-05-17T15:10:21.693638+0000","last_active":"2023-05-17T15:10:21.694968+0000","last_peered":"2023-05-17T15:10:21.694968+0000","last_clean":"2023-05-17T15:10:21.694968+0000","last_became_active":"2023-05-17T15:10:21.693339+0000","last_became_peered":"2023-05-17T15:10:21.693339+0000","last_unstale":"2023-05-17T15:10:21.694968+0000","last_undegraded":"2023-05-17T15:10:21.694968+0000","last_fullsized":"2023-05-17T15:10:21.694968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692231+0000","last_change":"2023-05-17T15:10:21.690962+0000","last_active":"2023-05-17T15:10:21.692231+0000","last_peered":"2023-05-17T15:10:21.692231+0000","last_clean":"2023-05-17T15:10:21.692231+0000","last_became_active":"2023-05-17T15:10:21.690681+0000","last_became_peered":"2023-05-17T15:10:21.690681+0000","last_unstale":"2023-05-17T15:10:21.692231+0000","last_undegraded":"2023-05-17T15:10:21.692231+0000","last_fullsized":"2023-05-17T15:10:21.692231+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696276+0000","last_change":"2023-05-17T15:10:21.684825+0000","last_active":"2023-05-17T15:10:21.696276+0000","last_peered":"2023-05-17T15:10:21.696276+0000","last_clean":"2023-05-17T15:10:21.696276+0000","last_became_active":"2023-05-17T15:10:21.684525+0000","last_became_peered":"2023-05-17T15:10:21.684525+0000","last_unstale":"2023-05-17T15:10:21.696276+0000","last_undegraded":"2023-05-17T15:10:21.696276+0000","last_fullsized":"2023-05-17T15:10:21.696276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691116+0000","last_change":"2023-05-17T15:10:21.290239+0000","last_active":"2023-05-17T15:10:21.691116+0000","last_peered":"2023-05-17T15:10:21.691116+0000","last_clean":"2023-05-17T15:10:21.691116+0000","last_became_active":"2023-05-17T15:10:21.289965+0000","last_became_peered":"2023-05-17T15:10:21.289965+0000","last_unstale":"2023-05-17T15:10:21.691116+0000","last_undegraded":"2023-05-17T15:10:21.691116+0000","last_fullsized":"2023-05-17T15:10:21.691116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675392+0000","last_change":"2023-05-17T15:10:21.293582+0000","last_active":"2023-05-17T15:10:21.675392+0000","last_peered":"2023-05-17T15:10:21.675392+0000","last_clean":"2023-05-17T15:10:21.675392+0000","last_became_active":"2023-05-17T15:10:21.293290+0000","last_became_peered":"2023-05-17T15:10:21.293290+0000","last_unstale":"2023-05-17T15:10:21.675392+0000","last_undegraded":"2023-05-17T15:10:21.675392+0000","last_fullsized":"2023-05-17T15:10:21.675392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689211+0000","last_change":"2023-05-17T15:10:21.683174+0000","last_active":"2023-05-17T15:10:21.689211+0000","last_peered":"2023-05-17T15:10:21.689211+0000","last_clean":"2023-05-17T15:10:21.689211+0000","last_became_active":"2023-05-17T15:10:21.682594+0000","last_became_peered":"2023-05-17T15:10:21.682594+0000","last_unstale":"2023-05-17T15:10:21.689211+0000","last_undegraded":"2023-05-17T15:10:21.689211+0000","last_fullsized":"2023-05-17T15:10:21.689211+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670511+0000","last_change":"2023-05-17T15:10:21.294708+0000","last_active":"2023-05-17T15:10:21.670511+0000","last_peered":"2023-05-17T15:10:21.670511+0000","last_clean":"2023-05-17T15:10:21.670511+0000","last_became_active":"2023-05-17T15:10:21.294391+0000","last_became_peered":"2023-05-17T15:10:21.294391+0000","last_unstale":"2023-05-17T15:10:21.670511+0000","last_undegraded":"2023-05-17T15:10:21.670511+0000","last_fullsized":"2023-05-17T15:10:21.670511+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699542+0000","last_change":"2023-05-17T15:10:21.697712+0000","last_active":"2023-05-17T15:10:21.699542+0000","last_peered":"2023-05-17T15:10:21.699542+0000","last_clean":"2023-05-17T15:10:21.699542+0000","last_became_active":"2023-05-17T15:10:21.697438+0000","last_became_peered":"2023-05-17T15:10:21.697438+0000","last_unstale":"2023-05-17T15:10:21.699542+0000","last_undegraded":"2023-05-17T15:10:21.699542+0000","last_fullsized":"2023-05-17T15:10:21.699542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690346+0000","last_change":"2023-05-17T15:10:21.687552+0000","last_active":"2023-05-17T15:10:21.690346+0000","last_peered":"2023-05-17T15:10:21.690346+0000","last_clean":"2023-05-17T15:10:21.690346+0000","last_became_active":"2023-05-17T15:10:21.687317+0000","last_became_peered":"2023-05-17T15:10:21.687317+0000","last_unstale":"2023-05-17T15:10:21.690346+0000","last_undegraded":"2023-05-17T15:10:21.690346+0000","last_fullsized":"2023-05-17T15:10:21.690346+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694620+0000","last_change":"2023-05-17T15:10:21.291005+0000","last_active":"2023-05-17T15:10:21.694620+0000","last_peered":"2023-05-17T15:10:21.694620+0000","last_clean":"2023-05-17T15:10:21.694620+0000","last_became_active":"2023-05-17T15:10:21.290732+0000","last_became_peered":"2023-05-17T15:10:21.290732+0000","last_unstale":"2023-05-17T15:10:21.694620+0000","last_undegraded":"2023-05-17T15:10:21.694620+0000","last_fullsized":"2023-05-17T15:10:21.694620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681239+0000","last_change":"2023-05-17T15:10:21.297096+0000","last_active":"2023-05-17T15:10:21.681239+0000","last_peered":"2023-05-17T15:10:21.681239+0000","last_clean":"2023-05-17T15:10:21.681239+0000","last_became_active":"2023-05-17T15:10:21.296805+0000","last_became_peered":"2023-05-17T15:10:21.296805+0000","last_unstale":"2023-05-17T15:10:21.681239+0000","last_undegraded":"2023-05-17T15:10:21.681239+0000","last_fullsized":"2023-05-17T15:10:21.681239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686740+0000","last_change":"2023-05-17T15:10:21.681045+0000","last_active":"2023-05-17T15:10:21.686740+0000","last_peered":"2023-05-17T15:10:21.686740+0000","last_clean":"2023-05-17T15:10:21.686740+0000","last_became_active":"2023-05-17T15:10:21.680765+0000","last_became_peered":"2023-05-17T15:10:21.680765+0000","last_unstale":"2023-05-17T15:10:21.686740+0000","last_undegraded":"2023-05-17T15:10:21.686740+0000","last_fullsized":"2023-05-17T15:10:21.686740+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697076+0000","last_change":"2023-05-17T15:10:21.694208+0000","last_active":"2023-05-17T15:10:21.697076+0000","last_peered":"2023-05-17T15:10:21.697076+0000","last_clean":"2023-05-17T15:10:21.697076+0000","last_became_active":"2023-05-17T15:10:21.693812+0000","last_became_peered":"2023-05-17T15:10:21.693812+0000","last_unstale":"2023-05-17T15:10:21.697076+0000","last_undegraded":"2023-05-17T15:10:21.697076+0000","last_fullsized":"2023-05-17T15:10:21.697076+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682140+0000","last_change":"2023-05-17T15:10:21.293631+0000","last_active":"2023-05-17T15:10:21.682140+0000","last_peered":"2023-05-17T15:10:21.682140+0000","last_clean":"2023-05-17T15:10:21.682140+0000","last_became_active":"2023-05-17T15:10:21.293366+0000","last_became_peered":"2023-05-17T15:10:21.293366+0000","last_unstale":"2023-05-17T15:10:21.682140+0000","last_undegraded":"2023-05-17T15:10:21.682140+0000","last_fullsized":"2023-05-17T15:10:21.682140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693690+0000","last_change":"2023-05-17T15:10:21.688471+0000","last_active":"2023-05-17T15:10:21.693690+0000","last_peered":"2023-05-17T15:10:21.693690+0000","last_clean":"2023-05-17T15:10:21.693690+0000","last_became_active":"2023-05-17T15:10:21.688210+0000","last_became_peered":"2023-05-17T15:10:21.688210+0000","last_unstale":"2023-05-17T15:10:21.693690+0000","last_undegraded":"2023-05-17T15:10:21.693690+0000","last_fullsized":"2023-05-17T15:10:21.693690+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694629+0000","last_change":"2023-05-17T15:10:21.693002+0000","last_active":"2023-05-17T15:10:21.694629+0000","last_peered":"2023-05-17T15:10:21.694629+0000","last_clean":"2023-05-17T15:10:21.694629+0000","last_became_active":"2023-05-17T15:10:21.690224+0000","last_became_peered":"2023-05-17T15:10:21.690224+0000","last_unstale":"2023-05-17T15:10:21.694629+0000","last_undegraded":"2023-05-17T15:10:21.694629+0000","last_fullsized":"2023-05-17T15:10:21.694629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670786+0000","last_change":"2023-05-17T15:10:21.297424+0000","last_active":"2023-05-17T15:10:21.670786+0000","last_peered":"2023-05-17T15:10:21.670786+0000","last_clean":"2023-05-17T15:10:21.670786+0000","last_became_active":"2023-05-17T15:10:21.296968+0000","last_became_peered":"2023-05-17T15:10:21.296968+0000","last_unstale":"2023-05-17T15:10:21.670786+0000","last_undegraded":"2023-05-17T15:10:21.670786+0000","last_fullsized":"2023-05-17T15:10:21.670786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696269+0000","last_change":"2023-05-17T15:10:21.686410+0000","last_active":"2023-05-17T15:10:21.696269+0000","last_peered":"2023-05-17T15:10:21.696269+0000","last_clean":"2023-05-17T15:10:21.696269+0000","last_became_active":"2023-05-17T15:10:21.685577+0000","last_became_peered":"2023-05-17T15:10:21.685577+0000","last_unstale":"2023-05-17T15:10:21.696269+0000","last_undegraded":"2023-05-17T15:10:21.696269+0000","last_fullsized":"2023-05-17T15:10:21.696269+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670815+0000","last_change":"2023-05-17T15:10:21.297742+0000","last_active":"2023-05-17T15:10:21.670815+0000","last_peered":"2023-05-17T15:10:21.670815+0000","last_clean":"2023-05-17T15:10:21.670815+0000","last_became_active":"2023-05-17T15:10:21.295280+0000","last_became_peered":"2023-05-17T15:10:21.295280+0000","last_unstale":"2023-05-17T15:10:21.670815+0000","last_undegraded":"2023-05-17T15:10:21.670815+0000","last_fullsized":"2023-05-17T15:10:21.670815+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693624+0000","last_change":"2023-05-17T15:10:21.686165+0000","last_active":"2023-05-17T15:10:21.693624+0000","last_peered":"2023-05-17T15:10:21.693624+0000","last_clean":"2023-05-17T15:10:21.693624+0000","last_became_active":"2023-05-17T15:10:21.685897+0000","last_became_peered":"2023-05-17T15:10:21.685897+0000","last_unstale":"2023-05-17T15:10:21.693624+0000","last_undegraded":"2023-05-17T15:10:21.693624+0000","last_fullsized":"2023-05-17T15:10:21.693624+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682219+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:21.682219+0000","last_peered":"2023-05-17T15:10:21.682219+0000","last_clean":"2023-05-17T15:10:21.682219+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:21.682219+0000","last_undegraded":"2023-05-17T15:10:21.682219+0000","last_fullsized":"2023-05-17T15:10:21.682219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693195+0000","last_change":"2023-05-17T15:10:21.685833+0000","last_active":"2023-05-17T15:10:21.693195+0000","last_peered":"2023-05-17T15:10:21.693195+0000","last_clean":"2023-05-17T15:10:21.693195+0000","last_became_active":"2023-05-17T15:10:21.685558+0000","last_became_peered":"2023-05-17T15:10:21.685558+0000","last_unstale":"2023-05-17T15:10:21.693195+0000","last_undegraded":"2023-05-17T15:10:21.693195+0000","last_fullsized":"2023-05-17T15:10:21.693195+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673594+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:21.673594+0000","last_peered":"2023-05-17T15:10:21.673594+0000","last_clean":"2023-05-17T15:10:21.673594+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:21.673594+0000","last_undegraded":"2023-05-17T15:10:21.673594+0000","last_fullsized":"2023-05-17T15:10:21.673594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689689+0000","last_change":"2023-05-17T15:10:21.687760+0000","last_active":"2023-05-17T15:10:21.689689+0000","last_peered":"2023-05-17T15:10:21.689689+0000","last_clean":"2023-05-17T15:10:21.689689+0000","last_became_active":"2023-05-17T15:10:21.687515+0000","last_became_peered":"2023-05-17T15:10:21.687515+0000","last_unstale":"2023-05-17T15:10:21.689689+0000","last_undegraded":"2023-05-17T15:10:21.689689+0000","last_fullsized":"2023-05-17T15:10:21.689689+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674769+0000","last_change":"2023-05-17T15:10:21.296404+0000","last_active":"2023-05-17T15:10:21.674769+0000","last_peered":"2023-05-17T15:10:21.674769+0000","last_clean":"2023-05-17T15:10:21.674769+0000","last_became_active":"2023-05-17T15:10:21.296102+0000","last_became_peered":"2023-05-17T15:10:21.296102+0000","last_unstale":"2023-05-17T15:10:21.674769+0000","last_undegraded":"2023-05-17T15:10:21.674769+0000","last_fullsized":"2023-05-17T15:10:21.674769+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670607+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:21.670607+0000","last_peered":"2023-05-17T15:10:21.670607+0000","last_clean":"2023-05-17T15:10:21.670607+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:21.670607+0000","last_undegraded":"2023-05-17T15:10:21.670607+0000","last_fullsized":"2023-05-17T15:10:21.670607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.693385+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.682985+0000","last_became_peered":"2023-05-17T15:10:21.682985+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694622+0000","last_change":"2023-05-17T15:10:21.293923+0000","last_active":"2023-05-17T15:10:21.694622+0000","last_peered":"2023-05-17T15:10:21.694622+0000","last_clean":"2023-05-17T15:10:21.694622+0000","last_became_active":"2023-05-17T15:10:21.290866+0000","last_became_peered":"2023-05-17T15:10:21.290866+0000","last_unstale":"2023-05-17T15:10:21.694622+0000","last_undegraded":"2023-05-17T15:10:21.694622+0000","last_fullsized":"2023-05-17T15:10:21.694622+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675429+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:21.675429+0000","last_peered":"2023-05-17T15:10:21.675429+0000","last_clean":"2023-05-17T15:10:21.675429+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:21.675429+0000","last_undegraded":"2023-05-17T15:10:21.675429+0000","last_fullsized":"2023-05-17T15:10:21.675429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328747+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:16.328747+0000","last_peered":"2023-05-17T15:10:16.328747+0000","last_clean":"2023-05-17T15:10:16.328747+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:16.328747+0000","last_undegraded":"2023-05-17T15:10:16.328747+0000","last_fullsized":"2023-05-17T15:10:16.328747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328734+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:16.328734+0000","last_peered":"2023-05-17T15:10:16.328734+0000","last_clean":"2023-05-17T15:10:16.328734+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:16.328734+0000","last_undegraded":"2023-05-17T15:10:16.328734+0000","last_fullsized":"2023-05-17T15:10:16.328734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694563+0000","last_change":"2023-05-17T15:10:21.692741+0000","last_active":"2023-05-17T15:10:21.694563+0000","last_peered":"2023-05-17T15:10:21.694563+0000","last_clean":"2023-05-17T15:10:21.694563+0000","last_became_active":"2023-05-17T15:10:21.690100+0000","last_became_peered":"2023-05-17T15:10:21.690100+0000","last_unstale":"2023-05-17T15:10:21.694563+0000","last_undegraded":"2023-05-17T15:10:21.694563+0000","last_fullsized":"2023-05-17T15:10:21.694563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670906+0000","last_change":"2023-05-17T15:10:21.297556+0000","last_active":"2023-05-17T15:10:21.670906+0000","last_peered":"2023-05-17T15:10:21.670906+0000","last_clean":"2023-05-17T15:10:21.670906+0000","last_became_active":"2023-05-17T15:10:21.289321+0000","last_became_peered":"2023-05-17T15:10:21.289321+0000","last_unstale":"2023-05-17T15:10:21.670906+0000","last_undegraded":"2023-05-17T15:10:21.670906+0000","last_fullsized":"2023-05-17T15:10:21.670906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328740+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:16.328740+0000","last_peered":"2023-05-17T15:10:16.328740+0000","last_clean":"2023-05-17T15:10:16.328740+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:16.328740+0000","last_undegraded":"2023-05-17T15:10:16.328740+0000","last_fullsized":"2023-05-17T15:10:16.328740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692726+0000","last_change":"2023-05-17T15:10:21.688711+0000","last_active":"2023-05-17T15:10:21.692726+0000","last_peered":"2023-05-17T15:10:21.692726+0000","last_clean":"2023-05-17T15:10:21.692726+0000","last_became_active":"2023-05-17T15:10:21.688420+0000","last_became_peered":"2023-05-17T15:10:21.688420+0000","last_unstale":"2023-05-17T15:10:21.692726+0000","last_undegraded":"2023-05-17T15:10:21.692726+0000","last_fullsized":"2023-05-17T15:10:21.692726+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694327+0000","last_change":"2023-05-17T15:10:21.295531+0000","last_active":"2023-05-17T15:10:21.694327+0000","last_peered":"2023-05-17T15:10:21.694327+0000","last_clean":"2023-05-17T15:10:21.694327+0000","last_became_active":"2023-05-17T15:10:21.295253+0000","last_became_peered":"2023-05-17T15:10:21.295253+0000","last_unstale":"2023-05-17T15:10:21.694327+0000","last_undegraded":"2023-05-17T15:10:21.694327+0000","last_fullsized":"2023-05-17T15:10:21.694327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686122+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:21.686122+0000","last_peered":"2023-05-17T15:10:21.686122+0000","last_clean":"2023-05-17T15:10:21.686122+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:21.686122+0000","last_undegraded":"2023-05-17T15:10:21.686122+0000","last_fullsized":"2023-05-17T15:10:21.686122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692908+0000","last_change":"2023-05-17T15:10:21.690118+0000","last_active":"2023-05-17T15:10:21.692908+0000","last_peered":"2023-05-17T15:10:21.692908+0000","last_clean":"2023-05-17T15:10:21.692908+0000","last_became_active":"2023-05-17T15:10:21.689835+0000","last_became_peered":"2023-05-17T15:10:21.689835+0000","last_unstale":"2023-05-17T15:10:21.692908+0000","last_undegraded":"2023-05-17T15:10:21.692908+0000","last_fullsized":"2023-05-17T15:10:21.692908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670901+0000","last_change":"2023-05-17T15:10:21.297233+0000","last_active":"2023-05-17T15:10:21.670901+0000","last_peered":"2023-05-17T15:10:21.670901+0000","last_clean":"2023-05-17T15:10:21.670901+0000","last_became_active":"2023-05-17T15:10:21.291087+0000","last_became_peered":"2023-05-17T15:10:21.291087+0000","last_unstale":"2023-05-17T15:10:21.670901+0000","last_undegraded":"2023-05-17T15:10:21.670901+0000","last_fullsized":"2023-05-17T15:10:21.670901+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328912+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:16.328912+0000","last_peered":"2023-05-17T15:10:16.328912+0000","last_clean":"2023-05-17T15:10:16.328912+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:16.328912+0000","last_undegraded":"2023-05-17T15:10:16.328912+0000","last_fullsized":"2023-05-17T15:10:16.328912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":658,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":76,"acting":76,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18376,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353464,"statfs":{"total":96636764160,"available":96617947136,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.64800000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17928,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353912,"statfs":{"total":96636764160,"available":96618405888,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59799999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.629}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.44},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17992,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353848,"statfs":{"total":96636764160,"available":96618340352,"internally_reserved":0,"allocated":1572864,"data_stored":785301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.33700000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17668,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354172,"statfs":{"total":96636764160,"available":96618672128,"internally_reserved":0,"allocated":1568768,"data_stored":784485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.378}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19072,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":17536,"kb_avail":94352768,"statfs":{"total":96636764160,"available":96617234432,"internally_reserved":0,"allocated":1564672,"data_stored":783855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17956864},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.249},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.313}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.72099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":20480,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":1556480,"data_stored":783751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20971520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.46899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":18120,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353720,"statfs":{"total":96636764160,"available":96618209280,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.441},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.48399999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.374},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21564,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350276,"statfs":{"total":96636764160,"available":96614682624,"internally_reserved":0,"allocated":1560576,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77500000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.82999999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:10:25.770 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:10:25.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.883+0000 7f557fca5700 1 Processor -- start 2023-05-17T15:10:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.883+0000 7f557fca5700 1 -- start start 2023-05-17T15:10:25.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557fca5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f55781543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557fca5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780bfcd0 con 0x7f55780c5f30 2023-05-17T15:10:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557fca5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780c0290 con 0x7f55780c6310 2023-05-17T15:10:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557fca5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780aa1a0 con 0x7f55780c1730 2023-05-17T15:10:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557da41700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f55780c5f30 0x7f5578158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42014/0 (socket says 172.21.15.27:42014) 2023-05-17T15:10:25.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557da41700 1 -- 172.21.15.27:0/861024941 learned_addr learned my addr 172.21.15.27:0/861024941 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:25.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735707939 0 0) 0x7f55780bfcd0 con 0x7f55780c5f30 2023-05-17T15:10:25.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55600033f0 con 0x7f55780c5f30 2023-05-17T15:10:25.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557e242700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f55781543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1916957895 0 0) 0x7f55600033f0 con 0x7f55780c5f30 2023-05-17T15:10:25.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 msgr2=0x7f55781543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f55781543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 >> v1:172.21.15.40:6789/0 conn(0x7f55780c6310 legacy=0x7f5578153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780aa480 con 0x7f55780c5f30 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5570001470 con 0x7f55780c5f30 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 >> v1:172.21.15.27:6789/0 conn(0x7f55780c5f30 legacy=0x7f5578158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f5560003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5560003ed0 0x7f5560004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5560004b80 0x7f5560005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780aa1a0 con 0x7f5560004b80 2023-05-17T15:10:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556000ba10 con 0x7f5560003ed0 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556000bbd0 con 0x7f55780c1730 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557e242700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5560004b80 0x7f5560005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.884+0000 7f557da41700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f5560003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557d240700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5560003ed0 0x7f5560004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 -- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 msgr2=0x7f5560003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f5560003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 -- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5560003ed0 msgr2=0x7f5560004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5560003ed0 0x7f5560004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 -- 172.21.15.27:0/861024941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600033f0 con 0x7f5560004b80 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557da41700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55780c1730 0x7f5560003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5560004b80 0x7f5560005000 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f5568007440 tx=0x7f5568009710).ready entity=mon.0 client_cookie=882b51bd075baeda server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568009a20 con 0x7f5560004b80 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568007cf0 con 0x7f5560004b80 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557ca3f700 1 -- 172.21.15.27:0/861024941 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568015680 con 0x7f5560004b80 2023-05-17T15:10:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557fca5700 1 -- 172.21.15.27:0/861024941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5560004b80 msgr2=0x7f5560005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557fca5700 1 --2- 172.21.15.27:0/861024941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5560004b80 0x7f5560005000 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f5568007440 tx=0x7f5568009710).stop 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557e242700 1 -- 172.21.15.27:0/861024941 reap_dead start 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557fca5700 1 -- 172.21.15.27:0/861024941 shutdown_connections 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.885+0000 7f557fca5700 1 -- 172.21.15.27:0/861024941 >> 172.21.15.27:0/861024941 conn(0x7f5578069e70 msgr2=0x7f557805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.886+0000 7f557fca5700 1 -- 172.21.15.27:0/861024941 shutdown_connections 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.886+0000 7f557fca5700 1 -- 172.21.15.27:0/861024941 wait complete. 2023-05-17T15:10:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 Processor -- start 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 -- start start 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f557814f530 0x7f5578164c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 0x7f5578151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5578152110 0x7f5578154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578152570 con 0x7f5578165180 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578151790 con 0x7f557814f530 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.887+0000 7f557fca5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5578150b80 con 0x7f5578152110 2023-05-17T15:10:25.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 0x7f5578151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 0x7f5578151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42466/0 (socket says 172.21.15.27:42466) 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 -- 172.21.15.27:0/2067903431 learned_addr learned my addr 172.21.15.27:0/2067903431 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557da41700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f557814f530 0x7f5578164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557e242700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5578152110 0x7f5578154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 -- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5578152110 msgr2=0x7f5578154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5578152110 0x7f5578154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 -- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f557814f530 msgr2=0x7f5578164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:25.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f557814f530 0x7f5578164c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 -- 172.21.15.27:0/2067903431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578150e60 con 0x7f5578165180 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557d240700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 0x7f5578151c20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f556c00e480 tx=0x7f556c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c007020 con 0x7f5578165180 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c010040 con 0x7f5578165180 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5578151140 con 0x7f5578165180 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c007390 con 0x7f5578165180 2023-05-17T15:10:25.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.888+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557814f910 con 0x7f5578165180 2023-05-17T15:10:25.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.889+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557805f4a0 con 0x7f5578165180 2023-05-17T15:10:25.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.890+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f556c0068b0 con 0x7f5578165180 2023-05-17T15:10:25.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.890+0000 7f5575ffb700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f556405ed90 0x7f5564061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:25.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.890+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f556c079180 con 0x7f5578165180 2023-05-17T15:10:25.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.890+0000 7f557da41700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f556405ed90 0x7f5564061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:25.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.891+0000 7f557da41700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f556405ed90 0x7f5564061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f55700015a0 tx=0x7f5570007040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:25.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:25.894+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f556c04a660 con 0x7f5578165180 2023-05-17T15:10:26.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.063+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f557806bdf0 con 0x7f556405ed90 2023-05-17T15:10:26.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.073+0000 7f5575ffb700 1 -- 172.21.15.27:0/2067903431 <== mgr.7389 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357173 (secure 0 0 0) 0x7f557806bdf0 con 0x7f556405ed90 2023-05-17T15:10:26.080 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:26.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f556405ed90 msgr2=0x7f5564061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f556405ed90 0x7f5564061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f55700015a0 tx=0x7f5570007040).stop 2023-05-17T15:10:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 msgr2=0x7f5578151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 0x7f5578151c20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f556c00e480 tx=0x7f556c009040).stop 2023-05-17T15:10:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 shutdown_connections 2023-05-17T15:10:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f556405ed90 0x7f5564061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5578152110 0x7f5578154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f557814f530 0x7f5578164c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 --2- 172.21.15.27:0/2067903431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5578165180 0x7f5578151c20 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 >> 172.21.15.27:0/2067903431 conn(0x7f5578069e70 msgr2=0x7f55780ac690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:26.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 shutdown_connections 2023-05-17T15:10:26.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.076+0000 7f557fca5700 1 -- 172.21.15.27:0/2067903431 wait complete. 2023-05-17T15:10:26.083 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:10:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:10:24.729968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":152728,"kb_used_data":12056,"kb_used_omap":0,"kb_used_meta":140608,"kb_avail":754821992,"statfs":{"total":773094113280,"available":772937719808,"internally_reserved":0,"allocated":12345344,"data_stored":6191401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":143982592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.507476"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689060+0000","last_change":"2023-05-17T15:10:21.683295+0000","last_active":"2023-05-17T15:10:21.689060+0000","last_peered":"2023-05-17T15:10:21.689060+0000","last_clean":"2023-05-17T15:10:21.689060+0000","last_became_active":"2023-05-17T15:10:21.682915+0000","last_became_peered":"2023-05-17T15:10:21.682915+0000","last_unstale":"2023-05-17T15:10:21.689060+0000","last_undegraded":"2023-05-17T15:10:21.689060+0000","last_fullsized":"2023-05-17T15:10:21.689060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697693+0000","last_change":"2023-05-17T15:10:21.299521+0000","last_active":"2023-05-17T15:10:21.697693+0000","last_peered":"2023-05-17T15:10:21.697693+0000","last_clean":"2023-05-17T15:10:21.697693+0000","last_became_active":"2023-05-17T15:10:21.299249+0000","last_became_peered":"2023-05-17T15:10:21.299249+0000","last_unstale":"2023-05-17T15:10:21.697693+0000","last_undegraded":"2023-05-17T15:10:21.697693+0000","last_fullsized":"2023-05-17T15:10:21.697693+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681030+0000","last_change":"2023-05-17T15:10:21.292372+0000","last_active":"2023-05-17T15:10:21.681030+0000","last_peered":"2023-05-17T15:10:21.681030+0000","last_clean":"2023-05-17T15:10:21.681030+0000","last_became_active":"2023-05-17T15:10:21.291668+0000","last_became_peered":"2023-05-17T15:10:21.291668+0000","last_unstale":"2023-05-17T15:10:21.681030+0000","last_undegraded":"2023-05-17T15:10:21.681030+0000","last_fullsized":"2023-05-17T15:10:21.681030+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685863+0000","last_change":"2023-05-17T15:10:21.299601+0000","last_active":"2023-05-17T15:10:21.685863+0000","last_peered":"2023-05-17T15:10:21.685863+0000","last_clean":"2023-05-17T15:10:21.685863+0000","last_became_active":"2023-05-17T15:10:21.299304+0000","last_became_peered":"2023-05-17T15:10:21.299304+0000","last_unstale":"2023-05-17T15:10:21.685863+0000","last_undegraded":"2023-05-17T15:10:21.685863+0000","last_fullsized":"2023-05-17T15:10:21.685863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689518+0000","last_change":"2023-05-17T15:10:21.682112+0000","last_active":"2023-05-17T15:10:21.689518+0000","last_peered":"2023-05-17T15:10:21.689518+0000","last_clean":"2023-05-17T15:10:21.689518+0000","last_became_active":"2023-05-17T15:10:21.681845+0000","last_became_peered":"2023-05-17T15:10:21.681845+0000","last_unstale":"2023-05-17T15:10:21.689518+0000","last_undegraded":"2023-05-17T15:10:21.689518+0000","last_fullsized":"2023-05-17T15:10:21.689518+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693301+0000","last_change":"2023-05-17T15:10:21.292923+0000","last_active":"2023-05-17T15:10:21.693301+0000","last_peered":"2023-05-17T15:10:21.693301+0000","last_clean":"2023-05-17T15:10:21.693301+0000","last_became_active":"2023-05-17T15:10:21.292654+0000","last_became_peered":"2023-05-17T15:10:21.292654+0000","last_unstale":"2023-05-17T15:10:21.693301+0000","last_undegraded":"2023-05-17T15:10:21.693301+0000","last_fullsized":"2023-05-17T15:10:21.693301+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696983+0000","last_change":"2023-05-17T15:10:21.688215+0000","last_active":"2023-05-17T15:10:21.696983+0000","last_peered":"2023-05-17T15:10:21.696983+0000","last_clean":"2023-05-17T15:10:21.696983+0000","last_became_active":"2023-05-17T15:10:21.687921+0000","last_became_peered":"2023-05-17T15:10:21.687921+0000","last_unstale":"2023-05-17T15:10:21.696983+0000","last_undegraded":"2023-05-17T15:10:21.696983+0000","last_fullsized":"2023-05-17T15:10:21.696983+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681289+0000","last_change":"2023-05-17T15:10:21.294570+0000","last_active":"2023-05-17T15:10:21.681289+0000","last_peered":"2023-05-17T15:10:21.681289+0000","last_clean":"2023-05-17T15:10:21.681289+0000","last_became_active":"2023-05-17T15:10:21.293467+0000","last_became_peered":"2023-05-17T15:10:21.293467+0000","last_unstale":"2023-05-17T15:10:21.681289+0000","last_undegraded":"2023-05-17T15:10:21.681289+0000","last_fullsized":"2023-05-17T15:10:21.681289+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688641+0000","last_change":"2023-05-17T15:10:21.682283+0000","last_active":"2023-05-17T15:10:21.688641+0000","last_peered":"2023-05-17T15:10:21.688641+0000","last_clean":"2023-05-17T15:10:21.688641+0000","last_became_active":"2023-05-17T15:10:21.682017+0000","last_became_peered":"2023-05-17T15:10:21.682017+0000","last_unstale":"2023-05-17T15:10:21.688641+0000","last_undegraded":"2023-05-17T15:10:21.688641+0000","last_fullsized":"2023-05-17T15:10:21.688641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699575+0000","last_change":"2023-05-17T15:10:21.698224+0000","last_active":"2023-05-17T15:10:21.699575+0000","last_peered":"2023-05-17T15:10:21.699575+0000","last_clean":"2023-05-17T15:10:21.699575+0000","last_became_active":"2023-05-17T15:10:21.697946+0000","last_became_peered":"2023-05-17T15:10:21.697946+0000","last_unstale":"2023-05-17T15:10:21.699575+0000","last_undegraded":"2023-05-17T15:10:21.699575+0000","last_fullsized":"2023-05-17T15:10:21.699575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692164+0000","last_change":"2023-05-17T15:10:21.689824+0000","last_active":"2023-05-17T15:10:21.692164+0000","last_peered":"2023-05-17T15:10:21.692164+0000","last_clean":"2023-05-17T15:10:21.692164+0000","last_became_active":"2023-05-17T15:10:21.689431+0000","last_became_peered":"2023-05-17T15:10:21.689431+0000","last_unstale":"2023-05-17T15:10:21.692164+0000","last_undegraded":"2023-05-17T15:10:21.692164+0000","last_fullsized":"2023-05-17T15:10:21.692164+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694262+0000","last_change":"2023-05-17T15:10:21.689351+0000","last_active":"2023-05-17T15:10:21.694262+0000","last_peered":"2023-05-17T15:10:21.694262+0000","last_clean":"2023-05-17T15:10:21.694262+0000","last_became_active":"2023-05-17T15:10:21.689089+0000","last_became_peered":"2023-05-17T15:10:21.689089+0000","last_unstale":"2023-05-17T15:10:21.694262+0000","last_undegraded":"2023-05-17T15:10:21.694262+0000","last_fullsized":"2023-05-17T15:10:21.694262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692633+0000","last_change":"2023-05-17T15:10:21.298019+0000","last_active":"2023-05-17T15:10:21.692633+0000","last_peered":"2023-05-17T15:10:21.692633+0000","last_clean":"2023-05-17T15:10:21.692633+0000","last_became_active":"2023-05-17T15:10:21.294051+0000","last_became_peered":"2023-05-17T15:10:21.294051+0000","last_unstale":"2023-05-17T15:10:21.692633+0000","last_undegraded":"2023-05-17T15:10:21.692633+0000","last_fullsized":"2023-05-17T15:10:21.692633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.695998+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.695779+0000","last_became_peered":"2023-05-17T15:10:21.695779+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670675+0000","last_change":"2023-05-17T15:10:21.298810+0000","last_active":"2023-05-17T15:10:21.670675+0000","last_peered":"2023-05-17T15:10:21.670675+0000","last_clean":"2023-05-17T15:10:21.670675+0000","last_became_active":"2023-05-17T15:10:21.298535+0000","last_became_peered":"2023-05-17T15:10:21.298535+0000","last_unstale":"2023-05-17T15:10:21.670675+0000","last_undegraded":"2023-05-17T15:10:21.670675+0000","last_fullsized":"2023-05-17T15:10:21.670675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675380+0000","last_change":"2023-05-17T15:10:21.291603+0000","last_active":"2023-05-17T15:10:21.675380+0000","last_peered":"2023-05-17T15:10:21.675380+0000","last_clean":"2023-05-17T15:10:21.675380+0000","last_became_active":"2023-05-17T15:10:21.289948+0000","last_became_peered":"2023-05-17T15:10:21.289948+0000","last_unstale":"2023-05-17T15:10:21.675380+0000","last_undegraded":"2023-05-17T15:10:21.675380+0000","last_fullsized":"2023-05-17T15:10:21.675380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699525+0000","last_change":"2023-05-17T15:10:21.697668+0000","last_active":"2023-05-17T15:10:21.699525+0000","last_peered":"2023-05-17T15:10:21.699525+0000","last_clean":"2023-05-17T15:10:21.699525+0000","last_became_active":"2023-05-17T15:10:21.697419+0000","last_became_peered":"2023-05-17T15:10:21.697419+0000","last_unstale":"2023-05-17T15:10:21.699525+0000","last_undegraded":"2023-05-17T15:10:21.699525+0000","last_fullsized":"2023-05-17T15:10:21.699525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681170+0000","last_change":"2023-05-17T15:10:21.288238+0000","last_active":"2023-05-17T15:10:21.681170+0000","last_peered":"2023-05-17T15:10:21.681170+0000","last_clean":"2023-05-17T15:10:21.681170+0000","last_became_active":"2023-05-17T15:10:21.287952+0000","last_became_peered":"2023-05-17T15:10:21.287952+0000","last_unstale":"2023-05-17T15:10:21.681170+0000","last_undegraded":"2023-05-17T15:10:21.681170+0000","last_fullsized":"2023-05-17T15:10:21.681170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.676011+0000","last_change":"2023-05-17T15:10:21.293333+0000","last_active":"2023-05-17T15:10:21.676011+0000","last_peered":"2023-05-17T15:10:21.676011+0000","last_clean":"2023-05-17T15:10:21.676011+0000","last_became_active":"2023-05-17T15:10:21.291969+0000","last_became_peered":"2023-05-17T15:10:21.291969+0000","last_unstale":"2023-05-17T15:10:21.676011+0000","last_undegraded":"2023-05-17T15:10:21.676011+0000","last_fullsized":"2023-05-17T15:10:21.676011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693914+0000","last_change":"2023-05-17T15:10:21.290304+0000","last_active":"2023-05-17T15:10:21.693914+0000","last_peered":"2023-05-17T15:10:21.693914+0000","last_clean":"2023-05-17T15:10:21.693914+0000","last_became_active":"2023-05-17T15:10:21.290023+0000","last_became_peered":"2023-05-17T15:10:21.290023+0000","last_unstale":"2023-05-17T15:10:21.693914+0000","last_undegraded":"2023-05-17T15:10:21.693914+0000","last_fullsized":"2023-05-17T15:10:21.693914+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693819+0000","last_change":"2023-05-17T15:10:21.687930+0000","last_active":"2023-05-17T15:10:21.693819+0000","last_peered":"2023-05-17T15:10:21.693819+0000","last_clean":"2023-05-17T15:10:21.693819+0000","last_became_active":"2023-05-17T15:10:21.687700+0000","last_became_peered":"2023-05-17T15:10:21.687700+0000","last_unstale":"2023-05-17T15:10:21.693819+0000","last_undegraded":"2023-05-17T15:10:21.693819+0000","last_fullsized":"2023-05-17T15:10:21.693819+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697136+0000","last_change":"2023-05-17T15:10:21.298512+0000","last_active":"2023-05-17T15:10:21.697136+0000","last_peered":"2023-05-17T15:10:21.697136+0000","last_clean":"2023-05-17T15:10:21.697136+0000","last_became_active":"2023-05-17T15:10:21.298105+0000","last_became_peered":"2023-05-17T15:10:21.298105+0000","last_unstale":"2023-05-17T15:10:21.697136+0000","last_undegraded":"2023-05-17T15:10:21.697136+0000","last_fullsized":"2023-05-17T15:10:21.697136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698112+0000","last_change":"2023-05-17T15:10:21.695099+0000","last_active":"2023-05-17T15:10:21.698112+0000","last_peered":"2023-05-17T15:10:21.698112+0000","last_clean":"2023-05-17T15:10:21.698112+0000","last_became_active":"2023-05-17T15:10:21.694788+0000","last_became_peered":"2023-05-17T15:10:21.694788+0000","last_unstale":"2023-05-17T15:10:21.698112+0000","last_undegraded":"2023-05-17T15:10:21.698112+0000","last_fullsized":"2023-05-17T15:10:21.698112+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679296+0000","last_change":"2023-05-17T15:10:21.297458+0000","last_active":"2023-05-17T15:10:21.679296+0000","last_peered":"2023-05-17T15:10:21.679296+0000","last_clean":"2023-05-17T15:10:21.679296+0000","last_became_active":"2023-05-17T15:10:21.297156+0000","last_became_peered":"2023-05-17T15:10:21.297156+0000","last_unstale":"2023-05-17T15:10:21.679296+0000","last_undegraded":"2023-05-17T15:10:21.679296+0000","last_fullsized":"2023-05-17T15:10:21.679296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690230+0000","last_change":"2023-05-17T15:10:21.686606+0000","last_active":"2023-05-17T15:10:21.690230+0000","last_peered":"2023-05-17T15:10:21.690230+0000","last_clean":"2023-05-17T15:10:21.690230+0000","last_became_active":"2023-05-17T15:10:21.686335+0000","last_became_peered":"2023-05-17T15:10:21.686335+0000","last_unstale":"2023-05-17T15:10:21.690230+0000","last_undegraded":"2023-05-17T15:10:21.690230+0000","last_fullsized":"2023-05-17T15:10:21.690230+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679535+0000","last_change":"2023-05-17T15:10:21.288322+0000","last_active":"2023-05-17T15:10:21.679535+0000","last_peered":"2023-05-17T15:10:21.679535+0000","last_clean":"2023-05-17T15:10:21.679535+0000","last_became_active":"2023-05-17T15:10:21.288046+0000","last_became_peered":"2023-05-17T15:10:21.288046+0000","last_unstale":"2023-05-17T15:10:21.679535+0000","last_undegraded":"2023-05-17T15:10:21.679535+0000","last_fullsized":"2023-05-17T15:10:21.679535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686781+0000","last_change":"2023-05-17T15:10:21.678612+0000","last_active":"2023-05-17T15:10:21.686781+0000","last_peered":"2023-05-17T15:10:21.686781+0000","last_clean":"2023-05-17T15:10:21.686781+0000","last_became_active":"2023-05-17T15:10:21.678335+0000","last_became_peered":"2023-05-17T15:10:21.678335+0000","last_unstale":"2023-05-17T15:10:21.686781+0000","last_undegraded":"2023-05-17T15:10:21.686781+0000","last_fullsized":"2023-05-17T15:10:21.686781+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681138+0000","last_change":"2023-05-17T15:10:21.297023+0000","last_active":"2023-05-17T15:10:21.681138+0000","last_peered":"2023-05-17T15:10:21.681138+0000","last_clean":"2023-05-17T15:10:21.681138+0000","last_became_active":"2023-05-17T15:10:21.296741+0000","last_became_peered":"2023-05-17T15:10:21.296741+0000","last_unstale":"2023-05-17T15:10:21.681138+0000","last_undegraded":"2023-05-17T15:10:21.681138+0000","last_fullsized":"2023-05-17T15:10:21.681138+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692213+0000","last_change":"2023-05-17T15:10:21.689525+0000","last_active":"2023-05-17T15:10:21.692213+0000","last_peered":"2023-05-17T15:10:21.692213+0000","last_clean":"2023-05-17T15:10:21.692213+0000","last_became_active":"2023-05-17T15:10:21.688968+0000","last_became_peered":"2023-05-17T15:10:21.688968+0000","last_unstale":"2023-05-17T15:10:21.692213+0000","last_undegraded":"2023-05-17T15:10:21.692213+0000","last_fullsized":"2023-05-17T15:10:21.692213+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693855+0000","last_change":"2023-05-17T15:10:21.686284+0000","last_active":"2023-05-17T15:10:21.693855+0000","last_peered":"2023-05-17T15:10:21.693855+0000","last_clean":"2023-05-17T15:10:21.693855+0000","last_became_active":"2023-05-17T15:10:21.684239+0000","last_became_peered":"2023-05-17T15:10:21.684239+0000","last_unstale":"2023-05-17T15:10:21.693855+0000","last_undegraded":"2023-05-17T15:10:21.693855+0000","last_fullsized":"2023-05-17T15:10:21.693855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679410+0000","last_change":"2023-05-17T15:10:21.297089+0000","last_active":"2023-05-17T15:10:21.679410+0000","last_peered":"2023-05-17T15:10:21.679410+0000","last_clean":"2023-05-17T15:10:21.679410+0000","last_became_active":"2023-05-17T15:10:21.296773+0000","last_became_peered":"2023-05-17T15:10:21.296773+0000","last_unstale":"2023-05-17T15:10:21.679410+0000","last_undegraded":"2023-05-17T15:10:21.679410+0000","last_fullsized":"2023-05-17T15:10:21.679410+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699232+0000","last_change":"2023-05-17T15:10:21.697475+0000","last_active":"2023-05-17T15:10:21.699232+0000","last_peered":"2023-05-17T15:10:21.699232+0000","last_clean":"2023-05-17T15:10:21.699232+0000","last_became_active":"2023-05-17T15:10:21.697193+0000","last_became_peered":"2023-05-17T15:10:21.697193+0000","last_unstale":"2023-05-17T15:10:21.699232+0000","last_undegraded":"2023-05-17T15:10:21.699232+0000","last_fullsized":"2023-05-17T15:10:21.699232+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671010+0000","last_change":"2023-05-17T15:10:21.296684+0000","last_active":"2023-05-17T15:10:21.671010+0000","last_peered":"2023-05-17T15:10:21.671010+0000","last_clean":"2023-05-17T15:10:21.671010+0000","last_became_active":"2023-05-17T15:10:21.290716+0000","last_became_peered":"2023-05-17T15:10:21.290716+0000","last_unstale":"2023-05-17T15:10:21.671010+0000","last_undegraded":"2023-05-17T15:10:21.671010+0000","last_fullsized":"2023-05-17T15:10:21.671010+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675476+0000","last_change":"2023-05-17T15:10:21.285520+0000","last_active":"2023-05-17T15:10:21.675476+0000","last_peered":"2023-05-17T15:10:21.675476+0000","last_clean":"2023-05-17T15:10:21.675476+0000","last_became_active":"2023-05-17T15:10:21.285201+0000","last_became_peered":"2023-05-17T15:10:21.285201+0000","last_unstale":"2023-05-17T15:10:21.675476+0000","last_undegraded":"2023-05-17T15:10:21.675476+0000","last_fullsized":"2023-05-17T15:10:21.675476+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694439+0000","last_change":"2023-05-17T15:10:21.693273+0000","last_active":"2023-05-17T15:10:21.694439+0000","last_peered":"2023-05-17T15:10:21.694439+0000","last_clean":"2023-05-17T15:10:21.694439+0000","last_became_active":"2023-05-17T15:10:21.692975+0000","last_became_peered":"2023-05-17T15:10:21.692975+0000","last_unstale":"2023-05-17T15:10:21.694439+0000","last_undegraded":"2023-05-17T15:10:21.694439+0000","last_fullsized":"2023-05-17T15:10:21.694439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681548+0000","last_change":"2023-05-17T15:10:21.298675+0000","last_active":"2023-05-17T15:10:21.681548+0000","last_peered":"2023-05-17T15:10:21.681548+0000","last_clean":"2023-05-17T15:10:21.681548+0000","last_became_active":"2023-05-17T15:10:21.298404+0000","last_became_peered":"2023-05-17T15:10:21.298404+0000","last_unstale":"2023-05-17T15:10:21.681548+0000","last_undegraded":"2023-05-17T15:10:21.681548+0000","last_fullsized":"2023-05-17T15:10:21.681548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696504+0000","last_change":"2023-05-17T15:10:21.694697+0000","last_active":"2023-05-17T15:10:21.696504+0000","last_peered":"2023-05-17T15:10:21.696504+0000","last_clean":"2023-05-17T15:10:21.696504+0000","last_became_active":"2023-05-17T15:10:21.694445+0000","last_became_peered":"2023-05-17T15:10:21.694445+0000","last_unstale":"2023-05-17T15:10:21.696504+0000","last_undegraded":"2023-05-17T15:10:21.696504+0000","last_fullsized":"2023-05-17T15:10:21.696504+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693885+0000","last_change":"2023-05-17T15:10:21.288608+0000","last_active":"2023-05-17T15:10:21.693885+0000","last_peered":"2023-05-17T15:10:21.693885+0000","last_clean":"2023-05-17T15:10:21.693885+0000","last_became_active":"2023-05-17T15:10:21.288281+0000","last_became_peered":"2023-05-17T15:10:21.288281+0000","last_unstale":"2023-05-17T15:10:21.693885+0000","last_undegraded":"2023-05-17T15:10:21.693885+0000","last_fullsized":"2023-05-17T15:10:21.693885+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688927+0000","last_change":"2023-05-17T15:10:21.683486+0000","last_active":"2023-05-17T15:10:21.688927+0000","last_peered":"2023-05-17T15:10:21.688927+0000","last_clean":"2023-05-17T15:10:21.688927+0000","last_became_active":"2023-05-17T15:10:21.683229+0000","last_became_peered":"2023-05-17T15:10:21.683229+0000","last_unstale":"2023-05-17T15:10:21.688927+0000","last_undegraded":"2023-05-17T15:10:21.688927+0000","last_fullsized":"2023-05-17T15:10:21.688927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693732+0000","last_change":"2023-05-17T15:10:21.295144+0000","last_active":"2023-05-17T15:10:21.693732+0000","last_peered":"2023-05-17T15:10:21.693732+0000","last_clean":"2023-05-17T15:10:21.693732+0000","last_became_active":"2023-05-17T15:10:21.294535+0000","last_became_peered":"2023-05-17T15:10:21.294535+0000","last_unstale":"2023-05-17T15:10:21.693732+0000","last_undegraded":"2023-05-17T15:10:21.693732+0000","last_fullsized":"2023-05-17T15:10:21.693732+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697058+0000","last_change":"2023-05-17T15:10:21.693852+0000","last_active":"2023-05-17T15:10:21.697058+0000","last_peered":"2023-05-17T15:10:21.697058+0000","last_clean":"2023-05-17T15:10:21.697058+0000","last_became_active":"2023-05-17T15:10:21.693190+0000","last_became_peered":"2023-05-17T15:10:21.693190+0000","last_unstale":"2023-05-17T15:10:21.697058+0000","last_undegraded":"2023-05-17T15:10:21.697058+0000","last_fullsized":"2023-05-17T15:10:21.697058+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682018+0000","last_change":"2023-05-17T15:10:21.294898+0000","last_active":"2023-05-17T15:10:21.682018+0000","last_peered":"2023-05-17T15:10:21.682018+0000","last_clean":"2023-05-17T15:10:21.682018+0000","last_became_active":"2023-05-17T15:10:21.294622+0000","last_became_peered":"2023-05-17T15:10:21.294622+0000","last_unstale":"2023-05-17T15:10:21.682018+0000","last_undegraded":"2023-05-17T15:10:21.682018+0000","last_fullsized":"2023-05-17T15:10:21.682018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693870+0000","last_change":"2023-05-17T15:10:21.691292+0000","last_active":"2023-05-17T15:10:21.693870+0000","last_peered":"2023-05-17T15:10:21.693870+0000","last_clean":"2023-05-17T15:10:21.693870+0000","last_became_active":"2023-05-17T15:10:21.691037+0000","last_became_peered":"2023-05-17T15:10:21.691037+0000","last_unstale":"2023-05-17T15:10:21.693870+0000","last_undegraded":"2023-05-17T15:10:21.693870+0000","last_fullsized":"2023-05-17T15:10:21.693870+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696614+0000","last_change":"2023-05-17T15:10:21.694755+0000","last_active":"2023-05-17T15:10:21.696614+0000","last_peered":"2023-05-17T15:10:21.696614+0000","last_clean":"2023-05-17T15:10:21.696614+0000","last_became_active":"2023-05-17T15:10:21.694471+0000","last_became_peered":"2023-05-17T15:10:21.694471+0000","last_unstale":"2023-05-17T15:10:21.696614+0000","last_undegraded":"2023-05-17T15:10:21.696614+0000","last_fullsized":"2023-05-17T15:10:21.696614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673474+0000","last_change":"2023-05-17T15:10:21.293702+0000","last_active":"2023-05-17T15:10:21.673474+0000","last_peered":"2023-05-17T15:10:21.673474+0000","last_clean":"2023-05-17T15:10:21.673474+0000","last_became_active":"2023-05-17T15:10:21.293422+0000","last_became_peered":"2023-05-17T15:10:21.293422+0000","last_unstale":"2023-05-17T15:10:21.673474+0000","last_undegraded":"2023-05-17T15:10:21.673474+0000","last_fullsized":"2023-05-17T15:10:21.673474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693266+0000","last_change":"2023-05-17T15:10:21.682997+0000","last_active":"2023-05-17T15:10:21.693266+0000","last_peered":"2023-05-17T15:10:21.693266+0000","last_clean":"2023-05-17T15:10:21.693266+0000","last_became_active":"2023-05-17T15:10:21.682798+0000","last_became_peered":"2023-05-17T15:10:21.682798+0000","last_unstale":"2023-05-17T15:10:21.693266+0000","last_undegraded":"2023-05-17T15:10:21.693266+0000","last_fullsized":"2023-05-17T15:10:21.693266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675239+0000","last_change":"2023-05-17T15:10:21.292338+0000","last_active":"2023-05-17T15:10:21.675239+0000","last_peered":"2023-05-17T15:10:21.675239+0000","last_clean":"2023-05-17T15:10:21.675239+0000","last_became_active":"2023-05-17T15:10:21.289967+0000","last_became_peered":"2023-05-17T15:10:21.289967+0000","last_unstale":"2023-05-17T15:10:21.675239+0000","last_undegraded":"2023-05-17T15:10:21.675239+0000","last_fullsized":"2023-05-17T15:10:21.675239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696914+0000","last_change":"2023-05-17T15:10:21.696004+0000","last_active":"2023-05-17T15:10:21.696914+0000","last_peered":"2023-05-17T15:10:21.696914+0000","last_clean":"2023-05-17T15:10:21.696914+0000","last_became_active":"2023-05-17T15:10:21.695768+0000","last_became_peered":"2023-05-17T15:10:21.695768+0000","last_unstale":"2023-05-17T15:10:21.696914+0000","last_undegraded":"2023-05-17T15:10:21.696914+0000","last_fullsized":"2023-05-17T15:10:21.696914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690654+0000","last_change":"2023-05-17T15:10:21.689154+0000","last_active":"2023-05-17T15:10:21.690654+0000","last_peered":"2023-05-17T15:10:21.690654+0000","last_clean":"2023-05-17T15:10:21.690654+0000","last_became_active":"2023-05-17T15:10:21.688888+0000","last_became_peered":"2023-05-17T15:10:21.688888+0000","last_unstale":"2023-05-17T15:10:21.690654+0000","last_undegraded":"2023-05-17T15:10:21.690654+0000","last_fullsized":"2023-05-17T15:10:21.690654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681341+0000","last_change":"2023-05-17T15:10:21.292560+0000","last_active":"2023-05-17T15:10:21.681341+0000","last_peered":"2023-05-17T15:10:21.681341+0000","last_clean":"2023-05-17T15:10:21.681341+0000","last_became_active":"2023-05-17T15:10:21.292093+0000","last_became_peered":"2023-05-17T15:10:21.292093+0000","last_unstale":"2023-05-17T15:10:21.681341+0000","last_undegraded":"2023-05-17T15:10:21.681341+0000","last_fullsized":"2023-05-17T15:10:21.681341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694968+0000","last_change":"2023-05-17T15:10:21.693638+0000","last_active":"2023-05-17T15:10:21.694968+0000","last_peered":"2023-05-17T15:10:21.694968+0000","last_clean":"2023-05-17T15:10:21.694968+0000","last_became_active":"2023-05-17T15:10:21.693339+0000","last_became_peered":"2023-05-17T15:10:21.693339+0000","last_unstale":"2023-05-17T15:10:21.694968+0000","last_undegraded":"2023-05-17T15:10:21.694968+0000","last_fullsized":"2023-05-17T15:10:21.694968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692231+0000","last_change":"2023-05-17T15:10:21.690962+0000","last_active":"2023-05-17T15:10:21.692231+0000","last_peered":"2023-05-17T15:10:21.692231+0000","last_clean":"2023-05-17T15:10:21.692231+0000","last_became_active":"2023-05-17T15:10:21.690681+0000","last_became_peered":"2023-05-17T15:10:21.690681+0000","last_unstale":"2023-05-17T15:10:21.692231+0000","last_undegraded":"2023-05-17T15:10:21.692231+0000","last_fullsized":"2023-05-17T15:10:21.692231+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696276+0000","last_change":"2023-05-17T15:10:21.684825+0000","last_active":"2023-05-17T15:10:21.696276+0000","last_peered":"2023-05-17T15:10:21.696276+0000","last_clean":"2023-05-17T15:10:21.696276+0000","last_became_active":"2023-05-17T15:10:21.684525+0000","last_became_peered":"2023-05-17T15:10:21.684525+0000","last_unstale":"2023-05-17T15:10:21.696276+0000","last_undegraded":"2023-05-17T15:10:21.696276+0000","last_fullsized":"2023-05-17T15:10:21.696276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691116+0000","last_change":"2023-05-17T15:10:21.290239+0000","last_active":"2023-05-17T15:10:21.691116+0000","last_peered":"2023-05-17T15:10:21.691116+0000","last_clean":"2023-05-17T15:10:21.691116+0000","last_became_active":"2023-05-17T15:10:21.289965+0000","last_became_peered":"2023-05-17T15:10:21.289965+0000","last_unstale":"2023-05-17T15:10:21.691116+0000","last_undegraded":"2023-05-17T15:10:21.691116+0000","last_fullsized":"2023-05-17T15:10:21.691116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675392+0000","last_change":"2023-05-17T15:10:21.293582+0000","last_active":"2023-05-17T15:10:21.675392+0000","last_peered":"2023-05-17T15:10:21.675392+0000","last_clean":"2023-05-17T15:10:21.675392+0000","last_became_active":"2023-05-17T15:10:21.293290+0000","last_became_peered":"2023-05-17T15:10:21.293290+0000","last_unstale":"2023-05-17T15:10:21.675392+0000","last_undegraded":"2023-05-17T15:10:21.675392+0000","last_fullsized":"2023-05-17T15:10:21.675392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689211+0000","last_change":"2023-05-17T15:10:21.683174+0000","last_active":"2023-05-17T15:10:21.689211+0000","last_peered":"2023-05-17T15:10:21.689211+0000","last_clean":"2023-05-17T15:10:21.689211+0000","last_became_active":"2023-05-17T15:10:21.682594+0000","last_became_peered":"2023-05-17T15:10:21.682594+0000","last_unstale":"2023-05-17T15:10:21.689211+0000","last_undegraded":"2023-05-17T15:10:21.689211+0000","last_fullsized":"2023-05-17T15:10:21.689211+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670511+0000","last_change":"2023-05-17T15:10:21.294708+0000","last_active":"2023-05-17T15:10:21.670511+0000","last_peered":"2023-05-17T15:10:21.670511+0000","last_clean":"2023-05-17T15:10:21.670511+0000","last_became_active":"2023-05-17T15:10:21.294391+0000","last_became_peered":"2023-05-17T15:10:21.294391+0000","last_unstale":"2023-05-17T15:10:21.670511+0000","last_undegraded":"2023-05-17T15:10:21.670511+0000","last_fullsized":"2023-05-17T15:10:21.670511+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699542+0000","last_change":"2023-05-17T15:10:21.697712+0000","last_active":"2023-05-17T15:10:21.699542+0000","last_peered":"2023-05-17T15:10:21.699542+0000","last_clean":"2023-05-17T15:10:21.699542+0000","last_became_active":"2023-05-17T15:10:21.697438+0000","last_became_peered":"2023-05-17T15:10:21.697438+0000","last_unstale":"2023-05-17T15:10:21.699542+0000","last_undegraded":"2023-05-17T15:10:21.699542+0000","last_fullsized":"2023-05-17T15:10:21.699542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690346+0000","last_change":"2023-05-17T15:10:21.687552+0000","last_active":"2023-05-17T15:10:21.690346+0000","last_peered":"2023-05-17T15:10:21.690346+0000","last_clean":"2023-05-17T15:10:21.690346+0000","last_became_active":"2023-05-17T15:10:21.687317+0000","last_became_peered":"2023-05-17T15:10:21.687317+0000","last_unstale":"2023-05-17T15:10:21.690346+0000","last_undegraded":"2023-05-17T15:10:21.690346+0000","last_fullsized":"2023-05-17T15:10:21.690346+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694620+0000","last_change":"2023-05-17T15:10:21.291005+0000","last_active":"2023-05-17T15:10:21.694620+0000","last_peered":"2023-05-17T15:10:21.694620+0000","last_clean":"2023-05-17T15:10:21.694620+0000","last_became_active":"2023-05-17T15:10:21.290732+0000","last_became_peered":"2023-05-17T15:10:21.290732+0000","last_unstale":"2023-05-17T15:10:21.694620+0000","last_undegraded":"2023-05-17T15:10:21.694620+0000","last_fullsized":"2023-05-17T15:10:21.694620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681239+0000","last_change":"2023-05-17T15:10:21.297096+0000","last_active":"2023-05-17T15:10:21.681239+0000","last_peered":"2023-05-17T15:10:21.681239+0000","last_clean":"2023-05-17T15:10:21.681239+0000","last_became_active":"2023-05-17T15:10:21.296805+0000","last_became_peered":"2023-05-17T15:10:21.296805+0000","last_unstale":"2023-05-17T15:10:21.681239+0000","last_undegraded":"2023-05-17T15:10:21.681239+0000","last_fullsized":"2023-05-17T15:10:21.681239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686740+0000","last_change":"2023-05-17T15:10:21.681045+0000","last_active":"2023-05-17T15:10:21.686740+0000","last_peered":"2023-05-17T15:10:21.686740+0000","last_clean":"2023-05-17T15:10:21.686740+0000","last_became_active":"2023-05-17T15:10:21.680765+0000","last_became_peered":"2023-05-17T15:10:21.680765+0000","last_unstale":"2023-05-17T15:10:21.686740+0000","last_undegraded":"2023-05-17T15:10:21.686740+0000","last_fullsized":"2023-05-17T15:10:21.686740+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697076+0000","last_change":"2023-05-17T15:10:21.694208+0000","last_active":"2023-05-17T15:10:21.697076+0000","last_peered":"2023-05-17T15:10:21.697076+0000","last_clean":"2023-05-17T15:10:21.697076+0000","last_became_active":"2023-05-17T15:10:21.693812+0000","last_became_peered":"2023-05-17T15:10:21.693812+0000","last_unstale":"2023-05-17T15:10:21.697076+0000","last_undegraded":"2023-05-17T15:10:21.697076+0000","last_fullsized":"2023-05-17T15:10:21.697076+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682140+0000","last_change":"2023-05-17T15:10:21.293631+0000","last_active":"2023-05-17T15:10:21.682140+0000","last_peered":"2023-05-17T15:10:21.682140+0000","last_clean":"2023-05-17T15:10:21.682140+0000","last_became_active":"2023-05-17T15:10:21.293366+0000","last_became_peered":"2023-05-17T15:10:21.293366+0000","last_unstale":"2023-05-17T15:10:21.682140+0000","last_undegraded":"2023-05-17T15:10:21.682140+0000","last_fullsized":"2023-05-17T15:10:21.682140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693690+0000","last_change":"2023-05-17T15:10:21.688471+0000","last_active":"2023-05-17T15:10:21.693690+0000","last_peered":"2023-05-17T15:10:21.693690+0000","last_clean":"2023-05-17T15:10:21.693690+0000","last_became_active":"2023-05-17T15:10:21.688210+0000","last_became_peered":"2023-05-17T15:10:21.688210+0000","last_unstale":"2023-05-17T15:10:21.693690+0000","last_undegraded":"2023-05-17T15:10:21.693690+0000","last_fullsized":"2023-05-17T15:10:21.693690+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694629+0000","last_change":"2023-05-17T15:10:21.693002+0000","last_active":"2023-05-17T15:10:21.694629+0000","last_peered":"2023-05-17T15:10:21.694629+0000","last_clean":"2023-05-17T15:10:21.694629+0000","last_became_active":"2023-05-17T15:10:21.690224+0000","last_became_peered":"2023-05-17T15:10:21.690224+0000","last_unstale":"2023-05-17T15:10:21.694629+0000","last_undegraded":"2023-05-17T15:10:21.694629+0000","last_fullsized":"2023-05-17T15:10:21.694629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670786+0000","last_change":"2023-05-17T15:10:21.297424+0000","last_active":"2023-05-17T15:10:21.670786+0000","last_peered":"2023-05-17T15:10:21.670786+0000","last_clean":"2023-05-17T15:10:21.670786+0000","last_became_active":"2023-05-17T15:10:21.296968+0000","last_became_peered":"2023-05-17T15:10:21.296968+0000","last_unstale":"2023-05-17T15:10:21.670786+0000","last_undegraded":"2023-05-17T15:10:21.670786+0000","last_fullsized":"2023-05-17T15:10:21.670786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696269+0000","last_change":"2023-05-17T15:10:21.686410+0000","last_active":"2023-05-17T15:10:21.696269+0000","last_peered":"2023-05-17T15:10:21.696269+0000","last_clean":"2023-05-17T15:10:21.696269+0000","last_became_active":"2023-05-17T15:10:21.685577+0000","last_became_peered":"2023-05-17T15:10:21.685577+0000","last_unstale":"2023-05-17T15:10:21.696269+0000","last_undegraded":"2023-05-17T15:10:21.696269+0000","last_fullsized":"2023-05-17T15:10:21.696269+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670815+0000","last_change":"2023-05-17T15:10:21.297742+0000","last_active":"2023-05-17T15:10:21.670815+0000","last_peered":"2023-05-17T15:10:21.670815+0000","last_clean":"2023-05-17T15:10:21.670815+0000","last_became_active":"2023-05-17T15:10:21.295280+0000","last_became_peered":"2023-05-17T15:10:21.295280+0000","last_unstale":"2023-05-17T15:10:21.670815+0000","last_undegraded":"2023-05-17T15:10:21.670815+0000","last_fullsized":"2023-05-17T15:10:21.670815+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693624+0000","last_change":"2023-05-17T15:10:21.686165+0000","last_active":"2023-05-17T15:10:21.693624+0000","last_peered":"2023-05-17T15:10:21.693624+0000","last_clean":"2023-05-17T15:10:21.693624+0000","last_became_active":"2023-05-17T15:10:21.685897+0000","last_became_peered":"2023-05-17T15:10:21.685897+0000","last_unstale":"2023-05-17T15:10:21.693624+0000","last_undegraded":"2023-05-17T15:10:21.693624+0000","last_fullsized":"2023-05-17T15:10:21.693624+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682219+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:21.682219+0000","last_peered":"2023-05-17T15:10:21.682219+0000","last_clean":"2023-05-17T15:10:21.682219+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:21.682219+0000","last_undegraded":"2023-05-17T15:10:21.682219+0000","last_fullsized":"2023-05-17T15:10:21.682219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693195+0000","last_change":"2023-05-17T15:10:21.685833+0000","last_active":"2023-05-17T15:10:21.693195+0000","last_peered":"2023-05-17T15:10:21.693195+0000","last_clean":"2023-05-17T15:10:21.693195+0000","last_became_active":"2023-05-17T15:10:21.685558+0000","last_became_peered":"2023-05-17T15:10:21.685558+0000","last_unstale":"2023-05-17T15:10:21.693195+0000","last_undegraded":"2023-05-17T15:10:21.693195+0000","last_fullsized":"2023-05-17T15:10:21.693195+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673594+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:21.673594+0000","last_peered":"2023-05-17T15:10:21.673594+0000","last_clean":"2023-05-17T15:10:21.673594+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:21.673594+0000","last_undegraded":"2023-05-17T15:10:21.673594+0000","last_fullsized":"2023-05-17T15:10:21.673594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689689+0000","last_change":"2023-05-17T15:10:21.687760+0000","last_active":"2023-05-17T15:10:21.689689+0000","last_peered":"2023-05-17T15:10:21.689689+0000","last_clean":"2023-05-17T15:10:21.689689+0000","last_became_active":"2023-05-17T15:10:21.687515+0000","last_became_peered":"2023-05-17T15:10:21.687515+0000","last_unstale":"2023-05-17T15:10:21.689689+0000","last_undegraded":"2023-05-17T15:10:21.689689+0000","last_fullsized":"2023-05-17T15:10:21.689689+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674769+0000","last_change":"2023-05-17T15:10:21.296404+0000","last_active":"2023-05-17T15:10:21.674769+0000","last_peered":"2023-05-17T15:10:21.674769+0000","last_clean":"2023-05-17T15:10:21.674769+0000","last_became_active":"2023-05-17T15:10:21.296102+0000","last_became_peered":"2023-05-17T15:10:21.296102+0000","last_unstale":"2023-05-17T15:10:21.674769+0000","last_undegraded":"2023-05-17T15:10:21.674769+0000","last_fullsized":"2023-05-17T15:10:21.674769+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670607+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:21.670607+0000","last_peered":"2023-05-17T15:10:21.670607+0000","last_clean":"2023-05-17T15:10:21.670607+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:21.670607+0000","last_undegraded":"2023-05-17T15:10:21.670607+0000","last_fullsized":"2023-05-17T15:10:21.670607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.693385+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.682985+0000","last_became_peered":"2023-05-17T15:10:21.682985+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694622+0000","last_change":"2023-05-17T15:10:21.293923+0000","last_active":"2023-05-17T15:10:21.694622+0000","last_peered":"2023-05-17T15:10:21.694622+0000","last_clean":"2023-05-17T15:10:21.694622+0000","last_became_active":"2023-05-17T15:10:21.290866+0000","last_became_peered":"2023-05-17T15:10:21.290866+0000","last_unstale":"2023-05-17T15:10:21.694622+0000","last_undegraded":"2023-05-17T15:10:21.694622+0000","last_fullsized":"2023-05-17T15:10:21.694622+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675429+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:21.675429+0000","last_peered":"2023-05-17T15:10:21.675429+0000","last_clean":"2023-05-17T15:10:21.675429+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:21.675429+0000","last_undegraded":"2023-05-17T15:10:21.675429+0000","last_fullsized":"2023-05-17T15:10:21.675429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328747+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:16.328747+0000","last_peered":"2023-05-17T15:10:16.328747+0000","last_clean":"2023-05-17T15:10:16.328747+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:16.328747+0000","last_undegraded":"2023-05-17T15:10:16.328747+0000","last_fullsized":"2023-05-17T15:10:16.328747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328734+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:16.328734+0000","last_peered":"2023-05-17T15:10:16.328734+0000","last_clean":"2023-05-17T15:10:16.328734+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:16.328734+0000","last_undegraded":"2023-05-17T15:10:16.328734+0000","last_fullsized":"2023-05-17T15:10:16.328734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694563+0000","last_change":"2023-05-17T15:10:21.692741+0000","last_active":"2023-05-17T15:10:21.694563+0000","last_peered":"2023-05-17T15:10:21.694563+0000","last_clean":"2023-05-17T15:10:21.694563+0000","last_became_active":"2023-05-17T15:10:21.690100+0000","last_became_peered":"2023-05-17T15:10:21.690100+0000","last_unstale":"2023-05-17T15:10:21.694563+0000","last_undegraded":"2023-05-17T15:10:21.694563+0000","last_fullsized":"2023-05-17T15:10:21.694563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670906+0000","last_change":"2023-05-17T15:10:21.297556+0000","last_active":"2023-05-17T15:10:21.670906+0000","last_peered":"2023-05-17T15:10:21.670906+0000","last_clean":"2023-05-17T15:10:21.670906+0000","last_became_active":"2023-05-17T15:10:21.289321+0000","last_became_peered":"2023-05-17T15:10:21.289321+0000","last_unstale":"2023-05-17T15:10:21.670906+0000","last_undegraded":"2023-05-17T15:10:21.670906+0000","last_fullsized":"2023-05-17T15:10:21.670906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328740+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:16.328740+0000","last_peered":"2023-05-17T15:10:16.328740+0000","last_clean":"2023-05-17T15:10:16.328740+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:16.328740+0000","last_undegraded":"2023-05-17T15:10:16.328740+0000","last_fullsized":"2023-05-17T15:10:16.328740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692726+0000","last_change":"2023-05-17T15:10:21.688711+0000","last_active":"2023-05-17T15:10:21.692726+0000","last_peered":"2023-05-17T15:10:21.692726+0000","last_clean":"2023-05-17T15:10:21.692726+0000","last_became_active":"2023-05-17T15:10:21.688420+0000","last_became_peered":"2023-05-17T15:10:21.688420+0000","last_unstale":"2023-05-17T15:10:21.692726+0000","last_undegraded":"2023-05-17T15:10:21.692726+0000","last_fullsized":"2023-05-17T15:10:21.692726+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694327+0000","last_change":"2023-05-17T15:10:21.295531+0000","last_active":"2023-05-17T15:10:21.694327+0000","last_peered":"2023-05-17T15:10:21.694327+0000","last_clean":"2023-05-17T15:10:21.694327+0000","last_became_active":"2023-05-17T15:10:21.295253+0000","last_became_peered":"2023-05-17T15:10:21.295253+0000","last_unstale":"2023-05-17T15:10:21.694327+0000","last_undegraded":"2023-05-17T15:10:21.694327+0000","last_fullsized":"2023-05-17T15:10:21.694327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686122+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:21.686122+0000","last_peered":"2023-05-17T15:10:21.686122+0000","last_clean":"2023-05-17T15:10:21.686122+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:21.686122+0000","last_undegraded":"2023-05-17T15:10:21.686122+0000","last_fullsized":"2023-05-17T15:10:21.686122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692908+0000","last_change":"2023-05-17T15:10:21.690118+0000","last_active":"2023-05-17T15:10:21.692908+0000","last_peered":"2023-05-17T15:10:21.692908+0000","last_clean":"2023-05-17T15:10:21.692908+0000","last_became_active":"2023-05-17T15:10:21.689835+0000","last_became_peered":"2023-05-17T15:10:21.689835+0000","last_unstale":"2023-05-17T15:10:21.692908+0000","last_undegraded":"2023-05-17T15:10:21.692908+0000","last_fullsized":"2023-05-17T15:10:21.692908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670901+0000","last_change":"2023-05-17T15:10:21.297233+0000","last_active":"2023-05-17T15:10:21.670901+0000","last_peered":"2023-05-17T15:10:21.670901+0000","last_clean":"2023-05-17T15:10:21.670901+0000","last_became_active":"2023-05-17T15:10:21.291087+0000","last_became_peered":"2023-05-17T15:10:21.291087+0000","last_unstale":"2023-05-17T15:10:21.670901+0000","last_undegraded":"2023-05-17T15:10:21.670901+0000","last_fullsized":"2023-05-17T15:10:21.670901+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328912+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:16.328912+0000","last_peered":"2023-05-17T15:10:16.328912+0000","last_clean":"2023-05-17T15:10:16.328912+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:16.328912+0000","last_undegraded":"2023-05-17T15:10:16.328912+0000","last_fullsized":"2023-05-17T15:10:16.328912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":658,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":76,"acting":76,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18376,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353464,"statfs":{"total":96636764160,"available":96617947136,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.64800000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17928,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353912,"statfs":{"total":96636764160,"available":96618405888,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59799999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.629}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.44},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17992,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353848,"statfs":{"total":96636764160,"available":96618340352,"internally_reserved":0,"allocated":1572864,"data_stored":785301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.33700000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17668,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354172,"statfs":{"total":96636764160,"available":96618672128,"internally_reserved":0,"allocated":1568768,"data_stored":784485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.378}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19072,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":17536,"kb_avail":94352768,"statfs":{"total":96636764160,"available":96617234432,"internally_reserved":0,"allocated":1564672,"data_stored":783855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17956864},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.249},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.313}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.72099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":20480,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":1556480,"data_stored":783751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20971520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.46899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":18120,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353720,"statfs":{"total":96636764160,"available":96618209280,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.441},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.48399999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.374},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21564,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350276,"statfs":{"total":96636764160,"available":96614682624,"internally_reserved":0,"allocated":1560576,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77500000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.82999999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:10:26.099 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:10:26.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.245+0000 7fbc261f0700 1 Processor -- start 2023-05-17T15:10:26.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.245+0000 7fbc261f0700 1 -- start start 2023-05-17T15:10:26.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc261f0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc200c5f30 0x7fbc200c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc261f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc20158880 0x7fbc20153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc261f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc201541c0 0x7fbc200c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc261f0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200bfcd0 con 0x7fbc200c5f30 2023-05-17T15:10:26.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc261f0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200c0290 con 0x7fbc201541c0 2023-05-17T15:10:26.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc261f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200aa1a0 con 0x7fbc20158880 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc200c5f30 0x7fbc200c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc200c5f30 0x7fbc200c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42472/0 (socket says 172.21.15.27:42472) 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 -- 172.21.15.27:0/4032047375 learned_addr learned my addr 172.21.15.27:0/4032047375 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1effd700 1 --2- 172.21.15.27:0/4032047375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc20158880 0x7fbc20153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1ffff700 1 --2- 172.21.15.27:0/4032047375 >> v2:172.21.15.40:3300/0 conn(0x7fbc201541c0 0x7fbc200c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 -- 172.21.15.27:0/4032047375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc20158880 msgr2=0x7fbc20153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4032047375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc20158880 0x7fbc20153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 -- 172.21.15.27:0/4032047375 >> v2:172.21.15.40:3300/0 conn(0x7fbc201541c0 msgr2=0x7fbc200c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4032047375 >> v2:172.21.15.40:3300/0 conn(0x7fbc201541c0 0x7fbc200c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 -- 172.21.15.27:0/4032047375 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200aa480 con 0x7fbc200c5f30 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4032047375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc200c5f30 0x7fbc200c6310 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fbc200c6830 tx=0x7fbc080090f0).ready entity=mon.0 client_cookie=8bccc64932ab070b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1e7fc700 1 -- 172.21.15.27:0/4032047375 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800b600 con 0x7fbc200c5f30 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1e7fc700 1 -- 172.21.15.27:0/4032047375 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800b760 con 0x7fbc200c5f30 2023-05-17T15:10:26.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.246+0000 7fbc1e7fc700 1 -- 172.21.15.27:0/4032047375 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800bae0 con 0x7fbc200c5f30 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 -- 172.21.15.27:0/4032047375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc200c5f30 msgr2=0x7fbc200c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4032047375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc200c5f30 0x7fbc200c6310 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fbc200c6830 tx=0x7fbc080090f0).stop 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 -- 172.21.15.27:0/4032047375 shutdown_connections 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4032047375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc200c5f30 0x7fbc200c6310 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4032047375 >> v2:172.21.15.40:3300/0 conn(0x7fbc201541c0 0x7fbc200c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4032047375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc20158880 0x7fbc20153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 -- 172.21.15.27:0/4032047375 >> 172.21.15.27:0/4032047375 conn(0x7fbc20069e70 msgr2=0x7fbc2005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 -- 172.21.15.27:0/4032047375 shutdown_connections 2023-05-17T15:10:26.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.247+0000 7fbc261f0700 1 -- 172.21.15.27:0/4032047375 wait complete. 2023-05-17T15:10:26.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.248+0000 7fbc261f0700 1 Processor -- start 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.248+0000 7fbc261f0700 1 -- start start 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc261f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc200c5f30 0x7fbc20144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc261f0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 0x7fbc201548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc261f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc20158880 0x7fbc200c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc261f0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20166990 con 0x7fbc201541c0 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc261f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20154de0 con 0x7fbc20158880 2023-05-17T15:10:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc261f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20165d80 con 0x7fbc200c5f30 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 0x7fbc201548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 0x7fbc201548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42480/0 (socket says 172.21.15.27:42480) 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 -- 172.21.15.27:0/4015991298 learned_addr learned my addr 172.21.15.27:0/4015991298 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc200c5f30 0x7fbc20144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1ffff700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc20158880 0x7fbc200c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 -- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc200c5f30 msgr2=0x7fbc20144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc200c5f30 0x7fbc20144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 -- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc20158880 msgr2=0x7fbc200c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc20158880 0x7fbc200c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 -- 172.21.15.27:0/4015991298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08009370 con 0x7fbc201541c0 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc200c5f30 0x7fbc20144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1ffff700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc20158880 0x7fbc200c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.249+0000 7fbc1effd700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 0x7fbc201548f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fbc1000d860 tx=0x7fbc10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.250+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10011590 con 0x7fbc201541c0 2023-05-17T15:10:26.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.250+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc100116f0 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.250+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc20166060 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.250+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10011a70 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.250+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc20166620 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.250+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2005f4a0 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.251+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbc10012420 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.251+0000 7fbc177fe700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbc0005ed90 0x7fbc00061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.251+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbc10079730 con 0x7fbc201541c0 2023-05-17T15:10:26.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.251+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbc0005ed90 0x7fbc00061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.252+0000 7fbc1f7fe700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbc0005ed90 0x7fbc00061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbc08009fd0 tx=0x7fbc08017000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:26.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.255+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc1004ac10 con 0x7fbc201541c0 2023-05-17T15:10:26.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.422+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc2006bdf0 con 0x7fbc0005ed90 2023-05-17T15:10:26.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.432+0000 7fbc177fe700 1 -- 172.21.15.27:0/4015991298 <== mgr.7389 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357173 (secure 0 0 0) 0x7fbc2006bdf0 con 0x7fbc0005ed90 2023-05-17T15:10:26.439 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbc0005ed90 msgr2=0x7fbc00061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbc0005ed90 0x7fbc00061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbc08009fd0 tx=0x7fbc08017000).stop 2023-05-17T15:10:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 msgr2=0x7fbc201548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 0x7fbc201548f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fbc1000d860 tx=0x7fbc10008040).stop 2023-05-17T15:10:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 shutdown_connections 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fbc0005ed90 0x7fbc00061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc20158880 0x7fbc200c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc200c5f30 0x7fbc20144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 --2- 172.21.15.27:0/4015991298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc201541c0 0x7fbc201548f0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.435+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 >> 172.21.15.27:0/4015991298 conn(0x7fbc20069e70 msgr2=0x7fbc200ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.436+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 shutdown_connections 2023-05-17T15:10:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.436+0000 7fbc261f0700 1 -- 172.21.15.27:0/4015991298 wait complete. 2023-05-17T15:10:26.443 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:10:26.451 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:10:24.729968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":152728,"kb_used_data":12056,"kb_used_omap":0,"kb_used_meta":140608,"kb_avail":754821992,"statfs":{"total":773094113280,"available":772937719808,"internally_reserved":0,"allocated":12345344,"data_stored":6191401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":143982592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.507476"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689060+0000","last_change":"2023-05-17T15:10:21.683295+0000","last_active":"2023-05-17T15:10:21.689060+0000","last_peered":"2023-05-17T15:10:21.689060+0000","last_clean":"2023-05-17T15:10:21.689060+0000","last_became_active":"2023-05-17T15:10:21.682915+0000","last_became_peered":"2023-05-17T15:10:21.682915+0000","last_unstale":"2023-05-17T15:10:21.689060+0000","last_undegraded":"2023-05-17T15:10:21.689060+0000","last_fullsized":"2023-05-17T15:10:21.689060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697693+0000","last_change":"2023-05-17T15:10:21.299521+0000","last_active":"2023-05-17T15:10:21.697693+0000","last_peered":"2023-05-17T15:10:21.697693+0000","last_clean":"2023-05-17T15:10:21.697693+0000","last_became_active":"2023-05-17T15:10:21.299249+0000","last_became_peered":"2023-05-17T15:10:21.299249+0000","last_unstale":"2023-05-17T15:10:21.697693+0000","last_undegraded":"2023-05-17T15:10:21.697693+0000","last_fullsized":"2023-05-17T15:10:21.697693+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681030+0000","last_change":"2023-05-17T15:10:21.292372+0000","last_active":"2023-05-17T15:10:21.681030+0000","last_peered":"2023-05-17T15:10:21.681030+0000","last_clean":"2023-05-17T15:10:21.681030+0000","last_became_active":"2023-05-17T15:10:21.291668+0000","last_became_peered":"2023-05-17T15:10:21.291668+0000","last_unstale":"2023-05-17T15:10:21.681030+0000","last_undegraded":"2023-05-17T15:10:21.681030+0000","last_fullsized":"2023-05-17T15:10:21.681030+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685863+0000","last_change":"2023-05-17T15:10:21.299601+0000","last_active":"2023-05-17T15:10:21.685863+0000","last_peered":"2023-05-17T15:10:21.685863+0000","last_clean":"2023-05-17T15:10:21.685863+0000","last_became_active":"2023-05-17T15:10:21.299304+0000","last_became_peered":"2023-05-17T15:10:21.299304+0000","last_unstale":"2023-05-17T15:10:21.685863+0000","last_undegraded":"2023-05-17T15:10:21.685863+0000","last_fullsized":"2023-05-17T15:10:21.685863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689518+0000","last_change":"2023-05-17T15:10:21.682112+0000","last_active":"2023-05-17T15:10:21.689518+0000","last_peered":"2023-05-17T15:10:21.689518+0000","last_clean":"2023-05-17T15:10:21.689518+0000","last_became_active":"2023-05-17T15:10:21.681845+0000","last_became_peered":"2023-05-17T15:10:21.681845+0000","last_unstale":"2023-05-17T15:10:21.689518+0000","last_undegraded":"2023-05-17T15:10:21.689518+0000","last_fullsized":"2023-05-17T15:10:21.689518+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693301+0000","last_change":"2023-05-17T15:10:21.292923+0000","last_active":"2023-05-17T15:10:21.693301+0000","last_peered":"2023-05-17T15:10:21.693301+0000","last_clean":"2023-05-17T15:10:21.693301+0000","last_became_active":"2023-05-17T15:10:21.292654+0000","last_became_peered":"2023-05-17T15:10:21.292654+0000","last_unstale":"2023-05-17T15:10:21.693301+0000","last_undegraded":"2023-05-17T15:10:21.693301+0000","last_fullsized":"2023-05-17T15:10:21.693301+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696983+0000","last_change":"2023-05-17T15:10:21.688215+0000","last_active":"2023-05-17T15:10:21.696983+0000","last_peered":"2023-05-17T15:10:21.696983+0000","last_clean":"2023-05-17T15:10:21.696983+0000","last_became_active":"2023-05-17T15:10:21.687921+0000","last_became_peered":"2023-05-17T15:10:21.687921+0000","last_unstale":"2023-05-17T15:10:21.696983+0000","last_undegraded":"2023-05-17T15:10:21.696983+0000","last_fullsized":"2023-05-17T15:10:21.696983+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681289+0000","last_change":"2023-05-17T15:10:21.294570+0000","last_active":"2023-05-17T15:10:21.681289+0000","last_peered":"2023-05-17T15:10:21.681289+0000","last_clean":"2023-05-17T15:10:21.681289+0000","last_became_active":"2023-05-17T15:10:21.293467+0000","last_became_peered":"2023-05-17T15:10:21.293467+0000","last_unstale":"2023-05-17T15:10:21.681289+0000","last_undegraded":"2023-05-17T15:10:21.681289+0000","last_fullsized":"2023-05-17T15:10:21.681289+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688641+0000","last_change":"2023-05-17T15:10:21.682283+0000","last_active":"2023-05-17T15:10:21.688641+0000","last_peered":"2023-05-17T15:10:21.688641+0000","last_clean":"2023-05-17T15:10:21.688641+0000","last_became_active":"2023-05-17T15:10:21.682017+0000","last_became_peered":"2023-05-17T15:10:21.682017+0000","last_unstale":"2023-05-17T15:10:21.688641+0000","last_undegraded":"2023-05-17T15:10:21.688641+0000","last_fullsized":"2023-05-17T15:10:21.688641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699575+0000","last_change":"2023-05-17T15:10:21.698224+0000","last_active":"2023-05-17T15:10:21.699575+0000","last_peered":"2023-05-17T15:10:21.699575+0000","last_clean":"2023-05-17T15:10:21.699575+0000","last_became_active":"2023-05-17T15:10:21.697946+0000","last_became_peered":"2023-05-17T15:10:21.697946+0000","last_unstale":"2023-05-17T15:10:21.699575+0000","last_undegraded":"2023-05-17T15:10:21.699575+0000","last_fullsized":"2023-05-17T15:10:21.699575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692164+0000","last_change":"2023-05-17T15:10:21.689824+0000","last_active":"2023-05-17T15:10:21.692164+0000","last_peered":"2023-05-17T15:10:21.692164+0000","last_clean":"2023-05-17T15:10:21.692164+0000","last_became_active":"2023-05-17T15:10:21.689431+0000","last_became_peered":"2023-05-17T15:10:21.689431+0000","last_unstale":"2023-05-17T15:10:21.692164+0000","last_undegraded":"2023-05-17T15:10:21.692164+0000","last_fullsized":"2023-05-17T15:10:21.692164+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694262+0000","last_change":"2023-05-17T15:10:21.689351+0000","last_active":"2023-05-17T15:10:21.694262+0000","last_peered":"2023-05-17T15:10:21.694262+0000","last_clean":"2023-05-17T15:10:21.694262+0000","last_became_active":"2023-05-17T15:10:21.689089+0000","last_became_peered":"2023-05-17T15:10:21.689089+0000","last_unstale":"2023-05-17T15:10:21.694262+0000","last_undegraded":"2023-05-17T15:10:21.694262+0000","last_fullsized":"2023-05-17T15:10:21.694262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692633+0000","last_change":"2023-05-17T15:10:21.298019+0000","last_active":"2023-05-17T15:10:21.692633+0000","last_peered":"2023-05-17T15:10:21.692633+0000","last_clean":"2023-05-17T15:10:21.692633+0000","last_became_active":"2023-05-17T15:10:21.294051+0000","last_became_peered":"2023-05-17T15:10:21.294051+0000","last_unstale":"2023-05-17T15:10:21.692633+0000","last_undegraded":"2023-05-17T15:10:21.692633+0000","last_fullsized":"2023-05-17T15:10:21.692633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.695998+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.695779+0000","last_became_peered":"2023-05-17T15:10:21.695779+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670675+0000","last_change":"2023-05-17T15:10:21.298810+0000","last_active":"2023-05-17T15:10:21.670675+0000","last_peered":"2023-05-17T15:10:21.670675+0000","last_clean":"2023-05-17T15:10:21.670675+0000","last_became_active":"2023-05-17T15:10:21.298535+0000","last_became_peered":"2023-05-17T15:10:21.298535+0000","last_unstale":"2023-05-17T15:10:21.670675+0000","last_undegraded":"2023-05-17T15:10:21.670675+0000","last_fullsized":"2023-05-17T15:10:21.670675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675380+0000","last_change":"2023-05-17T15:10:21.291603+0000","last_active":"2023-05-17T15:10:21.675380+0000","last_peered":"2023-05-17T15:10:21.675380+0000","last_clean":"2023-05-17T15:10:21.675380+0000","last_became_active":"2023-05-17T15:10:21.289948+0000","last_became_peered":"2023-05-17T15:10:21.289948+0000","last_unstale":"2023-05-17T15:10:21.675380+0000","last_undegraded":"2023-05-17T15:10:21.675380+0000","last_fullsized":"2023-05-17T15:10:21.675380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699525+0000","last_change":"2023-05-17T15:10:21.697668+0000","last_active":"2023-05-17T15:10:21.699525+0000","last_peered":"2023-05-17T15:10:21.699525+0000","last_clean":"2023-05-17T15:10:21.699525+0000","last_became_active":"2023-05-17T15:10:21.697419+0000","last_became_peered":"2023-05-17T15:10:21.697419+0000","last_unstale":"2023-05-17T15:10:21.699525+0000","last_undegraded":"2023-05-17T15:10:21.699525+0000","last_fullsized":"2023-05-17T15:10:21.699525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681170+0000","last_change":"2023-05-17T15:10:21.288238+0000","last_active":"2023-05-17T15:10:21.681170+0000","last_peered":"2023-05-17T15:10:21.681170+0000","last_clean":"2023-05-17T15:10:21.681170+0000","last_became_active":"2023-05-17T15:10:21.287952+0000","last_became_peered":"2023-05-17T15:10:21.287952+0000","last_unstale":"2023-05-17T15:10:21.681170+0000","last_undegraded":"2023-05-17T15:10:21.681170+0000","last_fullsized":"2023-05-17T15:10:21.681170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.676011+0000","last_change":"2023-05-17T15:10:21.293333+0000","last_active":"2023-05-17T15:10:21.676011+0000","last_peered":"2023-05-17T15:10:21.676011+0000","last_clean":"2023-05-17T15:10:21.676011+0000","last_became_active":"2023-05-17T15:10:21.291969+0000","last_became_peered":"2023-05-17T15:10:21.291969+0000","last_unstale":"2023-05-17T15:10:21.676011+0000","last_undegraded":"2023-05-17T15:10:21.676011+0000","last_fullsized":"2023-05-17T15:10:21.676011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693914+0000","last_change":"2023-05-17T15:10:21.290304+0000","last_active":"2023-05-17T15:10:21.693914+0000","last_peered":"2023-05-17T15:10:21.693914+0000","last_clean":"2023-05-17T15:10:21.693914+0000","last_became_active":"2023-05-17T15:10:21.290023+0000","last_became_peered":"2023-05-17T15:10:21.290023+0000","last_unstale":"2023-05-17T15:10:21.693914+0000","last_undegraded":"2023-05-17T15:10:21.693914+0000","last_fullsized":"2023-05-17T15:10:21.693914+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693819+0000","last_change":"2023-05-17T15:10:21.687930+0000","last_active":"2023-05-17T15:10:21.693819+0000","last_peered":"2023-05-17T15:10:21.693819+0000","last_clean":"2023-05-17T15:10:21.693819+0000","last_became_active":"2023-05-17T15:10:21.687700+0000","last_became_peered":"2023-05-17T15:10:21.687700+0000","last_unstale":"2023-05-17T15:10:21.693819+0000","last_undegraded":"2023-05-17T15:10:21.693819+0000","last_fullsized":"2023-05-17T15:10:21.693819+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697136+0000","last_change":"2023-05-17T15:10:21.298512+0000","last_active":"2023-05-17T15:10:21.697136+0000","last_peered":"2023-05-17T15:10:21.697136+0000","last_clean":"2023-05-17T15:10:21.697136+0000","last_became_active":"2023-05-17T15:10:21.298105+0000","last_became_peered":"2023-05-17T15:10:21.298105+0000","last_unstale":"2023-05-17T15:10:21.697136+0000","last_undegraded":"2023-05-17T15:10:21.697136+0000","last_fullsized":"2023-05-17T15:10:21.697136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698112+0000","last_change":"2023-05-17T15:10:21.695099+0000","last_active":"2023-05-17T15:10:21.698112+0000","last_peered":"2023-05-17T15:10:21.698112+0000","last_clean":"2023-05-17T15:10:21.698112+0000","last_became_active":"2023-05-17T15:10:21.694788+0000","last_became_peered":"2023-05-17T15:10:21.694788+0000","last_unstale":"2023-05-17T15:10:21.698112+0000","last_undegraded":"2023-05-17T15:10:21.698112+0000","last_fullsized":"2023-05-17T15:10:21.698112+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679296+0000","last_change":"2023-05-17T15:10:21.297458+0000","last_active":"2023-05-17T15:10:21.679296+0000","last_peered":"2023-05-17T15:10:21.679296+0000","last_clean":"2023-05-17T15:10:21.679296+0000","last_became_active":"2023-05-17T15:10:21.297156+0000","last_became_peered":"2023-05-17T15:10:21.297156+0000","last_unstale":"2023-05-17T15:10:21.679296+0000","last_undegraded":"2023-05-17T15:10:21.679296+0000","last_fullsized":"2023-05-17T15:10:21.679296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690230+0000","last_change":"2023-05-17T15:10:21.686606+0000","last_active":"2023-05-17T15:10:21.690230+0000","last_peered":"2023-05-17T15:10:21.690230+0000","last_clean":"2023-05-17T15:10:21.690230+0000","last_became_active":"2023-05-17T15:10:21.686335+0000","last_became_peered":"2023-05-17T15:10:21.686335+0000","last_unstale":"2023-05-17T15:10:21.690230+0000","last_undegraded":"2023-05-17T15:10:21.690230+0000","last_fullsized":"2023-05-17T15:10:21.690230+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679535+0000","last_change":"2023-05-17T15:10:21.288322+0000","last_active":"2023-05-17T15:10:21.679535+0000","last_peered":"2023-05-17T15:10:21.679535+0000","last_clean":"2023-05-17T15:10:21.679535+0000","last_became_active":"2023-05-17T15:10:21.288046+0000","last_became_peered":"2023-05-17T15:10:21.288046+0000","last_unstale":"2023-05-17T15:10:21.679535+0000","last_undegraded":"2023-05-17T15:10:21.679535+0000","last_fullsized":"2023-05-17T15:10:21.679535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686781+0000","last_change":"2023-05-17T15:10:21.678612+0000","last_active":"2023-05-17T15:10:21.686781+0000","last_peered":"2023-05-17T15:10:21.686781+0000","last_clean":"2023-05-17T15:10:21.686781+0000","last_became_active":"2023-05-17T15:10:21.678335+0000","last_became_peered":"2023-05-17T15:10:21.678335+0000","last_unstale":"2023-05-17T15:10:21.686781+0000","last_undegraded":"2023-05-17T15:10:21.686781+0000","last_fullsized":"2023-05-17T15:10:21.686781+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681138+0000","last_change":"2023-05-17T15:10:21.297023+0000","last_active":"2023-05-17T15:10:21.681138+0000","last_peered":"2023-05-17T15:10:21.681138+0000","last_clean":"2023-05-17T15:10:21.681138+0000","last_became_active":"2023-05-17T15:10:21.296741+0000","last_became_peered":"2023-05-17T15:10:21.296741+0000","last_unstale":"2023-05-17T15:10:21.681138+0000","last_undegraded":"2023-05-17T15:10:21.681138+0000","last_fullsized":"2023-05-17T15:10:21.681138+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692213+0000","last_change":"2023-05-17T15:10:21.689525+0000","last_active":"2023-05-17T15:10:21.692213+0000","last_peered":"2023-05-17T15:10:21.692213+0000","last_clean":"2023-05-17T15:10:21.692213+0000","last_became_active":"2023-05-17T15:10:21.688968+0000","last_became_peered":"2023-05-17T15:10:21.688968+0000","last_unstale":"2023-05-17T15:10:21.692213+0000","last_undegraded":"2023-05-17T15:10:21.692213+0000","last_fullsized":"2023-05-17T15:10:21.692213+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693855+0000","last_change":"2023-05-17T15:10:21.686284+0000","last_active":"2023-05-17T15:10:21.693855+0000","last_peered":"2023-05-17T15:10:21.693855+0000","last_clean":"2023-05-17T15:10:21.693855+0000","last_became_active":"2023-05-17T15:10:21.684239+0000","last_became_peered":"2023-05-17T15:10:21.684239+0000","last_unstale":"2023-05-17T15:10:21.693855+0000","last_undegraded":"2023-05-17T15:10:21.693855+0000","last_fullsized":"2023-05-17T15:10:21.693855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679410+0000","last_change":"2023-05-17T15:10:21.297089+0000","last_active":"2023-05-17T15:10:21.679410+0000","last_peered":"2023-05-17T15:10:21.679410+0000","last_clean":"2023-05-17T15:10:21.679410+0000","last_became_active":"2023-05-17T15:10:21.296773+0000","last_became_peered":"2023-05-17T15:10:21.296773+0000","last_unstale":"2023-05-17T15:10:21.679410+0000","last_undegraded":"2023-05-17T15:10:21.679410+0000","last_fullsized":"2023-05-17T15:10:21.679410+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699232+0000","last_change":"2023-05-17T15:10:21.697475+0000","last_active":"2023-05-17T15:10:21.699232+0000","last_peered":"2023-05-17T15:10:21.699232+0000","last_clean":"2023-05-17T15:10:21.699232+0000","last_became_active":"2023-05-17T15:10:21.697193+0000","last_became_peered":"2023-05-17T15:10:21.697193+0000","last_unstale":"2023-05-17T15:10:21.699232+0000","last_undegraded":"2023-05-17T15:10:21.699232+0000","last_fullsized":"2023-05-17T15:10:21.699232+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671010+0000","last_change":"2023-05-17T15:10:21.296684+0000","last_active":"2023-05-17T15:10:21.671010+0000","last_peered":"2023-05-17T15:10:21.671010+0000","last_clean":"2023-05-17T15:10:21.671010+0000","last_became_active":"2023-05-17T15:10:21.290716+0000","last_became_peered":"2023-05-17T15:10:21.290716+0000","last_unstale":"2023-05-17T15:10:21.671010+0000","last_undegraded":"2023-05-17T15:10:21.671010+0000","last_fullsized":"2023-05-17T15:10:21.671010+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675476+0000","last_change":"2023-05-17T15:10:21.285520+0000","last_active":"2023-05-17T15:10:21.675476+0000","last_peered":"2023-05-17T15:10:21.675476+0000","last_clean":"2023-05-17T15:10:21.675476+0000","last_became_active":"2023-05-17T15:10:21.285201+0000","last_became_peered":"2023-05-17T15:10:21.285201+0000","last_unstale":"2023-05-17T15:10:21.675476+0000","last_undegraded":"2023-05-17T15:10:21.675476+0000","last_fullsized":"2023-05-17T15:10:21.675476+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694439+0000","last_change":"2023-05-17T15:10:21.693273+0000","last_active":"2023-05-17T15:10:21.694439+0000","last_peered":"2023-05-17T15:10:21.694439+0000","last_clean":"2023-05-17T15:10:21.694439+0000","last_became_active":"2023-05-17T15:10:21.692975+0000","last_became_peered":"2023-05-17T15:10:21.692975+0000","last_unstale":"2023-05-17T15:10:21.694439+0000","last_undegraded":"2023-05-17T15:10:21.694439+0000","last_fullsized":"2023-05-17T15:10:21.694439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681548+0000","last_change":"2023-05-17T15:10:21.298675+0000","last_active":"2023-05-17T15:10:21.681548+0000","last_peered":"2023-05-17T15:10:21.681548+0000","last_clean":"2023-05-17T15:10:21.681548+0000","last_became_active":"2023-05-17T15:10:21.298404+0000","last_became_peered":"2023-05-17T15:10:21.298404+0000","last_unstale":"2023-05-17T15:10:21.681548+0000","last_undegraded":"2023-05-17T15:10:21.681548+0000","last_fullsized":"2023-05-17T15:10:21.681548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696504+0000","last_change":"2023-05-17T15:10:21.694697+0000","last_active":"2023-05-17T15:10:21.696504+0000","last_peered":"2023-05-17T15:10:21.696504+0000","last_clean":"2023-05-17T15:10:21.696504+0000","last_became_active":"2023-05-17T15:10:21.694445+0000","last_became_peered":"2023-05-17T15:10:21.694445+0000","last_unstale":"2023-05-17T15:10:21.696504+0000","last_undegraded":"2023-05-17T15:10:21.696504+0000","last_fullsized":"2023-05-17T15:10:21.696504+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693885+0000","last_change":"2023-05-17T15:10:21.288608+0000","last_active":"2023-05-17T15:10:21.693885+0000","last_peered":"2023-05-17T15:10:21.693885+0000","last_clean":"2023-05-17T15:10:21.693885+0000","last_became_active":"2023-05-17T15:10:21.288281+0000","last_became_peered":"2023-05-17T15:10:21.288281+0000","last_unstale":"2023-05-17T15:10:21.693885+0000","last_undegraded":"2023-05-17T15:10:21.693885+0000","last_fullsized":"2023-05-17T15:10:21.693885+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688927+0000","last_change":"2023-05-17T15:10:21.683486+0000","last_active":"2023-05-17T15:10:21.688927+0000","last_peered":"2023-05-17T15:10:21.688927+0000","last_clean":"2023-05-17T15:10:21.688927+0000","last_became_active":"2023-05-17T15:10:21.683229+0000","last_became_peered":"2023-05-17T15:10:21.683229+0000","last_unstale":"2023-05-17T15:10:21.688927+0000","last_undegraded":"2023-05-17T15:10:21.688927+0000","last_fullsized":"2023-05-17T15:10:21.688927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693732+0000","last_change":"2023-05-17T15:10:21.295144+0000","last_active":"2023-05-17T15:10:21.693732+0000","last_peered":"2023-05-17T15:10:21.693732+0000","last_clean":"2023-05-17T15:10:21.693732+0000","last_became_active":"2023-05-17T15:10:21.294535+0000","last_became_peered":"2023-05-17T15:10:21.294535+0000","last_unstale":"2023-05-17T15:10:21.693732+0000","last_undegraded":"2023-05-17T15:10:21.693732+0000","last_fullsized":"2023-05-17T15:10:21.693732+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697058+0000","last_change":"2023-05-17T15:10:21.693852+0000","last_active":"2023-05-17T15:10:21.697058+0000","last_peered":"2023-05-17T15:10:21.697058+0000","last_clean":"2023-05-17T15:10:21.697058+0000","last_became_active":"2023-05-17T15:10:21.693190+0000","last_became_peered":"2023-05-17T15:10:21.693190+0000","last_unstale":"2023-05-17T15:10:21.697058+0000","last_undegraded":"2023-05-17T15:10:21.697058+0000","last_fullsized":"2023-05-17T15:10:21.697058+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682018+0000","last_change":"2023-05-17T15:10:21.294898+0000","last_active":"2023-05-17T15:10:21.682018+0000","last_peered":"2023-05-17T15:10:21.682018+0000","last_clean":"2023-05-17T15:10:21.682018+0000","last_became_active":"2023-05-17T15:10:21.294622+0000","last_became_peered":"2023-05-17T15:10:21.294622+0000","last_unstale":"2023-05-17T15:10:21.682018+0000","last_undegraded":"2023-05-17T15:10:21.682018+0000","last_fullsized":"2023-05-17T15:10:21.682018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693870+0000","last_change":"2023-05-17T15:10:21.691292+0000","last_active":"2023-05-17T15:10:21.693870+0000","last_peered":"2023-05-17T15:10:21.693870+0000","last_clean":"2023-05-17T15:10:21.693870+0000","last_became_active":"2023-05-17T15:10:21.691037+0000","last_became_peered":"2023-05-17T15:10:21.691037+0000","last_unstale":"2023-05-17T15:10:21.693870+0000","last_undegraded":"2023-05-17T15:10:21.693870+0000","last_fullsized":"2023-05-17T15:10:21.693870+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696614+0000","last_change":"2023-05-17T15:10:21.694755+0000","last_active":"2023-05-17T15:10:21.696614+0000","last_peered":"2023-05-17T15:10:21.696614+0000","last_clean":"2023-05-17T15:10:21.696614+0000","last_became_active":"2023-05-17T15:10:21.694471+0000","last_became_peered":"2023-05-17T15:10:21.694471+0000","last_unstale":"2023-05-17T15:10:21.696614+0000","last_undegraded":"2023-05-17T15:10:21.696614+0000","last_fullsized":"2023-05-17T15:10:21.696614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673474+0000","last_change":"2023-05-17T15:10:21.293702+0000","last_active":"2023-05-17T15:10:21.673474+0000","last_peered":"2023-05-17T15:10:21.673474+0000","last_clean":"2023-05-17T15:10:21.673474+0000","last_became_active":"2023-05-17T15:10:21.293422+0000","last_became_peered":"2023-05-17T15:10:21.293422+0000","last_unstale":"2023-05-17T15:10:21.673474+0000","last_undegraded":"2023-05-17T15:10:21.673474+0000","last_fullsized":"2023-05-17T15:10:21.673474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693266+0000","last_change":"2023-05-17T15:10:21.682997+0000","last_active":"2023-05-17T15:10:21.693266+0000","last_peered":"2023-05-17T15:10:21.693266+0000","last_clean":"2023-05-17T15:10:21.693266+0000","last_became_active":"2023-05-17T15:10:21.682798+0000","last_became_peered":"2023-05-17T15:10:21.682798+0000","last_unstale":"2023-05-17T15:10:21.693266+0000","last_undegraded":"2023-05-17T15:10:21.693266+0000","last_fullsized":"2023-05-17T15:10:21.693266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675239+0000","last_change":"2023-05-17T15:10:21.292338+0000","last_active":"2023-05-17T15:10:21.675239+0000","last_peered":"2023-05-17T15:10:21.675239+0000","last_clean":"2023-05-17T15:10:21.675239+0000","last_became_active":"2023-05-17T15:10:21.289967+0000","last_became_peered":"2023-05-17T15:10:21.289967+0000","last_unstale":"2023-05-17T15:10:21.675239+0000","last_undegraded":"2023-05-17T15:10:21.675239+0000","last_fullsized":"2023-05-17T15:10:21.675239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696914+0000","last_change":"2023-05-17T15:10:21.696004+0000","last_active":"2023-05-17T15:10:21.696914+0000","last_peered":"2023-05-17T15:10:21.696914+0000","last_clean":"2023-05-17T15:10:21.696914+0000","last_became_active":"2023-05-17T15:10:21.695768+0000","last_became_peered":"2023-05-17T15:10:21.695768+0000","last_unstale":"2023-05-17T15:10:21.696914+0000","last_undegraded":"2023-05-17T15:10:21.696914+0000","last_fullsized":"2023-05-17T15:10:21.696914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690654+0000","last_change":"2023-05-17T15:10:21.689154+0000","last_active":"2023-05-17T15:10:21.690654+0000","last_peered":"2023-05-17T15:10:21.690654+0000","last_clean":"2023-05-17T15:10:21.690654+0000","last_became_active":"2023-05-17T15:10:21.688888+0000","last_became_peered":"2023-05-17T15:10:21.688888+0000","last_unstale":"2023-05-17T15:10:21.690654+0000","last_undegraded":"2023-05-17T15:10:21.690654+0000","last_fullsized":"2023-05-17T15:10:21.690654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681341+0000","last_change":"2023-05-17T15:10:21.292560+0000","last_active":"2023-05-17T15:10:21.681341+0000","last_peered":"2023-05-17T15:10:21.681341+0000","last_clean":"2023-05-17T15:10:21.681341+0000","last_became_active":"2023-05-17T15:10:21.292093+0000","last_became_peered":"2023-05-17T15:10:21.292093+0000","last_unstale":"2023-05-17T15:10:21.681341+0000","last_undegraded":"2023-05-17T15:10:21.681341+0000","last_fullsized":"2023-05-17T15:10:21.681341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694968+0000","last_change":"2023-05-17T15:10:21.693638+0000","last_active":"2023-05-17T15:10:21.694968+0000","last_peered":"2023-05-17T15:10:21.694968+0000","last_clean":"2023-05-17T15:10:21.694968+0000","last_became_active":"2023-05-17T15:10:21.693339+0000","last_became_peered":"2023-05-17T15:10:21.693339+0000","last_unstale":"2023-05-17T15:10:21.694968+0000","last_undegraded":"2023-05-17T15:10:21.694968+0000","last_fullsized":"2023-05-17T15:10:21.694968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692231+0000","last_change":"2023-05-17T15:10:21.690962+0000","last_active":"2023-05-17T15:10:21.692231+0000","last_peered":"2023-05-17T15:10:21.692231+0000","last_clean":"2023-05-17T15:10:21.692231+0000","last_became_active":"2023-05-17T15:10:21.690681+0000","last_became_peered":"2023-05-17T15:10:21.690681+0000","last_unstale":"2023-05-17T15:10:21.692231+0000","last_undegraded":"2023-05-17T15:10:21.692231+0000","last_fullsized":"2023-05-17T15:10:21.692231+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696276+0000","last_change":"2023-05-17T15:10:21.684825+0000","last_active":"2023-05-17T15:10:21.696276+0000","last_peered":"2023-05-17T15:10:21.696276+0000","last_clean":"2023-05-17T15:10:21.696276+0000","last_became_active":"2023-05-17T15:10:21.684525+0000","last_became_peered":"2023-05-17T15:10:21.684525+0000","last_unstale":"2023-05-17T15:10:21.696276+0000","last_undegraded":"2023-05-17T15:10:21.696276+0000","last_fullsized":"2023-05-17T15:10:21.696276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691116+0000","last_change":"2023-05-17T15:10:21.290239+0000","last_active":"2023-05-17T15:10:21.691116+0000","last_peered":"2023-05-17T15:10:21.691116+0000","last_clean":"2023-05-17T15:10:21.691116+0000","last_became_active":"2023-05-17T15:10:21.289965+0000","last_became_peered":"2023-05-17T15:10:21.289965+0000","last_unstale":"2023-05-17T15:10:21.691116+0000","last_undegraded":"2023-05-17T15:10:21.691116+0000","last_fullsized":"2023-05-17T15:10:21.691116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675392+0000","last_change":"2023-05-17T15:10:21.293582+0000","last_active":"2023-05-17T15:10:21.675392+0000","last_peered":"2023-05-17T15:10:21.675392+0000","last_clean":"2023-05-17T15:10:21.675392+0000","last_became_active":"2023-05-17T15:10:21.293290+0000","last_became_peered":"2023-05-17T15:10:21.293290+0000","last_unstale":"2023-05-17T15:10:21.675392+0000","last_undegraded":"2023-05-17T15:10:21.675392+0000","last_fullsized":"2023-05-17T15:10:21.675392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689211+0000","last_change":"2023-05-17T15:10:21.683174+0000","last_active":"2023-05-17T15:10:21.689211+0000","last_peered":"2023-05-17T15:10:21.689211+0000","last_clean":"2023-05-17T15:10:21.689211+0000","last_became_active":"2023-05-17T15:10:21.682594+0000","last_became_peered":"2023-05-17T15:10:21.682594+0000","last_unstale":"2023-05-17T15:10:21.689211+0000","last_undegraded":"2023-05-17T15:10:21.689211+0000","last_fullsized":"2023-05-17T15:10:21.689211+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670511+0000","last_change":"2023-05-17T15:10:21.294708+0000","last_active":"2023-05-17T15:10:21.670511+0000","last_peered":"2023-05-17T15:10:21.670511+0000","last_clean":"2023-05-17T15:10:21.670511+0000","last_became_active":"2023-05-17T15:10:21.294391+0000","last_became_peered":"2023-05-17T15:10:21.294391+0000","last_unstale":"2023-05-17T15:10:21.670511+0000","last_undegraded":"2023-05-17T15:10:21.670511+0000","last_fullsized":"2023-05-17T15:10:21.670511+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699542+0000","last_change":"2023-05-17T15:10:21.697712+0000","last_active":"2023-05-17T15:10:21.699542+0000","last_peered":"2023-05-17T15:10:21.699542+0000","last_clean":"2023-05-17T15:10:21.699542+0000","last_became_active":"2023-05-17T15:10:21.697438+0000","last_became_peered":"2023-05-17T15:10:21.697438+0000","last_unstale":"2023-05-17T15:10:21.699542+0000","last_undegraded":"2023-05-17T15:10:21.699542+0000","last_fullsized":"2023-05-17T15:10:21.699542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690346+0000","last_change":"2023-05-17T15:10:21.687552+0000","last_active":"2023-05-17T15:10:21.690346+0000","last_peered":"2023-05-17T15:10:21.690346+0000","last_clean":"2023-05-17T15:10:21.690346+0000","last_became_active":"2023-05-17T15:10:21.687317+0000","last_became_peered":"2023-05-17T15:10:21.687317+0000","last_unstale":"2023-05-17T15:10:21.690346+0000","last_undegraded":"2023-05-17T15:10:21.690346+0000","last_fullsized":"2023-05-17T15:10:21.690346+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694620+0000","last_change":"2023-05-17T15:10:21.291005+0000","last_active":"2023-05-17T15:10:21.694620+0000","last_peered":"2023-05-17T15:10:21.694620+0000","last_clean":"2023-05-17T15:10:21.694620+0000","last_became_active":"2023-05-17T15:10:21.290732+0000","last_became_peered":"2023-05-17T15:10:21.290732+0000","last_unstale":"2023-05-17T15:10:21.694620+0000","last_undegraded":"2023-05-17T15:10:21.694620+0000","last_fullsized":"2023-05-17T15:10:21.694620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681239+0000","last_change":"2023-05-17T15:10:21.297096+0000","last_active":"2023-05-17T15:10:21.681239+0000","last_peered":"2023-05-17T15:10:21.681239+0000","last_clean":"2023-05-17T15:10:21.681239+0000","last_became_active":"2023-05-17T15:10:21.296805+0000","last_became_peered":"2023-05-17T15:10:21.296805+0000","last_unstale":"2023-05-17T15:10:21.681239+0000","last_undegraded":"2023-05-17T15:10:21.681239+0000","last_fullsized":"2023-05-17T15:10:21.681239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686740+0000","last_change":"2023-05-17T15:10:21.681045+0000","last_active":"2023-05-17T15:10:21.686740+0000","last_peered":"2023-05-17T15:10:21.686740+0000","last_clean":"2023-05-17T15:10:21.686740+0000","last_became_active":"2023-05-17T15:10:21.680765+0000","last_became_peered":"2023-05-17T15:10:21.680765+0000","last_unstale":"2023-05-17T15:10:21.686740+0000","last_undegraded":"2023-05-17T15:10:21.686740+0000","last_fullsized":"2023-05-17T15:10:21.686740+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697076+0000","last_change":"2023-05-17T15:10:21.694208+0000","last_active":"2023-05-17T15:10:21.697076+0000","last_peered":"2023-05-17T15:10:21.697076+0000","last_clean":"2023-05-17T15:10:21.697076+0000","last_became_active":"2023-05-17T15:10:21.693812+0000","last_became_peered":"2023-05-17T15:10:21.693812+0000","last_unstale":"2023-05-17T15:10:21.697076+0000","last_undegraded":"2023-05-17T15:10:21.697076+0000","last_fullsized":"2023-05-17T15:10:21.697076+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682140+0000","last_change":"2023-05-17T15:10:21.293631+0000","last_active":"2023-05-17T15:10:21.682140+0000","last_peered":"2023-05-17T15:10:21.682140+0000","last_clean":"2023-05-17T15:10:21.682140+0000","last_became_active":"2023-05-17T15:10:21.293366+0000","last_became_peered":"2023-05-17T15:10:21.293366+0000","last_unstale":"2023-05-17T15:10:21.682140+0000","last_undegraded":"2023-05-17T15:10:21.682140+0000","last_fullsized":"2023-05-17T15:10:21.682140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693690+0000","last_change":"2023-05-17T15:10:21.688471+0000","last_active":"2023-05-17T15:10:21.693690+0000","last_peered":"2023-05-17T15:10:21.693690+0000","last_clean":"2023-05-17T15:10:21.693690+0000","last_became_active":"2023-05-17T15:10:21.688210+0000","last_became_peered":"2023-05-17T15:10:21.688210+0000","last_unstale":"2023-05-17T15:10:21.693690+0000","last_undegraded":"2023-05-17T15:10:21.693690+0000","last_fullsized":"2023-05-17T15:10:21.693690+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694629+0000","last_change":"2023-05-17T15:10:21.693002+0000","last_active":"2023-05-17T15:10:21.694629+0000","last_peered":"2023-05-17T15:10:21.694629+0000","last_clean":"2023-05-17T15:10:21.694629+0000","last_became_active":"2023-05-17T15:10:21.690224+0000","last_became_peered":"2023-05-17T15:10:21.690224+0000","last_unstale":"2023-05-17T15:10:21.694629+0000","last_undegraded":"2023-05-17T15:10:21.694629+0000","last_fullsized":"2023-05-17T15:10:21.694629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670786+0000","last_change":"2023-05-17T15:10:21.297424+0000","last_active":"2023-05-17T15:10:21.670786+0000","last_peered":"2023-05-17T15:10:21.670786+0000","last_clean":"2023-05-17T15:10:21.670786+0000","last_became_active":"2023-05-17T15:10:21.296968+0000","last_became_peered":"2023-05-17T15:10:21.296968+0000","last_unstale":"2023-05-17T15:10:21.670786+0000","last_undegraded":"2023-05-17T15:10:21.670786+0000","last_fullsized":"2023-05-17T15:10:21.670786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696269+0000","last_change":"2023-05-17T15:10:21.686410+0000","last_active":"2023-05-17T15:10:21.696269+0000","last_peered":"2023-05-17T15:10:21.696269+0000","last_clean":"2023-05-17T15:10:21.696269+0000","last_became_active":"2023-05-17T15:10:21.685577+0000","last_became_peered":"2023-05-17T15:10:21.685577+0000","last_unstale":"2023-05-17T15:10:21.696269+0000","last_undegraded":"2023-05-17T15:10:21.696269+0000","last_fullsized":"2023-05-17T15:10:21.696269+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670815+0000","last_change":"2023-05-17T15:10:21.297742+0000","last_active":"2023-05-17T15:10:21.670815+0000","last_peered":"2023-05-17T15:10:21.670815+0000","last_clean":"2023-05-17T15:10:21.670815+0000","last_became_active":"2023-05-17T15:10:21.295280+0000","last_became_peered":"2023-05-17T15:10:21.295280+0000","last_unstale":"2023-05-17T15:10:21.670815+0000","last_undegraded":"2023-05-17T15:10:21.670815+0000","last_fullsized":"2023-05-17T15:10:21.670815+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693624+0000","last_change":"2023-05-17T15:10:21.686165+0000","last_active":"2023-05-17T15:10:21.693624+0000","last_peered":"2023-05-17T15:10:21.693624+0000","last_clean":"2023-05-17T15:10:21.693624+0000","last_became_active":"2023-05-17T15:10:21.685897+0000","last_became_peered":"2023-05-17T15:10:21.685897+0000","last_unstale":"2023-05-17T15:10:21.693624+0000","last_undegraded":"2023-05-17T15:10:21.693624+0000","last_fullsized":"2023-05-17T15:10:21.693624+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682219+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:21.682219+0000","last_peered":"2023-05-17T15:10:21.682219+0000","last_clean":"2023-05-17T15:10:21.682219+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:21.682219+0000","last_undegraded":"2023-05-17T15:10:21.682219+0000","last_fullsized":"2023-05-17T15:10:21.682219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693195+0000","last_change":"2023-05-17T15:10:21.685833+0000","last_active":"2023-05-17T15:10:21.693195+0000","last_peered":"2023-05-17T15:10:21.693195+0000","last_clean":"2023-05-17T15:10:21.693195+0000","last_became_active":"2023-05-17T15:10:21.685558+0000","last_became_peered":"2023-05-17T15:10:21.685558+0000","last_unstale":"2023-05-17T15:10:21.693195+0000","last_undegraded":"2023-05-17T15:10:21.693195+0000","last_fullsized":"2023-05-17T15:10:21.693195+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673594+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:21.673594+0000","last_peered":"2023-05-17T15:10:21.673594+0000","last_clean":"2023-05-17T15:10:21.673594+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:21.673594+0000","last_undegraded":"2023-05-17T15:10:21.673594+0000","last_fullsized":"2023-05-17T15:10:21.673594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689689+0000","last_change":"2023-05-17T15:10:21.687760+0000","last_active":"2023-05-17T15:10:21.689689+0000","last_peered":"2023-05-17T15:10:21.689689+0000","last_clean":"2023-05-17T15:10:21.689689+0000","last_became_active":"2023-05-17T15:10:21.687515+0000","last_became_peered":"2023-05-17T15:10:21.687515+0000","last_unstale":"2023-05-17T15:10:21.689689+0000","last_undegraded":"2023-05-17T15:10:21.689689+0000","last_fullsized":"2023-05-17T15:10:21.689689+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674769+0000","last_change":"2023-05-17T15:10:21.296404+0000","last_active":"2023-05-17T15:10:21.674769+0000","last_peered":"2023-05-17T15:10:21.674769+0000","last_clean":"2023-05-17T15:10:21.674769+0000","last_became_active":"2023-05-17T15:10:21.296102+0000","last_became_peered":"2023-05-17T15:10:21.296102+0000","last_unstale":"2023-05-17T15:10:21.674769+0000","last_undegraded":"2023-05-17T15:10:21.674769+0000","last_fullsized":"2023-05-17T15:10:21.674769+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670607+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:21.670607+0000","last_peered":"2023-05-17T15:10:21.670607+0000","last_clean":"2023-05-17T15:10:21.670607+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:21.670607+0000","last_undegraded":"2023-05-17T15:10:21.670607+0000","last_fullsized":"2023-05-17T15:10:21.670607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.693385+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.682985+0000","last_became_peered":"2023-05-17T15:10:21.682985+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694622+0000","last_change":"2023-05-17T15:10:21.293923+0000","last_active":"2023-05-17T15:10:21.694622+0000","last_peered":"2023-05-17T15:10:21.694622+0000","last_clean":"2023-05-17T15:10:21.694622+0000","last_became_active":"2023-05-17T15:10:21.290866+0000","last_became_peered":"2023-05-17T15:10:21.290866+0000","last_unstale":"2023-05-17T15:10:21.694622+0000","last_undegraded":"2023-05-17T15:10:21.694622+0000","last_fullsized":"2023-05-17T15:10:21.694622+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675429+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:21.675429+0000","last_peered":"2023-05-17T15:10:21.675429+0000","last_clean":"2023-05-17T15:10:21.675429+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:21.675429+0000","last_undegraded":"2023-05-17T15:10:21.675429+0000","last_fullsized":"2023-05-17T15:10:21.675429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328747+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:16.328747+0000","last_peered":"2023-05-17T15:10:16.328747+0000","last_clean":"2023-05-17T15:10:16.328747+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:16.328747+0000","last_undegraded":"2023-05-17T15:10:16.328747+0000","last_fullsized":"2023-05-17T15:10:16.328747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:21.265523+0000","last_change":"2023-05-17T15:10:21.265523+0000","last_active":"2023-05-17T15:10:21.265523+0000","last_peered":"2023-05-17T15:10:21.265523+0000","last_clean":"2023-05-17T15:10:21.265523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:21.265523+0000","last_undegraded":"2023-05-17T15:10:21.265523+0000","last_fullsized":"2023-05-17T15:10:21.265523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:20.258857+0000","last_change":"2023-05-17T15:10:20.258857+0000","last_active":"2023-05-17T15:10:20.258857+0000","last_peered":"2023-05-17T15:10:20.258857+0000","last_clean":"2023-05-17T15:10:20.258857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:20.258857+0000","last_undegraded":"2023-05-17T15:10:20.258857+0000","last_fullsized":"2023-05-17T15:10:20.258857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328734+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:16.328734+0000","last_peered":"2023-05-17T15:10:16.328734+0000","last_clean":"2023-05-17T15:10:16.328734+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:16.328734+0000","last_undegraded":"2023-05-17T15:10:16.328734+0000","last_fullsized":"2023-05-17T15:10:16.328734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694563+0000","last_change":"2023-05-17T15:10:21.692741+0000","last_active":"2023-05-17T15:10:21.694563+0000","last_peered":"2023-05-17T15:10:21.694563+0000","last_clean":"2023-05-17T15:10:21.694563+0000","last_became_active":"2023-05-17T15:10:21.690100+0000","last_became_peered":"2023-05-17T15:10:21.690100+0000","last_unstale":"2023-05-17T15:10:21.694563+0000","last_undegraded":"2023-05-17T15:10:21.694563+0000","last_fullsized":"2023-05-17T15:10:21.694563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670906+0000","last_change":"2023-05-17T15:10:21.297556+0000","last_active":"2023-05-17T15:10:21.670906+0000","last_peered":"2023-05-17T15:10:21.670906+0000","last_clean":"2023-05-17T15:10:21.670906+0000","last_became_active":"2023-05-17T15:10:21.289321+0000","last_became_peered":"2023-05-17T15:10:21.289321+0000","last_unstale":"2023-05-17T15:10:21.670906+0000","last_undegraded":"2023-05-17T15:10:21.670906+0000","last_fullsized":"2023-05-17T15:10:21.670906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328740+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:16.328740+0000","last_peered":"2023-05-17T15:10:16.328740+0000","last_clean":"2023-05-17T15:10:16.328740+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:16.328740+0000","last_undegraded":"2023-05-17T15:10:16.328740+0000","last_fullsized":"2023-05-17T15:10:16.328740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692726+0000","last_change":"2023-05-17T15:10:21.688711+0000","last_active":"2023-05-17T15:10:21.692726+0000","last_peered":"2023-05-17T15:10:21.692726+0000","last_clean":"2023-05-17T15:10:21.692726+0000","last_became_active":"2023-05-17T15:10:21.688420+0000","last_became_peered":"2023-05-17T15:10:21.688420+0000","last_unstale":"2023-05-17T15:10:21.692726+0000","last_undegraded":"2023-05-17T15:10:21.692726+0000","last_fullsized":"2023-05-17T15:10:21.692726+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694327+0000","last_change":"2023-05-17T15:10:21.295531+0000","last_active":"2023-05-17T15:10:21.694327+0000","last_peered":"2023-05-17T15:10:21.694327+0000","last_clean":"2023-05-17T15:10:21.694327+0000","last_became_active":"2023-05-17T15:10:21.295253+0000","last_became_peered":"2023-05-17T15:10:21.295253+0000","last_unstale":"2023-05-17T15:10:21.694327+0000","last_undegraded":"2023-05-17T15:10:21.694327+0000","last_fullsized":"2023-05-17T15:10:21.694327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686122+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:21.686122+0000","last_peered":"2023-05-17T15:10:21.686122+0000","last_clean":"2023-05-17T15:10:21.686122+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:21.686122+0000","last_undegraded":"2023-05-17T15:10:21.686122+0000","last_fullsized":"2023-05-17T15:10:21.686122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692908+0000","last_change":"2023-05-17T15:10:21.690118+0000","last_active":"2023-05-17T15:10:21.692908+0000","last_peered":"2023-05-17T15:10:21.692908+0000","last_clean":"2023-05-17T15:10:21.692908+0000","last_became_active":"2023-05-17T15:10:21.689835+0000","last_became_peered":"2023-05-17T15:10:21.689835+0000","last_unstale":"2023-05-17T15:10:21.692908+0000","last_undegraded":"2023-05-17T15:10:21.692908+0000","last_fullsized":"2023-05-17T15:10:21.692908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670901+0000","last_change":"2023-05-17T15:10:21.297233+0000","last_active":"2023-05-17T15:10:21.670901+0000","last_peered":"2023-05-17T15:10:21.670901+0000","last_clean":"2023-05-17T15:10:21.670901+0000","last_became_active":"2023-05-17T15:10:21.291087+0000","last_became_peered":"2023-05-17T15:10:21.291087+0000","last_unstale":"2023-05-17T15:10:21.670901+0000","last_undegraded":"2023-05-17T15:10:21.670901+0000","last_fullsized":"2023-05-17T15:10:21.670901+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-17T15:10:16.328912+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:16.328912+0000","last_peered":"2023-05-17T15:10:16.328912+0000","last_clean":"2023-05-17T15:10:16.328912+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:16.328912+0000","last_undegraded":"2023-05-17T15:10:16.328912+0000","last_fullsized":"2023-05-17T15:10:16.328912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":658,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":76,"acting":76,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18376,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353464,"statfs":{"total":96636764160,"available":96617947136,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.64800000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17928,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353912,"statfs":{"total":96636764160,"available":96618405888,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59799999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.629}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.44},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17992,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353848,"statfs":{"total":96636764160,"available":96618340352,"internally_reserved":0,"allocated":1572864,"data_stored":785301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.33700000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17668,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354172,"statfs":{"total":96636764160,"available":96618672128,"internally_reserved":0,"allocated":1568768,"data_stored":784485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.378}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19072,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":17536,"kb_avail":94352768,"statfs":{"total":96636764160,"available":96617234432,"internally_reserved":0,"allocated":1564672,"data_stored":783855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17956864},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.249},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.313}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.72099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":20480,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":1556480,"data_stored":783751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20971520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.46899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":18120,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353720,"statfs":{"total":96636764160,"available":96618209280,"internally_reserved":0,"allocated":1507328,"data_stored":756568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.441},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.48399999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.374},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21564,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350276,"statfs":{"total":96636764160,"available":96614682624,"internally_reserved":0,"allocated":1560576,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77500000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.82999999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:10:26.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-05-17T15:10:26.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-05-17T15:10:26.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-05-17T15:10:26.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-05-17T15:10:26.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-05-17T15:10:26.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-05-17T15:10:26.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-05-17T15:10:26.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-05-17T15:10:26.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-05-17T15:10:26.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-05-17T15:10:26.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-05-17T15:10:26.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-05-17T15:10:26.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-05-17T15:10:26.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-05-17T15:10:26.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-05-17T15:10:26.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-05-17T15:10:26.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-05-17T15:10:26.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-05-17T15:10:26.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-05-17T15:10:26.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-05-17T15:10:26.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-05-17T15:10:26.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-05-17T15:10:26.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-05-17T15:10:26.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-05-17T15:10:26.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-05-17T15:10:26.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-05-17T15:10:26.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-05-17T15:10:26.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-05-17T15:10:26.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-05-17T15:10:26.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-05-17T15:10:26.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-05-17T15:10:26.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-05-17T15:10:26.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-05-17T15:10:26.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-05-17T15:10:26.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-05-17T15:10:26.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-05-17T15:10:26.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-05-17T15:10:26.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-05-17T15:10:26.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-05-17T15:10:26.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-05-17T15:10:26.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-05-17T15:10:26.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-05-17T15:10:26.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-05-17T15:10:26.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-05-17T15:10:26.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-05-17T15:10:26.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-05-17T15:10:26.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:21.265523+0000', 'last_change': '2023-05-17T15:10:21.265523+0000', 'last_active': '2023-05-17T15:10:21.265523+0000', 'last_peered': '2023-05-17T15:10:21.265523+0000', 'last_clean': '2023-05-17T15:10:21.265523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:21.265523+0000', 'last_undegraded': '2023-05-17T15:10:21.265523+0000', 'last_fullsized': '2023-05-17T15:10:21.265523+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:21.265523+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-05-17T15:10:26.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-17T15:10:20.258857+0000', 'last_change': '2023-05-17T15:10:20.258857+0000', 'last_active': '2023-05-17T15:10:20.258857+0000', 'last_peered': '2023-05-17T15:10:20.258857+0000', 'last_clean': '2023-05-17T15:10:20.258857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:10:20.258857+0000', 'last_undegraded': '2023-05-17T15:10:20.258857+0000', 'last_fullsized': '2023-05-17T15:10:20.258857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'last_clean_scrub_stamp': '2023-05-17T15:10:20.258857+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-17T15:10:26.490 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-17T15:10:26.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.602+0000 7f6100e8e700 1 Processor -- start 2023-05-17T15:10:26.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.602+0000 7f6100e8e700 1 -- start start 2023-05-17T15:10:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.603+0000 7f6100e8e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60fc0c3b40 0x7f60fc0bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.603+0000 7f6100e8e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc154d60 con 0x7f60fc14dec0 2023-05-17T15:10:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.603+0000 7f6100e8e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc0c2f80 con 0x7f60fc14e2a0 2023-05-17T15:10:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.603+0000 7f6100e8e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc154150 con 0x7f60fc0c3b40 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.603+0000 7f60fa59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f60fc14dec0 0x7f60fc0bc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42048/0 (socket says 172.21.15.27:42048) 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.603+0000 7f60fa59c700 1 -- 172.21.15.27:0/517844851 learned_addr learned my addr 172.21.15.27:0/517844851 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086053217 0 0) 0x7f60fc154d60 con 0x7f60fc14dec0 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 --2- 172.21.15.27:0/517844851 >> v2:172.21.15.40:3300/0 conn(0x7f60fc0c3b40 0x7f60fc0bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e40033f0 con 0x7f60fc14dec0 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2600776222 0 0) 0x7f60e40033f0 con 0x7f60fc14dec0 2023-05-17T15:10:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 >> v2:172.21.15.40:3300/0 conn(0x7f60fc0c3b40 msgr2=0x7f60fc0bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 --2- 172.21.15.27:0/517844851 >> v2:172.21.15.40:3300/0 conn(0x7f60fc0c3b40 0x7f60fc0bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 >> v1:172.21.15.40:6789/0 conn(0x7f60fc14e2a0 legacy=0x7f60fc065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc154430 con 0x7f60fc14dec0 2023-05-17T15:10:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f60f4001970 con 0x7f60fc14dec0 2023-05-17T15:10:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 >> v1:172.21.15.27:6789/0 conn(0x7f60fc14dec0 legacy=0x7f60fc0bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e40038e0 0x7f60e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e4004690 0x7f60e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60e400c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc154150 con 0x7f60e4005000 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e400cfc0 con 0x7f60e40038e0 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e400d180 con 0x7f60e4004690 2023-05-17T15:10:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60e400c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fa59c700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e40038e0 0x7f60e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60f9d9b700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e4004690 0x7f60e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 -- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e4004690 msgr2=0x7f60e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e4004690 0x7f60e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 -- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e40038e0 msgr2=0x7f60e4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e40038e0 0x7f60e4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.604+0000 7f60fad9d700 1 -- 172.21.15.27:0/517844851 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e40033f0 con 0x7f60e4005000 2023-05-17T15:10:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f60fad9d700 1 -- 172.21.15.27:0/517844851 reap_dead start 2023-05-17T15:10:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f60fad9d700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60e400c9f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f60ec009a80 tx=0x7f60ec009060).ready entity=mon.0 client_cookie=660c3c704278794b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec009430 con 0x7f60e4005000 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00e640 con 0x7f60e4005000 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f60f959a700 1 -- 172.21.15.27:0/517844851 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00ea00 con 0x7f60e4005000 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 -- 172.21.15.27:0/517844851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 msgr2=0x7f60e400c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60e400c9f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f60ec009a80 tx=0x7f60ec009060).stop 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 -- 172.21.15.27:0/517844851 shutdown_connections 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 --2- 172.21.15.27:0/517844851 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60e400c9f0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 -- 172.21.15.27:0/517844851 >> 172.21.15.27:0/517844851 conn(0x7f60fc05dd50 msgr2=0x7f60fc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:26.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 -- 172.21.15.27:0/517844851 shutdown_connections 2023-05-17T15:10:26.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.605+0000 7f6100e8e700 1 -- 172.21.15.27:0/517844851 wait complete. 2023-05-17T15:10:26.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.606+0000 7f6100e8e700 1 Processor -- start 2023-05-17T15:10:26.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.606+0000 7f6100e8e700 1 -- start start 2023-05-17T15:10:26.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f6100e8e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60fc13b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f6100e8e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60fc14eb40 0x7f60fc14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f6100e8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60fc148e50 0x7f60fc1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f6100e8e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc148ad0 con 0x7f60e4005000 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f6100e8e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc14a670 con 0x7f60fc14eb40 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f6100e8e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc14f4b0 con 0x7f60fc148e50 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f60fa59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60fc13b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f60fa59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60fc13b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42498/0 (socket says 172.21.15.27:42498) 2023-05-17T15:10:26.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f60fa59c700 1 -- 172.21.15.27:0/1950815953 learned_addr learned my addr 172.21.15.27:0/1950815953 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:26.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f60f9d9b700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60fc14eb40 0x7f60fc14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.607+0000 7f60fad9d700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60fc148e50 0x7f60fc1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60fa59c700 1 -- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60fc148e50 msgr2=0x7f60fc1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60fa59c700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60fc148e50 0x7f60fc1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60fa59c700 1 -- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60fc14eb40 msgr2=0x7f60fc14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60fa59c700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60fc14eb40 0x7f60fc14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60fa59c700 1 -- 172.21.15.27:0/1950815953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc1497c0 con 0x7f60e4005000 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60fa59c700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60fc13b250 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f60f400ffa0 tx=0x7f60f4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40059f0 con 0x7f60e4005000 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4005b50 con 0x7f60e4005000 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400d9a0 con 0x7f60e4005000 2023-05-17T15:10:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc149a60 con 0x7f60e4005000 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.608+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc14a020 con 0x7f60e4005000 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.609+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc06bdf0 con 0x7f60e4005000 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.609+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f60f401a030 con 0x7f60e4005000 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.610+0000 7f60ea7fc700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60dc05ed90 0x7f60dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.610+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f60f4079660 con 0x7f60e4005000 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.610+0000 7f60f9d9b700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60dc05ed90 0x7f60dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.610+0000 7f60f9d9b700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60dc05ed90 0x7f60dc061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f60f0007fd0 tx=0x7f60f0007bb0).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.614+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60f40498f0 con 0x7f60e4005000 2023-05-17T15:10:26.683 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:10:26.679+0000 7f26d731a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:10:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.860+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f60fc154710 con 0x7f60e4005000 2023-05-17T15:10:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.860+0000 7f60ea7fc700 1 -- 172.21.15.27:0/1950815953 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1026 (secure 0 0 0) 0x7f60fc154710 con 0x7f60e4005000 2023-05-17T15:10:26.865 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:26.865 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1012,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":126,"num_osds":8,"num_up_osds":8,"osd_up_since":1684335223,"num_in_osds":8,"osd_in_since":1684335217,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"unknown","count":47}],"num_pgs":137,"num_pools":4,"num_objects":9,"data_bytes":658,"bytes_used":156393472,"bytes_avail":772937719808,"bytes_total":773094113280,"unknown_pgs_ratio":0.34306567907333374},"fsmap":{"epoch":52,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7581}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-05-17T15:07:12.655393+0000","services":{}},"progress_events":{}} 2023-05-17T15:10:26.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60dc05ed90 msgr2=0x7f60dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60dc05ed90 0x7f60dc061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f60f0007fd0 tx=0x7f60f0007bb0).stop 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 msgr2=0x7f60fc13b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60fc13b250 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f60f400ffa0 tx=0x7f60f4009040).stop 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 shutdown_connections 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f60dc05ed90 0x7f60dc061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60fc148e50 0x7f60fc1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60e4005000 0x7f60fc13b250 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 --2- 172.21.15.27:0/1950815953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60fc14eb40 0x7f60fc14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 >> 172.21.15.27:0/1950815953 conn(0x7f60fc05dd50 msgr2=0x7f60fc0bc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:26.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 shutdown_connections 2023-05-17T15:10:26.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.862+0000 7f6100e8e700 1 -- 172.21.15.27:0/1950815953 wait complete. 2023-05-17T15:10:26.878 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-17T15:10:26.879 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:10:26.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.990+0000 7f21331d7700 1 Processor -- start 2023-05-17T15:10:26.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 -- start start 2023-05-17T15:10:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f212c14f850 0x7f212c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c14fc30 0x7f212c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f212c0c5040 0x7f212c0bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c152b60 con 0x7f212c0c5040 2023-05-17T15:10:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c0a6e70 con 0x7f212c14f850 2023-05-17T15:10:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.991+0000 7f21331d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0a7150 con 0x7f212c14fc30 2023-05-17T15:10:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f212c0c5040 0x7f212c0bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f212c0c5040 0x7f212c0bd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42510/0 (socket says 172.21.15.27:42510) 2023-05-17T15:10:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 -- 172.21.15.27:0/529832072 learned_addr learned my addr 172.21.15.27:0/529832072 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2130f73700 1 --2- 172.21.15.27:0/529832072 >> v2:172.21.15.40:3300/0 conn(0x7f212c14f850 0x7f212c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f212bfff700 1 --2- 172.21.15.27:0/529832072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c14fc30 0x7f212c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 -- 172.21.15.27:0/529832072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c14fc30 msgr2=0x7f212c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 --2- 172.21.15.27:0/529832072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c14fc30 0x7f212c0c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 -- 172.21.15.27:0/529832072 >> v2:172.21.15.40:3300/0 conn(0x7f212c14f850 msgr2=0x7f212c152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 --2- 172.21.15.27:0/529832072 >> v2:172.21.15.40:3300/0 conn(0x7f212c14f850 0x7f212c152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 -- 172.21.15.27:0/529832072 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c152510 con 0x7f212c0c5040 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f2131774700 1 --2- 172.21.15.27:0/529832072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c0c5040 0x7f212c0bd260 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f212c0c21d0 tx=0x7f21140090f0).ready entity=mon.0 client_cookie=832a3084810825e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f212b7fe700 1 -- 172.21.15.27:0/529832072 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400b600 con 0x7f212c0c5040 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f212b7fe700 1 -- 172.21.15.27:0/529832072 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400b760 con 0x7f212c0c5040 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.992+0000 7f212b7fe700 1 -- 172.21.15.27:0/529832072 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400bae0 con 0x7f212c0c5040 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 -- 172.21.15.27:0/529832072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c0c5040 msgr2=0x7f212c0bd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 --2- 172.21.15.27:0/529832072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c0c5040 0x7f212c0bd260 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f212c0c21d0 tx=0x7f21140090f0).stop 2023-05-17T15:10:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 -- 172.21.15.27:0/529832072 shutdown_connections 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 --2- 172.21.15.27:0/529832072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c0c5040 0x7f212c0bd260 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 --2- 172.21.15.27:0/529832072 >> v2:172.21.15.40:3300/0 conn(0x7f212c14f850 0x7f212c152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 --2- 172.21.15.27:0/529832072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c14fc30 0x7f212c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 -- 172.21.15.27:0/529832072 >> 172.21.15.27:0/529832072 conn(0x7f212c0c8400 msgr2=0x7f212c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 -- 172.21.15.27:0/529832072 shutdown_connections 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.993+0000 7f21331d7700 1 -- 172.21.15.27:0/529832072 wait complete. 2023-05-17T15:10:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.994+0000 7f21331d7700 1 Processor -- start 2023-05-17T15:10:27.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.994+0000 7f21331d7700 1 -- start start 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c0c5040 0x7f212c0a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212c14f850 0x7f212c154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 0x7f212c154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c154ee0 con 0x7f212c14fc30 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c063da0 con 0x7f212c14f850 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c156c10 con 0x7f212c0c5040 2023-05-17T15:10:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 0x7f212c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 0x7f212c154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42516/0 (socket says 172.21.15.27:42516) 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 -- 172.21.15.27:0/1540211182 learned_addr learned my addr 172.21.15.27:0/1540211182 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2130f73700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c0c5040 0x7f212c0a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f212bfff700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212c14f850 0x7f212c154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 -- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c0c5040 msgr2=0x7f212c0a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c0c5040 0x7f212c0a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 -- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212c14f850 msgr2=0x7f212c154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212c14f850 0x7f212c154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 -- 172.21.15.27:0/1540211182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009370 con 0x7f212c14fc30 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2131774700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 0x7f212c154820 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f212c066400 tx=0x7f2114017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114006d90 con 0x7f212c14fc30 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400bea0 con 0x7f212c14fc30 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c063470 con 0x7f212c14fc30 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400bae0 con 0x7f212c14fc30 2023-05-17T15:10:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.995+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c063a30 con 0x7f212c14fc30 2023-05-17T15:10:27.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.996+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c063f30 con 0x7f212c14fc30 2023-05-17T15:10:27.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.997+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2114022030 con 0x7f212c14fc30 2023-05-17T15:10:27.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.997+0000 7f2128ff9700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f210c05ed90 0x7f210c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:27.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.997+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f211407bad0 con 0x7f212c14fc30 2023-05-17T15:10:27.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.997+0000 7f2130f73700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f210c05ed90 0x7f210c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:27.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:26.997+0000 7f2130f73700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f210c05ed90 0x7f210c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2124009fd0 tx=0x7f2124009880).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:27.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.001+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f211404d010 con 0x7f212c14fc30 2023-05-17T15:10:27.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.169+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f212c1527f0 con 0x7f210c05ed90 2023-05-17T15:10:27.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.179+0000 7f2128ff9700 1 -- 172.21.15.27:0/1540211182 <== mgr.7389 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361566 (secure 0 0 0) 0x7f212c1527f0 con 0x7f210c05ed90 2023-05-17T15:10:27.188 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f210c05ed90 msgr2=0x7f210c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f210c05ed90 0x7f210c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2124009fd0 tx=0x7f2124009880).stop 2023-05-17T15:10:27.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 msgr2=0x7f212c154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 0x7f212c154820 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f212c066400 tx=0x7f2114017000).stop 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 shutdown_connections 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f210c05ed90 0x7f210c061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f212c14fc30 0x7f212c154820 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f212c0c5040 0x7f212c0a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 --2- 172.21.15.27:0/1540211182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212c14f850 0x7f212c154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:27.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 >> 172.21.15.27:0/1540211182 conn(0x7f212c0c8400 msgr2=0x7f212c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 shutdown_connections 2023-05-17T15:10:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:27.183+0000 7f21331d7700 1 -- 172.21.15.27:0/1540211182 wait complete. 2023-05-17T15:10:27.192 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:10:27.199 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-17T15:10:26.730377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":153408,"kb_used_data":12224,"kb_used_omap":0,"kb_used_meta":141120,"kb_avail":754821312,"statfs":{"total":773094113280,"available":772937023488,"internally_reserved":0,"allocated":12517376,"data_stored":6274620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":144506880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18377,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-43,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.507886"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689060+0000","last_change":"2023-05-17T15:10:21.683295+0000","last_active":"2023-05-17T15:10:21.689060+0000","last_peered":"2023-05-17T15:10:21.689060+0000","last_clean":"2023-05-17T15:10:21.689060+0000","last_became_active":"2023-05-17T15:10:21.682915+0000","last_became_peered":"2023-05-17T15:10:21.682915+0000","last_unstale":"2023-05-17T15:10:21.689060+0000","last_undegraded":"2023-05-17T15:10:21.689060+0000","last_fullsized":"2023-05-17T15:10:21.689060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697693+0000","last_change":"2023-05-17T15:10:21.299521+0000","last_active":"2023-05-17T15:10:21.697693+0000","last_peered":"2023-05-17T15:10:21.697693+0000","last_clean":"2023-05-17T15:10:21.697693+0000","last_became_active":"2023-05-17T15:10:21.299249+0000","last_became_peered":"2023-05-17T15:10:21.299249+0000","last_unstale":"2023-05-17T15:10:21.697693+0000","last_undegraded":"2023-05-17T15:10:21.697693+0000","last_fullsized":"2023-05-17T15:10:21.697693+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694394+0000","last_change":"2023-05-17T15:10:21.690313+0000","last_active":"2023-05-17T15:10:21.694394+0000","last_peered":"2023-05-17T15:10:21.694394+0000","last_clean":"2023-05-17T15:10:21.694394+0000","last_became_active":"2023-05-17T15:10:21.690034+0000","last_became_peered":"2023-05-17T15:10:21.690034+0000","last_unstale":"2023-05-17T15:10:21.694394+0000","last_undegraded":"2023-05-17T15:10:21.694394+0000","last_fullsized":"2023-05-17T15:10:21.694394+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681030+0000","last_change":"2023-05-17T15:10:21.292372+0000","last_active":"2023-05-17T15:10:21.681030+0000","last_peered":"2023-05-17T15:10:21.681030+0000","last_clean":"2023-05-17T15:10:21.681030+0000","last_became_active":"2023-05-17T15:10:21.291668+0000","last_became_peered":"2023-05-17T15:10:21.291668+0000","last_unstale":"2023-05-17T15:10:21.681030+0000","last_undegraded":"2023-05-17T15:10:21.681030+0000","last_fullsized":"2023-05-17T15:10:21.681030+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686693+0000","last_change":"2023-05-17T15:10:21.684066+0000","last_active":"2023-05-17T15:10:21.686693+0000","last_peered":"2023-05-17T15:10:21.686693+0000","last_clean":"2023-05-17T15:10:21.686693+0000","last_became_active":"2023-05-17T15:10:21.683761+0000","last_became_peered":"2023-05-17T15:10:21.683761+0000","last_unstale":"2023-05-17T15:10:21.686693+0000","last_undegraded":"2023-05-17T15:10:21.686693+0000","last_fullsized":"2023-05-17T15:10:21.686693+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685863+0000","last_change":"2023-05-17T15:10:21.299601+0000","last_active":"2023-05-17T15:10:21.685863+0000","last_peered":"2023-05-17T15:10:21.685863+0000","last_clean":"2023-05-17T15:10:21.685863+0000","last_became_active":"2023-05-17T15:10:21.299304+0000","last_became_peered":"2023-05-17T15:10:21.299304+0000","last_unstale":"2023-05-17T15:10:21.685863+0000","last_undegraded":"2023-05-17T15:10:21.685863+0000","last_fullsized":"2023-05-17T15:10:21.685863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689518+0000","last_change":"2023-05-17T15:10:21.682112+0000","last_active":"2023-05-17T15:10:21.689518+0000","last_peered":"2023-05-17T15:10:21.689518+0000","last_clean":"2023-05-17T15:10:21.689518+0000","last_became_active":"2023-05-17T15:10:21.681845+0000","last_became_peered":"2023-05-17T15:10:21.681845+0000","last_unstale":"2023-05-17T15:10:21.689518+0000","last_undegraded":"2023-05-17T15:10:21.689518+0000","last_fullsized":"2023-05-17T15:10:21.689518+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693301+0000","last_change":"2023-05-17T15:10:21.292923+0000","last_active":"2023-05-17T15:10:21.693301+0000","last_peered":"2023-05-17T15:10:21.693301+0000","last_clean":"2023-05-17T15:10:21.693301+0000","last_became_active":"2023-05-17T15:10:21.292654+0000","last_became_peered":"2023-05-17T15:10:21.292654+0000","last_unstale":"2023-05-17T15:10:21.693301+0000","last_undegraded":"2023-05-17T15:10:21.693301+0000","last_fullsized":"2023-05-17T15:10:21.693301+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698385+0000","last_change":"2023-05-17T15:10:21.696216+0000","last_active":"2023-05-17T15:10:21.698385+0000","last_peered":"2023-05-17T15:10:21.698385+0000","last_clean":"2023-05-17T15:10:21.698385+0000","last_became_active":"2023-05-17T15:10:21.695895+0000","last_became_peered":"2023-05-17T15:10:21.695895+0000","last_unstale":"2023-05-17T15:10:21.698385+0000","last_undegraded":"2023-05-17T15:10:21.698385+0000","last_fullsized":"2023-05-17T15:10:21.698385+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694420+0000","last_change":"2023-05-17T15:10:21.288355+0000","last_active":"2023-05-17T15:10:21.694420+0000","last_peered":"2023-05-17T15:10:21.694420+0000","last_clean":"2023-05-17T15:10:21.694420+0000","last_became_active":"2023-05-17T15:10:21.288061+0000","last_became_peered":"2023-05-17T15:10:21.288061+0000","last_unstale":"2023-05-17T15:10:21.694420+0000","last_undegraded":"2023-05-17T15:10:21.694420+0000","last_fullsized":"2023-05-17T15:10:21.694420+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696983+0000","last_change":"2023-05-17T15:10:21.688215+0000","last_active":"2023-05-17T15:10:21.696983+0000","last_peered":"2023-05-17T15:10:21.696983+0000","last_clean":"2023-05-17T15:10:21.696983+0000","last_became_active":"2023-05-17T15:10:21.687921+0000","last_became_peered":"2023-05-17T15:10:21.687921+0000","last_unstale":"2023-05-17T15:10:21.696983+0000","last_undegraded":"2023-05-17T15:10:21.696983+0000","last_fullsized":"2023-05-17T15:10:21.696983+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696376+0000","last_change":"2023-05-17T15:10:21.297237+0000","last_active":"2023-05-17T15:10:21.696376+0000","last_peered":"2023-05-17T15:10:21.696376+0000","last_clean":"2023-05-17T15:10:21.696376+0000","last_became_active":"2023-05-17T15:10:21.296950+0000","last_became_peered":"2023-05-17T15:10:21.296950+0000","last_unstale":"2023-05-17T15:10:21.696376+0000","last_undegraded":"2023-05-17T15:10:21.696376+0000","last_fullsized":"2023-05-17T15:10:21.696376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686600+0000","last_change":"2023-05-17T15:10:21.683307+0000","last_active":"2023-05-17T15:10:21.686600+0000","last_peered":"2023-05-17T15:10:21.686600+0000","last_clean":"2023-05-17T15:10:21.686600+0000","last_became_active":"2023-05-17T15:10:21.682968+0000","last_became_peered":"2023-05-17T15:10:21.682968+0000","last_unstale":"2023-05-17T15:10:21.686600+0000","last_undegraded":"2023-05-17T15:10:21.686600+0000","last_fullsized":"2023-05-17T15:10:21.686600+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675565+0000","last_change":"2023-05-17T15:10:21.297285+0000","last_active":"2023-05-17T15:10:21.675565+0000","last_peered":"2023-05-17T15:10:21.675565+0000","last_clean":"2023-05-17T15:10:21.675565+0000","last_became_active":"2023-05-17T15:10:21.296999+0000","last_became_peered":"2023-05-17T15:10:21.296999+0000","last_unstale":"2023-05-17T15:10:21.675565+0000","last_undegraded":"2023-05-17T15:10:21.675565+0000","last_fullsized":"2023-05-17T15:10:21.675565+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689816+0000","last_change":"2023-05-17T15:10:21.685816+0000","last_active":"2023-05-17T15:10:21.689816+0000","last_peered":"2023-05-17T15:10:21.689816+0000","last_clean":"2023-05-17T15:10:21.689816+0000","last_became_active":"2023-05-17T15:10:21.684517+0000","last_became_peered":"2023-05-17T15:10:21.684517+0000","last_unstale":"2023-05-17T15:10:21.689816+0000","last_undegraded":"2023-05-17T15:10:21.689816+0000","last_fullsized":"2023-05-17T15:10:21.689816+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681289+0000","last_change":"2023-05-17T15:10:21.294570+0000","last_active":"2023-05-17T15:10:21.681289+0000","last_peered":"2023-05-17T15:10:21.681289+0000","last_clean":"2023-05-17T15:10:21.681289+0000","last_became_active":"2023-05-17T15:10:21.293467+0000","last_became_peered":"2023-05-17T15:10:21.293467+0000","last_unstale":"2023-05-17T15:10:21.681289+0000","last_undegraded":"2023-05-17T15:10:21.681289+0000","last_fullsized":"2023-05-17T15:10:21.681289+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688641+0000","last_change":"2023-05-17T15:10:21.682283+0000","last_active":"2023-05-17T15:10:21.688641+0000","last_peered":"2023-05-17T15:10:21.688641+0000","last_clean":"2023-05-17T15:10:21.688641+0000","last_became_active":"2023-05-17T15:10:21.682017+0000","last_became_peered":"2023-05-17T15:10:21.682017+0000","last_unstale":"2023-05-17T15:10:21.688641+0000","last_undegraded":"2023-05-17T15:10:21.688641+0000","last_fullsized":"2023-05-17T15:10:21.688641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.672838+0000","last_change":"2023-05-17T15:10:21.300788+0000","last_active":"2023-05-17T15:10:21.672838+0000","last_peered":"2023-05-17T15:10:21.672838+0000","last_clean":"2023-05-17T15:10:21.672838+0000","last_became_active":"2023-05-17T15:10:21.300412+0000","last_became_peered":"2023-05-17T15:10:21.300412+0000","last_unstale":"2023-05-17T15:10:21.672838+0000","last_undegraded":"2023-05-17T15:10:21.672838+0000","last_fullsized":"2023-05-17T15:10:21.672838+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699575+0000","last_change":"2023-05-17T15:10:21.698224+0000","last_active":"2023-05-17T15:10:21.699575+0000","last_peered":"2023-05-17T15:10:21.699575+0000","last_clean":"2023-05-17T15:10:21.699575+0000","last_became_active":"2023-05-17T15:10:21.697946+0000","last_became_peered":"2023-05-17T15:10:21.697946+0000","last_unstale":"2023-05-17T15:10:21.699575+0000","last_undegraded":"2023-05-17T15:10:21.699575+0000","last_fullsized":"2023-05-17T15:10:21.699575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.677222+0000","last_change":"2023-05-17T15:10:21.292475+0000","last_active":"2023-05-17T15:10:21.677222+0000","last_peered":"2023-05-17T15:10:21.677222+0000","last_clean":"2023-05-17T15:10:21.677222+0000","last_became_active":"2023-05-17T15:10:21.292190+0000","last_became_peered":"2023-05-17T15:10:21.292190+0000","last_unstale":"2023-05-17T15:10:21.677222+0000","last_undegraded":"2023-05-17T15:10:21.677222+0000","last_fullsized":"2023-05-17T15:10:21.677222+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692164+0000","last_change":"2023-05-17T15:10:21.689824+0000","last_active":"2023-05-17T15:10:21.692164+0000","last_peered":"2023-05-17T15:10:21.692164+0000","last_clean":"2023-05-17T15:10:21.692164+0000","last_became_active":"2023-05-17T15:10:21.689431+0000","last_became_peered":"2023-05-17T15:10:21.689431+0000","last_unstale":"2023-05-17T15:10:21.692164+0000","last_undegraded":"2023-05-17T15:10:21.692164+0000","last_fullsized":"2023-05-17T15:10:21.692164+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674884+0000","last_change":"2023-05-17T15:10:21.293866+0000","last_active":"2023-05-17T15:10:21.674884+0000","last_peered":"2023-05-17T15:10:21.674884+0000","last_clean":"2023-05-17T15:10:21.674884+0000","last_became_active":"2023-05-17T15:10:21.293559+0000","last_became_peered":"2023-05-17T15:10:21.293559+0000","last_unstale":"2023-05-17T15:10:21.674884+0000","last_undegraded":"2023-05-17T15:10:21.674884+0000","last_fullsized":"2023-05-17T15:10:21.674884+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694262+0000","last_change":"2023-05-17T15:10:21.689351+0000","last_active":"2023-05-17T15:10:21.694262+0000","last_peered":"2023-05-17T15:10:21.694262+0000","last_clean":"2023-05-17T15:10:21.694262+0000","last_became_active":"2023-05-17T15:10:21.689089+0000","last_became_peered":"2023-05-17T15:10:21.689089+0000","last_unstale":"2023-05-17T15:10:21.694262+0000","last_undegraded":"2023-05-17T15:10:21.694262+0000","last_fullsized":"2023-05-17T15:10:21.694262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699717+0000","last_change":"2023-05-17T15:10:21.292075+0000","last_active":"2023-05-17T15:10:21.699717+0000","last_peered":"2023-05-17T15:10:21.699717+0000","last_clean":"2023-05-17T15:10:21.699717+0000","last_became_active":"2023-05-17T15:10:21.291677+0000","last_became_peered":"2023-05-17T15:10:21.291677+0000","last_unstale":"2023-05-17T15:10:21.699717+0000","last_undegraded":"2023-05-17T15:10:21.699717+0000","last_fullsized":"2023-05-17T15:10:21.699717+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689774+0000","last_change":"2023-05-17T15:10:21.684202+0000","last_active":"2023-05-17T15:10:21.689774+0000","last_peered":"2023-05-17T15:10:21.689774+0000","last_clean":"2023-05-17T15:10:21.689774+0000","last_became_active":"2023-05-17T15:10:21.683915+0000","last_became_peered":"2023-05-17T15:10:21.683915+0000","last_unstale":"2023-05-17T15:10:21.689774+0000","last_undegraded":"2023-05-17T15:10:21.689774+0000","last_fullsized":"2023-05-17T15:10:21.689774+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692633+0000","last_change":"2023-05-17T15:10:21.298019+0000","last_active":"2023-05-17T15:10:21.692633+0000","last_peered":"2023-05-17T15:10:21.692633+0000","last_clean":"2023-05-17T15:10:21.692633+0000","last_became_active":"2023-05-17T15:10:21.294051+0000","last_became_peered":"2023-05-17T15:10:21.294051+0000","last_unstale":"2023-05-17T15:10:21.692633+0000","last_undegraded":"2023-05-17T15:10:21.692633+0000","last_fullsized":"2023-05-17T15:10:21.692633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.695998+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.695779+0000","last_became_peered":"2023-05-17T15:10:21.695779+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670675+0000","last_change":"2023-05-17T15:10:21.298810+0000","last_active":"2023-05-17T15:10:21.670675+0000","last_peered":"2023-05-17T15:10:21.670675+0000","last_clean":"2023-05-17T15:10:21.670675+0000","last_became_active":"2023-05-17T15:10:21.298535+0000","last_became_peered":"2023-05-17T15:10:21.298535+0000","last_unstale":"2023-05-17T15:10:21.670675+0000","last_undegraded":"2023-05-17T15:10:21.670675+0000","last_fullsized":"2023-05-17T15:10:21.670675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696331+0000","last_change":"2023-05-17T15:10:21.692304+0000","last_active":"2023-05-17T15:10:21.696331+0000","last_peered":"2023-05-17T15:10:21.696331+0000","last_clean":"2023-05-17T15:10:21.696331+0000","last_became_active":"2023-05-17T15:10:21.692006+0000","last_became_peered":"2023-05-17T15:10:21.692006+0000","last_unstale":"2023-05-17T15:10:21.696331+0000","last_undegraded":"2023-05-17T15:10:21.696331+0000","last_fullsized":"2023-05-17T15:10:21.696331+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675380+0000","last_change":"2023-05-17T15:10:21.291603+0000","last_active":"2023-05-17T15:10:21.675380+0000","last_peered":"2023-05-17T15:10:21.675380+0000","last_clean":"2023-05-17T15:10:21.675380+0000","last_became_active":"2023-05-17T15:10:21.289948+0000","last_became_peered":"2023-05-17T15:10:21.289948+0000","last_unstale":"2023-05-17T15:10:21.675380+0000","last_undegraded":"2023-05-17T15:10:21.675380+0000","last_fullsized":"2023-05-17T15:10:21.675380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699525+0000","last_change":"2023-05-17T15:10:21.697668+0000","last_active":"2023-05-17T15:10:21.699525+0000","last_peered":"2023-05-17T15:10:21.699525+0000","last_clean":"2023-05-17T15:10:21.699525+0000","last_became_active":"2023-05-17T15:10:21.697419+0000","last_became_peered":"2023-05-17T15:10:21.697419+0000","last_unstale":"2023-05-17T15:10:21.699525+0000","last_undegraded":"2023-05-17T15:10:21.699525+0000","last_fullsized":"2023-05-17T15:10:21.699525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.687522+0000","last_change":"2023-05-17T15:10:21.299540+0000","last_active":"2023-05-17T15:10:21.687522+0000","last_peered":"2023-05-17T15:10:21.687522+0000","last_clean":"2023-05-17T15:10:21.687522+0000","last_became_active":"2023-05-17T15:10:21.299220+0000","last_became_peered":"2023-05-17T15:10:21.299220+0000","last_unstale":"2023-05-17T15:10:21.687522+0000","last_undegraded":"2023-05-17T15:10:21.687522+0000","last_fullsized":"2023-05-17T15:10:21.687522+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691152+0000","last_change":"2023-05-17T15:10:21.684731+0000","last_active":"2023-05-17T15:10:21.691152+0000","last_peered":"2023-05-17T15:10:21.691152+0000","last_clean":"2023-05-17T15:10:21.691152+0000","last_became_active":"2023-05-17T15:10:21.684485+0000","last_became_peered":"2023-05-17T15:10:21.684485+0000","last_unstale":"2023-05-17T15:10:21.691152+0000","last_undegraded":"2023-05-17T15:10:21.691152+0000","last_fullsized":"2023-05-17T15:10:21.691152+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681170+0000","last_change":"2023-05-17T15:10:21.288238+0000","last_active":"2023-05-17T15:10:21.681170+0000","last_peered":"2023-05-17T15:10:21.681170+0000","last_clean":"2023-05-17T15:10:21.681170+0000","last_became_active":"2023-05-17T15:10:21.287952+0000","last_became_peered":"2023-05-17T15:10:21.287952+0000","last_unstale":"2023-05-17T15:10:21.681170+0000","last_undegraded":"2023-05-17T15:10:21.681170+0000","last_fullsized":"2023-05-17T15:10:21.681170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698916+0000","last_change":"2023-05-17T15:10:21.697765+0000","last_active":"2023-05-17T15:10:21.698916+0000","last_peered":"2023-05-17T15:10:21.698916+0000","last_clean":"2023-05-17T15:10:21.698916+0000","last_became_active":"2023-05-17T15:10:21.697445+0000","last_became_peered":"2023-05-17T15:10:21.697445+0000","last_unstale":"2023-05-17T15:10:21.698916+0000","last_undegraded":"2023-05-17T15:10:21.698916+0000","last_fullsized":"2023-05-17T15:10:21.698916+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.676011+0000","last_change":"2023-05-17T15:10:21.293333+0000","last_active":"2023-05-17T15:10:21.676011+0000","last_peered":"2023-05-17T15:10:21.676011+0000","last_clean":"2023-05-17T15:10:21.676011+0000","last_became_active":"2023-05-17T15:10:21.291969+0000","last_became_peered":"2023-05-17T15:10:21.291969+0000","last_unstale":"2023-05-17T15:10:21.676011+0000","last_undegraded":"2023-05-17T15:10:21.676011+0000","last_fullsized":"2023-05-17T15:10:21.676011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692946+0000","last_change":"2023-05-17T15:10:21.689884+0000","last_active":"2023-05-17T15:10:21.692946+0000","last_peered":"2023-05-17T15:10:21.692946+0000","last_clean":"2023-05-17T15:10:21.692946+0000","last_became_active":"2023-05-17T15:10:21.687316+0000","last_became_peered":"2023-05-17T15:10:21.687316+0000","last_unstale":"2023-05-17T15:10:21.692946+0000","last_undegraded":"2023-05-17T15:10:21.692946+0000","last_fullsized":"2023-05-17T15:10:21.692946+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693914+0000","last_change":"2023-05-17T15:10:21.290304+0000","last_active":"2023-05-17T15:10:21.693914+0000","last_peered":"2023-05-17T15:10:21.693914+0000","last_clean":"2023-05-17T15:10:21.693914+0000","last_became_active":"2023-05-17T15:10:21.290023+0000","last_became_peered":"2023-05-17T15:10:21.290023+0000","last_unstale":"2023-05-17T15:10:21.693914+0000","last_undegraded":"2023-05-17T15:10:21.693914+0000","last_fullsized":"2023-05-17T15:10:21.693914+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693819+0000","last_change":"2023-05-17T15:10:21.687930+0000","last_active":"2023-05-17T15:10:21.693819+0000","last_peered":"2023-05-17T15:10:21.693819+0000","last_clean":"2023-05-17T15:10:21.693819+0000","last_became_active":"2023-05-17T15:10:21.687700+0000","last_became_peered":"2023-05-17T15:10:21.687700+0000","last_unstale":"2023-05-17T15:10:21.693819+0000","last_undegraded":"2023-05-17T15:10:21.693819+0000","last_fullsized":"2023-05-17T15:10:21.693819+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.672472+0000","last_change":"2023-05-17T15:10:21.300640+0000","last_active":"2023-05-17T15:10:21.672472+0000","last_peered":"2023-05-17T15:10:21.672472+0000","last_clean":"2023-05-17T15:10:21.672472+0000","last_became_active":"2023-05-17T15:10:21.300350+0000","last_became_peered":"2023-05-17T15:10:21.300350+0000","last_unstale":"2023-05-17T15:10:21.672472+0000","last_undegraded":"2023-05-17T15:10:21.672472+0000","last_fullsized":"2023-05-17T15:10:21.672472+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689754+0000","last_change":"2023-05-17T15:10:21.684185+0000","last_active":"2023-05-17T15:10:21.689754+0000","last_peered":"2023-05-17T15:10:21.689754+0000","last_clean":"2023-05-17T15:10:21.689754+0000","last_became_active":"2023-05-17T15:10:21.683528+0000","last_became_peered":"2023-05-17T15:10:21.683528+0000","last_unstale":"2023-05-17T15:10:21.689754+0000","last_undegraded":"2023-05-17T15:10:21.689754+0000","last_fullsized":"2023-05-17T15:10:21.689754+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697136+0000","last_change":"2023-05-17T15:10:21.298512+0000","last_active":"2023-05-17T15:10:21.697136+0000","last_peered":"2023-05-17T15:10:21.697136+0000","last_clean":"2023-05-17T15:10:21.697136+0000","last_became_active":"2023-05-17T15:10:21.298105+0000","last_became_peered":"2023-05-17T15:10:21.298105+0000","last_unstale":"2023-05-17T15:10:21.697136+0000","last_undegraded":"2023-05-17T15:10:21.697136+0000","last_fullsized":"2023-05-17T15:10:21.697136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698112+0000","last_change":"2023-05-17T15:10:21.695099+0000","last_active":"2023-05-17T15:10:21.698112+0000","last_peered":"2023-05-17T15:10:21.698112+0000","last_clean":"2023-05-17T15:10:21.698112+0000","last_became_active":"2023-05-17T15:10:21.694788+0000","last_became_peered":"2023-05-17T15:10:21.694788+0000","last_unstale":"2023-05-17T15:10:21.698112+0000","last_undegraded":"2023-05-17T15:10:21.698112+0000","last_fullsized":"2023-05-17T15:10:21.698112+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679296+0000","last_change":"2023-05-17T15:10:21.297458+0000","last_active":"2023-05-17T15:10:21.679296+0000","last_peered":"2023-05-17T15:10:21.679296+0000","last_clean":"2023-05-17T15:10:21.679296+0000","last_became_active":"2023-05-17T15:10:21.297156+0000","last_became_peered":"2023-05-17T15:10:21.297156+0000","last_unstale":"2023-05-17T15:10:21.679296+0000","last_undegraded":"2023-05-17T15:10:21.679296+0000","last_fullsized":"2023-05-17T15:10:21.679296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690230+0000","last_change":"2023-05-17T15:10:21.686606+0000","last_active":"2023-05-17T15:10:21.690230+0000","last_peered":"2023-05-17T15:10:21.690230+0000","last_clean":"2023-05-17T15:10:21.690230+0000","last_became_active":"2023-05-17T15:10:21.686335+0000","last_became_peered":"2023-05-17T15:10:21.686335+0000","last_unstale":"2023-05-17T15:10:21.690230+0000","last_undegraded":"2023-05-17T15:10:21.690230+0000","last_fullsized":"2023-05-17T15:10:21.690230+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679535+0000","last_change":"2023-05-17T15:10:21.288322+0000","last_active":"2023-05-17T15:10:21.679535+0000","last_peered":"2023-05-17T15:10:21.679535+0000","last_clean":"2023-05-17T15:10:21.679535+0000","last_became_active":"2023-05-17T15:10:21.288046+0000","last_became_peered":"2023-05-17T15:10:21.288046+0000","last_unstale":"2023-05-17T15:10:21.679535+0000","last_undegraded":"2023-05-17T15:10:21.679535+0000","last_fullsized":"2023-05-17T15:10:21.679535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693445+0000","last_change":"2023-05-17T15:10:21.687798+0000","last_active":"2023-05-17T15:10:21.693445+0000","last_peered":"2023-05-17T15:10:21.693445+0000","last_clean":"2023-05-17T15:10:21.693445+0000","last_became_active":"2023-05-17T15:10:21.687509+0000","last_became_peered":"2023-05-17T15:10:21.687509+0000","last_unstale":"2023-05-17T15:10:21.693445+0000","last_undegraded":"2023-05-17T15:10:21.693445+0000","last_fullsized":"2023-05-17T15:10:21.693445+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675039+0000","last_change":"2023-05-17T15:10:21.294698+0000","last_active":"2023-05-17T15:10:21.675039+0000","last_peered":"2023-05-17T15:10:21.675039+0000","last_clean":"2023-05-17T15:10:21.675039+0000","last_became_active":"2023-05-17T15:10:21.294263+0000","last_became_peered":"2023-05-17T15:10:21.294263+0000","last_unstale":"2023-05-17T15:10:21.675039+0000","last_undegraded":"2023-05-17T15:10:21.675039+0000","last_fullsized":"2023-05-17T15:10:21.675039+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686781+0000","last_change":"2023-05-17T15:10:21.678612+0000","last_active":"2023-05-17T15:10:21.686781+0000","last_peered":"2023-05-17T15:10:21.686781+0000","last_clean":"2023-05-17T15:10:21.686781+0000","last_became_active":"2023-05-17T15:10:21.678335+0000","last_became_peered":"2023-05-17T15:10:21.678335+0000","last_unstale":"2023-05-17T15:10:21.686781+0000","last_undegraded":"2023-05-17T15:10:21.686781+0000","last_fullsized":"2023-05-17T15:10:21.686781+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.678084+0000","last_change":"2023-05-17T15:10:21.291885+0000","last_active":"2023-05-17T15:10:21.678084+0000","last_peered":"2023-05-17T15:10:21.678084+0000","last_clean":"2023-05-17T15:10:21.678084+0000","last_became_active":"2023-05-17T15:10:21.291602+0000","last_became_peered":"2023-05-17T15:10:21.291602+0000","last_unstale":"2023-05-17T15:10:21.678084+0000","last_undegraded":"2023-05-17T15:10:21.678084+0000","last_fullsized":"2023-05-17T15:10:21.678084+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694413+0000","last_change":"2023-05-17T15:10:21.691605+0000","last_active":"2023-05-17T15:10:21.694413+0000","last_peered":"2023-05-17T15:10:21.694413+0000","last_clean":"2023-05-17T15:10:21.694413+0000","last_became_active":"2023-05-17T15:10:21.691312+0000","last_became_peered":"2023-05-17T15:10:21.691312+0000","last_unstale":"2023-05-17T15:10:21.694413+0000","last_undegraded":"2023-05-17T15:10:21.694413+0000","last_fullsized":"2023-05-17T15:10:21.694413+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681138+0000","last_change":"2023-05-17T15:10:21.297023+0000","last_active":"2023-05-17T15:10:21.681138+0000","last_peered":"2023-05-17T15:10:21.681138+0000","last_clean":"2023-05-17T15:10:21.681138+0000","last_became_active":"2023-05-17T15:10:21.296741+0000","last_became_peered":"2023-05-17T15:10:21.296741+0000","last_unstale":"2023-05-17T15:10:21.681138+0000","last_undegraded":"2023-05-17T15:10:21.681138+0000","last_fullsized":"2023-05-17T15:10:21.681138+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694356+0000","last_change":"2023-05-17T15:10:21.691298+0000","last_active":"2023-05-17T15:10:21.694356+0000","last_peered":"2023-05-17T15:10:21.694356+0000","last_clean":"2023-05-17T15:10:21.694356+0000","last_became_active":"2023-05-17T15:10:21.690993+0000","last_became_peered":"2023-05-17T15:10:21.690993+0000","last_unstale":"2023-05-17T15:10:21.694356+0000","last_undegraded":"2023-05-17T15:10:21.694356+0000","last_fullsized":"2023-05-17T15:10:21.694356+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674536+0000","last_change":"2023-05-17T15:10:21.300290+0000","last_active":"2023-05-17T15:10:21.674536+0000","last_peered":"2023-05-17T15:10:21.674536+0000","last_clean":"2023-05-17T15:10:21.674536+0000","last_became_active":"2023-05-17T15:10:21.299599+0000","last_became_peered":"2023-05-17T15:10:21.299599+0000","last_unstale":"2023-05-17T15:10:21.674536+0000","last_undegraded":"2023-05-17T15:10:21.674536+0000","last_fullsized":"2023-05-17T15:10:21.674536+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692213+0000","last_change":"2023-05-17T15:10:21.689525+0000","last_active":"2023-05-17T15:10:21.692213+0000","last_peered":"2023-05-17T15:10:21.692213+0000","last_clean":"2023-05-17T15:10:21.692213+0000","last_became_active":"2023-05-17T15:10:21.688968+0000","last_became_peered":"2023-05-17T15:10:21.688968+0000","last_unstale":"2023-05-17T15:10:21.692213+0000","last_undegraded":"2023-05-17T15:10:21.692213+0000","last_fullsized":"2023-05-17T15:10:21.692213+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.677408+0000","last_change":"2023-05-17T15:10:21.291432+0000","last_active":"2023-05-17T15:10:21.677408+0000","last_peered":"2023-05-17T15:10:21.677408+0000","last_clean":"2023-05-17T15:10:21.677408+0000","last_became_active":"2023-05-17T15:10:21.288800+0000","last_became_peered":"2023-05-17T15:10:21.288800+0000","last_unstale":"2023-05-17T15:10:21.677408+0000","last_undegraded":"2023-05-17T15:10:21.677408+0000","last_fullsized":"2023-05-17T15:10:21.677408+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693855+0000","last_change":"2023-05-17T15:10:21.686284+0000","last_active":"2023-05-17T15:10:21.693855+0000","last_peered":"2023-05-17T15:10:21.693855+0000","last_clean":"2023-05-17T15:10:21.693855+0000","last_became_active":"2023-05-17T15:10:21.684239+0000","last_became_peered":"2023-05-17T15:10:21.684239+0000","last_unstale":"2023-05-17T15:10:21.693855+0000","last_undegraded":"2023-05-17T15:10:21.693855+0000","last_fullsized":"2023-05-17T15:10:21.693855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679410+0000","last_change":"2023-05-17T15:10:21.297089+0000","last_active":"2023-05-17T15:10:21.679410+0000","last_peered":"2023-05-17T15:10:21.679410+0000","last_clean":"2023-05-17T15:10:21.679410+0000","last_became_active":"2023-05-17T15:10:21.296773+0000","last_became_peered":"2023-05-17T15:10:21.296773+0000","last_unstale":"2023-05-17T15:10:21.679410+0000","last_undegraded":"2023-05-17T15:10:21.679410+0000","last_fullsized":"2023-05-17T15:10:21.679410+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699232+0000","last_change":"2023-05-17T15:10:21.697475+0000","last_active":"2023-05-17T15:10:21.699232+0000","last_peered":"2023-05-17T15:10:21.699232+0000","last_clean":"2023-05-17T15:10:21.699232+0000","last_became_active":"2023-05-17T15:10:21.697193+0000","last_became_peered":"2023-05-17T15:10:21.697193+0000","last_unstale":"2023-05-17T15:10:21.699232+0000","last_undegraded":"2023-05-17T15:10:21.699232+0000","last_fullsized":"2023-05-17T15:10:21.699232+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671010+0000","last_change":"2023-05-17T15:10:21.296684+0000","last_active":"2023-05-17T15:10:21.671010+0000","last_peered":"2023-05-17T15:10:21.671010+0000","last_clean":"2023-05-17T15:10:21.671010+0000","last_became_active":"2023-05-17T15:10:21.290716+0000","last_became_peered":"2023-05-17T15:10:21.290716+0000","last_unstale":"2023-05-17T15:10:21.671010+0000","last_undegraded":"2023-05-17T15:10:21.671010+0000","last_fullsized":"2023-05-17T15:10:21.671010+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685829+0000","last_change":"2023-05-17T15:10:21.682646+0000","last_active":"2023-05-17T15:10:21.685829+0000","last_peered":"2023-05-17T15:10:21.685829+0000","last_clean":"2023-05-17T15:10:21.685829+0000","last_became_active":"2023-05-17T15:10:21.681751+0000","last_became_peered":"2023-05-17T15:10:21.681751+0000","last_unstale":"2023-05-17T15:10:21.685829+0000","last_undegraded":"2023-05-17T15:10:21.685829+0000","last_fullsized":"2023-05-17T15:10:21.685829+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675476+0000","last_change":"2023-05-17T15:10:21.285520+0000","last_active":"2023-05-17T15:10:21.675476+0000","last_peered":"2023-05-17T15:10:21.675476+0000","last_clean":"2023-05-17T15:10:21.675476+0000","last_became_active":"2023-05-17T15:10:21.285201+0000","last_became_peered":"2023-05-17T15:10:21.285201+0000","last_unstale":"2023-05-17T15:10:21.675476+0000","last_undegraded":"2023-05-17T15:10:21.675476+0000","last_fullsized":"2023-05-17T15:10:21.675476+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694439+0000","last_change":"2023-05-17T15:10:21.693273+0000","last_active":"2023-05-17T15:10:21.694439+0000","last_peered":"2023-05-17T15:10:21.694439+0000","last_clean":"2023-05-17T15:10:21.694439+0000","last_became_active":"2023-05-17T15:10:21.692975+0000","last_became_peered":"2023-05-17T15:10:21.692975+0000","last_unstale":"2023-05-17T15:10:21.694439+0000","last_undegraded":"2023-05-17T15:10:21.694439+0000","last_fullsized":"2023-05-17T15:10:21.694439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681548+0000","last_change":"2023-05-17T15:10:21.298675+0000","last_active":"2023-05-17T15:10:21.681548+0000","last_peered":"2023-05-17T15:10:21.681548+0000","last_clean":"2023-05-17T15:10:21.681548+0000","last_became_active":"2023-05-17T15:10:21.298404+0000","last_became_peered":"2023-05-17T15:10:21.298404+0000","last_unstale":"2023-05-17T15:10:21.681548+0000","last_undegraded":"2023-05-17T15:10:21.681548+0000","last_fullsized":"2023-05-17T15:10:21.681548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696504+0000","last_change":"2023-05-17T15:10:21.694697+0000","last_active":"2023-05-17T15:10:21.696504+0000","last_peered":"2023-05-17T15:10:21.696504+0000","last_clean":"2023-05-17T15:10:21.696504+0000","last_became_active":"2023-05-17T15:10:21.694445+0000","last_became_peered":"2023-05-17T15:10:21.694445+0000","last_unstale":"2023-05-17T15:10:21.696504+0000","last_undegraded":"2023-05-17T15:10:21.696504+0000","last_fullsized":"2023-05-17T15:10:21.696504+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693885+0000","last_change":"2023-05-17T15:10:21.288608+0000","last_active":"2023-05-17T15:10:21.693885+0000","last_peered":"2023-05-17T15:10:21.693885+0000","last_clean":"2023-05-17T15:10:21.693885+0000","last_became_active":"2023-05-17T15:10:21.288281+0000","last_became_peered":"2023-05-17T15:10:21.288281+0000","last_unstale":"2023-05-17T15:10:21.693885+0000","last_undegraded":"2023-05-17T15:10:21.693885+0000","last_fullsized":"2023-05-17T15:10:21.693885+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688927+0000","last_change":"2023-05-17T15:10:21.683486+0000","last_active":"2023-05-17T15:10:21.688927+0000","last_peered":"2023-05-17T15:10:21.688927+0000","last_clean":"2023-05-17T15:10:21.688927+0000","last_became_active":"2023-05-17T15:10:21.683229+0000","last_became_peered":"2023-05-17T15:10:21.683229+0000","last_unstale":"2023-05-17T15:10:21.688927+0000","last_undegraded":"2023-05-17T15:10:21.688927+0000","last_fullsized":"2023-05-17T15:10:21.688927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693732+0000","last_change":"2023-05-17T15:10:21.295144+0000","last_active":"2023-05-17T15:10:21.693732+0000","last_peered":"2023-05-17T15:10:21.693732+0000","last_clean":"2023-05-17T15:10:21.693732+0000","last_became_active":"2023-05-17T15:10:21.294535+0000","last_became_peered":"2023-05-17T15:10:21.294535+0000","last_unstale":"2023-05-17T15:10:21.693732+0000","last_undegraded":"2023-05-17T15:10:21.693732+0000","last_fullsized":"2023-05-17T15:10:21.693732+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694036+0000","last_change":"2023-05-17T15:10:21.693100+0000","last_active":"2023-05-17T15:10:21.694036+0000","last_peered":"2023-05-17T15:10:21.694036+0000","last_clean":"2023-05-17T15:10:21.694036+0000","last_became_active":"2023-05-17T15:10:21.692790+0000","last_became_peered":"2023-05-17T15:10:21.692790+0000","last_unstale":"2023-05-17T15:10:21.694036+0000","last_undegraded":"2023-05-17T15:10:21.694036+0000","last_fullsized":"2023-05-17T15:10:21.694036+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697462+0000","last_change":"2023-05-17T15:10:21.299838+0000","last_active":"2023-05-17T15:10:21.697462+0000","last_peered":"2023-05-17T15:10:21.697462+0000","last_clean":"2023-05-17T15:10:21.697462+0000","last_became_active":"2023-05-17T15:10:21.299614+0000","last_became_peered":"2023-05-17T15:10:21.299614+0000","last_unstale":"2023-05-17T15:10:21.697462+0000","last_undegraded":"2023-05-17T15:10:21.697462+0000","last_fullsized":"2023-05-17T15:10:21.697462+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697058+0000","last_change":"2023-05-17T15:10:21.693852+0000","last_active":"2023-05-17T15:10:21.697058+0000","last_peered":"2023-05-17T15:10:21.697058+0000","last_clean":"2023-05-17T15:10:21.697058+0000","last_became_active":"2023-05-17T15:10:21.693190+0000","last_became_peered":"2023-05-17T15:10:21.693190+0000","last_unstale":"2023-05-17T15:10:21.697058+0000","last_undegraded":"2023-05-17T15:10:21.697058+0000","last_fullsized":"2023-05-17T15:10:21.697058+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682018+0000","last_change":"2023-05-17T15:10:21.294898+0000","last_active":"2023-05-17T15:10:21.682018+0000","last_peered":"2023-05-17T15:10:21.682018+0000","last_clean":"2023-05-17T15:10:21.682018+0000","last_became_active":"2023-05-17T15:10:21.294622+0000","last_became_peered":"2023-05-17T15:10:21.294622+0000","last_unstale":"2023-05-17T15:10:21.682018+0000","last_undegraded":"2023-05-17T15:10:21.682018+0000","last_fullsized":"2023-05-17T15:10:21.682018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693870+0000","last_change":"2023-05-17T15:10:21.691292+0000","last_active":"2023-05-17T15:10:21.693870+0000","last_peered":"2023-05-17T15:10:21.693870+0000","last_clean":"2023-05-17T15:10:21.693870+0000","last_became_active":"2023-05-17T15:10:21.691037+0000","last_became_peered":"2023-05-17T15:10:21.691037+0000","last_unstale":"2023-05-17T15:10:21.693870+0000","last_undegraded":"2023-05-17T15:10:21.693870+0000","last_fullsized":"2023-05-17T15:10:21.693870+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.677890+0000","last_change":"2023-05-17T15:10:21.292261+0000","last_active":"2023-05-17T15:10:21.677890+0000","last_peered":"2023-05-17T15:10:21.677890+0000","last_clean":"2023-05-17T15:10:21.677890+0000","last_became_active":"2023-05-17T15:10:21.291988+0000","last_became_peered":"2023-05-17T15:10:21.291988+0000","last_unstale":"2023-05-17T15:10:21.677890+0000","last_undegraded":"2023-05-17T15:10:21.677890+0000","last_fullsized":"2023-05-17T15:10:21.677890+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696614+0000","last_change":"2023-05-17T15:10:21.694755+0000","last_active":"2023-05-17T15:10:21.696614+0000","last_peered":"2023-05-17T15:10:21.696614+0000","last_clean":"2023-05-17T15:10:21.696614+0000","last_became_active":"2023-05-17T15:10:21.694471+0000","last_became_peered":"2023-05-17T15:10:21.694471+0000","last_unstale":"2023-05-17T15:10:21.696614+0000","last_undegraded":"2023-05-17T15:10:21.696614+0000","last_fullsized":"2023-05-17T15:10:21.696614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673474+0000","last_change":"2023-05-17T15:10:21.293702+0000","last_active":"2023-05-17T15:10:21.673474+0000","last_peered":"2023-05-17T15:10:21.673474+0000","last_clean":"2023-05-17T15:10:21.673474+0000","last_became_active":"2023-05-17T15:10:21.293422+0000","last_became_peered":"2023-05-17T15:10:21.293422+0000","last_unstale":"2023-05-17T15:10:21.673474+0000","last_undegraded":"2023-05-17T15:10:21.673474+0000","last_fullsized":"2023-05-17T15:10:21.673474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698432+0000","last_change":"2023-05-17T15:10:21.696746+0000","last_active":"2023-05-17T15:10:21.698432+0000","last_peered":"2023-05-17T15:10:21.698432+0000","last_clean":"2023-05-17T15:10:21.698432+0000","last_became_active":"2023-05-17T15:10:21.696490+0000","last_became_peered":"2023-05-17T15:10:21.696490+0000","last_unstale":"2023-05-17T15:10:21.698432+0000","last_undegraded":"2023-05-17T15:10:21.698432+0000","last_fullsized":"2023-05-17T15:10:21.698432+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675964+0000","last_change":"2023-05-17T15:10:21.298232+0000","last_active":"2023-05-17T15:10:21.675964+0000","last_peered":"2023-05-17T15:10:21.675964+0000","last_clean":"2023-05-17T15:10:21.675964+0000","last_became_active":"2023-05-17T15:10:21.297711+0000","last_became_peered":"2023-05-17T15:10:21.297711+0000","last_unstale":"2023-05-17T15:10:21.675964+0000","last_undegraded":"2023-05-17T15:10:21.675964+0000","last_fullsized":"2023-05-17T15:10:21.675964+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693266+0000","last_change":"2023-05-17T15:10:21.682997+0000","last_active":"2023-05-17T15:10:21.693266+0000","last_peered":"2023-05-17T15:10:21.693266+0000","last_clean":"2023-05-17T15:10:21.693266+0000","last_became_active":"2023-05-17T15:10:21.682798+0000","last_became_peered":"2023-05-17T15:10:21.682798+0000","last_unstale":"2023-05-17T15:10:21.693266+0000","last_undegraded":"2023-05-17T15:10:21.693266+0000","last_fullsized":"2023-05-17T15:10:21.693266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675239+0000","last_change":"2023-05-17T15:10:21.292338+0000","last_active":"2023-05-17T15:10:21.675239+0000","last_peered":"2023-05-17T15:10:21.675239+0000","last_clean":"2023-05-17T15:10:21.675239+0000","last_became_active":"2023-05-17T15:10:21.289967+0000","last_became_peered":"2023-05-17T15:10:21.289967+0000","last_unstale":"2023-05-17T15:10:21.675239+0000","last_undegraded":"2023-05-17T15:10:21.675239+0000","last_fullsized":"2023-05-17T15:10:21.675239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696914+0000","last_change":"2023-05-17T15:10:21.696004+0000","last_active":"2023-05-17T15:10:21.696914+0000","last_peered":"2023-05-17T15:10:21.696914+0000","last_clean":"2023-05-17T15:10:21.696914+0000","last_became_active":"2023-05-17T15:10:21.695768+0000","last_became_peered":"2023-05-17T15:10:21.695768+0000","last_unstale":"2023-05-17T15:10:21.696914+0000","last_undegraded":"2023-05-17T15:10:21.696914+0000","last_fullsized":"2023-05-17T15:10:21.696914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.672947+0000","last_change":"2023-05-17T15:10:21.300161+0000","last_active":"2023-05-17T15:10:21.672947+0000","last_peered":"2023-05-17T15:10:21.672947+0000","last_clean":"2023-05-17T15:10:21.672947+0000","last_became_active":"2023-05-17T15:10:21.299864+0000","last_became_peered":"2023-05-17T15:10:21.299864+0000","last_unstale":"2023-05-17T15:10:21.672947+0000","last_undegraded":"2023-05-17T15:10:21.672947+0000","last_fullsized":"2023-05-17T15:10:21.672947+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690654+0000","last_change":"2023-05-17T15:10:21.689154+0000","last_active":"2023-05-17T15:10:21.690654+0000","last_peered":"2023-05-17T15:10:21.690654+0000","last_clean":"2023-05-17T15:10:21.690654+0000","last_became_active":"2023-05-17T15:10:21.688888+0000","last_became_peered":"2023-05-17T15:10:21.688888+0000","last_unstale":"2023-05-17T15:10:21.690654+0000","last_undegraded":"2023-05-17T15:10:21.690654+0000","last_fullsized":"2023-05-17T15:10:21.690654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681341+0000","last_change":"2023-05-17T15:10:21.292560+0000","last_active":"2023-05-17T15:10:21.681341+0000","last_peered":"2023-05-17T15:10:21.681341+0000","last_clean":"2023-05-17T15:10:21.681341+0000","last_became_active":"2023-05-17T15:10:21.292093+0000","last_became_peered":"2023-05-17T15:10:21.292093+0000","last_unstale":"2023-05-17T15:10:21.681341+0000","last_undegraded":"2023-05-17T15:10:21.681341+0000","last_fullsized":"2023-05-17T15:10:21.681341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694968+0000","last_change":"2023-05-17T15:10:21.693638+0000","last_active":"2023-05-17T15:10:21.694968+0000","last_peered":"2023-05-17T15:10:21.694968+0000","last_clean":"2023-05-17T15:10:21.694968+0000","last_became_active":"2023-05-17T15:10:21.693339+0000","last_became_peered":"2023-05-17T15:10:21.693339+0000","last_unstale":"2023-05-17T15:10:21.694968+0000","last_undegraded":"2023-05-17T15:10:21.694968+0000","last_fullsized":"2023-05-17T15:10:21.694968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691068+0000","last_change":"2023-05-17T15:10:21.295388+0000","last_active":"2023-05-17T15:10:21.691068+0000","last_peered":"2023-05-17T15:10:21.691068+0000","last_clean":"2023-05-17T15:10:21.691068+0000","last_became_active":"2023-05-17T15:10:21.295093+0000","last_became_peered":"2023-05-17T15:10:21.295093+0000","last_unstale":"2023-05-17T15:10:21.691068+0000","last_undegraded":"2023-05-17T15:10:21.691068+0000","last_fullsized":"2023-05-17T15:10:21.691068+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692231+0000","last_change":"2023-05-17T15:10:21.690962+0000","last_active":"2023-05-17T15:10:21.692231+0000","last_peered":"2023-05-17T15:10:21.692231+0000","last_clean":"2023-05-17T15:10:21.692231+0000","last_became_active":"2023-05-17T15:10:21.690681+0000","last_became_peered":"2023-05-17T15:10:21.690681+0000","last_unstale":"2023-05-17T15:10:21.692231+0000","last_undegraded":"2023-05-17T15:10:21.692231+0000","last_fullsized":"2023-05-17T15:10:21.692231+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690609+0000","last_change":"2023-05-17T15:10:21.294753+0000","last_active":"2023-05-17T15:10:21.690609+0000","last_peered":"2023-05-17T15:10:21.690609+0000","last_clean":"2023-05-17T15:10:21.690609+0000","last_became_active":"2023-05-17T15:10:21.294465+0000","last_became_peered":"2023-05-17T15:10:21.294465+0000","last_unstale":"2023-05-17T15:10:21.690609+0000","last_undegraded":"2023-05-17T15:10:21.690609+0000","last_fullsized":"2023-05-17T15:10:21.690609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696276+0000","last_change":"2023-05-17T15:10:21.684825+0000","last_active":"2023-05-17T15:10:21.696276+0000","last_peered":"2023-05-17T15:10:21.696276+0000","last_clean":"2023-05-17T15:10:21.696276+0000","last_became_active":"2023-05-17T15:10:21.684525+0000","last_became_peered":"2023-05-17T15:10:21.684525+0000","last_unstale":"2023-05-17T15:10:21.696276+0000","last_undegraded":"2023-05-17T15:10:21.696276+0000","last_fullsized":"2023-05-17T15:10:21.696276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691116+0000","last_change":"2023-05-17T15:10:21.290239+0000","last_active":"2023-05-17T15:10:21.691116+0000","last_peered":"2023-05-17T15:10:21.691116+0000","last_clean":"2023-05-17T15:10:21.691116+0000","last_became_active":"2023-05-17T15:10:21.289965+0000","last_became_peered":"2023-05-17T15:10:21.289965+0000","last_unstale":"2023-05-17T15:10:21.691116+0000","last_undegraded":"2023-05-17T15:10:21.691116+0000","last_fullsized":"2023-05-17T15:10:21.691116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693517+0000","last_change":"2023-05-17T15:10:21.687206+0000","last_active":"2023-05-17T15:10:21.693517+0000","last_peered":"2023-05-17T15:10:21.693517+0000","last_clean":"2023-05-17T15:10:21.693517+0000","last_became_active":"2023-05-17T15:10:21.686885+0000","last_became_peered":"2023-05-17T15:10:21.686885+0000","last_unstale":"2023-05-17T15:10:21.693517+0000","last_undegraded":"2023-05-17T15:10:21.693517+0000","last_fullsized":"2023-05-17T15:10:21.693517+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675392+0000","last_change":"2023-05-17T15:10:21.293582+0000","last_active":"2023-05-17T15:10:21.675392+0000","last_peered":"2023-05-17T15:10:21.675392+0000","last_clean":"2023-05-17T15:10:21.675392+0000","last_became_active":"2023-05-17T15:10:21.293290+0000","last_became_peered":"2023-05-17T15:10:21.293290+0000","last_unstale":"2023-05-17T15:10:21.675392+0000","last_undegraded":"2023-05-17T15:10:21.675392+0000","last_fullsized":"2023-05-17T15:10:21.675392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689211+0000","last_change":"2023-05-17T15:10:21.683174+0000","last_active":"2023-05-17T15:10:21.689211+0000","last_peered":"2023-05-17T15:10:21.689211+0000","last_clean":"2023-05-17T15:10:21.689211+0000","last_became_active":"2023-05-17T15:10:21.682594+0000","last_became_peered":"2023-05-17T15:10:21.682594+0000","last_unstale":"2023-05-17T15:10:21.689211+0000","last_undegraded":"2023-05-17T15:10:21.689211+0000","last_fullsized":"2023-05-17T15:10:21.689211+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670511+0000","last_change":"2023-05-17T15:10:21.294708+0000","last_active":"2023-05-17T15:10:21.670511+0000","last_peered":"2023-05-17T15:10:21.670511+0000","last_clean":"2023-05-17T15:10:21.670511+0000","last_became_active":"2023-05-17T15:10:21.294391+0000","last_became_peered":"2023-05-17T15:10:21.294391+0000","last_unstale":"2023-05-17T15:10:21.670511+0000","last_undegraded":"2023-05-17T15:10:21.670511+0000","last_fullsized":"2023-05-17T15:10:21.670511+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699542+0000","last_change":"2023-05-17T15:10:21.697712+0000","last_active":"2023-05-17T15:10:21.699542+0000","last_peered":"2023-05-17T15:10:21.699542+0000","last_clean":"2023-05-17T15:10:21.699542+0000","last_became_active":"2023-05-17T15:10:21.697438+0000","last_became_peered":"2023-05-17T15:10:21.697438+0000","last_unstale":"2023-05-17T15:10:21.699542+0000","last_undegraded":"2023-05-17T15:10:21.699542+0000","last_fullsized":"2023-05-17T15:10:21.699542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697576+0000","last_change":"2023-05-17T15:10:21.299773+0000","last_active":"2023-05-17T15:10:21.697576+0000","last_peered":"2023-05-17T15:10:21.697576+0000","last_clean":"2023-05-17T15:10:21.697576+0000","last_became_active":"2023-05-17T15:10:21.299464+0000","last_became_peered":"2023-05-17T15:10:21.299464+0000","last_unstale":"2023-05-17T15:10:21.697576+0000","last_undegraded":"2023-05-17T15:10:21.697576+0000","last_fullsized":"2023-05-17T15:10:21.697576+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690346+0000","last_change":"2023-05-17T15:10:21.687552+0000","last_active":"2023-05-17T15:10:21.690346+0000","last_peered":"2023-05-17T15:10:21.690346+0000","last_clean":"2023-05-17T15:10:21.690346+0000","last_became_active":"2023-05-17T15:10:21.687317+0000","last_became_peered":"2023-05-17T15:10:21.687317+0000","last_unstale":"2023-05-17T15:10:21.690346+0000","last_undegraded":"2023-05-17T15:10:21.690346+0000","last_fullsized":"2023-05-17T15:10:21.690346+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694620+0000","last_change":"2023-05-17T15:10:21.291005+0000","last_active":"2023-05-17T15:10:21.694620+0000","last_peered":"2023-05-17T15:10:21.694620+0000","last_clean":"2023-05-17T15:10:21.694620+0000","last_became_active":"2023-05-17T15:10:21.290732+0000","last_became_peered":"2023-05-17T15:10:21.290732+0000","last_unstale":"2023-05-17T15:10:21.694620+0000","last_undegraded":"2023-05-17T15:10:21.694620+0000","last_fullsized":"2023-05-17T15:10:21.694620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681163+0000","last_change":"2023-05-17T15:10:21.680293+0000","last_active":"2023-05-17T15:10:21.681163+0000","last_peered":"2023-05-17T15:10:21.681163+0000","last_clean":"2023-05-17T15:10:21.681163+0000","last_became_active":"2023-05-17T15:10:21.680059+0000","last_became_peered":"2023-05-17T15:10:21.680059+0000","last_unstale":"2023-05-17T15:10:21.681163+0000","last_undegraded":"2023-05-17T15:10:21.681163+0000","last_fullsized":"2023-05-17T15:10:21.681163+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681239+0000","last_change":"2023-05-17T15:10:21.297096+0000","last_active":"2023-05-17T15:10:21.681239+0000","last_peered":"2023-05-17T15:10:21.681239+0000","last_clean":"2023-05-17T15:10:21.681239+0000","last_became_active":"2023-05-17T15:10:21.296805+0000","last_became_peered":"2023-05-17T15:10:21.296805+0000","last_unstale":"2023-05-17T15:10:21.681239+0000","last_undegraded":"2023-05-17T15:10:21.681239+0000","last_fullsized":"2023-05-17T15:10:21.681239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686740+0000","last_change":"2023-05-17T15:10:21.681045+0000","last_active":"2023-05-17T15:10:21.686740+0000","last_peered":"2023-05-17T15:10:21.686740+0000","last_clean":"2023-05-17T15:10:21.686740+0000","last_became_active":"2023-05-17T15:10:21.680765+0000","last_became_peered":"2023-05-17T15:10:21.680765+0000","last_unstale":"2023-05-17T15:10:21.686740+0000","last_undegraded":"2023-05-17T15:10:21.686740+0000","last_fullsized":"2023-05-17T15:10:21.686740+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674582+0000","last_change":"2023-05-17T15:10:21.290711+0000","last_active":"2023-05-17T15:10:21.674582+0000","last_peered":"2023-05-17T15:10:21.674582+0000","last_clean":"2023-05-17T15:10:21.674582+0000","last_became_active":"2023-05-17T15:10:21.290407+0000","last_became_peered":"2023-05-17T15:10:21.290407+0000","last_unstale":"2023-05-17T15:10:21.674582+0000","last_undegraded":"2023-05-17T15:10:21.674582+0000","last_fullsized":"2023-05-17T15:10:21.674582+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697076+0000","last_change":"2023-05-17T15:10:21.694208+0000","last_active":"2023-05-17T15:10:21.697076+0000","last_peered":"2023-05-17T15:10:21.697076+0000","last_clean":"2023-05-17T15:10:21.697076+0000","last_became_active":"2023-05-17T15:10:21.693812+0000","last_became_peered":"2023-05-17T15:10:21.693812+0000","last_unstale":"2023-05-17T15:10:21.697076+0000","last_undegraded":"2023-05-17T15:10:21.697076+0000","last_fullsized":"2023-05-17T15:10:21.697076+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682140+0000","last_change":"2023-05-17T15:10:21.293631+0000","last_active":"2023-05-17T15:10:21.682140+0000","last_peered":"2023-05-17T15:10:21.682140+0000","last_clean":"2023-05-17T15:10:21.682140+0000","last_became_active":"2023-05-17T15:10:21.293366+0000","last_became_peered":"2023-05-17T15:10:21.293366+0000","last_unstale":"2023-05-17T15:10:21.682140+0000","last_undegraded":"2023-05-17T15:10:21.682140+0000","last_fullsized":"2023-05-17T15:10:21.682140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693690+0000","last_change":"2023-05-17T15:10:21.688471+0000","last_active":"2023-05-17T15:10:21.693690+0000","last_peered":"2023-05-17T15:10:21.693690+0000","last_clean":"2023-05-17T15:10:21.693690+0000","last_became_active":"2023-05-17T15:10:21.688210+0000","last_became_peered":"2023-05-17T15:10:21.688210+0000","last_unstale":"2023-05-17T15:10:21.693690+0000","last_undegraded":"2023-05-17T15:10:21.693690+0000","last_fullsized":"2023-05-17T15:10:21.693690+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671560+0000","last_change":"2023-05-17T15:10:21.297138+0000","last_active":"2023-05-17T15:10:21.671560+0000","last_peered":"2023-05-17T15:10:21.671560+0000","last_clean":"2023-05-17T15:10:21.671560+0000","last_became_active":"2023-05-17T15:10:21.296841+0000","last_became_peered":"2023-05-17T15:10:21.296841+0000","last_unstale":"2023-05-17T15:10:21.671560+0000","last_undegraded":"2023-05-17T15:10:21.671560+0000","last_fullsized":"2023-05-17T15:10:21.671560+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694629+0000","last_change":"2023-05-17T15:10:21.693002+0000","last_active":"2023-05-17T15:10:21.694629+0000","last_peered":"2023-05-17T15:10:21.694629+0000","last_clean":"2023-05-17T15:10:21.694629+0000","last_became_active":"2023-05-17T15:10:21.690224+0000","last_became_peered":"2023-05-17T15:10:21.690224+0000","last_unstale":"2023-05-17T15:10:21.694629+0000","last_undegraded":"2023-05-17T15:10:21.694629+0000","last_fullsized":"2023-05-17T15:10:21.694629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670786+0000","last_change":"2023-05-17T15:10:21.297424+0000","last_active":"2023-05-17T15:10:21.670786+0000","last_peered":"2023-05-17T15:10:21.670786+0000","last_clean":"2023-05-17T15:10:21.670786+0000","last_became_active":"2023-05-17T15:10:21.296968+0000","last_became_peered":"2023-05-17T15:10:21.296968+0000","last_unstale":"2023-05-17T15:10:21.670786+0000","last_undegraded":"2023-05-17T15:10:21.670786+0000","last_fullsized":"2023-05-17T15:10:21.670786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698614+0000","last_change":"2023-05-17T15:10:21.696983+0000","last_active":"2023-05-17T15:10:21.698614+0000","last_peered":"2023-05-17T15:10:21.698614+0000","last_clean":"2023-05-17T15:10:21.698614+0000","last_became_active":"2023-05-17T15:10:21.696681+0000","last_became_peered":"2023-05-17T15:10:21.696681+0000","last_unstale":"2023-05-17T15:10:21.698614+0000","last_undegraded":"2023-05-17T15:10:21.698614+0000","last_fullsized":"2023-05-17T15:10:21.698614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.678572+0000","last_change":"2023-05-17T15:10:21.288635+0000","last_active":"2023-05-17T15:10:21.678572+0000","last_peered":"2023-05-17T15:10:21.678572+0000","last_clean":"2023-05-17T15:10:21.678572+0000","last_became_active":"2023-05-17T15:10:21.288306+0000","last_became_peered":"2023-05-17T15:10:21.288306+0000","last_unstale":"2023-05-17T15:10:21.678572+0000","last_undegraded":"2023-05-17T15:10:21.678572+0000","last_fullsized":"2023-05-17T15:10:21.678572+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696269+0000","last_change":"2023-05-17T15:10:21.686410+0000","last_active":"2023-05-17T15:10:21.696269+0000","last_peered":"2023-05-17T15:10:21.696269+0000","last_clean":"2023-05-17T15:10:21.696269+0000","last_became_active":"2023-05-17T15:10:21.685577+0000","last_became_peered":"2023-05-17T15:10:21.685577+0000","last_unstale":"2023-05-17T15:10:21.696269+0000","last_undegraded":"2023-05-17T15:10:21.696269+0000","last_fullsized":"2023-05-17T15:10:21.696269+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670815+0000","last_change":"2023-05-17T15:10:21.297742+0000","last_active":"2023-05-17T15:10:21.670815+0000","last_peered":"2023-05-17T15:10:21.670815+0000","last_clean":"2023-05-17T15:10:21.670815+0000","last_became_active":"2023-05-17T15:10:21.295280+0000","last_became_peered":"2023-05-17T15:10:21.295280+0000","last_unstale":"2023-05-17T15:10:21.670815+0000","last_undegraded":"2023-05-17T15:10:21.670815+0000","last_fullsized":"2023-05-17T15:10:21.670815+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693624+0000","last_change":"2023-05-17T15:10:21.686165+0000","last_active":"2023-05-17T15:10:21.693624+0000","last_peered":"2023-05-17T15:10:21.693624+0000","last_clean":"2023-05-17T15:10:21.693624+0000","last_became_active":"2023-05-17T15:10:21.685897+0000","last_became_peered":"2023-05-17T15:10:21.685897+0000","last_unstale":"2023-05-17T15:10:21.693624+0000","last_undegraded":"2023-05-17T15:10:21.693624+0000","last_fullsized":"2023-05-17T15:10:21.693624+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675673+0000","last_change":"2023-05-17T15:10:21.290882+0000","last_active":"2023-05-17T15:10:21.675673+0000","last_peered":"2023-05-17T15:10:21.675673+0000","last_clean":"2023-05-17T15:10:21.675673+0000","last_became_active":"2023-05-17T15:10:21.290588+0000","last_became_peered":"2023-05-17T15:10:21.290588+0000","last_unstale":"2023-05-17T15:10:21.675673+0000","last_undegraded":"2023-05-17T15:10:21.675673+0000","last_fullsized":"2023-05-17T15:10:21.675673+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682219+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:21.682219+0000","last_peered":"2023-05-17T15:10:21.682219+0000","last_clean":"2023-05-17T15:10:21.682219+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:21.682219+0000","last_undegraded":"2023-05-17T15:10:21.682219+0000","last_fullsized":"2023-05-17T15:10:21.682219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693195+0000","last_change":"2023-05-17T15:10:21.685833+0000","last_active":"2023-05-17T15:10:21.693195+0000","last_peered":"2023-05-17T15:10:21.693195+0000","last_clean":"2023-05-17T15:10:21.693195+0000","last_became_active":"2023-05-17T15:10:21.685558+0000","last_became_peered":"2023-05-17T15:10:21.685558+0000","last_unstale":"2023-05-17T15:10:21.693195+0000","last_undegraded":"2023-05-17T15:10:21.693195+0000","last_fullsized":"2023-05-17T15:10:21.693195+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692312+0000","last_change":"2023-05-17T15:10:21.291323+0000","last_active":"2023-05-17T15:10:21.692312+0000","last_peered":"2023-05-17T15:10:21.692312+0000","last_clean":"2023-05-17T15:10:21.692312+0000","last_became_active":"2023-05-17T15:10:21.290241+0000","last_became_peered":"2023-05-17T15:10:21.290241+0000","last_unstale":"2023-05-17T15:10:21.692312+0000","last_undegraded":"2023-05-17T15:10:21.692312+0000","last_fullsized":"2023-05-17T15:10:21.692312+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673594+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:21.673594+0000","last_peered":"2023-05-17T15:10:21.673594+0000","last_clean":"2023-05-17T15:10:21.673594+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:21.673594+0000","last_undegraded":"2023-05-17T15:10:21.673594+0000","last_fullsized":"2023-05-17T15:10:21.673594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689689+0000","last_change":"2023-05-17T15:10:21.687760+0000","last_active":"2023-05-17T15:10:21.689689+0000","last_peered":"2023-05-17T15:10:21.689689+0000","last_clean":"2023-05-17T15:10:21.689689+0000","last_became_active":"2023-05-17T15:10:21.687515+0000","last_became_peered":"2023-05-17T15:10:21.687515+0000","last_unstale":"2023-05-17T15:10:21.689689+0000","last_undegraded":"2023-05-17T15:10:21.689689+0000","last_fullsized":"2023-05-17T15:10:21.689689+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674769+0000","last_change":"2023-05-17T15:10:21.296404+0000","last_active":"2023-05-17T15:10:21.674769+0000","last_peered":"2023-05-17T15:10:21.674769+0000","last_clean":"2023-05-17T15:10:21.674769+0000","last_became_active":"2023-05-17T15:10:21.296102+0000","last_became_peered":"2023-05-17T15:10:21.296102+0000","last_unstale":"2023-05-17T15:10:21.674769+0000","last_undegraded":"2023-05-17T15:10:21.674769+0000","last_fullsized":"2023-05-17T15:10:21.674769+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670607+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:21.670607+0000","last_peered":"2023-05-17T15:10:21.670607+0000","last_clean":"2023-05-17T15:10:21.670607+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:21.670607+0000","last_undegraded":"2023-05-17T15:10:21.670607+0000","last_fullsized":"2023-05-17T15:10:21.670607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.693385+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.682985+0000","last_became_peered":"2023-05-17T15:10:21.682985+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694622+0000","last_change":"2023-05-17T15:10:21.293923+0000","last_active":"2023-05-17T15:10:21.694622+0000","last_peered":"2023-05-17T15:10:21.694622+0000","last_clean":"2023-05-17T15:10:21.694622+0000","last_became_active":"2023-05-17T15:10:21.290866+0000","last_became_peered":"2023-05-17T15:10:21.290866+0000","last_unstale":"2023-05-17T15:10:21.694622+0000","last_undegraded":"2023-05-17T15:10:21.694622+0000","last_fullsized":"2023-05-17T15:10:21.694622+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675429+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:21.675429+0000","last_peered":"2023-05-17T15:10:21.675429+0000","last_clean":"2023-05-17T15:10:21.675429+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:21.675429+0000","last_undegraded":"2023-05-17T15:10:21.675429+0000","last_fullsized":"2023-05-17T15:10:21.675429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675089+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:21.675089+0000","last_peered":"2023-05-17T15:10:21.675089+0000","last_clean":"2023-05-17T15:10:21.675089+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:21.675089+0000","last_undegraded":"2023-05-17T15:10:21.675089+0000","last_fullsized":"2023-05-17T15:10:21.675089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693864+0000","last_change":"2023-05-17T15:10:21.689011+0000","last_active":"2023-05-17T15:10:21.693864+0000","last_peered":"2023-05-17T15:10:21.693864+0000","last_clean":"2023-05-17T15:10:21.693864+0000","last_became_active":"2023-05-17T15:10:21.688661+0000","last_became_peered":"2023-05-17T15:10:21.688661+0000","last_unstale":"2023-05-17T15:10:21.693864+0000","last_undegraded":"2023-05-17T15:10:21.693864+0000","last_fullsized":"2023-05-17T15:10:21.693864+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674759+0000","last_change":"2023-05-17T15:10:21.292579+0000","last_active":"2023-05-17T15:10:21.674759+0000","last_peered":"2023-05-17T15:10:21.674759+0000","last_clean":"2023-05-17T15:10:21.674759+0000","last_became_active":"2023-05-17T15:10:21.292265+0000","last_became_peered":"2023-05-17T15:10:21.292265+0000","last_unstale":"2023-05-17T15:10:21.674759+0000","last_undegraded":"2023-05-17T15:10:21.674759+0000","last_fullsized":"2023-05-17T15:10:21.674759+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675124+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:21.675124+0000","last_peered":"2023-05-17T15:10:21.675124+0000","last_clean":"2023-05-17T15:10:21.675124+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:21.675124+0000","last_undegraded":"2023-05-17T15:10:21.675124+0000","last_fullsized":"2023-05-17T15:10:21.675124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694563+0000","last_change":"2023-05-17T15:10:21.692741+0000","last_active":"2023-05-17T15:10:21.694563+0000","last_peered":"2023-05-17T15:10:21.694563+0000","last_clean":"2023-05-17T15:10:21.694563+0000","last_became_active":"2023-05-17T15:10:21.690100+0000","last_became_peered":"2023-05-17T15:10:21.690100+0000","last_unstale":"2023-05-17T15:10:21.694563+0000","last_undegraded":"2023-05-17T15:10:21.694563+0000","last_fullsized":"2023-05-17T15:10:21.694563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670906+0000","last_change":"2023-05-17T15:10:21.297556+0000","last_active":"2023-05-17T15:10:21.670906+0000","last_peered":"2023-05-17T15:10:21.670906+0000","last_clean":"2023-05-17T15:10:21.670906+0000","last_became_active":"2023-05-17T15:10:21.289321+0000","last_became_peered":"2023-05-17T15:10:21.289321+0000","last_unstale":"2023-05-17T15:10:21.670906+0000","last_undegraded":"2023-05-17T15:10:21.670906+0000","last_fullsized":"2023-05-17T15:10:21.670906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674983+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:21.674983+0000","last_peered":"2023-05-17T15:10:21.674983+0000","last_clean":"2023-05-17T15:10:21.674983+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:21.674983+0000","last_undegraded":"2023-05-17T15:10:21.674983+0000","last_fullsized":"2023-05-17T15:10:21.674983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692726+0000","last_change":"2023-05-17T15:10:21.688711+0000","last_active":"2023-05-17T15:10:21.692726+0000","last_peered":"2023-05-17T15:10:21.692726+0000","last_clean":"2023-05-17T15:10:21.692726+0000","last_became_active":"2023-05-17T15:10:21.688420+0000","last_became_peered":"2023-05-17T15:10:21.688420+0000","last_unstale":"2023-05-17T15:10:21.692726+0000","last_undegraded":"2023-05-17T15:10:21.692726+0000","last_fullsized":"2023-05-17T15:10:21.692726+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694327+0000","last_change":"2023-05-17T15:10:21.295531+0000","last_active":"2023-05-17T15:10:21.694327+0000","last_peered":"2023-05-17T15:10:21.694327+0000","last_clean":"2023-05-17T15:10:21.694327+0000","last_became_active":"2023-05-17T15:10:21.295253+0000","last_became_peered":"2023-05-17T15:10:21.295253+0000","last_unstale":"2023-05-17T15:10:21.694327+0000","last_undegraded":"2023-05-17T15:10:21.694327+0000","last_fullsized":"2023-05-17T15:10:21.694327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686122+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:21.686122+0000","last_peered":"2023-05-17T15:10:21.686122+0000","last_clean":"2023-05-17T15:10:21.686122+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:21.686122+0000","last_undegraded":"2023-05-17T15:10:21.686122+0000","last_fullsized":"2023-05-17T15:10:21.686122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692908+0000","last_change":"2023-05-17T15:10:21.690118+0000","last_active":"2023-05-17T15:10:21.692908+0000","last_peered":"2023-05-17T15:10:21.692908+0000","last_clean":"2023-05-17T15:10:21.692908+0000","last_became_active":"2023-05-17T15:10:21.689835+0000","last_became_peered":"2023-05-17T15:10:21.689835+0000","last_unstale":"2023-05-17T15:10:21.692908+0000","last_undegraded":"2023-05-17T15:10:21.692908+0000","last_fullsized":"2023-05-17T15:10:21.692908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670901+0000","last_change":"2023-05-17T15:10:21.297233+0000","last_active":"2023-05-17T15:10:21.670901+0000","last_peered":"2023-05-17T15:10:21.670901+0000","last_clean":"2023-05-17T15:10:21.670901+0000","last_became_active":"2023-05-17T15:10:21.291087+0000","last_became_peered":"2023-05-17T15:10:21.291087+0000","last_unstale":"2023-05-17T15:10:21.670901+0000","last_undegraded":"2023-05-17T15:10:21.670901+0000","last_fullsized":"2023-05-17T15:10:21.670901+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.678317+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:21.678317+0000","last_peered":"2023-05-17T15:10:21.678317+0000","last_clean":"2023-05-17T15:10:21.678317+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:21.678317+0000","last_undegraded":"2023-05-17T15:10:21.678317+0000","last_fullsized":"2023-05-17T15:10:21.678317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18556,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353284,"statfs":{"total":96636764160,"available":96617762816,"internally_reserved":0,"allocated":1560576,"data_stored":783841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.84799999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.76800000000000002}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.63400000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18180,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353660,"statfs":{"total":96636764160,"available":96618147840,"internally_reserved":0,"allocated":1568768,"data_stored":784417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.505},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56200000000000006}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.441}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17992,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353848,"statfs":{"total":96636764160,"available":96618340352,"internally_reserved":0,"allocated":1572864,"data_stored":785301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.33700000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17668,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354172,"statfs":{"total":96636764160,"available":96618672128,"internally_reserved":0,"allocated":1568768,"data_stored":784485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.378}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19072,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":17536,"kb_avail":94352768,"statfs":{"total":96636764160,"available":96617234432,"internally_reserved":0,"allocated":1564672,"data_stored":783855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17956864},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.249},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.313}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.72099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":20480,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":1556480,"data_stored":783751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20971520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.46899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18368,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353472,"statfs":{"total":96636764160,"available":96617955328,"internally_reserved":0,"allocated":1564672,"data_stored":784665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.626}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.69499999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.73799999999999999}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.755},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.81000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21564,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350276,"statfs":{"total":96636764160,"available":96614682624,"internally_reserved":0,"allocated":1560576,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77500000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.82999999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:10:30.208 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:10:30.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.334+0000 7fb13e70a700 1 Processor -- start 2023-05-17T15:10:30.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 -- start start 2023-05-17T15:10:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380bf340 0x7fb1380c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1380c3db0 0x7fb138065390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1380665f0 0x7fb138065880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb138065d70 con 0x7fb1380c3db0 2023-05-17T15:10:30.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb138152f90 con 0x7fb1380665f0 2023-05-17T15:10:30.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.335+0000 7fb13e70a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb138153420 con 0x7fb1380bf340 2023-05-17T15:10:30.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1380c3db0 0x7fb138065390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb1380c3db0 0x7fb138065390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42522/0 (socket says 172.21.15.27:42522) 2023-05-17T15:10:30.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 -- 172.21.15.27:0/3862978933 learned_addr learned my addr 172.21.15.27:0/3862978933 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb13cca7700 1 --2- 172.21.15.27:0/3862978933 >> v2:172.21.15.40:3300/0 conn(0x7fb1380665f0 0x7fb138065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb137fff700 1 --2- 172.21.15.27:0/3862978933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380bf340 0x7fb1380c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 -- 172.21.15.27:0/3862978933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380bf340 msgr2=0x7fb1380c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 --2- 172.21.15.27:0/3862978933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380bf340 0x7fb1380c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 -- 172.21.15.27:0/3862978933 >> v2:172.21.15.40:3300/0 conn(0x7fb1380665f0 msgr2=0x7fb138065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 --2- 172.21.15.27:0/3862978933 >> v2:172.21.15.40:3300/0 conn(0x7fb1380665f0 0x7fb138065880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 -- 172.21.15.27:0/3862978933 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138152660 con 0x7fb1380c3db0 2023-05-17T15:10:30.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb1377fe700 1 --2- 172.21.15.27:0/3862978933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380c3db0 0x7fb138065390 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fb13806a900 tx=0x7fb1200090f0).ready entity=mon.0 client_cookie=f2310211963d581f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:30.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb136ffd700 1 -- 172.21.15.27:0/3862978933 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000f510 con 0x7fb1380c3db0 2023-05-17T15:10:30.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb136ffd700 1 -- 172.21.15.27:0/3862978933 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000f670 con 0x7fb1380c3db0 2023-05-17T15:10:30.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.336+0000 7fb136ffd700 1 -- 172.21.15.27:0/3862978933 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000f9f0 con 0x7fb1380c3db0 2023-05-17T15:10:30.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 -- 172.21.15.27:0/3862978933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380c3db0 msgr2=0x7fb138065390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 --2- 172.21.15.27:0/3862978933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380c3db0 0x7fb138065390 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fb13806a900 tx=0x7fb1200090f0).stop 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 -- 172.21.15.27:0/3862978933 shutdown_connections 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 --2- 172.21.15.27:0/3862978933 >> v2:172.21.15.40:3300/0 conn(0x7fb1380665f0 0x7fb138065880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 --2- 172.21.15.27:0/3862978933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380bf340 0x7fb1380c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 --2- 172.21.15.27:0/3862978933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380c3db0 0x7fb138065390 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 -- 172.21.15.27:0/3862978933 >> 172.21.15.27:0/3862978933 conn(0x7fb1380c94a0 msgr2=0x7fb1380c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 -- 172.21.15.27:0/3862978933 shutdown_connections 2023-05-17T15:10:30.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.337+0000 7fb13e70a700 1 -- 172.21.15.27:0/3862978933 wait complete. 2023-05-17T15:10:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.338+0000 7fb13e70a700 1 Processor -- start 2023-05-17T15:10:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.338+0000 7fb13e70a700 1 -- start start 2023-05-17T15:10:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13e70a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380665f0 0x7fb13814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13e70a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 0x7fb138143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13e70a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1380c3db0 0x7fb1380a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13e70a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380c1150 con 0x7fb1380bf340 2023-05-17T15:10:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13e70a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380ac240 con 0x7fb1380c3db0 2023-05-17T15:10:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13e70a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380ac500 con 0x7fb1380665f0 2023-05-17T15:10:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 0x7fb138143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 0x7fb138143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42528/0 (socket says 172.21.15.27:42528) 2023-05-17T15:10:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 -- 172.21.15.27:0/4226271105 learned_addr learned my addr 172.21.15.27:0/4226271105 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:30.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb13cca7700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1380c3db0 0x7fb1380a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb137fff700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380665f0 0x7fb13814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 -- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380665f0 msgr2=0x7fb13814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380665f0 0x7fb13814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 -- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1380c3db0 msgr2=0x7fb1380a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1380c3db0 0x7fb1380a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 -- 172.21.15.27:0/4226271105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009370 con 0x7fb1380bf340 2023-05-17T15:10:30.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb137fff700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380665f0 0x7fb13814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:30.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.339+0000 7fb1377fe700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 0x7fb138143630 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fb120011000 tx=0x7fb120017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:30.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.340+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000f7e0 con 0x7fb1380bf340 2023-05-17T15:10:30.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.340+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000f940 con 0x7fb1380bf340 2023-05-17T15:10:30.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.340+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1380ac7e0 con 0x7fb1380bf340 2023-05-17T15:10:30.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.340+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12001c670 con 0x7fb1380bf340 2023-05-17T15:10:30.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.340+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1380aafd0 con 0x7fb1380bf340 2023-05-17T15:10:30.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.341+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13806bdf0 con 0x7fb1380bf340 2023-05-17T15:10:30.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.341+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb12000f070 con 0x7fb1380bf340 2023-05-17T15:10:30.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.341+0000 7fb12ffff700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb11805edc0 0x7fb118061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.341+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fb12007b510 con 0x7fb1380bf340 2023-05-17T15:10:30.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.342+0000 7fb137fff700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb11805edc0 0x7fb118061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.342+0000 7fb137fff700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb11805edc0 0x7fb118061280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb128009c00 tx=0x7fb128008040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:30.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.346+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb12004c940 con 0x7fb1380bf340 2023-05-17T15:10:30.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.515+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1380c6210 con 0x7fb11805edc0 2023-05-17T15:10:30.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.526+0000 7fb12ffff700 1 -- 172.21.15.27:0/4226271105 <== mgr.7389 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361566 (secure 0 0 0) 0x7fb1380c6210 con 0x7fb11805edc0 2023-05-17T15:10:30.533 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:30.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb11805edc0 msgr2=0x7fb118061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb11805edc0 0x7fb118061280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb128009c00 tx=0x7fb128008040).stop 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 msgr2=0x7fb138143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 0x7fb138143630 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fb120011000 tx=0x7fb120017000).stop 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 shutdown_connections 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb11805edc0 0x7fb118061280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1380c3db0 0x7fb1380a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1380665f0 0x7fb13814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 --2- 172.21.15.27:0/4226271105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1380bf340 0x7fb138143630 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 >> 172.21.15.27:0/4226271105 conn(0x7fb1380c94a0 msgr2=0x7fb138150bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:30.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 shutdown_connections 2023-05-17T15:10:30.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.529+0000 7fb13e70a700 1 -- 172.21.15.27:0/4226271105 wait complete. 2023-05-17T15:10:30.537 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:10:30.544 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-17T15:10:28.730943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":153408,"kb_used_data":12224,"kb_used_omap":0,"kb_used_meta":141120,"kb_avail":754821312,"statfs":{"total":773094113280,"available":772937023488,"internally_reserved":0,"allocated":12517376,"data_stored":6274620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":144506880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18377,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-43,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.508451"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689060+0000","last_change":"2023-05-17T15:10:21.683295+0000","last_active":"2023-05-17T15:10:21.689060+0000","last_peered":"2023-05-17T15:10:21.689060+0000","last_clean":"2023-05-17T15:10:21.689060+0000","last_became_active":"2023-05-17T15:10:21.682915+0000","last_became_peered":"2023-05-17T15:10:21.682915+0000","last_unstale":"2023-05-17T15:10:21.689060+0000","last_undegraded":"2023-05-17T15:10:21.689060+0000","last_fullsized":"2023-05-17T15:10:21.689060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697693+0000","last_change":"2023-05-17T15:10:21.299521+0000","last_active":"2023-05-17T15:10:21.697693+0000","last_peered":"2023-05-17T15:10:21.697693+0000","last_clean":"2023-05-17T15:10:21.697693+0000","last_became_active":"2023-05-17T15:10:21.299249+0000","last_became_peered":"2023-05-17T15:10:21.299249+0000","last_unstale":"2023-05-17T15:10:21.697693+0000","last_undegraded":"2023-05-17T15:10:21.697693+0000","last_fullsized":"2023-05-17T15:10:21.697693+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694394+0000","last_change":"2023-05-17T15:10:21.690313+0000","last_active":"2023-05-17T15:10:21.694394+0000","last_peered":"2023-05-17T15:10:21.694394+0000","last_clean":"2023-05-17T15:10:21.694394+0000","last_became_active":"2023-05-17T15:10:21.690034+0000","last_became_peered":"2023-05-17T15:10:21.690034+0000","last_unstale":"2023-05-17T15:10:21.694394+0000","last_undegraded":"2023-05-17T15:10:21.694394+0000","last_fullsized":"2023-05-17T15:10:21.694394+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681030+0000","last_change":"2023-05-17T15:10:21.292372+0000","last_active":"2023-05-17T15:10:21.681030+0000","last_peered":"2023-05-17T15:10:21.681030+0000","last_clean":"2023-05-17T15:10:21.681030+0000","last_became_active":"2023-05-17T15:10:21.291668+0000","last_became_peered":"2023-05-17T15:10:21.291668+0000","last_unstale":"2023-05-17T15:10:21.681030+0000","last_undegraded":"2023-05-17T15:10:21.681030+0000","last_fullsized":"2023-05-17T15:10:21.681030+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686693+0000","last_change":"2023-05-17T15:10:21.684066+0000","last_active":"2023-05-17T15:10:21.686693+0000","last_peered":"2023-05-17T15:10:21.686693+0000","last_clean":"2023-05-17T15:10:21.686693+0000","last_became_active":"2023-05-17T15:10:21.683761+0000","last_became_peered":"2023-05-17T15:10:21.683761+0000","last_unstale":"2023-05-17T15:10:21.686693+0000","last_undegraded":"2023-05-17T15:10:21.686693+0000","last_fullsized":"2023-05-17T15:10:21.686693+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685863+0000","last_change":"2023-05-17T15:10:21.299601+0000","last_active":"2023-05-17T15:10:21.685863+0000","last_peered":"2023-05-17T15:10:21.685863+0000","last_clean":"2023-05-17T15:10:21.685863+0000","last_became_active":"2023-05-17T15:10:21.299304+0000","last_became_peered":"2023-05-17T15:10:21.299304+0000","last_unstale":"2023-05-17T15:10:21.685863+0000","last_undegraded":"2023-05-17T15:10:21.685863+0000","last_fullsized":"2023-05-17T15:10:21.685863+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689518+0000","last_change":"2023-05-17T15:10:21.682112+0000","last_active":"2023-05-17T15:10:21.689518+0000","last_peered":"2023-05-17T15:10:21.689518+0000","last_clean":"2023-05-17T15:10:21.689518+0000","last_became_active":"2023-05-17T15:10:21.681845+0000","last_became_peered":"2023-05-17T15:10:21.681845+0000","last_unstale":"2023-05-17T15:10:21.689518+0000","last_undegraded":"2023-05-17T15:10:21.689518+0000","last_fullsized":"2023-05-17T15:10:21.689518+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693301+0000","last_change":"2023-05-17T15:10:21.292923+0000","last_active":"2023-05-17T15:10:21.693301+0000","last_peered":"2023-05-17T15:10:21.693301+0000","last_clean":"2023-05-17T15:10:21.693301+0000","last_became_active":"2023-05-17T15:10:21.292654+0000","last_became_peered":"2023-05-17T15:10:21.292654+0000","last_unstale":"2023-05-17T15:10:21.693301+0000","last_undegraded":"2023-05-17T15:10:21.693301+0000","last_fullsized":"2023-05-17T15:10:21.693301+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698385+0000","last_change":"2023-05-17T15:10:21.696216+0000","last_active":"2023-05-17T15:10:21.698385+0000","last_peered":"2023-05-17T15:10:21.698385+0000","last_clean":"2023-05-17T15:10:21.698385+0000","last_became_active":"2023-05-17T15:10:21.695895+0000","last_became_peered":"2023-05-17T15:10:21.695895+0000","last_unstale":"2023-05-17T15:10:21.698385+0000","last_undegraded":"2023-05-17T15:10:21.698385+0000","last_fullsized":"2023-05-17T15:10:21.698385+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694420+0000","last_change":"2023-05-17T15:10:21.288355+0000","last_active":"2023-05-17T15:10:21.694420+0000","last_peered":"2023-05-17T15:10:21.694420+0000","last_clean":"2023-05-17T15:10:21.694420+0000","last_became_active":"2023-05-17T15:10:21.288061+0000","last_became_peered":"2023-05-17T15:10:21.288061+0000","last_unstale":"2023-05-17T15:10:21.694420+0000","last_undegraded":"2023-05-17T15:10:21.694420+0000","last_fullsized":"2023-05-17T15:10:21.694420+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696983+0000","last_change":"2023-05-17T15:10:21.688215+0000","last_active":"2023-05-17T15:10:21.696983+0000","last_peered":"2023-05-17T15:10:21.696983+0000","last_clean":"2023-05-17T15:10:21.696983+0000","last_became_active":"2023-05-17T15:10:21.687921+0000","last_became_peered":"2023-05-17T15:10:21.687921+0000","last_unstale":"2023-05-17T15:10:21.696983+0000","last_undegraded":"2023-05-17T15:10:21.696983+0000","last_fullsized":"2023-05-17T15:10:21.696983+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696376+0000","last_change":"2023-05-17T15:10:21.297237+0000","last_active":"2023-05-17T15:10:21.696376+0000","last_peered":"2023-05-17T15:10:21.696376+0000","last_clean":"2023-05-17T15:10:21.696376+0000","last_became_active":"2023-05-17T15:10:21.296950+0000","last_became_peered":"2023-05-17T15:10:21.296950+0000","last_unstale":"2023-05-17T15:10:21.696376+0000","last_undegraded":"2023-05-17T15:10:21.696376+0000","last_fullsized":"2023-05-17T15:10:21.696376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686600+0000","last_change":"2023-05-17T15:10:21.683307+0000","last_active":"2023-05-17T15:10:21.686600+0000","last_peered":"2023-05-17T15:10:21.686600+0000","last_clean":"2023-05-17T15:10:21.686600+0000","last_became_active":"2023-05-17T15:10:21.682968+0000","last_became_peered":"2023-05-17T15:10:21.682968+0000","last_unstale":"2023-05-17T15:10:21.686600+0000","last_undegraded":"2023-05-17T15:10:21.686600+0000","last_fullsized":"2023-05-17T15:10:21.686600+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675565+0000","last_change":"2023-05-17T15:10:21.297285+0000","last_active":"2023-05-17T15:10:21.675565+0000","last_peered":"2023-05-17T15:10:21.675565+0000","last_clean":"2023-05-17T15:10:21.675565+0000","last_became_active":"2023-05-17T15:10:21.296999+0000","last_became_peered":"2023-05-17T15:10:21.296999+0000","last_unstale":"2023-05-17T15:10:21.675565+0000","last_undegraded":"2023-05-17T15:10:21.675565+0000","last_fullsized":"2023-05-17T15:10:21.675565+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689816+0000","last_change":"2023-05-17T15:10:21.685816+0000","last_active":"2023-05-17T15:10:21.689816+0000","last_peered":"2023-05-17T15:10:21.689816+0000","last_clean":"2023-05-17T15:10:21.689816+0000","last_became_active":"2023-05-17T15:10:21.684517+0000","last_became_peered":"2023-05-17T15:10:21.684517+0000","last_unstale":"2023-05-17T15:10:21.689816+0000","last_undegraded":"2023-05-17T15:10:21.689816+0000","last_fullsized":"2023-05-17T15:10:21.689816+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681289+0000","last_change":"2023-05-17T15:10:21.294570+0000","last_active":"2023-05-17T15:10:21.681289+0000","last_peered":"2023-05-17T15:10:21.681289+0000","last_clean":"2023-05-17T15:10:21.681289+0000","last_became_active":"2023-05-17T15:10:21.293467+0000","last_became_peered":"2023-05-17T15:10:21.293467+0000","last_unstale":"2023-05-17T15:10:21.681289+0000","last_undegraded":"2023-05-17T15:10:21.681289+0000","last_fullsized":"2023-05-17T15:10:21.681289+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688641+0000","last_change":"2023-05-17T15:10:21.682283+0000","last_active":"2023-05-17T15:10:21.688641+0000","last_peered":"2023-05-17T15:10:21.688641+0000","last_clean":"2023-05-17T15:10:21.688641+0000","last_became_active":"2023-05-17T15:10:21.682017+0000","last_became_peered":"2023-05-17T15:10:21.682017+0000","last_unstale":"2023-05-17T15:10:21.688641+0000","last_undegraded":"2023-05-17T15:10:21.688641+0000","last_fullsized":"2023-05-17T15:10:21.688641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.672838+0000","last_change":"2023-05-17T15:10:21.300788+0000","last_active":"2023-05-17T15:10:21.672838+0000","last_peered":"2023-05-17T15:10:21.672838+0000","last_clean":"2023-05-17T15:10:21.672838+0000","last_became_active":"2023-05-17T15:10:21.300412+0000","last_became_peered":"2023-05-17T15:10:21.300412+0000","last_unstale":"2023-05-17T15:10:21.672838+0000","last_undegraded":"2023-05-17T15:10:21.672838+0000","last_fullsized":"2023-05-17T15:10:21.672838+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699575+0000","last_change":"2023-05-17T15:10:21.698224+0000","last_active":"2023-05-17T15:10:21.699575+0000","last_peered":"2023-05-17T15:10:21.699575+0000","last_clean":"2023-05-17T15:10:21.699575+0000","last_became_active":"2023-05-17T15:10:21.697946+0000","last_became_peered":"2023-05-17T15:10:21.697946+0000","last_unstale":"2023-05-17T15:10:21.699575+0000","last_undegraded":"2023-05-17T15:10:21.699575+0000","last_fullsized":"2023-05-17T15:10:21.699575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.677222+0000","last_change":"2023-05-17T15:10:21.292475+0000","last_active":"2023-05-17T15:10:21.677222+0000","last_peered":"2023-05-17T15:10:21.677222+0000","last_clean":"2023-05-17T15:10:21.677222+0000","last_became_active":"2023-05-17T15:10:21.292190+0000","last_became_peered":"2023-05-17T15:10:21.292190+0000","last_unstale":"2023-05-17T15:10:21.677222+0000","last_undegraded":"2023-05-17T15:10:21.677222+0000","last_fullsized":"2023-05-17T15:10:21.677222+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692164+0000","last_change":"2023-05-17T15:10:21.689824+0000","last_active":"2023-05-17T15:10:21.692164+0000","last_peered":"2023-05-17T15:10:21.692164+0000","last_clean":"2023-05-17T15:10:21.692164+0000","last_became_active":"2023-05-17T15:10:21.689431+0000","last_became_peered":"2023-05-17T15:10:21.689431+0000","last_unstale":"2023-05-17T15:10:21.692164+0000","last_undegraded":"2023-05-17T15:10:21.692164+0000","last_fullsized":"2023-05-17T15:10:21.692164+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674884+0000","last_change":"2023-05-17T15:10:21.293866+0000","last_active":"2023-05-17T15:10:21.674884+0000","last_peered":"2023-05-17T15:10:21.674884+0000","last_clean":"2023-05-17T15:10:21.674884+0000","last_became_active":"2023-05-17T15:10:21.293559+0000","last_became_peered":"2023-05-17T15:10:21.293559+0000","last_unstale":"2023-05-17T15:10:21.674884+0000","last_undegraded":"2023-05-17T15:10:21.674884+0000","last_fullsized":"2023-05-17T15:10:21.674884+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694262+0000","last_change":"2023-05-17T15:10:21.689351+0000","last_active":"2023-05-17T15:10:21.694262+0000","last_peered":"2023-05-17T15:10:21.694262+0000","last_clean":"2023-05-17T15:10:21.694262+0000","last_became_active":"2023-05-17T15:10:21.689089+0000","last_became_peered":"2023-05-17T15:10:21.689089+0000","last_unstale":"2023-05-17T15:10:21.694262+0000","last_undegraded":"2023-05-17T15:10:21.694262+0000","last_fullsized":"2023-05-17T15:10:21.694262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699717+0000","last_change":"2023-05-17T15:10:21.292075+0000","last_active":"2023-05-17T15:10:21.699717+0000","last_peered":"2023-05-17T15:10:21.699717+0000","last_clean":"2023-05-17T15:10:21.699717+0000","last_became_active":"2023-05-17T15:10:21.291677+0000","last_became_peered":"2023-05-17T15:10:21.291677+0000","last_unstale":"2023-05-17T15:10:21.699717+0000","last_undegraded":"2023-05-17T15:10:21.699717+0000","last_fullsized":"2023-05-17T15:10:21.699717+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689774+0000","last_change":"2023-05-17T15:10:21.684202+0000","last_active":"2023-05-17T15:10:21.689774+0000","last_peered":"2023-05-17T15:10:21.689774+0000","last_clean":"2023-05-17T15:10:21.689774+0000","last_became_active":"2023-05-17T15:10:21.683915+0000","last_became_peered":"2023-05-17T15:10:21.683915+0000","last_unstale":"2023-05-17T15:10:21.689774+0000","last_undegraded":"2023-05-17T15:10:21.689774+0000","last_fullsized":"2023-05-17T15:10:21.689774+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692633+0000","last_change":"2023-05-17T15:10:21.298019+0000","last_active":"2023-05-17T15:10:21.692633+0000","last_peered":"2023-05-17T15:10:21.692633+0000","last_clean":"2023-05-17T15:10:21.692633+0000","last_became_active":"2023-05-17T15:10:21.294051+0000","last_became_peered":"2023-05-17T15:10:21.294051+0000","last_unstale":"2023-05-17T15:10:21.692633+0000","last_undegraded":"2023-05-17T15:10:21.692633+0000","last_fullsized":"2023-05-17T15:10:21.692633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.695998+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.695779+0000","last_became_peered":"2023-05-17T15:10:21.695779+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670675+0000","last_change":"2023-05-17T15:10:21.298810+0000","last_active":"2023-05-17T15:10:21.670675+0000","last_peered":"2023-05-17T15:10:21.670675+0000","last_clean":"2023-05-17T15:10:21.670675+0000","last_became_active":"2023-05-17T15:10:21.298535+0000","last_became_peered":"2023-05-17T15:10:21.298535+0000","last_unstale":"2023-05-17T15:10:21.670675+0000","last_undegraded":"2023-05-17T15:10:21.670675+0000","last_fullsized":"2023-05-17T15:10:21.670675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696331+0000","last_change":"2023-05-17T15:10:21.692304+0000","last_active":"2023-05-17T15:10:21.696331+0000","last_peered":"2023-05-17T15:10:21.696331+0000","last_clean":"2023-05-17T15:10:21.696331+0000","last_became_active":"2023-05-17T15:10:21.692006+0000","last_became_peered":"2023-05-17T15:10:21.692006+0000","last_unstale":"2023-05-17T15:10:21.696331+0000","last_undegraded":"2023-05-17T15:10:21.696331+0000","last_fullsized":"2023-05-17T15:10:21.696331+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675380+0000","last_change":"2023-05-17T15:10:21.291603+0000","last_active":"2023-05-17T15:10:21.675380+0000","last_peered":"2023-05-17T15:10:21.675380+0000","last_clean":"2023-05-17T15:10:21.675380+0000","last_became_active":"2023-05-17T15:10:21.289948+0000","last_became_peered":"2023-05-17T15:10:21.289948+0000","last_unstale":"2023-05-17T15:10:21.675380+0000","last_undegraded":"2023-05-17T15:10:21.675380+0000","last_fullsized":"2023-05-17T15:10:21.675380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699525+0000","last_change":"2023-05-17T15:10:21.697668+0000","last_active":"2023-05-17T15:10:21.699525+0000","last_peered":"2023-05-17T15:10:21.699525+0000","last_clean":"2023-05-17T15:10:21.699525+0000","last_became_active":"2023-05-17T15:10:21.697419+0000","last_became_peered":"2023-05-17T15:10:21.697419+0000","last_unstale":"2023-05-17T15:10:21.699525+0000","last_undegraded":"2023-05-17T15:10:21.699525+0000","last_fullsized":"2023-05-17T15:10:21.699525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.687522+0000","last_change":"2023-05-17T15:10:21.299540+0000","last_active":"2023-05-17T15:10:21.687522+0000","last_peered":"2023-05-17T15:10:21.687522+0000","last_clean":"2023-05-17T15:10:21.687522+0000","last_became_active":"2023-05-17T15:10:21.299220+0000","last_became_peered":"2023-05-17T15:10:21.299220+0000","last_unstale":"2023-05-17T15:10:21.687522+0000","last_undegraded":"2023-05-17T15:10:21.687522+0000","last_fullsized":"2023-05-17T15:10:21.687522+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691152+0000","last_change":"2023-05-17T15:10:21.684731+0000","last_active":"2023-05-17T15:10:21.691152+0000","last_peered":"2023-05-17T15:10:21.691152+0000","last_clean":"2023-05-17T15:10:21.691152+0000","last_became_active":"2023-05-17T15:10:21.684485+0000","last_became_peered":"2023-05-17T15:10:21.684485+0000","last_unstale":"2023-05-17T15:10:21.691152+0000","last_undegraded":"2023-05-17T15:10:21.691152+0000","last_fullsized":"2023-05-17T15:10:21.691152+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681170+0000","last_change":"2023-05-17T15:10:21.288238+0000","last_active":"2023-05-17T15:10:21.681170+0000","last_peered":"2023-05-17T15:10:21.681170+0000","last_clean":"2023-05-17T15:10:21.681170+0000","last_became_active":"2023-05-17T15:10:21.287952+0000","last_became_peered":"2023-05-17T15:10:21.287952+0000","last_unstale":"2023-05-17T15:10:21.681170+0000","last_undegraded":"2023-05-17T15:10:21.681170+0000","last_fullsized":"2023-05-17T15:10:21.681170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698916+0000","last_change":"2023-05-17T15:10:21.697765+0000","last_active":"2023-05-17T15:10:21.698916+0000","last_peered":"2023-05-17T15:10:21.698916+0000","last_clean":"2023-05-17T15:10:21.698916+0000","last_became_active":"2023-05-17T15:10:21.697445+0000","last_became_peered":"2023-05-17T15:10:21.697445+0000","last_unstale":"2023-05-17T15:10:21.698916+0000","last_undegraded":"2023-05-17T15:10:21.698916+0000","last_fullsized":"2023-05-17T15:10:21.698916+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.676011+0000","last_change":"2023-05-17T15:10:21.293333+0000","last_active":"2023-05-17T15:10:21.676011+0000","last_peered":"2023-05-17T15:10:21.676011+0000","last_clean":"2023-05-17T15:10:21.676011+0000","last_became_active":"2023-05-17T15:10:21.291969+0000","last_became_peered":"2023-05-17T15:10:21.291969+0000","last_unstale":"2023-05-17T15:10:21.676011+0000","last_undegraded":"2023-05-17T15:10:21.676011+0000","last_fullsized":"2023-05-17T15:10:21.676011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692946+0000","last_change":"2023-05-17T15:10:21.689884+0000","last_active":"2023-05-17T15:10:21.692946+0000","last_peered":"2023-05-17T15:10:21.692946+0000","last_clean":"2023-05-17T15:10:21.692946+0000","last_became_active":"2023-05-17T15:10:21.687316+0000","last_became_peered":"2023-05-17T15:10:21.687316+0000","last_unstale":"2023-05-17T15:10:21.692946+0000","last_undegraded":"2023-05-17T15:10:21.692946+0000","last_fullsized":"2023-05-17T15:10:21.692946+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693914+0000","last_change":"2023-05-17T15:10:21.290304+0000","last_active":"2023-05-17T15:10:21.693914+0000","last_peered":"2023-05-17T15:10:21.693914+0000","last_clean":"2023-05-17T15:10:21.693914+0000","last_became_active":"2023-05-17T15:10:21.290023+0000","last_became_peered":"2023-05-17T15:10:21.290023+0000","last_unstale":"2023-05-17T15:10:21.693914+0000","last_undegraded":"2023-05-17T15:10:21.693914+0000","last_fullsized":"2023-05-17T15:10:21.693914+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693819+0000","last_change":"2023-05-17T15:10:21.687930+0000","last_active":"2023-05-17T15:10:21.693819+0000","last_peered":"2023-05-17T15:10:21.693819+0000","last_clean":"2023-05-17T15:10:21.693819+0000","last_became_active":"2023-05-17T15:10:21.687700+0000","last_became_peered":"2023-05-17T15:10:21.687700+0000","last_unstale":"2023-05-17T15:10:21.693819+0000","last_undegraded":"2023-05-17T15:10:21.693819+0000","last_fullsized":"2023-05-17T15:10:21.693819+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.672472+0000","last_change":"2023-05-17T15:10:21.300640+0000","last_active":"2023-05-17T15:10:21.672472+0000","last_peered":"2023-05-17T15:10:21.672472+0000","last_clean":"2023-05-17T15:10:21.672472+0000","last_became_active":"2023-05-17T15:10:21.300350+0000","last_became_peered":"2023-05-17T15:10:21.300350+0000","last_unstale":"2023-05-17T15:10:21.672472+0000","last_undegraded":"2023-05-17T15:10:21.672472+0000","last_fullsized":"2023-05-17T15:10:21.672472+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689754+0000","last_change":"2023-05-17T15:10:21.684185+0000","last_active":"2023-05-17T15:10:21.689754+0000","last_peered":"2023-05-17T15:10:21.689754+0000","last_clean":"2023-05-17T15:10:21.689754+0000","last_became_active":"2023-05-17T15:10:21.683528+0000","last_became_peered":"2023-05-17T15:10:21.683528+0000","last_unstale":"2023-05-17T15:10:21.689754+0000","last_undegraded":"2023-05-17T15:10:21.689754+0000","last_fullsized":"2023-05-17T15:10:21.689754+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697136+0000","last_change":"2023-05-17T15:10:21.298512+0000","last_active":"2023-05-17T15:10:21.697136+0000","last_peered":"2023-05-17T15:10:21.697136+0000","last_clean":"2023-05-17T15:10:21.697136+0000","last_became_active":"2023-05-17T15:10:21.298105+0000","last_became_peered":"2023-05-17T15:10:21.298105+0000","last_unstale":"2023-05-17T15:10:21.697136+0000","last_undegraded":"2023-05-17T15:10:21.697136+0000","last_fullsized":"2023-05-17T15:10:21.697136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698112+0000","last_change":"2023-05-17T15:10:21.695099+0000","last_active":"2023-05-17T15:10:21.698112+0000","last_peered":"2023-05-17T15:10:21.698112+0000","last_clean":"2023-05-17T15:10:21.698112+0000","last_became_active":"2023-05-17T15:10:21.694788+0000","last_became_peered":"2023-05-17T15:10:21.694788+0000","last_unstale":"2023-05-17T15:10:21.698112+0000","last_undegraded":"2023-05-17T15:10:21.698112+0000","last_fullsized":"2023-05-17T15:10:21.698112+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679296+0000","last_change":"2023-05-17T15:10:21.297458+0000","last_active":"2023-05-17T15:10:21.679296+0000","last_peered":"2023-05-17T15:10:21.679296+0000","last_clean":"2023-05-17T15:10:21.679296+0000","last_became_active":"2023-05-17T15:10:21.297156+0000","last_became_peered":"2023-05-17T15:10:21.297156+0000","last_unstale":"2023-05-17T15:10:21.679296+0000","last_undegraded":"2023-05-17T15:10:21.679296+0000","last_fullsized":"2023-05-17T15:10:21.679296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690230+0000","last_change":"2023-05-17T15:10:21.686606+0000","last_active":"2023-05-17T15:10:21.690230+0000","last_peered":"2023-05-17T15:10:21.690230+0000","last_clean":"2023-05-17T15:10:21.690230+0000","last_became_active":"2023-05-17T15:10:21.686335+0000","last_became_peered":"2023-05-17T15:10:21.686335+0000","last_unstale":"2023-05-17T15:10:21.690230+0000","last_undegraded":"2023-05-17T15:10:21.690230+0000","last_fullsized":"2023-05-17T15:10:21.690230+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679535+0000","last_change":"2023-05-17T15:10:21.288322+0000","last_active":"2023-05-17T15:10:21.679535+0000","last_peered":"2023-05-17T15:10:21.679535+0000","last_clean":"2023-05-17T15:10:21.679535+0000","last_became_active":"2023-05-17T15:10:21.288046+0000","last_became_peered":"2023-05-17T15:10:21.288046+0000","last_unstale":"2023-05-17T15:10:21.679535+0000","last_undegraded":"2023-05-17T15:10:21.679535+0000","last_fullsized":"2023-05-17T15:10:21.679535+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693445+0000","last_change":"2023-05-17T15:10:21.687798+0000","last_active":"2023-05-17T15:10:21.693445+0000","last_peered":"2023-05-17T15:10:21.693445+0000","last_clean":"2023-05-17T15:10:21.693445+0000","last_became_active":"2023-05-17T15:10:21.687509+0000","last_became_peered":"2023-05-17T15:10:21.687509+0000","last_unstale":"2023-05-17T15:10:21.693445+0000","last_undegraded":"2023-05-17T15:10:21.693445+0000","last_fullsized":"2023-05-17T15:10:21.693445+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675039+0000","last_change":"2023-05-17T15:10:21.294698+0000","last_active":"2023-05-17T15:10:21.675039+0000","last_peered":"2023-05-17T15:10:21.675039+0000","last_clean":"2023-05-17T15:10:21.675039+0000","last_became_active":"2023-05-17T15:10:21.294263+0000","last_became_peered":"2023-05-17T15:10:21.294263+0000","last_unstale":"2023-05-17T15:10:21.675039+0000","last_undegraded":"2023-05-17T15:10:21.675039+0000","last_fullsized":"2023-05-17T15:10:21.675039+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686781+0000","last_change":"2023-05-17T15:10:21.678612+0000","last_active":"2023-05-17T15:10:21.686781+0000","last_peered":"2023-05-17T15:10:21.686781+0000","last_clean":"2023-05-17T15:10:21.686781+0000","last_became_active":"2023-05-17T15:10:21.678335+0000","last_became_peered":"2023-05-17T15:10:21.678335+0000","last_unstale":"2023-05-17T15:10:21.686781+0000","last_undegraded":"2023-05-17T15:10:21.686781+0000","last_fullsized":"2023-05-17T15:10:21.686781+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.678084+0000","last_change":"2023-05-17T15:10:21.291885+0000","last_active":"2023-05-17T15:10:21.678084+0000","last_peered":"2023-05-17T15:10:21.678084+0000","last_clean":"2023-05-17T15:10:21.678084+0000","last_became_active":"2023-05-17T15:10:21.291602+0000","last_became_peered":"2023-05-17T15:10:21.291602+0000","last_unstale":"2023-05-17T15:10:21.678084+0000","last_undegraded":"2023-05-17T15:10:21.678084+0000","last_fullsized":"2023-05-17T15:10:21.678084+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694413+0000","last_change":"2023-05-17T15:10:21.691605+0000","last_active":"2023-05-17T15:10:21.694413+0000","last_peered":"2023-05-17T15:10:21.694413+0000","last_clean":"2023-05-17T15:10:21.694413+0000","last_became_active":"2023-05-17T15:10:21.691312+0000","last_became_peered":"2023-05-17T15:10:21.691312+0000","last_unstale":"2023-05-17T15:10:21.694413+0000","last_undegraded":"2023-05-17T15:10:21.694413+0000","last_fullsized":"2023-05-17T15:10:21.694413+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681138+0000","last_change":"2023-05-17T15:10:21.297023+0000","last_active":"2023-05-17T15:10:21.681138+0000","last_peered":"2023-05-17T15:10:21.681138+0000","last_clean":"2023-05-17T15:10:21.681138+0000","last_became_active":"2023-05-17T15:10:21.296741+0000","last_became_peered":"2023-05-17T15:10:21.296741+0000","last_unstale":"2023-05-17T15:10:21.681138+0000","last_undegraded":"2023-05-17T15:10:21.681138+0000","last_fullsized":"2023-05-17T15:10:21.681138+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694356+0000","last_change":"2023-05-17T15:10:21.691298+0000","last_active":"2023-05-17T15:10:21.694356+0000","last_peered":"2023-05-17T15:10:21.694356+0000","last_clean":"2023-05-17T15:10:21.694356+0000","last_became_active":"2023-05-17T15:10:21.690993+0000","last_became_peered":"2023-05-17T15:10:21.690993+0000","last_unstale":"2023-05-17T15:10:21.694356+0000","last_undegraded":"2023-05-17T15:10:21.694356+0000","last_fullsized":"2023-05-17T15:10:21.694356+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674536+0000","last_change":"2023-05-17T15:10:21.300290+0000","last_active":"2023-05-17T15:10:21.674536+0000","last_peered":"2023-05-17T15:10:21.674536+0000","last_clean":"2023-05-17T15:10:21.674536+0000","last_became_active":"2023-05-17T15:10:21.299599+0000","last_became_peered":"2023-05-17T15:10:21.299599+0000","last_unstale":"2023-05-17T15:10:21.674536+0000","last_undegraded":"2023-05-17T15:10:21.674536+0000","last_fullsized":"2023-05-17T15:10:21.674536+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692213+0000","last_change":"2023-05-17T15:10:21.689525+0000","last_active":"2023-05-17T15:10:21.692213+0000","last_peered":"2023-05-17T15:10:21.692213+0000","last_clean":"2023-05-17T15:10:21.692213+0000","last_became_active":"2023-05-17T15:10:21.688968+0000","last_became_peered":"2023-05-17T15:10:21.688968+0000","last_unstale":"2023-05-17T15:10:21.692213+0000","last_undegraded":"2023-05-17T15:10:21.692213+0000","last_fullsized":"2023-05-17T15:10:21.692213+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.677408+0000","last_change":"2023-05-17T15:10:21.291432+0000","last_active":"2023-05-17T15:10:21.677408+0000","last_peered":"2023-05-17T15:10:21.677408+0000","last_clean":"2023-05-17T15:10:21.677408+0000","last_became_active":"2023-05-17T15:10:21.288800+0000","last_became_peered":"2023-05-17T15:10:21.288800+0000","last_unstale":"2023-05-17T15:10:21.677408+0000","last_undegraded":"2023-05-17T15:10:21.677408+0000","last_fullsized":"2023-05-17T15:10:21.677408+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693855+0000","last_change":"2023-05-17T15:10:21.686284+0000","last_active":"2023-05-17T15:10:21.693855+0000","last_peered":"2023-05-17T15:10:21.693855+0000","last_clean":"2023-05-17T15:10:21.693855+0000","last_became_active":"2023-05-17T15:10:21.684239+0000","last_became_peered":"2023-05-17T15:10:21.684239+0000","last_unstale":"2023-05-17T15:10:21.693855+0000","last_undegraded":"2023-05-17T15:10:21.693855+0000","last_fullsized":"2023-05-17T15:10:21.693855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.679410+0000","last_change":"2023-05-17T15:10:21.297089+0000","last_active":"2023-05-17T15:10:21.679410+0000","last_peered":"2023-05-17T15:10:21.679410+0000","last_clean":"2023-05-17T15:10:21.679410+0000","last_became_active":"2023-05-17T15:10:21.296773+0000","last_became_peered":"2023-05-17T15:10:21.296773+0000","last_unstale":"2023-05-17T15:10:21.679410+0000","last_undegraded":"2023-05-17T15:10:21.679410+0000","last_fullsized":"2023-05-17T15:10:21.679410+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699232+0000","last_change":"2023-05-17T15:10:21.697475+0000","last_active":"2023-05-17T15:10:21.699232+0000","last_peered":"2023-05-17T15:10:21.699232+0000","last_clean":"2023-05-17T15:10:21.699232+0000","last_became_active":"2023-05-17T15:10:21.697193+0000","last_became_peered":"2023-05-17T15:10:21.697193+0000","last_unstale":"2023-05-17T15:10:21.699232+0000","last_undegraded":"2023-05-17T15:10:21.699232+0000","last_fullsized":"2023-05-17T15:10:21.699232+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671010+0000","last_change":"2023-05-17T15:10:21.296684+0000","last_active":"2023-05-17T15:10:21.671010+0000","last_peered":"2023-05-17T15:10:21.671010+0000","last_clean":"2023-05-17T15:10:21.671010+0000","last_became_active":"2023-05-17T15:10:21.290716+0000","last_became_peered":"2023-05-17T15:10:21.290716+0000","last_unstale":"2023-05-17T15:10:21.671010+0000","last_undegraded":"2023-05-17T15:10:21.671010+0000","last_fullsized":"2023-05-17T15:10:21.671010+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.685829+0000","last_change":"2023-05-17T15:10:21.682646+0000","last_active":"2023-05-17T15:10:21.685829+0000","last_peered":"2023-05-17T15:10:21.685829+0000","last_clean":"2023-05-17T15:10:21.685829+0000","last_became_active":"2023-05-17T15:10:21.681751+0000","last_became_peered":"2023-05-17T15:10:21.681751+0000","last_unstale":"2023-05-17T15:10:21.685829+0000","last_undegraded":"2023-05-17T15:10:21.685829+0000","last_fullsized":"2023-05-17T15:10:21.685829+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675476+0000","last_change":"2023-05-17T15:10:21.285520+0000","last_active":"2023-05-17T15:10:21.675476+0000","last_peered":"2023-05-17T15:10:21.675476+0000","last_clean":"2023-05-17T15:10:21.675476+0000","last_became_active":"2023-05-17T15:10:21.285201+0000","last_became_peered":"2023-05-17T15:10:21.285201+0000","last_unstale":"2023-05-17T15:10:21.675476+0000","last_undegraded":"2023-05-17T15:10:21.675476+0000","last_fullsized":"2023-05-17T15:10:21.675476+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694439+0000","last_change":"2023-05-17T15:10:21.693273+0000","last_active":"2023-05-17T15:10:21.694439+0000","last_peered":"2023-05-17T15:10:21.694439+0000","last_clean":"2023-05-17T15:10:21.694439+0000","last_became_active":"2023-05-17T15:10:21.692975+0000","last_became_peered":"2023-05-17T15:10:21.692975+0000","last_unstale":"2023-05-17T15:10:21.694439+0000","last_undegraded":"2023-05-17T15:10:21.694439+0000","last_fullsized":"2023-05-17T15:10:21.694439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681548+0000","last_change":"2023-05-17T15:10:21.298675+0000","last_active":"2023-05-17T15:10:21.681548+0000","last_peered":"2023-05-17T15:10:21.681548+0000","last_clean":"2023-05-17T15:10:21.681548+0000","last_became_active":"2023-05-17T15:10:21.298404+0000","last_became_peered":"2023-05-17T15:10:21.298404+0000","last_unstale":"2023-05-17T15:10:21.681548+0000","last_undegraded":"2023-05-17T15:10:21.681548+0000","last_fullsized":"2023-05-17T15:10:21.681548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696504+0000","last_change":"2023-05-17T15:10:21.694697+0000","last_active":"2023-05-17T15:10:21.696504+0000","last_peered":"2023-05-17T15:10:21.696504+0000","last_clean":"2023-05-17T15:10:21.696504+0000","last_became_active":"2023-05-17T15:10:21.694445+0000","last_became_peered":"2023-05-17T15:10:21.694445+0000","last_unstale":"2023-05-17T15:10:21.696504+0000","last_undegraded":"2023-05-17T15:10:21.696504+0000","last_fullsized":"2023-05-17T15:10:21.696504+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693885+0000","last_change":"2023-05-17T15:10:21.288608+0000","last_active":"2023-05-17T15:10:21.693885+0000","last_peered":"2023-05-17T15:10:21.693885+0000","last_clean":"2023-05-17T15:10:21.693885+0000","last_became_active":"2023-05-17T15:10:21.288281+0000","last_became_peered":"2023-05-17T15:10:21.288281+0000","last_unstale":"2023-05-17T15:10:21.693885+0000","last_undegraded":"2023-05-17T15:10:21.693885+0000","last_fullsized":"2023-05-17T15:10:21.693885+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.688927+0000","last_change":"2023-05-17T15:10:21.683486+0000","last_active":"2023-05-17T15:10:21.688927+0000","last_peered":"2023-05-17T15:10:21.688927+0000","last_clean":"2023-05-17T15:10:21.688927+0000","last_became_active":"2023-05-17T15:10:21.683229+0000","last_became_peered":"2023-05-17T15:10:21.683229+0000","last_unstale":"2023-05-17T15:10:21.688927+0000","last_undegraded":"2023-05-17T15:10:21.688927+0000","last_fullsized":"2023-05-17T15:10:21.688927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693732+0000","last_change":"2023-05-17T15:10:21.295144+0000","last_active":"2023-05-17T15:10:21.693732+0000","last_peered":"2023-05-17T15:10:21.693732+0000","last_clean":"2023-05-17T15:10:21.693732+0000","last_became_active":"2023-05-17T15:10:21.294535+0000","last_became_peered":"2023-05-17T15:10:21.294535+0000","last_unstale":"2023-05-17T15:10:21.693732+0000","last_undegraded":"2023-05-17T15:10:21.693732+0000","last_fullsized":"2023-05-17T15:10:21.693732+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694036+0000","last_change":"2023-05-17T15:10:21.693100+0000","last_active":"2023-05-17T15:10:21.694036+0000","last_peered":"2023-05-17T15:10:21.694036+0000","last_clean":"2023-05-17T15:10:21.694036+0000","last_became_active":"2023-05-17T15:10:21.692790+0000","last_became_peered":"2023-05-17T15:10:21.692790+0000","last_unstale":"2023-05-17T15:10:21.694036+0000","last_undegraded":"2023-05-17T15:10:21.694036+0000","last_fullsized":"2023-05-17T15:10:21.694036+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697462+0000","last_change":"2023-05-17T15:10:21.299838+0000","last_active":"2023-05-17T15:10:21.697462+0000","last_peered":"2023-05-17T15:10:21.697462+0000","last_clean":"2023-05-17T15:10:21.697462+0000","last_became_active":"2023-05-17T15:10:21.299614+0000","last_became_peered":"2023-05-17T15:10:21.299614+0000","last_unstale":"2023-05-17T15:10:21.697462+0000","last_undegraded":"2023-05-17T15:10:21.697462+0000","last_fullsized":"2023-05-17T15:10:21.697462+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697058+0000","last_change":"2023-05-17T15:10:21.693852+0000","last_active":"2023-05-17T15:10:21.697058+0000","last_peered":"2023-05-17T15:10:21.697058+0000","last_clean":"2023-05-17T15:10:21.697058+0000","last_became_active":"2023-05-17T15:10:21.693190+0000","last_became_peered":"2023-05-17T15:10:21.693190+0000","last_unstale":"2023-05-17T15:10:21.697058+0000","last_undegraded":"2023-05-17T15:10:21.697058+0000","last_fullsized":"2023-05-17T15:10:21.697058+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682018+0000","last_change":"2023-05-17T15:10:21.294898+0000","last_active":"2023-05-17T15:10:21.682018+0000","last_peered":"2023-05-17T15:10:21.682018+0000","last_clean":"2023-05-17T15:10:21.682018+0000","last_became_active":"2023-05-17T15:10:21.294622+0000","last_became_peered":"2023-05-17T15:10:21.294622+0000","last_unstale":"2023-05-17T15:10:21.682018+0000","last_undegraded":"2023-05-17T15:10:21.682018+0000","last_fullsized":"2023-05-17T15:10:21.682018+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693870+0000","last_change":"2023-05-17T15:10:21.691292+0000","last_active":"2023-05-17T15:10:21.693870+0000","last_peered":"2023-05-17T15:10:21.693870+0000","last_clean":"2023-05-17T15:10:21.693870+0000","last_became_active":"2023-05-17T15:10:21.691037+0000","last_became_peered":"2023-05-17T15:10:21.691037+0000","last_unstale":"2023-05-17T15:10:21.693870+0000","last_undegraded":"2023-05-17T15:10:21.693870+0000","last_fullsized":"2023-05-17T15:10:21.693870+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.677890+0000","last_change":"2023-05-17T15:10:21.292261+0000","last_active":"2023-05-17T15:10:21.677890+0000","last_peered":"2023-05-17T15:10:21.677890+0000","last_clean":"2023-05-17T15:10:21.677890+0000","last_became_active":"2023-05-17T15:10:21.291988+0000","last_became_peered":"2023-05-17T15:10:21.291988+0000","last_unstale":"2023-05-17T15:10:21.677890+0000","last_undegraded":"2023-05-17T15:10:21.677890+0000","last_fullsized":"2023-05-17T15:10:21.677890+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696614+0000","last_change":"2023-05-17T15:10:21.694755+0000","last_active":"2023-05-17T15:10:21.696614+0000","last_peered":"2023-05-17T15:10:21.696614+0000","last_clean":"2023-05-17T15:10:21.696614+0000","last_became_active":"2023-05-17T15:10:21.694471+0000","last_became_peered":"2023-05-17T15:10:21.694471+0000","last_unstale":"2023-05-17T15:10:21.696614+0000","last_undegraded":"2023-05-17T15:10:21.696614+0000","last_fullsized":"2023-05-17T15:10:21.696614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673474+0000","last_change":"2023-05-17T15:10:21.293702+0000","last_active":"2023-05-17T15:10:21.673474+0000","last_peered":"2023-05-17T15:10:21.673474+0000","last_clean":"2023-05-17T15:10:21.673474+0000","last_became_active":"2023-05-17T15:10:21.293422+0000","last_became_peered":"2023-05-17T15:10:21.293422+0000","last_unstale":"2023-05-17T15:10:21.673474+0000","last_undegraded":"2023-05-17T15:10:21.673474+0000","last_fullsized":"2023-05-17T15:10:21.673474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698432+0000","last_change":"2023-05-17T15:10:21.696746+0000","last_active":"2023-05-17T15:10:21.698432+0000","last_peered":"2023-05-17T15:10:21.698432+0000","last_clean":"2023-05-17T15:10:21.698432+0000","last_became_active":"2023-05-17T15:10:21.696490+0000","last_became_peered":"2023-05-17T15:10:21.696490+0000","last_unstale":"2023-05-17T15:10:21.698432+0000","last_undegraded":"2023-05-17T15:10:21.698432+0000","last_fullsized":"2023-05-17T15:10:21.698432+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675964+0000","last_change":"2023-05-17T15:10:21.298232+0000","last_active":"2023-05-17T15:10:21.675964+0000","last_peered":"2023-05-17T15:10:21.675964+0000","last_clean":"2023-05-17T15:10:21.675964+0000","last_became_active":"2023-05-17T15:10:21.297711+0000","last_became_peered":"2023-05-17T15:10:21.297711+0000","last_unstale":"2023-05-17T15:10:21.675964+0000","last_undegraded":"2023-05-17T15:10:21.675964+0000","last_fullsized":"2023-05-17T15:10:21.675964+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693266+0000","last_change":"2023-05-17T15:10:21.682997+0000","last_active":"2023-05-17T15:10:21.693266+0000","last_peered":"2023-05-17T15:10:21.693266+0000","last_clean":"2023-05-17T15:10:21.693266+0000","last_became_active":"2023-05-17T15:10:21.682798+0000","last_became_peered":"2023-05-17T15:10:21.682798+0000","last_unstale":"2023-05-17T15:10:21.693266+0000","last_undegraded":"2023-05-17T15:10:21.693266+0000","last_fullsized":"2023-05-17T15:10:21.693266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675239+0000","last_change":"2023-05-17T15:10:21.292338+0000","last_active":"2023-05-17T15:10:21.675239+0000","last_peered":"2023-05-17T15:10:21.675239+0000","last_clean":"2023-05-17T15:10:21.675239+0000","last_became_active":"2023-05-17T15:10:21.289967+0000","last_became_peered":"2023-05-17T15:10:21.289967+0000","last_unstale":"2023-05-17T15:10:21.675239+0000","last_undegraded":"2023-05-17T15:10:21.675239+0000","last_fullsized":"2023-05-17T15:10:21.675239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696914+0000","last_change":"2023-05-17T15:10:21.696004+0000","last_active":"2023-05-17T15:10:21.696914+0000","last_peered":"2023-05-17T15:10:21.696914+0000","last_clean":"2023-05-17T15:10:21.696914+0000","last_became_active":"2023-05-17T15:10:21.695768+0000","last_became_peered":"2023-05-17T15:10:21.695768+0000","last_unstale":"2023-05-17T15:10:21.696914+0000","last_undegraded":"2023-05-17T15:10:21.696914+0000","last_fullsized":"2023-05-17T15:10:21.696914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.672947+0000","last_change":"2023-05-17T15:10:21.300161+0000","last_active":"2023-05-17T15:10:21.672947+0000","last_peered":"2023-05-17T15:10:21.672947+0000","last_clean":"2023-05-17T15:10:21.672947+0000","last_became_active":"2023-05-17T15:10:21.299864+0000","last_became_peered":"2023-05-17T15:10:21.299864+0000","last_unstale":"2023-05-17T15:10:21.672947+0000","last_undegraded":"2023-05-17T15:10:21.672947+0000","last_fullsized":"2023-05-17T15:10:21.672947+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690654+0000","last_change":"2023-05-17T15:10:21.689154+0000","last_active":"2023-05-17T15:10:21.690654+0000","last_peered":"2023-05-17T15:10:21.690654+0000","last_clean":"2023-05-17T15:10:21.690654+0000","last_became_active":"2023-05-17T15:10:21.688888+0000","last_became_peered":"2023-05-17T15:10:21.688888+0000","last_unstale":"2023-05-17T15:10:21.690654+0000","last_undegraded":"2023-05-17T15:10:21.690654+0000","last_fullsized":"2023-05-17T15:10:21.690654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681341+0000","last_change":"2023-05-17T15:10:21.292560+0000","last_active":"2023-05-17T15:10:21.681341+0000","last_peered":"2023-05-17T15:10:21.681341+0000","last_clean":"2023-05-17T15:10:21.681341+0000","last_became_active":"2023-05-17T15:10:21.292093+0000","last_became_peered":"2023-05-17T15:10:21.292093+0000","last_unstale":"2023-05-17T15:10:21.681341+0000","last_undegraded":"2023-05-17T15:10:21.681341+0000","last_fullsized":"2023-05-17T15:10:21.681341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694968+0000","last_change":"2023-05-17T15:10:21.693638+0000","last_active":"2023-05-17T15:10:21.694968+0000","last_peered":"2023-05-17T15:10:21.694968+0000","last_clean":"2023-05-17T15:10:21.694968+0000","last_became_active":"2023-05-17T15:10:21.693339+0000","last_became_peered":"2023-05-17T15:10:21.693339+0000","last_unstale":"2023-05-17T15:10:21.694968+0000","last_undegraded":"2023-05-17T15:10:21.694968+0000","last_fullsized":"2023-05-17T15:10:21.694968+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691068+0000","last_change":"2023-05-17T15:10:21.295388+0000","last_active":"2023-05-17T15:10:21.691068+0000","last_peered":"2023-05-17T15:10:21.691068+0000","last_clean":"2023-05-17T15:10:21.691068+0000","last_became_active":"2023-05-17T15:10:21.295093+0000","last_became_peered":"2023-05-17T15:10:21.295093+0000","last_unstale":"2023-05-17T15:10:21.691068+0000","last_undegraded":"2023-05-17T15:10:21.691068+0000","last_fullsized":"2023-05-17T15:10:21.691068+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692231+0000","last_change":"2023-05-17T15:10:21.690962+0000","last_active":"2023-05-17T15:10:21.692231+0000","last_peered":"2023-05-17T15:10:21.692231+0000","last_clean":"2023-05-17T15:10:21.692231+0000","last_became_active":"2023-05-17T15:10:21.690681+0000","last_became_peered":"2023-05-17T15:10:21.690681+0000","last_unstale":"2023-05-17T15:10:21.692231+0000","last_undegraded":"2023-05-17T15:10:21.692231+0000","last_fullsized":"2023-05-17T15:10:21.692231+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690609+0000","last_change":"2023-05-17T15:10:21.294753+0000","last_active":"2023-05-17T15:10:21.690609+0000","last_peered":"2023-05-17T15:10:21.690609+0000","last_clean":"2023-05-17T15:10:21.690609+0000","last_became_active":"2023-05-17T15:10:21.294465+0000","last_became_peered":"2023-05-17T15:10:21.294465+0000","last_unstale":"2023-05-17T15:10:21.690609+0000","last_undegraded":"2023-05-17T15:10:21.690609+0000","last_fullsized":"2023-05-17T15:10:21.690609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696276+0000","last_change":"2023-05-17T15:10:21.684825+0000","last_active":"2023-05-17T15:10:21.696276+0000","last_peered":"2023-05-17T15:10:21.696276+0000","last_clean":"2023-05-17T15:10:21.696276+0000","last_became_active":"2023-05-17T15:10:21.684525+0000","last_became_peered":"2023-05-17T15:10:21.684525+0000","last_unstale":"2023-05-17T15:10:21.696276+0000","last_undegraded":"2023-05-17T15:10:21.696276+0000","last_fullsized":"2023-05-17T15:10:21.696276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.691116+0000","last_change":"2023-05-17T15:10:21.290239+0000","last_active":"2023-05-17T15:10:21.691116+0000","last_peered":"2023-05-17T15:10:21.691116+0000","last_clean":"2023-05-17T15:10:21.691116+0000","last_became_active":"2023-05-17T15:10:21.289965+0000","last_became_peered":"2023-05-17T15:10:21.289965+0000","last_unstale":"2023-05-17T15:10:21.691116+0000","last_undegraded":"2023-05-17T15:10:21.691116+0000","last_fullsized":"2023-05-17T15:10:21.691116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693517+0000","last_change":"2023-05-17T15:10:21.687206+0000","last_active":"2023-05-17T15:10:21.693517+0000","last_peered":"2023-05-17T15:10:21.693517+0000","last_clean":"2023-05-17T15:10:21.693517+0000","last_became_active":"2023-05-17T15:10:21.686885+0000","last_became_peered":"2023-05-17T15:10:21.686885+0000","last_unstale":"2023-05-17T15:10:21.693517+0000","last_undegraded":"2023-05-17T15:10:21.693517+0000","last_fullsized":"2023-05-17T15:10:21.693517+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675392+0000","last_change":"2023-05-17T15:10:21.293582+0000","last_active":"2023-05-17T15:10:21.675392+0000","last_peered":"2023-05-17T15:10:21.675392+0000","last_clean":"2023-05-17T15:10:21.675392+0000","last_became_active":"2023-05-17T15:10:21.293290+0000","last_became_peered":"2023-05-17T15:10:21.293290+0000","last_unstale":"2023-05-17T15:10:21.675392+0000","last_undegraded":"2023-05-17T15:10:21.675392+0000","last_fullsized":"2023-05-17T15:10:21.675392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689211+0000","last_change":"2023-05-17T15:10:21.683174+0000","last_active":"2023-05-17T15:10:21.689211+0000","last_peered":"2023-05-17T15:10:21.689211+0000","last_clean":"2023-05-17T15:10:21.689211+0000","last_became_active":"2023-05-17T15:10:21.682594+0000","last_became_peered":"2023-05-17T15:10:21.682594+0000","last_unstale":"2023-05-17T15:10:21.689211+0000","last_undegraded":"2023-05-17T15:10:21.689211+0000","last_fullsized":"2023-05-17T15:10:21.689211+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670511+0000","last_change":"2023-05-17T15:10:21.294708+0000","last_active":"2023-05-17T15:10:21.670511+0000","last_peered":"2023-05-17T15:10:21.670511+0000","last_clean":"2023-05-17T15:10:21.670511+0000","last_became_active":"2023-05-17T15:10:21.294391+0000","last_became_peered":"2023-05-17T15:10:21.294391+0000","last_unstale":"2023-05-17T15:10:21.670511+0000","last_undegraded":"2023-05-17T15:10:21.670511+0000","last_fullsized":"2023-05-17T15:10:21.670511+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.699542+0000","last_change":"2023-05-17T15:10:21.697712+0000","last_active":"2023-05-17T15:10:21.699542+0000","last_peered":"2023-05-17T15:10:21.699542+0000","last_clean":"2023-05-17T15:10:21.699542+0000","last_became_active":"2023-05-17T15:10:21.697438+0000","last_became_peered":"2023-05-17T15:10:21.697438+0000","last_unstale":"2023-05-17T15:10:21.699542+0000","last_undegraded":"2023-05-17T15:10:21.699542+0000","last_fullsized":"2023-05-17T15:10:21.699542+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697576+0000","last_change":"2023-05-17T15:10:21.299773+0000","last_active":"2023-05-17T15:10:21.697576+0000","last_peered":"2023-05-17T15:10:21.697576+0000","last_clean":"2023-05-17T15:10:21.697576+0000","last_became_active":"2023-05-17T15:10:21.299464+0000","last_became_peered":"2023-05-17T15:10:21.299464+0000","last_unstale":"2023-05-17T15:10:21.697576+0000","last_undegraded":"2023-05-17T15:10:21.697576+0000","last_fullsized":"2023-05-17T15:10:21.697576+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.690346+0000","last_change":"2023-05-17T15:10:21.687552+0000","last_active":"2023-05-17T15:10:21.690346+0000","last_peered":"2023-05-17T15:10:21.690346+0000","last_clean":"2023-05-17T15:10:21.690346+0000","last_became_active":"2023-05-17T15:10:21.687317+0000","last_became_peered":"2023-05-17T15:10:21.687317+0000","last_unstale":"2023-05-17T15:10:21.690346+0000","last_undegraded":"2023-05-17T15:10:21.690346+0000","last_fullsized":"2023-05-17T15:10:21.690346+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694620+0000","last_change":"2023-05-17T15:10:21.291005+0000","last_active":"2023-05-17T15:10:21.694620+0000","last_peered":"2023-05-17T15:10:21.694620+0000","last_clean":"2023-05-17T15:10:21.694620+0000","last_became_active":"2023-05-17T15:10:21.290732+0000","last_became_peered":"2023-05-17T15:10:21.290732+0000","last_unstale":"2023-05-17T15:10:21.694620+0000","last_undegraded":"2023-05-17T15:10:21.694620+0000","last_fullsized":"2023-05-17T15:10:21.694620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681163+0000","last_change":"2023-05-17T15:10:21.680293+0000","last_active":"2023-05-17T15:10:21.681163+0000","last_peered":"2023-05-17T15:10:21.681163+0000","last_clean":"2023-05-17T15:10:21.681163+0000","last_became_active":"2023-05-17T15:10:21.680059+0000","last_became_peered":"2023-05-17T15:10:21.680059+0000","last_unstale":"2023-05-17T15:10:21.681163+0000","last_undegraded":"2023-05-17T15:10:21.681163+0000","last_fullsized":"2023-05-17T15:10:21.681163+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.681239+0000","last_change":"2023-05-17T15:10:21.297096+0000","last_active":"2023-05-17T15:10:21.681239+0000","last_peered":"2023-05-17T15:10:21.681239+0000","last_clean":"2023-05-17T15:10:21.681239+0000","last_became_active":"2023-05-17T15:10:21.296805+0000","last_became_peered":"2023-05-17T15:10:21.296805+0000","last_unstale":"2023-05-17T15:10:21.681239+0000","last_undegraded":"2023-05-17T15:10:21.681239+0000","last_fullsized":"2023-05-17T15:10:21.681239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686740+0000","last_change":"2023-05-17T15:10:21.681045+0000","last_active":"2023-05-17T15:10:21.686740+0000","last_peered":"2023-05-17T15:10:21.686740+0000","last_clean":"2023-05-17T15:10:21.686740+0000","last_became_active":"2023-05-17T15:10:21.680765+0000","last_became_peered":"2023-05-17T15:10:21.680765+0000","last_unstale":"2023-05-17T15:10:21.686740+0000","last_undegraded":"2023-05-17T15:10:21.686740+0000","last_fullsized":"2023-05-17T15:10:21.686740+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674582+0000","last_change":"2023-05-17T15:10:21.290711+0000","last_active":"2023-05-17T15:10:21.674582+0000","last_peered":"2023-05-17T15:10:21.674582+0000","last_clean":"2023-05-17T15:10:21.674582+0000","last_became_active":"2023-05-17T15:10:21.290407+0000","last_became_peered":"2023-05-17T15:10:21.290407+0000","last_unstale":"2023-05-17T15:10:21.674582+0000","last_undegraded":"2023-05-17T15:10:21.674582+0000","last_fullsized":"2023-05-17T15:10:21.674582+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.697076+0000","last_change":"2023-05-17T15:10:21.694208+0000","last_active":"2023-05-17T15:10:21.697076+0000","last_peered":"2023-05-17T15:10:21.697076+0000","last_clean":"2023-05-17T15:10:21.697076+0000","last_became_active":"2023-05-17T15:10:21.693812+0000","last_became_peered":"2023-05-17T15:10:21.693812+0000","last_unstale":"2023-05-17T15:10:21.697076+0000","last_undegraded":"2023-05-17T15:10:21.697076+0000","last_fullsized":"2023-05-17T15:10:21.697076+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682140+0000","last_change":"2023-05-17T15:10:21.293631+0000","last_active":"2023-05-17T15:10:21.682140+0000","last_peered":"2023-05-17T15:10:21.682140+0000","last_clean":"2023-05-17T15:10:21.682140+0000","last_became_active":"2023-05-17T15:10:21.293366+0000","last_became_peered":"2023-05-17T15:10:21.293366+0000","last_unstale":"2023-05-17T15:10:21.682140+0000","last_undegraded":"2023-05-17T15:10:21.682140+0000","last_fullsized":"2023-05-17T15:10:21.682140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693690+0000","last_change":"2023-05-17T15:10:21.688471+0000","last_active":"2023-05-17T15:10:21.693690+0000","last_peered":"2023-05-17T15:10:21.693690+0000","last_clean":"2023-05-17T15:10:21.693690+0000","last_became_active":"2023-05-17T15:10:21.688210+0000","last_became_peered":"2023-05-17T15:10:21.688210+0000","last_unstale":"2023-05-17T15:10:21.693690+0000","last_undegraded":"2023-05-17T15:10:21.693690+0000","last_fullsized":"2023-05-17T15:10:21.693690+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.671560+0000","last_change":"2023-05-17T15:10:21.297138+0000","last_active":"2023-05-17T15:10:21.671560+0000","last_peered":"2023-05-17T15:10:21.671560+0000","last_clean":"2023-05-17T15:10:21.671560+0000","last_became_active":"2023-05-17T15:10:21.296841+0000","last_became_peered":"2023-05-17T15:10:21.296841+0000","last_unstale":"2023-05-17T15:10:21.671560+0000","last_undegraded":"2023-05-17T15:10:21.671560+0000","last_fullsized":"2023-05-17T15:10:21.671560+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694629+0000","last_change":"2023-05-17T15:10:21.693002+0000","last_active":"2023-05-17T15:10:21.694629+0000","last_peered":"2023-05-17T15:10:21.694629+0000","last_clean":"2023-05-17T15:10:21.694629+0000","last_became_active":"2023-05-17T15:10:21.690224+0000","last_became_peered":"2023-05-17T15:10:21.690224+0000","last_unstale":"2023-05-17T15:10:21.694629+0000","last_undegraded":"2023-05-17T15:10:21.694629+0000","last_fullsized":"2023-05-17T15:10:21.694629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670786+0000","last_change":"2023-05-17T15:10:21.297424+0000","last_active":"2023-05-17T15:10:21.670786+0000","last_peered":"2023-05-17T15:10:21.670786+0000","last_clean":"2023-05-17T15:10:21.670786+0000","last_became_active":"2023-05-17T15:10:21.296968+0000","last_became_peered":"2023-05-17T15:10:21.296968+0000","last_unstale":"2023-05-17T15:10:21.670786+0000","last_undegraded":"2023-05-17T15:10:21.670786+0000","last_fullsized":"2023-05-17T15:10:21.670786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.698614+0000","last_change":"2023-05-17T15:10:21.696983+0000","last_active":"2023-05-17T15:10:21.698614+0000","last_peered":"2023-05-17T15:10:21.698614+0000","last_clean":"2023-05-17T15:10:21.698614+0000","last_became_active":"2023-05-17T15:10:21.696681+0000","last_became_peered":"2023-05-17T15:10:21.696681+0000","last_unstale":"2023-05-17T15:10:21.698614+0000","last_undegraded":"2023-05-17T15:10:21.698614+0000","last_fullsized":"2023-05-17T15:10:21.698614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.678572+0000","last_change":"2023-05-17T15:10:21.288635+0000","last_active":"2023-05-17T15:10:21.678572+0000","last_peered":"2023-05-17T15:10:21.678572+0000","last_clean":"2023-05-17T15:10:21.678572+0000","last_became_active":"2023-05-17T15:10:21.288306+0000","last_became_peered":"2023-05-17T15:10:21.288306+0000","last_unstale":"2023-05-17T15:10:21.678572+0000","last_undegraded":"2023-05-17T15:10:21.678572+0000","last_fullsized":"2023-05-17T15:10:21.678572+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696269+0000","last_change":"2023-05-17T15:10:21.686410+0000","last_active":"2023-05-17T15:10:21.696269+0000","last_peered":"2023-05-17T15:10:21.696269+0000","last_clean":"2023-05-17T15:10:21.696269+0000","last_became_active":"2023-05-17T15:10:21.685577+0000","last_became_peered":"2023-05-17T15:10:21.685577+0000","last_unstale":"2023-05-17T15:10:21.696269+0000","last_undegraded":"2023-05-17T15:10:21.696269+0000","last_fullsized":"2023-05-17T15:10:21.696269+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670815+0000","last_change":"2023-05-17T15:10:21.297742+0000","last_active":"2023-05-17T15:10:21.670815+0000","last_peered":"2023-05-17T15:10:21.670815+0000","last_clean":"2023-05-17T15:10:21.670815+0000","last_became_active":"2023-05-17T15:10:21.295280+0000","last_became_peered":"2023-05-17T15:10:21.295280+0000","last_unstale":"2023-05-17T15:10:21.670815+0000","last_undegraded":"2023-05-17T15:10:21.670815+0000","last_fullsized":"2023-05-17T15:10:21.670815+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693624+0000","last_change":"2023-05-17T15:10:21.686165+0000","last_active":"2023-05-17T15:10:21.693624+0000","last_peered":"2023-05-17T15:10:21.693624+0000","last_clean":"2023-05-17T15:10:21.693624+0000","last_became_active":"2023-05-17T15:10:21.685897+0000","last_became_peered":"2023-05-17T15:10:21.685897+0000","last_unstale":"2023-05-17T15:10:21.693624+0000","last_undegraded":"2023-05-17T15:10:21.693624+0000","last_fullsized":"2023-05-17T15:10:21.693624+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675673+0000","last_change":"2023-05-17T15:10:21.290882+0000","last_active":"2023-05-17T15:10:21.675673+0000","last_peered":"2023-05-17T15:10:21.675673+0000","last_clean":"2023-05-17T15:10:21.675673+0000","last_became_active":"2023-05-17T15:10:21.290588+0000","last_became_peered":"2023-05-17T15:10:21.290588+0000","last_unstale":"2023-05-17T15:10:21.675673+0000","last_undegraded":"2023-05-17T15:10:21.675673+0000","last_fullsized":"2023-05-17T15:10:21.675673+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.682219+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:21.682219+0000","last_peered":"2023-05-17T15:10:21.682219+0000","last_clean":"2023-05-17T15:10:21.682219+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:21.682219+0000","last_undegraded":"2023-05-17T15:10:21.682219+0000","last_fullsized":"2023-05-17T15:10:21.682219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693195+0000","last_change":"2023-05-17T15:10:21.685833+0000","last_active":"2023-05-17T15:10:21.693195+0000","last_peered":"2023-05-17T15:10:21.693195+0000","last_clean":"2023-05-17T15:10:21.693195+0000","last_became_active":"2023-05-17T15:10:21.685558+0000","last_became_peered":"2023-05-17T15:10:21.685558+0000","last_unstale":"2023-05-17T15:10:21.693195+0000","last_undegraded":"2023-05-17T15:10:21.693195+0000","last_fullsized":"2023-05-17T15:10:21.693195+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692312+0000","last_change":"2023-05-17T15:10:21.291323+0000","last_active":"2023-05-17T15:10:21.692312+0000","last_peered":"2023-05-17T15:10:21.692312+0000","last_clean":"2023-05-17T15:10:21.692312+0000","last_became_active":"2023-05-17T15:10:21.290241+0000","last_became_peered":"2023-05-17T15:10:21.290241+0000","last_unstale":"2023-05-17T15:10:21.692312+0000","last_undegraded":"2023-05-17T15:10:21.692312+0000","last_fullsized":"2023-05-17T15:10:21.692312+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.673594+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:21.673594+0000","last_peered":"2023-05-17T15:10:21.673594+0000","last_clean":"2023-05-17T15:10:21.673594+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:21.673594+0000","last_undegraded":"2023-05-17T15:10:21.673594+0000","last_fullsized":"2023-05-17T15:10:21.673594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.689689+0000","last_change":"2023-05-17T15:10:21.687760+0000","last_active":"2023-05-17T15:10:21.689689+0000","last_peered":"2023-05-17T15:10:21.689689+0000","last_clean":"2023-05-17T15:10:21.689689+0000","last_became_active":"2023-05-17T15:10:21.687515+0000","last_became_peered":"2023-05-17T15:10:21.687515+0000","last_unstale":"2023-05-17T15:10:21.689689+0000","last_undegraded":"2023-05-17T15:10:21.689689+0000","last_fullsized":"2023-05-17T15:10:21.689689+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674769+0000","last_change":"2023-05-17T15:10:21.296404+0000","last_active":"2023-05-17T15:10:21.674769+0000","last_peered":"2023-05-17T15:10:21.674769+0000","last_clean":"2023-05-17T15:10:21.674769+0000","last_became_active":"2023-05-17T15:10:21.296102+0000","last_became_peered":"2023-05-17T15:10:21.296102+0000","last_unstale":"2023-05-17T15:10:21.674769+0000","last_undegraded":"2023-05-17T15:10:21.674769+0000","last_fullsized":"2023-05-17T15:10:21.674769+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670607+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:21.670607+0000","last_peered":"2023-05-17T15:10:21.670607+0000","last_clean":"2023-05-17T15:10:21.670607+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:21.670607+0000","last_undegraded":"2023-05-17T15:10:21.670607+0000","last_fullsized":"2023-05-17T15:10:21.670607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.696911+0000","last_change":"2023-05-17T15:10:21.693385+0000","last_active":"2023-05-17T15:10:21.696911+0000","last_peered":"2023-05-17T15:10:21.696911+0000","last_clean":"2023-05-17T15:10:21.696911+0000","last_became_active":"2023-05-17T15:10:21.682985+0000","last_became_peered":"2023-05-17T15:10:21.682985+0000","last_unstale":"2023-05-17T15:10:21.696911+0000","last_undegraded":"2023-05-17T15:10:21.696911+0000","last_fullsized":"2023-05-17T15:10:21.696911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694622+0000","last_change":"2023-05-17T15:10:21.293923+0000","last_active":"2023-05-17T15:10:21.694622+0000","last_peered":"2023-05-17T15:10:21.694622+0000","last_clean":"2023-05-17T15:10:21.694622+0000","last_became_active":"2023-05-17T15:10:21.290866+0000","last_became_peered":"2023-05-17T15:10:21.290866+0000","last_unstale":"2023-05-17T15:10:21.694622+0000","last_undegraded":"2023-05-17T15:10:21.694622+0000","last_fullsized":"2023-05-17T15:10:21.694622+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675429+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:21.675429+0000","last_peered":"2023-05-17T15:10:21.675429+0000","last_clean":"2023-05-17T15:10:21.675429+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:21.675429+0000","last_undegraded":"2023-05-17T15:10:21.675429+0000","last_fullsized":"2023-05-17T15:10:21.675429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675089+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:21.675089+0000","last_peered":"2023-05-17T15:10:21.675089+0000","last_clean":"2023-05-17T15:10:21.675089+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:21.675089+0000","last_undegraded":"2023-05-17T15:10:21.675089+0000","last_fullsized":"2023-05-17T15:10:21.675089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.693864+0000","last_change":"2023-05-17T15:10:21.689011+0000","last_active":"2023-05-17T15:10:21.693864+0000","last_peered":"2023-05-17T15:10:21.693864+0000","last_clean":"2023-05-17T15:10:21.693864+0000","last_became_active":"2023-05-17T15:10:21.688661+0000","last_became_peered":"2023-05-17T15:10:21.688661+0000","last_unstale":"2023-05-17T15:10:21.693864+0000","last_undegraded":"2023-05-17T15:10:21.693864+0000","last_fullsized":"2023-05-17T15:10:21.693864+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674759+0000","last_change":"2023-05-17T15:10:21.292579+0000","last_active":"2023-05-17T15:10:21.674759+0000","last_peered":"2023-05-17T15:10:21.674759+0000","last_clean":"2023-05-17T15:10:21.674759+0000","last_became_active":"2023-05-17T15:10:21.292265+0000","last_became_peered":"2023-05-17T15:10:21.292265+0000","last_unstale":"2023-05-17T15:10:21.674759+0000","last_undegraded":"2023-05-17T15:10:21.674759+0000","last_fullsized":"2023-05-17T15:10:21.674759+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.675124+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:21.675124+0000","last_peered":"2023-05-17T15:10:21.675124+0000","last_clean":"2023-05-17T15:10:21.675124+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:21.675124+0000","last_undegraded":"2023-05-17T15:10:21.675124+0000","last_fullsized":"2023-05-17T15:10:21.675124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694563+0000","last_change":"2023-05-17T15:10:21.692741+0000","last_active":"2023-05-17T15:10:21.694563+0000","last_peered":"2023-05-17T15:10:21.694563+0000","last_clean":"2023-05-17T15:10:21.694563+0000","last_became_active":"2023-05-17T15:10:21.690100+0000","last_became_peered":"2023-05-17T15:10:21.690100+0000","last_unstale":"2023-05-17T15:10:21.694563+0000","last_undegraded":"2023-05-17T15:10:21.694563+0000","last_fullsized":"2023-05-17T15:10:21.694563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670906+0000","last_change":"2023-05-17T15:10:21.297556+0000","last_active":"2023-05-17T15:10:21.670906+0000","last_peered":"2023-05-17T15:10:21.670906+0000","last_clean":"2023-05-17T15:10:21.670906+0000","last_became_active":"2023-05-17T15:10:21.289321+0000","last_became_peered":"2023-05-17T15:10:21.289321+0000","last_unstale":"2023-05-17T15:10:21.670906+0000","last_undegraded":"2023-05-17T15:10:21.670906+0000","last_fullsized":"2023-05-17T15:10:21.670906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.674983+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:21.674983+0000","last_peered":"2023-05-17T15:10:21.674983+0000","last_clean":"2023-05-17T15:10:21.674983+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:21.674983+0000","last_undegraded":"2023-05-17T15:10:21.674983+0000","last_fullsized":"2023-05-17T15:10:21.674983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692726+0000","last_change":"2023-05-17T15:10:21.688711+0000","last_active":"2023-05-17T15:10:21.692726+0000","last_peered":"2023-05-17T15:10:21.692726+0000","last_clean":"2023-05-17T15:10:21.692726+0000","last_became_active":"2023-05-17T15:10:21.688420+0000","last_became_peered":"2023-05-17T15:10:21.688420+0000","last_unstale":"2023-05-17T15:10:21.692726+0000","last_undegraded":"2023-05-17T15:10:21.692726+0000","last_fullsized":"2023-05-17T15:10:21.692726+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.694327+0000","last_change":"2023-05-17T15:10:21.295531+0000","last_active":"2023-05-17T15:10:21.694327+0000","last_peered":"2023-05-17T15:10:21.694327+0000","last_clean":"2023-05-17T15:10:21.694327+0000","last_became_active":"2023-05-17T15:10:21.295253+0000","last_became_peered":"2023-05-17T15:10:21.295253+0000","last_unstale":"2023-05-17T15:10:21.694327+0000","last_undegraded":"2023-05-17T15:10:21.694327+0000","last_fullsized":"2023-05-17T15:10:21.694327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.686122+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:21.686122+0000","last_peered":"2023-05-17T15:10:21.686122+0000","last_clean":"2023-05-17T15:10:21.686122+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:21.686122+0000","last_undegraded":"2023-05-17T15:10:21.686122+0000","last_fullsized":"2023-05-17T15:10:21.686122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.692908+0000","last_change":"2023-05-17T15:10:21.690118+0000","last_active":"2023-05-17T15:10:21.692908+0000","last_peered":"2023-05-17T15:10:21.692908+0000","last_clean":"2023-05-17T15:10:21.692908+0000","last_became_active":"2023-05-17T15:10:21.689835+0000","last_became_peered":"2023-05-17T15:10:21.689835+0000","last_unstale":"2023-05-17T15:10:21.692908+0000","last_undegraded":"2023-05-17T15:10:21.692908+0000","last_fullsized":"2023-05-17T15:10:21.692908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:21.265523+0000","last_clean_scrub_stamp":"2023-05-17T15:10:21.265523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.670901+0000","last_change":"2023-05-17T15:10:21.297233+0000","last_active":"2023-05-17T15:10:21.670901+0000","last_peered":"2023-05-17T15:10:21.670901+0000","last_clean":"2023-05-17T15:10:21.670901+0000","last_became_active":"2023-05-17T15:10:21.291087+0000","last_became_peered":"2023-05-17T15:10:21.291087+0000","last_unstale":"2023-05-17T15:10:21.670901+0000","last_undegraded":"2023-05-17T15:10:21.670901+0000","last_fullsized":"2023-05-17T15:10:21.670901+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:20.258857+0000","last_clean_scrub_stamp":"2023-05-17T15:10:20.258857+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-05-17T15:10:21.678317+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:21.678317+0000","last_peered":"2023-05-17T15:10:21.678317+0000","last_clean":"2023-05-17T15:10:21.678317+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:21.678317+0000","last_undegraded":"2023-05-17T15:10:21.678317+0000","last_fullsized":"2023-05-17T15:10:21.678317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18556,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353284,"statfs":{"total":96636764160,"available":96617762816,"internally_reserved":0,"allocated":1560576,"data_stored":783841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.84799999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.76800000000000002}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.63400000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18180,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353660,"statfs":{"total":96636764160,"available":96618147840,"internally_reserved":0,"allocated":1568768,"data_stored":784417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.505},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56200000000000006}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.441}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17992,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94353848,"statfs":{"total":96636764160,"available":96618340352,"internally_reserved":0,"allocated":1572864,"data_stored":785301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38600000000000001,"15min":0.38500000000000001},"min":{"1min":0.26400000000000001,"5min":0.246,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.441},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.23000000000000001},"max":{"1min":0.50600000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.38}]},{"osd":2,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27400000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.20000000000000001},"max":{"1min":0.52700000000000002,"5min":1.956,"15min":1.956},"last":0.33700000000000002}]},{"osd":3,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27100000000000002},"max":{"1min":0.55300000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":1.149,"15min":1.149},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.02,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.378},"max":{"1min":0.876,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.044,"5min":1.103,"15min":1.6100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98399999999999999,"5min":1.524,"15min":1.524},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed May 17 15:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.01,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.92800000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17668,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354172,"statfs":{"total":96636764160,"available":96618672128,"internally_reserved":0,"allocated":1568768,"data_stored":784485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.378}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19072,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":17536,"kb_avail":94352768,"statfs":{"total":96636764160,"available":96617234432,"internally_reserved":0,"allocated":1564672,"data_stored":783855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17956864},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.249},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.28100000000000003}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.313}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.72099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":20480,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":1556480,"data_stored":783751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20971520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.46899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18368,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353472,"statfs":{"total":96636764160,"available":96617955328,"internally_reserved":0,"allocated":1564672,"data_stored":784665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.626}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.69499999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.73799999999999999}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.755},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.81000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21564,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":20032,"kb_avail":94350276,"statfs":{"total":96636764160,"available":96614682624,"internally_reserved":0,"allocated":1560576,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20512768},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77500000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.82999999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:10:30.553 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:10:30.554 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:10:30.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 Processor -- start 2023-05-17T15:10:30.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 -- start start 2023-05-17T15:10:30.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6ca0153cd0 0x7f6ca00697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca00bdb30 0x7f6ca0095010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ca0095500 0x7f6ca0157950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca0095990 con 0x7f6ca0153cd0 2023-05-17T15:10:30.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca0069ce0 con 0x7f6ca0095500 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.704+0000 7f6c9ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00be310 con 0x7f6ca00bdb30 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6ca0153cd0 0x7f6ca00697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6ca0153cd0 0x7f6ca00697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42534/0 (socket says 172.21.15.27:42534) 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 -- 172.21.15.27:0/689893175 learned_addr learned my addr 172.21.15.27:0/689893175 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9e7fc700 1 --2- 172.21.15.27:0/689893175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca00bdb30 0x7f6ca0095010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9f7fe700 1 --2- 172.21.15.27:0/689893175 >> v2:172.21.15.40:3300/0 conn(0x7f6ca0095500 0x7f6ca0157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 -- 172.21.15.27:0/689893175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca00bdb30 msgr2=0x7f6ca0095010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 --2- 172.21.15.27:0/689893175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca00bdb30 0x7f6ca0095010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 -- 172.21.15.27:0/689893175 >> v2:172.21.15.40:3300/0 conn(0x7f6ca0095500 msgr2=0x7f6ca0157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 --2- 172.21.15.27:0/689893175 >> v2:172.21.15.40:3300/0 conn(0x7f6ca0095500 0x7f6ca0157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 -- 172.21.15.27:0/689893175 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00be5f0 con 0x7f6ca0153cd0 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9effd700 1 --2- 172.21.15.27:0/689893175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca0153cd0 0x7f6ca00697f0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f6ca006c4d0 tx=0x7f6c94009060).ready entity=mon.0 client_cookie=8313797adacd1ee7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9dffb700 1 -- 172.21.15.27:0/689893175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94005880 con 0x7f6ca0153cd0 2023-05-17T15:10:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9dffb700 1 -- 172.21.15.27:0/689893175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940059e0 con 0x7f6ca0153cd0 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.705+0000 7f6c9dffb700 1 -- 172.21.15.27:0/689893175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94005d60 con 0x7f6ca0153cd0 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 -- 172.21.15.27:0/689893175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca0153cd0 msgr2=0x7f6ca00697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/689893175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca0153cd0 0x7f6ca00697f0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f6ca006c4d0 tx=0x7f6c94009060).stop 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 -- 172.21.15.27:0/689893175 shutdown_connections 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/689893175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca0153cd0 0x7f6ca00697f0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/689893175 >> v2:172.21.15.40:3300/0 conn(0x7f6ca0095500 0x7f6ca0157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/689893175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca00bdb30 0x7f6ca0095010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 -- 172.21.15.27:0/689893175 >> 172.21.15.27:0/689893175 conn(0x7f6ca00c8820 msgr2=0x7f6ca00c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:30.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 -- 172.21.15.27:0/689893175 shutdown_connections 2023-05-17T15:10:30.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.706+0000 7f6c9ffff700 1 -- 172.21.15.27:0/689893175 wait complete. 2023-05-17T15:10:30.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.707+0000 7f6c9ffff700 1 Processor -- start 2023-05-17T15:10:30.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.707+0000 7f6c9ffff700 1 -- start start 2023-05-17T15:10:30.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca0095500 0x7f6ca00abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 0x7f6ca00bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca0153cd0 0x7f6ca0148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00ac450 con 0x7f6ca00bdb30 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00bffc0 con 0x7f6ca0153cd0 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00bfdb0 con 0x7f6ca0095500 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 0x7f6ca00bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 0x7f6ca00bf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42540/0 (socket says 172.21.15.27:42540) 2023-05-17T15:10:30.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 -- 172.21.15.27:0/2571729638 learned_addr learned my addr 172.21.15.27:0/2571729638 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9effd700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca0095500 0x7f6ca00abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9f7fe700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca0153cd0 0x7f6ca0148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 -- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca0095500 msgr2=0x7f6ca00abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca0095500 0x7f6ca00abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 -- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca0153cd0 msgr2=0x7f6ca0148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca0153cd0 0x7f6ca0148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 -- 172.21.15.27:0/2571729638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009300 con 0x7f6ca00bdb30 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9effd700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca0095500 0x7f6ca00abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9e7fc700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 0x7f6ca00bf8c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f6c9000e930 tx=0x7f6c90009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000eed0 con 0x7f6ca00bdb30 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9000c850 con 0x7f6ca00bdb30 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca00c2a00 con 0x7f6ca00bdb30 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000cbd0 con 0x7f6ca00bdb30 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.708+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca00c23b0 con 0x7f6ca00bdb30 2023-05-17T15:10:30.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.709+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca00c2bb0 con 0x7f6ca00bdb30 2023-05-17T15:10:30.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.710+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6c90022070 con 0x7f6ca00bdb30 2023-05-17T15:10:30.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.710+0000 7f6c86ffd700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6c8c05ed90 0x7f6c8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:30.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.710+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f6c9007a580 con 0x7f6ca00bdb30 2023-05-17T15:10:30.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.710+0000 7f6c9effd700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6c8c05ed90 0x7f6c8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:30.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.711+0000 7f6c9effd700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6c8c05ed90 0x7f6c8c061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6ca006c4d0 tx=0x7f6c94016000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:30.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.714+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c9004bb40 con 0x7f6ca00bdb30 2023-05-17T15:10:30.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.955+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f6ca0047150 con 0x7f6ca00bdb30 2023-05-17T15:10:30.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.959+0000 7f6c86ffd700 1 -- 172.21.15.27:0/2571729638 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6c9004f160 con 0x7f6ca00bdb30 2023-05-17T15:10:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6c8c05ed90 msgr2=0x7f6c8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6c8c05ed90 0x7f6c8c061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6ca006c4d0 tx=0x7f6c94016000).stop 2023-05-17T15:10:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 msgr2=0x7f6ca00bf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:30.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 0x7f6ca00bf8c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f6c9000e930 tx=0x7f6c90009060).stop 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 shutdown_connections 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6c8c05ed90 0x7f6c8c061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca0153cd0 0x7f6ca0148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca0095500 0x7f6ca00abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 --2- 172.21.15.27:0/2571729638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca00bdb30 0x7f6ca00bf8c0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 >> 172.21.15.27:0/2571729638 conn(0x7f6ca00c8820 msgr2=0x7f6ca00695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:30.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 shutdown_connections 2023-05-17T15:10:30.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:30.961+0000 7f6c9ffff700 1 -- 172.21.15.27:0/2571729638 wait complete. 2023-05-17T15:10:30.967 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:10:30.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:31.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.089+0000 7fa741062700 1 Processor -- start 2023-05-17T15:10:31.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.089+0000 7fa741062700 1 -- start start 2023-05-17T15:10:31.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa741062700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c0c5f30 0x7fa73c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa741062700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa73c158880 0x7fa73c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa741062700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0bfcd0 con 0x7fa73c1541c0 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa741062700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0c0290 con 0x7fa73c158880 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa741062700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0aa1a0 con 0x7fa73c0c5f30 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73b59e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa73c1541c0 0x7fa73c0c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42110/0 (socket says 172.21.15.27:42110) 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73b59e700 1 -- 172.21.15.27:0/1446578871 learned_addr learned my addr 172.21.15.27:0/1446578871 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73a59c700 1 --2- 172.21.15.27:0/1446578871 >> v2:172.21.15.40:3300/0 conn(0x7fa73c158880 0x7fa73c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73ad9d700 1 --2- 172.21.15.27:0/1446578871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c0c5f30 0x7fa73c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa739d9b700 1 -- 172.21.15.27:0/1446578871 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816550397 0 0) 0x7fa73c0bfcd0 con 0x7fa73c1541c0 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa739d9b700 1 -- 172.21.15.27:0/1446578871 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7280033f0 con 0x7fa73c1541c0 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73ad9d700 1 -- 172.21.15.27:0/1446578871 >> v2:172.21.15.40:3300/0 conn(0x7fa73c158880 msgr2=0x7fa73c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73ad9d700 1 --2- 172.21.15.27:0/1446578871 >> v2:172.21.15.40:3300/0 conn(0x7fa73c158880 0x7fa73c153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73ad9d700 1 -- 172.21.15.27:0/1446578871 >> v1:172.21.15.27:6789/0 conn(0x7fa73c1541c0 legacy=0x7fa73c0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73ad9d700 1 -- 172.21.15.27:0/1446578871 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0aa480 con 0x7fa73c0c5f30 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.090+0000 7fa73a59c700 1 --2- 172.21.15.27:0/1446578871 >> v2:172.21.15.40:3300/0 conn(0x7fa73c158880 0x7fa73c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa73ad9d700 1 --2- 172.21.15.27:0/1446578871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c0c5f30 0x7fa73c0c6310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa734009e60 tx=0x7fa734009780).ready entity=mon.2 client_cookie=a2efff96e92c9953 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa739d9b700 1 -- 172.21.15.27:0/1446578871 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400e070 con 0x7fa73c0c5f30 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa739d9b700 1 -- 172.21.15.27:0/1446578871 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400bab0 con 0x7fa73c0c5f30 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa739d9b700 1 -- 172.21.15.27:0/1446578871 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400be30 con 0x7fa73c0c5f30 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 -- 172.21.15.27:0/1446578871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c0c5f30 msgr2=0x7fa73c0c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 --2- 172.21.15.27:0/1446578871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c0c5f30 0x7fa73c0c6310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa734009e60 tx=0x7fa734009780).stop 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 -- 172.21.15.27:0/1446578871 shutdown_connections 2023-05-17T15:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 --2- 172.21.15.27:0/1446578871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c0c5f30 0x7fa73c0c6310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 --2- 172.21.15.27:0/1446578871 >> v2:172.21.15.40:3300/0 conn(0x7fa73c158880 0x7fa73c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 -- 172.21.15.27:0/1446578871 >> 172.21.15.27:0/1446578871 conn(0x7fa73c069e70 msgr2=0x7fa73c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 -- 172.21.15.27:0/1446578871 shutdown_connections 2023-05-17T15:10:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.091+0000 7fa741062700 1 -- 172.21.15.27:0/1446578871 wait complete. 2023-05-17T15:10:31.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 Processor -- start 2023-05-17T15:10:31.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 -- start start 2023-05-17T15:10:31.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0c5f30 0x7fa73c0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c1541c0 0x7fa73c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 0x7fa73c0a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1547c0 con 0x7fa73c158880 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0ca0f0 con 0x7fa73c0c5f30 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.093+0000 7fa741062700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0ca3d0 con 0x7fa73c1541c0 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 0x7fa73c0a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 0x7fa73c0a9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42556/0 (socket says 172.21.15.27:42556) 2023-05-17T15:10:31.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 -- 172.21.15.27:0/14129542 learned_addr learned my addr 172.21.15.27:0/14129542 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73a59c700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c1541c0 0x7fa73c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73ad9d700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0c5f30 0x7fa73c0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 -- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c1541c0 msgr2=0x7fa73c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c1541c0 0x7fa73c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 -- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0c5f30 msgr2=0x7fa73c0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0c5f30 0x7fa73c0c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 -- 172.21.15.27:0/14129542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240092a0 con 0x7fa73c158880 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73a59c700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c1541c0 0x7fa73c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa73b59e700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 0x7fa73c0a9470 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fa72c0010e0 tx=0x7fa72c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0072e0 con 0x7fa73c158880 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c007440 con 0x7fa73c158880 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0057a0 con 0x7fa73c158880 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa734009a20 con 0x7fa73c158880 2023-05-17T15:10:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.094+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0ca990 con 0x7fa73c158880 2023-05-17T15:10:31.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.095+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c154930 con 0x7fa73c158880 2023-05-17T15:10:31.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.095+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa72c010070 con 0x7fa73c158880 2023-05-17T15:10:31.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.096+0000 7fa732ffd700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa71c05ed90 0x7fa71c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.096+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fa72c079210 con 0x7fa73c158880 2023-05-17T15:10:31.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.096+0000 7fa73ad9d700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa71c05ed90 0x7fa71c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.096+0000 7fa73ad9d700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa71c05ed90 0x7fa71c061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa734009e60 tx=0x7fa734009780).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.100+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa73c154930 con 0x7fa73c158880 2023-05-17T15:10:31.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.321+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa73c154930 con 0x7fa73c158880 2023-05-17T15:10:31.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.322+0000 7fa732ffd700 1 -- 172.21.15.27:0/14129542 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fa73c154930 con 0x7fa73c158880 2023-05-17T15:10:31.326 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:31.326 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:21.665012+0000","modified":"2023-05-17T15:10:24.678553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2675320429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2675320429},{"type":"v1","addr":"172.21.15.40:6834","nonce":2675320429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-17T15:10:31.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa71c05ed90 msgr2=0x7fa71c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa71c05ed90 0x7fa71c061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa734009e60 tx=0x7fa734009780).stop 2023-05-17T15:10:31.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 msgr2=0x7fa73c0a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 0x7fa73c0a9470 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fa72c0010e0 tx=0x7fa72c007c50).stop 2023-05-17T15:10:31.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 shutdown_connections 2023-05-17T15:10:31.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa71c05ed90 0x7fa71c061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c158880 0x7fa73c0a9470 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0c5f30 0x7fa73c0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 --2- 172.21.15.27:0/14129542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa73c1541c0 0x7fa73c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 >> 172.21.15.27:0/14129542 conn(0x7fa73c069e70 msgr2=0x7fa73c0ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 shutdown_connections 2023-05-17T15:10:31.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.324+0000 7fa741062700 1 -- 172.21.15.27:0/14129542 wait complete. 2023-05-17T15:10:31.330 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 52 2023-05-17T15:10:31.742 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:10:21.665012+0000', 'modified': '2023-05-17T15:10:24.678553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7581}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7581': {'gid': 7581, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6834/2675320429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 2675320429}, {'type': 'v1', 'addr': '172.21.15.40:6834', 'nonce': 2675320429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:10:31.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:10:31.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-17T15:10:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.861+0000 7f142fe7e700 1 Processor -- start 2023-05-17T15:10:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.861+0000 7f142fe7e700 1 -- start start 2023-05-17T15:10:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142fe7e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1428154090 0x7f1428154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142fe7e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f14280cb450 0x7f14280cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142fe7e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280c5a50 con 0x7f1428068f00 2023-05-17T15:10:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142fe7e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1428069fa0 con 0x7f1428154090 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142fe7e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14280c04e0 con 0x7f14280cb450 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142dc1a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1428154090 0x7f1428154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142dc1a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1428154090 0x7f1428154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42560/0 (socket says 172.21.15.27:42560) 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142dc1a700 1 -- 172.21.15.27:0/2008029913 learned_addr learned my addr 172.21.15.27:0/2008029913 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.862+0000 7f142e41b700 1 --1- 172.21.15.27:0/2008029913 >> v1:172.21.15.27:6789/0 conn(0x7f1428068f00 0x7f1428157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42126/0 (socket says 172.21.15.27:42126) 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142d419700 1 --2- 172.21.15.27:0/2008029913 >> v2:172.21.15.40:3300/0 conn(0x7f14280cb450 0x7f14280cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142dc1a700 1 -- 172.21.15.27:0/2008029913 >> v2:172.21.15.40:3300/0 conn(0x7f14280cb450 msgr2=0x7f14280cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142dc1a700 1 --2- 172.21.15.27:0/2008029913 >> v2:172.21.15.40:3300/0 conn(0x7f14280cb450 0x7f14280cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142dc1a700 1 -- 172.21.15.27:0/2008029913 >> v1:172.21.15.27:6789/0 conn(0x7f1428068f00 legacy=0x7f1428157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142cc18700 1 -- 172.21.15.27:0/2008029913 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784574356 0 0) 0x7f14280c5a50 con 0x7f1428068f00 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142dc1a700 1 -- 172.21.15.27:0/2008029913 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280c0760 con 0x7f1428154090 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142d419700 1 --2- 172.21.15.27:0/2008029913 >> v2:172.21.15.40:3300/0 conn(0x7f14280cb450 0x7f14280cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142dc1a700 1 --2- 172.21.15.27:0/2008029913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1428154090 0x7f1428154470 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f14280bff40 tx=0x7f14200090f0).ready entity=mon.0 client_cookie=bc0d62b7b5657f46 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142cc18700 1 -- 172.21.15.27:0/2008029913 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000b600 con 0x7f1428154090 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142cc18700 1 -- 172.21.15.27:0/2008029913 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000b760 con 0x7f1428154090 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142cc18700 1 -- 172.21.15.27:0/2008029913 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000bae0 con 0x7f1428154090 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142fe7e700 1 -- 172.21.15.27:0/2008029913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1428154090 msgr2=0x7f1428154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2008029913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1428154090 0x7f1428154470 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f14280bff40 tx=0x7f14200090f0).stop 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142fe7e700 1 -- 172.21.15.27:0/2008029913 shutdown_connections 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2008029913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1428154090 0x7f1428154470 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2008029913 >> v2:172.21.15.40:3300/0 conn(0x7f14280cb450 0x7f14280cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.863+0000 7f142fe7e700 1 -- 172.21.15.27:0/2008029913 >> 172.21.15.27:0/2008029913 conn(0x7f142805e7e0 msgr2=0x7f14280cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.864+0000 7f142fe7e700 1 -- 172.21.15.27:0/2008029913 shutdown_connections 2023-05-17T15:10:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.864+0000 7f142fe7e700 1 -- 172.21.15.27:0/2008029913 wait complete. 2023-05-17T15:10:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 Processor -- start 2023-05-17T15:10:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 -- start start 2023-05-17T15:10:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1428068f00 0x7f1428155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 0x7f14280c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1428154090 0x7f1428144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1428156e30 con 0x7f14280cb450 2023-05-17T15:10:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1428156220 con 0x7f1428154090 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142fe7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1428156500 con 0x7f1428068f00 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.865+0000 7f142d419700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 0x7f14280c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 0x7f14280c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42568/0 (socket says 172.21.15.27:42568) 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 -- 172.21.15.27:0/2363074452 learned_addr learned my addr 172.21.15.27:0/2363074452 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142dc1a700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1428068f00 0x7f1428155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142e41b700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1428154090 0x7f1428144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 -- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1428068f00 msgr2=0x7f1428155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1428068f00 0x7f1428155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 -- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1428154090 msgr2=0x7f1428144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1428154090 0x7f1428144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 -- 172.21.15.27:0/2363074452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009370 con 0x7f14280cb450 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142d419700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 0x7f14280c4190 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f141c00c880 tx=0x7f141c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f1425ffb700 1 -- 172.21.15.27:0/2363074452 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c010580 con 0x7f14280cb450 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f1425ffb700 1 -- 172.21.15.27:0/2363074452 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0106e0 con 0x7f14280cb450 2023-05-17T15:10:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14281567e0 con 0x7f14280cb450 2023-05-17T15:10:31.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f1425ffb700 1 -- 172.21.15.27:0/2363074452 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c010a60 con 0x7f14280cb450 2023-05-17T15:10:31.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.866+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14280c4680 con 0x7f14280cb450 2023-05-17T15:10:31.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.868+0000 7f1425ffb700 1 -- 172.21.15.27:0/2363074452 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f141c01b460 con 0x7f14280cb450 2023-05-17T15:10:31.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.868+0000 7f1425ffb700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f141405ed90 0x7f1414061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.868+0000 7f1425ffb700 1 -- 172.21.15.27:0/2363074452 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f141c079d00 con 0x7f14280cb450 2023-05-17T15:10:31.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.868+0000 7f142dc1a700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f141405ed90 0x7f1414061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.869+0000 7f142dc1a700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f141405ed90 0x7f1414061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1420009130 tx=0x7f1420017000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.870+0000 7f1441810b80 1 Processor -- start 2023-05-17T15:10:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.870+0000 7f1441810b80 1 -- start start 2023-05-17T15:10:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f1441810b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8493710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f1441810b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae845e5e0 con 0x558ae84e2480 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae83d58a0 con 0x558ae8499300 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ae83ea900 con 0x558ae84dd560 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f142d419700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f142d419700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42576/0 (socket says 172.21.15.27:42576) 2023-05-17T15:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f142d419700 1 -- 172.21.15.27:0/335233945 learned_addr learned my addr 172.21.15.27:0/335233945 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f142dc1a700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.871+0000 7f142e41b700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8493710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142d419700 1 -- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 msgr2=0x558ae84c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142d419700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142d419700 1 -- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 msgr2=0x558ae8493710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142d419700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8493710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142d419700 1 -- 172.21.15.27:0/335233945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ae845e450 con 0x558ae84e2480 2023-05-17T15:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142dc1a700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142e41b700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8493710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f142d419700 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dd940 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f141c04ea90 tx=0x7f141c00f000).ready entity=mon.0 client_cookie=e77620535ab3908c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f140effd700 1 -- 172.21.15.27:0/335233945 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0545e0 con 0x558ae84e2480 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f140effd700 1 -- 172.21.15.27:0/335233945 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c051040 con 0x558ae84e2480 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f140effd700 1 -- 172.21.15.27:0/335233945 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c04d240 con 0x558ae84e2480 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 -- 172.21.15.27:0/335233945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 msgr2=0x558ae84dd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dd940 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f141c04ea90 tx=0x7f141c00f000).stop 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 -- 172.21.15.27:0/335233945 shutdown_connections 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8493710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 --2- 172.21.15.27:0/335233945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dd940 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 -- 172.21.15.27:0/335233945 >> 172.21.15.27:0/335233945 conn(0x558ae8255e40 msgr2=0x558ae84e19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.872+0000 7f1441810b80 1 -- 172.21.15.27:0/335233945 shutdown_connections 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.873+0000 7f1441810b80 1 -- 172.21.15.27:0/335233945 wait complete. 2023-05-17T15:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.873+0000 7f1441810b80 1 -- start start 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.873+0000 7f1441810b80 1 Processor -- start 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 0x558ae84c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae84dd560 0x558ae84bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae83b1ed0 con 0x558ae8499300 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae84f1a60 con 0x558ae84dd560 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ae84bd1f0 con 0x558ae84e2480 2023-05-17T15:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f1441810b80 10 client.0 ll_register_callbacks cb 0x558ae84581f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 0x558ae84c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 0x558ae84c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42580/0 (socket says 172.21.15.27:42580) 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 -- 172.21.15.27:0/3085420129 learned_addr learned my addr 172.21.15.27:0/3085420129 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142d419700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae84dd560 0x558ae84bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142e41b700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 -- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 msgr2=0x558ae84f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84f0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 -- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae84dd560 msgr2=0x558ae84bcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae84dd560 0x558ae84bcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142dc1a700 1 -- 172.21.15.27:0/3085420129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14280c4680 con 0x558ae8499300 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.874+0000 7f142e41b700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f142dc1a700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 0x558ae84c2130 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f1420011000 tx=0x7f142001e070).ready entity=mon.0 client_cookie=1a1e3a8604afd92d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1407fff700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:10:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1407fff700 1 -- 172.21.15.27:0/3085420129 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420006a40 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1407fff700 1 -- 172.21.15.27:0/3085420129 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f14200276f0 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ae848c460 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1407fff700 1 -- 172.21.15.27:0/3085420129 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14200278b0 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 10 client.7740 fetch_fsmap learned FSMap version 52 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x558ae828d310 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1407fff700 1 -- 172.21.15.27:0/3085420129 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ae848c460 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1407fff700 1 -- 172.21.15.27:0/3085420129 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1420027a10 con 0x558ae8499300 2023-05-17T15:10:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 10 client.7740 fetch_fsmap finished waiting for FSMap version 52 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 10 client.7740 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 20 client.7740 populate_metadata read hostname 'smithi027' 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84f1020 0x558ae84944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 4 client.7740 mds_command: new command op to 7581 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.875+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 --> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ae8251ca0 con 0x558ae84f1020 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.876+0000 7f142d419700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84f1020 0x558ae84944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.876+0000 7f1407fff700 10 client.7740 ms_handle_connect on v2:172.21.15.40:6832/2675320429 2023-05-17T15:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.876+0000 7f142d419700 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84f1020 0x558ae84944d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ce95de59681d76c4 server_cookie=5c66302b0032dcc in_seq=0 out_seq=0 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1407fff700 1 -- 172.21.15.27:0/3085420129 <== mds.0 v2:172.21.15.40:6832/2675320429 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x558ae8251ca0 con 0x558ae84f1020 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1407fff700 10 client.7740 handle_command_reply: tid=0 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 client.7740 shutdown 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 msgr2=0x558ae84c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 0x558ae84c2130 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f1420011000 tx=0x7f142001e070).stop 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 shutdown_connections 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84f1020 0x558ae84944d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1407fff700 0 client.7740 ms_handle_reset on v2:172.21.15.40:6832/2675320429 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae8499300 0x558ae84c2130 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 --2- 172.21.15.27:0/3085420129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae84dd560 0x558ae84bcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 >> 172.21.15.27:0/3085420129 conn(0x558ae8255e40 msgr2=0x558ae84e1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 shutdown_connections 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 1 -- 172.21.15.27:0/3085420129 wait complete. 2023-05-17T15:10:31.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.877+0000 7f1441810b80 20 client.7740 trim_cache size 0 max 16384 2023-05-17T15:10:31.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 Processor -- start 2023-05-17T15:10:31.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 -- start start 2023-05-17T15:10:31.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae84f0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 0x558ae84f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae8499bd0 con 0x558ae84dd560 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae84dd020 con 0x558ae8499300 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.894+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ae84e2220 con 0x558ae84e2480 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 0x558ae84f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 0x558ae84f00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42588/0 (socket says 172.21.15.27:42588) 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 -- 172.21.15.27:0/2938675549 learned_addr learned my addr 172.21.15.27:0/2938675549 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142dc1a700 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae84f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142e41b700 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 -- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 msgr2=0x558ae84e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84e14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 -- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 msgr2=0x558ae84f0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae84f0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 -- 172.21.15.27:0/2938675549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ae83e3880 con 0x558ae84dd560 2023-05-17T15:10:31.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f142d419700 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 0x558ae84f00a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f141c04eba0 tx=0x7f141c057000).ready entity=mon.0 client_cookie=bde50b939924e4c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f140f7fe700 1 -- 172.21.15.27:0/2938675549 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c04d240 con 0x558ae84dd560 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f140f7fe700 1 -- 172.21.15.27:0/2938675549 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c010c60 con 0x558ae84dd560 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.895+0000 7f140f7fe700 1 -- 172.21.15.27:0/2938675549 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c04e390 con 0x558ae84dd560 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 -- 172.21.15.27:0/2938675549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 msgr2=0x558ae84f00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 0x558ae84f00a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f141c04eba0 tx=0x7f141c057000).stop 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 -- 172.21.15.27:0/2938675549 shutdown_connections 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84e2480 0x558ae84e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae84f0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 --2- 172.21.15.27:0/2938675549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84dd560 0x558ae84f00a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 -- 172.21.15.27:0/2938675549 >> 172.21.15.27:0/2938675549 conn(0x558ae8255e40 msgr2=0x558ae84c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 -- 172.21.15.27:0/2938675549 shutdown_connections 2023-05-17T15:10:31.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 -- 172.21.15.27:0/2938675549 wait complete. 2023-05-17T15:10:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 -- start start 2023-05-17T15:10:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.896+0000 7f1441810b80 1 Processor -- start 2023-05-17T15:10:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8542500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae84e5540 con 0x558ae84e2480 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ae84de340 con 0x558ae8499300 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ae84bb820 con 0x558ae84dd560 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f1441810b80 10 client.0 ll_register_callbacks cb 0x558ae84581f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f142e41b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f142e41b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42598/0 (socket says 172.21.15.27:42598) 2023-05-17T15:10:31.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f142e41b700 1 -- 172.21.15.27:0/1111538632 learned_addr learned my addr 172.21.15.27:0/1111538632 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f142d419700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.897+0000 7f142dc1a700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8542500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f142e41b700 1 -- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 msgr2=0x558ae84e4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f142e41b700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84e4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f142e41b700 1 -- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 msgr2=0x558ae8542500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f142e41b700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8542500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f142e41b700 1 -- 172.21.15.27:0/1111538632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ae845e450 con 0x558ae84e2480 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f142e41b700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dbc00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f1418000f80 tx=0x7f1418009040).ready entity=mon.0 client_cookie=7c0a49449e79446d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1407fff700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1407fff700 1 -- 172.21.15.27:0/1111538632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141801c070 con 0x558ae84e2480 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1407fff700 1 -- 172.21.15.27:0/1111538632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f1418002010 con 0x558ae84e2480 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f141c051040 con 0x558ae84e2480 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1407fff700 1 -- 172.21.15.27:0/1111538632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1418004c40 con 0x558ae84e2480 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 10 client.7746 fetch_fsmap learned FSMap version 52 2023-05-17T15:10:31.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x558ae83df070 con 0x558ae84e2480 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1407fff700 1 -- 172.21.15.27:0/1111538632 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c051040 con 0x558ae84e2480 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1407fff700 1 -- 172.21.15.27:0/1111538632 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1418005030 con 0x558ae84e2480 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 10 client.7746 fetch_fsmap finished waiting for FSMap version 52 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 10 client.7746 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 20 client.7746 populate_metadata read hostname 'smithi027' 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84bbd00 0x558ae84bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:31.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 4 client.7746 mds_command: new command op to 7581 tid=0[{"prefix": "status"}] 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.898+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 --> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ae8288ca0 con 0x558ae84bbd00 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f142dc1a700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84bbd00 0x558ae84bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1407fff700 10 client.7746 ms_handle_connect on v2:172.21.15.40:6832/2675320429 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f142dc1a700 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84bbd00 0x558ae84bc0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7111710a9be4c8c2 server_cookie=5b3205387522cff9 in_seq=0 out_seq=0 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1407fff700 1 -- 172.21.15.27:0/1111538632 <== mds.0 v2:172.21.15.40:6832/2675320429 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x558ae8288ca0 con 0x558ae84bbd00 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1407fff700 10 client.7746 handle_command_reply: tid=0 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 client.7746 shutdown 2023-05-17T15:10:31.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 msgr2=0x558ae84dbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dbc00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f1418000f80 tx=0x7f1418009040).stop 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 shutdown_connections 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:6832/2675320429,v1:172.21.15.40:6834/2675320429] conn(0x558ae84bbd00 0x558ae84bc0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ae84e2480 0x558ae84dbc00 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1407fff700 0 client.7746 ms_handle_reset on v2:172.21.15.40:6832/2675320429 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ae8499300 0x558ae8542500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 --2- 172.21.15.27:0/1111538632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ae84dd560 0x558ae84e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 >> 172.21.15.27:0/1111538632 conn(0x558ae8255e40 msgr2=0x558ae8495730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 shutdown_connections 2023-05-17T15:10:31.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.899+0000 7f1441810b80 1 -- 172.21.15.27:0/1111538632 wait complete. 2023-05-17T15:10:31.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f1441810b80 20 client.7746 trim_cache size 0 max 16384 2023-05-17T15:10:31.913 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 7581, 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:10:31.914 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 10.23322654, 2023-05-17T15:10:31.915 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 52, 2023-05-17T15:10:31.915 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 126, 2023-05-17T15:10:31.915 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 126, 2023-05-17T15:10:31.915 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 15.738175542 2023-05-17T15:10:31.915 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:10:31.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f141405ed90 msgr2=0x7f1414061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f141405ed90 0x7f1414061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1420009130 tx=0x7f1420017000).stop 2023-05-17T15:10:31.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 msgr2=0x7f14280c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 0x7f14280c4190 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f141c00c880 tx=0x7f141c008040).stop 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 shutdown_connections 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f141405ed90 0x7f1414061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1428154090 0x7f1428144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1428068f00 0x7f1428155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 --2- 172.21.15.27:0/2363074452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14280cb450 0x7f14280c4190 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:31.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 >> 172.21.15.27:0/2363074452 conn(0x7f142805e7e0 msgr2=0x7f14280a9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:31.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 shutdown_connections 2023-05-17T15:10:31.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:31.900+0000 7f142fe7e700 1 -- 172.21.15.27:0/2363074452 wait complete. 2023-05-17T15:10:31.918 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:10:32.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.017+0000 7f31eb33b700 1 Processor -- start 2023-05-17T15:10:32.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.017+0000 7f31eb33b700 1 -- start start 2023-05-17T15:10:32.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31eb33b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31e4152bc0 0x7f31e40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:32.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31eb33b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f31e40a79e0 0x7f31e40a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:32.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31eb33b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e40c6400 con 0x7f31e414fb50 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31eb33b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e40c5a80 con 0x7f31e40a79e0 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31eb33b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e414ff30 con 0x7f31e4152bc0 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31e98d8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f31e40a79e0 0x7f31e40a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31e98d8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f31e40a79e0 0x7f31e40a7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42604/0 (socket says 172.21.15.27:42604) 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.018+0000 7f31e98d8700 1 -- 172.21.15.27:0/3688330755 learned_addr learned my addr 172.21.15.27:0/3688330755 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e88d6700 1 --2- 172.21.15.27:0/3688330755 >> v2:172.21.15.40:3300/0 conn(0x7f31e4152bc0 0x7f31e40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:32.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e98d8700 1 -- 172.21.15.27:0/3688330755 >> v2:172.21.15.40:3300/0 conn(0x7f31e4152bc0 msgr2=0x7f31e40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:32.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e98d8700 1 --2- 172.21.15.27:0/3688330755 >> v2:172.21.15.40:3300/0 conn(0x7f31e4152bc0 0x7f31e40c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e98d8700 1 -- 172.21.15.27:0/3688330755 >> v1:172.21.15.40:6789/0 conn(0x7f31e414fb50 legacy=0x7f31e41524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:32.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e98d8700 1 -- 172.21.15.27:0/3688330755 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40a8300 con 0x7f31e40a79e0 2023-05-17T15:10:32.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e88d6700 1 --2- 172.21.15.27:0/3688330755 >> v2:172.21.15.40:3300/0 conn(0x7f31e4152bc0 0x7f31e40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:32.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e98d8700 1 --2- 172.21.15.27:0/3688330755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e40a79e0 0x7f31e40a7e10 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f31e40aec30 tx=0x7f31d4009840).ready entity=mon.0 client_cookie=184b11476f8aefbd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:32.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e3fff700 1 -- 172.21.15.27:0/3688330755 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400e070 con 0x7f31e40a79e0 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e3fff700 1 -- 172.21.15.27:0/3688330755 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400ba10 con 0x7f31e40a79e0 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31e3fff700 1 -- 172.21.15.27:0/3688330755 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400bd90 con 0x7f31e40a79e0 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 -- 172.21.15.27:0/3688330755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e40a79e0 msgr2=0x7f31e40a7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3688330755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e40a79e0 0x7f31e40a7e10 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f31e40aec30 tx=0x7f31d4009840).stop 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 -- 172.21.15.27:0/3688330755 shutdown_connections 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3688330755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e40a79e0 0x7f31e40a7e10 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.026 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3688330755 >> v2:172.21.15.40:3300/0 conn(0x7f31e4152bc0 0x7f31e40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 -- 172.21.15.27:0/3688330755 >> 172.21.15.27:0/3688330755 conn(0x7f31e4092090 msgr2=0x7f31e4062ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:32.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 -- 172.21.15.27:0/3688330755 shutdown_connections 2023-05-17T15:10:32.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.019+0000 7f31eb33b700 1 -- 172.21.15.27:0/3688330755 wait complete. 2023-05-17T15:10:32.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 Processor -- start 2023-05-17T15:10:32.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 -- start start 2023-05-17T15:10:32.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31e40a79e0 0x7f31e4149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31e414fb50 0x7f31e40a8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 0x7f31e40a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40a8f00 con 0x7f31e4152bc0 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e414d4a0 con 0x7f31e40a79e0 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.021+0000 7f31eb33b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4152010 con 0x7f31e414fb50 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 0x7f31e40a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:32.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 0x7f31e40a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42612/0 (socket says 172.21.15.27:42612) 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 -- 172.21.15.27:0/3111236920 learned_addr learned my addr 172.21.15.27:0/3111236920 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e90d7700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31e40a79e0 0x7f31e4149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e88d6700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31e414fb50 0x7f31e40a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 -- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31e414fb50 msgr2=0x7f31e40a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31e414fb50 0x7f31e40a8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 -- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31e40a79e0 msgr2=0x7f31e4149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:32.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31e40a79e0 0x7f31e4149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 -- 172.21.15.27:0/3111236920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4009ae0 con 0x7f31e4152bc0 2023-05-17T15:10:32.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e90d7700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31e40a79e0 0x7f31e4149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:32.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e98d8700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 0x7f31e40a8a10 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f31d4009540 tx=0x7f31d4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:32.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d401d410 con 0x7f31e4152bc0 2023-05-17T15:10:32.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d401d570 con 0x7f31e4152bc0 2023-05-17T15:10:32.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e414cb70 con 0x7f31e4152bc0 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d401d910 con 0x7f31e4152bc0 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.022+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e414d130 con 0x7f31e4152bc0 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.023+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e4068740 con 0x7f31e4152bc0 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.023+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f31d401b040 con 0x7f31e4152bc0 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.024+0000 7f31e17fa700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f31d005ed90 0x7f31d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.024+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f31d407b680 con 0x7f31e4152bc0 2023-05-17T15:10:32.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.024+0000 7f31e90d7700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f31d005ed90 0x7f31d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:32.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.024+0000 7f31e90d7700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f31d005ed90 0x7f31d0061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f31dc00b910 tx=0x7f31dc008040).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:32.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.028+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31d404cbc0 con 0x7f31e4152bc0 2023-05-17T15:10:32.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.250+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31e40c6400 con 0x7f31e4152bc0 2023-05-17T15:10:32.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.250+0000 7f31e17fa700 1 -- 172.21.15.27:0/3111236920 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31e40c6400 con 0x7f31e4152bc0 2023-05-17T15:10:32.254 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:10:32.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f31d005ed90 msgr2=0x7f31d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:32.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f31d005ed90 0x7f31d0061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f31dc00b910 tx=0x7f31dc008040).stop 2023-05-17T15:10:32.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 msgr2=0x7f31e40a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:32.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 0x7f31e40a8a10 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f31d4009540 tx=0x7f31d4009840).stop 2023-05-17T15:10:32.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 shutdown_connections 2023-05-17T15:10:32.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f31d005ed90 0x7f31d0061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31e4152bc0 0x7f31e40a8a10 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31e40a79e0 0x7f31e4149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 --2- 172.21.15.27:0/3111236920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31e414fb50 0x7f31e40a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:32.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 >> 172.21.15.27:0/3111236920 conn(0x7f31e4092090 msgr2=0x7f31e4065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:32.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 shutdown_connections 2023-05-17T15:10:32.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:32.252+0000 7f31eb33b700 1 -- 172.21.15.27:0/3111236920 wait complete. 2023-05-17T15:10:32.267 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:10:32.267 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:10:32.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:10:32.268 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:10:32.269 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:10:32.269 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:10:32.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:10:32.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:10:32.271 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:10:32.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.272 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:10:32.288 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:10:32.288 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:10:32.288 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:10:32.288 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:10:32.289 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:10:32.290 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 41280sec preferred_lft 41280sec 2023-05-17T15:10:32.290 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:10:32.290 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.290 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:10:32.290 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:10:32.290 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:10:32.291 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:10:32.292 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:10:32.293 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:10:32.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.293 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:10:32.353 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:10:32.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.354 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:10:32.410 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:10:32.410 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:10:32.410 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:10:32.411 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:10:32.411 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:10:32.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.412 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:10:32.412 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:10:32.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:10:32.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:10:32.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:10:32.413 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:10:32.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.511 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:10:32.525 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:10:32.526 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:10:32.526 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:10:32.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.527 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:10:32.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.591 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:10:32.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:32.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:32.645 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:10:32.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:10:32.761 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:10:32.761 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:10:32.804 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:10:32.804 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:10:32.806 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:10:32.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:32.807 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:10:32.873 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:10:33.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.029+0000 7f378dee1700 1 Processor -- start 2023-05-17T15:10:33.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.029+0000 7f378dee1700 1 -- start start 2023-05-17T15:10:33.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f378dee1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f37880c2930 0x7f37880c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f378dee1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37880699b0 0x7f37880673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f378dee1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3788155030 con 0x7f3788066f50 2023-05-17T15:10:33.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f378dee1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3788154180 con 0x7f37880c2930 2023-05-17T15:10:33.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f378dee1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3788154420 con 0x7f37880699b0 2023-05-17T15:10:33.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f37877fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f37880c2930 0x7f37880c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f37877fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f37880c2930 0x7f37880c2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42622/0 (socket says 172.21.15.27:42622) 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f37877fe700 1 -- 172.21.15.27:0/457090088 learned_addr learned my addr 172.21.15.27:0/457090088 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f3787fff700 1 --2- 172.21.15.27:0/457090088 >> v2:172.21.15.40:3300/0 conn(0x7f37880699b0 0x7f37880673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f37877fe700 1 -- 172.21.15.27:0/457090088 >> v2:172.21.15.40:3300/0 conn(0x7f37880699b0 msgr2=0x7f37880673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f37877fe700 1 --2- 172.21.15.27:0/457090088 >> v2:172.21.15.40:3300/0 conn(0x7f37880699b0 0x7f37880673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.030+0000 7f37877fe700 1 -- 172.21.15.27:0/457090088 >> v1:172.21.15.40:6789/0 conn(0x7f3788066f50 legacy=0x7f37880692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:33.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f37877fe700 1 -- 172.21.15.27:0/457090088 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788154700 con 0x7f37880c2930 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f37877fe700 1 --2- 172.21.15.27:0/457090088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880c2930 0x7f37880c2d10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f37880acac0 tx=0x7f37700090f0).ready entity=mon.0 client_cookie=b746a97aa329b7be server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f37867fc700 1 -- 172.21.15.27:0/457090088 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000b5a0 con 0x7f37880c2930 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f37867fc700 1 -- 172.21.15.27:0/457090088 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000b700 con 0x7f37880c2930 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f37867fc700 1 -- 172.21.15.27:0/457090088 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000baa0 con 0x7f37880c2930 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 -- 172.21.15.27:0/457090088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880c2930 msgr2=0x7f37880c2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 --2- 172.21.15.27:0/457090088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880c2930 0x7f37880c2d10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f37880acac0 tx=0x7f37700090f0).stop 2023-05-17T15:10:33.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 -- 172.21.15.27:0/457090088 shutdown_connections 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 --2- 172.21.15.27:0/457090088 >> v2:172.21.15.40:3300/0 conn(0x7f37880699b0 0x7f37880673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 --2- 172.21.15.27:0/457090088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880c2930 0x7f37880c2d10 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 -- 172.21.15.27:0/457090088 >> 172.21.15.27:0/457090088 conn(0x7f378805e7e0 msgr2=0x7f37880c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 -- 172.21.15.27:0/457090088 shutdown_connections 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.031+0000 7f378dee1700 1 -- 172.21.15.27:0/457090088 wait complete. 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 Processor -- start 2023-05-17T15:10:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 -- start start 2023-05-17T15:10:33.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3788066f50 0x7f37880bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 0x7f3788165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37880c2930 0x7f37880a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880bde00 con 0x7f37880699b0 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880bec20 con 0x7f3788066f50 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.033+0000 7f378dee1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788165930 con 0x7f37880c2930 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 0x7f3788165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 0x7f3788165440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42630/0 (socket says 172.21.15.27:42630) 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 -- 172.21.15.27:0/3659710392 learned_addr learned my addr 172.21.15.27:0/3659710392 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f37877fe700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3788066f50 0x7f37880bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3787fff700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37880c2930 0x7f37880a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 -- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37880c2930 msgr2=0x7f37880a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37880c2930 0x7f37880a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 -- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3788066f50 msgr2=0x7f37880bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3788066f50 0x7f37880bd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 -- 172.21.15.27:0/3659710392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009370 con 0x7f37880699b0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f3786ffd700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 0x7f3788165440 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f377800c440 tx=0x7f3778007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800f470 con 0x7f37880699b0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800f5f0 con 0x7f37880699b0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800f9b0 con 0x7f37880699b0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37880be010 con 0x7f37880699b0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.034+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37880be5d0 con 0x7f37880699b0 2023-05-17T15:10:33.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.035+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378806a970 con 0x7f37880699b0 2023-05-17T15:10:33.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.036+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3778019030 con 0x7f37880699b0 2023-05-17T15:10:33.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.037+0000 7f377f7fe700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f376805ed90 0x7f3768061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.037+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f3778078f40 con 0x7f37880699b0 2023-05-17T15:10:33.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.037+0000 7f37877fe700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f376805ed90 0x7f3768061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.037+0000 7f37877fe700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f376805ed90 0x7f3768061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3770009130 tx=0x7f3770015000).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.041+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37780488f0 con 0x7f37880699b0 2023-05-17T15:10:33.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.243+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3788154a80 con 0x7f376805ed90 2023-05-17T15:10:33.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.245+0000 7f377f7fe700 1 -- 172.21.15.27:0/3659710392 <== mgr.7389 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3770000c50 con 0x7f376805ed90 2023-05-17T15:10:33.253 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:10:33.254 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:33.254 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:10:33.254 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:33.254 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:10:33.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f376805ed90 msgr2=0x7f3768061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f376805ed90 0x7f3768061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3770009130 tx=0x7f3770015000).stop 2023-05-17T15:10:33.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 msgr2=0x7f3788165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 0x7f3788165440 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f377800c440 tx=0x7f3778007de0).stop 2023-05-17T15:10:33.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 shutdown_connections 2023-05-17T15:10:33.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f376805ed90 0x7f3768061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37880c2930 0x7f37880a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3788066f50 0x7f37880bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 --2- 172.21.15.27:0/3659710392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37880699b0 0x7f3788165440 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 >> 172.21.15.27:0/3659710392 conn(0x7f378805e7e0 msgr2=0x7f37880c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:33.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 shutdown_connections 2023-05-17T15:10:33.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.247+0000 7f378dee1700 1 -- 172.21.15.27:0/3659710392 wait complete. 2023-05-17T15:10:33.263 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:10:33.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.381+0000 7f47a14ca700 1 Processor -- start 2023-05-17T15:10:33.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.381+0000 7f47a14ca700 1 -- start start 2023-05-17T15:10:33.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f47a14ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0c6310 0x7f479c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f47a14ca700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c158790 con 0x7f479c1543d0 2023-05-17T15:10:33.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f47a14ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c157e60 con 0x7f479c0691f0 2023-05-17T15:10:33.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f47a14ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0c1c50 con 0x7f479c0c6310 2023-05-17T15:10:33.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f479affd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f479c1543d0 0x7f479c0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42200/0 (socket says 172.21.15.27:42200) 2023-05-17T15:10:33.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f479affd700 1 -- 172.21.15.27:0/3859472020 learned_addr learned my addr 172.21.15.27:0/3859472020 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.382+0000 7f479a7fc700 1 --2- 172.21.15.27:0/3859472020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0c6310 0x7f479c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866265302 0 0) 0x7f479c158790 con 0x7f479c1543d0 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47840033f0 con 0x7f479c1543d0 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725008585 0 0) 0x7f479c157e60 con 0x7f479c0691f0 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c158790 con 0x7f479c0691f0 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f479a7fc700 1 -- 172.21.15.27:0/3859472020 >> v1:172.21.15.40:6789/0 conn(0x7f479c0691f0 legacy=0x7f479c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f479a7fc700 1 -- 172.21.15.27:0/3859472020 >> v1:172.21.15.27:6789/0 conn(0x7f479c1543d0 legacy=0x7f479c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548033888 0 0) 0x7f47840033f0 con 0x7f479c1543d0 2023-05-17T15:10:33.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f479a7fc700 1 -- 172.21.15.27:0/3859472020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c158140 con 0x7f479c0c6310 2023-05-17T15:10:33.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f479a7fc700 1 --2- 172.21.15.27:0/3859472020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0c6310 0x7f479c068d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4790009790 tx=0x7f4790009060).ready entity=mon.2 client_cookie=608e4ca7ba5d8a34 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000f510 con 0x7f479c0c6310 2023-05-17T15:10:33.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479000f670 con 0x7f479c0c6310 2023-05-17T15:10:33.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.383+0000 7f4799ffb700 1 -- 172.21.15.27:0/3859472020 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000f9f0 con 0x7f479c0c6310 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 -- 172.21.15.27:0/3859472020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0c6310 msgr2=0x7f479c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3859472020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0c6310 0x7f479c068d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4790009790 tx=0x7f4790009060).stop 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 -- 172.21.15.27:0/3859472020 shutdown_connections 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3859472020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0c6310 0x7f479c068d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 -- 172.21.15.27:0/3859472020 >> 172.21.15.27:0/3859472020 conn(0x7f479c0cb7f0 msgr2=0x7f479c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 -- 172.21.15.27:0/3859472020 shutdown_connections 2023-05-17T15:10:33.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.384+0000 7f47a14ca700 1 -- 172.21.15.27:0/3859472020 wait complete. 2023-05-17T15:10:33.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.386+0000 7f47a14ca700 1 Processor -- start 2023-05-17T15:10:33.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.386+0000 7f47a14ca700 1 -- start start 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.387+0000 7f47a14ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0691f0 0x7f479c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.387+0000 7f47a14ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f479c0c6310 0x7f479c0c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.387+0000 7f47a14ca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 0x7f479c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.387+0000 7f47a14ca700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0c30f0 con 0x7f479c1543d0 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.387+0000 7f47a14ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c1649e0 con 0x7f479c0c6310 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.387+0000 7f47a14ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0afc70 con 0x7f479c0691f0 2023-05-17T15:10:33.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 0x7f479c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 0x7f479c152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42646/0 (socket says 172.21.15.27:42646) 2023-05-17T15:10:33.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 -- 172.21.15.27:0/3375323460 learned_addr learned my addr 172.21.15.27:0/3375323460 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:33.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479a7fc700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f479c0c6310 0x7f479c0c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479affd700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0691f0 0x7f479c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 -- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0691f0 msgr2=0x7f479c0af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0691f0 0x7f479c0af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 -- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f479c0c6310 msgr2=0x7f479c0c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f479c0c6310 0x7f479c0c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 -- 172.21.15.27:0/3375323460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900092a0 con 0x7f479c1543d0 2023-05-17T15:10:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479a7fc700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f479c0c6310 0x7f479c0c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f479b7fe700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 0x7f479c152d40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f479400c710 tx=0x7f479400cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794010510 con 0x7f479c1543d0 2023-05-17T15:10:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794010670 con 0x7f479c1543d0 2023-05-17T15:10:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0aff50 con 0x7f479c1543d0 2023-05-17T15:10:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940109f0 con 0x7f479c1543d0 2023-05-17T15:10:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.388+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c0b0510 con 0x7f479c1543d0 2023-05-17T15:10:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.389+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c06bdf0 con 0x7f479c1543d0 2023-05-17T15:10:33.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.390+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4794010070 con 0x7f479c1543d0 2023-05-17T15:10:33.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.391+0000 7f4782ffd700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f478805ed90 0x7f4788061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.391+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f479407a480 con 0x7f479c1543d0 2023-05-17T15:10:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.391+0000 7f479affd700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f478805ed90 0x7f4788061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.391+0000 7f479affd700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f478805ed90 0x7f4788061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f479c0c0df0 tx=0x7f478c007160).ready entity=mgr.7389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.395+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f479404b8d0 con 0x7f479c1543d0 2023-05-17T15:10:33.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.616+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f479c158420 con 0x7f479c1543d0 2023-05-17T15:10:33.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.815+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 48) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f4794078290 con 0x7f479c1543d0 2023-05-17T15:10:33.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.816+0000 7f4782ffd700 1 -- 172.21.15.27:0/3375323460 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v48) v1 ==== 92+0+0 (secure 0 0 0) 0x7f4794074bf0 con 0x7f479c1543d0 2023-05-17T15:10:33.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f478805ed90 msgr2=0x7f4788061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f478805ed90 0x7f4788061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f479c0c0df0 tx=0x7f478c007160).stop 2023-05-17T15:10:33.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 msgr2=0x7f479c152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 0x7f479c152d40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f479400c710 tx=0x7f479400cad0).stop 2023-05-17T15:10:33.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 shutdown_connections 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f478805ed90 0x7f4788061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f479c1543d0 0x7f479c152d40 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f479c0691f0 0x7f479c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.818+0000 7f47a14ca700 1 --2- 172.21.15.27:0/3375323460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f479c0c6310 0x7f479c0c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.819+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 >> 172.21.15.27:0/3375323460 conn(0x7f479c0cb7f0 msgr2=0x7f479c0c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.819+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 shutdown_connections 2023-05-17T15:10:33.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.819+0000 7f47a14ca700 1 -- 172.21.15.27:0/3375323460 wait complete. 2023-05-17T15:10:33.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:10:33.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.959+0000 7f9e8f63b700 1 Processor -- start 2023-05-17T15:10:33.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.959+0000 7f9e8f63b700 1 -- start start 2023-05-17T15:10:33.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8f63b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9e880a9890 0x7f9e880a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8f63b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e880bc830 0x7f9e880bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8f63b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e880c5200 con 0x7f9e88063340 2023-05-17T15:10:33.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8f63b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e880bd170 con 0x7f9e880a9890 2023-05-17T15:10:33.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8f63b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e880637d0 con 0x7f9e880bc830 2023-05-17T15:10:33.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9e880a9890 0x7f9e880a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9e880a9890 0x7f9e880a9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42676/0 (socket says 172.21.15.27:42676) 2023-05-17T15:10:33.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/579422132 learned_addr learned my addr 172.21.15.27:0/579422132 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:33.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8dbd8700 1 --2- 172.21.15.27:0/579422132 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e880bc830 0x7f9e880bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e7ffff700 1 -- 172.21.15.27:0/579422132 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871621619 0 0) 0x7f9e880c5200 con 0x7f9e88063340 2023-05-17T15:10:33.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e7ffff700 1 -- 172.21.15.27:0/579422132 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e740033f0 con 0x7f9e88063340 2023-05-17T15:10:33.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/579422132 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e880bc830 msgr2=0x7f9e880bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:33.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 --2- 172.21.15.27:0/579422132 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e880bc830 0x7f9e880bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/579422132 >> v1:172.21.15.40:6789/0 conn(0x7f9e88063340 legacy=0x7f9e88151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.960+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/579422132 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e880c2000 con 0x7f9e880a9890 2023-05-17T15:10:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8d3d7700 1 --2- 172.21.15.27:0/579422132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e880a9c70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f9e84006fd0 tx=0x7f9e8400b3b0).ready entity=mon.0 client_cookie=e9295fb991f5596c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e7ffff700 1 -- 172.21.15.27:0/579422132 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400da70 con 0x7f9e880a9890 2023-05-17T15:10:33.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e7ffff700 1 -- 172.21.15.27:0/579422132 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400dbd0 con 0x7f9e880a9890 2023-05-17T15:10:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e7ffff700 1 -- 172.21.15.27:0/579422132 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84010470 con 0x7f9e880a9890 2023-05-17T15:10:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8f63b700 1 -- 172.21.15.27:0/579422132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 msgr2=0x7f9e880a9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/579422132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e880a9c70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f9e84006fd0 tx=0x7f9e8400b3b0).stop 2023-05-17T15:10:33.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8f63b700 1 -- 172.21.15.27:0/579422132 shutdown_connections 2023-05-17T15:10:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/579422132 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e880bc830 0x7f9e880bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/579422132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e880a9c70 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.961+0000 7f9e8f63b700 1 -- 172.21.15.27:0/579422132 >> 172.21.15.27:0/579422132 conn(0x7f9e880c83a0 msgr2=0x7f9e880c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.962+0000 7f9e8f63b700 1 -- 172.21.15.27:0/579422132 shutdown_connections 2023-05-17T15:10:33.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.962+0000 7f9e8f63b700 1 -- 172.21.15.27:0/579422132 wait complete. 2023-05-17T15:10:33.974 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:33.961+0000 7f3b689e0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:10:33.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.963+0000 7f9e8f63b700 1 Processor -- start 2023-05-17T15:10:33.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.963+0000 7f9e8f63b700 1 -- start start 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8f63b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e8814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8f63b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e880bc830 0x7f9e880c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8f63b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e8814e860 0x7f9e880c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8f63b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8814f8f0 con 0x7f9e880a9890 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8f63b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8814fd80 con 0x7f9e880bc830 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8f63b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8814ece0 con 0x7f9e8814e860 2023-05-17T15:10:33.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e8814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e8814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42682/0 (socket says 172.21.15.27:42682) 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/2010785959 learned_addr learned my addr 172.21.15.27:0/2010785959 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8dbd8700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e8814e860 0x7f9e880c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8cbd6700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e880bc830 0x7f9e880c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e8814e860 msgr2=0x7f9e880c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e8814e860 0x7f9e880c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e880bc830 msgr2=0x7f9e880c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e880bc830 0x7f9e880c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 -- 172.21.15.27:0/2010785959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8400b610 con 0x7f9e880a9890 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.964+0000 7f9e8d3d7700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e8814e370 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f9e88066300 tx=0x7f9e88151370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.965+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84020070 con 0x7f9e880a9890 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.965+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84019450 con 0x7f9e880a9890 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.965+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8814efc0 con 0x7f9e880a9890 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.965+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840197f0 con 0x7f9e880a9890 2023-05-17T15:10:33.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.965+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8814f580 con 0x7f9e880a9890 2023-05-17T15:10:33.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.966+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8814fbd0 con 0x7f9e880a9890 2023-05-17T15:10:33.980 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:33.966+0000 7f1545ab7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:10:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.966+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 48) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f9e8402c070 con 0x7f9e880a9890 2023-05-17T15:10:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.967+0000 7f9e7d7fa700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9e6c05ede0 0x7f9e6c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.967+0000 7f9e8cbd6700 1 -- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9e6c05ede0 msgr2=0x7f9e6c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.967+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f9e8407d2f0 con 0x7f9e880a9890 2023-05-17T15:10:33.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.967+0000 7f9e8cbd6700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9e6c05ede0 0x7f9e6c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:33.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:33.971+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e8404e830 con 0x7f9e880a9890 2023-05-17T15:10:34.031 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:34.027+0000 7f3b689e0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:10:34.038 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:34.034+0000 7f1545ab7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:10:34.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.149+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f9e8806bdf0 con 0x7f9e880a9890 2023-05-17T15:10:34.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.152+0000 7f9e7d7fa700 1 -- 172.21.15.27:0/2010785959 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9e84051e50 con 0x7f9e880a9890 2023-05-17T15:10:34.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9e6c05ede0 msgr2=0x7f9e6c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:34.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9e6c05ede0 0x7f9e6c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:34.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 msgr2=0x7f9e8814e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:34.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e8814e370 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f9e88066300 tx=0x7f9e88151370).stop 2023-05-17T15:10:34.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 shutdown_connections 2023-05-17T15:10:34.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9e6c05ede0 0x7f9e6c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:34.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e8814e860 0x7f9e880c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:34.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e880a9890 0x7f9e8814e370 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:34.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 --2- 172.21.15.27:0/2010785959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e880bc830 0x7f9e880c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:34.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.155+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 >> 172.21.15.27:0/2010785959 conn(0x7f9e880c83a0 msgr2=0x7f9e880c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:34.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.156+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 shutdown_connections 2023-05-17T15:10:34.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.156+0000 7f9e8f63b700 1 -- 172.21.15.27:0/2010785959 wait complete. 2023-05-17T15:10:34.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:34.179 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:10:34.212 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-05-17T15:10:34.317 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:34.313+0000 7f3b689e0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:10:34.341 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:34.337+0000 7f1545ab7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:10:34.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.375+0000 7faee8fdd700 1 Processor -- start 2023-05-17T15:10:34.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.375+0000 7faee8fdd700 1 -- start start 2023-05-17T15:10:34.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee8fdd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faee40be1a0 0x7faee405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:34.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee8fdd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee405e6b0 con 0x7faee405e240 2023-05-17T15:10:34.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee8fdd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40bc6d0 con 0x7faee4151d60 2023-05-17T15:10:34.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee8fdd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40c2010 con 0x7faee40be1a0 2023-05-17T15:10:34.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee3fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faee405e240 0x7faee415b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42284/0 (socket says 172.21.15.27:42284) 2023-05-17T15:10:34.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee3fff700 1 -- 172.21.15.27:0/502006744 learned_addr learned my addr 172.21.15.27:0/502006744 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:34.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee2ffd700 1 --2- 172.21.15.27:0/502006744 >> v2:172.21.15.40:3300/0 conn(0x7faee40be1a0 0x7faee405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:34.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee27fc700 1 -- 172.21.15.27:0/502006744 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909292221 0 0) 0x7faee405e6b0 con 0x7faee405e240 2023-05-17T15:10:34.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee27fc700 1 -- 172.21.15.27:0/502006744 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc0033f0 con 0x7faee405e240 2023-05-17T15:10:34.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee2ffd700 1 -- 172.21.15.27:0/502006744 >> v1:172.21.15.40:6789/0 conn(0x7faee4151d60 legacy=0x7faee40a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:34.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee27fc700 1 -- 172.21.15.27:0/502006744 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115102496 0 0) 0x7faee40bc6d0 con 0x7faee4151d60 2023-05-17T15:10:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee2ffd700 1 -- 172.21.15.27:0/502006744 >> v1:172.21.15.27:6789/0 conn(0x7faee405e240 legacy=0x7faee415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.376+0000 7faee2ffd700 1 -- 172.21.15.27:0/502006744 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40c81f0 con 0x7faee40be1a0 2023-05-17T15:10:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee2ffd700 1 --2- 172.21.15.27:0/502006744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee40be1a0 0x7faee405dd50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7faed8009760 tx=0x7faed8009060).ready entity=mon.1 client_cookie=eeab9779cc20fe38 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee27fc700 1 -- 172.21.15.27:0/502006744 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800f510 con 0x7faee40be1a0 2023-05-17T15:10:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee27fc700 1 -- 172.21.15.27:0/502006744 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800f670 con 0x7faee40be1a0 2023-05-17T15:10:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee27fc700 1 -- 172.21.15.27:0/502006744 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800f9f0 con 0x7faee40be1a0 2023-05-17T15:10:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 -- 172.21.15.27:0/502006744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee40be1a0 msgr2=0x7faee405dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 --2- 172.21.15.27:0/502006744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee40be1a0 0x7faee405dd50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7faed8009760 tx=0x7faed8009060).stop 2023-05-17T15:10:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 -- 172.21.15.27:0/502006744 shutdown_connections 2023-05-17T15:10:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 --2- 172.21.15.27:0/502006744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee40be1a0 0x7faee405dd50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 -- 172.21.15.27:0/502006744 >> 172.21.15.27:0/502006744 conn(0x7faee4068720 msgr2=0x7faee40c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 -- 172.21.15.27:0/502006744 shutdown_connections 2023-05-17T15:10:34.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.377+0000 7faee8fdd700 1 -- 172.21.15.27:0/502006744 wait complete. 2023-05-17T15:10:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 Processor -- start 2023-05-17T15:10:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 -- start start 2023-05-17T15:10:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee405e240 0x7faee4168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faee40be1a0 0x7faee414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:34.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 0x7faee40c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:34.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40a4620 con 0x7faee4151d60 2023-05-17T15:10:34.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee414bcc0 con 0x7faee405e240 2023-05-17T15:10:34.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.379+0000 7faee8fdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40c63b0 con 0x7faee40be1a0 2023-05-17T15:10:34.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 0x7faee40c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:34.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee405e240 0x7faee4168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 0x7faee40c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42728/0 (socket says 172.21.15.27:42728) 2023-05-17T15:10:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faee40be1a0 0x7faee414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 -- 172.21.15.27:0/3696528839 learned_addr learned my addr 172.21.15.27:0/3696528839 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faee40be1a0 msgr2=0x7faee414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faee40be1a0 0x7faee414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee405e240 msgr2=0x7faee4168600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee405e240 0x7faee4168600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 -- 172.21.15.27:0/3696528839 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80092a0 con 0x7faee4151d60 2023-05-17T15:10:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee405e240 0x7faee4168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee3fff700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 0x7faee40c7820 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7faedc005ad0 tx=0x7faedc001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc005d30 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc005e90 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc007320 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee40c7d10 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.380+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee40c60d0 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.382+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4069e20 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.382+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 48) v1 ==== 75259+0+0 (secure 0 0 0) 0x7faedc010030 con 0x7faee4151d60 2023-05-17T15:10:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.383+0000 7faecb7fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:34.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.383+0000 7faee37fe700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:34.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.383+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6221+0+0 (secure 0 0 0) 0x7faedc079a30 con 0x7faee4151d60 2023-05-17T15:10:34.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.383+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:34.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.387+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faedc04b020 con 0x7faee4151d60 2023-05-17T15:10:34.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.584+0000 7faee37fe700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:34.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.584+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:34.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.586+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7faee40c7ea0 con 0x7faed005ede0 2023-05-17T15:10:34.978 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:34.974+0000 7f3b689e0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:10:34.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.985+0000 7faee37fe700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:34.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:34.985+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:10:35.013 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:35.007+0000 7f1545ab7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:10:35.046 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:35.042+0000 7f3b689e0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:10:35.082 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:35.078+0000 7f1545ab7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:10:35.238 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:35.234+0000 7f3b689e0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:10:35.274 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:35.270+0000 7f1545ab7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:10:35.674 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:35.670+0000 7f3b689e0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:10:35.708 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:35.705+0000 7f1545ab7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:10:35.782 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:35.778+0000 7f3b689e0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:35.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:35.786+0000 7faee37fe700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:35.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:35.786+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:10:35.816 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:35.812+0000 7f1545ab7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:35.940 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:35.936+0000 7f3b689e0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:35.974 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:35.970+0000 7f1545ab7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:36.017 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:36.014+0000 7f3b689e0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:10:36.050 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:36.047+0000 7f1545ab7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:10:36.087 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:36.083+0000 7f3b689e0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:10:36.120 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:36.116+0000 7f1545ab7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:10:36.357 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:36.354+0000 7f3b689e0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:10:36.390 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:36.386+0000 7f1545ab7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:10:36.550 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:36.547+0000 7f3b689e0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:36.579 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:36.575+0000 7f1545ab7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:37.228 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.225+0000 7f3b689e0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:10:37.257 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.254+0000 7f1545ab7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:10:37.300 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.297+0000 7f3b689e0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:10:37.330 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.327+0000 7f1545ab7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:10:37.378 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.374+0000 7f3b689e0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:10:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:37.387+0000 7faee37fe700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:37.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:37.387+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:10:37.408 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.404+0000 7f1545ab7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:10:37.529 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.525+0000 7f3b689e0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:10:37.559 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.555+0000 7f1545ab7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:10:37.601 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.597+0000 7f3b689e0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:10:37.631 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.628+0000 7f1545ab7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:10:37.723 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.719+0000 7f3b689e0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:10:37.753 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.749+0000 7f1545ab7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:10:37.835 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:37.832+0000 7f3b689e0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:37.864 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:37.860+0000 7f1545ab7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:38.135 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:38.131+0000 7f3b689e0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:10:38.165 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.161+0000 7f1545ab7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:10:38.207 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:38.204+0000 7f3b689e0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:10:38.238 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.234+0000 7f1545ab7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:10:38.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:38.273+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 49) v1 ==== 75109+0+0 (secure 0 0 0) 0x7faedc0778d0 con 0x7faee4151d60 2023-05-17T15:10:38.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:38.273+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:38.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:38.273+0000 7faecb7fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:38.336 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c4299700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c1293700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c4299700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c1293700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c4299700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c1293700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c4299700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.337 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c1293700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.338 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c4299700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:38.338 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:38.332+0000 7f14c1293700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.285+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7faedc077c50 con 0x7faee4151d60 2023-05-17T15:10:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.286+0000 7faecb7fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.286+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7faee40c7ea0 con 0x7faed005ede0 2023-05-17T15:10:39.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.287+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.288+0000 7faee37fe700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed0061220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7faed4001430 tx=0x7faed4009040).ready entity=mgr.7770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.301+0000 7faecb7fe700 1 -- 172.21.15.27:0/3696528839 <== mgr.7770 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faee40c7ea0 con 0x7faed005ede0 2023-05-17T15:10:39.305 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path snap_test_dir1 2023-05-17T15:10:39.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 msgr2=0x7faed0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed0061220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7faed4001430 tx=0x7faed4009040).stop 2023-05-17T15:10:39.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 msgr2=0x7faee40c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 0x7faee40c7820 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7faedc005ad0 tx=0x7faedc001650).stop 2023-05-17T15:10:39.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 shutdown_connections 2023-05-17T15:10:39.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faed005ede0 0x7faed0061220 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faee4151d60 0x7faee40c7820 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faee405e240 0x7faee4168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 --2- 172.21.15.27:0/3696528839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faee40be1a0 0x7faee414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.303+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 >> 172.21.15.27:0/3696528839 conn(0x7faee4068720 msgr2=0x7faee40a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:39.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.304+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 shutdown_connections 2023-05-17T15:10:39.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.304+0000 7faee8fdd700 1 -- 172.21.15.27:0/3696528839 wait complete. 2023-05-17T15:10:39.321 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-17T15:10:39.322 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-17T15:10:39.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.443+0000 7f55ae6d1700 1 Processor -- start 2023-05-17T15:10:39.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.443+0000 7f55ae6d1700 1 -- start start 2023-05-17T15:10:39.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55ae6d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55a80a73b0 0x7f55a80a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55ae6d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 0x7f55a8066fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55ae6d1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a80a6310 con 0x7f55a80a5a40 2023-05-17T15:10:39.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55ae6d1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a8150aa0 con 0x7f55a80a73b0 2023-05-17T15:10:39.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55ae6d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8069450 con 0x7f55a8066b30 2023-05-17T15:10:39.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55acc6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 0x7f55a8066fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55a77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55a80a73b0 0x7f55a80a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55acc6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 0x7f55a8066fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:44012/0 (socket says 172.21.15.27:44012) 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55a7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f55a80a5a40 0x7f55a80c32b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:48464/0 (socket says 172.21.15.27:48464) 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.444+0000 7f55acc6e700 1 -- 172.21.15.27:0/1049207506 learned_addr learned my addr 172.21.15.27:0/1049207506 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55a6ffd700 1 -- 172.21.15.27:0/1049207506 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369583200 0 0) 0x7f55a80a6310 con 0x7f55a80a5a40 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55a6ffd700 1 -- 172.21.15.27:0/1049207506 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55900033f0 con 0x7f55a80a5a40 2023-05-17T15:10:39.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55acc6e700 1 -- 172.21.15.27:0/1049207506 >> v2:172.21.15.40:3300/0 conn(0x7f55a80a73b0 msgr2=0x7f55a80a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55acc6e700 1 --2- 172.21.15.27:0/1049207506 >> v2:172.21.15.40:3300/0 conn(0x7f55a80a73b0 0x7f55a80a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55acc6e700 1 -- 172.21.15.27:0/1049207506 >> v1:172.21.15.40:6789/0 conn(0x7f55a80a5a40 legacy=0x7f55a80c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55acc6e700 1 -- 172.21.15.27:0/1049207506 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8069fd0 con 0x7f55a8066b30 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55a77fe700 1 --2- 172.21.15.27:0/1049207506 >> v2:172.21.15.40:3300/0 conn(0x7f55a80a73b0 0x7f55a80a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55acc6e700 1 --2- 172.21.15.27:0/1049207506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 0x7f55a8066fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f55a0009f20 tx=0x7f55a0009840).ready entity=mon.2 client_cookie=aa4aef349213be8b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55a6ffd700 1 -- 172.21.15.27:0/1049207506 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000e070 con 0x7f55a8066b30 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55a6ffd700 1 -- 172.21.15.27:0/1049207506 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000b970 con 0x7f55a8066b30 2023-05-17T15:10:39.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.445+0000 7f55a6ffd700 1 -- 172.21.15.27:0/1049207506 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000bcf0 con 0x7f55a8066b30 2023-05-17T15:10:39.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 -- 172.21.15.27:0/1049207506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 msgr2=0x7f55a8066fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/1049207506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 0x7f55a8066fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f55a0009f20 tx=0x7f55a0009840).stop 2023-05-17T15:10:39.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 -- 172.21.15.27:0/1049207506 shutdown_connections 2023-05-17T15:10:39.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/1049207506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a8066b30 0x7f55a8066fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/1049207506 >> v2:172.21.15.40:3300/0 conn(0x7f55a80a73b0 0x7f55a80a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 -- 172.21.15.27:0/1049207506 >> 172.21.15.27:0/1049207506 conn(0x7f55a8062280 msgr2=0x7f55a8062690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 -- 172.21.15.27:0/1049207506 shutdown_connections 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.446+0000 7f55ae6d1700 1 -- 172.21.15.27:0/1049207506 wait complete. 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.447+0000 7f55ae6d1700 1 Processor -- start 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.447+0000 7f55ae6d1700 1 -- start start 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55a8066b30 0x7f55a8164900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a80a5a40 0x7f55a80aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 0x7f55a814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a81503a0 con 0x7f55a80a73b0 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8164df0 con 0x7f55a8066b30 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a81500c0 con 0x7f55a80a5a40 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 0x7f55a814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 0x7f55a814c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42910/0 (socket says 172.21.15.27:42910) 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 -- 172.21.15.27:0/2810881541 learned_addr learned my addr 172.21.15.27:0/2810881541 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:39.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55a7fff700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55a8066b30 0x7f55a8164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55a77fe700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a80a5a40 0x7f55a80aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 -- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a80a5a40 msgr2=0x7f55a80aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a80a5a40 0x7f55a80aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 -- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55a8066b30 msgr2=0x7f55a8164900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55a8066b30 0x7f55a8164900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 -- 172.21.15.27:0/2810881541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0092a0 con 0x7f55a80a73b0 2023-05-17T15:10:39.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55a77fe700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a80a5a40 0x7f55a80aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55acc6e700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 0x7f55a814c480 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f55a000b610 tx=0x7f55a0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000bee0 con 0x7f55a80a73b0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a00092e0 con 0x7f55a80a73b0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0009ae0 con 0x7f55a80a73b0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.448+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a001e6a0 con 0x7f55a80a73b0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.449+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a814bca0 con 0x7f55a80a73b0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.449+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a806bdf0 con 0x7f55a80a73b0 2023-05-17T15:10:39.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.450+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f55a0025030 con 0x7f55a80a73b0 2023-05-17T15:10:39.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.450+0000 7f558ffff700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f559405ed40 0x7f5594061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.450+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f55a007b2b0 con 0x7f55a80a73b0 2023-05-17T15:10:39.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.450+0000 7f55a7fff700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f559405ed40 0x7f5594061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.451+0000 7f55a7fff700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f559405ed40 0x7f5594061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f55980076d0 tx=0x7f5598007160).ready entity=mgr.7770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.455+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55a004c780 con 0x7f55a80a73b0 2023-05-17T15:10:39.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.652+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f55a80661b0 con 0x7f559405ed40 2023-05-17T15:10:39.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.656+0000 7f558ffff700 1 -- 172.21.15.27:0/2810881541 <== mgr.7770 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f55a80661b0 con 0x7f559405ed40 2023-05-17T15:10:39.660 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path snap_test_dir1 2023-05-17T15:10:39.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f559405ed40 msgr2=0x7f5594061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f559405ed40 0x7f5594061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f55980076d0 tx=0x7f5598007160).stop 2023-05-17T15:10:39.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 msgr2=0x7f55a814c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 0x7f55a814c480 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f55a000b610 tx=0x7f55a0009840).stop 2023-05-17T15:10:39.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 shutdown_connections 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f559405ed40 0x7f5594061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55a80a73b0 0x7f55a814c480 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55a8066b30 0x7f55a8164900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 --2- 172.21.15.27:0/2810881541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55a80a5a40 0x7f55a80aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 >> 172.21.15.27:0/2810881541 conn(0x7f55a8062280 msgr2=0x7f55a80c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 shutdown_connections 2023-05-17T15:10:39.663 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.658+0000 7f55ae6d1700 1 -- 172.21.15.27:0/2810881541 wait complete. 2023-05-17T15:10:39.674 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-17T15:10:39.674 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-05-17T15:10:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.791+0000 7fb849e15700 1 Processor -- start 2023-05-17T15:10:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.791+0000 7fb849e15700 1 -- start start 2023-05-17T15:10:39.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849e15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c1080 0x7fb8440c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849e15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb844154520 0x7fb8440c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849e15700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb844154a50 con 0x7fb8440c5d60 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849e15700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb844154d30 con 0x7fb844154520 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849e15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb844155010 con 0x7fb8440c1080 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849614700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb8440c5d60 0x7fb8440a99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42480/0 (socket says 172.21.15.27:42480) 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb849614700 1 -- 172.21.15.27:0/1431547100 learned_addr learned my addr 172.21.15.27:0/1431547100 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb848e13700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c1080 0x7fb8440c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb843fff700 1 --2- 172.21.15.27:0/1431547100 >> v2:172.21.15.40:3300/0 conn(0x7fb844154520 0x7fb8440c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb8437fe700 1 -- 172.21.15.27:0/1431547100 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496281938 0 0) 0x7fb844154a50 con 0x7fb8440c5d60 2023-05-17T15:10:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb8437fe700 1 -- 172.21.15.27:0/1431547100 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c0033f0 con 0x7fb8440c5d60 2023-05-17T15:10:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb843fff700 1 -- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c1080 msgr2=0x7fb8440c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb843fff700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c1080 0x7fb8440c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb8437fe700 1 -- 172.21.15.27:0/1431547100 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140276835 0 0) 0x7fb82c0033f0 con 0x7fb8440c5d60 2023-05-17T15:10:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb843fff700 1 -- 172.21.15.27:0/1431547100 >> v1:172.21.15.27:6789/0 conn(0x7fb8440c5d60 legacy=0x7fb8440a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb843fff700 1 -- 172.21.15.27:0/1431547100 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8441552f0 con 0x7fb844154520 2023-05-17T15:10:39.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.792+0000 7fb848e13700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c1080 0x7fb8440c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:39.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb843fff700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb844154520 0x7fb8440c02e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fb838009760 tx=0x7fb838009060).ready entity=mon.1 client_cookie=5046bc12e6b16f6f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb8437fe700 1 -- 172.21.15.27:0/1431547100 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834001470 con 0x7fb844154520 2023-05-17T15:10:39.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb8437fe700 1 -- 172.21.15.27:0/1431547100 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011400 con 0x7fb844154520 2023-05-17T15:10:39.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb8437fe700 1 -- 172.21.15.27:0/1431547100 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011780 con 0x7fb844154520 2023-05-17T15:10:39.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 -- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb844154520 msgr2=0x7fb8440c02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb844154520 0x7fb8440c02e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fb838009760 tx=0x7fb838009060).stop 2023-05-17T15:10:39.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 -- 172.21.15.27:0/1431547100 shutdown_connections 2023-05-17T15:10:39.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c1080 0x7fb8440c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 --2- 172.21.15.27:0/1431547100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb844154520 0x7fb8440c02e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 -- 172.21.15.27:0/1431547100 >> 172.21.15.27:0/1431547100 conn(0x7fb84405dd50 msgr2=0x7fb84405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:39.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 -- 172.21.15.27:0/1431547100 shutdown_connections 2023-05-17T15:10:39.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.793+0000 7fb849e15700 1 -- 172.21.15.27:0/1431547100 wait complete. 2023-05-17T15:10:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.794+0000 7fb849e15700 1 Processor -- start 2023-05-17T15:10:39.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 -- start start 2023-05-17T15:10:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8440c1080 0x7fb84414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c5d60 0x7fb8440ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb844154520 0x7fb8440caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844158890 con 0x7fb844154520 2023-05-17T15:10:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440caaa0 con 0x7fb8440c1080 2023-05-17T15:10:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849e15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb844150400 con 0x7fb8440c5d60 2023-05-17T15:10:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.795+0000 7fb849614700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb844154520 0x7fb8440caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb844154520 0x7fb8440caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42922/0 (socket says 172.21.15.27:42922) 2023-05-17T15:10:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 -- 172.21.15.27:0/427850730 learned_addr learned my addr 172.21.15.27:0/427850730 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:39.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb843fff700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c5d60 0x7fb8440ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb848e13700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8440c1080 0x7fb84414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 -- 172.21.15.27:0/427850730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c5d60 msgr2=0x7fb8440ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8440c5d60 0x7fb8440ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 -- 172.21.15.27:0/427850730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8440c1080 msgr2=0x7fb84414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8440c1080 0x7fb84414ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 -- 172.21.15.27:0/427850730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009a20 con 0x7fb844154520 2023-05-17T15:10:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849614700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb844154520 0x7fb8440caf30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fb83400c7e0 tx=0x7fb834001a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834007170 con 0x7fb844154520 2023-05-17T15:10:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8340072f0 con 0x7fb844154520 2023-05-17T15:10:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849e15700 1 -- 172.21.15.27:0/427850730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380092a0 con 0x7fb844154520 2023-05-17T15:10:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340048c0 con 0x7fb844154520 2023-05-17T15:10:39.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.796+0000 7fb849e15700 1 -- 172.21.15.27:0/427850730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8440ca170 con 0x7fb844154520 2023-05-17T15:10:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.797+0000 7fb849e15700 1 -- 172.21.15.27:0/427850730 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb844047150 con 0x7fb844154520 2023-05-17T15:10:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.797+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fb834004c30 con 0x7fb844154520 2023-05-17T15:10:39.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.798+0000 7fb840ff9700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb83005ed40 0x7fb830061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.798+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fb834079640 con 0x7fb844154520 2023-05-17T15:10:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.798+0000 7fb848e13700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb83005ed40 0x7fb830061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.798+0000 7fb848e13700 1 --2- 172.21.15.27:0/427850730 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb83005ed40 0x7fb830061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb83c009fd0 tx=0x7fb83c00b040).ready entity=mgr.7770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:39.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.802+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb83404ab70 con 0x7fb844154520 2023-05-17T15:10:40.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:39.999+0000 7fb849e15700 1 -- 172.21.15.27:0/427850730 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb844068800 con 0x7fb83005ed40 2023-05-17T15:10:40.004 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:40.000+0000 7f14f3542700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-05-17T15:10:40.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.000+0000 7fb840ff9700 1 -- 172.21.15.27:0/427850730 <== mgr.7770 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fb844068800 con 0x7fb83005ed40 2023-05-17T15:10:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-05-17T15:10:40.008 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-17T15:10:40.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:40.010 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-17T15:10:40.026 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:10:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.181+0000 7f88a8ef6700 1 Processor -- start 2023-05-17T15:10:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.181+0000 7f88a8ef6700 1 -- start start 2023-05-17T15:10:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a8ef6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88a41543d0 0x7f88a40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a8ef6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88a40c60f0 0x7f88a4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a8ef6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a40c0c90 con 0x7f88a40691f0 2023-05-17T15:10:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a8ef6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40c1c50 con 0x7f88a41543d0 2023-05-17T15:10:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a8ef6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a4158790 con 0x7f88a40c60f0 2023-05-17T15:10:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88a41543d0 0x7f88a40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a2d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f88a40691f0 0x7f88a41547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42490/0 (socket says 172.21.15.27:42490) 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a259c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88a41543d0 0x7f88a40c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42926/0 (socket says 172.21.15.27:42926) 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a2d9d700 1 -- 172.21.15.27:0/235762423 learned_addr learned my addr 172.21.15.27:0/235762423 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a1d9b700 1 --2- 172.21.15.27:0/235762423 >> v2:172.21.15.40:3300/0 conn(0x7f88a40c60f0 0x7f88a4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.182+0000 7f88a259c700 1 -- 172.21.15.27:0/235762423 >> v2:172.21.15.40:3300/0 conn(0x7f88a40c60f0 msgr2=0x7f88a4068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a259c700 1 --2- 172.21.15.27:0/235762423 >> v2:172.21.15.40:3300/0 conn(0x7f88a40c60f0 0x7f88a4068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a259c700 1 -- 172.21.15.27:0/235762423 >> v1:172.21.15.27:6789/0 conn(0x7f88a40691f0 legacy=0x7f88a41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a259c700 1 -- 172.21.15.27:0/235762423 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40c6570 con 0x7f88a41543d0 2023-05-17T15:10:40.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a159a700 1 -- 172.21.15.27:0/235762423 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725888094 0 0) 0x7f88a40c0c90 con 0x7f88a40691f0 2023-05-17T15:10:40.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a259c700 1 --2- 172.21.15.27:0/235762423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a40c5c00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f88a40c5620 tx=0x7f889c009780).ready entity=mon.0 client_cookie=d373ac9c50c76420 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:40.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a159a700 1 -- 172.21.15.27:0/235762423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00e070 con 0x7f88a41543d0 2023-05-17T15:10:40.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a159a700 1 -- 172.21.15.27:0/235762423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00bc30 con 0x7f88a41543d0 2023-05-17T15:10:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a159a700 1 -- 172.21.15.27:0/235762423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c012410 con 0x7f88a41543d0 2023-05-17T15:10:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 -- 172.21.15.27:0/235762423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 msgr2=0x7f88a40c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/235762423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a40c5c00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f88a40c5620 tx=0x7f889c009780).stop 2023-05-17T15:10:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 -- 172.21.15.27:0/235762423 shutdown_connections 2023-05-17T15:10:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/235762423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a40c5c00 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/235762423 >> v2:172.21.15.40:3300/0 conn(0x7f88a40c60f0 0x7f88a4068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 -- 172.21.15.27:0/235762423 >> 172.21.15.27:0/235762423 conn(0x7f88a40cb7f0 msgr2=0x7f88a40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 -- 172.21.15.27:0/235762423 shutdown_connections 2023-05-17T15:10:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.183+0000 7f88a8ef6700 1 -- 172.21.15.27:0/235762423 wait complete. 2023-05-17T15:10:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.184+0000 7f88a8ef6700 1 Processor -- start 2023-05-17T15:10:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 -- start start 2023-05-17T15:10:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88a40691f0 0x7f88a40c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a40c60f0 0x7f88a40c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a4164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40aed40 con 0x7f88a41543d0 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40af020 con 0x7f88a40c60f0 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a8ef6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40af300 con 0x7f88a40691f0 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a4164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a4164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42934/0 (socket says 172.21.15.27:42934) 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.185+0000 7f88a2d9d700 1 -- 172.21.15.27:0/174345755 learned_addr learned my addr 172.21.15.27:0/174345755 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a259c700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88a40691f0 0x7f88a40c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a1d9b700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a40c60f0 0x7f88a40c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a2d9d700 1 -- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88a40691f0 msgr2=0x7f88a40c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a2d9d700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88a40691f0 0x7f88a40c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a2d9d700 1 -- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a40c60f0 msgr2=0x7f88a40c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a2d9d700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a40c60f0 0x7f88a40c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a2d9d700 1 -- 172.21.15.27:0/174345755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009a20 con 0x7f88a41543d0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a2d9d700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a4164920 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f889400c490 tx=0x7f8894007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400ce00 con 0x7f88a41543d0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88940072e0 con 0x7f88a41543d0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a40af5e0 con 0x7f88a41543d0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007660 con 0x7f88a41543d0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.186+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a40c4d90 con 0x7f88a41543d0 2023-05-17T15:10:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.187+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a40c4fb0 con 0x7f88a41543d0 2023-05-17T15:10:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.187+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f889401a060 con 0x7f88a41543d0 2023-05-17T15:10:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.188+0000 7f889a7fc700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f888405ed40 0x7f8884061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.188+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f8894079200 con 0x7f88a41543d0 2023-05-17T15:10:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.188+0000 7f88a259c700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f888405ed40 0x7f8884061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:40.198 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.188+0000 7f88a259c700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f888405ed40 0x7f8884061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f889c009f90 tx=0x7f889c009780).ready entity=mgr.7770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:40.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.192+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88a40c4fb0 con 0x7f88a41543d0 2023-05-17T15:10:40.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.413+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f88a40c4fb0 con 0x7f88a41543d0 2023-05-17T15:10:40.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.683+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f8894010070 con 0x7f88a41543d0 2023-05-17T15:10:40.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.685+0000 7f889a7fc700 1 -- 172.21.15.27:0/174345755 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v51) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8894076290 con 0x7f88a41543d0 2023-05-17T15:10:40.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f888405ed40 msgr2=0x7f8884061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:40.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f888405ed40 0x7f8884061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f889c009f90 tx=0x7f889c009780).stop 2023-05-17T15:10:40.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 msgr2=0x7f88a4164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:40.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a4164920 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f889400c490 tx=0x7f8894007c10).stop 2023-05-17T15:10:40.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 shutdown_connections 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f888405ed40 0x7f8884061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88a41543d0 0x7f88a4164920 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88a40691f0 0x7f88a40c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 --2- 172.21.15.27:0/174345755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a40c60f0 0x7f88a40c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 >> 172.21.15.27:0/174345755 conn(0x7f88a40cb7f0 msgr2=0x7f88a40aa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 shutdown_connections 2023-05-17T15:10:40.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:40.688+0000 7f88a8ef6700 1 -- 172.21.15.27:0/174345755 wait complete. 2023-05-17T15:10:40.708 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:10:40.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:40.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:40.768 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:10:40.769 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:10:40.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:10:40.769 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:10:40.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:10:40.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:10:40.821 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:10:40.835 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:40.832+0000 7f98e39aa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:10:40.838 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:40.834+0000 7ff26a6b4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:10:40.852 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:40.901 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:40.897+0000 7f98e39aa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:10:40.904 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:40.900+0000 7ff26a6b4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:10:41.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.007+0000 7fc6cc589700 1 Processor -- start 2023-05-17T15:10:41.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.007+0000 7fc6cc589700 1 -- start start 2023-05-17T15:10:41.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6cc589700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6c414e2a0 0x7fc6c40bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6cc589700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c4154d60 con 0x7fc6c414dec0 2023-05-17T15:10:41.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6cc589700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40c2f80 con 0x7fc6c40c3b40 2023-05-17T15:10:41.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6cc589700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c4154150 con 0x7fc6c414e2a0 2023-05-17T15:10:41.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6c9b24700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6c414e2a0 0x7fc6c40bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6ca325700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc6c414dec0 0x7fc6c40bc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42554/0 (socket says 172.21.15.27:42554) 2023-05-17T15:10:41.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.008+0000 7fc6ca325700 1 -- 172.21.15.27:0/3463503808 learned_addr learned my addr 172.21.15.27:0/3463503808 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:41.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9b24700 1 -- 172.21.15.27:0/3463503808 >> v1:172.21.15.40:6789/0 conn(0x7fc6c40c3b40 legacy=0x7fc6c4065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9b24700 1 -- 172.21.15.27:0/3463503808 >> v1:172.21.15.27:6789/0 conn(0x7fc6c414dec0 legacy=0x7fc6c40bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9323700 1 -- 172.21.15.27:0/3463503808 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138762782 0 0) 0x7fc6c4154d60 con 0x7fc6c414dec0 2023-05-17T15:10:41.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9b24700 1 -- 172.21.15.27:0/3463503808 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4154430 con 0x7fc6c414e2a0 2023-05-17T15:10:41.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9b24700 1 --2- 172.21.15.27:0/3463503808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40bcfa0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fc6c0009760 tx=0x7fc6c0009060).ready entity=mon.0 client_cookie=9337db83237bdf6b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:41.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9323700 1 -- 172.21.15.27:0/3463503808 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b580 con 0x7fc6c414e2a0 2023-05-17T15:10:41.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9323700 1 -- 172.21.15.27:0/3463503808 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000b6e0 con 0x7fc6c414e2a0 2023-05-17T15:10:41.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6c9323700 1 -- 172.21.15.27:0/3463503808 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000ba60 con 0x7fc6c414e2a0 2023-05-17T15:10:41.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6cc589700 1 -- 172.21.15.27:0/3463503808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414e2a0 msgr2=0x7fc6c40bcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.009+0000 7fc6cc589700 1 --2- 172.21.15.27:0/3463503808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40bcfa0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fc6c0009760 tx=0x7fc6c0009060).stop 2023-05-17T15:10:41.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.010+0000 7fc6cc589700 1 -- 172.21.15.27:0/3463503808 shutdown_connections 2023-05-17T15:10:41.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.010+0000 7fc6cc589700 1 --2- 172.21.15.27:0/3463503808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40bcfa0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.010+0000 7fc6cc589700 1 -- 172.21.15.27:0/3463503808 >> 172.21.15.27:0/3463503808 conn(0x7fc6c405dd50 msgr2=0x7fc6c405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:41.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.010+0000 7fc6cc589700 1 -- 172.21.15.27:0/3463503808 shutdown_connections 2023-05-17T15:10:41.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.010+0000 7fc6cc589700 1 -- 172.21.15.27:0/3463503808 wait complete. 2023-05-17T15:10:41.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.011+0000 7fc6cc589700 1 Processor -- start 2023-05-17T15:10:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.011+0000 7fc6cc589700 1 -- start start 2023-05-17T15:10:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.011+0000 7fc6cc589700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c40c3b40 0x7fc6c4141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.011+0000 7fc6cc589700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 0x7fc6c40a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cc589700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cc589700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40bf530 con 0x7fc6c414dec0 2023-05-17T15:10:41.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cc589700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40be960 con 0x7fc6c414e2a0 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cc589700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40bec00 con 0x7fc6c40c3b40 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 0x7fc6c40a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 0x7fc6c40a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42998/0 (socket says 172.21.15.27:42998) 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 -- 172.21.15.27:0/2553551320 learned_addr learned my addr 172.21.15.27:0/2553551320 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6ca325700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c40c3b40 0x7fc6c4141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cab26700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 -- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c40c3b40 msgr2=0x7fc6c4141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c40c3b40 0x7fc6c4141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 -- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c414e2a0 msgr2=0x7fc6c40c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 -- 172.21.15.27:0/2553551320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00092a0 con 0x7fc6c414dec0 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6c9b24700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 0x7fc6c40a8e20 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fc6c40658a0 tx=0x7fc6c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b850 con 0x7fc6c414dec0 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000b9b0 con 0x7fc6c414dec0 2023-05-17T15:10:41.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40beee0 con 0x7fc6c414dec0 2023-05-17T15:10:41.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c001b670 con 0x7fc6c414dec0 2023-05-17T15:10:41.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.012+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c40a9310 con 0x7fc6c414dec0 2023-05-17T15:10:41.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.013+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c406bdf0 con 0x7fc6c414dec0 2023-05-17T15:10:41.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.014+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc6c000f070 con 0x7fc6c414dec0 2023-05-17T15:10:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.014+0000 7fc6ba7fc700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 0x7fc6a80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.014+0000 7fc6ca325700 1 -- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 msgr2=0x7fc6a80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.014+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fc6c007b3c0 con 0x7fc6c414dec0 2023-05-17T15:10:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.014+0000 7fc6ca325700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 0x7fc6a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.018+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6c004c780 con 0x7fc6c414dec0 2023-05-17T15:10:41.187 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:41.183+0000 7f98e39aa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:10:41.195 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:41.191+0000 7ff26a6b4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:10:41.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.215+0000 7fc6ca325700 1 -- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 msgr2=0x7fc6a80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:41.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.215+0000 7fc6ca325700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 0x7fc6a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:41.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.237+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6c405e900 con 0x7fc6c414dec0 2023-05-17T15:10:41.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.237+0000 7fc6ba7fc700 1 -- 172.21.15.27:0/2553551320 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fc6c004fda0 con 0x7fc6c414dec0 2023-05-17T15:10:41.241 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:41.241 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:21.665012+0000","modified":"2023-05-17T15:10:24.678553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2675320429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2675320429},{"type":"v1","addr":"172.21.15.40:6834","nonce":2675320429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-17T15:10:41.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 msgr2=0x7fc6a80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:41.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 0x7fc6a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:41.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 msgr2=0x7fc6c40a8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 0x7fc6c40a8e20 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fc6c40658a0 tx=0x7fc6c0017000).stop 2023-05-17T15:10:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 shutdown_connections 2023-05-17T15:10:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc6a805ede0 0x7fc6a80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c414e2a0 0x7fc6c40c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c40c3b40 0x7fc6c4141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 --2- 172.21.15.27:0/2553551320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c414dec0 0x7fc6c40a8e20 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 >> 172.21.15.27:0/2553551320 conn(0x7fc6c405dd50 msgr2=0x7fc6c4150ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:41.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 shutdown_connections 2023-05-17T15:10:41.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.239+0000 7fc6cc589700 1 -- 172.21.15.27:0/2553551320 wait complete. 2023-05-17T15:10:41.245 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 52 2023-05-17T15:10:41.255 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:41.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.409+0000 7f9d47061700 1 Processor -- start 2023-05-17T15:10:41.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.409+0000 7f9d47061700 1 -- start start 2023-05-17T15:10:41.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d47061700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9d40063340 0x7f9d400bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d47061700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d40157be0 con 0x7f9d40153e20 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d47061700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d40154b30 con 0x7f9d40067cb0 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d47061700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d400c2290 con 0x7f9d40063340 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4585e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9d40063340 0x7f9d400bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4605f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9d40153e20 0x7f9d40154200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42596/0 (socket says 172.21.15.27:42596) 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4605f700 1 -- 172.21.15.27:0/525139229 learned_addr learned my addr 172.21.15.27:0/525139229 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:41.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4585e700 1 -- 172.21.15.27:0/525139229 >> v1:172.21.15.40:6789/0 conn(0x7f9d40067cb0 legacy=0x7f9d40158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4585e700 1 -- 172.21.15.27:0/525139229 >> v1:172.21.15.27:6789/0 conn(0x7f9d40153e20 legacy=0x7f9d40154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4585e700 1 -- 172.21.15.27:0/525139229 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d40154e10 con 0x7f9d40063340 2023-05-17T15:10:41.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4505d700 1 -- 172.21.15.27:0/525139229 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930339666 0 0) 0x7f9d40157be0 con 0x7f9d40153e20 2023-05-17T15:10:41.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.410+0000 7f9d4585e700 1 --2- 172.21.15.27:0/525139229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d400bcac0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f9d30009760 tx=0x7f9d30009060).ready entity=mon.0 client_cookie=d7c57c6e6dc5f142 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:41.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d4505d700 1 -- 172.21.15.27:0/525139229 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000b580 con 0x7f9d40063340 2023-05-17T15:10:41.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d4505d700 1 -- 172.21.15.27:0/525139229 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000b6e0 con 0x7f9d40063340 2023-05-17T15:10:41.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d4505d700 1 -- 172.21.15.27:0/525139229 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000ba60 con 0x7f9d40063340 2023-05-17T15:10:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 -- 172.21.15.27:0/525139229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 msgr2=0x7f9d400bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 --2- 172.21.15.27:0/525139229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d400bcac0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f9d30009760 tx=0x7f9d30009060).stop 2023-05-17T15:10:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 -- 172.21.15.27:0/525139229 shutdown_connections 2023-05-17T15:10:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 --2- 172.21.15.27:0/525139229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d400bcac0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 -- 172.21.15.27:0/525139229 >> 172.21.15.27:0/525139229 conn(0x7f9d400675b0 msgr2=0x7f9d400c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 -- 172.21.15.27:0/525139229 shutdown_connections 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.411+0000 7f9d47061700 1 -- 172.21.15.27:0/525139229 wait complete. 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.412+0000 7f9d47061700 1 Processor -- start 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.412+0000 7f9d47061700 1 -- start start 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d47061700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d40144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d47061700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d40067cb0 0x7f9d400c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d47061700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d40153e20 0x7f9d40158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d47061700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c6830 con 0x7f9d40063340 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d47061700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c6b10 con 0x7f9d40153e20 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d47061700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c6df0 con 0x7f9d40067cb0 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d4605f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d40144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d4605f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d40144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43040/0 (socket says 172.21.15.27:43040) 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d4605f700 1 -- 172.21.15.27:0/1749309460 learned_addr learned my addr 172.21.15.27:0/1749309460 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d46860700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d40153e20 0x7f9d40158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.413+0000 7f9d4585e700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d40067cb0 0x7f9d400c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4605f700 1 -- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d40067cb0 msgr2=0x7f9d400c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4605f700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d40067cb0 0x7f9d400c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4605f700 1 -- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d40153e20 msgr2=0x7f9d40158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4605f700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d40153e20 0x7f9d40158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4605f700 1 -- 172.21.15.27:0/1749309460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300092a0 con 0x7f9d40063340 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4585e700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d40067cb0 0x7f9d400c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:41.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d4605f700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d40144380 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f9d3c00c490 tx=0x7f9d3c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00ce40 con 0x7f9d40063340 2023-05-17T15:10:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c0072e0 con 0x7f9d40063340 2023-05-17T15:10:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0057a0 con 0x7f9d40063340 2023-05-17T15:10:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d400c70d0 con 0x7f9d40063340 2023-05-17T15:10:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.414+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d400c6450 con 0x7f9d40063340 2023-05-17T15:10:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.415+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d40065560 con 0x7f9d40063340 2023-05-17T15:10:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.415+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9d3c010070 con 0x7f9d40063340 2023-05-17T15:10:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.416+0000 7f9d367fc700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9d2405ede0 0x7f9d240612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.416+0000 7f9d4585e700 1 -- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9d2405ede0 msgr2=0x7f9d240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.416+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f9d3c0792d0 con 0x7f9d40063340 2023-05-17T15:10:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.416+0000 7f9d4585e700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9d2405ede0 0x7f9d240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:41.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.420+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d3c04a690 con 0x7f9d40063340 2023-05-17T15:10:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.596+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d400c75f0 con 0x7f9d40063340 2023-05-17T15:10:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.597+0000 7f9d367fc700 1 -- 172.21.15.27:0/1749309460 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+17345 (secure 0 0 0) 0x7f9d3c04dcb0 con 0x7f9d40063340 2023-05-17T15:10:41.601 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:41.601 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":127,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:38.247557+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:19.299248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:20.644965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4125572758":"2023-05-18T15:10:38.247529+0000","172.21.15.27:0/3909417837":"2023-05-18T15:10:38.247529+0000","172.21.15.27:6837/86332":"2023-05-18T15:10:38.247529+0000","172.21.15.27:6836/86332":"2023-05-18T15:10:38.247529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9d2405ede0 msgr2=0x7f9d240612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:41.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9d2405ede0 0x7f9d240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:41.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 msgr2=0x7f9d40144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d40144380 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f9d3c00c490 tx=0x7f9d3c007e40).stop 2023-05-17T15:10:41.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 shutdown_connections 2023-05-17T15:10:41.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9d2405ede0 0x7f9d240612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:41.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d40153e20 0x7f9d40158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d40063340 0x7f9d40144380 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 --2- 172.21.15.27:0/1749309460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d40067cb0 0x7f9d400c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 >> 172.21.15.27:0/1749309460 conn(0x7f9d400675b0 msgr2=0x7f9d40156050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:41.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 shutdown_connections 2023-05-17T15:10:41.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.599+0000 7f9d47061700 1 -- 172.21.15.27:0/1749309460 wait complete. 2023-05-17T15:10:41.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:10:19.299248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:10:20.644965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:10:41.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:10:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.735+0000 7f82a0fa0700 1 Processor -- start 2023-05-17T15:10:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.735+0000 7f82a0fa0700 1 -- start start 2023-05-17T15:10:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f82a0fa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0bd4b0 0x7f829c0bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f82a0fa0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c155530 con 0x7f829c0c7610 2023-05-17T15:10:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f82a0fa0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c154920 con 0x7f829c150dd0 2023-05-17T15:10:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f82a0fa0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c154c00 con 0x7f829c0bd4b0 2023-05-17T15:10:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f829affd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f829c0c7610 0x7f829c1506c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42610/0 (socket says 172.21.15.27:42610) 2023-05-17T15:10:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f829affd700 1 -- 172.21.15.27:0/2062740461 learned_addr learned my addr 172.21.15.27:0/2062740461 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.736+0000 7f829b7fe700 1 --2- 172.21.15.27:0/2062740461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0bd4b0 0x7f829c0bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765402745 0 0) 0x7f829c155530 con 0x7f829c0c7610 2023-05-17T15:10:41.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82840033f0 con 0x7f829c0c7610 2023-05-17T15:10:41.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632804049 0 0) 0x7f829c154920 con 0x7f829c150dd0 2023-05-17T15:10:41.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f829c155530 con 0x7f829c150dd0 2023-05-17T15:10:41.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829b7fe700 1 -- 172.21.15.27:0/2062740461 >> v1:172.21.15.40:6789/0 conn(0x7f829c150dd0 legacy=0x7f829c0633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829b7fe700 1 -- 172.21.15.27:0/2062740461 >> v1:172.21.15.27:6789/0 conn(0x7f829c0c7610 legacy=0x7f829c1506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829b7fe700 1 -- 172.21.15.27:0/2062740461 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c154ee0 con 0x7f829c0bd4b0 2023-05-17T15:10:41.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829b7fe700 1 --2- 172.21.15.27:0/2062740461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0bd4b0 0x7f829c0bd890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f828c0097c0 tx=0x7f828c009060).ready entity=mon.2 client_cookie=762a39f0c3dcd41e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:41.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00d4a0 con 0x7f829c0bd4b0 2023-05-17T15:10:41.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00d600 con 0x7f829c0bd4b0 2023-05-17T15:10:41.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.737+0000 7f829a7fc700 1 -- 172.21.15.27:0/2062740461 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00d980 con 0x7f829c0bd4b0 2023-05-17T15:10:41.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 -- 172.21.15.27:0/2062740461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0bd4b0 msgr2=0x7f829c0bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/2062740461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0bd4b0 0x7f829c0bd890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f828c0097c0 tx=0x7f828c009060).stop 2023-05-17T15:10:41.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 -- 172.21.15.27:0/2062740461 shutdown_connections 2023-05-17T15:10:41.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/2062740461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0bd4b0 0x7f829c0bd890 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 -- 172.21.15.27:0/2062740461 >> 172.21.15.27:0/2062740461 conn(0x7f829c068780 msgr2=0x7f829c0c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:41.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 -- 172.21.15.27:0/2062740461 shutdown_connections 2023-05-17T15:10:41.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.738+0000 7f82a0fa0700 1 -- 172.21.15.27:0/2062740461 wait complete. 2023-05-17T15:10:41.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.739+0000 7f82a0fa0700 1 Processor -- start 2023-05-17T15:10:41.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.739+0000 7f82a0fa0700 1 -- start start 2023-05-17T15:10:41.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f82a0fa0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0bd4b0 0x7f829c0a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f82a0fa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0c7610 0x7f829c0aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f82a0fa0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 0x7f829c147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f82a0fa0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0abd20 con 0x7f829c150dd0 2023-05-17T15:10:41.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f82a0fa0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0ab110 con 0x7f829c0bd4b0 2023-05-17T15:10:41.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f82a0fa0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0ab3f0 con 0x7f829c0c7610 2023-05-17T15:10:41.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 0x7f829c147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 0x7f829c147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43058/0 (socket says 172.21.15.27:43058) 2023-05-17T15:10:41.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0bd4b0 0x7f829c0a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 -- 172.21.15.27:0/225495319 learned_addr learned my addr 172.21.15.27:0/225495319 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:41.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829affd700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0c7610 0x7f829c0aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:41.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 -- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0c7610 msgr2=0x7f829c0aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0c7610 0x7f829c0aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 -- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0bd4b0 msgr2=0x7f829c0a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0bd4b0 0x7f829c0a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829bfff700 1 -- 172.21.15.27:0/225495319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0092a0 con 0x7f829c150dd0 2023-05-17T15:10:41.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.740+0000 7f829b7fe700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0bd4b0 0x7f829c0a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:41.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.741+0000 7f829bfff700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 0x7f829c147c10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f829400c7c0 tx=0x7f8294007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:41.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.741+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400e4a0 con 0x7f829c150dd0 2023-05-17T15:10:41.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.741+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400e600 con 0x7f829c150dd0 2023-05-17T15:10:41.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.741+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400e980 con 0x7f829c150dd0 2023-05-17T15:10:41.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.741+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c0ab6d0 con 0x7f829c150dd0 2023-05-17T15:10:41.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.741+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0aadb0 con 0x7f829c150dd0 2023-05-17T15:10:41.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.742+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0abed0 con 0x7f829c150dd0 2023-05-17T15:10:41.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.742+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f8294019030 con 0x7f829c150dd0 2023-05-17T15:10:41.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.743+0000 7f82837fe700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 0x7f82880612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:41.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.743+0000 7f829b7fe700 1 -- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 msgr2=0x7f82880612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:41.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.743+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f8294079260 con 0x7f829c150dd0 2023-05-17T15:10:41.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.743+0000 7f829b7fe700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 0x7f82880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:41.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.747+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82940488f0 con 0x7f829c150dd0 2023-05-17T15:10:41.845 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:41.842+0000 7f98e39aa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:10:41.861 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:41.857+0000 7ff26a6b4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:10:41.914 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:41.910+0000 7f98e39aa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:10:41.931 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:41.927+0000 7ff26a6b4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:10:41.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.944+0000 7f829b7fe700 1 -- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 msgr2=0x7f82880612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:41.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.944+0000 7f829b7fe700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 0x7f82880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:41.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.966+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f829c047150 con 0x7f829c150dd0 2023-05-17T15:10:41.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.967+0000 7f82837fe700 1 -- 172.21.15.27:0/225495319 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8294017070 con 0x7f829c150dd0 2023-05-17T15:10:41.971 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:10:41.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 msgr2=0x7f82880612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:41.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 0x7f82880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:41.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 msgr2=0x7f829c147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:41.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 0x7f829c147c10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f829400c7c0 tx=0x7f8294007f50).stop 2023-05-17T15:10:41.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 shutdown_connections 2023-05-17T15:10:41.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f828805ede0 0x7f82880612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:41.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f829c150dd0 0x7f829c147c10 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0bd4b0 0x7f829c0a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 --2- 172.21.15.27:0/225495319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829c0c7610 0x7f829c0aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 >> 172.21.15.27:0/225495319 conn(0x7f829c068780 msgr2=0x7f829c0c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 shutdown_connections 2023-05-17T15:10:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:41.969+0000 7f82a0fa0700 1 -- 172.21.15.27:0/225495319 wait complete. 2023-05-17T15:10:41.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:10:42.106 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:42.102+0000 7f98e39aa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:10:42.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.104+0000 7efe7d57b700 1 Processor -- start 2023-05-17T15:10:42.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.104+0000 7efe7d57b700 1 -- start start 2023-05-17T15:10:42.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7d57b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efe780be910 0x7efe7815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7d57b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780a60c0 con 0x7efe780c8430 2023-05-17T15:10:42.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7d57b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780a5790 con 0x7efe780c8050 2023-05-17T15:10:42.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7d57b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe780a8170 con 0x7efe780be910 2023-05-17T15:10:42.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7cd7a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efe780be910 0x7efe7815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe777fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efe780c8430 0x7efe780be200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42628/0 (socket says 172.21.15.27:42628) 2023-05-17T15:10:42.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe777fe700 1 -- 172.21.15.27:0/2833622195 learned_addr learned my addr 172.21.15.27:0/2833622195 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:42.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7cd7a700 1 --2- 172.21.15.27:0/2833622195 >> v2:172.21.15.27:3300/0 conn(0x7efe780be910 0x7efe7815ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43068/0 (socket says 172.21.15.27:43068) 2023-05-17T15:10:42.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7cd7a700 1 -- 172.21.15.27:0/2833622195 >> v1:172.21.15.40:6789/0 conn(0x7efe780c8050 legacy=0x7efe780a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7cd7a700 1 -- 172.21.15.27:0/2833622195 >> v1:172.21.15.27:6789/0 conn(0x7efe780c8430 legacy=0x7efe780be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7cd7a700 1 -- 172.21.15.27:0/2833622195 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780a5a70 con 0x7efe780be910 2023-05-17T15:10:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe76ffd700 1 -- 172.21.15.27:0/2833622195 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879140452 0 0) 0x7efe780a60c0 con 0x7efe780c8430 2023-05-17T15:10:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe7cd7a700 1 --2- 172.21.15.27:0/2833622195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780be910 0x7efe7815ca90 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7efe70009e60 tx=0x7efe70009780).ready entity=mon.0 client_cookie=8248a53a558ec1f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:42.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe76ffd700 1 -- 172.21.15.27:0/2833622195 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000e070 con 0x7efe780be910 2023-05-17T15:10:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.105+0000 7efe76ffd700 1 -- 172.21.15.27:0/2833622195 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000bc30 con 0x7efe780be910 2023-05-17T15:10:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe76ffd700 1 -- 172.21.15.27:0/2833622195 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70012410 con 0x7efe780be910 2023-05-17T15:10:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 -- 172.21.15.27:0/2833622195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780be910 msgr2=0x7efe7815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2833622195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780be910 0x7efe7815ca90 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7efe70009e60 tx=0x7efe70009780).stop 2023-05-17T15:10:42.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 -- 172.21.15.27:0/2833622195 shutdown_connections 2023-05-17T15:10:42.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2833622195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780be910 0x7efe7815ca90 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 -- 172.21.15.27:0/2833622195 >> 172.21.15.27:0/2833622195 conn(0x7efe78091fa0 msgr2=0x7efe78062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:42.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 -- 172.21.15.27:0/2833622195 shutdown_connections 2023-05-17T15:10:42.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.106+0000 7efe7d57b700 1 -- 172.21.15.27:0/2833622195 wait complete. 2023-05-17T15:10:42.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.108+0000 7efe7d57b700 1 Processor -- start 2023-05-17T15:10:42.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.108+0000 7efe7d57b700 1 -- start start 2023-05-17T15:10:42.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe7d57b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780be910 0x7efe78149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe7d57b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 0x7efe7814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe7d57b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe780c8430 0x7efe780c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe7d57b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe781503f0 con 0x7efe780c8050 2023-05-17T15:10:42.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe7d57b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe78167cc0 con 0x7efe780be910 2023-05-17T15:10:42.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe7d57b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe78167fa0 con 0x7efe780c8430 2023-05-17T15:10:42.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 0x7efe7814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 0x7efe7814e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43072/0 (socket says 172.21.15.27:43072) 2023-05-17T15:10:42.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.109+0000 7efe777fe700 1 -- 172.21.15.27:0/2358667930 learned_addr learned my addr 172.21.15.27:0/2358667930 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:42.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe77fff700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780be910 0x7efe78149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe7cd7a700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe780c8430 0x7efe780c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe777fe700 1 -- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe780c8430 msgr2=0x7efe780c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe777fe700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe780c8430 0x7efe780c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe777fe700 1 -- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780be910 msgr2=0x7efe78149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe777fe700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780be910 0x7efe78149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe777fe700 1 -- 172.21.15.27:0/2358667930 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70009a20 con 0x7efe780c8050 2023-05-17T15:10:42.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe777fe700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 0x7efe7814e200 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7efe6c00c490 tx=0x7efe6c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:42.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00ce40 con 0x7efe780c8050 2023-05-17T15:10:42.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe78168280 con 0x7efe780c8050 2023-05-17T15:10:42.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0072e0 con 0x7efe780c8050 2023-05-17T15:10:42.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0057a0 con 0x7efe780c8050 2023-05-17T15:10:42.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.110+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe780c4c80 con 0x7efe780c8050 2023-05-17T15:10:42.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.111+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7efe6c010070 con 0x7efe780c8050 2023-05-17T15:10:42.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.112+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe78047150 con 0x7efe780c8050 2023-05-17T15:10:42.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.112+0000 7efe5ffff700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efe6405ede0 0x7efe640612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.112+0000 7efe77fff700 1 -- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efe6405ede0 msgr2=0x7efe640612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:42.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.112+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7efe6c0793c0 con 0x7efe780c8050 2023-05-17T15:10:42.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.112+0000 7efe77fff700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efe6405ede0 0x7efe640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:42.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.116+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe6c04a780 con 0x7efe780c8050 2023-05-17T15:10:42.129 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:42.126+0000 7ff26a6b4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:10:42.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.288+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efe7805e230 con 0x7efe780c8050 2023-05-17T15:10:42.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.289+0000 7efe5ffff700 1 -- 172.21.15.27:0/2358667930 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7efe6c04dda0 con 0x7efe780c8050 2023-05-17T15:10:42.293 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:10:42.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efe6405ede0 msgr2=0x7efe640612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:42.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efe6405ede0 0x7efe640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:42.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 msgr2=0x7efe7814e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 0x7efe7814e200 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7efe6c00c490 tx=0x7efe6c007e40).stop 2023-05-17T15:10:42.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 shutdown_connections 2023-05-17T15:10:42.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efe6405ede0 0x7efe640612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:42.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe780c8430 0x7efe780c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780be910 0x7efe78149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 --2- 172.21.15.27:0/2358667930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe780c8050 0x7efe7814e200 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 >> 172.21.15.27:0/2358667930 conn(0x7efe78091fa0 msgr2=0x7efe780bdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:42.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 shutdown_connections 2023-05-17T15:10:42.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.291+0000 7efe7d57b700 1 -- 172.21.15.27:0/2358667930 wait complete. 2023-05-17T15:10:42.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:10:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.426+0000 7f111cc47700 1 Processor -- start 2023-05-17T15:10:42.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.426+0000 7f111cc47700 1 -- start start 2023-05-17T15:10:42.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.427+0000 7f111cc47700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11180683c0 0x7f1118064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.427+0000 7f111cc47700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11180c28e0 con 0x7f1118150f40 2023-05-17T15:10:42.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.427+0000 7f111cc47700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1118065390 con 0x7f1118150b60 2023-05-17T15:10:42.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.427+0000 7f111cc47700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11180c2d70 con 0x7f11180683c0 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.427+0000 7f1116d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11180683c0 0x7f1118064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.427+0000 7f110ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1118150f40 0x7f11181548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42658/0 (socket says 172.21.15.27:42658) 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f110ffff700 1 -- 172.21.15.27:0/341019340 learned_addr learned my addr 172.21.15.27:0/341019340 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1116d9d700 1 -- 172.21.15.27:0/341019340 >> v1:172.21.15.40:6789/0 conn(0x7f1118150b60 legacy=0x7f1118067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1116d9d700 1 -- 172.21.15.27:0/341019340 >> v1:172.21.15.27:6789/0 conn(0x7f1118150f40 legacy=0x7f11181548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1115d9b700 1 -- 172.21.15.27:0/341019340 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942678167 0 0) 0x7f1118065390 con 0x7f1118150b60 2023-05-17T15:10:42.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1116d9d700 1 -- 172.21.15.27:0/341019340 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118065610 con 0x7f11180683c0 2023-05-17T15:10:42.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1116d9d700 1 --2- 172.21.15.27:0/341019340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f1118064ea0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1110009e60 tx=0x7f1110009780).ready entity=mon.0 client_cookie=67dd44adc01c556f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:42.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1115d9b700 1 -- 172.21.15.27:0/341019340 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111000e070 con 0x7f11180683c0 2023-05-17T15:10:42.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1115d9b700 1 -- 172.21.15.27:0/341019340 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111000bb30 con 0x7f11180683c0 2023-05-17T15:10:42.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.428+0000 7f1115d9b700 1 -- 172.21.15.27:0/341019340 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111000beb0 con 0x7f11180683c0 2023-05-17T15:10:42.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 -- 172.21.15.27:0/341019340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 msgr2=0x7f1118064ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 --2- 172.21.15.27:0/341019340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f1118064ea0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1110009e60 tx=0x7f1110009780).stop 2023-05-17T15:10:42.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 -- 172.21.15.27:0/341019340 shutdown_connections 2023-05-17T15:10:42.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 --2- 172.21.15.27:0/341019340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f1118064ea0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 -- 172.21.15.27:0/341019340 >> 172.21.15.27:0/341019340 conn(0x7f11180c7910 msgr2=0x7f11180c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 -- 172.21.15.27:0/341019340 shutdown_connections 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.429+0000 7f111cc47700 1 -- 172.21.15.27:0/341019340 wait complete. 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.430+0000 7f111cc47700 1 Processor -- start 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.430+0000 7f111cc47700 1 -- start start 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111cc47700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f11180c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111cc47700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1118150b60 0x7f111814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111cc47700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1118150f40 0x7f111814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111cc47700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111814c480 con 0x7f11180683c0 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111cc47700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11180be9b0 con 0x7f1118150b60 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111cc47700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11180bef70 con 0x7f1118150f40 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f11180c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f11180c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43100/0 (socket says 172.21.15.27:43100) 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 -- 172.21.15.27:0/3644200454 learned_addr learned my addr 172.21.15.27:0/3644200454 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f110ffff700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1118150b60 0x7f111814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f1116d9d700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1118150f40 0x7f111814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 -- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1118150f40 msgr2=0x7f111814e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1118150f40 0x7f111814e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 -- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1118150b60 msgr2=0x7f111814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1118150b60 0x7f111814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.431+0000 7f111659c700 1 -- 172.21.15.27:0/3644200454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110009a20 con 0x7f11180683c0 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.432+0000 7f111659c700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f11180c1050 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f110800c4e0 tx=0x7f1108007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.432+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800ce50 con 0x7f11180683c0 2023-05-17T15:10:42.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.432+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110800f470 con 0x7f11180683c0 2023-05-17T15:10:42.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.432+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11180c15e0 con 0x7f11180683c0 2023-05-17T15:10:42.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.432+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800f830 con 0x7f11180683c0 2023-05-17T15:10:42.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.432+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11180bec00 con 0x7f11180683c0 2023-05-17T15:10:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.433+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11180bf250 con 0x7f11180683c0 2023-05-17T15:10:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.433+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1108019030 con 0x7f11180683c0 2023-05-17T15:10:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.433+0000 7f110e7fc700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f10f805ede0 0x7f10f80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.433+0000 7f110ffff700 1 -- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f10f805ede0 msgr2=0x7f10f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.434+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f1108079030 con 0x7f11180683c0 2023-05-17T15:10:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.434+0000 7f110ffff700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f10f805ede0 0x7f10f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:42.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.438+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11080488f0 con 0x7f11180683c0 2023-05-17T15:10:42.542 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:42.539+0000 7f98e39aa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:10:42.571 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:42.567+0000 7ff26a6b4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:10:42.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.610+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f111806bdf0 con 0x7f11180683c0 2023-05-17T15:10:42.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.611+0000 7f110e7fc700 1 -- 172.21.15.27:0/3644200454 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+11 (secure 0 0 0) 0x7f110804a4a0 con 0x7f11180683c0 2023-05-17T15:10:42.615 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f10f805ede0 msgr2=0x7f10f80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f10f805ede0 0x7f10f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 msgr2=0x7f11180c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f11180c1050 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f110800c4e0 tx=0x7f1108007c70).stop 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 shutdown_connections 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f10f805ede0 0x7f10f80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:42.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1118150f40 0x7f111814e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180683c0 0x7f11180c1050 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 --2- 172.21.15.27:0/3644200454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1118150b60 0x7f111814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 >> 172.21.15.27:0/3644200454 conn(0x7f11180c7910 msgr2=0x7f11180c3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:42.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 shutdown_connections 2023-05-17T15:10:42.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.613+0000 7f111cc47700 1 -- 172.21.15.27:0/3644200454 wait complete. 2023-05-17T15:10:42.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:10:42.651 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:42.647+0000 7f98e39aa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:42.681 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:42.678+0000 7ff26a6b4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:42.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.745+0000 7fe6789e0700 1 Processor -- start 2023-05-17T15:10:42.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.745+0000 7fe6789e0700 1 -- start start 2023-05-17T15:10:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.746+0000 7fe6789e0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6741540a0 0x7fe67405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.746+0000 7fe6789e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe67405e240 0x7fe6740c2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.746+0000 7fe6789e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6740c2900 0x7fe674157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.746+0000 7fe6789e0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe674064180 con 0x7fe6740c2900 2023-05-17T15:10:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.746+0000 7fe6789e0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67405e6c0 con 0x7fe6741540a0 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.746+0000 7fe6789e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe674063e50 con 0x7fe67405e240 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6740c2900 0x7fe674157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6740c2900 0x7fe674157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43112/0 (socket says 172.21.15.27:43112) 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 -- 172.21.15.27:0/1232889492 learned_addr learned my addr 172.21.15.27:0/1232889492 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe67259c700 1 --2- 172.21.15.27:0/1232889492 >> v2:172.21.15.40:3300/0 conn(0x7fe6741540a0 0x7fe67405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe671d9b700 1 --2- 172.21.15.27:0/1232889492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe67405e240 0x7fe6740c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 -- 172.21.15.27:0/1232889492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe67405e240 msgr2=0x7fe6740c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 --2- 172.21.15.27:0/1232889492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe67405e240 0x7fe6740c2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 -- 172.21.15.27:0/1232889492 >> v2:172.21.15.40:3300/0 conn(0x7fe6741540a0 msgr2=0x7fe67405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 --2- 172.21.15.27:0/1232889492 >> v2:172.21.15.40:3300/0 conn(0x7fe6741540a0 0x7fe67405dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 -- 172.21.15.27:0/1232889492 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740c3970 con 0x7fe6740c2900 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe672d9d700 1 --2- 172.21.15.27:0/1232889492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe674157b00 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fe67406a120 tx=0x7fe66c009840).ready entity=mon.0 client_cookie=1228409f58b4a0e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe67159a700 1 -- 172.21.15.27:0/1232889492 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00e070 con 0x7fe6740c2900 2023-05-17T15:10:42.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe67159a700 1 -- 172.21.15.27:0/1232889492 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00b970 con 0x7fe6740c2900 2023-05-17T15:10:42.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.747+0000 7fe67159a700 1 -- 172.21.15.27:0/1232889492 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00bcf0 con 0x7fe6740c2900 2023-05-17T15:10:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 -- 172.21.15.27:0/1232889492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 msgr2=0x7fe674157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1232889492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe674157b00 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fe67406a120 tx=0x7fe66c009840).stop 2023-05-17T15:10:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 -- 172.21.15.27:0/1232889492 shutdown_connections 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1232889492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe674157b00 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1232889492 >> v2:172.21.15.40:3300/0 conn(0x7fe6741540a0 0x7fe67405dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1232889492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe67405e240 0x7fe6740c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 -- 172.21.15.27:0/1232889492 >> 172.21.15.27:0/1232889492 conn(0x7fe6740c83d0 msgr2=0x7fe6740c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 -- 172.21.15.27:0/1232889492 shutdown_connections 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.748+0000 7fe6789e0700 1 -- 172.21.15.27:0/1232889492 wait complete. 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.749+0000 7fe6789e0700 1 Processor -- start 2023-05-17T15:10:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.749+0000 7fe6789e0700 1 -- start start 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe6789e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe67405e240 0x7fe6740a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe6789e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe6741512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe6789e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6741540a0 0x7fe6740bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe6789e0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740a4850 con 0x7fe6740c2900 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe6789e0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740a5af0 con 0x7fe67405e240 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe6789e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740a4570 con 0x7fe6741540a0 2023-05-17T15:10:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe671d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe6741512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe671d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe6741512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43116/0 (socket says 172.21.15.27:43116) 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe671d9b700 1 -- 172.21.15.27:0/1335301545 learned_addr learned my addr 172.21.15.27:0/1335301545 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe67259c700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe67405e240 0x7fe6740a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.750+0000 7fe672d9d700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6741540a0 0x7fe6740bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe671d9b700 1 -- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6741540a0 msgr2=0x7fe6740bdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe671d9b700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6741540a0 0x7fe6740bdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe671d9b700 1 -- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe67405e240 msgr2=0x7fe6740a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe671d9b700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe67405e240 0x7fe6740a5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe671d9b700 1 -- 172.21.15.27:0/1335301545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c009ae0 con 0x7fe6740c2900 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe671d9b700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe6741512b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fe66400e950 tx=0x7fe664009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664009530 con 0x7fe6740c2900 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664012600 con 0x7fe6740c2900 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664012980 con 0x7fe6740c2900 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740a54a0 con 0x7fe6740c2900 2023-05-17T15:10:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.751+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6741517a0 con 0x7fe6740c2900 2023-05-17T15:10:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.752+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe674158d00 con 0x7fe6740c2900 2023-05-17T15:10:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.752+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe664022070 con 0x7fe6740c2900 2023-05-17T15:10:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.752+0000 7fe6627fc700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe65405ede0 0x7fe6540612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.753+0000 7fe67259c700 1 -- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe65405ede0 msgr2=0x7fe6540612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.753+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fe66407a170 con 0x7fe6740c2900 2023-05-17T15:10:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.753+0000 7fe67259c700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe65405ede0 0x7fe6540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:42.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.757+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe66404b530 con 0x7fe6740c2900 2023-05-17T15:10:42.808 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:42.805+0000 7f98e39aa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:42.842 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:42.838+0000 7ff26a6b4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:42.886 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:42.882+0000 7f98e39aa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:10:42.919 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:42.915+0000 7ff26a6b4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:10:42.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.932+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6740a5c80 con 0x7fe6740c2900 2023-05-17T15:10:42.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.933+0000 7fe6627fc700 1 -- 172.21.15.27:0/1335301545 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe66404eb50 con 0x7fe6740c2900 2023-05-17T15:10:42.937 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:10:42.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.934+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe65405ede0 msgr2=0x7fe6540612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.934+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe65405ede0 0x7fe6540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.934+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 msgr2=0x7fe6741512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.934+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe6741512b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fe66400e950 tx=0x7fe664009060).stop 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 shutdown_connections 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe65405ede0 0x7fe6540612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6741540a0 0x7fe6740bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe67405e240 0x7fe6740a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 --2- 172.21.15.27:0/1335301545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6740c2900 0x7fe6741512b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 >> 172.21.15.27:0/1335301545 conn(0x7fe6740c83d0 msgr2=0x7fe6740bc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 shutdown_connections 2023-05-17T15:10:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:42.935+0000 7fe6789e0700 1 -- 172.21.15.27:0/1335301545 wait complete. 2023-05-17T15:10:42.950 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:42.956 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:42.953+0000 7f98e39aa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:10:42.991 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:42.987+0000 7ff26a6b4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:10:43.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.064+0000 7fdb43882700 1 Processor -- start 2023-05-17T15:10:43.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.064+0000 7fdb43882700 1 -- start start 2023-05-17T15:10:43.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb43882700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb3c153e50 0x7fdb3c0a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb43882700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb3c0c6190 0x7fdb3c0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb43882700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3c158c10 con 0x7fdb3c154230 2023-05-17T15:10:43.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb43882700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3c158000 con 0x7fdb3c153e50 2023-05-17T15:10:43.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb43882700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3c1582e0 con 0x7fdb3c0c6190 2023-05-17T15:10:43.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb3c153e50 0x7fdb3c0a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb3c153e50 0x7fdb3c0a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43122/0 (socket says 172.21.15.27:43122) 2023-05-17T15:10:43.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 -- 172.21.15.27:0/663974748 learned_addr learned my addr 172.21.15.27:0/663974748 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb41e1f700 1 --2- 172.21.15.27:0/663974748 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c0c6190 0x7fdb3c0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 -- 172.21.15.27:0/663974748 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c0c6190 msgr2=0x7fdb3c0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 --2- 172.21.15.27:0/663974748 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c0c6190 0x7fdb3c0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 -- 172.21.15.27:0/663974748 >> v1:172.21.15.40:6789/0 conn(0x7fdb3c154230 legacy=0x7fdb3c0c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 -- 172.21.15.27:0/663974748 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c1585c0 con 0x7fdb3c153e50 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.065+0000 7fdb4161e700 1 --2- 172.21.15.27:0/663974748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c0a9d50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fdb3c0b0d10 tx=0x7fdb2c0090f0).ready entity=mon.0 client_cookie=7157515071db6f46 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:43.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb33fff700 1 -- 172.21.15.27:0/663974748 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00b520 con 0x7fdb3c153e50 2023-05-17T15:10:43.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb33fff700 1 -- 172.21.15.27:0/663974748 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00b680 con 0x7fdb3c153e50 2023-05-17T15:10:43.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb33fff700 1 -- 172.21.15.27:0/663974748 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00ba00 con 0x7fdb3c153e50 2023-05-17T15:10:43.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 -- 172.21.15.27:0/663974748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 msgr2=0x7fdb3c0a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 --2- 172.21.15.27:0/663974748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c0a9d50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fdb3c0b0d10 tx=0x7fdb2c0090f0).stop 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 -- 172.21.15.27:0/663974748 shutdown_connections 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 --2- 172.21.15.27:0/663974748 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c0c6190 0x7fdb3c0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 --2- 172.21.15.27:0/663974748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c0a9d50 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 -- 172.21.15.27:0/663974748 >> 172.21.15.27:0/663974748 conn(0x7fdb3c062440 msgr2=0x7fdb3c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 -- 172.21.15.27:0/663974748 shutdown_connections 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.066+0000 7fdb43882700 1 -- 172.21.15.27:0/663974748 wait complete. 2023-05-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.067+0000 7fdb43882700 1 Processor -- start 2023-05-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.067+0000 7fdb43882700 1 -- start start 2023-05-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb43882700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c0c6190 0x7fdb3c14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb43882700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb43882700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c154230 0x7fdb3c0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb43882700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c155e90 con 0x7fdb3c153e50 2023-05-17T15:10:43.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb43882700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c0c4720 con 0x7fdb3c154230 2023-05-17T15:10:43.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb43882700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c0c4a00 con 0x7fdb3c0c6190 2023-05-17T15:10:43.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.068+0000 7fdb40e1d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43130/0 (socket says 172.21.15.27:43130) 2023-05-17T15:10:43.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 -- 172.21.15.27:0/4038762524 learned_addr learned my addr 172.21.15.27:0/4038762524 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:43.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb41e1f700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c154230 0x7fdb3c0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb4161e700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c0c6190 0x7fdb3c14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 -- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c0c6190 msgr2=0x7fdb3c14d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c0c6190 0x7fdb3c14d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 -- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c154230 msgr2=0x7fdb3c0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c154230 0x7fdb3c0c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 -- 172.21.15.27:0/4038762524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c009370 con 0x7fdb3c153e50 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb41e1f700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c154230 0x7fdb3c0c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb40e1d700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c152aa0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fdb3800c440 tx=0x7fdb38007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38007020 con 0x7fdb3c153e50 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38007180 con 0x7fdb3c153e50 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3c0c4ce0 con 0x7fdb3c153e50 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38007520 con 0x7fdb3c153e50 2023-05-17T15:10:43.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.069+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c14dba0 con 0x7fdb3c153e50 2023-05-17T15:10:43.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.070+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3c156040 con 0x7fdb3c153e50 2023-05-17T15:10:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.071+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fdb38010070 con 0x7fdb3c153e50 2023-05-17T15:10:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.071+0000 7fdb317fa700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 0x7fdb200612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.071+0000 7fdb4161e700 1 -- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 msgr2=0x7fdb200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.071+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fdb38079650 con 0x7fdb3c153e50 2023-05-17T15:10:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.071+0000 7fdb4161e700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 0x7fdb200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.076+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb3c156040 con 0x7fdb3c153e50 2023-05-17T15:10:43.227 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:43.223+0000 7f98e39aa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:10:43.263 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:43.260+0000 7ff26a6b4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:10:43.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.272+0000 7fdb4161e700 1 -- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 msgr2=0x7fdb200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:43.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.272+0000 7fdb4161e700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 0x7fdb200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.289+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb3c062850 con 0x7fdb3c153e50 2023-05-17T15:10:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.289+0000 7fdb317fa700 1 -- 172.21.15.27:0/4038762524 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fdb3804a900 con 0x7fdb3c153e50 2023-05-17T15:10:43.293 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:43.294 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:21.665012+0000","modified":"2023-05-17T15:10:24.678553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2675320429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2675320429},{"type":"v1","addr":"172.21.15.40:6834","nonce":2675320429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-17T15:10:43.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.291+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 msgr2=0x7fdb200612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.291+0000 7fdb43882700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 0x7fdb200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.291+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 msgr2=0x7fdb3c152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.291+0000 7fdb43882700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c152aa0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fdb3800c440 tx=0x7fdb38007dd0).stop 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 shutdown_connections 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fdb2005ede0 0x7fdb200612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c154230 0x7fdb3c0c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c0c6190 0x7fdb3c14d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 --2- 172.21.15.27:0/4038762524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb3c153e50 0x7fdb3c152aa0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 >> 172.21.15.27:0/4038762524 conn(0x7fdb3c062440 msgr2=0x7fdb3c0aad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 shutdown_connections 2023-05-17T15:10:43.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.292+0000 7fdb43882700 1 -- 172.21.15.27:0/4038762524 wait complete. 2023-05-17T15:10:43.298 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 52 2023-05-17T15:10:43.308 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:43.415 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:43.411+0000 7f98e39aa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:43.456 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:43.452+0000 7ff26a6b4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:10:43.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.466+0000 7faf6bfff700 1 Processor -- start 2023-05-17T15:10:43.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.466+0000 7faf6bfff700 1 -- start start 2023-05-17T15:10:43.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf6c1544f0 0x7faf6c0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf6c0aa070 0x7faf6c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c1549b0 con 0x7faf6c0c1180 2023-05-17T15:10:43.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6bfff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c154c90 con 0x7faf6c0aa070 2023-05-17T15:10:43.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c154f70 con 0x7faf6c1544f0 2023-05-17T15:10:43.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf6c0aa070 0x7faf6c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf6c0aa070 0x7faf6c0c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43140/0 (socket says 172.21.15.27:43140) 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2701133098 learned_addr learned my addr 172.21.15.27:0/2701133098 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6a7fc700 1 --2- 172.21.15.27:0/2701133098 >> v2:172.21.15.40:3300/0 conn(0x7faf6c1544f0 0x7faf6c0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2701133098 >> v2:172.21.15.40:3300/0 conn(0x7faf6c1544f0 msgr2=0x7faf6c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 --2- 172.21.15.27:0/2701133098 >> v2:172.21.15.40:3300/0 conn(0x7faf6c1544f0 0x7faf6c0a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2701133098 >> v1:172.21.15.40:6789/0 conn(0x7faf6c0c1180 legacy=0x7faf6c0c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 -- 172.21.15.27:0/2701133098 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c155250 con 0x7faf6c0aa070 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf6b7fe700 1 --2- 172.21.15.27:0/2701133098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0aa070 0x7faf6c0c74a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7faf6c0c8580 tx=0x7faf64009840).ready entity=mon.0 client_cookie=5880b98af429248f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.467+0000 7faf69ffb700 1 -- 172.21.15.27:0/2701133098 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6400e070 con 0x7faf6c0aa070 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf69ffb700 1 -- 172.21.15.27:0/2701133098 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6400ba20 con 0x7faf6c0aa070 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf69ffb700 1 -- 172.21.15.27:0/2701133098 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6400bda0 con 0x7faf6c0aa070 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 -- 172.21.15.27:0/2701133098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0aa070 msgr2=0x7faf6c0c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 --2- 172.21.15.27:0/2701133098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0aa070 0x7faf6c0c74a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7faf6c0c8580 tx=0x7faf64009840).stop 2023-05-17T15:10:43.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 -- 172.21.15.27:0/2701133098 shutdown_connections 2023-05-17T15:10:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 --2- 172.21.15.27:0/2701133098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0aa070 0x7faf6c0c74a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 --2- 172.21.15.27:0/2701133098 >> v2:172.21.15.40:3300/0 conn(0x7faf6c1544f0 0x7faf6c0a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 -- 172.21.15.27:0/2701133098 >> 172.21.15.27:0/2701133098 conn(0x7faf6c05dd50 msgr2=0x7faf6c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 -- 172.21.15.27:0/2701133098 shutdown_connections 2023-05-17T15:10:43.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.468+0000 7faf6bfff700 1 -- 172.21.15.27:0/2701133098 wait complete. 2023-05-17T15:10:43.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.469+0000 7faf6bfff700 1 Processor -- start 2023-05-17T15:10:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.469+0000 7faf6bfff700 1 -- start start 2023-05-17T15:10:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c0aa070 0x7faf6c168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 0x7faf6c0a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf6c1544f0 0x7faf6c0c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6bfff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0c4a80 con 0x7faf6c0c1180 2023-05-17T15:10:43.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c1684f0 con 0x7faf6c0aa070 2023-05-17T15:10:43.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0c3e70 con 0x7faf6c1544f0 2023-05-17T15:10:43.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 0x7faf6c0a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 0x7faf6c0a8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43144/0 (socket says 172.21.15.27:43144) 2023-05-17T15:10:43.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6a7fc700 1 -- 172.21.15.27:0/536666988 learned_addr learned my addr 172.21.15.27:0/536666988 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:43.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6affd700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c0aa070 0x7faf6c168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.470+0000 7faf6b7fe700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf6c1544f0 0x7faf6c0c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6a7fc700 1 -- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf6c1544f0 msgr2=0x7faf6c0c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6a7fc700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf6c1544f0 0x7faf6c0c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6a7fc700 1 -- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c0aa070 msgr2=0x7faf6c168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6a7fc700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c0aa070 0x7faf6c168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6a7fc700 1 -- 172.21.15.27:0/536666988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64009ae0 con 0x7faf6c0c1180 2023-05-17T15:10:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6a7fc700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 0x7faf6c0a8dd0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7faf5c00e900 tx=0x7faf5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:43.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012600 con 0x7faf6c0c1180 2023-05-17T15:10:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c012760 con 0x7faf6c0c1180 2023-05-17T15:10:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c0c4150 con 0x7faf6c0c1180 2023-05-17T15:10:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012ae0 con 0x7faf6c0c1180 2023-05-17T15:10:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.471+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c0c4710 con 0x7faf6c0c1180 2023-05-17T15:10:43.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.472+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c0c4c30 con 0x7faf6c0c1180 2023-05-17T15:10:43.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.472+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7faf5c022070 con 0x7faf6c0c1180 2023-05-17T15:10:43.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.473+0000 7faf62ffd700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf4c05ede0 0x7faf4c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.473+0000 7faf6affd700 1 -- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf4c05ede0 msgr2=0x7faf4c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.473+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7faf5c079f20 con 0x7faf6c0c1180 2023-05-17T15:10:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.473+0000 7faf6affd700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf4c05ede0 0x7faf4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:43.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.477+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf5c0a88f0 con 0x7faf6c0c1180 2023-05-17T15:10:43.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.665+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf6c06bdf0 con 0x7faf6c0c1180 2023-05-17T15:10:43.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.666+0000 7faf62ffd700 1 -- 172.21.15.27:0/536666988 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+17345 (secure 0 0 0) 0x7faf5c04b2e0 con 0x7faf6c0c1180 2023-05-17T15:10:43.672 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:43.672 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":127,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:38.247557+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:19.299248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:20.644965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4125572758":"2023-05-18T15:10:38.247529+0000","172.21.15.27:0/3909417837":"2023-05-18T15:10:38.247529+0000","172.21.15.27:6837/86332":"2023-05-18T15:10:38.247529+0000","172.21.15.27:6836/86332":"2023-05-18T15:10:38.247529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:43.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf4c05ede0 msgr2=0x7faf4c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:43.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf4c05ede0 0x7faf4c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:43.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 msgr2=0x7faf6c0a8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 0x7faf6c0a8dd0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7faf5c00e900 tx=0x7faf5c009060).stop 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 shutdown_connections 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7faf4c05ede0 0x7faf4c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf6c1544f0 0x7faf6c0c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c0aa070 0x7faf6c168000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 --2- 172.21.15.27:0/536666988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf6c0c1180 0x7faf6c0a8dd0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 >> 172.21.15.27:0/536666988 conn(0x7faf6c05dd50 msgr2=0x7faf6c1556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:43.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 shutdown_connections 2023-05-17T15:10:43.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.668+0000 7faf6bfff700 1 -- 172.21.15.27:0/536666988 wait complete. 2023-05-17T15:10:43.685 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:10:43.686 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:43.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.799+0000 7fd6a9841700 1 Processor -- start 2023-05-17T15:10:43.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.799+0000 7fd6a9841700 1 -- start start 2023-05-17T15:10:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a9841700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a40c6310 0x7fd6a4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a9841700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6a41541c0 0x7fd6a40c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a9841700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a40bfcd0 con 0x7fd6a40c5f30 2023-05-17T15:10:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a9841700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40c0290 con 0x7fd6a41541c0 2023-05-17T15:10:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a9841700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a40aa1a0 con 0x7fd6a40c6310 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a2ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd6a40c5f30 0x7fd6a4158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42726/0 (socket says 172.21.15.27:42726) 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a2ffd700 1 -- 172.21.15.27:0/2951881830 learned_addr learned my addr 172.21.15.27:0/2951881830 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a37fe700 1 --2- 172.21.15.27:0/2951881830 >> v2:172.21.15.40:3300/0 conn(0x7fd6a41541c0 0x7fd6a40c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a27fc700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a40c6310 0x7fd6a4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a1ffb700 1 -- 172.21.15.27:0/2951881830 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481845515 0 0) 0x7fd6a40bfcd0 con 0x7fd6a40c5f30 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a1ffb700 1 -- 172.21.15.27:0/2951881830 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6900033f0 con 0x7fd6a40c5f30 2023-05-17T15:10:43.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a37fe700 1 -- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a40c6310 msgr2=0x7fd6a4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a37fe700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a40c6310 0x7fd6a4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a37fe700 1 -- 172.21.15.27:0/2951881830 >> v1:172.21.15.27:6789/0 conn(0x7fd6a40c5f30 legacy=0x7fd6a4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a1ffb700 1 -- 172.21.15.27:0/2951881830 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3975649990 0 0) 0x7fd6900033f0 con 0x7fd6a40c5f30 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a37fe700 1 -- 172.21.15.27:0/2951881830 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a40aa480 con 0x7fd6a41541c0 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.800+0000 7fd6a27fc700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a40c6310 0x7fd6a4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a37fe700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a41541c0 0x7fd6a40c0720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fd69c009e60 tx=0x7fd69c009780).ready entity=mon.1 client_cookie=18c63c409a22c735 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:43.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a1ffb700 1 -- 172.21.15.27:0/2951881830 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00e070 con 0x7fd6a41541c0 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a1ffb700 1 -- 172.21.15.27:0/2951881830 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c00b7a0 con 0x7fd6a41541c0 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a1ffb700 1 -- 172.21.15.27:0/2951881830 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694001470 con 0x7fd6a41541c0 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 -- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a41541c0 msgr2=0x7fd6a40c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a41541c0 0x7fd6a40c0720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fd69c009e60 tx=0x7fd69c009780).stop 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 -- 172.21.15.27:0/2951881830 shutdown_connections 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a41541c0 0x7fd6a40c0720 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 --2- 172.21.15.27:0/2951881830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a40c6310 0x7fd6a4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 -- 172.21.15.27:0/2951881830 >> 172.21.15.27:0/2951881830 conn(0x7fd6a4069e70 msgr2=0x7fd6a405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:43.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 -- 172.21.15.27:0/2951881830 shutdown_connections 2023-05-17T15:10:43.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.801+0000 7fd6a9841700 1 -- 172.21.15.27:0/2951881830 wait complete. 2023-05-17T15:10:43.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 Processor -- start 2023-05-17T15:10:43.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 -- start start 2023-05-17T15:10:43.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a40c5f30 0x7fd6a414e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 0x7fd6a4143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a41541c0 0x7fd6a40ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4167e60 con 0x7fd6a40c6310 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4168140 con 0x7fd6a40c5f30 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a9841700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4168420 con 0x7fd6a41541c0 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.803+0000 7fd6a27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 0x7fd6a4143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 0x7fd6a4143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43172/0 (socket says 172.21.15.27:43172) 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 -- 172.21.15.27:0/4186684825 learned_addr learned my addr 172.21.15.27:0/4186684825 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a2ffd700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a40c5f30 0x7fd6a414e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a37fe700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a41541c0 0x7fd6a40ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:43.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 -- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a41541c0 msgr2=0x7fd6a40ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a41541c0 0x7fd6a40ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 -- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a40c5f30 msgr2=0x7fd6a414e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:43.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a40c5f30 0x7fd6a414e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 -- 172.21.15.27:0/4186684825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0092a0 con 0x7fd6a40c6310 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a27fc700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 0x7fd6a4143700 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fd68c00ea20 tx=0x7fd68c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00ee60 con 0x7fd6a40c6310 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00c850 con 0x7fd6a40c6310 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00cbd0 con 0x7fd6a40c6310 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c009a20 con 0x7fd6a40c6310 2023-05-17T15:10:43.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.804+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a40c1e10 con 0x7fd6a40c6310 2023-05-17T15:10:43.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.805+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a405f4a0 con 0x7fd6a40c6310 2023-05-17T15:10:43.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.806+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd68c022070 con 0x7fd6a40c6310 2023-05-17T15:10:43.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.806+0000 7fd69affd700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 0x7fd6840612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:43.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.806+0000 7fd6a2ffd700 1 -- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 msgr2=0x7fd6840612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:43.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.806+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fd68c07a130 con 0x7fd6a40c6310 2023-05-17T15:10:43.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.806+0000 7fd6a2ffd700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 0x7fd6840612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:43.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:43.810+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd68c04b4f0 con 0x7fd6a40c6310 2023-05-17T15:10:44.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.007+0000 7fd6a2ffd700 1 -- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 msgr2=0x7fd6840612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:44.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.007+0000 7fd6a2ffd700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 0x7fd6840612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:44.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.027+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6a40c2000 con 0x7fd6a40c6310 2023-05-17T15:10:44.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.028+0000 7fd69affd700 1 -- 172.21.15.27:0/4186684825 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fd68c04eb10 con 0x7fd6a40c6310 2023-05-17T15:10:44.033 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:44.033 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:21.665012+0000","modified":"2023-05-17T15:10:24.678553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2675320429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2675320429},{"type":"v1","addr":"172.21.15.40:6834","nonce":2675320429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-17T15:10:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 msgr2=0x7fd6840612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 0x7fd6840612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 msgr2=0x7fd6a4143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 0x7fd6a4143700 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fd68c00ea20 tx=0x7fd68c009060).stop 2023-05-17T15:10:44.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 shutdown_connections 2023-05-17T15:10:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd68405ede0 0x7fd6840612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a41541c0 0x7fd6a40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a40c5f30 0x7fd6a414e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 --2- 172.21.15.27:0/4186684825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a40c6310 0x7fd6a4143700 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 >> 172.21.15.27:0/4186684825 conn(0x7fd6a4069e70 msgr2=0x7fd6a414f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:44.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 shutdown_connections 2023-05-17T15:10:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.030+0000 7fd6a9841700 1 -- 172.21.15.27:0/4186684825 wait complete. 2023-05-17T15:10:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 52 2023-05-17T15:10:44.048 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:44.094 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.091+0000 7f98e39aa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:10:44.156 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.151+0000 7ff26a6b4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:10:44.164 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.161+0000 7f98e39aa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:10:44.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.162+0000 7fc212caf700 1 Processor -- start 2023-05-17T15:10:44.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.162+0000 7fc212caf700 1 -- start start 2023-05-17T15:10:44.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc212caf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c0cb130 0x7fc20c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc212caf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c0c0120 con 0x7fc20c1571b0 2023-05-17T15:10:44.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc212caf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c158880 con 0x7fc20c157970 2023-05-17T15:10:44.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc212caf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c6e20 con 0x7fc20c0cb130 2023-05-17T15:10:44.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc211cad700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc20c1571b0 0x7fc20c0c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42742/0 (socket says 172.21.15.27:42742) 2023-05-17T15:10:44.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc211cad700 1 -- 172.21.15.27:0/4285605787 learned_addr learned my addr 172.21.15.27:0/4285605787 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:44.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc2124ae700 1 --2- 172.21.15.27:0/4285605787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c0cb130 0x7fc20c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321988537 0 0) 0x7fc20c0c0120 con 0x7fc20c1571b0 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.163+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f80033f0 con 0x7fc20c1571b0 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593240527 0 0) 0x7fc20c158880 con 0x7fc20c157970 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc20c0c0120 con 0x7fc20c157970 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc2124ae700 1 -- 172.21.15.27:0/4285605787 >> v1:172.21.15.40:6789/0 conn(0x7fc20c157970 legacy=0x7fc20c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc2124ae700 1 -- 172.21.15.27:0/4285605787 >> v1:172.21.15.27:6789/0 conn(0x7fc20c1571b0 legacy=0x7fc20c0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695689763 0 0) 0x7fc1f80033f0 con 0x7fc20c1571b0 2023-05-17T15:10:44.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc2124ae700 1 -- 172.21.15.27:0/4285605787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c157fe0 con 0x7fc20c0cb130 2023-05-17T15:10:44.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc2124ae700 1 --2- 172.21.15.27:0/4285605787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c0cb130 0x7fc20c15ed10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc204009e90 tx=0x7fc204009780).ready entity=mon.2 client_cookie=8b89ec19e9b1e831 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:44.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20400e070 con 0x7fc20c0cb130 2023-05-17T15:10:44.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20400b7a0 con 0x7fc20c0cb130 2023-05-17T15:10:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.164+0000 7fc210cab700 1 -- 172.21.15.27:0/4285605787 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc001470 con 0x7fc20c0cb130 2023-05-17T15:10:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 -- 172.21.15.27:0/4285605787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c0cb130 msgr2=0x7fc20c15ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 --2- 172.21.15.27:0/4285605787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c0cb130 0x7fc20c15ed10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc204009e90 tx=0x7fc204009780).stop 2023-05-17T15:10:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 -- 172.21.15.27:0/4285605787 shutdown_connections 2023-05-17T15:10:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 --2- 172.21.15.27:0/4285605787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c0cb130 0x7fc20c15ed10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 -- 172.21.15.27:0/4285605787 >> 172.21.15.27:0/4285605787 conn(0x7fc20c05dd50 msgr2=0x7fc20c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 -- 172.21.15.27:0/4285605787 shutdown_connections 2023-05-17T15:10:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.165+0000 7fc212caf700 1 -- 172.21.15.27:0/4285605787 wait complete. 2023-05-17T15:10:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.166+0000 7fc212caf700 1 Processor -- start 2023-05-17T15:10:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.166+0000 7fc212caf700 1 -- start start 2023-05-17T15:10:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.166+0000 7fc212caf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 0x7fc20c1681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.166+0000 7fc212caf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c1571b0 0x7fc20c0ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.166+0000 7fc212caf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc20c157970 0x7fc20c13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc212caf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0ad2b0 con 0x7fc20c0cb130 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc212caf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0ac210 con 0x7fc20c157970 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc212caf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0ac4f0 con 0x7fc20c1571b0 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 0x7fc20c1681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 0x7fc20c1681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43186/0 (socket says 172.21.15.27:43186) 2023-05-17T15:10:44.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 -- 172.21.15.27:0/3000783674 learned_addr learned my addr 172.21.15.27:0/3000783674 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:44.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc2114ac700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c1571b0 0x7fc20c0ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc2124ae700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc20c157970 0x7fc20c13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 -- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c1571b0 msgr2=0x7fc20c0ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c1571b0 0x7fc20c0ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 -- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc20c157970 msgr2=0x7fc20c13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc20c157970 0x7fc20c13ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 -- 172.21.15.27:0/3000783674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204009a20 con 0x7fc20c0cb130 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc211cad700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 0x7fc20c1681f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fc1fc00c760 tx=0x7fc1fc001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc007170 con 0x7fc20c0cb130 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0072d0 con 0x7fc20c0cb130 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c0ac7d0 con 0x7fc20c0cb130 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0048c0 con 0x7fc20c0cb130 2023-05-17T15:10:44.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.167+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c0acd90 con 0x7fc20c0cb130 2023-05-17T15:10:44.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.168+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c06bdf0 con 0x7fc20c0cb130 2023-05-17T15:10:44.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.169+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc1fc004cb0 con 0x7fc20c0cb130 2023-05-17T15:10:44.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.169+0000 7fc201ffb700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 0x7fc1f0061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.169+0000 7fc2114ac700 1 -- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 msgr2=0x7fc1f0061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:44.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.169+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fc1fc079a60 con 0x7fc20c0cb130 2023-05-17T15:10:44.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.169+0000 7fc2114ac700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 0x7fc1f0061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:44.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.177+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1fc04ad10 con 0x7fc20c0cb130 2023-05-17T15:10:44.233 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.228+0000 7ff26a6b4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:10:44.242 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.238+0000 7f98e39aa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:10:44.311 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.306+0000 7ff26a6b4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:10:44.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.370+0000 7fc2114ac700 1 -- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 msgr2=0x7fc1f0061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:44.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.370+0000 7fc2114ac700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 0x7fc1f0061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:44.394 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.390+0000 7f98e39aa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:10:44.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.393+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc20c0c1930 con 0x7fc20c0cb130 2023-05-17T15:10:44.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.393+0000 7fc201ffb700 1 -- 172.21.15.27:0/3000783674 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fc1fc04e330 con 0x7fc20c0cb130 2023-05-17T15:10:44.398 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:44.399 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:21.665012+0000","modified":"2023-05-17T15:10:24.678553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2675320429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2675320429},{"type":"v1","addr":"172.21.15.40:6834","nonce":2675320429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-17T15:10:44.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 msgr2=0x7fc1f0061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:44.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 0x7fc1f0061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:44.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 msgr2=0x7fc20c1681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 0x7fc20c1681f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fc1fc00c760 tx=0x7fc1fc001b00).stop 2023-05-17T15:10:44.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 shutdown_connections 2023-05-17T15:10:44.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc1f005edb0 0x7fc1f0061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:44.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc20c157970 0x7fc20c13ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc20c0cb130 0x7fc20c1681f0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 --2- 172.21.15.27:0/3000783674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc20c1571b0 0x7fc20c0ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.395+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 >> 172.21.15.27:0/3000783674 conn(0x7fc20c05dd50 msgr2=0x7fc20c0aae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:44.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.396+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 shutdown_connections 2023-05-17T15:10:44.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.396+0000 7fc212caf700 1 -- 172.21.15.27:0/3000783674 wait complete. 2023-05-17T15:10:44.404 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 52 2023-05-17T15:10:44.413 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:44.466 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.461+0000 7ff26a6b4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:10:44.468 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.463+0000 7f98e39aa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:10:44.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.526+0000 7f3232e7e700 1 Processor -- start 2023-05-17T15:10:44.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.526+0000 7f3232e7e700 1 -- start start 2023-05-17T15:10:44.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3232e7e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 0x7f322c068250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3232e7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 0x7f322c139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3232e7e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0653b0 con 0x7f322c13a480 2023-05-17T15:10:44.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3232e7e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c0bcf60 con 0x7f322c067e70 2023-05-17T15:10:44.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3232e7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0bc980 con 0x7f322c155370 2023-05-17T15:10:44.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3230c1a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 0x7f322c068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f322bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 0x7f322c139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3230c1a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 0x7f322c068250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:32894/0 (socket says 172.21.15.27:32894) 2023-05-17T15:10:44.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f322bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 0x7f322c139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:44308/0 (socket says 172.21.15.27:44308) 2023-05-17T15:10:44.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.528+0000 7f3230c1a700 1 -- 172.21.15.27:0/698194142 learned_addr learned my addr 172.21.15.27:0/698194142 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:44.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322bfff700 1 -- 172.21.15.27:0/698194142 >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 msgr2=0x7f322c068250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:44.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322bfff700 1 --2- 172.21.15.27:0/698194142 >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 0x7f322c068250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322bfff700 1 -- 172.21.15.27:0/698194142 >> v1:172.21.15.40:6789/0 conn(0x7f322c13a480 legacy=0x7f322c0c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322bfff700 1 -- 172.21.15.27:0/698194142 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c13a910 con 0x7f322c155370 2023-05-17T15:10:44.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f3230c1a700 1 --2- 172.21.15.27:0/698194142 >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 0x7f322c068250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:44.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322bfff700 1 --2- 172.21.15.27:0/698194142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 0x7f322c139f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3218009760 tx=0x7f3218009060).ready entity=mon.2 client_cookie=23f3bd5f1e5d02a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:44.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322b7fe700 1 -- 172.21.15.27:0/698194142 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800f510 con 0x7f322c155370 2023-05-17T15:10:44.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322b7fe700 1 -- 172.21.15.27:0/698194142 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800f670 con 0x7f322c155370 2023-05-17T15:10:44.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.529+0000 7f322b7fe700 1 -- 172.21.15.27:0/698194142 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800f9f0 con 0x7f322c155370 2023-05-17T15:10:44.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 -- 172.21.15.27:0/698194142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 msgr2=0x7f322c139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 --2- 172.21.15.27:0/698194142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 0x7f322c139f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3218009760 tx=0x7f3218009060).stop 2023-05-17T15:10:44.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 -- 172.21.15.27:0/698194142 shutdown_connections 2023-05-17T15:10:44.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 --2- 172.21.15.27:0/698194142 >> v2:172.21.15.40:3300/0 conn(0x7f322c067e70 0x7f322c068250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 --2- 172.21.15.27:0/698194142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c155370 0x7f322c139f90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 -- 172.21.15.27:0/698194142 >> 172.21.15.27:0/698194142 conn(0x7f322c0c7980 msgr2=0x7f322c0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:44.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 -- 172.21.15.27:0/698194142 shutdown_connections 2023-05-17T15:10:44.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.530+0000 7f3232e7e700 1 -- 172.21.15.27:0/698194142 wait complete. 2023-05-17T15:10:44.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.532+0000 7f3232e7e700 1 Processor -- start 2023-05-17T15:10:44.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.532+0000 7f3232e7e700 1 -- start start 2023-05-17T15:10:44.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3232e7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 0x7f322c160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3232e7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c13a480 0x7f322c0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3232e7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f322c155370 0x7f322c138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3232e7e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0c66b0 con 0x7f322c155370 2023-05-17T15:10:44.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3232e7e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0ac5c0 con 0x7f322c067e70 2023-05-17T15:10:44.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3232e7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0ac8a0 con 0x7f322c13a480 2023-05-17T15:10:44.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3230c1a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 0x7f322c160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f323141b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f322c155370 0x7f322c138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3230c1a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 0x7f322c160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:32900/0 (socket says 172.21.15.27:32900) 2023-05-17T15:10:44.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f3230c1a700 1 -- 172.21.15.27:0/2459223794 learned_addr learned my addr 172.21.15.27:0/2459223794 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:44.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.533+0000 7f322bfff700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c13a480 0x7f322c0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3230c1a700 1 -- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c13a480 msgr2=0x7f322c0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3230c1a700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c13a480 0x7f322c0ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3230c1a700 1 -- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f322c155370 msgr2=0x7f322c138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3230c1a700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f322c155370 0x7f322c138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3230c1a700 1 -- 172.21.15.27:0/2459223794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322000b610 con 0x7f322c067e70 2023-05-17T15:10:44.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3230c1a700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 0x7f322c160a20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f3220010e90 tx=0x7f322000b3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:44.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000ed40 con 0x7f322c067e70 2023-05-17T15:10:44.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322001a470 con 0x7f322c067e70 2023-05-17T15:10:44.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180092a0 con 0x7f322c067e70 2023-05-17T15:10:44.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000eea0 con 0x7f322c067e70 2023-05-17T15:10:44.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.534+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c0ad590 con 0x7f322c067e70 2023-05-17T15:10:44.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.535+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c0acd40 con 0x7f322c067e70 2023-05-17T15:10:44.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.536+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f3220021060 con 0x7f322c067e70 2023-05-17T15:10:44.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.536+0000 7f3228ff9700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f321005ede0 0x7f32100612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.536+0000 7f322bfff700 1 -- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f321005ede0 msgr2=0x7f32100612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:44.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.536+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f322007cd20 con 0x7f322c067e70 2023-05-17T15:10:44.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.536+0000 7f322bfff700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f321005ede0 0x7f32100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:44.556 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.539+0000 7ff26a6b4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:10:44.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.544+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f322004e0e0 con 0x7f322c067e70 2023-05-17T15:10:44.590 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.586+0000 7f98e39aa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:10:44.665 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.660+0000 7ff26a6b4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:10:44.704 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.699+0000 7f98e39aa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:44.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.719+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f322c0acef0 con 0x7f322c067e70 2023-05-17T15:10:44.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.721+0000 7f3228ff9700 1 -- 172.21.15.27:0/2459223794 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+17345 (secure 0 0 0) 0x7f322001f070 con 0x7f322c067e70 2023-05-17T15:10:44.726 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:44.726 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":127,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:38.247557+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:19.299248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:20.644965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/4125572758":"2023-05-18T15:10:38.247529+0000","172.21.15.27:0/3909417837":"2023-05-18T15:10:38.247529+0000","172.21.15.27:6837/86332":"2023-05-18T15:10:38.247529+0000","172.21.15.27:6836/86332":"2023-05-18T15:10:38.247529+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f321005ede0 msgr2=0x7f32100612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f321005ede0 0x7f32100612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 msgr2=0x7f322c160a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 0x7f322c160a20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f3220010e90 tx=0x7f322000b3b0).stop 2023-05-17T15:10:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 shutdown_connections 2023-05-17T15:10:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f321005ede0 0x7f32100612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f322c155370 0x7f322c138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f322c067e70 0x7f322c160a20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 --2- 172.21.15.27:0/2459223794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f322c13a480 0x7f322c0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 >> 172.21.15.27:0/2459223794 conn(0x7f322c0c7980 msgr2=0x7f322c1548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 shutdown_connections 2023-05-17T15:10:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.723+0000 7f3232e7e700 1 -- 172.21.15.27:0/2459223794 wait complete. 2023-05-17T15:10:44.740 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:10:44.781 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:44.776+0000 7ff26a6b4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:10:44.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.856+0000 7f4f09dd6700 1 Processor -- start 2023-05-17T15:10:44.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.856+0000 7f4f09dd6700 1 -- start start 2023-05-17T15:10:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.856+0000 7f4f09dd6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4f040a7e90 0x7f4f040c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.856+0000 7f4f09dd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f04156170 0x7f4f040bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f09dd6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f04156830 con 0x7f4f040c3f20 2023-05-17T15:10:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f09dd6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040bdab0 con 0x7f4f040a7e90 2023-05-17T15:10:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f09dd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04065e90 con 0x7f4f04156170 2023-05-17T15:10:44.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4f040a7e90 0x7f4f040c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4f040a7e90 0x7f4f040c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43210/0 (socket says 172.21.15.27:43210) 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 -- 172.21.15.27:0/3782330071 learned_addr learned my addr 172.21.15.27:0/3782330071 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f03fff700 1 --2- 172.21.15.27:0/3782330071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f04156170 0x7f4f040bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 -- 172.21.15.27:0/3782330071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f04156170 msgr2=0x7f4f040bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 --2- 172.21.15.27:0/3782330071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f04156170 0x7f4f040bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 -- 172.21.15.27:0/3782330071 >> v1:172.21.15.40:6789/0 conn(0x7f4f040c3f20 legacy=0x7f4f04155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 -- 172.21.15.27:0/3782330071 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04066170 con 0x7f4f040a7e90 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f037fe700 1 --2- 172.21.15.27:0/3782330071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040a7e90 0x7f4f040c3a30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f4eec006fd0 tx=0x7f4eec0090f0).ready entity=mon.0 client_cookie=732f70e3127c8903 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f027fc700 1 -- 172.21.15.27:0/3782330071 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00b580 con 0x7f4f040a7e90 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f027fc700 1 -- 172.21.15.27:0/3782330071 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00b6e0 con 0x7f4f040a7e90 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.857+0000 7f4f027fc700 1 -- 172.21.15.27:0/3782330071 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00ba60 con 0x7f4f040a7e90 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 -- 172.21.15.27:0/3782330071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040a7e90 msgr2=0x7f4f040c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/3782330071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040a7e90 0x7f4f040c3a30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f4eec006fd0 tx=0x7f4eec0090f0).stop 2023-05-17T15:10:44.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 -- 172.21.15.27:0/3782330071 shutdown_connections 2023-05-17T15:10:44.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/3782330071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f04156170 0x7f4f040bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/3782330071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f040a7e90 0x7f4f040c3a30 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 -- 172.21.15.27:0/3782330071 >> 172.21.15.27:0/3782330071 conn(0x7f4f040c94b0 msgr2=0x7f4f040c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:44.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 -- 172.21.15.27:0/3782330071 shutdown_connections 2023-05-17T15:10:44.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.858+0000 7f4f09dd6700 1 -- 172.21.15.27:0/3782330071 wait complete. 2023-05-17T15:10:44.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.859+0000 7f4f09dd6700 1 Processor -- start 2023-05-17T15:10:44.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.859+0000 7f4f09dd6700 1 -- start start 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f09dd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040a7e90 0x7f4f04068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f09dd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040c3f20 0x7f4f04068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f09dd6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 0x7f4f04069030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f09dd6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0414d2c0 con 0x7f4f04156170 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f09dd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040681c0 con 0x7f4f040a7e90 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f09dd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040a7970 con 0x7f4f040c3f20 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f03fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 0x7f4f04069030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f03fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 0x7f4f04069030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43220/0 (socket says 172.21.15.27:43220) 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f03fff700 1 -- 172.21.15.27:0/1410210961 learned_addr learned my addr 172.21.15.27:0/1410210961 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f037fe700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040a7e90 0x7f4f04068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.860+0000 7f4f02ffd700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040c3f20 0x7f4f04068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f03fff700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040c3f20 msgr2=0x7f4f04068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f03fff700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040c3f20 0x7f4f04068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f03fff700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040a7e90 msgr2=0x7f4f04068650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:44.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f03fff700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040a7e90 0x7f4f04068650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f03fff700 1 -- 172.21.15.27:0/1410210961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009370 con 0x7f4f04156170 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f037fe700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040a7e90 0x7f4f04068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f03fff700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 0x7f4f04069030 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f4efc009d70 tx=0x7f4efc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00caa0 con 0x7f4f04156170 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00f040 con 0x7f4f04156170 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0414cd00 con 0x7f4f04156170 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00ce10 con 0x7f4f04156170 2023-05-17T15:10:44.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.861+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f04067e50 con 0x7f4f04156170 2023-05-17T15:10:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.862+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f04067cb0 con 0x7f4f04156170 2023-05-17T15:10:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.862+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 51) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f4efc013610 con 0x7f4f04156170 2023-05-17T15:10:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.863+0000 7f4efb7fe700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.863+0000 7f4f037fe700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 msgr2=0x7f4ee40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.863+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f4efc07a5d0 con 0x7f4f04156170 2023-05-17T15:10:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.863+0000 7f4f037fe700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:10:44.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:44.870+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f04067cb0 con 0x7f4f04156170 2023-05-17T15:10:45.002 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:44.998+0000 7f98e39aa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:10:45.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.064+0000 7f4f037fe700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 msgr2=0x7f4ee40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:45.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.064+0000 7f4f037fe700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:10:45.074 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:10:45.071+0000 7f98e39aa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:10:45.088 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.083+0000 7ff26a6b4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:10:45.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.092+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f04067cb0 con 0x7f4f04156170 2023-05-17T15:10:45.163 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.158+0000 7ff26a6b4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:10:45.184 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:10:45.180+0000 7f26d3b13700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:45.185 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:10:45.180+0000 7f26d3b13700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:45.185 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-05-17T15:10:45.180+0000 7f26d3b13700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:10:45.188 INFO:tasks.ceph.mds.d.smithi040.stderr: -2288> 2023-05-17T15:10:26.679+0000 7f26d731a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:10:45.191 INFO:tasks.ceph.mds.d.smithi040.stderr: -5> 2023-05-17T15:10:45.180+0000 7f26d3b13700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:45.191 INFO:tasks.ceph.mds.d.smithi040.stderr: -4> 2023-05-17T15:10:45.180+0000 7f26d3b13700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:10:45.191 INFO:tasks.ceph.mds.d.smithi040.stderr: -1> 2023-05-17T15:10:45.180+0000 7f26d3b13700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:10:45.209 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:10:45.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.465+0000 7f4f037fe700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 msgr2=0x7f4ee40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:10:45.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.465+0000 7f4f037fe700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:10:45.680 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:10:45.674+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:10:45.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.676+0000 7f4efb7fe700 1 -- 172.21.15.27:0/1410210961 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4f04067cb0 con 0x7f4f04156170 2023-05-17T15:10:45.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.678+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 msgr2=0x7f4ee40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:10:45.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.678+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:45.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 msgr2=0x7f4f04069030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:45.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 0x7f4f04069030 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f4efc009d70 tx=0x7f4efc00b040).stop 2023-05-17T15:10:45.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 shutdown_connections 2023-05-17T15:10:45.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:45.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f04156170 0x7f4f04069030 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040a7e90 0x7f4f04068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 --2- 172.21.15.27:0/1410210961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f040c3f20 0x7f4f04068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 >> 172.21.15.27:0/1410210961 conn(0x7f4f040c94b0 msgr2=0x7f4f040c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:45.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 shutdown_connections 2023-05-17T15:10:45.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.679+0000 7f4f09dd6700 1 -- 172.21.15.27:0/1410210961 wait complete. 2023-05-17T15:10:45.685 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:10:45.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:10:45.740 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1ece9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1ece9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1ece9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1ece9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1ece9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1e9e98700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1e9e98700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.742 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1e9e98700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.742 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1e9e98700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.742 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:10:45.735+0000 7ff1e9e98700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:10:45.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.854+0000 7f9f9544a700 1 Processor -- start 2023-05-17T15:10:45.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.854+0000 7f9f9544a700 1 -- start start 2023-05-17T15:10:45.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f9544a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90154090 0x7f9f90154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:45.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f9544a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f900cb450 0x7f9f900cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:45.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f9544a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f90068f00 0x7f9f900693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f9544a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f90069fa0 con 0x7f9f900cb450 2023-05-17T15:10:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f9544a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900698a0 con 0x7f9f90068f00 2023-05-17T15:10:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f9544a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c5a50 con 0x7f9f90154090 2023-05-17T15:10:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f900cb450 0x7f9f900cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f900cb450 0x7f9f900cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43290/0 (socket says 172.21.15.27:43290) 2023-05-17T15:10:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/1775122571 learned_addr learned my addr 172.21.15.27:0/1775122571 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8effd700 1 --2- 172.21.15.27:0/1775122571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90154090 0x7f9f90154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8f7fe700 1 --2- 172.21.15.27:0/1775122571 >> v2:172.21.15.40:3300/0 conn(0x7f9f90068f00 0x7f9f900693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/1775122571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90154090 msgr2=0x7f9f90154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 --2- 172.21.15.27:0/1775122571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90154090 0x7f9f90154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/1775122571 >> v2:172.21.15.40:3300/0 conn(0x7f9f90068f00 msgr2=0x7f9f900693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 --2- 172.21.15.27:0/1775122571 >> v2:172.21.15.40:3300/0 conn(0x7f9f90068f00 0x7f9f900693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.855+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/1775122571 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900c04e0 con 0x7f9f900cb450 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f8e7fc700 1 --2- 172.21.15.27:0/1775122571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f900cb8d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f9f84006fd0 tx=0x7f9f840090f0).ready entity=mon.0 client_cookie=17de49e3a611620b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f8dffb700 1 -- 172.21.15.27:0/1775122571 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400b600 con 0x7f9f900cb450 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f8dffb700 1 -- 172.21.15.27:0/1775122571 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8400b760 con 0x7f9f900cb450 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f8dffb700 1 -- 172.21.15.27:0/1775122571 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400bae0 con 0x7f9f900cb450 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 -- 172.21.15.27:0/1775122571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 msgr2=0x7f9f900cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 --2- 172.21.15.27:0/1775122571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f900cb8d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f9f84006fd0 tx=0x7f9f840090f0).stop 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 -- 172.21.15.27:0/1775122571 shutdown_connections 2023-05-17T15:10:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 --2- 172.21.15.27:0/1775122571 >> v2:172.21.15.40:3300/0 conn(0x7f9f90068f00 0x7f9f900693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 --2- 172.21.15.27:0/1775122571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90154090 0x7f9f90154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 --2- 172.21.15.27:0/1775122571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f900cb8d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 -- 172.21.15.27:0/1775122571 >> 172.21.15.27:0/1775122571 conn(0x7f9f9005e7e0 msgr2=0x7f9f900cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 -- 172.21.15.27:0/1775122571 shutdown_connections 2023-05-17T15:10:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.856+0000 7f9f9544a700 1 -- 172.21.15.27:0/1775122571 wait complete. 2023-05-17T15:10:45.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 Processor -- start 2023-05-17T15:10:45.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 -- start start 2023-05-17T15:10:45.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90068f00 0x7f9f900c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f901501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f90154090 0x7f9f90166a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c2db0 con 0x7f9f900cb450 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c3c10 con 0x7f9f90154090 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f9544a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c3000 con 0x7f9f90068f00 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f8e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f901501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f8e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f901501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43300/0 (socket says 172.21.15.27:43300) 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.858+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/771413928 learned_addr learned my addr 172.21.15.27:0/771413928 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8effd700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90068f00 0x7f9f900c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8f7fe700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f90154090 0x7f9f90166a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90068f00 msgr2=0x7f9f900c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8e7fc700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90068f00 0x7f9f900c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f90154090 msgr2=0x7f9f90166a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8e7fc700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f90154090 0x7f9f90166a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:45.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8e7fc700 1 -- 172.21.15.27:0/771413928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009370 con 0x7f9f900cb450 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f8e7fc700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f901501d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f9f84009f50 tx=0x7f9f84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400bea0 con 0x7f9f900cb450 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8400b8d0 con 0x7f9f900cb450 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8401c670 con 0x7f9f900cb450 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f900c32e0 con 0x7f9f900cb450 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.859+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900c38a0 con 0x7f9f900cb450 2023-05-17T15:10:45.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.860+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9006bdf0 con 0x7f9f900cb450 2023-05-17T15:10:45.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.860+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 52) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f9f8402c070 con 0x7f9f900cb450 2023-05-17T15:10:45.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.861+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f9f8407b900 con 0x7f9f900cb450 2023-05-17T15:10:45.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:45.865+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f8404cd00 con 0x7f9f900cb450 2023-05-17T15:10:46.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.082+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9f90068ae0 con 0x7f9f900cb450 2023-05-17T15:10:46.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.688+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 53) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f9f8407dd70 con 0x7f9f900cb450 2023-05-17T15:10:46.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.688+0000 7f9f76ffd700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f7c0301b0 0x7f9f7c0678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:46.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.689+0000 7f9f8effd700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f7c0301b0 0x7f9f7c0678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:46.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.691+0000 7f9f8effd700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f7c0301b0 0x7f9f7c0678f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9f8800bb10 tx=0x7f9f88008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:46.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.693+0000 7f9f76ffd700 1 -- 172.21.15.27:0/771413928 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9f84054790 con 0x7f9f900cb450 2023-05-17T15:10:46.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f7c0301b0 msgr2=0x7f9f7c0678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:46.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f7c0301b0 0x7f9f7c0678f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9f8800bb10 tx=0x7f9f88008040).stop 2023-05-17T15:10:46.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 msgr2=0x7f9f901501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:46.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f901501d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f9f84009f50 tx=0x7f9f84017000).stop 2023-05-17T15:10:46.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 shutdown_connections 2023-05-17T15:10:46.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9f7c0301b0 0x7f9f7c0678f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f90154090 0x7f9f90166a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f90068f00 0x7f9f900c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 --2- 172.21.15.27:0/771413928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f900cb450 0x7f9f901501d0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 >> 172.21.15.27:0/771413928 conn(0x7f9f9005e7e0 msgr2=0x7f9f900caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:46.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 shutdown_connections 2023-05-17T15:10:46.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.695+0000 7f9f9544a700 1 -- 172.21.15.27:0/771413928 wait complete. 2023-05-17T15:10:46.713 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:10:46.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.828+0000 7f9b9cf52700 1 Processor -- start 2023-05-17T15:10:46.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.828+0000 7f9b9cf52700 1 -- start start 2023-05-17T15:10:46.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.829+0000 7f9b9cf52700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9b98153f80 0x7f9b98064cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:46.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.829+0000 7f9b9cf52700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b98063f70 con 0x7f9b9805e460 2023-05-17T15:10:46.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.829+0000 7f9b9cf52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b98158980 con 0x7f9b980c50b0 2023-05-17T15:10:46.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.829+0000 7f9b9cf52700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b980bdcc0 con 0x7f9b98153f80 2023-05-17T15:10:46.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9b98153f80 0x7f9b98064cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:46.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9b98153f80 0x7f9b98064cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43324/0 (socket says 172.21.15.27:43324) 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 -- 172.21.15.27:0/59811867 learned_addr learned my addr 172.21.15.27:0/59811867 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 -- 172.21.15.27:0/59811867 >> v1:172.21.15.40:6789/0 conn(0x7f9b980c50b0 legacy=0x7f9b9805dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 -- 172.21.15.27:0/59811867 >> v1:172.21.15.27:6789/0 conn(0x7f9b9805e460 legacy=0x7f9b980c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 -- 172.21.15.27:0/59811867 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98064210 con 0x7f9b98153f80 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9659c700 1 --2- 172.21.15.27:0/59811867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b98153f80 0x7f9b98064cf0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f9b90009f20 tx=0x7f9b90009840).ready entity=mon.0 client_cookie=aee8bb44271cae42 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9559a700 1 -- 172.21.15.27:0/59811867 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000e070 con 0x7f9b98153f80 2023-05-17T15:10:46.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9559a700 1 -- 172.21.15.27:0/59811867 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9000ba40 con 0x7f9b98153f80 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.830+0000 7f9b9559a700 1 -- 172.21.15.27:0/59811867 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000bdc0 con 0x7f9b98153f80 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 -- 172.21.15.27:0/59811867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b98153f80 msgr2=0x7f9b98064cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/59811867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b98153f80 0x7f9b98064cf0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f9b90009f20 tx=0x7f9b90009840).stop 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 -- 172.21.15.27:0/59811867 shutdown_connections 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/59811867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b98153f80 0x7f9b98064cf0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 -- 172.21.15.27:0/59811867 >> 172.21.15.27:0/59811867 conn(0x7f9b980c84a0 msgr2=0x7f9b980c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 -- 172.21.15.27:0/59811867 shutdown_connections 2023-05-17T15:10:46.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.831+0000 7f9b9cf52700 1 -- 172.21.15.27:0/59811867 wait complete. 2023-05-17T15:10:46.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.832+0000 7f9b9cf52700 1 Processor -- start 2023-05-17T15:10:46.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.832+0000 7f9b9cf52700 1 -- start start 2023-05-17T15:10:46.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 0x7f9b980a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:46.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b980c50b0 0x7f9b98164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:46.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b98153f80 0x7f9b9814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:46.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9814d320 con 0x7f9b9805e460 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980a5090 con 0x7f9b98153f80 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980a5650 con 0x7f9b980c50b0 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 0x7f9b980a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 0x7f9b980a4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43328/0 (socket says 172.21.15.27:43328) 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 -- 172.21.15.27:0/2652515061 learned_addr learned my addr 172.21.15.27:0/2652515061 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b96d9d700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b98153f80 0x7f9b9814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:46.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b95d9b700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b980c50b0 0x7f9b98164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 -- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b980c50b0 msgr2=0x7f9b98164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b980c50b0 0x7f9b98164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 -- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b98153f80 msgr2=0x7f9b9814ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b98153f80 0x7f9b9814ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 -- 172.21.15.27:0/2652515061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90009ae0 con 0x7f9b9805e460 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9659c700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 0x7f9b980a4a90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f9b980aa700 tx=0x7f9b90009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000bc80 con 0x7f9b9805e460 2023-05-17T15:10:46.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9000bde0 con 0x7f9b9805e460 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b98157480 con 0x7f9b9805e460 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9001d620 con 0x7f9b9805e460 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.833+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980a52e0 con 0x7f9b9805e460 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.834+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b981579a0 con 0x7f9b9805e460 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.835+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 53) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f9b9001b040 con 0x7f9b9805e460 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.835+0000 7f9b867fc700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9b7805ecc0 0x7f9b78061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:46.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.835+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f9b9007b860 con 0x7f9b9805e460 2023-05-17T15:10:46.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.835+0000 7f9b95d9b700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9b7805ecc0 0x7f9b78061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:46.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.835+0000 7f9b95d9b700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9b7805ecc0 0x7f9b78061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9b9814f150 tx=0x7f9b8c008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:46.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:46.839+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b9004cb50 con 0x7f9b9805e460 2023-05-17T15:10:47.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.016+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b981579a0 con 0x7f9b9805e460 2023-05-17T15:10:47.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.699+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9b900794b0 con 0x7f9b9805e460 2023-05-17T15:10:47.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.705+0000 7f9b867fc700 1 -- 172.21.15.27:0/2652515061 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v130) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9b90042910 con 0x7f9b9805e460 2023-05-17T15:10:47.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9b7805ecc0 msgr2=0x7f9b78061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:47.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9b7805ecc0 0x7f9b78061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9b9814f150 tx=0x7f9b8c008040).stop 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 msgr2=0x7f9b980a4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 0x7f9b980a4a90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f9b980aa700 tx=0x7f9b90009840).stop 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 shutdown_connections 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f9b7805ecc0 0x7f9b78061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b98153f80 0x7f9b9814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b9805e460 0x7f9b980a4a90 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 --2- 172.21.15.27:0/2652515061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b980c50b0 0x7f9b98164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.707+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 >> 172.21.15.27:0/2652515061 conn(0x7f9b980c84a0 msgr2=0x7f9b9814dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:47.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.708+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 shutdown_connections 2023-05-17T15:10:47.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.708+0000 7f9b9cf52700 1 -- 172.21.15.27:0/2652515061 wait complete. 2023-05-17T15:10:47.715 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:10:47.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:10:47.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.844+0000 7f05ac702700 1 Processor -- start 2023-05-17T15:10:47.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.844+0000 7f05ac702700 1 -- start start 2023-05-17T15:10:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.845+0000 7f05ac702700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05a4151c90 0x7f05a4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.845+0000 7f05ac702700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05a40c0520 0x7f05a4081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.845+0000 7f05ac702700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a4158010 con 0x7f05a4154980 2023-05-17T15:10:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.845+0000 7f05ac702700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a4154f60 con 0x7f05a40c0520 2023-05-17T15:10:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.845+0000 7f05ac702700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a4155240 con 0x7f05a4151c90 2023-05-17T15:10:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.845+0000 7f05aac9f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05a40c0520 0x7f05a4081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05a40c0520 0x7f05a4081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43340/0 (socket says 172.21.15.27:43340) 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 -- 172.21.15.27:0/953954916 learned_addr learned my addr 172.21.15.27:0/953954916 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05a9c9d700 1 --1- 172.21.15.27:0/953954916 >> v1:172.21.15.27:6789/0 conn(0x7f05a4154980 0x7f05a40c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42900/0 (socket says 172.21.15.27:42900) 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aa49e700 1 --2- 172.21.15.27:0/953954916 >> v2:172.21.15.40:3300/0 conn(0x7f05a4151c90 0x7f05a4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 -- 172.21.15.27:0/953954916 >> v2:172.21.15.40:3300/0 conn(0x7f05a4151c90 msgr2=0x7f05a4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 --2- 172.21.15.27:0/953954916 >> v2:172.21.15.40:3300/0 conn(0x7f05a4151c90 0x7f05a4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 -- 172.21.15.27:0/953954916 >> v1:172.21.15.27:6789/0 conn(0x7f05a4154980 legacy=0x7f05a40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:47.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 -- 172.21.15.27:0/953954916 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a4155520 con 0x7f05a40c0520 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05aac9f700 1 --2- 172.21.15.27:0/953954916 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a40c0520 0x7f05a4081fd0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f05a4084120 tx=0x7f0594009840).ready entity=mon.0 client_cookie=7f0dcd1249ef896b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05a949c700 1 -- 172.21.15.27:0/953954916 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400e070 con 0x7f05a40c0520 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05a949c700 1 -- 172.21.15.27:0/953954916 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059400ba50 con 0x7f05a40c0520 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05a949c700 1 -- 172.21.15.27:0/953954916 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400bdd0 con 0x7f05a40c0520 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05ac702700 1 -- 172.21.15.27:0/953954916 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a40c0520 msgr2=0x7f05a4081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.846+0000 7f05ac702700 1 --2- 172.21.15.27:0/953954916 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a40c0520 0x7f05a4081fd0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f05a4084120 tx=0x7f0594009840).stop 2023-05-17T15:10:47.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.847+0000 7f05ac702700 1 -- 172.21.15.27:0/953954916 shutdown_connections 2023-05-17T15:10:47.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.847+0000 7f05ac702700 1 --2- 172.21.15.27:0/953954916 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a40c0520 0x7f05a4081fd0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.847+0000 7f05ac702700 1 --2- 172.21.15.27:0/953954916 >> v2:172.21.15.40:3300/0 conn(0x7f05a4151c90 0x7f05a4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.847+0000 7f05ac702700 1 -- 172.21.15.27:0/953954916 >> 172.21.15.27:0/953954916 conn(0x7f05a40cae10 msgr2=0x7f05a40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:47.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.847+0000 7f05ac702700 1 -- 172.21.15.27:0/953954916 shutdown_connections 2023-05-17T15:10:47.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.847+0000 7f05ac702700 1 -- 172.21.15.27:0/953954916 wait complete. 2023-05-17T15:10:47.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.848+0000 7f05ac702700 1 Processor -- start 2023-05-17T15:10:47.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.848+0000 7f05ac702700 1 -- start start 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05a40c0520 0x7f05a4168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 0x7f05a40a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05a4154980 0x7f05a40addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4151470 con 0x7f05a4151c90 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4167bc0 con 0x7f05a40c0520 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a41675e0 con 0x7f05a4154980 2023-05-17T15:10:47.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 0x7f05a40a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 0x7f05a40a9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43344/0 (socket says 172.21.15.27:43344) 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 -- 172.21.15.27:0/1901393993 learned_addr learned my addr 172.21.15.27:0/1901393993 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05aa49e700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05a40c0520 0x7f05a4168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05aac9f700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05a4154980 0x7f05a40addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 -- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05a4154980 msgr2=0x7f05a40addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05a4154980 0x7f05a40addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 -- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05a40c0520 msgr2=0x7f05a4168050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:47.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05a40c0520 0x7f05a4168050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 -- 172.21.15.27:0/1901393993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009ae0 con 0x7f05a4151c90 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05aac9f700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05a4154980 0x7f05a40addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a9c9d700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 0x7f05a40a9050 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f059800c410 tx=0x7f0598007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800ce30 con 0x7f05a4151c90 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980072e0 con 0x7f05a4151c90 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a40b0a10 con 0x7f05a4151c90 2023-05-17T15:10:47.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980056e0 con 0x7f05a4151c90 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.849+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a4167850 con 0x7f05a4151c90 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.850+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a4168590 con 0x7f05a4151c90 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.851+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f059801a060 con 0x7f05a4151c90 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.851+0000 7f05a27fc700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f059005edc0 0x7f0590061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.851+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6256+0+0 (secure 0 0 0) 0x7f0598079190 con 0x7f05a4151c90 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.851+0000 7f05aa49e700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f059005edc0 0x7f0590061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:47.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.851+0000 7f05aa49e700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f059005edc0 0x7f0590061280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f05a4154730 tx=0x7f059c008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:47.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:47.855+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f059804a6b0 con 0x7f05a4151c90 2023-05-17T15:10:48.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.029+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05a4167d50 con 0x7f05a4151c90 2023-05-17T15:10:48.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.709+0000 7f05a27fc700 1 -- 172.21.15.27:0/1901393993 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v131) v1 ==== 169+0+0 (secure 0 0 0) 0x7f05980180d0 con 0x7f05a4151c90 2023-05-17T15:10:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f059005edc0 msgr2=0x7f0590061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f059005edc0 0x7f0590061280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f05a4154730 tx=0x7f059c008040).stop 2023-05-17T15:10:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 msgr2=0x7f05a40a9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 0x7f05a40a9050 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f059800c410 tx=0x7f0598007df0).stop 2023-05-17T15:10:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 shutdown_connections 2023-05-17T15:10:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f059005edc0 0x7f0590061280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05a4154980 0x7f05a40addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05a40c0520 0x7f05a4168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 --2- 172.21.15.27:0/1901393993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05a4151c90 0x7f05a40a9050 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 >> 172.21.15.27:0/1901393993 conn(0x7f05a40cae10 msgr2=0x7f05a4155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:48.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 shutdown_connections 2023-05-17T15:10:48.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.712+0000 7f05ac702700 1 -- 172.21.15.27:0/1901393993 wait complete. 2023-05-17T15:10:48.720 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:10:48.731 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:10:48.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.848+0000 7f8052f1c700 1 Processor -- start 2023-05-17T15:10:48.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.848+0000 7f8052f1c700 1 -- start start 2023-05-17T15:10:48.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.848+0000 7f8052f1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 0x7f804c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.848+0000 7f8052f1c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f804c0691f0 0x7f804c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.848+0000 7f8052f1c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c158790 con 0x7f804c1543d0 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f8052f1c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c0c1c50 con 0x7f804c0691f0 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f8052f1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c157e60 con 0x7f804c0c6310 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f8050cb8700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f804c1543d0 0x7f804c0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42912/0 (socket says 172.21.15.27:42912) 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f8050cb8700 1 -- 172.21.15.27:0/364753044 learned_addr learned my addr 172.21.15.27:0/364753044 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116135825 0 0) 0x7f804c158790 con 0x7f804c1543d0 2023-05-17T15:10:48.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804bfff700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 0x7f804c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80380033f0 con 0x7f804c1543d0 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f80514b9700 1 --2- 172.21.15.27:0/364753044 >> v2:172.21.15.40:3300/0 conn(0x7f804c0691f0 0x7f804c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853689625 0 0) 0x7f80380033f0 con 0x7f804c1543d0 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 msgr2=0x7f804c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 0x7f804c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 >> v2:172.21.15.40:3300/0 conn(0x7f804c0691f0 msgr2=0x7f804c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:48.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 --2- 172.21.15.27:0/364753044 >> v2:172.21.15.40:3300/0 conn(0x7f804c0691f0 0x7f804c0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c158140 con 0x7f804c1543d0 2023-05-17T15:10:48.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f8044001470 con 0x7f804c1543d0 2023-05-17T15:10:48.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 >> v1:172.21.15.27:6789/0 conn(0x7f804c1543d0 legacy=0x7f804c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:48.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 0x7f80380038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8038003e10 0x7f8038004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8038004b80 0x7f8038005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c157e60 con 0x7f8038004b80 2023-05-17T15:10:48.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803800b8e0 con 0x7f8038003e10 2023-05-17T15:10:48.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803800ba20 con 0x7f804c0c6310 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.849+0000 7f80514b9700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8038004b80 0x7f8038005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f8050cb8700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 0x7f80380038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f804bfff700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8038003e10 0x7f8038004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 -- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 msgr2=0x7f80380038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c0c6310 0x7f80380038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 -- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8038003e10 msgr2=0x7f8038004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8038003e10 0x7f8038004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 -- 172.21.15.27:0/364753044 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380033f0 con 0x7f8038004b80 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8038004b80 0x7f8038005000 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f8034009ab0 tx=0x7f8034009060).ready entity=mon.0 client_cookie=21e87bf544a2d9e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034009430 con 0x7f8038004b80 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400e640 con 0x7f8038004b80 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f804b7fe700 1 -- 172.21.15.27:0/364753044 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803400e9c0 con 0x7f8038004b80 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f8052f1c700 1 -- 172.21.15.27:0/364753044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8038004b80 msgr2=0x7f8038005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f8052f1c700 1 --2- 172.21.15.27:0/364753044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8038004b80 0x7f8038005000 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f8034009ab0 tx=0x7f8034009060).stop 2023-05-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f80514b9700 1 -- 172.21.15.27:0/364753044 reap_dead start 2023-05-17T15:10:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f8052f1c700 1 -- 172.21.15.27:0/364753044 shutdown_connections 2023-05-17T15:10:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.850+0000 7f8052f1c700 1 -- 172.21.15.27:0/364753044 >> 172.21.15.27:0/364753044 conn(0x7f804c0cb7f0 msgr2=0x7f804c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.851+0000 7f8052f1c700 1 -- 172.21.15.27:0/364753044 shutdown_connections 2023-05-17T15:10:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.851+0000 7f8052f1c700 1 -- 172.21.15.27:0/364753044 wait complete. 2023-05-17T15:10:48.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 Processor -- start 2023-05-17T15:10:48.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 -- start start 2023-05-17T15:10:48.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c164980 0x7f804c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f804c0c49c0 0x7f804c164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 0x7f804c0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c168810 con 0x7f804c165250 2023-05-17T15:10:48.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c167b90 con 0x7f804c0c49c0 2023-05-17T15:10:48.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.852+0000 7f8052f1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c167e70 con 0x7f804c164980 2023-05-17T15:10:48.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 0x7f804c0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 0x7f804c0c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43366/0 (socket says 172.21.15.27:43366) 2023-05-17T15:10:48.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 -- 172.21.15.27:0/1668994034 learned_addr learned my addr 172.21.15.27:0/1668994034 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:48.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f8050cb8700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c164980 0x7f804c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f804bfff700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f804c0c49c0 0x7f804c164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 -- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c164980 msgr2=0x7f804c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:48.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c164980 0x7f804c0c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 -- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f804c0c49c0 msgr2=0x7f804c164d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:48.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f804c0c49c0 0x7f804c164d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 -- 172.21.15.27:0/1668994034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c168150 con 0x7f804c165250 2023-05-17T15:10:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f80514b9700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 0x7f804c0c9fa0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f8034001eb0 tx=0x7f803401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034009430 con 0x7f804c165250 2023-05-17T15:10:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400e7b0 con 0x7f804c165250 2023-05-17T15:10:48.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340243f0 con 0x7f804c165250 2023-05-17T15:10:48.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c168430 con 0x7f804c165250 2023-05-17T15:10:48.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.853+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c0ca650 con 0x7f804c165250 2023-05-17T15:10:48.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.854+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c168950 con 0x7f804c165250 2023-05-17T15:10:48.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.855+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f803402b030 con 0x7f804c165250 2023-05-17T15:10:48.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.855+0000 7f8048ff9700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f802c05ed90 0x7f802c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:48.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.855+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5842+0+0 (secure 0 0 0) 0x7f803407ac50 con 0x7f804c165250 2023-05-17T15:10:48.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.855+0000 7f8050cb8700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f802c05ed90 0x7f802c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:48.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.855+0000 7f8050cb8700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f802c05ed90 0x7f802c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8044007860 tx=0x7f8044001e90).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:48.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:48.859+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f803404c380 con 0x7f804c165250 2023-05-17T15:10:49.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.030+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f804c06bdf0 con 0x7f804c165250 2023-05-17T15:10:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.034+0000 7f8048ff9700 1 -- 172.21.15.27:0/1668994034 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v24) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8034029020 con 0x7f804c165250 2023-05-17T15:10:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f802c05ed90 msgr2=0x7f802c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f802c05ed90 0x7f802c061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8044007860 tx=0x7f8044001e90).stop 2023-05-17T15:10:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 msgr2=0x7f804c0c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 0x7f804c0c9fa0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f8034001eb0 tx=0x7f803401a000).stop 2023-05-17T15:10:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 shutdown_connections 2023-05-17T15:10:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f802c05ed90 0x7f802c061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f804c165250 0x7f804c0c9fa0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f804c164980 0x7f804c0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 --2- 172.21.15.27:0/1668994034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f804c0c49c0 0x7f804c164d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 >> 172.21.15.27:0/1668994034 conn(0x7f804c0cb7f0 msgr2=0x7f804c1539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 shutdown_connections 2023-05-17T15:10:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.036+0000 7f8052f1c700 1 -- 172.21.15.27:0/1668994034 wait complete. 2023-05-17T15:10:49.053 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:10:49.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.166+0000 7fb17dc9c700 1 Processor -- start 2023-05-17T15:10:49.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.166+0000 7fb17dc9c700 1 -- start start 2023-05-17T15:10:49.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.167+0000 7fb17dc9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1781542f0 0x7fb178066360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.167+0000 7fb17dc9c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb178065350 con 0x7fb178157c80 2023-05-17T15:10:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.167+0000 7fb17dc9c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb178065ed0 con 0x7fb178153f10 2023-05-17T15:10:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.167+0000 7fb17dc9c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780655a0 con 0x7fb1781542f0 2023-05-17T15:10:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.167+0000 7fb177fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb178157c80 0x7fb1780bd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42936/0 (socket says 172.21.15.27:42936) 2023-05-17T15:10:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.167+0000 7fb177fff700 1 -- 172.21.15.27:0/2848354063 learned_addr learned my addr 172.21.15.27:0/2848354063 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:49.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb176ffd700 1 --2- 172.21.15.27:0/2848354063 >> v2:172.21.15.40:3300/0 conn(0x7fb1781542f0 0x7fb178066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226567012 0 0) 0x7fb178065350 con 0x7fb178157c80 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1600033f0 con 0x7fb178157c80 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286097852 0 0) 0x7fb1600033f0 con 0x7fb178157c80 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 >> v2:172.21.15.40:3300/0 conn(0x7fb1781542f0 msgr2=0x7fb178066360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 --2- 172.21.15.27:0/2848354063 >> v2:172.21.15.40:3300/0 conn(0x7fb1781542f0 0x7fb178066360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 >> v1:172.21.15.40:6789/0 conn(0x7fb178153f10 legacy=0x7fb1780c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178065880 con 0x7fb178157c80 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fb1700017f0 con 0x7fb178157c80 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 >> v1:172.21.15.27:6789/0 conn(0x7fb178157c80 legacy=0x7fb1780bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1600038e0 0x7fb160003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb160004690 0x7fb160004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb160005000 0x7fb16000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780655a0 con 0x7fb160005000 2023-05-17T15:10:49.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16000bf60 con 0x7fb1600038e0 2023-05-17T15:10:49.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16000c0f0 con 0x7fb160004690 2023-05-17T15:10:49.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb177fff700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb160005000 0x7fb16000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb176ffd700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb160004690 0x7fb160004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb1777fe700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1600038e0 0x7fb160003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb177fff700 1 -- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb160004690 msgr2=0x7fb160004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:49.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb177fff700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb160004690 0x7fb160004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb177fff700 1 -- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1600038e0 msgr2=0x7fb160003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb177fff700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1600038e0 0x7fb160003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.168+0000 7fb177fff700 1 -- 172.21.15.27:0/2848354063 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600033f0 con 0x7fb160005000 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb177fff700 1 -- 172.21.15.27:0/2848354063 reap_dead start 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb177fff700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb160005000 0x7fb16000b8e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fb17000c480 tx=0x7fb17000c790).ready entity=mon.0 client_cookie=1aef30332ecea6ab server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170002030 con 0x7fb160005000 2023-05-17T15:10:49.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17000ce20 con 0x7fb160005000 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb1767fc700 1 -- 172.21.15.27:0/2848354063 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170005d30 con 0x7fb160005000 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2848354063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb160005000 msgr2=0x7fb16000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb160005000 0x7fb16000b8e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fb17000c480 tx=0x7fb17000c790).stop 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2848354063 shutdown_connections 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2848354063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb160005000 0x7fb16000b8e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2848354063 >> 172.21.15.27:0/2848354063 conn(0x7fb1780c94b0 msgr2=0x7fb1780c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:49.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2848354063 shutdown_connections 2023-05-17T15:10:49.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.169+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2848354063 wait complete. 2023-05-17T15:10:49.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 Processor -- start 2023-05-17T15:10:49.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 -- start start 2023-05-17T15:10:49.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb160005000 0x7fb1780bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 0x7fb1780acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1780ad050 0x7fb178152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c00a0 con 0x7fb178168810 2023-05-17T15:10:49.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c0380 con 0x7fb160005000 2023-05-17T15:10:49.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb17dc9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c0660 con 0x7fb1780ad050 2023-05-17T15:10:49.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb176ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 0x7fb1780acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb176ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 0x7fb1780acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43384/0 (socket says 172.21.15.27:43384) 2023-05-17T15:10:49.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.171+0000 7fb176ffd700 1 -- 172.21.15.27:0/2645336942 learned_addr learned my addr 172.21.15.27:0/2645336942 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:49.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb177fff700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1780ad050 0x7fb178152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb1777fe700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb160005000 0x7fb1780bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb176ffd700 1 -- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1780ad050 msgr2=0x7fb178152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb176ffd700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1780ad050 0x7fb178152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb176ffd700 1 -- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb160005000 msgr2=0x7fb1780bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb176ffd700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb160005000 0x7fb1780bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb176ffd700 1 -- 172.21.15.27:0/2645336942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780c0940 con 0x7fb178168810 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb176ffd700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 0x7fb1780acb60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fb16c0119c0 tx=0x7fb16c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00f730 con 0x7fb178168810 2023-05-17T15:10:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00f890 con 0x7fb178168810 2023-05-17T15:10:49.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780c0c20 con 0x7fb178168810 2023-05-17T15:10:49.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00fc10 con 0x7fb178168810 2023-05-17T15:10:49.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.172+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb178153360 con 0x7fb178168810 2023-05-17T15:10:49.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.173+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17806bdf0 con 0x7fb178168810 2023-05-17T15:10:49.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.173+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb16c014440 con 0x7fb178168810 2023-05-17T15:10:49.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.174+0000 7fb15f7fe700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb16405ed90 0x7fb164061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.174+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5842+0+0 (secure 0 0 0) 0x7fb16c07a060 con 0x7fb178168810 2023-05-17T15:10:49.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.174+0000 7fb1777fe700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb16405ed90 0x7fb164061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.174+0000 7fb1777fe700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb16405ed90 0x7fb164061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb168000c00 tx=0x7fb168009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:49.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.178+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb16c04b6b0 con 0x7fb178168810 2023-05-17T15:10:49.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.361+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb178065b60 con 0x7fb178168810 2023-05-17T15:10:49.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.364+0000 7fb15f7fe700 1 -- 172.21.15.27:0/2645336942 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb16c04ecd0 con 0x7fb178168810 2023-05-17T15:10:49.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb16405ed90 msgr2=0x7fb164061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb16405ed90 0x7fb164061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb168000c00 tx=0x7fb168009040).stop 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 msgr2=0x7fb1780acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 0x7fb1780acb60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fb16c0119c0 tx=0x7fb16c009060).stop 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 shutdown_connections 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb16405ed90 0x7fb164061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1780ad050 0x7fb178152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb160005000 0x7fb1780bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 --2- 172.21.15.27:0/2645336942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb178168810 0x7fb1780acb60 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 >> 172.21.15.27:0/2645336942 conn(0x7fb1780c94b0 msgr2=0x7fb1780c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 shutdown_connections 2023-05-17T15:10:49.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.366+0000 7fb17dc9c700 1 -- 172.21.15.27:0/2645336942 wait complete. 2023-05-17T15:10:49.383 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-05-17T15:10:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.494+0000 7fe15b4d2700 1 Processor -- start 2023-05-17T15:10:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.494+0000 7fe15b4d2700 1 -- start start 2023-05-17T15:10:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe15b4d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154154220 0x7fe1540653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe15b4d2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe1540658d0 0x7fe1540bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe15b4d2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1540c4540 con 0x7fe154153e40 2023-05-17T15:10:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe15b4d2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1541546a0 con 0x7fe1540658d0 2023-05-17T15:10:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe15b4d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe154065d60 con 0x7fe154154220 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe1540658d0 0x7fe1540bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe1540658d0 0x7fe1540bd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43392/0 (socket says 172.21.15.27:43392) 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 -- 172.21.15.27:0/3037067725 learned_addr learned my addr 172.21.15.27:0/3037067725 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe158a6d700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154154220 0x7fe1540653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 -- 172.21.15.27:0/3037067725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154154220 msgr2=0x7fe1540653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154154220 0x7fe1540653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 -- 172.21.15.27:0/3037067725 >> v1:172.21.15.40:6789/0 conn(0x7fe154153e40 legacy=0x7fe1540c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe159a6f700 1 -- 172.21.15.27:0/3037067725 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540c36b0 con 0x7fe1540658d0 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.495+0000 7fe158a6d700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154154220 0x7fe1540653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe159a6f700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1540658d0 0x7fe1540bd9b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fe150006fd0 tx=0x7fe1500090f0).ready entity=mon.0 client_cookie=9fd932bc59c18f7f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe14bfff700 1 -- 172.21.15.27:0/3037067725 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000b600 con 0x7fe1540658d0 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe14bfff700 1 -- 172.21.15.27:0/3037067725 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000b760 con 0x7fe1540658d0 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe14bfff700 1 -- 172.21.15.27:0/3037067725 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000bae0 con 0x7fe1540658d0 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 -- 172.21.15.27:0/3037067725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1540658d0 msgr2=0x7fe1540bd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1540658d0 0x7fe1540bd9b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fe150006fd0 tx=0x7fe1500090f0).stop 2023-05-17T15:10:49.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 -- 172.21.15.27:0/3037067725 shutdown_connections 2023-05-17T15:10:49.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1540658d0 0x7fe1540bd9b0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/3037067725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154154220 0x7fe1540653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 -- 172.21.15.27:0/3037067725 >> 172.21.15.27:0/3037067725 conn(0x7fe1540c9560 msgr2=0x7fe1540c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:49.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 -- 172.21.15.27:0/3037067725 shutdown_connections 2023-05-17T15:10:49.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.496+0000 7fe15b4d2700 1 -- 172.21.15.27:0/3037067725 wait complete. 2023-05-17T15:10:49.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.497+0000 7fe15b4d2700 1 Processor -- start 2023-05-17T15:10:49.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.497+0000 7fe15b4d2700 1 -- start start 2023-05-17T15:10:49.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe15b4d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1540658d0 0x7fe154142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe15b4d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154153e40 0x7fe154142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe15b4d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 0x7fe1540aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe15b4d2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154158890 con 0x7fe154154220 2023-05-17T15:10:49.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe15b4d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540a7f50 con 0x7fe154153e40 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe15b4d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540a8230 con 0x7fe1540658d0 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe159a6f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 0x7fe1540aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe159a6f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 0x7fe1540aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43400/0 (socket says 172.21.15.27:43400) 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.498+0000 7fe159a6f700 1 -- 172.21.15.27:0/688715937 learned_addr learned my addr 172.21.15.27:0/688715937 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe158a6d700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154153e40 0x7fe154142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe15926e700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1540658d0 0x7fe154142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe159a6f700 1 -- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1540658d0 msgr2=0x7fe154142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe159a6f700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1540658d0 0x7fe154142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe159a6f700 1 -- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154153e40 msgr2=0x7fe154142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe159a6f700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154153e40 0x7fe154142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe159a6f700 1 -- 172.21.15.27:0/688715937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009370 con 0x7fe154154220 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe158a6d700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154153e40 0x7fe154142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe15926e700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1540658d0 0x7fe154142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe159a6f700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 0x7fe1540aa170 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fe150002ff0 tx=0x7fe150017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:49.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000bae0 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150024470 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe154157ff0 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500247f0 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.499+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1541585b0 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.500+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15406bdf0 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.500+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe15000f070 con 0x7fe154154220 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.501+0000 7fe1497fa700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe13805ed90 0x7fe138061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:49.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.501+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5842+0+0 (secure 0 0 0) 0x7fe15007bb00 con 0x7fe154154220 2023-05-17T15:10:49.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.501+0000 7fe15926e700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe13805ed90 0x7fe138061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:49.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.501+0000 7fe15926e700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe13805ed90 0x7fe138061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe14c002e70 tx=0x7fe14c009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:49.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.505+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe15004d1b0 con 0x7fe154154220 2023-05-17T15:10:49.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:49.745+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fe1540a8370 con 0x7fe154154220 2023-05-17T15:10:50.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.711+0000 7fe1497fa700 1 -- 172.21.15.27:0/688715937 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v645) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe1500507d0 con 0x7fe154154220 2023-05-17T15:10:50.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe13805ed90 msgr2=0x7fe138061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:50.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe13805ed90 0x7fe138061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe14c002e70 tx=0x7fe14c009040).stop 2023-05-17T15:10:50.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 msgr2=0x7fe1540aa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 0x7fe1540aa170 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fe150002ff0 tx=0x7fe150017000).stop 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 shutdown_connections 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fe13805ed90 0x7fe138061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe154154220 0x7fe1540aa170 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1540658d0 0x7fe154142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 --2- 172.21.15.27:0/688715937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154153e40 0x7fe154142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 >> 172.21.15.27:0/688715937 conn(0x7fe1540c9560 msgr2=0x7fe1540adb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:50.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 shutdown_connections 2023-05-17T15:10:50.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.714+0000 7fe15b4d2700 1 -- 172.21.15.27:0/688715937 wait complete. 2023-05-17T15:10:50.734 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-05-17T15:10:50.735 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-05-17T15:10:50.735 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:10:50.735 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-05-17T15:10:50.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.853+0000 7f58ff3f5700 1 Processor -- start 2023-05-17T15:10:50.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.853+0000 7f58ff3f5700 1 -- start start 2023-05-17T15:10:50.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58ff3f5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58f80aae70 0x7f58f8069060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:50.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58ff3f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f80c6490 0x7f58f8069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:50.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58ff3f5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f80c07a0 con 0x7f58f8153fa0 2023-05-17T15:10:50.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58ff3f5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f8069d70 con 0x7f58f80aae70 2023-05-17T15:10:50.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58ff3f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80c1c40 con 0x7f58f80c6490 2023-05-17T15:10:50.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58f80aae70 0x7f58f8069060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:50.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58f80aae70 0x7f58f8069060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43408/0 (socket says 172.21.15.27:43408) 2023-05-17T15:10:50.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 -- 172.21.15.27:0/3315052 learned_addr learned my addr 172.21.15.27:0/3315052 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:50.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fd992700 1 --2- 172.21.15.27:0/3315052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f80c6490 0x7f58f8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:50.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 -- 172.21.15.27:0/3315052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f80c6490 msgr2=0x7f58f8069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:50.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 --2- 172.21.15.27:0/3315052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f80c6490 0x7f58f8069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 -- 172.21.15.27:0/3315052 >> v1:172.21.15.40:6789/0 conn(0x7f58f8153fa0 legacy=0x7f58f80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 -- 172.21.15.27:0/3315052 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80bfe70 con 0x7f58f80aae70 2023-05-17T15:10:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.854+0000 7f58fc990700 1 --2- 172.21.15.27:0/3315052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8069060 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f58ec009f70 tx=0x7f58ec009840).ready entity=mon.0 client_cookie=a35250b7d51bf042 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58f7fff700 1 -- 172.21.15.27:0/3315052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00e070 con 0x7f58f80aae70 2023-05-17T15:10:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58f7fff700 1 -- 172.21.15.27:0/3315052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec00ba90 con 0x7f58f80aae70 2023-05-17T15:10:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58f7fff700 1 -- 172.21.15.27:0/3315052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00be10 con 0x7f58f80aae70 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 -- 172.21.15.27:0/3315052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 msgr2=0x7f58f8069060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/3315052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8069060 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f58ec009f70 tx=0x7f58ec009840).stop 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 -- 172.21.15.27:0/3315052 shutdown_connections 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/3315052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f80c6490 0x7f58f8069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/3315052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8069060 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 -- 172.21.15.27:0/3315052 >> 172.21.15.27:0/3315052 conn(0x7f58f80cb810 msgr2=0x7f58f80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:50.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 -- 172.21.15.27:0/3315052 shutdown_connections 2023-05-17T15:10:50.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.855+0000 7f58ff3f5700 1 -- 172.21.15.27:0/3315052 wait complete. 2023-05-17T15:10:50.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.856+0000 7f58ff3f5700 1 Processor -- start 2023-05-17T15:10:50.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.856+0000 7f58ff3f5700 1 -- start start 2023-05-17T15:10:50.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58ff3f5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:50.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58ff3f5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f80c6490 0x7f58f8152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:50.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58ff3f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f8153fa0 0x7f58f8167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:50.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58ff3f5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8156000 con 0x7f58f80aae70 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58ff3f5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8156490 con 0x7f58f80c6490 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58ff3f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8155710 con 0x7f58f8153fa0 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58fd191700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58fd191700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43410/0 (socket says 172.21.15.27:43410) 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.857+0000 7f58fd191700 1 -- 172.21.15.27:0/1368325824 learned_addr learned my addr 172.21.15.27:0/1368325824 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fc990700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f80c6490 0x7f58f8152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd992700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f8153fa0 0x7f58f8167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd191700 1 -- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f8153fa0 msgr2=0x7f58f8167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd191700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f8153fa0 0x7f58f8167e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd191700 1 -- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f80c6490 msgr2=0x7f58f8152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd191700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f80c6490 0x7f58f8152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd191700 1 -- 172.21.15.27:0/1368325824 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec009ae0 con 0x7f58f80aae70 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fc990700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f80c6490 0x7f58f8152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58fd191700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8156eb0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f58f000b460 tx=0x7f58f0006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0012410 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0012590 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f81559b0 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0012950 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.858+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f8157910 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.859+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f806bdf0 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.859+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f58f000f030 con 0x7f58f80aae70 2023-05-17T15:10:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.860+0000 7f58f57fa700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58e405ed90 0x7f58e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:50.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.860+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5842+0+0 (secure 0 0 0) 0x7f58f00796b0 con 0x7f58f80aae70 2023-05-17T15:10:50.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.860+0000 7f58fc990700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58e405ed90 0x7f58e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:50.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.860+0000 7f58fc990700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58e405ed90 0x7f58e4061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f58ec00ba60 tx=0x7f58ec009840).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:50.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:50.864+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58f004ad60 con 0x7f58f80aae70 2023-05-17T15:10:51.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.112+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f58f80c0150 con 0x7f58f80aae70 2023-05-17T15:10:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.717+0000 7f58f57fa700 1 -- 172.21.15.27:0/1368325824 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v646) v1 ==== 168+0+0 (secure 0 0 0) 0x7f58f004e380 con 0x7f58f80aae70 2023-05-17T15:10:51.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58e405ed90 msgr2=0x7f58e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:51.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58e405ed90 0x7f58e4061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f58ec00ba60 tx=0x7f58ec009840).stop 2023-05-17T15:10:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 msgr2=0x7f58f8156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8156eb0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f58f000b460 tx=0x7f58f0006f20).stop 2023-05-17T15:10:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 shutdown_connections 2023-05-17T15:10:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f58e405ed90 0x7f58e4061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58f8153fa0 0x7f58f8167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58f80aae70 0x7f58f8156eb0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 --2- 172.21.15.27:0/1368325824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f80c6490 0x7f58f8152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 >> 172.21.15.27:0/1368325824 conn(0x7f58f80cb810 msgr2=0x7f58f80ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.719+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 shutdown_connections 2023-05-17T15:10:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.720+0000 7f58ff3f5700 1 -- 172.21.15.27:0/1368325824 wait complete. 2023-05-17T15:10:51.738 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:10:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.859+0000 7f6ad88c9700 1 Processor -- start 2023-05-17T15:10:51.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.859+0000 7f6ad88c9700 1 -- start start 2023-05-17T15:10:51.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad88c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad40a9a70 0x7f6ad4150690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:51.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad88c9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ad40bd300 0x7f6ad40bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:51.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad88c9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad41515a0 con 0x7f6ad41502b0 2023-05-17T15:10:51.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad88c9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad4154f40 con 0x7f6ad40bd300 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad88c9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4150c70 con 0x7f6ad40a9a70 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad2d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ad40bd300 0x7f6ad40bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.860+0000 7f6ad1d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad40a9a70 0x7f6ad4150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ad41502b0 0x7f6ad40a9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:48982/0 (socket says 172.21.15.27:48982) 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad259c700 1 -- 172.21.15.27:0/29073623 learned_addr learned my addr 172.21.15.27:0/29073623 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad159a700 1 -- 172.21.15.27:0/29073623 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160561748 0 0) 0x7f6ad41515a0 con 0x7f6ad41502b0 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad159a700 1 -- 172.21.15.27:0/29073623 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6abc0033f0 con 0x7f6ad41502b0 2023-05-17T15:10:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad2d9d700 1 -- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad40a9a70 msgr2=0x7f6ad4150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad2d9d700 1 --2- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad40a9a70 0x7f6ad4150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad2d9d700 1 -- 172.21.15.27:0/29073623 >> v1:172.21.15.40:6789/0 conn(0x7f6ad41502b0 legacy=0x7f6ad40a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad2d9d700 1 -- 172.21.15.27:0/29073623 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4150f50 con 0x7f6ad40bd300 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad1d9b700 1 --2- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad40a9a70 0x7f6ad4150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad2d9d700 1 --2- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40bd770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6ac4009e60 tx=0x7f6ac4009780).ready entity=mon.1 client_cookie=4636351b88d9bb11 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad159a700 1 -- 172.21.15.27:0/29073623 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400e070 con 0x7f6ad40bd300 2023-05-17T15:10:51.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad159a700 1 -- 172.21.15.27:0/29073623 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac400bab0 con 0x7f6ad40bd300 2023-05-17T15:10:51.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.861+0000 7f6ad159a700 1 -- 172.21.15.27:0/29073623 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400be30 con 0x7f6ad40bd300 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 -- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 msgr2=0x7f6ad40bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40bd770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6ac4009e60 tx=0x7f6ac4009780).stop 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 -- 172.21.15.27:0/29073623 shutdown_connections 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40bd770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/29073623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad40a9a70 0x7f6ad4150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 -- 172.21.15.27:0/29073623 >> 172.21.15.27:0/29073623 conn(0x7f6ad4063dd0 msgr2=0x7f6ad4067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 -- 172.21.15.27:0/29073623 shutdown_connections 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.862+0000 7f6ad88c9700 1 -- 172.21.15.27:0/29073623 wait complete. 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.863+0000 7f6ad88c9700 1 Processor -- start 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.863+0000 7f6ad88c9700 1 -- start start 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad88c9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 0x7f6ad409f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad88c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad88c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad41502b0 0x7f6ad414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:51.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad88c9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4164560 con 0x7f6ad40a9a70 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad88c9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4164840 con 0x7f6ad40bd300 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad88c9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4164b20 con 0x7f6ad41502b0 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 0x7f6ad409f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 0x7f6ad409f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43424/0 (socket says 172.21.15.27:43424) 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 -- 172.21.15.27:0/3786188233 learned_addr learned my addr 172.21.15.27:0/3786188233 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad1d9b700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad2d9d700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad41502b0 0x7f6ad414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:51.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 -- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad41502b0 msgr2=0x7f6ad414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad41502b0 0x7f6ad414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 -- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 msgr2=0x7f6ad40c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 -- 172.21.15.27:0/3786188233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80092a0 con 0x7f6ad40a9a70 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad2d9d700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad41502b0 0x7f6ad414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ad259c700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 0x7f6ad409f650 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f6acc00c410 tx=0x7f6acc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.864+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00ce70 con 0x7f6ad40a9a70 2023-05-17T15:10:51.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.865+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc0072e0 con 0x7f6ad40a9a70 2023-05-17T15:10:51.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.865+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac4009a20 con 0x7f6ad40a9a70 2023-05-17T15:10:51.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.865+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0057a0 con 0x7f6ad40a9a70 2023-05-17T15:10:51.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.865+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad41650e0 con 0x7f6ad40a9a70 2023-05-17T15:10:51.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.866+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad4165300 con 0x7f6ad40a9a70 2023-05-17T15:10:51.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.866+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6acc010070 con 0x7f6ad40a9a70 2023-05-17T15:10:51.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.866+0000 7f6ac27fc700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ab405ed90 0x7f6ab4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:51.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.866+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5842+0+0 (secure 0 0 0) 0x7f6acc078f20 con 0x7f6ad40a9a70 2023-05-17T15:10:51.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.866+0000 7f6ad1d9b700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ab405ed90 0x7f6ab4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:51.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.867+0000 7f6ad1d9b700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ab405ed90 0x7f6ab4061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6ad4164420 tx=0x7f6ac8009060).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:51.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:51.871+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6acc04a5d0 con 0x7f6ad40a9a70 2023-05-17T15:10:52.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.045+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6ad4151230 con 0x7f6ad40a9a70 2023-05-17T15:10:52.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.048+0000 7f6ac27fc700 1 -- 172.21.15.27:0/3786188233 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6acc04dbf0 con 0x7f6ad40a9a70 2023-05-17T15:10:52.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ab405ed90 msgr2=0x7f6ab4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ab405ed90 0x7f6ab4061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6ad4164420 tx=0x7f6ac8009060).stop 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 msgr2=0x7f6ad409f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 0x7f6ad409f650 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f6acc00c410 tx=0x7f6acc007c70).stop 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 shutdown_connections 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f6ab405ed90 0x7f6ab4061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ad41502b0 0x7f6ad414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ad40a9a70 0x7f6ad409f650 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 --2- 172.21.15.27:0/3786188233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ad40bd300 0x7f6ad40c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 >> 172.21.15.27:0/3786188233 conn(0x7f6ad4063dd0 msgr2=0x7f6ad40c3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:52.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 shutdown_connections 2023-05-17T15:10:52.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.050+0000 7f6ad88c9700 1 -- 172.21.15.27:0/3786188233 wait complete. 2023-05-17T15:10:52.066 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:10:52.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:52.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:10:52.129 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:10:52.129 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:10:52.130 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:10:52.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.246+0000 7fc5e6b01700 1 Processor -- start 2023-05-17T15:10:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.246+0000 7fc5e6b01700 1 -- start start 2023-05-17T15:10:52.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e6b01700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5e00bd970 0x7fc5e0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e6b01700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e0152b60 con 0x7fc5e014f850 2023-05-17T15:10:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e6b01700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00c5260 con 0x7fc5e014fc30 2023-05-17T15:10:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e6b01700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e00a6e70 con 0x7fc5e00bd970 2023-05-17T15:10:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e509e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5e00bd970 0x7fc5e0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e509e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5e00bd970 0x7fc5e0152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43434/0 (socket says 172.21.15.27:43434) 2023-05-17T15:10:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e509e700 1 -- 172.21.15.27:0/260801165 learned_addr learned my addr 172.21.15.27:0/260801165 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.247+0000 7fc5e489d700 1 --1- 172.21.15.27:0/260801165 >> v1:172.21.15.27:6789/0 conn(0x7fc5e014f850 0x7fc5e00c4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42994/0 (socket says 172.21.15.27:42994) 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e509e700 1 -- 172.21.15.27:0/260801165 >> v1:172.21.15.40:6789/0 conn(0x7fc5e014fc30 legacy=0x7fc5e00bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e509e700 1 -- 172.21.15.27:0/260801165 >> v1:172.21.15.27:6789/0 conn(0x7fc5e014f850 legacy=0x7fc5e00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e509e700 1 -- 172.21.15.27:0/260801165 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00a7150 con 0x7fc5e00bd970 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e509e700 1 --2- 172.21.15.27:0/260801165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e00bd970 0x7fc5e0152ff0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fc5d0006fd0 tx=0x7fc5d00090f0).ready entity=mon.0 client_cookie=3dfa79f596d0e5fc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5df7fe700 1 -- 172.21.15.27:0/260801165 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000b600 con 0x7fc5e00bd970 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5df7fe700 1 -- 172.21.15.27:0/260801165 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d000b760 con 0x7fc5e00bd970 2023-05-17T15:10:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5df7fe700 1 -- 172.21.15.27:0/260801165 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000bae0 con 0x7fc5e00bd970 2023-05-17T15:10:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e6b01700 1 -- 172.21.15.27:0/260801165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e00bd970 msgr2=0x7fc5e0152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/260801165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e00bd970 0x7fc5e0152ff0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fc5d0006fd0 tx=0x7fc5d00090f0).stop 2023-05-17T15:10:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e6b01700 1 -- 172.21.15.27:0/260801165 shutdown_connections 2023-05-17T15:10:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/260801165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e00bd970 0x7fc5e0152ff0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.248+0000 7fc5e6b01700 1 -- 172.21.15.27:0/260801165 >> 172.21.15.27:0/260801165 conn(0x7fc5e00c8400 msgr2=0x7fc5e00c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.249+0000 7fc5e6b01700 1 -- 172.21.15.27:0/260801165 shutdown_connections 2023-05-17T15:10:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.249+0000 7fc5e6b01700 1 -- 172.21.15.27:0/260801165 wait complete. 2023-05-17T15:10:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.250+0000 7fc5e6b01700 1 Processor -- start 2023-05-17T15:10:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.250+0000 7fc5e6b01700 1 -- start start 2023-05-17T15:10:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e00bd970 0x7fc5e01426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e014f850 0x7fc5e0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 0x7fc5e00681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0068690 con 0x7fc5e014fc30 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00c0860 con 0x7fc5e014f850 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00c0b40 con 0x7fc5e00bd970 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 0x7fc5e00681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 0x7fc5e00681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43442/0 (socket says 172.21.15.27:43442) 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 -- 172.21.15.27:0/568978442 learned_addr learned my addr 172.21.15.27:0/568978442 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e489d700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e00bd970 0x7fc5e01426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5dffff700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e014f850 0x7fc5e0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 -- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e00bd970 msgr2=0x7fc5e01426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e00bd970 0x7fc5e01426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 -- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e014f850 msgr2=0x7fc5e0067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e014f850 0x7fc5e0067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 -- 172.21.15.27:0/568978442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d0009370 con 0x7fc5e014fc30 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e509e700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 0x7fc5e00681a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fc5d0009700 tx=0x7fc5d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000bae0 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d0024470 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00247f0 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e00c0e20 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.251+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e00c13e0 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.252+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e00c15d0 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.253+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc5d000f070 con 0x7fc5e014fc30 2023-05-17T15:10:52.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.253+0000 7fc5dcff9700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5cc05ed60 0x7fc5cc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.253+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5842+0+0 (secure 0 0 0) 0x7fc5d007bb20 con 0x7fc5e014fc30 2023-05-17T15:10:52.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.253+0000 7fc5e489d700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5cc05ed60 0x7fc5cc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.253+0000 7fc5e489d700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5cc05ed60 0x7fc5cc061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc5d8007fd0 tx=0x7fc5d8009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:52.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.257+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5d004d1d0 con 0x7fc5e014fc30 2023-05-17T15:10:52.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.475+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5e0152510 con 0x7fc5e014fc30 2023-05-17T15:10:52.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.475+0000 7fc5dcff9700 1 -- 172.21.15.27:0/568978442 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc5d0029030 con 0x7fc5e014fc30 2023-05-17T15:10:52.480 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:52.480 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/3924125477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3924125477},{"type":"v1","addr":"172.21.15.40:6834","nonce":3924125477}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7566,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1646515777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1646515777},{"type":"v1","addr":"172.21.15.27:6834","nonce":1646515777}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2343255732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2343255732},{"type":"v1","addr":"172.21.15.27:6835","nonce":2343255732}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3220579661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3220579661},{"type":"v1","addr":"172.21.15.40:6835","nonce":3220579661}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[]} 2023-05-17T15:10:52.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5cc05ed60 msgr2=0x7fc5cc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5cc05ed60 0x7fc5cc061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc5d8007fd0 tx=0x7fc5d8009040).stop 2023-05-17T15:10:52.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 msgr2=0x7fc5e00681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 0x7fc5e00681a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fc5d0009700 tx=0x7fc5d0017000).stop 2023-05-17T15:10:52.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 shutdown_connections 2023-05-17T15:10:52.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fc5cc05ed60 0x7fc5cc061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e014fc30 0x7fc5e00681a0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e00bd970 0x7fc5e01426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 --2- 172.21.15.27:0/568978442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e014f850 0x7fc5e0067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 >> 172.21.15.27:0/568978442 conn(0x7fc5e00c8400 msgr2=0x7fc5e00a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:52.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 shutdown_connections 2023-05-17T15:10:52.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.477+0000 7fc5e6b01700 1 -- 172.21.15.27:0/568978442 wait complete. 2023-05-17T15:10:52.483 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 54 2023-05-17T15:10:52.493 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:10:52.494 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:10:52.494 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:10:52.494 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:52.494 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:10:52.495 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:10:52.495 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:10:52.495 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:52.495 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:10:52.496 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:10:52.496 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:10:52.496 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:52.496 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:10:52.497 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:10:52.497 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:10:52.497 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:10:52.502 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:10:52.502 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:10:52.503 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:10:52.504 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:10:52.507 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:10:52.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:10:52.508 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:10:52.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:10:52.545 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:10:52.546 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:52.547 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:10:52.547 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:52.550 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:10:52.550 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:52.551 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:10:52.551 DEBUG:teuthology.parallel:result is None 2023-05-17T15:10:52.552 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:10:52.619 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:10:52.620 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:10:52.636 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:10:52.636 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:10:52.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.672+0000 7fa5c85cd700 1 Processor -- start 2023-05-17T15:10:52.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.672+0000 7fa5c85cd700 1 -- start start 2023-05-17T15:10:52.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c85cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c00be280 0x7fa5c0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c85cd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00a7bf0 con 0x7fa5c005e2f0 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c85cd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c0155970 con 0x7fa5c005df10 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c85cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c005e750 con 0x7fa5c00be280 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5b68700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa5c005e2f0 0x7fa5c01517b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43034/0 (socket says 172.21.15.27:43034) 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5b68700 1 -- 172.21.15.27:0/3609967331 learned_addr learned my addr 172.21.15.27:0/3609967331 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158550352 0 0) 0x7fa5c00a7bf0 con 0x7fa5c005e2f0 2023-05-17T15:10:52.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ac0033f0 con 0x7fa5c005e2f0 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c00be280 0x7fa5c0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744430556 0 0) 0x7fa5ac0033f0 con 0x7fa5c005e2f0 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c00be280 msgr2=0x7fa5c0151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c00be280 0x7fa5c0151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 >> v1:172.21.15.40:6789/0 conn(0x7fa5c005df10 legacy=0x7fa5c0064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0155c30 con 0x7fa5c005e2f0 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fa5b0001470 con 0x7fa5c005e2f0 2023-05-17T15:10:52.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 >> v1:172.21.15.27:6789/0 conn(0x7fa5c005e2f0 legacy=0x7fa5c01517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac003910 0x7fa5ac003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.673+0000 7fa5c5367700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5ac004690 0x7fa5ac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5ac00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c005e750 con 0x7fa5ac005000 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac00be30 con 0x7fa5ac003910 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac00bff0 con 0x7fa5ac004690 2023-05-17T15:10:52.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c00be280 0x7fa5c0151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6369700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac003910 0x7fa5ac003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5ac00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5b68700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5ac004690 0x7fa5ac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 -- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5ac004690 msgr2=0x7fa5ac004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5ac004690 0x7fa5ac004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 -- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac003910 msgr2=0x7fa5ac003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac003910 0x7fa5ac003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 -- 172.21.15.27:0/3609967331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0033f0 con 0x7fa5ac005000 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5ac00b8e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fa5c00a73c0 tx=0x7fa5b80097b0).ready entity=mon.0 client_cookie=c0700b0e760eb1ed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009aa0 con 0x7fa5ac005000 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b800f040 con 0x7fa5ac005000 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.674+0000 7fa5c5367700 1 -- 172.21.15.27:0/3609967331 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8007dd0 con 0x7fa5ac005000 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c85cd700 1 -- 172.21.15.27:0/3609967331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 msgr2=0x7fa5ac00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/3609967331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5ac00b8e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7fa5c00a73c0 tx=0x7fa5b80097b0).stop 2023-05-17T15:10:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c6b6a700 1 -- 172.21.15.27:0/3609967331 reap_dead start 2023-05-17T15:10:52.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c85cd700 1 -- 172.21.15.27:0/3609967331 shutdown_connections 2023-05-17T15:10:52.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c85cd700 1 -- 172.21.15.27:0/3609967331 >> 172.21.15.27:0/3609967331 conn(0x7fa5c00c7910 msgr2=0x7fa5c00c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:52.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c85cd700 1 -- 172.21.15.27:0/3609967331 shutdown_connections 2023-05-17T15:10:52.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.675+0000 7fa5c85cd700 1 -- 172.21.15.27:0/3609967331 wait complete. 2023-05-17T15:10:52.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.676+0000 7fa5c85cd700 1 Processor -- start 2023-05-17T15:10:52.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.676+0000 7fa5c85cd700 1 -- start start 2023-05-17T15:10:52.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5c014b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c014b860 0x7fa5c00c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c00c6c10 0x7fa5c0154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0165b80 con 0x7fa5ac005000 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c7090 con 0x7fa5c00c6c10 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01666c0 con 0x7fa5c014b860 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5c014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5c014b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43482/0 (socket says 172.21.15.27:43482) 2023-05-17T15:10:52.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 -- 172.21.15.27:0/763819588 learned_addr learned my addr 172.21.15.27:0/763819588 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c5b68700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c014b860 0x7fa5c00c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6b6a700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c00c6c10 0x7fa5c0154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 -- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c014b860 msgr2=0x7fa5c00c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c014b860 0x7fa5c00c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 -- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c00c6c10 msgr2=0x7fa5c0154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c00c6c10 0x7fa5c0154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 -- 172.21.15.27:0/763819588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0165d90 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c6369700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5c014b370 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fa5bc001050 tx=0x7fa5bc007b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00f8d0 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00fa30 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c0166070 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00fdd0 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.677+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00c00d0 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.678+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c00661f0 con 0x7fa5ac005000 2023-05-17T15:10:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.679+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa5bc01b030 con 0x7fa5ac005000 2023-05-17T15:10:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.679+0000 7fa5b67fc700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa5a405edc0 0x7fa5a4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.679+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5842+0+0 (secure 0 0 0) 0x7fa5bc0798b0 con 0x7fa5ac005000 2023-05-17T15:10:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.679+0000 7fa5c5b68700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa5a405edc0 0x7fa5a4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.680+0000 7fa5c5b68700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa5a405edc0 0x7fa5a4061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa5b00015a0 tx=0x7fa5b0009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.683+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5bc04af60 con 0x7fa5ac005000 2023-05-17T15:10:52.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:52.874+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa5c0166a50 con 0x7fa5ac005000 2023-05-17T15:10:53.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.727+0000 7fa5b67fc700 1 -- 172.21.15.27:0/763819588 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v136) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa5bc04e580 con 0x7fa5ac005000 2023-05-17T15:10:53.733 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa5a405edc0 msgr2=0x7fa5a4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa5a405edc0 0x7fa5a4061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa5b00015a0 tx=0x7fa5b0009040).stop 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 msgr2=0x7fa5c014b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5c014b370 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fa5bc001050 tx=0x7fa5bc007b70).stop 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 shutdown_connections 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa5a405edc0 0x7fa5a4061280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c00c6c10 0x7fa5c0154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5ac005000 0x7fa5c014b370 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 --2- 172.21.15.27:0/763819588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5c014b860 0x7fa5c00c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.729+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 >> 172.21.15.27:0/763819588 conn(0x7fa5c00c7910 msgr2=0x7fa5c0063340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.730+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 shutdown_connections 2023-05-17T15:10:53.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.730+0000 7fa5c85cd700 1 -- 172.21.15.27:0/763819588 wait complete. 2023-05-17T15:10:53.735 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:10:53.748 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:10:53.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.867+0000 7fccbd67e700 1 Processor -- start 2023-05-17T15:10:53.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.867+0000 7fccbd67e700 1 -- start start 2023-05-17T15:10:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccbd67e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccb80c1180 0x7fccb80c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccbd67e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb80c07e0 con 0x7fccb81544f0 2023-05-17T15:10:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccbd67e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb81549b0 con 0x7fccb80c1560 2023-05-17T15:10:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccbd67e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb8154c90 con 0x7fccb80c1180 2023-05-17T15:10:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb77fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fccb81544f0 0x7fccb80a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43056/0 (socket says 172.21.15.27:43056) 2023-05-17T15:10:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb77fe700 1 -- 172.21.15.27:0/3604513027 learned_addr learned my addr 172.21.15.27:0/3604513027 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb7fff700 1 --2- 172.21.15.27:0/3604513027 >> v2:172.21.15.40:3300/0 conn(0x7fccb80c1180 0x7fccb80c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810975620 0 0) 0x7fccb80c07e0 con 0x7fccb81544f0 2023-05-17T15:10:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca00033f0 con 0x7fccb81544f0 2023-05-17T15:10:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1114184630 0 0) 0x7fcca00033f0 con 0x7fccb81544f0 2023-05-17T15:10:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 >> v2:172.21.15.40:3300/0 conn(0x7fccb80c1180 msgr2=0x7fccb80c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 --2- 172.21.15.27:0/3604513027 >> v2:172.21.15.40:3300/0 conn(0x7fccb80c1180 0x7fccb80c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 >> v1:172.21.15.40:6789/0 conn(0x7fccb80c1560 legacy=0x7fccb80c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8154f70 con 0x7fccb81544f0 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fcca8001470 con 0x7fccb81544f0 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.868+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 >> v1:172.21.15.27:6789/0 conn(0x7fccb81544f0 legacy=0x7fccb80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00038e0 0x7fcca0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcca0004690 0x7fcca0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0005050 0x7fcca000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb8154c90 con 0x7fcca0004690 2023-05-17T15:10:53.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca000bfe0 con 0x7fcca00038e0 2023-05-17T15:10:53.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca000c1a0 con 0x7fcca0005050 2023-05-17T15:10:53.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcca0004690 0x7fcca0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb7fff700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00038e0 0x7fcca0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccbce7d700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0005050 0x7fcca000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 -- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0005050 msgr2=0x7fcca000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:53.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0005050 0x7fcca000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 -- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00038e0 msgr2=0x7fcca0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:53.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00038e0 0x7fcca0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 -- 172.21.15.27:0/3604513027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00033f0 con 0x7fcca0004690 2023-05-17T15:10:53.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccbce7d700 1 -- 172.21.15.27:0/3604513027 reap_dead start 2023-05-17T15:10:53.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb77fe700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcca0004690 0x7fcca0004b10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fcca800c160 tx=0x7fcca8001e50).ready entity=mon.0 client_cookie=e9a8f4037fb81553 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8007a20 con 0x7fcca0004690 2023-05-17T15:10:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca800ca50 con 0x7fcca0004690 2023-05-17T15:10:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.869+0000 7fccb6ffd700 1 -- 172.21.15.27:0/3604513027 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca800ce10 con 0x7fcca0004690 2023-05-17T15:10:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 -- 172.21.15.27:0/3604513027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcca0004690 msgr2=0x7fcca0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcca0004690 0x7fcca0004b10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fcca800c160 tx=0x7fcca8001e50).stop 2023-05-17T15:10:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 -- 172.21.15.27:0/3604513027 shutdown_connections 2023-05-17T15:10:53.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 --2- 172.21.15.27:0/3604513027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcca0004690 0x7fcca0004b10 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 -- 172.21.15.27:0/3604513027 >> 172.21.15.27:0/3604513027 conn(0x7fccb805dd50 msgr2=0x7fccb805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 -- 172.21.15.27:0/3604513027 shutdown_connections 2023-05-17T15:10:53.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.870+0000 7fccbd67e700 1 -- 172.21.15.27:0/3604513027 wait complete. 2023-05-17T15:10:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.871+0000 7fccbd67e700 1 Processor -- start 2023-05-17T15:10:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.871+0000 7fccbd67e700 1 -- start start 2023-05-17T15:10:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbd67e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0004690 0x7fccb80c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbd67e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb8145170 0x7fccb8147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbd67e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 0x7fccb80c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbd67e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80c3010 con 0x7fccb80c34a0 2023-05-17T15:10:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbd67e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80c4c00 con 0x7fccb8145170 2023-05-17T15:10:53.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbd67e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80c4e80 con 0x7fcca0004690 2023-05-17T15:10:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 0x7fccb80c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 0x7fccb80c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43508/0 (socket says 172.21.15.27:43508) 2023-05-17T15:10:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 -- 172.21.15.27:0/1264647913 learned_addr learned my addr 172.21.15.27:0/1264647913 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:53.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccb77fe700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb8145170 0x7fccb8147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccb7fff700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0004690 0x7fccb80c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 -- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0004690 msgr2=0x7fccb80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0004690 0x7fccb80c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 -- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb8145170 msgr2=0x7fccb8147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb8145170 0x7fccb8147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 -- 172.21.15.27:0/1264647913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb80c2720 con 0x7fccb80c34a0 2023-05-17T15:10:53.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccb7fff700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0004690 0x7fccb80c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:53.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.872+0000 7fccbce7d700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 0x7fccb80c3920 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fccb8083b80 tx=0x7fccb0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:53.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.873+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0006c30 con 0x7fccb80c34a0 2023-05-17T15:10:53.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.873+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0006d90 con 0x7fccb80c34a0 2023-05-17T15:10:53.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.873+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb80c29c0 con 0x7fccb80c34a0 2023-05-17T15:10:53.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.873+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0007260 con 0x7fccb80c34a0 2023-05-17T15:10:53.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.873+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb8147ff0 con 0x7fccb80c34a0 2023-05-17T15:10:53.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.874+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb80c2e60 con 0x7fccb80c34a0 2023-05-17T15:10:53.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.874+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fccb00075d0 con 0x7fccb80c34a0 2023-05-17T15:10:53.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.874+0000 7fcc9ffff700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcca405ed90 0x7fcca4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:53.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.874+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5369+0+0 (secure 0 0 0) 0x7fccb0078f70 con 0x7fccb80c34a0 2023-05-17T15:10:53.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.875+0000 7fccb7fff700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcca405ed90 0x7fcca4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:53.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.875+0000 7fccb7fff700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcca405ed90 0x7fcca4061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fccac006d80 tx=0x7fccac008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:53.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:53.878+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccb004a8b0 con 0x7fccb80c34a0 2023-05-17T15:10:54.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.118+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fccb806bdf0 con 0x7fccb80c34a0 2023-05-17T15:10:54.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.119+0000 7fcc9ffff700 1 -- 172.21.15.27:0/1264647913 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fccb004ded0 con 0x7fccb80c34a0 2023-05-17T15:10:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:54.123 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:10:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:10:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.123 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.124 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.125 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:10:54.126 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.127 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:54.128 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.129 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:10:54.130 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:10:54.131 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.132 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.134 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.136 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:10:54.137 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.138 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:10:54.140 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.141 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.142 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:10:54.144 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.145 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:10:54.146 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:10:54.147 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:10:54.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcca405ed90 msgr2=0x7fcca4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcca405ed90 0x7fcca4061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fccac006d80 tx=0x7fccac008040).stop 2023-05-17T15:10:54.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 msgr2=0x7fccb80c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 0x7fccb80c3920 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fccb8083b80 tx=0x7fccb0007f30).stop 2023-05-17T15:10:54.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 shutdown_connections 2023-05-17T15:10:54.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcca405ed90 0x7fcca4061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccb80c34a0 0x7fccb80c3920 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcca0004690 0x7fccb80c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 --2- 172.21.15.27:0/1264647913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb8145170 0x7fccb8147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 >> 172.21.15.27:0/1264647913 conn(0x7fccb805dd50 msgr2=0x7fccb80afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:54.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 shutdown_connections 2023-05-17T15:10:54.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.121+0000 7fccbd67e700 1 -- 172.21.15.27:0/1264647913 wait complete. 2023-05-17T15:10:54.151 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:54.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.263+0000 7fcda56fd700 1 Processor -- start 2023-05-17T15:10:54.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.263+0000 7fcda56fd700 1 -- start start 2023-05-17T15:10:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcda56fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcda56fd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcda0065350 0x7fcda0065800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcda56fd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda0065cf0 con 0x7fcda00664a0 2023-05-17T15:10:54.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcda56fd700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda00c4180 con 0x7fcda0065350 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcda56fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00bde90 con 0x7fcda0154000 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcd9f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcda0065350 0x7fcda0065800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcd9f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcda0065350 0x7fcda0065800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43514/0 (socket says 172.21.15.27:43514) 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcd9f7fe700 1 -- 172.21.15.27:0/2315677274 learned_addr learned my addr 172.21.15.27:0/2315677274 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.264+0000 7fcd9effd700 1 --2- 172.21.15.27:0/2315677274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9f7fe700 1 -- 172.21.15.27:0/2315677274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 msgr2=0x7fcda00bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9f7fe700 1 --2- 172.21.15.27:0/2315677274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9f7fe700 1 -- 172.21.15.27:0/2315677274 >> v1:172.21.15.40:6789/0 conn(0x7fcda00664a0 legacy=0x7fcda0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9f7fe700 1 -- 172.21.15.27:0/2315677274 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0068ef0 con 0x7fcda0065350 2023-05-17T15:10:54.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9f7fe700 1 --2- 172.21.15.27:0/2315677274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda0065350 0x7fcda0065800 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fcd90009f20 tx=0x7fcd90009840).ready entity=mon.0 client_cookie=ae2d1f1f6ffadd75 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9dffb700 1 -- 172.21.15.27:0/2315677274 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000e070 con 0x7fcda0065350 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9dffb700 1 -- 172.21.15.27:0/2315677274 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000b9d0 con 0x7fcda0065350 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcd9dffb700 1 -- 172.21.15.27:0/2315677274 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000bd50 con 0x7fcda0065350 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 -- 172.21.15.27:0/2315677274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda0065350 msgr2=0x7fcda0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 --2- 172.21.15.27:0/2315677274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda0065350 0x7fcda0065800 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fcd90009f20 tx=0x7fcd90009840).stop 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 -- 172.21.15.27:0/2315677274 shutdown_connections 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 --2- 172.21.15.27:0/2315677274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda0065350 0x7fcda0065800 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 --2- 172.21.15.27:0/2315677274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 -- 172.21.15.27:0/2315677274 >> 172.21.15.27:0/2315677274 conn(0x7fcda00c94d0 msgr2=0x7fcda00c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:54.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 -- 172.21.15.27:0/2315677274 shutdown_connections 2023-05-17T15:10:54.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.265+0000 7fcda56fd700 1 -- 172.21.15.27:0/2315677274 wait complete. 2023-05-17T15:10:54.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 Processor -- start 2023-05-17T15:10:54.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 -- start start 2023-05-17T15:10:54.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda0065350 0x7fcda014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 0x7fcda0152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00abe00 con 0x7fcda00664a0 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0153250 con 0x7fcda0065350 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.267+0000 7fcda56fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0153530 con 0x7fcda0154000 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 0x7fcda0152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 0x7fcda0152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43520/0 (socket says 172.21.15.27:43520) 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 -- 172.21.15.27:0/449415924 learned_addr learned my addr 172.21.15.27:0/449415924 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9f7fe700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9effd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda0065350 0x7fcda014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 -- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 msgr2=0x7fcda00bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 -- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda0065350 msgr2=0x7fcda014ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda0065350 0x7fcda014ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 -- 172.21.15.27:0/449415924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90009ae0 con 0x7fcda00664a0 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd9e7fc700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 0x7fcda0152850 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fcd9400c440 tx=0x7fcd94007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94007020 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd94007180 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0153810 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94007520 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.268+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda014f360 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.269+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda00bd9a0 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.269+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcd94010070 con 0x7fcda00664a0 2023-05-17T15:10:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.270+0000 7fcd86ffd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcd8c05ed90 0x7fcd8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.270+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5369+0+0 (secure 0 0 0) 0x7fcd94078e90 con 0x7fcda00664a0 2023-05-17T15:10:54.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.270+0000 7fcd9effd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcd8c05ed90 0x7fcd8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.270+0000 7fcd9effd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcd8c05ed90 0x7fcd8c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcd98009b90 tx=0x7fcd98009060).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.274+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd9404a720 con 0x7fcda00664a0 2023-05-17T15:10:54.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.447+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcda0065cf0 con 0x7fcda00664a0 2023-05-17T15:10:54.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.448+0000 7fcd86ffd700 1 -- 172.21.15.27:0/449415924 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+13882 (secure 0 0 0) 0x7fcda0065cf0 con 0x7fcda00664a0 2023-05-17T15:10:54.452 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:54.453 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":136,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:53.720224+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcd8c05ed90 msgr2=0x7fcd8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcd8c05ed90 0x7fcd8c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcd98009b90 tx=0x7fcd98009060).stop 2023-05-17T15:10:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 msgr2=0x7fcda0152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 0x7fcda0152850 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fcd9400c440 tx=0x7fcd94007dd0).stop 2023-05-17T15:10:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 shutdown_connections 2023-05-17T15:10:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fcd8c05ed90 0x7fcd8c061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda0154000 0x7fcda00bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda0065350 0x7fcda014ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.449+0000 7fcda56fd700 1 --2- 172.21.15.27:0/449415924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcda00664a0 0x7fcda0152850 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.450+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 >> 172.21.15.27:0/449415924 conn(0x7fcda00c94d0 msgr2=0x7fcda0064450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.450+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 shutdown_connections 2023-05-17T15:10:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.450+0000 7fcda56fd700 1 -- 172.21.15.27:0/449415924 wait complete. 2023-05-17T15:10:54.465 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:10:54.466 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:10:54.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.581+0000 7f88d62f1700 1 Processor -- start 2023-05-17T15:10:54.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.581+0000 7f88d62f1700 1 -- start start 2023-05-17T15:10:54.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88d62f1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88d00c6310 0x7f88d0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88d62f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d00691f0 0x7f88d00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88d62f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d0158790 con 0x7f88d01543d0 2023-05-17T15:10:54.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88d62f1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00c1c50 con 0x7f88d00c6310 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88d62f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0157e60 con 0x7f88d00691f0 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88d00c6310 0x7f88d0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f88d01543d0 0x7f88d00c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43088/0 (socket says 172.21.15.27:43088) 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88d00c6310 0x7f88d0068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43528/0 (socket says 172.21.15.27:43528) 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cffff700 1 -- 172.21.15.27:0/3301990295 learned_addr learned my addr 172.21.15.27:0/3301990295 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88d488e700 1 --2- 172.21.15.27:0/3301990295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d00691f0 0x7f88d00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cf7fe700 1 -- 172.21.15.27:0/3301990295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d00691f0 msgr2=0x7f88d00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cf7fe700 1 --2- 172.21.15.27:0/3301990295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d00691f0 0x7f88d00bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cf7fe700 1 -- 172.21.15.27:0/3301990295 >> v1:172.21.15.27:6789/0 conn(0x7f88d01543d0 legacy=0x7f88d00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88cf7fe700 1 -- 172.21.15.27:0/3301990295 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0158140 con 0x7f88d00c6310 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.582+0000 7f88ceffd700 1 -- 172.21.15.27:0/3301990295 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401146406 0 0) 0x7f88d0158790 con 0x7f88d01543d0 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88cf7fe700 1 --2- 172.21.15.27:0/3301990295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00c6310 0x7f88d0068d00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f88c4009760 tx=0x7f88c4009060).ready entity=mon.0 client_cookie=65e87feb6eac2d5a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88ceffd700 1 -- 172.21.15.27:0/3301990295 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400b580 con 0x7f88d00c6310 2023-05-17T15:10:54.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88ceffd700 1 -- 172.21.15.27:0/3301990295 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c400b6e0 con 0x7f88d00c6310 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88ceffd700 1 -- 172.21.15.27:0/3301990295 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400ba60 con 0x7f88d00c6310 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 -- 172.21.15.27:0/3301990295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00c6310 msgr2=0x7f88d0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3301990295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00c6310 0x7f88d0068d00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f88c4009760 tx=0x7f88c4009060).stop 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 -- 172.21.15.27:0/3301990295 shutdown_connections 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3301990295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d00691f0 0x7f88d00bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3301990295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00c6310 0x7f88d0068d00 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 -- 172.21.15.27:0/3301990295 >> 172.21.15.27:0/3301990295 conn(0x7f88d00cb7f0 msgr2=0x7f88d00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 -- 172.21.15.27:0/3301990295 shutdown_connections 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.583+0000 7f88d62f1700 1 -- 172.21.15.27:0/3301990295 wait complete. 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.584+0000 7f88d62f1700 1 Processor -- start 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 -- start start 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 0x7f88d0152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d00c6310 0x7f88d00af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d01543d0 0x7f88d01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01647f0 con 0x7f88d00691f0 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00afdf0 con 0x7f88d00c6310 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d62f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00b00d0 con 0x7f88d01543d0 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88cffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 0x7f88d0152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88cffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 0x7f88d0152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43534/0 (socket says 172.21.15.27:43534) 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88cffff700 1 -- 172.21.15.27:0/3250448866 learned_addr learned my addr 172.21.15.27:0/3250448866 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:54.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88d488e700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d01543d0 0x7f88d01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.585+0000 7f88cf7fe700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d00c6310 0x7f88d00af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cffff700 1 -- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d01543d0 msgr2=0x7f88d01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cffff700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d01543d0 0x7f88d01547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cffff700 1 -- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d00c6310 msgr2=0x7f88d00af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cffff700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d00c6310 0x7f88d00af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cffff700 1 -- 172.21.15.27:0/3250448866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40092a0 con 0x7f88d00691f0 2023-05-17T15:10:54.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88d488e700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d01543d0 0x7f88d01547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cf7fe700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d00c6310 0x7f88d00af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88cffff700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 0x7f88d0152bb0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f88c0001eb0 tx=0x7f88c0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00072e0 con 0x7f88d00691f0 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0007440 con 0x7f88d00691f0 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d00b03b0 con 0x7f88d00691f0 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00057a0 con 0x7f88d00691f0 2023-05-17T15:10:54.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.586+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d01530a0 con 0x7f88d00691f0 2023-05-17T15:10:54.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.587+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d006bdf0 con 0x7f88d00691f0 2023-05-17T15:10:54.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.587+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f88c0010070 con 0x7f88d00691f0 2023-05-17T15:10:54.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.588+0000 7f88b7fff700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f88bc05ed90 0x7f88bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.588+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f88c0078f00 con 0x7f88d00691f0 2023-05-17T15:10:54.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.588+0000 7f88cf7fe700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f88bc05ed90 0x7f88bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.588+0000 7f88cf7fe700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f88bc05ed90 0x7f88bc061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f88d00c6710 tx=0x7f88c4017000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.592+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88c004a790 con 0x7f88d00691f0 2023-05-17T15:10:54.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.765+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f88d0158420 con 0x7f88d00691f0 2023-05-17T15:10:54.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.765+0000 7f88b7fff700 1 -- 172.21.15.27:0/3250448866 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7f88c004ddb0 con 0x7f88d00691f0 2023-05-17T15:10:54.769 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:10:54.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f88bc05ed90 msgr2=0x7f88bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f88bc05ed90 0x7f88bc061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f88d00c6710 tx=0x7f88c4017000).stop 2023-05-17T15:10:54.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 msgr2=0x7f88d0152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 0x7f88d0152bb0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f88c0001eb0 tx=0x7f88c0007e90).stop 2023-05-17T15:10:54.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 shutdown_connections 2023-05-17T15:10:54.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f88bc05ed90 0x7f88bc061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d01543d0 0x7f88d01547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88d00691f0 0x7f88d0152bb0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 --2- 172.21.15.27:0/3250448866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d00c6310 0x7f88d00af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 >> 172.21.15.27:0/3250448866 conn(0x7f88d00cb7f0 msgr2=0x7f88d0156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 shutdown_connections 2023-05-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.767+0000 7f88d62f1700 1 -- 172.21.15.27:0/3250448866 wait complete. 2023-05-17T15:10:54.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:10:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 Processor -- start 2023-05-17T15:10:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 -- start start 2023-05-17T15:10:54.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f772c0cac00 0x7f772c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f772c157980 0x7f772c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0c60d0 con 0x7f772c1537e0 2023-05-17T15:10:54.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c1588b0 con 0x7f772c0cac00 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.898+0000 7f77308ac700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c157e00 con 0x7f772c157980 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772ad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f772c0cac00 0x7f772c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772b59e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f772c1537e0 0x7f772c153c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43104/0 (socket says 172.21.15.27:43104) 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772b59e700 1 -- 172.21.15.27:0/2230377858 learned_addr learned my addr 172.21.15.27:0/2230377858 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772ad9d700 1 -- 172.21.15.27:0/2230377858 >> v2:172.21.15.40:3300/0 conn(0x7f772c157980 msgr2=0x7f772c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772ad9d700 1 --2- 172.21.15.27:0/2230377858 >> v2:172.21.15.40:3300/0 conn(0x7f772c157980 0x7f772c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f7729d9b700 1 -- 172.21.15.27:0/2230377858 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714643120 0 0) 0x7f772c0c60d0 con 0x7f772c1537e0 2023-05-17T15:10:54.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772ad9d700 1 -- 172.21.15.27:0/2230377858 >> v1:172.21.15.27:6789/0 conn(0x7f772c1537e0 legacy=0x7f772c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772ad9d700 1 -- 172.21.15.27:0/2230377858 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c158010 con 0x7f772c0cac00 2023-05-17T15:10:54.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f772ad9d700 1 --2- 172.21.15.27:0/2230377858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c0cac00 0x7f772c0cafe0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f772c05ec40 tx=0x7f771c009060).ready entity=mon.0 client_cookie=bb61a98ba40073de server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f7729d9b700 1 -- 172.21.15.27:0/2230377858 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c00b580 con 0x7f772c0cac00 2023-05-17T15:10:54.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f7729d9b700 1 -- 172.21.15.27:0/2230377858 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c00b6e0 con 0x7f772c0cac00 2023-05-17T15:10:54.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.899+0000 7f7729d9b700 1 -- 172.21.15.27:0/2230377858 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c00ba60 con 0x7f772c0cac00 2023-05-17T15:10:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 -- 172.21.15.27:0/2230377858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c0cac00 msgr2=0x7f772c0cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 --2- 172.21.15.27:0/2230377858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c0cac00 0x7f772c0cafe0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f772c05ec40 tx=0x7f771c009060).stop 2023-05-17T15:10:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 -- 172.21.15.27:0/2230377858 shutdown_connections 2023-05-17T15:10:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 --2- 172.21.15.27:0/2230377858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c0cac00 0x7f772c0cafe0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 --2- 172.21.15.27:0/2230377858 >> v2:172.21.15.40:3300/0 conn(0x7f772c157980 0x7f772c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:10:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 -- 172.21.15.27:0/2230377858 >> 172.21.15.27:0/2230377858 conn(0x7f772c05dd50 msgr2=0x7f772c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 -- 172.21.15.27:0/2230377858 shutdown_connections 2023-05-17T15:10:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.900+0000 7f77308ac700 1 -- 172.21.15.27:0/2230377858 wait complete. 2023-05-17T15:10:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.901+0000 7f77308ac700 1 Processor -- start 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.901+0000 7f77308ac700 1 -- start start 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c0cac00 0x7f772c165250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f772c1537e0 0x7f772c14f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 0x7f772c0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c0fb0 con 0x7f772c157980 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c2e60 con 0x7f772c0cac00 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c155420 con 0x7f772c1537e0 2023-05-17T15:10:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 0x7f772c0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 0x7f772c0aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43548/0 (socket says 172.21.15.27:43548) 2023-05-17T15:10:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 -- 172.21.15.27:0/928321884 learned_addr learned my addr 172.21.15.27:0/928321884 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772ad9d700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c0cac00 0x7f772c165250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772a59c700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f772c1537e0 0x7f772c14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 -- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f772c1537e0 msgr2=0x7f772c14f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f772c1537e0 0x7f772c14f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 -- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c0cac00 msgr2=0x7f772c165250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c0cac00 0x7f772c165250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 -- 172.21.15.27:0/928321884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c0092a0 con 0x7f772c157980 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772a59c700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f772c1537e0 0x7f772c14f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772ad9d700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c0cac00 0x7f772c165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f772b59e700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 0x7f772c0aea30 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f772400c7e0 tx=0x7f7724007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724005d30 con 0x7f772c157980 2023-05-17T15:10:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c165740 con 0x7f772c157980 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.902+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724005e90 con 0x7f772c157980 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.903+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724007320 con 0x7f772c157980 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.903+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c154e60 con 0x7f772c157980 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.903+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c1576e0 con 0x7f772c157980 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.904+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7724010030 con 0x7f772c157980 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.904+0000 7f7712ffd700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f771805ed90 0x7f7718061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.904+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f7724079910 con 0x7f772c157980 2023-05-17T15:10:54.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.904+0000 7f772ad9d700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f771805ed90 0x7f7718061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:54.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.905+0000 7f772ad9d700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f771805ed90 0x7f7718061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f772c0c8140 tx=0x7f771c017000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:54.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:54.908+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f772404b090 con 0x7f772c157980 2023-05-17T15:10:55.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.083+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f772c1582f0 con 0x7f772c157980 2023-05-17T15:10:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.083+0000 7f7712ffd700 1 -- 172.21.15.27:0/928321884 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7f772404e6b0 con 0x7f772c157980 2023-05-17T15:10:55.087 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:10:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f771805ed90 msgr2=0x7f7718061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f771805ed90 0x7f7718061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f772c0c8140 tx=0x7f771c017000).stop 2023-05-17T15:10:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 msgr2=0x7f772c0aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 0x7f772c0aea30 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f772400c7e0 tx=0x7f7724007f90).stop 2023-05-17T15:10:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 shutdown_connections 2023-05-17T15:10:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f771805ed90 0x7f7718061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f772c157980 0x7f772c0aea30 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c0cac00 0x7f772c165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 --2- 172.21.15.27:0/928321884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f772c1537e0 0x7f772c14f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 >> 172.21.15.27:0/928321884 conn(0x7f772c05dd50 msgr2=0x7f772c152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 shutdown_connections 2023-05-17T15:10:55.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.085+0000 7f77308ac700 1 -- 172.21.15.27:0/928321884 wait complete. 2023-05-17T15:10:55.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:10:55.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.212+0000 7f7e9c7ea700 1 Processor -- start 2023-05-17T15:10:55.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.212+0000 7f7e9c7ea700 1 -- start start 2023-05-17T15:10:55.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.213+0000 7f7e9c7ea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e940c60c0 0x7f7e940c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.213+0000 7f7e9c7ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940a9f70 0x7f7e94153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.213+0000 7f7e9c7ea700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9405e7e0 con 0x7f7e940aa3b0 2023-05-17T15:10:55.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.213+0000 7f7e9c7ea700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9405eac0 con 0x7f7e940c60c0 2023-05-17T15:10:55.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.213+0000 7f7e9c7ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940bfd70 con 0x7f7e940a9f70 2023-05-17T15:10:55.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e940c60c0 0x7f7e940c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9ad87700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7e940aa3b0 0x7f7e94157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43118/0 (socket says 172.21.15.27:43118) 2023-05-17T15:10:55.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e940c60c0 0x7f7e940c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43552/0 (socket says 172.21.15.27:43552) 2023-05-17T15:10:55.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9ad87700 1 -- 172.21.15.27:0/2323159344 learned_addr learned my addr 172.21.15.27:0/2323159344 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:55.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e99d85700 1 --2- 172.21.15.27:0/2323159344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940a9f70 0x7f7e94153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 -- 172.21.15.27:0/2323159344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940a9f70 msgr2=0x7f7e94153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 --2- 172.21.15.27:0/2323159344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940a9f70 0x7f7e94153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 -- 172.21.15.27:0/2323159344 >> v1:172.21.15.27:6789/0 conn(0x7f7e940aa3b0 legacy=0x7f7e94157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 -- 172.21.15.27:0/2323159344 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940c0050 con 0x7f7e940c60c0 2023-05-17T15:10:55.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e99584700 1 -- 172.21.15.27:0/2323159344 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572525197 0 0) 0x7f7e9405e7e0 con 0x7f7e940aa3b0 2023-05-17T15:10:55.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e9a586700 1 --2- 172.21.15.27:0/2323159344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940c60c0 0x7f7e940c64a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f7e8c009760 tx=0x7f7e8c009060).ready entity=mon.0 client_cookie=9e1fa12b64a046d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e99584700 1 -- 172.21.15.27:0/2323159344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00b580 con 0x7f7e940c60c0 2023-05-17T15:10:55.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e99584700 1 -- 172.21.15.27:0/2323159344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00b6e0 con 0x7f7e940c60c0 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.214+0000 7f7e99584700 1 -- 172.21.15.27:0/2323159344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00ba60 con 0x7f7e940c60c0 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2323159344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940c60c0 msgr2=0x7f7e940c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2323159344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940c60c0 0x7f7e940c64a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f7e8c009760 tx=0x7f7e8c009060).stop 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2323159344 shutdown_connections 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2323159344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940c60c0 0x7f7e940c64a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2323159344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940a9f70 0x7f7e94153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2323159344 >> 172.21.15.27:0/2323159344 conn(0x7f7e94069e70 msgr2=0x7f7e9405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:55.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2323159344 shutdown_connections 2023-05-17T15:10:55.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.215+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2323159344 wait complete. 2023-05-17T15:10:55.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.216+0000 7f7e9c7ea700 1 Processor -- start 2023-05-17T15:10:55.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.216+0000 7f7e9c7ea700 1 -- start start 2023-05-17T15:10:55.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 0x7f7e940c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940aa3b0 0x7f7e940a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e940c60c0 0x7f7e940a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940c4d10 con 0x7f7e940a9f70 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940a2490 con 0x7f7e940c60c0 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94165920 con 0x7f7e940aa3b0 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 0x7f7e940c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 0x7f7e940c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43558/0 (socket says 172.21.15.27:43558) 2023-05-17T15:10:55.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 -- 172.21.15.27:0/2886829581 learned_addr learned my addr 172.21.15.27:0/2886829581 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9ad87700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e940c60c0 0x7f7e940a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e99d85700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940aa3b0 0x7f7e940a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 -- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940aa3b0 msgr2=0x7f7e940a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940aa3b0 0x7f7e940a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 -- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e940c60c0 msgr2=0x7f7e940a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e940c60c0 0x7f7e940a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 -- 172.21.15.27:0/2886829581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0092a0 con 0x7f7e940a9f70 2023-05-17T15:10:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9a586700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 0x7f7e940c3d00 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f7e94067930 tx=0x7f7e8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00b850 con 0x7f7e940a9f70 2023-05-17T15:10:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00b9b0 con 0x7f7e940a9f70 2023-05-17T15:10:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940c41f0 con 0x7f7e940a9f70 2023-05-17T15:10:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c01b690 con 0x7f7e940a9f70 2023-05-17T15:10:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.217+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940c4750 con 0x7f7e940a9f70 2023-05-17T15:10:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.218+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e941656f0 con 0x7f7e940a9f70 2023-05-17T15:10:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.219+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7e8c00f070 con 0x7f7e940a9f70 2023-05-17T15:10:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.219+0000 7f7e927fc700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7e8005ed90 0x7f7e80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.219+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f7e8c07b0e0 con 0x7f7e940a9f70 2023-05-17T15:10:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.219+0000 7f7e99d85700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7e8005ed90 0x7f7e80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.220+0000 7f7e99d85700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7e8005ed90 0x7f7e80061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7e88006fd0 tx=0x7f7e88008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.223+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e941656f0 con 0x7f7e940a9f70 2023-05-17T15:10:55.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.398+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e941656f0 con 0x7f7e940a9f70 2023-05-17T15:10:55.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.398+0000 7f7e927fc700 1 -- 172.21.15.27:0/2886829581 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7e941656f0 con 0x7f7e940a9f70 2023-05-17T15:10:55.402 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:10:55.403 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:10:55.404 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:10:55.404 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7e8005ed90 msgr2=0x7f7e80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7e8005ed90 0x7f7e80061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7e88006fd0 tx=0x7f7e88008040).stop 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 msgr2=0x7f7e940c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 0x7f7e940c3d00 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f7e94067930 tx=0x7f7e8c017000).stop 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 shutdown_connections 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f7e8005ed90 0x7f7e80061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e940c60c0 0x7f7e940a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e940a9f70 0x7f7e940c3d00 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 --2- 172.21.15.27:0/2886829581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e940aa3b0 0x7f7e940a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 >> 172.21.15.27:0/2886829581 conn(0x7f7e94069e70 msgr2=0x7f7e940af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 shutdown_connections 2023-05-17T15:10:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.400+0000 7f7e9c7ea700 1 -- 172.21.15.27:0/2886829581 wait complete. 2023-05-17T15:10:55.415 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:10:55.416 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:10:55.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 Processor -- start 2023-05-17T15:10:55.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 -- start start 2023-05-17T15:10:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd8a4153a40 0x7fd8a4153e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8a40670c0 0x7fd8a40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a4066c30 con 0x7fd8a40c58d0 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40c5df0 con 0x7fd8a4153a40 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.533+0000 7fd8a914f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a4066300 con 0x7fd8a40670c0 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd8a4153a40 0x7fd8a4153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd8a4153a40 0x7fd8a4153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43566/0 (socket says 172.21.15.27:43566) 2023-05-17T15:10:55.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3161754389 learned_addr learned my addr 172.21.15.27:0/3161754389 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3161754389 >> v2:172.21.15.40:3300/0 conn(0x7fd8a40670c0 msgr2=0x7fd8a40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a37fe700 1 --2- 172.21.15.27:0/3161754389 >> v2:172.21.15.40:3300/0 conn(0x7fd8a40670c0 0x7fd8a40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 --2- 172.21.15.27:0/3161754389 >> v2:172.21.15.40:3300/0 conn(0x7fd8a40670c0 0x7fd8a40c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3161754389 >> v1:172.21.15.40:6789/0 conn(0x7fd8a40c58d0 legacy=0x7fd8a40c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3161754389 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40665e0 con 0x7fd8a4153a40 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a37fe700 1 --2- 172.21.15.27:0/3161754389 >> v2:172.21.15.40:3300/0 conn(0x7fd8a40670c0 0x7fd8a40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:55.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a3fff700 1 --2- 172.21.15.27:0/3161754389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a4153a40 0x7fd8a4153e20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fd8a40ad0d0 tx=0x7fd8940090f0).ready entity=mon.0 client_cookie=1ee718d93084dcb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a2ffd700 1 -- 172.21.15.27:0/3161754389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400b5a0 con 0x7fd8a4153a40 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a2ffd700 1 -- 172.21.15.27:0/3161754389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400b700 con 0x7fd8a4153a40 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.534+0000 7fd8a2ffd700 1 -- 172.21.15.27:0/3161754389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400ba80 con 0x7fd8a4153a40 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 -- 172.21.15.27:0/3161754389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a4153a40 msgr2=0x7fd8a4153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3161754389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a4153a40 0x7fd8a4153e20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fd8a40ad0d0 tx=0x7fd8940090f0).stop 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 -- 172.21.15.27:0/3161754389 shutdown_connections 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3161754389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a4153a40 0x7fd8a4153e20 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3161754389 >> v2:172.21.15.40:3300/0 conn(0x7fd8a40670c0 0x7fd8a40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 -- 172.21.15.27:0/3161754389 >> 172.21.15.27:0/3161754389 conn(0x7fd8a406a6f0 msgr2=0x7fd8a4063340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:55.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 -- 172.21.15.27:0/3161754389 shutdown_connections 2023-05-17T15:10:55.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.535+0000 7fd8a914f700 1 -- 172.21.15.27:0/3161754389 wait complete. 2023-05-17T15:10:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.536+0000 7fd8a914f700 1 Processor -- start 2023-05-17T15:10:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.536+0000 7fd8a914f700 1 -- start start 2023-05-17T15:10:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a914f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 0x7fd8a41514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a914f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8a40c58d0 0x7fd8a4155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a914f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a4153a40 0x7fd8a413e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a914f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4156510 con 0x7fd8a40670c0 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a914f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a41567f0 con 0x7fd8a4153a40 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a914f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4156ad0 con 0x7fd8a40c58d0 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 0x7fd8a41514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 0x7fd8a41514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43572/0 (socket says 172.21.15.27:43572) 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3773263728 learned_addr learned my addr 172.21.15.27:0/3773263728 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:55.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a894e700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a4153a40 0x7fd8a413e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a37fe700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8a40c58d0 0x7fd8a4155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8a40c58d0 msgr2=0x7fd8a4155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8a40c58d0 0x7fd8a4155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a4153a40 msgr2=0x7fd8a413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a4153a40 0x7fd8a413e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 -- 172.21.15.27:0/3773263728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009370 con 0x7fd8a40670c0 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.537+0000 7fd8a3fff700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 0x7fd8a41514c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fd894009130 tx=0x7fd894015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.538+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400b870 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.538+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400b9d0 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.538+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a4156db0 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.538+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89401b640 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.538+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a40aa050 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.539+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a40bdfe0 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.539+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd89400f070 con 0x7fd8a40670c0 2023-05-17T15:10:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.539+0000 7fd89bfff700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd88405ed90 0x7fd884061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.539+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5369+0+0 (secure 0 0 0) 0x7fd89407aca0 con 0x7fd8a40670c0 2023-05-17T15:10:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.539+0000 7fd8a37fe700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd88405ed90 0x7fd884061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.540+0000 7fd8a37fe700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd88405ed90 0x7fd884061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd8a40c3610 tx=0x7fd88c008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.544+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd89407f070 con 0x7fd8a40670c0 2023-05-17T15:10:55.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.717+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd8a4047150 con 0x7fd8a40670c0 2023-05-17T15:10:55.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.812+0000 7fd89bfff700 1 -- 172.21.15.27:0/3773263728 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v137) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd89404c530 con 0x7fd8a40670c0 2023-05-17T15:10:55.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd88405ed90 msgr2=0x7fd884061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd88405ed90 0x7fd884061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd8a40c3610 tx=0x7fd88c008040).stop 2023-05-17T15:10:55.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 msgr2=0x7fd8a41514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 0x7fd8a41514c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fd894009130 tx=0x7fd894015000).stop 2023-05-17T15:10:55.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 shutdown_connections 2023-05-17T15:10:55.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fd88405ed90 0x7fd884061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a4153a40 0x7fd8a413e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8a40670c0 0x7fd8a41514c0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 --2- 172.21.15.27:0/3773263728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8a40c58d0 0x7fd8a4155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.815+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 >> 172.21.15.27:0/3773263728 conn(0x7fd8a406a6f0 msgr2=0x7fd8a40c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:55.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.816+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 shutdown_connections 2023-05-17T15:10:55.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.816+0000 7fd8a914f700 1 -- 172.21.15.27:0/3773263728 wait complete. 2023-05-17T15:10:55.822 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:10:55.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:10:55.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.955+0000 7f09f06fe700 1 Processor -- start 2023-05-17T15:10:55.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.955+0000 7f09f06fe700 1 -- start start 2023-05-17T15:10:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.956+0000 7f09f06fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09e8069410 0x7f09e815f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.956+0000 7f09f06fe700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e80c0c90 con 0x7f09e81543d0 2023-05-17T15:10:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.956+0000 7f09f06fe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e8158790 con 0x7f09e80c6310 2023-05-17T15:10:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.956+0000 7f09f06fe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e80c1c50 con 0x7f09e8069410 2023-05-17T15:10:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.956+0000 7f09ee49a700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f09e81543d0 0x7f09e80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43142/0 (socket says 172.21.15.27:43142) 2023-05-17T15:10:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.956+0000 7f09ee49a700 1 -- 172.21.15.27:0/1291703845 learned_addr learned my addr 172.21.15.27:0/1291703845 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619443391 0 0) 0x7f09e80c0c90 con 0x7f09e81543d0 2023-05-17T15:10:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 --2- 172.21.15.27:0/1291703845 >> v2:172.21.15.40:3300/0 conn(0x7f09e8069410 0x7f09e815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d00033f0 con 0x7f09e81543d0 2023-05-17T15:10:55.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 555589170 0 0) 0x7f09d00033f0 con 0x7f09e81543d0 2023-05-17T15:10:55.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 >> v2:172.21.15.40:3300/0 conn(0x7f09e8069410 msgr2=0x7f09e815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:55.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 --2- 172.21.15.27:0/1291703845 >> v2:172.21.15.40:3300/0 conn(0x7f09e8069410 0x7f09e815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 >> v1:172.21.15.40:6789/0 conn(0x7f09e80c6310 legacy=0x7f09e8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8157e60 con 0x7f09e81543d0 2023-05-17T15:10:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f09e0001470 con 0x7f09e81543d0 2023-05-17T15:10:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 >> v1:172.21.15.27:6789/0 conn(0x7f09e81543d0 legacy=0x7f09e80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d00038e0 0x7f09d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09d0004690 0x7f09d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09d0005000 0x7f09d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000be80 con 0x7f09d0005000 2023-05-17T15:10:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000bff0 con 0x7f09d0004690 2023-05-17T15:10:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000c1b0 con 0x7f09d00038e0 2023-05-17T15:10:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09d0005000 0x7f09d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09ee49a700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d00038e0 0x7f09d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09edc99700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09d0004690 0x7f09d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 -- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d00038e0 msgr2=0x7f09d0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d00038e0 0x7f09d0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 -- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09d0004690 msgr2=0x7f09d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09d0004690 0x7f09d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 -- 172.21.15.27:0/1291703845 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00033f0 con 0x7f09d0005000 2023-05-17T15:10:55.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.957+0000 7f09eec9b700 1 -- 172.21.15.27:0/1291703845 reap_dead start 2023-05-17T15:10:55.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09eec9b700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09d0005000 0x7f09d000b8e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f09d800e210 tx=0x7f09d800b040).ready entity=mon.0 client_cookie=dc3aad182f8d04f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8009ac0 con 0x7f09d0005000 2023-05-17T15:10:55.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d800f040 con 0x7f09d0005000 2023-05-17T15:10:55.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09ed498700 1 -- 172.21.15.27:0/1291703845 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800ed10 con 0x7f09d0005000 2023-05-17T15:10:55.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 -- 172.21.15.27:0/1291703845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09d0005000 msgr2=0x7f09d000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09d0005000 0x7f09d000b8e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f09d800e210 tx=0x7f09d800b040).stop 2023-05-17T15:10:55.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 -- 172.21.15.27:0/1291703845 shutdown_connections 2023-05-17T15:10:55.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 --2- 172.21.15.27:0/1291703845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09d0005000 0x7f09d000b8e0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 -- 172.21.15.27:0/1291703845 >> 172.21.15.27:0/1291703845 conn(0x7f09e80cb7f0 msgr2=0x7f09e80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:55.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 -- 172.21.15.27:0/1291703845 shutdown_connections 2023-05-17T15:10:55.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.958+0000 7f09f06fe700 1 -- 172.21.15.27:0/1291703845 wait complete. 2023-05-17T15:10:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.959+0000 7f09f06fe700 1 Processor -- start 2023-05-17T15:10:55.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 -- start start 2023-05-17T15:10:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d0005000 0x7f09e8145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 0x7f09e80c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e80abc80 0x7f09e80ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e8150f30 con 0x7f09e80c1dc0 2023-05-17T15:10:55.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e81650b0 con 0x7f09e80abc80 2023-05-17T15:10:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09f06fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80ac5d0 con 0x7f09d0005000 2023-05-17T15:10:55.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09edc99700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 0x7f09e80c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09edc99700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 0x7f09e80c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43594/0 (socket says 172.21.15.27:43594) 2023-05-17T15:10:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09edc99700 1 -- 172.21.15.27:0/914259046 learned_addr learned my addr 172.21.15.27:0/914259046 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:55.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.960+0000 7f09ee49a700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d0005000 0x7f09e8145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09eec9b700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e80abc80 0x7f09e80ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09edc99700 1 -- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d0005000 msgr2=0x7f09e8145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09edc99700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d0005000 0x7f09e8145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09edc99700 1 -- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e80abc80 msgr2=0x7f09e80ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09edc99700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e80abc80 0x7f09e80ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:55.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09edc99700 1 -- 172.21.15.27:0/914259046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e81644a0 con 0x7f09e80c1dc0 2023-05-17T15:10:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09edc99700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 0x7f09e80c2240 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f09dc002690 tx=0x7f09dc007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0114c0 con 0x7f09e80c1dc0 2023-05-17T15:10:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc011620 con 0x7f09e80c1dc0 2023-05-17T15:10:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e8164780 con 0x7f09e80c1dc0 2023-05-17T15:10:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0119a0 con 0x7f09e80c1dc0 2023-05-17T15:10:55.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.961+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e8164d40 con 0x7f09e80c1dc0 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.962+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e80c3bd0 con 0x7f09e80c1dc0 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.963+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f09dc01a030 con 0x7f09e80c1dc0 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.963+0000 7f09e67fc700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f09d405ed90 0x7f09d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.963+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f09dc0790a0 con 0x7f09e80c1dc0 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.963+0000 7f09ee49a700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f09d405ed90 0x7f09d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.964+0000 7f09ee49a700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f09d405ed90 0x7f09d4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f09e0001050 tx=0x7f09e0001e50).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:55.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:55.968+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09dc0498f0 con 0x7f09e80c1dc0 2023-05-17T15:10:56.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.143+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f09e806bdf0 con 0x7f09e80c1dc0 2023-05-17T15:10:56.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.813+0000 7f09e67fc700 1 -- 172.21.15.27:0/914259046 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v138) v1 ==== 170+0+0 (secure 0 0 0) 0x7f09dc04e240 con 0x7f09e80c1dc0 2023-05-17T15:10:56.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.817+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f09d405ed90 msgr2=0x7f09d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.817+0000 7f09f06fe700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f09d405ed90 0x7f09d4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f09e0001050 tx=0x7f09e0001e50).stop 2023-05-17T15:10:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.817+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 msgr2=0x7f09e80c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:56.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.817+0000 7f09f06fe700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 0x7f09e80c2240 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f09dc002690 tx=0x7f09dc007bb0).stop 2023-05-17T15:10:56.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.820+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 shutdown_connections 2023-05-17T15:10:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.820+0000 7f09f06fe700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f09d405ed90 0x7f09d4061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.820+0000 7f09f06fe700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e80abc80 0x7f09e80ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.820+0000 7f09f06fe700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09d0005000 0x7f09e8145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.820+0000 7f09f06fe700 1 --2- 172.21.15.27:0/914259046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09e80c1dc0 0x7f09e80c2240 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.820+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 >> 172.21.15.27:0/914259046 conn(0x7f09e80cb7f0 msgr2=0x7f09e80bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:56.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.821+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 shutdown_connections 2023-05-17T15:10:56.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.822+0000 7f09f06fe700 1 -- 172.21.15.27:0/914259046 wait complete. 2023-05-17T15:10:56.828 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:10:56.851 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:10:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.970+0000 7f45fa278700 1 Processor -- start 2023-05-17T15:10:56.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.970+0000 7f45fa278700 1 -- start start 2023-05-17T15:10:56.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45fa278700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45f41543d0 0x7f45f40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:56.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45fa278700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f40bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:56.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45fa278700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4158790 con 0x7f45f40c60f0 2023-05-17T15:10:56.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45fa278700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40c1c50 con 0x7f45f41543d0 2023-05-17T15:10:56.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45fa278700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c6570 con 0x7f45f4069410 2023-05-17T15:10:56.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45f41543d0 0x7f45f40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:56.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f45f41543d0 0x7f45f40c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43600/0 (socket says 172.21.15.27:43600) 2023-05-17T15:10:56.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 -- 172.21.15.27:0/2635768696 learned_addr learned my addr 172.21.15.27:0/2635768696 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:56.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f8815700 1 --2- 172.21.15.27:0/2635768696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f40bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:56.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 -- 172.21.15.27:0/2635768696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 msgr2=0x7f45f40bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:56.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 --2- 172.21.15.27:0/2635768696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f40bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 -- 172.21.15.27:0/2635768696 >> v1:172.21.15.40:6789/0 conn(0x7f45f40c60f0 legacy=0x7f45f4068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 -- 172.21.15.27:0/2635768696 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4157e60 con 0x7f45f41543d0 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.971+0000 7f45f3fff700 1 --2- 172.21.15.27:0/2635768696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f41543d0 0x7f45f40c5c00 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f45e4006fd0 tx=0x7f45e40090f0).ready entity=mon.0 client_cookie=e4d6b62e054df02a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45f2ffd700 1 -- 172.21.15.27:0/2635768696 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400b600 con 0x7f45f41543d0 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45f2ffd700 1 -- 172.21.15.27:0/2635768696 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400b760 con 0x7f45f41543d0 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45f2ffd700 1 -- 172.21.15.27:0/2635768696 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400bae0 con 0x7f45f41543d0 2023-05-17T15:10:56.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 -- 172.21.15.27:0/2635768696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f41543d0 msgr2=0x7f45f40c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 --2- 172.21.15.27:0/2635768696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f41543d0 0x7f45f40c5c00 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f45e4006fd0 tx=0x7f45e40090f0).stop 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 -- 172.21.15.27:0/2635768696 shutdown_connections 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 --2- 172.21.15.27:0/2635768696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f40bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 --2- 172.21.15.27:0/2635768696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f41543d0 0x7f45f40c5c00 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 -- 172.21.15.27:0/2635768696 >> 172.21.15.27:0/2635768696 conn(0x7f45f40cb7f0 msgr2=0x7f45f40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 -- 172.21.15.27:0/2635768696 shutdown_connections 2023-05-17T15:10:56.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.972+0000 7f45fa278700 1 -- 172.21.15.27:0/2635768696 wait complete. 2023-05-17T15:10:56.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.973+0000 7f45fa278700 1 Processor -- start 2023-05-17T15:10:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.973+0000 7f45fa278700 1 -- start start 2023-05-17T15:10:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45fa278700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f4167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45fa278700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 0x7f45f4152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45fa278700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45f41543d0 0x7f45f40afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45fa278700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4168520 con 0x7f45f40c60f0 2023-05-17T15:10:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45fa278700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4168800 con 0x7f45f41543d0 2023-05-17T15:10:56.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45fa278700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4168ae0 con 0x7f45f4069410 2023-05-17T15:10:56.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45f37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 0x7f45f4152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:56.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45f37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 0x7f45f4152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43606/0 (socket says 172.21.15.27:43606) 2023-05-17T15:10:56.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.974+0000 7f45f37fe700 1 -- 172.21.15.27:0/2660798070 learned_addr learned my addr 172.21.15.27:0/2660798070 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f3fff700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f4167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f8815700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45f41543d0 0x7f45f40afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f37fe700 1 -- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 msgr2=0x7f45f4167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f37fe700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f4167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f37fe700 1 -- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45f41543d0 msgr2=0x7f45f40afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f37fe700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45f41543d0 0x7f45f40afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:56.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f37fe700 1 -- 172.21.15.27:0/2660798070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4009370 con 0x7f45f40c60f0 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f3fff700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f4167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f8815700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45f41543d0 0x7f45f40afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45f37fe700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 0x7f45f4152d40 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f45dc00c4c0 tx=0x7f45dc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc007020 con 0x7f45f40c60f0 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc001e90 con 0x7f45f40c60f0 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40af5c0 con 0x7f45f40c60f0 2023-05-17T15:10:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0073b0 con 0x7f45f40c60f0 2023-05-17T15:10:56.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.975+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f41681c0 con 0x7f45f40c60f0 2023-05-17T15:10:56.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.976+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40afae0 con 0x7f45f40c60f0 2023-05-17T15:10:56.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.977+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f45dc010070 con 0x7f45f40c60f0 2023-05-17T15:10:56.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.977+0000 7f45ebfff700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f45d405ed90 0x7f45d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:56.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.977+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f45dc0798c0 con 0x7f45f40c60f0 2023-05-17T15:10:56.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.977+0000 7f45f3fff700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f45d405ed90 0x7f45d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:56.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.977+0000 7f45f3fff700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f45d405ed90 0x7f45d4061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f45e4006fd0 tx=0x7f45e4017000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:56.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:56.981+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45dc04aee0 con 0x7f45f40c60f0 2023-05-17T15:10:57.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.198+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45f40afae0 con 0x7f45f40c60f0 2023-05-17T15:10:57.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.203+0000 7f45ebfff700 1 -- 172.21.15.27:0/2660798070 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f45f40afae0 con 0x7f45f40c60f0 2023-05-17T15:10:57.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.208+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f45d405ed90 msgr2=0x7f45d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.208+0000 7f45fa278700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f45d405ed90 0x7f45d4061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f45e4006fd0 tx=0x7f45e4017000).stop 2023-05-17T15:10:57.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.208+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 msgr2=0x7f45f4152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.208+0000 7f45fa278700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 0x7f45f4152d40 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f45dc00c4c0 tx=0x7f45dc007e00).stop 2023-05-17T15:10:57.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.209+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 shutdown_connections 2023-05-17T15:10:57.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.209+0000 7f45fa278700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f45d405ed90 0x7f45d4061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.209+0000 7f45fa278700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45f41543d0 0x7f45f40afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.209+0000 7f45fa278700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45f4069410 0x7f45f4167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.209+0000 7f45fa278700 1 --2- 172.21.15.27:0/2660798070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45f40c60f0 0x7f45f4152d40 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.209+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 >> 172.21.15.27:0/2660798070 conn(0x7f45f40cb7f0 msgr2=0x7f45f40c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:57.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.211+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 shutdown_connections 2023-05-17T15:10:57.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.211+0000 7f45fa278700 1 -- 172.21.15.27:0/2660798070 wait complete. 2023-05-17T15:10:57.223 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 17 and data pool 18 2023-05-17T15:10:57.238 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.351+0000 7f54b61e6700 1 Processor -- start 2023-05-17T15:10:57.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.351+0000 7f54b61e6700 1 -- start start 2023-05-17T15:10:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.351+0000 7f54b61e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54b00c5f30 0x7f54b00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.351+0000 7f54b61e6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00bfcd0 con 0x7f54b0158880 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.351+0000 7f54b61e6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00c0290 con 0x7f54b01543e0 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.351+0000 7f54b61e6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b00aa1a0 con 0x7f54b00c5f30 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54aeffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f54b0158880 0x7f54b0153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43178/0 (socket says 172.21.15.27:43178) 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54aeffd700 1 -- 172.21.15.27:0/3385796282 learned_addr learned my addr 172.21.15.27:0/3385796282 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365832358 0 0) 0x7f54b00bfcd0 con 0x7f54b0158880 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54980033f0 con 0x7f54b0158880 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54af7fe700 1 --2- 172.21.15.27:0/3385796282 >> v2:172.21.15.40:3300/0 conn(0x7f54b00c5f30 0x7f54b00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1194336095 0 0) 0x7f54980033f0 con 0x7f54b0158880 2023-05-17T15:10:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 >> v2:172.21.15.40:3300/0 conn(0x7f54b00c5f30 msgr2=0x7f54b00c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 --2- 172.21.15.27:0/3385796282 >> v2:172.21.15.40:3300/0 conn(0x7f54b00c5f30 0x7f54b00c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 >> v1:172.21.15.40:6789/0 conn(0x7f54b01543e0 legacy=0x7f54b00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00aa480 con 0x7f54b0158880 2023-05-17T15:10:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f54a4001470 con 0x7f54b0158880 2023-05-17T15:10:57.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 >> v1:172.21.15.27:6789/0 conn(0x7f54b0158880 legacy=0x7f54b0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54980038e0 0x7f5498003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5498004690 0x7f5498004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f549800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00aa1a0 con 0x7f5498005000 2023-05-17T15:10:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549800bf60 con 0x7f5498004690 2023-05-17T15:10:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549800c0f0 con 0x7f54980038e0 2023-05-17T15:10:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54affff700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f549800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54aeffd700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5498004690 0x7f5498004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.352+0000 7f54af7fe700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54980038e0 0x7f5498003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 -- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54980038e0 msgr2=0x7f5498003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54980038e0 0x7f5498003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 -- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5498004690 msgr2=0x7f5498004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5498004690 0x7f5498004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 -- 172.21.15.27:0/3385796282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980033f0 con 0x7f5498005000 2023-05-17T15:10:57.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 -- 172.21.15.27:0/3385796282 reap_dead start 2023-05-17T15:10:57.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54affff700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f549800b8e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f54a8001e30 tx=0x7f54a8007f30).ready entity=mon.0 client_cookie=913a8bd2f07c898 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8006a20 con 0x7f5498005000 2023-05-17T15:10:57.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8006b80 con 0x7f5498005000 2023-05-17T15:10:57.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54ae7fc700 1 -- 172.21.15.27:0/3385796282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800c5d0 con 0x7f5498005000 2023-05-17T15:10:57.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 -- 172.21.15.27:0/3385796282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 msgr2=0x7f549800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f549800b8e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f54a8001e30 tx=0x7f54a8007f30).stop 2023-05-17T15:10:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 -- 172.21.15.27:0/3385796282 shutdown_connections 2023-05-17T15:10:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 --2- 172.21.15.27:0/3385796282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f549800b8e0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 -- 172.21.15.27:0/3385796282 >> 172.21.15.27:0/3385796282 conn(0x7f54b0069e70 msgr2=0x7f54b005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 -- 172.21.15.27:0/3385796282 shutdown_connections 2023-05-17T15:10:57.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.353+0000 7f54b61e6700 1 -- 172.21.15.27:0/3385796282 wait complete. 2023-05-17T15:10:57.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.355+0000 7f54b61e6700 1 Processor -- start 2023-05-17T15:10:57.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.355+0000 7f54b61e6700 1 -- start start 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.355+0000 7f54b61e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f54b0152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b0158420 0x7f54b014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b014dc90 0x7f54b0167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0152f00 con 0x7f5498005000 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b01520a0 con 0x7f54b014dc90 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00c2320 con 0x7f54b0158420 2023-05-17T15:10:57.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f54b0152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f54b0152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43624/0 (socket says 172.21.15.27:43624) 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 -- 172.21.15.27:0/1591487760 learned_addr learned my addr 172.21.15.27:0/1591487760 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54aeffd700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b0158420 0x7f54b014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54affff700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b014dc90 0x7f54b0167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 -- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b0158420 msgr2=0x7f54b014d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b0158420 0x7f54b014d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 -- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b014dc90 msgr2=0x7f54b0167ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b014dc90 0x7f54b0167ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 -- 172.21.15.27:0/1591487760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b01522f0 con 0x7f5498005000 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54af7fe700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f54b0152a10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f54a00119c0 tx=0x7f54a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0013680 con 0x7f5498005000 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a00137e0 con 0x7f5498005000 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b01525d0 con 0x7f5498005000 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0013ba0 con 0x7f5498005000 2023-05-17T15:10:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.356+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b01683c0 con 0x7f5498005000 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.357+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b00c1df0 con 0x7f5498005000 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.358+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f54a0014440 con 0x7f5498005000 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.358+0000 7f54977fe700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f549c05edc0 0x7f549c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.358+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f54a007a490 con 0x7f5498005000 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.358+0000 7f54aeffd700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f549c05edc0 0x7f549c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.359+0000 7f54aeffd700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f549c05edc0 0x7f549c061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f54b0151a80 tx=0x7f54a4001e50).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.362+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54a004b970 con 0x7f5498005000 2023-05-17T15:10:57.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.535+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54b005f4a0 con 0x7f5498005000 2023-05-17T15:10:57.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.536+0000 7f54977fe700 1 -- 172.21.15.27:0/1591487760 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17115 (secure 0 0 0) 0x7f54a004ef90 con 0x7f5498005000 2023-05-17T15:10:57.541 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:57.541 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":139,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:57.199222+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:55.754589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:56.180897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:57.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f549c05edc0 msgr2=0x7f549c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f549c05edc0 0x7f549c061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f54b0151a80 tx=0x7f54a4001e50).stop 2023-05-17T15:10:57.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 msgr2=0x7f54b0152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f54b0152a10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f54a00119c0 tx=0x7f54a0009060).stop 2023-05-17T15:10:57.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 shutdown_connections 2023-05-17T15:10:57.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f549c05edc0 0x7f549c061280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54b014dc90 0x7f54b0167ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5498005000 0x7f54b0152a10 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 --2- 172.21.15.27:0/1591487760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54b0158420 0x7f54b014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 >> 172.21.15.27:0/1591487760 conn(0x7f54b0069e70 msgr2=0x7f54b00c0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:57.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 shutdown_connections 2023-05-17T15:10:57.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.538+0000 7f54b61e6700 1 -- 172.21.15.27:0/1591487760 wait complete. 2023-05-17T15:10:57.554 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:10:57.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.666+0000 7fed606f5700 1 Processor -- start 2023-05-17T15:10:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.667+0000 7fed606f5700 1 -- start start 2023-05-17T15:10:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed606f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 0x7fed58153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed606f5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed581541c0 0x7fed580c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed606f5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed580bfcd0 con 0x7fed580c5f30 2023-05-17T15:10:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed606f5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed580c0290 con 0x7fed581541c0 2023-05-17T15:10:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed606f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed580aa1a0 con 0x7fed580c6310 2023-05-17T15:10:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5e491700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fed580c5f30 0x7fed58158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43194/0 (socket says 172.21.15.27:43194) 2023-05-17T15:10:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5e491700 1 -- 172.21.15.27:0/2045926120 learned_addr learned my addr 172.21.15.27:0/2045926120 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5dc90700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 0x7fed58153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5ec92700 1 --2- 172.21.15.27:0/2045926120 >> v2:172.21.15.40:3300/0 conn(0x7fed581541c0 0x7fed580c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287681777 0 0) 0x7fed580bfcd0 con 0x7fed580c5f30 2023-05-17T15:10:57.674 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed400033f0 con 0x7fed580c5f30 2023-05-17T15:10:57.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338251571 0 0) 0x7fed400033f0 con 0x7fed580c5f30 2023-05-17T15:10:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 msgr2=0x7fed58153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 0x7fed58153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 >> v2:172.21.15.40:3300/0 conn(0x7fed581541c0 msgr2=0x7fed580c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 --2- 172.21.15.27:0/2045926120 >> v2:172.21.15.40:3300/0 conn(0x7fed581541c0 0x7fed580c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580aa480 con 0x7fed580c5f30 2023-05-17T15:10:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fed50001470 con 0x7fed580c5f30 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 >> v1:172.21.15.27:6789/0 conn(0x7fed580c5f30 legacy=0x7fed58158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed400038e0 0x7fed40003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed40004690 0x7fed40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 0x7fed40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580c0290 con 0x7fed40004690 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580aa1a0 con 0x7fed400038e0 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4000b8e0 con 0x7fed580c6310 2023-05-17T15:10:57.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.668+0000 7fed5dc90700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed40004690 0x7fed40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5e491700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed400038e0 0x7fed40003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5ec92700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 0x7fed40005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5dc90700 1 -- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 msgr2=0x7fed40005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5dc90700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed580c6310 0x7fed40005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5dc90700 1 -- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed400038e0 msgr2=0x7fed40003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5dc90700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed400038e0 0x7fed40003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5dc90700 1 -- 172.21.15.27:0/2045926120 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400033f0 con 0x7fed40004690 2023-05-17T15:10:57.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5e491700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed400038e0 0x7fed40003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:57.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5dc90700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed40004690 0x7fed40004b10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fed4c009a80 tx=0x7fed4c009060).ready entity=mon.0 client_cookie=82eeffb6a5f2a01a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c009430 con 0x7fed40004690 2023-05-17T15:10:57.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00e640 con 0x7fed40004690 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5d48f700 1 -- 172.21.15.27:0/2045926120 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00e9c0 con 0x7fed40004690 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed606f5700 1 -- 172.21.15.27:0/2045926120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed40004690 msgr2=0x7fed40004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed606f5700 1 --2- 172.21.15.27:0/2045926120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed40004690 0x7fed40004b10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fed4c009a80 tx=0x7fed4c009060).stop 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed5ec92700 1 -- 172.21.15.27:0/2045926120 reap_dead start 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed606f5700 1 -- 172.21.15.27:0/2045926120 shutdown_connections 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.669+0000 7fed606f5700 1 -- 172.21.15.27:0/2045926120 >> 172.21.15.27:0/2045926120 conn(0x7fed58069e70 msgr2=0x7fed5805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.670+0000 7fed606f5700 1 -- 172.21.15.27:0/2045926120 shutdown_connections 2023-05-17T15:10:57.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.670+0000 7fed606f5700 1 -- 172.21.15.27:0/2045926120 wait complete. 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 Processor -- start 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 -- start start 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed40004690 0x7fed581410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 0x7fed58155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed58141880 0x7fed58141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580c4c90 con 0x7fed58155380 2023-05-17T15:10:57.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed58156a50 con 0x7fed58141880 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed606f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed581415d0 con 0x7fed40004690 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed5dc90700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 0x7fed58155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed5dc90700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 0x7fed58155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43644/0 (socket says 172.21.15.27:43644) 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.671+0000 7fed5dc90700 1 -- 172.21.15.27:0/3341918964 learned_addr learned my addr 172.21.15.27:0/3341918964 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5e491700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed40004690 0x7fed581410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5ec92700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed58141880 0x7fed58141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5dc90700 1 -- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed40004690 msgr2=0x7fed581410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5dc90700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed40004690 0x7fed581410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5dc90700 1 -- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed58141880 msgr2=0x7fed58141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5dc90700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed58141880 0x7fed58141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5dc90700 1 -- 172.21.15.27:0/3341918964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58155e40 con 0x7fed58155380 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed5dc90700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 0x7fed58155800 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fed4c01dfa0 tx=0x7fed4c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00ed30 con 0x7fed58155380 2023-05-17T15:10:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00ee90 con 0x7fed58155380 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed58156120 con 0x7fed58155380 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c026440 con 0x7fed58155380 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.672+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed581566e0 con 0x7fed58155380 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.673+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed58156be0 con 0x7fed58155380 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.673+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fed4c02c020 con 0x7fed58155380 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.674+0000 7fed567fc700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fed4405ed90 0x7fed44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.674+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fed4c07b820 con 0x7fed58155380 2023-05-17T15:10:57.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.674+0000 7fed5e491700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fed4405ed90 0x7fed44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.674+0000 7fed5e491700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fed4405ed90 0x7fed44061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fed50000e10 tx=0x7fed50009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.687 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.678+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed4c04cc50 con 0x7fed58155380 2023-05-17T15:10:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.850+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed5805f4a0 con 0x7fed58155380 2023-05-17T15:10:57.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.851+0000 7fed567fc700 1 -- 172.21.15.27:0/3341918964 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17115 (secure 0 0 0) 0x7fed4c016020 con 0x7fed58155380 2023-05-17T15:10:57.856 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:10:57.856 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":139,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:57.199222+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:55.754589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:56.180897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:10:57.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fed4405ed90 msgr2=0x7fed44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fed4405ed90 0x7fed44061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fed50000e10 tx=0x7fed50009040).stop 2023-05-17T15:10:57.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 msgr2=0x7fed58155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 0x7fed58155800 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fed4c01dfa0 tx=0x7fed4c01a000).stop 2023-05-17T15:10:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 shutdown_connections 2023-05-17T15:10:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fed4405ed90 0x7fed44061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed58141880 0x7fed58141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed40004690 0x7fed581410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 --2- 172.21.15.27:0/3341918964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed58155380 0x7fed58155800 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 >> 172.21.15.27:0/3341918964 conn(0x7fed58069e70 msgr2=0x7fed580aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:57.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 shutdown_connections 2023-05-17T15:10:57.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.853+0000 7fed606f5700 1 -- 172.21.15.27:0/3341918964 wait complete. 2023-05-17T15:10:57.869 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:10:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.984+0000 7f1e0c881700 1 Processor -- start 2023-05-17T15:10:57.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.984+0000 7f1e0c881700 1 -- start start 2023-05-17T15:10:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e0c881700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e081543d0 0x7f1e080c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e0c881700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e080c60f0 0x7f1e08068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e0c881700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080c0c90 con 0x7f1e080691f0 2023-05-17T15:10:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e0c881700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080c1c50 con 0x7f1e080c60f0 2023-05-17T15:10:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e0c881700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08158790 con 0x7f1e081543d0 2023-05-17T15:10:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e06d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1e080691f0 0x7f1e081547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43218/0 (socket says 172.21.15.27:43218) 2023-05-17T15:10:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.985+0000 7f1e06d9d700 1 -- 172.21.15.27:0/3375821785 learned_addr learned my addr 172.21.15.27:0/3375821785 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:10:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e05d9b700 1 --2- 172.21.15.27:0/3375821785 >> v2:172.21.15.40:3300/0 conn(0x7f1e080c60f0 0x7f1e08068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0659c700 1 --2- 172.21.15.27:0/3375821785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e081543d0 0x7f1e080c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0559a700 1 -- 172.21.15.27:0/3375821785 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168570344 0 0) 0x7f1e080c0c90 con 0x7f1e080691f0 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0559a700 1 -- 172.21.15.27:0/3375821785 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df40033f0 con 0x7f1e080691f0 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0659c700 1 -- 172.21.15.27:0/3375821785 >> v2:172.21.15.40:3300/0 conn(0x7f1e080c60f0 msgr2=0x7f1e08068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0659c700 1 --2- 172.21.15.27:0/3375821785 >> v2:172.21.15.40:3300/0 conn(0x7f1e080c60f0 0x7f1e08068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0559a700 1 -- 172.21.15.27:0/3375821785 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1816920724 0 0) 0x7f1df40033f0 con 0x7f1e080691f0 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0659c700 1 -- 172.21.15.27:0/3375821785 >> v1:172.21.15.27:6789/0 conn(0x7f1e080691f0 legacy=0x7f1e081547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0659c700 1 -- 172.21.15.27:0/3375821785 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080c6570 con 0x7f1e081543d0 2023-05-17T15:10:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e05d9b700 1 --2- 172.21.15.27:0/3375821785 >> v2:172.21.15.40:3300/0 conn(0x7f1e080c60f0 0x7f1e08068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0659c700 1 --2- 172.21.15.27:0/3375821785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e081543d0 0x7f1e080c5c00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1e00009e60 tx=0x7f1e00009780).ready entity=mon.2 client_cookie=877b2fd2b316e0dc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0559a700 1 -- 172.21.15.27:0/3375821785 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000e070 con 0x7f1e081543d0 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0559a700 1 -- 172.21.15.27:0/3375821785 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000b7a0 con 0x7f1e081543d0 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.986+0000 7f1e0559a700 1 -- 172.21.15.27:0/3375821785 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8001470 con 0x7f1e081543d0 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 -- 172.21.15.27:0/3375821785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e081543d0 msgr2=0x7f1e080c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 --2- 172.21.15.27:0/3375821785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e081543d0 0x7f1e080c5c00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1e00009e60 tx=0x7f1e00009780).stop 2023-05-17T15:10:57.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 -- 172.21.15.27:0/3375821785 shutdown_connections 2023-05-17T15:10:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 --2- 172.21.15.27:0/3375821785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e081543d0 0x7f1e080c5c00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 --2- 172.21.15.27:0/3375821785 >> v2:172.21.15.40:3300/0 conn(0x7f1e080c60f0 0x7f1e08068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 -- 172.21.15.27:0/3375821785 >> 172.21.15.27:0/3375821785 conn(0x7f1e080cb7f0 msgr2=0x7f1e080c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 -- 172.21.15.27:0/3375821785 shutdown_connections 2023-05-17T15:10:57.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.987+0000 7f1e0c881700 1 -- 172.21.15.27:0/3375821785 wait complete. 2023-05-17T15:10:57.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.988+0000 7f1e0c881700 1 Processor -- start 2023-05-17T15:10:57.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.988+0000 7f1e0c881700 1 -- start start 2023-05-17T15:10:57.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0c881700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e080691f0 0x7f1e08163f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0c881700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 0x7f1e080b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0c881700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e081543d0 0x7f1e08144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:57.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0c881700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08164520 con 0x7f1e080c60f0 2023-05-17T15:10:57.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0c881700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08164800 con 0x7f1e081543d0 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0c881700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08164ae0 con 0x7f1e080691f0 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 0x7f1e080b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 0x7f1e080b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43660/0 (socket says 172.21.15.27:43660) 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 -- 172.21.15.27:0/464454850 learned_addr learned my addr 172.21.15.27:0/464454850 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e0659c700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e080691f0 0x7f1e08163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e06d9d700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e081543d0 0x7f1e08144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 -- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e080691f0 msgr2=0x7f1e08163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e080691f0 0x7f1e08163f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 -- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e081543d0 msgr2=0x7f1e08144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e081543d0 0x7f1e08144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 -- 172.21.15.27:0/464454850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df00092a0 con 0x7f1e080c60f0 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e06d9d700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e081543d0 0x7f1e08144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1e05d9b700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 0x7f1e080b07e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f1df000e9d0 tx=0x7f1df0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.989+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000eec0 con 0x7f1e080c60f0 2023-05-17T15:10:58.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.990+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df000c850 con 0x7f1e080c60f0 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.990+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e00009a20 con 0x7f1e080c60f0 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.990+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000cbd0 con 0x7f1e080c60f0 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.990+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e08167510 con 0x7f1e080c60f0 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.990+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e08167730 con 0x7f1e080c60f0 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.992+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1df0022070 con 0x7f1e080c60f0 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.992+0000 7f1dfe7fc700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1de805ed90 0x7f1de8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:58.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.992+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f1df007a740 con 0x7f1e080c60f0 2023-05-17T15:10:58.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.992+0000 7f1e0659c700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1de805ed90 0x7f1de8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:58.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.993+0000 7f1e0659c700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1de805ed90 0x7f1de8061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1e000099f0 tx=0x7f1e00009780).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:58.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:57.996+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1df004bb70 con 0x7f1e080c60f0 2023-05-17T15:10:58.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:58.212+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1e0806bdf0 con 0x7f1e080c60f0 2023-05-17T15:10:59.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.213+0000 7f1dfe7fc700 1 -- 172.21.15.27:0/464454850 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1df004f190 con 0x7f1e080c60f0 2023-05-17T15:10:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1de805ed90 msgr2=0x7f1de8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1de805ed90 0x7f1de8061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1e000099f0 tx=0x7f1e00009780).stop 2023-05-17T15:10:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 msgr2=0x7f1e080b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 0x7f1e080b07e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f1df000e9d0 tx=0x7f1df0009060).stop 2023-05-17T15:10:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 shutdown_connections 2023-05-17T15:10:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1de805ed90 0x7f1de8061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e081543d0 0x7f1e08144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e080691f0 0x7f1e08163f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 --2- 172.21.15.27:0/464454850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e080c60f0 0x7f1e080b07e0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 >> 172.21.15.27:0/464454850 conn(0x7f1e080cb7f0 msgr2=0x7f1e08153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 shutdown_connections 2023-05-17T15:10:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.216+0000 7f1e0c881700 1 -- 172.21.15.27:0/464454850 wait complete. 2023-05-17T15:10:59.235 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:10:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.357+0000 7f0566da9700 1 Processor -- start 2023-05-17T15:10:59.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.357+0000 7f0566da9700 1 -- start start 2023-05-17T15:10:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0566da9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05600c81e0 0x7f05600c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0566da9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0560155770 con 0x7f05600c7e00 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0566da9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05600c0b40 con 0x7f05600caa40 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0566da9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0560155420 con 0x7f05600c81e0 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05600c81e0 0x7f05600c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05600c81e0 0x7f05600c0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43668/0 (socket says 172.21.15.27:43668) 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 -- 172.21.15.27:0/726781203 learned_addr learned my addr 172.21.15.27:0/726781203 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0565da7700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f05600c7e00 0x7f0560154320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43228/0 (socket says 172.21.15.27:43228) 2023-05-17T15:10:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 -- 172.21.15.27:0/726781203 >> v1:172.21.15.40:6789/0 conn(0x7f05600caa40 legacy=0x7f0560155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 -- 172.21.15.27:0/726781203 >> v1:172.21.15.27:6789/0 conn(0x7f05600c7e00 legacy=0x7f0560154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 -- 172.21.15.27:0/726781203 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560154b80 con 0x7f05600c81e0 2023-05-17T15:10:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f05655a6700 1 --2- 172.21.15.27:0/726781203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f05600c0650 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f0554009f20 tx=0x7f0554009840).ready entity=mon.0 client_cookie=61dad954c67abc8b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0564da5700 1 -- 172.21.15.27:0/726781203 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400e070 con 0x7f05600c81e0 2023-05-17T15:10:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0564da5700 1 -- 172.21.15.27:0/726781203 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400ba80 con 0x7f05600c81e0 2023-05-17T15:10:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.358+0000 7f0564da5700 1 -- 172.21.15.27:0/726781203 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400be00 con 0x7f05600c81e0 2023-05-17T15:10:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 -- 172.21.15.27:0/726781203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 msgr2=0x7f05600c0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 --2- 172.21.15.27:0/726781203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f05600c0650 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f0554009f20 tx=0x7f0554009840).stop 2023-05-17T15:10:59.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 -- 172.21.15.27:0/726781203 shutdown_connections 2023-05-17T15:10:59.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 --2- 172.21.15.27:0/726781203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f05600c0650 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 -- 172.21.15.27:0/726781203 >> 172.21.15.27:0/726781203 conn(0x7f056005dd50 msgr2=0x7f056005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:10:59.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 -- 172.21.15.27:0/726781203 shutdown_connections 2023-05-17T15:10:59.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.359+0000 7f0566da9700 1 -- 172.21.15.27:0/726781203 wait complete. 2023-05-17T15:10:59.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.360+0000 7f0566da9700 1 Processor -- start 2023-05-17T15:10:59.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.360+0000 7f0566da9700 1 -- start start 2023-05-17T15:10:59.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0566da9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600c7e00 0x7f05600c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:59.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0566da9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f0560146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:59.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0566da9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05600caa40 0x7f05600b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:59.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0566da9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c3950 con 0x7f05600c81e0 2023-05-17T15:10:59.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0566da9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c2d40 con 0x7f05600caa40 2023-05-17T15:10:59.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0566da9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c3020 con 0x7f05600c7e00 2023-05-17T15:10:59.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f0560146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:59.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f0560146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43672/0 (socket says 172.21.15.27:43672) 2023-05-17T15:10:59.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 -- 172.21.15.27:0/2748955677 learned_addr learned my addr 172.21.15.27:0/2748955677 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05665a8700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05600caa40 0x7f05600b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0565da7700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600c7e00 0x7f05600c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 -- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600c7e00 msgr2=0x7f05600c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600c7e00 0x7f05600c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 -- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05600caa40 msgr2=0x7f05600b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05600caa40 0x7f05600b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:10:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 -- 172.21.15.27:0/2748955677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009ae0 con 0x7f05600c81e0 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f0565da7700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600c7e00 0x7f05600c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f05655a6700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f0560146470 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f05600c85c0 tx=0x7f0554009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554013d90 con 0x7f05600c81e0 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.361+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055401d410 con 0x7f05600c81e0 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.362+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05600c3300 con 0x7f05600c81e0 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.362+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055401d7b0 con 0x7f05600c81e0 2023-05-17T15:10:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.362+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05600c42d0 con 0x7f05600c81e0 2023-05-17T15:10:59.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.363+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0560047150 con 0x7f05600c81e0 2023-05-17T15:10:59.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.363+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f055401b040 con 0x7f05600c81e0 2023-05-17T15:10:59.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.363+0000 7f055dffb700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f054c05ed90 0x7f054c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:10:59.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.363+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f055407b810 con 0x7f05600c81e0 2023-05-17T15:10:59.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.363+0000 7f0565da7700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f054c05ed90 0x7f054c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:10:59.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.364+0000 7f0565da7700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f054c05ed90 0x7f054c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f05580016b0 tx=0x7f0558009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:10:59.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.368+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f055404cc40 con 0x7f05600c81e0 2023-05-17T15:10:59.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:10:59.588+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f05600b0a40 con 0x7f05600c81e0 2023-05-17T15:11:00.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.215+0000 7f055dffb700 1 -- 172.21.15.27:0/2748955677 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0554050260 con 0x7f05600c81e0 2023-05-17T15:11:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f054c05ed90 msgr2=0x7f054c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f054c05ed90 0x7f054c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f05580016b0 tx=0x7f0558009040).stop 2023-05-17T15:11:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 msgr2=0x7f0560146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f0560146470 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f05600c85c0 tx=0x7f0554009840).stop 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 shutdown_connections 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f054c05ed90 0x7f054c061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05600caa40 0x7f05600b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05600c7e00 0x7f05600c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 --2- 172.21.15.27:0/2748955677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05600c81e0 0x7f0560146470 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 >> 172.21.15.27:0/2748955677 conn(0x7f056005dd50 msgr2=0x7f05600c9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:00.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 shutdown_connections 2023-05-17T15:11:00.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.218+0000 7f0566da9700 1 -- 172.21.15.27:0/2748955677 wait complete. 2023-05-17T15:11:00.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:11:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.353+0000 7f422413b700 1 Processor -- start 2023-05-17T15:11:00.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.353+0000 7f422413b700 1 -- start start 2023-05-17T15:11:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f422413b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f421c0c64a0 0x7f421c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f422413b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c154260 0x7f421c0c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f422413b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c0aa680 con 0x7f421c0c60c0 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f422413b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c0c68e0 con 0x7f421c0c64a0 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f422413b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c05e7e0 con 0x7f421c154260 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f421c0c64a0 0x7f421c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f421c0c64a0 0x7f421c153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43684/0 (socket says 172.21.15.27:43684) 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 -- 172.21.15.27:0/2844436261 learned_addr learned my addr 172.21.15.27:0/2844436261 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:00.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42226d8700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c154260 0x7f421c0c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 -- 172.21.15.27:0/2844436261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c154260 msgr2=0x7f421c0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c154260 0x7f421c0c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 -- 172.21.15.27:0/2844436261 >> v1:172.21.15.40:6789/0 conn(0x7f421c0c60c0 legacy=0x7f421c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42216d6700 1 -- 172.21.15.27:0/2844436261 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c05eac0 con 0x7f421c0c64a0 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.354+0000 7f42226d8700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c154260 0x7f421c0c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f42216d6700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c64a0 0x7f421c153d70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f4210006fd0 tx=0x7f42100090f0).ready entity=mon.0 client_cookie=d3a0e53901d1d70b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:00.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f4220ed5700 1 -- 172.21.15.27:0/2844436261 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000b600 con 0x7f421c0c64a0 2023-05-17T15:11:00.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f4220ed5700 1 -- 172.21.15.27:0/2844436261 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421000b760 con 0x7f421c0c64a0 2023-05-17T15:11:00.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f4220ed5700 1 -- 172.21.15.27:0/2844436261 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000bae0 con 0x7f421c0c64a0 2023-05-17T15:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 -- 172.21.15.27:0/2844436261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c64a0 msgr2=0x7f421c153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c64a0 0x7f421c153d70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f4210006fd0 tx=0x7f42100090f0).stop 2023-05-17T15:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 -- 172.21.15.27:0/2844436261 shutdown_connections 2023-05-17T15:11:00.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c154260 0x7f421c0c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 --2- 172.21.15.27:0/2844436261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c64a0 0x7f421c153d70 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 -- 172.21.15.27:0/2844436261 >> 172.21.15.27:0/2844436261 conn(0x7f421c069e70 msgr2=0x7f421c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 -- 172.21.15.27:0/2844436261 shutdown_connections 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.355+0000 7f422413b700 1 -- 172.21.15.27:0/2844436261 wait complete. 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.356+0000 7f422413b700 1 Processor -- start 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.356+0000 7f422413b700 1 -- start start 2023-05-17T15:11:00.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f422413b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 0x7f421c13f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f422413b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c0c64a0 0x7f421c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f422413b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c154260 0x7f421c0ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f422413b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0c2b50 con 0x7f421c0c60c0 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f422413b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0c1f40 con 0x7f421c154260 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f422413b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0c2220 con 0x7f421c0c64a0 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f4221ed7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 0x7f421c13f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f4221ed7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 0x7f421c13f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43686/0 (socket says 172.21.15.27:43686) 2023-05-17T15:11:00.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f4221ed7700 1 -- 172.21.15.27:0/2511843385 learned_addr learned my addr 172.21.15.27:0/2511843385 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f42226d8700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c154260 0x7f421c0ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.357+0000 7f42216d6700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c0c64a0 0x7f421c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4221ed7700 1 -- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c0c64a0 msgr2=0x7f421c1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4221ed7700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c0c64a0 0x7f421c1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4221ed7700 1 -- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c154260 msgr2=0x7f421c0ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4221ed7700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c154260 0x7f421c0ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4221ed7700 1 -- 172.21.15.27:0/2511843385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210009370 con 0x7f421c0c60c0 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f42226d8700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c154260 0x7f421c0ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f42216d6700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c0c64a0 0x7f421c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4221ed7700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 0x7f421c13f310 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f421400c4c0 tx=0x7f4214007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214007020 con 0x7f421c0c60c0 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214001e90 con 0x7f421c0c60c0 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c0c2500 con 0x7f421c0c60c0 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140073b0 con 0x7f421c0c60c0 2023-05-17T15:11:00.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.358+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c13f800 con 0x7f421c0c60c0 2023-05-17T15:11:00.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.359+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c05f4a0 con 0x7f421c0c60c0 2023-05-17T15:11:00.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.359+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4214010070 con 0x7f421c0c60c0 2023-05-17T15:11:00.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.360+0000 7f4219ffb700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f420805ed90 0x7f4208061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.360+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f42140793f0 con 0x7f421c0c60c0 2023-05-17T15:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.360+0000 7f42216d6700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f420805ed90 0x7f4208061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.360+0000 7f42216d6700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f420805ed90 0x7f4208061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4210009130 tx=0x7f4210017000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:00.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.364+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f421404a930 con 0x7f421c0c60c0 2023-05-17T15:11:00.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.580+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f421c06bdf0 con 0x7f421c0c60c0 2023-05-17T15:11:00.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.581+0000 7f4219ffb700 1 -- 172.21.15.27:0/2511843385 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f421404df50 con 0x7f421c0c60c0 2023-05-17T15:11:00.585 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:00.585 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:57.199573+0000","modified":"2023-05-17T15:11:00.212835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/4188362565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4188362565},{"type":"v1","addr":"172.21.15.40:6835","nonce":4188362565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-17T15:11:00.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f420805ed90 msgr2=0x7f4208061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f420805ed90 0x7f4208061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4210009130 tx=0x7f4210017000).stop 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 msgr2=0x7f421c13f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 0x7f421c13f310 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f421400c4c0 tx=0x7f4214007e00).stop 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 shutdown_connections 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f420805ed90 0x7f4208061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c154260 0x7f421c0ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0c60c0 0x7f421c13f310 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 --2- 172.21.15.27:0/2511843385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421c0c64a0 0x7f421c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 >> 172.21.15.27:0/2511843385 conn(0x7f421c069e70 msgr2=0x7f421c0ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:00.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 shutdown_connections 2023-05-17T15:11:00.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.583+0000 7f422413b700 1 -- 172.21.15.27:0/2511843385 wait complete. 2023-05-17T15:11:00.588 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 60 2023-05-17T15:11:00.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:11:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.712+0000 7fa314bb2700 1 Processor -- start 2023-05-17T15:11:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.712+0000 7fa314bb2700 1 -- start start 2023-05-17T15:11:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa314bb2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa3100c1180 0x7fa3100c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa314bb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3101544f0 0x7fa3100a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa314bb2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3100aa070 0x7fa3100c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa314bb2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3100c07e0 con 0x7fa3100c1180 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa314bb2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3101549b0 con 0x7fa3100aa070 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa314bb2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa310154c90 con 0x7fa3101544f0 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa3100c1180 0x7fa3100c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa3100c1180 0x7fa3100c02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43694/0 (socket says 172.21.15.27:43694) 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30f7fe700 1 -- 172.21.15.27:0/3008566469 learned_addr learned my addr 172.21.15.27:0/3008566469 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:00.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30ffff700 1 --2- 172.21.15.27:0/3008566469 >> v2:172.21.15.40:3300/0 conn(0x7fa3100aa070 0x7fa3100c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30effd700 1 --2- 172.21.15.27:0/3008566469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3101544f0 0x7fa3100a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30f7fe700 1 -- 172.21.15.27:0/3008566469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3101544f0 msgr2=0x7fa3100a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.713+0000 7fa30f7fe700 1 --2- 172.21.15.27:0/3008566469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3101544f0 0x7fa3100a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30f7fe700 1 -- 172.21.15.27:0/3008566469 >> v2:172.21.15.40:3300/0 conn(0x7fa3100aa070 msgr2=0x7fa3100c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30f7fe700 1 --2- 172.21.15.27:0/3008566469 >> v2:172.21.15.40:3300/0 conn(0x7fa3100aa070 0x7fa3100c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30f7fe700 1 -- 172.21.15.27:0/3008566469 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310154f70 con 0x7fa3100c1180 2023-05-17T15:11:00.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30f7fe700 1 --2- 172.21.15.27:0/3008566469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100c02f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fa3100c8420 tx=0x7fa3000090f0).ready entity=mon.0 client_cookie=da468940b0a3602d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30e7fc700 1 -- 172.21.15.27:0/3008566469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000b520 con 0x7fa3100c1180 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30e7fc700 1 -- 172.21.15.27:0/3008566469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000b680 con 0x7fa3100c1180 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa30e7fc700 1 -- 172.21.15.27:0/3008566469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000ba20 con 0x7fa3100c1180 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 -- 172.21.15.27:0/3008566469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 msgr2=0x7fa3100c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3008566469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100c02f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fa3100c8420 tx=0x7fa3000090f0).stop 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 -- 172.21.15.27:0/3008566469 shutdown_connections 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3008566469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100c02f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3008566469 >> v2:172.21.15.40:3300/0 conn(0x7fa3100aa070 0x7fa3100c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3008566469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3101544f0 0x7fa3100a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 -- 172.21.15.27:0/3008566469 >> 172.21.15.27:0/3008566469 conn(0x7fa31005dd50 msgr2=0x7fa31005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:00.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 -- 172.21.15.27:0/3008566469 shutdown_connections 2023-05-17T15:11:00.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.714+0000 7fa314bb2700 1 -- 172.21.15.27:0/3008566469 wait complete. 2023-05-17T15:11:00.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.716+0000 7fa314bb2700 1 Processor -- start 2023-05-17T15:11:00.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.716+0000 7fa314bb2700 1 -- start start 2023-05-17T15:11:00.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.716+0000 7fa314bb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3100aa070 0x7fa310142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.716+0000 7fa314bb2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.716+0000 7fa314bb2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3101544f0 0x7fa3101641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa314bb2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100c8e30 con 0x7fa3100c1180 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa314bb2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100b0a50 con 0x7fa3101544f0 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa314bb2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa310142c70 con 0x7fa3100aa070 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43702/0 (socket says 172.21.15.27:43702) 2023-05-17T15:11:00.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 -- 172.21.15.27:0/3527688143 learned_addr learned my addr 172.21.15.27:0/3527688143 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30f7fe700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3100aa070 0x7fa310142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30ffff700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3101544f0 0x7fa3101641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 -- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3100aa070 msgr2=0x7fa310142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3100aa070 0x7fa310142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 -- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3101544f0 msgr2=0x7fa3101641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3101544f0 0x7fa3101641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 -- 172.21.15.27:0/3527688143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009370 con 0x7fa3100c1180 2023-05-17T15:11:00.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa30effd700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100ada00 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fa30400d890 tx=0x7fa304008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304011590 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3040116f0 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3100b01b0 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304011a70 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.717+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3100b0770 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.718+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3100c8fa0 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.719+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa30401c460 con 0x7fa3100c1180 2023-05-17T15:11:00.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.719+0000 7fa2f77fe700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa2fc05ed90 0x7fa2fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.719+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fa3040799e0 con 0x7fa3100c1180 2023-05-17T15:11:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.719+0000 7fa30f7fe700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa2fc05ed90 0x7fa2fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.719+0000 7fa30f7fe700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa2fc05ed90 0x7fa2fc061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa30000b2e0 tx=0x7fa300017000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.723+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3100c8fa0 con 0x7fa3100c1180 2023-05-17T15:11:00.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.894+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3100c8f70 con 0x7fa3100c1180 2023-05-17T15:11:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.895+0000 7fa2f77fe700 1 -- 172.21.15.27:0/3527688143 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+17102 (secure 0 0 0) 0x7fa30404aec0 con 0x7fa3100c1180 2023-05-17T15:11:00.899 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:00.900 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":140,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:10:58.201311+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:55.754589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:56.180897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:11:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa2fc05ed90 msgr2=0x7fa2fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa2fc05ed90 0x7fa2fc061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa30000b2e0 tx=0x7fa300017000).stop 2023-05-17T15:11:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 msgr2=0x7fa3100ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100ada00 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fa30400d890 tx=0x7fa304008040).stop 2023-05-17T15:11:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 shutdown_connections 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa2fc05ed90 0x7fa2fc061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3101544f0 0x7fa3101641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3100aa070 0x7fa310142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 --2- 172.21.15.27:0/3527688143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3100c1180 0x7fa3100ada00 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 >> 172.21.15.27:0/3527688143 conn(0x7fa31005dd50 msgr2=0x7fa3100acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 shutdown_connections 2023-05-17T15:11:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:00.897+0000 7fa314bb2700 1 -- 172.21.15.27:0/3527688143 wait complete. 2023-05-17T15:11:00.913 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:11:00.914 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:11:01.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.025+0000 7ff0d5eab700 1 Processor -- start 2023-05-17T15:11:01.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.025+0000 7ff0d5eab700 1 -- start start 2023-05-17T15:11:01.036 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0d5eab700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0d00c5f30 0x7ff0d00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0d5eab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d00c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0d5eab700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00bfcd0 con 0x7ff0d0158880 2023-05-17T15:11:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0d5eab700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00c0290 con 0x7ff0d00c5f30 2023-05-17T15:11:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0d5eab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00aa1a0 con 0x7ff0d01543e0 2023-05-17T15:11:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0d00c5f30 0x7ff0d00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0d00c5f30 0x7ff0d00c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43708/0 (socket says 172.21.15.27:43708) 2023-05-17T15:11:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1400995806 learned_addr learned my addr 172.21.15.27:0/1400995806 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:01.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cffff700 1 --2- 172.21.15.27:0/1400995806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d00c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1400995806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 msgr2=0x7ff0d00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:01.039 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cf7fe700 1 --2- 172.21.15.27:0/1400995806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d00c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.026+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1400995806 >> v1:172.21.15.40:6789/0 conn(0x7ff0d0158880 legacy=0x7ff0d0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1400995806 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00aa480 con 0x7ff0d00c5f30 2023-05-17T15:11:01.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0cf7fe700 1 --2- 172.21.15.27:0/1400995806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d00c6310 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7ff0c0006fd0 tx=0x7ff0c00090f0).ready entity=mon.0 client_cookie=b479332ab03a91be server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0ce7fc700 1 -- 172.21.15.27:0/1400995806 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000b600 con 0x7ff0d00c5f30 2023-05-17T15:11:01.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0ce7fc700 1 -- 172.21.15.27:0/1400995806 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000b760 con 0x7ff0d00c5f30 2023-05-17T15:11:01.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0ce7fc700 1 -- 172.21.15.27:0/1400995806 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000bae0 con 0x7ff0d00c5f30 2023-05-17T15:11:01.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1400995806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 msgr2=0x7ff0d00c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1400995806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d00c6310 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7ff0c0006fd0 tx=0x7ff0c00090f0).stop 2023-05-17T15:11:01.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1400995806 shutdown_connections 2023-05-17T15:11:01.042 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1400995806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d00c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1400995806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d00c6310 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1400995806 >> 172.21.15.27:0/1400995806 conn(0x7ff0d0069e70 msgr2=0x7ff0d005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:01.043 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1400995806 shutdown_connections 2023-05-17T15:11:01.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.027+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1400995806 wait complete. 2023-05-17T15:11:01.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 Processor -- start 2023-05-17T15:11:01.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 -- start start 2023-05-17T15:11:01.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.044 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d01682a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0158880 0x7ff0d00c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0157230 con 0x7ff0d00c5f30 2023-05-17T15:11:01.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0157a40 con 0x7ff0d0158880 2023-05-17T15:11:01.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0d5eab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0157480 con 0x7ff0d01543e0 2023-05-17T15:11:01.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0cf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0cf7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d0154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43714/0 (socket says 172.21.15.27:43714) 2023-05-17T15:11:01.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.029+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1831563747 learned_addr learned my addr 172.21.15.27:0/1831563747 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cffff700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0158880 0x7ff0d00c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0ceffd700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d01682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 msgr2=0x7ff0d01682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cf7fe700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d01682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0158880 msgr2=0x7ff0d00c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cf7fe700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0158880 0x7ff0d00c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cf7fe700 1 -- 172.21.15.27:0/1831563747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0009370 con 0x7ff0d00c5f30 2023-05-17T15:11:01.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0ceffd700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d01682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:01.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0cf7fe700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d0154d60 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7ff0d0083770 tx=0x7ff0c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000b8d0 con 0x7ff0d00c5f30 2023-05-17T15:11:01.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000ba30 con 0x7ff0d00c5f30 2023-05-17T15:11:01.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d0157760 con 0x7ff0d00c5f30 2023-05-17T15:11:01.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c001c670 con 0x7ff0d00c5f30 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.030+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d0155250 con 0x7ff0d00c5f30 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.031+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d00c3b40 con 0x7ff0d00c5f30 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.031+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff0c002c070 con 0x7ff0d00c5f30 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.032+0000 7ff0b77fe700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff0bc05ed90 0x7ff0bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.032+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7ff0c007b700 con 0x7ff0d00c5f30 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.032+0000 7ff0ceffd700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff0bc05ed90 0x7ff0bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.032+0000 7ff0ceffd700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff0bc05ed90 0x7ff0bc061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff0d01691f0 tx=0x7ff0c4009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.036+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0c004cc40 con 0x7ff0d00c5f30 2023-05-17T15:11:01.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.205+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0d005f4a0 con 0x7ff0bc05ed90 2023-05-17T15:11:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.215+0000 7ff0b77fe700 1 -- 172.21.15.27:0/1831563747 <== mgr.7842 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352686 (secure 0 0 0) 0x7ff0d005f4a0 con 0x7ff0bc05ed90 2023-05-17T15:11:01.225 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:01.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff0bc05ed90 msgr2=0x7ff0bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff0bc05ed90 0x7ff0bc061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff0d01691f0 tx=0x7ff0c4009040).stop 2023-05-17T15:11:01.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 msgr2=0x7ff0d0154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d0154d60 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7ff0d0083770 tx=0x7ff0c0017000).stop 2023-05-17T15:11:01.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 shutdown_connections 2023-05-17T15:11:01.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ff0bc05ed90 0x7ff0bc061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0158880 0x7ff0d00c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0d00c5f30 0x7ff0d0154d60 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 --2- 172.21.15.27:0/1831563747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d01543e0 0x7ff0d01682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.218+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 >> 172.21.15.27:0/1831563747 conn(0x7ff0d0069e70 msgr2=0x7ff0d00af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.219+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 shutdown_connections 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.219+0000 7ff0d5eab700 1 -- 172.21.15.27:0/1831563747 wait complete. 2023-05-17T15:11:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:11:01.235 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:10:59.697454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":155668,"kb_used_data":13268,"kb_used_omap":0,"kb_used_meta":142336,"kb_avail":754819052,"statfs":{"total":773094113280,"available":772934709248,"internally_reserved":0,"allocated":13586432,"data_stored":6830383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145752064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10278,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.010330"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820406+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814088+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821884+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821154+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817798+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815962+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817091+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820933+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820013+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819362+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816658+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820378+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818396+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820478+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815742+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820694+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815013+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816503+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821335+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.813830+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816005+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818206+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.813832+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819631+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814535+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819036+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816200+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821095+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815597+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815517+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820017+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815952+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815490+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816034+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820528+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815788+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815245+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819422+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816644+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818256+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815958+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817869+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818664+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818253+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818566+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818190+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818578+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819877+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819611+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816004+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815102+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818906+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814735+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816207+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818304+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819396+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814952+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":103,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.983964+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:53.983964+0000","last_peered":"2023-05-17T15:10:53.983964+0000","last_clean":"2023-05-17T15:10:53.983964+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:53.983964+0000","last_undegraded":"2023-05-17T15:10:53.983964+0000","last_fullsized":"2023-05-17T15:10:53.983964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818968+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.729052+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:53.729052+0000","last_peered":"2023-05-17T15:10:53.729052+0000","last_clean":"2023-05-17T15:10:53.729052+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:53.729052+0000","last_undegraded":"2023-05-17T15:10:53.729052+0000","last_fullsized":"2023-05-17T15:10:53.729052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817772+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.983737+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:53.983737+0000","last_peered":"2023-05-17T15:10:53.983737+0000","last_clean":"2023-05-17T15:10:53.983737+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:53.983737+0000","last_undegraded":"2023-05-17T15:10:53.983737+0000","last_fullsized":"2023-05-17T15:10:53.983737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819245+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.729074+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:53.729074+0000","last_peered":"2023-05-17T15:10:53.729074+0000","last_clean":"2023-05-17T15:10:53.729074+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:53.729074+0000","last_undegraded":"2023-05-17T15:10:53.729074+0000","last_fullsized":"2023-05-17T15:10:53.729074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984156+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:53.984156+0000","last_peered":"2023-05-17T15:10:53.984156+0000","last_clean":"2023-05-17T15:10:53.984156+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:53.984156+0000","last_undegraded":"2023-05-17T15:10:53.984156+0000","last_fullsized":"2023-05-17T15:10:53.984156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819116+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984164+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:53.984164+0000","last_peered":"2023-05-17T15:10:53.984164+0000","last_clean":"2023-05-17T15:10:53.984164+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:53.984164+0000","last_undegraded":"2023-05-17T15:10:53.984164+0000","last_fullsized":"2023-05-17T15:10:53.984164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817523+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984205+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:53.984205+0000","last_peered":"2023-05-17T15:10:53.984205+0000","last_clean":"2023-05-17T15:10:53.984205+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:53.984205+0000","last_undegraded":"2023-05-17T15:10:53.984205+0000","last_fullsized":"2023-05-17T15:10:53.984205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816171+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":103,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.983954+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:53.983954+0000","last_peered":"2023-05-17T15:10:53.983954+0000","last_clean":"2023-05-17T15:10:53.983954+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:53.983954+0000","last_undegraded":"2023-05-17T15:10:53.983954+0000","last_fullsized":"2023-05-17T15:10:53.983954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817981+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984182+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:53.984182+0000","last_peered":"2023-05-17T15:10:53.984182+0000","last_clean":"2023-05-17T15:10:53.984182+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:53.984182+0000","last_undegraded":"2023-05-17T15:10:53.984182+0000","last_fullsized":"2023-05-17T15:10:53.984182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.624},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.42299999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.40000000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18436,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353404,"statfs":{"total":96636764160,"available":96617885696,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.64500000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":1687552,"data_stored":848267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.222},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23899999999999999},"max":{"1min":0.55000000000000004,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.51800000000000002,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.20000000000000001},"max":{"1min":0.64700000000000002,"5min":1.956,"15min":1.956},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.373,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":1.149,"15min":1.149},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96599999999999997,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.371}]},{"osd":5,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89600000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":1.103,"15min":1.103},"last":0.378}]},{"osd":6,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.65800000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.99199999999999999,"5min":1.524,"15min":1.524},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.442},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66900000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17988,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":94353852,"statfs":{"total":96636764160,"available":96618344448,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.28100000000000003}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.249},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.622},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.497}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575049,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19332,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17664,"kb_avail":94352508,"statfs":{"total":96636764160,"available":96616968192,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18087936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.24299999999999999}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.311}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.379}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.62},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.57499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22276,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94349564,"statfs":{"total":96636764160,"available":96613953536,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18692,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353148,"statfs":{"total":96636764160,"available":96617623552,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.47399999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.56999999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.67300000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575049,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21892,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":20224,"kb_avail":94349948,"statfs":{"total":96636764160,"available":96614346752,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20709376},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:11:01.244 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:11:01.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.387+0000 7f1beee17700 1 Processor -- start 2023-05-17T15:11:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.387+0000 7f1beee17700 1 -- start start 2023-05-17T15:11:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.388+0000 7f1beee17700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1be8152490 0x7f1be80a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.388+0000 7f1beee17700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be8153430 con 0x7f1be805df10 2023-05-17T15:11:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.388+0000 7f1beee17700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be8155c20 con 0x7f1be805e2f0 2023-05-17T15:11:01.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.388+0000 7f1beee17700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80a7240 con 0x7f1be8152490 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.388+0000 7f1becbb3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1be805df10 0x7f1be80c2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43284/0 (socket says 172.21.15.27:43284) 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.388+0000 7f1becbb3700 1 -- 172.21.15.27:0/4143825230 learned_addr learned my addr 172.21.15.27:0/4143825230 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1bed3b4700 1 --2- 172.21.15.27:0/4143825230 >> v2:172.21.15.40:3300/0 conn(0x7f1be8152490 0x7f1be80a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687256813 0 0) 0x7f1be8153430 con 0x7f1be805df10 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd40033f0 con 0x7f1be805df10 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034480928 0 0) 0x7f1bd40033f0 con 0x7f1be805df10 2023-05-17T15:11:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 >> v2:172.21.15.40:3300/0 conn(0x7f1be8152490 msgr2=0x7f1be80a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 --2- 172.21.15.27:0/4143825230 >> v2:172.21.15.40:3300/0 conn(0x7f1be8152490 0x7f1be80a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 >> v1:172.21.15.40:6789/0 conn(0x7f1be805e2f0 legacy=0x7f1be81560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8152b90 con 0x7f1be805df10 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f1be00017f0 con 0x7f1be805df10 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 >> v1:172.21.15.27:6789/0 conn(0x7f1be805df10 legacy=0x7f1be80c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bd40038e0 0x7f1bd4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bd4004690 0x7f1bd4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd4005000 0x7f1bd400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80a7240 con 0x7f1bd40038e0 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd400beb0 con 0x7f1bd4004690 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd400c070 con 0x7f1bd4005000 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bd40038e0 0x7f1bd4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1be7fff700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bd4004690 0x7f1bd4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.389+0000 7f1bed3b4700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd4005000 0x7f1bd400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1becbb3700 1 -- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd4005000 msgr2=0x7f1bd400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd4005000 0x7f1bd400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1becbb3700 1 -- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bd4004690 msgr2=0x7f1bd4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bd4004690 0x7f1bd4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1becbb3700 1 -- 172.21.15.27:0/4143825230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40033f0 con 0x7f1bd40038e0 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1bed3b4700 1 -- 172.21.15.27:0/4143825230 reap_dead start 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bd40038e0 0x7f1bd4003cc0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f1be000c5f0 tx=0x7f1be0001d90).ready entity=mon.0 client_cookie=d4fade5af0504242 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0001fc0 con 0x7f1bd40038e0 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be000ce40 con 0x7f1bd40038e0 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1be77fe700 1 -- 172.21.15.27:0/4143825230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0005d30 con 0x7f1bd40038e0 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 -- 172.21.15.27:0/4143825230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bd40038e0 msgr2=0x7f1bd4003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bd40038e0 0x7f1bd4003cc0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f1be000c5f0 tx=0x7f1be0001d90).stop 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 -- 172.21.15.27:0/4143825230 shutdown_connections 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 --2- 172.21.15.27:0/4143825230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1bd40038e0 0x7f1bd4003cc0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 -- 172.21.15.27:0/4143825230 >> 172.21.15.27:0/4143825230 conn(0x7f1be80c7980 msgr2=0x7f1be80c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:01.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 -- 172.21.15.27:0/4143825230 shutdown_connections 2023-05-17T15:11:01.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.390+0000 7f1beee17700 1 -- 172.21.15.27:0/4143825230 wait complete. 2023-05-17T15:11:01.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 Processor -- start 2023-05-17T15:11:01.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 -- start start 2023-05-17T15:11:01.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd40038e0 0x7f1be8149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bec00 0x7f1be80a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 0x7f1be8167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80bf080 con 0x7f1be8147470 2023-05-17T15:11:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80639c0 con 0x7f1be80bec00 2023-05-17T15:11:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.392+0000 7f1beee17700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80633e0 con 0x7f1bd40038e0 2023-05-17T15:11:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 0x7f1be8167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 0x7f1be8167fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43738/0 (socket says 172.21.15.27:43738) 2023-05-17T15:11:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 -- 172.21.15.27:0/4271806887 learned_addr learned my addr 172.21.15.27:0/4271806887 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:01.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd40038e0 0x7f1be8149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1be7fff700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bec00 0x7f1be80a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 -- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd40038e0 msgr2=0x7f1be8149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd40038e0 0x7f1be8149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 -- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bec00 msgr2=0x7f1be80a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bec00 0x7f1be80a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 -- 172.21.15.27:0/4271806887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80a4f50 con 0x7f1be8147470 2023-05-17T15:11:01.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1bed3b4700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 0x7f1be8167fc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f1bd0006d80 tx=0x7f1bd0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0013680 con 0x7f1be8147470 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00137e0 con 0x7f1be8147470 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be8063650 con 0x7f1be8147470 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0013b80 con 0x7f1be8147470 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.393+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be80a5230 con 0x7f1be8147470 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.394+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be806bdf0 con 0x7f1be8147470 2023-05-17T15:11:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.395+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1bd0024070 con 0x7f1be8147470 2023-05-17T15:11:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.395+0000 7f1be4ff9700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bc805ed60 0x7f1bc8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.395+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f1bd007a0d0 con 0x7f1be8147470 2023-05-17T15:11:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.395+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bc805ed60 0x7f1bc8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.395+0000 7f1becbb3700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bc805ed60 0x7f1bc8061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1be000d010 tx=0x7f1be0015000).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.399+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1bd004b610 con 0x7f1be8147470 2023-05-17T15:11:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.565+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1be8068f30 con 0x7f1bc805ed60 2023-05-17T15:11:01.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.574+0000 7f1be4ff9700 1 -- 172.21.15.27:0/4271806887 <== mgr.7842 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352686 (secure 0 0 0) 0x7f1be8068f30 con 0x7f1bc805ed60 2023-05-17T15:11:01.582 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bc805ed60 msgr2=0x7f1bc8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bc805ed60 0x7f1bc8061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1be000d010 tx=0x7f1be0015000).stop 2023-05-17T15:11:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 msgr2=0x7f1be8167fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 0x7f1be8167fc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f1bd0006d80 tx=0x7f1bd0009060).stop 2023-05-17T15:11:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 shutdown_connections 2023-05-17T15:11:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1bc805ed60 0x7f1bc8061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1be8147470 0x7f1be8167fc0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bd40038e0 0x7f1be8149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 --2- 172.21.15.27:0/4271806887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bec00 0x7f1be80a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 >> 172.21.15.27:0/4271806887 conn(0x7f1be80c7980 msgr2=0x7f1be80c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 shutdown_connections 2023-05-17T15:11:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.578+0000 7f1beee17700 1 -- 172.21.15.27:0/4271806887 wait complete. 2023-05-17T15:11:01.587 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:11:01.593 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:10:59.697454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":155668,"kb_used_data":13268,"kb_used_omap":0,"kb_used_meta":142336,"kb_avail":754819052,"statfs":{"total":773094113280,"available":772934709248,"internally_reserved":0,"allocated":13586432,"data_stored":6830383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145752064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10278,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.010330"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820406+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814088+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821884+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821154+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817798+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815962+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817091+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820933+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820013+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819362+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816658+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820378+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818396+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820478+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815742+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820694+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815013+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816503+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821335+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.813830+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816005+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818206+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.813832+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819631+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814535+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819036+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816200+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.821095+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815597+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815517+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820017+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815952+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815490+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816034+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.820528+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815788+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815245+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819422+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816644+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818256+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815958+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817869+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818664+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818253+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818566+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818190+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818578+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819877+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819611+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816004+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.815102+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818906+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814735+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816207+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818304+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819396+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.814952+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":103,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.983964+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:53.983964+0000","last_peered":"2023-05-17T15:10:53.983964+0000","last_clean":"2023-05-17T15:10:53.983964+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:53.983964+0000","last_undegraded":"2023-05-17T15:10:53.983964+0000","last_fullsized":"2023-05-17T15:10:53.983964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.818968+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.729052+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:53.729052+0000","last_peered":"2023-05-17T15:10:53.729052+0000","last_clean":"2023-05-17T15:10:53.729052+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:53.729052+0000","last_undegraded":"2023-05-17T15:10:53.729052+0000","last_fullsized":"2023-05-17T15:10:53.729052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817772+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.983737+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:53.983737+0000","last_peered":"2023-05-17T15:10:53.983737+0000","last_clean":"2023-05-17T15:10:53.983737+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:53.983737+0000","last_undegraded":"2023-05-17T15:10:53.983737+0000","last_fullsized":"2023-05-17T15:10:53.983737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819245+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.729074+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:53.729074+0000","last_peered":"2023-05-17T15:10:53.729074+0000","last_clean":"2023-05-17T15:10:53.729074+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:53.729074+0000","last_undegraded":"2023-05-17T15:10:53.729074+0000","last_fullsized":"2023-05-17T15:10:53.729074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984156+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:53.984156+0000","last_peered":"2023-05-17T15:10:53.984156+0000","last_clean":"2023-05-17T15:10:53.984156+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:53.984156+0000","last_undegraded":"2023-05-17T15:10:53.984156+0000","last_fullsized":"2023-05-17T15:10:53.984156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.819116+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984164+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:53.984164+0000","last_peered":"2023-05-17T15:10:53.984164+0000","last_clean":"2023-05-17T15:10:53.984164+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:53.984164+0000","last_undegraded":"2023-05-17T15:10:53.984164+0000","last_fullsized":"2023-05-17T15:10:53.984164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817523+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984205+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:53.984205+0000","last_peered":"2023-05-17T15:10:53.984205+0000","last_clean":"2023-05-17T15:10:53.984205+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:53.984205+0000","last_undegraded":"2023-05-17T15:10:53.984205+0000","last_fullsized":"2023-05-17T15:10:53.984205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.816171+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":103,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.983954+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:53.983954+0000","last_peered":"2023-05-17T15:10:53.983954+0000","last_clean":"2023-05-17T15:10:53.983954+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:53.983954+0000","last_undegraded":"2023-05-17T15:10:53.983954+0000","last_fullsized":"2023-05-17T15:10:53.983954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-17T15:10:56.809329+0000","last_change":"2023-05-17T15:10:56.809329+0000","last_active":"2023-05-17T15:10:56.809329+0000","last_peered":"2023-05-17T15:10:56.809329+0000","last_clean":"2023-05-17T15:10:56.809329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:56.809329+0000","last_undegraded":"2023-05-17T15:10:56.809329+0000","last_fullsized":"2023-05-17T15:10:56.809329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:10:55.804730+0000","last_change":"2023-05-17T15:10:55.817981+0000","last_active":"2023-05-17T15:10:55.804730+0000","last_peered":"2023-05-17T15:10:55.804730+0000","last_clean":"2023-05-17T15:10:55.804730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:10:55.804730+0000","last_undegraded":"2023-05-17T15:10:55.804730+0000","last_fullsized":"2023-05-17T15:10:55.804730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-05-17T15:10:53.984182+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:53.984182+0000","last_peered":"2023-05-17T15:10:53.984182+0000","last_clean":"2023-05-17T15:10:53.984182+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:53.984182+0000","last_undegraded":"2023-05-17T15:10:53.984182+0000","last_fullsized":"2023-05-17T15:10:53.984182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18820,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353020,"statfs":{"total":96636764160,"available":96617492480,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.624},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.42299999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.40000000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18436,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353404,"statfs":{"total":96636764160,"available":96617885696,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":0.64500000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":1687552,"data_stored":848267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.222},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23899999999999999},"max":{"1min":0.55000000000000004,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.51800000000000002,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.20000000000000001},"max":{"1min":0.64700000000000002,"5min":1.956,"15min":1.956},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.373,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":1.149,"15min":1.149},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96599999999999997,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.371}]},{"osd":5,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89600000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":1.103,"15min":1.103},"last":0.378}]},{"osd":6,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.65800000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.99199999999999999,"5min":1.524,"15min":1.524},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.442},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66900000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17988,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":94353852,"statfs":{"total":96636764160,"available":96618344448,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.28100000000000003}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.249},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.622},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.497}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575049,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19332,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17664,"kb_avail":94352508,"statfs":{"total":96636764160,"available":96616968192,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18087936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.24299999999999999}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.311}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.379}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.62},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.57499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22276,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94349564,"statfs":{"total":96636764160,"available":96613953536,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18692,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353148,"statfs":{"total":96636764160,"available":96617623552,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.47399999999999998}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.56999999999999995}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.67300000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575049,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21892,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":20224,"kb_avail":94349948,"statfs":{"total":96636764160,"available":96614346752,"internally_reserved":0,"allocated":1699840,"data_stored":854588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20709376},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:11:01.603 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:11:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.747+0000 7fa3d95b6700 1 Processor -- start 2023-05-17T15:11:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.747+0000 7fa3d95b6700 1 -- start start 2023-05-17T15:11:01.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d95b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d41543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d95b6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40bfcd0 con 0x7fa3d40c6310 2023-05-17T15:11:01.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d95b6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40c0290 con 0x7fa3d40c5f30 2023-05-17T15:11:01.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d95b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40aa1a0 con 0x7fa3d40c1730 2023-05-17T15:11:01.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d27fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa3d40c6310 0x7fa3d4153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43306/0 (socket says 172.21.15.27:43306) 2023-05-17T15:11:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d27fc700 1 -- 172.21.15.27:0/2180057901 learned_addr learned my addr 172.21.15.27:0/2180057901 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d37fe700 1 --2- 172.21.15.27:0/2180057901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d41543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147727172 0 0) 0x7fa3d40bfcd0 con 0x7fa3d40c6310 2023-05-17T15:11:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c00033f0 con 0x7fa3d40c6310 2023-05-17T15:11:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508816384 0 0) 0x7fa3d40c0290 con 0x7fa3d40c5f30 2023-05-17T15:11:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d40bfcd0 con 0x7fa3d40c5f30 2023-05-17T15:11:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d37fe700 1 -- 172.21.15.27:0/2180057901 >> v1:172.21.15.40:6789/0 conn(0x7fa3d40c5f30 legacy=0x7fa3d4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d37fe700 1 -- 172.21.15.27:0/2180057901 >> v1:172.21.15.27:6789/0 conn(0x7fa3d40c6310 legacy=0x7fa3d4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d37fe700 1 -- 172.21.15.27:0/2180057901 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40aa480 con 0x7fa3d40c1730 2023-05-17T15:11:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.748+0000 7fa3d37fe700 1 --2- 172.21.15.27:0/2180057901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d41543e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa3c4009790 tx=0x7fa3c4009060).ready entity=mon.2 client_cookie=20de5f734b22228 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400f510 con 0x7fa3d40c1730 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c400f670 con 0x7fa3d40c1730 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d1ffb700 1 -- 172.21.15.27:0/2180057901 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400f9f0 con 0x7fa3d40c1730 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2180057901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 msgr2=0x7fa3d41543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2180057901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d41543e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa3c4009790 tx=0x7fa3c4009060).stop 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2180057901 shutdown_connections 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2180057901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d41543e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2180057901 >> 172.21.15.27:0/2180057901 conn(0x7fa3d4069e70 msgr2=0x7fa3d405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:01.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2180057901 shutdown_connections 2023-05-17T15:11:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.749+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2180057901 wait complete. 2023-05-17T15:11:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.750+0000 7fa3d95b6700 1 Processor -- start 2023-05-17T15:11:01.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.750+0000 7fa3d95b6700 1 -- start start 2023-05-17T15:11:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d95b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d95b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 0x7fa3d40ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d95b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3d40c6310 0x7fa3d40ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d95b6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40acac0 con 0x7fa3d40c5f30 2023-05-17T15:11:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d95b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4155d70 con 0x7fa3d40c6310 2023-05-17T15:11:01.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d95b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4155160 con 0x7fa3d40c1730 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 0x7fa3d40ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 0x7fa3d40ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43750/0 (socket says 172.21.15.27:43750) 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d27fc700 1 -- 172.21.15.27:0/2957674060 learned_addr learned my addr 172.21.15.27:0/2957674060 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d37fe700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3d40c6310 0x7fa3d40ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.751+0000 7fa3d2ffd700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d27fc700 1 -- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 msgr2=0x7fa3d414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d27fc700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d414ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d27fc700 1 -- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3d40c6310 msgr2=0x7fa3d40ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d27fc700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3d40c6310 0x7fa3d40ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d27fc700 1 -- 172.21.15.27:0/2957674060 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40092a0 con 0x7fa3d40c5f30 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d2ffd700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d27fc700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 0x7fa3d40ac0e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fa3bc00c560 tx=0x7fa3bc007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0072e0 con 0x7fa3d40c5f30 2023-05-17T15:11:01.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc007440 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d4155440 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0057a0 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.752+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d4155a00 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.753+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d4155f00 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.753+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa3bc01a060 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.754+0000 7fa3caffd700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa3b405ed90 0x7fa3b4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.754+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fa3bc0793f0 con 0x7fa3d40c5f30 2023-05-17T15:11:01.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.754+0000 7fa3d2ffd700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa3b405ed90 0x7fa3b4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:01.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.754+0000 7fa3d2ffd700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa3b405ed90 0x7fa3b4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa3cc000f80 tx=0x7fa3cc009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:01.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.758+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3bc04a930 con 0x7fa3d40c5f30 2023-05-17T15:11:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.927+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3d405f4a0 con 0x7fa3b405ed90 2023-05-17T15:11:01.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.937+0000 7fa3caffd700 1 -- 172.21.15.27:0/2957674060 <== mgr.7842 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361555 (secure 0 0 0) 0x7fa3d405f4a0 con 0x7fa3b405ed90 2023-05-17T15:11:01.944 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:01.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa3b405ed90 msgr2=0x7fa3b4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa3b405ed90 0x7fa3b4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa3cc000f80 tx=0x7fa3cc009040).stop 2023-05-17T15:11:01.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 msgr2=0x7fa3d40ac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 0x7fa3d40ac0e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fa3bc00c560 tx=0x7fa3bc007d20).stop 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 shutdown_connections 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa3b405ed90 0x7fa3b4061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3d40c6310 0x7fa3d40ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3d40c1730 0x7fa3d414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 --2- 172.21.15.27:0/2957674060 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d40c5f30 0x7fa3d40ac0e0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:01.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 >> 172.21.15.27:0/2957674060 conn(0x7fa3d4069e70 msgr2=0x7fa3d40af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 shutdown_connections 2023-05-17T15:11:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:01.940+0000 7fa3d95b6700 1 -- 172.21.15.27:0/2957674060 wait complete. 2023-05-17T15:11:01.948 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:11:01.956 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:11:01.697769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":157568,"kb_used_data":13632,"kb_used_omap":0,"kb_used_meta":143872,"kb_avail":754817152,"statfs":{"total":773094113280,"available":772932763648,"internally_reserved":0,"allocated":13959168,"data_stored":7008212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":147324928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10278,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.010330"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234889+0000","last_change":"2023-05-17T15:10:57.231439+0000","last_active":"2023-05-17T15:10:57.234889+0000","last_peered":"2023-05-17T15:10:57.234889+0000","last_clean":"2023-05-17T15:10:57.234889+0000","last_became_active":"2023-05-17T15:10:57.231117+0000","last_became_peered":"2023-05-17T15:10:57.231117+0000","last_unstale":"2023-05-17T15:10:57.234889+0000","last_undegraded":"2023-05-17T15:10:57.234889+0000","last_fullsized":"2023-05-17T15:10:57.234889+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232058+0000","last_change":"2023-05-17T15:10:56.832856+0000","last_active":"2023-05-17T15:10:57.232058+0000","last_peered":"2023-05-17T15:10:57.232058+0000","last_clean":"2023-05-17T15:10:57.232058+0000","last_became_active":"2023-05-17T15:10:56.832558+0000","last_became_peered":"2023-05-17T15:10:56.832558+0000","last_unstale":"2023-05-17T15:10:57.232058+0000","last_undegraded":"2023-05-17T15:10:57.232058+0000","last_fullsized":"2023-05-17T15:10:57.232058+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227111+0000","last_change":"2023-05-17T15:10:57.218961+0000","last_active":"2023-05-17T15:10:57.227111+0000","last_peered":"2023-05-17T15:10:57.227111+0000","last_clean":"2023-05-17T15:10:57.227111+0000","last_became_active":"2023-05-17T15:10:57.217542+0000","last_became_peered":"2023-05-17T15:10:57.217542+0000","last_unstale":"2023-05-17T15:10:57.227111+0000","last_undegraded":"2023-05-17T15:10:57.227111+0000","last_fullsized":"2023-05-17T15:10:57.227111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208490+0000","last_change":"2023-05-17T15:10:56.834250+0000","last_active":"2023-05-17T15:10:57.208490+0000","last_peered":"2023-05-17T15:10:57.208490+0000","last_clean":"2023-05-17T15:10:57.208490+0000","last_became_active":"2023-05-17T15:10:56.833982+0000","last_became_peered":"2023-05-17T15:10:56.833982+0000","last_unstale":"2023-05-17T15:10:57.208490+0000","last_undegraded":"2023-05-17T15:10:57.208490+0000","last_fullsized":"2023-05-17T15:10:57.208490+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232841+0000","last_change":"2023-05-17T15:10:57.230075+0000","last_active":"2023-05-17T15:10:57.232841+0000","last_peered":"2023-05-17T15:10:57.232841+0000","last_clean":"2023-05-17T15:10:57.232841+0000","last_became_active":"2023-05-17T15:10:57.229851+0000","last_became_peered":"2023-05-17T15:10:57.229851+0000","last_unstale":"2023-05-17T15:10:57.232841+0000","last_undegraded":"2023-05-17T15:10:57.232841+0000","last_fullsized":"2023-05-17T15:10:57.232841+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.223961+0000","last_change":"2023-05-17T15:10:56.839662+0000","last_active":"2023-05-17T15:10:57.223961+0000","last_peered":"2023-05-17T15:10:57.223961+0000","last_clean":"2023-05-17T15:10:57.223961+0000","last_became_active":"2023-05-17T15:10:56.839412+0000","last_became_peered":"2023-05-17T15:10:56.839412+0000","last_unstale":"2023-05-17T15:10:57.223961+0000","last_undegraded":"2023-05-17T15:10:57.223961+0000","last_fullsized":"2023-05-17T15:10:57.223961+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227992+0000","last_change":"2023-05-17T15:10:57.217169+0000","last_active":"2023-05-17T15:10:57.227992+0000","last_peered":"2023-05-17T15:10:57.227992+0000","last_clean":"2023-05-17T15:10:57.227992+0000","last_became_active":"2023-05-17T15:10:57.216851+0000","last_became_peered":"2023-05-17T15:10:57.216851+0000","last_unstale":"2023-05-17T15:10:57.227992+0000","last_undegraded":"2023-05-17T15:10:57.227992+0000","last_fullsized":"2023-05-17T15:10:57.227992+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.229484+0000","last_change":"2023-05-17T15:10:56.838881+0000","last_active":"2023-05-17T15:10:57.229484+0000","last_peered":"2023-05-17T15:10:57.229484+0000","last_clean":"2023-05-17T15:10:57.229484+0000","last_became_active":"2023-05-17T15:10:56.836360+0000","last_became_peered":"2023-05-17T15:10:56.836360+0000","last_unstale":"2023-05-17T15:10:57.229484+0000","last_undegraded":"2023-05-17T15:10:57.229484+0000","last_fullsized":"2023-05-17T15:10:57.229484+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226859+0000","last_change":"2023-05-17T15:10:57.217310+0000","last_active":"2023-05-17T15:10:57.226859+0000","last_peered":"2023-05-17T15:10:57.226859+0000","last_clean":"2023-05-17T15:10:57.226859+0000","last_became_active":"2023-05-17T15:10:57.217067+0000","last_became_peered":"2023-05-17T15:10:57.217067+0000","last_unstale":"2023-05-17T15:10:57.226859+0000","last_undegraded":"2023-05-17T15:10:57.226859+0000","last_fullsized":"2023-05-17T15:10:57.226859+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227204+0000","last_change":"2023-05-17T15:10:56.828562+0000","last_active":"2023-05-17T15:10:57.227204+0000","last_peered":"2023-05-17T15:10:57.227204+0000","last_clean":"2023-05-17T15:10:57.227204+0000","last_became_active":"2023-05-17T15:10:56.828263+0000","last_became_peered":"2023-05-17T15:10:56.828263+0000","last_unstale":"2023-05-17T15:10:57.227204+0000","last_undegraded":"2023-05-17T15:10:57.227204+0000","last_fullsized":"2023-05-17T15:10:57.227204+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233123+0000","last_change":"2023-05-17T15:10:57.232414+0000","last_active":"2023-05-17T15:10:57.233123+0000","last_peered":"2023-05-17T15:10:57.233123+0000","last_clean":"2023-05-17T15:10:57.233123+0000","last_became_active":"2023-05-17T15:10:57.232117+0000","last_became_peered":"2023-05-17T15:10:57.232117+0000","last_unstale":"2023-05-17T15:10:57.233123+0000","last_undegraded":"2023-05-17T15:10:57.233123+0000","last_fullsized":"2023-05-17T15:10:57.233123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227885+0000","last_change":"2023-05-17T15:10:56.839017+0000","last_active":"2023-05-17T15:10:57.227885+0000","last_peered":"2023-05-17T15:10:57.227885+0000","last_clean":"2023-05-17T15:10:57.227885+0000","last_became_active":"2023-05-17T15:10:56.838716+0000","last_became_peered":"2023-05-17T15:10:56.838716+0000","last_unstale":"2023-05-17T15:10:57.227885+0000","last_undegraded":"2023-05-17T15:10:57.227885+0000","last_fullsized":"2023-05-17T15:10:57.227885+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227328+0000","last_change":"2023-05-17T15:10:57.224895+0000","last_active":"2023-05-17T15:10:57.227328+0000","last_peered":"2023-05-17T15:10:57.227328+0000","last_clean":"2023-05-17T15:10:57.227328+0000","last_became_active":"2023-05-17T15:10:57.224534+0000","last_became_peered":"2023-05-17T15:10:57.224534+0000","last_unstale":"2023-05-17T15:10:57.227328+0000","last_undegraded":"2023-05-17T15:10:57.227328+0000","last_fullsized":"2023-05-17T15:10:57.227328+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205984+0000","last_change":"2023-05-17T15:10:56.834017+0000","last_active":"2023-05-17T15:10:57.205984+0000","last_peered":"2023-05-17T15:10:57.205984+0000","last_clean":"2023-05-17T15:10:57.205984+0000","last_became_active":"2023-05-17T15:10:56.832528+0000","last_became_peered":"2023-05-17T15:10:56.832528+0000","last_unstale":"2023-05-17T15:10:57.205984+0000","last_undegraded":"2023-05-17T15:10:57.205984+0000","last_fullsized":"2023-05-17T15:10:57.205984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228832+0000","last_change":"2023-05-17T15:10:57.226850+0000","last_active":"2023-05-17T15:10:57.228832+0000","last_peered":"2023-05-17T15:10:57.228832+0000","last_clean":"2023-05-17T15:10:57.228832+0000","last_became_active":"2023-05-17T15:10:57.226532+0000","last_became_peered":"2023-05-17T15:10:57.226532+0000","last_unstale":"2023-05-17T15:10:57.228832+0000","last_undegraded":"2023-05-17T15:10:57.228832+0000","last_fullsized":"2023-05-17T15:10:57.228832+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215134+0000","last_change":"2023-05-17T15:10:56.841641+0000","last_active":"2023-05-17T15:10:57.215134+0000","last_peered":"2023-05-17T15:10:57.215134+0000","last_clean":"2023-05-17T15:10:57.215134+0000","last_became_active":"2023-05-17T15:10:56.841348+0000","last_became_peered":"2023-05-17T15:10:56.841348+0000","last_unstale":"2023-05-17T15:10:57.215134+0000","last_undegraded":"2023-05-17T15:10:57.215134+0000","last_fullsized":"2023-05-17T15:10:57.215134+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225702+0000","last_change":"2023-05-17T15:10:57.220804+0000","last_active":"2023-05-17T15:10:57.225702+0000","last_peered":"2023-05-17T15:10:57.225702+0000","last_clean":"2023-05-17T15:10:57.225702+0000","last_became_active":"2023-05-17T15:10:57.219896+0000","last_became_peered":"2023-05-17T15:10:57.219896+0000","last_unstale":"2023-05-17T15:10:57.225702+0000","last_undegraded":"2023-05-17T15:10:57.225702+0000","last_fullsized":"2023-05-17T15:10:57.225702+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205865+0000","last_change":"2023-05-17T15:10:56.829766+0000","last_active":"2023-05-17T15:10:57.205865+0000","last_peered":"2023-05-17T15:10:57.205865+0000","last_clean":"2023-05-17T15:10:57.205865+0000","last_became_active":"2023-05-17T15:10:56.829476+0000","last_became_peered":"2023-05-17T15:10:56.829476+0000","last_unstale":"2023-05-17T15:10:57.205865+0000","last_undegraded":"2023-05-17T15:10:57.205865+0000","last_fullsized":"2023-05-17T15:10:57.205865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228105+0000","last_change":"2023-05-17T15:10:57.222990+0000","last_active":"2023-05-17T15:10:57.228105+0000","last_peered":"2023-05-17T15:10:57.228105+0000","last_clean":"2023-05-17T15:10:57.228105+0000","last_became_active":"2023-05-17T15:10:57.222492+0000","last_became_peered":"2023-05-17T15:10:57.222492+0000","last_unstale":"2023-05-17T15:10:57.228105+0000","last_undegraded":"2023-05-17T15:10:57.228105+0000","last_fullsized":"2023-05-17T15:10:57.228105+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206451+0000","last_change":"2023-05-17T15:10:56.835464+0000","last_active":"2023-05-17T15:10:57.206451+0000","last_peered":"2023-05-17T15:10:57.206451+0000","last_clean":"2023-05-17T15:10:57.206451+0000","last_became_active":"2023-05-17T15:10:56.833882+0000","last_became_peered":"2023-05-17T15:10:56.833882+0000","last_unstale":"2023-05-17T15:10:57.206451+0000","last_undegraded":"2023-05-17T15:10:57.206451+0000","last_fullsized":"2023-05-17T15:10:57.206451+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224131+0000","last_change":"2023-05-17T15:10:57.213885+0000","last_active":"2023-05-17T15:10:57.224131+0000","last_peered":"2023-05-17T15:10:57.224131+0000","last_clean":"2023-05-17T15:10:57.224131+0000","last_became_active":"2023-05-17T15:10:57.213575+0000","last_became_peered":"2023-05-17T15:10:57.213575+0000","last_unstale":"2023-05-17T15:10:57.224131+0000","last_undegraded":"2023-05-17T15:10:57.224131+0000","last_fullsized":"2023-05-17T15:10:57.224131+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209304+0000","last_change":"2023-05-17T15:10:56.832141+0000","last_active":"2023-05-17T15:10:57.209304+0000","last_peered":"2023-05-17T15:10:57.209304+0000","last_clean":"2023-05-17T15:10:57.209304+0000","last_became_active":"2023-05-17T15:10:56.831844+0000","last_became_peered":"2023-05-17T15:10:56.831844+0000","last_unstale":"2023-05-17T15:10:57.209304+0000","last_undegraded":"2023-05-17T15:10:57.209304+0000","last_fullsized":"2023-05-17T15:10:57.209304+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233812+0000","last_change":"2023-05-17T15:10:57.231257+0000","last_active":"2023-05-17T15:10:57.233812+0000","last_peered":"2023-05-17T15:10:57.233812+0000","last_clean":"2023-05-17T15:10:57.233812+0000","last_became_active":"2023-05-17T15:10:57.230945+0000","last_became_peered":"2023-05-17T15:10:57.230945+0000","last_unstale":"2023-05-17T15:10:57.233812+0000","last_undegraded":"2023-05-17T15:10:57.233812+0000","last_fullsized":"2023-05-17T15:10:57.233812+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232104+0000","last_change":"2023-05-17T15:10:56.831837+0000","last_active":"2023-05-17T15:10:57.232104+0000","last_peered":"2023-05-17T15:10:57.232104+0000","last_clean":"2023-05-17T15:10:57.232104+0000","last_became_active":"2023-05-17T15:10:56.831011+0000","last_became_peered":"2023-05-17T15:10:56.831011+0000","last_unstale":"2023-05-17T15:10:57.232104+0000","last_undegraded":"2023-05-17T15:10:57.232104+0000","last_fullsized":"2023-05-17T15:10:57.232104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222029+0000","last_change":"2023-05-17T15:10:57.213569+0000","last_active":"2023-05-17T15:10:57.222029+0000","last_peered":"2023-05-17T15:10:57.222029+0000","last_clean":"2023-05-17T15:10:57.222029+0000","last_became_active":"2023-05-17T15:10:57.213285+0000","last_became_peered":"2023-05-17T15:10:57.213285+0000","last_unstale":"2023-05-17T15:10:57.222029+0000","last_undegraded":"2023-05-17T15:10:57.222029+0000","last_fullsized":"2023-05-17T15:10:57.222029+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233137+0000","last_change":"2023-05-17T15:10:56.840789+0000","last_active":"2023-05-17T15:10:57.233137+0000","last_peered":"2023-05-17T15:10:57.233137+0000","last_clean":"2023-05-17T15:10:57.233137+0000","last_became_active":"2023-05-17T15:10:56.840561+0000","last_became_peered":"2023-05-17T15:10:56.840561+0000","last_unstale":"2023-05-17T15:10:57.233137+0000","last_undegraded":"2023-05-17T15:10:57.233137+0000","last_fullsized":"2023-05-17T15:10:57.233137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228187+0000","last_change":"2023-05-17T15:10:57.223796+0000","last_active":"2023-05-17T15:10:57.228187+0000","last_peered":"2023-05-17T15:10:57.228187+0000","last_clean":"2023-05-17T15:10:57.228187+0000","last_became_active":"2023-05-17T15:10:57.222389+0000","last_became_peered":"2023-05-17T15:10:57.222389+0000","last_unstale":"2023-05-17T15:10:57.228187+0000","last_undegraded":"2023-05-17T15:10:57.228187+0000","last_fullsized":"2023-05-17T15:10:57.228187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219811+0000","last_change":"2023-05-17T15:10:56.837666+0000","last_active":"2023-05-17T15:10:57.219811+0000","last_peered":"2023-05-17T15:10:57.219811+0000","last_clean":"2023-05-17T15:10:57.219811+0000","last_became_active":"2023-05-17T15:10:56.837330+0000","last_became_peered":"2023-05-17T15:10:56.837330+0000","last_unstale":"2023-05-17T15:10:57.219811+0000","last_undegraded":"2023-05-17T15:10:57.219811+0000","last_fullsized":"2023-05-17T15:10:57.219811+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227698+0000","last_change":"2023-05-17T15:10:57.223730+0000","last_active":"2023-05-17T15:10:57.227698+0000","last_peered":"2023-05-17T15:10:57.227698+0000","last_clean":"2023-05-17T15:10:57.227698+0000","last_became_active":"2023-05-17T15:10:57.223035+0000","last_became_peered":"2023-05-17T15:10:57.223035+0000","last_unstale":"2023-05-17T15:10:57.227698+0000","last_undegraded":"2023-05-17T15:10:57.227698+0000","last_fullsized":"2023-05-17T15:10:57.227698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207014+0000","last_change":"2023-05-17T15:10:56.834347+0000","last_active":"2023-05-17T15:10:57.207014+0000","last_peered":"2023-05-17T15:10:57.207014+0000","last_clean":"2023-05-17T15:10:57.207014+0000","last_became_active":"2023-05-17T15:10:56.834051+0000","last_became_peered":"2023-05-17T15:10:56.834051+0000","last_unstale":"2023-05-17T15:10:57.207014+0000","last_undegraded":"2023-05-17T15:10:57.207014+0000","last_fullsized":"2023-05-17T15:10:57.207014+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226982+0000","last_change":"2023-05-17T15:10:57.220386+0000","last_active":"2023-05-17T15:10:57.226982+0000","last_peered":"2023-05-17T15:10:57.226982+0000","last_clean":"2023-05-17T15:10:57.226982+0000","last_became_active":"2023-05-17T15:10:57.220055+0000","last_became_peered":"2023-05-17T15:10:57.220055+0000","last_unstale":"2023-05-17T15:10:57.226982+0000","last_undegraded":"2023-05-17T15:10:57.226982+0000","last_fullsized":"2023-05-17T15:10:57.226982+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233714+0000","last_change":"2023-05-17T15:10:56.842907+0000","last_active":"2023-05-17T15:10:57.233714+0000","last_peered":"2023-05-17T15:10:57.233714+0000","last_clean":"2023-05-17T15:10:57.233714+0000","last_became_active":"2023-05-17T15:10:56.842535+0000","last_became_peered":"2023-05-17T15:10:56.842535+0000","last_unstale":"2023-05-17T15:10:57.233714+0000","last_undegraded":"2023-05-17T15:10:57.233714+0000","last_fullsized":"2023-05-17T15:10:57.233714+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.220702+0000","last_change":"2023-05-17T15:10:57.214051+0000","last_active":"2023-05-17T15:10:57.220702+0000","last_peered":"2023-05-17T15:10:57.220702+0000","last_clean":"2023-05-17T15:10:57.220702+0000","last_became_active":"2023-05-17T15:10:57.213766+0000","last_became_peered":"2023-05-17T15:10:57.213766+0000","last_unstale":"2023-05-17T15:10:57.220702+0000","last_undegraded":"2023-05-17T15:10:57.220702+0000","last_fullsized":"2023-05-17T15:10:57.220702+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213724+0000","last_change":"2023-05-17T15:10:56.828650+0000","last_active":"2023-05-17T15:10:57.213724+0000","last_peered":"2023-05-17T15:10:57.213724+0000","last_clean":"2023-05-17T15:10:57.213724+0000","last_became_active":"2023-05-17T15:10:56.827988+0000","last_became_peered":"2023-05-17T15:10:56.827988+0000","last_unstale":"2023-05-17T15:10:57.213724+0000","last_undegraded":"2023-05-17T15:10:57.213724+0000","last_fullsized":"2023-05-17T15:10:57.213724+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222227+0000","last_change":"2023-05-17T15:10:57.217989+0000","last_active":"2023-05-17T15:10:57.222227+0000","last_peered":"2023-05-17T15:10:57.222227+0000","last_clean":"2023-05-17T15:10:57.222227+0000","last_became_active":"2023-05-17T15:10:57.216742+0000","last_became_peered":"2023-05-17T15:10:57.216742+0000","last_unstale":"2023-05-17T15:10:57.222227+0000","last_undegraded":"2023-05-17T15:10:57.222227+0000","last_fullsized":"2023-05-17T15:10:57.222227+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206250+0000","last_change":"2023-05-17T15:10:56.827238+0000","last_active":"2023-05-17T15:10:57.206250+0000","last_peered":"2023-05-17T15:10:57.206250+0000","last_clean":"2023-05-17T15:10:57.206250+0000","last_became_active":"2023-05-17T15:10:56.826951+0000","last_became_peered":"2023-05-17T15:10:56.826951+0000","last_unstale":"2023-05-17T15:10:57.206250+0000","last_undegraded":"2023-05-17T15:10:57.206250+0000","last_fullsized":"2023-05-17T15:10:57.206250+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232863+0000","last_change":"2023-05-17T15:10:57.230081+0000","last_active":"2023-05-17T15:10:57.232863+0000","last_peered":"2023-05-17T15:10:57.232863+0000","last_clean":"2023-05-17T15:10:57.232863+0000","last_became_active":"2023-05-17T15:10:57.229804+0000","last_became_peered":"2023-05-17T15:10:57.229804+0000","last_unstale":"2023-05-17T15:10:57.232863+0000","last_undegraded":"2023-05-17T15:10:57.232863+0000","last_fullsized":"2023-05-17T15:10:57.232863+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235031+0000","last_change":"2023-05-17T15:10:56.841201+0000","last_active":"2023-05-17T15:10:57.235031+0000","last_peered":"2023-05-17T15:10:57.235031+0000","last_clean":"2023-05-17T15:10:57.235031+0000","last_became_active":"2023-05-17T15:10:56.840419+0000","last_became_peered":"2023-05-17T15:10:56.840419+0000","last_unstale":"2023-05-17T15:10:57.235031+0000","last_undegraded":"2023-05-17T15:10:57.235031+0000","last_fullsized":"2023-05-17T15:10:57.235031+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226982+0000","last_change":"2023-05-17T15:10:57.217830+0000","last_active":"2023-05-17T15:10:57.226982+0000","last_peered":"2023-05-17T15:10:57.226982+0000","last_clean":"2023-05-17T15:10:57.226982+0000","last_became_active":"2023-05-17T15:10:57.217566+0000","last_became_peered":"2023-05-17T15:10:57.217566+0000","last_unstale":"2023-05-17T15:10:57.226982+0000","last_undegraded":"2023-05-17T15:10:57.226982+0000","last_fullsized":"2023-05-17T15:10:57.226982+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.210208+0000","last_change":"2023-05-17T15:10:56.833922+0000","last_active":"2023-05-17T15:10:57.210208+0000","last_peered":"2023-05-17T15:10:57.210208+0000","last_clean":"2023-05-17T15:10:57.210208+0000","last_became_active":"2023-05-17T15:10:56.833590+0000","last_became_peered":"2023-05-17T15:10:56.833590+0000","last_unstale":"2023-05-17T15:10:57.210208+0000","last_undegraded":"2023-05-17T15:10:57.210208+0000","last_fullsized":"2023-05-17T15:10:57.210208+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222174+0000","last_change":"2023-05-17T15:10:57.218640+0000","last_active":"2023-05-17T15:10:57.222174+0000","last_peered":"2023-05-17T15:10:57.222174+0000","last_clean":"2023-05-17T15:10:57.222174+0000","last_became_active":"2023-05-17T15:10:57.218135+0000","last_became_peered":"2023-05-17T15:10:57.218135+0000","last_unstale":"2023-05-17T15:10:57.222174+0000","last_undegraded":"2023-05-17T15:10:57.222174+0000","last_fullsized":"2023-05-17T15:10:57.222174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228419+0000","last_change":"2023-05-17T15:10:56.836012+0000","last_active":"2023-05-17T15:10:57.228419+0000","last_peered":"2023-05-17T15:10:57.228419+0000","last_clean":"2023-05-17T15:10:57.228419+0000","last_became_active":"2023-05-17T15:10:56.835680+0000","last_became_peered":"2023-05-17T15:10:56.835680+0000","last_unstale":"2023-05-17T15:10:57.228419+0000","last_undegraded":"2023-05-17T15:10:57.228419+0000","last_fullsized":"2023-05-17T15:10:57.228419+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235198+0000","last_change":"2023-05-17T15:10:57.234027+0000","last_active":"2023-05-17T15:10:57.235198+0000","last_peered":"2023-05-17T15:10:57.235198+0000","last_clean":"2023-05-17T15:10:57.235198+0000","last_became_active":"2023-05-17T15:10:57.233432+0000","last_became_peered":"2023-05-17T15:10:57.233432+0000","last_unstale":"2023-05-17T15:10:57.235198+0000","last_undegraded":"2023-05-17T15:10:57.235198+0000","last_fullsized":"2023-05-17T15:10:57.235198+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211711+0000","last_change":"2023-05-17T15:10:56.832469+0000","last_active":"2023-05-17T15:10:57.211711+0000","last_peered":"2023-05-17T15:10:57.211711+0000","last_clean":"2023-05-17T15:10:57.211711+0000","last_became_active":"2023-05-17T15:10:56.831700+0000","last_became_peered":"2023-05-17T15:10:56.831700+0000","last_unstale":"2023-05-17T15:10:57.211711+0000","last_undegraded":"2023-05-17T15:10:57.211711+0000","last_fullsized":"2023-05-17T15:10:57.211711+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227987+0000","last_change":"2023-05-17T15:10:57.218887+0000","last_active":"2023-05-17T15:10:57.227987+0000","last_peered":"2023-05-17T15:10:57.227987+0000","last_clean":"2023-05-17T15:10:57.227987+0000","last_became_active":"2023-05-17T15:10:57.218605+0000","last_became_peered":"2023-05-17T15:10:57.218605+0000","last_unstale":"2023-05-17T15:10:57.227987+0000","last_undegraded":"2023-05-17T15:10:57.227987+0000","last_fullsized":"2023-05-17T15:10:57.227987+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211419+0000","last_change":"2023-05-17T15:10:56.827587+0000","last_active":"2023-05-17T15:10:57.211419+0000","last_peered":"2023-05-17T15:10:57.211419+0000","last_clean":"2023-05-17T15:10:57.211419+0000","last_became_active":"2023-05-17T15:10:56.827063+0000","last_became_peered":"2023-05-17T15:10:56.827063+0000","last_unstale":"2023-05-17T15:10:57.211419+0000","last_undegraded":"2023-05-17T15:10:57.211419+0000","last_fullsized":"2023-05-17T15:10:57.211419+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235189+0000","last_change":"2023-05-17T15:10:57.233608+0000","last_active":"2023-05-17T15:10:57.235189+0000","last_peered":"2023-05-17T15:10:57.235189+0000","last_clean":"2023-05-17T15:10:57.235189+0000","last_became_active":"2023-05-17T15:10:57.233064+0000","last_became_peered":"2023-05-17T15:10:57.233064+0000","last_unstale":"2023-05-17T15:10:57.235189+0000","last_undegraded":"2023-05-17T15:10:57.235189+0000","last_fullsized":"2023-05-17T15:10:57.235189+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207220+0000","last_change":"2023-05-17T15:10:56.836753+0000","last_active":"2023-05-17T15:10:57.207220+0000","last_peered":"2023-05-17T15:10:57.207220+0000","last_clean":"2023-05-17T15:10:57.207220+0000","last_became_active":"2023-05-17T15:10:56.836423+0000","last_became_peered":"2023-05-17T15:10:56.836423+0000","last_unstale":"2023-05-17T15:10:57.207220+0000","last_undegraded":"2023-05-17T15:10:57.207220+0000","last_fullsized":"2023-05-17T15:10:57.207220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227402+0000","last_change":"2023-05-17T15:10:57.224377+0000","last_active":"2023-05-17T15:10:57.227402+0000","last_peered":"2023-05-17T15:10:57.227402+0000","last_clean":"2023-05-17T15:10:57.227402+0000","last_became_active":"2023-05-17T15:10:57.222293+0000","last_became_peered":"2023-05-17T15:10:57.222293+0000","last_unstale":"2023-05-17T15:10:57.227402+0000","last_undegraded":"2023-05-17T15:10:57.227402+0000","last_fullsized":"2023-05-17T15:10:57.227402+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213848+0000","last_change":"2023-05-17T15:10:56.828661+0000","last_active":"2023-05-17T15:10:57.213848+0000","last_peered":"2023-05-17T15:10:57.213848+0000","last_clean":"2023-05-17T15:10:57.213848+0000","last_became_active":"2023-05-17T15:10:56.828339+0000","last_became_peered":"2023-05-17T15:10:56.828339+0000","last_unstale":"2023-05-17T15:10:57.213848+0000","last_undegraded":"2023-05-17T15:10:57.213848+0000","last_fullsized":"2023-05-17T15:10:57.213848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222251+0000","last_change":"2023-05-17T15:10:57.218444+0000","last_active":"2023-05-17T15:10:57.222251+0000","last_peered":"2023-05-17T15:10:57.222251+0000","last_clean":"2023-05-17T15:10:57.222251+0000","last_became_active":"2023-05-17T15:10:57.217137+0000","last_became_peered":"2023-05-17T15:10:57.217137+0000","last_unstale":"2023-05-17T15:10:57.222251+0000","last_undegraded":"2023-05-17T15:10:57.222251+0000","last_fullsized":"2023-05-17T15:10:57.222251+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206554+0000","last_change":"2023-05-17T15:10:56.834973+0000","last_active":"2023-05-17T15:10:57.206554+0000","last_peered":"2023-05-17T15:10:57.206554+0000","last_clean":"2023-05-17T15:10:57.206554+0000","last_became_active":"2023-05-17T15:10:56.834275+0000","last_became_peered":"2023-05-17T15:10:56.834275+0000","last_unstale":"2023-05-17T15:10:57.206554+0000","last_undegraded":"2023-05-17T15:10:57.206554+0000","last_fullsized":"2023-05-17T15:10:57.206554+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221708+0000","last_change":"2023-05-17T15:10:57.218670+0000","last_active":"2023-05-17T15:10:57.221708+0000","last_peered":"2023-05-17T15:10:57.221708+0000","last_clean":"2023-05-17T15:10:57.221708+0000","last_became_active":"2023-05-17T15:10:57.218215+0000","last_became_peered":"2023-05-17T15:10:57.218215+0000","last_unstale":"2023-05-17T15:10:57.221708+0000","last_undegraded":"2023-05-17T15:10:57.221708+0000","last_fullsized":"2023-05-17T15:10:57.221708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207574+0000","last_change":"2023-05-17T15:10:56.837598+0000","last_active":"2023-05-17T15:10:57.207574+0000","last_peered":"2023-05-17T15:10:57.207574+0000","last_clean":"2023-05-17T15:10:57.207574+0000","last_became_active":"2023-05-17T15:10:56.837314+0000","last_became_peered":"2023-05-17T15:10:56.837314+0000","last_unstale":"2023-05-17T15:10:57.207574+0000","last_undegraded":"2023-05-17T15:10:57.207574+0000","last_fullsized":"2023-05-17T15:10:57.207574+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226578+0000","last_change":"2023-05-17T15:10:57.221141+0000","last_active":"2023-05-17T15:10:57.226578+0000","last_peered":"2023-05-17T15:10:57.226578+0000","last_clean":"2023-05-17T15:10:57.226578+0000","last_became_active":"2023-05-17T15:10:57.220625+0000","last_became_peered":"2023-05-17T15:10:57.220625+0000","last_unstale":"2023-05-17T15:10:57.226578+0000","last_undegraded":"2023-05-17T15:10:57.226578+0000","last_fullsized":"2023-05-17T15:10:57.226578+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207305+0000","last_change":"2023-05-17T15:10:56.832662+0000","last_active":"2023-05-17T15:10:57.207305+0000","last_peered":"2023-05-17T15:10:57.207305+0000","last_clean":"2023-05-17T15:10:57.207305+0000","last_became_active":"2023-05-17T15:10:56.832345+0000","last_became_peered":"2023-05-17T15:10:56.832345+0000","last_unstale":"2023-05-17T15:10:57.207305+0000","last_undegraded":"2023-05-17T15:10:57.207305+0000","last_fullsized":"2023-05-17T15:10:57.207305+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222150+0000","last_change":"2023-05-17T15:10:57.218441+0000","last_active":"2023-05-17T15:10:57.222150+0000","last_peered":"2023-05-17T15:10:57.222150+0000","last_clean":"2023-05-17T15:10:57.222150+0000","last_became_active":"2023-05-17T15:10:57.217501+0000","last_became_peered":"2023-05-17T15:10:57.217501+0000","last_unstale":"2023-05-17T15:10:57.222150+0000","last_undegraded":"2023-05-17T15:10:57.222150+0000","last_fullsized":"2023-05-17T15:10:57.222150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209095+0000","last_change":"2023-05-17T15:10:56.833660+0000","last_active":"2023-05-17T15:10:57.209095+0000","last_peered":"2023-05-17T15:10:57.209095+0000","last_clean":"2023-05-17T15:10:57.209095+0000","last_became_active":"2023-05-17T15:10:56.833359+0000","last_became_peered":"2023-05-17T15:10:56.833359+0000","last_unstale":"2023-05-17T15:10:57.209095+0000","last_undegraded":"2023-05-17T15:10:57.209095+0000","last_fullsized":"2023-05-17T15:10:57.209095+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221311+0000","last_change":"2023-05-17T15:10:57.214503+0000","last_active":"2023-05-17T15:10:57.221311+0000","last_peered":"2023-05-17T15:10:57.221311+0000","last_clean":"2023-05-17T15:10:57.221311+0000","last_became_active":"2023-05-17T15:10:57.213407+0000","last_became_peered":"2023-05-17T15:10:57.213407+0000","last_unstale":"2023-05-17T15:10:57.221311+0000","last_undegraded":"2023-05-17T15:10:57.221311+0000","last_fullsized":"2023-05-17T15:10:57.221311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205144+0000","last_change":"2023-05-17T15:10:56.827934+0000","last_active":"2023-05-17T15:10:57.205144+0000","last_peered":"2023-05-17T15:10:57.205144+0000","last_clean":"2023-05-17T15:10:57.205144+0000","last_became_active":"2023-05-17T15:10:56.827522+0000","last_became_peered":"2023-05-17T15:10:56.827522+0000","last_unstale":"2023-05-17T15:10:57.205144+0000","last_undegraded":"2023-05-17T15:10:57.205144+0000","last_fullsized":"2023-05-17T15:10:57.205144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227205+0000","last_change":"2023-05-17T15:10:57.220828+0000","last_active":"2023-05-17T15:10:57.227205+0000","last_peered":"2023-05-17T15:10:57.227205+0000","last_clean":"2023-05-17T15:10:57.227205+0000","last_became_active":"2023-05-17T15:10:57.218264+0000","last_became_peered":"2023-05-17T15:10:57.218264+0000","last_unstale":"2023-05-17T15:10:57.227205+0000","last_undegraded":"2023-05-17T15:10:57.227205+0000","last_fullsized":"2023-05-17T15:10:57.227205+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208403+0000","last_change":"2023-05-17T15:10:56.834089+0000","last_active":"2023-05-17T15:10:57.208403+0000","last_peered":"2023-05-17T15:10:57.208403+0000","last_clean":"2023-05-17T15:10:57.208403+0000","last_became_active":"2023-05-17T15:10:56.833714+0000","last_became_peered":"2023-05-17T15:10:56.833714+0000","last_unstale":"2023-05-17T15:10:57.208403+0000","last_undegraded":"2023-05-17T15:10:57.208403+0000","last_fullsized":"2023-05-17T15:10:57.208403+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226279+0000","last_change":"2023-05-17T15:10:57.225169+0000","last_active":"2023-05-17T15:10:57.226279+0000","last_peered":"2023-05-17T15:10:57.226279+0000","last_clean":"2023-05-17T15:10:57.226279+0000","last_became_active":"2023-05-17T15:10:57.224862+0000","last_became_peered":"2023-05-17T15:10:57.224862+0000","last_unstale":"2023-05-17T15:10:57.226279+0000","last_undegraded":"2023-05-17T15:10:57.226279+0000","last_fullsized":"2023-05-17T15:10:57.226279+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206277+0000","last_change":"2023-05-17T15:10:56.834228+0000","last_active":"2023-05-17T15:10:57.206277+0000","last_peered":"2023-05-17T15:10:57.206277+0000","last_clean":"2023-05-17T15:10:57.206277+0000","last_became_active":"2023-05-17T15:10:56.833932+0000","last_became_peered":"2023-05-17T15:10:56.833932+0000","last_unstale":"2023-05-17T15:10:57.206277+0000","last_undegraded":"2023-05-17T15:10:57.206277+0000","last_fullsized":"2023-05-17T15:10:57.206277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226690+0000","last_change":"2023-05-17T15:10:57.215803+0000","last_active":"2023-05-17T15:10:57.226690+0000","last_peered":"2023-05-17T15:10:57.226690+0000","last_clean":"2023-05-17T15:10:57.226690+0000","last_became_active":"2023-05-17T15:10:57.215505+0000","last_became_peered":"2023-05-17T15:10:57.215505+0000","last_unstale":"2023-05-17T15:10:57.226690+0000","last_undegraded":"2023-05-17T15:10:57.226690+0000","last_fullsized":"2023-05-17T15:10:57.226690+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233959+0000","last_change":"2023-05-17T15:10:56.833320+0000","last_active":"2023-05-17T15:10:57.233959+0000","last_peered":"2023-05-17T15:10:57.233959+0000","last_clean":"2023-05-17T15:10:57.233959+0000","last_became_active":"2023-05-17T15:10:56.833002+0000","last_became_peered":"2023-05-17T15:10:56.833002+0000","last_unstale":"2023-05-17T15:10:57.233959+0000","last_undegraded":"2023-05-17T15:10:57.233959+0000","last_fullsized":"2023-05-17T15:10:57.233959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227311+0000","last_change":"2023-05-17T15:10:57.224838+0000","last_active":"2023-05-17T15:10:57.227311+0000","last_peered":"2023-05-17T15:10:57.227311+0000","last_clean":"2023-05-17T15:10:57.227311+0000","last_became_active":"2023-05-17T15:10:57.224462+0000","last_became_peered":"2023-05-17T15:10:57.224462+0000","last_unstale":"2023-05-17T15:10:57.227311+0000","last_undegraded":"2023-05-17T15:10:57.227311+0000","last_fullsized":"2023-05-17T15:10:57.227311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224162+0000","last_change":"2023-05-17T15:10:56.832264+0000","last_active":"2023-05-17T15:10:57.224162+0000","last_peered":"2023-05-17T15:10:57.224162+0000","last_clean":"2023-05-17T15:10:57.224162+0000","last_became_active":"2023-05-17T15:10:56.831929+0000","last_became_peered":"2023-05-17T15:10:56.831929+0000","last_unstale":"2023-05-17T15:10:57.224162+0000","last_undegraded":"2023-05-17T15:10:57.224162+0000","last_fullsized":"2023-05-17T15:10:57.224162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221196+0000","last_change":"2023-05-17T15:10:57.217611+0000","last_active":"2023-05-17T15:10:57.221196+0000","last_peered":"2023-05-17T15:10:57.221196+0000","last_clean":"2023-05-17T15:10:57.221196+0000","last_became_active":"2023-05-17T15:10:57.214351+0000","last_became_peered":"2023-05-17T15:10:57.214351+0000","last_unstale":"2023-05-17T15:10:57.221196+0000","last_undegraded":"2023-05-17T15:10:57.221196+0000","last_fullsized":"2023-05-17T15:10:57.221196+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233540+0000","last_change":"2023-05-17T15:10:56.841000+0000","last_active":"2023-05-17T15:10:57.233540+0000","last_peered":"2023-05-17T15:10:57.233540+0000","last_clean":"2023-05-17T15:10:57.233540+0000","last_became_active":"2023-05-17T15:10:56.840483+0000","last_became_peered":"2023-05-17T15:10:56.840483+0000","last_unstale":"2023-05-17T15:10:57.233540+0000","last_undegraded":"2023-05-17T15:10:57.233540+0000","last_fullsized":"2023-05-17T15:10:57.233540+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234924+0000","last_change":"2023-05-17T15:10:57.232156+0000","last_active":"2023-05-17T15:10:57.234924+0000","last_peered":"2023-05-17T15:10:57.234924+0000","last_clean":"2023-05-17T15:10:57.234924+0000","last_became_active":"2023-05-17T15:10:57.231174+0000","last_became_peered":"2023-05-17T15:10:57.231174+0000","last_unstale":"2023-05-17T15:10:57.234924+0000","last_undegraded":"2023-05-17T15:10:57.234924+0000","last_fullsized":"2023-05-17T15:10:57.234924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207640+0000","last_change":"2023-05-17T15:10:56.834777+0000","last_active":"2023-05-17T15:10:57.207640+0000","last_peered":"2023-05-17T15:10:57.207640+0000","last_clean":"2023-05-17T15:10:57.207640+0000","last_became_active":"2023-05-17T15:10:56.834423+0000","last_became_peered":"2023-05-17T15:10:56.834423+0000","last_unstale":"2023-05-17T15:10:57.207640+0000","last_undegraded":"2023-05-17T15:10:57.207640+0000","last_fullsized":"2023-05-17T15:10:57.207640+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226969+0000","last_change":"2023-05-17T15:10:57.218550+0000","last_active":"2023-05-17T15:10:57.226969+0000","last_peered":"2023-05-17T15:10:57.226969+0000","last_clean":"2023-05-17T15:10:57.226969+0000","last_became_active":"2023-05-17T15:10:57.218266+0000","last_became_peered":"2023-05-17T15:10:57.218266+0000","last_unstale":"2023-05-17T15:10:57.226969+0000","last_undegraded":"2023-05-17T15:10:57.226969+0000","last_fullsized":"2023-05-17T15:10:57.226969+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209220+0000","last_change":"2023-05-17T15:10:56.830287+0000","last_active":"2023-05-17T15:10:57.209220+0000","last_peered":"2023-05-17T15:10:57.209220+0000","last_clean":"2023-05-17T15:10:57.209220+0000","last_became_active":"2023-05-17T15:10:56.830005+0000","last_became_peered":"2023-05-17T15:10:56.830005+0000","last_unstale":"2023-05-17T15:10:57.209220+0000","last_undegraded":"2023-05-17T15:10:57.209220+0000","last_fullsized":"2023-05-17T15:10:57.209220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228057+0000","last_change":"2023-05-17T15:10:57.219768+0000","last_active":"2023-05-17T15:10:57.228057+0000","last_peered":"2023-05-17T15:10:57.228057+0000","last_clean":"2023-05-17T15:10:57.228057+0000","last_became_active":"2023-05-17T15:10:57.216072+0000","last_became_peered":"2023-05-17T15:10:57.216072+0000","last_unstale":"2023-05-17T15:10:57.228057+0000","last_undegraded":"2023-05-17T15:10:57.228057+0000","last_fullsized":"2023-05-17T15:10:57.228057+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207908+0000","last_change":"2023-05-17T15:10:56.828442+0000","last_active":"2023-05-17T15:10:57.207908+0000","last_peered":"2023-05-17T15:10:57.207908+0000","last_clean":"2023-05-17T15:10:57.207908+0000","last_became_active":"2023-05-17T15:10:56.828161+0000","last_became_peered":"2023-05-17T15:10:56.828161+0000","last_unstale":"2023-05-17T15:10:57.207908+0000","last_undegraded":"2023-05-17T15:10:57.207908+0000","last_fullsized":"2023-05-17T15:10:57.207908+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227194+0000","last_change":"2023-05-17T15:10:57.220647+0000","last_active":"2023-05-17T15:10:57.227194+0000","last_peered":"2023-05-17T15:10:57.227194+0000","last_clean":"2023-05-17T15:10:57.227194+0000","last_became_active":"2023-05-17T15:10:57.217855+0000","last_became_peered":"2023-05-17T15:10:57.217855+0000","last_unstale":"2023-05-17T15:10:57.227194+0000","last_undegraded":"2023-05-17T15:10:57.227194+0000","last_fullsized":"2023-05-17T15:10:57.227194+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206066+0000","last_change":"2023-05-17T15:10:56.832160+0000","last_active":"2023-05-17T15:10:57.206066+0000","last_peered":"2023-05-17T15:10:57.206066+0000","last_clean":"2023-05-17T15:10:57.206066+0000","last_became_active":"2023-05-17T15:10:56.831892+0000","last_became_peered":"2023-05-17T15:10:56.831892+0000","last_unstale":"2023-05-17T15:10:57.206066+0000","last_undegraded":"2023-05-17T15:10:57.206066+0000","last_fullsized":"2023-05-17T15:10:57.206066+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228186+0000","last_change":"2023-05-17T15:10:57.225426+0000","last_active":"2023-05-17T15:10:57.228186+0000","last_peered":"2023-05-17T15:10:57.228186+0000","last_clean":"2023-05-17T15:10:57.228186+0000","last_became_active":"2023-05-17T15:10:57.225106+0000","last_became_peered":"2023-05-17T15:10:57.225106+0000","last_unstale":"2023-05-17T15:10:57.228186+0000","last_undegraded":"2023-05-17T15:10:57.228186+0000","last_fullsized":"2023-05-17T15:10:57.228186+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206603+0000","last_change":"2023-05-17T15:10:56.831442+0000","last_active":"2023-05-17T15:10:57.206603+0000","last_peered":"2023-05-17T15:10:57.206603+0000","last_clean":"2023-05-17T15:10:57.206603+0000","last_became_active":"2023-05-17T15:10:56.831147+0000","last_became_peered":"2023-05-17T15:10:56.831147+0000","last_unstale":"2023-05-17T15:10:57.206603+0000","last_undegraded":"2023-05-17T15:10:57.206603+0000","last_fullsized":"2023-05-17T15:10:57.206603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219023+0000","last_change":"2023-05-17T15:10:57.214798+0000","last_active":"2023-05-17T15:10:57.219023+0000","last_peered":"2023-05-17T15:10:57.219023+0000","last_clean":"2023-05-17T15:10:57.219023+0000","last_became_active":"2023-05-17T15:10:57.214473+0000","last_became_peered":"2023-05-17T15:10:57.214473+0000","last_unstale":"2023-05-17T15:10:57.219023+0000","last_undegraded":"2023-05-17T15:10:57.219023+0000","last_fullsized":"2023-05-17T15:10:57.219023+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225651+0000","last_change":"2023-05-17T15:10:56.842757+0000","last_active":"2023-05-17T15:10:57.225651+0000","last_peered":"2023-05-17T15:10:57.225651+0000","last_clean":"2023-05-17T15:10:57.225651+0000","last_became_active":"2023-05-17T15:10:56.842401+0000","last_became_peered":"2023-05-17T15:10:56.842401+0000","last_unstale":"2023-05-17T15:10:57.225651+0000","last_undegraded":"2023-05-17T15:10:57.225651+0000","last_fullsized":"2023-05-17T15:10:57.225651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227868+0000","last_change":"2023-05-17T15:10:57.217015+0000","last_active":"2023-05-17T15:10:57.227868+0000","last_peered":"2023-05-17T15:10:57.227868+0000","last_clean":"2023-05-17T15:10:57.227868+0000","last_became_active":"2023-05-17T15:10:57.216478+0000","last_became_peered":"2023-05-17T15:10:57.216478+0000","last_unstale":"2023-05-17T15:10:57.227868+0000","last_undegraded":"2023-05-17T15:10:57.227868+0000","last_fullsized":"2023-05-17T15:10:57.227868+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225688+0000","last_change":"2023-05-17T15:10:56.833412+0000","last_active":"2023-05-17T15:10:57.225688+0000","last_peered":"2023-05-17T15:10:57.225688+0000","last_clean":"2023-05-17T15:10:57.225688+0000","last_became_active":"2023-05-17T15:10:56.833007+0000","last_became_peered":"2023-05-17T15:10:56.833007+0000","last_unstale":"2023-05-17T15:10:57.225688+0000","last_undegraded":"2023-05-17T15:10:57.225688+0000","last_fullsized":"2023-05-17T15:10:57.225688+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226377+0000","last_change":"2023-05-17T15:10:57.223581+0000","last_active":"2023-05-17T15:10:57.226377+0000","last_peered":"2023-05-17T15:10:57.226377+0000","last_clean":"2023-05-17T15:10:57.226377+0000","last_became_active":"2023-05-17T15:10:57.222657+0000","last_became_peered":"2023-05-17T15:10:57.222657+0000","last_unstale":"2023-05-17T15:10:57.226377+0000","last_undegraded":"2023-05-17T15:10:57.226377+0000","last_fullsized":"2023-05-17T15:10:57.226377+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224391+0000","last_change":"2023-05-17T15:10:56.838318+0000","last_active":"2023-05-17T15:10:57.224391+0000","last_peered":"2023-05-17T15:10:57.224391+0000","last_clean":"2023-05-17T15:10:57.224391+0000","last_became_active":"2023-05-17T15:10:56.838048+0000","last_became_peered":"2023-05-17T15:10:56.838048+0000","last_unstale":"2023-05-17T15:10:57.224391+0000","last_undegraded":"2023-05-17T15:10:57.224391+0000","last_fullsized":"2023-05-17T15:10:57.224391+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226557+0000","last_change":"2023-05-17T15:10:57.220917+0000","last_active":"2023-05-17T15:10:57.226557+0000","last_peered":"2023-05-17T15:10:57.226557+0000","last_clean":"2023-05-17T15:10:57.226557+0000","last_became_active":"2023-05-17T15:10:57.220106+0000","last_became_peered":"2023-05-17T15:10:57.220106+0000","last_unstale":"2023-05-17T15:10:57.226557+0000","last_undegraded":"2023-05-17T15:10:57.226557+0000","last_fullsized":"2023-05-17T15:10:57.226557+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.220671+0000","last_change":"2023-05-17T15:10:56.843745+0000","last_active":"2023-05-17T15:10:57.220671+0000","last_peered":"2023-05-17T15:10:57.220671+0000","last_clean":"2023-05-17T15:10:57.220671+0000","last_became_active":"2023-05-17T15:10:56.843479+0000","last_became_peered":"2023-05-17T15:10:56.843479+0000","last_unstale":"2023-05-17T15:10:57.220671+0000","last_undegraded":"2023-05-17T15:10:57.220671+0000","last_fullsized":"2023-05-17T15:10:57.220671+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225848+0000","last_change":"2023-05-17T15:10:57.223358+0000","last_active":"2023-05-17T15:10:57.225848+0000","last_peered":"2023-05-17T15:10:57.225848+0000","last_clean":"2023-05-17T15:10:57.225848+0000","last_became_active":"2023-05-17T15:10:57.222532+0000","last_became_peered":"2023-05-17T15:10:57.222532+0000","last_unstale":"2023-05-17T15:10:57.225848+0000","last_undegraded":"2023-05-17T15:10:57.225848+0000","last_fullsized":"2023-05-17T15:10:57.225848+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232145+0000","last_change":"2023-05-17T15:10:56.837020+0000","last_active":"2023-05-17T15:10:57.232145+0000","last_peered":"2023-05-17T15:10:57.232145+0000","last_clean":"2023-05-17T15:10:57.232145+0000","last_became_active":"2023-05-17T15:10:56.836737+0000","last_became_peered":"2023-05-17T15:10:56.836737+0000","last_unstale":"2023-05-17T15:10:57.232145+0000","last_undegraded":"2023-05-17T15:10:57.232145+0000","last_fullsized":"2023-05-17T15:10:57.232145+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227704+0000","last_change":"2023-05-17T15:10:57.223963+0000","last_active":"2023-05-17T15:10:57.227704+0000","last_peered":"2023-05-17T15:10:57.227704+0000","last_clean":"2023-05-17T15:10:57.227704+0000","last_became_active":"2023-05-17T15:10:57.223709+0000","last_became_peered":"2023-05-17T15:10:57.223709+0000","last_unstale":"2023-05-17T15:10:57.227704+0000","last_undegraded":"2023-05-17T15:10:57.227704+0000","last_fullsized":"2023-05-17T15:10:57.227704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219998+0000","last_change":"2023-05-17T15:10:56.841574+0000","last_active":"2023-05-17T15:10:57.219998+0000","last_peered":"2023-05-17T15:10:57.219998+0000","last_clean":"2023-05-17T15:10:57.219998+0000","last_became_active":"2023-05-17T15:10:56.841288+0000","last_became_peered":"2023-05-17T15:10:56.841288+0000","last_unstale":"2023-05-17T15:10:57.219998+0000","last_undegraded":"2023-05-17T15:10:57.219998+0000","last_fullsized":"2023-05-17T15:10:57.219998+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227654+0000","last_change":"2023-05-17T15:10:57.223557+0000","last_active":"2023-05-17T15:10:57.227654+0000","last_peered":"2023-05-17T15:10:57.227654+0000","last_clean":"2023-05-17T15:10:57.227654+0000","last_became_active":"2023-05-17T15:10:57.222696+0000","last_became_peered":"2023-05-17T15:10:57.222696+0000","last_unstale":"2023-05-17T15:10:57.227654+0000","last_undegraded":"2023-05-17T15:10:57.227654+0000","last_fullsized":"2023-05-17T15:10:57.227654+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213096+0000","last_change":"2023-05-17T15:10:56.833261+0000","last_active":"2023-05-17T15:10:57.213096+0000","last_peered":"2023-05-17T15:10:57.213096+0000","last_clean":"2023-05-17T15:10:57.213096+0000","last_became_active":"2023-05-17T15:10:56.832990+0000","last_became_peered":"2023-05-17T15:10:56.832990+0000","last_unstale":"2023-05-17T15:10:57.213096+0000","last_undegraded":"2023-05-17T15:10:57.213096+0000","last_fullsized":"2023-05-17T15:10:57.213096+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221637+0000","last_change":"2023-05-17T15:10:57.218219+0000","last_active":"2023-05-17T15:10:57.221637+0000","last_peered":"2023-05-17T15:10:57.221637+0000","last_clean":"2023-05-17T15:10:57.221637+0000","last_became_active":"2023-05-17T15:10:57.217924+0000","last_became_peered":"2023-05-17T15:10:57.217924+0000","last_unstale":"2023-05-17T15:10:57.221637+0000","last_undegraded":"2023-05-17T15:10:57.221637+0000","last_fullsized":"2023-05-17T15:10:57.221637+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215240+0000","last_change":"2023-05-17T15:10:56.841047+0000","last_active":"2023-05-17T15:10:57.215240+0000","last_peered":"2023-05-17T15:10:57.215240+0000","last_clean":"2023-05-17T15:10:57.215240+0000","last_became_active":"2023-05-17T15:10:56.840736+0000","last_became_peered":"2023-05-17T15:10:56.840736+0000","last_unstale":"2023-05-17T15:10:57.215240+0000","last_undegraded":"2023-05-17T15:10:57.215240+0000","last_fullsized":"2023-05-17T15:10:57.215240+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227390+0000","last_change":"2023-05-17T15:10:57.222569+0000","last_active":"2023-05-17T15:10:57.227390+0000","last_peered":"2023-05-17T15:10:57.227390+0000","last_clean":"2023-05-17T15:10:57.227390+0000","last_became_active":"2023-05-17T15:10:57.221644+0000","last_became_peered":"2023-05-17T15:10:57.221644+0000","last_unstale":"2023-05-17T15:10:57.227390+0000","last_undegraded":"2023-05-17T15:10:57.227390+0000","last_fullsized":"2023-05-17T15:10:57.227390+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228678+0000","last_change":"2023-05-17T15:10:56.835798+0000","last_active":"2023-05-17T15:10:57.228678+0000","last_peered":"2023-05-17T15:10:57.228678+0000","last_clean":"2023-05-17T15:10:57.228678+0000","last_became_active":"2023-05-17T15:10:56.835527+0000","last_became_peered":"2023-05-17T15:10:56.835527+0000","last_unstale":"2023-05-17T15:10:57.228678+0000","last_undegraded":"2023-05-17T15:10:57.228678+0000","last_fullsized":"2023-05-17T15:10:57.228678+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228008+0000","last_change":"2023-05-17T15:10:57.223357+0000","last_active":"2023-05-17T15:10:57.228008+0000","last_peered":"2023-05-17T15:10:57.228008+0000","last_clean":"2023-05-17T15:10:57.228008+0000","last_became_active":"2023-05-17T15:10:57.223105+0000","last_became_peered":"2023-05-17T15:10:57.223105+0000","last_unstale":"2023-05-17T15:10:57.228008+0000","last_undegraded":"2023-05-17T15:10:57.228008+0000","last_fullsized":"2023-05-17T15:10:57.228008+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206373+0000","last_change":"2023-05-17T15:10:56.831199+0000","last_active":"2023-05-17T15:10:57.206373+0000","last_peered":"2023-05-17T15:10:57.206373+0000","last_clean":"2023-05-17T15:10:57.206373+0000","last_became_active":"2023-05-17T15:10:56.830892+0000","last_became_peered":"2023-05-17T15:10:56.830892+0000","last_unstale":"2023-05-17T15:10:57.206373+0000","last_undegraded":"2023-05-17T15:10:57.206373+0000","last_fullsized":"2023-05-17T15:10:57.206373+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235139+0000","last_change":"2023-05-17T15:10:57.232955+0000","last_active":"2023-05-17T15:10:57.235139+0000","last_peered":"2023-05-17T15:10:57.235139+0000","last_clean":"2023-05-17T15:10:57.235139+0000","last_became_active":"2023-05-17T15:10:57.231087+0000","last_became_peered":"2023-05-17T15:10:57.231087+0000","last_unstale":"2023-05-17T15:10:57.235139+0000","last_undegraded":"2023-05-17T15:10:57.235139+0000","last_fullsized":"2023-05-17T15:10:57.235139+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209149+0000","last_change":"2023-05-17T15:10:56.836571+0000","last_active":"2023-05-17T15:10:57.209149+0000","last_peered":"2023-05-17T15:10:57.209149+0000","last_clean":"2023-05-17T15:10:57.209149+0000","last_became_active":"2023-05-17T15:10:56.836309+0000","last_became_peered":"2023-05-17T15:10:56.836309+0000","last_unstale":"2023-05-17T15:10:57.209149+0000","last_undegraded":"2023-05-17T15:10:57.209149+0000","last_fullsized":"2023-05-17T15:10:57.209149+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.223591+0000","last_change":"2023-05-17T15:10:57.221988+0000","last_active":"2023-05-17T15:10:57.223591+0000","last_peered":"2023-05-17T15:10:57.223591+0000","last_clean":"2023-05-17T15:10:57.223591+0000","last_became_active":"2023-05-17T15:10:57.221736+0000","last_became_peered":"2023-05-17T15:10:57.221736+0000","last_unstale":"2023-05-17T15:10:57.223591+0000","last_undegraded":"2023-05-17T15:10:57.223591+0000","last_fullsized":"2023-05-17T15:10:57.223591+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.210187+0000","last_change":"2023-05-17T15:10:56.836097+0000","last_active":"2023-05-17T15:10:57.210187+0000","last_peered":"2023-05-17T15:10:57.210187+0000","last_clean":"2023-05-17T15:10:57.210187+0000","last_became_active":"2023-05-17T15:10:56.831534+0000","last_became_peered":"2023-05-17T15:10:56.831534+0000","last_unstale":"2023-05-17T15:10:57.210187+0000","last_undegraded":"2023-05-17T15:10:57.210187+0000","last_fullsized":"2023-05-17T15:10:57.210187+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224520+0000","last_change":"2023-05-17T15:10:57.214177+0000","last_active":"2023-05-17T15:10:57.224520+0000","last_peered":"2023-05-17T15:10:57.224520+0000","last_clean":"2023-05-17T15:10:57.224520+0000","last_became_active":"2023-05-17T15:10:57.213092+0000","last_became_peered":"2023-05-17T15:10:57.213092+0000","last_unstale":"2023-05-17T15:10:57.224520+0000","last_undegraded":"2023-05-17T15:10:57.224520+0000","last_fullsized":"2023-05-17T15:10:57.224520+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209330+0000","last_change":"2023-05-17T15:10:56.826915+0000","last_active":"2023-05-17T15:10:57.209330+0000","last_peered":"2023-05-17T15:10:57.209330+0000","last_clean":"2023-05-17T15:10:57.209330+0000","last_became_active":"2023-05-17T15:10:56.826574+0000","last_became_peered":"2023-05-17T15:10:56.826574+0000","last_unstale":"2023-05-17T15:10:57.209330+0000","last_undegraded":"2023-05-17T15:10:57.209330+0000","last_fullsized":"2023-05-17T15:10:57.209330+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227369+0000","last_change":"2023-05-17T15:10:57.216838+0000","last_active":"2023-05-17T15:10:57.227369+0000","last_peered":"2023-05-17T15:10:57.227369+0000","last_clean":"2023-05-17T15:10:57.227369+0000","last_became_active":"2023-05-17T15:10:57.216564+0000","last_became_peered":"2023-05-17T15:10:57.216564+0000","last_unstale":"2023-05-17T15:10:57.227369+0000","last_undegraded":"2023-05-17T15:10:57.227369+0000","last_fullsized":"2023-05-17T15:10:57.227369+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207920+0000","last_change":"2023-05-17T15:10:56.831622+0000","last_active":"2023-05-17T15:10:57.207920+0000","last_peered":"2023-05-17T15:10:57.207920+0000","last_clean":"2023-05-17T15:10:57.207920+0000","last_became_active":"2023-05-17T15:10:56.831335+0000","last_became_peered":"2023-05-17T15:10:56.831335+0000","last_unstale":"2023-05-17T15:10:57.207920+0000","last_undegraded":"2023-05-17T15:10:57.207920+0000","last_fullsized":"2023-05-17T15:10:57.207920+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234932+0000","last_change":"2023-05-17T15:10:57.232576+0000","last_active":"2023-05-17T15:10:57.234932+0000","last_peered":"2023-05-17T15:10:57.234932+0000","last_clean":"2023-05-17T15:10:57.234932+0000","last_became_active":"2023-05-17T15:10:57.232423+0000","last_became_peered":"2023-05-17T15:10:57.232423+0000","last_unstale":"2023-05-17T15:10:57.234932+0000","last_undegraded":"2023-05-17T15:10:57.234932+0000","last_fullsized":"2023-05-17T15:10:57.234932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208499+0000","last_change":"2023-05-17T15:10:56.830655+0000","last_active":"2023-05-17T15:10:57.208499+0000","last_peered":"2023-05-17T15:10:57.208499+0000","last_clean":"2023-05-17T15:10:57.208499+0000","last_became_active":"2023-05-17T15:10:56.830224+0000","last_became_peered":"2023-05-17T15:10:56.830224+0000","last_unstale":"2023-05-17T15:10:57.208499+0000","last_undegraded":"2023-05-17T15:10:57.208499+0000","last_fullsized":"2023-05-17T15:10:57.208499+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226940+0000","last_change":"2023-05-17T15:10:57.220044+0000","last_active":"2023-05-17T15:10:57.226940+0000","last_peered":"2023-05-17T15:10:57.226940+0000","last_clean":"2023-05-17T15:10:57.226940+0000","last_became_active":"2023-05-17T15:10:57.219740+0000","last_became_peered":"2023-05-17T15:10:57.219740+0000","last_unstale":"2023-05-17T15:10:57.226940+0000","last_undegraded":"2023-05-17T15:10:57.226940+0000","last_fullsized":"2023-05-17T15:10:57.226940+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215345+0000","last_change":"2023-05-17T15:10:56.841280+0000","last_active":"2023-05-17T15:10:57.215345+0000","last_peered":"2023-05-17T15:10:57.215345+0000","last_clean":"2023-05-17T15:10:57.215345+0000","last_became_active":"2023-05-17T15:10:56.840969+0000","last_became_peered":"2023-05-17T15:10:56.840969+0000","last_unstale":"2023-05-17T15:10:57.215345+0000","last_undegraded":"2023-05-17T15:10:57.215345+0000","last_fullsized":"2023-05-17T15:10:57.215345+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222110+0000","last_change":"2023-05-17T15:10:57.217248+0000","last_active":"2023-05-17T15:10:57.222110+0000","last_peered":"2023-05-17T15:10:57.222110+0000","last_clean":"2023-05-17T15:10:57.222110+0000","last_became_active":"2023-05-17T15:10:57.216934+0000","last_became_peered":"2023-05-17T15:10:57.216934+0000","last_unstale":"2023-05-17T15:10:57.222110+0000","last_undegraded":"2023-05-17T15:10:57.222110+0000","last_fullsized":"2023-05-17T15:10:57.222110+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206923+0000","last_change":"2023-05-17T15:10:56.837090+0000","last_active":"2023-05-17T15:10:57.206923+0000","last_peered":"2023-05-17T15:10:57.206923+0000","last_clean":"2023-05-17T15:10:57.206923+0000","last_became_active":"2023-05-17T15:10:56.836488+0000","last_became_peered":"2023-05-17T15:10:56.836488+0000","last_unstale":"2023-05-17T15:10:57.206923+0000","last_undegraded":"2023-05-17T15:10:57.206923+0000","last_fullsized":"2023-05-17T15:10:57.206923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207724+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:57.207724+0000","last_peered":"2023-05-17T15:10:57.207724+0000","last_clean":"2023-05-17T15:10:57.207724+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:57.207724+0000","last_undegraded":"2023-05-17T15:10:57.207724+0000","last_fullsized":"2023-05-17T15:10:57.207724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222708+0000","last_change":"2023-05-17T15:10:57.220378+0000","last_active":"2023-05-17T15:10:57.222708+0000","last_peered":"2023-05-17T15:10:57.222708+0000","last_clean":"2023-05-17T15:10:57.222708+0000","last_became_active":"2023-05-17T15:10:57.220120+0000","last_became_peered":"2023-05-17T15:10:57.220120+0000","last_unstale":"2023-05-17T15:10:57.222708+0000","last_undegraded":"2023-05-17T15:10:57.222708+0000","last_fullsized":"2023-05-17T15:10:57.222708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213087+0000","last_change":"2023-05-17T15:10:56.830080+0000","last_active":"2023-05-17T15:10:57.213087+0000","last_peered":"2023-05-17T15:10:57.213087+0000","last_clean":"2023-05-17T15:10:57.213087+0000","last_became_active":"2023-05-17T15:10:56.829819+0000","last_became_peered":"2023-05-17T15:10:56.829819+0000","last_unstale":"2023-05-17T15:10:57.213087+0000","last_undegraded":"2023-05-17T15:10:57.213087+0000","last_fullsized":"2023-05-17T15:10:57.213087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205244+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:57.205244+0000","last_peered":"2023-05-17T15:10:57.205244+0000","last_clean":"2023-05-17T15:10:57.205244+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:57.205244+0000","last_undegraded":"2023-05-17T15:10:57.205244+0000","last_fullsized":"2023-05-17T15:10:57.205244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227340+0000","last_change":"2023-05-17T15:10:57.219754+0000","last_active":"2023-05-17T15:10:57.227340+0000","last_peered":"2023-05-17T15:10:57.227340+0000","last_clean":"2023-05-17T15:10:57.227340+0000","last_became_active":"2023-05-17T15:10:57.219481+0000","last_became_peered":"2023-05-17T15:10:57.219481+0000","last_unstale":"2023-05-17T15:10:57.227340+0000","last_undegraded":"2023-05-17T15:10:57.227340+0000","last_fullsized":"2023-05-17T15:10:57.227340+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211833+0000","last_change":"2023-05-17T15:10:56.838145+0000","last_active":"2023-05-17T15:10:57.211833+0000","last_peered":"2023-05-17T15:10:57.211833+0000","last_clean":"2023-05-17T15:10:57.211833+0000","last_became_active":"2023-05-17T15:10:56.837867+0000","last_became_peered":"2023-05-17T15:10:56.837867+0000","last_unstale":"2023-05-17T15:10:57.211833+0000","last_undegraded":"2023-05-17T15:10:57.211833+0000","last_fullsized":"2023-05-17T15:10:57.211833+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206285+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:57.206285+0000","last_peered":"2023-05-17T15:10:57.206285+0000","last_clean":"2023-05-17T15:10:57.206285+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:57.206285+0000","last_undegraded":"2023-05-17T15:10:57.206285+0000","last_fullsized":"2023-05-17T15:10:57.206285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234959+0000","last_change":"2023-05-17T15:10:57.231513+0000","last_active":"2023-05-17T15:10:57.234959+0000","last_peered":"2023-05-17T15:10:57.234959+0000","last_clean":"2023-05-17T15:10:57.234959+0000","last_became_active":"2023-05-17T15:10:57.230999+0000","last_became_peered":"2023-05-17T15:10:57.230999+0000","last_unstale":"2023-05-17T15:10:57.234959+0000","last_undegraded":"2023-05-17T15:10:57.234959+0000","last_fullsized":"2023-05-17T15:10:57.234959+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.231270+0000","last_change":"2023-05-17T15:10:56.827814+0000","last_active":"2023-05-17T15:10:57.231270+0000","last_peered":"2023-05-17T15:10:57.231270+0000","last_clean":"2023-05-17T15:10:57.231270+0000","last_became_active":"2023-05-17T15:10:56.827512+0000","last_became_peered":"2023-05-17T15:10:56.827512+0000","last_unstale":"2023-05-17T15:10:57.231270+0000","last_undegraded":"2023-05-17T15:10:57.231270+0000","last_fullsized":"2023-05-17T15:10:57.231270+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207212+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:57.207212+0000","last_peered":"2023-05-17T15:10:57.207212+0000","last_clean":"2023-05-17T15:10:57.207212+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:57.207212+0000","last_undegraded":"2023-05-17T15:10:57.207212+0000","last_fullsized":"2023-05-17T15:10:57.207212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215509+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:57.215509+0000","last_peered":"2023-05-17T15:10:57.215509+0000","last_clean":"2023-05-17T15:10:57.215509+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:57.215509+0000","last_undegraded":"2023-05-17T15:10:57.215509+0000","last_fullsized":"2023-05-17T15:10:57.215509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.230047+0000","last_change":"2023-05-17T15:10:57.226990+0000","last_active":"2023-05-17T15:10:57.230047+0000","last_peered":"2023-05-17T15:10:57.230047+0000","last_clean":"2023-05-17T15:10:57.230047+0000","last_became_active":"2023-05-17T15:10:57.225515+0000","last_became_peered":"2023-05-17T15:10:57.225515+0000","last_unstale":"2023-05-17T15:10:57.230047+0000","last_undegraded":"2023-05-17T15:10:57.230047+0000","last_fullsized":"2023-05-17T15:10:57.230047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233384+0000","last_change":"2023-05-17T15:10:56.837257+0000","last_active":"2023-05-17T15:10:57.233384+0000","last_peered":"2023-05-17T15:10:57.233384+0000","last_clean":"2023-05-17T15:10:57.233384+0000","last_became_active":"2023-05-17T15:10:56.836895+0000","last_became_peered":"2023-05-17T15:10:56.836895+0000","last_unstale":"2023-05-17T15:10:57.233384+0000","last_undegraded":"2023-05-17T15:10:57.233384+0000","last_fullsized":"2023-05-17T15:10:57.233384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215594+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:57.215594+0000","last_peered":"2023-05-17T15:10:57.215594+0000","last_clean":"2023-05-17T15:10:57.215594+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:57.215594+0000","last_undegraded":"2023-05-17T15:10:57.215594+0000","last_fullsized":"2023-05-17T15:10:57.215594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219609+0000","last_change":"2023-05-17T15:10:57.215430+0000","last_active":"2023-05-17T15:10:57.219609+0000","last_peered":"2023-05-17T15:10:57.219609+0000","last_clean":"2023-05-17T15:10:57.219609+0000","last_became_active":"2023-05-17T15:10:57.215080+0000","last_became_peered":"2023-05-17T15:10:57.215080+0000","last_unstale":"2023-05-17T15:10:57.219609+0000","last_undegraded":"2023-05-17T15:10:57.219609+0000","last_fullsized":"2023-05-17T15:10:57.219609+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208004+0000","last_change":"2023-05-17T15:10:56.827772+0000","last_active":"2023-05-17T15:10:57.208004+0000","last_peered":"2023-05-17T15:10:57.208004+0000","last_clean":"2023-05-17T15:10:57.208004+0000","last_became_active":"2023-05-17T15:10:56.827497+0000","last_became_peered":"2023-05-17T15:10:56.827497+0000","last_unstale":"2023-05-17T15:10:57.208004+0000","last_undegraded":"2023-05-17T15:10:57.208004+0000","last_fullsized":"2023-05-17T15:10:57.208004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224486+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:57.224486+0000","last_peered":"2023-05-17T15:10:57.224486+0000","last_clean":"2023-05-17T15:10:57.224486+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:57.224486+0000","last_undegraded":"2023-05-17T15:10:57.224486+0000","last_fullsized":"2023-05-17T15:10:57.224486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227275+0000","last_change":"2023-05-17T15:10:57.222582+0000","last_active":"2023-05-17T15:10:57.227275+0000","last_peered":"2023-05-17T15:10:57.227275+0000","last_clean":"2023-05-17T15:10:57.227275+0000","last_became_active":"2023-05-17T15:10:57.222321+0000","last_became_peered":"2023-05-17T15:10:57.222321+0000","last_unstale":"2023-05-17T15:10:57.227275+0000","last_undegraded":"2023-05-17T15:10:57.227275+0000","last_fullsized":"2023-05-17T15:10:57.227275+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232053+0000","last_change":"2023-05-17T15:10:56.833302+0000","last_active":"2023-05-17T15:10:57.232053+0000","last_peered":"2023-05-17T15:10:57.232053+0000","last_clean":"2023-05-17T15:10:57.232053+0000","last_became_active":"2023-05-17T15:10:56.832985+0000","last_became_peered":"2023-05-17T15:10:56.832985+0000","last_unstale":"2023-05-17T15:10:57.232053+0000","last_undegraded":"2023-05-17T15:10:57.232053+0000","last_fullsized":"2023-05-17T15:10:57.232053+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206086+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:57.206086+0000","last_peered":"2023-05-17T15:10:57.206086+0000","last_clean":"2023-05-17T15:10:57.206086+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:57.206086+0000","last_undegraded":"2023-05-17T15:10:57.206086+0000","last_fullsized":"2023-05-17T15:10:57.206086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221331+0000","last_change":"2023-05-17T15:10:57.217668+0000","last_active":"2023-05-17T15:10:57.221331+0000","last_peered":"2023-05-17T15:10:57.221331+0000","last_clean":"2023-05-17T15:10:57.221331+0000","last_became_active":"2023-05-17T15:10:57.217204+0000","last_became_peered":"2023-05-17T15:10:57.217204+0000","last_unstale":"2023-05-17T15:10:57.221331+0000","last_undegraded":"2023-05-17T15:10:57.221331+0000","last_fullsized":"2023-05-17T15:10:57.221331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.229305+0000","last_change":"2023-05-17T15:10:56.829548+0000","last_active":"2023-05-17T15:10:57.229305+0000","last_peered":"2023-05-17T15:10:57.229305+0000","last_clean":"2023-05-17T15:10:57.229305+0000","last_became_active":"2023-05-17T15:10:56.829265+0000","last_became_peered":"2023-05-17T15:10:56.829265+0000","last_unstale":"2023-05-17T15:10:57.229305+0000","last_undegraded":"2023-05-17T15:10:57.229305+0000","last_fullsized":"2023-05-17T15:10:57.229305+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207013+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:57.207013+0000","last_peered":"2023-05-17T15:10:57.207013+0000","last_clean":"2023-05-17T15:10:57.207013+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:57.207013+0000","last_undegraded":"2023-05-17T15:10:57.207013+0000","last_fullsized":"2023-05-17T15:10:57.207013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":17408,"kb_avail":94352716,"statfs":{"total":96636764160,"available":96617181184,"internally_reserved":0,"allocated":1748992,"data_stored":875644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17825792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.62}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.57399999999999995}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.35599999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575051,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18668,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":16960,"kb_avail":94353172,"statfs":{"total":96636764160,"available":96617648128,"internally_reserved":0,"allocated":1740800,"data_stored":876004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17367040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":3.427},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":4.4779999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":1.0229999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":1.171},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":1.2809999999999999}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":3.1150000000000002}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.625},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":1.452}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":1.21},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0640000000000001}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":2.6259999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.246}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18476,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353364,"statfs":{"total":96636764160,"available":96617844736,"internally_reserved":0,"allocated":1740800,"data_stored":875472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23899999999999999},"max":{"1min":0.55000000000000004,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.51800000000000002,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.20000000000000001},"max":{"1min":0.64700000000000002,"5min":1.956,"15min":1.956},"last":0.26900000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":1.149,"15min":1.149},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96599999999999997,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89600000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":1.103,"15min":1.103},"last":1.3779999999999999}]},{"osd":6,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.65800000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.99199999999999999,"5min":1.524,"15min":1.524},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66900000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18292,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353548,"statfs":{"total":96636764160,"available":96618033152,"internally_reserved":0,"allocated":1748992,"data_stored":876918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19504,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":17792,"kb_avail":94352336,"statfs":{"total":96636764160,"available":96616792064,"internally_reserved":0,"allocated":1744896,"data_stored":876412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18219008},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.253},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.626}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575051,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22516,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349324,"statfs":{"total":96636764160,"available":96613707776,"internally_reserved":0,"allocated":1748992,"data_stored":876128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18928,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":17216,"kb_avail":94352912,"statfs":{"total":96636764160,"available":96617381888,"internally_reserved":0,"allocated":1744896,"data_stored":876094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17629184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.747},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.623}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22060,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":20352,"kb_avail":94349780,"statfs":{"total":96636764160,"available":96614174720,"internally_reserved":0,"allocated":1740800,"data_stored":875540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20840448},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:11:01.965 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-17T15:11:02.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.107+0000 7fb666037700 1 Processor -- start 2023-05-17T15:11:02.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.107+0000 7fb666037700 1 -- start start 2023-05-17T15:11:02.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb666037700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6601540d0 0x7fb660155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb666037700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660067ec0 0x7fb660065390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb666037700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb660065880 0x7fb660157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb666037700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb660065d30 con 0x7fb660065880 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb666037700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb660069020 con 0x7fb6601540d0 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb666037700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660155700 con 0x7fb660067ec0 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb65ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb660065880 0x7fb660157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb65ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb660065880 0x7fb660157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43758/0 (socket says 172.21.15.27:43758) 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.108+0000 7fb65ffff700 1 -- 172.21.15.27:0/3454607009 learned_addr learned my addr 172.21.15.27:0/3454607009 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65f7fe700 1 --2- 172.21.15.27:0/3454607009 >> v2:172.21.15.40:3300/0 conn(0x7fb6601540d0 0x7fb660155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65effd700 1 --2- 172.21.15.27:0/3454607009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660067ec0 0x7fb660065390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65ffff700 1 -- 172.21.15.27:0/3454607009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660067ec0 msgr2=0x7fb660065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65ffff700 1 --2- 172.21.15.27:0/3454607009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660067ec0 0x7fb660065390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65ffff700 1 -- 172.21.15.27:0/3454607009 >> v2:172.21.15.40:3300/0 conn(0x7fb6601540d0 msgr2=0x7fb660155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65ffff700 1 --2- 172.21.15.27:0/3454607009 >> v2:172.21.15.40:3300/0 conn(0x7fb6601540d0 0x7fb660155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65ffff700 1 -- 172.21.15.27:0/3454607009 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600c3610 con 0x7fb660065880 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65ffff700 1 --2- 172.21.15.27:0/3454607009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660065880 0x7fb660157d60 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fb66005f9d0 tx=0x7fb658009840).ready entity=mon.0 client_cookie=c9876a008c6644da server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65e7fc700 1 -- 172.21.15.27:0/3454607009 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800e070 con 0x7fb660065880 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65e7fc700 1 -- 172.21.15.27:0/3454607009 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800ba50 con 0x7fb660065880 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb65e7fc700 1 -- 172.21.15.27:0/3454607009 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800bdd0 con 0x7fb660065880 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb666037700 1 -- 172.21.15.27:0/3454607009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660065880 msgr2=0x7fb660157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.109+0000 7fb666037700 1 --2- 172.21.15.27:0/3454607009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660065880 0x7fb660157d60 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fb66005f9d0 tx=0x7fb658009840).stop 2023-05-17T15:11:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 -- 172.21.15.27:0/3454607009 shutdown_connections 2023-05-17T15:11:02.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 --2- 172.21.15.27:0/3454607009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660065880 0x7fb660157d60 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 --2- 172.21.15.27:0/3454607009 >> v2:172.21.15.40:3300/0 conn(0x7fb6601540d0 0x7fb660155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 --2- 172.21.15.27:0/3454607009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660067ec0 0x7fb660065390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 -- 172.21.15.27:0/3454607009 >> 172.21.15.27:0/3454607009 conn(0x7fb6600c94a0 msgr2=0x7fb6600c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:02.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 -- 172.21.15.27:0/3454607009 shutdown_connections 2023-05-17T15:11:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.110+0000 7fb666037700 1 -- 172.21.15.27:0/3454607009 wait complete. 2023-05-17T15:11:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.111+0000 7fb666037700 1 Processor -- start 2023-05-17T15:11:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.111+0000 7fb666037700 1 -- start start 2023-05-17T15:11:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660065880 0x7fb66014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 0x7fb6600c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6601540d0 0x7fb660152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c2dd0 con 0x7fb660067ec0 2023-05-17T15:11:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600ae090 con 0x7fb6601540d0 2023-05-17T15:11:02.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600ad480 con 0x7fb660065880 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 0x7fb6600c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 0x7fb6600c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43762/0 (socket says 172.21.15.27:43762) 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 -- 172.21.15.27:0/3303126745 learned_addr learned my addr 172.21.15.27:0/3303126745 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65ffff700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6601540d0 0x7fb660152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65f7fe700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660065880 0x7fb66014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 -- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660065880 msgr2=0x7fb66014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660065880 0x7fb66014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 -- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6601540d0 msgr2=0x7fb660152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6601540d0 0x7fb660152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 -- 172.21.15.27:0/3303126745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658009ae0 con 0x7fb660067ec0 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb65effd700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 0x7fb6600c28e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fb65400c880 tx=0x7fb654008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654010580 con 0x7fb660067ec0 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540106e0 con 0x7fb660067ec0 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600ad760 con 0x7fb660067ec0 2023-05-17T15:11:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654010a60 con 0x7fb660067ec0 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.112+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6600add20 con 0x7fb660067ec0 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.113+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6601503b0 con 0x7fb660067ec0 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.114+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb65401b460 con 0x7fb660067ec0 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.114+0000 7fb6477fe700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb64c05ed90 0x7fb64c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.114+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fb654079aa0 con 0x7fb660067ec0 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.114+0000 7fb65f7fe700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb64c05ed90 0x7fb64c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.115+0000 7fb65f7fe700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb64c05ed90 0x7fb64c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb6600ad3b0 tx=0x7fb650008040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:02.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.119+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6601503b0 con 0x7fb660067ec0 2023-05-17T15:11:02.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.363+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb6601503b0 con 0x7fb660067ec0 2023-05-17T15:11:02.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.363+0000 7fb6477fe700 1 -- 172.21.15.27:0/3303126745 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+953 (secure 0 0 0) 0x7fb6601503b0 con 0x7fb660067ec0 2023-05-17T15:11:02.367 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:02.367 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1047,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1684335223,"num_in_osds":8,"osd_in_since":1684335217,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":161349632,"bytes_avail":772932763648,"bytes_total":773094113280},"fsmap":{"epoch":60,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":8034}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-05-17T15:07:12.655393+0000","services":{}},"progress_events":{}} 2023-05-17T15:11:02.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb64c05ed90 msgr2=0x7fb64c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb64c05ed90 0x7fb64c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb6600ad3b0 tx=0x7fb650008040).stop 2023-05-17T15:11:02.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 msgr2=0x7fb6600c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 0x7fb6600c28e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fb65400c880 tx=0x7fb654008040).stop 2023-05-17T15:11:02.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 shutdown_connections 2023-05-17T15:11:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fb64c05ed90 0x7fb64c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6601540d0 0x7fb660152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb660065880 0x7fb66014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 --2- 172.21.15.27:0/3303126745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb660067ec0 0x7fb6600c28e0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 >> 172.21.15.27:0/3303126745 conn(0x7fb6600c94a0 msgr2=0x7fb6600c37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 shutdown_connections 2023-05-17T15:11:02.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.365+0000 7fb666037700 1 -- 172.21.15.27:0/3303126745 wait complete. 2023-05-17T15:11:02.381 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-17T15:11:02.381 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:11:02.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.494+0000 7ffbdddcb700 1 Processor -- start 2023-05-17T15:11:02.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.494+0000 7ffbdddcb700 1 -- start start 2023-05-17T15:11:02.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbdddcb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffbd80c60c0 0x7ffbd80c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbdddcb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80a9f70 0x7ffbd8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbdddcb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd805e7e0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbdddcb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd805eac0 con 0x7ffbd80c60c0 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbdddcb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80bfd70 con 0x7ffbd80a9f70 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffbd80c60c0 0x7ffbd80c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffbd80c60c0 0x7ffbd80c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43770/0 (socket says 172.21.15.27:43770) 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 -- 172.21.15.27:0/2053321768 learned_addr learned my addr 172.21.15.27:0/2053321768 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd6ffd700 1 --2- 172.21.15.27:0/2053321768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80a9f70 0x7ffbd8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 -- 172.21.15.27:0/2053321768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80a9f70 msgr2=0x7ffbd8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 --2- 172.21.15.27:0/2053321768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80a9f70 0x7ffbd8153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 -- 172.21.15.27:0/2053321768 >> v1:172.21.15.40:6789/0 conn(0x7ffbd80aa3b0 legacy=0x7ffbd8157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 -- 172.21.15.27:0/2053321768 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80c0050 con 0x7ffbd80c60c0 2023-05-17T15:11:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd77fe700 1 --2- 172.21.15.27:0/2053321768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80c60c0 0x7ffbd80c64a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7ffbd0009f20 tx=0x7ffbd0009840).ready entity=mon.0 client_cookie=ee53a26cb04e3f76 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd67fc700 1 -- 172.21.15.27:0/2053321768 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000e070 con 0x7ffbd80c60c0 2023-05-17T15:11:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd67fc700 1 -- 172.21.15.27:0/2053321768 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000ba40 con 0x7ffbd80c60c0 2023-05-17T15:11:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.495+0000 7ffbd67fc700 1 -- 172.21.15.27:0/2053321768 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000bdc0 con 0x7ffbd80c60c0 2023-05-17T15:11:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 -- 172.21.15.27:0/2053321768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80c60c0 msgr2=0x7ffbd80c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/2053321768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80c60c0 0x7ffbd80c64a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7ffbd0009f20 tx=0x7ffbd0009840).stop 2023-05-17T15:11:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 -- 172.21.15.27:0/2053321768 shutdown_connections 2023-05-17T15:11:02.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/2053321768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80c60c0 0x7ffbd80c64a0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/2053321768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80a9f70 0x7ffbd8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 -- 172.21.15.27:0/2053321768 >> 172.21.15.27:0/2053321768 conn(0x7ffbd8069e70 msgr2=0x7ffbd805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 -- 172.21.15.27:0/2053321768 shutdown_connections 2023-05-17T15:11:02.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.496+0000 7ffbdddcb700 1 -- 172.21.15.27:0/2053321768 wait complete. 2023-05-17T15:11:02.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.497+0000 7ffbdddcb700 1 Processor -- start 2023-05-17T15:11:02.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.497+0000 7ffbdddcb700 1 -- start start 2023-05-17T15:11:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbdddcb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd80a9f70 0x7ffbd81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbdddcb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 0x7ffbd80c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbdddcb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80c60c0 0x7ffbd8150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbdddcb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80c9c70 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbdddcb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8150b20 con 0x7ffbd80a9f70 2023-05-17T15:11:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbdddcb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80c9ef0 con 0x7ffbd80c60c0 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 0x7ffbd80c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 0x7ffbd80c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43776/0 (socket says 172.21.15.27:43776) 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 -- 172.21.15.27:0/1133782630 learned_addr learned my addr 172.21.15.27:0/1133782630 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd77fe700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd80a9f70 0x7ffbd81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 -- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80c60c0 msgr2=0x7ffbd8150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80c60c0 0x7ffbd8150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:11:02.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 -- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd80a9f70 msgr2=0x7ffbd81545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd80a9f70 0x7ffbd81545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.498+0000 7ffbd6ffd700 1 -- 172.21.15.27:0/1133782630 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0009ae0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.499+0000 7ffbd6ffd700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 0x7ffbd80c9780 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7ffbc000c880 tx=0x7ffbc0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.499+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0010580 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.499+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00106e0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.499+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd80ca1d0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.499+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0010a60 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.499+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd80ca790 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.500+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd805f4a0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.500+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffbc001b460 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.500+0000 7ffbcf7fe700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffbb805ed90 0x7ffbb8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.500+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7ffbc0079cf0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.501+0000 7ffbd77fe700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffbb805ed90 0x7ffbb8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:02.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.501+0000 7ffbd77fe700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffbb805ed90 0x7ffbb8061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffbd000c010 tx=0x7ffbd0009840).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:02.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.505+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffbc004b1d0 con 0x7ffbd80aa3b0 2023-05-17T15:11:02.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.674+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbd806bdf0 con 0x7ffbb805ed90 2023-05-17T15:11:02.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.684+0000 7ffbcf7fe700 1 -- 172.21.15.27:0/1133782630 <== mgr.7842 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361555 (secure 0 0 0) 0x7ffbd806bdf0 con 0x7ffbb805ed90 2023-05-17T15:11:02.692 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:02.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.687+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffbb805ed90 msgr2=0x7ffbb8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.687+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffbb805ed90 0x7ffbb8061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffbd000c010 tx=0x7ffbd0009840).stop 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.687+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 msgr2=0x7ffbd80c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.687+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 0x7ffbd80c9780 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7ffbc000c880 tx=0x7ffbc0008040).stop 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 shutdown_connections 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7ffbb805ed90 0x7ffbb8061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbd80c60c0 0x7ffbd8150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd80a9f70 0x7ffbd81545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 --2- 172.21.15.27:0/1133782630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbd80aa3b0 0x7ffbd80c9780 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 >> 172.21.15.27:0/1133782630 conn(0x7ffbd8069e70 msgr2=0x7ffbd80c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 shutdown_connections 2023-05-17T15:11:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:02.688+0000 7ffbdddcb700 1 -- 172.21.15.27:0/1133782630 wait complete. 2023-05-17T15:11:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:11:02.701 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:02.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:02.705 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:11:01.697769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":157568,"kb_used_data":13632,"kb_used_omap":0,"kb_used_meta":143872,"kb_avail":754817152,"statfs":{"total":773094113280,"available":772932763648,"internally_reserved":0,"allocated":13959168,"data_stored":7008212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":147324928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10278,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.010330"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234889+0000","last_change":"2023-05-17T15:10:57.231439+0000","last_active":"2023-05-17T15:10:57.234889+0000","last_peered":"2023-05-17T15:10:57.234889+0000","last_clean":"2023-05-17T15:10:57.234889+0000","last_became_active":"2023-05-17T15:10:57.231117+0000","last_became_peered":"2023-05-17T15:10:57.231117+0000","last_unstale":"2023-05-17T15:10:57.234889+0000","last_undegraded":"2023-05-17T15:10:57.234889+0000","last_fullsized":"2023-05-17T15:10:57.234889+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232058+0000","last_change":"2023-05-17T15:10:56.832856+0000","last_active":"2023-05-17T15:10:57.232058+0000","last_peered":"2023-05-17T15:10:57.232058+0000","last_clean":"2023-05-17T15:10:57.232058+0000","last_became_active":"2023-05-17T15:10:56.832558+0000","last_became_peered":"2023-05-17T15:10:56.832558+0000","last_unstale":"2023-05-17T15:10:57.232058+0000","last_undegraded":"2023-05-17T15:10:57.232058+0000","last_fullsized":"2023-05-17T15:10:57.232058+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227111+0000","last_change":"2023-05-17T15:10:57.218961+0000","last_active":"2023-05-17T15:10:57.227111+0000","last_peered":"2023-05-17T15:10:57.227111+0000","last_clean":"2023-05-17T15:10:57.227111+0000","last_became_active":"2023-05-17T15:10:57.217542+0000","last_became_peered":"2023-05-17T15:10:57.217542+0000","last_unstale":"2023-05-17T15:10:57.227111+0000","last_undegraded":"2023-05-17T15:10:57.227111+0000","last_fullsized":"2023-05-17T15:10:57.227111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208490+0000","last_change":"2023-05-17T15:10:56.834250+0000","last_active":"2023-05-17T15:10:57.208490+0000","last_peered":"2023-05-17T15:10:57.208490+0000","last_clean":"2023-05-17T15:10:57.208490+0000","last_became_active":"2023-05-17T15:10:56.833982+0000","last_became_peered":"2023-05-17T15:10:56.833982+0000","last_unstale":"2023-05-17T15:10:57.208490+0000","last_undegraded":"2023-05-17T15:10:57.208490+0000","last_fullsized":"2023-05-17T15:10:57.208490+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232841+0000","last_change":"2023-05-17T15:10:57.230075+0000","last_active":"2023-05-17T15:10:57.232841+0000","last_peered":"2023-05-17T15:10:57.232841+0000","last_clean":"2023-05-17T15:10:57.232841+0000","last_became_active":"2023-05-17T15:10:57.229851+0000","last_became_peered":"2023-05-17T15:10:57.229851+0000","last_unstale":"2023-05-17T15:10:57.232841+0000","last_undegraded":"2023-05-17T15:10:57.232841+0000","last_fullsized":"2023-05-17T15:10:57.232841+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.223961+0000","last_change":"2023-05-17T15:10:56.839662+0000","last_active":"2023-05-17T15:10:57.223961+0000","last_peered":"2023-05-17T15:10:57.223961+0000","last_clean":"2023-05-17T15:10:57.223961+0000","last_became_active":"2023-05-17T15:10:56.839412+0000","last_became_peered":"2023-05-17T15:10:56.839412+0000","last_unstale":"2023-05-17T15:10:57.223961+0000","last_undegraded":"2023-05-17T15:10:57.223961+0000","last_fullsized":"2023-05-17T15:10:57.223961+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227992+0000","last_change":"2023-05-17T15:10:57.217169+0000","last_active":"2023-05-17T15:10:57.227992+0000","last_peered":"2023-05-17T15:10:57.227992+0000","last_clean":"2023-05-17T15:10:57.227992+0000","last_became_active":"2023-05-17T15:10:57.216851+0000","last_became_peered":"2023-05-17T15:10:57.216851+0000","last_unstale":"2023-05-17T15:10:57.227992+0000","last_undegraded":"2023-05-17T15:10:57.227992+0000","last_fullsized":"2023-05-17T15:10:57.227992+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.229484+0000","last_change":"2023-05-17T15:10:56.838881+0000","last_active":"2023-05-17T15:10:57.229484+0000","last_peered":"2023-05-17T15:10:57.229484+0000","last_clean":"2023-05-17T15:10:57.229484+0000","last_became_active":"2023-05-17T15:10:56.836360+0000","last_became_peered":"2023-05-17T15:10:56.836360+0000","last_unstale":"2023-05-17T15:10:57.229484+0000","last_undegraded":"2023-05-17T15:10:57.229484+0000","last_fullsized":"2023-05-17T15:10:57.229484+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226859+0000","last_change":"2023-05-17T15:10:57.217310+0000","last_active":"2023-05-17T15:10:57.226859+0000","last_peered":"2023-05-17T15:10:57.226859+0000","last_clean":"2023-05-17T15:10:57.226859+0000","last_became_active":"2023-05-17T15:10:57.217067+0000","last_became_peered":"2023-05-17T15:10:57.217067+0000","last_unstale":"2023-05-17T15:10:57.226859+0000","last_undegraded":"2023-05-17T15:10:57.226859+0000","last_fullsized":"2023-05-17T15:10:57.226859+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227204+0000","last_change":"2023-05-17T15:10:56.828562+0000","last_active":"2023-05-17T15:10:57.227204+0000","last_peered":"2023-05-17T15:10:57.227204+0000","last_clean":"2023-05-17T15:10:57.227204+0000","last_became_active":"2023-05-17T15:10:56.828263+0000","last_became_peered":"2023-05-17T15:10:56.828263+0000","last_unstale":"2023-05-17T15:10:57.227204+0000","last_undegraded":"2023-05-17T15:10:57.227204+0000","last_fullsized":"2023-05-17T15:10:57.227204+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233123+0000","last_change":"2023-05-17T15:10:57.232414+0000","last_active":"2023-05-17T15:10:57.233123+0000","last_peered":"2023-05-17T15:10:57.233123+0000","last_clean":"2023-05-17T15:10:57.233123+0000","last_became_active":"2023-05-17T15:10:57.232117+0000","last_became_peered":"2023-05-17T15:10:57.232117+0000","last_unstale":"2023-05-17T15:10:57.233123+0000","last_undegraded":"2023-05-17T15:10:57.233123+0000","last_fullsized":"2023-05-17T15:10:57.233123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227885+0000","last_change":"2023-05-17T15:10:56.839017+0000","last_active":"2023-05-17T15:10:57.227885+0000","last_peered":"2023-05-17T15:10:57.227885+0000","last_clean":"2023-05-17T15:10:57.227885+0000","last_became_active":"2023-05-17T15:10:56.838716+0000","last_became_peered":"2023-05-17T15:10:56.838716+0000","last_unstale":"2023-05-17T15:10:57.227885+0000","last_undegraded":"2023-05-17T15:10:57.227885+0000","last_fullsized":"2023-05-17T15:10:57.227885+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227328+0000","last_change":"2023-05-17T15:10:57.224895+0000","last_active":"2023-05-17T15:10:57.227328+0000","last_peered":"2023-05-17T15:10:57.227328+0000","last_clean":"2023-05-17T15:10:57.227328+0000","last_became_active":"2023-05-17T15:10:57.224534+0000","last_became_peered":"2023-05-17T15:10:57.224534+0000","last_unstale":"2023-05-17T15:10:57.227328+0000","last_undegraded":"2023-05-17T15:10:57.227328+0000","last_fullsized":"2023-05-17T15:10:57.227328+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205984+0000","last_change":"2023-05-17T15:10:56.834017+0000","last_active":"2023-05-17T15:10:57.205984+0000","last_peered":"2023-05-17T15:10:57.205984+0000","last_clean":"2023-05-17T15:10:57.205984+0000","last_became_active":"2023-05-17T15:10:56.832528+0000","last_became_peered":"2023-05-17T15:10:56.832528+0000","last_unstale":"2023-05-17T15:10:57.205984+0000","last_undegraded":"2023-05-17T15:10:57.205984+0000","last_fullsized":"2023-05-17T15:10:57.205984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228832+0000","last_change":"2023-05-17T15:10:57.226850+0000","last_active":"2023-05-17T15:10:57.228832+0000","last_peered":"2023-05-17T15:10:57.228832+0000","last_clean":"2023-05-17T15:10:57.228832+0000","last_became_active":"2023-05-17T15:10:57.226532+0000","last_became_peered":"2023-05-17T15:10:57.226532+0000","last_unstale":"2023-05-17T15:10:57.228832+0000","last_undegraded":"2023-05-17T15:10:57.228832+0000","last_fullsized":"2023-05-17T15:10:57.228832+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215134+0000","last_change":"2023-05-17T15:10:56.841641+0000","last_active":"2023-05-17T15:10:57.215134+0000","last_peered":"2023-05-17T15:10:57.215134+0000","last_clean":"2023-05-17T15:10:57.215134+0000","last_became_active":"2023-05-17T15:10:56.841348+0000","last_became_peered":"2023-05-17T15:10:56.841348+0000","last_unstale":"2023-05-17T15:10:57.215134+0000","last_undegraded":"2023-05-17T15:10:57.215134+0000","last_fullsized":"2023-05-17T15:10:57.215134+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225702+0000","last_change":"2023-05-17T15:10:57.220804+0000","last_active":"2023-05-17T15:10:57.225702+0000","last_peered":"2023-05-17T15:10:57.225702+0000","last_clean":"2023-05-17T15:10:57.225702+0000","last_became_active":"2023-05-17T15:10:57.219896+0000","last_became_peered":"2023-05-17T15:10:57.219896+0000","last_unstale":"2023-05-17T15:10:57.225702+0000","last_undegraded":"2023-05-17T15:10:57.225702+0000","last_fullsized":"2023-05-17T15:10:57.225702+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205865+0000","last_change":"2023-05-17T15:10:56.829766+0000","last_active":"2023-05-17T15:10:57.205865+0000","last_peered":"2023-05-17T15:10:57.205865+0000","last_clean":"2023-05-17T15:10:57.205865+0000","last_became_active":"2023-05-17T15:10:56.829476+0000","last_became_peered":"2023-05-17T15:10:56.829476+0000","last_unstale":"2023-05-17T15:10:57.205865+0000","last_undegraded":"2023-05-17T15:10:57.205865+0000","last_fullsized":"2023-05-17T15:10:57.205865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228105+0000","last_change":"2023-05-17T15:10:57.222990+0000","last_active":"2023-05-17T15:10:57.228105+0000","last_peered":"2023-05-17T15:10:57.228105+0000","last_clean":"2023-05-17T15:10:57.228105+0000","last_became_active":"2023-05-17T15:10:57.222492+0000","last_became_peered":"2023-05-17T15:10:57.222492+0000","last_unstale":"2023-05-17T15:10:57.228105+0000","last_undegraded":"2023-05-17T15:10:57.228105+0000","last_fullsized":"2023-05-17T15:10:57.228105+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206451+0000","last_change":"2023-05-17T15:10:56.835464+0000","last_active":"2023-05-17T15:10:57.206451+0000","last_peered":"2023-05-17T15:10:57.206451+0000","last_clean":"2023-05-17T15:10:57.206451+0000","last_became_active":"2023-05-17T15:10:56.833882+0000","last_became_peered":"2023-05-17T15:10:56.833882+0000","last_unstale":"2023-05-17T15:10:57.206451+0000","last_undegraded":"2023-05-17T15:10:57.206451+0000","last_fullsized":"2023-05-17T15:10:57.206451+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224131+0000","last_change":"2023-05-17T15:10:57.213885+0000","last_active":"2023-05-17T15:10:57.224131+0000","last_peered":"2023-05-17T15:10:57.224131+0000","last_clean":"2023-05-17T15:10:57.224131+0000","last_became_active":"2023-05-17T15:10:57.213575+0000","last_became_peered":"2023-05-17T15:10:57.213575+0000","last_unstale":"2023-05-17T15:10:57.224131+0000","last_undegraded":"2023-05-17T15:10:57.224131+0000","last_fullsized":"2023-05-17T15:10:57.224131+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209304+0000","last_change":"2023-05-17T15:10:56.832141+0000","last_active":"2023-05-17T15:10:57.209304+0000","last_peered":"2023-05-17T15:10:57.209304+0000","last_clean":"2023-05-17T15:10:57.209304+0000","last_became_active":"2023-05-17T15:10:56.831844+0000","last_became_peered":"2023-05-17T15:10:56.831844+0000","last_unstale":"2023-05-17T15:10:57.209304+0000","last_undegraded":"2023-05-17T15:10:57.209304+0000","last_fullsized":"2023-05-17T15:10:57.209304+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233812+0000","last_change":"2023-05-17T15:10:57.231257+0000","last_active":"2023-05-17T15:10:57.233812+0000","last_peered":"2023-05-17T15:10:57.233812+0000","last_clean":"2023-05-17T15:10:57.233812+0000","last_became_active":"2023-05-17T15:10:57.230945+0000","last_became_peered":"2023-05-17T15:10:57.230945+0000","last_unstale":"2023-05-17T15:10:57.233812+0000","last_undegraded":"2023-05-17T15:10:57.233812+0000","last_fullsized":"2023-05-17T15:10:57.233812+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232104+0000","last_change":"2023-05-17T15:10:56.831837+0000","last_active":"2023-05-17T15:10:57.232104+0000","last_peered":"2023-05-17T15:10:57.232104+0000","last_clean":"2023-05-17T15:10:57.232104+0000","last_became_active":"2023-05-17T15:10:56.831011+0000","last_became_peered":"2023-05-17T15:10:56.831011+0000","last_unstale":"2023-05-17T15:10:57.232104+0000","last_undegraded":"2023-05-17T15:10:57.232104+0000","last_fullsized":"2023-05-17T15:10:57.232104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222029+0000","last_change":"2023-05-17T15:10:57.213569+0000","last_active":"2023-05-17T15:10:57.222029+0000","last_peered":"2023-05-17T15:10:57.222029+0000","last_clean":"2023-05-17T15:10:57.222029+0000","last_became_active":"2023-05-17T15:10:57.213285+0000","last_became_peered":"2023-05-17T15:10:57.213285+0000","last_unstale":"2023-05-17T15:10:57.222029+0000","last_undegraded":"2023-05-17T15:10:57.222029+0000","last_fullsized":"2023-05-17T15:10:57.222029+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233137+0000","last_change":"2023-05-17T15:10:56.840789+0000","last_active":"2023-05-17T15:10:57.233137+0000","last_peered":"2023-05-17T15:10:57.233137+0000","last_clean":"2023-05-17T15:10:57.233137+0000","last_became_active":"2023-05-17T15:10:56.840561+0000","last_became_peered":"2023-05-17T15:10:56.840561+0000","last_unstale":"2023-05-17T15:10:57.233137+0000","last_undegraded":"2023-05-17T15:10:57.233137+0000","last_fullsized":"2023-05-17T15:10:57.233137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228187+0000","last_change":"2023-05-17T15:10:57.223796+0000","last_active":"2023-05-17T15:10:57.228187+0000","last_peered":"2023-05-17T15:10:57.228187+0000","last_clean":"2023-05-17T15:10:57.228187+0000","last_became_active":"2023-05-17T15:10:57.222389+0000","last_became_peered":"2023-05-17T15:10:57.222389+0000","last_unstale":"2023-05-17T15:10:57.228187+0000","last_undegraded":"2023-05-17T15:10:57.228187+0000","last_fullsized":"2023-05-17T15:10:57.228187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219811+0000","last_change":"2023-05-17T15:10:56.837666+0000","last_active":"2023-05-17T15:10:57.219811+0000","last_peered":"2023-05-17T15:10:57.219811+0000","last_clean":"2023-05-17T15:10:57.219811+0000","last_became_active":"2023-05-17T15:10:56.837330+0000","last_became_peered":"2023-05-17T15:10:56.837330+0000","last_unstale":"2023-05-17T15:10:57.219811+0000","last_undegraded":"2023-05-17T15:10:57.219811+0000","last_fullsized":"2023-05-17T15:10:57.219811+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227698+0000","last_change":"2023-05-17T15:10:57.223730+0000","last_active":"2023-05-17T15:10:57.227698+0000","last_peered":"2023-05-17T15:10:57.227698+0000","last_clean":"2023-05-17T15:10:57.227698+0000","last_became_active":"2023-05-17T15:10:57.223035+0000","last_became_peered":"2023-05-17T15:10:57.223035+0000","last_unstale":"2023-05-17T15:10:57.227698+0000","last_undegraded":"2023-05-17T15:10:57.227698+0000","last_fullsized":"2023-05-17T15:10:57.227698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207014+0000","last_change":"2023-05-17T15:10:56.834347+0000","last_active":"2023-05-17T15:10:57.207014+0000","last_peered":"2023-05-17T15:10:57.207014+0000","last_clean":"2023-05-17T15:10:57.207014+0000","last_became_active":"2023-05-17T15:10:56.834051+0000","last_became_peered":"2023-05-17T15:10:56.834051+0000","last_unstale":"2023-05-17T15:10:57.207014+0000","last_undegraded":"2023-05-17T15:10:57.207014+0000","last_fullsized":"2023-05-17T15:10:57.207014+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226982+0000","last_change":"2023-05-17T15:10:57.220386+0000","last_active":"2023-05-17T15:10:57.226982+0000","last_peered":"2023-05-17T15:10:57.226982+0000","last_clean":"2023-05-17T15:10:57.226982+0000","last_became_active":"2023-05-17T15:10:57.220055+0000","last_became_peered":"2023-05-17T15:10:57.220055+0000","last_unstale":"2023-05-17T15:10:57.226982+0000","last_undegraded":"2023-05-17T15:10:57.226982+0000","last_fullsized":"2023-05-17T15:10:57.226982+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233714+0000","last_change":"2023-05-17T15:10:56.842907+0000","last_active":"2023-05-17T15:10:57.233714+0000","last_peered":"2023-05-17T15:10:57.233714+0000","last_clean":"2023-05-17T15:10:57.233714+0000","last_became_active":"2023-05-17T15:10:56.842535+0000","last_became_peered":"2023-05-17T15:10:56.842535+0000","last_unstale":"2023-05-17T15:10:57.233714+0000","last_undegraded":"2023-05-17T15:10:57.233714+0000","last_fullsized":"2023-05-17T15:10:57.233714+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.220702+0000","last_change":"2023-05-17T15:10:57.214051+0000","last_active":"2023-05-17T15:10:57.220702+0000","last_peered":"2023-05-17T15:10:57.220702+0000","last_clean":"2023-05-17T15:10:57.220702+0000","last_became_active":"2023-05-17T15:10:57.213766+0000","last_became_peered":"2023-05-17T15:10:57.213766+0000","last_unstale":"2023-05-17T15:10:57.220702+0000","last_undegraded":"2023-05-17T15:10:57.220702+0000","last_fullsized":"2023-05-17T15:10:57.220702+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213724+0000","last_change":"2023-05-17T15:10:56.828650+0000","last_active":"2023-05-17T15:10:57.213724+0000","last_peered":"2023-05-17T15:10:57.213724+0000","last_clean":"2023-05-17T15:10:57.213724+0000","last_became_active":"2023-05-17T15:10:56.827988+0000","last_became_peered":"2023-05-17T15:10:56.827988+0000","last_unstale":"2023-05-17T15:10:57.213724+0000","last_undegraded":"2023-05-17T15:10:57.213724+0000","last_fullsized":"2023-05-17T15:10:57.213724+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222227+0000","last_change":"2023-05-17T15:10:57.217989+0000","last_active":"2023-05-17T15:10:57.222227+0000","last_peered":"2023-05-17T15:10:57.222227+0000","last_clean":"2023-05-17T15:10:57.222227+0000","last_became_active":"2023-05-17T15:10:57.216742+0000","last_became_peered":"2023-05-17T15:10:57.216742+0000","last_unstale":"2023-05-17T15:10:57.222227+0000","last_undegraded":"2023-05-17T15:10:57.222227+0000","last_fullsized":"2023-05-17T15:10:57.222227+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206250+0000","last_change":"2023-05-17T15:10:56.827238+0000","last_active":"2023-05-17T15:10:57.206250+0000","last_peered":"2023-05-17T15:10:57.206250+0000","last_clean":"2023-05-17T15:10:57.206250+0000","last_became_active":"2023-05-17T15:10:56.826951+0000","last_became_peered":"2023-05-17T15:10:56.826951+0000","last_unstale":"2023-05-17T15:10:57.206250+0000","last_undegraded":"2023-05-17T15:10:57.206250+0000","last_fullsized":"2023-05-17T15:10:57.206250+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232863+0000","last_change":"2023-05-17T15:10:57.230081+0000","last_active":"2023-05-17T15:10:57.232863+0000","last_peered":"2023-05-17T15:10:57.232863+0000","last_clean":"2023-05-17T15:10:57.232863+0000","last_became_active":"2023-05-17T15:10:57.229804+0000","last_became_peered":"2023-05-17T15:10:57.229804+0000","last_unstale":"2023-05-17T15:10:57.232863+0000","last_undegraded":"2023-05-17T15:10:57.232863+0000","last_fullsized":"2023-05-17T15:10:57.232863+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235031+0000","last_change":"2023-05-17T15:10:56.841201+0000","last_active":"2023-05-17T15:10:57.235031+0000","last_peered":"2023-05-17T15:10:57.235031+0000","last_clean":"2023-05-17T15:10:57.235031+0000","last_became_active":"2023-05-17T15:10:56.840419+0000","last_became_peered":"2023-05-17T15:10:56.840419+0000","last_unstale":"2023-05-17T15:10:57.235031+0000","last_undegraded":"2023-05-17T15:10:57.235031+0000","last_fullsized":"2023-05-17T15:10:57.235031+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226982+0000","last_change":"2023-05-17T15:10:57.217830+0000","last_active":"2023-05-17T15:10:57.226982+0000","last_peered":"2023-05-17T15:10:57.226982+0000","last_clean":"2023-05-17T15:10:57.226982+0000","last_became_active":"2023-05-17T15:10:57.217566+0000","last_became_peered":"2023-05-17T15:10:57.217566+0000","last_unstale":"2023-05-17T15:10:57.226982+0000","last_undegraded":"2023-05-17T15:10:57.226982+0000","last_fullsized":"2023-05-17T15:10:57.226982+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.210208+0000","last_change":"2023-05-17T15:10:56.833922+0000","last_active":"2023-05-17T15:10:57.210208+0000","last_peered":"2023-05-17T15:10:57.210208+0000","last_clean":"2023-05-17T15:10:57.210208+0000","last_became_active":"2023-05-17T15:10:56.833590+0000","last_became_peered":"2023-05-17T15:10:56.833590+0000","last_unstale":"2023-05-17T15:10:57.210208+0000","last_undegraded":"2023-05-17T15:10:57.210208+0000","last_fullsized":"2023-05-17T15:10:57.210208+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222174+0000","last_change":"2023-05-17T15:10:57.218640+0000","last_active":"2023-05-17T15:10:57.222174+0000","last_peered":"2023-05-17T15:10:57.222174+0000","last_clean":"2023-05-17T15:10:57.222174+0000","last_became_active":"2023-05-17T15:10:57.218135+0000","last_became_peered":"2023-05-17T15:10:57.218135+0000","last_unstale":"2023-05-17T15:10:57.222174+0000","last_undegraded":"2023-05-17T15:10:57.222174+0000","last_fullsized":"2023-05-17T15:10:57.222174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228419+0000","last_change":"2023-05-17T15:10:56.836012+0000","last_active":"2023-05-17T15:10:57.228419+0000","last_peered":"2023-05-17T15:10:57.228419+0000","last_clean":"2023-05-17T15:10:57.228419+0000","last_became_active":"2023-05-17T15:10:56.835680+0000","last_became_peered":"2023-05-17T15:10:56.835680+0000","last_unstale":"2023-05-17T15:10:57.228419+0000","last_undegraded":"2023-05-17T15:10:57.228419+0000","last_fullsized":"2023-05-17T15:10:57.228419+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235198+0000","last_change":"2023-05-17T15:10:57.234027+0000","last_active":"2023-05-17T15:10:57.235198+0000","last_peered":"2023-05-17T15:10:57.235198+0000","last_clean":"2023-05-17T15:10:57.235198+0000","last_became_active":"2023-05-17T15:10:57.233432+0000","last_became_peered":"2023-05-17T15:10:57.233432+0000","last_unstale":"2023-05-17T15:10:57.235198+0000","last_undegraded":"2023-05-17T15:10:57.235198+0000","last_fullsized":"2023-05-17T15:10:57.235198+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211711+0000","last_change":"2023-05-17T15:10:56.832469+0000","last_active":"2023-05-17T15:10:57.211711+0000","last_peered":"2023-05-17T15:10:57.211711+0000","last_clean":"2023-05-17T15:10:57.211711+0000","last_became_active":"2023-05-17T15:10:56.831700+0000","last_became_peered":"2023-05-17T15:10:56.831700+0000","last_unstale":"2023-05-17T15:10:57.211711+0000","last_undegraded":"2023-05-17T15:10:57.211711+0000","last_fullsized":"2023-05-17T15:10:57.211711+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227987+0000","last_change":"2023-05-17T15:10:57.218887+0000","last_active":"2023-05-17T15:10:57.227987+0000","last_peered":"2023-05-17T15:10:57.227987+0000","last_clean":"2023-05-17T15:10:57.227987+0000","last_became_active":"2023-05-17T15:10:57.218605+0000","last_became_peered":"2023-05-17T15:10:57.218605+0000","last_unstale":"2023-05-17T15:10:57.227987+0000","last_undegraded":"2023-05-17T15:10:57.227987+0000","last_fullsized":"2023-05-17T15:10:57.227987+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211419+0000","last_change":"2023-05-17T15:10:56.827587+0000","last_active":"2023-05-17T15:10:57.211419+0000","last_peered":"2023-05-17T15:10:57.211419+0000","last_clean":"2023-05-17T15:10:57.211419+0000","last_became_active":"2023-05-17T15:10:56.827063+0000","last_became_peered":"2023-05-17T15:10:56.827063+0000","last_unstale":"2023-05-17T15:10:57.211419+0000","last_undegraded":"2023-05-17T15:10:57.211419+0000","last_fullsized":"2023-05-17T15:10:57.211419+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235189+0000","last_change":"2023-05-17T15:10:57.233608+0000","last_active":"2023-05-17T15:10:57.235189+0000","last_peered":"2023-05-17T15:10:57.235189+0000","last_clean":"2023-05-17T15:10:57.235189+0000","last_became_active":"2023-05-17T15:10:57.233064+0000","last_became_peered":"2023-05-17T15:10:57.233064+0000","last_unstale":"2023-05-17T15:10:57.235189+0000","last_undegraded":"2023-05-17T15:10:57.235189+0000","last_fullsized":"2023-05-17T15:10:57.235189+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207220+0000","last_change":"2023-05-17T15:10:56.836753+0000","last_active":"2023-05-17T15:10:57.207220+0000","last_peered":"2023-05-17T15:10:57.207220+0000","last_clean":"2023-05-17T15:10:57.207220+0000","last_became_active":"2023-05-17T15:10:56.836423+0000","last_became_peered":"2023-05-17T15:10:56.836423+0000","last_unstale":"2023-05-17T15:10:57.207220+0000","last_undegraded":"2023-05-17T15:10:57.207220+0000","last_fullsized":"2023-05-17T15:10:57.207220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227402+0000","last_change":"2023-05-17T15:10:57.224377+0000","last_active":"2023-05-17T15:10:57.227402+0000","last_peered":"2023-05-17T15:10:57.227402+0000","last_clean":"2023-05-17T15:10:57.227402+0000","last_became_active":"2023-05-17T15:10:57.222293+0000","last_became_peered":"2023-05-17T15:10:57.222293+0000","last_unstale":"2023-05-17T15:10:57.227402+0000","last_undegraded":"2023-05-17T15:10:57.227402+0000","last_fullsized":"2023-05-17T15:10:57.227402+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213848+0000","last_change":"2023-05-17T15:10:56.828661+0000","last_active":"2023-05-17T15:10:57.213848+0000","last_peered":"2023-05-17T15:10:57.213848+0000","last_clean":"2023-05-17T15:10:57.213848+0000","last_became_active":"2023-05-17T15:10:56.828339+0000","last_became_peered":"2023-05-17T15:10:56.828339+0000","last_unstale":"2023-05-17T15:10:57.213848+0000","last_undegraded":"2023-05-17T15:10:57.213848+0000","last_fullsized":"2023-05-17T15:10:57.213848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222251+0000","last_change":"2023-05-17T15:10:57.218444+0000","last_active":"2023-05-17T15:10:57.222251+0000","last_peered":"2023-05-17T15:10:57.222251+0000","last_clean":"2023-05-17T15:10:57.222251+0000","last_became_active":"2023-05-17T15:10:57.217137+0000","last_became_peered":"2023-05-17T15:10:57.217137+0000","last_unstale":"2023-05-17T15:10:57.222251+0000","last_undegraded":"2023-05-17T15:10:57.222251+0000","last_fullsized":"2023-05-17T15:10:57.222251+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206554+0000","last_change":"2023-05-17T15:10:56.834973+0000","last_active":"2023-05-17T15:10:57.206554+0000","last_peered":"2023-05-17T15:10:57.206554+0000","last_clean":"2023-05-17T15:10:57.206554+0000","last_became_active":"2023-05-17T15:10:56.834275+0000","last_became_peered":"2023-05-17T15:10:56.834275+0000","last_unstale":"2023-05-17T15:10:57.206554+0000","last_undegraded":"2023-05-17T15:10:57.206554+0000","last_fullsized":"2023-05-17T15:10:57.206554+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221708+0000","last_change":"2023-05-17T15:10:57.218670+0000","last_active":"2023-05-17T15:10:57.221708+0000","last_peered":"2023-05-17T15:10:57.221708+0000","last_clean":"2023-05-17T15:10:57.221708+0000","last_became_active":"2023-05-17T15:10:57.218215+0000","last_became_peered":"2023-05-17T15:10:57.218215+0000","last_unstale":"2023-05-17T15:10:57.221708+0000","last_undegraded":"2023-05-17T15:10:57.221708+0000","last_fullsized":"2023-05-17T15:10:57.221708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207574+0000","last_change":"2023-05-17T15:10:56.837598+0000","last_active":"2023-05-17T15:10:57.207574+0000","last_peered":"2023-05-17T15:10:57.207574+0000","last_clean":"2023-05-17T15:10:57.207574+0000","last_became_active":"2023-05-17T15:10:56.837314+0000","last_became_peered":"2023-05-17T15:10:56.837314+0000","last_unstale":"2023-05-17T15:10:57.207574+0000","last_undegraded":"2023-05-17T15:10:57.207574+0000","last_fullsized":"2023-05-17T15:10:57.207574+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226578+0000","last_change":"2023-05-17T15:10:57.221141+0000","last_active":"2023-05-17T15:10:57.226578+0000","last_peered":"2023-05-17T15:10:57.226578+0000","last_clean":"2023-05-17T15:10:57.226578+0000","last_became_active":"2023-05-17T15:10:57.220625+0000","last_became_peered":"2023-05-17T15:10:57.220625+0000","last_unstale":"2023-05-17T15:10:57.226578+0000","last_undegraded":"2023-05-17T15:10:57.226578+0000","last_fullsized":"2023-05-17T15:10:57.226578+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207305+0000","last_change":"2023-05-17T15:10:56.832662+0000","last_active":"2023-05-17T15:10:57.207305+0000","last_peered":"2023-05-17T15:10:57.207305+0000","last_clean":"2023-05-17T15:10:57.207305+0000","last_became_active":"2023-05-17T15:10:56.832345+0000","last_became_peered":"2023-05-17T15:10:56.832345+0000","last_unstale":"2023-05-17T15:10:57.207305+0000","last_undegraded":"2023-05-17T15:10:57.207305+0000","last_fullsized":"2023-05-17T15:10:57.207305+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222150+0000","last_change":"2023-05-17T15:10:57.218441+0000","last_active":"2023-05-17T15:10:57.222150+0000","last_peered":"2023-05-17T15:10:57.222150+0000","last_clean":"2023-05-17T15:10:57.222150+0000","last_became_active":"2023-05-17T15:10:57.217501+0000","last_became_peered":"2023-05-17T15:10:57.217501+0000","last_unstale":"2023-05-17T15:10:57.222150+0000","last_undegraded":"2023-05-17T15:10:57.222150+0000","last_fullsized":"2023-05-17T15:10:57.222150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209095+0000","last_change":"2023-05-17T15:10:56.833660+0000","last_active":"2023-05-17T15:10:57.209095+0000","last_peered":"2023-05-17T15:10:57.209095+0000","last_clean":"2023-05-17T15:10:57.209095+0000","last_became_active":"2023-05-17T15:10:56.833359+0000","last_became_peered":"2023-05-17T15:10:56.833359+0000","last_unstale":"2023-05-17T15:10:57.209095+0000","last_undegraded":"2023-05-17T15:10:57.209095+0000","last_fullsized":"2023-05-17T15:10:57.209095+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221311+0000","last_change":"2023-05-17T15:10:57.214503+0000","last_active":"2023-05-17T15:10:57.221311+0000","last_peered":"2023-05-17T15:10:57.221311+0000","last_clean":"2023-05-17T15:10:57.221311+0000","last_became_active":"2023-05-17T15:10:57.213407+0000","last_became_peered":"2023-05-17T15:10:57.213407+0000","last_unstale":"2023-05-17T15:10:57.221311+0000","last_undegraded":"2023-05-17T15:10:57.221311+0000","last_fullsized":"2023-05-17T15:10:57.221311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205144+0000","last_change":"2023-05-17T15:10:56.827934+0000","last_active":"2023-05-17T15:10:57.205144+0000","last_peered":"2023-05-17T15:10:57.205144+0000","last_clean":"2023-05-17T15:10:57.205144+0000","last_became_active":"2023-05-17T15:10:56.827522+0000","last_became_peered":"2023-05-17T15:10:56.827522+0000","last_unstale":"2023-05-17T15:10:57.205144+0000","last_undegraded":"2023-05-17T15:10:57.205144+0000","last_fullsized":"2023-05-17T15:10:57.205144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227205+0000","last_change":"2023-05-17T15:10:57.220828+0000","last_active":"2023-05-17T15:10:57.227205+0000","last_peered":"2023-05-17T15:10:57.227205+0000","last_clean":"2023-05-17T15:10:57.227205+0000","last_became_active":"2023-05-17T15:10:57.218264+0000","last_became_peered":"2023-05-17T15:10:57.218264+0000","last_unstale":"2023-05-17T15:10:57.227205+0000","last_undegraded":"2023-05-17T15:10:57.227205+0000","last_fullsized":"2023-05-17T15:10:57.227205+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208403+0000","last_change":"2023-05-17T15:10:56.834089+0000","last_active":"2023-05-17T15:10:57.208403+0000","last_peered":"2023-05-17T15:10:57.208403+0000","last_clean":"2023-05-17T15:10:57.208403+0000","last_became_active":"2023-05-17T15:10:56.833714+0000","last_became_peered":"2023-05-17T15:10:56.833714+0000","last_unstale":"2023-05-17T15:10:57.208403+0000","last_undegraded":"2023-05-17T15:10:57.208403+0000","last_fullsized":"2023-05-17T15:10:57.208403+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226279+0000","last_change":"2023-05-17T15:10:57.225169+0000","last_active":"2023-05-17T15:10:57.226279+0000","last_peered":"2023-05-17T15:10:57.226279+0000","last_clean":"2023-05-17T15:10:57.226279+0000","last_became_active":"2023-05-17T15:10:57.224862+0000","last_became_peered":"2023-05-17T15:10:57.224862+0000","last_unstale":"2023-05-17T15:10:57.226279+0000","last_undegraded":"2023-05-17T15:10:57.226279+0000","last_fullsized":"2023-05-17T15:10:57.226279+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206277+0000","last_change":"2023-05-17T15:10:56.834228+0000","last_active":"2023-05-17T15:10:57.206277+0000","last_peered":"2023-05-17T15:10:57.206277+0000","last_clean":"2023-05-17T15:10:57.206277+0000","last_became_active":"2023-05-17T15:10:56.833932+0000","last_became_peered":"2023-05-17T15:10:56.833932+0000","last_unstale":"2023-05-17T15:10:57.206277+0000","last_undegraded":"2023-05-17T15:10:57.206277+0000","last_fullsized":"2023-05-17T15:10:57.206277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226690+0000","last_change":"2023-05-17T15:10:57.215803+0000","last_active":"2023-05-17T15:10:57.226690+0000","last_peered":"2023-05-17T15:10:57.226690+0000","last_clean":"2023-05-17T15:10:57.226690+0000","last_became_active":"2023-05-17T15:10:57.215505+0000","last_became_peered":"2023-05-17T15:10:57.215505+0000","last_unstale":"2023-05-17T15:10:57.226690+0000","last_undegraded":"2023-05-17T15:10:57.226690+0000","last_fullsized":"2023-05-17T15:10:57.226690+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233959+0000","last_change":"2023-05-17T15:10:56.833320+0000","last_active":"2023-05-17T15:10:57.233959+0000","last_peered":"2023-05-17T15:10:57.233959+0000","last_clean":"2023-05-17T15:10:57.233959+0000","last_became_active":"2023-05-17T15:10:56.833002+0000","last_became_peered":"2023-05-17T15:10:56.833002+0000","last_unstale":"2023-05-17T15:10:57.233959+0000","last_undegraded":"2023-05-17T15:10:57.233959+0000","last_fullsized":"2023-05-17T15:10:57.233959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227311+0000","last_change":"2023-05-17T15:10:57.224838+0000","last_active":"2023-05-17T15:10:57.227311+0000","last_peered":"2023-05-17T15:10:57.227311+0000","last_clean":"2023-05-17T15:10:57.227311+0000","last_became_active":"2023-05-17T15:10:57.224462+0000","last_became_peered":"2023-05-17T15:10:57.224462+0000","last_unstale":"2023-05-17T15:10:57.227311+0000","last_undegraded":"2023-05-17T15:10:57.227311+0000","last_fullsized":"2023-05-17T15:10:57.227311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224162+0000","last_change":"2023-05-17T15:10:56.832264+0000","last_active":"2023-05-17T15:10:57.224162+0000","last_peered":"2023-05-17T15:10:57.224162+0000","last_clean":"2023-05-17T15:10:57.224162+0000","last_became_active":"2023-05-17T15:10:56.831929+0000","last_became_peered":"2023-05-17T15:10:56.831929+0000","last_unstale":"2023-05-17T15:10:57.224162+0000","last_undegraded":"2023-05-17T15:10:57.224162+0000","last_fullsized":"2023-05-17T15:10:57.224162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221196+0000","last_change":"2023-05-17T15:10:57.217611+0000","last_active":"2023-05-17T15:10:57.221196+0000","last_peered":"2023-05-17T15:10:57.221196+0000","last_clean":"2023-05-17T15:10:57.221196+0000","last_became_active":"2023-05-17T15:10:57.214351+0000","last_became_peered":"2023-05-17T15:10:57.214351+0000","last_unstale":"2023-05-17T15:10:57.221196+0000","last_undegraded":"2023-05-17T15:10:57.221196+0000","last_fullsized":"2023-05-17T15:10:57.221196+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233540+0000","last_change":"2023-05-17T15:10:56.841000+0000","last_active":"2023-05-17T15:10:57.233540+0000","last_peered":"2023-05-17T15:10:57.233540+0000","last_clean":"2023-05-17T15:10:57.233540+0000","last_became_active":"2023-05-17T15:10:56.840483+0000","last_became_peered":"2023-05-17T15:10:56.840483+0000","last_unstale":"2023-05-17T15:10:57.233540+0000","last_undegraded":"2023-05-17T15:10:57.233540+0000","last_fullsized":"2023-05-17T15:10:57.233540+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234924+0000","last_change":"2023-05-17T15:10:57.232156+0000","last_active":"2023-05-17T15:10:57.234924+0000","last_peered":"2023-05-17T15:10:57.234924+0000","last_clean":"2023-05-17T15:10:57.234924+0000","last_became_active":"2023-05-17T15:10:57.231174+0000","last_became_peered":"2023-05-17T15:10:57.231174+0000","last_unstale":"2023-05-17T15:10:57.234924+0000","last_undegraded":"2023-05-17T15:10:57.234924+0000","last_fullsized":"2023-05-17T15:10:57.234924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207640+0000","last_change":"2023-05-17T15:10:56.834777+0000","last_active":"2023-05-17T15:10:57.207640+0000","last_peered":"2023-05-17T15:10:57.207640+0000","last_clean":"2023-05-17T15:10:57.207640+0000","last_became_active":"2023-05-17T15:10:56.834423+0000","last_became_peered":"2023-05-17T15:10:56.834423+0000","last_unstale":"2023-05-17T15:10:57.207640+0000","last_undegraded":"2023-05-17T15:10:57.207640+0000","last_fullsized":"2023-05-17T15:10:57.207640+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226969+0000","last_change":"2023-05-17T15:10:57.218550+0000","last_active":"2023-05-17T15:10:57.226969+0000","last_peered":"2023-05-17T15:10:57.226969+0000","last_clean":"2023-05-17T15:10:57.226969+0000","last_became_active":"2023-05-17T15:10:57.218266+0000","last_became_peered":"2023-05-17T15:10:57.218266+0000","last_unstale":"2023-05-17T15:10:57.226969+0000","last_undegraded":"2023-05-17T15:10:57.226969+0000","last_fullsized":"2023-05-17T15:10:57.226969+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209220+0000","last_change":"2023-05-17T15:10:56.830287+0000","last_active":"2023-05-17T15:10:57.209220+0000","last_peered":"2023-05-17T15:10:57.209220+0000","last_clean":"2023-05-17T15:10:57.209220+0000","last_became_active":"2023-05-17T15:10:56.830005+0000","last_became_peered":"2023-05-17T15:10:56.830005+0000","last_unstale":"2023-05-17T15:10:57.209220+0000","last_undegraded":"2023-05-17T15:10:57.209220+0000","last_fullsized":"2023-05-17T15:10:57.209220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228057+0000","last_change":"2023-05-17T15:10:57.219768+0000","last_active":"2023-05-17T15:10:57.228057+0000","last_peered":"2023-05-17T15:10:57.228057+0000","last_clean":"2023-05-17T15:10:57.228057+0000","last_became_active":"2023-05-17T15:10:57.216072+0000","last_became_peered":"2023-05-17T15:10:57.216072+0000","last_unstale":"2023-05-17T15:10:57.228057+0000","last_undegraded":"2023-05-17T15:10:57.228057+0000","last_fullsized":"2023-05-17T15:10:57.228057+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207908+0000","last_change":"2023-05-17T15:10:56.828442+0000","last_active":"2023-05-17T15:10:57.207908+0000","last_peered":"2023-05-17T15:10:57.207908+0000","last_clean":"2023-05-17T15:10:57.207908+0000","last_became_active":"2023-05-17T15:10:56.828161+0000","last_became_peered":"2023-05-17T15:10:56.828161+0000","last_unstale":"2023-05-17T15:10:57.207908+0000","last_undegraded":"2023-05-17T15:10:57.207908+0000","last_fullsized":"2023-05-17T15:10:57.207908+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227194+0000","last_change":"2023-05-17T15:10:57.220647+0000","last_active":"2023-05-17T15:10:57.227194+0000","last_peered":"2023-05-17T15:10:57.227194+0000","last_clean":"2023-05-17T15:10:57.227194+0000","last_became_active":"2023-05-17T15:10:57.217855+0000","last_became_peered":"2023-05-17T15:10:57.217855+0000","last_unstale":"2023-05-17T15:10:57.227194+0000","last_undegraded":"2023-05-17T15:10:57.227194+0000","last_fullsized":"2023-05-17T15:10:57.227194+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206066+0000","last_change":"2023-05-17T15:10:56.832160+0000","last_active":"2023-05-17T15:10:57.206066+0000","last_peered":"2023-05-17T15:10:57.206066+0000","last_clean":"2023-05-17T15:10:57.206066+0000","last_became_active":"2023-05-17T15:10:56.831892+0000","last_became_peered":"2023-05-17T15:10:56.831892+0000","last_unstale":"2023-05-17T15:10:57.206066+0000","last_undegraded":"2023-05-17T15:10:57.206066+0000","last_fullsized":"2023-05-17T15:10:57.206066+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228186+0000","last_change":"2023-05-17T15:10:57.225426+0000","last_active":"2023-05-17T15:10:57.228186+0000","last_peered":"2023-05-17T15:10:57.228186+0000","last_clean":"2023-05-17T15:10:57.228186+0000","last_became_active":"2023-05-17T15:10:57.225106+0000","last_became_peered":"2023-05-17T15:10:57.225106+0000","last_unstale":"2023-05-17T15:10:57.228186+0000","last_undegraded":"2023-05-17T15:10:57.228186+0000","last_fullsized":"2023-05-17T15:10:57.228186+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206603+0000","last_change":"2023-05-17T15:10:56.831442+0000","last_active":"2023-05-17T15:10:57.206603+0000","last_peered":"2023-05-17T15:10:57.206603+0000","last_clean":"2023-05-17T15:10:57.206603+0000","last_became_active":"2023-05-17T15:10:56.831147+0000","last_became_peered":"2023-05-17T15:10:56.831147+0000","last_unstale":"2023-05-17T15:10:57.206603+0000","last_undegraded":"2023-05-17T15:10:57.206603+0000","last_fullsized":"2023-05-17T15:10:57.206603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219023+0000","last_change":"2023-05-17T15:10:57.214798+0000","last_active":"2023-05-17T15:10:57.219023+0000","last_peered":"2023-05-17T15:10:57.219023+0000","last_clean":"2023-05-17T15:10:57.219023+0000","last_became_active":"2023-05-17T15:10:57.214473+0000","last_became_peered":"2023-05-17T15:10:57.214473+0000","last_unstale":"2023-05-17T15:10:57.219023+0000","last_undegraded":"2023-05-17T15:10:57.219023+0000","last_fullsized":"2023-05-17T15:10:57.219023+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225651+0000","last_change":"2023-05-17T15:10:56.842757+0000","last_active":"2023-05-17T15:10:57.225651+0000","last_peered":"2023-05-17T15:10:57.225651+0000","last_clean":"2023-05-17T15:10:57.225651+0000","last_became_active":"2023-05-17T15:10:56.842401+0000","last_became_peered":"2023-05-17T15:10:56.842401+0000","last_unstale":"2023-05-17T15:10:57.225651+0000","last_undegraded":"2023-05-17T15:10:57.225651+0000","last_fullsized":"2023-05-17T15:10:57.225651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227868+0000","last_change":"2023-05-17T15:10:57.217015+0000","last_active":"2023-05-17T15:10:57.227868+0000","last_peered":"2023-05-17T15:10:57.227868+0000","last_clean":"2023-05-17T15:10:57.227868+0000","last_became_active":"2023-05-17T15:10:57.216478+0000","last_became_peered":"2023-05-17T15:10:57.216478+0000","last_unstale":"2023-05-17T15:10:57.227868+0000","last_undegraded":"2023-05-17T15:10:57.227868+0000","last_fullsized":"2023-05-17T15:10:57.227868+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225688+0000","last_change":"2023-05-17T15:10:56.833412+0000","last_active":"2023-05-17T15:10:57.225688+0000","last_peered":"2023-05-17T15:10:57.225688+0000","last_clean":"2023-05-17T15:10:57.225688+0000","last_became_active":"2023-05-17T15:10:56.833007+0000","last_became_peered":"2023-05-17T15:10:56.833007+0000","last_unstale":"2023-05-17T15:10:57.225688+0000","last_undegraded":"2023-05-17T15:10:57.225688+0000","last_fullsized":"2023-05-17T15:10:57.225688+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226377+0000","last_change":"2023-05-17T15:10:57.223581+0000","last_active":"2023-05-17T15:10:57.226377+0000","last_peered":"2023-05-17T15:10:57.226377+0000","last_clean":"2023-05-17T15:10:57.226377+0000","last_became_active":"2023-05-17T15:10:57.222657+0000","last_became_peered":"2023-05-17T15:10:57.222657+0000","last_unstale":"2023-05-17T15:10:57.226377+0000","last_undegraded":"2023-05-17T15:10:57.226377+0000","last_fullsized":"2023-05-17T15:10:57.226377+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224391+0000","last_change":"2023-05-17T15:10:56.838318+0000","last_active":"2023-05-17T15:10:57.224391+0000","last_peered":"2023-05-17T15:10:57.224391+0000","last_clean":"2023-05-17T15:10:57.224391+0000","last_became_active":"2023-05-17T15:10:56.838048+0000","last_became_peered":"2023-05-17T15:10:56.838048+0000","last_unstale":"2023-05-17T15:10:57.224391+0000","last_undegraded":"2023-05-17T15:10:57.224391+0000","last_fullsized":"2023-05-17T15:10:57.224391+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226557+0000","last_change":"2023-05-17T15:10:57.220917+0000","last_active":"2023-05-17T15:10:57.226557+0000","last_peered":"2023-05-17T15:10:57.226557+0000","last_clean":"2023-05-17T15:10:57.226557+0000","last_became_active":"2023-05-17T15:10:57.220106+0000","last_became_peered":"2023-05-17T15:10:57.220106+0000","last_unstale":"2023-05-17T15:10:57.226557+0000","last_undegraded":"2023-05-17T15:10:57.226557+0000","last_fullsized":"2023-05-17T15:10:57.226557+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.220671+0000","last_change":"2023-05-17T15:10:56.843745+0000","last_active":"2023-05-17T15:10:57.220671+0000","last_peered":"2023-05-17T15:10:57.220671+0000","last_clean":"2023-05-17T15:10:57.220671+0000","last_became_active":"2023-05-17T15:10:56.843479+0000","last_became_peered":"2023-05-17T15:10:56.843479+0000","last_unstale":"2023-05-17T15:10:57.220671+0000","last_undegraded":"2023-05-17T15:10:57.220671+0000","last_fullsized":"2023-05-17T15:10:57.220671+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225848+0000","last_change":"2023-05-17T15:10:57.223358+0000","last_active":"2023-05-17T15:10:57.225848+0000","last_peered":"2023-05-17T15:10:57.225848+0000","last_clean":"2023-05-17T15:10:57.225848+0000","last_became_active":"2023-05-17T15:10:57.222532+0000","last_became_peered":"2023-05-17T15:10:57.222532+0000","last_unstale":"2023-05-17T15:10:57.225848+0000","last_undegraded":"2023-05-17T15:10:57.225848+0000","last_fullsized":"2023-05-17T15:10:57.225848+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232145+0000","last_change":"2023-05-17T15:10:56.837020+0000","last_active":"2023-05-17T15:10:57.232145+0000","last_peered":"2023-05-17T15:10:57.232145+0000","last_clean":"2023-05-17T15:10:57.232145+0000","last_became_active":"2023-05-17T15:10:56.836737+0000","last_became_peered":"2023-05-17T15:10:56.836737+0000","last_unstale":"2023-05-17T15:10:57.232145+0000","last_undegraded":"2023-05-17T15:10:57.232145+0000","last_fullsized":"2023-05-17T15:10:57.232145+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227704+0000","last_change":"2023-05-17T15:10:57.223963+0000","last_active":"2023-05-17T15:10:57.227704+0000","last_peered":"2023-05-17T15:10:57.227704+0000","last_clean":"2023-05-17T15:10:57.227704+0000","last_became_active":"2023-05-17T15:10:57.223709+0000","last_became_peered":"2023-05-17T15:10:57.223709+0000","last_unstale":"2023-05-17T15:10:57.227704+0000","last_undegraded":"2023-05-17T15:10:57.227704+0000","last_fullsized":"2023-05-17T15:10:57.227704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219998+0000","last_change":"2023-05-17T15:10:56.841574+0000","last_active":"2023-05-17T15:10:57.219998+0000","last_peered":"2023-05-17T15:10:57.219998+0000","last_clean":"2023-05-17T15:10:57.219998+0000","last_became_active":"2023-05-17T15:10:56.841288+0000","last_became_peered":"2023-05-17T15:10:56.841288+0000","last_unstale":"2023-05-17T15:10:57.219998+0000","last_undegraded":"2023-05-17T15:10:57.219998+0000","last_fullsized":"2023-05-17T15:10:57.219998+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227654+0000","last_change":"2023-05-17T15:10:57.223557+0000","last_active":"2023-05-17T15:10:57.227654+0000","last_peered":"2023-05-17T15:10:57.227654+0000","last_clean":"2023-05-17T15:10:57.227654+0000","last_became_active":"2023-05-17T15:10:57.222696+0000","last_became_peered":"2023-05-17T15:10:57.222696+0000","last_unstale":"2023-05-17T15:10:57.227654+0000","last_undegraded":"2023-05-17T15:10:57.227654+0000","last_fullsized":"2023-05-17T15:10:57.227654+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213096+0000","last_change":"2023-05-17T15:10:56.833261+0000","last_active":"2023-05-17T15:10:57.213096+0000","last_peered":"2023-05-17T15:10:57.213096+0000","last_clean":"2023-05-17T15:10:57.213096+0000","last_became_active":"2023-05-17T15:10:56.832990+0000","last_became_peered":"2023-05-17T15:10:56.832990+0000","last_unstale":"2023-05-17T15:10:57.213096+0000","last_undegraded":"2023-05-17T15:10:57.213096+0000","last_fullsized":"2023-05-17T15:10:57.213096+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221637+0000","last_change":"2023-05-17T15:10:57.218219+0000","last_active":"2023-05-17T15:10:57.221637+0000","last_peered":"2023-05-17T15:10:57.221637+0000","last_clean":"2023-05-17T15:10:57.221637+0000","last_became_active":"2023-05-17T15:10:57.217924+0000","last_became_peered":"2023-05-17T15:10:57.217924+0000","last_unstale":"2023-05-17T15:10:57.221637+0000","last_undegraded":"2023-05-17T15:10:57.221637+0000","last_fullsized":"2023-05-17T15:10:57.221637+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215240+0000","last_change":"2023-05-17T15:10:56.841047+0000","last_active":"2023-05-17T15:10:57.215240+0000","last_peered":"2023-05-17T15:10:57.215240+0000","last_clean":"2023-05-17T15:10:57.215240+0000","last_became_active":"2023-05-17T15:10:56.840736+0000","last_became_peered":"2023-05-17T15:10:56.840736+0000","last_unstale":"2023-05-17T15:10:57.215240+0000","last_undegraded":"2023-05-17T15:10:57.215240+0000","last_fullsized":"2023-05-17T15:10:57.215240+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227390+0000","last_change":"2023-05-17T15:10:57.222569+0000","last_active":"2023-05-17T15:10:57.227390+0000","last_peered":"2023-05-17T15:10:57.227390+0000","last_clean":"2023-05-17T15:10:57.227390+0000","last_became_active":"2023-05-17T15:10:57.221644+0000","last_became_peered":"2023-05-17T15:10:57.221644+0000","last_unstale":"2023-05-17T15:10:57.227390+0000","last_undegraded":"2023-05-17T15:10:57.227390+0000","last_fullsized":"2023-05-17T15:10:57.227390+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228678+0000","last_change":"2023-05-17T15:10:56.835798+0000","last_active":"2023-05-17T15:10:57.228678+0000","last_peered":"2023-05-17T15:10:57.228678+0000","last_clean":"2023-05-17T15:10:57.228678+0000","last_became_active":"2023-05-17T15:10:56.835527+0000","last_became_peered":"2023-05-17T15:10:56.835527+0000","last_unstale":"2023-05-17T15:10:57.228678+0000","last_undegraded":"2023-05-17T15:10:57.228678+0000","last_fullsized":"2023-05-17T15:10:57.228678+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228008+0000","last_change":"2023-05-17T15:10:57.223357+0000","last_active":"2023-05-17T15:10:57.228008+0000","last_peered":"2023-05-17T15:10:57.228008+0000","last_clean":"2023-05-17T15:10:57.228008+0000","last_became_active":"2023-05-17T15:10:57.223105+0000","last_became_peered":"2023-05-17T15:10:57.223105+0000","last_unstale":"2023-05-17T15:10:57.228008+0000","last_undegraded":"2023-05-17T15:10:57.228008+0000","last_fullsized":"2023-05-17T15:10:57.228008+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206373+0000","last_change":"2023-05-17T15:10:56.831199+0000","last_active":"2023-05-17T15:10:57.206373+0000","last_peered":"2023-05-17T15:10:57.206373+0000","last_clean":"2023-05-17T15:10:57.206373+0000","last_became_active":"2023-05-17T15:10:56.830892+0000","last_became_peered":"2023-05-17T15:10:56.830892+0000","last_unstale":"2023-05-17T15:10:57.206373+0000","last_undegraded":"2023-05-17T15:10:57.206373+0000","last_fullsized":"2023-05-17T15:10:57.206373+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235139+0000","last_change":"2023-05-17T15:10:57.232955+0000","last_active":"2023-05-17T15:10:57.235139+0000","last_peered":"2023-05-17T15:10:57.235139+0000","last_clean":"2023-05-17T15:10:57.235139+0000","last_became_active":"2023-05-17T15:10:57.231087+0000","last_became_peered":"2023-05-17T15:10:57.231087+0000","last_unstale":"2023-05-17T15:10:57.235139+0000","last_undegraded":"2023-05-17T15:10:57.235139+0000","last_fullsized":"2023-05-17T15:10:57.235139+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209149+0000","last_change":"2023-05-17T15:10:56.836571+0000","last_active":"2023-05-17T15:10:57.209149+0000","last_peered":"2023-05-17T15:10:57.209149+0000","last_clean":"2023-05-17T15:10:57.209149+0000","last_became_active":"2023-05-17T15:10:56.836309+0000","last_became_peered":"2023-05-17T15:10:56.836309+0000","last_unstale":"2023-05-17T15:10:57.209149+0000","last_undegraded":"2023-05-17T15:10:57.209149+0000","last_fullsized":"2023-05-17T15:10:57.209149+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.223591+0000","last_change":"2023-05-17T15:10:57.221988+0000","last_active":"2023-05-17T15:10:57.223591+0000","last_peered":"2023-05-17T15:10:57.223591+0000","last_clean":"2023-05-17T15:10:57.223591+0000","last_became_active":"2023-05-17T15:10:57.221736+0000","last_became_peered":"2023-05-17T15:10:57.221736+0000","last_unstale":"2023-05-17T15:10:57.223591+0000","last_undegraded":"2023-05-17T15:10:57.223591+0000","last_fullsized":"2023-05-17T15:10:57.223591+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.210187+0000","last_change":"2023-05-17T15:10:56.836097+0000","last_active":"2023-05-17T15:10:57.210187+0000","last_peered":"2023-05-17T15:10:57.210187+0000","last_clean":"2023-05-17T15:10:57.210187+0000","last_became_active":"2023-05-17T15:10:56.831534+0000","last_became_peered":"2023-05-17T15:10:56.831534+0000","last_unstale":"2023-05-17T15:10:57.210187+0000","last_undegraded":"2023-05-17T15:10:57.210187+0000","last_fullsized":"2023-05-17T15:10:57.210187+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224520+0000","last_change":"2023-05-17T15:10:57.214177+0000","last_active":"2023-05-17T15:10:57.224520+0000","last_peered":"2023-05-17T15:10:57.224520+0000","last_clean":"2023-05-17T15:10:57.224520+0000","last_became_active":"2023-05-17T15:10:57.213092+0000","last_became_peered":"2023-05-17T15:10:57.213092+0000","last_unstale":"2023-05-17T15:10:57.224520+0000","last_undegraded":"2023-05-17T15:10:57.224520+0000","last_fullsized":"2023-05-17T15:10:57.224520+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209330+0000","last_change":"2023-05-17T15:10:56.826915+0000","last_active":"2023-05-17T15:10:57.209330+0000","last_peered":"2023-05-17T15:10:57.209330+0000","last_clean":"2023-05-17T15:10:57.209330+0000","last_became_active":"2023-05-17T15:10:56.826574+0000","last_became_peered":"2023-05-17T15:10:56.826574+0000","last_unstale":"2023-05-17T15:10:57.209330+0000","last_undegraded":"2023-05-17T15:10:57.209330+0000","last_fullsized":"2023-05-17T15:10:57.209330+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227369+0000","last_change":"2023-05-17T15:10:57.216838+0000","last_active":"2023-05-17T15:10:57.227369+0000","last_peered":"2023-05-17T15:10:57.227369+0000","last_clean":"2023-05-17T15:10:57.227369+0000","last_became_active":"2023-05-17T15:10:57.216564+0000","last_became_peered":"2023-05-17T15:10:57.216564+0000","last_unstale":"2023-05-17T15:10:57.227369+0000","last_undegraded":"2023-05-17T15:10:57.227369+0000","last_fullsized":"2023-05-17T15:10:57.227369+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207920+0000","last_change":"2023-05-17T15:10:56.831622+0000","last_active":"2023-05-17T15:10:57.207920+0000","last_peered":"2023-05-17T15:10:57.207920+0000","last_clean":"2023-05-17T15:10:57.207920+0000","last_became_active":"2023-05-17T15:10:56.831335+0000","last_became_peered":"2023-05-17T15:10:56.831335+0000","last_unstale":"2023-05-17T15:10:57.207920+0000","last_undegraded":"2023-05-17T15:10:57.207920+0000","last_fullsized":"2023-05-17T15:10:57.207920+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234932+0000","last_change":"2023-05-17T15:10:57.232576+0000","last_active":"2023-05-17T15:10:57.234932+0000","last_peered":"2023-05-17T15:10:57.234932+0000","last_clean":"2023-05-17T15:10:57.234932+0000","last_became_active":"2023-05-17T15:10:57.232423+0000","last_became_peered":"2023-05-17T15:10:57.232423+0000","last_unstale":"2023-05-17T15:10:57.234932+0000","last_undegraded":"2023-05-17T15:10:57.234932+0000","last_fullsized":"2023-05-17T15:10:57.234932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208499+0000","last_change":"2023-05-17T15:10:56.830655+0000","last_active":"2023-05-17T15:10:57.208499+0000","last_peered":"2023-05-17T15:10:57.208499+0000","last_clean":"2023-05-17T15:10:57.208499+0000","last_became_active":"2023-05-17T15:10:56.830224+0000","last_became_peered":"2023-05-17T15:10:56.830224+0000","last_unstale":"2023-05-17T15:10:57.208499+0000","last_undegraded":"2023-05-17T15:10:57.208499+0000","last_fullsized":"2023-05-17T15:10:57.208499+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226940+0000","last_change":"2023-05-17T15:10:57.220044+0000","last_active":"2023-05-17T15:10:57.226940+0000","last_peered":"2023-05-17T15:10:57.226940+0000","last_clean":"2023-05-17T15:10:57.226940+0000","last_became_active":"2023-05-17T15:10:57.219740+0000","last_became_peered":"2023-05-17T15:10:57.219740+0000","last_unstale":"2023-05-17T15:10:57.226940+0000","last_undegraded":"2023-05-17T15:10:57.226940+0000","last_fullsized":"2023-05-17T15:10:57.226940+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215345+0000","last_change":"2023-05-17T15:10:56.841280+0000","last_active":"2023-05-17T15:10:57.215345+0000","last_peered":"2023-05-17T15:10:57.215345+0000","last_clean":"2023-05-17T15:10:57.215345+0000","last_became_active":"2023-05-17T15:10:56.840969+0000","last_became_peered":"2023-05-17T15:10:56.840969+0000","last_unstale":"2023-05-17T15:10:57.215345+0000","last_undegraded":"2023-05-17T15:10:57.215345+0000","last_fullsized":"2023-05-17T15:10:57.215345+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222110+0000","last_change":"2023-05-17T15:10:57.217248+0000","last_active":"2023-05-17T15:10:57.222110+0000","last_peered":"2023-05-17T15:10:57.222110+0000","last_clean":"2023-05-17T15:10:57.222110+0000","last_became_active":"2023-05-17T15:10:57.216934+0000","last_became_peered":"2023-05-17T15:10:57.216934+0000","last_unstale":"2023-05-17T15:10:57.222110+0000","last_undegraded":"2023-05-17T15:10:57.222110+0000","last_fullsized":"2023-05-17T15:10:57.222110+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206923+0000","last_change":"2023-05-17T15:10:56.837090+0000","last_active":"2023-05-17T15:10:57.206923+0000","last_peered":"2023-05-17T15:10:57.206923+0000","last_clean":"2023-05-17T15:10:57.206923+0000","last_became_active":"2023-05-17T15:10:56.836488+0000","last_became_peered":"2023-05-17T15:10:56.836488+0000","last_unstale":"2023-05-17T15:10:57.206923+0000","last_undegraded":"2023-05-17T15:10:57.206923+0000","last_fullsized":"2023-05-17T15:10:57.206923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207724+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:57.207724+0000","last_peered":"2023-05-17T15:10:57.207724+0000","last_clean":"2023-05-17T15:10:57.207724+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:57.207724+0000","last_undegraded":"2023-05-17T15:10:57.207724+0000","last_fullsized":"2023-05-17T15:10:57.207724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222708+0000","last_change":"2023-05-17T15:10:57.220378+0000","last_active":"2023-05-17T15:10:57.222708+0000","last_peered":"2023-05-17T15:10:57.222708+0000","last_clean":"2023-05-17T15:10:57.222708+0000","last_became_active":"2023-05-17T15:10:57.220120+0000","last_became_peered":"2023-05-17T15:10:57.220120+0000","last_unstale":"2023-05-17T15:10:57.222708+0000","last_undegraded":"2023-05-17T15:10:57.222708+0000","last_fullsized":"2023-05-17T15:10:57.222708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213087+0000","last_change":"2023-05-17T15:10:56.830080+0000","last_active":"2023-05-17T15:10:57.213087+0000","last_peered":"2023-05-17T15:10:57.213087+0000","last_clean":"2023-05-17T15:10:57.213087+0000","last_became_active":"2023-05-17T15:10:56.829819+0000","last_became_peered":"2023-05-17T15:10:56.829819+0000","last_unstale":"2023-05-17T15:10:57.213087+0000","last_undegraded":"2023-05-17T15:10:57.213087+0000","last_fullsized":"2023-05-17T15:10:57.213087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205244+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:57.205244+0000","last_peered":"2023-05-17T15:10:57.205244+0000","last_clean":"2023-05-17T15:10:57.205244+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:57.205244+0000","last_undegraded":"2023-05-17T15:10:57.205244+0000","last_fullsized":"2023-05-17T15:10:57.205244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227340+0000","last_change":"2023-05-17T15:10:57.219754+0000","last_active":"2023-05-17T15:10:57.227340+0000","last_peered":"2023-05-17T15:10:57.227340+0000","last_clean":"2023-05-17T15:10:57.227340+0000","last_became_active":"2023-05-17T15:10:57.219481+0000","last_became_peered":"2023-05-17T15:10:57.219481+0000","last_unstale":"2023-05-17T15:10:57.227340+0000","last_undegraded":"2023-05-17T15:10:57.227340+0000","last_fullsized":"2023-05-17T15:10:57.227340+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211833+0000","last_change":"2023-05-17T15:10:56.838145+0000","last_active":"2023-05-17T15:10:57.211833+0000","last_peered":"2023-05-17T15:10:57.211833+0000","last_clean":"2023-05-17T15:10:57.211833+0000","last_became_active":"2023-05-17T15:10:56.837867+0000","last_became_peered":"2023-05-17T15:10:56.837867+0000","last_unstale":"2023-05-17T15:10:57.211833+0000","last_undegraded":"2023-05-17T15:10:57.211833+0000","last_fullsized":"2023-05-17T15:10:57.211833+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206285+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:57.206285+0000","last_peered":"2023-05-17T15:10:57.206285+0000","last_clean":"2023-05-17T15:10:57.206285+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:57.206285+0000","last_undegraded":"2023-05-17T15:10:57.206285+0000","last_fullsized":"2023-05-17T15:10:57.206285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234959+0000","last_change":"2023-05-17T15:10:57.231513+0000","last_active":"2023-05-17T15:10:57.234959+0000","last_peered":"2023-05-17T15:10:57.234959+0000","last_clean":"2023-05-17T15:10:57.234959+0000","last_became_active":"2023-05-17T15:10:57.230999+0000","last_became_peered":"2023-05-17T15:10:57.230999+0000","last_unstale":"2023-05-17T15:10:57.234959+0000","last_undegraded":"2023-05-17T15:10:57.234959+0000","last_fullsized":"2023-05-17T15:10:57.234959+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.231270+0000","last_change":"2023-05-17T15:10:56.827814+0000","last_active":"2023-05-17T15:10:57.231270+0000","last_peered":"2023-05-17T15:10:57.231270+0000","last_clean":"2023-05-17T15:10:57.231270+0000","last_became_active":"2023-05-17T15:10:56.827512+0000","last_became_peered":"2023-05-17T15:10:56.827512+0000","last_unstale":"2023-05-17T15:10:57.231270+0000","last_undegraded":"2023-05-17T15:10:57.231270+0000","last_fullsized":"2023-05-17T15:10:57.231270+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207212+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:57.207212+0000","last_peered":"2023-05-17T15:10:57.207212+0000","last_clean":"2023-05-17T15:10:57.207212+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:57.207212+0000","last_undegraded":"2023-05-17T15:10:57.207212+0000","last_fullsized":"2023-05-17T15:10:57.207212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215509+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:57.215509+0000","last_peered":"2023-05-17T15:10:57.215509+0000","last_clean":"2023-05-17T15:10:57.215509+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:57.215509+0000","last_undegraded":"2023-05-17T15:10:57.215509+0000","last_fullsized":"2023-05-17T15:10:57.215509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.230047+0000","last_change":"2023-05-17T15:10:57.226990+0000","last_active":"2023-05-17T15:10:57.230047+0000","last_peered":"2023-05-17T15:10:57.230047+0000","last_clean":"2023-05-17T15:10:57.230047+0000","last_became_active":"2023-05-17T15:10:57.225515+0000","last_became_peered":"2023-05-17T15:10:57.225515+0000","last_unstale":"2023-05-17T15:10:57.230047+0000","last_undegraded":"2023-05-17T15:10:57.230047+0000","last_fullsized":"2023-05-17T15:10:57.230047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233384+0000","last_change":"2023-05-17T15:10:56.837257+0000","last_active":"2023-05-17T15:10:57.233384+0000","last_peered":"2023-05-17T15:10:57.233384+0000","last_clean":"2023-05-17T15:10:57.233384+0000","last_became_active":"2023-05-17T15:10:56.836895+0000","last_became_peered":"2023-05-17T15:10:56.836895+0000","last_unstale":"2023-05-17T15:10:57.233384+0000","last_undegraded":"2023-05-17T15:10:57.233384+0000","last_fullsized":"2023-05-17T15:10:57.233384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215594+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:57.215594+0000","last_peered":"2023-05-17T15:10:57.215594+0000","last_clean":"2023-05-17T15:10:57.215594+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:57.215594+0000","last_undegraded":"2023-05-17T15:10:57.215594+0000","last_fullsized":"2023-05-17T15:10:57.215594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219609+0000","last_change":"2023-05-17T15:10:57.215430+0000","last_active":"2023-05-17T15:10:57.219609+0000","last_peered":"2023-05-17T15:10:57.219609+0000","last_clean":"2023-05-17T15:10:57.219609+0000","last_became_active":"2023-05-17T15:10:57.215080+0000","last_became_peered":"2023-05-17T15:10:57.215080+0000","last_unstale":"2023-05-17T15:10:57.219609+0000","last_undegraded":"2023-05-17T15:10:57.219609+0000","last_fullsized":"2023-05-17T15:10:57.219609+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208004+0000","last_change":"2023-05-17T15:10:56.827772+0000","last_active":"2023-05-17T15:10:57.208004+0000","last_peered":"2023-05-17T15:10:57.208004+0000","last_clean":"2023-05-17T15:10:57.208004+0000","last_became_active":"2023-05-17T15:10:56.827497+0000","last_became_peered":"2023-05-17T15:10:56.827497+0000","last_unstale":"2023-05-17T15:10:57.208004+0000","last_undegraded":"2023-05-17T15:10:57.208004+0000","last_fullsized":"2023-05-17T15:10:57.208004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224486+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:57.224486+0000","last_peered":"2023-05-17T15:10:57.224486+0000","last_clean":"2023-05-17T15:10:57.224486+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:57.224486+0000","last_undegraded":"2023-05-17T15:10:57.224486+0000","last_fullsized":"2023-05-17T15:10:57.224486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227275+0000","last_change":"2023-05-17T15:10:57.222582+0000","last_active":"2023-05-17T15:10:57.227275+0000","last_peered":"2023-05-17T15:10:57.227275+0000","last_clean":"2023-05-17T15:10:57.227275+0000","last_became_active":"2023-05-17T15:10:57.222321+0000","last_became_peered":"2023-05-17T15:10:57.222321+0000","last_unstale":"2023-05-17T15:10:57.227275+0000","last_undegraded":"2023-05-17T15:10:57.227275+0000","last_fullsized":"2023-05-17T15:10:57.227275+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232053+0000","last_change":"2023-05-17T15:10:56.833302+0000","last_active":"2023-05-17T15:10:57.232053+0000","last_peered":"2023-05-17T15:10:57.232053+0000","last_clean":"2023-05-17T15:10:57.232053+0000","last_became_active":"2023-05-17T15:10:56.832985+0000","last_became_peered":"2023-05-17T15:10:56.832985+0000","last_unstale":"2023-05-17T15:10:57.232053+0000","last_undegraded":"2023-05-17T15:10:57.232053+0000","last_fullsized":"2023-05-17T15:10:57.232053+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206086+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:57.206086+0000","last_peered":"2023-05-17T15:10:57.206086+0000","last_clean":"2023-05-17T15:10:57.206086+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:57.206086+0000","last_undegraded":"2023-05-17T15:10:57.206086+0000","last_fullsized":"2023-05-17T15:10:57.206086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221331+0000","last_change":"2023-05-17T15:10:57.217668+0000","last_active":"2023-05-17T15:10:57.221331+0000","last_peered":"2023-05-17T15:10:57.221331+0000","last_clean":"2023-05-17T15:10:57.221331+0000","last_became_active":"2023-05-17T15:10:57.217204+0000","last_became_peered":"2023-05-17T15:10:57.217204+0000","last_unstale":"2023-05-17T15:10:57.221331+0000","last_undegraded":"2023-05-17T15:10:57.221331+0000","last_fullsized":"2023-05-17T15:10:57.221331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.229305+0000","last_change":"2023-05-17T15:10:56.829548+0000","last_active":"2023-05-17T15:10:57.229305+0000","last_peered":"2023-05-17T15:10:57.229305+0000","last_clean":"2023-05-17T15:10:57.229305+0000","last_became_active":"2023-05-17T15:10:56.829265+0000","last_became_peered":"2023-05-17T15:10:56.829265+0000","last_unstale":"2023-05-17T15:10:57.229305+0000","last_undegraded":"2023-05-17T15:10:57.229305+0000","last_fullsized":"2023-05-17T15:10:57.229305+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207013+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:57.207013+0000","last_peered":"2023-05-17T15:10:57.207013+0000","last_clean":"2023-05-17T15:10:57.207013+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:57.207013+0000","last_undegraded":"2023-05-17T15:10:57.207013+0000","last_fullsized":"2023-05-17T15:10:57.207013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":17408,"kb_avail":94352716,"statfs":{"total":96636764160,"available":96617181184,"internally_reserved":0,"allocated":1748992,"data_stored":875644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17825792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.62}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.57399999999999995}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.35599999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575051,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18668,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":16960,"kb_avail":94353172,"statfs":{"total":96636764160,"available":96617648128,"internally_reserved":0,"allocated":1740800,"data_stored":876004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17367040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":3.427},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":4.4779999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":1.0229999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":1.171},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":1.2809999999999999}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":3.1150000000000002}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.625},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":1.452}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":1.21},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0640000000000001}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":2.6259999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.246}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18476,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353364,"statfs":{"total":96636764160,"available":96617844736,"internally_reserved":0,"allocated":1740800,"data_stored":875472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23899999999999999},"max":{"1min":0.55000000000000004,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.51800000000000002,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.20000000000000001},"max":{"1min":0.64700000000000002,"5min":1.956,"15min":1.956},"last":0.26900000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":1.149,"15min":1.149},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96599999999999997,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89600000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":1.103,"15min":1.103},"last":1.3779999999999999}]},{"osd":6,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.65800000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.99199999999999999,"5min":1.524,"15min":1.524},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66900000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18292,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353548,"statfs":{"total":96636764160,"available":96618033152,"internally_reserved":0,"allocated":1748992,"data_stored":876918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19504,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":17792,"kb_avail":94352336,"statfs":{"total":96636764160,"available":96616792064,"internally_reserved":0,"allocated":1744896,"data_stored":876412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18219008},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.253},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.626}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575051,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22516,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349324,"statfs":{"total":96636764160,"available":96613707776,"internally_reserved":0,"allocated":1748992,"data_stored":876128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18928,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":17216,"kb_avail":94352912,"statfs":{"total":96636764160,"available":96617381888,"internally_reserved":0,"allocated":1744896,"data_stored":876094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17629184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.747},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.623}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22060,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":20352,"kb_avail":94349780,"statfs":{"total":96636764160,"available":96614174720,"internally_reserved":0,"allocated":1740800,"data_stored":875540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20840448},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:11:03.059 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-05-17T15:11:03.055+0000 7f03dca98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:11:05.713 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:11:05.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.841+0000 7f1eada7a700 1 Processor -- start 2023-05-17T15:11:05.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.841+0000 7f1eada7a700 1 -- start start 2023-05-17T15:11:05.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1eada7a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ea80c1730 0x7f1ea81543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1eada7a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea80bfcd0 con 0x7f1ea80c6310 2023-05-17T15:11:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1eada7a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea80c0290 con 0x7f1ea80c5f30 2023-05-17T15:11:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1eada7a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80aa1a0 con 0x7f1ea80c1730 2023-05-17T15:11:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1ea7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ea80c1730 0x7f1ea81543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1ea6ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1ea80c6310 0x7f1ea8153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43346/0 (socket says 172.21.15.27:43346) 2023-05-17T15:11:05.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.842+0000 7f1ea6ffd700 1 -- 172.21.15.27:0/885169978 learned_addr learned my addr 172.21.15.27:0/885169978 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea7fff700 1 -- 172.21.15.27:0/885169978 >> v1:172.21.15.40:6789/0 conn(0x7f1ea80c5f30 legacy=0x7f1ea8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea7fff700 1 -- 172.21.15.27:0/885169978 >> v1:172.21.15.27:6789/0 conn(0x7f1ea80c6310 legacy=0x7f1ea8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea7fff700 1 -- 172.21.15.27:0/885169978 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80aa480 con 0x7f1ea80c1730 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea67fc700 1 -- 172.21.15.27:0/885169978 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071130110 0 0) 0x7f1ea80bfcd0 con 0x7f1ea80c6310 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea7fff700 1 --2- 172.21.15.27:0/885169978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c1730 0x7f1ea81543e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f1ea0009e60 tx=0x7f1ea0009780).ready entity=mon.0 client_cookie=47e37415ac27df0d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea67fc700 1 -- 172.21.15.27:0/885169978 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000e070 con 0x7f1ea80c1730 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea67fc700 1 -- 172.21.15.27:0/885169978 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea000bc30 con 0x7f1ea80c1730 2023-05-17T15:11:05.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1ea67fc700 1 -- 172.21.15.27:0/885169978 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0012410 con 0x7f1ea80c1730 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1eada7a700 1 -- 172.21.15.27:0/885169978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c1730 msgr2=0x7f1ea81543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1eada7a700 1 --2- 172.21.15.27:0/885169978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c1730 0x7f1ea81543e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f1ea0009e60 tx=0x7f1ea0009780).stop 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1eada7a700 1 -- 172.21.15.27:0/885169978 shutdown_connections 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1eada7a700 1 --2- 172.21.15.27:0/885169978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c1730 0x7f1ea81543e0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.843+0000 7f1eada7a700 1 -- 172.21.15.27:0/885169978 >> 172.21.15.27:0/885169978 conn(0x7f1ea8069e70 msgr2=0x7f1ea805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.844+0000 7f1eada7a700 1 -- 172.21.15.27:0/885169978 shutdown_connections 2023-05-17T15:11:05.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.844+0000 7f1eada7a700 1 -- 172.21.15.27:0/885169978 wait complete. 2023-05-17T15:11:05.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.845+0000 7f1eada7a700 1 Processor -- start 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.845+0000 7f1eada7a700 1 -- start start 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea80c1730 0x7f1ea813d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 0x7f1ea80c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea80c6310 0x7f1ea80c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea813d590 con 0x7f1ea80c5f30 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80c3370 con 0x7f1ea80c1730 2023-05-17T15:11:05.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80c3cf0 con 0x7f1ea80c6310 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 0x7f1ea80c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 0x7f1ea80c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43790/0 (socket says 172.21.15.27:43790) 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 -- 172.21.15.27:0/3963365677 learned_addr learned my addr 172.21.15.27:0/3963365677 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea7fff700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea80c6310 0x7f1ea80c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea77fe700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea80c1730 0x7f1ea813d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 -- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea80c6310 msgr2=0x7f1ea80c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea80c6310 0x7f1ea80c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:05.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 -- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea80c1730 msgr2=0x7f1ea813d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea80c1730 0x7f1ea813d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 -- 172.21.15.27:0/3963365677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0009a20 con 0x7f1ea80c5f30 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1ea6ffd700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 0x7f1ea80c3800 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f1e9c00c490 tx=0x7f1e9c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0070d0 con 0x7f1ea80c5f30 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c007250 con 0x7f1ea80c5f30 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea80c2760 con 0x7f1ea80c5f30 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c007610 con 0x7f1ea80c5f30 2023-05-17T15:11:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.846+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea80c2d20 con 0x7f1ea80c5f30 2023-05-17T15:11:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.848+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea80c3500 con 0x7f1ea80c5f30 2023-05-17T15:11:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.848+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1e9c010070 con 0x7f1ea80c5f30 2023-05-17T15:11:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.848+0000 7f1e8f7fe700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1e9405ed90 0x7f1e94061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.848+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f1e9c0791e0 con 0x7f1ea80c5f30 2023-05-17T15:11:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.849+0000 7f1ea77fe700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1e9405ed90 0x7f1e94061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.849+0000 7f1ea77fe700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1e9405ed90 0x7f1e94061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1e98003900 tx=0x7f1e98007d40).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:05.853+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e9c04a720 con 0x7f1ea80c5f30 2023-05-17T15:11:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.020+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ea805f4a0 con 0x7f1e9405ed90 2023-05-17T15:11:06.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.030+0000 7f1e8f7fe700 1 -- 172.21.15.27:0/3963365677 <== mgr.7842 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361555 (secure 0 0 0) 0x7f1ea805f4a0 con 0x7f1e9405ed90 2023-05-17T15:11:06.038 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1e9405ed90 msgr2=0x7f1e94061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1e9405ed90 0x7f1e94061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1e98003900 tx=0x7f1e98007d40).stop 2023-05-17T15:11:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 msgr2=0x7f1ea80c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 0x7f1ea80c3800 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f1e9c00c490 tx=0x7f1e9c007e40).stop 2023-05-17T15:11:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 shutdown_connections 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f1e9405ed90 0x7f1e94061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea80c6310 0x7f1ea80c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea80c1730 0x7f1ea813d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 --2- 172.21.15.27:0/3963365677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ea80c5f30 0x7f1ea80c3800 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 >> 172.21.15.27:0/3963365677 conn(0x7f1ea8069e70 msgr2=0x7f1ea80ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 shutdown_connections 2023-05-17T15:11:06.041 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.034+0000 7f1eada7a700 1 -- 172.21.15.27:0/3963365677 wait complete. 2023-05-17T15:11:06.042 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:11:06.050 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-17T15:11:05.698835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":157568,"kb_used_data":13632,"kb_used_omap":0,"kb_used_meta":143872,"kb_avail":754817152,"statfs":{"total":773094113280,"available":772932763648,"internally_reserved":0,"allocated":13959168,"data_stored":7008212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":147324928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10278,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.011396"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234889+0000","last_change":"2023-05-17T15:10:57.231439+0000","last_active":"2023-05-17T15:10:57.234889+0000","last_peered":"2023-05-17T15:10:57.234889+0000","last_clean":"2023-05-17T15:10:57.234889+0000","last_became_active":"2023-05-17T15:10:57.231117+0000","last_became_peered":"2023-05-17T15:10:57.231117+0000","last_unstale":"2023-05-17T15:10:57.234889+0000","last_undegraded":"2023-05-17T15:10:57.234889+0000","last_fullsized":"2023-05-17T15:10:57.234889+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232058+0000","last_change":"2023-05-17T15:10:56.832856+0000","last_active":"2023-05-17T15:10:57.232058+0000","last_peered":"2023-05-17T15:10:57.232058+0000","last_clean":"2023-05-17T15:10:57.232058+0000","last_became_active":"2023-05-17T15:10:56.832558+0000","last_became_peered":"2023-05-17T15:10:56.832558+0000","last_unstale":"2023-05-17T15:10:57.232058+0000","last_undegraded":"2023-05-17T15:10:57.232058+0000","last_fullsized":"2023-05-17T15:10:57.232058+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227111+0000","last_change":"2023-05-17T15:10:57.218961+0000","last_active":"2023-05-17T15:10:57.227111+0000","last_peered":"2023-05-17T15:10:57.227111+0000","last_clean":"2023-05-17T15:10:57.227111+0000","last_became_active":"2023-05-17T15:10:57.217542+0000","last_became_peered":"2023-05-17T15:10:57.217542+0000","last_unstale":"2023-05-17T15:10:57.227111+0000","last_undegraded":"2023-05-17T15:10:57.227111+0000","last_fullsized":"2023-05-17T15:10:57.227111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208490+0000","last_change":"2023-05-17T15:10:56.834250+0000","last_active":"2023-05-17T15:10:57.208490+0000","last_peered":"2023-05-17T15:10:57.208490+0000","last_clean":"2023-05-17T15:10:57.208490+0000","last_became_active":"2023-05-17T15:10:56.833982+0000","last_became_peered":"2023-05-17T15:10:56.833982+0000","last_unstale":"2023-05-17T15:10:57.208490+0000","last_undegraded":"2023-05-17T15:10:57.208490+0000","last_fullsized":"2023-05-17T15:10:57.208490+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232841+0000","last_change":"2023-05-17T15:10:57.230075+0000","last_active":"2023-05-17T15:10:57.232841+0000","last_peered":"2023-05-17T15:10:57.232841+0000","last_clean":"2023-05-17T15:10:57.232841+0000","last_became_active":"2023-05-17T15:10:57.229851+0000","last_became_peered":"2023-05-17T15:10:57.229851+0000","last_unstale":"2023-05-17T15:10:57.232841+0000","last_undegraded":"2023-05-17T15:10:57.232841+0000","last_fullsized":"2023-05-17T15:10:57.232841+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.223961+0000","last_change":"2023-05-17T15:10:56.839662+0000","last_active":"2023-05-17T15:10:57.223961+0000","last_peered":"2023-05-17T15:10:57.223961+0000","last_clean":"2023-05-17T15:10:57.223961+0000","last_became_active":"2023-05-17T15:10:56.839412+0000","last_became_peered":"2023-05-17T15:10:56.839412+0000","last_unstale":"2023-05-17T15:10:57.223961+0000","last_undegraded":"2023-05-17T15:10:57.223961+0000","last_fullsized":"2023-05-17T15:10:57.223961+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227992+0000","last_change":"2023-05-17T15:10:57.217169+0000","last_active":"2023-05-17T15:10:57.227992+0000","last_peered":"2023-05-17T15:10:57.227992+0000","last_clean":"2023-05-17T15:10:57.227992+0000","last_became_active":"2023-05-17T15:10:57.216851+0000","last_became_peered":"2023-05-17T15:10:57.216851+0000","last_unstale":"2023-05-17T15:10:57.227992+0000","last_undegraded":"2023-05-17T15:10:57.227992+0000","last_fullsized":"2023-05-17T15:10:57.227992+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.229484+0000","last_change":"2023-05-17T15:10:56.838881+0000","last_active":"2023-05-17T15:10:57.229484+0000","last_peered":"2023-05-17T15:10:57.229484+0000","last_clean":"2023-05-17T15:10:57.229484+0000","last_became_active":"2023-05-17T15:10:56.836360+0000","last_became_peered":"2023-05-17T15:10:56.836360+0000","last_unstale":"2023-05-17T15:10:57.229484+0000","last_undegraded":"2023-05-17T15:10:57.229484+0000","last_fullsized":"2023-05-17T15:10:57.229484+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226859+0000","last_change":"2023-05-17T15:10:57.217310+0000","last_active":"2023-05-17T15:10:57.226859+0000","last_peered":"2023-05-17T15:10:57.226859+0000","last_clean":"2023-05-17T15:10:57.226859+0000","last_became_active":"2023-05-17T15:10:57.217067+0000","last_became_peered":"2023-05-17T15:10:57.217067+0000","last_unstale":"2023-05-17T15:10:57.226859+0000","last_undegraded":"2023-05-17T15:10:57.226859+0000","last_fullsized":"2023-05-17T15:10:57.226859+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227204+0000","last_change":"2023-05-17T15:10:56.828562+0000","last_active":"2023-05-17T15:10:57.227204+0000","last_peered":"2023-05-17T15:10:57.227204+0000","last_clean":"2023-05-17T15:10:57.227204+0000","last_became_active":"2023-05-17T15:10:56.828263+0000","last_became_peered":"2023-05-17T15:10:56.828263+0000","last_unstale":"2023-05-17T15:10:57.227204+0000","last_undegraded":"2023-05-17T15:10:57.227204+0000","last_fullsized":"2023-05-17T15:10:57.227204+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233123+0000","last_change":"2023-05-17T15:10:57.232414+0000","last_active":"2023-05-17T15:10:57.233123+0000","last_peered":"2023-05-17T15:10:57.233123+0000","last_clean":"2023-05-17T15:10:57.233123+0000","last_became_active":"2023-05-17T15:10:57.232117+0000","last_became_peered":"2023-05-17T15:10:57.232117+0000","last_unstale":"2023-05-17T15:10:57.233123+0000","last_undegraded":"2023-05-17T15:10:57.233123+0000","last_fullsized":"2023-05-17T15:10:57.233123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227885+0000","last_change":"2023-05-17T15:10:56.839017+0000","last_active":"2023-05-17T15:10:57.227885+0000","last_peered":"2023-05-17T15:10:57.227885+0000","last_clean":"2023-05-17T15:10:57.227885+0000","last_became_active":"2023-05-17T15:10:56.838716+0000","last_became_peered":"2023-05-17T15:10:56.838716+0000","last_unstale":"2023-05-17T15:10:57.227885+0000","last_undegraded":"2023-05-17T15:10:57.227885+0000","last_fullsized":"2023-05-17T15:10:57.227885+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227328+0000","last_change":"2023-05-17T15:10:57.224895+0000","last_active":"2023-05-17T15:10:57.227328+0000","last_peered":"2023-05-17T15:10:57.227328+0000","last_clean":"2023-05-17T15:10:57.227328+0000","last_became_active":"2023-05-17T15:10:57.224534+0000","last_became_peered":"2023-05-17T15:10:57.224534+0000","last_unstale":"2023-05-17T15:10:57.227328+0000","last_undegraded":"2023-05-17T15:10:57.227328+0000","last_fullsized":"2023-05-17T15:10:57.227328+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205984+0000","last_change":"2023-05-17T15:10:56.834017+0000","last_active":"2023-05-17T15:10:57.205984+0000","last_peered":"2023-05-17T15:10:57.205984+0000","last_clean":"2023-05-17T15:10:57.205984+0000","last_became_active":"2023-05-17T15:10:56.832528+0000","last_became_peered":"2023-05-17T15:10:56.832528+0000","last_unstale":"2023-05-17T15:10:57.205984+0000","last_undegraded":"2023-05-17T15:10:57.205984+0000","last_fullsized":"2023-05-17T15:10:57.205984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228832+0000","last_change":"2023-05-17T15:10:57.226850+0000","last_active":"2023-05-17T15:10:57.228832+0000","last_peered":"2023-05-17T15:10:57.228832+0000","last_clean":"2023-05-17T15:10:57.228832+0000","last_became_active":"2023-05-17T15:10:57.226532+0000","last_became_peered":"2023-05-17T15:10:57.226532+0000","last_unstale":"2023-05-17T15:10:57.228832+0000","last_undegraded":"2023-05-17T15:10:57.228832+0000","last_fullsized":"2023-05-17T15:10:57.228832+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215134+0000","last_change":"2023-05-17T15:10:56.841641+0000","last_active":"2023-05-17T15:10:57.215134+0000","last_peered":"2023-05-17T15:10:57.215134+0000","last_clean":"2023-05-17T15:10:57.215134+0000","last_became_active":"2023-05-17T15:10:56.841348+0000","last_became_peered":"2023-05-17T15:10:56.841348+0000","last_unstale":"2023-05-17T15:10:57.215134+0000","last_undegraded":"2023-05-17T15:10:57.215134+0000","last_fullsized":"2023-05-17T15:10:57.215134+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225702+0000","last_change":"2023-05-17T15:10:57.220804+0000","last_active":"2023-05-17T15:10:57.225702+0000","last_peered":"2023-05-17T15:10:57.225702+0000","last_clean":"2023-05-17T15:10:57.225702+0000","last_became_active":"2023-05-17T15:10:57.219896+0000","last_became_peered":"2023-05-17T15:10:57.219896+0000","last_unstale":"2023-05-17T15:10:57.225702+0000","last_undegraded":"2023-05-17T15:10:57.225702+0000","last_fullsized":"2023-05-17T15:10:57.225702+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205865+0000","last_change":"2023-05-17T15:10:56.829766+0000","last_active":"2023-05-17T15:10:57.205865+0000","last_peered":"2023-05-17T15:10:57.205865+0000","last_clean":"2023-05-17T15:10:57.205865+0000","last_became_active":"2023-05-17T15:10:56.829476+0000","last_became_peered":"2023-05-17T15:10:56.829476+0000","last_unstale":"2023-05-17T15:10:57.205865+0000","last_undegraded":"2023-05-17T15:10:57.205865+0000","last_fullsized":"2023-05-17T15:10:57.205865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228105+0000","last_change":"2023-05-17T15:10:57.222990+0000","last_active":"2023-05-17T15:10:57.228105+0000","last_peered":"2023-05-17T15:10:57.228105+0000","last_clean":"2023-05-17T15:10:57.228105+0000","last_became_active":"2023-05-17T15:10:57.222492+0000","last_became_peered":"2023-05-17T15:10:57.222492+0000","last_unstale":"2023-05-17T15:10:57.228105+0000","last_undegraded":"2023-05-17T15:10:57.228105+0000","last_fullsized":"2023-05-17T15:10:57.228105+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206451+0000","last_change":"2023-05-17T15:10:56.835464+0000","last_active":"2023-05-17T15:10:57.206451+0000","last_peered":"2023-05-17T15:10:57.206451+0000","last_clean":"2023-05-17T15:10:57.206451+0000","last_became_active":"2023-05-17T15:10:56.833882+0000","last_became_peered":"2023-05-17T15:10:56.833882+0000","last_unstale":"2023-05-17T15:10:57.206451+0000","last_undegraded":"2023-05-17T15:10:57.206451+0000","last_fullsized":"2023-05-17T15:10:57.206451+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224131+0000","last_change":"2023-05-17T15:10:57.213885+0000","last_active":"2023-05-17T15:10:57.224131+0000","last_peered":"2023-05-17T15:10:57.224131+0000","last_clean":"2023-05-17T15:10:57.224131+0000","last_became_active":"2023-05-17T15:10:57.213575+0000","last_became_peered":"2023-05-17T15:10:57.213575+0000","last_unstale":"2023-05-17T15:10:57.224131+0000","last_undegraded":"2023-05-17T15:10:57.224131+0000","last_fullsized":"2023-05-17T15:10:57.224131+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209304+0000","last_change":"2023-05-17T15:10:56.832141+0000","last_active":"2023-05-17T15:10:57.209304+0000","last_peered":"2023-05-17T15:10:57.209304+0000","last_clean":"2023-05-17T15:10:57.209304+0000","last_became_active":"2023-05-17T15:10:56.831844+0000","last_became_peered":"2023-05-17T15:10:56.831844+0000","last_unstale":"2023-05-17T15:10:57.209304+0000","last_undegraded":"2023-05-17T15:10:57.209304+0000","last_fullsized":"2023-05-17T15:10:57.209304+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233812+0000","last_change":"2023-05-17T15:10:57.231257+0000","last_active":"2023-05-17T15:10:57.233812+0000","last_peered":"2023-05-17T15:10:57.233812+0000","last_clean":"2023-05-17T15:10:57.233812+0000","last_became_active":"2023-05-17T15:10:57.230945+0000","last_became_peered":"2023-05-17T15:10:57.230945+0000","last_unstale":"2023-05-17T15:10:57.233812+0000","last_undegraded":"2023-05-17T15:10:57.233812+0000","last_fullsized":"2023-05-17T15:10:57.233812+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232104+0000","last_change":"2023-05-17T15:10:56.831837+0000","last_active":"2023-05-17T15:10:57.232104+0000","last_peered":"2023-05-17T15:10:57.232104+0000","last_clean":"2023-05-17T15:10:57.232104+0000","last_became_active":"2023-05-17T15:10:56.831011+0000","last_became_peered":"2023-05-17T15:10:56.831011+0000","last_unstale":"2023-05-17T15:10:57.232104+0000","last_undegraded":"2023-05-17T15:10:57.232104+0000","last_fullsized":"2023-05-17T15:10:57.232104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222029+0000","last_change":"2023-05-17T15:10:57.213569+0000","last_active":"2023-05-17T15:10:57.222029+0000","last_peered":"2023-05-17T15:10:57.222029+0000","last_clean":"2023-05-17T15:10:57.222029+0000","last_became_active":"2023-05-17T15:10:57.213285+0000","last_became_peered":"2023-05-17T15:10:57.213285+0000","last_unstale":"2023-05-17T15:10:57.222029+0000","last_undegraded":"2023-05-17T15:10:57.222029+0000","last_fullsized":"2023-05-17T15:10:57.222029+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233137+0000","last_change":"2023-05-17T15:10:56.840789+0000","last_active":"2023-05-17T15:10:57.233137+0000","last_peered":"2023-05-17T15:10:57.233137+0000","last_clean":"2023-05-17T15:10:57.233137+0000","last_became_active":"2023-05-17T15:10:56.840561+0000","last_became_peered":"2023-05-17T15:10:56.840561+0000","last_unstale":"2023-05-17T15:10:57.233137+0000","last_undegraded":"2023-05-17T15:10:57.233137+0000","last_fullsized":"2023-05-17T15:10:57.233137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228187+0000","last_change":"2023-05-17T15:10:57.223796+0000","last_active":"2023-05-17T15:10:57.228187+0000","last_peered":"2023-05-17T15:10:57.228187+0000","last_clean":"2023-05-17T15:10:57.228187+0000","last_became_active":"2023-05-17T15:10:57.222389+0000","last_became_peered":"2023-05-17T15:10:57.222389+0000","last_unstale":"2023-05-17T15:10:57.228187+0000","last_undegraded":"2023-05-17T15:10:57.228187+0000","last_fullsized":"2023-05-17T15:10:57.228187+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219811+0000","last_change":"2023-05-17T15:10:56.837666+0000","last_active":"2023-05-17T15:10:57.219811+0000","last_peered":"2023-05-17T15:10:57.219811+0000","last_clean":"2023-05-17T15:10:57.219811+0000","last_became_active":"2023-05-17T15:10:56.837330+0000","last_became_peered":"2023-05-17T15:10:56.837330+0000","last_unstale":"2023-05-17T15:10:57.219811+0000","last_undegraded":"2023-05-17T15:10:57.219811+0000","last_fullsized":"2023-05-17T15:10:57.219811+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227698+0000","last_change":"2023-05-17T15:10:57.223730+0000","last_active":"2023-05-17T15:10:57.227698+0000","last_peered":"2023-05-17T15:10:57.227698+0000","last_clean":"2023-05-17T15:10:57.227698+0000","last_became_active":"2023-05-17T15:10:57.223035+0000","last_became_peered":"2023-05-17T15:10:57.223035+0000","last_unstale":"2023-05-17T15:10:57.227698+0000","last_undegraded":"2023-05-17T15:10:57.227698+0000","last_fullsized":"2023-05-17T15:10:57.227698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207014+0000","last_change":"2023-05-17T15:10:56.834347+0000","last_active":"2023-05-17T15:10:57.207014+0000","last_peered":"2023-05-17T15:10:57.207014+0000","last_clean":"2023-05-17T15:10:57.207014+0000","last_became_active":"2023-05-17T15:10:56.834051+0000","last_became_peered":"2023-05-17T15:10:56.834051+0000","last_unstale":"2023-05-17T15:10:57.207014+0000","last_undegraded":"2023-05-17T15:10:57.207014+0000","last_fullsized":"2023-05-17T15:10:57.207014+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226982+0000","last_change":"2023-05-17T15:10:57.220386+0000","last_active":"2023-05-17T15:10:57.226982+0000","last_peered":"2023-05-17T15:10:57.226982+0000","last_clean":"2023-05-17T15:10:57.226982+0000","last_became_active":"2023-05-17T15:10:57.220055+0000","last_became_peered":"2023-05-17T15:10:57.220055+0000","last_unstale":"2023-05-17T15:10:57.226982+0000","last_undegraded":"2023-05-17T15:10:57.226982+0000","last_fullsized":"2023-05-17T15:10:57.226982+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233714+0000","last_change":"2023-05-17T15:10:56.842907+0000","last_active":"2023-05-17T15:10:57.233714+0000","last_peered":"2023-05-17T15:10:57.233714+0000","last_clean":"2023-05-17T15:10:57.233714+0000","last_became_active":"2023-05-17T15:10:56.842535+0000","last_became_peered":"2023-05-17T15:10:56.842535+0000","last_unstale":"2023-05-17T15:10:57.233714+0000","last_undegraded":"2023-05-17T15:10:57.233714+0000","last_fullsized":"2023-05-17T15:10:57.233714+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.220702+0000","last_change":"2023-05-17T15:10:57.214051+0000","last_active":"2023-05-17T15:10:57.220702+0000","last_peered":"2023-05-17T15:10:57.220702+0000","last_clean":"2023-05-17T15:10:57.220702+0000","last_became_active":"2023-05-17T15:10:57.213766+0000","last_became_peered":"2023-05-17T15:10:57.213766+0000","last_unstale":"2023-05-17T15:10:57.220702+0000","last_undegraded":"2023-05-17T15:10:57.220702+0000","last_fullsized":"2023-05-17T15:10:57.220702+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213724+0000","last_change":"2023-05-17T15:10:56.828650+0000","last_active":"2023-05-17T15:10:57.213724+0000","last_peered":"2023-05-17T15:10:57.213724+0000","last_clean":"2023-05-17T15:10:57.213724+0000","last_became_active":"2023-05-17T15:10:56.827988+0000","last_became_peered":"2023-05-17T15:10:56.827988+0000","last_unstale":"2023-05-17T15:10:57.213724+0000","last_undegraded":"2023-05-17T15:10:57.213724+0000","last_fullsized":"2023-05-17T15:10:57.213724+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222227+0000","last_change":"2023-05-17T15:10:57.217989+0000","last_active":"2023-05-17T15:10:57.222227+0000","last_peered":"2023-05-17T15:10:57.222227+0000","last_clean":"2023-05-17T15:10:57.222227+0000","last_became_active":"2023-05-17T15:10:57.216742+0000","last_became_peered":"2023-05-17T15:10:57.216742+0000","last_unstale":"2023-05-17T15:10:57.222227+0000","last_undegraded":"2023-05-17T15:10:57.222227+0000","last_fullsized":"2023-05-17T15:10:57.222227+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206250+0000","last_change":"2023-05-17T15:10:56.827238+0000","last_active":"2023-05-17T15:10:57.206250+0000","last_peered":"2023-05-17T15:10:57.206250+0000","last_clean":"2023-05-17T15:10:57.206250+0000","last_became_active":"2023-05-17T15:10:56.826951+0000","last_became_peered":"2023-05-17T15:10:56.826951+0000","last_unstale":"2023-05-17T15:10:57.206250+0000","last_undegraded":"2023-05-17T15:10:57.206250+0000","last_fullsized":"2023-05-17T15:10:57.206250+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232863+0000","last_change":"2023-05-17T15:10:57.230081+0000","last_active":"2023-05-17T15:10:57.232863+0000","last_peered":"2023-05-17T15:10:57.232863+0000","last_clean":"2023-05-17T15:10:57.232863+0000","last_became_active":"2023-05-17T15:10:57.229804+0000","last_became_peered":"2023-05-17T15:10:57.229804+0000","last_unstale":"2023-05-17T15:10:57.232863+0000","last_undegraded":"2023-05-17T15:10:57.232863+0000","last_fullsized":"2023-05-17T15:10:57.232863+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235031+0000","last_change":"2023-05-17T15:10:56.841201+0000","last_active":"2023-05-17T15:10:57.235031+0000","last_peered":"2023-05-17T15:10:57.235031+0000","last_clean":"2023-05-17T15:10:57.235031+0000","last_became_active":"2023-05-17T15:10:56.840419+0000","last_became_peered":"2023-05-17T15:10:56.840419+0000","last_unstale":"2023-05-17T15:10:57.235031+0000","last_undegraded":"2023-05-17T15:10:57.235031+0000","last_fullsized":"2023-05-17T15:10:57.235031+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226982+0000","last_change":"2023-05-17T15:10:57.217830+0000","last_active":"2023-05-17T15:10:57.226982+0000","last_peered":"2023-05-17T15:10:57.226982+0000","last_clean":"2023-05-17T15:10:57.226982+0000","last_became_active":"2023-05-17T15:10:57.217566+0000","last_became_peered":"2023-05-17T15:10:57.217566+0000","last_unstale":"2023-05-17T15:10:57.226982+0000","last_undegraded":"2023-05-17T15:10:57.226982+0000","last_fullsized":"2023-05-17T15:10:57.226982+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.210208+0000","last_change":"2023-05-17T15:10:56.833922+0000","last_active":"2023-05-17T15:10:57.210208+0000","last_peered":"2023-05-17T15:10:57.210208+0000","last_clean":"2023-05-17T15:10:57.210208+0000","last_became_active":"2023-05-17T15:10:56.833590+0000","last_became_peered":"2023-05-17T15:10:56.833590+0000","last_unstale":"2023-05-17T15:10:57.210208+0000","last_undegraded":"2023-05-17T15:10:57.210208+0000","last_fullsized":"2023-05-17T15:10:57.210208+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222174+0000","last_change":"2023-05-17T15:10:57.218640+0000","last_active":"2023-05-17T15:10:57.222174+0000","last_peered":"2023-05-17T15:10:57.222174+0000","last_clean":"2023-05-17T15:10:57.222174+0000","last_became_active":"2023-05-17T15:10:57.218135+0000","last_became_peered":"2023-05-17T15:10:57.218135+0000","last_unstale":"2023-05-17T15:10:57.222174+0000","last_undegraded":"2023-05-17T15:10:57.222174+0000","last_fullsized":"2023-05-17T15:10:57.222174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228419+0000","last_change":"2023-05-17T15:10:56.836012+0000","last_active":"2023-05-17T15:10:57.228419+0000","last_peered":"2023-05-17T15:10:57.228419+0000","last_clean":"2023-05-17T15:10:57.228419+0000","last_became_active":"2023-05-17T15:10:56.835680+0000","last_became_peered":"2023-05-17T15:10:56.835680+0000","last_unstale":"2023-05-17T15:10:57.228419+0000","last_undegraded":"2023-05-17T15:10:57.228419+0000","last_fullsized":"2023-05-17T15:10:57.228419+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235198+0000","last_change":"2023-05-17T15:10:57.234027+0000","last_active":"2023-05-17T15:10:57.235198+0000","last_peered":"2023-05-17T15:10:57.235198+0000","last_clean":"2023-05-17T15:10:57.235198+0000","last_became_active":"2023-05-17T15:10:57.233432+0000","last_became_peered":"2023-05-17T15:10:57.233432+0000","last_unstale":"2023-05-17T15:10:57.235198+0000","last_undegraded":"2023-05-17T15:10:57.235198+0000","last_fullsized":"2023-05-17T15:10:57.235198+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211711+0000","last_change":"2023-05-17T15:10:56.832469+0000","last_active":"2023-05-17T15:10:57.211711+0000","last_peered":"2023-05-17T15:10:57.211711+0000","last_clean":"2023-05-17T15:10:57.211711+0000","last_became_active":"2023-05-17T15:10:56.831700+0000","last_became_peered":"2023-05-17T15:10:56.831700+0000","last_unstale":"2023-05-17T15:10:57.211711+0000","last_undegraded":"2023-05-17T15:10:57.211711+0000","last_fullsized":"2023-05-17T15:10:57.211711+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227987+0000","last_change":"2023-05-17T15:10:57.218887+0000","last_active":"2023-05-17T15:10:57.227987+0000","last_peered":"2023-05-17T15:10:57.227987+0000","last_clean":"2023-05-17T15:10:57.227987+0000","last_became_active":"2023-05-17T15:10:57.218605+0000","last_became_peered":"2023-05-17T15:10:57.218605+0000","last_unstale":"2023-05-17T15:10:57.227987+0000","last_undegraded":"2023-05-17T15:10:57.227987+0000","last_fullsized":"2023-05-17T15:10:57.227987+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211419+0000","last_change":"2023-05-17T15:10:56.827587+0000","last_active":"2023-05-17T15:10:57.211419+0000","last_peered":"2023-05-17T15:10:57.211419+0000","last_clean":"2023-05-17T15:10:57.211419+0000","last_became_active":"2023-05-17T15:10:56.827063+0000","last_became_peered":"2023-05-17T15:10:56.827063+0000","last_unstale":"2023-05-17T15:10:57.211419+0000","last_undegraded":"2023-05-17T15:10:57.211419+0000","last_fullsized":"2023-05-17T15:10:57.211419+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235189+0000","last_change":"2023-05-17T15:10:57.233608+0000","last_active":"2023-05-17T15:10:57.235189+0000","last_peered":"2023-05-17T15:10:57.235189+0000","last_clean":"2023-05-17T15:10:57.235189+0000","last_became_active":"2023-05-17T15:10:57.233064+0000","last_became_peered":"2023-05-17T15:10:57.233064+0000","last_unstale":"2023-05-17T15:10:57.235189+0000","last_undegraded":"2023-05-17T15:10:57.235189+0000","last_fullsized":"2023-05-17T15:10:57.235189+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207220+0000","last_change":"2023-05-17T15:10:56.836753+0000","last_active":"2023-05-17T15:10:57.207220+0000","last_peered":"2023-05-17T15:10:57.207220+0000","last_clean":"2023-05-17T15:10:57.207220+0000","last_became_active":"2023-05-17T15:10:56.836423+0000","last_became_peered":"2023-05-17T15:10:56.836423+0000","last_unstale":"2023-05-17T15:10:57.207220+0000","last_undegraded":"2023-05-17T15:10:57.207220+0000","last_fullsized":"2023-05-17T15:10:57.207220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227402+0000","last_change":"2023-05-17T15:10:57.224377+0000","last_active":"2023-05-17T15:10:57.227402+0000","last_peered":"2023-05-17T15:10:57.227402+0000","last_clean":"2023-05-17T15:10:57.227402+0000","last_became_active":"2023-05-17T15:10:57.222293+0000","last_became_peered":"2023-05-17T15:10:57.222293+0000","last_unstale":"2023-05-17T15:10:57.227402+0000","last_undegraded":"2023-05-17T15:10:57.227402+0000","last_fullsized":"2023-05-17T15:10:57.227402+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213848+0000","last_change":"2023-05-17T15:10:56.828661+0000","last_active":"2023-05-17T15:10:57.213848+0000","last_peered":"2023-05-17T15:10:57.213848+0000","last_clean":"2023-05-17T15:10:57.213848+0000","last_became_active":"2023-05-17T15:10:56.828339+0000","last_became_peered":"2023-05-17T15:10:56.828339+0000","last_unstale":"2023-05-17T15:10:57.213848+0000","last_undegraded":"2023-05-17T15:10:57.213848+0000","last_fullsized":"2023-05-17T15:10:57.213848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222251+0000","last_change":"2023-05-17T15:10:57.218444+0000","last_active":"2023-05-17T15:10:57.222251+0000","last_peered":"2023-05-17T15:10:57.222251+0000","last_clean":"2023-05-17T15:10:57.222251+0000","last_became_active":"2023-05-17T15:10:57.217137+0000","last_became_peered":"2023-05-17T15:10:57.217137+0000","last_unstale":"2023-05-17T15:10:57.222251+0000","last_undegraded":"2023-05-17T15:10:57.222251+0000","last_fullsized":"2023-05-17T15:10:57.222251+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206554+0000","last_change":"2023-05-17T15:10:56.834973+0000","last_active":"2023-05-17T15:10:57.206554+0000","last_peered":"2023-05-17T15:10:57.206554+0000","last_clean":"2023-05-17T15:10:57.206554+0000","last_became_active":"2023-05-17T15:10:56.834275+0000","last_became_peered":"2023-05-17T15:10:56.834275+0000","last_unstale":"2023-05-17T15:10:57.206554+0000","last_undegraded":"2023-05-17T15:10:57.206554+0000","last_fullsized":"2023-05-17T15:10:57.206554+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221708+0000","last_change":"2023-05-17T15:10:57.218670+0000","last_active":"2023-05-17T15:10:57.221708+0000","last_peered":"2023-05-17T15:10:57.221708+0000","last_clean":"2023-05-17T15:10:57.221708+0000","last_became_active":"2023-05-17T15:10:57.218215+0000","last_became_peered":"2023-05-17T15:10:57.218215+0000","last_unstale":"2023-05-17T15:10:57.221708+0000","last_undegraded":"2023-05-17T15:10:57.221708+0000","last_fullsized":"2023-05-17T15:10:57.221708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207574+0000","last_change":"2023-05-17T15:10:56.837598+0000","last_active":"2023-05-17T15:10:57.207574+0000","last_peered":"2023-05-17T15:10:57.207574+0000","last_clean":"2023-05-17T15:10:57.207574+0000","last_became_active":"2023-05-17T15:10:56.837314+0000","last_became_peered":"2023-05-17T15:10:56.837314+0000","last_unstale":"2023-05-17T15:10:57.207574+0000","last_undegraded":"2023-05-17T15:10:57.207574+0000","last_fullsized":"2023-05-17T15:10:57.207574+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226578+0000","last_change":"2023-05-17T15:10:57.221141+0000","last_active":"2023-05-17T15:10:57.226578+0000","last_peered":"2023-05-17T15:10:57.226578+0000","last_clean":"2023-05-17T15:10:57.226578+0000","last_became_active":"2023-05-17T15:10:57.220625+0000","last_became_peered":"2023-05-17T15:10:57.220625+0000","last_unstale":"2023-05-17T15:10:57.226578+0000","last_undegraded":"2023-05-17T15:10:57.226578+0000","last_fullsized":"2023-05-17T15:10:57.226578+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207305+0000","last_change":"2023-05-17T15:10:56.832662+0000","last_active":"2023-05-17T15:10:57.207305+0000","last_peered":"2023-05-17T15:10:57.207305+0000","last_clean":"2023-05-17T15:10:57.207305+0000","last_became_active":"2023-05-17T15:10:56.832345+0000","last_became_peered":"2023-05-17T15:10:56.832345+0000","last_unstale":"2023-05-17T15:10:57.207305+0000","last_undegraded":"2023-05-17T15:10:57.207305+0000","last_fullsized":"2023-05-17T15:10:57.207305+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222150+0000","last_change":"2023-05-17T15:10:57.218441+0000","last_active":"2023-05-17T15:10:57.222150+0000","last_peered":"2023-05-17T15:10:57.222150+0000","last_clean":"2023-05-17T15:10:57.222150+0000","last_became_active":"2023-05-17T15:10:57.217501+0000","last_became_peered":"2023-05-17T15:10:57.217501+0000","last_unstale":"2023-05-17T15:10:57.222150+0000","last_undegraded":"2023-05-17T15:10:57.222150+0000","last_fullsized":"2023-05-17T15:10:57.222150+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209095+0000","last_change":"2023-05-17T15:10:56.833660+0000","last_active":"2023-05-17T15:10:57.209095+0000","last_peered":"2023-05-17T15:10:57.209095+0000","last_clean":"2023-05-17T15:10:57.209095+0000","last_became_active":"2023-05-17T15:10:56.833359+0000","last_became_peered":"2023-05-17T15:10:56.833359+0000","last_unstale":"2023-05-17T15:10:57.209095+0000","last_undegraded":"2023-05-17T15:10:57.209095+0000","last_fullsized":"2023-05-17T15:10:57.209095+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221311+0000","last_change":"2023-05-17T15:10:57.214503+0000","last_active":"2023-05-17T15:10:57.221311+0000","last_peered":"2023-05-17T15:10:57.221311+0000","last_clean":"2023-05-17T15:10:57.221311+0000","last_became_active":"2023-05-17T15:10:57.213407+0000","last_became_peered":"2023-05-17T15:10:57.213407+0000","last_unstale":"2023-05-17T15:10:57.221311+0000","last_undegraded":"2023-05-17T15:10:57.221311+0000","last_fullsized":"2023-05-17T15:10:57.221311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205144+0000","last_change":"2023-05-17T15:10:56.827934+0000","last_active":"2023-05-17T15:10:57.205144+0000","last_peered":"2023-05-17T15:10:57.205144+0000","last_clean":"2023-05-17T15:10:57.205144+0000","last_became_active":"2023-05-17T15:10:56.827522+0000","last_became_peered":"2023-05-17T15:10:56.827522+0000","last_unstale":"2023-05-17T15:10:57.205144+0000","last_undegraded":"2023-05-17T15:10:57.205144+0000","last_fullsized":"2023-05-17T15:10:57.205144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227205+0000","last_change":"2023-05-17T15:10:57.220828+0000","last_active":"2023-05-17T15:10:57.227205+0000","last_peered":"2023-05-17T15:10:57.227205+0000","last_clean":"2023-05-17T15:10:57.227205+0000","last_became_active":"2023-05-17T15:10:57.218264+0000","last_became_peered":"2023-05-17T15:10:57.218264+0000","last_unstale":"2023-05-17T15:10:57.227205+0000","last_undegraded":"2023-05-17T15:10:57.227205+0000","last_fullsized":"2023-05-17T15:10:57.227205+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208403+0000","last_change":"2023-05-17T15:10:56.834089+0000","last_active":"2023-05-17T15:10:57.208403+0000","last_peered":"2023-05-17T15:10:57.208403+0000","last_clean":"2023-05-17T15:10:57.208403+0000","last_became_active":"2023-05-17T15:10:56.833714+0000","last_became_peered":"2023-05-17T15:10:56.833714+0000","last_unstale":"2023-05-17T15:10:57.208403+0000","last_undegraded":"2023-05-17T15:10:57.208403+0000","last_fullsized":"2023-05-17T15:10:57.208403+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226279+0000","last_change":"2023-05-17T15:10:57.225169+0000","last_active":"2023-05-17T15:10:57.226279+0000","last_peered":"2023-05-17T15:10:57.226279+0000","last_clean":"2023-05-17T15:10:57.226279+0000","last_became_active":"2023-05-17T15:10:57.224862+0000","last_became_peered":"2023-05-17T15:10:57.224862+0000","last_unstale":"2023-05-17T15:10:57.226279+0000","last_undegraded":"2023-05-17T15:10:57.226279+0000","last_fullsized":"2023-05-17T15:10:57.226279+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206277+0000","last_change":"2023-05-17T15:10:56.834228+0000","last_active":"2023-05-17T15:10:57.206277+0000","last_peered":"2023-05-17T15:10:57.206277+0000","last_clean":"2023-05-17T15:10:57.206277+0000","last_became_active":"2023-05-17T15:10:56.833932+0000","last_became_peered":"2023-05-17T15:10:56.833932+0000","last_unstale":"2023-05-17T15:10:57.206277+0000","last_undegraded":"2023-05-17T15:10:57.206277+0000","last_fullsized":"2023-05-17T15:10:57.206277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226690+0000","last_change":"2023-05-17T15:10:57.215803+0000","last_active":"2023-05-17T15:10:57.226690+0000","last_peered":"2023-05-17T15:10:57.226690+0000","last_clean":"2023-05-17T15:10:57.226690+0000","last_became_active":"2023-05-17T15:10:57.215505+0000","last_became_peered":"2023-05-17T15:10:57.215505+0000","last_unstale":"2023-05-17T15:10:57.226690+0000","last_undegraded":"2023-05-17T15:10:57.226690+0000","last_fullsized":"2023-05-17T15:10:57.226690+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233959+0000","last_change":"2023-05-17T15:10:56.833320+0000","last_active":"2023-05-17T15:10:57.233959+0000","last_peered":"2023-05-17T15:10:57.233959+0000","last_clean":"2023-05-17T15:10:57.233959+0000","last_became_active":"2023-05-17T15:10:56.833002+0000","last_became_peered":"2023-05-17T15:10:56.833002+0000","last_unstale":"2023-05-17T15:10:57.233959+0000","last_undegraded":"2023-05-17T15:10:57.233959+0000","last_fullsized":"2023-05-17T15:10:57.233959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227311+0000","last_change":"2023-05-17T15:10:57.224838+0000","last_active":"2023-05-17T15:10:57.227311+0000","last_peered":"2023-05-17T15:10:57.227311+0000","last_clean":"2023-05-17T15:10:57.227311+0000","last_became_active":"2023-05-17T15:10:57.224462+0000","last_became_peered":"2023-05-17T15:10:57.224462+0000","last_unstale":"2023-05-17T15:10:57.227311+0000","last_undegraded":"2023-05-17T15:10:57.227311+0000","last_fullsized":"2023-05-17T15:10:57.227311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224162+0000","last_change":"2023-05-17T15:10:56.832264+0000","last_active":"2023-05-17T15:10:57.224162+0000","last_peered":"2023-05-17T15:10:57.224162+0000","last_clean":"2023-05-17T15:10:57.224162+0000","last_became_active":"2023-05-17T15:10:56.831929+0000","last_became_peered":"2023-05-17T15:10:56.831929+0000","last_unstale":"2023-05-17T15:10:57.224162+0000","last_undegraded":"2023-05-17T15:10:57.224162+0000","last_fullsized":"2023-05-17T15:10:57.224162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221196+0000","last_change":"2023-05-17T15:10:57.217611+0000","last_active":"2023-05-17T15:10:57.221196+0000","last_peered":"2023-05-17T15:10:57.221196+0000","last_clean":"2023-05-17T15:10:57.221196+0000","last_became_active":"2023-05-17T15:10:57.214351+0000","last_became_peered":"2023-05-17T15:10:57.214351+0000","last_unstale":"2023-05-17T15:10:57.221196+0000","last_undegraded":"2023-05-17T15:10:57.221196+0000","last_fullsized":"2023-05-17T15:10:57.221196+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233540+0000","last_change":"2023-05-17T15:10:56.841000+0000","last_active":"2023-05-17T15:10:57.233540+0000","last_peered":"2023-05-17T15:10:57.233540+0000","last_clean":"2023-05-17T15:10:57.233540+0000","last_became_active":"2023-05-17T15:10:56.840483+0000","last_became_peered":"2023-05-17T15:10:56.840483+0000","last_unstale":"2023-05-17T15:10:57.233540+0000","last_undegraded":"2023-05-17T15:10:57.233540+0000","last_fullsized":"2023-05-17T15:10:57.233540+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234924+0000","last_change":"2023-05-17T15:10:57.232156+0000","last_active":"2023-05-17T15:10:57.234924+0000","last_peered":"2023-05-17T15:10:57.234924+0000","last_clean":"2023-05-17T15:10:57.234924+0000","last_became_active":"2023-05-17T15:10:57.231174+0000","last_became_peered":"2023-05-17T15:10:57.231174+0000","last_unstale":"2023-05-17T15:10:57.234924+0000","last_undegraded":"2023-05-17T15:10:57.234924+0000","last_fullsized":"2023-05-17T15:10:57.234924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207640+0000","last_change":"2023-05-17T15:10:56.834777+0000","last_active":"2023-05-17T15:10:57.207640+0000","last_peered":"2023-05-17T15:10:57.207640+0000","last_clean":"2023-05-17T15:10:57.207640+0000","last_became_active":"2023-05-17T15:10:56.834423+0000","last_became_peered":"2023-05-17T15:10:56.834423+0000","last_unstale":"2023-05-17T15:10:57.207640+0000","last_undegraded":"2023-05-17T15:10:57.207640+0000","last_fullsized":"2023-05-17T15:10:57.207640+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226969+0000","last_change":"2023-05-17T15:10:57.218550+0000","last_active":"2023-05-17T15:10:57.226969+0000","last_peered":"2023-05-17T15:10:57.226969+0000","last_clean":"2023-05-17T15:10:57.226969+0000","last_became_active":"2023-05-17T15:10:57.218266+0000","last_became_peered":"2023-05-17T15:10:57.218266+0000","last_unstale":"2023-05-17T15:10:57.226969+0000","last_undegraded":"2023-05-17T15:10:57.226969+0000","last_fullsized":"2023-05-17T15:10:57.226969+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209220+0000","last_change":"2023-05-17T15:10:56.830287+0000","last_active":"2023-05-17T15:10:57.209220+0000","last_peered":"2023-05-17T15:10:57.209220+0000","last_clean":"2023-05-17T15:10:57.209220+0000","last_became_active":"2023-05-17T15:10:56.830005+0000","last_became_peered":"2023-05-17T15:10:56.830005+0000","last_unstale":"2023-05-17T15:10:57.209220+0000","last_undegraded":"2023-05-17T15:10:57.209220+0000","last_fullsized":"2023-05-17T15:10:57.209220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228057+0000","last_change":"2023-05-17T15:10:57.219768+0000","last_active":"2023-05-17T15:10:57.228057+0000","last_peered":"2023-05-17T15:10:57.228057+0000","last_clean":"2023-05-17T15:10:57.228057+0000","last_became_active":"2023-05-17T15:10:57.216072+0000","last_became_peered":"2023-05-17T15:10:57.216072+0000","last_unstale":"2023-05-17T15:10:57.228057+0000","last_undegraded":"2023-05-17T15:10:57.228057+0000","last_fullsized":"2023-05-17T15:10:57.228057+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207908+0000","last_change":"2023-05-17T15:10:56.828442+0000","last_active":"2023-05-17T15:10:57.207908+0000","last_peered":"2023-05-17T15:10:57.207908+0000","last_clean":"2023-05-17T15:10:57.207908+0000","last_became_active":"2023-05-17T15:10:56.828161+0000","last_became_peered":"2023-05-17T15:10:56.828161+0000","last_unstale":"2023-05-17T15:10:57.207908+0000","last_undegraded":"2023-05-17T15:10:57.207908+0000","last_fullsized":"2023-05-17T15:10:57.207908+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227194+0000","last_change":"2023-05-17T15:10:57.220647+0000","last_active":"2023-05-17T15:10:57.227194+0000","last_peered":"2023-05-17T15:10:57.227194+0000","last_clean":"2023-05-17T15:10:57.227194+0000","last_became_active":"2023-05-17T15:10:57.217855+0000","last_became_peered":"2023-05-17T15:10:57.217855+0000","last_unstale":"2023-05-17T15:10:57.227194+0000","last_undegraded":"2023-05-17T15:10:57.227194+0000","last_fullsized":"2023-05-17T15:10:57.227194+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206066+0000","last_change":"2023-05-17T15:10:56.832160+0000","last_active":"2023-05-17T15:10:57.206066+0000","last_peered":"2023-05-17T15:10:57.206066+0000","last_clean":"2023-05-17T15:10:57.206066+0000","last_became_active":"2023-05-17T15:10:56.831892+0000","last_became_peered":"2023-05-17T15:10:56.831892+0000","last_unstale":"2023-05-17T15:10:57.206066+0000","last_undegraded":"2023-05-17T15:10:57.206066+0000","last_fullsized":"2023-05-17T15:10:57.206066+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228186+0000","last_change":"2023-05-17T15:10:57.225426+0000","last_active":"2023-05-17T15:10:57.228186+0000","last_peered":"2023-05-17T15:10:57.228186+0000","last_clean":"2023-05-17T15:10:57.228186+0000","last_became_active":"2023-05-17T15:10:57.225106+0000","last_became_peered":"2023-05-17T15:10:57.225106+0000","last_unstale":"2023-05-17T15:10:57.228186+0000","last_undegraded":"2023-05-17T15:10:57.228186+0000","last_fullsized":"2023-05-17T15:10:57.228186+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206603+0000","last_change":"2023-05-17T15:10:56.831442+0000","last_active":"2023-05-17T15:10:57.206603+0000","last_peered":"2023-05-17T15:10:57.206603+0000","last_clean":"2023-05-17T15:10:57.206603+0000","last_became_active":"2023-05-17T15:10:56.831147+0000","last_became_peered":"2023-05-17T15:10:56.831147+0000","last_unstale":"2023-05-17T15:10:57.206603+0000","last_undegraded":"2023-05-17T15:10:57.206603+0000","last_fullsized":"2023-05-17T15:10:57.206603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219023+0000","last_change":"2023-05-17T15:10:57.214798+0000","last_active":"2023-05-17T15:10:57.219023+0000","last_peered":"2023-05-17T15:10:57.219023+0000","last_clean":"2023-05-17T15:10:57.219023+0000","last_became_active":"2023-05-17T15:10:57.214473+0000","last_became_peered":"2023-05-17T15:10:57.214473+0000","last_unstale":"2023-05-17T15:10:57.219023+0000","last_undegraded":"2023-05-17T15:10:57.219023+0000","last_fullsized":"2023-05-17T15:10:57.219023+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225651+0000","last_change":"2023-05-17T15:10:56.842757+0000","last_active":"2023-05-17T15:10:57.225651+0000","last_peered":"2023-05-17T15:10:57.225651+0000","last_clean":"2023-05-17T15:10:57.225651+0000","last_became_active":"2023-05-17T15:10:56.842401+0000","last_became_peered":"2023-05-17T15:10:56.842401+0000","last_unstale":"2023-05-17T15:10:57.225651+0000","last_undegraded":"2023-05-17T15:10:57.225651+0000","last_fullsized":"2023-05-17T15:10:57.225651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227868+0000","last_change":"2023-05-17T15:10:57.217015+0000","last_active":"2023-05-17T15:10:57.227868+0000","last_peered":"2023-05-17T15:10:57.227868+0000","last_clean":"2023-05-17T15:10:57.227868+0000","last_became_active":"2023-05-17T15:10:57.216478+0000","last_became_peered":"2023-05-17T15:10:57.216478+0000","last_unstale":"2023-05-17T15:10:57.227868+0000","last_undegraded":"2023-05-17T15:10:57.227868+0000","last_fullsized":"2023-05-17T15:10:57.227868+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225688+0000","last_change":"2023-05-17T15:10:56.833412+0000","last_active":"2023-05-17T15:10:57.225688+0000","last_peered":"2023-05-17T15:10:57.225688+0000","last_clean":"2023-05-17T15:10:57.225688+0000","last_became_active":"2023-05-17T15:10:56.833007+0000","last_became_peered":"2023-05-17T15:10:56.833007+0000","last_unstale":"2023-05-17T15:10:57.225688+0000","last_undegraded":"2023-05-17T15:10:57.225688+0000","last_fullsized":"2023-05-17T15:10:57.225688+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226377+0000","last_change":"2023-05-17T15:10:57.223581+0000","last_active":"2023-05-17T15:10:57.226377+0000","last_peered":"2023-05-17T15:10:57.226377+0000","last_clean":"2023-05-17T15:10:57.226377+0000","last_became_active":"2023-05-17T15:10:57.222657+0000","last_became_peered":"2023-05-17T15:10:57.222657+0000","last_unstale":"2023-05-17T15:10:57.226377+0000","last_undegraded":"2023-05-17T15:10:57.226377+0000","last_fullsized":"2023-05-17T15:10:57.226377+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224391+0000","last_change":"2023-05-17T15:10:56.838318+0000","last_active":"2023-05-17T15:10:57.224391+0000","last_peered":"2023-05-17T15:10:57.224391+0000","last_clean":"2023-05-17T15:10:57.224391+0000","last_became_active":"2023-05-17T15:10:56.838048+0000","last_became_peered":"2023-05-17T15:10:56.838048+0000","last_unstale":"2023-05-17T15:10:57.224391+0000","last_undegraded":"2023-05-17T15:10:57.224391+0000","last_fullsized":"2023-05-17T15:10:57.224391+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226557+0000","last_change":"2023-05-17T15:10:57.220917+0000","last_active":"2023-05-17T15:10:57.226557+0000","last_peered":"2023-05-17T15:10:57.226557+0000","last_clean":"2023-05-17T15:10:57.226557+0000","last_became_active":"2023-05-17T15:10:57.220106+0000","last_became_peered":"2023-05-17T15:10:57.220106+0000","last_unstale":"2023-05-17T15:10:57.226557+0000","last_undegraded":"2023-05-17T15:10:57.226557+0000","last_fullsized":"2023-05-17T15:10:57.226557+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.220671+0000","last_change":"2023-05-17T15:10:56.843745+0000","last_active":"2023-05-17T15:10:57.220671+0000","last_peered":"2023-05-17T15:10:57.220671+0000","last_clean":"2023-05-17T15:10:57.220671+0000","last_became_active":"2023-05-17T15:10:56.843479+0000","last_became_peered":"2023-05-17T15:10:56.843479+0000","last_unstale":"2023-05-17T15:10:57.220671+0000","last_undegraded":"2023-05-17T15:10:57.220671+0000","last_fullsized":"2023-05-17T15:10:57.220671+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.225848+0000","last_change":"2023-05-17T15:10:57.223358+0000","last_active":"2023-05-17T15:10:57.225848+0000","last_peered":"2023-05-17T15:10:57.225848+0000","last_clean":"2023-05-17T15:10:57.225848+0000","last_became_active":"2023-05-17T15:10:57.222532+0000","last_became_peered":"2023-05-17T15:10:57.222532+0000","last_unstale":"2023-05-17T15:10:57.225848+0000","last_undegraded":"2023-05-17T15:10:57.225848+0000","last_fullsized":"2023-05-17T15:10:57.225848+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232145+0000","last_change":"2023-05-17T15:10:56.837020+0000","last_active":"2023-05-17T15:10:57.232145+0000","last_peered":"2023-05-17T15:10:57.232145+0000","last_clean":"2023-05-17T15:10:57.232145+0000","last_became_active":"2023-05-17T15:10:56.836737+0000","last_became_peered":"2023-05-17T15:10:56.836737+0000","last_unstale":"2023-05-17T15:10:57.232145+0000","last_undegraded":"2023-05-17T15:10:57.232145+0000","last_fullsized":"2023-05-17T15:10:57.232145+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227704+0000","last_change":"2023-05-17T15:10:57.223963+0000","last_active":"2023-05-17T15:10:57.227704+0000","last_peered":"2023-05-17T15:10:57.227704+0000","last_clean":"2023-05-17T15:10:57.227704+0000","last_became_active":"2023-05-17T15:10:57.223709+0000","last_became_peered":"2023-05-17T15:10:57.223709+0000","last_unstale":"2023-05-17T15:10:57.227704+0000","last_undegraded":"2023-05-17T15:10:57.227704+0000","last_fullsized":"2023-05-17T15:10:57.227704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219998+0000","last_change":"2023-05-17T15:10:56.841574+0000","last_active":"2023-05-17T15:10:57.219998+0000","last_peered":"2023-05-17T15:10:57.219998+0000","last_clean":"2023-05-17T15:10:57.219998+0000","last_became_active":"2023-05-17T15:10:56.841288+0000","last_became_peered":"2023-05-17T15:10:56.841288+0000","last_unstale":"2023-05-17T15:10:57.219998+0000","last_undegraded":"2023-05-17T15:10:57.219998+0000","last_fullsized":"2023-05-17T15:10:57.219998+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227654+0000","last_change":"2023-05-17T15:10:57.223557+0000","last_active":"2023-05-17T15:10:57.227654+0000","last_peered":"2023-05-17T15:10:57.227654+0000","last_clean":"2023-05-17T15:10:57.227654+0000","last_became_active":"2023-05-17T15:10:57.222696+0000","last_became_peered":"2023-05-17T15:10:57.222696+0000","last_unstale":"2023-05-17T15:10:57.227654+0000","last_undegraded":"2023-05-17T15:10:57.227654+0000","last_fullsized":"2023-05-17T15:10:57.227654+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213096+0000","last_change":"2023-05-17T15:10:56.833261+0000","last_active":"2023-05-17T15:10:57.213096+0000","last_peered":"2023-05-17T15:10:57.213096+0000","last_clean":"2023-05-17T15:10:57.213096+0000","last_became_active":"2023-05-17T15:10:56.832990+0000","last_became_peered":"2023-05-17T15:10:56.832990+0000","last_unstale":"2023-05-17T15:10:57.213096+0000","last_undegraded":"2023-05-17T15:10:57.213096+0000","last_fullsized":"2023-05-17T15:10:57.213096+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221637+0000","last_change":"2023-05-17T15:10:57.218219+0000","last_active":"2023-05-17T15:10:57.221637+0000","last_peered":"2023-05-17T15:10:57.221637+0000","last_clean":"2023-05-17T15:10:57.221637+0000","last_became_active":"2023-05-17T15:10:57.217924+0000","last_became_peered":"2023-05-17T15:10:57.217924+0000","last_unstale":"2023-05-17T15:10:57.221637+0000","last_undegraded":"2023-05-17T15:10:57.221637+0000","last_fullsized":"2023-05-17T15:10:57.221637+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215240+0000","last_change":"2023-05-17T15:10:56.841047+0000","last_active":"2023-05-17T15:10:57.215240+0000","last_peered":"2023-05-17T15:10:57.215240+0000","last_clean":"2023-05-17T15:10:57.215240+0000","last_became_active":"2023-05-17T15:10:56.840736+0000","last_became_peered":"2023-05-17T15:10:56.840736+0000","last_unstale":"2023-05-17T15:10:57.215240+0000","last_undegraded":"2023-05-17T15:10:57.215240+0000","last_fullsized":"2023-05-17T15:10:57.215240+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227390+0000","last_change":"2023-05-17T15:10:57.222569+0000","last_active":"2023-05-17T15:10:57.227390+0000","last_peered":"2023-05-17T15:10:57.227390+0000","last_clean":"2023-05-17T15:10:57.227390+0000","last_became_active":"2023-05-17T15:10:57.221644+0000","last_became_peered":"2023-05-17T15:10:57.221644+0000","last_unstale":"2023-05-17T15:10:57.227390+0000","last_undegraded":"2023-05-17T15:10:57.227390+0000","last_fullsized":"2023-05-17T15:10:57.227390+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228678+0000","last_change":"2023-05-17T15:10:56.835798+0000","last_active":"2023-05-17T15:10:57.228678+0000","last_peered":"2023-05-17T15:10:57.228678+0000","last_clean":"2023-05-17T15:10:57.228678+0000","last_became_active":"2023-05-17T15:10:56.835527+0000","last_became_peered":"2023-05-17T15:10:56.835527+0000","last_unstale":"2023-05-17T15:10:57.228678+0000","last_undegraded":"2023-05-17T15:10:57.228678+0000","last_fullsized":"2023-05-17T15:10:57.228678+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.228008+0000","last_change":"2023-05-17T15:10:57.223357+0000","last_active":"2023-05-17T15:10:57.228008+0000","last_peered":"2023-05-17T15:10:57.228008+0000","last_clean":"2023-05-17T15:10:57.228008+0000","last_became_active":"2023-05-17T15:10:57.223105+0000","last_became_peered":"2023-05-17T15:10:57.223105+0000","last_unstale":"2023-05-17T15:10:57.228008+0000","last_undegraded":"2023-05-17T15:10:57.228008+0000","last_fullsized":"2023-05-17T15:10:57.228008+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206373+0000","last_change":"2023-05-17T15:10:56.831199+0000","last_active":"2023-05-17T15:10:57.206373+0000","last_peered":"2023-05-17T15:10:57.206373+0000","last_clean":"2023-05-17T15:10:57.206373+0000","last_became_active":"2023-05-17T15:10:56.830892+0000","last_became_peered":"2023-05-17T15:10:56.830892+0000","last_unstale":"2023-05-17T15:10:57.206373+0000","last_undegraded":"2023-05-17T15:10:57.206373+0000","last_fullsized":"2023-05-17T15:10:57.206373+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.235139+0000","last_change":"2023-05-17T15:10:57.232955+0000","last_active":"2023-05-17T15:10:57.235139+0000","last_peered":"2023-05-17T15:10:57.235139+0000","last_clean":"2023-05-17T15:10:57.235139+0000","last_became_active":"2023-05-17T15:10:57.231087+0000","last_became_peered":"2023-05-17T15:10:57.231087+0000","last_unstale":"2023-05-17T15:10:57.235139+0000","last_undegraded":"2023-05-17T15:10:57.235139+0000","last_fullsized":"2023-05-17T15:10:57.235139+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209149+0000","last_change":"2023-05-17T15:10:56.836571+0000","last_active":"2023-05-17T15:10:57.209149+0000","last_peered":"2023-05-17T15:10:57.209149+0000","last_clean":"2023-05-17T15:10:57.209149+0000","last_became_active":"2023-05-17T15:10:56.836309+0000","last_became_peered":"2023-05-17T15:10:56.836309+0000","last_unstale":"2023-05-17T15:10:57.209149+0000","last_undegraded":"2023-05-17T15:10:57.209149+0000","last_fullsized":"2023-05-17T15:10:57.209149+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.223591+0000","last_change":"2023-05-17T15:10:57.221988+0000","last_active":"2023-05-17T15:10:57.223591+0000","last_peered":"2023-05-17T15:10:57.223591+0000","last_clean":"2023-05-17T15:10:57.223591+0000","last_became_active":"2023-05-17T15:10:57.221736+0000","last_became_peered":"2023-05-17T15:10:57.221736+0000","last_unstale":"2023-05-17T15:10:57.223591+0000","last_undegraded":"2023-05-17T15:10:57.223591+0000","last_fullsized":"2023-05-17T15:10:57.223591+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.210187+0000","last_change":"2023-05-17T15:10:56.836097+0000","last_active":"2023-05-17T15:10:57.210187+0000","last_peered":"2023-05-17T15:10:57.210187+0000","last_clean":"2023-05-17T15:10:57.210187+0000","last_became_active":"2023-05-17T15:10:56.831534+0000","last_became_peered":"2023-05-17T15:10:56.831534+0000","last_unstale":"2023-05-17T15:10:57.210187+0000","last_undegraded":"2023-05-17T15:10:57.210187+0000","last_fullsized":"2023-05-17T15:10:57.210187+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224520+0000","last_change":"2023-05-17T15:10:57.214177+0000","last_active":"2023-05-17T15:10:57.224520+0000","last_peered":"2023-05-17T15:10:57.224520+0000","last_clean":"2023-05-17T15:10:57.224520+0000","last_became_active":"2023-05-17T15:10:57.213092+0000","last_became_peered":"2023-05-17T15:10:57.213092+0000","last_unstale":"2023-05-17T15:10:57.224520+0000","last_undegraded":"2023-05-17T15:10:57.224520+0000","last_fullsized":"2023-05-17T15:10:57.224520+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.209330+0000","last_change":"2023-05-17T15:10:56.826915+0000","last_active":"2023-05-17T15:10:57.209330+0000","last_peered":"2023-05-17T15:10:57.209330+0000","last_clean":"2023-05-17T15:10:57.209330+0000","last_became_active":"2023-05-17T15:10:56.826574+0000","last_became_peered":"2023-05-17T15:10:56.826574+0000","last_unstale":"2023-05-17T15:10:57.209330+0000","last_undegraded":"2023-05-17T15:10:57.209330+0000","last_fullsized":"2023-05-17T15:10:57.209330+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227369+0000","last_change":"2023-05-17T15:10:57.216838+0000","last_active":"2023-05-17T15:10:57.227369+0000","last_peered":"2023-05-17T15:10:57.227369+0000","last_clean":"2023-05-17T15:10:57.227369+0000","last_became_active":"2023-05-17T15:10:57.216564+0000","last_became_peered":"2023-05-17T15:10:57.216564+0000","last_unstale":"2023-05-17T15:10:57.227369+0000","last_undegraded":"2023-05-17T15:10:57.227369+0000","last_fullsized":"2023-05-17T15:10:57.227369+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207920+0000","last_change":"2023-05-17T15:10:56.831622+0000","last_active":"2023-05-17T15:10:57.207920+0000","last_peered":"2023-05-17T15:10:57.207920+0000","last_clean":"2023-05-17T15:10:57.207920+0000","last_became_active":"2023-05-17T15:10:56.831335+0000","last_became_peered":"2023-05-17T15:10:56.831335+0000","last_unstale":"2023-05-17T15:10:57.207920+0000","last_undegraded":"2023-05-17T15:10:57.207920+0000","last_fullsized":"2023-05-17T15:10:57.207920+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234932+0000","last_change":"2023-05-17T15:10:57.232576+0000","last_active":"2023-05-17T15:10:57.234932+0000","last_peered":"2023-05-17T15:10:57.234932+0000","last_clean":"2023-05-17T15:10:57.234932+0000","last_became_active":"2023-05-17T15:10:57.232423+0000","last_became_peered":"2023-05-17T15:10:57.232423+0000","last_unstale":"2023-05-17T15:10:57.234932+0000","last_undegraded":"2023-05-17T15:10:57.234932+0000","last_fullsized":"2023-05-17T15:10:57.234932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208499+0000","last_change":"2023-05-17T15:10:56.830655+0000","last_active":"2023-05-17T15:10:57.208499+0000","last_peered":"2023-05-17T15:10:57.208499+0000","last_clean":"2023-05-17T15:10:57.208499+0000","last_became_active":"2023-05-17T15:10:56.830224+0000","last_became_peered":"2023-05-17T15:10:56.830224+0000","last_unstale":"2023-05-17T15:10:57.208499+0000","last_undegraded":"2023-05-17T15:10:57.208499+0000","last_fullsized":"2023-05-17T15:10:57.208499+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.226940+0000","last_change":"2023-05-17T15:10:57.220044+0000","last_active":"2023-05-17T15:10:57.226940+0000","last_peered":"2023-05-17T15:10:57.226940+0000","last_clean":"2023-05-17T15:10:57.226940+0000","last_became_active":"2023-05-17T15:10:57.219740+0000","last_became_peered":"2023-05-17T15:10:57.219740+0000","last_unstale":"2023-05-17T15:10:57.226940+0000","last_undegraded":"2023-05-17T15:10:57.226940+0000","last_fullsized":"2023-05-17T15:10:57.226940+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215345+0000","last_change":"2023-05-17T15:10:56.841280+0000","last_active":"2023-05-17T15:10:57.215345+0000","last_peered":"2023-05-17T15:10:57.215345+0000","last_clean":"2023-05-17T15:10:57.215345+0000","last_became_active":"2023-05-17T15:10:56.840969+0000","last_became_peered":"2023-05-17T15:10:56.840969+0000","last_unstale":"2023-05-17T15:10:57.215345+0000","last_undegraded":"2023-05-17T15:10:57.215345+0000","last_fullsized":"2023-05-17T15:10:57.215345+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222110+0000","last_change":"2023-05-17T15:10:57.217248+0000","last_active":"2023-05-17T15:10:57.222110+0000","last_peered":"2023-05-17T15:10:57.222110+0000","last_clean":"2023-05-17T15:10:57.222110+0000","last_became_active":"2023-05-17T15:10:57.216934+0000","last_became_peered":"2023-05-17T15:10:57.216934+0000","last_unstale":"2023-05-17T15:10:57.222110+0000","last_undegraded":"2023-05-17T15:10:57.222110+0000","last_fullsized":"2023-05-17T15:10:57.222110+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206923+0000","last_change":"2023-05-17T15:10:56.837090+0000","last_active":"2023-05-17T15:10:57.206923+0000","last_peered":"2023-05-17T15:10:57.206923+0000","last_clean":"2023-05-17T15:10:57.206923+0000","last_became_active":"2023-05-17T15:10:56.836488+0000","last_became_peered":"2023-05-17T15:10:56.836488+0000","last_unstale":"2023-05-17T15:10:57.206923+0000","last_undegraded":"2023-05-17T15:10:57.206923+0000","last_fullsized":"2023-05-17T15:10:57.206923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207724+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:10:57.207724+0000","last_peered":"2023-05-17T15:10:57.207724+0000","last_clean":"2023-05-17T15:10:57.207724+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:10:57.207724+0000","last_undegraded":"2023-05-17T15:10:57.207724+0000","last_fullsized":"2023-05-17T15:10:57.207724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.222708+0000","last_change":"2023-05-17T15:10:57.220378+0000","last_active":"2023-05-17T15:10:57.222708+0000","last_peered":"2023-05-17T15:10:57.222708+0000","last_clean":"2023-05-17T15:10:57.222708+0000","last_became_active":"2023-05-17T15:10:57.220120+0000","last_became_peered":"2023-05-17T15:10:57.220120+0000","last_unstale":"2023-05-17T15:10:57.222708+0000","last_undegraded":"2023-05-17T15:10:57.222708+0000","last_fullsized":"2023-05-17T15:10:57.222708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.213087+0000","last_change":"2023-05-17T15:10:56.830080+0000","last_active":"2023-05-17T15:10:57.213087+0000","last_peered":"2023-05-17T15:10:57.213087+0000","last_clean":"2023-05-17T15:10:57.213087+0000","last_became_active":"2023-05-17T15:10:56.829819+0000","last_became_peered":"2023-05-17T15:10:56.829819+0000","last_unstale":"2023-05-17T15:10:57.213087+0000","last_undegraded":"2023-05-17T15:10:57.213087+0000","last_fullsized":"2023-05-17T15:10:57.213087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.205244+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:10:57.205244+0000","last_peered":"2023-05-17T15:10:57.205244+0000","last_clean":"2023-05-17T15:10:57.205244+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:10:57.205244+0000","last_undegraded":"2023-05-17T15:10:57.205244+0000","last_fullsized":"2023-05-17T15:10:57.205244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227340+0000","last_change":"2023-05-17T15:10:57.219754+0000","last_active":"2023-05-17T15:10:57.227340+0000","last_peered":"2023-05-17T15:10:57.227340+0000","last_clean":"2023-05-17T15:10:57.227340+0000","last_became_active":"2023-05-17T15:10:57.219481+0000","last_became_peered":"2023-05-17T15:10:57.219481+0000","last_unstale":"2023-05-17T15:10:57.227340+0000","last_undegraded":"2023-05-17T15:10:57.227340+0000","last_fullsized":"2023-05-17T15:10:57.227340+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.211833+0000","last_change":"2023-05-17T15:10:56.838145+0000","last_active":"2023-05-17T15:10:57.211833+0000","last_peered":"2023-05-17T15:10:57.211833+0000","last_clean":"2023-05-17T15:10:57.211833+0000","last_became_active":"2023-05-17T15:10:56.837867+0000","last_became_peered":"2023-05-17T15:10:56.837867+0000","last_unstale":"2023-05-17T15:10:57.211833+0000","last_undegraded":"2023-05-17T15:10:57.211833+0000","last_fullsized":"2023-05-17T15:10:57.211833+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206285+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:10:57.206285+0000","last_peered":"2023-05-17T15:10:57.206285+0000","last_clean":"2023-05-17T15:10:57.206285+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:10:57.206285+0000","last_undegraded":"2023-05-17T15:10:57.206285+0000","last_fullsized":"2023-05-17T15:10:57.206285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.234959+0000","last_change":"2023-05-17T15:10:57.231513+0000","last_active":"2023-05-17T15:10:57.234959+0000","last_peered":"2023-05-17T15:10:57.234959+0000","last_clean":"2023-05-17T15:10:57.234959+0000","last_became_active":"2023-05-17T15:10:57.230999+0000","last_became_peered":"2023-05-17T15:10:57.230999+0000","last_unstale":"2023-05-17T15:10:57.234959+0000","last_undegraded":"2023-05-17T15:10:57.234959+0000","last_fullsized":"2023-05-17T15:10:57.234959+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.231270+0000","last_change":"2023-05-17T15:10:56.827814+0000","last_active":"2023-05-17T15:10:57.231270+0000","last_peered":"2023-05-17T15:10:57.231270+0000","last_clean":"2023-05-17T15:10:57.231270+0000","last_became_active":"2023-05-17T15:10:56.827512+0000","last_became_peered":"2023-05-17T15:10:56.827512+0000","last_unstale":"2023-05-17T15:10:57.231270+0000","last_undegraded":"2023-05-17T15:10:57.231270+0000","last_fullsized":"2023-05-17T15:10:57.231270+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207212+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:10:57.207212+0000","last_peered":"2023-05-17T15:10:57.207212+0000","last_clean":"2023-05-17T15:10:57.207212+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:10:57.207212+0000","last_undegraded":"2023-05-17T15:10:57.207212+0000","last_fullsized":"2023-05-17T15:10:57.207212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215509+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:10:57.215509+0000","last_peered":"2023-05-17T15:10:57.215509+0000","last_clean":"2023-05-17T15:10:57.215509+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:10:57.215509+0000","last_undegraded":"2023-05-17T15:10:57.215509+0000","last_fullsized":"2023-05-17T15:10:57.215509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.230047+0000","last_change":"2023-05-17T15:10:57.226990+0000","last_active":"2023-05-17T15:10:57.230047+0000","last_peered":"2023-05-17T15:10:57.230047+0000","last_clean":"2023-05-17T15:10:57.230047+0000","last_became_active":"2023-05-17T15:10:57.225515+0000","last_became_peered":"2023-05-17T15:10:57.225515+0000","last_unstale":"2023-05-17T15:10:57.230047+0000","last_undegraded":"2023-05-17T15:10:57.230047+0000","last_fullsized":"2023-05-17T15:10:57.230047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.233384+0000","last_change":"2023-05-17T15:10:56.837257+0000","last_active":"2023-05-17T15:10:57.233384+0000","last_peered":"2023-05-17T15:10:57.233384+0000","last_clean":"2023-05-17T15:10:57.233384+0000","last_became_active":"2023-05-17T15:10:56.836895+0000","last_became_peered":"2023-05-17T15:10:56.836895+0000","last_unstale":"2023-05-17T15:10:57.233384+0000","last_undegraded":"2023-05-17T15:10:57.233384+0000","last_fullsized":"2023-05-17T15:10:57.233384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.215594+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:10:57.215594+0000","last_peered":"2023-05-17T15:10:57.215594+0000","last_clean":"2023-05-17T15:10:57.215594+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:10:57.215594+0000","last_undegraded":"2023-05-17T15:10:57.215594+0000","last_fullsized":"2023-05-17T15:10:57.215594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.219609+0000","last_change":"2023-05-17T15:10:57.215430+0000","last_active":"2023-05-17T15:10:57.219609+0000","last_peered":"2023-05-17T15:10:57.219609+0000","last_clean":"2023-05-17T15:10:57.219609+0000","last_became_active":"2023-05-17T15:10:57.215080+0000","last_became_peered":"2023-05-17T15:10:57.215080+0000","last_unstale":"2023-05-17T15:10:57.219609+0000","last_undegraded":"2023-05-17T15:10:57.219609+0000","last_fullsized":"2023-05-17T15:10:57.219609+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.208004+0000","last_change":"2023-05-17T15:10:56.827772+0000","last_active":"2023-05-17T15:10:57.208004+0000","last_peered":"2023-05-17T15:10:57.208004+0000","last_clean":"2023-05-17T15:10:57.208004+0000","last_became_active":"2023-05-17T15:10:56.827497+0000","last_became_peered":"2023-05-17T15:10:56.827497+0000","last_unstale":"2023-05-17T15:10:57.208004+0000","last_undegraded":"2023-05-17T15:10:57.208004+0000","last_fullsized":"2023-05-17T15:10:57.208004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.224486+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:10:57.224486+0000","last_peered":"2023-05-17T15:10:57.224486+0000","last_clean":"2023-05-17T15:10:57.224486+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:10:57.224486+0000","last_undegraded":"2023-05-17T15:10:57.224486+0000","last_fullsized":"2023-05-17T15:10:57.224486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.227275+0000","last_change":"2023-05-17T15:10:57.222582+0000","last_active":"2023-05-17T15:10:57.227275+0000","last_peered":"2023-05-17T15:10:57.227275+0000","last_clean":"2023-05-17T15:10:57.227275+0000","last_became_active":"2023-05-17T15:10:57.222321+0000","last_became_peered":"2023-05-17T15:10:57.222321+0000","last_unstale":"2023-05-17T15:10:57.227275+0000","last_undegraded":"2023-05-17T15:10:57.227275+0000","last_fullsized":"2023-05-17T15:10:57.227275+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.232053+0000","last_change":"2023-05-17T15:10:56.833302+0000","last_active":"2023-05-17T15:10:57.232053+0000","last_peered":"2023-05-17T15:10:57.232053+0000","last_clean":"2023-05-17T15:10:57.232053+0000","last_became_active":"2023-05-17T15:10:56.832985+0000","last_became_peered":"2023-05-17T15:10:56.832985+0000","last_unstale":"2023-05-17T15:10:57.232053+0000","last_undegraded":"2023-05-17T15:10:57.232053+0000","last_fullsized":"2023-05-17T15:10:57.232053+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.206086+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:10:57.206086+0000","last_peered":"2023-05-17T15:10:57.206086+0000","last_clean":"2023-05-17T15:10:57.206086+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:10:57.206086+0000","last_undegraded":"2023-05-17T15:10:57.206086+0000","last_fullsized":"2023-05-17T15:10:57.206086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.221331+0000","last_change":"2023-05-17T15:10:57.217668+0000","last_active":"2023-05-17T15:10:57.221331+0000","last_peered":"2023-05-17T15:10:57.221331+0000","last_clean":"2023-05-17T15:10:57.221331+0000","last_became_active":"2023-05-17T15:10:57.217204+0000","last_became_peered":"2023-05-17T15:10:57.217204+0000","last_unstale":"2023-05-17T15:10:57.221331+0000","last_undegraded":"2023-05-17T15:10:57.221331+0000","last_fullsized":"2023-05-17T15:10:57.221331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:56.809329+0000","last_clean_scrub_stamp":"2023-05-17T15:10:56.809329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.229305+0000","last_change":"2023-05-17T15:10:56.829548+0000","last_active":"2023-05-17T15:10:57.229305+0000","last_peered":"2023-05-17T15:10:57.229305+0000","last_clean":"2023-05-17T15:10:57.229305+0000","last_became_active":"2023-05-17T15:10:56.829265+0000","last_became_peered":"2023-05-17T15:10:56.829265+0000","last_unstale":"2023-05-17T15:10:57.229305+0000","last_undegraded":"2023-05-17T15:10:57.229305+0000","last_fullsized":"2023-05-17T15:10:57.229305+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:10:55.804730+0000","last_clean_scrub_stamp":"2023-05-17T15:10:55.804730+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-05-17T15:10:57.207013+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:10:57.207013+0000","last_peered":"2023-05-17T15:10:57.207013+0000","last_clean":"2023-05-17T15:10:57.207013+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:10:57.207013+0000","last_undegraded":"2023-05-17T15:10:57.207013+0000","last_fullsized":"2023-05-17T15:10:57.207013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":17408,"kb_avail":94352716,"statfs":{"total":96636764160,"available":96617181184,"internally_reserved":0,"allocated":1748992,"data_stored":875644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17825792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54000000000000004,"15min":0.57699999999999996},"min":{"1min":0.27200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.62}]},{"osd":1,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.78300000000000003,"5min":0.83499999999999996,"15min":0.94099999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80200000000000005,"5min":0.85899999999999999,"15min":0.89800000000000002},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.86699999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.875},"last":0.57399999999999995}]},{"osd":3,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.0109999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.746,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"max":{"1min":0.79400000000000004,"5min":0.85299999999999998,"15min":0.95899999999999996},"last":0.35599999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.31900000000000001},"max":{"1min":0.83099999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.95599999999999996,"15min":1.042},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575051,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18668,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":16960,"kb_avail":94353172,"statfs":{"total":96636764160,"available":96617648128,"internally_reserved":0,"allocated":1740800,"data_stored":876004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17367040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":3.427},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":4.4779999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.63100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85799999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.39400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.04,"15min":1.04},"last":1.0229999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.92800000000000005},"last":1.171},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.37,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.70299999999999996,"5min":1.087,"15min":1.087},"last":1.2809999999999999}]},{"osd":3,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":3.1150000000000002}]},{"osd":4,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86099999999999999,"5min":1.159,"15min":1.159},"last":0.625},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":1.452}]},{"osd":5,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":1.609,"15min":1.609},"last":1.21},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0640000000000001}]},{"osd":7,"last update":"Wed May 17 15:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82999999999999996,"5min":0.879,"15min":0.879},"last":2.6259999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.246}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18476,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353364,"statfs":{"total":96636764160,"available":96617844736,"internally_reserved":0,"allocated":1740800,"data_stored":875472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41999999999999998,"15min":0.44400000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23899999999999999},"max":{"1min":0.55000000000000004,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.376,"15min":0.39300000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.51800000000000002,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.20000000000000001},"max":{"1min":0.64700000000000002,"5min":1.956,"15min":1.956},"last":0.26900000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":1.149,"15min":1.149},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96599999999999997,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89600000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.65200000000000002},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":1.103,"15min":1.103},"last":1.3779999999999999}]},{"osd":6,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.65800000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.99199999999999999,"5min":1.524,"15min":1.524},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 17 15:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93400000000000005,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66900000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18292,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353548,"statfs":{"total":96636764160,"available":96618033152,"internally_reserved":0,"allocated":1748992,"data_stored":876918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.49099999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40200000000000002,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59099999999999997,"5min":1.129,"15min":1.129},"last":0.318}]},{"osd":2,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.215,"15min":0.215},"max":{"1min":0.61299999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":0.70099999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.214},"max":{"1min":0.54700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.78300000000000003,"15min":0.80500000000000005},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.875,"5min":1.163,"15min":1.163},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88300000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.119},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.087},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 17 15:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.67400000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19504,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":17792,"kb_avail":94352336,"statfs":{"total":96636764160,"available":96616792064,"internally_reserved":0,"allocated":1744896,"data_stored":876412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18219008},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48799999999999999,"5min":0.628,"15min":0.628},"last":0.253},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.377,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.68100000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.39400000000000002},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47699999999999998,"5min":0.57099999999999995,"15min":0.73999999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.436,"15min":0.45900000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58799999999999997,"5min":0.70499999999999996,"15min":0.71099999999999997},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64700000000000002,"15min":0.67900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85999999999999999,"5min":0.95999999999999996,"15min":1.046},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90200000000000002,"5min":0.98799999999999999,"15min":1.014},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.39700000000000002},"max":{"1min":0.75600000000000001,"5min":1.016,"15min":1.016},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0860000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.036,"15min":1.036},"last":0.626}]},{"osd":7,"last update":"Wed May 17 15:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63600000000000001,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.97499999999999998,"15min":1.03},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0029999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575051,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22516,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349324,"statfs":{"total":96636764160,"available":96613707776,"internally_reserved":0,"allocated":1748992,"data_stored":876128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.68300000000000005,"15min":0.748},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.52800000000000002,"5min":0.67300000000000004,"15min":0.69299999999999995},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.71699999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.75700000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38}]},{"osd":4,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64100000000000001,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.99099999999999999,"15min":1.034},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":1.0409999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":1.155,"15min":1.155},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81899999999999995,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.772,"15min":1.772},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84899999999999998,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 17 15:10:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.501,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.1519999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18928,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":17216,"kb_avail":94352912,"statfs":{"total":96636764160,"available":96617381888,"internally_reserved":0,"allocated":1744896,"data_stored":876094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17629184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.313,"15min":0.31},"max":{"1min":0.85399999999999998,"5min":0.91100000000000003,"15min":1.0069999999999999},"last":0.747},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":1.292,"15min":1.292},"last":0.623}]},{"osd":2,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.96899999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0620000000000001,"5min":1.329,"15min":1.329},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86099999999999999,"5min":1.151,"15min":1.151},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed May 17 15:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92300000000000004,"5min":0.99299999999999999,"15min":1.0629999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97199999999999998,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22060,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":20352,"kb_avail":94349780,"statfs":{"total":96636764160,"available":96614174720,"internally_reserved":0,"allocated":1740800,"data_stored":875540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20840448},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.86699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58099999999999996,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.995},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68700000000000006,"5min":0.997,"15min":0.997},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.85999999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.746,"5min":0.88,"15min":0.91700000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.30599999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92700000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":1.091,"15min":1.091},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.51000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82999999999999996,"5min":1.016,"15min":1.016},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed May 17 15:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.31},"max":{"1min":0.85899999999999999,"5min":1.107,"15min":1.107},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:11:06.058 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:11:06.059 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:11:06.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.208+0000 7f100c1c4700 1 Processor -- start 2023-05-17T15:11:06.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.208+0000 7f100c1c4700 1 -- start start 2023-05-17T15:11:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100c1c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10041543d0 0x7f10040c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100c1c4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1004069410 0x7f10040bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100c1c4700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1004158790 con 0x7f10040c60f0 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100c1c4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10040c1c50 con 0x7f1004069410 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100c1c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c6570 con 0x7f10041543d0 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100a761700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1004069410 0x7f10040bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100975f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f10040c60f0 0x7f1004068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43358/0 (socket says 172.21.15.27:43358) 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100975f700 1 -- 172.21.15.27:0/1566096391 learned_addr learned my addr 172.21.15.27:0/1566096391 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f1009f60700 1 --2- 172.21.15.27:0/1566096391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10041543d0 0x7f10040c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100a761700 1 -- 172.21.15.27:0/1566096391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10041543d0 msgr2=0x7f10040c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100a761700 1 --2- 172.21.15.27:0/1566096391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10041543d0 0x7f10040c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f100a761700 1 -- 172.21.15.27:0/1566096391 >> v1:172.21.15.27:6789/0 conn(0x7f10040c60f0 legacy=0x7f1004068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.209+0000 7f1008f5e700 1 -- 172.21.15.27:0/1566096391 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370707594 0 0) 0x7f1004158790 con 0x7f10040c60f0 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100a761700 1 -- 172.21.15.27:0/1566096391 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004157e60 con 0x7f1004069410 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100a761700 1 --2- 172.21.15.27:0/1566096391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1004069410 0x7f10040bfc80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f0ff4009e60 tx=0x7f0ff4009780).ready entity=mon.0 client_cookie=c585f8e5271a7c4b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f1008f5e700 1 -- 172.21.15.27:0/1566096391 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400e070 con 0x7f1004069410 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f1008f5e700 1 -- 172.21.15.27:0/1566096391 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff400bc30 con 0x7f1004069410 2023-05-17T15:11:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f1008f5e700 1 -- 172.21.15.27:0/1566096391 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4012410 con 0x7f1004069410 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 -- 172.21.15.27:0/1566096391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1004069410 msgr2=0x7f10040bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 --2- 172.21.15.27:0/1566096391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1004069410 0x7f10040bfc80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f0ff4009e60 tx=0x7f0ff4009780).stop 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 -- 172.21.15.27:0/1566096391 shutdown_connections 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 --2- 172.21.15.27:0/1566096391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1004069410 0x7f10040bfc80 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 --2- 172.21.15.27:0/1566096391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10041543d0 0x7f10040c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 -- 172.21.15.27:0/1566096391 >> 172.21.15.27:0/1566096391 conn(0x7f10040cb7f0 msgr2=0x7f10040c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:06.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 -- 172.21.15.27:0/1566096391 shutdown_connections 2023-05-17T15:11:06.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.210+0000 7f100c1c4700 1 -- 172.21.15.27:0/1566096391 wait complete. 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.211+0000 7f100c1c4700 1 Processor -- start 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.211+0000 7f100c1c4700 1 -- start start 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100c1c4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1004069410 0x7f10040c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100c1c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10040c60f0 0x7f10041521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100c1c4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 0x7f10040c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100c1c4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c3ff0 con 0x7f10041543d0 2023-05-17T15:11:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100c1c4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c1e60 con 0x7f1004069410 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100c1c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c2140 con 0x7f10040c60f0 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100a761700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 0x7f10040c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100a761700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 0x7f10040c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43804/0 (socket says 172.21.15.27:43804) 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100a761700 1 -- 172.21.15.27:0/634575136 learned_addr learned my addr 172.21.15.27:0/634575136 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f1009f60700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1004069410 0x7f10040c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.212+0000 7f100975f700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10040c60f0 0x7f10041521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100a761700 1 -- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10040c60f0 msgr2=0x7f10041521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100a761700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10040c60f0 0x7f10041521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100a761700 1 -- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1004069410 msgr2=0x7f10040c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100a761700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1004069410 0x7f10040c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100a761700 1 -- 172.21.15.27:0/634575136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009a20 con 0x7f10041543d0 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100a761700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 0x7f10040c3550 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f0ff400b6c0 tx=0x7f0ff4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40116d0 con 0x7f10041543d0 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff4011830 con 0x7f10041543d0 2023-05-17T15:11:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040c2420 con 0x7f10041543d0 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4011bf0 con 0x7f10041543d0 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.213+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10040b0a30 con 0x7f10041543d0 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.214+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10040c2920 con 0x7f10041543d0 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.214+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ff401d420 con 0x7f10041543d0 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.215+0000 7f1001ffb700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0ff005ed90 0x7f0ff0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.215+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f0ff407bec0 con 0x7f10041543d0 2023-05-17T15:11:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.215+0000 7f1009f60700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0ff005ed90 0x7f0ff0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.215+0000 7f1009f60700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0ff005ed90 0x7f0ff0061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0ffc00ab00 tx=0x7f0ffc006f90).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.219+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ff404d290 con 0x7f10041543d0 2023-05-17T15:11:06.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.458+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f1004158140 con 0x7f10041543d0 2023-05-17T15:11:06.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.461+0000 7f1001ffb700 1 -- 172.21.15.27:0/634575136 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0ff40508b0 con 0x7f10041543d0 2023-05-17T15:11:06.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0ff005ed90 msgr2=0x7f0ff0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0ff005ed90 0x7f0ff0061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0ffc00ab00 tx=0x7f0ffc006f90).stop 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 msgr2=0x7f10040c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 0x7f10040c3550 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f0ff400b6c0 tx=0x7f0ff4009780).stop 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 shutdown_connections 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0ff005ed90 0x7f0ff0061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10041543d0 0x7f10040c3550 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1004069410 0x7f10040c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 --2- 172.21.15.27:0/634575136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10040c60f0 0x7f10041521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 >> 172.21.15.27:0/634575136 conn(0x7f10040cb7f0 msgr2=0x7f1004157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:06.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 shutdown_connections 2023-05-17T15:11:06.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.463+0000 7f100c1c4700 1 -- 172.21.15.27:0/634575136 wait complete. 2023-05-17T15:11:06.469 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:11:06.479 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:11:06.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.591+0000 7f65c55a2700 1 Processor -- start 2023-05-17T15:11:06.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.591+0000 7f65c55a2700 1 -- start start 2023-05-17T15:11:06.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65c55a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65c005e460 0x7f65c00653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65c55a2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0064f20 con 0x7f65c0153d80 2023-05-17T15:11:06.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65c55a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0064310 con 0x7f65c0154160 2023-05-17T15:11:06.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65c55a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c00645f0 con 0x7f65c005e460 2023-05-17T15:11:06.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65beffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f65c0153d80 0x7f65c00bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43372/0 (socket says 172.21.15.27:43372) 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65beffd700 1 -- 172.21.15.27:0/4276539084 learned_addr learned my addr 172.21.15.27:0/4276539084 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.592+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056923343 0 0) 0x7f65c0064f20 con 0x7f65c0153d80 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ac0033f0 con 0x7f65c0153d80 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/4276539084 >> v2:172.21.15.40:3300/0 conn(0x7f65c005e460 0x7f65c00653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729493940 0 0) 0x7f65ac0033f0 con 0x7f65c0153d80 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 >> v2:172.21.15.40:3300/0 conn(0x7f65c005e460 msgr2=0x7f65c00653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 --2- 172.21.15.27:0/4276539084 >> v2:172.21.15.40:3300/0 conn(0x7f65c005e460 0x7f65c00653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 >> v1:172.21.15.40:6789/0 conn(0x7f65c0154160 legacy=0x7f65c005dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00648d0 con 0x7f65c0153d80 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f65b80017f0 con 0x7f65c0153d80 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 >> v1:172.21.15.27:6789/0 conn(0x7f65c0153d80 legacy=0x7f65c00bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ac0038e0 0x7f65ac003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65ac004690 0x7f65ac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65ac00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00645f0 con 0x7f65ac005000 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac00beb0 con 0x7f65ac0038e0 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac00c070 con 0x7f65ac004690 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65ac00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65beffd700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ac0038e0 0x7f65ac003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65be7fc700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65ac004690 0x7f65ac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 -- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65ac004690 msgr2=0x7f65ac004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65ac004690 0x7f65ac004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 -- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ac0038e0 msgr2=0x7f65ac003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ac0038e0 0x7f65ac003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 -- 172.21.15.27:0/4276539084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0033f0 con 0x7f65ac005000 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 -- 172.21.15.27:0/4276539084 reap_dead start 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.593+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65ac00b8e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f65c00c1ee0 tx=0x7f65b0009060).ready entity=mon.0 client_cookie=aafab6f33819f7d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0009e90 con 0x7f65ac005000 2023-05-17T15:11:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0009430 con 0x7f65ac005000 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65bdffb700 1 -- 172.21.15.27:0/4276539084 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000e870 con 0x7f65ac005000 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 -- 172.21.15.27:0/4276539084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 msgr2=0x7f65ac00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65ac00b8e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f65c00c1ee0 tx=0x7f65b0009060).stop 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 -- 172.21.15.27:0/4276539084 shutdown_connections 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 --2- 172.21.15.27:0/4276539084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65ac00b8e0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 -- 172.21.15.27:0/4276539084 >> 172.21.15.27:0/4276539084 conn(0x7f65c00c8400 msgr2=0x7f65c00c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:06.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 -- 172.21.15.27:0/4276539084 shutdown_connections 2023-05-17T15:11:06.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.594+0000 7f65c55a2700 1 -- 172.21.15.27:0/4276539084 wait complete. 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.595+0000 7f65c55a2700 1 Processor -- start 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.595+0000 7f65c55a2700 1 -- start start 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65c55a2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65c0152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65c55a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c014e4e0 0x7f65c00be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65c55a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65c014dbc0 0x7f65c00c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65c55a2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00abcf0 con 0x7f65ac005000 2023-05-17T15:11:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65c55a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00ac830 con 0x7f65c014e4e0 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65c55a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00abf00 con 0x7f65c014dbc0 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65beffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65c0152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65beffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65c0152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43822/0 (socket says 172.21.15.27:43822) 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65beffd700 1 -- 172.21.15.27:0/764047010 learned_addr learned my addr 172.21.15.27:0/764047010 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65be7fc700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c014e4e0 0x7f65c00be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.596+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65c014dbc0 0x7f65c00c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65beffd700 1 -- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65c014dbc0 msgr2=0x7f65c00c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65beffd700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65c014dbc0 0x7f65c00c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65beffd700 1 -- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c014e4e0 msgr2=0x7f65c00be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65beffd700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c014e4e0 0x7f65c00be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65beffd700 1 -- 172.21.15.27:0/764047010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00ac1e0 con 0x7f65ac005000 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65be7fc700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c014e4e0 0x7f65c00be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65bf7fe700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65c014dbc0 0x7f65c00c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65beffd700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65c0152ae0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f65b8007710 tx=0x7f65b8001860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800f8d0 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b800fa30 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c00ac4c0 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800fdd0 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.597+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c00beec0 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.598+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c006bdf0 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.598+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f65b801b030 con 0x7f65ac005000 2023-05-17T15:11:06.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.598+0000 7f65b6ffd700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65a005ed90 0x7f65a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:06.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.598+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f65b8079790 con 0x7f65ac005000 2023-05-17T15:11:06.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.599+0000 7f65be7fc700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65a005ed90 0x7f65a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:06.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.599+0000 7f65be7fc700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65a005ed90 0x7f65a0061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f65a8007cc0 tx=0x7f65a8009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:06.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.603+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65b804ad80 con 0x7f65ac005000 2023-05-17T15:11:06.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.816+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65c0064bb0 con 0x7f65ac005000 2023-05-17T15:11:06.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.817+0000 7f65b6ffd700 1 -- 172.21.15.27:0/764047010 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f65b8019020 con 0x7f65ac005000 2023-05-17T15:11:06.822 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:11:06.822 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:57.199573+0000","modified":"2023-05-17T15:11:00.212835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/4188362565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4188362565},{"type":"v1","addr":"172.21.15.40:6835","nonce":4188362565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-17T15:11:06.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65a005ed90 msgr2=0x7f65a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65a005ed90 0x7f65a0061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f65a8007cc0 tx=0x7f65a8009040).stop 2023-05-17T15:11:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 msgr2=0x7f65c0152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65c0152ae0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f65b8007710 tx=0x7f65b8001860).stop 2023-05-17T15:11:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 shutdown_connections 2023-05-17T15:11:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f65a005ed90 0x7f65a0061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65c014dbc0 0x7f65c00c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65ac005000 0x7f65c0152ae0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 --2- 172.21.15.27:0/764047010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c014e4e0 0x7f65c00be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 >> 172.21.15.27:0/764047010 conn(0x7f65c00c8400 msgr2=0x7f65c00c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 shutdown_connections 2023-05-17T15:11:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:06.819+0000 7f65c55a2700 1 -- 172.21.15.27:0/764047010 wait complete. 2023-05-17T15:11:06.825 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 60 2023-05-17T15:11:07.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:10:57.199573+0000', 'modified': '2023-05-17T15:11:00.212835+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8034}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8034': {'gid': 8034, 'name': 'b', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/4188362565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6833', 'nonce': 4188362565}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 4188362565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:11:07.238 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:11:07.238 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-17T15:11:07.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.353+0000 7f595f46b700 1 Processor -- start 2023-05-17T15:11:07.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.353+0000 7f595f46b700 1 -- start start 2023-05-17T15:11:07.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595f46b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 0x7f59580cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595f46b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5958069060 0x7f59580c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595f46b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580c6650 con 0x7f59580c61a0 2023-05-17T15:11:07.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595f46b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580c01c0 con 0x7f5958069060 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595f46b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580698b0 con 0x7f5958153f10 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595da08700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f59580c61a0 0x7f5958157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43396/0 (socket says 172.21.15.27:43396) 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.354+0000 7f595da08700 1 -- 172.21.15.27:0/3201880336 learned_addr learned my addr 172.21.15.27:0/3201880336 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f595ca06700 1 --2- 172.21.15.27:0/3201880336 >> v2:172.21.15.40:3300/0 conn(0x7f5958069060 0x7f59580c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f595d207700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 0x7f59580cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187417140 0 0) 0x7f5950001110 con 0x7f59580c61a0 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59400033f0 con 0x7f59580c61a0 2023-05-17T15:11:07.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4290940773 0 0) 0x7f59400033f0 con 0x7f59580c61a0 2023-05-17T15:11:07.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 msgr2=0x7f59580cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 0x7f59580cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 >> v2:172.21.15.40:3300/0 conn(0x7f5958069060 msgr2=0x7f59580c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 --2- 172.21.15.27:0/3201880336 >> v2:172.21.15.40:3300/0 conn(0x7f5958069060 0x7f59580c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958069b90 con 0x7f59580c61a0 2023-05-17T15:11:07.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5950001600 con 0x7f59580c61a0 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 >> v1:172.21.15.27:6789/0 conn(0x7f59580c61a0 legacy=0x7f5958157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59400038e0 0x7f5940003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5940004690 0x7f5940004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 0x7f5940005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c01c0 con 0x7f5940004690 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580698b0 con 0x7f59400038e0 2023-05-17T15:11:07.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594000b8e0 con 0x7f5958153f10 2023-05-17T15:11:07.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f595ca06700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5940004690 0x7f5940004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f595d207700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59400038e0 0x7f5940003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.355+0000 7f595da08700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 0x7f5940005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595ca06700 1 -- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 msgr2=0x7f5940005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595ca06700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5958153f10 0x7f5940005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595ca06700 1 -- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59400038e0 msgr2=0x7f5940003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595ca06700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59400038e0 0x7f5940003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595ca06700 1 -- 172.21.15.27:0/3201880336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400033f0 con 0x7f5940004690 2023-05-17T15:11:07.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595d207700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59400038e0 0x7f5940003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:07.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595ca06700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5940004690 0x7f5940004b10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f5958157b70 tx=0x7f594c009060).ready entity=mon.0 client_cookie=597056cfd6e6ea77 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c009e90 con 0x7f5940004690 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c009430 con 0x7f5940004690 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f5957fff700 1 -- 172.21.15.27:0/3201880336 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c00e850 con 0x7f5940004690 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595f46b700 1 -- 172.21.15.27:0/3201880336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5940004690 msgr2=0x7f5940004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595f46b700 1 --2- 172.21.15.27:0/3201880336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5940004690 0x7f5940004b10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f5958157b70 tx=0x7f594c009060).stop 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595da08700 1 -- 172.21.15.27:0/3201880336 reap_dead start 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595f46b700 1 -- 172.21.15.27:0/3201880336 shutdown_connections 2023-05-17T15:11:07.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595f46b700 1 -- 172.21.15.27:0/3201880336 >> 172.21.15.27:0/3201880336 conn(0x7f595805e820 msgr2=0x7f59580cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595f46b700 1 -- 172.21.15.27:0/3201880336 shutdown_connections 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.356+0000 7f595f46b700 1 -- 172.21.15.27:0/3201880336 wait complete. 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.357+0000 7f595f46b700 1 Processor -- start 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 -- start start 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5940004690 0x7f59581575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 0x7f5958164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59580b0a00 0x7f5958165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958165ca0 con 0x7f59580b0580 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581560c0 con 0x7f59580b0a00 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.358+0000 7f595f46b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958156350 con 0x7f5940004690 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 0x7f5958164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 0x7f5958164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43844/0 (socket says 172.21.15.27:43844) 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 -- 172.21.15.27:0/1388144775 learned_addr learned my addr 172.21.15.27:0/1388144775 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595da08700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59580b0a00 0x7f5958165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595d207700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5940004690 0x7f59581575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 -- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5940004690 msgr2=0x7f59581575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5940004690 0x7f59581575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 -- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59580b0a00 msgr2=0x7f5958165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59580b0a00 0x7f5958165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 -- 172.21.15.27:0/1388144775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958156630 con 0x7f59580b0580 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595d207700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5940004690 0x7f59581575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595ca06700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 0x7f5958164b90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f594c00e4b0 tx=0x7f594c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f59557fa700 1 -- 172.21.15.27:0/1388144775 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c01d8d0 con 0x7f59580b0580 2023-05-17T15:11:07.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f59557fa700 1 -- 172.21.15.27:0/1388144775 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c01da30 con 0x7f59580b0580 2023-05-17T15:11:07.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580c1f10 con 0x7f59580b0580 2023-05-17T15:11:07.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f59557fa700 1 -- 172.21.15.27:0/1388144775 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c01ddf0 con 0x7f59580b0580 2023-05-17T15:11:07.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.359+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958156910 con 0x7f59580b0580 2023-05-17T15:11:07.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.361+0000 7f59557fa700 1 -- 172.21.15.27:0/1388144775 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f594c02c020 con 0x7f59580b0580 2023-05-17T15:11:07.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.361+0000 7f59557fa700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f594405ed90 0x7f5944061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.361+0000 7f59557fa700 1 -- 172.21.15.27:0/1388144775 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f594c07b740 con 0x7f59580b0580 2023-05-17T15:11:07.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.361+0000 7f595d207700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f594405ed90 0x7f5944061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.361+0000 7f595d207700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f594405ed90 0x7f5944061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f59480076a0 tx=0x7f594800b040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.363+0000 7f5970dfdb80 1 Processor -- start 2023-05-17T15:11:07.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.363+0000 7f5970dfdb80 1 -- start start 2023-05-17T15:11:07.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ecf560 0x55d033eb2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033ecf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e85710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033e505e0 con 0x55d033ed4480 2023-05-17T15:11:07.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033dc78a0 con 0x55d033ecf560 2023-05-17T15:11:07.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d033ddc900 con 0x55d033e8b300 2023-05-17T15:11:07.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033ecf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033ecf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43852/0 (socket says 172.21.15.27:43852) 2023-05-17T15:11:07.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 -- 172.21.15.27:0/607496422 learned_addr learned my addr 172.21.15.27:0/607496422 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:07.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595d207700 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ecf560 0x55d033eb2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595da08700 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e85710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 -- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 msgr2=0x55d033e85710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e85710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 -- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ecf560 msgr2=0x55d033eb2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ecf560 0x55d033eb2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 -- 172.21.15.27:0/607496422 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d033e50450 con 0x55d033ed4480 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595da08700 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e85710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f595ca06700 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033ecf940 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f594c050500 tx=0x7f594c011000).ready entity=mon.0 client_cookie=ba6ead9106d22b56 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f593e7fc700 1 -- 172.21.15.27:0/607496422 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c04ece0 con 0x55d033ed4480 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f593e7fc700 1 -- 172.21.15.27:0/607496422 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0795e0 con 0x55d033ed4480 2023-05-17T15:11:07.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.364+0000 7f593e7fc700 1 -- 172.21.15.27:0/607496422 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c079750 con 0x55d033ed4480 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 -- 172.21.15.27:0/607496422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 msgr2=0x55d033ecf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033ecf940 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f594c050500 tx=0x7f594c011000).stop 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 -- 172.21.15.27:0/607496422 shutdown_connections 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e85710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ecf560 0x55d033eb2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/607496422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033ecf940 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 -- 172.21.15.27:0/607496422 >> 172.21.15.27:0/607496422 conn(0x55d033c47e40 msgr2=0x55d033ed39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 -- 172.21.15.27:0/607496422 shutdown_connections 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.365+0000 7f5970dfdb80 1 -- 172.21.15.27:0/607496422 wait complete. 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.366+0000 7f5970dfdb80 1 -- start start 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.366+0000 7f5970dfdb80 1 Processor -- start 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 0x55d033e865a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033da3ed0 con 0x55d033e8b300 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033eaeb20 con 0x55d033ed4480 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d033eb9560 con 0x55d033ecf560 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 10 client.0 ll_register_callbacks cb 0x55d033e4a1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 0x55d033e865a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 0x55d033e865a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43856/0 (socket says 172.21.15.27:43856) 2023-05-17T15:11:07.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 -- 172.21.15.27:0/1344921196 learned_addr learned my addr 172.21.15.27:0/1344921196 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595ca06700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595da08700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 -- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 msgr2=0x55d033eb8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 -- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 msgr2=0x55d033eb8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 -- 172.21.15.27:0/1344921196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958156910 con 0x55d033e8b300 2023-05-17T15:11:07.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f595d207700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 0x55d033e865a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f5948014460 tx=0x7f5948019040).ready entity=mon.0 client_cookie=4d31e10e5696cf79 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f59377fe700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:11:07.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f59377fe700 1 -- 172.21.15.27:0/1344921196 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594800e040 con 0x55d033e8b300 2023-05-17T15:11:07.390 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f59377fe700 1 -- 172.21.15.27:0/1344921196 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f5948014b80 con 0x55d033e8b300 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d033e7e460 con 0x55d033e8b300 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f59377fe700 1 -- 172.21.15.27:0/1344921196 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5948023480 con 0x55d033e8b300 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 10 client.8202 fetch_fsmap learned FSMap version 60 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.367+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55d033c7f310 con 0x55d033e8b300 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f59377fe700 1 -- 172.21.15.27:0/1344921196 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d033e7e460 con 0x55d033e8b300 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f59377fe700 1 -- 172.21.15.27:0/1344921196 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f59480235e0 con 0x55d033e8b300 2023-05-17T15:11:07.391 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f5970dfdb80 10 client.8202 fetch_fsmap finished waiting for FSMap version 60 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f5970dfdb80 10 client.8202 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f5970dfdb80 20 client.8202 populate_metadata read hostname 'smithi027' 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033eadf40 0x55d033eae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f5970dfdb80 4 client.8202 mds_command: new command op to 8034 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 --> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d033c43ca0 con 0x55d033eadf40 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f595ca06700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033eadf40 0x55d033eae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.392 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f59377fe700 10 client.8202 ms_handle_connect on v2:172.21.15.40:6833/4188362565 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.368+0000 7f595ca06700 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033eadf40 0x55d033eae320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b0c36c0218c50115 server_cookie=8491370fa1292c81 in_seq=0 out_seq=0 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f59377fe700 1 -- 172.21.15.27:0/1344921196 <== mds.0 v2:172.21.15.40:6833/4188362565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d033c43ca0 con 0x55d033eadf40 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f59377fe700 10 client.8202 handle_command_reply: tid=0 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 client.8202 shutdown 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 msgr2=0x55d033e865a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 0x55d033e865a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f5948014460 tx=0x7f5948019040).stop 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 shutdown_connections 2023-05-17T15:11:07.393 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033eadf40 0x55d033eae320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033e8b300 0x55d033e865a0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f59377fe700 0 client.8202 ms_handle_reset on v2:172.21.15.40:6833/4188362565 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/1344921196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 >> 172.21.15.27:0/1344921196 conn(0x55d033c47e40 msgr2=0x55d033ed02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 shutdown_connections 2023-05-17T15:11:07.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.369+0000 7f5970dfdb80 1 -- 172.21.15.27:0/1344921196 wait complete. 2023-05-17T15:11:07.395 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.370+0000 7f5970dfdb80 20 client.8202 trim_cache size 0 max 16384 2023-05-17T15:11:07.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.386+0000 7f5970dfdb80 1 Processor -- start 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.386+0000 7f5970dfdb80 1 -- start start 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e81b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 0x55d033e85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033eb5c80 con 0x55d033ecf560 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033e8a030 con 0x55d033ed4480 2023-05-17T15:11:07.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d033e86350 con 0x55d033e8b300 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 0x55d033e85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 0x55d033e85830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43866/0 (socket says 172.21.15.27:43866) 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 -- 172.21.15.27:0/2259227802 learned_addr learned my addr 172.21.15.27:0/2259227802 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595d207700 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e81b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595da08700 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 -- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 msgr2=0x55d033e81b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e81b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 -- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 msgr2=0x55d033eb8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 -- 172.21.15.27:0/2259227802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d033dd5880 con 0x55d033ecf560 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595da08700 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f595ca06700 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 0x55d033e85830 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f594c0095a0 tx=0x7f594c054000).ready entity=mon.0 client_cookie=5981b798c073bfa3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f593effd700 1 -- 172.21.15.27:0/2259227802 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c01d690 con 0x55d033ecf560 2023-05-17T15:11:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f593effd700 1 -- 172.21.15.27:0/2259227802 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c04ece0 con 0x55d033ecf560 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.387+0000 7f593effd700 1 -- 172.21.15.27:0/2259227802 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c079960 con 0x55d033ecf560 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 -- 172.21.15.27:0/2259227802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 msgr2=0x55d033e85830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 0x55d033e85830 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f594c0095a0 tx=0x7f594c054000).stop 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 -- 172.21.15.27:0/2259227802 shutdown_connections 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033ed4480 0x55d033eb8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033e8b300 0x55d033e81b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/2259227802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ecf560 0x55d033e85830 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 -- 172.21.15.27:0/2259227802 >> 172.21.15.27:0/2259227802 conn(0x55d033c47e40 msgr2=0x55d033eb2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 -- 172.21.15.27:0/2259227802 shutdown_connections 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 -- 172.21.15.27:0/2259227802 wait complete. 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.388+0000 7f5970dfdb80 1 -- start start 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 Processor -- start 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033e8b300 0x55d033ed26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033f1d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033eab520 con 0x55d033ed4480 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d033f34a60 con 0x55d033e8b300 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d033eab6c0 con 0x55d033ecf560 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f5970dfdb80 10 client.0 ll_register_callbacks cb 0x55d033e4a1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f595da08700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033f1d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f595da08700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033f1d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43874/0 (socket says 172.21.15.27:43874) 2023-05-17T15:11:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.389+0000 7f595da08700 1 -- 172.21.15.27:0/3620944149 learned_addr learned my addr 172.21.15.27:0/3620944149 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595d207700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033e8b300 0x55d033ed26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595ca06700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595da08700 1 -- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 msgr2=0x55d033eb2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595da08700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595da08700 1 -- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033e8b300 msgr2=0x55d033ed26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595da08700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033e8b300 0x55d033ed26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595da08700 1 -- 172.21.15.27:0/3620944149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d033e50450 con 0x55d033ed4480 2023-05-17T15:11:07.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595ca06700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f595da08700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033f1d7a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f5958083d70 tx=0x7f5950007040).ready entity=mon.0 client_cookie=535d6e9468995089 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f59377fe700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f59377fe700 1 -- 172.21.15.27:0/3620944149 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950006920 con 0x55d033ed4480 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f59377fe700 1 -- 172.21.15.27:0/3620944149 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f5950016760 con 0x55d033ed4480 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f594c0795e0 con 0x55d033ed4480 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f59377fe700 1 -- 172.21.15.27:0/3620944149 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5950016920 con 0x55d033ed4480 2023-05-17T15:11:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 10 client.8208 fetch_fsmap learned FSMap version 60 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55d033dd1070 con 0x55d033ed4480 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f59377fe700 1 -- 172.21.15.27:0/3620944149 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0795e0 con 0x55d033ed4480 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f59377fe700 1 -- 172.21.15.27:0/3620944149 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5950016a80 con 0x55d033ed4480 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 10 client.8208 fetch_fsmap finished waiting for FSMap version 60 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 10 client.8208 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 20 client.8208 populate_metadata read hostname 'smithi027' 2023-05-17T15:11:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033e84a90 0x55d033e84e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 4 client.8208 mds_command: new command op to 8034 tid=0[{"prefix": "status"}] 2023-05-17T15:11:07.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.390+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 --> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d033c7aca0 con 0x55d033e84a90 2023-05-17T15:11:07.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f595d207700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033e84a90 0x55d033e84e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f59377fe700 10 client.8208 ms_handle_connect on v2:172.21.15.40:6833/4188362565 2023-05-17T15:11:07.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f595d207700 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033e84a90 0x55d033e84e70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=90c52689bbb7e049 server_cookie=3d602f8c7623665e in_seq=0 out_seq=0 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f59377fe700 1 -- 172.21.15.27:0/3620944149 <== mds.0 v2:172.21.15.40:6833/4188362565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d033c7aca0 con 0x55d033e84a90 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f59377fe700 10 client.8208 handle_command_reply: tid=0 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 client.8208 shutdown 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 msgr2=0x55d033f1d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033f1d7a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f5958083d70 tx=0x7f5950007040).stop 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 shutdown_connections 2023-05-17T15:11:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:6833/4188362565,v1:172.21.15.40:6835/4188362565] conn(0x55d033e84a90 0x55d033e84e70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d033ed4480 0x55d033f1d7a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f59377fe700 0 client.8208 ms_handle_reset on v2:172.21.15.40:6833/4188362565 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d033e8b300 0x55d033ed26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 --2- 172.21.15.27:0/3620944149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55d033ecf560 0x55d033eb2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 >> 172.21.15.27:0/3620944149 conn(0x55d033c47e40 msgr2=0x55d033e865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 shutdown_connections 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.391+0000 7f5970dfdb80 1 -- 172.21.15.27:0/3620944149 wait complete. 2023-05-17T15:11:07.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f5970dfdb80 20 client.8208 trim_cache size 0 max 16384 2023-05-17T15:11:07.412 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:11:07.412 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:11:07.413 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:11:07.413 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 8034, 2023-05-17T15:11:07.413 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:11:07.413 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:11:07.413 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:11:07.414 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 10.190866374000001, 2023-05-17T15:11:07.414 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 60, 2023-05-17T15:11:07.414 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 140, 2023-05-17T15:11:07.414 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 140, 2023-05-17T15:11:07.414 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 14.757072788 2023-05-17T15:11:07.415 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:11:07.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f594405ed90 msgr2=0x7f5944061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f594405ed90 0x7f5944061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f59480076a0 tx=0x7f594800b040).stop 2023-05-17T15:11:07.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 msgr2=0x7f5958164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 0x7f5958164b90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f594c00e4b0 tx=0x7f594c01a000).stop 2023-05-17T15:11:07.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 shutdown_connections 2023-05-17T15:11:07.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f594405ed90 0x7f5944061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59580b0a00 0x7f5958165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5940004690 0x7f59581575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 --2- 172.21.15.27:0/1388144775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59580b0580 0x7f5958164b90 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 >> 172.21.15.27:0/1388144775 conn(0x7f595805e820 msgr2=0x7f5958157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 shutdown_connections 2023-05-17T15:11:07.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.392+0000 7f595f46b700 1 -- 172.21.15.27:0/1388144775 wait complete. 2023-05-17T15:11:07.419 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:11:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.519+0000 7efd5d237700 1 Processor -- start 2023-05-17T15:11:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.519+0000 7efd5d237700 1 -- start start 2023-05-17T15:11:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5d237700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd58153c00 0x7efd580638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5d237700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd580c5110 0x7efd580c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5d237700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd58063460 con 0x7efd58153fe0 2023-05-17T15:11:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5d237700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd58062850 con 0x7efd580c5110 2023-05-17T15:11:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5d237700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd58062b30 con 0x7efd58153c00 2023-05-17T15:11:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5ca36700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd580c5110 0x7efd580c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd577fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efd58153fe0 0x7efd580c4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43442/0 (socket says 172.21.15.27:43442) 2023-05-17T15:11:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd577fe700 1 -- 172.21.15.27:0/1921375740 learned_addr learned my addr 172.21.15.27:0/1921375740 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd57fff700 1 --2- 172.21.15.27:0/1921375740 >> v2:172.21.15.40:3300/0 conn(0x7efd58153c00 0x7efd580638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5ca36700 1 -- 172.21.15.27:0/1921375740 >> v2:172.21.15.40:3300/0 conn(0x7efd58153c00 msgr2=0x7efd580638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5ca36700 1 --2- 172.21.15.27:0/1921375740 >> v2:172.21.15.40:3300/0 conn(0x7efd58153c00 0x7efd580638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5ca36700 1 -- 172.21.15.27:0/1921375740 >> v1:172.21.15.27:6789/0 conn(0x7efd58153fe0 legacy=0x7efd580c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5ca36700 1 -- 172.21.15.27:0/1921375740 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58062e10 con 0x7efd580c5110 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd56ffd700 1 -- 172.21.15.27:0/1921375740 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104332584 0 0) 0x7efd58063460 con 0x7efd58153fe0 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd5ca36700 1 --2- 172.21.15.27:0/1921375740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd580c14a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7efd58067900 tx=0x7efd50009780).ready entity=mon.0 client_cookie=e904ce4d50f8ca69 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.520+0000 7efd56ffd700 1 -- 172.21.15.27:0/1921375740 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000e070 con 0x7efd580c5110 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd56ffd700 1 -- 172.21.15.27:0/1921375740 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5000bc30 con 0x7efd580c5110 2023-05-17T15:11:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd56ffd700 1 -- 172.21.15.27:0/1921375740 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50012410 con 0x7efd580c5110 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 -- 172.21.15.27:0/1921375740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 msgr2=0x7efd580c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 --2- 172.21.15.27:0/1921375740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd580c14a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7efd58067900 tx=0x7efd50009780).stop 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 -- 172.21.15.27:0/1921375740 shutdown_connections 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 --2- 172.21.15.27:0/1921375740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd580c14a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 --2- 172.21.15.27:0/1921375740 >> v2:172.21.15.40:3300/0 conn(0x7efd58153c00 0x7efd580638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 -- 172.21.15.27:0/1921375740 >> 172.21.15.27:0/1921375740 conn(0x7efd58064d80 msgr2=0x7efd580c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 -- 172.21.15.27:0/1921375740 shutdown_connections 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.521+0000 7efd5d237700 1 -- 172.21.15.27:0/1921375740 wait complete. 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.522+0000 7efd5d237700 1 Processor -- start 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.522+0000 7efd5d237700 1 -- start start 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5d237700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd58151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5d237700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd58153c00 0x7efd58154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5d237700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd58153fe0 0x7efd580a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5d237700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58154a20 con 0x7efd580c5110 2023-05-17T15:11:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5d237700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58155fb0 con 0x7efd58153c00 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5d237700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd58152050 con 0x7efd58153fe0 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd58151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd57fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd58151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43884/0 (socket says 172.21.15.27:43884) 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd57fff700 1 -- 172.21.15.27:0/3225404220 learned_addr learned my addr 172.21.15.27:0/3225404220 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd577fe700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd58153c00 0x7efd58154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd5ca36700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd58153fe0 0x7efd580a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd57fff700 1 -- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd58153fe0 msgr2=0x7efd580a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.523+0000 7efd57fff700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd58153fe0 0x7efd580a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd57fff700 1 -- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd58153c00 msgr2=0x7efd58154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd57fff700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd58153c00 0x7efd58154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd57fff700 1 -- 172.21.15.27:0/3225404220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009a20 con 0x7efd580c5110 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd577fe700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd58153c00 0x7efd58154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd57fff700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd58151a90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7efd4800d890 tx=0x7efd48008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480125f0 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48012750 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd58152330 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48012ad0 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.524+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd581528f0 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.525+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd581562e0 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.525+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efd48013480 con 0x7efd580c5110 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.525+0000 7efd4ffff700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd3805ed90 0x7efd38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.526+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7efd48079af0 con 0x7efd580c5110 2023-05-17T15:11:07.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.526+0000 7efd577fe700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd3805ed90 0x7efd38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:07.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.526+0000 7efd577fe700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd3805ed90 0x7efd38061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7efd58151f80 tx=0x7efd40009040).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:07.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.530+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd4804afd0 con 0x7efd580c5110 2023-05-17T15:11:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.749+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd58156120 con 0x7efd580c5110 2023-05-17T15:11:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.749+0000 7efd4ffff700 1 -- 172.21.15.27:0/3225404220 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7efd58156120 con 0x7efd580c5110 2023-05-17T15:11:07.753 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:11:07.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd3805ed90 msgr2=0x7efd38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd3805ed90 0x7efd38061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7efd58151f80 tx=0x7efd40009040).stop 2023-05-17T15:11:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 msgr2=0x7efd58151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:07.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd58151a90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7efd4800d890 tx=0x7efd48008040).stop 2023-05-17T15:11:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 shutdown_connections 2023-05-17T15:11:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7efd3805ed90 0x7efd38061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd58153fe0 0x7efd580a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd580c5110 0x7efd58151a90 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 --2- 172.21.15.27:0/3225404220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd58153c00 0x7efd58154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:07.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 >> 172.21.15.27:0/3225404220 conn(0x7efd58064d80 msgr2=0x7efd580a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:07.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 shutdown_connections 2023-05-17T15:11:07.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:07.751+0000 7efd5d237700 1 -- 172.21.15.27:0/3225404220 wait complete. 2023-05-17T15:11:07.766 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:11:07.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:11:07.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:11:07.767 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:11:07.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:11:07.768 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:11:07.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:11:07.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:11:07.769 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:11:07.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:07.770 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:11:07.785 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:11:07.786 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:11:07.786 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:11:07.786 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.786 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:11:07.786 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 41245sec preferred_lft 41245sec 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:11:07.787 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:11:07.788 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:11:07.789 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.789 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:11:07.789 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.789 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:11:07.789 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:11:07.789 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:11:07.790 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.790 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:11:07.790 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:11:07.790 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:11:07.790 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:11:07.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:07.791 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:11:07.849 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:11:07.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:07.851 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:11:07.907 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:11:07.907 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:11:07.907 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:11:07.908 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:11:07.908 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:11:07.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:07.909 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:11:07.910 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:11:07.911 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:11:07.911 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:11:07.912 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:11:07.913 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:11:08.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:08.008 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:11:08.025 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:11:08.025 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:11:08.026 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:11:08.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:08.027 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:11:08.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:08.090 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:11:08.144 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:11:08.144 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:11:08.222 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:11:08.222 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:11:08.264 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:11:08.265 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:11:08.266 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:11:08.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:11:08.267 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:11:08.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:11:08.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.486+0000 7f45c3194700 1 Processor -- start 2023-05-17T15:11:08.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.486+0000 7f45c3194700 1 -- start start 2023-05-17T15:11:08.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45c3194700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45bc154090 0x7f45bc154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45c3194700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 0x7f45bc0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45c3194700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc0c5a50 con 0x7f45bc068f00 2023-05-17T15:11:08.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45c3194700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc069fa0 con 0x7f45bc154090 2023-05-17T15:11:08.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45c3194700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c04e0 con 0x7f45bc0cb450 2023-05-17T15:11:08.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 0x7f45bc0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45c0f30700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45bc154090 0x7f45bc154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 0x7f45bc0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:45010/0 (socket says 172.21.15.27:45010) 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.487+0000 7f45bbfff700 1 -- 172.21.15.27:0/3018233090 learned_addr learned my addr 172.21.15.27:0/3018233090 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bbfff700 1 -- 172.21.15.27:0/3018233090 >> v2:172.21.15.40:3300/0 conn(0x7f45bc154090 msgr2=0x7f45bc154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bbfff700 1 --2- 172.21.15.27:0/3018233090 >> v2:172.21.15.40:3300/0 conn(0x7f45bc154090 0x7f45bc154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bbfff700 1 -- 172.21.15.27:0/3018233090 >> v1:172.21.15.40:6789/0 conn(0x7f45bc068f00 legacy=0x7f45bc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bbfff700 1 -- 172.21.15.27:0/3018233090 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0c0760 con 0x7f45bc0cb450 2023-05-17T15:11:08.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bb7fe700 1 -- 172.21.15.27:0/3018233090 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010903920 0 0) 0x7f45bc0c5a50 con 0x7f45bc068f00 2023-05-17T15:11:08.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45c0f30700 1 --2- 172.21.15.27:0/3018233090 >> v2:172.21.15.40:3300/0 conn(0x7f45bc154090 0x7f45bc154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:11:08.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bbfff700 1 --2- 172.21.15.27:0/3018233090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 0x7f45bc0cb8d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f45ac009f50 tx=0x7f45ac009840).ready entity=mon.2 client_cookie=3c2bee5f5fae8720 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:08.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bb7fe700 1 -- 172.21.15.27:0/3018233090 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00e070 con 0x7f45bc0cb450 2023-05-17T15:11:08.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bb7fe700 1 -- 172.21.15.27:0/3018233090 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac00b9c0 con 0x7f45bc0cb450 2023-05-17T15:11:08.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.488+0000 7f45bb7fe700 1 -- 172.21.15.27:0/3018233090 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00bd40 con 0x7f45bc0cb450 2023-05-17T15:11:08.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 -- 172.21.15.27:0/3018233090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 msgr2=0x7f45bc0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 --2- 172.21.15.27:0/3018233090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 0x7f45bc0cb8d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f45ac009f50 tx=0x7f45ac009840).stop 2023-05-17T15:11:08.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 -- 172.21.15.27:0/3018233090 shutdown_connections 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 --2- 172.21.15.27:0/3018233090 >> v2:172.21.15.40:3300/0 conn(0x7f45bc154090 0x7f45bc154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 --2- 172.21.15.27:0/3018233090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc0cb450 0x7f45bc0cb8d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 -- 172.21.15.27:0/3018233090 >> 172.21.15.27:0/3018233090 conn(0x7f45bc05e7e0 msgr2=0x7f45bc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 -- 172.21.15.27:0/3018233090 shutdown_connections 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.489+0000 7f45c3194700 1 -- 172.21.15.27:0/3018233090 wait complete. 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.490+0000 7f45c3194700 1 Processor -- start 2023-05-17T15:11:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.490+0000 7f45c3194700 1 -- start start 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc068f00 0x7f45bc13b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 0x7f45bc154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc154090 0x7f45bc154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc154fe0 con 0x7f45bc0cb450 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c2db0 con 0x7f45bc068f00 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c3090 con 0x7f45bc154090 2023-05-17T15:11:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 0x7f45bc154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 0x7f45bc154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43906/0 (socket says 172.21.15.27:43906) 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 -- 172.21.15.27:0/783521226 learned_addr learned my addr 172.21.15.27:0/783521226 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c0f30700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc068f00 0x7f45bc13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c1731700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc154090 0x7f45bc154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 -- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc154090 msgr2=0x7f45bc154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc154090 0x7f45bc154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 -- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc068f00 msgr2=0x7f45bc13b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc068f00 0x7f45bc13b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 -- 172.21.15.27:0/783521226 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40092a0 con 0x7f45bc0cb450 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c0f30700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc068f00 0x7f45bc13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45bbfff700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 0x7f45bc154600 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f45ac00b950 tx=0x7f45bc0c0650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0092e0 con 0x7f45bc0cb450 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac00bb30 con 0x7f45bc0cb450 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac01e680 con 0x7f45bc0cb450 2023-05-17T15:11:08.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.491+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac009ae0 con 0x7f45bc0cb450 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.492+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc157720 con 0x7f45bc0cb450 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.492+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc0c31d0 con 0x7f45bc0cb450 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.493+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f45ac025030 con 0x7f45bc0cb450 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.493+0000 7f45b8ff9700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f459c05ed90 0x7f459c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.493+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f45ac07af70 con 0x7f45bc0cb450 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.493+0000 7f45c0f30700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f459c05ed90 0x7f459c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.493+0000 7f45c0f30700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f459c05ed90 0x7f459c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f45b40114c0 tx=0x7f45b4009060).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:08.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.497+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45ac0a98f0 con 0x7f45bc0cb450 2023-05-17T15:11:08.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.696+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f45bc0b0d20 con 0x7f459c05ed90 2023-05-17T15:11:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.697+0000 7f45b8ff9700 1 -- 172.21.15.27:0/783521226 <== mgr.7842 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f45bc0b0d20 con 0x7f459c05ed90 2023-05-17T15:11:08.701 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:11:08.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:11:08.702 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:11:08.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:11:08.702 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:11:08.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f459c05ed90 msgr2=0x7f459c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f459c05ed90 0x7f459c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f45b40114c0 tx=0x7f45b4009060).stop 2023-05-17T15:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 msgr2=0x7f45bc154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 0x7f45bc154600 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f45ac00b950 tx=0x7f45bc0c0650).stop 2023-05-17T15:11:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 shutdown_connections 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f459c05ed90 0x7f459c061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc154090 0x7f45bc154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc068f00 0x7f45bc13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.699+0000 7f45c3194700 1 --2- 172.21.15.27:0/783521226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0cb450 0x7f45bc154600 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.700+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 >> 172.21.15.27:0/783521226 conn(0x7f45bc05e7e0 msgr2=0x7f45bc14dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.700+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 shutdown_connections 2023-05-17T15:11:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.700+0000 7f45c3194700 1 -- 172.21.15.27:0/783521226 wait complete. 2023-05-17T15:11:08.715 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:11:08.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.830+0000 7f314b8d4700 1 Processor -- start 2023-05-17T15:11:08.834 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.830+0000 7f314b8d4700 1 -- start start 2023-05-17T15:11:08.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f314b8d4700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f31441543d0 0x7f31440c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.835 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f314b8d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31440c60f0 0x7f3144068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f314b8d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31441547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f314b8d4700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440c1c50 con 0x7f31441543d0 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f314b8d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3144158790 con 0x7f31440c60f0 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f314b8d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c6570 con 0x7f31440691f0 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f31441543d0 0x7f31440c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f31441543d0 0x7f31440c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43912/0 (socket says 172.21.15.27:43912) 2023-05-17T15:11:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 -- 172.21.15.27:0/2154818282 learned_addr learned my addr 172.21.15.27:0/2154818282 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3148e6f700 1 --2- 172.21.15.27:0/2154818282 >> v2:172.21.15.40:3300/0 conn(0x7f31440c60f0 0x7f3144068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149e71700 1 --2- 172.21.15.27:0/2154818282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31441547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 -- 172.21.15.27:0/2154818282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 msgr2=0x7f31441547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 --2- 172.21.15.27:0/2154818282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31441547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 -- 172.21.15.27:0/2154818282 >> v2:172.21.15.40:3300/0 conn(0x7f31440c60f0 msgr2=0x7f3144068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 --2- 172.21.15.27:0/2154818282 >> v2:172.21.15.40:3300/0 conn(0x7f31440c60f0 0x7f3144068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 -- 172.21.15.27:0/2154818282 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144157e60 con 0x7f31441543d0 2023-05-17T15:11:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3148e6f700 1 --2- 172.21.15.27:0/2154818282 >> v2:172.21.15.40:3300/0 conn(0x7f31440c60f0 0x7f3144068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.831+0000 7f3149670700 1 --2- 172.21.15.27:0/2154818282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440c5c00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f31440c5620 tx=0x7f313c009840).ready entity=mon.0 client_cookie=3dcbacea965cff9e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f3143fff700 1 -- 172.21.15.27:0/2154818282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00e070 con 0x7f31441543d0 2023-05-17T15:11:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f3143fff700 1 -- 172.21.15.27:0/2154818282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00ba50 con 0x7f31441543d0 2023-05-17T15:11:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f3143fff700 1 -- 172.21.15.27:0/2154818282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00bdd0 con 0x7f31441543d0 2023-05-17T15:11:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 -- 172.21.15.27:0/2154818282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 msgr2=0x7f31440c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 --2- 172.21.15.27:0/2154818282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440c5c00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f31440c5620 tx=0x7f313c009840).stop 2023-05-17T15:11:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 -- 172.21.15.27:0/2154818282 shutdown_connections 2023-05-17T15:11:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 --2- 172.21.15.27:0/2154818282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440c5c00 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 --2- 172.21.15.27:0/2154818282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31441547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 --2- 172.21.15.27:0/2154818282 >> v2:172.21.15.40:3300/0 conn(0x7f31440c60f0 0x7f3144068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 -- 172.21.15.27:0/2154818282 >> 172.21.15.27:0/2154818282 conn(0x7f31440cb7f0 msgr2=0x7f31440c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 -- 172.21.15.27:0/2154818282 shutdown_connections 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.832+0000 7f314b8d4700 1 -- 172.21.15.27:0/2154818282 wait complete. 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.833+0000 7f314b8d4700 1 Processor -- start 2023-05-17T15:11:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.833+0000 7f314b8d4700 1 -- start start 2023-05-17T15:11:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f314b8d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31440c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f314b8d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31440c60f0 0x7f31440c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f314b8d4700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f314b8d4700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c2f70 con 0x7f31441543d0 2023-05-17T15:11:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f314b8d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c2360 con 0x7f31440c60f0 2023-05-17T15:11:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f314b8d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c2640 con 0x7f31440691f0 2023-05-17T15:11:08.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f3149e71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f3149e71700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43920/0 (socket says 172.21.15.27:43920) 2023-05-17T15:11:08.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f3149e71700 1 -- 172.21.15.27:0/4097996100 learned_addr learned my addr 172.21.15.27:0/4097996100 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:08.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f3148e6f700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31440c60f0 0x7f31440c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.834+0000 7f3149670700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31440c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3149e71700 1 -- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 msgr2=0x7f31440c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3149e71700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31440c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3149e71700 1 -- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31440c60f0 msgr2=0x7f31440c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3149e71700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31440c60f0 0x7f31440c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3149e71700 1 -- 172.21.15.27:0/4097996100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009ae0 con 0x7f31441543d0 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3148e6f700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31440c60f0 0x7f31440c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f3149e71700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440aecd0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f313400d890 tx=0x7f3134008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:08.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31340125f0 con 0x7f31441543d0 2023-05-17T15:11:08.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3134012750 con 0x7f31441543d0 2023-05-17T15:11:08.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440c2920 con 0x7f31441543d0 2023-05-17T15:11:08.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134012ad0 con 0x7f31441543d0 2023-05-17T15:11:08.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.835+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31440af1c0 con 0x7f31441543d0 2023-05-17T15:11:08.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.836+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31440c3120 con 0x7f31441543d0 2023-05-17T15:11:08.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.836+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 54) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3134013480 con 0x7f31441543d0 2023-05-17T15:11:08.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.837+0000 7f31417fa700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f313005ed90 0x7f3130061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:08.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.837+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f3134079a00 con 0x7f31441543d0 2023-05-17T15:11:08.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.837+0000 7f3149670700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f313005ed90 0x7f3130061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:08.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.837+0000 7f3149670700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f313005ed90 0x7f3130061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f313c00ba20 tx=0x7f313c009840).ready entity=mgr.7842 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:08.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:08.841+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31440c3120 con 0x7f31441543d0 2023-05-17T15:11:09.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.063+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f31440c30b0 con 0x7f31441543d0 2023-05-17T15:11:09.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.803+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 55) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f31340778a0 con 0x7f31441543d0 2023-05-17T15:11:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.804+0000 7f31417fa700 1 -- 172.21.15.27:0/4097996100 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v55) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3134073190 con 0x7f31441543d0 2023-05-17T15:11:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f313005ed90 msgr2=0x7f3130061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f313005ed90 0x7f3130061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f313c00ba20 tx=0x7f313c009840).stop 2023-05-17T15:11:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 msgr2=0x7f31440aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440aecd0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f313400d890 tx=0x7f3134008040).stop 2023-05-17T15:11:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 shutdown_connections 2023-05-17T15:11:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f313005ed90 0x7f3130061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441543d0 0x7f31440aecd0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31440691f0 0x7f31440c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 --2- 172.21.15.27:0/4097996100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31440c60f0 0x7f31440c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 >> 172.21.15.27:0/4097996100 conn(0x7f31440cb7f0 msgr2=0x7f31441539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 shutdown_connections 2023-05-17T15:11:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.808+0000 7f314b8d4700 1 -- 172.21.15.27:0/4097996100 wait complete. 2023-05-17T15:11:09.831 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:11:09.952 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:09.948+0000 7f7eceb81680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:11:09.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.953+0000 7fa476d31700 1 Processor -- start 2023-05-17T15:11:09.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.954+0000 7fa476d31700 1 -- start start 2023-05-17T15:11:09.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.954+0000 7fa476d31700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4700c6310 0x7fa470068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:09.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.954+0000 7fa476d31700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa4700691f0 0x7fa4700bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:09.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.954+0000 7fa476d31700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa470158790 con 0x7fa4701543d0 2023-05-17T15:11:09.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.954+0000 7fa476d31700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4700c1c50 con 0x7fa4700691f0 2023-05-17T15:11:09.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.954+0000 7fa476d31700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa470157e60 con 0x7fa4700c6310 2023-05-17T15:11:09.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa4700691f0 0x7fa4700bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:09.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa4700691f0 0x7fa4700bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43954/0 (socket says 172.21.15.27:43954) 2023-05-17T15:11:09.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 -- 172.21.15.27:0/145711497 learned_addr learned my addr 172.21.15.27:0/145711497 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:09.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa46ffff700 1 --2- 172.21.15.27:0/145711497 >> v2:172.21.15.40:3300/0 conn(0x7fa4700c6310 0x7fa470068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:09.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa46f7fe700 1 -- 172.21.15.27:0/145711497 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748421974 0 0) 0x7fa470158790 con 0x7fa4701543d0 2023-05-17T15:11:09.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 -- 172.21.15.27:0/145711497 >> v2:172.21.15.40:3300/0 conn(0x7fa4700c6310 msgr2=0x7fa470068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:09.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 --2- 172.21.15.27:0/145711497 >> v2:172.21.15.40:3300/0 conn(0x7fa4700c6310 0x7fa470068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 -- 172.21.15.27:0/145711497 >> v1:172.21.15.40:6789/0 conn(0x7fa4701543d0 legacy=0x7fa4700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 -- 172.21.15.27:0/145711497 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470158140 con 0x7fa4700691f0 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa4752ce700 1 --2- 172.21.15.27:0/145711497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700691f0 0x7fa4700bfc80 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa4700c5620 tx=0x7fa468009840).ready entity=mon.0 client_cookie=9a04b79f6f561c22 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa46f7fe700 1 -- 172.21.15.27:0/145711497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800e070 con 0x7fa4700691f0 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa46f7fe700 1 -- 172.21.15.27:0/145711497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800ba20 con 0x7fa4700691f0 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.955+0000 7fa46f7fe700 1 -- 172.21.15.27:0/145711497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800bda0 con 0x7fa4700691f0 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 -- 172.21.15.27:0/145711497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700691f0 msgr2=0x7fa4700bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:09.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 --2- 172.21.15.27:0/145711497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700691f0 0x7fa4700bfc80 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa4700c5620 tx=0x7fa468009840).stop 2023-05-17T15:11:09.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 -- 172.21.15.27:0/145711497 shutdown_connections 2023-05-17T15:11:09.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 --2- 172.21.15.27:0/145711497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700691f0 0x7fa4700bfc80 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 --2- 172.21.15.27:0/145711497 >> v2:172.21.15.40:3300/0 conn(0x7fa4700c6310 0x7fa470068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 -- 172.21.15.27:0/145711497 >> 172.21.15.27:0/145711497 conn(0x7fa4700cb7f0 msgr2=0x7fa4700c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:09.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 -- 172.21.15.27:0/145711497 shutdown_connections 2023-05-17T15:11:09.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.956+0000 7fa476d31700 1 -- 172.21.15.27:0/145711497 wait complete. 2023-05-17T15:11:09.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.957+0000 7fa476d31700 1 Processor -- start 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.957+0000 7fa476d31700 1 -- start start 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa476d31700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4700691f0 0x7fa4700c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa476d31700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 0x7fa470152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa476d31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4701543d0 0x7fa470152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa476d31700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700c3ff0 con 0x7fa4700c6310 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa476d31700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470153060 con 0x7fa4700691f0 2023-05-17T15:11:09.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa476d31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700c33e0 con 0x7fa4701543d0 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 0x7fa470152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 0x7fa470152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43958/0 (socket says 172.21.15.27:43958) 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 -- 172.21.15.27:0/1847220360 learned_addr learned my addr 172.21.15.27:0/1847220360 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa474acd700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4700691f0 0x7fa4700c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa4752ce700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4701543d0 0x7fa470152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 -- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4701543d0 msgr2=0x7fa470152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:09.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4701543d0 0x7fa470152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 -- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4700691f0 msgr2=0x7fa4700c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4700691f0 0x7fa4700c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.958+0000 7fa46ffff700 1 -- 172.21.15.27:0/1847220360 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009ae0 con 0x7fa4700c6310 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.959+0000 7fa46ffff700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 0x7fa470152b70 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fa45c00e930 tx=0x7fa45c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.959+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c012600 con 0x7fa4700c6310 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.959+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c012760 con 0x7fa4700c6310 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.959+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c012ae0 con 0x7fa4700c6310 2023-05-17T15:11:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.959+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4700c36c0 con 0x7fa4700c6310 2023-05-17T15:11:09.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.959+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4700c3c80 con 0x7fa4700c6310 2023-05-17T15:11:09.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.960+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47006bdf0 con 0x7fa4700c6310 2023-05-17T15:11:09.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.960+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 55) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fa45c022070 con 0x7fa4700c6310 2023-05-17T15:11:09.969 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:09.960+0000 7f547bac4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:11:09.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.960+0000 7fa46cff9700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa45405ede0 0x7fa4540612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:09.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.960+0000 7fa474acd700 1 -- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa45405ede0 msgr2=0x7fa4540612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:11:09.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.961+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fa45c079f20 con 0x7fa4700c6310 2023-05-17T15:11:09.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.961+0000 7fa474acd700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa45405ede0 0x7fa4540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:11:09.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:09.965+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa45c0a88f0 con 0x7fa4700c6310 2023-05-17T15:11:10.018 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:10.014+0000 7f7eceb81680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:11:10.030 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:10.026+0000 7f547bac4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:11:10.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.141+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fa470068ac0 con 0x7fa4700c6310 2023-05-17T15:11:10.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.144+0000 7fa46cff9700 1 -- 172.21.15.27:0/1847220360 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa45c016020 con 0x7fa4700c6310 2023-05-17T15:11:10.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa45405ede0 msgr2=0x7fa4540612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:11:10.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa45405ede0 0x7fa4540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:11:10.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 msgr2=0x7fa470152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:10.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 0x7fa470152b70 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fa45c00e930 tx=0x7fa45c009060).stop 2023-05-17T15:11:10.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 shutdown_connections 2023-05-17T15:11:10.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7fa45405ede0 0x7fa4540612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:11:10.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4701543d0 0x7fa470152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4700691f0 0x7fa4700c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 --2- 172.21.15.27:0/1847220360 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4700c6310 0x7fa470152b70 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 >> 172.21.15.27:0/1847220360 conn(0x7fa4700cb7f0 msgr2=0x7fa4700c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 shutdown_connections 2023-05-17T15:11:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.146+0000 7fa476d31700 1 -- 172.21.15.27:0/1847220360 wait complete. 2023-05-17T15:11:10.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:11:10.163 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:11:10.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:11:10.184 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-05-17T15:11:10.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-17T15:11:10.303 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:10.299+0000 7f7eceb81680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:11:10.317 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:10.314+0000 7f547bac4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:11:10.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.400+0000 7f106535c700 1 Processor -- start 2023-05-17T15:11:10.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.400+0000 7f106535c700 1 -- start start 2023-05-17T15:11:10.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f106535c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1060152070 0x7f1060154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:10.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f106535c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10600c0520 0x7f1060081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:10.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f106535c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1060158010 con 0x7f1060151c90 2023-05-17T15:11:10.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f106535c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1060154f60 con 0x7f10600c0520 2023-05-17T15:11:10.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f106535c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1060155240 con 0x7f1060152070 2023-05-17T15:11:10.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105effd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1060151c90 0x7f10600c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43540/0 (socket says 172.21.15.27:43540) 2023-05-17T15:11:10.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105effd700 1 -- 172.21.15.27:0/2335218026 learned_addr learned my addr 172.21.15.27:0/2335218026 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:10.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105f7fe700 1 --2- 172.21.15.27:0/2335218026 >> v2:172.21.15.27:3300/0 conn(0x7f10600c0520 0x7f1060081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:10.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105e7fc700 1 --2- 172.21.15.27:0/2335218026 >> v2:172.21.15.40:3300/0 conn(0x7f1060152070 0x7f1060154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:10.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105f7fe700 1 -- 172.21.15.27:0/2335218026 >> v2:172.21.15.40:3300/0 conn(0x7f1060152070 msgr2=0x7f1060154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:10.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105f7fe700 1 --2- 172.21.15.27:0/2335218026 >> v2:172.21.15.40:3300/0 conn(0x7f1060152070 0x7f1060154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105f7fe700 1 -- 172.21.15.27:0/2335218026 >> v1:172.21.15.27:6789/0 conn(0x7f1060151c90 legacy=0x7f10600c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:10.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105dffb700 1 -- 172.21.15.27:0/2335218026 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104983692 0 0) 0x7f1060158010 con 0x7f1060151c90 2023-05-17T15:11:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.401+0000 7f105f7fe700 1 -- 172.21.15.27:0/2335218026 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060155520 con 0x7f10600c0520 2023-05-17T15:11:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f105f7fe700 1 --2- 172.21.15.27:0/2335218026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10600c0520 0x7f1060081fd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f1060083ff0 tx=0x7f1058009780).ready entity=mon.0 client_cookie=9a4f1d9c17080e91 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f105dffb700 1 -- 172.21.15.27:0/2335218026 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800e070 con 0x7f10600c0520 2023-05-17T15:11:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f105dffb700 1 -- 172.21.15.27:0/2335218026 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800bb60 con 0x7f10600c0520 2023-05-17T15:11:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f105dffb700 1 -- 172.21.15.27:0/2335218026 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058012410 con 0x7f10600c0520 2023-05-17T15:11:10.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 -- 172.21.15.27:0/2335218026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10600c0520 msgr2=0x7f1060081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:10.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 --2- 172.21.15.27:0/2335218026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10600c0520 0x7f1060081fd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f1060083ff0 tx=0x7f1058009780).stop 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 -- 172.21.15.27:0/2335218026 shutdown_connections 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 --2- 172.21.15.27:0/2335218026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10600c0520 0x7f1060081fd0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 --2- 172.21.15.27:0/2335218026 >> v2:172.21.15.40:3300/0 conn(0x7f1060152070 0x7f1060154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 -- 172.21.15.27:0/2335218026 >> 172.21.15.27:0/2335218026 conn(0x7f10600cae10 msgr2=0x7f10600cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.402+0000 7f106535c700 1 -- 172.21.15.27:0/2335218026 shutdown_connections 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.403+0000 7f106535c700 1 -- 172.21.15.27:0/2335218026 wait complete. 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.404+0000 7f106535c700 1 Processor -- start 2023-05-17T15:11:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.404+0000 7f106535c700 1 -- start start 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10600c0520 0x7f10600c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 0x7f10600c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1060152070 0x7f10601457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c2530 con 0x7f1060151c90 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c4db0 con 0x7f1060152070 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c3f00 con 0x7f10600c0520 2023-05-17T15:11:10.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 0x7f10600c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 0x7f10600c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43986/0 (socket says 172.21.15.27:43986) 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 -- 172.21.15.27:0/299459684 learned_addr learned my addr 172.21.15.27:0/299459684 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10600c0520 0x7f10600c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105f7fe700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1060152070 0x7f10601457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10600c0520 msgr2=0x7f10600c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10600c0520 0x7f10600c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1060152070 msgr2=0x7f10601457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1060152070 0x7f10601457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 -- 172.21.15.27:0/299459684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009a20 con 0x7f1060151c90 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f105e7fc700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 0x7f10600c3a10 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f104800e900 tx=0x7f1048009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048012600 con 0x7f1060151c90 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048012760 con 0x7f1060151c90 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048012ae0 con 0x7f1060151c90 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.405+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600c41a0 con 0x7f1060151c90 2023-05-17T15:11:10.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.406+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600c4760 con 0x7f1060151c90 2023-05-17T15:11:10.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.407+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106006bdf0 con 0x7f1060151c90 2023-05-17T15:11:10.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.407+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 55) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1048022070 con 0x7f1060151c90 2023-05-17T15:11:10.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.408+0000 7f1056ffd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:10.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.408+0000 7f105effd700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f1040061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:11:10.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.408+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f104807a380 con 0x7f1060151c90 2023-05-17T15:11:10.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.408+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:11:10.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.411+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f104804b940 con 0x7f1060151c90 2023-05-17T15:11:10.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.609+0000 7f105effd700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f1040061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:11:10.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.609+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:11:10.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:10.610+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10600c1c00 con 0x7f104005edb0 2023-05-17T15:11:10.957 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:10.954+0000 7f7eceb81680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:11:10.976 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:10.972+0000 7f547bac4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:11:11.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:11.010+0000 7f105effd700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f1040061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:11:11.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:11.010+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:11:11.025 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:11.021+0000 7f7eceb81680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:11:11.044 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:11.040+0000 7f547bac4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:11:11.216 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:11.213+0000 7f7eceb81680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:11:11.236 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:11.232+0000 7f547bac4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:11:11.649 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:11.646+0000 7f7eceb81680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:11:11.670 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:11.666+0000 7f547bac4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:11:11.756 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:11.753+0000 7f7eceb81680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:11:11.777 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:11.773+0000 7f547bac4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:11:11.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:11.811+0000 7f105effd700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f1040061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:11:11.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:11.811+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:11:11.914 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:11.910+0000 7f7eceb81680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:11:11.935 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:11.932+0000 7f547bac4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:11:11.991 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:11.987+0000 7f7eceb81680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:11:12.012 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:12.008+0000 7f547bac4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:11:12.060 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:12.056+0000 7f7eceb81680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:11:12.081 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:12.078+0000 7f547bac4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:11:12.328 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:12.325+0000 7f7eceb81680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:11:12.350 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:12.346+0000 7f547bac4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:11:12.519 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:12.515+0000 7f7eceb81680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:11:12.539 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:12.535+0000 7f547bac4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:11:13.195 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.191+0000 7f7eceb81680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:11:13.220 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.216+0000 7f547bac4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:11:13.268 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.264+0000 7f7eceb81680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:11:13.293 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.289+0000 7f547bac4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:11:13.344 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.341+0000 7f7eceb81680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:11:13.370 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.366+0000 7f547bac4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:11:13.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:13.412+0000 7f105effd700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f1040061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/86332 2023-05-17T15:11:13.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:13.412+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:11:13.494 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.491+0000 7f7eceb81680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:11:13.521 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.517+0000 7f547bac4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:11:13.567 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.563+0000 7f7eceb81680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:11:13.594 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.590+0000 7f547bac4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:11:13.685 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.681+0000 7f7eceb81680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:11:13.712 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.708+0000 7f547bac4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:11:13.796 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:13.792+0000 7f7eceb81680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:11:13.824 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:13.820+0000 7f547bac4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:11:14.095 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:14.090+0000 7f7eceb81680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:11:14.124 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.120+0000 7f547bac4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:11:14.167 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:11:14.162+0000 7f7eceb81680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:11:14.199 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.195+0000 7f547bac4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:11:14.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:14.232+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 56) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f10480782a0 con 0x7f1060151c90 2023-05-17T15:11:14.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:14.233+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f1040061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:11:14.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:14.233+0000 7f1056ffd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f1040061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:11:14.294 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53fa2a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.294 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53fa2a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.294 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53fa2a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.295 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53fa2a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.295 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53fa2a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.295 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53f6a9f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.295 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53f6a9f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.295 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53f6a9f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.296 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53f6a9f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:14.296 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:11:14.290+0000 7f53f6a9f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:11:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.247+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 57) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f1048018d20 con 0x7f1060151c90 2023-05-17T15:11:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.248+0000 7f1056ffd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f10400611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.248+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f104002faf0 con 0x7f104005edb0 2023-05-17T15:11:15.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.249+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f10400611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.250+0000 7f105effd700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f10400611f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f10600c5b90 tx=0x7f1050007bb0).ready entity=mgr.8238 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:15.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.274+0000 7f1056ffd700 1 -- 172.21.15.27:0/299459684 <== mgr.8238 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f104002faf0 con 0x7f104005edb0 2023-05-17T15:11:15.278 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-05-17T15:11:15.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 msgr2=0x7f10400611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f10400611f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f10600c5b90 tx=0x7f1050007bb0).stop 2023-05-17T15:11:15.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 msgr2=0x7f10600c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 0x7f10600c3a10 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f104800e900 tx=0x7f1048009060).stop 2023-05-17T15:11:15.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 shutdown_connections 2023-05-17T15:11:15.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f104005edb0 0x7f10400611f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1060152070 0x7f10601457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10600c0520 0x7f10600c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 --2- 172.21.15.27:0/299459684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1060151c90 0x7f10600c3a10 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.276+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 >> 172.21.15.27:0/299459684 conn(0x7f10600cae10 msgr2=0x7f10601564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.277+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 shutdown_connections 2023-05-17T15:11:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.277+0000 7f106535c700 1 -- 172.21.15.27:0/299459684 wait complete. 2023-05-17T15:11:15.295 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-05-17T15:11:15.296 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-17T15:11:15.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.459+0000 7f0f256b5700 1 Processor -- start 2023-05-17T15:11:15.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.459+0000 7f0f256b5700 1 -- start start 2023-05-17T15:11:15.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.459+0000 7f0f256b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 0x7f0f200c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.459+0000 7f0f256b5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200c1610 con 0x7f0f200826e0 2023-05-17T15:11:15.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.459+0000 7f0f256b5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200c0a00 con 0x7f0f200aa130 2023-05-17T15:11:15.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.459+0000 7f0f256b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200c0ce0 con 0x7f0f20153fa0 2023-05-17T15:11:15.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0f200826e0 0x7f0f200aae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43738/0 (socket says 172.21.15.27:43738) 2023-05-17T15:11:15.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1f7fe700 1 -- 172.21.15.27:0/276103309 learned_addr learned my addr 172.21.15.27:0/276103309 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1effd700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 0x7f0f200c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728751227 0 0) 0x7f0f200c1610 con 0x7f0f200826e0 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f0c0033f0 con 0x7f0f200826e0 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3874957556 0 0) 0x7f0f0c0033f0 con 0x7f0f200826e0 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 msgr2=0x7f0f200c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 0x7f0f200c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 >> v1:172.21.15.40:6789/0 conn(0x7f0f200aa130 legacy=0x7f0f20081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200c0fc0 con 0x7f0f200826e0 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f0f10001470 con 0x7f0f200826e0 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 >> v1:172.21.15.27:6789/0 conn(0x7f0f200826e0 legacy=0x7f0f200aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c003910 0x7f0f0c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 0x7f0f0c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200c0ce0 con 0x7f0f0c004690 2023-05-17T15:11:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00b910 con 0x7f0f0c003910 2023-05-17T15:11:15.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00bad0 con 0x7f0f20153fa0 2023-05-17T15:11:15.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.460+0000 7f0f1effd700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c003910 0x7f0f0c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1f7fe700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 0x7f0f0c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1e7fc700 1 -- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 msgr2=0x7f0f0c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f20153fa0 0x7f0f0c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1e7fc700 1 -- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c003910 msgr2=0x7f0f0c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c003910 0x7f0f0c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1e7fc700 1 -- 172.21.15.27:0/276103309 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0033f0 con 0x7f0f0c004690 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f0c004b10 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f0f08001e30 tx=0x7f0f08007f30).ready entity=mon.0 client_cookie=9eaf4e7513d53cc8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08006a20 con 0x7f0f0c004690 2023-05-17T15:11:15.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08006b80 con 0x7f0f0c004690 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1dffb700 1 -- 172.21.15.27:0/276103309 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800c5d0 con 0x7f0f0c004690 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f256b5700 1 -- 172.21.15.27:0/276103309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 msgr2=0x7f0f0c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f256b5700 1 --2- 172.21.15.27:0/276103309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f0c004b10 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f0f08001e30 tx=0x7f0f08007f30).stop 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f1f7fe700 1 -- 172.21.15.27:0/276103309 reap_dead start 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f256b5700 1 -- 172.21.15.27:0/276103309 shutdown_connections 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.461+0000 7f0f256b5700 1 -- 172.21.15.27:0/276103309 >> 172.21.15.27:0/276103309 conn(0x7f0f2005e820 msgr2=0x7f0f200cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.462+0000 7f0f256b5700 1 -- 172.21.15.27:0/276103309 shutdown_connections 2023-05-17T15:11:15.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.462+0000 7f0f256b5700 1 -- 172.21.15.27:0/276103309 wait complete. 2023-05-17T15:11:15.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.463+0000 7f0f256b5700 1 Processor -- start 2023-05-17T15:11:15.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.463+0000 7f0f256b5700 1 -- start start 2023-05-17T15:11:15.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f20149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f200b0650 0x7f0f200ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f200b0ad0 0x7f0f200ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200aee20 con 0x7f0f0c004690 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200c2a10 con 0x7f0f200b0650 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200c2cf0 con 0x7f0f200b0ad0 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f20149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f20149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44188/0 (socket says 172.21.15.27:44188) 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 -- 172.21.15.27:0/2052160969 learned_addr learned my addr 172.21.15.27:0/2052160969 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:11:15.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f200b0650 0x7f0f200ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1f7fe700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f200b0ad0 0x7f0f200ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 -- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f200b0ad0 msgr2=0x7f0f200ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f200b0ad0 0x7f0f200ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 -- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f200b0650 msgr2=0x7f0f200ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f200b0650 0x7f0f200ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 -- 172.21.15.27:0/2052160969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200c2fd0 con 0x7f0f0c004690 2023-05-17T15:11:15.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f1effd700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f20149ad0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f0f180119f0 tx=0x7f0f18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800f940 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1800faa0 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f200c32b0 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800fe20 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.464+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f20153080 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.465+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2006bdf0 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.466+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 57) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f0f18024070 con 0x7f0f0c004690 2023-05-17T15:11:15.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.466+0000 7f0f16ffd700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0f0005ed40 0x7f0f00061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:11:15.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.466+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f0f1807a720 con 0x7f0f0c004690 2023-05-17T15:11:15.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.466+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0f0005ed40 0x7f0f00061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:11:15.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.466+0000 7f0f1e7fc700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0f0005ed40 0x7f0f00061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0f201526a0 tx=0x7f0f08016000).ready entity=mgr.8238 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:11:15.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.470+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f1804bc50 con 0x7f0f0c004690 2023-05-17T15:11:15.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.669+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f200c12a0 con 0x7f0f0005ed40 2023-05-17T15:11:15.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.675+0000 7f0f16ffd700 1 -- 172.21.15.27:0/2052160969 <== mgr.8238 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f0f200c12a0 con 0x7f0f0005ed40 2023-05-17T15:11:15.678 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-05-17T15:11:15.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0f0005ed40 msgr2=0x7f0f00061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0f0005ed40 0x7f0f00061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0f201526a0 tx=0x7f0f08016000).stop 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 msgr2=0x7f0f20149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f20149ad0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f0f180119f0 tx=0x7f0f18009060).stop 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 shutdown_connections 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f0f0005ed40 0x7f0f00061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f200b0ad0 0x7f0f200ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f0c004690 0x7f0f20149ad0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 --2- 172.21.15.27:0/2052160969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f200b0650 0x7f0f200ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:11:15.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.676+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 >> 172.21.15.27:0/2052160969 conn(0x7f0f2005e820 msgr2=0x7f0f200c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:11:15.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.677+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 shutdown_connections 2023-05-17T15:11:15.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:11:15.677+0000 7f0f256b5700 1 -- 172.21.15.27:0/2052160969 wait complete. 2023-05-17T15:11:15.693 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-05-17T15:11:32.775 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:11:32.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:00.683 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:12:00.679+0000 7f53e9a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:12:00.684 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:12:00.679+0000 7f53e9a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:12:00.684 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:12:00.679+0000 7f53e9a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:12:00.685 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:12:00.679+0000 7f53e9a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:12:00.685 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:12:00.679+0000 7f53e9a85700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:12:02.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:02.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:32.910 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:12:32.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:02.968 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:02.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:33.039 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:33.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:03.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:03.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:33.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:33.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:03.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:03.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:33.371 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:33.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:03.435 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:03.438 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:33.515 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:33.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:03.588 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:03.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:33.652 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:33.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:03.717 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:03.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:33.806 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:33.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:03.878 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:03.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:33.970 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:33.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:04.043 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:04.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:34.107 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:20:34.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:04.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:04.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:34.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:34.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:04.322 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:04.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:15.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:22:15.695 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-05-17T15:22:15.717 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_12_00_UTC 2023-05-17T15:22:15.718 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_13_00_UTC 2023-05-17T15:22:15.718 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_14_00_UTC 2023-05-17T15:22:15.718 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_15_00_UTC 2023-05-17T15:22:15.718 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_16_00_UTC 2023-05-17T15:22:15.718 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_17_00_UTC 2023-05-17T15:22:15.718 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_18_00_UTC 2023-05-17T15:22:15.719 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_19_00_UTC 2023-05-17T15:22:15.719 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_20_00_UTC 2023-05-17T15:22:15.719 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_21_00_UTC 2023-05-17T15:22:15.719 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_22_00_UTC 2023-05-17T15:22:15.720 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-15_12_00_UTC', 'scheduled-2023-05-17-15_13_00_UTC', 'scheduled-2023-05-17-15_14_00_UTC', 'scheduled-2023-05-17-15_15_00_UTC', 'scheduled-2023-05-17-15_16_00_UTC', 'scheduled-2023-05-17-15_17_00_UTC', 'scheduled-2023-05-17-15_18_00_UTC', 'scheduled-2023-05-17-15_19_00_UTC', 'scheduled-2023-05-17-15_20_00_UTC', 'scheduled-2023-05-17-15_21_00_UTC', 'scheduled-2023-05-17-15_22_00_UTC'] 2023-05-17T15:22:15.720 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-05-17T15:22:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.886+0000 7f2328ec8700 1 Processor -- start 2023-05-17T15:22:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.886+0000 7f2328ec8700 1 -- start start 2023-05-17T15:22:15.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.887+0000 7f2328ec8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2324155560 0x7f232405dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:15.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.887+0000 7f2328ec8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f23240bd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:15.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.887+0000 7f2328ec8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240bd300 con 0x7f2324155180 2023-05-17T15:22:15.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.887+0000 7f2328ec8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232405e6d0 con 0x7f2324155560 2023-05-17T15:22:15.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.887+0000 7f2328ec8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2324064ae0 con 0x7f232405e240 2023-05-17T15:22:15.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2321d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2324155560 0x7f232405dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:15.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2322d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f23240bd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:15.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f232259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2324155180 0x7f2324064020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:49790/0 (socket says 172.21.15.27:49790) 2023-05-17T15:22:15.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f232259c700 1 -- 172.21.15.27:0/3985143125 learned_addr learned my addr 172.21.15.27:0/3985143125 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:22:15.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2322d9d700 1 -- 172.21.15.27:0/3985143125 >> v2:172.21.15.40:3300/0 conn(0x7f2324155560 msgr2=0x7f232405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:22:15.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2322d9d700 1 --2- 172.21.15.27:0/3985143125 >> v2:172.21.15.40:3300/0 conn(0x7f2324155560 0x7f232405dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:15.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2322d9d700 1 -- 172.21.15.27:0/3985143125 >> v1:172.21.15.40:6789/0 conn(0x7f2324155180 legacy=0x7f2324064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:15.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2322d9d700 1 -- 172.21.15.27:0/3985143125 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240bc9d0 con 0x7f232405e240 2023-05-17T15:22:15.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f232159a700 1 -- 172.21.15.27:0/3985143125 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117597523 0 0) 0x7f23240bd300 con 0x7f2324155180 2023-05-17T15:22:15.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2321d9b700 1 --2- 172.21.15.27:0/3985143125 >> v2:172.21.15.40:3300/0 conn(0x7f2324155560 0x7f232405dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:22:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.888+0000 7f2322d9d700 1 --2- 172.21.15.27:0/3985143125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f23240bd790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2314009760 tx=0x7f2314009060).ready entity=mon.2 client_cookie=44800e32d4493ef5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:22:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f232159a700 1 -- 172.21.15.27:0/3985143125 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400f510 con 0x7f232405e240 2023-05-17T15:22:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f232159a700 1 -- 172.21.15.27:0/3985143125 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231400f670 con 0x7f232405e240 2023-05-17T15:22:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f232159a700 1 -- 172.21.15.27:0/3985143125 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400f9f0 con 0x7f232405e240 2023-05-17T15:22:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 -- 172.21.15.27:0/3985143125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 msgr2=0x7f23240bd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3985143125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f23240bd790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2314009760 tx=0x7f2314009060).stop 2023-05-17T15:22:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 -- 172.21.15.27:0/3985143125 shutdown_connections 2023-05-17T15:22:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3985143125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f23240bd790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3985143125 >> v2:172.21.15.40:3300/0 conn(0x7f2324155560 0x7f232405dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 -- 172.21.15.27:0/3985143125 >> 172.21.15.27:0/3985143125 conn(0x7f23240c84a0 msgr2=0x7f23240c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:22:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 -- 172.21.15.27:0/3985143125 shutdown_connections 2023-05-17T15:22:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.889+0000 7f2328ec8700 1 -- 172.21.15.27:0/3985143125 wait complete. 2023-05-17T15:22:15.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 Processor -- start 2023-05-17T15:22:15.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 -- start start 2023-05-17T15:22:15.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f2324164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:15.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2324155180 0x7f23240ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:15.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 0x7f23240ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:15.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c2220 con 0x7f2324155560 2023-05-17T15:22:15.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c2500 con 0x7f2324155180 2023-05-17T15:22:15.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.891+0000 7f2328ec8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c27e0 con 0x7f232405e240 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 0x7f23240ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 0x7f23240ad240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44234/0 (socket says 172.21.15.27:44234) 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 -- 172.21.15.27:0/3585673461 learned_addr learned my addr 172.21.15.27:0/3585673461 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2321d9b700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2324155180 0x7f23240ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f232259c700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f2324164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 -- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 msgr2=0x7f2324164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:15.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f2324164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 -- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2324155180 msgr2=0x7f23240ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2324155180 0x7f23240ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 -- 172.21.15.27:0/3585673461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c009250 con 0x7f2324155560 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2322d9d700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 0x7f23240ad240 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f2324064c20 tx=0x7f2314017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400f7e0 con 0x7f2324155560 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231400f940 con 0x7f2324155560 2023-05-17T15:22:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23140092a0 con 0x7f2324155560 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231401b660 con 0x7f2324155560 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.892+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240c2da0 con 0x7f2324155560 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.893+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232406bdf0 con 0x7f2324155560 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.894+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 60) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f231400f070 con 0x7f2324155560 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.894+0000 7f231a7fc700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f230405ee70 0x7f2304061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.894+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f231407b8d0 con 0x7f2324155560 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.894+0000 7f232259c700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f230405ee70 0x7f2304061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.894+0000 7f232259c700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f230405ee70 0x7f2304061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f231c001560 tx=0x7f231c007f30).ready entity=mgr.8238 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:22:15.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:15.898+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f231404cd00 con 0x7f2324155560 2023-05-17T15:22:16.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.096+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 --> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f232405dd50 con 0x7f230405ee70 2023-05-17T15:22:16.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.098+0000 7f231a7fc700 1 -- 172.21.15.27:0/3585673461 <== mgr.8238 v2:172.21.15.27:6836/86332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f232405dd50 con 0x7f230405ee70 2023-05-17T15:22:16.102 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:22:16.102 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T15:11:15", "first": "2023-05-17T15:12:00", "last": "2023-05-17T15:22:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-05-17T15:22:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f230405ee70 msgr2=0x7f2304061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f230405ee70 0x7f2304061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f231c001560 tx=0x7f231c007f30).stop 2023-05-17T15:22:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 msgr2=0x7f23240ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 0x7f23240ad240 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f2324064c20 tx=0x7f2314017000).stop 2023-05-17T15:22:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 shutdown_connections 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f230405ee70 0x7f2304061330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2324155560 0x7f23240ad240 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232405e240 0x7f2324164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 --2- 172.21.15.27:0/3585673461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2324155180 0x7f23240ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 >> 172.21.15.27:0/3585673461 conn(0x7f23240c84a0 msgr2=0x7f23240a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 shutdown_connections 2023-05-17T15:22:16.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.100+0000 7f2328ec8700 1 -- 172.21.15.27:0/3585673461 wait complete. 2023-05-17T15:22:16.115 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T15:11:15", "first": "2023-05-17T15:12:00", "last": "2023-05-17T15:22:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-05-17T15:22:16.116 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T15:11:15', 'first': '2023-05-17T15:12:00', 'last': '2023-05-17T15:22:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-05-17T15:22:16.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-17T15:22:16.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.228+0000 7f3d6114f700 1 Processor -- start 2023-05-17T15:22:16.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.228+0000 7f3d6114f700 1 -- start start 2023-05-17T15:22:16.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d6114f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c0c1180 0x7f3d5c0c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:16.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d6114f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d5c0c1560 0x7f3d5c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:16.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d6114f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0c07e0 con 0x7f3d5c1544f0 2023-05-17T15:22:16.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d6114f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c1549b0 con 0x7f3d5c0c1180 2023-05-17T15:22:16.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d6114f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c154c90 con 0x7f3d5c0c1560 2023-05-17T15:22:16.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c0c1180 0x7f3d5c0c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:16.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c0c1180 0x7f3d5c0c02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44242/0 (socket says 172.21.15.27:44242) 2023-05-17T15:22:16.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 -- 172.21.15.27:0/2669800417 learned_addr learned my addr 172.21.15.27:0/2669800417 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:22:16.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d6094e700 1 --2- 172.21.15.27:0/2669800417 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c0c1560 0x7f3d5c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:16.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 -- 172.21.15.27:0/2669800417 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c0c1560 msgr2=0x7f3d5c0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:22:16.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 --2- 172.21.15.27:0/2669800417 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c0c1560 0x7f3d5c0c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 -- 172.21.15.27:0/2669800417 >> v1:172.21.15.40:6789/0 conn(0x7f3d5c1544f0 legacy=0x7f3d5c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 -- 172.21.15.27:0/2669800417 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c154f70 con 0x7f3d5c0c1180 2023-05-17T15:22:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.229+0000 7f3d5bfff700 1 --2- 172.21.15.27:0/2669800417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c0c02f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f3d5c0c0210 tx=0x7f3d4c0090f0).ready entity=mon.0 client_cookie=bf38b3dc4a70a493 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:22:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d5affd700 1 -- 172.21.15.27:0/2669800417 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00b600 con 0x7f3d5c0c1180 2023-05-17T15:22:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d5affd700 1 -- 172.21.15.27:0/2669800417 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00b760 con 0x7f3d5c0c1180 2023-05-17T15:22:16.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d5affd700 1 -- 172.21.15.27:0/2669800417 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00bb00 con 0x7f3d5c0c1180 2023-05-17T15:22:16.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 -- 172.21.15.27:0/2669800417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0c1180 msgr2=0x7f3d5c0c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 --2- 172.21.15.27:0/2669800417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c0c02f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f3d5c0c0210 tx=0x7f3d4c0090f0).stop 2023-05-17T15:22:16.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 -- 172.21.15.27:0/2669800417 shutdown_connections 2023-05-17T15:22:16.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 --2- 172.21.15.27:0/2669800417 >> v2:172.21.15.40:3300/0 conn(0x7f3d5c0c1560 0x7f3d5c0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 --2- 172.21.15.27:0/2669800417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c0c02f0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 -- 172.21.15.27:0/2669800417 >> 172.21.15.27:0/2669800417 conn(0x7f3d5c05dd50 msgr2=0x7f3d5c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:22:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 -- 172.21.15.27:0/2669800417 shutdown_connections 2023-05-17T15:22:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.230+0000 7f3d6114f700 1 -- 172.21.15.27:0/2669800417 wait complete. 2023-05-17T15:22:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.231+0000 7f3d6114f700 1 Processor -- start 2023-05-17T15:22:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.231+0000 7f3d6114f700 1 -- start start 2023-05-17T15:22:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6114f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6114f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1560 0x7f3d5c165820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6114f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6114f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c8880 con 0x7f3d5c1544f0 2023-05-17T15:22:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6114f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c9400 con 0x7f3d5c0c1180 2023-05-17T15:22:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6114f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c165d10 con 0x7f3d5c0c1560 2023-05-17T15:22:16.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6094e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:16.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6094e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44248/0 (socket says 172.21.15.27:44248) 2023-05-17T15:22:16.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d6094e700 1 -- 172.21.15.27:0/4234967731 learned_addr learned my addr 172.21.15.27:0/4234967731 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:22:16.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d5bfff700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:16.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.232+0000 7f3d5b7fe700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1560 0x7f3d5c165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6094e700 1 -- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1560 msgr2=0x7f3d5c165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6094e700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1560 0x7f3d5c165820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6094e700 1 -- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0c1180 msgr2=0x7f3d5c165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6094e700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6094e700 1 -- 172.21.15.27:0/4234967731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c009370 con 0x7f3d5c1544f0 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d5bfff700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6094e700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c3b80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f3d54007f50 tx=0x7f3d54009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:22:16.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400ec20 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5400ed80 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0c8ad0 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54014630 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.233+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0c9090 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.234+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c0c9590 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.234+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 60) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f3d5401b030 con 0x7f3d5c1544f0 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.235+0000 7f3d43fff700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3d4805ee70 0x7f3d48061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:22:16.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.235+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f3d54079ff0 con 0x7f3d5c1544f0 2023-05-17T15:22:16.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.235+0000 7f3d5bfff700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3d4805ee70 0x7f3d48061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:22:16.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.235+0000 7f3d5bfff700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3d4805ee70 0x7f3d48061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3d4c009fd0 tx=0x7f3d4c017000).ready entity=mgr.8238 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:22:16.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.239+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d5404b310 con 0x7f3d5c1544f0 2023-05-17T15:22:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.458+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3d5c06bdf0 con 0x7f3d5c1544f0 2023-05-17T15:22:16.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.461+0000 7f3d43fff700 1 -- 172.21.15.27:0/4234967731 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v60) v1 ==== 74+0+148677 (secure 0 0 0) 0x7f3d5404e930 con 0x7f3d5c1544f0 2023-05-17T15:22:16.467 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:22:16.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3d4805ee70 msgr2=0x7f3d48061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3d4805ee70 0x7f3d48061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3d4c009fd0 tx=0x7f3d4c017000).stop 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 msgr2=0x7f3d5c0c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c3b80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f3d54007f50 tx=0x7f3d54009860).stop 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 shutdown_connections 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:6836/86332,v1:172.21.15.27:6837/86332] conn(0x7f3d4805ee70 0x7f3d48061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c1544f0 0x7f3d5c0c3b80 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d5c0c1180 0x7f3d5c165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 --2- 172.21.15.27:0/4234967731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d5c0c1560 0x7f3d5c165820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:22:16.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 >> 172.21.15.27:0/4234967731 conn(0x7f3d5c05dd50 msgr2=0x7f3d5c0ab4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:22:16.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 shutdown_connections 2023-05-17T15:22:16.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:22:16.463+0000 7f3d6114f700 1 -- 172.21.15.27:0/4234967731 wait complete. 2023-05-17T15:22:16.479 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"active_gid":8238,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":86332},{"type":"v1","addr":"172.21.15.27:6837","nonce":86332}]},"active_addr":"172.21.15.27:6837/86332","active_change":"2023-05-17T15:11:14.209993+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":6755,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":141,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":603047944}]},{"addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":1777268805}]},{"addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":1807212823}]},{"addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":514334383}]}]} 2023-05-17T15:22:16.484 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-05-17T15:22:16.484 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-17T15:22:16.484 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-05-17T15:22:16.485 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-05-17T15:22:16.485 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:22:16.509 INFO:tasks.ceph.mgr.y:Stopped 2023-05-17T15:22:16.510 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-17T15:22:16.552 INFO:tasks.ceph.mgr.y:Started 2023-05-17T15:22:16.732 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:16.727+0000 7ff265848680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:22:16.797 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:16.793+0000 7ff265848680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:22:17.084 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:17.080+0000 7ff265848680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:22:17.746 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:17.742+0000 7ff265848680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:22:17.814 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:17.810+0000 7ff265848680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:22:18.008 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:18.004+0000 7ff265848680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:22:18.445 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:18.441+0000 7ff265848680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:22:18.553 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:18.549+0000 7ff265848680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:22:18.712 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:18.708+0000 7ff265848680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:22:18.790 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:18.786+0000 7ff265848680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:22:18.860 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:18.856+0000 7ff265848680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:22:19.131 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:19.127+0000 7ff265848680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:22:19.320 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:19.316+0000 7ff265848680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:22:20.002 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:19.998+0000 7ff265848680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:22:20.073 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.069+0000 7ff265848680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:22:20.151 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.147+0000 7ff265848680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:22:20.304 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.300+0000 7ff265848680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:22:20.377 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.373+0000 7ff265848680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:22:20.496 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.493+0000 7ff265848680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:22:20.609 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.605+0000 7ff265848680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:22:20.910 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.906+0000 7ff265848680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:22:20.984 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:20.980+0000 7ff265848680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:22:21.112 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e0823700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e0823700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e0823700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e0823700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e0823700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e3028700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.113 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e3028700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.114 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e3028700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.114 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e3028700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:21.114 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:22:21.108+0000 7ff1e3028700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:22:34.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:34.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:00.105 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:23:00.101+0000 7ff1ea036700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:23:00.105 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:23:00.101+0000 7ff1ea036700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:23:00.106 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:23:00.101+0000 7ff1ea036700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:23:00.106 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:23:00.101+0000 7ff1ea036700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:23:00.106 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:23:00.101+0000 7ff1ea036700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:23:04.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:04.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:34.555 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:34.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:04.625 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:04.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:34.706 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:34.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:04.786 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:04.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:34.852 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:34.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:04.931 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:04.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:35.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:35.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:05.068 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:05.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:16.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-17T15:27:16.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.684+0000 7fb9c0568700 1 Processor -- start 2023-05-17T15:27:16.688 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.684+0000 7fb9c0568700 1 -- start start 2023-05-17T15:27:16.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9c0568700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b8153fa0 0x7fb9b80c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9c0568700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9b80aa130 0x7fb9b8081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.690 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9c0568700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9b80824c0 0x7fb9b8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9c0568700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b80c1610 con 0x7fb9b80aa130 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9c0568700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b8082930 con 0x7fb9b80824c0 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9c0568700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80c0a00 con 0x7fb9b8153fa0 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9b80aa130 0x7fb9b8081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9b80aa130 0x7fb9b8081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44456/0 (socket says 172.21.15.27:44456) 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 -- 172.21.15.27:0/181139585 learned_addr learned my addr 172.21.15.27:0/181139585 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9beb05700 1 --2- 172.21.15.27:0/181139585 >> v2:172.21.15.40:3300/0 conn(0x7fb9b80824c0 0x7fb9b8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 -- 172.21.15.27:0/181139585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b8153fa0 msgr2=0x7fb9b80c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9be304700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b8153fa0 0x7fb9b80c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b8153fa0 0x7fb9b80c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 -- 172.21.15.27:0/181139585 >> v2:172.21.15.40:3300/0 conn(0x7fb9b80824c0 msgr2=0x7fb9b8068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 --2- 172.21.15.27:0/181139585 >> v2:172.21.15.40:3300/0 conn(0x7fb9b80824c0 0x7fb9b8068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 -- 172.21.15.27:0/181139585 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80c0ce0 con 0x7fb9b80aa130 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9beb05700 1 --2- 172.21.15.27:0/181139585 >> v2:172.21.15.40:3300/0 conn(0x7fb9b80824c0 0x7fb9b8068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9be304700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b8153fa0 0x7fb9b80c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.685+0000 7fb9bdb03700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b80aa130 0x7fb9b8081fd0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fb9b80c5010 tx=0x7fb9a80090f0).ready entity=mon.0 client_cookie=4d188b3bd8594906 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9bd302700 1 -- 172.21.15.27:0/181139585 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800b600 con 0x7fb9b80aa130 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9bd302700 1 -- 172.21.15.27:0/181139585 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a800b760 con 0x7fb9b80aa130 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9bd302700 1 -- 172.21.15.27:0/181139585 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800bae0 con 0x7fb9b80aa130 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 -- 172.21.15.27:0/181139585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b80aa130 msgr2=0x7fb9b8081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b80aa130 0x7fb9b8081fd0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fb9b80c5010 tx=0x7fb9a80090f0).stop 2023-05-17T15:27:16.693 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 -- 172.21.15.27:0/181139585 shutdown_connections 2023-05-17T15:27:16.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 --2- 172.21.15.27:0/181139585 >> v2:172.21.15.40:3300/0 conn(0x7fb9b80824c0 0x7fb9b8068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b8153fa0 0x7fb9b80c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 --2- 172.21.15.27:0/181139585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b80aa130 0x7fb9b8081fd0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 -- 172.21.15.27:0/181139585 >> 172.21.15.27:0/181139585 conn(0x7fb9b805e820 msgr2=0x7fb9b80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:16.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 -- 172.21.15.27:0/181139585 shutdown_connections 2023-05-17T15:27:16.694 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.686+0000 7fb9c0568700 1 -- 172.21.15.27:0/181139585 wait complete. 2023-05-17T15:27:16.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.687+0000 7fb9c0568700 1 Processor -- start 2023-05-17T15:27:16.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.687+0000 7fb9c0568700 1 -- start start 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9c0568700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b80824c0 0x7fb9b8154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9c0568700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b80aa130 0x7fb9b814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9c0568700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 0x7fb9b8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9c0568700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8155550 con 0x7fb9b8153fa0 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9c0568700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8154940 con 0x7fb9b80aa130 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9c0568700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8154c20 con 0x7fb9b80824c0 2023-05-17T15:27:16.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9beb05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 0x7fb9b8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9beb05700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 0x7fb9b8157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44462/0 (socket says 172.21.15.27:44462) 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9beb05700 1 -- 172.21.15.27:0/4241256505 learned_addr learned my addr 172.21.15.27:0/4241256505 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9bdb03700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b80aa130 0x7fb9b814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.688+0000 7fb9be304700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b80824c0 0x7fb9b8154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9beb05700 1 -- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b80824c0 msgr2=0x7fb9b8154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9beb05700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b80824c0 0x7fb9b8154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9beb05700 1 -- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b80aa130 msgr2=0x7fb9b814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9beb05700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b80aa130 0x7fb9b814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9beb05700 1 -- 172.21.15.27:0/4241256505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009370 con 0x7fb9b8153fa0 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9beb05700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 0x7fb9b8157e70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fb9b000a380 tx=0x7fb9b0007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0016470 con 0x7fb9b8153fa0 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b00165d0 con 0x7fb9b8153fa0 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b8154f00 con 0x7fb9b8153fa0 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0016950 con 0x7fb9b8153fa0 2023-05-17T15:27:16.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.689+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b80c4d00 con 0x7fb9b8153fa0 2023-05-17T15:27:16.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.690+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b80c9d70 con 0x7fb9b8153fa0 2023-05-17T15:27:16.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.690+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 65) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb9b001d060 con 0x7fb9b8153fa0 2023-05-17T15:27:16.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.691+0000 7fb9ae7fc700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb99c05ee70 0x7fb99c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:16.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.691+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fb9b007a900 con 0x7fb9b8153fa0 2023-05-17T15:27:16.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.691+0000 7fb9be304700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb99c05ee70 0x7fb99c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:16.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.691+0000 7fb9be304700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb99c05ee70 0x7fb99c061330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb9b400ab40 tx=0x7fb9b4008040).ready entity=mgr.8310 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:16.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.695+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9b004bc90 con 0x7fb9b8153fa0 2023-05-17T15:27:16.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.894+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b806bdf0 con 0x7fb99c05ee70 2023-05-17T15:27:16.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.898+0000 7fb9ae7fc700 1 -- 172.21.15.27:0/4241256505 <== mgr.8310 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fb9b806bdf0 con 0x7fb99c05ee70 2023-05-17T15:27:16.902 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-05-17T15:27:16.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb99c05ee70 msgr2=0x7fb99c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:16.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb99c05ee70 0x7fb99c061330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb9b400ab40 tx=0x7fb9b4008040).stop 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 msgr2=0x7fb9b8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 0x7fb9b8157e70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fb9b000a380 tx=0x7fb9b0007900).stop 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 shutdown_connections 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb99c05ee70 0x7fb99c061330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9b8153fa0 0x7fb9b8157e70 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b80824c0 0x7fb9b8154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 --2- 172.21.15.27:0/4241256505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b80aa130 0x7fb9b814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 >> 172.21.15.27:0/4241256505 conn(0x7fb9b805e820 msgr2=0x7fb9b80ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 shutdown_connections 2023-05-17T15:27:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:16.900+0000 7fb9c0568700 1 -- 172.21.15.27:0/4241256505 wait complete. 2023-05-17T15:27:16.915 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-05-17T15:27:16.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:16.916 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-05-17T15:27:16.931 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_12_00_UTC 2023-05-17T15:27:16.932 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_13_00_UTC 2023-05-17T15:27:16.932 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_14_00_UTC 2023-05-17T15:27:16.932 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_15_00_UTC 2023-05-17T15:27:16.932 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_16_00_UTC 2023-05-17T15:27:16.932 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_17_00_UTC 2023-05-17T15:27:16.932 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_18_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_19_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_20_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_21_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_22_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_23_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_24_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_25_00_UTC 2023-05-17T15:27:16.933 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_26_00_UTC 2023-05-17T15:27:16.934 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_27_00_UTC 2023-05-17T15:27:16.934 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-17-15_12_00_UTC', 'scheduled-2023-05-17-15_13_00_UTC', 'scheduled-2023-05-17-15_14_00_UTC', 'scheduled-2023-05-17-15_15_00_UTC', 'scheduled-2023-05-17-15_16_00_UTC', 'scheduled-2023-05-17-15_17_00_UTC', 'scheduled-2023-05-17-15_18_00_UTC', 'scheduled-2023-05-17-15_19_00_UTC', 'scheduled-2023-05-17-15_20_00_UTC', 'scheduled-2023-05-17-15_21_00_UTC', 'scheduled-2023-05-17-15_22_00_UTC', 'scheduled-2023-05-17-15_23_00_UTC', 'scheduled-2023-05-17-15_24_00_UTC', 'scheduled-2023-05-17-15_25_00_UTC', 'scheduled-2023-05-17-15_26_00_UTC', 'scheduled-2023-05-17-15_27_00_UTC'] 2023-05-17T15:27:16.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-05-17T15:27:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.090+0000 7f20a7aa8700 1 Processor -- start 2023-05-17T15:27:17.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.090+0000 7f20a7aa8700 1 -- start start 2023-05-17T15:27:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a7aa8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a7aa8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20a00826e0 0x7f20a00aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a7aa8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a00c1610 con 0x7f20a00aa130 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a7aa8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a00c0a00 con 0x7f20a00826e0 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a7aa8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00c0ce0 con 0x7f20a0153fa0 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a6045700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20a00826e0 0x7f20a00aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a5844700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a5043700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f20a00aa130 0x7f20a0081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:50032/0 (socket says 172.21.15.27:50032) 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a5043700 1 -- 172.21.15.27:0/685472709 learned_addr learned my addr 172.21.15.27:0/685472709 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:17.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a6045700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20a00826e0 0x7f20a00aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:34168/0 (socket says 172.21.15.27:34168) 2023-05-17T15:27:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.091+0000 7f20a5844700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:45576/0 (socket says 172.21.15.27:45576) 2023-05-17T15:27:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a6045700 1 -- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 msgr2=0x7f20a00c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a6045700 1 --2- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a6045700 1 -- 172.21.15.27:0/685472709 >> v1:172.21.15.40:6789/0 conn(0x7f20a00aa130 legacy=0x7f20a0081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a6045700 1 -- 172.21.15.27:0/685472709 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00c0fc0 con 0x7f20a00826e0 2023-05-17T15:27:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a4842700 1 -- 172.21.15.27:0/685472709 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135397092 0 0) 0x7f20a00c1610 con 0x7f20a00aa130 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a5844700 1 --2- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a6045700 1 --2- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a00aae50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f2090009e60 tx=0x7f2090009780).ready entity=mon.1 client_cookie=12d68f413d57564 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a4842700 1 -- 172.21.15.27:0/685472709 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000e070 con 0x7f20a00826e0 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a4842700 1 -- 172.21.15.27:0/685472709 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000bb60 con 0x7f20a00826e0 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.092+0000 7f20a4842700 1 -- 172.21.15.27:0/685472709 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090012410 con 0x7f20a00826e0 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 -- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 msgr2=0x7f20a00aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a00aae50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f2090009e60 tx=0x7f2090009780).stop 2023-05-17T15:27:17.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 -- 172.21.15.27:0/685472709 shutdown_connections 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a00aae50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/685472709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 -- 172.21.15.27:0/685472709 >> 172.21.15.27:0/685472709 conn(0x7f20a005e820 msgr2=0x7f20a00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 -- 172.21.15.27:0/685472709 shutdown_connections 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.093+0000 7f20a7aa8700 1 -- 172.21.15.27:0/685472709 wait complete. 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.094+0000 7f20a7aa8700 1 Processor -- start 2023-05-17T15:27:17.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.094+0000 7f20a7aa8700 1 -- start start 2023-05-17T15:27:17.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a7aa8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a0164d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a7aa8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 0x7f20a013c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a7aa8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a7aa8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00b0dc0 con 0x7f20a00aa130 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a7aa8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00b0520 con 0x7f20a00826e0 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a7aa8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00b0800 con 0x7f20a0153fa0 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 0x7f20a013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 0x7f20a013c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44474/0 (socket says 172.21.15.27:44474) 2023-05-17T15:27:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 -- 172.21.15.27:0/3933179869 learned_addr learned my addr 172.21.15.27:0/3933179869 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5844700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a0164d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a6045700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 -- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 msgr2=0x7f20a00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 -- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 msgr2=0x7f20a0164d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a0164d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 -- 172.21.15.27:0/3933179869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980092a0 con 0x7f20a00aa130 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a6045700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.095+0000 7f20a5043700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 0x7f20a013c240 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f209400c4a0 tx=0x7f2094007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.096+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20940072e0 con 0x7f20a00aa130 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.096+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094007440 con 0x7f20a00aa130 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.096+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20940057a0 con 0x7f20a00aa130 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.096+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2090009a20 con 0x7f20a00aa130 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.096+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a00ab370 con 0x7f20a00aa130 2023-05-17T15:27:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.097+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a006bdf0 con 0x7f20a00aa130 2023-05-17T15:27:17.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.097+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 65) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f2094010070 con 0x7f20a00aa130 2023-05-17T15:27:17.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.097+0000 7f209dffb700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f208c05ee70 0x7f208c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.097+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f20940794c0 con 0x7f20a00aa130 2023-05-17T15:27:17.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.097+0000 7f20a5844700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f208c05ee70 0x7f208c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.098+0000 7f20a5844700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f208c05ee70 0x7f208c061330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2098009270 tx=0x7f2098008040).ready entity=mgr.8310 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:17.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.101+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f209404a850 con 0x7f20a00aa130 2023-05-17T15:27:17.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.300+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20a00c26b0 con 0x7f208c05ee70 2023-05-17T15:27:17.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.301+0000 7f209dffb700 1 -- 172.21.15.27:0/3933179869 <== mgr.8310 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f20a00c26b0 con 0x7f208c05ee70 2023-05-17T15:27:17.305 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:17.305 INFO:teuthology.orchestra.run.smithi027.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T15:11:15", "first": "2023-05-17T15:12:00", "last": "2023-05-17T15:27:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-05-17T15:27:17.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f208c05ee70 msgr2=0x7f208c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f208c05ee70 0x7f208c061330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2098009270 tx=0x7f2098008040).stop 2023-05-17T15:27:17.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 msgr2=0x7f20a013c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 0x7f20a013c240 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f209400c4a0 tx=0x7f2094007c30).stop 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 shutdown_connections 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f208c05ee70 0x7f208c061330 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20a0153fa0 0x7f20a00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20a00826e0 0x7f20a0164d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 --2- 172.21.15.27:0/3933179869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20a00aa130 0x7f20a013c240 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 >> 172.21.15.27:0/3933179869 conn(0x7f20a005e820 msgr2=0x7f20a00c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:17.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 shutdown_connections 2023-05-17T15:27:17.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.303+0000 7f20a7aa8700 1 -- 172.21.15.27:0/3933179869 wait complete. 2023-05-17T15:27:17.318 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-17T00:00:00", "created": "2023-05-17T15:11:15", "first": "2023-05-17T15:12:00", "last": "2023-05-17T15:27:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-05-17T15:27:17.319 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-05-17T00:00:00', 'created': '2023-05-17T15:11:15', 'first': '2023-05-17T15:12:00', 'last': '2023-05-17T15:27:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-05-17T15:27:17.319 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-17T15:27:17.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.435+0000 7ffbcd842700 1 Processor -- start 2023-05-17T15:27:17.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.435+0000 7ffbcd842700 1 -- start start 2023-05-17T15:27:17.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbcd842700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffbc8151c90 0x7ffbc8152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbcd842700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbc8154980 0x7ffbc80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbcd842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc80c0520 0x7ffbc8081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbcd842700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc8158010 con 0x7ffbc8151c90 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbcd842700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc8154f60 con 0x7ffbc8154980 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbcd842700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8155240 con 0x7ffbc80c0520 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbc6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffbc8151c90 0x7ffbc8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbc6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ffbc8151c90 0x7ffbc8152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44480/0 (socket says 172.21.15.27:44480) 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.436+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/4189678180 learned_addr learned my addr 172.21.15.27:0/4189678180 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:17.442 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc67fc700 1 --2- 172.21.15.27:0/4189678180 >> v2:172.21.15.40:3300/0 conn(0x7ffbc8154980 0x7ffbc80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc77fe700 1 --2- 172.21.15.27:0/4189678180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc80c0520 0x7ffbc8081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/4189678180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc80c0520 msgr2=0x7ffbc8081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc6ffd700 1 --2- 172.21.15.27:0/4189678180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc80c0520 0x7ffbc8081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/4189678180 >> v2:172.21.15.40:3300/0 conn(0x7ffbc8154980 msgr2=0x7ffbc80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc6ffd700 1 --2- 172.21.15.27:0/4189678180 >> v2:172.21.15.40:3300/0 conn(0x7ffbc8154980 0x7ffbc80c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/4189678180 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8155520 con 0x7ffbc8151c90 2023-05-17T15:27:17.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc6ffd700 1 --2- 172.21.15.27:0/4189678180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc8151c90 0x7ffbc8152070 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7ffbc8083ff0 tx=0x7ffbc0009840).ready entity=mon.0 client_cookie=bc45507ae43b02dd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc5ffb700 1 -- 172.21.15.27:0/4189678180 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000e070 con 0x7ffbc8151c90 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc5ffb700 1 -- 172.21.15.27:0/4189678180 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000ba50 con 0x7ffbc8151c90 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbc5ffb700 1 -- 172.21.15.27:0/4189678180 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000bdd0 con 0x7ffbc8151c90 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 -- 172.21.15.27:0/4189678180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc8151c90 msgr2=0x7ffbc8152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 --2- 172.21.15.27:0/4189678180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc8151c90 0x7ffbc8152070 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7ffbc8083ff0 tx=0x7ffbc0009840).stop 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 -- 172.21.15.27:0/4189678180 shutdown_connections 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 --2- 172.21.15.27:0/4189678180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc8151c90 0x7ffbc8152070 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.444 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 --2- 172.21.15.27:0/4189678180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc80c0520 0x7ffbc8081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 --2- 172.21.15.27:0/4189678180 >> v2:172.21.15.40:3300/0 conn(0x7ffbc8154980 0x7ffbc80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.437+0000 7ffbcd842700 1 -- 172.21.15.27:0/4189678180 >> 172.21.15.27:0/4189678180 conn(0x7ffbc80cae10 msgr2=0x7ffbc80cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:17.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.438+0000 7ffbcd842700 1 -- 172.21.15.27:0/4189678180 shutdown_connections 2023-05-17T15:27:17.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.438+0000 7ffbcd842700 1 -- 172.21.15.27:0/4189678180 wait complete. 2023-05-17T15:27:17.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.439+0000 7ffbcd842700 1 Processor -- start 2023-05-17T15:27:17.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.439+0000 7ffbcd842700 1 -- start start 2023-05-17T15:27:17.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.439+0000 7ffbcd842700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 0x7ffbc8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc8151c90 0x7ffbc8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc8154980 0x7ffbc80ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8164710 con 0x7ffbc80c0520 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc815a7b0 con 0x7ffbc8154980 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc815aa90 con 0x7ffbc8151c90 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 0x7ffbc8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 0x7ffbc8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44486/0 (socket says 172.21.15.27:44486) 2023-05-17T15:27:17.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/3775964711 learned_addr learned my addr 172.21.15.27:0/3775964711 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc67fc700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc8151c90 0x7ffbc8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc77fe700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc8154980 0x7ffbc80ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc8151c90 msgr2=0x7ffbc8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc8151c90 0x7ffbc8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc8154980 msgr2=0x7ffbc80ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc8154980 0x7ffbc80ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 -- 172.21.15.27:0/3775964711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009ae0 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbc6ffd700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 0x7ffbc8159f80 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7ffbc0009fd0 tx=0x7ffbc0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000bbc0 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000bd20 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc815ad70 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc001e680 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.440+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc815a470 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.441+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc806bdf0 con 0x7ffbc80c0520 2023-05-17T15:27:17.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.442+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 65) v1 ==== 75339+0+0 (secure 0 0 0) 0x7ffbc0025030 con 0x7ffbc80c0520 2023-05-17T15:27:17.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.442+0000 7ffbbeffd700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ffba805ee40 0x7ffba8061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:17.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.442+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ffbc007b320 con 0x7ffbc80c0520 2023-05-17T15:27:17.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.442+0000 7ffbc67fc700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ffba805ee40 0x7ffba8061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:17.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.442+0000 7ffbc67fc700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ffba805ee40 0x7ffba8061300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ffbc80ad3a0 tx=0x7ffbb0006f90).ready entity=mgr.8310 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:17.451 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.446+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffbc004c760 con 0x7ffbc80c0520 2023-05-17T15:27:17.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.644+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbc80bff90 con 0x7ffba805ee40 2023-05-17T15:27:17.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.648+0000 7ffbbeffd700 1 -- 172.21.15.27:0/3775964711 <== mgr.8310 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7ffbc80bff90 con 0x7ffba805ee40 2023-05-17T15:27:17.652 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-05-17T15:27:17.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ffba805ee40 msgr2=0x7ffba8061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ffba805ee40 0x7ffba8061300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ffbc80ad3a0 tx=0x7ffbb0006f90).stop 2023-05-17T15:27:17.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 msgr2=0x7ffbc8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:17.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 0x7ffbc8159f80 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7ffbc0009fd0 tx=0x7ffbc0009840).stop 2023-05-17T15:27:17.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 shutdown_connections 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ffba805ee40 0x7ffba8061300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc8154980 0x7ffbc80ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbc80c0520 0x7ffbc8159f80 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 --2- 172.21.15.27:0/3775964711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc8151c90 0x7ffbc8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 >> 172.21.15.27:0/3775964711 conn(0x7ffbc80cae10 msgr2=0x7ffbc80c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 shutdown_connections 2023-05-17T15:27:17.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:17.650+0000 7ffbcd842700 1 -- 172.21.15.27:0/3775964711 wait complete. 2023-05-17T15:27:17.665 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-05-17T15:27:17.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.666 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-05-17T15:27:17.681 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_12_00_UTC 2023-05-17T15:27:17.682 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_13_00_UTC 2023-05-17T15:27:17.682 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_14_00_UTC 2023-05-17T15:27:17.682 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_15_00_UTC 2023-05-17T15:27:17.682 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_16_00_UTC 2023-05-17T15:27:17.682 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_17_00_UTC 2023-05-17T15:27:17.682 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_18_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_19_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_20_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_21_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_22_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_23_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_24_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_25_00_UTC 2023-05-17T15:27:17.683 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_26_00_UTC 2023-05-17T15:27:17.684 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_27_00_UTC 2023-05-17T15:27:17.684 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_12_00_UTC 2023-05-17T15:27:17.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.684 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_12_00_UTC) 2023-05-17T15:27:17.742 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_13_00_UTC 2023-05-17T15:27:17.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.743 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_13_00_UTC) 2023-05-17T15:27:17.802 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_14_00_UTC 2023-05-17T15:27:17.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.803 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_14_00_UTC) 2023-05-17T15:27:17.865 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_15_00_UTC 2023-05-17T15:27:17.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.866 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_15_00_UTC) 2023-05-17T15:27:17.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_16_00_UTC 2023-05-17T15:27:17.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.931 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_16_00_UTC) 2023-05-17T15:27:17.993 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_17_00_UTC 2023-05-17T15:27:17.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:17.994 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_17_00_UTC) 2023-05-17T15:27:18.056 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_18_00_UTC 2023-05-17T15:27:18.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.057 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_18_00_UTC) 2023-05-17T15:27:18.119 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_19_00_UTC 2023-05-17T15:27:18.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.120 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_19_00_UTC) 2023-05-17T15:27:18.179 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_20_00_UTC 2023-05-17T15:27:18.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.180 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_20_00_UTC) 2023-05-17T15:27:18.241 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_21_00_UTC 2023-05-17T15:27:18.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.242 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_21_00_UTC) 2023-05-17T15:27:18.304 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_22_00_UTC 2023-05-17T15:27:18.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.304 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_22_00_UTC) 2023-05-17T15:27:18.363 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_23_00_UTC 2023-05-17T15:27:18.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.364 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_23_00_UTC) 2023-05-17T15:27:18.424 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_24_00_UTC 2023-05-17T15:27:18.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.425 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_24_00_UTC) 2023-05-17T15:27:18.487 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_25_00_UTC 2023-05-17T15:27:18.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.488 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_25_00_UTC) 2023-05-17T15:27:18.548 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_26_00_UTC 2023-05-17T15:27:18.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.549 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_26_00_UTC) 2023-05-17T15:27:18.608 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_27_00_UTC 2023-05-17T15:27:18.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.609 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-17-15_27_00_UTC) 2023-05-17T15:27:18.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:18.669 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-05-17T15:27:18.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:27:18.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.879+0000 7fe906156700 1 Processor -- start 2023-05-17T15:27:18.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.879+0000 7fe906156700 1 -- start start 2023-05-17T15:27:18.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe906156700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe9001543d0 0x7fe9000c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:18.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe906156700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe900069410 0x7fe9000bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:18.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe906156700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe900158790 con 0x7fe9000c60f0 2023-05-17T15:27:18.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe906156700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9000c1c50 con 0x7fe9001543d0 2023-05-17T15:27:18.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe906156700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9000c6570 con 0x7fe900069410 2023-05-17T15:27:18.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe8ff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe9001543d0 0x7fe9000c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:18.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe8ff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe9001543d0 0x7fe9000c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44494/0 (socket says 172.21.15.27:44494) 2023-05-17T15:27:18.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe8ff7fe700 1 -- 172.21.15.27:0/3484452819 learned_addr learned my addr 172.21.15.27:0/3484452819 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:18.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe8feffd700 1 --1- 172.21.15.27:0/3484452819 >> v1:172.21.15.27:6789/0 conn(0x7fe9000c60f0 0x7fe900068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44058/0 (socket says 172.21.15.27:44058) 2023-05-17T15:27:18.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.880+0000 7fe8fffff700 1 --2- 172.21.15.27:0/3484452819 >> v2:172.21.15.40:3300/0 conn(0x7fe900069410 0x7fe9000bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:18.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8ff7fe700 1 -- 172.21.15.27:0/3484452819 >> v2:172.21.15.40:3300/0 conn(0x7fe900069410 msgr2=0x7fe9000bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:18.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8ff7fe700 1 --2- 172.21.15.27:0/3484452819 >> v2:172.21.15.40:3300/0 conn(0x7fe900069410 0x7fe9000bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:18.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8ff7fe700 1 -- 172.21.15.27:0/3484452819 >> v1:172.21.15.27:6789/0 conn(0x7fe9000c60f0 legacy=0x7fe900068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:18.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8fe7fc700 1 -- 172.21.15.27:0/3484452819 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216977232 0 0) 0x7fe900158790 con 0x7fe9000c60f0 2023-05-17T15:27:18.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8ff7fe700 1 -- 172.21.15.27:0/3484452819 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900157e60 con 0x7fe9001543d0 2023-05-17T15:27:18.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8fffff700 1 --2- 172.21.15.27:0/3484452819 >> v2:172.21.15.40:3300/0 conn(0x7fe900069410 0x7fe9000bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:18.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8ff7fe700 1 --2- 172.21.15.27:0/3484452819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9001543d0 0x7fe9000c5c00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fe900155920 tx=0x7fe8f00090f0).ready entity=mon.0 client_cookie=c0b5396070c20be8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:18.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8fe7fc700 1 -- 172.21.15.27:0/3484452819 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000b600 con 0x7fe9001543d0 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8fe7fc700 1 -- 172.21.15.27:0/3484452819 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f000b760 con 0x7fe9001543d0 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe8fe7fc700 1 -- 172.21.15.27:0/3484452819 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000bae0 con 0x7fe9001543d0 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 -- 172.21.15.27:0/3484452819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9001543d0 msgr2=0x7fe9000c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 --2- 172.21.15.27:0/3484452819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9001543d0 0x7fe9000c5c00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fe900155920 tx=0x7fe8f00090f0).stop 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 -- 172.21.15.27:0/3484452819 shutdown_connections 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 --2- 172.21.15.27:0/3484452819 >> v2:172.21.15.40:3300/0 conn(0x7fe900069410 0x7fe9000bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:18.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 --2- 172.21.15.27:0/3484452819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9001543d0 0x7fe9000c5c00 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:18.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 -- 172.21.15.27:0/3484452819 >> 172.21.15.27:0/3484452819 conn(0x7fe9000cb7f0 msgr2=0x7fe9000c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:18.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 -- 172.21.15.27:0/3484452819 shutdown_connections 2023-05-17T15:27:18.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.881+0000 7fe906156700 1 -- 172.21.15.27:0/3484452819 wait complete. 2023-05-17T15:27:18.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 Processor -- start 2023-05-17T15:27:18.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 -- start start 2023-05-17T15:27:18.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe900069410 0x7fe900147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 0x7fe9000c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9001543d0 0x7fe9000aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c1dc0 con 0x7fe9000c60f0 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900147f50 con 0x7fe900069410 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.883+0000 7fe906156700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000af6f0 con 0x7fe9001543d0 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 0x7fe9000c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 0x7fe9000c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44502/0 (socket says 172.21.15.27:44502) 2023-05-17T15:27:18.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 -- 172.21.15.27:0/3665906695 learned_addr learned my addr 172.21.15.27:0/3665906695 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8fffff700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9001543d0 0x7fe9000aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8ff7fe700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe900069410 0x7fe900147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 -- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9001543d0 msgr2=0x7fe9000aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9001543d0 0x7fe9000aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 -- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe900069410 msgr2=0x7fe900147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe900069410 0x7fe900147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 -- 172.21.15.27:0/3665906695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009370 con 0x7fe9000c60f0 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8fffff700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9001543d0 0x7fe9000aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8ff7fe700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe900069410 0x7fe900147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8feffd700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 0x7fe9000c2810 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fe8f400c560 tx=0x7fe8f4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40072e0 con 0x7fe9000c60f0 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f4007440 con 0x7fe9000c60f0 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4005930 con 0x7fe9000c60f0 2023-05-17T15:27:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9000af9d0 con 0x7fe9000c60f0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.884+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9000c22f0 con 0x7fe9000c60f0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.885+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90006bdf0 con 0x7fe9000c60f0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.885+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 65) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fe8f4010070 con 0x7fe9000c60f0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.886+0000 7fe8e77fe700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe8ec05ee70 0x7fe8ec061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.886+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fe8f4079490 con 0x7fe9000c60f0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.886+0000 7fe8ff7fe700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe8ec05ee70 0x7fe8ec061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.886+0000 7fe8ff7fe700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe8ec05ee70 0x7fe8ec061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe8f0009fd0 tx=0x7fe8f0017000).ready entity=mgr.8310 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:18.890+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8f404a820 con 0x7fe9000c60f0 2023-05-17T15:27:19.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.106+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe900069d00 con 0x7fe9000c60f0 2023-05-17T15:27:19.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.199+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 66) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe8f4005d20 con 0x7fe9000c60f0 2023-05-17T15:27:19.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.201+0000 7fe8e77fe700 1 -- 172.21.15.27:0/3665906695 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v66) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe8f4075390 con 0x7fe9000c60f0 2023-05-17T15:27:19.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe8ec05ee70 msgr2=0x7fe8ec061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:19.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe8ec05ee70 0x7fe8ec061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe8f0009fd0 tx=0x7fe8f0017000).stop 2023-05-17T15:27:19.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 msgr2=0x7fe9000c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:19.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 0x7fe9000c2810 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fe8f400c560 tx=0x7fe8f4007c90).stop 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 shutdown_connections 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe8ec05ee70 0x7fe8ec061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9001543d0 0x7fe9000aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe900069410 0x7fe900147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 --2- 172.21.15.27:0/3665906695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9000c60f0 0x7fe9000c2810 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 >> 172.21.15.27:0/3665906695 conn(0x7fe9000cb7f0 msgr2=0x7fe900153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 shutdown_connections 2023-05-17T15:27:19.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:19.203+0000 7fe906156700 1 -- 172.21.15.27:0/3665906695 wait complete. 2023-05-17T15:27:19.219 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:27:19.220 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:27:19.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:27:19.279 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:27:19.279 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:27:19.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:19.280 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:27:19.346 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:19.342+0000 7f53cff63680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:27:19.350 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:19.346+0000 7f79db99d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:27:19.411 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:19.407+0000 7f53cff63680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:27:19.415 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:19.411+0000 7f79db99d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:27:19.696 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:19.691+0000 7f53cff63680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:27:19.700 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:19.696+0000 7f79db99d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:27:20.351 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:20.347+0000 7f53cff63680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:27:20.357 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:20.354+0000 7f79db99d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:27:20.418 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:20.414+0000 7f53cff63680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:27:20.425 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:20.422+0000 7f79db99d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:27:20.611 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:20.607+0000 7f53cff63680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:27:20.617 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:20.614+0000 7f79db99d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:27:21.047 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.043+0000 7f53cff63680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:27:21.054 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.050+0000 7f79db99d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:27:21.155 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.152+0000 7f53cff63680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:21.161 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.158+0000 7f79db99d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:21.315 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.311+0000 7f53cff63680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:21.320 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.316+0000 7f79db99d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:21.392 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.389+0000 7f53cff63680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:27:21.397 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.394+0000 7f79db99d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:27:21.462 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.458+0000 7f53cff63680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:27:21.467 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.463+0000 7f79db99d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:27:21.731 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.727+0000 7f53cff63680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:27:21.737 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.733+0000 7f79db99d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:27:21.920 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:21.916+0000 7f53cff63680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:21.925 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:21.921+0000 7f79db99d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:22.596 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:22.593+0000 7f53cff63680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:27:22.602 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:22.599+0000 7f79db99d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:27:22.668 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:22.664+0000 7f53cff63680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:27:22.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:27:22.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:22.671 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:27:22.674 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:22.670+0000 7f79db99d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:27:22.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:22.751 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:22.747+0000 7f53cff63680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:27:22.780 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:22.776+0000 7f79db99d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:27:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.845+0000 7f255cbdd700 1 Processor -- start 2023-05-17T15:27:22.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.845+0000 7f255cbdd700 1 -- start start 2023-05-17T15:27:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255cbdd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25580cb470 0x7f25580c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255cbdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2558153bf0 0x7f2558154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:22.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255cbdd700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580c05f0 con 0x7f25580c5ef0 2023-05-17T15:27:22.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255cbdd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2558154570 con 0x7f25580cb470 2023-05-17T15:27:22.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255cbdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580aa510 con 0x7f2558153bf0 2023-05-17T15:27:22.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f25580c5ef0 0x7f25580a9d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44194/0 (socket says 172.21.15.27:44194) 2023-05-17T15:27:22.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f255659c700 1 -- 172.21.15.27:0/1890257874 learned_addr learned my addr 172.21.15.27:0/1890257874 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:22.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f2555d9b700 1 --2- 172.21.15.27:0/1890257874 >> v2:172.21.15.40:3300/0 conn(0x7f25580cb470 0x7f25580c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:22.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.846+0000 7f2556d9d700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2558153bf0 0x7f2558154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f255559a700 1 -- 172.21.15.27:0/1890257874 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40822320 0 0) 0x7f25580c05f0 con 0x7f25580c5ef0 2023-05-17T15:27:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f255559a700 1 -- 172.21.15.27:0/1890257874 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25400033f0 con 0x7f25580c5ef0 2023-05-17T15:27:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f2555d9b700 1 -- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2558153bf0 msgr2=0x7f2558154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f2555d9b700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2558153bf0 0x7f2558154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:22.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f2555d9b700 1 -- 172.21.15.27:0/1890257874 >> v1:172.21.15.27:6789/0 conn(0x7f25580c5ef0 legacy=0x7f25580a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f2555d9b700 1 -- 172.21.15.27:0/1890257874 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580bfcc0 con 0x7f25580cb470 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f2556d9d700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2558153bf0 0x7f2558154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f2555d9b700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25580cb470 0x7f25580c62d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f254c009760 tx=0x7f254c009060).ready entity=mon.1 client_cookie=cd2408a9bcdca068 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f255559a700 1 -- 172.21.15.27:0/1890257874 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00d4a0 con 0x7f25580cb470 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f255559a700 1 -- 172.21.15.27:0/1890257874 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00d600 con 0x7f25580cb470 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.847+0000 7f255559a700 1 -- 172.21.15.27:0/1890257874 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00d980 con 0x7f25580cb470 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 -- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25580cb470 msgr2=0x7f25580c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25580cb470 0x7f25580c62d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f254c009760 tx=0x7f254c009060).stop 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 -- 172.21.15.27:0/1890257874 shutdown_connections 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2558153bf0 0x7f2558154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 --2- 172.21.15.27:0/1890257874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25580cb470 0x7f25580c62d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 -- 172.21.15.27:0/1890257874 >> 172.21.15.27:0/1890257874 conn(0x7f255805e810 msgr2=0x7f25580cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 -- 172.21.15.27:0/1890257874 shutdown_connections 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.848+0000 7f255cbdd700 1 -- 172.21.15.27:0/1890257874 wait complete. 2023-05-17T15:27:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.849+0000 7f255cbdd700 1 Processor -- start 2023-05-17T15:27:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.849+0000 7f255cbdd700 1 -- start start 2023-05-17T15:27:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 0x7f25581571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25580cb470 0x7f2558154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2558153bf0 0x7f255814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2558158510 con 0x7f25580c5ef0 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2558157890 con 0x7f2558153bf0 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2558157b70 con 0x7f25580cb470 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 0x7f25581571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 0x7f25581571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44638/0 (socket says 172.21.15.27:44638) 2023-05-17T15:27:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 -- 172.21.15.27:0/771838483 learned_addr learned my addr 172.21.15.27:0/771838483 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f2555d9b700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25580cb470 0x7f2558154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f2556d9d700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2558153bf0 0x7f255814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 -- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25580cb470 msgr2=0x7f2558154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25580cb470 0x7f2558154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 -- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2558153bf0 msgr2=0x7f255814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2558153bf0 0x7f255814c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 -- 172.21.15.27:0/771838483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550009a20 con 0x7f25580c5ef0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255659c700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 0x7f25581571f0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f254800c590 tx=0x7f2548007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480072e0 con 0x7f25580c5ef0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548007440 con 0x7f25580c5ef0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c0092a0 con 0x7f25580c5ef0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480057a0 con 0x7f25580c5ef0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.850+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2558158130 con 0x7f25580c5ef0 2023-05-17T15:27:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.851+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255805f4a0 con 0x7f25580c5ef0 2023-05-17T15:27:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.852+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 66) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f254801a060 con 0x7f25580c5ef0 2023-05-17T15:27:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.852+0000 7f25467fc700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 0x7f25380612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.853+0000 7f2555d9b700 1 -- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 msgr2=0x7f25380612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.853+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6711+0+0 (secure 0 0 0) 0x7f2548079610 con 0x7f25580c5ef0 2023-05-17T15:27:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.853+0000 7f2555d9b700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 0x7f25380612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:27:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:22.856+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f254804a9c0 con 0x7f25580c5ef0 2023-05-17T15:27:22.912 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:22.908+0000 7f53cff63680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:27:22.935 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:22.932+0000 7f79db99d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:27:23.001 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:22.998+0000 7f53cff63680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:27:23.013 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:23.009+0000 7f79db99d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:27:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.054+0000 7f2555d9b700 1 -- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 msgr2=0x7f25380612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:23.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.054+0000 7f2555d9b700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 0x7f25380612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:27:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.099+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f255806bdf0 con 0x7f25580c5ef0 2023-05-17T15:27:23.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.100+0000 7f25467fc700 1 -- 172.21.15.27:0/771838483 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f2548018020 con 0x7f25580c5ef0 2023-05-17T15:27:23.106 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:23.106 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:57.199573+0000","modified":"2023-05-17T15:11:00.212835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/4188362565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4188362565},{"type":"v1","addr":"172.21.15.40:6835","nonce":4188362565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-17T15:27:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 msgr2=0x7f25380612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:27:23.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 0x7f25380612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 msgr2=0x7f25581571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 0x7f25581571f0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f254800c590 tx=0x7f2548007c80).stop 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 shutdown_connections 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f253805ee20 0x7f25380612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2558153bf0 0x7f255814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25580c5ef0 0x7f25581571f0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 --2- 172.21.15.27:0/771838483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25580cb470 0x7f2558154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 >> 172.21.15.27:0/771838483 conn(0x7f255805e810 msgr2=0x7f25580aba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 shutdown_connections 2023-05-17T15:27:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.103+0000 7f255cbdd700 1 -- 172.21.15.27:0/771838483 wait complete. 2023-05-17T15:27:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 60 2023-05-17T15:27:23.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:23.140 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.136+0000 7f53cff63680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:27:23.141 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:23.137+0000 7f79db99d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:27:23.277 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:23.273+0000 7f79db99d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:23.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.277+0000 7fc2c359e700 1 Processor -- start 2023-05-17T15:27:23.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.277+0000 7fc2c359e700 1 -- start start 2023-05-17T15:27:23.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2c4067e70 0x7fc2c4068250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c359e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2c40652a0 0x7fc2c40bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c40bca90 con 0x7fc2c40bcf20 2023-05-17T15:27:23.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c359e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40bc760 con 0x7fc2c40652a0 2023-05-17T15:27:23.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40a6720 con 0x7fc2c4067e70 2023-05-17T15:27:23.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2c40652a0 0x7fc2c40bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2c40652a0 0x7fc2c40bd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44652/0 (socket says 172.21.15.27:44652) 2023-05-17T15:27:23.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/6609245 learned_addr learned my addr 172.21.15.27:0/6609245 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:23.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c259c700 1 --2- 172.21.15.27:0/6609245 >> v2:172.21.15.40:3300/0 conn(0x7fc2c4067e70 0x7fc2c4068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.283 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.278+0000 7f53cff63680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:23.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/6609245 >> v2:172.21.15.40:3300/0 conn(0x7fc2c4067e70 msgr2=0x7fc2c4068250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:23.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 --2- 172.21.15.27:0/6609245 >> v2:172.21.15.40:3300/0 conn(0x7fc2c4067e70 0x7fc2c4068250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c159a700 1 -- 172.21.15.27:0/6609245 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300389875 0 0) 0x7fc2c40bca90 con 0x7fc2c40bcf20 2023-05-17T15:27:23.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/6609245 >> v1:172.21.15.40:6789/0 conn(0x7fc2c40bcf20 legacy=0x7fc2c4064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.278+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/6609245 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40a6a00 con 0x7fc2c40652a0 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c2d9d700 1 --2- 172.21.15.27:0/6609245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40652a0 0x7fc2c40bd3a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fc2c40c76a0 tx=0x7fc2bc009840).ready entity=mon.0 client_cookie=da92e4d85995a91 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c159a700 1 -- 172.21.15.27:0/6609245 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00ba20 con 0x7fc2c40652a0 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c159a700 1 -- 172.21.15.27:0/6609245 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00bb80 con 0x7fc2c40652a0 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c159a700 1 -- 172.21.15.27:0/6609245 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00bcf0 con 0x7fc2c40652a0 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 -- 172.21.15.27:0/6609245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40652a0 msgr2=0x7fc2c40bd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 --2- 172.21.15.27:0/6609245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40652a0 0x7fc2c40bd3a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fc2c40c76a0 tx=0x7fc2bc009840).stop 2023-05-17T15:27:23.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 -- 172.21.15.27:0/6609245 shutdown_connections 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 --2- 172.21.15.27:0/6609245 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40652a0 0x7fc2c40bd3a0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 --2- 172.21.15.27:0/6609245 >> v2:172.21.15.40:3300/0 conn(0x7fc2c4067e70 0x7fc2c4068250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 -- 172.21.15.27:0/6609245 >> 172.21.15.27:0/6609245 conn(0x7fc2c40c7760 msgr2=0x7fc2c40c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 -- 172.21.15.27:0/6609245 shutdown_connections 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.279+0000 7fc2c359e700 1 -- 172.21.15.27:0/6609245 wait complete. 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.280+0000 7fc2c359e700 1 Processor -- start 2023-05-17T15:27:23.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 -- start start 2023-05-17T15:27:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c40652a0 0x7fc2c4150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c4067e70 0x7fc2c4148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 0x7fc2c415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4151120 con 0x7fc2c40bcf20 2023-05-17T15:27:23.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c41492a0 con 0x7fc2c4067e70 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c41536d0 con 0x7fc2c40652a0 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 0x7fc2c415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c4067e70 0x7fc2c4148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 0x7fc2c415fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44658/0 (socket says 172.21.15.27:44658) 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c40652a0 0x7fc2c4150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c4067e70 0x7fc2c4148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:34354/0 (socket says 172.21.15.27:34354) 2023-05-17T15:27:23.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.281+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/256015278 learned_addr learned my addr 172.21.15.27:0/256015278 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/256015278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c40652a0 msgr2=0x7fc2c4150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c2d9d700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c40652a0 0x7fc2c4150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/256015278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c4067e70 msgr2=0x7fc2c4148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c2d9d700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c4067e70 0x7fc2c4148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c2d9d700 1 -- 172.21.15.27:0/256015278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc009ae0 con 0x7fc2c40bcf20 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c2d9d700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 0x7fc2c415fc50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fc2c406a980 tx=0x7fc2bc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00bcf0 con 0x7fc2c40bcf20 2023-05-17T15:27:23.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00bea0 con 0x7fc2c40bcf20 2023-05-17T15:27:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c41496a0 con 0x7fc2c40bcf20 2023-05-17T15:27:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00ba20 con 0x7fc2c40bcf20 2023-05-17T15:27:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.282+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c4152da0 con 0x7fc2c40bcf20 2023-05-17T15:27:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.283+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c4153a60 con 0x7fc2c40bcf20 2023-05-17T15:27:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.284+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 66) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc2bc029030 con 0x7fc2c40bcf20 2023-05-17T15:27:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.284+0000 7fc2ba7fc700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc2a405ee20 0x7fc2a40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.284+0000 7fc2c259c700 1 -- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc2a405ee20 msgr2=0x7fc2a40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.284+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6711+0+0 (secure 0 0 0) 0x7fc2bc07f640 con 0x7fc2c40bcf20 2023-05-17T15:27:23.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.284+0000 7fc2c259c700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc2a405ee20 0x7fc2a40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:27:23.294 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.288+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc2bc050a20 con 0x7fc2c40bcf20 2023-05-17T15:27:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.467+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2c406bdf0 con 0x7fc2c40bcf20 2023-05-17T15:27:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.468+0000 7fc2ba7fc700 1 -- 172.21.15.27:0/256015278 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17852 (secure 0 0 0) 0x7fc2bc027070 con 0x7fc2c40bcf20 2023-05-17T15:27:23.472 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:23.473 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":145,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:22.712539+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:55.754589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:56.180897+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.18","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/514334383":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/1777268805":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/1807212823":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/603047944":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/365514908":"2023-05-18T15:11:14.209618+0000","172.21.15.27:0/3558111842":"2023-05-18T15:11:14.209618+0000","172.21.15.27:6837/86332":"2023-05-18T15:11:14.209618+0000","172.21.15.27:6836/86332":"2023-05-18T15:11:14.209618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc2a405ee20 msgr2=0x7fc2a40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:27:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc2a405ee20 0x7fc2a40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 msgr2=0x7fc2c415fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 0x7fc2c415fc50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fc2c406a980 tx=0x7fc2bc01a000).stop 2023-05-17T15:27:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 shutdown_connections 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc2a405ee20 0x7fc2a40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2c40bcf20 0x7fc2c415fc50 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c40652a0 0x7fc2c4150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 --2- 172.21.15.27:0/256015278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c4067e70 0x7fc2c4148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 >> 172.21.15.27:0/256015278 conn(0x7fc2c40c7760 msgr2=0x7fc2c4149b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 shutdown_connections 2023-05-17T15:27:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.470+0000 7fc2c359e700 1 -- 172.21.15.27:0/256015278 wait complete. 2023-05-17T15:27:23.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:10:55.754589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:10:56.180897+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 145, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:27:23.487 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:27:23.577 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:23.573+0000 7f79db99d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:27:23.589 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.585+0000 7f53cff63680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:27:23.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.603+0000 7ff5c7fff700 1 Processor -- start 2023-05-17T15:27:23.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.603+0000 7ff5c7fff700 1 -- start start 2023-05-17T15:27:23.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff5c80cac00 0x7ff5c80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c7fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c80c60d0 con 0x7ff5c81537e0 2023-05-17T15:27:23.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c7fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c81588b0 con 0x7ff5c80cac00 2023-05-17T15:27:23.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c7fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8157e00 con 0x7ff5c8157980 2023-05-17T15:27:23.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff5c80cac00 0x7ff5c80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff5c80cac00 0x7ff5c80cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44662/0 (socket says 172.21.15.27:44662) 2023-05-17T15:27:23.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/1606009915 learned_addr learned my addr 172.21.15.27:0/1606009915 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:23.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c67fc700 1 --2- 172.21.15.27:0/1606009915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/1606009915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 msgr2=0x7ff5c80c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 --2- 172.21.15.27:0/1606009915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/1606009915 >> v1:172.21.15.40:6789/0 conn(0x7ff5c81537e0 legacy=0x7ff5c8153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/1606009915 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8158010 con 0x7ff5c80cac00 2023-05-17T15:27:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.604+0000 7ff5c6ffd700 1 --2- 172.21.15.27:0/1606009915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c80cafe0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7ff5b8009830 tx=0x7ff5b80090f0).ready entity=mon.0 client_cookie=cad2036598754c5f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:23.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c5ffb700 1 -- 172.21.15.27:0/1606009915 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800b580 con 0x7ff5c80cac00 2023-05-17T15:27:23.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c5ffb700 1 -- 172.21.15.27:0/1606009915 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800b6e0 con 0x7ff5c80cac00 2023-05-17T15:27:23.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c5ffb700 1 -- 172.21.15.27:0/1606009915 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800ba60 con 0x7ff5c80cac00 2023-05-17T15:27:23.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 -- 172.21.15.27:0/1606009915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 msgr2=0x7ff5c80cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/1606009915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c80cafe0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7ff5b8009830 tx=0x7ff5b80090f0).stop 2023-05-17T15:27:23.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 -- 172.21.15.27:0/1606009915 shutdown_connections 2023-05-17T15:27:23.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/1606009915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c80cafe0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/1606009915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 -- 172.21.15.27:0/1606009915 >> 172.21.15.27:0/1606009915 conn(0x7ff5c805dd50 msgr2=0x7ff5c805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:23.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 -- 172.21.15.27:0/1606009915 shutdown_connections 2023-05-17T15:27:23.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.605+0000 7ff5c7fff700 1 -- 172.21.15.27:0/1606009915 wait complete. 2023-05-17T15:27:23.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.607+0000 7ff5c7fff700 1 Processor -- start 2023-05-17T15:27:23.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.607+0000 7ff5c7fff700 1 -- start start 2023-05-17T15:27:23.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.608+0000 7ff5c7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5c81537e0 0x7ff5c8165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8165da0 con 0x7ff5c80cac00 2023-05-17T15:27:23.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81569b0 con 0x7ff5c81537e0 2023-05-17T15:27:23.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8156c90 con 0x7ff5c8157980 2023-05-17T15:27:23.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44670/0 (socket says 172.21.15.27:44670) 2023-05-17T15:27:23.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/4209786037 learned_addr learned my addr 172.21.15.27:0/4209786037 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c67fc700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5c81537e0 0x7ff5c8165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c77fe700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 msgr2=0x7ff5c80c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5c81537e0 msgr2=0x7ff5c8165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5c81537e0 0x7ff5c8165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 -- 172.21.15.27:0/4209786037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8009370 con 0x7ff5c80cac00 2023-05-17T15:27:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c6ffd700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c814e8e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7ff5b8009ed0 tx=0x7ff5b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8000bc0 con 0x7ff5c80cac00 2023-05-17T15:27:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800b850 con 0x7ff5c80cac00 2023-05-17T15:27:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c8165a30 con 0x7ff5c80cac00 2023-05-17T15:27:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8000d20 con 0x7ff5c80cac00 2023-05-17T15:27:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.609+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c8165660 con 0x7ff5c80cac00 2023-05-17T15:27:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.610+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c8153280 con 0x7ff5c80cac00 2023-05-17T15:27:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.611+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 66) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff5b802c070 con 0x7ff5c80cac00 2023-05-17T15:27:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.611+0000 7ff5aeffd700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff5b405ee20 0x7ff5b40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.611+0000 7ff5c67fc700 1 -- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff5b405ee20 msgr2=0x7ff5b40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.611+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6711+0+0 (secure 0 0 0) 0x7ff5b807bf90 con 0x7ff5c80cac00 2023-05-17T15:27:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.611+0000 7ff5c67fc700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff5b405ee20 0x7ff5b40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:27:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.615+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5b804d340 con 0x7ff5c80cac00 2023-05-17T15:27:23.652 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:23.648+0000 7f79db99d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:27:23.679 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.676+0000 7f53cff63680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:27:23.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.724+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 67) v1 ==== 75092+0+0 (secure 0 0 0) 0x7ff5b8022030 con 0x7ff5c80cac00 2023-05-17T15:27:23.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.724+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff5b405ee20 msgr2=0x7ff5b40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:27:23.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.724+0000 7ff5aeffd700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff5b405ee20 0x7ff5b40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:23.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f534f707700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.775 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f534f707700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f534f707700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f534f707700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f534f707700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f535270d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f535270d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.776 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f535270d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.777 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f535270d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.777 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:23.771+0000 7f535270d700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.824+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff5c8156e50 con 0x7ff5c80cac00 2023-05-17T15:27:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.824+0000 7ff5aeffd700 1 -- 172.21.15.27:0/4209786037 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v146) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff5b8048070 con 0x7ff5c80cac00 2023-05-17T15:27:23.828 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:27:23.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 msgr2=0x7ff5c814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c814e8e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7ff5b8009ed0 tx=0x7ff5b8017000).stop 2023-05-17T15:27:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 shutdown_connections 2023-05-17T15:27:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff5b405ee20 0x7ff5b40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5c8157980 0x7ff5c80c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5c80cac00 0x7ff5c814e8e0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 --2- 172.21.15.27:0/4209786037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5c81537e0 0x7ff5c8165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 >> 172.21.15.27:0/4209786037 conn(0x7ff5c805dd50 msgr2=0x7ff5c80ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 shutdown_connections 2023-05-17T15:27:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.826+0000 7ff5c7fff700 1 -- 172.21.15.27:0/4209786037 wait complete. 2023-05-17T15:27:23.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:27:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.956+0000 7f63f2c15700 1 Processor -- start 2023-05-17T15:27:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.956+0000 7f63f2c15700 1 -- start start 2023-05-17T15:27:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f2c15700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63ec1543d0 0x7f63ec0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f2c15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63ec0c60f0 0x7f63ec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f2c15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f2c15700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0c1c50 con 0x7f63ec1543d0 2023-05-17T15:27:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f2c15700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec158790 con 0x7f63ec0c60f0 2023-05-17T15:27:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f2c15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c6570 con 0x7f63ec0691f0 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f09b1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63ec1543d0 0x7f63ec0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f09b1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63ec1543d0 0x7f63ec0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44742/0 (socket says 172.21.15.27:44742) 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f09b1700 1 -- 172.21.15.27:0/2511069082 learned_addr learned my addr 172.21.15.27:0/2511069082 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63ebfff700 1 --2- 172.21.15.27:0/2511069082 >> v2:172.21.15.40:3300/0 conn(0x7f63ec0c60f0 0x7f63ec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.957+0000 7f63f11b2700 1 --2- 172.21.15.27:0/2511069082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f09b1700 1 -- 172.21.15.27:0/2511069082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 msgr2=0x7f63ec1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f09b1700 1 --2- 172.21.15.27:0/2511069082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f09b1700 1 -- 172.21.15.27:0/2511069082 >> v2:172.21.15.40:3300/0 conn(0x7f63ec0c60f0 msgr2=0x7f63ec068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f09b1700 1 --2- 172.21.15.27:0/2511069082 >> v2:172.21.15.40:3300/0 conn(0x7f63ec0c60f0 0x7f63ec068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f09b1700 1 -- 172.21.15.27:0/2511069082 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec157e60 con 0x7f63ec1543d0 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63ebfff700 1 --2- 172.21.15.27:0/2511069082 >> v2:172.21.15.40:3300/0 conn(0x7f63ec0c60f0 0x7f63ec068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f09b1700 1 --2- 172.21.15.27:0/2511069082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec0c5c00 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f63ec0c5620 tx=0x7f63e40090f0).ready entity=mon.0 client_cookie=aad2cc7c3f954c41 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63eb7fe700 1 -- 172.21.15.27:0/2511069082 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400b600 con 0x7f63ec1543d0 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63eb7fe700 1 -- 172.21.15.27:0/2511069082 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400b760 con 0x7f63ec1543d0 2023-05-17T15:27:23.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63eb7fe700 1 -- 172.21.15.27:0/2511069082 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400bae0 con 0x7f63ec1543d0 2023-05-17T15:27:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 -- 172.21.15.27:0/2511069082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 msgr2=0x7f63ec0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 --2- 172.21.15.27:0/2511069082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec0c5c00 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f63ec0c5620 tx=0x7f63e40090f0).stop 2023-05-17T15:27:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 -- 172.21.15.27:0/2511069082 shutdown_connections 2023-05-17T15:27:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 --2- 172.21.15.27:0/2511069082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec0c5c00 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 --2- 172.21.15.27:0/2511069082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 --2- 172.21.15.27:0/2511069082 >> v2:172.21.15.40:3300/0 conn(0x7f63ec0c60f0 0x7f63ec068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 -- 172.21.15.27:0/2511069082 >> 172.21.15.27:0/2511069082 conn(0x7f63ec0cb7f0 msgr2=0x7f63ec0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 -- 172.21.15.27:0/2511069082 shutdown_connections 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.958+0000 7f63f2c15700 1 -- 172.21.15.27:0/2511069082 wait complete. 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.960+0000 7f63f2c15700 1 Processor -- start 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.960+0000 7f63f2c15700 1 -- start start 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.960+0000 7f63f2c15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.960+0000 7f63f2c15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0c60f0 0x7f63ec0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.960+0000 7f63f2c15700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f2c15700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0ae230 con 0x7f63ec1543d0 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f2c15700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c3020 con 0x7f63ec0c60f0 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f2c15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c3300 con 0x7f63ec0691f0 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f11b2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f09b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0c60f0 0x7f63ec0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f11b2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44752/0 (socket says 172.21.15.27:44752) 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f11b2700 1 -- 172.21.15.27:0/3203573900 learned_addr learned my addr 172.21.15.27:0/3203573900 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 -- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 msgr2=0x7f63ec0b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec0b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 -- 172.21.15.27:0/3203573900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 msgr2=0x7f63ec144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 -- 172.21.15.27:0/3203573900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009370 con 0x7f63ec0c60f0 2023-05-17T15:27:23.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f11b2700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f09b1700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec0b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63ebfff700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0c60f0 0x7f63ec0c27d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f63dc00a380 tx=0x7f63dc007850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc016470 con 0x7f63ec0c60f0 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc0165d0 con 0x7f63ec0c60f0 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec0ade50 con 0x7f63ec0c60f0 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc016950 con 0x7f63ec0c60f0 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.961+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec144d50 con 0x7f63ec0c60f0 2023-05-17T15:27:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.962+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0c3520 con 0x7f63ec0c60f0 2023-05-17T15:27:23.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.963+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 67) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f63dc01d060 con 0x7f63ec0c60f0 2023-05-17T15:27:23.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.963+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f63dc07a870 con 0x7f63ec0c60f0 2023-05-17T15:27:23.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:23.968+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63dc04bb70 con 0x7f63ec0c60f0 2023-05-17T15:27:24.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.144+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63ec06bdf0 con 0x7f63ec0c60f0 2023-05-17T15:27:24.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.144+0000 7f63e8ff9700 1 -- 172.21.15.27:0/3203573900 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63dc01b070 con 0x7f63ec0c60f0 2023-05-17T15:27:24.148 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:27:24.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0c60f0 msgr2=0x7f63ec0c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0c60f0 0x7f63ec0c27d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f63dc00a380 tx=0x7f63dc007850).stop 2023-05-17T15:27:24.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 shutdown_connections 2023-05-17T15:27:24.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63ec1543d0 0x7f63ec144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec0691f0 0x7f63ec0b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 --2- 172.21.15.27:0/3203573900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0c60f0 0x7f63ec0c27d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 >> 172.21.15.27:0/3203573900 conn(0x7f63ec0cb7f0 msgr2=0x7f63ec157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:24.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 shutdown_connections 2023-05-17T15:27:24.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.146+0000 7f63f2c15700 1 -- 172.21.15.27:0/3203573900 wait complete. 2023-05-17T15:27:24.162 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:27:24.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.276+0000 7fc3a0a06700 1 Processor -- start 2023-05-17T15:27:24.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.277+0000 7fc3a0a06700 1 -- start start 2023-05-17T15:27:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.277+0000 7fc3a0a06700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc39c1543d0 0x7fc39c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.277+0000 7fc3a0a06700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c158790 con 0x7fc39c069410 2023-05-17T15:27:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.277+0000 7fc3a0a06700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c0c6570 con 0x7fc39c0c60f0 2023-05-17T15:27:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.277+0000 7fc3a0a06700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c0c1c50 con 0x7fc39c1543d0 2023-05-17T15:27:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc39c1543d0 0x7fc39c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc39c1543d0 0x7fc39c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44754/0 (socket says 172.21.15.27:44754) 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 -- 172.21.15.27:0/3574928911 learned_addr learned my addr 172.21.15.27:0/3574928911 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 -- 172.21.15.27:0/3574928911 >> v1:172.21.15.40:6789/0 conn(0x7fc39c0c60f0 legacy=0x7fc39c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 -- 172.21.15.27:0/3574928911 >> v1:172.21.15.27:6789/0 conn(0x7fc39c069410 legacy=0x7fc39c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 -- 172.21.15.27:0/3574928911 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c157e60 con 0x7fc39c1543d0 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39a59c700 1 --2- 172.21.15.27:0/3574928911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c0c5c00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fc394006fd0 tx=0x7fc3940090f0).ready entity=mon.0 client_cookie=f64b6646472572a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39959a700 1 -- 172.21.15.27:0/3574928911 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400b600 con 0x7fc39c1543d0 2023-05-17T15:27:24.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39959a700 1 -- 172.21.15.27:0/3574928911 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39400b760 con 0x7fc39c1543d0 2023-05-17T15:27:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.278+0000 7fc39959a700 1 -- 172.21.15.27:0/3574928911 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400bae0 con 0x7fc39c1543d0 2023-05-17T15:27:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 -- 172.21.15.27:0/3574928911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 msgr2=0x7fc39c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 --2- 172.21.15.27:0/3574928911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c0c5c00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fc394006fd0 tx=0x7fc3940090f0).stop 2023-05-17T15:27:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 -- 172.21.15.27:0/3574928911 shutdown_connections 2023-05-17T15:27:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 --2- 172.21.15.27:0/3574928911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c0c5c00 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 -- 172.21.15.27:0/3574928911 >> 172.21.15.27:0/3574928911 conn(0x7fc39c0cb7f0 msgr2=0x7fc39c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 -- 172.21.15.27:0/3574928911 shutdown_connections 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.279+0000 7fc3a0a06700 1 -- 172.21.15.27:0/3574928911 wait complete. 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.280+0000 7fc3a0a06700 1 Processor -- start 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.280+0000 7fc3a0a06700 1 -- start start 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc39c069410 0x7fc39c0c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc39c0c60f0 0x7fc39c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0b0730 con 0x7fc39c1543d0 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0b0a10 con 0x7fc39c069410 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0b0cf0 con 0x7fc39c0c60f0 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc39c069410 0x7fc39c0c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c164560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44764/0 (socket says 172.21.15.27:44764) 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 -- 172.21.15.27:0/2334019085 learned_addr learned my addr 172.21.15.27:0/2334019085 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc399d9b700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc39c0c60f0 0x7fc39c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 -- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc39c0c60f0 msgr2=0x7fc39c0c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc39c0c60f0 0x7fc39c0c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 -- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc39c069410 msgr2=0x7fc39c0c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc39c069410 0x7fc39c0c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 -- 172.21.15.27:0/2334019085 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009370 con 0x7fc39c1543d0 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc39ad9d700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c164560 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fc38c002230 tx=0x7fc38c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00e4a0 con 0x7fc39c1543d0 2023-05-17T15:27:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c00e600 con 0x7fc39c1543d0 2023-05-17T15:27:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c151380 con 0x7fc39c1543d0 2023-05-17T15:27:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.281+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00e980 con 0x7fc39c1543d0 2023-05-17T15:27:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.282+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c0b03b0 con 0x7fc39c1543d0 2023-05-17T15:27:24.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.282+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c1518a0 con 0x7fc39c1543d0 2023-05-17T15:27:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.283+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 67) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fc38c019030 con 0x7fc39c1543d0 2023-05-17T15:27:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.283+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fc38c0791f0 con 0x7fc39c1543d0 2023-05-17T15:27:24.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.287+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc38c0488f0 con 0x7fc39c1543d0 2023-05-17T15:27:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.459+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc39c06bdf0 con 0x7fc39c1543d0 2023-05-17T15:27:24.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.459+0000 7fc3927fc700 1 -- 172.21.15.27:0/2334019085 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc39c1518a0 con 0x7fc39c1543d0 2023-05-17T15:27:24.464 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:27:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 msgr2=0x7fc39c164560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c164560 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fc38c002230 tx=0x7fc38c0015e0).stop 2023-05-17T15:27:24.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 shutdown_connections 2023-05-17T15:27:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc39c1543d0 0x7fc39c164560 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc39c069410 0x7fc39c0c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 --2- 172.21.15.27:0/2334019085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc39c0c60f0 0x7fc39c0c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 >> 172.21.15.27:0/2334019085 conn(0x7fc39c0cb7f0 msgr2=0x7fc39c0c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 shutdown_connections 2023-05-17T15:27:24.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.461+0000 7fc3a0a06700 1 -- 172.21.15.27:0/2334019085 wait complete. 2023-05-17T15:27:24.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:27:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.591+0000 7f4532d34700 1 Processor -- start 2023-05-17T15:27:24.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.591+0000 7f4532d34700 1 -- start start 2023-05-17T15:27:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.592+0000 7f4532d34700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f452c1543d0 0x7f452c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.592+0000 7f4532d34700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.592+0000 7f4532d34700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c0c0c90 con 0x7f452c0691f0 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.592+0000 7f4532d34700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452c0c1c50 con 0x7f452c1543d0 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.592+0000 7f4532d34700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c158790 con 0x7f452c0c60f0 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f4530ad0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f452c1543d0 0x7f452c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f4530ad0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f452c1543d0 0x7f452c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:34464/0 (socket says 172.21.15.27:34464) 2023-05-17T15:27:24.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f4530ad0700 1 -- 172.21.15.27:0/1184228362 learned_addr learned my addr 172.21.15.27:0/1184228362 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:24.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452bfff700 1 -- 172.21.15.27:0/1184228362 >> v2:172.21.15.40:3300/0 conn(0x7f452c1543d0 msgr2=0x7f452c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:24.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452bfff700 1 --2- 172.21.15.27:0/1184228362 >> v2:172.21.15.40:3300/0 conn(0x7f452c1543d0 0x7f452c0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452bfff700 1 -- 172.21.15.27:0/1184228362 >> v1:172.21.15.40:6789/0 conn(0x7f452c0691f0 legacy=0x7f452c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452bfff700 1 -- 172.21.15.27:0/1184228362 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0c6570 con 0x7f452c0c60f0 2023-05-17T15:27:24.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452bfff700 1 --2- 172.21.15.27:0/1184228362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c068d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4520009760 tx=0x7f4520009060).ready entity=mon.2 client_cookie=193519cf758efffd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452b7fe700 1 -- 172.21.15.27:0/1184228362 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000f510 con 0x7f452c0c60f0 2023-05-17T15:27:24.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452b7fe700 1 -- 172.21.15.27:0/1184228362 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452000f670 con 0x7f452c0c60f0 2023-05-17T15:27:24.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.593+0000 7f452b7fe700 1 -- 172.21.15.27:0/1184228362 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000f9f0 con 0x7f452c0c60f0 2023-05-17T15:27:24.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 -- 172.21.15.27:0/1184228362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 msgr2=0x7f452c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 --2- 172.21.15.27:0/1184228362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c068d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4520009760 tx=0x7f4520009060).stop 2023-05-17T15:27:24.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 -- 172.21.15.27:0/1184228362 shutdown_connections 2023-05-17T15:27:24.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 --2- 172.21.15.27:0/1184228362 >> v2:172.21.15.40:3300/0 conn(0x7f452c1543d0 0x7f452c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 --2- 172.21.15.27:0/1184228362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c068d00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 -- 172.21.15.27:0/1184228362 >> 172.21.15.27:0/1184228362 conn(0x7f452c0cb7f0 msgr2=0x7f452c0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:24.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 -- 172.21.15.27:0/1184228362 shutdown_connections 2023-05-17T15:27:24.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.594+0000 7f4532d34700 1 -- 172.21.15.27:0/1184228362 wait complete. 2023-05-17T15:27:24.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.595+0000 7f4532d34700 1 Processor -- start 2023-05-17T15:27:24.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.595+0000 7f4532d34700 1 -- start start 2023-05-17T15:27:24.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4532d34700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f452c0691f0 0x7f452c0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4532d34700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4532d34700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 0x7f452c0c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4532d34700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0c22b0 con 0x7f452c1543d0 2023-05-17T15:27:24.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4532d34700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0c3170 con 0x7f452c0691f0 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4532d34700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0c2560 con 0x7f452c0c60f0 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 0x7f452c0c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 0x7f452c0c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44776/0 (socket says 172.21.15.27:44776) 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 -- 172.21.15.27:0/3768169112 learned_addr learned my addr 172.21.15.27:0/3768169112 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f4530ad0700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f452c0691f0 0x7f452c0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f452bfff700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 -- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 msgr2=0x7f452c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 -- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f452c0691f0 msgr2=0x7f452c0ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f452c0691f0 0x7f452c0ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.596+0000 7f45312d1700 1 -- 172.21.15.27:0/3768169112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45200092a0 con 0x7f452c1543d0 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.597+0000 7f45312d1700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 0x7f452c0c1dc0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f451c00c440 tx=0x7f451c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.597+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0123f0 con 0x7f452c1543d0 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.597+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c001e90 con 0x7f452c1543d0 2023-05-17T15:27:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.597+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c0c2840 con 0x7f452c1543d0 2023-05-17T15:27:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.597+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c012760 con 0x7f452c1543d0 2023-05-17T15:27:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.597+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c0c2e00 con 0x7f452c1543d0 2023-05-17T15:27:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.598+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c06bdf0 con 0x7f452c1543d0 2023-05-17T15:27:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.598+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 67) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f451c010070 con 0x7f452c1543d0 2023-05-17T15:27:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.598+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f451c078f40 con 0x7f452c1543d0 2023-05-17T15:27:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.602+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f451c0478f0 con 0x7f452c1543d0 2023-05-17T15:27:24.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.727+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 68) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f451c076ba0 con 0x7f452c1543d0 2023-05-17T15:27:24.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.727+0000 7f4528ff9700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45180301b0 0x7f4518067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.729+0000 7f4530ad0700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45180301b0 0x7f4518067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.730+0000 7f4530ad0700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45180301b0 0x7f4518067b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f4524009fd0 tx=0x7f452400b040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.781+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f452c157e60 con 0x7f452c1543d0 2023-05-17T15:27:24.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.782+0000 7f4528ff9700 1 -- 172.21.15.27:0/3768169112 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7f451c070700 con 0x7f452c1543d0 2023-05-17T15:27:24.786 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:27:24.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45180301b0 msgr2=0x7f4518067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45180301b0 0x7f4518067b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f4524009fd0 tx=0x7f452400b040).stop 2023-05-17T15:27:24.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 msgr2=0x7f452c0c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 0x7f452c0c1dc0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f451c00c440 tx=0x7f451c007d70).stop 2023-05-17T15:27:24.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 shutdown_connections 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45180301b0 0x7f4518067b70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f452c1543d0 0x7f452c0c1dc0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f452c0691f0 0x7f452c0ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 --2- 172.21.15.27:0/3768169112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f452c0c60f0 0x7f452c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 >> 172.21.15.27:0/3768169112 conn(0x7f452c0cb7f0 msgr2=0x7f452c0bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 shutdown_connections 2023-05-17T15:27:24.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.784+0000 7f4532d34700 1 -- 172.21.15.27:0/3768169112 wait complete. 2023-05-17T15:27:24.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:24.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.912+0000 7f73717a1700 1 Processor -- start 2023-05-17T15:27:24.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.912+0000 7f73717a1700 1 -- start start 2023-05-17T15:27:24.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.913+0000 7f73717a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f736c14f850 0x7f736c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.913+0000 7f73717a1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c152b60 con 0x7f736c0bd260 2023-05-17T15:27:24.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.913+0000 7f73717a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c0c5260 con 0x7f736c14fc30 2023-05-17T15:27:24.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.913+0000 7f73717a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0a6e70 con 0x7f736c14f850 2023-05-17T15:27:24.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.913+0000 7f736b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f736c0bd260 0x7f736c0c22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44366/0 (socket says 172.21.15.27:44366) 2023-05-17T15:27:24.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.913+0000 7f736b7fe700 1 -- 172.21.15.27:0/2930024663 learned_addr learned my addr 172.21.15.27:0/2930024663 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:24.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 --2- 172.21.15.27:0/2930024663 >> v2:172.21.15.40:3300/0 conn(0x7f736c14f850 0x7f736c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179575622 0 0) 0x7f736c152b60 con 0x7f736c0bd260 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73580033f0 con 0x7f736c0bd260 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2216522233 0 0) 0x7f73580033f0 con 0x7f736c0bd260 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 >> v2:172.21.15.40:3300/0 conn(0x7f736c14f850 msgr2=0x7f736c152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 --2- 172.21.15.27:0/2930024663 >> v2:172.21.15.40:3300/0 conn(0x7f736c14f850 0x7f736c152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 >> v1:172.21.15.40:6789/0 conn(0x7f736c14fc30 legacy=0x7f736c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0a7150 con 0x7f736c0bd260 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f735c0017f0 con 0x7f736c0bd260 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 >> v1:172.21.15.27:6789/0 conn(0x7f736c0bd260 legacy=0x7f736c0c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73580038e0 0x7f7358003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7358004690 0x7f7358004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7358005000 0x7f735800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0a6e70 con 0x7f73580038e0 2023-05-17T15:27:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735800beb0 con 0x7f7358005000 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735800c070 con 0x7f7358004690 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73580038e0 0x7f7358003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736b7fe700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7358005000 0x7f735800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736a7fc700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7358004690 0x7f7358004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 -- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7358004690 msgr2=0x7f7358004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7358004690 0x7f7358004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 -- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7358005000 msgr2=0x7f735800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:24.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7358005000 0x7f735800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736affd700 1 -- 172.21.15.27:0/2930024663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580033f0 con 0x7f73580038e0 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736b7fe700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7358005000 0x7f735800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.914+0000 7f736b7fe700 1 -- 172.21.15.27:0/2930024663 reap_dead start 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f736affd700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73580038e0 0x7f7358003d00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f7364009a60 tx=0x7f7364009060).ready entity=mon.0 client_cookie=1090c54eded10a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364009ea0 con 0x7f73580038e0 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364009430 con 0x7f73580038e0 2023-05-17T15:27:24.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f7369ffb700 1 -- 172.21.15.27:0/2930024663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400e870 con 0x7f73580038e0 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 -- 172.21.15.27:0/2930024663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73580038e0 msgr2=0x7f7358003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73580038e0 0x7f7358003d00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f7364009a60 tx=0x7f7364009060).stop 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 -- 172.21.15.27:0/2930024663 shutdown_connections 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 --2- 172.21.15.27:0/2930024663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73580038e0 0x7f7358003d00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 -- 172.21.15.27:0/2930024663 >> 172.21.15.27:0/2930024663 conn(0x7f736c0c8400 msgr2=0x7f736c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 -- 172.21.15.27:0/2930024663 shutdown_connections 2023-05-17T15:27:24.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.915+0000 7f73717a1700 1 -- 172.21.15.27:0/2930024663 wait complete. 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.916+0000 7f73717a1700 1 Processor -- start 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 -- start start 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73580038e0 0x7f736c064f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 0x7f736c0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f736c1511d0 0x7f736c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0a60f0 con 0x7f736c0a4e00 2023-05-17T15:27:24.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0a5280 con 0x7f736c1511d0 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f73717a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c151b40 con 0x7f73580038e0 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f736a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 0x7f736c0c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f736a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 0x7f736c0c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44814/0 (socket says 172.21.15.27:44814) 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.917+0000 7f736a7fc700 1 -- 172.21.15.27:0/2275105786 learned_addr learned my addr 172.21.15.27:0/2275105786 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736affd700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73580038e0 0x7f736c064f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736b7fe700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f736c1511d0 0x7f736c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736a7fc700 1 -- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73580038e0 msgr2=0x7f736c064f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736a7fc700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73580038e0 0x7f736c064f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736a7fc700 1 -- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f736c1511d0 msgr2=0x7f736c151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736a7fc700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f736c1511d0 0x7f736c151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736a7fc700 1 -- 172.21.15.27:0/2275105786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0a54e0 con 0x7f736c0a4e00 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736b7fe700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f736c1511d0 0x7f736c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f736a7fc700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 0x7f736c0c0370 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f735400e570 tx=0x7f7354009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354010450 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73540105b0 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0a57c0 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354010930 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.918+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c0a5d80 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.919+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c06bdf0 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.919+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 68) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f7354010ce0 con 0x7f736c0a4e00 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.919+0000 7f7362ffd700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f734c05ecf0 0x7f734c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.920+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f7354079a60 con 0x7f736c0a4e00 2023-05-17T15:27:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.920+0000 7f736affd700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f734c05ecf0 0x7f734c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.920+0000 7f736affd700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f734c05ecf0 0x7f734c0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7364006d50 tx=0x7f736401a000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:24.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:24.924+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73540498f0 con 0x7f736c0a4e00 2023-05-17T15:27:25.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.141+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f736c152510 con 0x7f736c0a4e00 2023-05-17T15:27:25.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.142+0000 7f7362ffd700 1 -- 172.21.15.27:0/2275105786 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f735404ad60 con 0x7f736c0a4e00 2023-05-17T15:27:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:25.146 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:57.199573+0000","modified":"2023-05-17T15:11:00.212835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/4188362565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4188362565},{"type":"v1","addr":"172.21.15.40:6835","nonce":4188362565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-17T15:27:25.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f734c05ecf0 msgr2=0x7f734c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f734c05ecf0 0x7f734c0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7364006d50 tx=0x7f736401a000).stop 2023-05-17T15:27:25.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 msgr2=0x7f736c0c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 0x7f736c0c0370 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f735400e570 tx=0x7f7354009040).stop 2023-05-17T15:27:25.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 shutdown_connections 2023-05-17T15:27:25.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f734c05ecf0 0x7f734c0611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f736c1511d0 0x7f736c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73580038e0 0x7f736c064f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 --2- 172.21.15.27:0/2275105786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f736c0a4e00 0x7f736c0c0370 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 >> 172.21.15.27:0/2275105786 conn(0x7f736c0c8400 msgr2=0x7f736c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:25.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 shutdown_connections 2023-05-17T15:27:25.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.143+0000 7f73717a1700 1 -- 172.21.15.27:0/2275105786 wait complete. 2023-05-17T15:27:25.149 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 60 2023-05-17T15:27:25.159 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:25.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.272+0000 7fc9480e0700 1 Processor -- start 2023-05-17T15:27:25.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.272+0000 7fc9480e0700 1 -- start start 2023-05-17T15:27:25.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc9480e0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc94014e2a0 0x7fc9400bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc9480e0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc940154d60 con 0x7fc94014dec0 2023-05-17T15:27:25.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc9480e0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9400c2f80 con 0x7fc9400c3b40 2023-05-17T15:27:25.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc9480e0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc940154150 con 0x7fc94014e2a0 2023-05-17T15:27:25.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc94567b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc94014e2a0 0x7fc9400bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc945e7c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc94014dec0 0x7fc9400bc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44382/0 (socket says 172.21.15.27:44382) 2023-05-17T15:27:25.277 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc945e7c700 1 -- 172.21.15.27:0/109107166 learned_addr learned my addr 172.21.15.27:0/109107166 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:25.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc94567b700 1 -- 172.21.15.27:0/109107166 >> v1:172.21.15.40:6789/0 conn(0x7fc9400c3b40 legacy=0x7fc940065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:25.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc94567b700 1 -- 172.21.15.27:0/109107166 >> v1:172.21.15.27:6789/0 conn(0x7fc94014dec0 legacy=0x7fc9400bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc944e7a700 1 -- 172.21.15.27:0/109107166 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403482922 0 0) 0x7fc940154d60 con 0x7fc94014dec0 2023-05-17T15:27:25.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc94567b700 1 -- 172.21.15.27:0/109107166 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940154430 con 0x7fc94014e2a0 2023-05-17T15:27:25.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc94567b700 1 --2- 172.21.15.27:0/109107166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc94014e2a0 0x7fc9400bcfa0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fc934009760 tx=0x7fc934009060).ready entity=mon.0 client_cookie=71990681a491e2b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc944e7a700 1 -- 172.21.15.27:0/109107166 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93400b520 con 0x7fc94014e2a0 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.273+0000 7fc944e7a700 1 -- 172.21.15.27:0/109107166 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93400b680 con 0x7fc94014e2a0 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc944e7a700 1 -- 172.21.15.27:0/109107166 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93400ba00 con 0x7fc94014e2a0 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 -- 172.21.15.27:0/109107166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc94014e2a0 msgr2=0x7fc9400bcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 --2- 172.21.15.27:0/109107166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc94014e2a0 0x7fc9400bcfa0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fc934009760 tx=0x7fc934009060).stop 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 -- 172.21.15.27:0/109107166 shutdown_connections 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 --2- 172.21.15.27:0/109107166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc94014e2a0 0x7fc9400bcfa0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 -- 172.21.15.27:0/109107166 >> 172.21.15.27:0/109107166 conn(0x7fc94005dd50 msgr2=0x7fc94005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:25.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 -- 172.21.15.27:0/109107166 shutdown_connections 2023-05-17T15:27:25.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.274+0000 7fc9480e0700 1 -- 172.21.15.27:0/109107166 wait complete. 2023-05-17T15:27:25.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.275+0000 7fc9480e0700 1 Processor -- start 2023-05-17T15:27:25.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.275+0000 7fc9480e0700 1 -- start start 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc9480e0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 0x7fc94014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc9480e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc94014dec0 0x7fc940164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc9480e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc94014e2a0 0x7fc9400c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc9480e0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401653e0 con 0x7fc9400c3b40 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc9480e0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9400c6030 con 0x7fc94014e2a0 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc9480e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9400c6310 con 0x7fc94014dec0 2023-05-17T15:27:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 0x7fc94014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 0x7fc94014f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44826/0 (socket says 172.21.15.27:44826) 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 -- 172.21.15.27:0/1638881681 learned_addr learned my addr 172.21.15.27:0/1638881681 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 -- 172.21.15.27:0/1638881681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc94014dec0 msgr2=0x7fc940164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc94014dec0 0x7fc940164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 -- 172.21.15.27:0/1638881681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc94014e2a0 msgr2=0x7fc9400c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc94014e2a0 0x7fc9400c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:25.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 -- 172.21.15.27:0/1638881681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340092a0 con 0x7fc9400c3b40 2023-05-17T15:27:25.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc945e7c700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 0x7fc94014f740 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fc93000c840 tx=0x7fc930007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.276+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930005c00 con 0x7fc9400c3b40 2023-05-17T15:27:25.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.277+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc930005d60 con 0x7fc9400c3b40 2023-05-17T15:27:25.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.277+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9400c65f0 con 0x7fc9400c3b40 2023-05-17T15:27:25.285 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.277+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930007340 con 0x7fc9400c3b40 2023-05-17T15:27:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.277+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9400c6bb0 con 0x7fc9400c3b40 2023-05-17T15:27:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.278+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94006bdf0 con 0x7fc9400c3b40 2023-05-17T15:27:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.278+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 68) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fc930010030 con 0x7fc9400c3b40 2023-05-17T15:27:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.278+0000 7fc93dffb700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc92c05ecf0 0x7fc92c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.278+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fc930079d00 con 0x7fc9400c3b40 2023-05-17T15:27:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.278+0000 7fc94567b700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc92c05ecf0 0x7fc92c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.279+0000 7fc94567b700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc92c05ecf0 0x7fc92c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc94014e700 tx=0x7fc934017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.283+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc93007d030 con 0x7fc9400c3b40 2023-05-17T15:27:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.457+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc940154710 con 0x7fc9400c3b40 2023-05-17T15:27:25.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.458+0000 7fc93dffb700 1 -- 172.21.15.27:0/1638881681 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18195 (secure 0 0 0) 0x7fc93004b000 con 0x7fc9400c3b40 2023-05-17T15:27:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:25.463 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":146,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:23.690005+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:55.754589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:56.180897+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.18","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3331365095":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/3994155458":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/3428450138":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/514334383":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/107792440":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/1777268805":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/1807212823":"2023-05-18T15:22:20.993602+0000","172.21.15.27:6836/122387":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/603047944":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/365514908":"2023-05-18T15:11:14.209618+0000","172.21.15.27:0/3558111842":"2023-05-18T15:11:14.209618+0000","172.21.15.27:6837/86332":"2023-05-18T15:11:14.209618+0000","172.21.15.27:6837/122387":"2023-05-18T15:27:23.689971+0000","172.21.15.27:6836/86332":"2023-05-18T15:11:14.209618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc92c05ecf0 msgr2=0x7fc92c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc92c05ecf0 0x7fc92c0611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc94014e700 tx=0x7fc934017000).stop 2023-05-17T15:27:25.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 msgr2=0x7fc94014f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 0x7fc94014f740 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fc93000c840 tx=0x7fc930007e80).stop 2023-05-17T15:27:25.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 shutdown_connections 2023-05-17T15:27:25.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc92c05ecf0 0x7fc92c0611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc94014e2a0 0x7fc9400c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:25.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9400c3b40 0x7fc94014f740 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 --2- 172.21.15.27:0/1638881681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc94014dec0 0x7fc940164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:25.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 >> 172.21.15.27:0/1638881681 conn(0x7fc94005dd50 msgr2=0x7fc9400bc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:25.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 shutdown_connections 2023-05-17T15:27:25.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.460+0000 7fc9480e0700 1 -- 172.21.15.27:0/1638881681 wait complete. 2023-05-17T15:27:25.476 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:27:25.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:25.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.588+0000 7fd6d759e700 1 Processor -- start 2023-05-17T15:27:25.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.588+0000 7fd6d759e700 1 -- start start 2023-05-17T15:27:25.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d80c1560 0x7fd6d80c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d759e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d81549b0 con 0x7fd6d81544f0 2023-05-17T15:27:25.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d8154c90 con 0x7fd6d80c1180 2023-05-17T15:27:25.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8154f70 con 0x7fd6d80c1560 2023-05-17T15:27:25.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d5d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd6d81544f0 0x7fd6d80a9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44398/0 (socket says 172.21.15.27:44398) 2023-05-17T15:27:25.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d5d9b700 1 -- 172.21.15.27:0/4023033390 learned_addr learned my addr 172.21.15.27:0/4023033390 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d6d9d700 1 --2- 172.21.15.27:0/4023033390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d80c1560 0x7fd6d80c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d559a700 1 -- 172.21.15.27:0/4023033390 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243036144 0 0) 0x7fd6d81549b0 con 0x7fd6d81544f0 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.589+0000 7fd6d559a700 1 -- 172.21.15.27:0/4023033390 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c40033f0 con 0x7fd6d81544f0 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d559a700 1 -- 172.21.15.27:0/4023033390 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189232223 0 0) 0x7fd6d8154c90 con 0x7fd6d80c1180 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d6d9d700 1 -- 172.21.15.27:0/4023033390 >> v1:172.21.15.40:6789/0 conn(0x7fd6d80c1180 legacy=0x7fd6d80c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d6d9d700 1 -- 172.21.15.27:0/4023033390 >> v1:172.21.15.27:6789/0 conn(0x7fd6d81544f0 legacy=0x7fd6d80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d6d9d700 1 -- 172.21.15.27:0/4023033390 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8155250 con 0x7fd6d80c1560 2023-05-17T15:27:25.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d6d9d700 1 --2- 172.21.15.27:0/4023033390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d80c1560 0x7fd6d80c74a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fd6c8009e90 tx=0x7fd6c8009780).ready entity=mon.2 client_cookie=dab357297d74df51 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d559a700 1 -- 172.21.15.27:0/4023033390 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800e070 con 0x7fd6d80c1560 2023-05-17T15:27:25.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d559a700 1 -- 172.21.15.27:0/4023033390 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800b850 con 0x7fd6d80c1560 2023-05-17T15:27:25.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d559a700 1 -- 172.21.15.27:0/4023033390 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00013f0 con 0x7fd6d80c1560 2023-05-17T15:27:25.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d759e700 1 -- 172.21.15.27:0/4023033390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d80c1560 msgr2=0x7fd6d80c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d759e700 1 --2- 172.21.15.27:0/4023033390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d80c1560 0x7fd6d80c74a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fd6c8009e90 tx=0x7fd6c8009780).stop 2023-05-17T15:27:25.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d759e700 1 -- 172.21.15.27:0/4023033390 shutdown_connections 2023-05-17T15:27:25.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d759e700 1 --2- 172.21.15.27:0/4023033390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d80c1560 0x7fd6d80c74a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.590+0000 7fd6d759e700 1 -- 172.21.15.27:0/4023033390 >> 172.21.15.27:0/4023033390 conn(0x7fd6d805dd50 msgr2=0x7fd6d805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:25.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.591+0000 7fd6d759e700 1 -- 172.21.15.27:0/4023033390 shutdown_connections 2023-05-17T15:27:25.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.591+0000 7fd6d759e700 1 -- 172.21.15.27:0/4023033390 wait complete. 2023-05-17T15:27:25.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 Processor -- start 2023-05-17T15:27:25.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 -- start start 2023-05-17T15:27:25.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d80c1180 0x7fd6d80cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 0x7fd6d814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d81544f0 0x7fd6d8167350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80af480 con 0x7fd6d80c1560 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80af760 con 0x7fd6d80c1180 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80afa40 con 0x7fd6d81544f0 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 0x7fd6d814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 0x7fd6d814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44842/0 (socket says 172.21.15.27:44842) 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.592+0000 7fd6d5d9b700 1 -- 172.21.15.27:0/3260410463 learned_addr learned my addr 172.21.15.27:0/3260410463 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d6d9d700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d81544f0 0x7fd6d8167350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d659c700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d80c1180 0x7fd6d80cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d5d9b700 1 -- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d81544f0 msgr2=0x7fd6d8167350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d5d9b700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d81544f0 0x7fd6d8167350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d5d9b700 1 -- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d80c1180 msgr2=0x7fd6d80cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d5d9b700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d80c1180 0x7fd6d80cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d5d9b700 1 -- 172.21.15.27:0/3260410463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009a20 con 0x7fd6d80c1560 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d5d9b700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 0x7fd6d814fa40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fd6c000c7f0 tx=0x7fd6c0001b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0007170 con 0x7fd6d80c1560 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c00072d0 con 0x7fd6d80c1560 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80afd20 con 0x7fd6d80c1560 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00048c0 con 0x7fd6d80c1560 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.593+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80cb740 con 0x7fd6d80c1560 2023-05-17T15:27:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.594+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80c34c0 con 0x7fd6d80c1560 2023-05-17T15:27:25.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.594+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 68) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fd6c0010070 con 0x7fd6d80c1560 2023-05-17T15:27:25.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.595+0000 7fd6ce7fc700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6b805ecf0 0x7fd6b80611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.595+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fd6c0079760 con 0x7fd6d80c1560 2023-05-17T15:27:25.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.595+0000 7fd6d659c700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6b805ecf0 0x7fd6b80611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.595+0000 7fd6d659c700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6b805ecf0 0x7fd6b80611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd6d00038c0 tx=0x7fd6d0007d40).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.599+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6d80c34c0 con 0x7fd6d80c1560 2023-05-17T15:27:25.820 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.816+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6d80c34c0 con 0x7fd6d80c1560 2023-05-17T15:27:25.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.817+0000 7fd6ce7fc700 1 -- 172.21.15.27:0/3260410463 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fd6d80c34c0 con 0x7fd6d80c1560 2023-05-17T15:27:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:25.821 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:57.199573+0000","modified":"2023-05-17T15:11:00.212835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/4188362565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4188362565},{"type":"v1","addr":"172.21.15.40:6835","nonce":4188362565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-17T15:27:25.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6b805ecf0 msgr2=0x7fd6b80611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6b805ecf0 0x7fd6b80611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd6d00038c0 tx=0x7fd6d0007d40).stop 2023-05-17T15:27:25.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 msgr2=0x7fd6d814fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 0x7fd6d814fa40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fd6c000c7f0 tx=0x7fd6c0001b70).stop 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 shutdown_connections 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6b805ecf0 0x7fd6b80611b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d81544f0 0x7fd6d8167350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d80c1180 0x7fd6d80cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 --2- 172.21.15.27:0/3260410463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6d80c1560 0x7fd6d814fa40 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 >> 172.21.15.27:0/3260410463 conn(0x7fd6d805dd50 msgr2=0x7fd6d80aaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:25.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 shutdown_connections 2023-05-17T15:27:25.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.819+0000 7fd6d759e700 1 -- 172.21.15.27:0/3260410463 wait complete. 2023-05-17T15:27:25.825 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 60 2023-05-17T15:27:25.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:25.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.949+0000 7fe1ace4b700 1 Processor -- start 2023-05-17T15:27:25.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.949+0000 7fe1ace4b700 1 -- start start 2023-05-17T15:27:25.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1ace4b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1a80c1180 0x7fe1a80c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1ace4b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe1a80c1560 0x7fe1a80c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1ace4b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a80c07e0 con 0x7fe1a81544f0 2023-05-17T15:27:25.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1ace4b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a81549b0 con 0x7fe1a80c1560 2023-05-17T15:27:25.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1ace4b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a8154c90 con 0x7fe1a80c1180 2023-05-17T15:27:25.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe1a80c1560 0x7fe1a80c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe1a80c1560 0x7fe1a80c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44852/0 (socket says 172.21.15.27:44852) 2023-05-17T15:27:25.957 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 -- 172.21.15.27:0/567049495 learned_addr learned my addr 172.21.15.27:0/567049495 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:25.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a77fe700 1 --2- 172.21.15.27:0/567049495 >> v2:172.21.15.40:3300/0 conn(0x7fe1a80c1180 0x7fe1a80c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 -- 172.21.15.27:0/567049495 >> v2:172.21.15.40:3300/0 conn(0x7fe1a80c1180 msgr2=0x7fe1a80c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:25.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 --2- 172.21.15.27:0/567049495 >> v2:172.21.15.40:3300/0 conn(0x7fe1a80c1180 0x7fe1a80c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 -- 172.21.15.27:0/567049495 >> v1:172.21.15.40:6789/0 conn(0x7fe1a81544f0 legacy=0x7fe1a80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 -- 172.21.15.27:0/567049495 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8154f70 con 0x7fe1a80c1560 2023-05-17T15:27:25.958 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.950+0000 7fe1a7fff700 1 --2- 172.21.15.27:0/567049495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a80c1560 0x7fe1a80c74a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fe1a8062c80 tx=0x7fe1a0009840).ready entity=mon.0 client_cookie=80da2526e013c057 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1a67fc700 1 -- 172.21.15.27:0/567049495 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000e070 con 0x7fe1a80c1560 2023-05-17T15:27:25.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1a67fc700 1 -- 172.21.15.27:0/567049495 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000ba50 con 0x7fe1a80c1560 2023-05-17T15:27:25.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1a67fc700 1 -- 172.21.15.27:0/567049495 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000bdd0 con 0x7fe1a80c1560 2023-05-17T15:27:25.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 -- 172.21.15.27:0/567049495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a80c1560 msgr2=0x7fe1a80c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/567049495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a80c1560 0x7fe1a80c74a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fe1a8062c80 tx=0x7fe1a0009840).stop 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 -- 172.21.15.27:0/567049495 shutdown_connections 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/567049495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a80c1560 0x7fe1a80c74a0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/567049495 >> v2:172.21.15.40:3300/0 conn(0x7fe1a80c1180 0x7fe1a80c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 -- 172.21.15.27:0/567049495 >> 172.21.15.27:0/567049495 conn(0x7fe1a805dd50 msgr2=0x7fe1a805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 -- 172.21.15.27:0/567049495 shutdown_connections 2023-05-17T15:27:25.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.951+0000 7fe1ace4b700 1 -- 172.21.15.27:0/567049495 wait complete. 2023-05-17T15:27:25.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.952+0000 7fe1ace4b700 1 Processor -- start 2023-05-17T15:27:25.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.952+0000 7fe1ace4b700 1 -- start start 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1ace4b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1a80c1180 0x7fe1a814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1ace4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1a80c1560 0x7fe1a80ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1ace4b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 0x7fe1a80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1ace4b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80cb7a0 con 0x7fe1a81544f0 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1ace4b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80cb1e0 con 0x7fe1a80c1180 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1ace4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80cb4c0 con 0x7fe1a80c1560 2023-05-17T15:27:25.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1a7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 0x7fe1a80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1a7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 0x7fe1a80cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44858/0 (socket says 172.21.15.27:44858) 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1a7fff700 1 -- 172.21.15.27:0/3370600109 learned_addr learned my addr 172.21.15.27:0/3370600109 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1a77fe700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1a80c1180 0x7fe1a814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.953+0000 7fe1a6ffd700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1a80c1560 0x7fe1a80ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1a7fff700 1 -- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1a80c1560 msgr2=0x7fe1a80ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1a7fff700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1a80c1560 0x7fe1a80ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1a7fff700 1 -- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1a80c1180 msgr2=0x7fe1a814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:25.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1a7fff700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1a80c1180 0x7fe1a814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:25.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1a7fff700 1 -- 172.21.15.27:0/3370600109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0009ae0 con 0x7fe1a81544f0 2023-05-17T15:27:25.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1a7fff700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 0x7fe1a80cac50 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fe1a0009fd0 tx=0x7fe1a0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00092e0 con 0x7fe1a81544f0 2023-05-17T15:27:25.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000bdd0 con 0x7fe1a81544f0 2023-05-17T15:27:25.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a80aecd0 con 0x7fe1a81544f0 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a001d690 con 0x7fe1a81544f0 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.954+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a815ae40 con 0x7fe1a81544f0 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.955+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a80af1f0 con 0x7fe1a81544f0 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.955+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe1a0024030 con 0x7fe1a81544f0 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.956+0000 7fe18f7fe700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe19405ee20 0x7fe1940612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.956+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fe1a007b3a0 con 0x7fe1a81544f0 2023-05-17T15:27:25.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.956+0000 7fe1a77fe700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe19405ee20 0x7fe1940612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:25.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.956+0000 7fe1a77fe700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe19405ee20 0x7fe1940612e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe19800bb10 tx=0x7fe198008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:25.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:25.960+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1a004c690 con 0x7fe1a81544f0 2023-05-17T15:27:26.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.173+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1a806bdf0 con 0x7fe1a81544f0 2023-05-17T15:27:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.174+0000 7fe18f7fe700 1 -- 172.21.15.27:0/3370600109 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fe1a0022070 con 0x7fe1a81544f0 2023-05-17T15:27:26.178 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:26.179 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":60,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:10:57.199573+0000","modified":"2023-05-17T15:11:00.212835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/4188362565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":4188362565},{"type":"v1","addr":"172.21.15.40:6835","nonce":4188362565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.175+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe19405ee20 msgr2=0x7fe1940612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.175+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe19405ee20 0x7fe1940612e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe19800bb10 tx=0x7fe198008040).stop 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.175+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 msgr2=0x7fe1a80cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.175+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 0x7fe1a80cac50 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fe1a0009fd0 tx=0x7fe1a0009840).stop 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 shutdown_connections 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe19405ee20 0x7fe1940612e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe1a81544f0 0x7fe1a80cac50 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1a80c1180 0x7fe1a814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 --2- 172.21.15.27:0/3370600109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1a80c1560 0x7fe1a80ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 >> 172.21.15.27:0/3370600109 conn(0x7fe1a805dd50 msgr2=0x7fe1a80acc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 shutdown_connections 2023-05-17T15:27:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.176+0000 7fe1ace4b700 1 -- 172.21.15.27:0/3370600109 wait complete. 2023-05-17T15:27:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 60 2023-05-17T15:27:26.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:26.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.303+0000 7f50b90fb700 1 Processor -- start 2023-05-17T15:27:26.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.303+0000 7f50b90fb700 1 -- start start 2023-05-17T15:27:26.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b90fb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50b414c1d0 0x7f50b40a6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b90fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b40a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b90fb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b4153160 con 0x7f50b40bd050 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b90fb700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b4152290 con 0x7f50b414c1d0 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b90fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4152550 con 0x7f50b414c5b0 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50b414c1d0 0x7f50b40a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b2d9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50b414c1d0 0x7f50b40a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44862/0 (socket says 172.21.15.27:44862) 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b2d9d700 1 -- 172.21.15.27:0/196032427 learned_addr learned my addr 172.21.15.27:0/196032427 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b259c700 1 --2- 172.21.15.27:0/196032427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b40a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b2d9d700 1 -- 172.21.15.27:0/196032427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 msgr2=0x7f50b40a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b2d9d700 1 --2- 172.21.15.27:0/196032427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b40a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.304+0000 7f50b2d9d700 1 -- 172.21.15.27:0/196032427 >> v1:172.21.15.40:6789/0 conn(0x7f50b40bd050 legacy=0x7f50b405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b2d9d700 1 -- 172.21.15.27:0/196032427 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4152830 con 0x7f50b414c1d0 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b2d9d700 1 --2- 172.21.15.27:0/196032427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b414c1d0 0x7f50b40a6900 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f50a8006fd0 tx=0x7f50a80090f0).ready entity=mon.0 client_cookie=a2893413b151bc0c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b1d9b700 1 -- 172.21.15.27:0/196032427 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800b600 con 0x7f50b414c1d0 2023-05-17T15:27:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b1d9b700 1 -- 172.21.15.27:0/196032427 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800b760 con 0x7f50b414c1d0 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b1d9b700 1 -- 172.21.15.27:0/196032427 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800bae0 con 0x7f50b414c1d0 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 -- 172.21.15.27:0/196032427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b414c1d0 msgr2=0x7f50b40a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 --2- 172.21.15.27:0/196032427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b414c1d0 0x7f50b40a6900 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f50a8006fd0 tx=0x7f50a80090f0).stop 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 -- 172.21.15.27:0/196032427 shutdown_connections 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 --2- 172.21.15.27:0/196032427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b414c1d0 0x7f50b40a6900 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 --2- 172.21.15.27:0/196032427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b40a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 -- 172.21.15.27:0/196032427 >> 172.21.15.27:0/196032427 conn(0x7f50b40c7920 msgr2=0x7f50b40c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 -- 172.21.15.27:0/196032427 shutdown_connections 2023-05-17T15:27:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.305+0000 7f50b90fb700 1 -- 172.21.15.27:0/196032427 wait complete. 2023-05-17T15:27:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.306+0000 7f50b90fb700 1 Processor -- start 2023-05-17T15:27:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 -- start start 2023-05-17T15:27:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 0x7f50b40a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b414c1d0 0x7f50b414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b41653b0 con 0x7f50b40bd050 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b414add0 con 0x7f50b414c1d0 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b90fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4164df0 con 0x7f50b414c5b0 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 0x7f50b40a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b2d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 0x7f50b40a6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44868/0 (socket says 172.21.15.27:44868) 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b2d9d700 1 -- 172.21.15.27:0/1830409381 learned_addr learned my addr 172.21.15.27:0/1830409381 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b259c700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b414c1d0 0x7f50b414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.307+0000 7f50b359e700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b2d9d700 1 -- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 msgr2=0x7f50b414ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b2d9d700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b414ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b2d9d700 1 -- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b414c1d0 msgr2=0x7f50b414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b2d9d700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b414c1d0 0x7f50b414c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b2d9d700 1 -- 172.21.15.27:0/1830409381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8009370 con 0x7f50b40bd050 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b359e700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:26.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b2d9d700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 0x7f50b40a6b30 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f50a8009f50 tx=0x7f50a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800b8d0 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800ba30 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b41650d0 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a801c670 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.308+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b41634e0 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.309+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b406bdf0 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.309+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f50a802c070 con 0x7f50b40bd050 2023-05-17T15:27:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.310+0000 7f509affd700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f50a005ee20 0x7f50a00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.310+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f50a807bb50 con 0x7f50b40bd050 2023-05-17T15:27:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.310+0000 7f50b259c700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f50a005ee20 0x7f50a00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.310+0000 7f50b259c700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f50a005ee20 0x7f50a00612e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f50b40a9cd0 tx=0x7f50a4008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.314+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50a804cd90 con 0x7f50b40bd050 2023-05-17T15:27:26.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.486+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50b4068e80 con 0x7f50b40bd050 2023-05-17T15:27:26.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.487+0000 7f509affd700 1 -- 172.21.15.27:0/1830409381 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18195 (secure 0 0 0) 0x7f50a802a020 con 0x7f50b40bd050 2023-05-17T15:27:26.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:26.492 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":146,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:23.690005+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:10:55.754589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-17T15:10:56.180897+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.18","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3331365095":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/3994155458":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/3428450138":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/514334383":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/107792440":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/1777268805":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/1807212823":"2023-05-18T15:22:20.993602+0000","172.21.15.27:6836/122387":"2023-05-18T15:27:23.689971+0000","172.21.15.27:0/603047944":"2023-05-18T15:22:20.993602+0000","172.21.15.27:0/365514908":"2023-05-18T15:11:14.209618+0000","172.21.15.27:0/3558111842":"2023-05-18T15:11:14.209618+0000","172.21.15.27:6837/86332":"2023-05-18T15:11:14.209618+0000","172.21.15.27:6837/122387":"2023-05-18T15:27:23.689971+0000","172.21.15.27:6836/86332":"2023-05-18T15:11:14.209618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f50a005ee20 msgr2=0x7f50a00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f50a005ee20 0x7f50a00612e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f50b40a9cd0 tx=0x7f50a4008040).stop 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 msgr2=0x7f50b40a6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 0x7f50b40a6b30 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f50a8009f50 tx=0x7f50a8017000).stop 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 shutdown_connections 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f50a005ee20 0x7f50a00612e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b414c5b0 0x7f50b414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b40bd050 0x7f50b40a6b30 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 --2- 172.21.15.27:0/1830409381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b414c1d0 0x7f50b414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 >> 172.21.15.27:0/1830409381 conn(0x7f50b40c7920 msgr2=0x7f50b40c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:26.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 shutdown_connections 2023-05-17T15:27:26.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.489+0000 7f50b90fb700 1 -- 172.21.15.27:0/1830409381 wait complete. 2023-05-17T15:27:26.505 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:27:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.618+0000 7f7bf7195700 1 Processor -- start 2023-05-17T15:27:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.618+0000 7f7bf7195700 1 -- start start 2023-05-17T15:27:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf7195700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bf0153ef0 0x7f7bf00cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf7195700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf0157980 0x7f7bf00c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf7195700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf0157de0 con 0x7f7bf00cac00 2023-05-17T15:27:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf7195700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf01588b0 con 0x7f7bf0153ef0 2023-05-17T15:27:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf7195700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00c60d0 con 0x7f7bf0157980 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf6193700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7bf00cac00 0x7f7bf01537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44438/0 (socket says 172.21.15.27:44438) 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf6193700 1 -- 172.21.15.27:0/1977555372 learned_addr learned my addr 172.21.15.27:0/1977555372 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf6994700 1 --2- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf0157980 0x7f7bf00c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5992700 1 --2- 172.21.15.27:0/1977555372 >> v2:172.21.15.40:3300/0 conn(0x7f7bf0153ef0 0x7f7bf00cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5191700 1 -- 172.21.15.27:0/1977555372 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311897012 0 0) 0x7f7bf0157de0 con 0x7f7bf00cac00 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5191700 1 -- 172.21.15.27:0/1977555372 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd80033f0 con 0x7f7bf00cac00 2023-05-17T15:27:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5992700 1 -- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf0157980 msgr2=0x7f7bf00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5992700 1 --2- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf0157980 0x7f7bf00c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5992700 1 -- 172.21.15.27:0/1977555372 >> v1:172.21.15.27:6789/0 conn(0x7f7bf00cac00 legacy=0x7f7bf01537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5992700 1 -- 172.21.15.27:0/1977555372 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0158010 con 0x7f7bf0153ef0 2023-05-17T15:27:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.619+0000 7f7bf5992700 1 --2- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0153ef0 0x7f7bf00cafe0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f7be4009e60 tx=0x7f7be4009780).ready entity=mon.1 client_cookie=148c664148e96a2a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:26.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf5191700 1 -- 172.21.15.27:0/1977555372 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be400e070 con 0x7f7bf0153ef0 2023-05-17T15:27:26.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf5191700 1 -- 172.21.15.27:0/1977555372 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be400bab0 con 0x7f7bf0153ef0 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf5191700 1 -- 172.21.15.27:0/1977555372 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be400be30 con 0x7f7bf0153ef0 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 -- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0153ef0 msgr2=0x7f7bf00cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 --2- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0153ef0 0x7f7bf00cafe0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f7be4009e60 tx=0x7f7be4009780).stop 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 -- 172.21.15.27:0/1977555372 shutdown_connections 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 --2- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf0157980 0x7f7bf00c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 --2- 172.21.15.27:0/1977555372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0153ef0 0x7f7bf00cafe0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 -- 172.21.15.27:0/1977555372 >> 172.21.15.27:0/1977555372 conn(0x7f7bf005dd50 msgr2=0x7f7bf005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 -- 172.21.15.27:0/1977555372 shutdown_connections 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.620+0000 7f7bf7195700 1 -- 172.21.15.27:0/1977555372 wait complete. 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.621+0000 7f7bf7195700 1 Processor -- start 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.621+0000 7f7bf7195700 1 -- start start 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf7195700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf00cac00 0x7f7bf0142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf7195700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 0x7f7bf01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf7195700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0157980 0x7f7bf0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf7195700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf01572a0 con 0x7f7bf0153ef0 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf7195700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0164ce0 con 0x7f7bf0157980 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf7195700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf014da70 con 0x7f7bf00cac00 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 0x7f7bf01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 0x7f7bf01568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44882/0 (socket says 172.21.15.27:44882) 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 -- 172.21.15.27:0/2801392736 learned_addr learned my addr 172.21.15.27:0/2801392736 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 -- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf00cac00 msgr2=0x7f7bf0142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf00cac00 0x7f7bf0142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf6994700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0157980 0x7f7bf0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 -- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0157980 msgr2=0x7f7bf0156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0157980 0x7f7bf0156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 -- 172.21.15.27:0/2801392736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4009a20 con 0x7f7bf0153ef0 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.622+0000 7f7bf5992700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 0x7f7bf01568c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f7be400b610 tx=0x7f7be4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.623+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be401d630 con 0x7f7bf0153ef0 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.623+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be401d790 con 0x7f7bf0153ef0 2023-05-17T15:27:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.623+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf014f2c0 con 0x7f7bf0153ef0 2023-05-17T15:27:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.623+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be401db50 con 0x7f7bf0153ef0 2023-05-17T15:27:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.623+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf01643f0 con 0x7f7bf0153ef0 2023-05-17T15:27:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.624+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf0047150 con 0x7f7bf0153ef0 2023-05-17T15:27:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.624+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7be4026410 con 0x7f7bf0153ef0 2023-05-17T15:27:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.624+0000 7f7bee7fc700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7bdc05ee20 0x7f7bdc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.624+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f7be407c020 con 0x7f7bf0153ef0 2023-05-17T15:27:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.624+0000 7f7bf6193700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7bdc05ee20 0x7f7bdc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.625+0000 7f7bf6193700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7bdc05ee20 0x7f7bdc0612e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7be8005750 tx=0x7f7be8007850).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.628+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7be404d200 con 0x7f7bf0153ef0 2023-05-17T15:27:26.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:26.846+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7bf0164e70 con 0x7f7bf0153ef0 2023-05-17T15:27:27.665 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-05-17T15:27:27.661+0000 7f03d9291700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:27:27.682 INFO:tasks.ceph.mds.b.smithi040.stderr: -1> 2023-05-17T15:27:27.661+0000 7f03d9291700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:27:27.704 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:27:27.747 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:27:27.743+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:27:27.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.751+0000 7f7bee7fc700 1 -- 172.21.15.27:0/2801392736 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7be4050820 con 0x7f7bf0153ef0 2023-05-17T15:27:27.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7bdc05ee20 msgr2=0x7f7bdc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:27.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7bdc05ee20 0x7f7bdc0612e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7be8005750 tx=0x7f7be8007850).stop 2023-05-17T15:27:27.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 msgr2=0x7f7bf01568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:27.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 0x7f7bf01568c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f7be400b610 tx=0x7f7be4009780).stop 2023-05-17T15:27:27.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 shutdown_connections 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7bdc05ee20 0x7f7bdc0612e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf0157980 0x7f7bf0156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bf00cac00 0x7f7bf0142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 --2- 172.21.15.27:0/2801392736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7bf0153ef0 0x7f7bf01568c0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 >> 172.21.15.27:0/2801392736 conn(0x7f7bf005dd50 msgr2=0x7f7bf00a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 shutdown_connections 2023-05-17T15:27:27.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.754+0000 7f7bf7195700 1 -- 172.21.15.27:0/2801392736 wait complete. 2023-05-17T15:27:27.760 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:27:27.773 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:27:27.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 Processor -- start 2023-05-17T15:27:27.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 -- start start 2023-05-17T15:27:27.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2da0154090 0x7f2da0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2da00cb450 0x7f2da00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da0069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da0069fa0 con 0x7f2da0154090 2023-05-17T15:27:27.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da00c5a50 con 0x7f2da00cb450 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.895+0000 7f2da62af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0069880 con 0x7f2da0068f00 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2da0154090 0x7f2da0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2da0154090 0x7f2da0154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44894/0 (socket says 172.21.15.27:44894) 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 -- 172.21.15.27:0/1974150089 learned_addr learned my addr 172.21.15.27:0/1974150089 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2da484c700 1 --2- 172.21.15.27:0/1974150089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da0069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/1974150089 >> v2:172.21.15.40:3300/0 conn(0x7f2da00cb450 0x7f2da00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 -- 172.21.15.27:0/1974150089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 msgr2=0x7f2da0069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/1974150089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da0069390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 -- 172.21.15.27:0/1974150089 >> v2:172.21.15.40:3300/0 conn(0x7f2da00cb450 msgr2=0x7f2da00cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/1974150089 >> v2:172.21.15.40:3300/0 conn(0x7f2da00cb450 0x7f2da00cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 -- 172.21.15.27:0/1974150089 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00c04e0 con 0x7f2da0154090 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/1974150089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0154090 0x7f2da0154470 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f2da00bff40 tx=0x7f2d900090f0).ready entity=mon.0 client_cookie=e51af44904cfb53e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9effd700 1 -- 172.21.15.27:0/1974150089 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000b600 con 0x7f2da0154090 2023-05-17T15:27:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9effd700 1 -- 172.21.15.27:0/1974150089 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000b760 con 0x7f2da0154090 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.896+0000 7f2d9effd700 1 -- 172.21.15.27:0/1974150089 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000bae0 con 0x7f2da0154090 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 -- 172.21.15.27:0/1974150089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0154090 msgr2=0x7f2da0154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 --2- 172.21.15.27:0/1974150089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0154090 0x7f2da0154470 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f2da00bff40 tx=0x7f2d900090f0).stop 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 -- 172.21.15.27:0/1974150089 shutdown_connections 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 --2- 172.21.15.27:0/1974150089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da0154090 0x7f2da0154470 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 --2- 172.21.15.27:0/1974150089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da0069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 --2- 172.21.15.27:0/1974150089 >> v2:172.21.15.40:3300/0 conn(0x7f2da00cb450 0x7f2da00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 -- 172.21.15.27:0/1974150089 >> 172.21.15.27:0/1974150089 conn(0x7f2da005e7e0 msgr2=0x7f2da00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 -- 172.21.15.27:0/1974150089 shutdown_connections 2023-05-17T15:27:27.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.897+0000 7f2da62af700 1 -- 172.21.15.27:0/1974150089 wait complete. 2023-05-17T15:27:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.898+0000 7f2da62af700 1 Processor -- start 2023-05-17T15:27:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.898+0000 7f2da62af700 1 -- start start 2023-05-17T15:27:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da62af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da00aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da62af700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 0x7f2da00c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da62af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0154090 0x7f2da0150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da62af700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c3240 con 0x7f2da00cb450 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da62af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c36d0 con 0x7f2da0154090 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da62af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c2630 con 0x7f2da0068f00 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 0x7f2da00c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 0x7f2da00c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44902/0 (socket says 172.21.15.27:44902) 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3706811663 learned_addr learned my addr 172.21.15.27:0/3706811663 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da00aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da484c700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0154090 0x7f2da0150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 msgr2=0x7f2da00aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da00aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0154090 msgr2=0x7f2da0150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0154090 0x7f2da0150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 -- 172.21.15.27:0/3706811663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009370 con 0x7f2da00cb450 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2da484c700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0154090 0x7f2da0150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:27.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.899+0000 7f2d9f7fe700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 0x7f2da00c1de0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f2d9400d890 tx=0x7f2d94008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.900+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940125f0 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.900+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d94012750 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.900+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00c2910 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.900+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94012ad0 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.900+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da00c2ed0 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.900+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da00c3520 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.901+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2d94013480 con 0x7f2da00cb450 2023-05-17T15:27:27.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.901+0000 7f2d87fff700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.901+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f2d9407a130 con 0x7f2da00cb450 2023-05-17T15:27:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.901+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.902+0000 7f2d9ffff700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2d90009130 tx=0x7f2d90017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:27.905+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d9404b2e0 con 0x7f2da00cb450 2023-05-17T15:27:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.126+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2da00c0760 con 0x7f2da00cb450 2023-05-17T15:27:28.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.852+0000 7f2d87fff700 1 -- 172.21.15.27:0/3706811663 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2d9404e900 con 0x7f2da00cb450 2023-05-17T15:27:28.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.854+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2d8c05ee20 msgr2=0x7f2d8c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:28.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.854+0000 7f2da62af700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2d90009130 tx=0x7f2d90017000).stop 2023-05-17T15:27:28.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 msgr2=0x7f2da00c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:28.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 0x7f2da00c1de0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f2d9400d890 tx=0x7f2d94008040).stop 2023-05-17T15:27:28.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 shutdown_connections 2023-05-17T15:27:28.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2d8c05ee20 0x7f2d8c0612e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:28.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2da0154090 0x7f2da0150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:28.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2da0068f00 0x7f2da00aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:28.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 --2- 172.21.15.27:0/3706811663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da00cb450 0x7f2da00c1de0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:28.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 >> 172.21.15.27:0/3706811663 conn(0x7f2da005e7e0 msgr2=0x7f2da00c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:28.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 shutdown_connections 2023-05-17T15:27:28.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.855+0000 7f2da62af700 1 -- 172.21.15.27:0/3706811663 wait complete. 2023-05-17T15:27:28.873 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:27:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.993+0000 7f3365b7d700 1 Processor -- start 2023-05-17T15:27:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.993+0000 7f3365b7d700 1 -- start start 2023-05-17T15:27:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f3365b7d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3360153fa0 0x7f33600c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f3365b7d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f33600aa130 0x7f3360081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f3365b7d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33600c1610 con 0x7f33600824c0 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f3365b7d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33600abe60 con 0x7f33600aa130 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f3365b7d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33600c0a00 con 0x7f3360153fa0 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f33600aa130 0x7f3360081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f33600aa130 0x7f3360081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44910/0 (socket says 172.21.15.27:44910) 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 -- 172.21.15.27:0/1366227800 learned_addr learned my addr 172.21.15.27:0/1366227800 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335f7fe700 1 --2- 172.21.15.27:0/1366227800 >> v2:172.21.15.40:3300/0 conn(0x7f3360153fa0 0x7f33600c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 -- 172.21.15.27:0/1366227800 >> v2:172.21.15.40:3300/0 conn(0x7f3360153fa0 msgr2=0x7f33600c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 --2- 172.21.15.27:0/1366227800 >> v2:172.21.15.40:3300/0 conn(0x7f3360153fa0 0x7f33600c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 -- 172.21.15.27:0/1366227800 >> v1:172.21.15.40:6789/0 conn(0x7f33600824c0 legacy=0x7f3360068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 -- 172.21.15.27:0/1366227800 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33600c0ce0 con 0x7f33600aa130 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.994+0000 7f335effd700 1 --2- 172.21.15.27:0/1366227800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f3360081fd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f33600cad20 tx=0x7f33540090f0).ready entity=mon.0 client_cookie=6158ee75a5bcba90 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f335e7fc700 1 -- 172.21.15.27:0/1366227800 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400b600 con 0x7f33600aa130 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f335e7fc700 1 -- 172.21.15.27:0/1366227800 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400b760 con 0x7f33600aa130 2023-05-17T15:27:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f335e7fc700 1 -- 172.21.15.27:0/1366227800 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400bae0 con 0x7f33600aa130 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 -- 172.21.15.27:0/1366227800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 msgr2=0x7f3360081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 --2- 172.21.15.27:0/1366227800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f3360081fd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f33600cad20 tx=0x7f33540090f0).stop 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 -- 172.21.15.27:0/1366227800 shutdown_connections 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 --2- 172.21.15.27:0/1366227800 >> v2:172.21.15.40:3300/0 conn(0x7f3360153fa0 0x7f33600c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 --2- 172.21.15.27:0/1366227800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f3360081fd0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 -- 172.21.15.27:0/1366227800 >> 172.21.15.27:0/1366227800 conn(0x7f336005e820 msgr2=0x7f33600cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 -- 172.21.15.27:0/1366227800 shutdown_connections 2023-05-17T15:27:29.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.995+0000 7f3365b7d700 1 -- 172.21.15.27:0/1366227800 wait complete. 2023-05-17T15:27:29.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.996+0000 7f3365b7d700 1 Processor -- start 2023-05-17T15:27:29.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.996+0000 7f3365b7d700 1 -- start start 2023-05-17T15:27:29.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f3365b7d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33600824c0 0x7f33601500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:29.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f3365b7d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f33600af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:29.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f3365b7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3360153fa0 0x7f33600b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:29.005 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f3365b7d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33601505d0 con 0x7f33600aa130 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f3365b7d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600af520 con 0x7f33600824c0 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f3365b7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33600af7a0 con 0x7f3360153fa0 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f335effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f33600af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f335effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f33600af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44916/0 (socket says 172.21.15.27:44916) 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f335effd700 1 -- 172.21.15.27:0/2647385221 learned_addr learned my addr 172.21.15.27:0/2647385221 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f335f7fe700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33600824c0 0x7f33601500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.997+0000 7f335ffff700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3360153fa0 0x7f33600b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:29.006 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f335effd700 1 -- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3360153fa0 msgr2=0x7f33600b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f335effd700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3360153fa0 0x7f33600b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f335effd700 1 -- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33600824c0 msgr2=0x7f33601500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f335effd700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33600824c0 0x7f33601500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f335effd700 1 -- 172.21.15.27:0/2647385221 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354009370 con 0x7f33600aa130 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f335effd700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f33600af030 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f3354009130 tx=0x7f3354017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400bea0 con 0x7f33600aa130 2023-05-17T15:27:29.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400b8d0 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33600afa80 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335401c670 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.998+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33600b0040 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.999+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336006bdf0 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:28.999+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f335402c070 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.000+0000 7f33477fe700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f334c05ee20 0x7f334c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.000+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f335407bae0 con 0x7f33600aa130 2023-05-17T15:27:29.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.000+0000 7f335f7fe700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f334c05ee20 0x7f334c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:29.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.000+0000 7f335f7fe700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f334c05ee20 0x7f334c0612e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f335000bb10 tx=0x7f3350008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:29.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.004+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f335404ccf0 con 0x7f33600aa130 2023-05-17T15:27:29.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.179+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f33601512a0 con 0x7f33600aa130 2023-05-17T15:27:29.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.857+0000 7f33477fe700 1 -- 172.21.15.27:0/2647385221 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v149) v1 ==== 181+0+0 (secure 0 0 0) 0x7f335402a0d0 con 0x7f33600aa130 2023-05-17T15:27:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f334c05ee20 msgr2=0x7f334c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f334c05ee20 0x7f334c0612e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f335000bb10 tx=0x7f3350008040).stop 2023-05-17T15:27:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 msgr2=0x7f33600af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f33600af030 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f3354009130 tx=0x7f3354017000).stop 2023-05-17T15:27:29.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 shutdown_connections 2023-05-17T15:27:29.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f334c05ee20 0x7f334c0612e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3360153fa0 0x7f33600b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33600824c0 0x7f33601500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 --2- 172.21.15.27:0/2647385221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33600aa130 0x7f33600af030 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:29.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 >> 172.21.15.27:0/2647385221 conn(0x7f336005e820 msgr2=0x7f33600c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:29.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 shutdown_connections 2023-05-17T15:27:29.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.861+0000 7f3365b7d700 1 -- 172.21.15.27:0/2647385221 wait complete. 2023-05-17T15:27:29.867 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:27:29.879 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:27:30.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.997+0000 7f2aa4a15700 1 Processor -- start 2023-05-17T15:27:30.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.997+0000 7f2aa4a15700 1 -- start start 2023-05-17T15:27:30.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2aa4a15700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2aa0151c90 0x7f2aa0152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2aa4a15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa0154980 0x7f2aa00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2aa4a15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa00c0520 0x7f2aa0081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2aa4a15700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa0158010 con 0x7f2aa0151c90 2023-05-17T15:27:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2aa4a15700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa0154f60 con 0x7f2aa00c0520 2023-05-17T15:27:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2aa4a15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0155240 con 0x7f2aa0154980 2023-05-17T15:27:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2aa0151c90 0x7f2aa0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2aa0151c90 0x7f2aa0152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44922/0 (socket says 172.21.15.27:44922) 2023-05-17T15:27:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 -- 172.21.15.27:0/3617785251 learned_addr learned my addr 172.21.15.27:0/3617785251 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 -- 172.21.15.27:0/3617785251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa0154980 msgr2=0x7f2aa00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:30.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9dd9b700 1 --2- 172.21.15.27:0/3617785251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa0154980 0x7f2aa00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/3617785251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa0154980 0x7f2aa00c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 -- 172.21.15.27:0/3617785251 >> v2:172.21.15.40:3300/0 conn(0x7f2aa00c0520 msgr2=0x7f2aa0081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:30.004 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9ed9d700 1 --2- 172.21.15.27:0/3617785251 >> v2:172.21.15.40:3300/0 conn(0x7f2aa00c0520 0x7f2aa0081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/3617785251 >> v2:172.21.15.40:3300/0 conn(0x7f2aa00c0520 0x7f2aa0081fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 -- 172.21.15.27:0/3617785251 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0155520 con 0x7f2aa0151c90 2023-05-17T15:27:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/3617785251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa0152070 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f2aa005fcf0 tx=0x7f2a900090f0).ready entity=mon.0 client_cookie=942b98bda3c582ce server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9d59a700 1 -- 172.21.15.27:0/3617785251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000b600 con 0x7f2aa0151c90 2023-05-17T15:27:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9d59a700 1 -- 172.21.15.27:0/3617785251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000b760 con 0x7f2aa0151c90 2023-05-17T15:27:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.998+0000 7f2a9d59a700 1 -- 172.21.15.27:0/3617785251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000bae0 con 0x7f2aa0151c90 2023-05-17T15:27:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 -- 172.21.15.27:0/3617785251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 msgr2=0x7f2aa0152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/3617785251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa0152070 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f2aa005fcf0 tx=0x7f2a900090f0).stop 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 -- 172.21.15.27:0/3617785251 shutdown_connections 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/3617785251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa0152070 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/3617785251 >> v2:172.21.15.40:3300/0 conn(0x7f2aa00c0520 0x7f2aa0081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/3617785251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa0154980 0x7f2aa00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 -- 172.21.15.27:0/3617785251 >> 172.21.15.27:0/3617785251 conn(0x7f2aa00cae10 msgr2=0x7f2aa00cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 -- 172.21.15.27:0/3617785251 shutdown_connections 2023-05-17T15:27:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:29.999+0000 7f2aa4a15700 1 -- 172.21.15.27:0/3617785251 wait complete. 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.000+0000 7f2aa4a15700 1 Processor -- start 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.000+0000 7f2aa4a15700 1 -- start start 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2aa4a15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa00c0520 0x7f2aa0167610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2aa4a15700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa00ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2aa4a15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa0154980 0x7f2aa00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2aa4a15700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00acda0 con 0x7f2aa0151c90 2023-05-17T15:27:30.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2aa4a15700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c3e70 con 0x7f2aa0154980 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2aa4a15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c4150 con 0x7f2aa00c0520 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa00ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa00ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44926/0 (socket says 172.21.15.27:44926) 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 -- 172.21.15.27:0/363894501 learned_addr learned my addr 172.21.15.27:0/363894501 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa00c0520 0x7f2aa0167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9ed9d700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa0154980 0x7f2aa00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 -- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa00c0520 msgr2=0x7f2aa0167610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa00c0520 0x7f2aa0167610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 -- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa0154980 msgr2=0x7f2aa00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa0154980 0x7f2aa00ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9dd9b700 1 -- 172.21.15.27:0/363894501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90009370 con 0x7f2aa0151c90 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.001+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa00c0520 0x7f2aa0167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.002+0000 7f2a9dd9b700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa00ac3c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f2a9400c650 tx=0x7f2a94008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.002+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94010580 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.002+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940106e0 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.002+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00c4430 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.002+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94010a60 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.002+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00c49f0 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.003+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa006bdf0 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.003+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2a9401b460 con 0x7f2aa0151c90 2023-05-17T15:27:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.003+0000 7f2a8e7fc700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8005ee20 0x7f2a800612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.003+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f2a94079d70 con 0x7f2aa0151c90 2023-05-17T15:27:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.004+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8005ee20 0x7f2a800612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.004+0000 7f2a9e59c700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8005ee20 0x7f2a800612e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2a90009fd0 tx=0x7f2a90017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.008+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a9404b110 con 0x7f2aa0151c90 2023-05-17T15:27:30.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.191+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2aa0155800 con 0x7f2aa0151c90 2023-05-17T15:27:30.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.910+0000 7f2a8e7fc700 1 -- 172.21.15.27:0/363894501 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2a9404e730 con 0x7f2aa0151c90 2023-05-17T15:27:30.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8005ee20 msgr2=0x7f2a800612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:30.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8005ee20 0x7f2a800612e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2a90009fd0 tx=0x7f2a90017000).stop 2023-05-17T15:27:30.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 msgr2=0x7f2aa00ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:30.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa00ac3c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f2a9400c650 tx=0x7f2a94008040).stop 2023-05-17T15:27:30.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 shutdown_connections 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8005ee20 0x7f2a800612e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa0154980 0x7f2aa00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa00c0520 0x7f2aa0167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 --2- 172.21.15.27:0/363894501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aa0151c90 0x7f2aa00ac3c0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 >> 172.21.15.27:0/363894501 conn(0x7f2aa00cae10 msgr2=0x7f2aa00c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 shutdown_connections 2023-05-17T15:27:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:30.913+0000 7f2aa4a15700 1 -- 172.21.15.27:0/363894501 wait complete. 2023-05-17T15:27:30.919 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:27:30.930 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:27:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.047+0000 7fb9ff1f6700 1 Processor -- start 2023-05-17T15:27:31.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.047+0000 7fb9ff1f6700 1 -- start start 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9ff1f6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9f80c6310 0x7fb9f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9ff1f6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9f80691f0 0x7fb9f80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9ff1f6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f8158790 con 0x7fb9f81543d0 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9ff1f6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80c1c50 con 0x7fb9f80c6310 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9ff1f6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f8157e60 con 0x7fb9f80691f0 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9f7fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9f80c6310 0x7fb9f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9fcf92700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb9f81543d0 0x7fb9f80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44494/0 (socket says 172.21.15.27:44494) 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9fcf92700 1 -- 172.21.15.27:0/654555085 learned_addr learned my addr 172.21.15.27:0/654555085 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9fd793700 1 --2- 172.21.15.27:0/654555085 >> v2:172.21.15.40:3300/0 conn(0x7fb9f80691f0 0x7fb9f80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.048+0000 7fb9f7fff700 1 -- 172.21.15.27:0/654555085 >> v2:172.21.15.40:3300/0 conn(0x7fb9f80691f0 msgr2=0x7fb9f80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f7fff700 1 --2- 172.21.15.27:0/654555085 >> v2:172.21.15.40:3300/0 conn(0x7fb9f80691f0 0x7fb9f80bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f7fff700 1 -- 172.21.15.27:0/654555085 >> v1:172.21.15.27:6789/0 conn(0x7fb9f81543d0 legacy=0x7fb9f80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f77fe700 1 -- 172.21.15.27:0/654555085 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196947486 0 0) 0x7fb9f8158790 con 0x7fb9f81543d0 2023-05-17T15:27:31.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f7fff700 1 -- 172.21.15.27:0/654555085 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8158140 con 0x7fb9f80c6310 2023-05-17T15:27:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f7fff700 1 --2- 172.21.15.27:0/654555085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80c6310 0x7fb9f8068d00 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fb9f8083a00 tx=0x7fb9ec009060).ready entity=mon.0 client_cookie=304b86179b737e21 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f77fe700 1 -- 172.21.15.27:0/654555085 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00b580 con 0x7fb9f80c6310 2023-05-17T15:27:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f77fe700 1 -- 172.21.15.27:0/654555085 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00b6e0 con 0x7fb9f80c6310 2023-05-17T15:27:31.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9f77fe700 1 -- 172.21.15.27:0/654555085 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00ba60 con 0x7fb9f80c6310 2023-05-17T15:27:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/654555085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80c6310 msgr2=0x7fb9f8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/654555085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80c6310 0x7fb9f8068d00 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fb9f8083a00 tx=0x7fb9ec009060).stop 2023-05-17T15:27:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/654555085 shutdown_connections 2023-05-17T15:27:31.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/654555085 >> v2:172.21.15.40:3300/0 conn(0x7fb9f80691f0 0x7fb9f80bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/654555085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80c6310 0x7fb9f8068d00 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/654555085 >> 172.21.15.27:0/654555085 conn(0x7fb9f80cb7f0 msgr2=0x7fb9f80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/654555085 shutdown_connections 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.049+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/654555085 wait complete. 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 Processor -- start 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 -- start start 2023-05-17T15:27:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 0x7fb9f80adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f80c6310 0x7fb9f8147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f81543d0 0x7fb9f80afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80ae1c0 con 0x7fb9f80691f0 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8167960 con 0x7fb9f81543d0 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.051+0000 7fb9ff1f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8167bb0 con 0x7fb9f80c6310 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 0x7fb9f80adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 0x7fb9f80adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44936/0 (socket says 172.21.15.27:44936) 2023-05-17T15:27:31.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 -- 172.21.15.27:0/1302631601 learned_addr learned my addr 172.21.15.27:0/1302631601 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9f7fff700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f80c6310 0x7fb9f8147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fd793700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f81543d0 0x7fb9f80afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 -- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f80c6310 msgr2=0x7fb9f8147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f80c6310 0x7fb9f8147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 -- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f81543d0 msgr2=0x7fb9f80afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f81543d0 0x7fb9f80afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 -- 172.21.15.27:0/1302631601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0092a0 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9fcf92700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 0x7fb9f80adcd0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fb9f000c810 tx=0x7fb9f0001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0005d30 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0005e90 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f8167e90 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0007320 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.052+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f8168450 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.053+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f806bdf0 con 0x7fb9f80691f0 2023-05-17T15:27:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.053+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb9f0010030 con 0x7fb9f80691f0 2023-05-17T15:27:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.054+0000 7fb9f4ff9700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb9e405ee20 0x7fb9e40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.054+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb9f0079a70 con 0x7fb9f80691f0 2023-05-17T15:27:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.054+0000 7fb9f7fff700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb9e405ee20 0x7fb9e40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.054+0000 7fb9f7fff700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb9e405ee20 0x7fb9e40612e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb9f80c6710 tx=0x7fb9ec017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.058+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9f004b030 con 0x7fb9f80691f0 2023-05-17T15:27:31.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.237+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb9f8164400 con 0x7fb9f80691f0 2023-05-17T15:27:31.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.240+0000 7fb9f4ff9700 1 -- 172.21.15.27:0/1302631601 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v28) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb9f0079e60 con 0x7fb9f80691f0 2023-05-17T15:27:31.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb9e405ee20 msgr2=0x7fb9e40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb9e405ee20 0x7fb9e40612e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb9f80c6710 tx=0x7fb9ec017000).stop 2023-05-17T15:27:31.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 msgr2=0x7fb9f80adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 0x7fb9f80adcd0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fb9f000c810 tx=0x7fb9f0001570).stop 2023-05-17T15:27:31.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 shutdown_connections 2023-05-17T15:27:31.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb9e405ee20 0x7fb9e40612e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f81543d0 0x7fb9f80afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9f80691f0 0x7fb9f80adcd0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 --2- 172.21.15.27:0/1302631601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f80c6310 0x7fb9f8147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.242+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 >> 172.21.15.27:0/1302631601 conn(0x7fb9f80cb7f0 msgr2=0x7fb9f8153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.243+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 shutdown_connections 2023-05-17T15:27:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.243+0000 7fb9ff1f6700 1 -- 172.21.15.27:0/1302631601 wait complete. 2023-05-17T15:27:31.258 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:27:31.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.373+0000 7f2eac691700 1 Processor -- start 2023-05-17T15:27:31.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.373+0000 7f2eac691700 1 -- start start 2023-05-17T15:27:31.378 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eac691700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea40c6310 0x7f2ea4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eac691700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ea40691f0 0x7f2ea40bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eac691700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea4158790 con 0x7f2ea41543d0 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eac691700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40c1c50 con 0x7f2ea40691f0 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eac691700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4157e60 con 0x7f2ea40c6310 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ea40691f0 0x7f2ea40bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ea40691f0 0x7f2ea40bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44948/0 (socket says 172.21.15.27:44948) 2023-05-17T15:27:31.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 -- 172.21.15.27:0/2650681824 learned_addr learned my addr 172.21.15.27:0/2650681824 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2ea9c2c700 1 --2- 172.21.15.27:0/2650681824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea40c6310 0x7f2ea4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 -- 172.21.15.27:0/2650681824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea40c6310 msgr2=0x7f2ea4068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 --2- 172.21.15.27:0/2650681824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea40c6310 0x7f2ea4068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 -- 172.21.15.27:0/2650681824 >> v1:172.21.15.40:6789/0 conn(0x7f2ea41543d0 legacy=0x7f2ea40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.374+0000 7f2eaac2e700 1 -- 172.21.15.27:0/2650681824 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4158140 con 0x7f2ea40691f0 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eaac2e700 1 --2- 172.21.15.27:0/2650681824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40691f0 0x7f2ea40bfc80 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f2e9c009f20 tx=0x7f2e9c009840).ready entity=mon.0 client_cookie=c29dcefd028ca440 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2ea942b700 1 -- 172.21.15.27:0/2650681824 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00e070 con 0x7f2ea40691f0 2023-05-17T15:27:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2ea942b700 1 -- 172.21.15.27:0/2650681824 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c00b9d0 con 0x7f2ea40691f0 2023-05-17T15:27:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2ea942b700 1 -- 172.21.15.27:0/2650681824 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00bd50 con 0x7f2ea40691f0 2023-05-17T15:27:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 -- 172.21.15.27:0/2650681824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40691f0 msgr2=0x7f2ea40bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 --2- 172.21.15.27:0/2650681824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40691f0 0x7f2ea40bfc80 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f2e9c009f20 tx=0x7f2e9c009840).stop 2023-05-17T15:27:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 -- 172.21.15.27:0/2650681824 shutdown_connections 2023-05-17T15:27:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 --2- 172.21.15.27:0/2650681824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40691f0 0x7f2ea40bfc80 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 --2- 172.21.15.27:0/2650681824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea40c6310 0x7f2ea4068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 -- 172.21.15.27:0/2650681824 >> 172.21.15.27:0/2650681824 conn(0x7f2ea40cb7f0 msgr2=0x7f2ea40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 -- 172.21.15.27:0/2650681824 shutdown_connections 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.375+0000 7f2eac691700 1 -- 172.21.15.27:0/2650681824 wait complete. 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.376+0000 7f2eac691700 1 Processor -- start 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.376+0000 7f2eac691700 1 -- start start 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eac691700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea40691f0 0x7f2ea41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eac691700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 0x7f2ea41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eac691700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea41543d0 0x7f2ea4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eac691700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4155190 con 0x7f2ea40c6310 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eac691700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4164380 con 0x7f2ea40691f0 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eac691700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea41651a0 con 0x7f2ea41543d0 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2ea9c2c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 0x7f2ea41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2ea9c2c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 0x7f2ea41547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44952/0 (socket says 172.21.15.27:44952) 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2ea9c2c700 1 -- 172.21.15.27:0/2418939388 learned_addr learned my addr 172.21.15.27:0/2418939388 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eaac2e700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea41543d0 0x7f2ea4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.377+0000 7f2eaa42d700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea40691f0 0x7f2ea41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2ea9c2c700 1 -- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea41543d0 msgr2=0x7f2ea4154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2ea9c2c700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea41543d0 0x7f2ea4154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2ea9c2c700 1 -- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea40691f0 msgr2=0x7f2ea41528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2ea9c2c700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea40691f0 0x7f2ea41528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2ea9c2c700 1 -- 172.21.15.27:0/2418939388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009ae0 con 0x7f2ea40c6310 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2eaa42d700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea40691f0 0x7f2ea41528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2ea9c2c700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 0x7f2ea41547b0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f2e9400e900 tx=0x7f2e94009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9400c670 con 0x7f2ea40c6310 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9400c7d0 con 0x7f2ea40c6310 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea40adcd0 con 0x7f2ea40c6310 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9400cb50 con 0x7f2ea40c6310 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.378+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea4164640 con 0x7f2ea40c6310 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.379+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea406bdf0 con 0x7f2ea40c6310 2023-05-17T15:27:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.379+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2e94022070 con 0x7f2ea40c6310 2023-05-17T15:27:31.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.379+0000 7f2e9a7fc700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2e8805ee20 0x7f2e880612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.380+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2e94079ee0 con 0x7f2ea40c6310 2023-05-17T15:27:31.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.380+0000 7f2eaa42d700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2e8805ee20 0x7f2e880612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.380+0000 7f2eaa42d700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2e8805ee20 0x7f2e880612e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2ea40a99f0 tx=0x7f2ea0009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.384+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e9404b4a0 con 0x7f2ea40c6310 2023-05-17T15:27:31.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.559+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2ea4069d00 con 0x7f2ea40c6310 2023-05-17T15:27:31.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.563+0000 7f2e9a7fc700 1 -- 172.21.15.27:0/2418939388 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e94016020 con 0x7f2ea40c6310 2023-05-17T15:27:31.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2e8805ee20 msgr2=0x7f2e880612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2e8805ee20 0x7f2e880612e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2ea40a99f0 tx=0x7f2ea0009040).stop 2023-05-17T15:27:31.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 msgr2=0x7f2ea41547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 0x7f2ea41547b0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f2e9400e900 tx=0x7f2e94009060).stop 2023-05-17T15:27:31.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 shutdown_connections 2023-05-17T15:27:31.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2e8805ee20 0x7f2e880612e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ea41543d0 0x7f2ea4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea40691f0 0x7f2ea41528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 --2- 172.21.15.27:0/2418939388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ea40c6310 0x7f2ea41547b0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 >> 172.21.15.27:0/2418939388 conn(0x7f2ea40cb7f0 msgr2=0x7f2ea40a9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:31.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 shutdown_connections 2023-05-17T15:27:31.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.565+0000 7f2eac691700 1 -- 172.21.15.27:0/2418939388 wait complete. 2023-05-17T15:27:31.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-05-17T15:27:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.692+0000 7f057f1a0700 1 Processor -- start 2023-05-17T15:27:31.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.692+0000 7f057f1a0700 1 -- start start 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f057f1a0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05781376a0 0x7f05780c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f057f1a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05780c22d0 0x7f05781548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f057f1a0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05780c34a0 con 0x7f05781372c0 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f057f1a0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0578064be0 con 0x7f05781376a0 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f057f1a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05780c2890 con 0x7f05780c22d0 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f0577fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05781376a0 0x7f05780c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.699 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f0577fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f05781376a0 0x7f05780c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44960/0 (socket says 172.21.15.27:44960) 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f057cf3c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f05781372c0 0x7f05780650d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44520/0 (socket says 172.21.15.27:44520) 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.693+0000 7f0577fff700 1 -- 172.21.15.27:0/2349959648 learned_addr learned my addr 172.21.15.27:0/2349959648 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057d73d700 1 --2- 172.21.15.27:0/2349959648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05780c22d0 0x7f05781548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f0577fff700 1 -- 172.21.15.27:0/2349959648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05780c22d0 msgr2=0x7f05781548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f0577fff700 1 --2- 172.21.15.27:0/2349959648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05780c22d0 0x7f05781548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f0577fff700 1 -- 172.21.15.27:0/2349959648 >> v1:172.21.15.27:6789/0 conn(0x7f05781372c0 legacy=0x7f05780650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.700 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f0577fff700 1 -- 172.21.15.27:0/2349959648 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780c2b70 con 0x7f05781376a0 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f0577fff700 1 --2- 172.21.15.27:0/2349959648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05781376a0 0x7f05780c3930 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f0568006fd0 tx=0x7f05680090f0).ready entity=mon.0 client_cookie=4798c4135e7fb687 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f05777fe700 1 -- 172.21.15.27:0/2349959648 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800b600 con 0x7f05781376a0 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f05777fe700 1 -- 172.21.15.27:0/2349959648 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056800b760 con 0x7f05781376a0 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f05777fe700 1 -- 172.21.15.27:0/2349959648 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800bae0 con 0x7f05781376a0 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057f1a0700 1 -- 172.21.15.27:0/2349959648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05781376a0 msgr2=0x7f05780c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057f1a0700 1 --2- 172.21.15.27:0/2349959648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05781376a0 0x7f05780c3930 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f0568006fd0 tx=0x7f05680090f0).stop 2023-05-17T15:27:31.701 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057f1a0700 1 -- 172.21.15.27:0/2349959648 shutdown_connections 2023-05-17T15:27:31.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057f1a0700 1 --2- 172.21.15.27:0/2349959648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05780c22d0 0x7f05781548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057f1a0700 1 --2- 172.21.15.27:0/2349959648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05781376a0 0x7f05780c3930 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.694+0000 7f057f1a0700 1 -- 172.21.15.27:0/2349959648 >> 172.21.15.27:0/2349959648 conn(0x7f05780c8400 msgr2=0x7f05780c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:31.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.695+0000 7f057f1a0700 1 -- 172.21.15.27:0/2349959648 shutdown_connections 2023-05-17T15:27:31.702 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.695+0000 7f057f1a0700 1 -- 172.21.15.27:0/2349959648 wait complete. 2023-05-17T15:27:31.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 Processor -- start 2023-05-17T15:27:31.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 -- start start 2023-05-17T15:27:31.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 0x7f057814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05781372c0 0x7f057805e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05781376a0 0x7f0578135d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057814ee10 con 0x7f05780c22d0 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578164310 con 0x7f05781376a0 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.696+0000 7f057f1a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05781639e0 con 0x7f05781372c0 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 0x7f057814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 0x7f057814e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44964/0 (socket says 172.21.15.27:44964) 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 -- 172.21.15.27:0/3137809102 learned_addr learned my addr 172.21.15.27:0/3137809102 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f0577fff700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05781372c0 0x7f057805e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057d73d700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05781376a0 0x7f0578135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 -- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05781372c0 msgr2=0x7f057805e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05781372c0 0x7f057805e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 -- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05781376a0 msgr2=0x7f0578135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05781376a0 0x7f0578135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 -- 172.21.15.27:0/3137809102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009370 con 0x7f05780c22d0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f0577fff700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05781372c0 0x7f057805e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057cf3c700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 0x7f057814e600 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f057000c870 tx=0x7f0570001610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570005c70 con 0x7f05780c22d0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570005dd0 con 0x7f05780c22d0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570007320 con 0x7f05780c22d0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0578163cc0 con 0x7f05780c22d0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.697+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057814eaf0 con 0x7f05780c22d0 2023-05-17T15:27:31.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.698+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057806bdf0 con 0x7f05780c22d0 2023-05-17T15:27:31.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.699+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f0570010030 con 0x7f05780c22d0 2023-05-17T15:27:31.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.699+0000 7f0574ff9700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f055805ee20 0x7f05580612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:31.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.699+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f0570079a50 con 0x7f05780c22d0 2023-05-17T15:27:31.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.699+0000 7f0577fff700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f055805ee20 0x7f05580612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:31.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.699+0000 7f0577fff700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f055805ee20 0x7f05580612e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0578152360 tx=0x7f0568017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:31.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.705+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f057004b010 con 0x7f05780c22d0 2023-05-17T15:27:31.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:31.947+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f05780c2e50 con 0x7f05780c22d0 2023-05-17T15:27:32.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.914+0000 7f0574ff9700 1 -- 172.21.15.27:0/3137809102 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1167) v1 ==== 165+0+0 (secure 0 0 0) 0x7f057004e630 con 0x7f05780c22d0 2023-05-17T15:27:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f055805ee20 msgr2=0x7f05580612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f055805ee20 0x7f05580612e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0578152360 tx=0x7f0568017000).stop 2023-05-17T15:27:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 msgr2=0x7f057814e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 0x7f057814e600 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f057000c870 tx=0x7f0570001610).stop 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 shutdown_connections 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f055805ee20 0x7f05580612e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05781376a0 0x7f0578135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05780c22d0 0x7f057814e600 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 --2- 172.21.15.27:0/3137809102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05781372c0 0x7f057805e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 >> 172.21.15.27:0/3137809102 conn(0x7f05780c8400 msgr2=0x7f05780c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 shutdown_connections 2023-05-17T15:27:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:32.917+0000 7f057f1a0700 1 -- 172.21.15.27:0/3137809102 wait complete. 2023-05-17T15:27:32.935 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-05-17T15:27:32.936 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-05-17T15:27:32.936 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-17T15:27:32.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-05-17T15:27:33.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.055+0000 7f45d6b4c700 1 Processor -- start 2023-05-17T15:27:33.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.055+0000 7f45d6b4c700 1 -- start start 2023-05-17T15:27:33.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d6b4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153fa0 0x7f45d00c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d6b4c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45d00aae70 0x7f45d00c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d6b4c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d00c07a0 con 0x7f45d0069060 2023-05-17T15:27:33.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d6b4c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d0069d70 con 0x7f45d00aae70 2023-05-17T15:27:33.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d6b4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c6760 con 0x7f45d0153fa0 2023-05-17T15:27:33.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d50e9700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f45d0069060 0x7f45d00694f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44538/0 (socket says 172.21.15.27:44538) 2023-05-17T15:27:33.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.056+0000 7f45d50e9700 1 -- 172.21.15.27:0/3854316644 learned_addr learned my addr 172.21.15.27:0/3854316644 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:33.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cffff700 1 --2- 172.21.15.27:0/3854316644 >> v2:172.21.15.40:3300/0 conn(0x7f45d00aae70 0x7f45d00c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45d48e8700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153fa0 0x7f45d00c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768218270 0 0) 0x7f45d00c07a0 con 0x7f45d0069060 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45bc0033f0 con 0x7f45d0069060 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1569328493 0 0) 0x7f45bc0033f0 con 0x7f45d0069060 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153fa0 msgr2=0x7f45d00c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153fa0 0x7f45d00c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 >> v2:172.21.15.40:3300/0 conn(0x7f45d00aae70 msgr2=0x7f45d00c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 --2- 172.21.15.27:0/3854316644 >> v2:172.21.15.40:3300/0 conn(0x7f45d00aae70 0x7f45d00c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00c1c40 con 0x7f45d0069060 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f45b8001470 con 0x7f45d0069060 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 >> v1:172.21.15.27:6789/0 conn(0x7f45d0069060 legacy=0x7f45d00694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc004690 0x7f45bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc005000 0x7f45bc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0069d70 con 0x7f45bc0038e0 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c6760 con 0x7f45bc005000 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc00bdd0 con 0x7f45bc004690 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cffff700 1 --2- 172.21.15.27:0/3854316644 >> v2:172.21.15.40:3300/0 conn(0x7f45d00aae70 0x7f45d00c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45d48e8700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153fa0 0x7f45d00c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45d50e9700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc005000 0x7f45bc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45d48e8700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.057+0000 7f45cffff700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc004690 0x7f45bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d48e8700 1 -- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc004690 msgr2=0x7f45bc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d48e8700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45bc004690 0x7f45bc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d48e8700 1 -- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc005000 msgr2=0x7f45bc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d48e8700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45bc005000 0x7f45bc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d48e8700 1 -- 172.21.15.27:0/3854316644 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0033f0 con 0x7f45bc0038e0 2023-05-17T15:27:33.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d48e8700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45bc003d00 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f45d006a670 tx=0x7f45c800b040).ready entity=mon.0 client_cookie=39d5e48c2bc8b4bd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800eaa0 con 0x7f45bc0038e0 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c800f040 con 0x7f45bc0038e0 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45cf7fe700 1 -- 172.21.15.27:0/3854316644 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800ee30 con 0x7f45bc0038e0 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d6b4c700 1 -- 172.21.15.27:0/3854316644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 msgr2=0x7f45bc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/3854316644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45bc003d00 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f45d006a670 tx=0x7f45c800b040).stop 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d50e9700 1 -- 172.21.15.27:0/3854316644 reap_dead start 2023-05-17T15:27:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d6b4c700 1 -- 172.21.15.27:0/3854316644 shutdown_connections 2023-05-17T15:27:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d6b4c700 1 -- 172.21.15.27:0/3854316644 >> 172.21.15.27:0/3854316644 conn(0x7f45d00cb810 msgr2=0x7f45d00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d6b4c700 1 -- 172.21.15.27:0/3854316644 shutdown_connections 2023-05-17T15:27:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.058+0000 7f45d6b4c700 1 -- 172.21.15.27:0/3854316644 wait complete. 2023-05-17T15:27:33.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 Processor -- start 2023-05-17T15:27:33.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 -- start start 2023-05-17T15:27:33.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45d014cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153020 0x7f45d00c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d014e2b0 0x7f45d014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c3300 con 0x7f45bc0038e0 2023-05-17T15:27:33.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d014ec00 con 0x7f45d014e2b0 2023-05-17T15:27:33.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.060+0000 7f45d6b4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c26f0 con 0x7f45d0153020 2023-05-17T15:27:33.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45d014cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45d014cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44984/0 (socket says 172.21.15.27:44984) 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 -- 172.21.15.27:0/2882056048 learned_addr learned my addr 172.21.15.27:0/2882056048 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45cffff700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153020 0x7f45d00c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d50e9700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d014e2b0 0x7f45d014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 -- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153020 msgr2=0x7f45d00c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153020 0x7f45d00c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 -- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d014e2b0 msgr2=0x7f45d014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:33.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d014e2b0 0x7f45d014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 -- 172.21.15.27:0/2882056048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00c29d0 con 0x7f45bc0038e0 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d48e8700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45d014cb60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f45c800e840 tx=0x7f45c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8014e70 con 0x7f45bc0038e0 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8020400 con 0x7f45bc0038e0 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00c2cb0 con 0x7f45bc0038e0 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80207c0 con 0x7f45bc0038e0 2023-05-17T15:27:33.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.061+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d014d050 con 0x7f45bc0038e0 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.062+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d006bdf0 con 0x7f45bc0038e0 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.063+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f45c8030070 con 0x7f45bc0038e0 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.063+0000 7f45ccff9700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45b005ee20 0x7f45b00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.063+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f45c807c3f0 con 0x7f45bc0038e0 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.063+0000 7f45cffff700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45b005ee20 0x7f45b00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.063+0000 7f45cffff700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45b005ee20 0x7f45b00612e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f45d014ee10 tx=0x7f45c0006f40).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:33.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.067+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45c804d9b0 con 0x7f45bc0038e0 2023-05-17T15:27:33.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.306+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f45d00bfe70 con 0x7f45bc0038e0 2023-05-17T15:27:33.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.917+0000 7f45ccff9700 1 -- 172.21.15.27:0/2882056048 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1168) v1 ==== 166+0+0 (secure 0 0 0) 0x7f45c8050fd0 con 0x7f45bc0038e0 2023-05-17T15:27:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45b005ee20 msgr2=0x7f45b00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45b005ee20 0x7f45b00612e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f45d014ee10 tx=0x7f45c0006f40).stop 2023-05-17T15:27:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 msgr2=0x7f45d014cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45d014cb60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f45c800e840 tx=0x7f45c8017000).stop 2023-05-17T15:27:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 shutdown_connections 2023-05-17T15:27:33.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f45b005ee20 0x7f45b00612e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45d014e2b0 0x7f45d014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45bc0038e0 0x7f45d014cb60 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 --2- 172.21.15.27:0/2882056048 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45d0153020 0x7f45d00c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 >> 172.21.15.27:0/2882056048 conn(0x7f45d00cb810 msgr2=0x7f45d00ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 shutdown_connections 2023-05-17T15:27:33.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:33.920+0000 7f45d6b4c700 1 -- 172.21.15.27:0/2882056048 wait complete. 2023-05-17T15:27:33.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:27:34.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.059+0000 7fe5690c7700 1 Processor -- start 2023-05-17T15:27:34.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.059+0000 7fe5690c7700 1 -- start start 2023-05-17T15:27:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.059+0000 7fe5690c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5640c6310 0x7fe564068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.059+0000 7fe5690c7700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe564158790 con 0x7fe5641543d0 2023-05-17T15:27:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.059+0000 7fe5690c7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe564157e60 con 0x7fe5640691f0 2023-05-17T15:27:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.059+0000 7fe5690c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640c1c50 con 0x7fe5640c6310 2023-05-17T15:27:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe562d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe5641543d0 0x7fe5640c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44554/0 (socket says 172.21.15.27:44554) 2023-05-17T15:27:34.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe562d9d700 1 -- 172.21.15.27:0/2378834621 learned_addr learned my addr 172.21.15.27:0/2378834621 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351396703 0 0) 0x7fe564158790 con 0x7fe5641543d0 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5500033f0 con 0x7fe5641543d0 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2378834621 >> v2:172.21.15.40:3300/0 conn(0x7fe5640c6310 0x7fe564068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3857482782 0 0) 0x7fe5500033f0 con 0x7fe5641543d0 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 >> v2:172.21.15.40:3300/0 conn(0x7fe5640c6310 msgr2=0x7fe564068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 --2- 172.21.15.27:0/2378834621 >> v2:172.21.15.40:3300/0 conn(0x7fe5640c6310 0x7fe564068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 >> v1:172.21.15.40:6789/0 conn(0x7fe5640691f0 legacy=0x7fe5640bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564158140 con 0x7fe5641543d0 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fe554001470 con 0x7fe5641543d0 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 >> v1:172.21.15.27:6789/0 conn(0x7fe5641543d0 legacy=0x7fe5640c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5500038e0 0x7fe550003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe550004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe550005000 0x7fe55000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000be80 con 0x7fe550004690 2023-05-17T15:27:34.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000bff0 con 0x7fe5500038e0 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000c1b0 con 0x7fe550005000 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe550004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe562d9d700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5500038e0 0x7fe550003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.060+0000 7fe56359e700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe550005000 0x7fe55000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe55bfff700 1 -- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe550005000 msgr2=0x7fe55000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe550005000 0x7fe55000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe55bfff700 1 -- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5500038e0 msgr2=0x7fe550003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5500038e0 0x7fe550003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe55bfff700 1 -- 172.21.15.27:0/2378834621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500033f0 con 0x7fe550004690 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe56359e700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe550005000 0x7fe55000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe56359e700 1 -- 172.21.15.27:0/2378834621 reap_dead start 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe550004b10 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fe5640c6710 tx=0x7fe54c009060).ready entity=mon.0 client_cookie=70be7de6117ed260 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c009430 con 0x7fe550004690 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c009e70 con 0x7fe550004690 2023-05-17T15:27:34.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe56259c700 1 -- 172.21.15.27:0/2378834621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00e850 con 0x7fe550004690 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 -- 172.21.15.27:0/2378834621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 msgr2=0x7fe550004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe550004b10 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fe5640c6710 tx=0x7fe54c009060).stop 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 -- 172.21.15.27:0/2378834621 shutdown_connections 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2378834621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe550004b10 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 -- 172.21.15.27:0/2378834621 >> 172.21.15.27:0/2378834621 conn(0x7fe5640cb7f0 msgr2=0x7fe5640c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 -- 172.21.15.27:0/2378834621 shutdown_connections 2023-05-17T15:27:34.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.061+0000 7fe5690c7700 1 -- 172.21.15.27:0/2378834621 wait complete. 2023-05-17T15:27:34.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 Processor -- start 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 -- start start 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe5640b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe564153a80 0x7fe5640c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640c2e70 0x7fe5640c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640aff70 con 0x7fe550004690 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640af360 con 0x7fe564153a80 2023-05-17T15:27:34.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe5690c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640af640 con 0x7fe5640c2e70 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe562d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe5640b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe562d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe5640b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45004/0 (socket says 172.21.15.27:45004) 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.063+0000 7fe562d9d700 1 -- 172.21.15.27:0/2061944007 learned_addr learned my addr 172.21.15.27:0/2061944007 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe564153a80 0x7fe5640c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe56359e700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640c2e70 0x7fe5640c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe562d9d700 1 -- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640c2e70 msgr2=0x7fe5640c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe562d9d700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640c2e70 0x7fe5640c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe562d9d700 1 -- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe564153a80 msgr2=0x7fe5640c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe562d9d700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe564153a80 0x7fe5640c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe562d9d700 1 -- 172.21.15.27:0/2061944007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640af920 con 0x7fe550004690 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe562d9d700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe5640b0400 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fe5540049e0 tx=0x7fe554001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400f660 con 0x7fe550004690 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55400f7c0 con 0x7fe550004690 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5640afc00 con 0x7fe550004690 2023-05-17T15:27:34.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400fb40 con 0x7fe550004690 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.064+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5640aef80 con 0x7fe550004690 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.065+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56406bdf0 con 0x7fe550004690 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.065+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe55401b030 con 0x7fe550004690 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.066+0000 7fe55affd700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe54405ee20 0x7fe5440612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.066+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fe5540794b0 con 0x7fe550004690 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.066+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe54405ee20 0x7fe5440612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.066+0000 7fe55bfff700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe54405ee20 0x7fe5440612e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe5640c2270 tx=0x7fe54c01a000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.070+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe55404aa70 con 0x7fe550004690 2023-05-17T15:27:34.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.243+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe564158420 con 0x7fe550004690 2023-05-17T15:27:34.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.247+0000 7fe55affd700 1 -- 172.21.15.27:0/2061944007 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe554019020 con 0x7fe550004690 2023-05-17T15:27:34.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe54405ee20 msgr2=0x7fe5440612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe54405ee20 0x7fe5440612e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe5640c2270 tx=0x7fe54c01a000).stop 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 msgr2=0x7fe5640b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe5640b0400 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fe5540049e0 tx=0x7fe554001e50).stop 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 shutdown_connections 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe54405ee20 0x7fe5440612e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640c2e70 0x7fe5640c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe550004690 0x7fe5640b0400 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 --2- 172.21.15.27:0/2061944007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe564153a80 0x7fe5640c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.248+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 >> 172.21.15.27:0/2061944007 conn(0x7fe5640cb7f0 msgr2=0x7fe5640bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:34.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.249+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 shutdown_connections 2023-05-17T15:27:34.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.249+0000 7fe5690c7700 1 -- 172.21.15.27:0/2061944007 wait complete. 2023-05-17T15:27:34.265 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:27:34.266 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:27:34.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:27:34.327 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:27:34.327 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:27:34.328 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:34.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.444+0000 7f62b7694700 1 Processor -- start 2023-05-17T15:27:34.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.444+0000 7f62b7694700 1 -- start start 2023-05-17T15:27:34.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b7694700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 0x7f62b0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b7694700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62b014fc30 0x7f62b00c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b7694700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b0152b60 con 0x7f62b00c5040 2023-05-17T15:27:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b7694700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b00a6e70 con 0x7f62b014fc30 2023-05-17T15:27:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b7694700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00a7150 con 0x7f62b014f850 2023-05-17T15:27:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b5c31700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f62b00c5040 0x7f62b00bd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44576/0 (socket says 172.21.15.27:44576) 2023-05-17T15:27:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.445+0000 7f62b5c31700 1 -- 172.21.15.27:0/505376866 learned_addr learned my addr 172.21.15.27:0/505376866 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 0x7f62b0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960201590 0 0) 0x7f62b0152b60 con 0x7f62b00c5040 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b4c2f700 1 --2- 172.21.15.27:0/505376866 >> v2:172.21.15.40:3300/0 conn(0x7f62b014fc30 0x7f62b00c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f629c0033f0 con 0x7f62b00c5040 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509006105 0 0) 0x7f629c0033f0 con 0x7f62b00c5040 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 msgr2=0x7f62b0152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 0x7f62b0152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 >> v2:172.21.15.40:3300/0 conn(0x7f62b014fc30 msgr2=0x7f62b00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 --2- 172.21.15.27:0/505376866 >> v2:172.21.15.40:3300/0 conn(0x7f62b014fc30 0x7f62b00c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0152510 con 0x7f62b00c5040 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f62ac001470 con 0x7f62b00c5040 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 >> v1:172.21.15.27:6789/0 conn(0x7f62b00c5040 legacy=0x7f62b00bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f629c0038e0 0x7f629c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 0x7f629c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c004b80 0x7f629c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00a6e70 con 0x7f629c0038e0 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00a7150 con 0x7f629c004b80 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c00b8e0 con 0x7f62b014f850 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f629c0038e0 0x7f629c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b4c2f700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 0x7f629c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5c31700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c004b80 0x7f629c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 -- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 msgr2=0x7f629c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b014f850 0x7f629c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 -- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c004b80 msgr2=0x7f629c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c004b80 0x7f629c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.446+0000 7f62b5430700 1 -- 172.21.15.27:0/505376866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0033f0 con 0x7f629c0038e0 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b5430700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f629c0038e0 0x7f629c003d00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f62a800e210 tx=0x7f62a800b040).ready entity=mon.0 client_cookie=670e938abfb8377d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8009ac0 con 0x7f629c0038e0 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a800f040 con 0x7f629c0038e0 2023-05-17T15:27:34.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62a7fff700 1 -- 172.21.15.27:0/505376866 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a800ecd0 con 0x7f629c0038e0 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b7694700 1 -- 172.21.15.27:0/505376866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f629c0038e0 msgr2=0x7f629c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b7694700 1 --2- 172.21.15.27:0/505376866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f629c0038e0 0x7f629c003d00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f62a800e210 tx=0x7f62a800b040).stop 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b5c31700 1 -- 172.21.15.27:0/505376866 reap_dead start 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b7694700 1 -- 172.21.15.27:0/505376866 shutdown_connections 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b7694700 1 -- 172.21.15.27:0/505376866 >> 172.21.15.27:0/505376866 conn(0x7f62b00c8400 msgr2=0x7f62b00c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b7694700 1 -- 172.21.15.27:0/505376866 shutdown_connections 2023-05-17T15:27:34.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.447+0000 7f62b7694700 1 -- 172.21.15.27:0/505376866 wait complete. 2023-05-17T15:27:34.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.448+0000 7f62b7694700 1 Processor -- start 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.448+0000 7f62b7694700 1 -- start start 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b7694700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c0038e0 0x7f62b00ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b7694700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b00a5cb0 0x7f62b00c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b7694700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 0x7f62b00c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b7694700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b014b140 con 0x7f62b00a6130 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b7694700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0151500 con 0x7f629c0038e0 2023-05-17T15:27:34.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b7694700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0161ec0 con 0x7f62b00a5cb0 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b5c31700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 0x7f62b00c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.449+0000 7f62b5c31700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 0x7f62b00c0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45028/0 (socket says 172.21.15.27:45028) 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 -- 172.21.15.27:0/1950432291 learned_addr learned my addr 172.21.15.27:0/1950432291 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5430700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c0038e0 0x7f62b00ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b4c2f700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b00a5cb0 0x7f62b00c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 -- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b00a5cb0 msgr2=0x7f62b00c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b00a5cb0 0x7f62b00c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 -- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c0038e0 msgr2=0x7f62b00ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c0038e0 0x7f62b00ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 -- 172.21.15.27:0/1950432291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b014b2a0 con 0x7f62b00a6130 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b5c31700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 0x7f62b00c0e40 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f62b00a6720 tx=0x7f62ac001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac001bd0 con 0x7f62b00a6130 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac011590 con 0x7f62b00a6130 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac011910 con 0x7f62b00a6130 2023-05-17T15:27:34.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b014b580 con 0x7f62b00a6130 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.450+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b014bb40 con 0x7f62b00a6130 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.451+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b0162050 con 0x7f62b00a6130 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.451+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f62ac011cc0 con 0x7f62b00a6130 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.452+0000 7f62a57fa700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f629405ee20 0x7f62940612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.452+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f62ac079260 con 0x7f62b00a6130 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.452+0000 7f62b5430700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f629405ee20 0x7f62940612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.452+0000 7f62b5430700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f629405ee20 0x7f62940612e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f62a800afd0 tx=0x7f62a801a000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.456+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62ac04a820 con 0x7f62b00a6130 2023-05-17T15:27:34.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.672+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62b01527f0 con 0x7f62b00a6130 2023-05-17T15:27:34.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.672+0000 7f62a57fa700 1 -- 172.21.15.27:0/1950432291 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f62ac04de40 con 0x7f62b00a6130 2023-05-17T15:27:34.678 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:34.678 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1582505768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1582505768},{"type":"v1","addr":"172.21.15.40:6835","nonce":1582505768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3010972371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3010972371},{"type":"v1","addr":"172.21.15.27:6835","nonce":3010972371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1601234014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1601234014},{"type":"v1","addr":"172.21.15.27:6834","nonce":1601234014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":8031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1621107610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1621107610},{"type":"v1","addr":"172.21.15.40:6834","nonce":1621107610}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[]} 2023-05-17T15:27:34.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f629405ee20 msgr2=0x7f62940612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f629405ee20 0x7f62940612e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f62a800afd0 tx=0x7f62a801a000).stop 2023-05-17T15:27:34.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 msgr2=0x7f62b00c0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 0x7f62b00c0e40 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f62b00a6720 tx=0x7f62ac001e90).stop 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 shutdown_connections 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f629405ee20 0x7f62940612e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62b00a6130 0x7f62b00c0e40 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c0038e0 0x7f62b00ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 --2- 172.21.15.27:0/1950432291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b00a5cb0 0x7f62b00c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 >> 172.21.15.27:0/1950432291 conn(0x7f62b00c8400 msgr2=0x7f62b00c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 shutdown_connections 2023-05-17T15:27:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.674+0000 7f62b7694700 1 -- 172.21.15.27:0/1950432291 wait complete. 2023-05-17T15:27:34.681 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 62 2023-05-17T15:27:34.691 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:27:34.691 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:27:34.691 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:27:34.692 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:27:34.692 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:27:34.692 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:27:34.692 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:27:34.693 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:27:34.693 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:27:34.693 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:27:34.693 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:27:34.693 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:27:34.694 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:27:34.694 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:27:34.694 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:27:34.694 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:27:34.700 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:27:34.700 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:27:34.701 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:27:34.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:27:34.705 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:27:34.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:27:34.706 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:27:34.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:27:34.743 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:27:34.744 DEBUG:teuthology.parallel:result is None 2023-05-17T15:27:34.745 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:27:34.745 DEBUG:teuthology.parallel:result is None 2023-05-17T15:27:34.747 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:27:34.747 DEBUG:teuthology.parallel:result is None 2023-05-17T15:27:34.748 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:27:34.749 DEBUG:teuthology.parallel:result is None 2023-05-17T15:27:34.749 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:27:34.816 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:27:34.817 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:27:34.831 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:27:34.832 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:27:34.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.870+0000 7f59b2746700 1 Processor -- start 2023-05-17T15:27:34.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.870+0000 7f59b2746700 1 -- start start 2023-05-17T15:27:34.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59b2746700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59ac069610 0x7f59ac15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59b2746700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ac0c5a50 con 0x7f59ac154470 2023-05-17T15:27:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59b2746700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ac0c04e0 con 0x7f59ac154090 2023-05-17T15:27:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59b2746700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ac069fa0 con 0x7f59ac069610 2023-05-17T15:27:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59ab7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f59ac154470 0x7f59ac068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44624/0 (socket says 172.21.15.27:44624) 2023-05-17T15:27:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59ab7fe700 1 -- 172.21.15.27:0/3468463619 learned_addr learned my addr 172.21.15.27:0/3468463619 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59b0ce3700 1 --2- 172.21.15.27:0/3468463619 >> v2:172.21.15.40:3300/0 conn(0x7f59ac069610 0x7f59ac15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.871+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138870928 0 0) 0x7f59ac0c5a50 con 0x7f59ac154470 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59980033f0 con 0x7f59ac154470 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712467728 0 0) 0x7f59980033f0 con 0x7f59ac154470 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 >> v2:172.21.15.40:3300/0 conn(0x7f59ac069610 msgr2=0x7f59ac15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 --2- 172.21.15.27:0/3468463619 >> v2:172.21.15.40:3300/0 conn(0x7f59ac069610 0x7f59ac15ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 >> v1:172.21.15.40:6789/0 conn(0x7f59ac154090 legacy=0x7f59ac0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0c0760 con 0x7f59ac154470 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5994001470 con 0x7f59ac154470 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 >> v1:172.21.15.27:6789/0 conn(0x7f59ac154470 legacy=0x7f59ac068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59980038e0 0x7f5998003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5998004690 0x7f5998004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5998005000 0x7f599800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac069fa0 con 0x7f5998004690 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599800be00 con 0x7f59980038e0 2023-05-17T15:27:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599800bfc0 con 0x7f5998005000 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5998004690 0x7f5998004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59abfff700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59980038e0 0x7f5998003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59b0ce3700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5998005000 0x7f599800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 -- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5998005000 msgr2=0x7f599800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5998005000 0x7f599800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 -- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59980038e0 msgr2=0x7f5998003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59980038e0 0x7f5998003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59b0ce3700 1 -- 172.21.15.27:0/3468463619 reap_dead start 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 -- 172.21.15.27:0/3468463619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980033f0 con 0x7f5998004690 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.872+0000 7f59ab7fe700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5998004690 0x7f5998004b10 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f599400c1e0 tx=0x7f59ac0c1030).ready entity=mon.0 client_cookie=191e1c082b0ccf60 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994007a60 con 0x7f5998004690 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400cab0 con 0x7f5998004690 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59aaffd700 1 -- 172.21.15.27:0/3468463619 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400ce50 con 0x7f5998004690 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 -- 172.21.15.27:0/3468463619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5998004690 msgr2=0x7f5998004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5998004690 0x7f5998004b10 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f599400c1e0 tx=0x7f59ac0c1030).stop 2023-05-17T15:27:34.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 -- 172.21.15.27:0/3468463619 shutdown_connections 2023-05-17T15:27:34.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 --2- 172.21.15.27:0/3468463619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5998004690 0x7f5998004b10 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 -- 172.21.15.27:0/3468463619 >> 172.21.15.27:0/3468463619 conn(0x7f59ac05e7e0 msgr2=0x7f59ac0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:34.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 -- 172.21.15.27:0/3468463619 shutdown_connections 2023-05-17T15:27:34.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.873+0000 7f59b2746700 1 -- 172.21.15.27:0/3468463619 wait complete. 2023-05-17T15:27:34.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.874+0000 7f59b2746700 1 Processor -- start 2023-05-17T15:27:34.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.874+0000 7f59b2746700 1 -- start start 2023-05-17T15:27:34.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b2746700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5998004690 0x7f59ac0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b2746700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ac157020 0x7f59ac1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b2746700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 0x7f59ac168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b2746700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0b0160 con 0x7f59ac167cc0 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b2746700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac168610 con 0x7f5998004690 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b2746700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0af8c0 con 0x7f59ac157020 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b0ce3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 0x7f59ac168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5998004690 0x7f59ac0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b0ce3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 0x7f59ac168120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45076/0 (socket says 172.21.15.27:45076) 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59b0ce3700 1 -- 172.21.15.27:0/620584353 learned_addr learned my addr 172.21.15.27:0/620584353 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.875+0000 7f59ab7fe700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ac157020 0x7f59ac1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b0ce3700 1 -- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ac157020 msgr2=0x7f59ac1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b0ce3700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ac157020 0x7f59ac1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b0ce3700 1 -- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5998004690 msgr2=0x7f59ac0c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b0ce3700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5998004690 0x7f59ac0c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:34.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b0ce3700 1 -- 172.21.15.27:0/620584353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0afba0 con 0x7f59ac167cc0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b0ce3700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 0x7f59ac168120 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f59ac0842a0 tx=0x7f59a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400e040 con 0x7f59ac167cc0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400f040 con 0x7f59ac167cc0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ac0afe80 con 0x7f59ac167cc0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400fd70 con 0x7f59ac167cc0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.876+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ac0c4ac0 con 0x7f59ac167cc0 2023-05-17T15:27:34.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.877+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ac0690e0 con 0x7f59ac167cc0 2023-05-17T15:27:34.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.877+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f59a4015660 con 0x7f59ac167cc0 2023-05-17T15:27:34.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.877+0000 7f59a3fff700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f598c05ee20 0x7f598c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:34.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.878+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f59a407a6a0 con 0x7f59ac167cc0 2023-05-17T15:27:34.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.878+0000 7f59abfff700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f598c05ee20 0x7f598c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:34.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.878+0000 7f59abfff700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f598c05ee20 0x7f598c0612e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f599c000c00 tx=0x7f599c007b90).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:34.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:34.882+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59a404bc60 con 0x7f59ac167cc0 2023-05-17T15:27:35.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.072+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f59ac0c1dc0 con 0x7f59ac167cc0 2023-05-17T15:27:35.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:35.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:35.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.926+0000 7f59a3fff700 1 -- 172.21.15.27:0/620584353 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v156) v1 ==== 97+0+0 (secure 0 0 0) 0x7f59a404f280 con 0x7f59ac167cc0 2023-05-17T15:27:35.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f598c05ee20 msgr2=0x7f598c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:35.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f598c05ee20 0x7f598c0612e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f599c000c00 tx=0x7f599c007b90).stop 2023-05-17T15:27:35.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 msgr2=0x7f59ac168120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:35.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 0x7f59ac168120 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f59ac0842a0 tx=0x7f59a400b040).stop 2023-05-17T15:27:35.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 shutdown_connections 2023-05-17T15:27:35.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f598c05ee20 0x7f598c0612e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:35.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac167cc0 0x7f59ac168120 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:35.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5998004690 0x7f59ac0c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:35.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 --2- 172.21.15.27:0/620584353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ac157020 0x7f59ac1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:35.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 >> 172.21.15.27:0/620584353 conn(0x7f59ac05e7e0 msgr2=0x7f59ac0c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:35.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 shutdown_connections 2023-05-17T15:27:35.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:35.929+0000 7f59b2746700 1 -- 172.21.15.27:0/620584353 wait complete. 2023-05-17T15:27:35.936 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:27:35.949 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:27:36.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.068+0000 7f874b39e700 1 Processor -- start 2023-05-17T15:27:36.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.068+0000 7f874b39e700 1 -- start start 2023-05-17T15:27:36.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874b39e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874b39e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f87441544f0 0x7f87440a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874b39e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87440aa070 0x7f87440c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874b39e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440c07e0 con 0x7f87441544f0 2023-05-17T15:27:36.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874b39e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87441549b0 con 0x7f87440aa070 2023-05-17T15:27:36.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874b39e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8744154c90 con 0x7f87440c1180 2023-05-17T15:27:36.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f87441544f0 0x7f87440a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f87441544f0 0x7f87440a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45084/0 (socket says 172.21.15.27:45084) 2023-05-17T15:27:36.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 -- 172.21.15.27:0/50267362 learned_addr learned my addr 172.21.15.27:0/50267362 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:36.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874a39c700 1 --2- 172.21.15.27:0/50267362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874ab9d700 1 --2- 172.21.15.27:0/50267362 >> v2:172.21.15.40:3300/0 conn(0x7f87440aa070 0x7f87440c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 -- 172.21.15.27:0/50267362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 msgr2=0x7f87440c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 --2- 172.21.15.27:0/50267362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 -- 172.21.15.27:0/50267362 >> v2:172.21.15.40:3300/0 conn(0x7f87440aa070 msgr2=0x7f87440c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 --2- 172.21.15.27:0/50267362 >> v2:172.21.15.40:3300/0 conn(0x7f87440aa070 0x7f87440c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 -- 172.21.15.27:0/50267362 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744154f70 con 0x7f87441544f0 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f8749b9b700 1 --2- 172.21.15.27:0/50267362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87441544f0 0x7f87440a9b80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f87440aa8b0 tx=0x7f87340090f0).ready entity=mon.0 client_cookie=8a3eb5c28d256b12 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874939a700 1 -- 172.21.15.27:0/50267362 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873400b600 con 0x7f87441544f0 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874939a700 1 -- 172.21.15.27:0/50267362 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873400b760 con 0x7f87441544f0 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.069+0000 7f874939a700 1 -- 172.21.15.27:0/50267362 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873400bb00 con 0x7f87441544f0 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 -- 172.21.15.27:0/50267362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87441544f0 msgr2=0x7f87440a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 --2- 172.21.15.27:0/50267362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87441544f0 0x7f87440a9b80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f87440aa8b0 tx=0x7f87340090f0).stop 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 -- 172.21.15.27:0/50267362 shutdown_connections 2023-05-17T15:27:36.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 --2- 172.21.15.27:0/50267362 >> v2:172.21.15.40:3300/0 conn(0x7f87440aa070 0x7f87440c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 --2- 172.21.15.27:0/50267362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 --2- 172.21.15.27:0/50267362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87441544f0 0x7f87440a9b80 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 -- 172.21.15.27:0/50267362 >> 172.21.15.27:0/50267362 conn(0x7f874405dd50 msgr2=0x7f874405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 -- 172.21.15.27:0/50267362 shutdown_connections 2023-05-17T15:27:36.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.070+0000 7f874b39e700 1 -- 172.21.15.27:0/50267362 wait complete. 2023-05-17T15:27:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.071+0000 7f874b39e700 1 Processor -- start 2023-05-17T15:27:36.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.071+0000 7f874b39e700 1 -- start start 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874b39e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 0x7f8744151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874b39e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874b39e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441544f0 0x7f87440c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874b39e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8744151840 con 0x7f87440aa070 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874b39e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440af780 con 0x7f87441544f0 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874b39e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8744150c30 con 0x7f87440c1180 2023-05-17T15:27:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 0x7f8744151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 0x7f8744151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45088/0 (socket says 172.21.15.27:45088) 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 -- 172.21.15.27:0/1414683573 learned_addr learned my addr 172.21.15.27:0/1414683573 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 -- 172.21.15.27:0/1414683573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 msgr2=0x7f87440af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 -- 172.21.15.27:0/1414683573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441544f0 msgr2=0x7f87440c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441544f0 0x7f87440c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 -- 172.21.15.27:0/1414683573 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009370 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f874a39c700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 0x7f8744151cd0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f874000d890 tx=0x7f8740008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.072+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400125f0 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.073+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740012750 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.073+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8744150f10 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.073+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740012ad0 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.073+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87441514d0 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.073+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874406bdf0 con 0x7f87440aa070 2023-05-17T15:27:36.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.074+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f8740013480 con 0x7f87440aa070 2023-05-17T15:27:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.074+0000 7f873a7fc700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f872805ee20 0x7f87280612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.074+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f8740079810 con 0x7f87440aa070 2023-05-17T15:27:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.074+0000 7f8749b9b700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f872805ee20 0x7f87280612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.075+0000 7f8749b9b700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f872805ee20 0x7f87280612e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f87440b0c40 tx=0x7f8734017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.079+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f874004b020 con 0x7f87440aa070 2023-05-17T15:27:36.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.316+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f87440bfb80 con 0x7f87440aa070 2023-05-17T15:27:36.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.316+0000 7f873a7fc700 1 -- 172.21.15.27:0/1414683573 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f874004e640 con 0x7f87440aa070 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:27:36.322 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.323 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.324 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:27:36.325 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:27:36.326 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.327 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.329 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.330 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.331 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:27:36.332 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.335 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:27:36.336 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.337 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:27:36.338 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.339 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:27:36.340 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:27:36.341 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:27:36.342 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.343 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.344 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:27:36.345 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:36.346 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:27:36.346 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:27:36.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f872805ee20 msgr2=0x7f87280612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f872805ee20 0x7f87280612e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f87440b0c40 tx=0x7f8734017000).stop 2023-05-17T15:27:36.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 msgr2=0x7f8744151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 0x7f8744151cd0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f874000d890 tx=0x7f8740008040).stop 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 shutdown_connections 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f872805ee20 0x7f87280612e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441544f0 0x7f87440c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87440aa070 0x7f8744151cd0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 --2- 172.21.15.27:0/1414683573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87440c1180 0x7f87440af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 >> 172.21.15.27:0/1414683573 conn(0x7f874405dd50 msgr2=0x7f87440ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:36.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.318+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 shutdown_connections 2023-05-17T15:27:36.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.319+0000 7f874b39e700 1 -- 172.21.15.27:0/1414683573 wait complete. 2023-05-17T15:27:36.349 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:36.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.460+0000 7f5604319700 1 Processor -- start 2023-05-17T15:27:36.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.460+0000 7f5604319700 1 -- start start 2023-05-17T15:27:36.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f5604319700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 0x7f55fc0bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f5604319700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0c4540 con 0x7f55fc153e40 2023-05-17T15:27:36.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f5604319700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0c36b0 con 0x7f55fc154220 2023-05-17T15:27:36.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f5604319700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1546a0 con 0x7f55fc065af0 2023-05-17T15:27:36.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f56020b5700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f55fc153e40 0x7f55fc0c49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44658/0 (socket says 172.21.15.27:44658) 2023-05-17T15:27:36.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f56020b5700 1 -- 172.21.15.27:0/3085334027 learned_addr learned my addr 172.21.15.27:0/3085334027 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:36.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910642796 0 0) 0x7f55fc0c4540 con 0x7f55fc153e40 2023-05-17T15:27:36.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e40033f0 con 0x7f55fc153e40 2023-05-17T15:27:36.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.461+0000 7f56028b6700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 0x7f55fc0bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 615352781 0 0) 0x7f55e40033f0 con 0x7f55fc153e40 2023-05-17T15:27:36.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 msgr2=0x7f55fc0bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 0x7f55fc0bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 >> v1:172.21.15.40:6789/0 conn(0x7f55fc154220 legacy=0x7f55fc0653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0c3930 con 0x7f55fc153e40 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f55f4001470 con 0x7f55fc153e40 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 >> v1:172.21.15.27:6789/0 conn(0x7f55fc153e40 legacy=0x7f55fc0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 0x7f55e4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4004b80 0x7f55e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1546a0 con 0x7f55e4003e40 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400b990 con 0x7f55e4004b80 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400bb50 con 0x7f55fc065af0 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56018b4700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56020b5700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 0x7f55e4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56028b6700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4004b80 0x7f55e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56018b4700 1 -- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 msgr2=0x7f55e4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56018b4700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc065af0 0x7f55e4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56018b4700 1 -- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4004b80 msgr2=0x7f55e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56018b4700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4004b80 0x7f55e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.462+0000 7f56018b4700 1 -- 172.21.15.27:0/3085334027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40033f0 con 0x7f55e4003e40 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f56018b4700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55e4004690 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f55f0001730 tx=0x7f55f0007bb0).ready entity=mon.0 client_cookie=93e5f6e8edd4fd9a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0007020 con 0x7f55e4003e40 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f0007180 con 0x7f55e4003e40 2023-05-17T15:27:36.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f56010b3700 1 -- 172.21.15.27:0/3085334027 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0007500 con 0x7f55e4003e40 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f5604319700 1 -- 172.21.15.27:0/3085334027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 msgr2=0x7f55e4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f5604319700 1 --2- 172.21.15.27:0/3085334027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55e4004690 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f55f0001730 tx=0x7f55f0007bb0).stop 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f56028b6700 1 -- 172.21.15.27:0/3085334027 reap_dead start 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f5604319700 1 -- 172.21.15.27:0/3085334027 shutdown_connections 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f5604319700 1 -- 172.21.15.27:0/3085334027 >> 172.21.15.27:0/3085334027 conn(0x7f55fc0c9560 msgr2=0x7f55fc0c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f5604319700 1 -- 172.21.15.27:0/3085334027 shutdown_connections 2023-05-17T15:27:36.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.463+0000 7f5604319700 1 -- 172.21.15.27:0/3085334027 wait complete. 2023-05-17T15:27:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.464+0000 7f5604319700 1 Processor -- start 2023-05-17T15:27:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.464+0000 7f5604319700 1 -- start start 2023-05-17T15:27:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f5604319700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55fc137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f5604319700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc138290 0x7f55fc168250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f5604319700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55fc168740 0x7f55fc0aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f5604319700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c2850 con 0x7f55e4003e40 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f5604319700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c1c40 con 0x7f55fc168740 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f5604319700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c1f20 con 0x7f55fc138290 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f56020b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55fc137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f56020b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55fc137da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45108/0 (socket says 172.21.15.27:45108) 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f56020b5700 1 -- 172.21.15.27:0/3233663215 learned_addr learned my addr 172.21.15.27:0/3233663215 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f56018b4700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc138290 0x7f55fc168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.465+0000 7f56028b6700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55fc168740 0x7f55fc0aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56020b5700 1 -- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc138290 msgr2=0x7f55fc168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56020b5700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc138290 0x7f55fc168250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56020b5700 1 -- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55fc168740 msgr2=0x7f55fc0aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56020b5700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55fc168740 0x7f55fc0aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56020b5700 1 -- 172.21.15.27:0/3233663215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0c2200 con 0x7f55e4003e40 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56028b6700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55fc168740 0x7f55fc0aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:36.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f56020b5700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55fc137da0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f55f40046b0 tx=0x7f55f4001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4011590 con 0x7f55e4003e40 2023-05-17T15:27:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40116f0 con 0x7f55e4003e40 2023-05-17T15:27:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc0c24e0 con 0x7f55e4003e40 2023-05-17T15:27:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4011a70 con 0x7f55e4003e40 2023-05-17T15:27:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.466+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc167d80 con 0x7f55e4003e40 2023-05-17T15:27:36.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.467+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc06bdf0 con 0x7f55e4003e40 2023-05-17T15:27:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.467+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f55f401b030 con 0x7f55e4003e40 2023-05-17T15:27:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.468+0000 7f55fa7fc700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f55e805ee50 0x7f55e8061310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.468+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f55f4078f80 con 0x7f55e4003e40 2023-05-17T15:27:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.468+0000 7f56018b4700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f55e805ee50 0x7f55e8061310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.468+0000 7f56018b4700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f55e805ee50 0x7f55e8061310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f55f0001010 tx=0x7f55f0015000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.472+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55f404a840 con 0x7f55e4003e40 2023-05-17T15:27:36.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.647+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55fc0c3c10 con 0x7f55e4003e40 2023-05-17T15:27:36.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.648+0000 7f55fa7fc700 1 -- 172.21.15.27:0/3233663215 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+13882 (secure 0 0 0) 0x7f55f4019030 con 0x7f55e4003e40 2023-05-17T15:27:36.653 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:36.653 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":156,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:35.921273+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:36.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f55e805ee50 msgr2=0x7f55e8061310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f55e805ee50 0x7f55e8061310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f55f0001010 tx=0x7f55f0015000).stop 2023-05-17T15:27:36.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 msgr2=0x7f55fc137da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55fc137da0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f55f40046b0 tx=0x7f55f4001e50).stop 2023-05-17T15:27:36.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 shutdown_connections 2023-05-17T15:27:36.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f55e805ee50 0x7f55e8061310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55fc168740 0x7f55fc0aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55e4003e40 0x7f55fc137da0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 --2- 172.21.15.27:0/3233663215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f55fc138290 0x7f55fc168250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 >> 172.21.15.27:0/3233663215 conn(0x7f55fc0c9560 msgr2=0x7f55fc0bf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 shutdown_connections 2023-05-17T15:27:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.650+0000 7f5604319700 1 -- 172.21.15.27:0/3233663215 wait complete. 2023-05-17T15:27:36.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:27:36.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:27:36.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.781+0000 7f3b0eb6d700 1 Processor -- start 2023-05-17T15:27:36.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.781+0000 7f3b0eb6d700 1 -- start start 2023-05-17T15:27:36.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0eb6d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b081543d0 0x7f3b080c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0eb6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b080c60f0 0x7f3b08068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0eb6d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3b080691f0 0x7f3b081547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0eb6d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080c1c50 con 0x7f3b080691f0 2023-05-17T15:27:36.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0eb6d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b08158790 con 0x7f3b081543d0 2023-05-17T15:27:36.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0eb6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080c6570 con 0x7f3b080c60f0 2023-05-17T15:27:36.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3b080691f0 0x7f3b081547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3b080691f0 0x7f3b081547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45120/0 (socket says 172.21.15.27:45120) 2023-05-17T15:27:36.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 -- 172.21.15.27:0/666114109 learned_addr learned my addr 172.21.15.27:0/666114109 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:36.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b07fff700 1 --2- 172.21.15.27:0/666114109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b080c60f0 0x7f3b08068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0c909700 1 --2- 172.21.15.27:0/666114109 >> v2:172.21.15.40:3300/0 conn(0x7f3b081543d0 0x7f3b080c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 -- 172.21.15.27:0/666114109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b080c60f0 msgr2=0x7f3b08068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 --2- 172.21.15.27:0/666114109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b080c60f0 0x7f3b08068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 -- 172.21.15.27:0/666114109 >> v2:172.21.15.40:3300/0 conn(0x7f3b081543d0 msgr2=0x7f3b080c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 --2- 172.21.15.27:0/666114109 >> v2:172.21.15.40:3300/0 conn(0x7f3b081543d0 0x7f3b080c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 -- 172.21.15.27:0/666114109 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08157e60 con 0x7f3b080691f0 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.782+0000 7f3b0d10a700 1 --2- 172.21.15.27:0/666114109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b081547b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f3b08155970 tx=0x7f3af80090f0).ready entity=mon.0 client_cookie=153974bf0959d3a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b077fe700 1 -- 172.21.15.27:0/666114109 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800b600 con 0x7f3b080691f0 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b077fe700 1 -- 172.21.15.27:0/666114109 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800b760 con 0x7f3b080691f0 2023-05-17T15:27:36.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b077fe700 1 -- 172.21.15.27:0/666114109 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800bae0 con 0x7f3b080691f0 2023-05-17T15:27:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/666114109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 msgr2=0x7f3b081547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/666114109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b081547b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f3b08155970 tx=0x7f3af80090f0).stop 2023-05-17T15:27:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/666114109 shutdown_connections 2023-05-17T15:27:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/666114109 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b081547b0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/666114109 >> v2:172.21.15.40:3300/0 conn(0x7f3b081543d0 0x7f3b080c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/666114109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b080c60f0 0x7f3b08068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/666114109 >> 172.21.15.27:0/666114109 conn(0x7f3b080cb7f0 msgr2=0x7f3b080c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:36.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/666114109 shutdown_connections 2023-05-17T15:27:36.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.783+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/666114109 wait complete. 2023-05-17T15:27:36.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.784+0000 7f3b0eb6d700 1 Processor -- start 2023-05-17T15:27:36.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.784+0000 7f3b0eb6d700 1 -- start start 2023-05-17T15:27:36.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0eb6d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b08164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0eb6d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b080c60f0 0x7f3b081671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0eb6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b081543d0 0x7f3b080c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0eb6d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080c1dc0 con 0x7f3b080691f0 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0eb6d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081676b0 con 0x7f3b080c60f0 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0eb6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08164900 con 0x7f3b081543d0 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0c909700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b08164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0c909700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b08164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45122/0 (socket says 172.21.15.27:45122) 2023-05-17T15:27:36.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.785+0000 7f3b0c909700 1 -- 172.21.15.27:0/796991260 learned_addr learned my addr 172.21.15.27:0/796991260 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0c909700 1 -- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b081543d0 msgr2=0x7f3b080c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b07fff700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b080c60f0 0x7f3b081671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0d10a700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b081543d0 0x7f3b080c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0c909700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b081543d0 0x7f3b080c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0c909700 1 -- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b080c60f0 msgr2=0x7f3b081671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0c909700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b080c60f0 0x7f3b081671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0c909700 1 -- 172.21.15.27:0/796991260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009370 con 0x7f3b080691f0 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b07fff700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b080c60f0 0x7f3b081671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0d10a700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b081543d0 0x7f3b080c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0c909700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b08164360 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f3b0000ce10 tx=0x7f3b00007810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000ab90 con 0x7f3b080691f0 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0000acf0 con 0x7f3b080691f0 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08164be0 con 0x7f3b080691f0 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000f610 con 0x7f3b080691f0 2023-05-17T15:27:36.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.786+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b081651a0 con 0x7f3b080691f0 2023-05-17T15:27:36.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.787+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0806bdf0 con 0x7f3b080691f0 2023-05-17T15:27:36.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.787+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3b0001f070 con 0x7f3b080691f0 2023-05-17T15:27:36.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.787+0000 7f3b04ff9700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3af405ee20 0x7f3af40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:36.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.788+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f3b00079c70 con 0x7f3b080691f0 2023-05-17T15:27:36.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.788+0000 7f3b07fff700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3af405ee20 0x7f3af40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:36.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.788+0000 7f3b07fff700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3af405ee20 0x7f3af40612e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3b081537e0 tx=0x7f3afc008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:36.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.792+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b0004b4e0 con 0x7f3b080691f0 2023-05-17T15:27:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.966+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3b08069d00 con 0x7f3b080691f0 2023-05-17T15:27:36.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.966+0000 7f3b04ff9700 1 -- 172.21.15.27:0/796991260 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v156) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3b0001d070 con 0x7f3b080691f0 2023-05-17T15:27:36.971 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:27:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3af405ee20 msgr2=0x7f3af40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3af405ee20 0x7f3af40612e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3b081537e0 tx=0x7f3afc008040).stop 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 msgr2=0x7f3b08164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b08164360 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f3b0000ce10 tx=0x7f3b00007810).stop 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 shutdown_connections 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3af405ee20 0x7f3af40612e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b081543d0 0x7f3b080c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3b080691f0 0x7f3b08164360 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 --2- 172.21.15.27:0/796991260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b080c60f0 0x7f3b081671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 >> 172.21.15.27:0/796991260 conn(0x7f3b080cb7f0 msgr2=0x7f3b08157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:36.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 shutdown_connections 2023-05-17T15:27:36.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:36.968+0000 7f3b0eb6d700 1 -- 172.21.15.27:0/796991260 wait complete. 2023-05-17T15:27:36.985 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:27:37.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.098+0000 7fb978ee9700 1 Processor -- start 2023-05-17T15:27:37.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.098+0000 7fb978ee9700 1 -- start start 2023-05-17T15:27:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb978ee9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9740c6310 0x7fb974068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb978ee9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740691f0 0x7fb9740bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb978ee9700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb974158790 con 0x7fb9741543d0 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb978ee9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9740c1c50 con 0x7fb9740c6310 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb978ee9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974157e60 con 0x7fb9740691f0 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb971d9b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9740c6310 0x7fb974068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb97259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb9741543d0 0x7fb9740c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44692/0 (socket says 172.21.15.27:44692) 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.099+0000 7fb97259c700 1 -- 172.21.15.27:0/3102045570 learned_addr learned my addr 172.21.15.27:0/3102045570 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb972d9d700 1 --2- 172.21.15.27:0/3102045570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740691f0 0x7fb9740bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb971d9b700 1 -- 172.21.15.27:0/3102045570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740691f0 msgr2=0x7fb9740bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb971d9b700 1 --2- 172.21.15.27:0/3102045570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740691f0 0x7fb9740bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb971d9b700 1 -- 172.21.15.27:0/3102045570 >> v1:172.21.15.27:6789/0 conn(0x7fb9741543d0 legacy=0x7fb9740c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb971d9b700 1 -- 172.21.15.27:0/3102045570 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974158140 con 0x7fb9740c6310 2023-05-17T15:27:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb971d9b700 1 --2- 172.21.15.27:0/3102045570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740c6310 0x7fb974068d00 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fb95c009760 tx=0x7fb95c009060).ready entity=mon.0 client_cookie=522f75020a99337a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb97159a700 1 -- 172.21.15.27:0/3102045570 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00b580 con 0x7fb9740c6310 2023-05-17T15:27:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb97159a700 1 -- 172.21.15.27:0/3102045570 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00b6e0 con 0x7fb9740c6310 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.100+0000 7fb97159a700 1 -- 172.21.15.27:0/3102045570 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00ba60 con 0x7fb9740c6310 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 -- 172.21.15.27:0/3102045570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740c6310 msgr2=0x7fb974068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 --2- 172.21.15.27:0/3102045570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740c6310 0x7fb974068d00 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fb95c009760 tx=0x7fb95c009060).stop 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 -- 172.21.15.27:0/3102045570 shutdown_connections 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 --2- 172.21.15.27:0/3102045570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740691f0 0x7fb9740bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 --2- 172.21.15.27:0/3102045570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740c6310 0x7fb974068d00 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 -- 172.21.15.27:0/3102045570 >> 172.21.15.27:0/3102045570 conn(0x7fb9740cb7f0 msgr2=0x7fb9740c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 -- 172.21.15.27:0/3102045570 shutdown_connections 2023-05-17T15:27:37.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.101+0000 7fb978ee9700 1 -- 172.21.15.27:0/3102045570 wait complete. 2023-05-17T15:27:37.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.102+0000 7fb978ee9700 1 Processor -- start 2023-05-17T15:27:37.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.102+0000 7fb978ee9700 1 -- start start 2023-05-17T15:27:37.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 0x7fb974153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740c6310 0x7fb9740aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9741543d0 0x7fb9740accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740ae8a0 con 0x7fb9740691f0 2023-05-17T15:27:37.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740adcd0 con 0x7fb9741543d0 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974153760 con 0x7fb9740c6310 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 0x7fb974153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 0x7fb974153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45136/0 (socket says 172.21.15.27:45136) 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 -- 172.21.15.27:0/2874799693 learned_addr learned my addr 172.21.15.27:0/2874799693 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb971d9b700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740c6310 0x7fb9740aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb972d9d700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9741543d0 0x7fb9740accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 -- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740c6310 msgr2=0x7fb9740aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740c6310 0x7fb9740aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 -- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9741543d0 msgr2=0x7fb9740accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9741543d0 0x7fb9740accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 -- 172.21.15.27:0/2874799693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0092a0 con 0x7fb9740691f0 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb97259c700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 0x7fb974153270 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fb96c001eb0 tx=0x7fb96c007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0072e0 con 0x7fb9740691f0 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c007440 con 0x7fb9740691f0 2023-05-17T15:27:37.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9740adf70 con 0x7fb9740691f0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0057a0 con 0x7fb9740691f0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.103+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9740ae530 con 0x7fb9740691f0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.104+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97406bdf0 con 0x7fb9740691f0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.105+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb96c01a060 con 0x7fb9740691f0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.105+0000 7fb96a7fc700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb95405ee20 0x7fb9540612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.105+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5369+0+0 (secure 0 0 0) 0x7fb96c078f60 con 0x7fb9740691f0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.105+0000 7fb971d9b700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb95405ee20 0x7fb9540612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.105+0000 7fb971d9b700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb95405ee20 0x7fb9540612e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb9740c6710 tx=0x7fb95c017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.109+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb96c04a7d0 con 0x7fb9740691f0 2023-05-17T15:27:37.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.284+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9740aeb80 con 0x7fb9740691f0 2023-05-17T15:27:37.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.285+0000 7fb96a7fc700 1 -- 172.21.15.27:0/2874799693 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v156) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb96c04ddf0 con 0x7fb9740691f0 2023-05-17T15:27:37.290 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb95405ee20 msgr2=0x7fb9540612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb95405ee20 0x7fb9540612e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb9740c6710 tx=0x7fb95c017000).stop 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 msgr2=0x7fb974153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 0x7fb974153270 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fb96c001eb0 tx=0x7fb96c007e50).stop 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 shutdown_connections 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb95405ee20 0x7fb9540612e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9741543d0 0x7fb9740accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9740691f0 0x7fb974153270 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 --2- 172.21.15.27:0/2874799693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9740c6310 0x7fb9740aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 >> 172.21.15.27:0/2874799693 conn(0x7fb9740cb7f0 msgr2=0x7fb9740c0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 shutdown_connections 2023-05-17T15:27:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.287+0000 7fb978ee9700 1 -- 172.21.15.27:0/2874799693 wait complete. 2023-05-17T15:27:37.304 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:27:37.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.414+0000 7f2ab11ee700 1 Processor -- start 2023-05-17T15:27:37.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.414+0000 7f2ab11ee700 1 -- start start 2023-05-17T15:27:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2ab11ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 0x7f2aac153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2ab11ee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aac154260 0x7f2aac0c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2ab11ee700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0aa680 con 0x7f2aac0c60c0 2023-05-17T15:27:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2ab11ee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0c68e0 con 0x7f2aac154260 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2ab11ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac05e7e0 con 0x7f2aac0c64a0 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2aab59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aac154260 0x7f2aac0c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.415+0000 7f2aaa59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 0x7f2aac153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aaa59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 0x7f2aac153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:46258/0 (socket says 172.21.15.27:46258) 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aab59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aac154260 0x7f2aac0c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:34844/0 (socket says 172.21.15.27:34844) 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aaa59c700 1 -- 172.21.15.27:0/3049092200 learned_addr learned my addr 172.21.15.27:0/3049092200 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aaad9d700 1 --1- 172.21.15.27:0/3049092200 >> v1:172.21.15.40:6789/0 conn(0x7f2aac0c60c0 0x7f2aac0a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:50708/0 (socket says 172.21.15.27:50708) 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aa9d9b700 1 -- 172.21.15.27:0/3049092200 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153931006 0 0) 0x7f2aac0aa680 con 0x7f2aac0c60c0 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aa9d9b700 1 -- 172.21.15.27:0/3049092200 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a980033f0 con 0x7f2aac0c60c0 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aab59e700 1 -- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 msgr2=0x7f2aac153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aab59e700 1 --2- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 0x7f2aac153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aab59e700 1 -- 172.21.15.27:0/3049092200 >> v1:172.21.15.40:6789/0 conn(0x7f2aac0c60c0 legacy=0x7f2aac0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aab59e700 1 -- 172.21.15.27:0/3049092200 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac05eac0 con 0x7f2aac154260 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aaa59c700 1 --2- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 0x7f2aac153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aab59e700 1 --2- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac0c0850 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2a9c009e60 tx=0x7f2a9c009780).ready entity=mon.1 client_cookie=fd49a55ae6eb3340 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aa9d9b700 1 -- 172.21.15.27:0/3049092200 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00e070 con 0x7f2aac154260 2023-05-17T15:27:37.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aa9d9b700 1 -- 172.21.15.27:0/3049092200 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00bab0 con 0x7f2aac154260 2023-05-17T15:27:37.424 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.416+0000 7f2aa9d9b700 1 -- 172.21.15.27:0/3049092200 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00be30 con 0x7f2aac154260 2023-05-17T15:27:37.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 -- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 msgr2=0x7f2aac0c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac0c0850 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2a9c009e60 tx=0x7f2a9c009780).stop 2023-05-17T15:27:37.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 -- 172.21.15.27:0/3049092200 shutdown_connections 2023-05-17T15:27:37.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac0c0850 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/3049092200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c64a0 0x7f2aac153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 -- 172.21.15.27:0/3049092200 >> 172.21.15.27:0/3049092200 conn(0x7f2aac069e70 msgr2=0x7f2aac05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 -- 172.21.15.27:0/3049092200 shutdown_connections 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.417+0000 7f2ab11ee700 1 -- 172.21.15.27:0/3049092200 wait complete. 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.418+0000 7f2ab11ee700 1 Processor -- start 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.418+0000 7f2ab11ee700 1 -- start start 2023-05-17T15:27:37.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2ab11ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c60c0 0x7f2aac1650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2ab11ee700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 0x7f2aac0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2ab11ee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2ab11ee700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c2750 con 0x7f2aac0c64a0 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2ab11ee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac165590 con 0x7f2aac154260 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2ab11ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c29a0 con 0x7f2aac0c60c0 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 0x7f2aac0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 0x7f2aac0c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45152/0 (socket says 172.21.15.27:45152) 2023-05-17T15:27:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 -- 172.21.15.27:0/4115752762 learned_addr learned my addr 172.21.15.27:0/4115752762 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aab59e700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaad9d700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c60c0 0x7f2aac1650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 -- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c60c0 msgr2=0x7f2aac1650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c60c0 0x7f2aac1650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 -- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 msgr2=0x7f2aac156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 -- 172.21.15.27:0/4115752762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94009370 con 0x7f2aac0c64a0 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.419+0000 7f2aaa59c700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 0x7f2aac0c4e60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f2a9400ea20 tx=0x7f2a940090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.420+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400ee60 con 0x7f2aac0c64a0 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.420+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9400c850 con 0x7f2aac0c64a0 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.420+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400cbd0 con 0x7f2aac0c64a0 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.420+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c009a20 con 0x7f2aac0c64a0 2023-05-17T15:27:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.420+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac0c4660 con 0x7f2aac0c64a0 2023-05-17T15:27:37.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.420+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac05f4a0 con 0x7f2aac0c64a0 2023-05-17T15:27:37.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.421+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2a94022070 con 0x7f2aac0c64a0 2023-05-17T15:27:37.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.421+0000 7f2aa2ffd700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8c05edf0 0x7f2a8c0612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.421+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5369+0+0 (secure 0 0 0) 0x7f2a94079d20 con 0x7f2aac0c64a0 2023-05-17T15:27:37.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.421+0000 7f2aaad9d700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8c05edf0 0x7f2a8c0612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.422+0000 7f2aaad9d700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8c05edf0 0x7f2a8c0612b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2aac167b50 tx=0x7f2aa4000bc0).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.426+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a9404b610 con 0x7f2aac0c64a0 2023-05-17T15:27:37.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.600+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2aac06bdf0 con 0x7f2aac0c64a0 2023-05-17T15:27:37.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.600+0000 7f2aa2ffd700 1 -- 172.21.15.27:0/4115752762 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v156) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2a94016070 con 0x7f2aac0c64a0 2023-05-17T15:27:37.606 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:37.606 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:27:37.606 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:37.606 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:27:37.606 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:27:37.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:27:37.607 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:37.607 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:27:37.607 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:27:37.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:37.607 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:27:37.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8c05edf0 msgr2=0x7f2a8c0612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8c05edf0 0x7f2a8c0612b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2aac167b50 tx=0x7f2aa4000bc0).stop 2023-05-17T15:27:37.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 msgr2=0x7f2aac0c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 0x7f2aac0c4e60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f2a9400ea20 tx=0x7f2a940090f0).stop 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 shutdown_connections 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a8c05edf0 0x7f2a8c0612b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aac154260 0x7f2aac156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aac0c60c0 0x7f2aac1650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 --2- 172.21.15.27:0/4115752762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2aac0c64a0 0x7f2aac0c4e60 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 >> 172.21.15.27:0/4115752762 conn(0x7f2aac069e70 msgr2=0x7f2aac0a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:37.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 shutdown_connections 2023-05-17T15:27:37.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.602+0000 7f2ab11ee700 1 -- 172.21.15.27:0/4115752762 wait complete. 2023-05-17T15:27:37.619 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:27:37.619 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:27:37.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.735+0000 7fb296288700 1 Processor -- start 2023-05-17T15:27:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.735+0000 7fb296288700 1 -- start start 2023-05-17T15:27:37.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb296288700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb296288700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2900826e0 0x7fb2900aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb296288700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2900c1610 con 0x7fb2900aa130 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb296288700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900c0a00 con 0x7fb2900826e0 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb296288700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900c0ce0 con 0x7fb290153fa0 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb294825700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2900826e0 0x7fb2900aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb294825700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2900826e0 0x7fb2900aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45162/0 (socket says 172.21.15.27:45162) 2023-05-17T15:27:37.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb294825700 1 -- 172.21.15.27:0/789779053 learned_addr learned my addr 172.21.15.27:0/789779053 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.736+0000 7fb28ffff700 1 --2- 172.21.15.27:0/789779053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb294825700 1 -- 172.21.15.27:0/789779053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 msgr2=0x7fb2900c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb294825700 1 --2- 172.21.15.27:0/789779053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb294825700 1 -- 172.21.15.27:0/789779053 >> v1:172.21.15.40:6789/0 conn(0x7fb2900aa130 legacy=0x7fb290081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb294825700 1 -- 172.21.15.27:0/789779053 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900c0fc0 con 0x7fb2900826e0 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb294825700 1 --2- 172.21.15.27:0/789779053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900aae50 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fb288009f20 tx=0x7fb288009840).ready entity=mon.0 client_cookie=bcac2c2d2462dc60 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb28effd700 1 -- 172.21.15.27:0/789779053 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800e070 con 0x7fb2900826e0 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb28effd700 1 -- 172.21.15.27:0/789779053 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800b9d0 con 0x7fb2900826e0 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb28effd700 1 -- 172.21.15.27:0/789779053 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800bd50 con 0x7fb2900826e0 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb296288700 1 -- 172.21.15.27:0/789779053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 msgr2=0x7fb2900aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb296288700 1 --2- 172.21.15.27:0/789779053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900aae50 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fb288009f20 tx=0x7fb288009840).stop 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb296288700 1 -- 172.21.15.27:0/789779053 shutdown_connections 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb296288700 1 --2- 172.21.15.27:0/789779053 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900aae50 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb296288700 1 --2- 172.21.15.27:0/789779053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.737+0000 7fb296288700 1 -- 172.21.15.27:0/789779053 >> 172.21.15.27:0/789779053 conn(0x7fb29005e820 msgr2=0x7fb2900cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:37.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.738+0000 7fb296288700 1 -- 172.21.15.27:0/789779053 shutdown_connections 2023-05-17T15:27:37.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.738+0000 7fb296288700 1 -- 172.21.15.27:0/789779053 wait complete. 2023-05-17T15:27:37.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.739+0000 7fb296288700 1 Processor -- start 2023-05-17T15:27:37.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.739+0000 7fb296288700 1 -- start start 2023-05-17T15:27:37.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900aa130 0x7fb2900af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900a2bb0 con 0x7fb2900826e0 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb290165a70 con 0x7fb2900aa130 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900b02e0 con 0x7fb290153fa0 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45164/0 (socket says 172.21.15.27:45164) 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 -- 172.21.15.27:0/105973821 learned_addr learned my addr 172.21.15.27:0/105973821 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb294825700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28f7fe700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900aa130 0x7fb2900af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 -- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 msgr2=0x7fb2900afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 -- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900aa130 msgr2=0x7fb2900af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900aa130 0x7fb2900af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 -- 172.21.15.27:0/105973821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288009ae0 con 0x7fb2900826e0 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb294825700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:37.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28f7fe700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900aa130 0x7fb2900af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb28ffff700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900a95e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fb28000e900 tx=0x7fb280009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000c640 con 0x7fb2900826e0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28000c7a0 con 0x7fb2900826e0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2900b05c0 con 0x7fb2900826e0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000cb20 con 0x7fb2900826e0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.740+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2900a9ad0 con 0x7fb2900826e0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.741+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2900c1cf0 con 0x7fb2900826e0 2023-05-17T15:27:37.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.742+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb280022070 con 0x7fb2900826e0 2023-05-17T15:27:37.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.742+0000 7fb277fff700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb27c05ee20 0x7fb27c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:37.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.742+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5369+0+0 (secure 0 0 0) 0x7fb280079ba0 con 0x7fb2900826e0 2023-05-17T15:27:37.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.742+0000 7fb28f7fe700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb27c05ee20 0x7fb27c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:37.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.742+0000 7fb28f7fe700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb27c05ee20 0x7fb27c0612e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb2900c28f0 tx=0x7fb284009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:37.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.746+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb28004b410 con 0x7fb2900826e0 2023-05-17T15:27:37.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:37.919+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fb2900b0800 con 0x7fb2900826e0 2023-05-17T15:27:38.015 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.010+0000 7fb277fff700 1 -- 172.21.15.27:0/105973821 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v157) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb2900b0800 con 0x7fb2900826e0 2023-05-17T15:27:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb27c05ee20 msgr2=0x7fb27c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb27c05ee20 0x7fb27c0612e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb2900c28f0 tx=0x7fb284009040).stop 2023-05-17T15:27:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 msgr2=0x7fb2900a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900a95e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fb28000e900 tx=0x7fb280009060).stop 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 shutdown_connections 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb27c05ee20 0x7fb27c0612e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb290153fa0 0x7fb2900afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2900826e0 0x7fb2900a95e0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 --2- 172.21.15.27:0/105973821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900aa130 0x7fb2900af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 >> 172.21.15.27:0/105973821 conn(0x7fb29005e820 msgr2=0x7fb2900ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 shutdown_connections 2023-05-17T15:27:38.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.012+0000 7fb296288700 1 -- 172.21.15.27:0/105973821 wait complete. 2023-05-17T15:27:38.019 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:27:38.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:27:38.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.150+0000 7fa5db1ca700 1 Processor -- start 2023-05-17T15:27:38.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.150+0000 7fa5db1ca700 1 -- start start 2023-05-17T15:27:38.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.151+0000 7fa5db1ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 0x7fa5d40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:38.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.151+0000 7fa5db1ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40c60f0 0x7fa5d4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:38.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.151+0000 7fa5db1ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d40c0c90 con 0x7fa5d40691f0 2023-05-17T15:27:38.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.151+0000 7fa5db1ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d40c1c50 con 0x7fa5d41543d0 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.151+0000 7fa5db1ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d4158790 con 0x7fa5d40c60f0 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d8f66700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 0x7fa5d40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40c60f0 0x7fa5d4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d9767700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa5d40691f0 0x7fa5d41547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:50740/0 (socket says 172.21.15.27:50740) 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d8f66700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 0x7fa5d40c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:34870/0 (socket says 172.21.15.27:34870) 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d9767700 1 -- 172.21.15.27:0/3568555957 learned_addr learned my addr 172.21.15.27:0/3568555957 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:38.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d3fff700 1 -- 172.21.15.27:0/3568555957 >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 msgr2=0x7fa5d40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d3fff700 1 --2- 172.21.15.27:0/3568555957 >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 0x7fa5d40c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d3fff700 1 -- 172.21.15.27:0/3568555957 >> v1:172.21.15.40:6789/0 conn(0x7fa5d40691f0 legacy=0x7fa5d41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d3fff700 1 -- 172.21.15.27:0/3568555957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40c6570 con 0x7fa5d40c60f0 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d8f66700 1 --2- 172.21.15.27:0/3568555957 >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 0x7fa5d40c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d3fff700 1 --2- 172.21.15.27:0/3568555957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40c60f0 0x7fa5d4068d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa5c4009760 tx=0x7fa5c4009060).ready entity=mon.2 client_cookie=8202e5d19072f3f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d37fe700 1 -- 172.21.15.27:0/3568555957 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400f510 con 0x7fa5d40c60f0 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d37fe700 1 -- 172.21.15.27:0/3568555957 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c400f670 con 0x7fa5d40c60f0 2023-05-17T15:27:38.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.152+0000 7fa5d37fe700 1 -- 172.21.15.27:0/3568555957 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400f9f0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.161 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 -- 172.21.15.27:0/3568555957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40c60f0 msgr2=0x7fa5d4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/3568555957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40c60f0 0x7fa5d4068d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa5c4009760 tx=0x7fa5c4009060).stop 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 -- 172.21.15.27:0/3568555957 shutdown_connections 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/3568555957 >> v2:172.21.15.40:3300/0 conn(0x7fa5d41543d0 0x7fa5d40c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/3568555957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40c60f0 0x7fa5d4068d00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 -- 172.21.15.27:0/3568555957 >> 172.21.15.27:0/3568555957 conn(0x7fa5d40cb7f0 msgr2=0x7fa5d40c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 -- 172.21.15.27:0/3568555957 shutdown_connections 2023-05-17T15:27:38.162 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.153+0000 7fa5db1ca700 1 -- 172.21.15.27:0/3568555957 wait complete. 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.154+0000 7fa5db1ca700 1 Processor -- start 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.154+0000 7fa5db1ca700 1 -- start start 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5db1ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40691f0 0x7fa5d40ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5db1ca700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 0x7fa5d41510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5db1ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d41543d0 0x7fa5d40c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5db1ca700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40c22b0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5db1ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40c3170 con 0x7fa5d41543d0 2023-05-17T15:27:38.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5db1ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40c2560 con 0x7fa5d40691f0 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 0x7fa5d41510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 0x7fa5d41510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45180/0 (socket says 172.21.15.27:45180) 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 -- 172.21.15.27:0/1935291059 learned_addr learned my addr 172.21.15.27:0/1935291059 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d8f66700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40691f0 0x7fa5d40ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d9767700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d41543d0 0x7fa5d40c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 -- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40691f0 msgr2=0x7fa5d40ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:38.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40691f0 0x7fa5d40ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 -- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d41543d0 msgr2=0x7fa5d40c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d41543d0 0x7fa5d40c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d3fff700 1 -- 172.21.15.27:0/1935291059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc009a20 con 0x7fa5d40c60f0 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.155+0000 7fa5d9767700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d41543d0 0x7fa5d40c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.156+0000 7fa5d3fff700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 0x7fa5d41510c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fa5c4009e00 tx=0x7fa5c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.156+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40115d0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.156+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c401e070 con 0x7fa5d40c60f0 2023-05-17T15:27:38.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.156+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c40092a0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.156+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40119a0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.156+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d40c2b20 con 0x7fa5d40c60f0 2023-05-17T15:27:38.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.157+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d406bdf0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.157+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fa5c400f070 con 0x7fa5d40c60f0 2023-05-17T15:27:38.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.158+0000 7fa5d0ff9700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa5b405ee20 0x7fa5b40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:38.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.158+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fa5c407add0 con 0x7fa5d40c60f0 2023-05-17T15:27:38.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.158+0000 7fa5d8f66700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa5b405ee20 0x7fa5b40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:38.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.158+0000 7fa5d8f66700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa5b405ee20 0x7fa5b40612e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa5cc0099f0 tx=0x7fa5cc00b040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:38.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.162+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5c404c550 con 0x7fa5d40c60f0 2023-05-17T15:27:38.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:38.336+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa5d4157e60 con 0x7fa5d40c60f0 2023-05-17T15:27:39.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.017+0000 7fa5d0ff9700 1 -- 172.21.15.27:0/1935291059 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v158) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa5c4028070 con 0x7fa5d40c60f0 2023-05-17T15:27:39.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.022+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa5b405ee20 msgr2=0x7fa5b40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.022+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa5b405ee20 0x7fa5b40612e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa5cc0099f0 tx=0x7fa5cc00b040).stop 2023-05-17T15:27:39.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.022+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 msgr2=0x7fa5d41510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.022+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 0x7fa5d41510c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fa5c4009e00 tx=0x7fa5c4017000).stop 2023-05-17T15:27:39.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.023+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 shutdown_connections 2023-05-17T15:27:39.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.023+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa5b405ee20 0x7fa5b40612e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.023+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d41543d0 0x7fa5d40c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.023+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d40691f0 0x7fa5d40ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.023+0000 7fa5db1ca700 1 --2- 172.21.15.27:0/1935291059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5d40c60f0 0x7fa5d41510c0 secure :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0x7fa5c4009e00 tx=0x7fa5c4017000).stop 2023-05-17T15:27:39.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.023+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 >> 172.21.15.27:0/1935291059 conn(0x7fa5d40cb7f0 msgr2=0x7fa5d40bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:39.033 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.029+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 shutdown_connections 2023-05-17T15:27:39.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.030+0000 7fa5db1ca700 1 -- 172.21.15.27:0/1935291059 wait complete. 2023-05-17T15:27:39.047 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:27:39.061 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:27:39.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.179+0000 7fc77685d700 1 Processor -- start 2023-05-17T15:27:39.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.179+0000 7fc77685d700 1 -- start start 2023-05-17T15:27:39.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77685d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700c5fd0 0x7fc7700ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77685d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc770154e90 0x7fc7700a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77685d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc770155340 con 0x7fc7700acdb0 2023-05-17T15:27:39.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77685d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc770157de0 con 0x7fc770154e90 2023-05-17T15:27:39.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77685d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7701580c0 con 0x7fc7700c5fd0 2023-05-17T15:27:39.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77585b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc7700acdb0 0x7fc7700c58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44748/0 (socket says 172.21.15.27:44748) 2023-05-17T15:27:39.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77585b700 1 -- 172.21.15.27:0/2109787128 learned_addr learned my addr 172.21.15.27:0/2109787128 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:39.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77505a700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700c5fd0 0x7fc7700ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77605c700 1 --2- 172.21.15.27:0/2109787128 >> v2:172.21.15.40:3300/0 conn(0x7fc770154e90 0x7fc7700a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc774859700 1 -- 172.21.15.27:0/2109787128 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230881597 0 0) 0x7fc770155340 con 0x7fc7700acdb0 2023-05-17T15:27:39.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc774859700 1 -- 172.21.15.27:0/2109787128 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7580033f0 con 0x7fc7700acdb0 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc774859700 1 -- 172.21.15.27:0/2109787128 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3464130644 0 0) 0x7fc7580033f0 con 0x7fc7700acdb0 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77605c700 1 -- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700c5fd0 msgr2=0x7fc7700ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77605c700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700c5fd0 0x7fc7700ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77605c700 1 -- 172.21.15.27:0/2109787128 >> v1:172.21.15.27:6789/0 conn(0x7fc7700acdb0 legacy=0x7fc7700c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77605c700 1 -- 172.21.15.27:0/2109787128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7701583a0 con 0x7fc770154e90 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77505a700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700c5fd0 0x7fc7700ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:39.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.180+0000 7fc77605c700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700a97a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fc768009760 tx=0x7fc768009060).ready entity=mon.1 client_cookie=f0c23762fa7f74b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc774859700 1 -- 172.21.15.27:0/2109787128 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760001470 con 0x7fc770154e90 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc774859700 1 -- 172.21.15.27:0/2109787128 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768011400 con 0x7fc770154e90 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc774859700 1 -- 172.21.15.27:0/2109787128 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011780 con 0x7fc770154e90 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 -- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 msgr2=0x7fc7700a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700a97a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fc768009760 tx=0x7fc768009060).stop 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 -- 172.21.15.27:0/2109787128 shutdown_connections 2023-05-17T15:27:39.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700a97a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 --2- 172.21.15.27:0/2109787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700c5fd0 0x7fc7700ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 -- 172.21.15.27:0/2109787128 >> 172.21.15.27:0/2109787128 conn(0x7fc77005dd50 msgr2=0x7fc77005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 -- 172.21.15.27:0/2109787128 shutdown_connections 2023-05-17T15:27:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.181+0000 7fc77685d700 1 -- 172.21.15.27:0/2109787128 wait complete. 2023-05-17T15:27:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.182+0000 7fc77685d700 1 Processor -- start 2023-05-17T15:27:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.182+0000 7fc77685d700 1 -- start start 2023-05-17T15:27:39.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77685d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700acdb0 0x7fc770149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77685d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 0x7fc7700ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77685d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77685d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700c20d0 con 0x7fc7700c5fd0 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77685d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770168340 con 0x7fc770154e90 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77685d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700c1aa0 con 0x7fc7700acdb0 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 0x7fc7700ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 0x7fc7700ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45194/0 (socket says 172.21.15.27:45194) 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 -- 172.21.15.27:0/2751557862 learned_addr learned my addr 172.21.15.27:0/2751557862 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:39.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77605c700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77585b700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700acdb0 0x7fc770149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 -- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700acdb0 msgr2=0x7fc770149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700acdb0 0x7fc770149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 -- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 msgr2=0x7fc7700ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.183+0000 7fc77505a700 1 -- 172.21.15.27:0/2751557862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009a20 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.184+0000 7fc77505a700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 0x7fc7700ae3c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fc76400c170 tx=0x7fc76400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.184+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764009d20 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.184+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400f040 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.184+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7680092a0 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.184+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764013400 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.184+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7700af210 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.185+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7700c2210 con 0x7fc7700c5fd0 2023-05-17T15:27:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.185+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc7640137b0 con 0x7fc7700c5fd0 2023-05-17T15:27:39.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.186+0000 7fc76dffb700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc75c05ee20 0x7fc75c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.186+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc76407af80 con 0x7fc7700c5fd0 2023-05-17T15:27:39.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.186+0000 7fc77585b700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc75c05ee20 0x7fc75c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.186+0000 7fc77585b700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc75c05ee20 0x7fc75c0612e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc7600016e0 tx=0x7fc760001500).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.190+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc76404c580 con 0x7fc7700c5fd0 2023-05-17T15:27:39.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.407+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc7700c2210 con 0x7fc7700c5fd0 2023-05-17T15:27:39.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.416+0000 7fc76dffb700 1 -- 172.21.15.27:0/2751557862 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc7700c2210 con 0x7fc7700c5fd0 2023-05-17T15:27:39.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.420+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc75c05ee20 msgr2=0x7fc75c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.420+0000 7fc77685d700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc75c05ee20 0x7fc75c0612e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc7600016e0 tx=0x7fc760001500).stop 2023-05-17T15:27:39.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.420+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 msgr2=0x7fc7700ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.420+0000 7fc77685d700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 0x7fc7700ae3c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fc76400c170 tx=0x7fc76400b040).stop 2023-05-17T15:27:39.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.421+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 shutdown_connections 2023-05-17T15:27:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.421+0000 7fc77685d700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc75c05ee20 0x7fc75c0612e0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0x7fc7600016e0 tx=0x7fc760001500).stop 2023-05-17T15:27:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.421+0000 7fc77685d700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc770154e90 0x7fc7700ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.421+0000 7fc77685d700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7700acdb0 0x7fc770149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.421+0000 7fc77685d700 1 --2- 172.21.15.27:0/2751557862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7700c5fd0 0x7fc7700ae3c0 secure :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0x7fc76400c170 tx=0x7fc76400b040).stop 2023-05-17T15:27:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.421+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 >> 172.21.15.27:0/2751557862 conn(0x7fc77005dd50 msgr2=0x7fc7700ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:39.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.422+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 shutdown_connections 2023-05-17T15:27:39.428 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.422+0000 7fc77685d700 1 -- 172.21.15.27:0/2751557862 wait complete. 2023-05-17T15:27:39.431 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 19 and data pool 20 2023-05-17T15:27:39.447 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:39.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.558+0000 7f82b0319700 1 Processor -- start 2023-05-17T15:27:39.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.558+0000 7f82b0319700 1 -- start start 2023-05-17T15:27:39.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82b0319700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82a8066510 0x7f82a80668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82b0319700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82a8063340 0x7f82a80672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82b0319700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80643e0 con 0x7f82a8064870 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82b0319700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a8067790 con 0x7f82a8066510 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82b0319700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a80637d0 con 0x7f82a8063340 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82a8066510 0x7f82a80668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82a8066510 0x7f82a80668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45200/0 (socket says 172.21.15.27:45200) 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 -- 172.21.15.27:0/1554131619 learned_addr learned my addr 172.21.15.27:0/1554131619 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:39.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ad8b4700 1 --2- 172.21.15.27:0/1554131619 >> v2:172.21.15.40:3300/0 conn(0x7f82a8063340 0x7f82a80672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 -- 172.21.15.27:0/1554131619 >> v2:172.21.15.40:3300/0 conn(0x7f82a8063340 msgr2=0x7f82a80672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 --2- 172.21.15.27:0/1554131619 >> v2:172.21.15.40:3300/0 conn(0x7f82a8063340 0x7f82a80672a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 -- 172.21.15.27:0/1554131619 >> v1:172.21.15.40:6789/0 conn(0x7f82a8064870 legacy=0x7f82a8151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.559+0000 7f82ae0b5700 1 -- 172.21.15.27:0/1554131619 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8063ab0 con 0x7f82a8066510 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82ae0b5700 1 --2- 172.21.15.27:0/1554131619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8066510 0x7f82a80668f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f82a80c1630 tx=0x7f82a0009840).ready entity=mon.0 client_cookie=c4b0f2bce75ffa3b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82ad0b3700 1 -- 172.21.15.27:0/1554131619 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000e070 con 0x7f82a8066510 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82ad0b3700 1 -- 172.21.15.27:0/1554131619 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000ba50 con 0x7f82a8066510 2023-05-17T15:27:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82ad0b3700 1 -- 172.21.15.27:0/1554131619 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000bdd0 con 0x7f82a8066510 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 -- 172.21.15.27:0/1554131619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8066510 msgr2=0x7f82a80668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 --2- 172.21.15.27:0/1554131619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8066510 0x7f82a80668f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f82a80c1630 tx=0x7f82a0009840).stop 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 -- 172.21.15.27:0/1554131619 shutdown_connections 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 --2- 172.21.15.27:0/1554131619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8066510 0x7f82a80668f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 --2- 172.21.15.27:0/1554131619 >> v2:172.21.15.40:3300/0 conn(0x7f82a8063340 0x7f82a80672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 -- 172.21.15.27:0/1554131619 >> 172.21.15.27:0/1554131619 conn(0x7f82a8068750 msgr2=0x7f82a80c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:39.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 -- 172.21.15.27:0/1554131619 shutdown_connections 2023-05-17T15:27:39.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.560+0000 7f82b0319700 1 -- 172.21.15.27:0/1554131619 wait complete. 2023-05-17T15:27:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.561+0000 7f82b0319700 1 Processor -- start 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 -- start start 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 0x7f82a8164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a8066510 0x7f82a80c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a8164720 0x7f82a80c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80c6c30 con 0x7f82a8064870 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a81681b0 con 0x7f82a8066510 2023-05-17T15:27:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82b0319700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8168490 con 0x7f82a8164720 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82ae0b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 0x7f82a8164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82ae0b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 0x7f82a8164230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45206/0 (socket says 172.21.15.27:45206) 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82ae0b5700 1 -- 172.21.15.27:0/2499665488 learned_addr learned my addr 172.21.15.27:0/2499665488 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.562+0000 7f82ad8b4700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a8066510 0x7f82a80c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae8b6700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a8164720 0x7f82a80c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae0b5700 1 -- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a8164720 msgr2=0x7f82a80c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae0b5700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a8164720 0x7f82a80c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae0b5700 1 -- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a8066510 msgr2=0x7f82a80c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae0b5700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a8066510 0x7f82a80c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae0b5700 1 -- 172.21.15.27:0/2499665488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a0009ae0 con 0x7f82a8064870 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae8b6700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a8164720 0x7f82a80c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82ae0b5700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 0x7f82a8164230 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f82a0009fd0 tx=0x7f82a80bd9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0009500 con 0x7f82a8064870 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000bbc0 con 0x7f82a8064870 2023-05-17T15:27:39.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a8168770 con 0x7f82a8064870 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a001c400 con 0x7f82a8064870 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.563+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a8168d30 con 0x7f82a8064870 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.564+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a80c1400 con 0x7f82a8064870 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.564+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f82a001c770 con 0x7f82a8064870 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.565+0000 7f82a67fc700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f829405ee20 0x7f82940612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.565+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f82a007b590 con 0x7f82a8064870 2023-05-17T15:27:39.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.565+0000 7f82ad8b4700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f829405ee20 0x7f82940612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.565+0000 7f82ad8b4700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f829405ee20 0x7f82940612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f829c00bb20 tx=0x7f829c008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.569+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82a004c9a0 con 0x7f82a8064870 2023-05-17T15:27:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.745+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82a806bdf0 con 0x7f82a8064870 2023-05-17T15:27:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.746+0000 7f82a67fc700 1 -- 172.21.15.27:0/2499665488 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17115 (secure 0 0 0) 0x7f82a004ffc0 con 0x7f82a8064870 2023-05-17T15:27:39.752 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:39.752 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":159,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:39.409787+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:27:37.958967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-17T15:27:38.376205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:39.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f829405ee20 msgr2=0x7f82940612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f829405ee20 0x7f82940612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f829c00bb20 tx=0x7f829c008040).stop 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 msgr2=0x7f82a8164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 0x7f82a8164230 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f82a0009fd0 tx=0x7f82a80bd9b0).stop 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 shutdown_connections 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f829405ee20 0x7f82940612e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82a8164720 0x7f82a80c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82a8064870 0x7f82a8164230 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 --2- 172.21.15.27:0/2499665488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82a8066510 0x7f82a80c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 >> 172.21.15.27:0/2499665488 conn(0x7f82a8068750 msgr2=0x7f82a80a9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 shutdown_connections 2023-05-17T15:27:39.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.748+0000 7f82b0319700 1 -- 172.21.15.27:0/2499665488 wait complete. 2023-05-17T15:27:39.766 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:39.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.877+0000 7f5cbcb3b700 1 Processor -- start 2023-05-17T15:27:39.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.877+0000 7f5cbcb3b700 1 -- start start 2023-05-17T15:27:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cbcb3b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5cb8153fa0 0x7f5cb80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cbcb3b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80c07a0 con 0x7f5cb8069770 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cbcb3b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80bfe70 con 0x7f5cb80aae70 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cbcb3b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb8069d70 con 0x7f5cb8153fa0 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cb6d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5cb8069770 0x7f5cb80c0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44780/0 (socket says 172.21.15.27:44780) 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cb6d9d700 1 -- 172.21.15.27:0/3073118641 learned_addr learned my addr 172.21.15.27:0/3073118641 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cb659c700 1 --2- 172.21.15.27:0/3073118641 >> v2:172.21.15.40:3300/0 conn(0x7f5cb8153fa0 0x7f5cb80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512375793 0 0) 0x7f5cb80c07a0 con 0x7f5cb8069770 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.878+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca40033f0 con 0x7f5cb8069770 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718812341 0 0) 0x7f5cb80bfe70 con 0x7f5cb80aae70 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb80c07a0 con 0x7f5cb80aae70 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798658821 0 0) 0x7f5ca40033f0 con 0x7f5cb8069770 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 >> v2:172.21.15.40:3300/0 conn(0x7f5cb8153fa0 msgr2=0x7f5cb80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 --2- 172.21.15.27:0/3073118641 >> v2:172.21.15.40:3300/0 conn(0x7f5cb8153fa0 0x7f5cb80c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 >> v1:172.21.15.40:6789/0 conn(0x7f5cb80aae70 legacy=0x7f5cb8069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80c0150 con 0x7f5cb8069770 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5ca80017f0 con 0x7f5cb8069770 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 >> v1:172.21.15.27:6789/0 conn(0x7f5cb8069770 legacy=0x7f5cb80c0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ca4003ac0 0x7f5ca4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4004690 0x7f5ca4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca4005000 0x7f5ca400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8069d70 con 0x7f5ca4003ac0 2023-05-17T15:27:39.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca400beb0 con 0x7f5ca4004690 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca400c070 con 0x7f5ca4005000 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ca4003ac0 0x7f5ca4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb5d9b700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4004690 0x7f5ca4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb6d9d700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca4005000 0x7f5ca400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 -- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca4005000 msgr2=0x7f5ca400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca4005000 0x7f5ca400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 -- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4004690 msgr2=0x7f5ca4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4004690 0x7f5ca4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 -- 172.21.15.27:0/3073118641 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40033f0 con 0x7f5ca4003ac0 2023-05-17T15:27:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb6d9d700 1 -- 172.21.15.27:0/3073118641 reap_dead start 2023-05-17T15:27:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb5d9b700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4004690 0x7f5ca4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb659c700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ca4003ac0 0x7f5ca4003ec0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f5cb0009a80 tx=0x7f5cb0009060).ready entity=mon.0 client_cookie=2bb78cc7101936aa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0009430 con 0x7f5ca4003ac0 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb000e640 con 0x7f5ca4003ac0 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.879+0000 7f5cb559a700 1 -- 172.21.15.27:0/3073118641 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000e9c0 con 0x7f5ca4003ac0 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/3073118641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ca4003ac0 msgr2=0x7f5ca4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ca4003ac0 0x7f5ca4003ec0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f5cb0009a80 tx=0x7f5cb0009060).stop 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/3073118641 shutdown_connections 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/3073118641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ca4003ac0 0x7f5ca4003ec0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/3073118641 >> 172.21.15.27:0/3073118641 conn(0x7f5cb80cb810 msgr2=0x7f5cb80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/3073118641 shutdown_connections 2023-05-17T15:27:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.880+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/3073118641 wait complete. 2023-05-17T15:27:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.881+0000 7f5cbcb3b700 1 Processor -- start 2023-05-17T15:27:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.881+0000 7f5cbcb3b700 1 -- start start 2023-05-17T15:27:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4003ac0 0x7f5cb81524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 0x7f5cb8150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb8166ca0 0x7f5cb8167120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80aecf0 con 0x7f5cb814fcd0 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8152cd0 con 0x7f5ca4003ac0 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8152fb0 con 0x7f5cb8166ca0 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 0x7f5cb8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 0x7f5cb8150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45228/0 (socket says 172.21.15.27:45228) 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 -- 172.21.15.27:0/1260852923 learned_addr learned my addr 172.21.15.27:0/1260852923 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb659c700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4003ac0 0x7f5cb81524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb6d9d700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb8166ca0 0x7f5cb8167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 -- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb8166ca0 msgr2=0x7f5cb8167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb8166ca0 0x7f5cb8167120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 -- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4003ac0 msgr2=0x7f5cb81524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4003ac0 0x7f5cb81524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 -- 172.21.15.27:0/1260852923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80aef40 con 0x7f5cb814fcd0 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cb5d9b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 0x7f5cb8150150 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f5ca0007950 tx=0x7f5ca0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00015a0 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca0001700 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb80af220 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.882+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0001a80 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.883+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb81658f0 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.883+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb80b0df0 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.884+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f5ca0014430 con 0x7f5cb814fcd0 2023-05-17T15:27:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.884+0000 7f5cae7fc700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5c9805ee20 0x7f5c980612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.884+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f5ca0079b20 con 0x7f5cb814fcd0 2023-05-17T15:27:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.884+0000 7f5cb659c700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5c9805ee20 0x7f5c980612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.884+0000 7f5cb659c700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5c9805ee20 0x7f5c980612e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5cb0006d50 tx=0x7f5cb001a000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:39.888+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ca00498f0 con 0x7f5cb814fcd0 2023-05-17T15:27:40.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.063+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cb80af410 con 0x7f5cb814fcd0 2023-05-17T15:27:40.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.063+0000 7f5cae7fc700 1 -- 172.21.15.27:0/1260852923 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17115 (secure 0 0 0) 0x7f5ca004afe0 con 0x7f5cb814fcd0 2023-05-17T15:27:40.069 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:40.069 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":159,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:39.409787+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:27:37.958967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-17T15:27:38.376205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:40.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5c9805ee20 msgr2=0x7f5c980612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:40.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5c9805ee20 0x7f5c980612e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5cb0006d50 tx=0x7f5cb001a000).stop 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 msgr2=0x7f5cb8150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 0x7f5cb8150150 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f5ca0007950 tx=0x7f5ca0009040).stop 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 shutdown_connections 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5c9805ee20 0x7f5c980612e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb8166ca0 0x7f5cb8167120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca4003ac0 0x7f5cb81524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 --2- 172.21.15.27:0/1260852923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb814fcd0 0x7f5cb8150150 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 >> 172.21.15.27:0/1260852923 conn(0x7f5cb80cb810 msgr2=0x7f5cb80ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:40.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 shutdown_connections 2023-05-17T15:27:40.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.065+0000 7f5cbcb3b700 1 -- 172.21.15.27:0/1260852923 wait complete. 2023-05-17T15:27:40.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:27:40.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.197+0000 7fd10006e700 1 Processor -- start 2023-05-17T15:27:40.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.197+0000 7fd10006e700 1 -- start start 2023-05-17T15:27:40.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd10006e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80c6310 0x7fd0f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:40.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd10006e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0f80691f0 0x7fd0f80bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:40.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd10006e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f8158790 con 0x7fd0f81543d0 2023-05-17T15:27:40.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd10006e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f80c1c50 con 0x7fd0f80691f0 2023-05-17T15:27:40.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd10006e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8157e60 con 0x7fd0f80c6310 2023-05-17T15:27:40.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd0fe60b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0f80691f0 0x7fd0f80bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd0fd609700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80c6310 0x7fd0f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd0fde0a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0f81543d0 0x7fd0f80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:50798/0 (socket says 172.21.15.27:50798) 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.198+0000 7fd0fde0a700 1 -- 172.21.15.27:0/1205084118 learned_addr learned my addr 172.21.15.27:0/1205084118 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fe60b700 1 -- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80c6310 msgr2=0x7fd0f8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fe60b700 1 --2- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80c6310 0x7fd0f8068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fe60b700 1 -- 172.21.15.27:0/1205084118 >> v1:172.21.15.40:6789/0 conn(0x7fd0f81543d0 legacy=0x7fd0f80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fe60b700 1 -- 172.21.15.27:0/1205084118 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8158140 con 0x7fd0f80691f0 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fe60b700 1 --2- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f80691f0 0x7fd0f80bfc80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fd0e8009760 tx=0x7fd0e8009060).ready entity=mon.1 client_cookie=2117dc7ac6b91027 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fce08700 1 -- 172.21.15.27:0/1205084118 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800f510 con 0x7fd0f80691f0 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fce08700 1 -- 172.21.15.27:0/1205084118 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800f670 con 0x7fd0f80691f0 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd0fce08700 1 -- 172.21.15.27:0/1205084118 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800f9f0 con 0x7fd0f80691f0 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 -- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f80691f0 msgr2=0x7fd0f80bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 --2- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f80691f0 0x7fd0f80bfc80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fd0e8009760 tx=0x7fd0e8009060).stop 2023-05-17T15:27:40.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 -- 172.21.15.27:0/1205084118 shutdown_connections 2023-05-17T15:27:40.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 --2- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f80691f0 0x7fd0f80bfc80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 --2- 172.21.15.27:0/1205084118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80c6310 0x7fd0f8068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 -- 172.21.15.27:0/1205084118 >> 172.21.15.27:0/1205084118 conn(0x7fd0f80cb7f0 msgr2=0x7fd0f80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:40.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 -- 172.21.15.27:0/1205084118 shutdown_connections 2023-05-17T15:27:40.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.199+0000 7fd10006e700 1 -- 172.21.15.27:0/1205084118 wait complete. 2023-05-17T15:27:40.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.200+0000 7fd10006e700 1 Processor -- start 2023-05-17T15:27:40.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 -- start start 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80691f0 0x7fd0f8152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 0x7fd0f80c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f81543d0 0x7fd0f8164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f81533d0 con 0x7fd0f80c6310 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c22b0 con 0x7fd0f81543d0 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd10006e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80ae4a0 con 0x7fd0f80691f0 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd0fd609700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 0x7fd0f80c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:40.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd0fd609700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 0x7fd0f80c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45242/0 (socket says 172.21.15.27:45242) 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd0fd609700 1 -- 172.21.15.27:0/3741553881 learned_addr learned my addr 172.21.15.27:0/3741553881 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd0fe60b700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f81543d0 0x7fd0f8164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.201+0000 7fd0fde0a700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80691f0 0x7fd0f8152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fd609700 1 -- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80691f0 msgr2=0x7fd0f8152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fd609700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80691f0 0x7fd0f8152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fd609700 1 -- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f81543d0 msgr2=0x7fd0f8164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:40.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fd609700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f81543d0 0x7fd0f8164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fd609700 1 -- 172.21.15.27:0/3741553881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80092a0 con 0x7fd0f80c6310 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fe60b700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f81543d0 0x7fd0f8164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0fd609700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 0x7fd0f80c1dc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fd0ec00e930 tx=0x7fd0ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec012600 con 0x7fd0f80c6310 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec012760 con 0x7fd0f80c6310 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f80c4680 con 0x7fd0f80c6310 2023-05-17T15:27:40.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec012ae0 con 0x7fd0f80c6310 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.202+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f80ade50 con 0x7fd0f80c6310 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.203+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f806bdf0 con 0x7fd0f80c6310 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.203+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd0ec022070 con 0x7fd0f80c6310 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.204+0000 7fd0f5ffb700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd0e405ee20 0x7fd0e40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.204+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fd0ec079e90 con 0x7fd0f80c6310 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.204+0000 7fd0fde0a700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd0e405ee20 0x7fd0e40612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:40.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.204+0000 7fd0fde0a700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd0e405ee20 0x7fd0e40612e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd0f0007fd0 tx=0x7fd0f0009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:40.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.208+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0ec04b3b0 con 0x7fd0f80c6310 2023-05-17T15:27:40.257 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-05-17T15:27:40.254+0000 7f8b7f86c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:27:40.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:40.426+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd0f8069d00 con 0x7fd0f80c6310 2023-05-17T15:27:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.419+0000 7fd0f5ffb700 1 -- 172.21.15.27:0/3741553881 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd0ec016070 con 0x7fd0f80c6310 2023-05-17T15:27:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd0e405ee20 msgr2=0x7fd0e40612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:41.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd0e405ee20 0x7fd0e40612e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd0f0007fd0 tx=0x7fd0f0009040).stop 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 msgr2=0x7fd0f80c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 0x7fd0f80c1dc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fd0ec00e930 tx=0x7fd0ec009060).stop 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 shutdown_connections 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd0e405ee20 0x7fd0e40612e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0f81543d0 0x7fd0f8164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0f80691f0 0x7fd0f8152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 --2- 172.21.15.27:0/3741553881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0f80c6310 0x7fd0f80c1dc0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 >> 172.21.15.27:0/3741553881 conn(0x7fd0f80cb7f0 msgr2=0x7fd0f80c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:41.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 shutdown_connections 2023-05-17T15:27:41.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.421+0000 7fd10006e700 1 -- 172.21.15.27:0/3741553881 wait complete. 2023-05-17T15:27:41.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:27:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.561+0000 7f3bc6c1a700 1 Processor -- start 2023-05-17T15:27:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.561+0000 7f3bc6c1a700 1 -- start start 2023-05-17T15:27:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bc6c1a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bc01543d0 0x7f3bc00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bc6c1a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bc00c60f0 0x7f3bc0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bc6c1a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00c0c90 con 0x7f3bc00691f0 2023-05-17T15:27:41.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bc6c1a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00c1c50 con 0x7f3bc00c60f0 2023-05-17T15:27:41.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bc6c1a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc0158790 con 0x7f3bc01543d0 2023-05-17T15:27:41.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bbffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bc00c60f0 0x7f3bc0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:41.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bbffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bc00c60f0 0x7f3bc0068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45248/0 (socket says 172.21.15.27:45248) 2023-05-17T15:27:41.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.562+0000 7f3bbffff700 1 -- 172.21.15.27:0/3864351838 learned_addr learned my addr 172.21.15.27:0/3864351838 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:41.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbffff700 1 -- 172.21.15.27:0/3864351838 >> v2:172.21.15.40:3300/0 conn(0x7f3bc01543d0 msgr2=0x7f3bc00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:41.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbffff700 1 --2- 172.21.15.27:0/3864351838 >> v2:172.21.15.40:3300/0 conn(0x7f3bc01543d0 0x7f3bc00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:41.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbffff700 1 -- 172.21.15.27:0/3864351838 >> v1:172.21.15.40:6789/0 conn(0x7f3bc00691f0 legacy=0x7f3bc01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbffff700 1 -- 172.21.15.27:0/3864351838 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00c6570 con 0x7f3bc00c60f0 2023-05-17T15:27:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbffff700 1 --2- 172.21.15.27:0/3864351838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc00c60f0 0x7f3bc0068d00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f3bc0155970 tx=0x7f3bb0009840).ready entity=mon.0 client_cookie=f949965cb73adfba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbf7fe700 1 -- 172.21.15.27:0/3864351838 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000e070 con 0x7f3bc00c60f0 2023-05-17T15:27:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbf7fe700 1 -- 172.21.15.27:0/3864351838 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000ba10 con 0x7f3bc00c60f0 2023-05-17T15:27:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bbf7fe700 1 -- 172.21.15.27:0/3864351838 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000bd90 con 0x7f3bc00c60f0 2023-05-17T15:27:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/3864351838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc00c60f0 msgr2=0x7f3bc0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/3864351838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc00c60f0 0x7f3bc0068d00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f3bc0155970 tx=0x7f3bb0009840).stop 2023-05-17T15:27:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/3864351838 shutdown_connections 2023-05-17T15:27:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/3864351838 >> v2:172.21.15.40:3300/0 conn(0x7f3bc01543d0 0x7f3bc00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:41.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/3864351838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc00c60f0 0x7f3bc0068d00 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/3864351838 >> 172.21.15.27:0/3864351838 conn(0x7f3bc00cb7f0 msgr2=0x7f3bc00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:41.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/3864351838 shutdown_connections 2023-05-17T15:27:41.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.563+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/3864351838 wait complete. 2023-05-17T15:27:41.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.564+0000 7f3bc6c1a700 1 Processor -- start 2023-05-17T15:27:41.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 -- start start 2023-05-17T15:27:41.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc00691f0 0x7f3bc0147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:41.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00c60f0 0x7f3bc00afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 0x7f3bc00b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00b0530 con 0x7f3bc01543d0 2023-05-17T15:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c2410 con 0x7f3bc00c60f0 2023-05-17T15:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.565+0000 7f3bc6c1a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00af2c0 con 0x7f3bc00691f0 2023-05-17T15:27:41.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 0x7f3bc00b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:41.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 0x7f3bc00b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45256/0 (socket says 172.21.15.27:45256) 2023-05-17T15:27:41.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 -- 172.21.15.27:0/628952893 learned_addr learned my addr 172.21.15.27:0/628952893 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:41.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bbffff700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00c60f0 0x7f3bc00afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:41.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc49b6700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc00691f0 0x7f3bc0147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:41.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 -- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc00691f0 msgr2=0x7f3bc0147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:41.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc00691f0 0x7f3bc0147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 -- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00c60f0 msgr2=0x7f3bc00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00c60f0 0x7f3bc00afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 -- 172.21.15.27:0/628952893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0009ae0 con 0x7f3bc01543d0 2023-05-17T15:27:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc49b6700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc00691f0 0x7f3bc0147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:41.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc51b7700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 0x7f3bc00b0040 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f3ba800b460 tx=0x7f3ba8006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:41.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba800be60 con 0x7f3bc01543d0 2023-05-17T15:27:41.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8012410 con 0x7f3bc01543d0 2023-05-17T15:27:41.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc00af5a0 con 0x7f3bc01543d0 2023-05-17T15:27:41.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80127d0 con 0x7f3bc01543d0 2023-05-17T15:27:41.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.566+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00c20a0 con 0x7f3bc01543d0 2023-05-17T15:27:41.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.567+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc006bdf0 con 0x7f3bc01543d0 2023-05-17T15:27:41.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.568+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3ba800f030 con 0x7f3bc01543d0 2023-05-17T15:27:41.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.568+0000 7f3bbcff9700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3ba005edf0 0x7f3ba00612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:41.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.568+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f3ba8079700 con 0x7f3bc01543d0 2023-05-17T15:27:41.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.568+0000 7f3bc49b6700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3ba005edf0 0x7f3ba00612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:41.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.568+0000 7f3bc49b6700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3ba005edf0 0x7f3ba00612b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3bb800b910 tx=0x7f3bb8008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:41.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.572+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ba804ac20 con 0x7f3bc01543d0 2023-05-17T15:27:41.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:41.786+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3bc0069d00 con 0x7f3bc01543d0 2023-05-17T15:27:42.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.422+0000 7f3bbcff9700 1 -- 172.21.15.27:0/628952893 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ba804e240 con 0x7f3bc01543d0 2023-05-17T15:27:42.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3ba005edf0 msgr2=0x7f3ba00612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3ba005edf0 0x7f3ba00612b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3bb800b910 tx=0x7f3bb8008040).stop 2023-05-17T15:27:42.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 msgr2=0x7f3bc00b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 0x7f3bc00b0040 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f3ba800b460 tx=0x7f3ba8006f20).stop 2023-05-17T15:27:42.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 shutdown_connections 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3ba005edf0 0x7f3ba00612b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc01543d0 0x7f3bc00b0040 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc00691f0 0x7f3bc0147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 --2- 172.21.15.27:0/628952893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00c60f0 0x7f3bc00afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 >> 172.21.15.27:0/628952893 conn(0x7f3bc00cb7f0 msgr2=0x7f3bc01570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 shutdown_connections 2023-05-17T15:27:42.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.425+0000 7f3bc6c1a700 1 -- 172.21.15.27:0/628952893 wait complete. 2023-05-17T15:27:42.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.559+0000 7f6c89775700 1 Processor -- start 2023-05-17T15:27:42.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.559+0000 7f6c89775700 1 -- start start 2023-05-17T15:27:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c89775700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 0x7f6c84153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c89775700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c84154260 0x7f6c840c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c89775700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840aa680 con 0x7f6c840c60c0 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c89775700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c840c68e0 con 0x7f6c84154260 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c89775700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8405e7e0 con 0x7f6c840c64a0 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c82ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6c840c60c0 0x7f6c840a9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44822/0 (socket says 172.21.15.27:44822) 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c82ffd700 1 -- 172.21.15.27:0/3950664257 learned_addr learned my addr 172.21.15.27:0/3950664257 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c837fe700 1 --2- 172.21.15.27:0/3950664257 >> v2:172.21.15.40:3300/0 conn(0x7f6c84154260 0x7f6c840c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c827fc700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 0x7f6c84153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.560+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890054050 0 0) 0x7f6c840aa680 con 0x7f6c840c60c0 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c700033f0 con 0x7f6c840c60c0 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2791186667 0 0) 0x7f6c700033f0 con 0x7f6c840c60c0 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 msgr2=0x7f6c84153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 0x7f6c84153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 >> v2:172.21.15.40:3300/0 conn(0x7f6c84154260 msgr2=0x7f6c840c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 --2- 172.21.15.27:0/3950664257 >> v2:172.21.15.40:3300/0 conn(0x7f6c84154260 0x7f6c840c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8405eac0 con 0x7f6c840c60c0 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f6c7c0017f0 con 0x7f6c840c60c0 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 >> v1:172.21.15.27:6789/0 conn(0x7f6c840c60c0 legacy=0x7f6c840a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c700038e0 0x7f6c70003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c70004690 0x7f6c70004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 0x7f6c70005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840c68e0 con 0x7f6c700038e0 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8405e7e0 con 0x7f6c70004690 2023-05-17T15:27:42.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7000b8e0 con 0x7f6c840c64a0 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c700038e0 0x7f6c70003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c827fc700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c70004690 0x7f6c70004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c837fe700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 0x7f6c70005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 -- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 msgr2=0x7f6c70005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c840c64a0 0x7f6c70005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 -- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c70004690 msgr2=0x7f6c70004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c70004690 0x7f6c70004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 -- 172.21.15.27:0/3950664257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700033f0 con 0x7f6c700038e0 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c827fc700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c70004690 0x7f6c70004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.561+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c700038e0 0x7f6c70003d00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f6c7c00c530 tx=0x7f6c7c001d90).ready entity=mon.0 client_cookie=b2d55f496172ec60 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00ce60 con 0x7f6c700038e0 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c005b20 con 0x7f6c700038e0 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c81ffb700 1 -- 172.21.15.27:0/3950664257 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0070d0 con 0x7f6c700038e0 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c89775700 1 -- 172.21.15.27:0/3950664257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c700038e0 msgr2=0x7f6c70003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c89775700 1 --2- 172.21.15.27:0/3950664257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c700038e0 0x7f6c70003d00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f6c7c00c530 tx=0x7f6c7c001d90).stop 2023-05-17T15:27:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c837fe700 1 -- 172.21.15.27:0/3950664257 reap_dead start 2023-05-17T15:27:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c89775700 1 -- 172.21.15.27:0/3950664257 shutdown_connections 2023-05-17T15:27:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c89775700 1 -- 172.21.15.27:0/3950664257 >> 172.21.15.27:0/3950664257 conn(0x7f6c84069e70 msgr2=0x7f6c8405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c89775700 1 -- 172.21.15.27:0/3950664257 shutdown_connections 2023-05-17T15:27:42.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.562+0000 7f6c89775700 1 -- 172.21.15.27:0/3950664257 wait complete. 2023-05-17T15:27:42.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.563+0000 7f6c89775700 1 Processor -- start 2023-05-17T15:27:42.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.563+0000 7f6c89775700 1 -- start start 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c89775700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c700038e0 0x7f6c840c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c89775700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c840cb580 0x7f6c8414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c89775700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 0x7f6c841684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c89775700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840af040 con 0x7f6c84168060 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c89775700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840af1b0 con 0x7f6c840cb580 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c89775700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840cba00 con 0x7f6c700038e0 2023-05-17T15:27:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 0x7f6c841684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c837fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 0x7f6c841684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45276/0 (socket says 172.21.15.27:45276) 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c837fe700 1 -- 172.21.15.27:0/1514408478 learned_addr learned my addr 172.21.15.27:0/1514408478 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c827fc700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c840cb580 0x7f6c8414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c700038e0 0x7f6c840c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c837fe700 1 -- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c700038e0 msgr2=0x7f6c840c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c837fe700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c700038e0 0x7f6c840c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.564+0000 7f6c837fe700 1 -- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c840cb580 msgr2=0x7f6c8414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c837fe700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c840cb580 0x7f6c8414dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c837fe700 1 -- 172.21.15.27:0/1514408478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c841689d0 con 0x7f6c84168060 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c837fe700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 0x7f6c841684e0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f6c84082790 tx=0x7f6c74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400f700 con 0x7f6c84168060 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400f860 con 0x7f6c84168060 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c840c9b50 con 0x7f6c84168060 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400fc00 con 0x7f6c84168060 2023-05-17T15:27:42.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.565+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c840ca110 con 0x7f6c84168060 2023-05-17T15:27:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.566+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c840af340 con 0x7f6c84168060 2023-05-17T15:27:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.566+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f6c7401f460 con 0x7f6c84168060 2023-05-17T15:27:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.567+0000 7f6c7affd700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6c6405ee50 0x7f6c64061310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.567+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f6c7407a110 con 0x7f6c84168060 2023-05-17T15:27:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.567+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6c6405ee50 0x7f6c64061310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.567+0000 7f6c82ffd700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6c6405ee50 0x7f6c64061310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6c7c00c3d0 tx=0x7f6c7c015000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.571+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c7404b5d0 con 0x7f6c84168060 2023-05-17T15:27:42.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.790+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c84067cb0 con 0x7f6c84168060 2023-05-17T15:27:42.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.790+0000 7f6c7affd700 1 -- 172.21.15.27:0/1514408478 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f6c84067cb0 con 0x7f6c84168060 2023-05-17T15:27:42.794 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:42.794 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":67,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:27:39.410260+0000","modified":"2023-05-17T15:27:42.418264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6833/3042009108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3042009108},{"type":"v1","addr":"172.21.15.40:6833","nonce":3042009108}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-17T15:27:42.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6c6405ee50 msgr2=0x7f6c64061310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6c6405ee50 0x7f6c64061310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6c7c00c3d0 tx=0x7f6c7c015000).stop 2023-05-17T15:27:42.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 msgr2=0x7f6c841684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 0x7f6c841684e0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f6c84082790 tx=0x7f6c74009060).stop 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 shutdown_connections 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6c6405ee50 0x7f6c64061310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c84168060 0x7f6c841684e0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c700038e0 0x7f6c840c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 --2- 172.21.15.27:0/1514408478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c840cb580 0x7f6c8414dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 >> 172.21.15.27:0/1514408478 conn(0x7f6c84069e70 msgr2=0x7f6c840c06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:42.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 shutdown_connections 2023-05-17T15:27:42.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.792+0000 7f6c89775700 1 -- 172.21.15.27:0/1514408478 wait complete. 2023-05-17T15:27:42.798 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 67 2023-05-17T15:27:42.808 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:27:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.920+0000 7fe6f6714700 1 Processor -- start 2023-05-17T15:27:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.920+0000 7fe6f6714700 1 -- start start 2023-05-17T15:27:42.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.921+0000 7fe6f6714700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 0x7fe6f0063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.921+0000 7fe6f6714700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f0154180 con 0x7fe6f0063f30 2023-05-17T15:27:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.921+0000 7fe6f6714700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f0154460 con 0x7fe6f00a91b0 2023-05-17T15:27:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.921+0000 7fe6f6714700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0154740 con 0x7fe6f0064310 2023-05-17T15:27:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.921+0000 7fe6effff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe6f0063f30 0x7fe6f00665f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44842/0 (socket says 172.21.15.27:44842) 2023-05-17T15:27:42.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.921+0000 7fe6effff700 1 -- 172.21.15.27:0/1924048246 learned_addr learned my addr 172.21.15.27:0/1924048246 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:42.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6ef7fe700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 0x7fe6f0063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065234083 0 0) 0x7fe6f0154180 con 0x7fe6f0063f30 2023-05-17T15:27:42.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d8004500 con 0x7fe6f0063f30 2023-05-17T15:27:42.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3892049094 0 0) 0x7fe6d8004500 con 0x7fe6f0063f30 2023-05-17T15:27:42.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 msgr2=0x7fe6f0063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 0x7fe6f0063340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 >> v1:172.21.15.40:6789/0 conn(0x7fe6f00a91b0 legacy=0x7fe6f00c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0154a20 con 0x7fe6f0063f30 2023-05-17T15:27:42.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fe6e0001470 con 0x7fe6f0063f30 2023-05-17T15:27:42.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 >> v1:172.21.15.27:6789/0 conn(0x7fe6f0063f30 legacy=0x7fe6f00665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8004a20 0x7fe6d8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 0x7fe6d80057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d8005c90 0x7fe6d8006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0154740 con 0x7fe6d8005c90 2023-05-17T15:27:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d800ca50 con 0x7fe6d8004a20 2023-05-17T15:27:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d800cc10 con 0x7fe6f0064310 2023-05-17T15:27:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d8005c90 0x7fe6d8006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6effff700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8004a20 0x7fe6d8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.922+0000 7fe6ef7fe700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 0x7fe6d80057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 msgr2=0x7fe6d80057a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f0064310 0x7fe6d80057a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8004a20 msgr2=0x7fe6d8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:42.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8004a20 0x7fe6d8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/1924048246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8004500 con 0x7fe6d8005c90 2023-05-17T15:27:42.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d8005c90 0x7fe6d8006110 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fe6e8001e30 tx=0x7fe6e8007f30).ready entity=mon.0 client_cookie=dbcd94e4bca1ab26 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:42.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8006a20 con 0x7fe6d8005c90 2023-05-17T15:27:42.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8006b80 con 0x7fe6d8005c90 2023-05-17T15:27:42.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6eeffd700 1 -- 172.21.15.27:0/1924048246 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800c5d0 con 0x7fe6d8005c90 2023-05-17T15:27:42.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f6714700 1 -- 172.21.15.27:0/1924048246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d8005c90 msgr2=0x7fe6d8006110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f6714700 1 --2- 172.21.15.27:0/1924048246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d8005c90 0x7fe6d8006110 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fe6e8001e30 tx=0x7fe6e8007f30).stop 2023-05-17T15:27:42.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/1924048246 reap_dead start 2023-05-17T15:27:42.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f6714700 1 -- 172.21.15.27:0/1924048246 shutdown_connections 2023-05-17T15:27:42.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f6714700 1 -- 172.21.15.27:0/1924048246 >> 172.21.15.27:0/1924048246 conn(0x7fe6f0068750 msgr2=0x7fe6f00c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:42.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f6714700 1 -- 172.21.15.27:0/1924048246 shutdown_connections 2023-05-17T15:27:42.944 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.923+0000 7fe6f6714700 1 -- 172.21.15.27:0/1924048246 wait complete. 2023-05-17T15:27:42.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.924+0000 7fe6f6714700 1 Processor -- start 2023-05-17T15:27:42.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 -- start start 2023-05-17T15:27:42.945 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f013c610 0x7fe6f0160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6f0163130 0x7fe6f01635b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 0x7fe6f00c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00bfbe0 con 0x7fe6f00c0070 2023-05-17T15:27:42.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0163aa0 con 0x7fe6f0163130 2023-05-17T15:27:42.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f6714700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00bf2b0 con 0x7fe6f013c610 2023-05-17T15:27:42.946 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.925+0000 7fe6f4cb1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 0x7fe6f00c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 0x7fe6f00c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45296/0 (socket says 172.21.15.27:45296) 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/604656949 learned_addr learned my addr 172.21.15.27:0/604656949 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6effff700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f013c610 0x7fe6f0160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6ef7fe700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6f0163130 0x7fe6f01635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f013c610 msgr2=0x7fe6f0160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f013c610 0x7fe6f0160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6f0163130 msgr2=0x7fe6f01635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6f0163130 0x7fe6f01635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 -- 172.21.15.27:0/604656949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00bf590 con 0x7fe6f00c0070 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f4cb1700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 0x7fe6f00c04f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fe6e8001220 tx=0x7fe6e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800c5d0 con 0x7fe6f00c0070 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8007230 con 0x7fe6f00c0070 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f00bf870 con 0x7fe6f00c0070 2023-05-17T15:27:42.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8006a20 con 0x7fe6f00c0070 2023-05-17T15:27:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.926+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f0161220 con 0x7fe6f00c0070 2023-05-17T15:27:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.927+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00bfd90 con 0x7fe6f00c0070 2023-05-17T15:27:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.927+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe6e8025030 con 0x7fe6f00c0070 2023-05-17T15:27:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.928+0000 7fe6d7fff700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6dc05ee20 0x7fe6dc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.928+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fe6e807a970 con 0x7fe6f00c0070 2023-05-17T15:27:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.928+0000 7fe6effff700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6dc05ee20 0x7fe6dc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:42.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.928+0000 7fe6effff700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6dc05ee20 0x7fe6dc0612e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe6e00010e0 tx=0x7fe6e0001e50).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:42.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:42.932+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6f00bfd90 con 0x7fe6f00c0070 2023-05-17T15:27:43.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.104+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6f006bdf0 con 0x7fe6f00c0070 2023-05-17T15:27:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.105+0000 7fe6d7fff700 1 -- 172.21.15.27:0/604656949 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+17102 (secure 0 0 0) 0x7fe6e8023070 con 0x7fe6f00c0070 2023-05-17T15:27:43.109 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:43.110 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":160,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:27:40.411910+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:27:37.958967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-17T15:27:38.376205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:27:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6dc05ee20 msgr2=0x7fe6dc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6dc05ee20 0x7fe6dc0612e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe6e00010e0 tx=0x7fe6e0001e50).stop 2023-05-17T15:27:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 msgr2=0x7fe6f00c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 0x7fe6f00c04f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fe6e8001220 tx=0x7fe6e8016000).stop 2023-05-17T15:27:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 shutdown_connections 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6dc05ee20 0x7fe6dc0612e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f00c0070 0x7fe6f00c04f0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6f013c610 0x7fe6f0160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 --2- 172.21.15.27:0/604656949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6f0163130 0x7fe6f01635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 >> 172.21.15.27:0/604656949 conn(0x7fe6f0068750 msgr2=0x7fe6f00c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 shutdown_connections 2023-05-17T15:27:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.107+0000 7fe6f6714700 1 -- 172.21.15.27:0/604656949 wait complete. 2023-05-17T15:27:43.123 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:27:43.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:27:43.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.235+0000 7f22d7b09700 1 Processor -- start 2023-05-17T15:27:43.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.235+0000 7f22d7b09700 1 -- start start 2023-05-17T15:27:43.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.236+0000 7f22d7b09700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22d01540d0 0x7f22d0155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.236+0000 7f22d7b09700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d0069020 con 0x7f22d0065aa0 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.236+0000 7f22d7b09700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d0155700 con 0x7f22d0067ec0 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.236+0000 7f22d7b09700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d00c3610 con 0x7f22d01540d0 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.236+0000 7f22d60a6700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f22d0065aa0 0x7f22d00c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44864/0 (socket says 172.21.15.27:44864) 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.236+0000 7f22d60a6700 1 -- 172.21.15.27:0/3640087345 learned_addr learned my addr 172.21.15.27:0/3640087345 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 --2- 172.21.15.27:0/3640087345 >> v2:172.21.15.40:3300/0 conn(0x7f22d01540d0 0x7f22d0155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875486402 0 0) 0x7f22d0069020 con 0x7f22d0065aa0 2023-05-17T15:27:43.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b80033f0 con 0x7f22d0065aa0 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3913545603 0 0) 0x7f22b80033f0 con 0x7f22d0065aa0 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 >> v2:172.21.15.40:3300/0 conn(0x7f22d01540d0 msgr2=0x7f22d0155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 --2- 172.21.15.27:0/3640087345 >> v2:172.21.15.40:3300/0 conn(0x7f22d01540d0 0x7f22d0155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 >> v1:172.21.15.40:6789/0 conn(0x7f22d0067ec0 legacy=0x7f22d0065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0068410 con 0x7f22d0065aa0 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f22c00017f0 con 0x7f22d0065aa0 2023-05-17T15:27:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 >> v1:172.21.15.27:6789/0 conn(0x7f22d0065aa0 legacy=0x7f22d00c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b80038e0 0x7f22b8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b8004690 0x7f22b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b8005000 0x7f22b800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d00c3610 con 0x7f22b80038e0 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b800beb0 con 0x7f22b8005000 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b800c070 con 0x7f22b8004690 2023-05-17T15:27:43.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b80038e0 0x7f22b8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d60a6700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b8005000 0x7f22b800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d50a4700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b8004690 0x7f22b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 -- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b8004690 msgr2=0x7f22b8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b8004690 0x7f22b8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 -- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b8005000 msgr2=0x7f22b800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b8005000 0x7f22b800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d60a6700 1 -- 172.21.15.27:0/3640087345 reap_dead start 2023-05-17T15:27:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.237+0000 7f22d58a5700 1 -- 172.21.15.27:0/3640087345 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80033f0 con 0x7f22b80038e0 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d58a5700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b80038e0 0x7f22b8003d00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f22c8009a60 tx=0x7f22c8009060).ready entity=mon.0 client_cookie=9e66888d41864f6d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8009ea0 con 0x7f22b80038e0 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8009430 con 0x7f22b80038e0 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d48a3700 1 -- 172.21.15.27:0/3640087345 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800e870 con 0x7f22b80038e0 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 -- 172.21.15.27:0/3640087345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b80038e0 msgr2=0x7f22b8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b80038e0 0x7f22b8003d00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f22c8009a60 tx=0x7f22c8009060).stop 2023-05-17T15:27:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 -- 172.21.15.27:0/3640087345 shutdown_connections 2023-05-17T15:27:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 --2- 172.21.15.27:0/3640087345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b80038e0 0x7f22b8003d00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 -- 172.21.15.27:0/3640087345 >> 172.21.15.27:0/3640087345 conn(0x7f22d00c94a0 msgr2=0x7f22d00c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 -- 172.21.15.27:0/3640087345 shutdown_connections 2023-05-17T15:27:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.238+0000 7f22d7b09700 1 -- 172.21.15.27:0/3640087345 wait complete. 2023-05-17T15:27:43.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.239+0000 7f22d7b09700 1 Processor -- start 2023-05-17T15:27:43.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.239+0000 7f22d7b09700 1 -- start start 2023-05-17T15:27:43.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d7b09700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b80038e0 0x7f22d0148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d7b09700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22d01566b0 0x7f22d00aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d7b09700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 0x7f22d0167c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d7b09700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0156220 con 0x7f22d00aa7b0 2023-05-17T15:27:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d7b09700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d00aac30 con 0x7f22b80038e0 2023-05-17T15:27:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d7b09700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0155930 con 0x7f22d01566b0 2023-05-17T15:27:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d60a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 0x7f22d0167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d60a6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 0x7f22d0167c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45316/0 (socket says 172.21.15.27:45316) 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.240+0000 7f22d60a6700 1 -- 172.21.15.27:0/4015734533 learned_addr learned my addr 172.21.15.27:0/4015734533 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d58a5700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b80038e0 0x7f22d0148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d50a4700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22d01566b0 0x7f22d00aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d60a6700 1 -- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22d01566b0 msgr2=0x7f22d00aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d60a6700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22d01566b0 0x7f22d00aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d60a6700 1 -- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b80038e0 msgr2=0x7f22d0148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d60a6700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b80038e0 0x7f22d0148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d60a6700 1 -- 172.21.15.27:0/4015734533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0148550 con 0x7f22d00aa7b0 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d60a6700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 0x7f22d0167c00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f22c0000f80 tx=0x7f22c0001300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000e830 con 0x7f22d00aa7b0 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000e990 con 0x7f22d00aa7b0 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d0155bd0 con 0x7f22d00aa7b0 2023-05-17T15:27:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000ed30 con 0x7f22d00aa7b0 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.241+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d01689c0 con 0x7f22d00aa7b0 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.242+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d0156390 con 0x7f22d00aa7b0 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.242+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f22c0014640 con 0x7f22d00aa7b0 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.243+0000 7f22cdffb700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f22bc05ee20 0x7f22bc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.243+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f22c0079b50 con 0x7f22d00aa7b0 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.243+0000 7f22d58a5700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f22bc05ee20 0x7f22bc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.243+0000 7f22d58a5700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f22bc05ee20 0x7f22bc0612e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f22c8006d50 tx=0x7f22c801a000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.247+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22c004b010 con 0x7f22d00aa7b0 2023-05-17T15:27:43.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.416+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22d006bdf0 con 0x7f22bc05ee20 2023-05-17T15:27:43.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.429+0000 7f22cdffb700 1 -- 172.21.15.27:0/4015734533 <== mgr.8379 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361981 (secure 0 0 0) 0x7f22d006bdf0 con 0x7f22bc05ee20 2023-05-17T15:27:43.436 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:43.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f22bc05ee20 msgr2=0x7f22bc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f22bc05ee20 0x7f22bc0612e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f22c8006d50 tx=0x7f22c801a000).stop 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 msgr2=0x7f22d0167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 0x7f22d0167c00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f22c0000f80 tx=0x7f22c0001300).stop 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 shutdown_connections 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f22bc05ee20 0x7f22bc0612e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22d00aa7b0 0x7f22d0167c00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b80038e0 0x7f22d0148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 --2- 172.21.15.27:0/4015734533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22d01566b0 0x7f22d00aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 >> 172.21.15.27:0/4015734533 conn(0x7f22d00c94a0 msgr2=0x7f22d00bf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:43.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 shutdown_connections 2023-05-17T15:27:43.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.433+0000 7f22d7b09700 1 -- 172.21.15.27:0/4015734533 wait complete. 2023-05-17T15:27:43.440 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:27:43.449 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-05-17T15:27:41.734707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":176232,"kb_used_data":15400,"kb_used_omap":0,"kb_used_meta":160768,"kb_avail":754798488,"statfs":{"total":773094113280,"available":772913651712,"internally_reserved":0,"allocated":15769600,"data_stored":7992805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164626432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594394,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.007038"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.422177+0000","last_change":"2023-05-17T15:27:39.422177+0000","last_active":"2023-05-17T15:27:39.422177+0000","last_peered":"2023-05-17T15:27:39.422177+0000","last_clean":"2023-05-17T15:27:39.422177+0000","last_became_active":"2023-05-17T15:27:39.421575+0000","last_became_peered":"2023-05-17T15:27:39.421575+0000","last_unstale":"2023-05-17T15:27:39.422177+0000","last_undegraded":"2023-05-17T15:27:39.422177+0000","last_fullsized":"2023-05-17T15:27:39.422177+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"159'3","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442603+0000","last_change":"2023-05-17T15:27:39.035079+0000","last_active":"2023-05-17T15:27:39.442603+0000","last_peered":"2023-05-17T15:27:39.442603+0000","last_clean":"2023-05-17T15:27:39.442603+0000","last_became_active":"2023-05-17T15:27:39.034751+0000","last_became_peered":"2023-05-17T15:27:39.034751+0000","last_unstale":"2023-05-17T15:27:39.442603+0000","last_undegraded":"2023-05-17T15:27:39.442603+0000","last_fullsized":"2023-05-17T15:27:39.442603+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444749+0000","last_change":"2023-05-17T15:27:39.444749+0000","last_active":"2023-05-17T15:27:39.444749+0000","last_peered":"2023-05-17T15:27:39.444749+0000","last_clean":"2023-05-17T15:27:39.444749+0000","last_became_active":"2023-05-17T15:27:39.444554+0000","last_became_peered":"2023-05-17T15:27:39.444554+0000","last_unstale":"2023-05-17T15:27:39.444749+0000","last_undegraded":"2023-05-17T15:27:39.444749+0000","last_fullsized":"2023-05-17T15:27:39.444749+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042742+0000","last_change":"2023-05-17T15:27:39.039178+0000","last_active":"2023-05-17T15:27:39.042742+0000","last_peered":"2023-05-17T15:27:39.042742+0000","last_clean":"2023-05-17T15:27:39.042742+0000","last_became_active":"2023-05-17T15:27:39.038884+0000","last_became_peered":"2023-05-17T15:27:39.038884+0000","last_unstale":"2023-05-17T15:27:39.042742+0000","last_undegraded":"2023-05-17T15:27:39.042742+0000","last_fullsized":"2023-05-17T15:27:39.042742+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442535+0000","last_change":"2023-05-17T15:27:39.442535+0000","last_active":"2023-05-17T15:27:39.442535+0000","last_peered":"2023-05-17T15:27:39.442535+0000","last_clean":"2023-05-17T15:27:39.442535+0000","last_became_active":"2023-05-17T15:27:39.441731+0000","last_became_peered":"2023-05-17T15:27:39.441731+0000","last_unstale":"2023-05-17T15:27:39.442535+0000","last_undegraded":"2023-05-17T15:27:39.442535+0000","last_fullsized":"2023-05-17T15:27:39.442535+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.041041+0000","last_change":"2023-05-17T15:27:39.038382+0000","last_active":"2023-05-17T15:27:39.041041+0000","last_peered":"2023-05-17T15:27:39.041041+0000","last_clean":"2023-05-17T15:27:39.041041+0000","last_became_active":"2023-05-17T15:27:39.038083+0000","last_became_peered":"2023-05-17T15:27:39.038083+0000","last_unstale":"2023-05-17T15:27:39.041041+0000","last_undegraded":"2023-05-17T15:27:39.041041+0000","last_fullsized":"2023-05-17T15:27:39.041041+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.423341+0000","last_change":"2023-05-17T15:27:39.423341+0000","last_active":"2023-05-17T15:27:39.423341+0000","last_peered":"2023-05-17T15:27:39.423341+0000","last_clean":"2023-05-17T15:27:39.423341+0000","last_became_active":"2023-05-17T15:27:39.423073+0000","last_became_peered":"2023-05-17T15:27:39.423073+0000","last_unstale":"2023-05-17T15:27:39.423341+0000","last_undegraded":"2023-05-17T15:27:39.423341+0000","last_fullsized":"2023-05-17T15:27:39.423341+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.438660+0000","last_change":"2023-05-17T15:27:39.033523+0000","last_active":"2023-05-17T15:27:39.438660+0000","last_peered":"2023-05-17T15:27:39.438660+0000","last_clean":"2023-05-17T15:27:39.438660+0000","last_became_active":"2023-05-17T15:27:39.033016+0000","last_became_peered":"2023-05-17T15:27:39.033016+0000","last_unstale":"2023-05-17T15:27:39.438660+0000","last_undegraded":"2023-05-17T15:27:39.438660+0000","last_fullsized":"2023-05-17T15:27:39.438660+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.435243+0000","last_change":"2023-05-17T15:27:39.435243+0000","last_active":"2023-05-17T15:27:39.435243+0000","last_peered":"2023-05-17T15:27:39.435243+0000","last_clean":"2023-05-17T15:27:39.435243+0000","last_became_active":"2023-05-17T15:27:39.435051+0000","last_became_peered":"2023-05-17T15:27:39.435051+0000","last_unstale":"2023-05-17T15:27:39.435243+0000","last_undegraded":"2023-05-17T15:27:39.435243+0000","last_fullsized":"2023-05-17T15:27:39.435243+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426282+0000","last_change":"2023-05-17T15:27:39.040414+0000","last_active":"2023-05-17T15:27:39.426282+0000","last_peered":"2023-05-17T15:27:39.426282+0000","last_clean":"2023-05-17T15:27:39.426282+0000","last_became_active":"2023-05-17T15:27:39.040138+0000","last_became_peered":"2023-05-17T15:27:39.040138+0000","last_unstale":"2023-05-17T15:27:39.426282+0000","last_undegraded":"2023-05-17T15:27:39.426282+0000","last_fullsized":"2023-05-17T15:27:39.426282+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437300+0000","last_change":"2023-05-17T15:27:39.437300+0000","last_active":"2023-05-17T15:27:39.437300+0000","last_peered":"2023-05-17T15:27:39.437300+0000","last_clean":"2023-05-17T15:27:39.437300+0000","last_became_active":"2023-05-17T15:27:39.436877+0000","last_became_peered":"2023-05-17T15:27:39.436877+0000","last_unstale":"2023-05-17T15:27:39.437300+0000","last_undegraded":"2023-05-17T15:27:39.437300+0000","last_fullsized":"2023-05-17T15:27:39.437300+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.416182+0000","last_change":"2023-05-17T15:27:39.042750+0000","last_active":"2023-05-17T15:27:39.416182+0000","last_peered":"2023-05-17T15:27:39.416182+0000","last_clean":"2023-05-17T15:27:39.416182+0000","last_became_active":"2023-05-17T15:27:39.042464+0000","last_became_peered":"2023-05-17T15:27:39.042464+0000","last_unstale":"2023-05-17T15:27:39.416182+0000","last_undegraded":"2023-05-17T15:27:39.416182+0000","last_fullsized":"2023-05-17T15:27:39.416182+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.433208+0000","last_change":"2023-05-17T15:27:39.433208+0000","last_active":"2023-05-17T15:27:39.433208+0000","last_peered":"2023-05-17T15:27:39.433208+0000","last_clean":"2023-05-17T15:27:39.433208+0000","last_became_active":"2023-05-17T15:27:39.432710+0000","last_became_peered":"2023-05-17T15:27:39.432710+0000","last_unstale":"2023-05-17T15:27:39.433208+0000","last_undegraded":"2023-05-17T15:27:39.433208+0000","last_fullsized":"2023-05-17T15:27:39.433208+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043807+0000","last_change":"2023-05-17T15:27:39.038911+0000","last_active":"2023-05-17T15:27:39.043807+0000","last_peered":"2023-05-17T15:27:39.043807+0000","last_clean":"2023-05-17T15:27:39.043807+0000","last_became_active":"2023-05-17T15:27:39.038596+0000","last_became_peered":"2023-05-17T15:27:39.038596+0000","last_unstale":"2023-05-17T15:27:39.043807+0000","last_undegraded":"2023-05-17T15:27:39.043807+0000","last_fullsized":"2023-05-17T15:27:39.043807+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429949+0000","last_change":"2023-05-17T15:27:39.429949+0000","last_active":"2023-05-17T15:27:39.429949+0000","last_peered":"2023-05-17T15:27:39.429949+0000","last_clean":"2023-05-17T15:27:39.429949+0000","last_became_active":"2023-05-17T15:27:39.428029+0000","last_became_peered":"2023-05-17T15:27:39.428029+0000","last_unstale":"2023-05-17T15:27:39.429949+0000","last_undegraded":"2023-05-17T15:27:39.429949+0000","last_fullsized":"2023-05-17T15:27:39.429949+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.048866+0000","last_change":"2023-05-17T15:27:39.044409+0000","last_active":"2023-05-17T15:27:39.048866+0000","last_peered":"2023-05-17T15:27:39.048866+0000","last_clean":"2023-05-17T15:27:39.048866+0000","last_became_active":"2023-05-17T15:27:39.044216+0000","last_became_peered":"2023-05-17T15:27:39.044216+0000","last_unstale":"2023-05-17T15:27:39.048866+0000","last_undegraded":"2023-05-17T15:27:39.048866+0000","last_fullsized":"2023-05-17T15:27:39.048866+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434514+0000","last_change":"2023-05-17T15:27:39.434514+0000","last_active":"2023-05-17T15:27:39.434514+0000","last_peered":"2023-05-17T15:27:39.434514+0000","last_clean":"2023-05-17T15:27:39.434514+0000","last_became_active":"2023-05-17T15:27:39.434347+0000","last_became_peered":"2023-05-17T15:27:39.434347+0000","last_unstale":"2023-05-17T15:27:39.434514+0000","last_undegraded":"2023-05-17T15:27:39.434514+0000","last_fullsized":"2023-05-17T15:27:39.434514+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046228+0000","last_change":"2023-05-17T15:27:39.042334+0000","last_active":"2023-05-17T15:27:39.046228+0000","last_peered":"2023-05-17T15:27:39.046228+0000","last_clean":"2023-05-17T15:27:39.046228+0000","last_became_active":"2023-05-17T15:27:39.042039+0000","last_became_peered":"2023-05-17T15:27:39.042039+0000","last_unstale":"2023-05-17T15:27:39.046228+0000","last_undegraded":"2023-05-17T15:27:39.046228+0000","last_fullsized":"2023-05-17T15:27:39.046228+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439204+0000","last_change":"2023-05-17T15:27:39.439204+0000","last_active":"2023-05-17T15:27:39.439204+0000","last_peered":"2023-05-17T15:27:39.439204+0000","last_clean":"2023-05-17T15:27:39.439204+0000","last_became_active":"2023-05-17T15:27:39.438780+0000","last_became_peered":"2023-05-17T15:27:39.438780+0000","last_unstale":"2023-05-17T15:27:39.439204+0000","last_undegraded":"2023-05-17T15:27:39.439204+0000","last_fullsized":"2023-05-17T15:27:39.439204+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042584+0000","last_change":"2023-05-17T15:27:39.036116+0000","last_active":"2023-05-17T15:27:39.042584+0000","last_peered":"2023-05-17T15:27:39.042584+0000","last_clean":"2023-05-17T15:27:39.042584+0000","last_became_active":"2023-05-17T15:27:39.035811+0000","last_became_peered":"2023-05-17T15:27:39.035811+0000","last_unstale":"2023-05-17T15:27:39.042584+0000","last_undegraded":"2023-05-17T15:27:39.042584+0000","last_fullsized":"2023-05-17T15:27:39.042584+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436160+0000","last_change":"2023-05-17T15:27:39.436160+0000","last_active":"2023-05-17T15:27:39.436160+0000","last_peered":"2023-05-17T15:27:39.436160+0000","last_clean":"2023-05-17T15:27:39.436160+0000","last_became_active":"2023-05-17T15:27:39.435889+0000","last_became_peered":"2023-05-17T15:27:39.435889+0000","last_unstale":"2023-05-17T15:27:39.436160+0000","last_undegraded":"2023-05-17T15:27:39.436160+0000","last_fullsized":"2023-05-17T15:27:39.436160+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.044320+0000","last_change":"2023-05-17T15:27:39.037323+0000","last_active":"2023-05-17T15:27:39.044320+0000","last_peered":"2023-05-17T15:27:39.044320+0000","last_clean":"2023-05-17T15:27:39.044320+0000","last_became_active":"2023-05-17T15:27:39.036877+0000","last_became_peered":"2023-05-17T15:27:39.036877+0000","last_unstale":"2023-05-17T15:27:39.044320+0000","last_undegraded":"2023-05-17T15:27:39.044320+0000","last_fullsized":"2023-05-17T15:27:39.044320+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442280+0000","last_change":"2023-05-17T15:27:39.442280+0000","last_active":"2023-05-17T15:27:39.442280+0000","last_peered":"2023-05-17T15:27:39.442280+0000","last_clean":"2023-05-17T15:27:39.442280+0000","last_became_active":"2023-05-17T15:27:39.441990+0000","last_became_peered":"2023-05-17T15:27:39.441990+0000","last_unstale":"2023-05-17T15:27:39.442280+0000","last_undegraded":"2023-05-17T15:27:39.442280+0000","last_fullsized":"2023-05-17T15:27:39.442280+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"159'4","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443071+0000","last_change":"2023-05-17T15:27:39.041770+0000","last_active":"2023-05-17T15:27:39.443071+0000","last_peered":"2023-05-17T15:27:39.443071+0000","last_clean":"2023-05-17T15:27:39.443071+0000","last_became_active":"2023-05-17T15:27:39.041493+0000","last_became_peered":"2023-05-17T15:27:39.041493+0000","last_unstale":"2023-05-17T15:27:39.443071+0000","last_undegraded":"2023-05-17T15:27:39.443071+0000","last_fullsized":"2023-05-17T15:27:39.443071+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434028+0000","last_change":"2023-05-17T15:27:39.434028+0000","last_active":"2023-05-17T15:27:39.434028+0000","last_peered":"2023-05-17T15:27:39.434028+0000","last_clean":"2023-05-17T15:27:39.434028+0000","last_became_active":"2023-05-17T15:27:39.433708+0000","last_became_peered":"2023-05-17T15:27:39.433708+0000","last_unstale":"2023-05-17T15:27:39.434028+0000","last_undegraded":"2023-05-17T15:27:39.434028+0000","last_fullsized":"2023-05-17T15:27:39.434028+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426271+0000","last_change":"2023-05-17T15:27:39.036959+0000","last_active":"2023-05-17T15:27:39.426271+0000","last_peered":"2023-05-17T15:27:39.426271+0000","last_clean":"2023-05-17T15:27:39.426271+0000","last_became_active":"2023-05-17T15:27:39.034813+0000","last_became_peered":"2023-05-17T15:27:39.034813+0000","last_unstale":"2023-05-17T15:27:39.426271+0000","last_undegraded":"2023-05-17T15:27:39.426271+0000","last_fullsized":"2023-05-17T15:27:39.426271+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443926+0000","last_change":"2023-05-17T15:27:39.443926+0000","last_active":"2023-05-17T15:27:39.443926+0000","last_peered":"2023-05-17T15:27:39.443926+0000","last_clean":"2023-05-17T15:27:39.443926+0000","last_became_active":"2023-05-17T15:27:39.443608+0000","last_became_peered":"2023-05-17T15:27:39.443608+0000","last_unstale":"2023-05-17T15:27:39.443926+0000","last_undegraded":"2023-05-17T15:27:39.443926+0000","last_fullsized":"2023-05-17T15:27:39.443926+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.045056+0000","last_change":"2023-05-17T15:27:39.041865+0000","last_active":"2023-05-17T15:27:39.045056+0000","last_peered":"2023-05-17T15:27:39.045056+0000","last_clean":"2023-05-17T15:27:39.045056+0000","last_became_active":"2023-05-17T15:27:39.041569+0000","last_became_peered":"2023-05-17T15:27:39.041569+0000","last_unstale":"2023-05-17T15:27:39.045056+0000","last_undegraded":"2023-05-17T15:27:39.045056+0000","last_fullsized":"2023-05-17T15:27:39.045056+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.430024+0000","last_change":"2023-05-17T15:27:39.430024+0000","last_active":"2023-05-17T15:27:39.430024+0000","last_peered":"2023-05-17T15:27:39.430024+0000","last_clean":"2023-05-17T15:27:39.430024+0000","last_became_active":"2023-05-17T15:27:39.429727+0000","last_became_peered":"2023-05-17T15:27:39.429727+0000","last_unstale":"2023-05-17T15:27:39.430024+0000","last_undegraded":"2023-05-17T15:27:39.430024+0000","last_fullsized":"2023-05-17T15:27:39.430024+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042349+0000","last_change":"2023-05-17T15:27:39.036674+0000","last_active":"2023-05-17T15:27:39.042349+0000","last_peered":"2023-05-17T15:27:39.042349+0000","last_clean":"2023-05-17T15:27:39.042349+0000","last_became_active":"2023-05-17T15:27:39.035719+0000","last_became_peered":"2023-05-17T15:27:39.035719+0000","last_unstale":"2023-05-17T15:27:39.042349+0000","last_undegraded":"2023-05-17T15:27:39.042349+0000","last_fullsized":"2023-05-17T15:27:39.042349+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437690+0000","last_change":"2023-05-17T15:27:39.437690+0000","last_active":"2023-05-17T15:27:39.437690+0000","last_peered":"2023-05-17T15:27:39.437690+0000","last_clean":"2023-05-17T15:27:39.437690+0000","last_became_active":"2023-05-17T15:27:39.437180+0000","last_became_peered":"2023-05-17T15:27:39.437180+0000","last_unstale":"2023-05-17T15:27:39.437690+0000","last_undegraded":"2023-05-17T15:27:39.437690+0000","last_fullsized":"2023-05-17T15:27:39.437690+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"159'4","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436781+0000","last_change":"2023-05-17T15:27:39.040504+0000","last_active":"2023-05-17T15:27:39.436781+0000","last_peered":"2023-05-17T15:27:39.436781+0000","last_clean":"2023-05-17T15:27:39.436781+0000","last_became_active":"2023-05-17T15:27:39.039244+0000","last_became_peered":"2023-05-17T15:27:39.039244+0000","last_unstale":"2023-05-17T15:27:39.436781+0000","last_undegraded":"2023-05-17T15:27:39.436781+0000","last_fullsized":"2023-05-17T15:27:39.436781+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437562+0000","last_change":"2023-05-17T15:27:39.437562+0000","last_active":"2023-05-17T15:27:39.437562+0000","last_peered":"2023-05-17T15:27:39.437562+0000","last_clean":"2023-05-17T15:27:39.437562+0000","last_became_active":"2023-05-17T15:27:39.437383+0000","last_became_peered":"2023-05-17T15:27:39.437383+0000","last_unstale":"2023-05-17T15:27:39.437562+0000","last_undegraded":"2023-05-17T15:27:39.437562+0000","last_fullsized":"2023-05-17T15:27:39.437562+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042213+0000","last_change":"2023-05-17T15:27:39.034989+0000","last_active":"2023-05-17T15:27:39.042213+0000","last_peered":"2023-05-17T15:27:39.042213+0000","last_clean":"2023-05-17T15:27:39.042213+0000","last_became_active":"2023-05-17T15:27:39.034676+0000","last_became_peered":"2023-05-17T15:27:39.034676+0000","last_unstale":"2023-05-17T15:27:39.042213+0000","last_undegraded":"2023-05-17T15:27:39.042213+0000","last_fullsized":"2023-05-17T15:27:39.042213+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.438701+0000","last_change":"2023-05-17T15:27:39.438701+0000","last_active":"2023-05-17T15:27:39.438701+0000","last_peered":"2023-05-17T15:27:39.438701+0000","last_clean":"2023-05-17T15:27:39.438701+0000","last_became_active":"2023-05-17T15:27:39.438333+0000","last_became_peered":"2023-05-17T15:27:39.438333+0000","last_unstale":"2023-05-17T15:27:39.438701+0000","last_undegraded":"2023-05-17T15:27:39.438701+0000","last_fullsized":"2023-05-17T15:27:39.438701+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.037876+0000","last_change":"2023-05-17T15:27:39.028789+0000","last_active":"2023-05-17T15:27:39.037876+0000","last_peered":"2023-05-17T15:27:39.037876+0000","last_clean":"2023-05-17T15:27:39.037876+0000","last_became_active":"2023-05-17T15:27:39.028541+0000","last_became_peered":"2023-05-17T15:27:39.028541+0000","last_unstale":"2023-05-17T15:27:39.037876+0000","last_undegraded":"2023-05-17T15:27:39.037876+0000","last_fullsized":"2023-05-17T15:27:39.037876+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.438685+0000","last_change":"2023-05-17T15:27:39.438685+0000","last_active":"2023-05-17T15:27:39.438685+0000","last_peered":"2023-05-17T15:27:39.438685+0000","last_clean":"2023-05-17T15:27:39.438685+0000","last_became_active":"2023-05-17T15:27:39.438405+0000","last_became_peered":"2023-05-17T15:27:39.438405+0000","last_unstale":"2023-05-17T15:27:39.438685+0000","last_undegraded":"2023-05-17T15:27:39.438685+0000","last_fullsized":"2023-05-17T15:27:39.438685+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.420022+0000","last_change":"2023-05-17T15:27:39.032090+0000","last_active":"2023-05-17T15:27:39.420022+0000","last_peered":"2023-05-17T15:27:39.420022+0000","last_clean":"2023-05-17T15:27:39.420022+0000","last_became_active":"2023-05-17T15:27:39.031806+0000","last_became_peered":"2023-05-17T15:27:39.031806+0000","last_unstale":"2023-05-17T15:27:39.420022+0000","last_undegraded":"2023-05-17T15:27:39.420022+0000","last_fullsized":"2023-05-17T15:27:39.420022+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436508+0000","last_change":"2023-05-17T15:27:39.436508+0000","last_active":"2023-05-17T15:27:39.436508+0000","last_peered":"2023-05-17T15:27:39.436508+0000","last_clean":"2023-05-17T15:27:39.436508+0000","last_became_active":"2023-05-17T15:27:39.436206+0000","last_became_peered":"2023-05-17T15:27:39.436206+0000","last_unstale":"2023-05-17T15:27:39.436508+0000","last_undegraded":"2023-05-17T15:27:39.436508+0000","last_fullsized":"2023-05-17T15:27:39.436508+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.038291+0000","last_change":"2023-05-17T15:27:39.031489+0000","last_active":"2023-05-17T15:27:39.038291+0000","last_peered":"2023-05-17T15:27:39.038291+0000","last_clean":"2023-05-17T15:27:39.038291+0000","last_became_active":"2023-05-17T15:27:39.030988+0000","last_became_peered":"2023-05-17T15:27:39.030988+0000","last_unstale":"2023-05-17T15:27:39.038291+0000","last_undegraded":"2023-05-17T15:27:39.038291+0000","last_fullsized":"2023-05-17T15:27:39.038291+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439657+0000","last_change":"2023-05-17T15:27:39.439657+0000","last_active":"2023-05-17T15:27:39.439657+0000","last_peered":"2023-05-17T15:27:39.439657+0000","last_clean":"2023-05-17T15:27:39.439657+0000","last_became_active":"2023-05-17T15:27:39.439040+0000","last_became_peered":"2023-05-17T15:27:39.439040+0000","last_unstale":"2023-05-17T15:27:39.439657+0000","last_undegraded":"2023-05-17T15:27:39.439657+0000","last_fullsized":"2023-05-17T15:27:39.439657+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426243+0000","last_change":"2023-05-17T15:27:39.035273+0000","last_active":"2023-05-17T15:27:39.426243+0000","last_peered":"2023-05-17T15:27:39.426243+0000","last_clean":"2023-05-17T15:27:39.426243+0000","last_became_active":"2023-05-17T15:27:39.034940+0000","last_became_peered":"2023-05-17T15:27:39.034940+0000","last_unstale":"2023-05-17T15:27:39.426243+0000","last_undegraded":"2023-05-17T15:27:39.426243+0000","last_fullsized":"2023-05-17T15:27:39.426243+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441735+0000","last_change":"2023-05-17T15:27:39.441735+0000","last_active":"2023-05-17T15:27:39.441735+0000","last_peered":"2023-05-17T15:27:39.441735+0000","last_clean":"2023-05-17T15:27:39.441735+0000","last_became_active":"2023-05-17T15:27:39.441414+0000","last_became_peered":"2023-05-17T15:27:39.441414+0000","last_unstale":"2023-05-17T15:27:39.441735+0000","last_undegraded":"2023-05-17T15:27:39.441735+0000","last_fullsized":"2023-05-17T15:27:39.441735+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.044288+0000","last_change":"2023-05-17T15:27:39.038170+0000","last_active":"2023-05-17T15:27:39.044288+0000","last_peered":"2023-05-17T15:27:39.044288+0000","last_clean":"2023-05-17T15:27:39.044288+0000","last_became_active":"2023-05-17T15:27:39.037875+0000","last_became_peered":"2023-05-17T15:27:39.037875+0000","last_unstale":"2023-05-17T15:27:39.044288+0000","last_undegraded":"2023-05-17T15:27:39.044288+0000","last_fullsized":"2023-05-17T15:27:39.044288+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.423667+0000","last_change":"2023-05-17T15:27:39.423667+0000","last_active":"2023-05-17T15:27:39.423667+0000","last_peered":"2023-05-17T15:27:39.423667+0000","last_clean":"2023-05-17T15:27:39.423667+0000","last_became_active":"2023-05-17T15:27:39.423411+0000","last_became_peered":"2023-05-17T15:27:39.423411+0000","last_unstale":"2023-05-17T15:27:39.423667+0000","last_undegraded":"2023-05-17T15:27:39.423667+0000","last_fullsized":"2023-05-17T15:27:39.423667+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046136+0000","last_change":"2023-05-17T15:27:39.041775+0000","last_active":"2023-05-17T15:27:39.046136+0000","last_peered":"2023-05-17T15:27:39.046136+0000","last_clean":"2023-05-17T15:27:39.046136+0000","last_became_active":"2023-05-17T15:27:39.041462+0000","last_became_peered":"2023-05-17T15:27:39.041462+0000","last_unstale":"2023-05-17T15:27:39.046136+0000","last_undegraded":"2023-05-17T15:27:39.046136+0000","last_fullsized":"2023-05-17T15:27:39.046136+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429747+0000","last_change":"2023-05-17T15:27:39.429747+0000","last_active":"2023-05-17T15:27:39.429747+0000","last_peered":"2023-05-17T15:27:39.429747+0000","last_clean":"2023-05-17T15:27:39.429747+0000","last_became_active":"2023-05-17T15:27:39.429484+0000","last_became_peered":"2023-05-17T15:27:39.429484+0000","last_unstale":"2023-05-17T15:27:39.429747+0000","last_undegraded":"2023-05-17T15:27:39.429747+0000","last_fullsized":"2023-05-17T15:27:39.429747+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.044790+0000","last_change":"2023-05-17T15:27:39.041073+0000","last_active":"2023-05-17T15:27:39.044790+0000","last_peered":"2023-05-17T15:27:39.044790+0000","last_clean":"2023-05-17T15:27:39.044790+0000","last_became_active":"2023-05-17T15:27:39.040768+0000","last_became_peered":"2023-05-17T15:27:39.040768+0000","last_unstale":"2023-05-17T15:27:39.044790+0000","last_undegraded":"2023-05-17T15:27:39.044790+0000","last_fullsized":"2023-05-17T15:27:39.044790+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.427726+0000","last_change":"2023-05-17T15:27:39.427726+0000","last_active":"2023-05-17T15:27:39.427726+0000","last_peered":"2023-05-17T15:27:39.427726+0000","last_clean":"2023-05-17T15:27:39.427726+0000","last_became_active":"2023-05-17T15:27:39.427499+0000","last_became_peered":"2023-05-17T15:27:39.427499+0000","last_unstale":"2023-05-17T15:27:39.427726+0000","last_undegraded":"2023-05-17T15:27:39.427726+0000","last_fullsized":"2023-05-17T15:27:39.427726+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043247+0000","last_change":"2023-05-17T15:27:39.035833+0000","last_active":"2023-05-17T15:27:39.043247+0000","last_peered":"2023-05-17T15:27:39.043247+0000","last_clean":"2023-05-17T15:27:39.043247+0000","last_became_active":"2023-05-17T15:27:39.035506+0000","last_became_peered":"2023-05-17T15:27:39.035506+0000","last_unstale":"2023-05-17T15:27:39.043247+0000","last_undegraded":"2023-05-17T15:27:39.043247+0000","last_fullsized":"2023-05-17T15:27:39.043247+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429749+0000","last_change":"2023-05-17T15:27:39.429749+0000","last_active":"2023-05-17T15:27:39.429749+0000","last_peered":"2023-05-17T15:27:39.429749+0000","last_clean":"2023-05-17T15:27:39.429749+0000","last_became_active":"2023-05-17T15:27:39.428639+0000","last_became_peered":"2023-05-17T15:27:39.428639+0000","last_unstale":"2023-05-17T15:27:39.429749+0000","last_undegraded":"2023-05-17T15:27:39.429749+0000","last_fullsized":"2023-05-17T15:27:39.429749+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.045118+0000","last_change":"2023-05-17T15:27:39.042649+0000","last_active":"2023-05-17T15:27:39.045118+0000","last_peered":"2023-05-17T15:27:39.045118+0000","last_clean":"2023-05-17T15:27:39.045118+0000","last_became_active":"2023-05-17T15:27:39.042363+0000","last_became_peered":"2023-05-17T15:27:39.042363+0000","last_unstale":"2023-05-17T15:27:39.045118+0000","last_undegraded":"2023-05-17T15:27:39.045118+0000","last_fullsized":"2023-05-17T15:27:39.045118+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437337+0000","last_change":"2023-05-17T15:27:39.437337+0000","last_active":"2023-05-17T15:27:39.437337+0000","last_peered":"2023-05-17T15:27:39.437337+0000","last_clean":"2023-05-17T15:27:39.437337+0000","last_became_active":"2023-05-17T15:27:39.436949+0000","last_became_peered":"2023-05-17T15:27:39.436949+0000","last_unstale":"2023-05-17T15:27:39.437337+0000","last_undegraded":"2023-05-17T15:27:39.437337+0000","last_fullsized":"2023-05-17T15:27:39.437337+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042278+0000","last_change":"2023-05-17T15:27:39.036485+0000","last_active":"2023-05-17T15:27:39.042278+0000","last_peered":"2023-05-17T15:27:39.042278+0000","last_clean":"2023-05-17T15:27:39.042278+0000","last_became_active":"2023-05-17T15:27:39.036242+0000","last_became_peered":"2023-05-17T15:27:39.036242+0000","last_unstale":"2023-05-17T15:27:39.042278+0000","last_undegraded":"2023-05-17T15:27:39.042278+0000","last_fullsized":"2023-05-17T15:27:39.042278+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439358+0000","last_change":"2023-05-17T15:27:39.439358+0000","last_active":"2023-05-17T15:27:39.439358+0000","last_peered":"2023-05-17T15:27:39.439358+0000","last_clean":"2023-05-17T15:27:39.439358+0000","last_became_active":"2023-05-17T15:27:39.439056+0000","last_became_peered":"2023-05-17T15:27:39.439056+0000","last_unstale":"2023-05-17T15:27:39.439358+0000","last_undegraded":"2023-05-17T15:27:39.439358+0000","last_fullsized":"2023-05-17T15:27:39.439358+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.048808+0000","last_change":"2023-05-17T15:27:39.041295+0000","last_active":"2023-05-17T15:27:39.048808+0000","last_peered":"2023-05-17T15:27:39.048808+0000","last_clean":"2023-05-17T15:27:39.048808+0000","last_became_active":"2023-05-17T15:27:39.040566+0000","last_became_peered":"2023-05-17T15:27:39.040566+0000","last_unstale":"2023-05-17T15:27:39.048808+0000","last_undegraded":"2023-05-17T15:27:39.048808+0000","last_fullsized":"2023-05-17T15:27:39.048808+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.431428+0000","last_change":"2023-05-17T15:27:39.431428+0000","last_active":"2023-05-17T15:27:39.431428+0000","last_peered":"2023-05-17T15:27:39.431428+0000","last_clean":"2023-05-17T15:27:39.431428+0000","last_became_active":"2023-05-17T15:27:39.429684+0000","last_became_peered":"2023-05-17T15:27:39.429684+0000","last_unstale":"2023-05-17T15:27:39.431428+0000","last_undegraded":"2023-05-17T15:27:39.431428+0000","last_fullsized":"2023-05-17T15:27:39.431428+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043512+0000","last_change":"2023-05-17T15:27:39.040066+0000","last_active":"2023-05-17T15:27:39.043512+0000","last_peered":"2023-05-17T15:27:39.043512+0000","last_clean":"2023-05-17T15:27:39.043512+0000","last_became_active":"2023-05-17T15:27:39.039764+0000","last_became_peered":"2023-05-17T15:27:39.039764+0000","last_unstale":"2023-05-17T15:27:39.043512+0000","last_undegraded":"2023-05-17T15:27:39.043512+0000","last_fullsized":"2023-05-17T15:27:39.043512+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436334+0000","last_change":"2023-05-17T15:27:39.436334+0000","last_active":"2023-05-17T15:27:39.436334+0000","last_peered":"2023-05-17T15:27:39.436334+0000","last_clean":"2023-05-17T15:27:39.436334+0000","last_became_active":"2023-05-17T15:27:39.436040+0000","last_became_peered":"2023-05-17T15:27:39.436040+0000","last_unstale":"2023-05-17T15:27:39.436334+0000","last_undegraded":"2023-05-17T15:27:39.436334+0000","last_fullsized":"2023-05-17T15:27:39.436334+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043688+0000","last_change":"2023-05-17T15:27:39.040043+0000","last_active":"2023-05-17T15:27:39.043688+0000","last_peered":"2023-05-17T15:27:39.043688+0000","last_clean":"2023-05-17T15:27:39.043688+0000","last_became_active":"2023-05-17T15:27:39.039746+0000","last_became_peered":"2023-05-17T15:27:39.039746+0000","last_unstale":"2023-05-17T15:27:39.043688+0000","last_undegraded":"2023-05-17T15:27:39.043688+0000","last_fullsized":"2023-05-17T15:27:39.043688+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444646+0000","last_change":"2023-05-17T15:27:39.444646+0000","last_active":"2023-05-17T15:27:39.444646+0000","last_peered":"2023-05-17T15:27:39.444646+0000","last_clean":"2023-05-17T15:27:39.444646+0000","last_became_active":"2023-05-17T15:27:39.444370+0000","last_became_peered":"2023-05-17T15:27:39.444370+0000","last_unstale":"2023-05-17T15:27:39.444646+0000","last_undegraded":"2023-05-17T15:27:39.444646+0000","last_fullsized":"2023-05-17T15:27:39.444646+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043446+0000","last_change":"2023-05-17T15:27:39.038906+0000","last_active":"2023-05-17T15:27:39.043446+0000","last_peered":"2023-05-17T15:27:39.043446+0000","last_clean":"2023-05-17T15:27:39.043446+0000","last_became_active":"2023-05-17T15:27:39.038494+0000","last_became_peered":"2023-05-17T15:27:39.038494+0000","last_unstale":"2023-05-17T15:27:39.043446+0000","last_undegraded":"2023-05-17T15:27:39.043446+0000","last_fullsized":"2023-05-17T15:27:39.043446+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441989+0000","last_change":"2023-05-17T15:27:39.441989+0000","last_active":"2023-05-17T15:27:39.441989+0000","last_peered":"2023-05-17T15:27:39.441989+0000","last_clean":"2023-05-17T15:27:39.441989+0000","last_became_active":"2023-05-17T15:27:39.441410+0000","last_became_peered":"2023-05-17T15:27:39.441410+0000","last_unstale":"2023-05-17T15:27:39.441989+0000","last_undegraded":"2023-05-17T15:27:39.441989+0000","last_fullsized":"2023-05-17T15:27:39.441989+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043897+0000","last_change":"2023-05-17T15:27:39.040141+0000","last_active":"2023-05-17T15:27:39.043897+0000","last_peered":"2023-05-17T15:27:39.043897+0000","last_clean":"2023-05-17T15:27:39.043897+0000","last_became_active":"2023-05-17T15:27:39.039734+0000","last_became_peered":"2023-05-17T15:27:39.039734+0000","last_unstale":"2023-05-17T15:27:39.043897+0000","last_undegraded":"2023-05-17T15:27:39.043897+0000","last_fullsized":"2023-05-17T15:27:39.043897+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.440762+0000","last_change":"2023-05-17T15:27:39.440762+0000","last_active":"2023-05-17T15:27:39.440762+0000","last_peered":"2023-05-17T15:27:39.440762+0000","last_clean":"2023-05-17T15:27:39.440762+0000","last_became_active":"2023-05-17T15:27:39.440498+0000","last_became_peered":"2023-05-17T15:27:39.440498+0000","last_unstale":"2023-05-17T15:27:39.440762+0000","last_undegraded":"2023-05-17T15:27:39.440762+0000","last_fullsized":"2023-05-17T15:27:39.440762+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434368+0000","last_change":"2023-05-17T15:27:39.043472+0000","last_active":"2023-05-17T15:27:39.434368+0000","last_peered":"2023-05-17T15:27:39.434368+0000","last_clean":"2023-05-17T15:27:39.434368+0000","last_became_active":"2023-05-17T15:27:39.043241+0000","last_became_peered":"2023-05-17T15:27:39.043241+0000","last_unstale":"2023-05-17T15:27:39.434368+0000","last_undegraded":"2023-05-17T15:27:39.434368+0000","last_fullsized":"2023-05-17T15:27:39.434368+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439032+0000","last_change":"2023-05-17T15:27:39.439032+0000","last_active":"2023-05-17T15:27:39.439032+0000","last_peered":"2023-05-17T15:27:39.439032+0000","last_clean":"2023-05-17T15:27:39.439032+0000","last_became_active":"2023-05-17T15:27:39.438549+0000","last_became_peered":"2023-05-17T15:27:39.438549+0000","last_unstale":"2023-05-17T15:27:39.439032+0000","last_undegraded":"2023-05-17T15:27:39.439032+0000","last_fullsized":"2023-05-17T15:27:39.439032+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.416864+0000","last_change":"2023-05-17T15:27:39.037763+0000","last_active":"2023-05-17T15:27:39.416864+0000","last_peered":"2023-05-17T15:27:39.416864+0000","last_clean":"2023-05-17T15:27:39.416864+0000","last_became_active":"2023-05-17T15:27:39.037426+0000","last_became_peered":"2023-05-17T15:27:39.037426+0000","last_unstale":"2023-05-17T15:27:39.416864+0000","last_undegraded":"2023-05-17T15:27:39.416864+0000","last_fullsized":"2023-05-17T15:27:39.416864+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434596+0000","last_change":"2023-05-17T15:27:39.434596+0000","last_active":"2023-05-17T15:27:39.434596+0000","last_peered":"2023-05-17T15:27:39.434596+0000","last_clean":"2023-05-17T15:27:39.434596+0000","last_became_active":"2023-05-17T15:27:39.434416+0000","last_became_peered":"2023-05-17T15:27:39.434416+0000","last_unstale":"2023-05-17T15:27:39.434596+0000","last_undegraded":"2023-05-17T15:27:39.434596+0000","last_fullsized":"2023-05-17T15:27:39.434596+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436508+0000","last_change":"2023-05-17T15:27:39.037535+0000","last_active":"2023-05-17T15:27:39.436508+0000","last_peered":"2023-05-17T15:27:39.436508+0000","last_clean":"2023-05-17T15:27:39.436508+0000","last_became_active":"2023-05-17T15:27:39.037095+0000","last_became_peered":"2023-05-17T15:27:39.037095+0000","last_unstale":"2023-05-17T15:27:39.436508+0000","last_undegraded":"2023-05-17T15:27:39.436508+0000","last_fullsized":"2023-05-17T15:27:39.436508+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436180+0000","last_change":"2023-05-17T15:27:39.436180+0000","last_active":"2023-05-17T15:27:39.436180+0000","last_peered":"2023-05-17T15:27:39.436180+0000","last_clean":"2023-05-17T15:27:39.436180+0000","last_became_active":"2023-05-17T15:27:39.434278+0000","last_became_peered":"2023-05-17T15:27:39.434278+0000","last_unstale":"2023-05-17T15:27:39.436180+0000","last_undegraded":"2023-05-17T15:27:39.436180+0000","last_fullsized":"2023-05-17T15:27:39.436180+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.037417+0000","last_change":"2023-05-17T15:27:39.032737+0000","last_active":"2023-05-17T15:27:39.037417+0000","last_peered":"2023-05-17T15:27:39.037417+0000","last_clean":"2023-05-17T15:27:39.037417+0000","last_became_active":"2023-05-17T15:27:39.032432+0000","last_became_peered":"2023-05-17T15:27:39.032432+0000","last_unstale":"2023-05-17T15:27:39.037417+0000","last_undegraded":"2023-05-17T15:27:39.037417+0000","last_fullsized":"2023-05-17T15:27:39.037417+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.427474+0000","last_change":"2023-05-17T15:27:39.427474+0000","last_active":"2023-05-17T15:27:39.427474+0000","last_peered":"2023-05-17T15:27:39.427474+0000","last_clean":"2023-05-17T15:27:39.427474+0000","last_became_active":"2023-05-17T15:27:39.427171+0000","last_became_peered":"2023-05-17T15:27:39.427171+0000","last_unstale":"2023-05-17T15:27:39.427474+0000","last_undegraded":"2023-05-17T15:27:39.427474+0000","last_fullsized":"2023-05-17T15:27:39.427474+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042940+0000","last_change":"2023-05-17T15:27:39.035691+0000","last_active":"2023-05-17T15:27:39.042940+0000","last_peered":"2023-05-17T15:27:39.042940+0000","last_clean":"2023-05-17T15:27:39.042940+0000","last_became_active":"2023-05-17T15:27:39.034983+0000","last_became_peered":"2023-05-17T15:27:39.034983+0000","last_unstale":"2023-05-17T15:27:39.042940+0000","last_undegraded":"2023-05-17T15:27:39.042940+0000","last_fullsized":"2023-05-17T15:27:39.042940+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.430073+0000","last_change":"2023-05-17T15:27:39.430073+0000","last_active":"2023-05-17T15:27:39.430073+0000","last_peered":"2023-05-17T15:27:39.430073+0000","last_clean":"2023-05-17T15:27:39.430073+0000","last_became_active":"2023-05-17T15:27:39.429606+0000","last_became_peered":"2023-05-17T15:27:39.429606+0000","last_unstale":"2023-05-17T15:27:39.430073+0000","last_undegraded":"2023-05-17T15:27:39.430073+0000","last_fullsized":"2023-05-17T15:27:39.430073+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.037503+0000","last_change":"2023-05-17T15:27:39.031946+0000","last_active":"2023-05-17T15:27:39.037503+0000","last_peered":"2023-05-17T15:27:39.037503+0000","last_clean":"2023-05-17T15:27:39.037503+0000","last_became_active":"2023-05-17T15:27:39.031633+0000","last_became_peered":"2023-05-17T15:27:39.031633+0000","last_unstale":"2023-05-17T15:27:39.037503+0000","last_undegraded":"2023-05-17T15:27:39.037503+0000","last_fullsized":"2023-05-17T15:27:39.037503+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439328+0000","last_change":"2023-05-17T15:27:39.439328+0000","last_active":"2023-05-17T15:27:39.439328+0000","last_peered":"2023-05-17T15:27:39.439328+0000","last_clean":"2023-05-17T15:27:39.439328+0000","last_became_active":"2023-05-17T15:27:39.439030+0000","last_became_peered":"2023-05-17T15:27:39.439030+0000","last_unstale":"2023-05-17T15:27:39.439328+0000","last_undegraded":"2023-05-17T15:27:39.439328+0000","last_fullsized":"2023-05-17T15:27:39.439328+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042787+0000","last_change":"2023-05-17T15:27:39.039639+0000","last_active":"2023-05-17T15:27:39.042787+0000","last_peered":"2023-05-17T15:27:39.042787+0000","last_clean":"2023-05-17T15:27:39.042787+0000","last_became_active":"2023-05-17T15:27:39.039337+0000","last_became_peered":"2023-05-17T15:27:39.039337+0000","last_unstale":"2023-05-17T15:27:39.042787+0000","last_undegraded":"2023-05-17T15:27:39.042787+0000","last_fullsized":"2023-05-17T15:27:39.042787+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436538+0000","last_change":"2023-05-17T15:27:39.436538+0000","last_active":"2023-05-17T15:27:39.436538+0000","last_peered":"2023-05-17T15:27:39.436538+0000","last_clean":"2023-05-17T15:27:39.436538+0000","last_became_active":"2023-05-17T15:27:39.436230+0000","last_became_peered":"2023-05-17T15:27:39.436230+0000","last_unstale":"2023-05-17T15:27:39.436538+0000","last_undegraded":"2023-05-17T15:27:39.436538+0000","last_fullsized":"2023-05-17T15:27:39.436538+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046073+0000","last_change":"2023-05-17T15:27:39.040616+0000","last_active":"2023-05-17T15:27:39.046073+0000","last_peered":"2023-05-17T15:27:39.046073+0000","last_clean":"2023-05-17T15:27:39.046073+0000","last_became_active":"2023-05-17T15:27:39.040329+0000","last_became_peered":"2023-05-17T15:27:39.040329+0000","last_unstale":"2023-05-17T15:27:39.046073+0000","last_undegraded":"2023-05-17T15:27:39.046073+0000","last_fullsized":"2023-05-17T15:27:39.046073+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437016+0000","last_change":"2023-05-17T15:27:39.437016+0000","last_active":"2023-05-17T15:27:39.437016+0000","last_peered":"2023-05-17T15:27:39.437016+0000","last_clean":"2023-05-17T15:27:39.437016+0000","last_became_active":"2023-05-17T15:27:39.436615+0000","last_became_peered":"2023-05-17T15:27:39.436615+0000","last_unstale":"2023-05-17T15:27:39.437016+0000","last_undegraded":"2023-05-17T15:27:39.437016+0000","last_fullsized":"2023-05-17T15:27:39.437016+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.420606+0000","last_change":"2023-05-17T15:27:39.033721+0000","last_active":"2023-05-17T15:27:39.420606+0000","last_peered":"2023-05-17T15:27:39.420606+0000","last_clean":"2023-05-17T15:27:39.420606+0000","last_became_active":"2023-05-17T15:27:39.033004+0000","last_became_peered":"2023-05-17T15:27:39.033004+0000","last_unstale":"2023-05-17T15:27:39.420606+0000","last_undegraded":"2023-05-17T15:27:39.420606+0000","last_fullsized":"2023-05-17T15:27:39.420606+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439366+0000","last_change":"2023-05-17T15:27:39.439366+0000","last_active":"2023-05-17T15:27:39.439366+0000","last_peered":"2023-05-17T15:27:39.439366+0000","last_clean":"2023-05-17T15:27:39.439366+0000","last_became_active":"2023-05-17T15:27:39.439066+0000","last_became_peered":"2023-05-17T15:27:39.439066+0000","last_unstale":"2023-05-17T15:27:39.439366+0000","last_undegraded":"2023-05-17T15:27:39.439366+0000","last_fullsized":"2023-05-17T15:27:39.439366+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442951+0000","last_change":"2023-05-17T15:27:39.036910+0000","last_active":"2023-05-17T15:27:39.442951+0000","last_peered":"2023-05-17T15:27:39.442951+0000","last_clean":"2023-05-17T15:27:39.442951+0000","last_became_active":"2023-05-17T15:27:39.036476+0000","last_became_peered":"2023-05-17T15:27:39.036476+0000","last_unstale":"2023-05-17T15:27:39.442951+0000","last_undegraded":"2023-05-17T15:27:39.442951+0000","last_fullsized":"2023-05-17T15:27:39.442951+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437066+0000","last_change":"2023-05-17T15:27:39.437066+0000","last_active":"2023-05-17T15:27:39.437066+0000","last_peered":"2023-05-17T15:27:39.437066+0000","last_clean":"2023-05-17T15:27:39.437066+0000","last_became_active":"2023-05-17T15:27:39.435835+0000","last_became_peered":"2023-05-17T15:27:39.435835+0000","last_unstale":"2023-05-17T15:27:39.437066+0000","last_undegraded":"2023-05-17T15:27:39.437066+0000","last_fullsized":"2023-05-17T15:27:39.437066+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042741+0000","last_change":"2023-05-17T15:27:39.038854+0000","last_active":"2023-05-17T15:27:39.042741+0000","last_peered":"2023-05-17T15:27:39.042741+0000","last_clean":"2023-05-17T15:27:39.042741+0000","last_became_active":"2023-05-17T15:27:39.038568+0000","last_became_peered":"2023-05-17T15:27:39.038568+0000","last_unstale":"2023-05-17T15:27:39.042741+0000","last_undegraded":"2023-05-17T15:27:39.042741+0000","last_fullsized":"2023-05-17T15:27:39.042741+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.440925+0000","last_change":"2023-05-17T15:27:39.440925+0000","last_active":"2023-05-17T15:27:39.440925+0000","last_peered":"2023-05-17T15:27:39.440925+0000","last_clean":"2023-05-17T15:27:39.440925+0000","last_became_active":"2023-05-17T15:27:39.440453+0000","last_became_peered":"2023-05-17T15:27:39.440453+0000","last_unstale":"2023-05-17T15:27:39.440925+0000","last_undegraded":"2023-05-17T15:27:39.440925+0000","last_fullsized":"2023-05-17T15:27:39.440925+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043667+0000","last_change":"2023-05-17T15:27:39.039691+0000","last_active":"2023-05-17T15:27:39.043667+0000","last_peered":"2023-05-17T15:27:39.043667+0000","last_clean":"2023-05-17T15:27:39.043667+0000","last_became_active":"2023-05-17T15:27:39.039404+0000","last_became_peered":"2023-05-17T15:27:39.039404+0000","last_unstale":"2023-05-17T15:27:39.043667+0000","last_undegraded":"2023-05-17T15:27:39.043667+0000","last_fullsized":"2023-05-17T15:27:39.043667+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.435082+0000","last_change":"2023-05-17T15:27:39.435082+0000","last_active":"2023-05-17T15:27:39.435082+0000","last_peered":"2023-05-17T15:27:39.435082+0000","last_clean":"2023-05-17T15:27:39.435082+0000","last_became_active":"2023-05-17T15:27:39.434608+0000","last_became_peered":"2023-05-17T15:27:39.434608+0000","last_unstale":"2023-05-17T15:27:39.435082+0000","last_undegraded":"2023-05-17T15:27:39.435082+0000","last_fullsized":"2023-05-17T15:27:39.435082+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.416296+0000","last_change":"2023-05-17T15:27:39.035890+0000","last_active":"2023-05-17T15:27:39.416296+0000","last_peered":"2023-05-17T15:27:39.416296+0000","last_clean":"2023-05-17T15:27:39.416296+0000","last_became_active":"2023-05-17T15:27:39.035393+0000","last_became_peered":"2023-05-17T15:27:39.035393+0000","last_unstale":"2023-05-17T15:27:39.416296+0000","last_undegraded":"2023-05-17T15:27:39.416296+0000","last_fullsized":"2023-05-17T15:27:39.416296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434083+0000","last_change":"2023-05-17T15:27:39.434083+0000","last_active":"2023-05-17T15:27:39.434083+0000","last_peered":"2023-05-17T15:27:39.434083+0000","last_clean":"2023-05-17T15:27:39.434083+0000","last_became_active":"2023-05-17T15:27:39.433824+0000","last_became_peered":"2023-05-17T15:27:39.433824+0000","last_unstale":"2023-05-17T15:27:39.434083+0000","last_undegraded":"2023-05-17T15:27:39.434083+0000","last_fullsized":"2023-05-17T15:27:39.434083+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043667+0000","last_change":"2023-05-17T15:27:39.038544+0000","last_active":"2023-05-17T15:27:39.043667+0000","last_peered":"2023-05-17T15:27:39.043667+0000","last_clean":"2023-05-17T15:27:39.043667+0000","last_became_active":"2023-05-17T15:27:39.036986+0000","last_became_peered":"2023-05-17T15:27:39.036986+0000","last_unstale":"2023-05-17T15:27:39.043667+0000","last_undegraded":"2023-05-17T15:27:39.043667+0000","last_fullsized":"2023-05-17T15:27:39.043667+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443807+0000","last_change":"2023-05-17T15:27:39.443807+0000","last_active":"2023-05-17T15:27:39.443807+0000","last_peered":"2023-05-17T15:27:39.443807+0000","last_clean":"2023-05-17T15:27:39.443807+0000","last_became_active":"2023-05-17T15:27:39.443489+0000","last_became_peered":"2023-05-17T15:27:39.443489+0000","last_unstale":"2023-05-17T15:27:39.443807+0000","last_undegraded":"2023-05-17T15:27:39.443807+0000","last_fullsized":"2023-05-17T15:27:39.443807+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043468+0000","last_change":"2023-05-17T15:27:39.039241+0000","last_active":"2023-05-17T15:27:39.043468+0000","last_peered":"2023-05-17T15:27:39.043468+0000","last_clean":"2023-05-17T15:27:39.043468+0000","last_became_active":"2023-05-17T15:27:39.038941+0000","last_became_peered":"2023-05-17T15:27:39.038941+0000","last_unstale":"2023-05-17T15:27:39.043468+0000","last_undegraded":"2023-05-17T15:27:39.043468+0000","last_fullsized":"2023-05-17T15:27:39.043468+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443861+0000","last_change":"2023-05-17T15:27:39.443861+0000","last_active":"2023-05-17T15:27:39.443861+0000","last_peered":"2023-05-17T15:27:39.443861+0000","last_clean":"2023-05-17T15:27:39.443861+0000","last_became_active":"2023-05-17T15:27:39.443542+0000","last_became_peered":"2023-05-17T15:27:39.443542+0000","last_unstale":"2023-05-17T15:27:39.443861+0000","last_undegraded":"2023-05-17T15:27:39.443861+0000","last_fullsized":"2023-05-17T15:27:39.443861+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042692+0000","last_change":"2023-05-17T15:27:39.034915+0000","last_active":"2023-05-17T15:27:39.042692+0000","last_peered":"2023-05-17T15:27:39.042692+0000","last_clean":"2023-05-17T15:27:39.042692+0000","last_became_active":"2023-05-17T15:27:39.034609+0000","last_became_peered":"2023-05-17T15:27:39.034609+0000","last_unstale":"2023-05-17T15:27:39.042692+0000","last_undegraded":"2023-05-17T15:27:39.042692+0000","last_fullsized":"2023-05-17T15:27:39.042692+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426974+0000","last_change":"2023-05-17T15:27:39.426974+0000","last_active":"2023-05-17T15:27:39.426974+0000","last_peered":"2023-05-17T15:27:39.426974+0000","last_clean":"2023-05-17T15:27:39.426974+0000","last_became_active":"2023-05-17T15:27:39.426716+0000","last_became_peered":"2023-05-17T15:27:39.426716+0000","last_unstale":"2023-05-17T15:27:39.426974+0000","last_undegraded":"2023-05-17T15:27:39.426974+0000","last_fullsized":"2023-05-17T15:27:39.426974+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443607+0000","last_change":"2023-05-17T15:27:39.039030+0000","last_active":"2023-05-17T15:27:39.443607+0000","last_peered":"2023-05-17T15:27:39.443607+0000","last_clean":"2023-05-17T15:27:39.443607+0000","last_became_active":"2023-05-17T15:27:39.038296+0000","last_became_peered":"2023-05-17T15:27:39.038296+0000","last_unstale":"2023-05-17T15:27:39.443607+0000","last_undegraded":"2023-05-17T15:27:39.443607+0000","last_fullsized":"2023-05-17T15:27:39.443607+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437548+0000","last_change":"2023-05-17T15:27:39.437548+0000","last_active":"2023-05-17T15:27:39.437548+0000","last_peered":"2023-05-17T15:27:39.437548+0000","last_clean":"2023-05-17T15:27:39.437548+0000","last_became_active":"2023-05-17T15:27:39.436647+0000","last_became_peered":"2023-05-17T15:27:39.436647+0000","last_unstale":"2023-05-17T15:27:39.437548+0000","last_undegraded":"2023-05-17T15:27:39.437548+0000","last_fullsized":"2023-05-17T15:27:39.437548+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042162+0000","last_change":"2023-05-17T15:27:39.035446+0000","last_active":"2023-05-17T15:27:39.042162+0000","last_peered":"2023-05-17T15:27:39.042162+0000","last_clean":"2023-05-17T15:27:39.042162+0000","last_became_active":"2023-05-17T15:27:39.035147+0000","last_became_peered":"2023-05-17T15:27:39.035147+0000","last_unstale":"2023-05-17T15:27:39.042162+0000","last_undegraded":"2023-05-17T15:27:39.042162+0000","last_fullsized":"2023-05-17T15:27:39.042162+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443566+0000","last_change":"2023-05-17T15:27:39.443566+0000","last_active":"2023-05-17T15:27:39.443566+0000","last_peered":"2023-05-17T15:27:39.443566+0000","last_clean":"2023-05-17T15:27:39.443566+0000","last_became_active":"2023-05-17T15:27:39.443273+0000","last_became_peered":"2023-05-17T15:27:39.443273+0000","last_unstale":"2023-05-17T15:27:39.443566+0000","last_undegraded":"2023-05-17T15:27:39.443566+0000","last_fullsized":"2023-05-17T15:27:39.443566+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042910+0000","last_change":"2023-05-17T15:27:39.036269+0000","last_active":"2023-05-17T15:27:39.042910+0000","last_peered":"2023-05-17T15:27:39.042910+0000","last_clean":"2023-05-17T15:27:39.042910+0000","last_became_active":"2023-05-17T15:27:39.035945+0000","last_became_peered":"2023-05-17T15:27:39.035945+0000","last_unstale":"2023-05-17T15:27:39.042910+0000","last_undegraded":"2023-05-17T15:27:39.042910+0000","last_fullsized":"2023-05-17T15:27:39.042910+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429924+0000","last_change":"2023-05-17T15:27:39.429924+0000","last_active":"2023-05-17T15:27:39.429924+0000","last_peered":"2023-05-17T15:27:39.429924+0000","last_clean":"2023-05-17T15:27:39.429924+0000","last_became_active":"2023-05-17T15:27:39.429630+0000","last_became_peered":"2023-05-17T15:27:39.429630+0000","last_unstale":"2023-05-17T15:27:39.429924+0000","last_undegraded":"2023-05-17T15:27:39.429924+0000","last_fullsized":"2023-05-17T15:27:39.429924+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042406+0000","last_change":"2023-05-17T15:27:39.033666+0000","last_active":"2023-05-17T15:27:39.042406+0000","last_peered":"2023-05-17T15:27:39.042406+0000","last_clean":"2023-05-17T15:27:39.042406+0000","last_became_active":"2023-05-17T15:27:39.032955+0000","last_became_peered":"2023-05-17T15:27:39.032955+0000","last_unstale":"2023-05-17T15:27:39.042406+0000","last_undegraded":"2023-05-17T15:27:39.042406+0000","last_fullsized":"2023-05-17T15:27:39.042406+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437890+0000","last_change":"2023-05-17T15:27:39.437890+0000","last_active":"2023-05-17T15:27:39.437890+0000","last_peered":"2023-05-17T15:27:39.437890+0000","last_clean":"2023-05-17T15:27:39.437890+0000","last_became_active":"2023-05-17T15:27:39.437117+0000","last_became_peered":"2023-05-17T15:27:39.437117+0000","last_unstale":"2023-05-17T15:27:39.437890+0000","last_undegraded":"2023-05-17T15:27:39.437890+0000","last_fullsized":"2023-05-17T15:27:39.437890+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.048996+0000","last_change":"2023-05-17T15:27:39.043075+0000","last_active":"2023-05-17T15:27:39.048996+0000","last_peered":"2023-05-17T15:27:39.048996+0000","last_clean":"2023-05-17T15:27:39.048996+0000","last_became_active":"2023-05-17T15:27:39.042768+0000","last_became_peered":"2023-05-17T15:27:39.042768+0000","last_unstale":"2023-05-17T15:27:39.048996+0000","last_undegraded":"2023-05-17T15:27:39.048996+0000","last_fullsized":"2023-05-17T15:27:39.048996+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.433836+0000","last_change":"2023-05-17T15:27:39.433836+0000","last_active":"2023-05-17T15:27:39.433836+0000","last_peered":"2023-05-17T15:27:39.433836+0000","last_clean":"2023-05-17T15:27:39.433836+0000","last_became_active":"2023-05-17T15:27:39.433565+0000","last_became_peered":"2023-05-17T15:27:39.433565+0000","last_unstale":"2023-05-17T15:27:39.433836+0000","last_undegraded":"2023-05-17T15:27:39.433836+0000","last_fullsized":"2023-05-17T15:27:39.433836+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.038674+0000","last_change":"2023-05-17T15:27:39.035134+0000","last_active":"2023-05-17T15:27:39.038674+0000","last_peered":"2023-05-17T15:27:39.038674+0000","last_clean":"2023-05-17T15:27:39.038674+0000","last_became_active":"2023-05-17T15:27:39.034834+0000","last_became_peered":"2023-05-17T15:27:39.034834+0000","last_unstale":"2023-05-17T15:27:39.038674+0000","last_undegraded":"2023-05-17T15:27:39.038674+0000","last_fullsized":"2023-05-17T15:27:39.038674+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439683+0000","last_change":"2023-05-17T15:27:39.439683+0000","last_active":"2023-05-17T15:27:39.439683+0000","last_peered":"2023-05-17T15:27:39.439683+0000","last_clean":"2023-05-17T15:27:39.439683+0000","last_became_active":"2023-05-17T15:27:39.439417+0000","last_became_peered":"2023-05-17T15:27:39.439417+0000","last_unstale":"2023-05-17T15:27:39.439683+0000","last_undegraded":"2023-05-17T15:27:39.439683+0000","last_fullsized":"2023-05-17T15:27:39.439683+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042529+0000","last_change":"2023-05-17T15:27:39.034973+0000","last_active":"2023-05-17T15:27:39.042529+0000","last_peered":"2023-05-17T15:27:39.042529+0000","last_clean":"2023-05-17T15:27:39.042529+0000","last_became_active":"2023-05-17T15:27:39.034641+0000","last_became_peered":"2023-05-17T15:27:39.034641+0000","last_unstale":"2023-05-17T15:27:39.042529+0000","last_undegraded":"2023-05-17T15:27:39.042529+0000","last_fullsized":"2023-05-17T15:27:39.042529+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444627+0000","last_change":"2023-05-17T15:27:39.444627+0000","last_active":"2023-05-17T15:27:39.444627+0000","last_peered":"2023-05-17T15:27:39.444627+0000","last_clean":"2023-05-17T15:27:39.444627+0000","last_became_active":"2023-05-17T15:27:39.444301+0000","last_became_peered":"2023-05-17T15:27:39.444301+0000","last_unstale":"2023-05-17T15:27:39.444627+0000","last_undegraded":"2023-05-17T15:27:39.444627+0000","last_fullsized":"2023-05-17T15:27:39.444627+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043678+0000","last_change":"2023-05-17T15:27:39.040704+0000","last_active":"2023-05-17T15:27:39.043678+0000","last_peered":"2023-05-17T15:27:39.043678+0000","last_clean":"2023-05-17T15:27:39.043678+0000","last_became_active":"2023-05-17T15:27:39.040215+0000","last_became_peered":"2023-05-17T15:27:39.040215+0000","last_unstale":"2023-05-17T15:27:39.043678+0000","last_undegraded":"2023-05-17T15:27:39.043678+0000","last_fullsized":"2023-05-17T15:27:39.043678+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443676+0000","last_change":"2023-05-17T15:27:39.443676+0000","last_active":"2023-05-17T15:27:39.443676+0000","last_peered":"2023-05-17T15:27:39.443676+0000","last_clean":"2023-05-17T15:27:39.443676+0000","last_became_active":"2023-05-17T15:27:39.443286+0000","last_became_peered":"2023-05-17T15:27:39.443286+0000","last_unstale":"2023-05-17T15:27:39.443676+0000","last_undegraded":"2023-05-17T15:27:39.443676+0000","last_fullsized":"2023-05-17T15:27:39.443676+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"159'3","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444367+0000","last_change":"2023-05-17T15:27:39.031816+0000","last_active":"2023-05-17T15:27:39.444367+0000","last_peered":"2023-05-17T15:27:39.444367+0000","last_clean":"2023-05-17T15:27:39.444367+0000","last_became_active":"2023-05-17T15:27:39.031535+0000","last_became_peered":"2023-05-17T15:27:39.031535+0000","last_unstale":"2023-05-17T15:27:39.444367+0000","last_undegraded":"2023-05-17T15:27:39.444367+0000","last_fullsized":"2023-05-17T15:27:39.444367+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.025697+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:27:39.025697+0000","last_peered":"2023-05-17T15:27:39.025697+0000","last_clean":"2023-05-17T15:27:39.025697+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:27:39.025697+0000","last_undegraded":"2023-05-17T15:27:39.025697+0000","last_fullsized":"2023-05-17T15:27:39.025697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434913+0000","last_change":"2023-05-17T15:27:39.434913+0000","last_active":"2023-05-17T15:27:39.434913+0000","last_peered":"2023-05-17T15:27:39.434913+0000","last_clean":"2023-05-17T15:27:39.434913+0000","last_became_active":"2023-05-17T15:27:39.434529+0000","last_became_peered":"2023-05-17T15:27:39.434529+0000","last_unstale":"2023-05-17T15:27:39.434913+0000","last_undegraded":"2023-05-17T15:27:39.434913+0000","last_fullsized":"2023-05-17T15:27:39.434913+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426138+0000","last_change":"2023-05-17T15:27:39.045498+0000","last_active":"2023-05-17T15:27:39.426138+0000","last_peered":"2023-05-17T15:27:39.426138+0000","last_clean":"2023-05-17T15:27:39.426138+0000","last_became_active":"2023-05-17T15:27:39.045224+0000","last_became_peered":"2023-05-17T15:27:39.045224+0000","last_unstale":"2023-05-17T15:27:39.426138+0000","last_undegraded":"2023-05-17T15:27:39.426138+0000","last_fullsized":"2023-05-17T15:27:39.426138+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.019470+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:27:39.019470+0000","last_peered":"2023-05-17T15:27:39.019470+0000","last_clean":"2023-05-17T15:27:39.019470+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:27:39.019470+0000","last_undegraded":"2023-05-17T15:27:39.019470+0000","last_fullsized":"2023-05-17T15:27:39.019470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.428513+0000","last_change":"2023-05-17T15:27:39.428513+0000","last_active":"2023-05-17T15:27:39.428513+0000","last_peered":"2023-05-17T15:27:39.428513+0000","last_clean":"2023-05-17T15:27:39.428513+0000","last_became_active":"2023-05-17T15:27:39.427869+0000","last_became_peered":"2023-05-17T15:27:39.427869+0000","last_unstale":"2023-05-17T15:27:39.428513+0000","last_undegraded":"2023-05-17T15:27:39.428513+0000","last_fullsized":"2023-05-17T15:27:39.428513+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"159'4","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443015+0000","last_change":"2023-05-17T15:27:39.036060+0000","last_active":"2023-05-17T15:27:39.443015+0000","last_peered":"2023-05-17T15:27:39.443015+0000","last_clean":"2023-05-17T15:27:39.443015+0000","last_became_active":"2023-05-17T15:27:39.035762+0000","last_became_peered":"2023-05-17T15:27:39.035762+0000","last_unstale":"2023-05-17T15:27:39.443015+0000","last_undegraded":"2023-05-17T15:27:39.443015+0000","last_fullsized":"2023-05-17T15:27:39.443015+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.027339+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:27:39.027339+0000","last_peered":"2023-05-17T15:27:39.027339+0000","last_clean":"2023-05-17T15:27:39.027339+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:27:39.027339+0000","last_undegraded":"2023-05-17T15:27:39.027339+0000","last_fullsized":"2023-05-17T15:27:39.027339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441725+0000","last_change":"2023-05-17T15:27:39.441725+0000","last_active":"2023-05-17T15:27:39.441725+0000","last_peered":"2023-05-17T15:27:39.441725+0000","last_clean":"2023-05-17T15:27:39.441725+0000","last_became_active":"2023-05-17T15:27:39.441353+0000","last_became_peered":"2023-05-17T15:27:39.441353+0000","last_unstale":"2023-05-17T15:27:39.441725+0000","last_undegraded":"2023-05-17T15:27:39.441725+0000","last_fullsized":"2023-05-17T15:27:39.441725+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.038699+0000","last_change":"2023-05-17T15:27:39.036268+0000","last_active":"2023-05-17T15:27:39.038699+0000","last_peered":"2023-05-17T15:27:39.038699+0000","last_clean":"2023-05-17T15:27:39.038699+0000","last_became_active":"2023-05-17T15:27:39.035973+0000","last_became_peered":"2023-05-17T15:27:39.035973+0000","last_unstale":"2023-05-17T15:27:39.038699+0000","last_undegraded":"2023-05-17T15:27:39.038699+0000","last_fullsized":"2023-05-17T15:27:39.038699+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.023684+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:27:39.023684+0000","last_peered":"2023-05-17T15:27:39.023684+0000","last_clean":"2023-05-17T15:27:39.023684+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:27:39.023684+0000","last_undegraded":"2023-05-17T15:27:39.023684+0000","last_fullsized":"2023-05-17T15:27:39.023684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":129,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.020429+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:27:39.020429+0000","last_peered":"2023-05-17T15:27:39.020429+0000","last_clean":"2023-05-17T15:27:39.020429+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:27:39.020429+0000","last_undegraded":"2023-05-17T15:27:39.020429+0000","last_fullsized":"2023-05-17T15:27:39.020429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441636+0000","last_change":"2023-05-17T15:27:39.441636+0000","last_active":"2023-05-17T15:27:39.441636+0000","last_peered":"2023-05-17T15:27:39.441636+0000","last_clean":"2023-05-17T15:27:39.441636+0000","last_became_active":"2023-05-17T15:27:39.441020+0000","last_became_peered":"2023-05-17T15:27:39.441020+0000","last_unstale":"2023-05-17T15:27:39.441636+0000","last_undegraded":"2023-05-17T15:27:39.441636+0000","last_fullsized":"2023-05-17T15:27:39.441636+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046053+0000","last_change":"2023-05-17T15:27:39.040583+0000","last_active":"2023-05-17T15:27:39.046053+0000","last_peered":"2023-05-17T15:27:39.046053+0000","last_clean":"2023-05-17T15:27:39.046053+0000","last_became_active":"2023-05-17T15:27:39.040294+0000","last_became_peered":"2023-05-17T15:27:39.040294+0000","last_unstale":"2023-05-17T15:27:39.046053+0000","last_undegraded":"2023-05-17T15:27:39.046053+0000","last_fullsized":"2023-05-17T15:27:39.046053+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.020786+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:27:39.020786+0000","last_peered":"2023-05-17T15:27:39.020786+0000","last_clean":"2023-05-17T15:27:39.020786+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:27:39.020786+0000","last_undegraded":"2023-05-17T15:27:39.020786+0000","last_fullsized":"2023-05-17T15:27:39.020786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.440066+0000","last_change":"2023-05-17T15:27:39.440066+0000","last_active":"2023-05-17T15:27:39.440066+0000","last_peered":"2023-05-17T15:27:39.440066+0000","last_clean":"2023-05-17T15:27:39.440066+0000","last_became_active":"2023-05-17T15:27:39.438199+0000","last_became_peered":"2023-05-17T15:27:39.438199+0000","last_unstale":"2023-05-17T15:27:39.440066+0000","last_undegraded":"2023-05-17T15:27:39.440066+0000","last_fullsized":"2023-05-17T15:27:39.440066+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437394+0000","last_change":"2023-05-17T15:27:39.039718+0000","last_active":"2023-05-17T15:27:39.437394+0000","last_peered":"2023-05-17T15:27:39.437394+0000","last_clean":"2023-05-17T15:27:39.437394+0000","last_became_active":"2023-05-17T15:27:39.039405+0000","last_became_peered":"2023-05-17T15:27:39.039405+0000","last_unstale":"2023-05-17T15:27:39.437394+0000","last_undegraded":"2023-05-17T15:27:39.437394+0000","last_fullsized":"2023-05-17T15:27:39.437394+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.022202+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:27:39.022202+0000","last_peered":"2023-05-17T15:27:39.022202+0000","last_clean":"2023-05-17T15:27:39.022202+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:27:39.022202+0000","last_undegraded":"2023-05-17T15:27:39.022202+0000","last_fullsized":"2023-05-17T15:27:39.022202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443631+0000","last_change":"2023-05-17T15:27:39.443631+0000","last_active":"2023-05-17T15:27:39.443631+0000","last_peered":"2023-05-17T15:27:39.443631+0000","last_clean":"2023-05-17T15:27:39.443631+0000","last_became_active":"2023-05-17T15:27:39.443345+0000","last_became_peered":"2023-05-17T15:27:39.443345+0000","last_unstale":"2023-05-17T15:27:39.443631+0000","last_undegraded":"2023-05-17T15:27:39.443631+0000","last_fullsized":"2023-05-17T15:27:39.443631+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.039715+0000","last_change":"2023-05-17T15:27:39.028051+0000","last_active":"2023-05-17T15:27:39.039715+0000","last_peered":"2023-05-17T15:27:39.039715+0000","last_clean":"2023-05-17T15:27:39.039715+0000","last_became_active":"2023-05-17T15:27:39.027785+0000","last_became_peered":"2023-05-17T15:27:39.027785+0000","last_unstale":"2023-05-17T15:27:39.039715+0000","last_undegraded":"2023-05-17T15:27:39.039715+0000","last_fullsized":"2023-05-17T15:27:39.039715+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":123,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.027951+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:27:39.027951+0000","last_peered":"2023-05-17T15:27:39.027951+0000","last_clean":"2023-05-17T15:27:39.027951+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:27:39.027951+0000","last_undegraded":"2023-05-17T15:27:39.027951+0000","last_fullsized":"2023-05-17T15:27:39.027951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.431001+0000","last_change":"2023-05-17T15:27:39.431001+0000","last_active":"2023-05-17T15:27:39.431001+0000","last_peered":"2023-05-17T15:27:39.431001+0000","last_clean":"2023-05-17T15:27:39.431001+0000","last_became_active":"2023-05-17T15:27:39.430717+0000","last_became_peered":"2023-05-17T15:27:39.430717+0000","last_unstale":"2023-05-17T15:27:39.431001+0000","last_undegraded":"2023-05-17T15:27:39.431001+0000","last_fullsized":"2023-05-17T15:27:39.431001+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.041768+0000","last_change":"2023-05-17T15:27:39.033560+0000","last_active":"2023-05-17T15:27:39.041768+0000","last_peered":"2023-05-17T15:27:39.041768+0000","last_clean":"2023-05-17T15:27:39.041768+0000","last_became_active":"2023-05-17T15:27:39.033253+0000","last_became_peered":"2023-05-17T15:27:39.033253+0000","last_unstale":"2023-05-17T15:27:39.041768+0000","last_undegraded":"2023-05-17T15:27:39.041768+0000","last_fullsized":"2023-05-17T15:27:39.041768+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.025418+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:27:39.025418+0000","last_peered":"2023-05-17T15:27:39.025418+0000","last_clean":"2023-05-17T15:27:39.025418+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:27:39.025418+0000","last_undegraded":"2023-05-17T15:27:39.025418+0000","last_fullsized":"2023-05-17T15:27:39.025418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575248,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20384,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351456,"statfs":{"total":96636764160,"available":96615890944,"internally_reserved":0,"allocated":1990656,"data_stored":1005833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.29399999999999998},"max":{"1min":0.77100000000000002,"5min":0.83799999999999997,"15min":0.86899999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.623,"15min":0.624},"min":{"1min":0.52600000000000002,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.40600000000000003},"max":{"1min":0.81599999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.84799999999999998,"15min":0.88},"last":0.499},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.5,"5min":0.41099999999999998,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.754}]},{"osd":3,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.746,"5min":0.83099999999999996,"15min":0.872},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.38900000000000001,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.754,"15min":0.78700000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64400000000000002,"5min":0.75800000000000001,"15min":0.84999999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.66600000000000004,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.82999999999999996,"15min":0.876},"last":0.71299999999999997}]},{"osd":6,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.38},"max":{"1min":0.79300000000000004,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.69599999999999995,"5min":0.80900000000000005,"15min":0.86899999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575249,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19772,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":17856,"kb_avail":94352068,"statfs":{"total":96636764160,"available":96616517632,"internally_reserved":0,"allocated":1953792,"data_stored":991041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18284544},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.433}]},{"osd":1,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.375},"max":{"1min":0.78300000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":0.77100000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.312},"max":{"1min":0.82799999999999996,"5min":0.876,"15min":0.876},"last":0.497},{"interface":"front","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.63700000000000001}]},{"osd":4,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.623},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.90600000000000003},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575249,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19400,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":17472,"kb_avail":94352440,"statfs":{"total":96636764160,"available":96616898560,"internally_reserved":0,"allocated":1966080,"data_stored":997820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17891328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.48199999999999998,"5min":0.63700000000000001,"15min":0.65000000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45900000000000002,"15min":0.45600000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.92800000000000005},"last":0.253}]},{"osd":2,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.83799999999999997},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.64400000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.443},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.432,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0169999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":0.90900000000000003,"5min":0.94099999999999995,"15min":1.0349999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.006,"15min":1.006},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.98499999999999999},"last":0.435}]},{"osd":6,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.433},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.45800000000000002},"max":{"1min":0.88100000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.45700000000000002},"max":{"1min":0.85399999999999998,"5min":1.024,"15min":1.079},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834575249,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20028,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":18112,"kb_avail":94351812,"statfs":{"total":96636764160,"available":96616255488,"internally_reserved":0,"allocated":1953792,"data_stored":991041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18546688},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.28100000000000003,"5min":0.251,"15min":0.223},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.1910000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.439},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.23799999999999999},"max":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":1.0980000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44,"15min":0.42999999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.56899999999999995,"5min":0.72999999999999998,"15min":1.056},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":1.669},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.29899999999999999,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":1.01},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.74399999999999999,"15min":0.86199999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.69299999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.85699999999999998,"5min":0.94199999999999995,"15min":1.222},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":1.1220000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.768},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.90300000000000002,"15min":1.3839999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":1.286},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53800000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575248,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21212,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94350628,"statfs":{"total":96636764160,"available":96615043072,"internally_reserved":0,"allocated":1986560,"data_stored":1005687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.38500000000000001},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.48099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.60699999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.27800000000000002}]},{"osd":1,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":1.254,"15min":1.254},"last":0.25},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.56399999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":1.04,"15min":1.04},"last":0.30299999999999999}]},{"osd":4,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.85599999999999998,"5min":1.006,"15min":1.006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.0760000000000001,"15min":1.125},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73399999999999999,"5min":1.018,"15min":1.018},"last":0.52100000000000002}]},{"osd":6,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.441},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.81599999999999995,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.498}]},{"osd":7,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.66300000000000003,"15min":0.68899999999999995},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.78200000000000003,"5min":0.94299999999999995,"15min":0.97899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86699999999999999,"5min":1.21,"15min":1.21},"last":0.54400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":26176,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1986560,"data_stored":1005743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26804224},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.69199999999999995,"15min":0.77500000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.24099999999999999},"max":{"1min":0.49199999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.54000000000000004,"5min":0.59599999999999997,"15min":0.74099999999999999},"last":0.376},{"interface":"front","average":{"1min":0.437,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.26900000000000002},"max":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.252}]},{"osd":2,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.499,"15min":0.5},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.57099999999999995,"5min":0.72799999999999998,"15min":0.77600000000000002},"last":0.437}]},{"osd":4,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.46800000000000003,"15min":0.46000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.3799999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.83399999999999996,"5min":0.98599999999999999,"15min":1.2609999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.49099999999999999,"15min":0.38900000000000001},"max":{"1min":0.83199999999999996,"5min":1.046,"15min":1.0940000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":0.81599999999999995,"5min":0.96599999999999997,"15min":1.036},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.443},"max":{"1min":0.88,"5min":1.026,"15min":1.083},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84799999999999998,"5min":0.96999999999999997,"15min":1.079},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.41499999999999998},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":1.036},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.51200000000000001,"5min":0.443,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20040,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":18112,"kb_avail":94351800,"statfs":{"total":96636764160,"available":96616243200,"internally_reserved":0,"allocated":1966080,"data_stored":997820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18546688},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.35699999999999998,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.32500000000000001},"max":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.93000000000000005},"last":0.64200000000000002}]},{"osd":1,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":0.86199999999999999,"15min":1.0169999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.85799999999999998,"15min":0.98499999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.34399999999999997},"max":{"1min":0.77200000000000002,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.39800000000000002,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.52800000000000002}]},{"osd":3,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71599999999999997,"5min":0.83999999999999997,"15min":1.004},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.67300000000000004,"5min":0.83599999999999997,"15min":0.92300000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":0.87,"15min":0.88800000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.88300000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.89000000000000001,"15min":0.94499999999999995},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.34100000000000003},"max":{"1min":0.86399999999999999,"5min":0.97799999999999998,"15min":1.1100000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":1.01,"15min":1.01},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575248,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":25344,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":1966080,"data_stored":997820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25952256},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.83299999999999996,"5min":0.85499999999999998,"15min":0.85699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.85199999999999998,"15min":0.89000000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.498,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47799999999999998,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.51900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.878,"15min":0.88400000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.374},"max":{"1min":0.73699999999999999,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.83399999999999996,"5min":0.84099999999999997,"15min":0.89700000000000002},"last":0.5}]},{"osd":4,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":1.0760000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.88,"15min":1.02},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.131},"last":0.623},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.36199999999999999,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.89700000000000002},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:27:43.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:27:43.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.601+0000 7feb05d63700 1 Processor -- start 2023-05-17T15:27:43.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.601+0000 7feb05d63700 1 -- start start 2023-05-17T15:27:43.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feb05d63700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb000c5f30 0x7feb000c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feb05d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00158880 0x7feb00153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feb05d63700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb000bfcd0 con 0x7feb001541c0 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feb05d63700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb000c0290 con 0x7feb000c5f30 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feb05d63700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000aa1a0 con 0x7feb00158880 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb000c5f30 0x7feb000c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb000c5f30 0x7feb000c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45320/0 (socket says 172.21.15.27:45320) 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 -- 172.21.15.27:0/3945309467 learned_addr learned my addr 172.21.15.27:0/3945309467 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:43.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feafeffd700 1 --2- 172.21.15.27:0/3945309467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00158880 0x7feb00153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 -- 172.21.15.27:0/3945309467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00158880 msgr2=0x7feb00153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 --2- 172.21.15.27:0/3945309467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00158880 0x7feb00153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 -- 172.21.15.27:0/3945309467 >> v1:172.21.15.40:6789/0 conn(0x7feb001541c0 legacy=0x7feb000c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 -- 172.21.15.27:0/3945309467 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000aa480 con 0x7feb000c5f30 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feaff7fe700 1 --2- 172.21.15.27:0/3945309467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000c6310 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7feaf4006fd0 tx=0x7feaf40090f0).ready entity=mon.0 client_cookie=b593afad8f995818 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.602+0000 7feafe7fc700 1 -- 172.21.15.27:0/3945309467 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400b600 con 0x7feb000c5f30 2023-05-17T15:27:43.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feafe7fc700 1 -- 172.21.15.27:0/3945309467 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400b760 con 0x7feb000c5f30 2023-05-17T15:27:43.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feafe7fc700 1 -- 172.21.15.27:0/3945309467 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400bae0 con 0x7feb000c5f30 2023-05-17T15:27:43.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 -- 172.21.15.27:0/3945309467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 msgr2=0x7feb000c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 --2- 172.21.15.27:0/3945309467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000c6310 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7feaf4006fd0 tx=0x7feaf40090f0).stop 2023-05-17T15:27:43.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 -- 172.21.15.27:0/3945309467 shutdown_connections 2023-05-17T15:27:43.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 --2- 172.21.15.27:0/3945309467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000c6310 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 --2- 172.21.15.27:0/3945309467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00158880 0x7feb00153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 -- 172.21.15.27:0/3945309467 >> 172.21.15.27:0/3945309467 conn(0x7feb00069e70 msgr2=0x7feb0005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 -- 172.21.15.27:0/3945309467 shutdown_connections 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.603+0000 7feb05d63700 1 -- 172.21.15.27:0/3945309467 wait complete. 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.604+0000 7feb05d63700 1 Processor -- start 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.604+0000 7feb05d63700 1 -- start start 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feb05d63700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feb05d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb001541c0 0x7feb000c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feb05d63700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb00158880 0x7feb00156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feb05d63700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00155c90 con 0x7feb000c5f30 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feb05d63700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00155080 con 0x7feb00158880 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feb05d63700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb00155360 con 0x7feb001541c0 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000a93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45328/0 (socket says 172.21.15.27:45328) 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 -- 172.21.15.27:0/1465469808 learned_addr learned my addr 172.21.15.27:0/1465469808 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:43.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feafeffd700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb001541c0 0x7feb000c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feafffff700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb00158880 0x7feb00156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 -- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb001541c0 msgr2=0x7feb000c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb001541c0 0x7feb000c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 -- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb00158880 msgr2=0x7feb00156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.605+0000 7feaff7fe700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb00158880 0x7feb00156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feaff7fe700 1 -- 172.21.15.27:0/1465469808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4009370 con 0x7feb000c5f30 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feafffff700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb00158880 0x7feb00156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:43.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feafeffd700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb001541c0 0x7feb000c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feaff7fe700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000a93b0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7feb00083770 tx=0x7feaf4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400b8d0 con 0x7feb000c5f30 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400ba30 con 0x7feb000c5f30 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf401c670 con 0x7feb000c5f30 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00155640 con 0x7feb000c5f30 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.606+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb000a98a0 con 0x7feb000c5f30 2023-05-17T15:27:43.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.607+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00155f70 con 0x7feb000c5f30 2023-05-17T15:27:43.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.608+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7feaf402c070 con 0x7feb000c5f30 2023-05-17T15:27:43.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.608+0000 7feae77fe700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feaec05ee20 0x7feaec0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.608+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7feaf407bb80 con 0x7feb000c5f30 2023-05-17T15:27:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.608+0000 7feafeffd700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feaec05ee20 0x7feaec0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.609+0000 7feafeffd700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feaec05ee20 0x7feaec0612e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7feaf0006fd0 tx=0x7feaf0008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.611+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feaf404d120 con 0x7feb000c5f30 2023-05-17T15:27:43.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.782+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb00155dd0 con 0x7feaec05ee20 2023-05-17T15:27:43.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.792+0000 7feae77fe700 1 -- 172.21.15.27:0/1465469808 <== mgr.8379 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361981 (secure 0 0 0) 0x7feaf0009530 con 0x7feaec05ee20 2023-05-17T15:27:43.799 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:43.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.795+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feaec05ee20 msgr2=0x7feaec0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.795+0000 7feb05d63700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feaec05ee20 0x7feaec0612e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7feaf0006fd0 tx=0x7feaf0008040).stop 2023-05-17T15:27:43.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.795+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 msgr2=0x7feb000a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.795+0000 7feb05d63700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000a93b0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7feb00083770 tx=0x7feaf4017000).stop 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.795+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 shutdown_connections 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feaec05ee20 0x7feaec0612e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb00158880 0x7feb00156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb000c5f30 0x7feb000a93b0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 --2- 172.21.15.27:0/1465469808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb001541c0 0x7feb000c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 >> 172.21.15.27:0/1465469808 conn(0x7feb00069e70 msgr2=0x7feb000af410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:43.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 shutdown_connections 2023-05-17T15:27:43.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.796+0000 7feb05d63700 1 -- 172.21.15.27:0/1465469808 wait complete. 2023-05-17T15:27:43.803 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:27:43.811 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-05-17T15:27:43.735042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":176232,"kb_used_data":15400,"kb_used_omap":0,"kb_used_meta":160768,"kb_avail":754798488,"statfs":{"total":773094113280,"available":772913651712,"internally_reserved":0,"allocated":15769600,"data_stored":7992805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164626432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594394,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.125340"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.422177+0000","last_change":"2023-05-17T15:27:39.422177+0000","last_active":"2023-05-17T15:27:39.422177+0000","last_peered":"2023-05-17T15:27:39.422177+0000","last_clean":"2023-05-17T15:27:39.422177+0000","last_became_active":"2023-05-17T15:27:39.421575+0000","last_became_peered":"2023-05-17T15:27:39.421575+0000","last_unstale":"2023-05-17T15:27:39.422177+0000","last_undegraded":"2023-05-17T15:27:39.422177+0000","last_fullsized":"2023-05-17T15:27:39.422177+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"159'3","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442603+0000","last_change":"2023-05-17T15:27:39.035079+0000","last_active":"2023-05-17T15:27:39.442603+0000","last_peered":"2023-05-17T15:27:39.442603+0000","last_clean":"2023-05-17T15:27:39.442603+0000","last_became_active":"2023-05-17T15:27:39.034751+0000","last_became_peered":"2023-05-17T15:27:39.034751+0000","last_unstale":"2023-05-17T15:27:39.442603+0000","last_undegraded":"2023-05-17T15:27:39.442603+0000","last_fullsized":"2023-05-17T15:27:39.442603+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444749+0000","last_change":"2023-05-17T15:27:39.444749+0000","last_active":"2023-05-17T15:27:39.444749+0000","last_peered":"2023-05-17T15:27:39.444749+0000","last_clean":"2023-05-17T15:27:39.444749+0000","last_became_active":"2023-05-17T15:27:39.444554+0000","last_became_peered":"2023-05-17T15:27:39.444554+0000","last_unstale":"2023-05-17T15:27:39.444749+0000","last_undegraded":"2023-05-17T15:27:39.444749+0000","last_fullsized":"2023-05-17T15:27:39.444749+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042742+0000","last_change":"2023-05-17T15:27:39.039178+0000","last_active":"2023-05-17T15:27:39.042742+0000","last_peered":"2023-05-17T15:27:39.042742+0000","last_clean":"2023-05-17T15:27:39.042742+0000","last_became_active":"2023-05-17T15:27:39.038884+0000","last_became_peered":"2023-05-17T15:27:39.038884+0000","last_unstale":"2023-05-17T15:27:39.042742+0000","last_undegraded":"2023-05-17T15:27:39.042742+0000","last_fullsized":"2023-05-17T15:27:39.042742+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442535+0000","last_change":"2023-05-17T15:27:39.442535+0000","last_active":"2023-05-17T15:27:39.442535+0000","last_peered":"2023-05-17T15:27:39.442535+0000","last_clean":"2023-05-17T15:27:39.442535+0000","last_became_active":"2023-05-17T15:27:39.441731+0000","last_became_peered":"2023-05-17T15:27:39.441731+0000","last_unstale":"2023-05-17T15:27:39.442535+0000","last_undegraded":"2023-05-17T15:27:39.442535+0000","last_fullsized":"2023-05-17T15:27:39.442535+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.041041+0000","last_change":"2023-05-17T15:27:39.038382+0000","last_active":"2023-05-17T15:27:39.041041+0000","last_peered":"2023-05-17T15:27:39.041041+0000","last_clean":"2023-05-17T15:27:39.041041+0000","last_became_active":"2023-05-17T15:27:39.038083+0000","last_became_peered":"2023-05-17T15:27:39.038083+0000","last_unstale":"2023-05-17T15:27:39.041041+0000","last_undegraded":"2023-05-17T15:27:39.041041+0000","last_fullsized":"2023-05-17T15:27:39.041041+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.423341+0000","last_change":"2023-05-17T15:27:39.423341+0000","last_active":"2023-05-17T15:27:39.423341+0000","last_peered":"2023-05-17T15:27:39.423341+0000","last_clean":"2023-05-17T15:27:39.423341+0000","last_became_active":"2023-05-17T15:27:39.423073+0000","last_became_peered":"2023-05-17T15:27:39.423073+0000","last_unstale":"2023-05-17T15:27:39.423341+0000","last_undegraded":"2023-05-17T15:27:39.423341+0000","last_fullsized":"2023-05-17T15:27:39.423341+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.438660+0000","last_change":"2023-05-17T15:27:39.033523+0000","last_active":"2023-05-17T15:27:39.438660+0000","last_peered":"2023-05-17T15:27:39.438660+0000","last_clean":"2023-05-17T15:27:39.438660+0000","last_became_active":"2023-05-17T15:27:39.033016+0000","last_became_peered":"2023-05-17T15:27:39.033016+0000","last_unstale":"2023-05-17T15:27:39.438660+0000","last_undegraded":"2023-05-17T15:27:39.438660+0000","last_fullsized":"2023-05-17T15:27:39.438660+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.435243+0000","last_change":"2023-05-17T15:27:39.435243+0000","last_active":"2023-05-17T15:27:39.435243+0000","last_peered":"2023-05-17T15:27:39.435243+0000","last_clean":"2023-05-17T15:27:39.435243+0000","last_became_active":"2023-05-17T15:27:39.435051+0000","last_became_peered":"2023-05-17T15:27:39.435051+0000","last_unstale":"2023-05-17T15:27:39.435243+0000","last_undegraded":"2023-05-17T15:27:39.435243+0000","last_fullsized":"2023-05-17T15:27:39.435243+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426282+0000","last_change":"2023-05-17T15:27:39.040414+0000","last_active":"2023-05-17T15:27:39.426282+0000","last_peered":"2023-05-17T15:27:39.426282+0000","last_clean":"2023-05-17T15:27:39.426282+0000","last_became_active":"2023-05-17T15:27:39.040138+0000","last_became_peered":"2023-05-17T15:27:39.040138+0000","last_unstale":"2023-05-17T15:27:39.426282+0000","last_undegraded":"2023-05-17T15:27:39.426282+0000","last_fullsized":"2023-05-17T15:27:39.426282+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437300+0000","last_change":"2023-05-17T15:27:39.437300+0000","last_active":"2023-05-17T15:27:39.437300+0000","last_peered":"2023-05-17T15:27:39.437300+0000","last_clean":"2023-05-17T15:27:39.437300+0000","last_became_active":"2023-05-17T15:27:39.436877+0000","last_became_peered":"2023-05-17T15:27:39.436877+0000","last_unstale":"2023-05-17T15:27:39.437300+0000","last_undegraded":"2023-05-17T15:27:39.437300+0000","last_fullsized":"2023-05-17T15:27:39.437300+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.416182+0000","last_change":"2023-05-17T15:27:39.042750+0000","last_active":"2023-05-17T15:27:39.416182+0000","last_peered":"2023-05-17T15:27:39.416182+0000","last_clean":"2023-05-17T15:27:39.416182+0000","last_became_active":"2023-05-17T15:27:39.042464+0000","last_became_peered":"2023-05-17T15:27:39.042464+0000","last_unstale":"2023-05-17T15:27:39.416182+0000","last_undegraded":"2023-05-17T15:27:39.416182+0000","last_fullsized":"2023-05-17T15:27:39.416182+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.433208+0000","last_change":"2023-05-17T15:27:39.433208+0000","last_active":"2023-05-17T15:27:39.433208+0000","last_peered":"2023-05-17T15:27:39.433208+0000","last_clean":"2023-05-17T15:27:39.433208+0000","last_became_active":"2023-05-17T15:27:39.432710+0000","last_became_peered":"2023-05-17T15:27:39.432710+0000","last_unstale":"2023-05-17T15:27:39.433208+0000","last_undegraded":"2023-05-17T15:27:39.433208+0000","last_fullsized":"2023-05-17T15:27:39.433208+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043807+0000","last_change":"2023-05-17T15:27:39.038911+0000","last_active":"2023-05-17T15:27:39.043807+0000","last_peered":"2023-05-17T15:27:39.043807+0000","last_clean":"2023-05-17T15:27:39.043807+0000","last_became_active":"2023-05-17T15:27:39.038596+0000","last_became_peered":"2023-05-17T15:27:39.038596+0000","last_unstale":"2023-05-17T15:27:39.043807+0000","last_undegraded":"2023-05-17T15:27:39.043807+0000","last_fullsized":"2023-05-17T15:27:39.043807+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429949+0000","last_change":"2023-05-17T15:27:39.429949+0000","last_active":"2023-05-17T15:27:39.429949+0000","last_peered":"2023-05-17T15:27:39.429949+0000","last_clean":"2023-05-17T15:27:39.429949+0000","last_became_active":"2023-05-17T15:27:39.428029+0000","last_became_peered":"2023-05-17T15:27:39.428029+0000","last_unstale":"2023-05-17T15:27:39.429949+0000","last_undegraded":"2023-05-17T15:27:39.429949+0000","last_fullsized":"2023-05-17T15:27:39.429949+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.048866+0000","last_change":"2023-05-17T15:27:39.044409+0000","last_active":"2023-05-17T15:27:39.048866+0000","last_peered":"2023-05-17T15:27:39.048866+0000","last_clean":"2023-05-17T15:27:39.048866+0000","last_became_active":"2023-05-17T15:27:39.044216+0000","last_became_peered":"2023-05-17T15:27:39.044216+0000","last_unstale":"2023-05-17T15:27:39.048866+0000","last_undegraded":"2023-05-17T15:27:39.048866+0000","last_fullsized":"2023-05-17T15:27:39.048866+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434514+0000","last_change":"2023-05-17T15:27:39.434514+0000","last_active":"2023-05-17T15:27:39.434514+0000","last_peered":"2023-05-17T15:27:39.434514+0000","last_clean":"2023-05-17T15:27:39.434514+0000","last_became_active":"2023-05-17T15:27:39.434347+0000","last_became_peered":"2023-05-17T15:27:39.434347+0000","last_unstale":"2023-05-17T15:27:39.434514+0000","last_undegraded":"2023-05-17T15:27:39.434514+0000","last_fullsized":"2023-05-17T15:27:39.434514+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046228+0000","last_change":"2023-05-17T15:27:39.042334+0000","last_active":"2023-05-17T15:27:39.046228+0000","last_peered":"2023-05-17T15:27:39.046228+0000","last_clean":"2023-05-17T15:27:39.046228+0000","last_became_active":"2023-05-17T15:27:39.042039+0000","last_became_peered":"2023-05-17T15:27:39.042039+0000","last_unstale":"2023-05-17T15:27:39.046228+0000","last_undegraded":"2023-05-17T15:27:39.046228+0000","last_fullsized":"2023-05-17T15:27:39.046228+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439204+0000","last_change":"2023-05-17T15:27:39.439204+0000","last_active":"2023-05-17T15:27:39.439204+0000","last_peered":"2023-05-17T15:27:39.439204+0000","last_clean":"2023-05-17T15:27:39.439204+0000","last_became_active":"2023-05-17T15:27:39.438780+0000","last_became_peered":"2023-05-17T15:27:39.438780+0000","last_unstale":"2023-05-17T15:27:39.439204+0000","last_undegraded":"2023-05-17T15:27:39.439204+0000","last_fullsized":"2023-05-17T15:27:39.439204+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042584+0000","last_change":"2023-05-17T15:27:39.036116+0000","last_active":"2023-05-17T15:27:39.042584+0000","last_peered":"2023-05-17T15:27:39.042584+0000","last_clean":"2023-05-17T15:27:39.042584+0000","last_became_active":"2023-05-17T15:27:39.035811+0000","last_became_peered":"2023-05-17T15:27:39.035811+0000","last_unstale":"2023-05-17T15:27:39.042584+0000","last_undegraded":"2023-05-17T15:27:39.042584+0000","last_fullsized":"2023-05-17T15:27:39.042584+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436160+0000","last_change":"2023-05-17T15:27:39.436160+0000","last_active":"2023-05-17T15:27:39.436160+0000","last_peered":"2023-05-17T15:27:39.436160+0000","last_clean":"2023-05-17T15:27:39.436160+0000","last_became_active":"2023-05-17T15:27:39.435889+0000","last_became_peered":"2023-05-17T15:27:39.435889+0000","last_unstale":"2023-05-17T15:27:39.436160+0000","last_undegraded":"2023-05-17T15:27:39.436160+0000","last_fullsized":"2023-05-17T15:27:39.436160+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.044320+0000","last_change":"2023-05-17T15:27:39.037323+0000","last_active":"2023-05-17T15:27:39.044320+0000","last_peered":"2023-05-17T15:27:39.044320+0000","last_clean":"2023-05-17T15:27:39.044320+0000","last_became_active":"2023-05-17T15:27:39.036877+0000","last_became_peered":"2023-05-17T15:27:39.036877+0000","last_unstale":"2023-05-17T15:27:39.044320+0000","last_undegraded":"2023-05-17T15:27:39.044320+0000","last_fullsized":"2023-05-17T15:27:39.044320+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442280+0000","last_change":"2023-05-17T15:27:39.442280+0000","last_active":"2023-05-17T15:27:39.442280+0000","last_peered":"2023-05-17T15:27:39.442280+0000","last_clean":"2023-05-17T15:27:39.442280+0000","last_became_active":"2023-05-17T15:27:39.441990+0000","last_became_peered":"2023-05-17T15:27:39.441990+0000","last_unstale":"2023-05-17T15:27:39.442280+0000","last_undegraded":"2023-05-17T15:27:39.442280+0000","last_fullsized":"2023-05-17T15:27:39.442280+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"159'4","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443071+0000","last_change":"2023-05-17T15:27:39.041770+0000","last_active":"2023-05-17T15:27:39.443071+0000","last_peered":"2023-05-17T15:27:39.443071+0000","last_clean":"2023-05-17T15:27:39.443071+0000","last_became_active":"2023-05-17T15:27:39.041493+0000","last_became_peered":"2023-05-17T15:27:39.041493+0000","last_unstale":"2023-05-17T15:27:39.443071+0000","last_undegraded":"2023-05-17T15:27:39.443071+0000","last_fullsized":"2023-05-17T15:27:39.443071+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434028+0000","last_change":"2023-05-17T15:27:39.434028+0000","last_active":"2023-05-17T15:27:39.434028+0000","last_peered":"2023-05-17T15:27:39.434028+0000","last_clean":"2023-05-17T15:27:39.434028+0000","last_became_active":"2023-05-17T15:27:39.433708+0000","last_became_peered":"2023-05-17T15:27:39.433708+0000","last_unstale":"2023-05-17T15:27:39.434028+0000","last_undegraded":"2023-05-17T15:27:39.434028+0000","last_fullsized":"2023-05-17T15:27:39.434028+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426271+0000","last_change":"2023-05-17T15:27:39.036959+0000","last_active":"2023-05-17T15:27:39.426271+0000","last_peered":"2023-05-17T15:27:39.426271+0000","last_clean":"2023-05-17T15:27:39.426271+0000","last_became_active":"2023-05-17T15:27:39.034813+0000","last_became_peered":"2023-05-17T15:27:39.034813+0000","last_unstale":"2023-05-17T15:27:39.426271+0000","last_undegraded":"2023-05-17T15:27:39.426271+0000","last_fullsized":"2023-05-17T15:27:39.426271+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443926+0000","last_change":"2023-05-17T15:27:39.443926+0000","last_active":"2023-05-17T15:27:39.443926+0000","last_peered":"2023-05-17T15:27:39.443926+0000","last_clean":"2023-05-17T15:27:39.443926+0000","last_became_active":"2023-05-17T15:27:39.443608+0000","last_became_peered":"2023-05-17T15:27:39.443608+0000","last_unstale":"2023-05-17T15:27:39.443926+0000","last_undegraded":"2023-05-17T15:27:39.443926+0000","last_fullsized":"2023-05-17T15:27:39.443926+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.045056+0000","last_change":"2023-05-17T15:27:39.041865+0000","last_active":"2023-05-17T15:27:39.045056+0000","last_peered":"2023-05-17T15:27:39.045056+0000","last_clean":"2023-05-17T15:27:39.045056+0000","last_became_active":"2023-05-17T15:27:39.041569+0000","last_became_peered":"2023-05-17T15:27:39.041569+0000","last_unstale":"2023-05-17T15:27:39.045056+0000","last_undegraded":"2023-05-17T15:27:39.045056+0000","last_fullsized":"2023-05-17T15:27:39.045056+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.430024+0000","last_change":"2023-05-17T15:27:39.430024+0000","last_active":"2023-05-17T15:27:39.430024+0000","last_peered":"2023-05-17T15:27:39.430024+0000","last_clean":"2023-05-17T15:27:39.430024+0000","last_became_active":"2023-05-17T15:27:39.429727+0000","last_became_peered":"2023-05-17T15:27:39.429727+0000","last_unstale":"2023-05-17T15:27:39.430024+0000","last_undegraded":"2023-05-17T15:27:39.430024+0000","last_fullsized":"2023-05-17T15:27:39.430024+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042349+0000","last_change":"2023-05-17T15:27:39.036674+0000","last_active":"2023-05-17T15:27:39.042349+0000","last_peered":"2023-05-17T15:27:39.042349+0000","last_clean":"2023-05-17T15:27:39.042349+0000","last_became_active":"2023-05-17T15:27:39.035719+0000","last_became_peered":"2023-05-17T15:27:39.035719+0000","last_unstale":"2023-05-17T15:27:39.042349+0000","last_undegraded":"2023-05-17T15:27:39.042349+0000","last_fullsized":"2023-05-17T15:27:39.042349+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437690+0000","last_change":"2023-05-17T15:27:39.437690+0000","last_active":"2023-05-17T15:27:39.437690+0000","last_peered":"2023-05-17T15:27:39.437690+0000","last_clean":"2023-05-17T15:27:39.437690+0000","last_became_active":"2023-05-17T15:27:39.437180+0000","last_became_peered":"2023-05-17T15:27:39.437180+0000","last_unstale":"2023-05-17T15:27:39.437690+0000","last_undegraded":"2023-05-17T15:27:39.437690+0000","last_fullsized":"2023-05-17T15:27:39.437690+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"159'4","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436781+0000","last_change":"2023-05-17T15:27:39.040504+0000","last_active":"2023-05-17T15:27:39.436781+0000","last_peered":"2023-05-17T15:27:39.436781+0000","last_clean":"2023-05-17T15:27:39.436781+0000","last_became_active":"2023-05-17T15:27:39.039244+0000","last_became_peered":"2023-05-17T15:27:39.039244+0000","last_unstale":"2023-05-17T15:27:39.436781+0000","last_undegraded":"2023-05-17T15:27:39.436781+0000","last_fullsized":"2023-05-17T15:27:39.436781+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437562+0000","last_change":"2023-05-17T15:27:39.437562+0000","last_active":"2023-05-17T15:27:39.437562+0000","last_peered":"2023-05-17T15:27:39.437562+0000","last_clean":"2023-05-17T15:27:39.437562+0000","last_became_active":"2023-05-17T15:27:39.437383+0000","last_became_peered":"2023-05-17T15:27:39.437383+0000","last_unstale":"2023-05-17T15:27:39.437562+0000","last_undegraded":"2023-05-17T15:27:39.437562+0000","last_fullsized":"2023-05-17T15:27:39.437562+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042213+0000","last_change":"2023-05-17T15:27:39.034989+0000","last_active":"2023-05-17T15:27:39.042213+0000","last_peered":"2023-05-17T15:27:39.042213+0000","last_clean":"2023-05-17T15:27:39.042213+0000","last_became_active":"2023-05-17T15:27:39.034676+0000","last_became_peered":"2023-05-17T15:27:39.034676+0000","last_unstale":"2023-05-17T15:27:39.042213+0000","last_undegraded":"2023-05-17T15:27:39.042213+0000","last_fullsized":"2023-05-17T15:27:39.042213+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.438701+0000","last_change":"2023-05-17T15:27:39.438701+0000","last_active":"2023-05-17T15:27:39.438701+0000","last_peered":"2023-05-17T15:27:39.438701+0000","last_clean":"2023-05-17T15:27:39.438701+0000","last_became_active":"2023-05-17T15:27:39.438333+0000","last_became_peered":"2023-05-17T15:27:39.438333+0000","last_unstale":"2023-05-17T15:27:39.438701+0000","last_undegraded":"2023-05-17T15:27:39.438701+0000","last_fullsized":"2023-05-17T15:27:39.438701+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.037876+0000","last_change":"2023-05-17T15:27:39.028789+0000","last_active":"2023-05-17T15:27:39.037876+0000","last_peered":"2023-05-17T15:27:39.037876+0000","last_clean":"2023-05-17T15:27:39.037876+0000","last_became_active":"2023-05-17T15:27:39.028541+0000","last_became_peered":"2023-05-17T15:27:39.028541+0000","last_unstale":"2023-05-17T15:27:39.037876+0000","last_undegraded":"2023-05-17T15:27:39.037876+0000","last_fullsized":"2023-05-17T15:27:39.037876+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.438685+0000","last_change":"2023-05-17T15:27:39.438685+0000","last_active":"2023-05-17T15:27:39.438685+0000","last_peered":"2023-05-17T15:27:39.438685+0000","last_clean":"2023-05-17T15:27:39.438685+0000","last_became_active":"2023-05-17T15:27:39.438405+0000","last_became_peered":"2023-05-17T15:27:39.438405+0000","last_unstale":"2023-05-17T15:27:39.438685+0000","last_undegraded":"2023-05-17T15:27:39.438685+0000","last_fullsized":"2023-05-17T15:27:39.438685+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.420022+0000","last_change":"2023-05-17T15:27:39.032090+0000","last_active":"2023-05-17T15:27:39.420022+0000","last_peered":"2023-05-17T15:27:39.420022+0000","last_clean":"2023-05-17T15:27:39.420022+0000","last_became_active":"2023-05-17T15:27:39.031806+0000","last_became_peered":"2023-05-17T15:27:39.031806+0000","last_unstale":"2023-05-17T15:27:39.420022+0000","last_undegraded":"2023-05-17T15:27:39.420022+0000","last_fullsized":"2023-05-17T15:27:39.420022+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436508+0000","last_change":"2023-05-17T15:27:39.436508+0000","last_active":"2023-05-17T15:27:39.436508+0000","last_peered":"2023-05-17T15:27:39.436508+0000","last_clean":"2023-05-17T15:27:39.436508+0000","last_became_active":"2023-05-17T15:27:39.436206+0000","last_became_peered":"2023-05-17T15:27:39.436206+0000","last_unstale":"2023-05-17T15:27:39.436508+0000","last_undegraded":"2023-05-17T15:27:39.436508+0000","last_fullsized":"2023-05-17T15:27:39.436508+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.038291+0000","last_change":"2023-05-17T15:27:39.031489+0000","last_active":"2023-05-17T15:27:39.038291+0000","last_peered":"2023-05-17T15:27:39.038291+0000","last_clean":"2023-05-17T15:27:39.038291+0000","last_became_active":"2023-05-17T15:27:39.030988+0000","last_became_peered":"2023-05-17T15:27:39.030988+0000","last_unstale":"2023-05-17T15:27:39.038291+0000","last_undegraded":"2023-05-17T15:27:39.038291+0000","last_fullsized":"2023-05-17T15:27:39.038291+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439657+0000","last_change":"2023-05-17T15:27:39.439657+0000","last_active":"2023-05-17T15:27:39.439657+0000","last_peered":"2023-05-17T15:27:39.439657+0000","last_clean":"2023-05-17T15:27:39.439657+0000","last_became_active":"2023-05-17T15:27:39.439040+0000","last_became_peered":"2023-05-17T15:27:39.439040+0000","last_unstale":"2023-05-17T15:27:39.439657+0000","last_undegraded":"2023-05-17T15:27:39.439657+0000","last_fullsized":"2023-05-17T15:27:39.439657+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426243+0000","last_change":"2023-05-17T15:27:39.035273+0000","last_active":"2023-05-17T15:27:39.426243+0000","last_peered":"2023-05-17T15:27:39.426243+0000","last_clean":"2023-05-17T15:27:39.426243+0000","last_became_active":"2023-05-17T15:27:39.034940+0000","last_became_peered":"2023-05-17T15:27:39.034940+0000","last_unstale":"2023-05-17T15:27:39.426243+0000","last_undegraded":"2023-05-17T15:27:39.426243+0000","last_fullsized":"2023-05-17T15:27:39.426243+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441735+0000","last_change":"2023-05-17T15:27:39.441735+0000","last_active":"2023-05-17T15:27:39.441735+0000","last_peered":"2023-05-17T15:27:39.441735+0000","last_clean":"2023-05-17T15:27:39.441735+0000","last_became_active":"2023-05-17T15:27:39.441414+0000","last_became_peered":"2023-05-17T15:27:39.441414+0000","last_unstale":"2023-05-17T15:27:39.441735+0000","last_undegraded":"2023-05-17T15:27:39.441735+0000","last_fullsized":"2023-05-17T15:27:39.441735+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.044288+0000","last_change":"2023-05-17T15:27:39.038170+0000","last_active":"2023-05-17T15:27:39.044288+0000","last_peered":"2023-05-17T15:27:39.044288+0000","last_clean":"2023-05-17T15:27:39.044288+0000","last_became_active":"2023-05-17T15:27:39.037875+0000","last_became_peered":"2023-05-17T15:27:39.037875+0000","last_unstale":"2023-05-17T15:27:39.044288+0000","last_undegraded":"2023-05-17T15:27:39.044288+0000","last_fullsized":"2023-05-17T15:27:39.044288+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.423667+0000","last_change":"2023-05-17T15:27:39.423667+0000","last_active":"2023-05-17T15:27:39.423667+0000","last_peered":"2023-05-17T15:27:39.423667+0000","last_clean":"2023-05-17T15:27:39.423667+0000","last_became_active":"2023-05-17T15:27:39.423411+0000","last_became_peered":"2023-05-17T15:27:39.423411+0000","last_unstale":"2023-05-17T15:27:39.423667+0000","last_undegraded":"2023-05-17T15:27:39.423667+0000","last_fullsized":"2023-05-17T15:27:39.423667+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046136+0000","last_change":"2023-05-17T15:27:39.041775+0000","last_active":"2023-05-17T15:27:39.046136+0000","last_peered":"2023-05-17T15:27:39.046136+0000","last_clean":"2023-05-17T15:27:39.046136+0000","last_became_active":"2023-05-17T15:27:39.041462+0000","last_became_peered":"2023-05-17T15:27:39.041462+0000","last_unstale":"2023-05-17T15:27:39.046136+0000","last_undegraded":"2023-05-17T15:27:39.046136+0000","last_fullsized":"2023-05-17T15:27:39.046136+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429747+0000","last_change":"2023-05-17T15:27:39.429747+0000","last_active":"2023-05-17T15:27:39.429747+0000","last_peered":"2023-05-17T15:27:39.429747+0000","last_clean":"2023-05-17T15:27:39.429747+0000","last_became_active":"2023-05-17T15:27:39.429484+0000","last_became_peered":"2023-05-17T15:27:39.429484+0000","last_unstale":"2023-05-17T15:27:39.429747+0000","last_undegraded":"2023-05-17T15:27:39.429747+0000","last_fullsized":"2023-05-17T15:27:39.429747+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.044790+0000","last_change":"2023-05-17T15:27:39.041073+0000","last_active":"2023-05-17T15:27:39.044790+0000","last_peered":"2023-05-17T15:27:39.044790+0000","last_clean":"2023-05-17T15:27:39.044790+0000","last_became_active":"2023-05-17T15:27:39.040768+0000","last_became_peered":"2023-05-17T15:27:39.040768+0000","last_unstale":"2023-05-17T15:27:39.044790+0000","last_undegraded":"2023-05-17T15:27:39.044790+0000","last_fullsized":"2023-05-17T15:27:39.044790+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.427726+0000","last_change":"2023-05-17T15:27:39.427726+0000","last_active":"2023-05-17T15:27:39.427726+0000","last_peered":"2023-05-17T15:27:39.427726+0000","last_clean":"2023-05-17T15:27:39.427726+0000","last_became_active":"2023-05-17T15:27:39.427499+0000","last_became_peered":"2023-05-17T15:27:39.427499+0000","last_unstale":"2023-05-17T15:27:39.427726+0000","last_undegraded":"2023-05-17T15:27:39.427726+0000","last_fullsized":"2023-05-17T15:27:39.427726+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043247+0000","last_change":"2023-05-17T15:27:39.035833+0000","last_active":"2023-05-17T15:27:39.043247+0000","last_peered":"2023-05-17T15:27:39.043247+0000","last_clean":"2023-05-17T15:27:39.043247+0000","last_became_active":"2023-05-17T15:27:39.035506+0000","last_became_peered":"2023-05-17T15:27:39.035506+0000","last_unstale":"2023-05-17T15:27:39.043247+0000","last_undegraded":"2023-05-17T15:27:39.043247+0000","last_fullsized":"2023-05-17T15:27:39.043247+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429749+0000","last_change":"2023-05-17T15:27:39.429749+0000","last_active":"2023-05-17T15:27:39.429749+0000","last_peered":"2023-05-17T15:27:39.429749+0000","last_clean":"2023-05-17T15:27:39.429749+0000","last_became_active":"2023-05-17T15:27:39.428639+0000","last_became_peered":"2023-05-17T15:27:39.428639+0000","last_unstale":"2023-05-17T15:27:39.429749+0000","last_undegraded":"2023-05-17T15:27:39.429749+0000","last_fullsized":"2023-05-17T15:27:39.429749+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.045118+0000","last_change":"2023-05-17T15:27:39.042649+0000","last_active":"2023-05-17T15:27:39.045118+0000","last_peered":"2023-05-17T15:27:39.045118+0000","last_clean":"2023-05-17T15:27:39.045118+0000","last_became_active":"2023-05-17T15:27:39.042363+0000","last_became_peered":"2023-05-17T15:27:39.042363+0000","last_unstale":"2023-05-17T15:27:39.045118+0000","last_undegraded":"2023-05-17T15:27:39.045118+0000","last_fullsized":"2023-05-17T15:27:39.045118+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437337+0000","last_change":"2023-05-17T15:27:39.437337+0000","last_active":"2023-05-17T15:27:39.437337+0000","last_peered":"2023-05-17T15:27:39.437337+0000","last_clean":"2023-05-17T15:27:39.437337+0000","last_became_active":"2023-05-17T15:27:39.436949+0000","last_became_peered":"2023-05-17T15:27:39.436949+0000","last_unstale":"2023-05-17T15:27:39.437337+0000","last_undegraded":"2023-05-17T15:27:39.437337+0000","last_fullsized":"2023-05-17T15:27:39.437337+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042278+0000","last_change":"2023-05-17T15:27:39.036485+0000","last_active":"2023-05-17T15:27:39.042278+0000","last_peered":"2023-05-17T15:27:39.042278+0000","last_clean":"2023-05-17T15:27:39.042278+0000","last_became_active":"2023-05-17T15:27:39.036242+0000","last_became_peered":"2023-05-17T15:27:39.036242+0000","last_unstale":"2023-05-17T15:27:39.042278+0000","last_undegraded":"2023-05-17T15:27:39.042278+0000","last_fullsized":"2023-05-17T15:27:39.042278+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439358+0000","last_change":"2023-05-17T15:27:39.439358+0000","last_active":"2023-05-17T15:27:39.439358+0000","last_peered":"2023-05-17T15:27:39.439358+0000","last_clean":"2023-05-17T15:27:39.439358+0000","last_became_active":"2023-05-17T15:27:39.439056+0000","last_became_peered":"2023-05-17T15:27:39.439056+0000","last_unstale":"2023-05-17T15:27:39.439358+0000","last_undegraded":"2023-05-17T15:27:39.439358+0000","last_fullsized":"2023-05-17T15:27:39.439358+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.048808+0000","last_change":"2023-05-17T15:27:39.041295+0000","last_active":"2023-05-17T15:27:39.048808+0000","last_peered":"2023-05-17T15:27:39.048808+0000","last_clean":"2023-05-17T15:27:39.048808+0000","last_became_active":"2023-05-17T15:27:39.040566+0000","last_became_peered":"2023-05-17T15:27:39.040566+0000","last_unstale":"2023-05-17T15:27:39.048808+0000","last_undegraded":"2023-05-17T15:27:39.048808+0000","last_fullsized":"2023-05-17T15:27:39.048808+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.431428+0000","last_change":"2023-05-17T15:27:39.431428+0000","last_active":"2023-05-17T15:27:39.431428+0000","last_peered":"2023-05-17T15:27:39.431428+0000","last_clean":"2023-05-17T15:27:39.431428+0000","last_became_active":"2023-05-17T15:27:39.429684+0000","last_became_peered":"2023-05-17T15:27:39.429684+0000","last_unstale":"2023-05-17T15:27:39.431428+0000","last_undegraded":"2023-05-17T15:27:39.431428+0000","last_fullsized":"2023-05-17T15:27:39.431428+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043512+0000","last_change":"2023-05-17T15:27:39.040066+0000","last_active":"2023-05-17T15:27:39.043512+0000","last_peered":"2023-05-17T15:27:39.043512+0000","last_clean":"2023-05-17T15:27:39.043512+0000","last_became_active":"2023-05-17T15:27:39.039764+0000","last_became_peered":"2023-05-17T15:27:39.039764+0000","last_unstale":"2023-05-17T15:27:39.043512+0000","last_undegraded":"2023-05-17T15:27:39.043512+0000","last_fullsized":"2023-05-17T15:27:39.043512+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436334+0000","last_change":"2023-05-17T15:27:39.436334+0000","last_active":"2023-05-17T15:27:39.436334+0000","last_peered":"2023-05-17T15:27:39.436334+0000","last_clean":"2023-05-17T15:27:39.436334+0000","last_became_active":"2023-05-17T15:27:39.436040+0000","last_became_peered":"2023-05-17T15:27:39.436040+0000","last_unstale":"2023-05-17T15:27:39.436334+0000","last_undegraded":"2023-05-17T15:27:39.436334+0000","last_fullsized":"2023-05-17T15:27:39.436334+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043688+0000","last_change":"2023-05-17T15:27:39.040043+0000","last_active":"2023-05-17T15:27:39.043688+0000","last_peered":"2023-05-17T15:27:39.043688+0000","last_clean":"2023-05-17T15:27:39.043688+0000","last_became_active":"2023-05-17T15:27:39.039746+0000","last_became_peered":"2023-05-17T15:27:39.039746+0000","last_unstale":"2023-05-17T15:27:39.043688+0000","last_undegraded":"2023-05-17T15:27:39.043688+0000","last_fullsized":"2023-05-17T15:27:39.043688+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444646+0000","last_change":"2023-05-17T15:27:39.444646+0000","last_active":"2023-05-17T15:27:39.444646+0000","last_peered":"2023-05-17T15:27:39.444646+0000","last_clean":"2023-05-17T15:27:39.444646+0000","last_became_active":"2023-05-17T15:27:39.444370+0000","last_became_peered":"2023-05-17T15:27:39.444370+0000","last_unstale":"2023-05-17T15:27:39.444646+0000","last_undegraded":"2023-05-17T15:27:39.444646+0000","last_fullsized":"2023-05-17T15:27:39.444646+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043446+0000","last_change":"2023-05-17T15:27:39.038906+0000","last_active":"2023-05-17T15:27:39.043446+0000","last_peered":"2023-05-17T15:27:39.043446+0000","last_clean":"2023-05-17T15:27:39.043446+0000","last_became_active":"2023-05-17T15:27:39.038494+0000","last_became_peered":"2023-05-17T15:27:39.038494+0000","last_unstale":"2023-05-17T15:27:39.043446+0000","last_undegraded":"2023-05-17T15:27:39.043446+0000","last_fullsized":"2023-05-17T15:27:39.043446+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441989+0000","last_change":"2023-05-17T15:27:39.441989+0000","last_active":"2023-05-17T15:27:39.441989+0000","last_peered":"2023-05-17T15:27:39.441989+0000","last_clean":"2023-05-17T15:27:39.441989+0000","last_became_active":"2023-05-17T15:27:39.441410+0000","last_became_peered":"2023-05-17T15:27:39.441410+0000","last_unstale":"2023-05-17T15:27:39.441989+0000","last_undegraded":"2023-05-17T15:27:39.441989+0000","last_fullsized":"2023-05-17T15:27:39.441989+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043897+0000","last_change":"2023-05-17T15:27:39.040141+0000","last_active":"2023-05-17T15:27:39.043897+0000","last_peered":"2023-05-17T15:27:39.043897+0000","last_clean":"2023-05-17T15:27:39.043897+0000","last_became_active":"2023-05-17T15:27:39.039734+0000","last_became_peered":"2023-05-17T15:27:39.039734+0000","last_unstale":"2023-05-17T15:27:39.043897+0000","last_undegraded":"2023-05-17T15:27:39.043897+0000","last_fullsized":"2023-05-17T15:27:39.043897+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.440762+0000","last_change":"2023-05-17T15:27:39.440762+0000","last_active":"2023-05-17T15:27:39.440762+0000","last_peered":"2023-05-17T15:27:39.440762+0000","last_clean":"2023-05-17T15:27:39.440762+0000","last_became_active":"2023-05-17T15:27:39.440498+0000","last_became_peered":"2023-05-17T15:27:39.440498+0000","last_unstale":"2023-05-17T15:27:39.440762+0000","last_undegraded":"2023-05-17T15:27:39.440762+0000","last_fullsized":"2023-05-17T15:27:39.440762+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434368+0000","last_change":"2023-05-17T15:27:39.043472+0000","last_active":"2023-05-17T15:27:39.434368+0000","last_peered":"2023-05-17T15:27:39.434368+0000","last_clean":"2023-05-17T15:27:39.434368+0000","last_became_active":"2023-05-17T15:27:39.043241+0000","last_became_peered":"2023-05-17T15:27:39.043241+0000","last_unstale":"2023-05-17T15:27:39.434368+0000","last_undegraded":"2023-05-17T15:27:39.434368+0000","last_fullsized":"2023-05-17T15:27:39.434368+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439032+0000","last_change":"2023-05-17T15:27:39.439032+0000","last_active":"2023-05-17T15:27:39.439032+0000","last_peered":"2023-05-17T15:27:39.439032+0000","last_clean":"2023-05-17T15:27:39.439032+0000","last_became_active":"2023-05-17T15:27:39.438549+0000","last_became_peered":"2023-05-17T15:27:39.438549+0000","last_unstale":"2023-05-17T15:27:39.439032+0000","last_undegraded":"2023-05-17T15:27:39.439032+0000","last_fullsized":"2023-05-17T15:27:39.439032+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.416864+0000","last_change":"2023-05-17T15:27:39.037763+0000","last_active":"2023-05-17T15:27:39.416864+0000","last_peered":"2023-05-17T15:27:39.416864+0000","last_clean":"2023-05-17T15:27:39.416864+0000","last_became_active":"2023-05-17T15:27:39.037426+0000","last_became_peered":"2023-05-17T15:27:39.037426+0000","last_unstale":"2023-05-17T15:27:39.416864+0000","last_undegraded":"2023-05-17T15:27:39.416864+0000","last_fullsized":"2023-05-17T15:27:39.416864+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434596+0000","last_change":"2023-05-17T15:27:39.434596+0000","last_active":"2023-05-17T15:27:39.434596+0000","last_peered":"2023-05-17T15:27:39.434596+0000","last_clean":"2023-05-17T15:27:39.434596+0000","last_became_active":"2023-05-17T15:27:39.434416+0000","last_became_peered":"2023-05-17T15:27:39.434416+0000","last_unstale":"2023-05-17T15:27:39.434596+0000","last_undegraded":"2023-05-17T15:27:39.434596+0000","last_fullsized":"2023-05-17T15:27:39.434596+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436508+0000","last_change":"2023-05-17T15:27:39.037535+0000","last_active":"2023-05-17T15:27:39.436508+0000","last_peered":"2023-05-17T15:27:39.436508+0000","last_clean":"2023-05-17T15:27:39.436508+0000","last_became_active":"2023-05-17T15:27:39.037095+0000","last_became_peered":"2023-05-17T15:27:39.037095+0000","last_unstale":"2023-05-17T15:27:39.436508+0000","last_undegraded":"2023-05-17T15:27:39.436508+0000","last_fullsized":"2023-05-17T15:27:39.436508+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436180+0000","last_change":"2023-05-17T15:27:39.436180+0000","last_active":"2023-05-17T15:27:39.436180+0000","last_peered":"2023-05-17T15:27:39.436180+0000","last_clean":"2023-05-17T15:27:39.436180+0000","last_became_active":"2023-05-17T15:27:39.434278+0000","last_became_peered":"2023-05-17T15:27:39.434278+0000","last_unstale":"2023-05-17T15:27:39.436180+0000","last_undegraded":"2023-05-17T15:27:39.436180+0000","last_fullsized":"2023-05-17T15:27:39.436180+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.037417+0000","last_change":"2023-05-17T15:27:39.032737+0000","last_active":"2023-05-17T15:27:39.037417+0000","last_peered":"2023-05-17T15:27:39.037417+0000","last_clean":"2023-05-17T15:27:39.037417+0000","last_became_active":"2023-05-17T15:27:39.032432+0000","last_became_peered":"2023-05-17T15:27:39.032432+0000","last_unstale":"2023-05-17T15:27:39.037417+0000","last_undegraded":"2023-05-17T15:27:39.037417+0000","last_fullsized":"2023-05-17T15:27:39.037417+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.427474+0000","last_change":"2023-05-17T15:27:39.427474+0000","last_active":"2023-05-17T15:27:39.427474+0000","last_peered":"2023-05-17T15:27:39.427474+0000","last_clean":"2023-05-17T15:27:39.427474+0000","last_became_active":"2023-05-17T15:27:39.427171+0000","last_became_peered":"2023-05-17T15:27:39.427171+0000","last_unstale":"2023-05-17T15:27:39.427474+0000","last_undegraded":"2023-05-17T15:27:39.427474+0000","last_fullsized":"2023-05-17T15:27:39.427474+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042940+0000","last_change":"2023-05-17T15:27:39.035691+0000","last_active":"2023-05-17T15:27:39.042940+0000","last_peered":"2023-05-17T15:27:39.042940+0000","last_clean":"2023-05-17T15:27:39.042940+0000","last_became_active":"2023-05-17T15:27:39.034983+0000","last_became_peered":"2023-05-17T15:27:39.034983+0000","last_unstale":"2023-05-17T15:27:39.042940+0000","last_undegraded":"2023-05-17T15:27:39.042940+0000","last_fullsized":"2023-05-17T15:27:39.042940+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.430073+0000","last_change":"2023-05-17T15:27:39.430073+0000","last_active":"2023-05-17T15:27:39.430073+0000","last_peered":"2023-05-17T15:27:39.430073+0000","last_clean":"2023-05-17T15:27:39.430073+0000","last_became_active":"2023-05-17T15:27:39.429606+0000","last_became_peered":"2023-05-17T15:27:39.429606+0000","last_unstale":"2023-05-17T15:27:39.430073+0000","last_undegraded":"2023-05-17T15:27:39.430073+0000","last_fullsized":"2023-05-17T15:27:39.430073+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.037503+0000","last_change":"2023-05-17T15:27:39.031946+0000","last_active":"2023-05-17T15:27:39.037503+0000","last_peered":"2023-05-17T15:27:39.037503+0000","last_clean":"2023-05-17T15:27:39.037503+0000","last_became_active":"2023-05-17T15:27:39.031633+0000","last_became_peered":"2023-05-17T15:27:39.031633+0000","last_unstale":"2023-05-17T15:27:39.037503+0000","last_undegraded":"2023-05-17T15:27:39.037503+0000","last_fullsized":"2023-05-17T15:27:39.037503+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439328+0000","last_change":"2023-05-17T15:27:39.439328+0000","last_active":"2023-05-17T15:27:39.439328+0000","last_peered":"2023-05-17T15:27:39.439328+0000","last_clean":"2023-05-17T15:27:39.439328+0000","last_became_active":"2023-05-17T15:27:39.439030+0000","last_became_peered":"2023-05-17T15:27:39.439030+0000","last_unstale":"2023-05-17T15:27:39.439328+0000","last_undegraded":"2023-05-17T15:27:39.439328+0000","last_fullsized":"2023-05-17T15:27:39.439328+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042787+0000","last_change":"2023-05-17T15:27:39.039639+0000","last_active":"2023-05-17T15:27:39.042787+0000","last_peered":"2023-05-17T15:27:39.042787+0000","last_clean":"2023-05-17T15:27:39.042787+0000","last_became_active":"2023-05-17T15:27:39.039337+0000","last_became_peered":"2023-05-17T15:27:39.039337+0000","last_unstale":"2023-05-17T15:27:39.042787+0000","last_undegraded":"2023-05-17T15:27:39.042787+0000","last_fullsized":"2023-05-17T15:27:39.042787+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.436538+0000","last_change":"2023-05-17T15:27:39.436538+0000","last_active":"2023-05-17T15:27:39.436538+0000","last_peered":"2023-05-17T15:27:39.436538+0000","last_clean":"2023-05-17T15:27:39.436538+0000","last_became_active":"2023-05-17T15:27:39.436230+0000","last_became_peered":"2023-05-17T15:27:39.436230+0000","last_unstale":"2023-05-17T15:27:39.436538+0000","last_undegraded":"2023-05-17T15:27:39.436538+0000","last_fullsized":"2023-05-17T15:27:39.436538+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046073+0000","last_change":"2023-05-17T15:27:39.040616+0000","last_active":"2023-05-17T15:27:39.046073+0000","last_peered":"2023-05-17T15:27:39.046073+0000","last_clean":"2023-05-17T15:27:39.046073+0000","last_became_active":"2023-05-17T15:27:39.040329+0000","last_became_peered":"2023-05-17T15:27:39.040329+0000","last_unstale":"2023-05-17T15:27:39.046073+0000","last_undegraded":"2023-05-17T15:27:39.046073+0000","last_fullsized":"2023-05-17T15:27:39.046073+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437016+0000","last_change":"2023-05-17T15:27:39.437016+0000","last_active":"2023-05-17T15:27:39.437016+0000","last_peered":"2023-05-17T15:27:39.437016+0000","last_clean":"2023-05-17T15:27:39.437016+0000","last_became_active":"2023-05-17T15:27:39.436615+0000","last_became_peered":"2023-05-17T15:27:39.436615+0000","last_unstale":"2023-05-17T15:27:39.437016+0000","last_undegraded":"2023-05-17T15:27:39.437016+0000","last_fullsized":"2023-05-17T15:27:39.437016+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.420606+0000","last_change":"2023-05-17T15:27:39.033721+0000","last_active":"2023-05-17T15:27:39.420606+0000","last_peered":"2023-05-17T15:27:39.420606+0000","last_clean":"2023-05-17T15:27:39.420606+0000","last_became_active":"2023-05-17T15:27:39.033004+0000","last_became_peered":"2023-05-17T15:27:39.033004+0000","last_unstale":"2023-05-17T15:27:39.420606+0000","last_undegraded":"2023-05-17T15:27:39.420606+0000","last_fullsized":"2023-05-17T15:27:39.420606+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439366+0000","last_change":"2023-05-17T15:27:39.439366+0000","last_active":"2023-05-17T15:27:39.439366+0000","last_peered":"2023-05-17T15:27:39.439366+0000","last_clean":"2023-05-17T15:27:39.439366+0000","last_became_active":"2023-05-17T15:27:39.439066+0000","last_became_peered":"2023-05-17T15:27:39.439066+0000","last_unstale":"2023-05-17T15:27:39.439366+0000","last_undegraded":"2023-05-17T15:27:39.439366+0000","last_fullsized":"2023-05-17T15:27:39.439366+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.442951+0000","last_change":"2023-05-17T15:27:39.036910+0000","last_active":"2023-05-17T15:27:39.442951+0000","last_peered":"2023-05-17T15:27:39.442951+0000","last_clean":"2023-05-17T15:27:39.442951+0000","last_became_active":"2023-05-17T15:27:39.036476+0000","last_became_peered":"2023-05-17T15:27:39.036476+0000","last_unstale":"2023-05-17T15:27:39.442951+0000","last_undegraded":"2023-05-17T15:27:39.442951+0000","last_fullsized":"2023-05-17T15:27:39.442951+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437066+0000","last_change":"2023-05-17T15:27:39.437066+0000","last_active":"2023-05-17T15:27:39.437066+0000","last_peered":"2023-05-17T15:27:39.437066+0000","last_clean":"2023-05-17T15:27:39.437066+0000","last_became_active":"2023-05-17T15:27:39.435835+0000","last_became_peered":"2023-05-17T15:27:39.435835+0000","last_unstale":"2023-05-17T15:27:39.437066+0000","last_undegraded":"2023-05-17T15:27:39.437066+0000","last_fullsized":"2023-05-17T15:27:39.437066+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042741+0000","last_change":"2023-05-17T15:27:39.038854+0000","last_active":"2023-05-17T15:27:39.042741+0000","last_peered":"2023-05-17T15:27:39.042741+0000","last_clean":"2023-05-17T15:27:39.042741+0000","last_became_active":"2023-05-17T15:27:39.038568+0000","last_became_peered":"2023-05-17T15:27:39.038568+0000","last_unstale":"2023-05-17T15:27:39.042741+0000","last_undegraded":"2023-05-17T15:27:39.042741+0000","last_fullsized":"2023-05-17T15:27:39.042741+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.440925+0000","last_change":"2023-05-17T15:27:39.440925+0000","last_active":"2023-05-17T15:27:39.440925+0000","last_peered":"2023-05-17T15:27:39.440925+0000","last_clean":"2023-05-17T15:27:39.440925+0000","last_became_active":"2023-05-17T15:27:39.440453+0000","last_became_peered":"2023-05-17T15:27:39.440453+0000","last_unstale":"2023-05-17T15:27:39.440925+0000","last_undegraded":"2023-05-17T15:27:39.440925+0000","last_fullsized":"2023-05-17T15:27:39.440925+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043667+0000","last_change":"2023-05-17T15:27:39.039691+0000","last_active":"2023-05-17T15:27:39.043667+0000","last_peered":"2023-05-17T15:27:39.043667+0000","last_clean":"2023-05-17T15:27:39.043667+0000","last_became_active":"2023-05-17T15:27:39.039404+0000","last_became_peered":"2023-05-17T15:27:39.039404+0000","last_unstale":"2023-05-17T15:27:39.043667+0000","last_undegraded":"2023-05-17T15:27:39.043667+0000","last_fullsized":"2023-05-17T15:27:39.043667+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.435082+0000","last_change":"2023-05-17T15:27:39.435082+0000","last_active":"2023-05-17T15:27:39.435082+0000","last_peered":"2023-05-17T15:27:39.435082+0000","last_clean":"2023-05-17T15:27:39.435082+0000","last_became_active":"2023-05-17T15:27:39.434608+0000","last_became_peered":"2023-05-17T15:27:39.434608+0000","last_unstale":"2023-05-17T15:27:39.435082+0000","last_undegraded":"2023-05-17T15:27:39.435082+0000","last_fullsized":"2023-05-17T15:27:39.435082+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.416296+0000","last_change":"2023-05-17T15:27:39.035890+0000","last_active":"2023-05-17T15:27:39.416296+0000","last_peered":"2023-05-17T15:27:39.416296+0000","last_clean":"2023-05-17T15:27:39.416296+0000","last_became_active":"2023-05-17T15:27:39.035393+0000","last_became_peered":"2023-05-17T15:27:39.035393+0000","last_unstale":"2023-05-17T15:27:39.416296+0000","last_undegraded":"2023-05-17T15:27:39.416296+0000","last_fullsized":"2023-05-17T15:27:39.416296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434083+0000","last_change":"2023-05-17T15:27:39.434083+0000","last_active":"2023-05-17T15:27:39.434083+0000","last_peered":"2023-05-17T15:27:39.434083+0000","last_clean":"2023-05-17T15:27:39.434083+0000","last_became_active":"2023-05-17T15:27:39.433824+0000","last_became_peered":"2023-05-17T15:27:39.433824+0000","last_unstale":"2023-05-17T15:27:39.434083+0000","last_undegraded":"2023-05-17T15:27:39.434083+0000","last_fullsized":"2023-05-17T15:27:39.434083+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043667+0000","last_change":"2023-05-17T15:27:39.038544+0000","last_active":"2023-05-17T15:27:39.043667+0000","last_peered":"2023-05-17T15:27:39.043667+0000","last_clean":"2023-05-17T15:27:39.043667+0000","last_became_active":"2023-05-17T15:27:39.036986+0000","last_became_peered":"2023-05-17T15:27:39.036986+0000","last_unstale":"2023-05-17T15:27:39.043667+0000","last_undegraded":"2023-05-17T15:27:39.043667+0000","last_fullsized":"2023-05-17T15:27:39.043667+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443807+0000","last_change":"2023-05-17T15:27:39.443807+0000","last_active":"2023-05-17T15:27:39.443807+0000","last_peered":"2023-05-17T15:27:39.443807+0000","last_clean":"2023-05-17T15:27:39.443807+0000","last_became_active":"2023-05-17T15:27:39.443489+0000","last_became_peered":"2023-05-17T15:27:39.443489+0000","last_unstale":"2023-05-17T15:27:39.443807+0000","last_undegraded":"2023-05-17T15:27:39.443807+0000","last_fullsized":"2023-05-17T15:27:39.443807+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043468+0000","last_change":"2023-05-17T15:27:39.039241+0000","last_active":"2023-05-17T15:27:39.043468+0000","last_peered":"2023-05-17T15:27:39.043468+0000","last_clean":"2023-05-17T15:27:39.043468+0000","last_became_active":"2023-05-17T15:27:39.038941+0000","last_became_peered":"2023-05-17T15:27:39.038941+0000","last_unstale":"2023-05-17T15:27:39.043468+0000","last_undegraded":"2023-05-17T15:27:39.043468+0000","last_fullsized":"2023-05-17T15:27:39.043468+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443861+0000","last_change":"2023-05-17T15:27:39.443861+0000","last_active":"2023-05-17T15:27:39.443861+0000","last_peered":"2023-05-17T15:27:39.443861+0000","last_clean":"2023-05-17T15:27:39.443861+0000","last_became_active":"2023-05-17T15:27:39.443542+0000","last_became_peered":"2023-05-17T15:27:39.443542+0000","last_unstale":"2023-05-17T15:27:39.443861+0000","last_undegraded":"2023-05-17T15:27:39.443861+0000","last_fullsized":"2023-05-17T15:27:39.443861+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042692+0000","last_change":"2023-05-17T15:27:39.034915+0000","last_active":"2023-05-17T15:27:39.042692+0000","last_peered":"2023-05-17T15:27:39.042692+0000","last_clean":"2023-05-17T15:27:39.042692+0000","last_became_active":"2023-05-17T15:27:39.034609+0000","last_became_peered":"2023-05-17T15:27:39.034609+0000","last_unstale":"2023-05-17T15:27:39.042692+0000","last_undegraded":"2023-05-17T15:27:39.042692+0000","last_fullsized":"2023-05-17T15:27:39.042692+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426974+0000","last_change":"2023-05-17T15:27:39.426974+0000","last_active":"2023-05-17T15:27:39.426974+0000","last_peered":"2023-05-17T15:27:39.426974+0000","last_clean":"2023-05-17T15:27:39.426974+0000","last_became_active":"2023-05-17T15:27:39.426716+0000","last_became_peered":"2023-05-17T15:27:39.426716+0000","last_unstale":"2023-05-17T15:27:39.426974+0000","last_undegraded":"2023-05-17T15:27:39.426974+0000","last_fullsized":"2023-05-17T15:27:39.426974+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443607+0000","last_change":"2023-05-17T15:27:39.039030+0000","last_active":"2023-05-17T15:27:39.443607+0000","last_peered":"2023-05-17T15:27:39.443607+0000","last_clean":"2023-05-17T15:27:39.443607+0000","last_became_active":"2023-05-17T15:27:39.038296+0000","last_became_peered":"2023-05-17T15:27:39.038296+0000","last_unstale":"2023-05-17T15:27:39.443607+0000","last_undegraded":"2023-05-17T15:27:39.443607+0000","last_fullsized":"2023-05-17T15:27:39.443607+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437548+0000","last_change":"2023-05-17T15:27:39.437548+0000","last_active":"2023-05-17T15:27:39.437548+0000","last_peered":"2023-05-17T15:27:39.437548+0000","last_clean":"2023-05-17T15:27:39.437548+0000","last_became_active":"2023-05-17T15:27:39.436647+0000","last_became_peered":"2023-05-17T15:27:39.436647+0000","last_unstale":"2023-05-17T15:27:39.437548+0000","last_undegraded":"2023-05-17T15:27:39.437548+0000","last_fullsized":"2023-05-17T15:27:39.437548+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042162+0000","last_change":"2023-05-17T15:27:39.035446+0000","last_active":"2023-05-17T15:27:39.042162+0000","last_peered":"2023-05-17T15:27:39.042162+0000","last_clean":"2023-05-17T15:27:39.042162+0000","last_became_active":"2023-05-17T15:27:39.035147+0000","last_became_peered":"2023-05-17T15:27:39.035147+0000","last_unstale":"2023-05-17T15:27:39.042162+0000","last_undegraded":"2023-05-17T15:27:39.042162+0000","last_fullsized":"2023-05-17T15:27:39.042162+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443566+0000","last_change":"2023-05-17T15:27:39.443566+0000","last_active":"2023-05-17T15:27:39.443566+0000","last_peered":"2023-05-17T15:27:39.443566+0000","last_clean":"2023-05-17T15:27:39.443566+0000","last_became_active":"2023-05-17T15:27:39.443273+0000","last_became_peered":"2023-05-17T15:27:39.443273+0000","last_unstale":"2023-05-17T15:27:39.443566+0000","last_undegraded":"2023-05-17T15:27:39.443566+0000","last_fullsized":"2023-05-17T15:27:39.443566+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042910+0000","last_change":"2023-05-17T15:27:39.036269+0000","last_active":"2023-05-17T15:27:39.042910+0000","last_peered":"2023-05-17T15:27:39.042910+0000","last_clean":"2023-05-17T15:27:39.042910+0000","last_became_active":"2023-05-17T15:27:39.035945+0000","last_became_peered":"2023-05-17T15:27:39.035945+0000","last_unstale":"2023-05-17T15:27:39.042910+0000","last_undegraded":"2023-05-17T15:27:39.042910+0000","last_fullsized":"2023-05-17T15:27:39.042910+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.429924+0000","last_change":"2023-05-17T15:27:39.429924+0000","last_active":"2023-05-17T15:27:39.429924+0000","last_peered":"2023-05-17T15:27:39.429924+0000","last_clean":"2023-05-17T15:27:39.429924+0000","last_became_active":"2023-05-17T15:27:39.429630+0000","last_became_peered":"2023-05-17T15:27:39.429630+0000","last_unstale":"2023-05-17T15:27:39.429924+0000","last_undegraded":"2023-05-17T15:27:39.429924+0000","last_fullsized":"2023-05-17T15:27:39.429924+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042406+0000","last_change":"2023-05-17T15:27:39.033666+0000","last_active":"2023-05-17T15:27:39.042406+0000","last_peered":"2023-05-17T15:27:39.042406+0000","last_clean":"2023-05-17T15:27:39.042406+0000","last_became_active":"2023-05-17T15:27:39.032955+0000","last_became_peered":"2023-05-17T15:27:39.032955+0000","last_unstale":"2023-05-17T15:27:39.042406+0000","last_undegraded":"2023-05-17T15:27:39.042406+0000","last_fullsized":"2023-05-17T15:27:39.042406+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437890+0000","last_change":"2023-05-17T15:27:39.437890+0000","last_active":"2023-05-17T15:27:39.437890+0000","last_peered":"2023-05-17T15:27:39.437890+0000","last_clean":"2023-05-17T15:27:39.437890+0000","last_became_active":"2023-05-17T15:27:39.437117+0000","last_became_peered":"2023-05-17T15:27:39.437117+0000","last_unstale":"2023-05-17T15:27:39.437890+0000","last_undegraded":"2023-05-17T15:27:39.437890+0000","last_fullsized":"2023-05-17T15:27:39.437890+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.048996+0000","last_change":"2023-05-17T15:27:39.043075+0000","last_active":"2023-05-17T15:27:39.048996+0000","last_peered":"2023-05-17T15:27:39.048996+0000","last_clean":"2023-05-17T15:27:39.048996+0000","last_became_active":"2023-05-17T15:27:39.042768+0000","last_became_peered":"2023-05-17T15:27:39.042768+0000","last_unstale":"2023-05-17T15:27:39.048996+0000","last_undegraded":"2023-05-17T15:27:39.048996+0000","last_fullsized":"2023-05-17T15:27:39.048996+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.433836+0000","last_change":"2023-05-17T15:27:39.433836+0000","last_active":"2023-05-17T15:27:39.433836+0000","last_peered":"2023-05-17T15:27:39.433836+0000","last_clean":"2023-05-17T15:27:39.433836+0000","last_became_active":"2023-05-17T15:27:39.433565+0000","last_became_peered":"2023-05-17T15:27:39.433565+0000","last_unstale":"2023-05-17T15:27:39.433836+0000","last_undegraded":"2023-05-17T15:27:39.433836+0000","last_fullsized":"2023-05-17T15:27:39.433836+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.038674+0000","last_change":"2023-05-17T15:27:39.035134+0000","last_active":"2023-05-17T15:27:39.038674+0000","last_peered":"2023-05-17T15:27:39.038674+0000","last_clean":"2023-05-17T15:27:39.038674+0000","last_became_active":"2023-05-17T15:27:39.034834+0000","last_became_peered":"2023-05-17T15:27:39.034834+0000","last_unstale":"2023-05-17T15:27:39.038674+0000","last_undegraded":"2023-05-17T15:27:39.038674+0000","last_fullsized":"2023-05-17T15:27:39.038674+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.439683+0000","last_change":"2023-05-17T15:27:39.439683+0000","last_active":"2023-05-17T15:27:39.439683+0000","last_peered":"2023-05-17T15:27:39.439683+0000","last_clean":"2023-05-17T15:27:39.439683+0000","last_became_active":"2023-05-17T15:27:39.439417+0000","last_became_peered":"2023-05-17T15:27:39.439417+0000","last_unstale":"2023-05-17T15:27:39.439683+0000","last_undegraded":"2023-05-17T15:27:39.439683+0000","last_fullsized":"2023-05-17T15:27:39.439683+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.042529+0000","last_change":"2023-05-17T15:27:39.034973+0000","last_active":"2023-05-17T15:27:39.042529+0000","last_peered":"2023-05-17T15:27:39.042529+0000","last_clean":"2023-05-17T15:27:39.042529+0000","last_became_active":"2023-05-17T15:27:39.034641+0000","last_became_peered":"2023-05-17T15:27:39.034641+0000","last_unstale":"2023-05-17T15:27:39.042529+0000","last_undegraded":"2023-05-17T15:27:39.042529+0000","last_fullsized":"2023-05-17T15:27:39.042529+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444627+0000","last_change":"2023-05-17T15:27:39.444627+0000","last_active":"2023-05-17T15:27:39.444627+0000","last_peered":"2023-05-17T15:27:39.444627+0000","last_clean":"2023-05-17T15:27:39.444627+0000","last_became_active":"2023-05-17T15:27:39.444301+0000","last_became_peered":"2023-05-17T15:27:39.444301+0000","last_unstale":"2023-05-17T15:27:39.444627+0000","last_undegraded":"2023-05-17T15:27:39.444627+0000","last_fullsized":"2023-05-17T15:27:39.444627+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.043678+0000","last_change":"2023-05-17T15:27:39.040704+0000","last_active":"2023-05-17T15:27:39.043678+0000","last_peered":"2023-05-17T15:27:39.043678+0000","last_clean":"2023-05-17T15:27:39.043678+0000","last_became_active":"2023-05-17T15:27:39.040215+0000","last_became_peered":"2023-05-17T15:27:39.040215+0000","last_unstale":"2023-05-17T15:27:39.043678+0000","last_undegraded":"2023-05-17T15:27:39.043678+0000","last_fullsized":"2023-05-17T15:27:39.043678+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443676+0000","last_change":"2023-05-17T15:27:39.443676+0000","last_active":"2023-05-17T15:27:39.443676+0000","last_peered":"2023-05-17T15:27:39.443676+0000","last_clean":"2023-05-17T15:27:39.443676+0000","last_became_active":"2023-05-17T15:27:39.443286+0000","last_became_peered":"2023-05-17T15:27:39.443286+0000","last_unstale":"2023-05-17T15:27:39.443676+0000","last_undegraded":"2023-05-17T15:27:39.443676+0000","last_fullsized":"2023-05-17T15:27:39.443676+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"159'3","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.444367+0000","last_change":"2023-05-17T15:27:39.031816+0000","last_active":"2023-05-17T15:27:39.444367+0000","last_peered":"2023-05-17T15:27:39.444367+0000","last_clean":"2023-05-17T15:27:39.444367+0000","last_became_active":"2023-05-17T15:27:39.031535+0000","last_became_peered":"2023-05-17T15:27:39.031535+0000","last_unstale":"2023-05-17T15:27:39.444367+0000","last_undegraded":"2023-05-17T15:27:39.444367+0000","last_fullsized":"2023-05-17T15:27:39.444367+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.025697+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:27:39.025697+0000","last_peered":"2023-05-17T15:27:39.025697+0000","last_clean":"2023-05-17T15:27:39.025697+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:27:39.025697+0000","last_undegraded":"2023-05-17T15:27:39.025697+0000","last_fullsized":"2023-05-17T15:27:39.025697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.434913+0000","last_change":"2023-05-17T15:27:39.434913+0000","last_active":"2023-05-17T15:27:39.434913+0000","last_peered":"2023-05-17T15:27:39.434913+0000","last_clean":"2023-05-17T15:27:39.434913+0000","last_became_active":"2023-05-17T15:27:39.434529+0000","last_became_peered":"2023-05-17T15:27:39.434529+0000","last_unstale":"2023-05-17T15:27:39.434913+0000","last_undegraded":"2023-05-17T15:27:39.434913+0000","last_fullsized":"2023-05-17T15:27:39.434913+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"159'1","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.426138+0000","last_change":"2023-05-17T15:27:39.045498+0000","last_active":"2023-05-17T15:27:39.426138+0000","last_peered":"2023-05-17T15:27:39.426138+0000","last_clean":"2023-05-17T15:27:39.426138+0000","last_became_active":"2023-05-17T15:27:39.045224+0000","last_became_peered":"2023-05-17T15:27:39.045224+0000","last_unstale":"2023-05-17T15:27:39.426138+0000","last_undegraded":"2023-05-17T15:27:39.426138+0000","last_fullsized":"2023-05-17T15:27:39.426138+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.019470+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:27:39.019470+0000","last_peered":"2023-05-17T15:27:39.019470+0000","last_clean":"2023-05-17T15:27:39.019470+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:27:39.019470+0000","last_undegraded":"2023-05-17T15:27:39.019470+0000","last_fullsized":"2023-05-17T15:27:39.019470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.428513+0000","last_change":"2023-05-17T15:27:39.428513+0000","last_active":"2023-05-17T15:27:39.428513+0000","last_peered":"2023-05-17T15:27:39.428513+0000","last_clean":"2023-05-17T15:27:39.428513+0000","last_became_active":"2023-05-17T15:27:39.427869+0000","last_became_peered":"2023-05-17T15:27:39.427869+0000","last_unstale":"2023-05-17T15:27:39.428513+0000","last_undegraded":"2023-05-17T15:27:39.428513+0000","last_fullsized":"2023-05-17T15:27:39.428513+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"159'4","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443015+0000","last_change":"2023-05-17T15:27:39.036060+0000","last_active":"2023-05-17T15:27:39.443015+0000","last_peered":"2023-05-17T15:27:39.443015+0000","last_clean":"2023-05-17T15:27:39.443015+0000","last_became_active":"2023-05-17T15:27:39.035762+0000","last_became_peered":"2023-05-17T15:27:39.035762+0000","last_unstale":"2023-05-17T15:27:39.443015+0000","last_undegraded":"2023-05-17T15:27:39.443015+0000","last_fullsized":"2023-05-17T15:27:39.443015+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.027339+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:27:39.027339+0000","last_peered":"2023-05-17T15:27:39.027339+0000","last_clean":"2023-05-17T15:27:39.027339+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:27:39.027339+0000","last_undegraded":"2023-05-17T15:27:39.027339+0000","last_fullsized":"2023-05-17T15:27:39.027339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441725+0000","last_change":"2023-05-17T15:27:39.441725+0000","last_active":"2023-05-17T15:27:39.441725+0000","last_peered":"2023-05-17T15:27:39.441725+0000","last_clean":"2023-05-17T15:27:39.441725+0000","last_became_active":"2023-05-17T15:27:39.441353+0000","last_became_peered":"2023-05-17T15:27:39.441353+0000","last_unstale":"2023-05-17T15:27:39.441725+0000","last_undegraded":"2023-05-17T15:27:39.441725+0000","last_fullsized":"2023-05-17T15:27:39.441725+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.038699+0000","last_change":"2023-05-17T15:27:39.036268+0000","last_active":"2023-05-17T15:27:39.038699+0000","last_peered":"2023-05-17T15:27:39.038699+0000","last_clean":"2023-05-17T15:27:39.038699+0000","last_became_active":"2023-05-17T15:27:39.035973+0000","last_became_peered":"2023-05-17T15:27:39.035973+0000","last_unstale":"2023-05-17T15:27:39.038699+0000","last_undegraded":"2023-05-17T15:27:39.038699+0000","last_fullsized":"2023-05-17T15:27:39.038699+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.023684+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:27:39.023684+0000","last_peered":"2023-05-17T15:27:39.023684+0000","last_clean":"2023-05-17T15:27:39.023684+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:27:39.023684+0000","last_undegraded":"2023-05-17T15:27:39.023684+0000","last_fullsized":"2023-05-17T15:27:39.023684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":129,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.020429+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:27:39.020429+0000","last_peered":"2023-05-17T15:27:39.020429+0000","last_clean":"2023-05-17T15:27:39.020429+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:27:39.020429+0000","last_undegraded":"2023-05-17T15:27:39.020429+0000","last_fullsized":"2023-05-17T15:27:39.020429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.441636+0000","last_change":"2023-05-17T15:27:39.441636+0000","last_active":"2023-05-17T15:27:39.441636+0000","last_peered":"2023-05-17T15:27:39.441636+0000","last_clean":"2023-05-17T15:27:39.441636+0000","last_became_active":"2023-05-17T15:27:39.441020+0000","last_became_peered":"2023-05-17T15:27:39.441020+0000","last_unstale":"2023-05-17T15:27:39.441636+0000","last_undegraded":"2023-05-17T15:27:39.441636+0000","last_fullsized":"2023-05-17T15:27:39.441636+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.046053+0000","last_change":"2023-05-17T15:27:39.040583+0000","last_active":"2023-05-17T15:27:39.046053+0000","last_peered":"2023-05-17T15:27:39.046053+0000","last_clean":"2023-05-17T15:27:39.046053+0000","last_became_active":"2023-05-17T15:27:39.040294+0000","last_became_peered":"2023-05-17T15:27:39.040294+0000","last_unstale":"2023-05-17T15:27:39.046053+0000","last_undegraded":"2023-05-17T15:27:39.046053+0000","last_fullsized":"2023-05-17T15:27:39.046053+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.020786+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:27:39.020786+0000","last_peered":"2023-05-17T15:27:39.020786+0000","last_clean":"2023-05-17T15:27:39.020786+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:27:39.020786+0000","last_undegraded":"2023-05-17T15:27:39.020786+0000","last_fullsized":"2023-05-17T15:27:39.020786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.440066+0000","last_change":"2023-05-17T15:27:39.440066+0000","last_active":"2023-05-17T15:27:39.440066+0000","last_peered":"2023-05-17T15:27:39.440066+0000","last_clean":"2023-05-17T15:27:39.440066+0000","last_became_active":"2023-05-17T15:27:39.438199+0000","last_became_peered":"2023-05-17T15:27:39.438199+0000","last_unstale":"2023-05-17T15:27:39.440066+0000","last_undegraded":"2023-05-17T15:27:39.440066+0000","last_fullsized":"2023-05-17T15:27:39.440066+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"159'2","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.437394+0000","last_change":"2023-05-17T15:27:39.039718+0000","last_active":"2023-05-17T15:27:39.437394+0000","last_peered":"2023-05-17T15:27:39.437394+0000","last_clean":"2023-05-17T15:27:39.437394+0000","last_became_active":"2023-05-17T15:27:39.039405+0000","last_became_peered":"2023-05-17T15:27:39.039405+0000","last_unstale":"2023-05-17T15:27:39.437394+0000","last_undegraded":"2023-05-17T15:27:39.437394+0000","last_fullsized":"2023-05-17T15:27:39.437394+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.022202+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:27:39.022202+0000","last_peered":"2023-05-17T15:27:39.022202+0000","last_clean":"2023-05-17T15:27:39.022202+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:27:39.022202+0000","last_undegraded":"2023-05-17T15:27:39.022202+0000","last_fullsized":"2023-05-17T15:27:39.022202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.443631+0000","last_change":"2023-05-17T15:27:39.443631+0000","last_active":"2023-05-17T15:27:39.443631+0000","last_peered":"2023-05-17T15:27:39.443631+0000","last_clean":"2023-05-17T15:27:39.443631+0000","last_became_active":"2023-05-17T15:27:39.443345+0000","last_became_peered":"2023-05-17T15:27:39.443345+0000","last_unstale":"2023-05-17T15:27:39.443631+0000","last_undegraded":"2023-05-17T15:27:39.443631+0000","last_fullsized":"2023-05-17T15:27:39.443631+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.039715+0000","last_change":"2023-05-17T15:27:39.028051+0000","last_active":"2023-05-17T15:27:39.039715+0000","last_peered":"2023-05-17T15:27:39.039715+0000","last_clean":"2023-05-17T15:27:39.039715+0000","last_became_active":"2023-05-17T15:27:39.027785+0000","last_became_peered":"2023-05-17T15:27:39.027785+0000","last_unstale":"2023-05-17T15:27:39.039715+0000","last_undegraded":"2023-05-17T15:27:39.039715+0000","last_fullsized":"2023-05-17T15:27:39.039715+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":123,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.027951+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:27:39.027951+0000","last_peered":"2023-05-17T15:27:39.027951+0000","last_clean":"2023-05-17T15:27:39.027951+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:27:39.027951+0000","last_undegraded":"2023-05-17T15:27:39.027951+0000","last_fullsized":"2023-05-17T15:27:39.027951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.431001+0000","last_change":"2023-05-17T15:27:39.431001+0000","last_active":"2023-05-17T15:27:39.431001+0000","last_peered":"2023-05-17T15:27:39.431001+0000","last_clean":"2023-05-17T15:27:39.431001+0000","last_became_active":"2023-05-17T15:27:39.430717+0000","last_became_peered":"2023-05-17T15:27:39.430717+0000","last_unstale":"2023-05-17T15:27:39.431001+0000","last_undegraded":"2023-05-17T15:27:39.431001+0000","last_fullsized":"2023-05-17T15:27:39.431001+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:39.010638+0000","last_clean_scrub_stamp":"2023-05-17T15:27:39.010638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.041768+0000","last_change":"2023-05-17T15:27:39.033560+0000","last_active":"2023-05-17T15:27:39.041768+0000","last_peered":"2023-05-17T15:27:39.041768+0000","last_clean":"2023-05-17T15:27:39.041768+0000","last_became_active":"2023-05-17T15:27:39.033253+0000","last_became_peered":"2023-05-17T15:27:39.033253+0000","last_unstale":"2023-05-17T15:27:39.041768+0000","last_undegraded":"2023-05-17T15:27:39.041768+0000","last_fullsized":"2023-05-17T15:27:39.041768+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:27:38.009100+0000","last_clean_scrub_stamp":"2023-05-17T15:27:38.009100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-05-17T15:27:39.025418+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:27:39.025418+0000","last_peered":"2023-05-17T15:27:39.025418+0000","last_clean":"2023-05-17T15:27:39.025418+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:27:39.025418+0000","last_undegraded":"2023-05-17T15:27:39.025418+0000","last_fullsized":"2023-05-17T15:27:39.025418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575248,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20384,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351456,"statfs":{"total":96636764160,"available":96615890944,"internally_reserved":0,"allocated":1990656,"data_stored":1005833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.29399999999999998},"max":{"1min":0.77100000000000002,"5min":0.83799999999999997,"15min":0.86899999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.623,"15min":0.624},"min":{"1min":0.52600000000000002,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.40600000000000003},"max":{"1min":0.81599999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.84799999999999998,"15min":0.88},"last":0.499},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.5,"5min":0.41099999999999998,"15min":0.38200000000000001},"max":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.754}]},{"osd":3,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.746,"5min":0.83099999999999996,"15min":0.872},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.49099999999999999},"min":{"1min":0.38900000000000001,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.71699999999999997,"5min":0.754,"15min":0.78700000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64400000000000002,"5min":0.75800000000000001,"15min":0.84999999999999998},"last":0.44400000000000001}]},{"osd":5,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.66600000000000004,"5min":0.78200000000000003,"15min":0.83899999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.47499999999999998,"5min":0.372,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.82999999999999996,"15min":0.876},"last":0.71299999999999997}]},{"osd":6,"last update":"Wed May 17 15:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.38},"max":{"1min":0.79300000000000004,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.69599999999999995,"5min":0.80900000000000005,"15min":0.86899999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575249,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19772,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":17856,"kb_avail":94352068,"statfs":{"total":96636764160,"available":96616517632,"internally_reserved":0,"allocated":1953792,"data_stored":991041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18284544},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.433}]},{"osd":1,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.375},"max":{"1min":0.78300000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":0.77100000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.312},"max":{"1min":0.82799999999999996,"5min":0.876,"15min":0.876},"last":0.497},{"interface":"front","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.63700000000000001}]},{"osd":4,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.623},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.90600000000000003},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 17 15:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575249,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19400,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":17472,"kb_avail":94352440,"statfs":{"total":96636764160,"available":96616898560,"internally_reserved":0,"allocated":1966080,"data_stored":997820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17891328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.48199999999999998,"5min":0.63700000000000001,"15min":0.65000000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45900000000000002,"15min":0.45600000000000002},"min":{"1min":0.35799999999999998,"5min":0.313,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.92800000000000005},"last":0.253}]},{"osd":2,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.83799999999999997},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.64400000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.308}]},{"osd":3,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.443},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.432,"15min":0.38200000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0169999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.44700000000000001},"max":{"1min":0.90900000000000003,"5min":0.94099999999999995,"15min":1.0349999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.006,"15min":1.006},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.98499999999999999},"last":0.435}]},{"osd":6,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.433},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.45800000000000002},"max":{"1min":0.88100000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Wed May 17 15:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.45700000000000002},"max":{"1min":0.85399999999999998,"5min":1.024,"15min":1.079},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":0.90000000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834575249,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20028,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":18112,"kb_avail":94351812,"statfs":{"total":96636764160,"available":96616255488,"internally_reserved":0,"allocated":1953792,"data_stored":991041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18546688},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.28100000000000003,"5min":0.251,"15min":0.223},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":1.1910000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.439},"min":{"1min":0.28399999999999997,"5min":0.27600000000000002,"15min":0.23799999999999999},"max":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":1.0980000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44,"15min":0.42999999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.56899999999999995,"5min":0.72999999999999998,"15min":1.056},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":1.669},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.29899999999999999,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":1.01},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.74399999999999999,"15min":0.86199999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.69299999999999995},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.85699999999999998,"5min":0.94199999999999995,"15min":1.222},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":1.1220000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.768},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.90300000000000002,"15min":1.3839999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":1.286},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 17 15:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53800000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575248,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21212,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":94350628,"statfs":{"total":96636764160,"available":96615043072,"internally_reserved":0,"allocated":1986560,"data_stored":1005687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.38500000000000001},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.48099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.41599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.60699999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.27800000000000002}]},{"osd":1,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":1.254,"15min":1.254},"last":0.25},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26600000000000001},"max":{"1min":0.626,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.56399999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":1.04,"15min":1.04},"last":0.30299999999999999}]},{"osd":4,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.85599999999999998,"5min":1.006,"15min":1.006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":1.0760000000000001,"15min":1.125},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73399999999999999,"5min":1.018,"15min":1.018},"last":0.52100000000000002}]},{"osd":6,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82599999999999996,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.441},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.81599999999999995,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.498}]},{"osd":7,"last update":"Wed May 17 15:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.66300000000000003,"15min":0.68899999999999995},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.78200000000000003,"5min":0.94299999999999995,"15min":0.97899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86699999999999999,"5min":1.21,"15min":1.21},"last":0.54400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":26176,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1986560,"data_stored":1005743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26804224},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.47499999999999998,"5min":0.69199999999999995,"15min":0.77500000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.41899999999999998},"min":{"1min":0.29599999999999999,"5min":0.28399999999999997,"15min":0.24099999999999999},"max":{"1min":0.49199999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.54000000000000004,"5min":0.59599999999999997,"15min":0.74099999999999999},"last":0.376},{"interface":"front","average":{"1min":0.437,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.26900000000000002},"max":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.252}]},{"osd":2,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44800000000000001,"15min":0.44700000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.58299999999999996,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.499,"15min":0.5},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.57099999999999995,"5min":0.72799999999999998,"15min":0.77600000000000002},"last":0.437}]},{"osd":4,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.46800000000000003,"15min":0.46000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.3799999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.83399999999999996,"5min":0.98599999999999999,"15min":1.2609999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.49099999999999999,"15min":0.38900000000000001},"max":{"1min":0.83199999999999996,"5min":1.046,"15min":1.0940000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":0.81599999999999995,"5min":0.96599999999999997,"15min":1.036},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.443},"max":{"1min":0.88,"5min":1.026,"15min":1.083},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84799999999999998,"5min":0.96999999999999997,"15min":1.079},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 17 15:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.41499999999999998},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":1.036},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.51200000000000001,"5min":0.443,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20040,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":18112,"kb_avail":94351800,"statfs":{"total":96636764160,"available":96616243200,"internally_reserved":0,"allocated":1966080,"data_stored":997820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18546688},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.35699999999999998,"15min":0.29599999999999999},"max":{"1min":0.72999999999999998,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.32500000000000001},"max":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.93000000000000005},"last":0.64200000000000002}]},{"osd":1,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":0.86199999999999999,"15min":1.0169999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.85799999999999998,"15min":0.98499999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.34399999999999997},"max":{"1min":0.77200000000000002,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.39800000000000002,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.52800000000000002}]},{"osd":3,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71599999999999997,"5min":0.83999999999999997,"15min":1.004},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.67300000000000004,"5min":0.83599999999999997,"15min":0.92300000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.35599999999999998,"5min":0.34999999999999998,"15min":0.313},"max":{"1min":0.81200000000000006,"5min":0.87,"15min":0.88800000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.88300000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.89000000000000001,"15min":0.94499999999999995},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed May 17 15:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.34100000000000003},"max":{"1min":0.86399999999999999,"5min":0.97799999999999998,"15min":1.1100000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":1.01,"15min":1.01},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575248,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":25344,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":1966080,"data_stored":997820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25952256},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.83299999999999996,"5min":0.85499999999999998,"15min":0.85699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.85199999999999998,"15min":0.89000000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.498,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47799999999999998,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61399999999999999,"15min":0.60299999999999998},"min":{"1min":0.51900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.878,"15min":0.88400000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.374},"max":{"1min":0.73699999999999999,"5min":0.90900000000000003,"15min":0.99399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.83399999999999996,"5min":0.84099999999999997,"15min":0.89700000000000002},"last":0.5}]},{"osd":4,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.497,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":1.0760000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.88,"15min":1.02},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.41499999999999998,"5min":0.35599999999999998,"15min":0.33600000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed May 17 15:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":0.84499999999999997,"15min":1.131},"last":0.623},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.36199999999999999,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.89700000000000002},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:27:43.820 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:27:43.820 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:27:43.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.969+0000 7fdd748a0700 1 Processor -- start 2023-05-17T15:27:43.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.969+0000 7fdd748a0700 1 -- start start 2023-05-17T15:27:43.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd748a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd70153ef0 0x7fdd700cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd748a0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdd70157980 0x7fdd700c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd748a0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700c60d0 con 0x7fdd700cac00 2023-05-17T15:27:43.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd748a0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd701588b0 con 0x7fdd70157980 2023-05-17T15:27:43.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd748a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd70157e10 con 0x7fdd70153ef0 2023-05-17T15:27:43.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd6f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdd70157980 0x7fdd700c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd6f59e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdd70157980 0x7fdd700c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45336/0 (socket says 172.21.15.27:45336) 2023-05-17T15:27:43.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.970+0000 7fdd6f59e700 1 -- 172.21.15.27:0/2233271106 learned_addr learned my addr 172.21.15.27:0/2233271106 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:43.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6e59c700 1 --2- 172.21.15.27:0/2233271106 >> v2:172.21.15.40:3300/0 conn(0x7fdd70153ef0 0x7fdd700cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6f59e700 1 -- 172.21.15.27:0/2233271106 >> v2:172.21.15.40:3300/0 conn(0x7fdd70153ef0 msgr2=0x7fdd700cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:43.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6f59e700 1 --2- 172.21.15.27:0/2233271106 >> v2:172.21.15.40:3300/0 conn(0x7fdd70153ef0 0x7fdd700cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6f59e700 1 -- 172.21.15.27:0/2233271106 >> v1:172.21.15.40:6789/0 conn(0x7fdd700cac00 legacy=0x7fdd701537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6f59e700 1 -- 172.21.15.27:0/2233271106 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70158010 con 0x7fdd70157980 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6e59c700 1 --2- 172.21.15.27:0/2233271106 >> v2:172.21.15.40:3300/0 conn(0x7fdd70153ef0 0x7fdd700cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6f59e700 1 --2- 172.21.15.27:0/2233271106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd70157980 0x7fdd700c5be0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fdd7005ec40 tx=0x7fdd60009840).ready entity=mon.0 client_cookie=b6f2eab63056051b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6dd9b700 1 -- 172.21.15.27:0/2233271106 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000e070 con 0x7fdd70157980 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6dd9b700 1 -- 172.21.15.27:0/2233271106 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000ba40 con 0x7fdd70157980 2023-05-17T15:27:43.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd6dd9b700 1 -- 172.21.15.27:0/2233271106 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000bdc0 con 0x7fdd70157980 2023-05-17T15:27:43.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd748a0700 1 -- 172.21.15.27:0/2233271106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd70157980 msgr2=0x7fdd700c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.971+0000 7fdd748a0700 1 --2- 172.21.15.27:0/2233271106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd70157980 0x7fdd700c5be0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fdd7005ec40 tx=0x7fdd60009840).stop 2023-05-17T15:27:43.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.972+0000 7fdd748a0700 1 -- 172.21.15.27:0/2233271106 shutdown_connections 2023-05-17T15:27:43.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.972+0000 7fdd748a0700 1 --2- 172.21.15.27:0/2233271106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd70157980 0x7fdd700c5be0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.972+0000 7fdd748a0700 1 --2- 172.21.15.27:0/2233271106 >> v2:172.21.15.40:3300/0 conn(0x7fdd70153ef0 0x7fdd700cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.972+0000 7fdd748a0700 1 -- 172.21.15.27:0/2233271106 >> 172.21.15.27:0/2233271106 conn(0x7fdd7005dd50 msgr2=0x7fdd7005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.972+0000 7fdd748a0700 1 -- 172.21.15.27:0/2233271106 shutdown_connections 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.972+0000 7fdd748a0700 1 -- 172.21.15.27:0/2233271106 wait complete. 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.973+0000 7fdd748a0700 1 Processor -- start 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.973+0000 7fdd748a0700 1 -- start start 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 0x7fdd70143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd70153ef0 0x7fdd701565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd70157980 0x7fdd70156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70151b90 con 0x7fdd700cac00 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70156fb0 con 0x7fdd70153ef0 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70150f10 con 0x7fdd70157980 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 0x7fdd70143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 0x7fdd70143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45340/0 (socket says 172.21.15.27:45340) 2023-05-17T15:27:43.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 -- 172.21.15.27:0/566738911 learned_addr learned my addr 172.21.15.27:0/566738911 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6e59c700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd70153ef0 0x7fdd701565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6f59e700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd70157980 0x7fdd70156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 -- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd70157980 msgr2=0x7fdd70156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd70157980 0x7fdd70156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 -- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd70153ef0 msgr2=0x7fdd701565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd70153ef0 0x7fdd701565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 -- 172.21.15.27:0/566738911 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60009ae0 con 0x7fdd700cac00 2023-05-17T15:27:43.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6e59c700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd70153ef0 0x7fdd701565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd6ed9d700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 0x7fdd70143790 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fdd6800c440 tx=0x7fdd68007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68007020 con 0x7fdd700cac00 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68007180 con 0x7fdd700cac00 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd701511f0 con 0x7fdd700cac00 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68007520 con 0x7fdd700cac00 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.974+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd701517b0 con 0x7fdd700cac00 2023-05-17T15:27:43.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.975+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd70047150 con 0x7fdd700cac00 2023-05-17T15:27:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.976+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fdd68010070 con 0x7fdd700cac00 2023-05-17T15:27:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.976+0000 7fdd66ffd700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdd5005ee20 0x7fdd500612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.976+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fdd68078ea0 con 0x7fdd700cac00 2023-05-17T15:27:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.976+0000 7fdd6e59c700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdd5005ee20 0x7fdd500612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.976+0000 7fdd6e59c700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdd5005ee20 0x7fdd500612e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fdd58006d80 tx=0x7fdd58008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:43.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:43.980+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd680478f0 con 0x7fdd700cac00 2023-05-17T15:27:44.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.220+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fdd700bfc30 con 0x7fdd700cac00 2023-05-17T15:27:44.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.223+0000 7fdd66ffd700 1 -- 172.21.15.27:0/566738911 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdd6804ddf0 con 0x7fdd700cac00 2023-05-17T15:27:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdd5005ee20 msgr2=0x7fdd500612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdd5005ee20 0x7fdd500612e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fdd58006d80 tx=0x7fdd58008040).stop 2023-05-17T15:27:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 msgr2=0x7fdd70143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 0x7fdd70143790 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fdd6800c440 tx=0x7fdd68007e00).stop 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 shutdown_connections 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdd5005ee20 0x7fdd500612e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd70157980 0x7fdd70156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdd700cac00 0x7fdd70143790 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 --2- 172.21.15.27:0/566738911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd70153ef0 0x7fdd701565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 >> 172.21.15.27:0/566738911 conn(0x7fdd7005dd50 msgr2=0x7fdd7014f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:44.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 shutdown_connections 2023-05-17T15:27:44.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.225+0000 7fdd748a0700 1 -- 172.21.15.27:0/566738911 wait complete. 2023-05-17T15:27:44.231 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:27:44.241 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:27:44.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.352+0000 7ff25c939700 1 Processor -- start 2023-05-17T15:27:44.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.352+0000 7ff25c939700 1 -- start start 2023-05-17T15:27:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.353+0000 7ff25c939700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580c5ef0 0x7ff2580c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.353+0000 7ff25c939700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 0x7ff2580a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.353+0000 7ff25c939700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580c05f0 con 0x7ff258153bf0 2023-05-17T15:27:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.353+0000 7ff25c939700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580aa240 con 0x7ff2580cb470 2023-05-17T15:27:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.353+0000 7ff25c939700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580aa510 con 0x7ff2580c5ef0 2023-05-17T15:27:44.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff255d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 0x7ff2580a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:44.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff255d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 0x7ff2580a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:35050/0 (socket says 172.21.15.27:35050) 2023-05-17T15:27:44.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff256d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff258153bf0 0x7ff258157c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:50912/0 (socket says 172.21.15.27:50912) 2023-05-17T15:27:44.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580c5ef0 0x7ff2580c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:44.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff255d9b700 1 -- 172.21.15.27:0/816190389 learned_addr learned my addr 172.21.15.27:0/816190389 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25659c700 1 -- 172.21.15.27:0/816190389 >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 msgr2=0x7ff2580a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25659c700 1 --2- 172.21.15.27:0/816190389 >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 0x7ff2580a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25659c700 1 -- 172.21.15.27:0/816190389 >> v1:172.21.15.40:6789/0 conn(0x7ff258153bf0 legacy=0x7ff258157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25659c700 1 -- 172.21.15.27:0/816190389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580bfcc0 con 0x7ff2580c5ef0 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff255d9b700 1 --2- 172.21.15.27:0/816190389 >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 0x7ff2580a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25559a700 1 -- 172.21.15.27:0/816190389 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358252253 0 0) 0x7ff2580c05f0 con 0x7ff258153bf0 2023-05-17T15:27:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25659c700 1 --2- 172.21.15.27:0/816190389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580c5ef0 0x7ff2580c62d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ff250009760 tx=0x7ff250009060).ready entity=mon.2 client_cookie=9a1f1bbf78336d7d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25559a700 1 -- 172.21.15.27:0/816190389 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000f510 con 0x7ff2580c5ef0 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25559a700 1 -- 172.21.15.27:0/816190389 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25000f670 con 0x7ff2580c5ef0 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.354+0000 7ff25559a700 1 -- 172.21.15.27:0/816190389 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000f9f0 con 0x7ff2580c5ef0 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 -- 172.21.15.27:0/816190389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580c5ef0 msgr2=0x7ff2580c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 --2- 172.21.15.27:0/816190389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580c5ef0 0x7ff2580c62d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ff250009760 tx=0x7ff250009060).stop 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 -- 172.21.15.27:0/816190389 shutdown_connections 2023-05-17T15:27:44.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 --2- 172.21.15.27:0/816190389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580c5ef0 0x7ff2580c62d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 --2- 172.21.15.27:0/816190389 >> v2:172.21.15.40:3300/0 conn(0x7ff2580cb470 0x7ff2580a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 -- 172.21.15.27:0/816190389 >> 172.21.15.27:0/816190389 conn(0x7ff25805e810 msgr2=0x7ff2580cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:44.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 -- 172.21.15.27:0/816190389 shutdown_connections 2023-05-17T15:27:44.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.355+0000 7ff25c939700 1 -- 172.21.15.27:0/816190389 wait complete. 2023-05-17T15:27:44.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.356+0000 7ff25c939700 1 Processor -- start 2023-05-17T15:27:44.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.356+0000 7ff25c939700 1 -- start start 2023-05-17T15:27:44.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25c939700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2580c5ef0 0x7ff2580c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:44.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25c939700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580cb470 0x7ff2581437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25c939700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 0x7ff258151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25c939700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581651b0 con 0x7ff258153bf0 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25c939700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25814ea20 con 0x7ff2580c5ef0 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25c939700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581642e0 con 0x7ff2580cb470 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 0x7ff258151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 0x7ff258151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45358/0 (socket says 172.21.15.27:45358) 2023-05-17T15:27:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 -- 172.21.15.27:0/2784816611 learned_addr learned my addr 172.21.15.27:0/2784816611 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff25659c700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2580c5ef0 0x7ff2580c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff255d9b700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580cb470 0x7ff2581437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 -- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580cb470 msgr2=0x7ff2581437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580cb470 0x7ff2581437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 -- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2580c5ef0 msgr2=0x7ff2580c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2580c5ef0 0x7ff2580c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 -- 172.21.15.27:0/2784816611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009370 con 0x7ff258153bf0 2023-05-17T15:27:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff256d9d700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 0x7ff258151e60 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7ff24800c840 tx=0x7ff2480014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248005c70 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.357+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248005dd0 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.358+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2500092a0 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.358+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248007320 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.358+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff258164880 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.358+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25805f4a0 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.359+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff24801a060 con 0x7ff258153bf0 2023-05-17T15:27:44.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.359+0000 7ff24e7fc700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff23805ee20 0x7ff2380612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:44.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.359+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7ff248079500 con 0x7ff258153bf0 2023-05-17T15:27:44.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.359+0000 7ff25659c700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff23805ee20 0x7ff2380612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:44.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.360+0000 7ff25659c700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff23805ee20 0x7ff2380612e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff250009fd0 tx=0x7ff250017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:44.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.363+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff24804aa20 con 0x7ff258153bf0 2023-05-17T15:27:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.581+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff25806bdf0 con 0x7ff258153bf0 2023-05-17T15:27:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.582+0000 7ff24e7fc700 1 -- 172.21.15.27:0/2784816611 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4488 (secure 0 0 0) 0x7ff248018020 con 0x7ff258153bf0 2023-05-17T15:27:44.586 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:44.586 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":67,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:27:39.410260+0000","modified":"2023-05-17T15:27:42.418264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6833/3042009108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3042009108},{"type":"v1","addr":"172.21.15.40:6833","nonce":3042009108}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-17T15:27:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.583+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff23805ee20 msgr2=0x7ff2380612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.583+0000 7ff25c939700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff23805ee20 0x7ff2380612e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff250009fd0 tx=0x7ff250017000).stop 2023-05-17T15:27:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.583+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 msgr2=0x7ff258151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 0x7ff258151e60 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7ff24800c840 tx=0x7ff2480014a0).stop 2023-05-17T15:27:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 shutdown_connections 2023-05-17T15:27:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff23805ee20 0x7ff2380612e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff258153bf0 0x7ff258151e60 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2580c5ef0 0x7ff2580c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 --2- 172.21.15.27:0/2784816611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2580cb470 0x7ff2581437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 >> 172.21.15.27:0/2784816611 conn(0x7ff25805e810 msgr2=0x7ff2580ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 shutdown_connections 2023-05-17T15:27:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:44.584+0000 7ff25c939700 1 -- 172.21.15.27:0/2784816611 wait complete. 2023-05-17T15:27:44.590 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 67 2023-05-17T15:27:45.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:27:39.410260+0000', 'modified': '2023-05-17T15:27:42.418264+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8565': {'gid': 8565, 'name': 'b', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6833/3042009108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 3042009108}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 3042009108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:27:45.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:27:45.002 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-17T15:27:45.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 Processor -- start 2023-05-17T15:27:45.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 -- start start 2023-05-17T15:27:45.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbed4154090 0x7fbed4154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 0x7fbed40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed40c5a50 con 0x7fbed40cb450 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed4069fa0 con 0x7fbed4154090 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.117+0000 7fbeda6f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40c04e0 con 0x7fbed4069610 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbed40cb450 0x7fbed4068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44924/0 (socket says 172.21.15.27:44924) 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed37fe700 1 -- 172.21.15.27:0/2995693184 learned_addr learned my addr 172.21.15.27:0/2995693184 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732347266 0 0) 0x7fbed40c5a50 con 0x7fbed40cb450 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 0x7fbed40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2995693184 >> v2:172.21.15.40:3300/0 conn(0x7fbed4154090 0x7fbed4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbebc0033f0 con 0x7fbed40cb450 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090649040 0 0) 0x7fbebc0033f0 con 0x7fbed40cb450 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 msgr2=0x7fbed40cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 0x7fbed40cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 >> v2:172.21.15.40:3300/0 conn(0x7fbed4154090 msgr2=0x7fbed4154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 --2- 172.21.15.27:0/2995693184 >> v2:172.21.15.40:3300/0 conn(0x7fbed4154090 0x7fbed4154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed40c0760 con 0x7fbed40cb450 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fbec8001470 con 0x7fbed40cb450 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 >> v1:172.21.15.27:6789/0 conn(0x7fbed40cb450 legacy=0x7fbed4068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbebc0038e0 0x7fbebc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 0x7fbebc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbebc004b80 0x7fbebc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4069fa0 con 0x7fbebc004b80 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40c04e0 con 0x7fbebc0038e0 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc00b8e0 con 0x7fbed4069610 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.118+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbebc004b80 0x7fbebc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed37fe700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 0x7fbebc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbebc0038e0 0x7fbebc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 msgr2=0x7fbebc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed4069610 0x7fbebc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbebc0038e0 msgr2=0x7fbebc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbebc0038e0 0x7fbebc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2995693184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0033f0 con 0x7fbebc004b80 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbebc0038e0 0x7fbebc003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbebc004b80 0x7fbebc005000 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fbecc00e210 tx=0x7fbecc00b040).ready entity=mon.0 client_cookie=8dec3ee66a7c7f40 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009ac0 con 0x7fbebc004b80 2023-05-17T15:27:45.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00f040 con 0x7fbebc004b80 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed2ffd700 1 -- 172.21.15.27:0/2995693184 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00ecd0 con 0x7fbebc004b80 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbeda6f1700 1 -- 172.21.15.27:0/2995693184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbebc004b80 msgr2=0x7fbebc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/2995693184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbebc004b80 0x7fbebc005000 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fbecc00e210 tx=0x7fbecc00b040).stop 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2995693184 reap_dead start 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbeda6f1700 1 -- 172.21.15.27:0/2995693184 shutdown_connections 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.119+0000 7fbeda6f1700 1 -- 172.21.15.27:0/2995693184 >> 172.21.15.27:0/2995693184 conn(0x7fbed405e7e0 msgr2=0x7fbed40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.120+0000 7fbeda6f1700 1 -- 172.21.15.27:0/2995693184 shutdown_connections 2023-05-17T15:27:45.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.120+0000 7fbeda6f1700 1 -- 172.21.15.27:0/2995693184 wait complete. 2023-05-17T15:27:45.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.121+0000 7fbeda6f1700 1 Processor -- start 2023-05-17T15:27:45.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.121+0000 7fbeda6f1700 1 -- start start 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 0x7fbed40c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed41578d0 0x7fbed4157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed414f680 0x7fbed414fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed414fff0 con 0x7fbed40c1fa0 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4158370 con 0x7fbed41578d0 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4158650 con 0x7fbed414f680 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 0x7fbed40c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 0x7fbed40c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45374/0 (socket says 172.21.15.27:45374) 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 -- 172.21.15.27:0/915947071 learned_addr learned my addr 172.21.15.27:0/915947071 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed414f680 0x7fbed414fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed37fe700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed41578d0 0x7fbed4157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 -- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed414f680 msgr2=0x7fbed414fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed414f680 0x7fbed414fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 -- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed41578d0 msgr2=0x7fbed4157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed41578d0 0x7fbed4157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 -- 172.21.15.27:0/915947071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4158930 con 0x7fbed40c1fa0 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed414f680 0x7fbed414fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed37fe700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed41578d0 0x7fbed4157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbed3fff700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 0x7fbed40c2380 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fbec4011690 tx=0x7fbec4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbebbfff700 1 -- 172.21.15.27:0/915947071 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4013620 con 0x7fbed40c1fa0 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbebbfff700 1 -- 172.21.15.27:0/915947071 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4013780 con 0x7fbed40c1fa0 2023-05-17T15:27:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed40aeeb0 con 0x7fbed40c1fa0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbebbfff700 1 -- 172.21.15.27:0/915947071 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4013b00 con 0x7fbed40c1fa0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.122+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed4155020 con 0x7fbed40c1fa0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.124+0000 7fbebbfff700 1 -- 172.21.15.27:0/915947071 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fbec4012040 con 0x7fbed40c1fa0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.124+0000 7fbebbfff700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ee20 0x7fbec00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.124+0000 7fbebbfff700 1 -- 172.21.15.27:0/915947071 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbec407a210 con 0x7fbed40c1fa0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.124+0000 7fbed37fe700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ee20 0x7fbec00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.125+0000 7fbed37fe700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ee20 0x7fbec00612e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbec8001200 tx=0x7fbec8009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.126+0000 7fbeec083b80 1 Processor -- start 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.126+0000 7fbeec083b80 1 -- start start 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e76684710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbeec083b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e7664f5e0 con 0x562e7668a300 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e765c68a0 con 0x562e766ce560 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e765db900 con 0x562e766d3480 2023-05-17T15:27:45.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbed8c8e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e76684710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbed8c8e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e76684710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45384/0 (socket says 172.21.15.27:45384) 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.127+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2873636416 learned_addr learned my addr 172.21.15.27:0/2873636416 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed37fe700 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 msgr2=0x562e766ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 msgr2=0x562e766b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2873636416 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e7664f450 con 0x562e7668a300 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e76684710 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fbebc004490 tx=0x7fbecc01a000).ready entity=mon.0 client_cookie=feb3b23294257324 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbeb97fa700 1 -- 172.21.15.27:0/2873636416 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009ac0 con 0x562e7668a300 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbeb97fa700 1 -- 172.21.15.27:0/2873636416 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00eac0 con 0x562e7668a300 2023-05-17T15:27:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.128+0000 7fbeb97fa700 1 -- 172.21.15.27:0/2873636416 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc01d610 con 0x562e7668a300 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 -- 172.21.15.27:0/2873636416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 msgr2=0x562e76684710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e76684710 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fbebc004490 tx=0x7fbecc01a000).stop 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 -- 172.21.15.27:0/2873636416 shutdown_connections 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e76684710 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2873636416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 -- 172.21.15.27:0/2873636416 >> 172.21.15.27:0/2873636416 conn(0x562e76446e40 msgr2=0x562e766d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 -- 172.21.15.27:0/2873636416 shutdown_connections 2023-05-17T15:27:45.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 -- 172.21.15.27:0/2873636416 wait complete. 2023-05-17T15:27:45.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 -- start start 2023-05-17T15:27:45.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.129+0000 7fbeec083b80 1 Processor -- start 2023-05-17T15:27:45.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e766c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e765a2ed0 con 0x562e7668a300 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e766cae40 con 0x562e766ce560 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e766cb120 con 0x562e766d3480 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbeec083b80 10 client.0 ll_register_callbacks cb 0x562e766491f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:27:45.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e766c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e766c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45388/0 (socket says 172.21.15.27:45388) 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbed3fff700 1 -- 172.21.15.27:0/3685607154 learned_addr learned my addr 172.21.15.27:0/3685607154 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbed37fe700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.130+0000 7fbed3fff700 1 -- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 msgr2=0x562e766aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbed3fff700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbed3fff700 1 -- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 msgr2=0x562e766c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbed3fff700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbed3fff700 1 -- 172.21.15.27:0/3685607154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc0033f0 con 0x562e7668a300 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbed3fff700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e766c9a50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fbec404ef60 tx=0x7fbec407a040).ready entity=mon.0 client_cookie=c9905816a0d0593f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeb27fc700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeb27fc700 1 -- 172.21.15.27:0/3685607154 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4054070 con 0x562e7668a300 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeb27fc700 1 -- 172.21.15.27:0/3685607154 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbec404e8e0 con 0x562e7668a300 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e7667d460 con 0x562e7668a300 2023-05-17T15:27:45.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeb27fc700 1 -- 172.21.15.27:0/3685607154 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec404b1e0 con 0x562e7668a300 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 10 client.8685 fetch_fsmap learned FSMap version 67 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x562e7647e310 con 0x562e7668a300 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeb27fc700 1 -- 172.21.15.27:0/3685607154 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e7667d460 con 0x562e7668a300 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeb27fc700 1 -- 172.21.15.27:0/3685607154 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbec4054d20 con 0x562e7668a300 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 10 client.8685 fetch_fsmap finished waiting for FSMap version 67 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 10 client.8685 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 20 client.8685 populate_metadata read hostname 'smithi027' 2023-05-17T15:27:45.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766cb5b0 0x562e766cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 4 client.8685 mds_command: new command op to 8565 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 --> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e76442ca0 con 0x562e766cb5b0 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.131+0000 7fbed37fe700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766cb5b0 0x562e766cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.132+0000 7fbed37fe700 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766cb5b0 0x562e766cc290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7ac961278aef121c server_cookie=e24e1594dfa0f4b1 in_seq=0 out_seq=0 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.132+0000 7fbeb27fc700 10 client.8685 ms_handle_connect on v2:172.21.15.40:6832/3042009108 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeb27fc700 1 -- 172.21.15.27:0/3685607154 <== mds.0 v2:172.21.15.40:6832/3042009108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x562e76442ca0 con 0x562e766cb5b0 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeb27fc700 10 client.8685 handle_command_reply: tid=0 2023-05-17T15:27:45.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 client.8685 shutdown 2023-05-17T15:27:45.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 msgr2=0x562e766c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e766c9a50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fbec404ef60 tx=0x7fbec407a040).stop 2023-05-17T15:27:45.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 shutdown_connections 2023-05-17T15:27:45.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766cb5b0 0x562e766cc290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e7668a300 0x562e766c9a50 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3685607154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e766c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeb27fc700 0 client.8685 ms_handle_reset on v2:172.21.15.40:6832/3042009108 2023-05-17T15:27:45.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 >> 172.21.15.27:0/3685607154 conn(0x562e76446e40 msgr2=0x562e766d25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 shutdown_connections 2023-05-17T15:27:45.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 1 -- 172.21.15.27:0/3685607154 wait complete. 2023-05-17T15:27:45.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.133+0000 7fbeec083b80 20 client.8685 trim_cache size 0 max 16384 2023-05-17T15:27:45.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.149+0000 7fbeec083b80 1 Processor -- start 2023-05-17T15:27:45.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.149+0000 7fbeec083b80 1 -- start start 2023-05-17T15:27:45.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e7668a300 0x562e76680b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 0x562e766d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766e08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbeec083b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e766b2290 con 0x562e766ce560 2023-05-17T15:27:45.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e766cde20 con 0x562e7668a300 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e766b40a0 con 0x562e766d3480 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbed37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 0x562e766d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbed37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 0x562e766d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45398/0 (socket says 172.21.15.27:45398) 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.150+0000 7fbed37fe700 1 -- 172.21.15.27:0/3850979760 learned_addr learned my addr 172.21.15.27:0/3850979760 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed3fff700 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e7668a300 0x562e76680b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766e08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed37fe700 1 -- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 msgr2=0x562e766e08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed37fe700 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766e08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed37fe700 1 -- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e7668a300 msgr2=0x562e76680b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed37fe700 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e7668a300 0x562e76680b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed37fe700 1 -- 172.21.15.27:0/3850979760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e7668ab80 con 0x562e766ce560 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbed37fe700 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 0x562e766d2780 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x562e766c9a20 tx=0x7fbec8015000).ready entity=mon.0 client_cookie=63f04d5ddb0ee448 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbeb9ffb700 1 -- 172.21.15.27:0/3850979760 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec80159e0 con 0x562e766ce560 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbeb9ffb700 1 -- 172.21.15.27:0/3850979760 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec802c070 con 0x562e766ce560 2023-05-17T15:27:45.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbeb9ffb700 1 -- 172.21.15.27:0/3850979760 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8015b40 con 0x562e766ce560 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbeec083b80 1 -- 172.21.15.27:0/3850979760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 msgr2=0x562e766d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.151+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 0x562e766d2780 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x562e766c9a20 tx=0x7fbec8015000).stop 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 -- 172.21.15.27:0/3850979760 shutdown_connections 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e766d3480 0x562e766e08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e7668a300 0x562e76680b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 --2- 172.21.15.27:0/3850979760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766ce560 0x562e766d2780 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 -- 172.21.15.27:0/3850979760 >> 172.21.15.27:0/3850979760 conn(0x562e76446e40 msgr2=0x562e766865e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 -- 172.21.15.27:0/3850979760 shutdown_connections 2023-05-17T15:27:45.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 -- 172.21.15.27:0/3850979760 wait complete. 2023-05-17T15:27:45.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 -- start start 2023-05-17T15:27:45.160 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.152+0000 7fbeec083b80 1 Processor -- start 2023-05-17T15:27:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e7668a300 0x562e766ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e76734910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 0x562e767310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e766cd220 con 0x562e766d3480 2023-05-17T15:27:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e766e9e60 con 0x562e766ce560 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e766ea630 con 0x562e7668a300 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeec083b80 10 client.0 ll_register_callbacks cb 0x562e766491f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 0x562e767310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 0x562e767310d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45406/0 (socket says 172.21.15.27:45406) 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2216448959 learned_addr learned my addr 172.21.15.27:0/2216448959 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e7668a300 0x562e766ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed37fe700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e76734910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e7668a300 msgr2=0x562e766ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e7668a300 0x562e766ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 msgr2=0x562e76734910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e76734910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 -- 172.21.15.27:0/2216448959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec801f040 con 0x562e766d3480 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed37fe700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e76734910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e7668a300 0x562e766ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:45.165 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbed8c8e700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 0x562e767310d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fbecc00e210 tx=0x7fbecc020040).ready entity=mon.0 client_cookie=ba662732a7993a22 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.153+0000 7fbeb27fc700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeb27fc700 1 -- 172.21.15.27:0/2216448959 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc01dca0 con 0x562e766d3480 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeb27fc700 1 -- 172.21.15.27:0/2216448959 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbecc01de00 con 0x562e766d3480 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbecc00eac0 con 0x562e766d3480 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeb27fc700 1 -- 172.21.15.27:0/2216448959 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbecc029660 con 0x562e766d3480 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 10 client.8691 fetch_fsmap learned FSMap version 67 2023-05-17T15:27:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x562e765d4880 con 0x562e766d3480 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeb27fc700 1 -- 172.21.15.27:0/2216448959 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00eac0 con 0x562e766d3480 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeb27fc700 1 -- 172.21.15.27:0/2216448959 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbecc0297c0 con 0x562e766d3480 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 10 client.8691 fetch_fsmap finished waiting for FSMap version 67 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 10 client.8691 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 20 client.8691 populate_metadata read hostname 'smithi027' 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766df8c0 0x562e766dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 4 client.8691 mds_command: new command op to 8565 tid=0[{"prefix": "status"}] 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 --> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562e76479ca0 con 0x562e766df8c0 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.154+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766df8c0 0x562e766dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeb27fc700 10 client.8691 ms_handle_connect on v2:172.21.15.40:6832/3042009108 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbed3fff700 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766df8c0 0x562e766dfca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fa8327eb875adfac server_cookie=26c914f91bdc260f in_seq=0 out_seq=0 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeb27fc700 1 -- 172.21.15.27:0/2216448959 <== mds.0 v2:172.21.15.40:6832/3042009108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562e76479ca0 con 0x562e766df8c0 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeb27fc700 10 client.8691 handle_command_reply: tid=0 2023-05-17T15:27:45.168 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 client.8691 shutdown 2023-05-17T15:27:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 msgr2=0x562e767310d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 0x562e767310d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fbecc00e210 tx=0x7fbecc020040).stop 2023-05-17T15:27:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 shutdown_connections 2023-05-17T15:27:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:6832/3042009108,v1:172.21.15.40:6833/3042009108] conn(0x562e766df8c0 0x562e766dfca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562e766d3480 0x562e767310d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x562e7668a300 0x562e766ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeb27fc700 0 client.8691 ms_handle_reset on v2:172.21.15.40:6832/3042009108 2023-05-17T15:27:45.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 --2- 172.21.15.27:0/2216448959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e766ce560 0x562e76734910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 >> 172.21.15.27:0/2216448959 conn(0x562e76446e40 msgr2=0x562e766865e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 shutdown_connections 2023-05-17T15:27:45.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 1 -- 172.21.15.27:0/2216448959 wait complete. 2023-05-17T15:27:45.170 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.155+0000 7fbeec083b80 20 client.8691 trim_cache size 0 max 16384 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 8565, 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:27:45.171 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:27:45.172 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 5.7439168709999997, 2023-05-17T15:27:45.172 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 67, 2023-05-17T15:27:45.172 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 160, 2023-05-17T15:27:45.172 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 160, 2023-05-17T15:27:45.172 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 10.326274417 2023-05-17T15:27:45.172 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:27:45.173 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ee20 msgr2=0x7fbec00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ee20 0x7fbec00612e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbec8001200 tx=0x7fbec8009040).stop 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 msgr2=0x7fbed40c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 0x7fbed40c2380 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fbec4011690 tx=0x7fbec4008040).stop 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 shutdown_connections 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ee20 0x7fbec00612e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbed414f680 0x7fbed414fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbed40c1fa0 0x7fbed40c2380 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 --2- 172.21.15.27:0/915947071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed41578d0 0x7fbed4157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 >> 172.21.15.27:0/915947071 conn(0x7fbed405e7e0 msgr2=0x7fbed40c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 shutdown_connections 2023-05-17T15:27:45.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.156+0000 7fbeda6f1700 1 -- 172.21.15.27:0/915947071 wait complete. 2023-05-17T15:27:45.175 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:27:45.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.275+0000 7fb4da554700 1 Processor -- start 2023-05-17T15:27:45.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.275+0000 7fb4da554700 1 -- start start 2023-05-17T15:27:45.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4da554700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40a6280 0x7fb4d40c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4da554700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 0x7fb4d40a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4da554700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40c7f80 con 0x7fb4d406b4e0 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4da554700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40c4d70 con 0x7fb4d40ac9c0 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4da554700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c5220 con 0x7fb4d40a6280 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d8af1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 0x7fb4d40a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40a6280 0x7fb4d40c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.281 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d37fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb4d406b4e0 0x7fb4d40ac2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:50974/0 (socket says 172.21.15.27:50974) 2023-05-17T15:27:45.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d8af1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 0x7fb4d40a6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:35112/0 (socket says 172.21.15.27:35112) 2023-05-17T15:27:45.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d37fe700 1 -- 172.21.15.27:0/466792081 learned_addr learned my addr 172.21.15.27:0/466792081 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:45.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d3fff700 1 -- 172.21.15.27:0/466792081 >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 msgr2=0x7fb4d40a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:45.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d3fff700 1 --2- 172.21.15.27:0/466792081 >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 0x7fb4d40a6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d3fff700 1 -- 172.21.15.27:0/466792081 >> v1:172.21.15.40:6789/0 conn(0x7fb4d406b4e0 legacy=0x7fb4d40ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d3fff700 1 -- 172.21.15.27:0/466792081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4151390 con 0x7fb4d40a6280 2023-05-17T15:27:45.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d8af1700 1 --2- 172.21.15.27:0/466792081 >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 0x7fb4d40a6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:27:45.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.276+0000 7fb4d3fff700 1 --2- 172.21.15.27:0/466792081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40a6280 0x7fb4d40c6a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb4c4006fd0 tx=0x7fb4c4006f40).ready entity=mon.2 client_cookie=44194cf9a1b53912 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4d2ffd700 1 -- 172.21.15.27:0/466792081 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4005880 con 0x7fb4d40a6280 2023-05-17T15:27:45.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4d2ffd700 1 -- 172.21.15.27:0/466792081 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c40059e0 con 0x7fb4d40a6280 2023-05-17T15:27:45.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4d2ffd700 1 -- 172.21.15.27:0/466792081 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4005d60 con 0x7fb4d40a6280 2023-05-17T15:27:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 -- 172.21.15.27:0/466792081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40a6280 msgr2=0x7fb4d40c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 --2- 172.21.15.27:0/466792081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40a6280 0x7fb4d40c6a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb4c4006fd0 tx=0x7fb4c4006f40).stop 2023-05-17T15:27:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 -- 172.21.15.27:0/466792081 shutdown_connections 2023-05-17T15:27:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 --2- 172.21.15.27:0/466792081 >> v2:172.21.15.40:3300/0 conn(0x7fb4d40ac9c0 0x7fb4d40a6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 --2- 172.21.15.27:0/466792081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40a6280 0x7fb4d40c6a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 -- 172.21.15.27:0/466792081 >> 172.21.15.27:0/466792081 conn(0x7fb4d40aacb0 msgr2=0x7fb4d40c71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 -- 172.21.15.27:0/466792081 shutdown_connections 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.277+0000 7fb4da554700 1 -- 172.21.15.27:0/466792081 wait complete. 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.278+0000 7fb4da554700 1 Processor -- start 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.278+0000 7fb4da554700 1 -- start start 2023-05-17T15:27:45.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4da554700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 0x7fb4d40a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4da554700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4d40a6280 0x7fb4d4153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4da554700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40ac9c0 0x7fb4d4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4da554700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40a7c30 con 0x7fb4d406b4e0 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4da554700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4154270 con 0x7fb4d40a6280 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4da554700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d41564a0 con 0x7fb4d40ac9c0 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 0x7fb4d40a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 0x7fb4d40a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45418/0 (socket says 172.21.15.27:45418) 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4d3fff700 1 -- 172.21.15.27:0/3066639334 learned_addr learned my addr 172.21.15.27:0/3066639334 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4d8af1700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40ac9c0 0x7fb4d4153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.279+0000 7fb4d37fe700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4d40a6280 0x7fb4d4153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4d3fff700 1 -- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40ac9c0 msgr2=0x7fb4d4153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4d3fff700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40ac9c0 0x7fb4d4153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4d3fff700 1 -- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4d40a6280 msgr2=0x7fb4d4153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.289 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4d3fff700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4d40a6280 0x7fb4d4153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4d3fff700 1 -- 172.21.15.27:0/3066639334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc009a20 con 0x7fb4d406b4e0 2023-05-17T15:27:45.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4d3fff700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 0x7fb4d40a4da0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7fb4d40c5360 tx=0x7fb4c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400f720 con 0x7fb4d406b4e0 2023-05-17T15:27:45.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400f880 con 0x7fb4d406b4e0 2023-05-17T15:27:45.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c4009250 con 0x7fb4d406b4e0 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400fc20 con 0x7fb4d406b4e0 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.280+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d40a7f00 con 0x7fb4d406b4e0 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.281+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d405fd10 con 0x7fb4d406b4e0 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.281+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb4c400f070 con 0x7fb4d406b4e0 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.282+0000 7fb4bbfff700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb4c005ee20 0x7fb4c00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.282+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fb4c407b100 con 0x7fb4d406b4e0 2023-05-17T15:27:45.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.282+0000 7fb4d37fe700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb4c005ee20 0x7fb4c00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:45.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.282+0000 7fb4d37fe700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb4c005ee20 0x7fb4c00612e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb4c8007fd0 tx=0x7fb4c8007d30).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:45.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.286+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4c404c620 con 0x7fb4d406b4e0 2023-05-17T15:27:45.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.500+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4d405e6a0 con 0x7fb4d406b4e0 2023-05-17T15:27:45.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.501+0000 7fb4bbfff700 1 -- 172.21.15.27:0/3066639334 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4c404fc40 con 0x7fb4d406b4e0 2023-05-17T15:27:45.505 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:27:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb4c005ee20 msgr2=0x7fb4c00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb4c005ee20 0x7fb4c00612e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb4c8007fd0 tx=0x7fb4c8007d30).stop 2023-05-17T15:27:45.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 msgr2=0x7fb4d40a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:45.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 0x7fb4d40a4da0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7fb4d40c5360 tx=0x7fb4c4016000).stop 2023-05-17T15:27:45.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 shutdown_connections 2023-05-17T15:27:45.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb4c005ee20 0x7fb4c00612e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4d40ac9c0 0x7fb4d4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4d406b4e0 0x7fb4d40a4da0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 --2- 172.21.15.27:0/3066639334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4d40a6280 0x7fb4d4153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:45.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 >> 172.21.15.27:0/3066639334 conn(0x7fb4d40aacb0 msgr2=0x7fb4d41505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:45.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 shutdown_connections 2023-05-17T15:27:45.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:45.502+0000 7fb4da554700 1 -- 172.21.15.27:0/3066639334 wait complete. 2023-05-17T15:27:45.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:27:45.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:27:45.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:27:45.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:27:45.520 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:27:45.521 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:27:45.521 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:27:45.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:27:45.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:27:45.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.524 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:27:45.540 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:27:45.541 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:27:45.541 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:27:45.542 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.542 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:27:45.543 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.543 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:27:45.543 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:27:45.544 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:27:45.544 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:27:45.544 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:27:45.545 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 40247sec preferred_lft 40247sec 2023-05-17T15:27:45.545 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:27:45.545 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.546 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:27:45.546 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:27:45.546 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:27:45.547 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:27:45.547 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:27:45.547 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:27:45.548 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:27:45.548 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.548 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:27:45.549 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.549 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:27:45.549 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:27:45.550 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:27:45.550 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.550 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:27:45.551 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:27:45.551 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:27:45.552 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:27:45.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.553 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:27:45.609 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:27:45.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.611 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:27:45.692 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:27:45.692 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:27:45.692 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:27:45.692 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:27:45.693 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:27:45.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.693 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:27:45.694 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:27:45.694 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:27:45.694 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:27:45.695 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:27:45.695 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:27:45.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.798 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:27:45.816 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:27:45.816 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:27:45.816 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:27:45.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:27:45.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:45.887 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:27:45.946 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:27:45.947 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:27:46.031 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:27:46.032 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:27:46.076 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:27:46.076 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:27:46.078 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:27:46.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:27:46.079 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:27:46.145 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:27:46.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 Processor -- start 2023-05-17T15:27:46.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 -- start start 2023-05-17T15:27:46.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd264150b60 0x7fd264064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150f40 0x7fd2640c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd264067cb0 0x7fd264068120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640c28e0 con 0x7fd264067cb0 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd264065390 con 0x7fd264150b60 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.299+0000 7fd26b25e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd264068610 con 0x7fd264150f40 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd264067cb0 0x7fd264068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd264067cb0 0x7fd264068120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45434/0 (socket says 172.21.15.27:45434) 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 -- 172.21.15.27:0/1843005191 learned_addr learned my addr 172.21.15.27:0/1843005191 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:46.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd268ffa700 1 --2- 172.21.15.27:0/1843005191 >> v2:172.21.15.40:3300/0 conn(0x7fd264150b60 0x7fd264064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd263fff700 1 --2- 172.21.15.27:0/1843005191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150f40 0x7fd2640c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 -- 172.21.15.27:0/1843005191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150f40 msgr2=0x7fd2640c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 --2- 172.21.15.27:0/1843005191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150f40 0x7fd2640c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 -- 172.21.15.27:0/1843005191 >> v2:172.21.15.40:3300/0 conn(0x7fd264150b60 msgr2=0x7fd264064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 --2- 172.21.15.27:0/1843005191 >> v2:172.21.15.40:3300/0 conn(0x7fd264150b60 0x7fd264064ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 -- 172.21.15.27:0/1843005191 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640c4190 con 0x7fd264067cb0 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2697fb700 1 --2- 172.21.15.27:0/1843005191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264067cb0 0x7fd264068120 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fd2640c7820 tx=0x7fd24c0090f0).ready entity=mon.0 client_cookie=c474d5ff134ab2b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2637fe700 1 -- 172.21.15.27:0/1843005191 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00b600 con 0x7fd264067cb0 2023-05-17T15:27:46.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2637fe700 1 -- 172.21.15.27:0/1843005191 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c00b760 con 0x7fd264067cb0 2023-05-17T15:27:46.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.300+0000 7fd2637fe700 1 -- 172.21.15.27:0/1843005191 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00bae0 con 0x7fd264067cb0 2023-05-17T15:27:46.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 -- 172.21.15.27:0/1843005191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264067cb0 msgr2=0x7fd264068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1843005191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264067cb0 0x7fd264068120 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fd2640c7820 tx=0x7fd24c0090f0).stop 2023-05-17T15:27:46.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 -- 172.21.15.27:0/1843005191 shutdown_connections 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1843005191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264067cb0 0x7fd264068120 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1843005191 >> v2:172.21.15.40:3300/0 conn(0x7fd264150b60 0x7fd264064ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1843005191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150f40 0x7fd2640c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 -- 172.21.15.27:0/1843005191 >> 172.21.15.27:0/1843005191 conn(0x7fd2640c7910 msgr2=0x7fd2640c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 -- 172.21.15.27:0/1843005191 shutdown_connections 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.301+0000 7fd26b25e700 1 -- 172.21.15.27:0/1843005191 wait complete. 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.302+0000 7fd26b25e700 1 Processor -- start 2023-05-17T15:27:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.302+0000 7fd26b25e700 1 -- start start 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd26b25e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd264067cb0 0x7fd26414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd26b25e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150b60 0x7fd264165900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd26b25e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 0x7fd26414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd26b25e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26414d490 con 0x7fd264150f40 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd26b25e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264165df0 con 0x7fd264067cb0 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd26b25e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26414f6d0 con 0x7fd264150b60 2023-05-17T15:27:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 0x7fd26414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 0x7fd26414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45438/0 (socket says 172.21.15.27:45438) 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 -- 172.21.15.27:0/1854215760 learned_addr learned my addr 172.21.15.27:0/1854215760 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd263fff700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150b60 0x7fd264165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd268ffa700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd264067cb0 0x7fd26414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 -- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150b60 msgr2=0x7fd264165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150b60 0x7fd264165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 -- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd264067cb0 msgr2=0x7fd26414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd264067cb0 0x7fd26414cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 -- 172.21.15.27:0/1854215760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009370 con 0x7fd264150f40 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.303+0000 7fd2697fb700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 0x7fd26414b4d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fd2640c8460 tx=0x7fd24c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.304+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00bae0 con 0x7fd264150f40 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.304+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c01c420 con 0x7fd264150f40 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.304+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c01c7e0 con 0x7fd264150f40 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.304+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26414d6a0 con 0x7fd264150f40 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.304+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26414f360 con 0x7fd264150f40 2023-05-17T15:27:46.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.305+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26414eee0 con 0x7fd264150f40 2023-05-17T15:27:46.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.305+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd24c02c070 con 0x7fd264150f40 2023-05-17T15:27:46.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.305+0000 7fd260ff9700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd24405ee20 0x7fd2440612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.305+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fd24c07bbc0 con 0x7fd264150f40 2023-05-17T15:27:46.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.305+0000 7fd268ffa700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd24405ee20 0x7fd2440612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.306+0000 7fd268ffa700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd24405ee20 0x7fd2440612e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd25c006fd0 tx=0x7fd25c008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:46.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.310+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd26414eee0 con 0x7fd264150f40 2023-05-17T15:27:46.514 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.510+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd26414eee0 con 0x7fd24405ee20 2023-05-17T15:27:46.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.512+0000 7fd260ff9700 1 -- 172.21.15.27:0/1854215760 <== mgr.8379 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd26414eee0 con 0x7fd24405ee20 2023-05-17T15:27:46.516 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:27:46.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:27:46.516 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:27:46.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:27:46.516 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd24405ee20 msgr2=0x7fd2440612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd24405ee20 0x7fd2440612e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd25c006fd0 tx=0x7fd25c008040).stop 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 msgr2=0x7fd26414b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 0x7fd26414b4d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fd2640c8460 tx=0x7fd24c017000).stop 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 shutdown_connections 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd24405ee20 0x7fd2440612e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264150f40 0x7fd26414b4d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd264067cb0 0x7fd26414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 --2- 172.21.15.27:0/1854215760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd264150b60 0x7fd264165900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 >> 172.21.15.27:0/1854215760 conn(0x7fd2640c7910 msgr2=0x7fd26414be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:46.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 shutdown_connections 2023-05-17T15:27:46.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.514+0000 7fd26b25e700 1 -- 172.21.15.27:0/1854215760 wait complete. 2023-05-17T15:27:46.529 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:27:46.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.643+0000 7fafc6f54700 1 Processor -- start 2023-05-17T15:27:46.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.643+0000 7fafc6f54700 1 -- start start 2023-05-17T15:27:46.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc6f54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 0x7fafc015f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc6f54700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc00c0c90 con 0x7fafc01543d0 2023-05-17T15:27:46.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc6f54700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc0158790 con 0x7fafc00c6310 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc6f54700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00c1c50 con 0x7fafc0069410 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc4cf0700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fafc01543d0 0x7fafc00c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45006/0 (socket says 172.21.15.27:45006) 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc4cf0700 1 -- 172.21.15.27:0/3906333190 learned_addr learned my addr 172.21.15.27:0/3906333190 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafc54f1700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 0x7fafc015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.644+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114143916 0 0) 0x7fafc00c0c90 con 0x7fafc01543d0 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac0033f0 con 0x7fafc01543d0 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3864012139 0 0) 0x7fafac0033f0 con 0x7fafc01543d0 2023-05-17T15:27:46.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 msgr2=0x7fafc015f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 0x7fafc015f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 >> v1:172.21.15.40:6789/0 conn(0x7fafc00c6310 legacy=0x7fafc0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0157e60 con 0x7fafc01543d0 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fafb8001470 con 0x7fafc01543d0 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 >> v1:172.21.15.27:6789/0 conn(0x7fafc01543d0 legacy=0x7fafc00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafac003910 0x7fafac003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac004690 0x7fafac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 0x7fafac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac00b8e0 con 0x7fafac003910 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac00ba50 con 0x7fafac004690 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac00bc10 con 0x7fafc0069410 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafac003910 0x7fafac003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbffff700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac004690 0x7fafac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc54f1700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 0x7fafac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 -- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 msgr2=0x7fafac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc0069410 0x7fafac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 -- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac004690 msgr2=0x7fafac004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac004690 0x7fafac004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 -- 172.21.15.27:0/3906333190 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0033f0 con 0x7fafac003910 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafbffff700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac004690 0x7fafac004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.645+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafac003910 0x7fafac003d30 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fafb800c190 tx=0x7fafb8001e50).ready entity=mon.0 client_cookie=3c6bbcf998d94f8b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:46.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8007a20 con 0x7fafac003910 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb800cac0 con 0x7fafac003910 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafbf7fe700 1 -- 172.21.15.27:0/3906333190 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800ce40 con 0x7fafac003910 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc6f54700 1 -- 172.21.15.27:0/3906333190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafac003910 msgr2=0x7fafac003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc6f54700 1 --2- 172.21.15.27:0/3906333190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafac003910 0x7fafac003d30 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fafb800c190 tx=0x7fafb8001e50).stop 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc54f1700 1 -- 172.21.15.27:0/3906333190 reap_dead start 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc6f54700 1 -- 172.21.15.27:0/3906333190 shutdown_connections 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc6f54700 1 -- 172.21.15.27:0/3906333190 >> 172.21.15.27:0/3906333190 conn(0x7fafc00cb7f0 msgr2=0x7fafc00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:46.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc6f54700 1 -- 172.21.15.27:0/3906333190 shutdown_connections 2023-05-17T15:27:46.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.646+0000 7fafc6f54700 1 -- 172.21.15.27:0/3906333190 wait complete. 2023-05-17T15:27:46.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.647+0000 7fafc6f54700 1 Processor -- start 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.647+0000 7fafc6f54700 1 -- start start 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc6f54700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac003910 0x7fafc01564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc6f54700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 0x7fafc0164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc6f54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc00afb90 0x7fafc00afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc6f54700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00af300 con 0x7fafc00aee80 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc6f54700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0165140 con 0x7fafac003910 2023-05-17T15:27:46.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc6f54700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00adde0 con 0x7fafc00afb90 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafbffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 0x7fafc0164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafbffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 0x7fafc0164c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45458/0 (socket says 172.21.15.27:45458) 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafbffff700 1 -- 172.21.15.27:0/782298191 learned_addr learned my addr 172.21.15.27:0/782298191 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac003910 0x7fafc01564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.648+0000 7fafc54f1700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc00afb90 0x7fafc00afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbffff700 1 -- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc00afb90 msgr2=0x7fafc00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbffff700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc00afb90 0x7fafc00afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbffff700 1 -- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac003910 msgr2=0x7fafc01564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbffff700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac003910 0x7fafc01564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbffff700 1 -- 172.21.15.27:0/782298191 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00ae0c0 con 0x7fafc00aee80 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbffff700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 0x7fafc0164c50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fafb000e8e0 tx=0x7fafb0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0010520 con 0x7fafc00aee80 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0010680 con 0x7fafc00aee80 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc00ae3a0 con 0x7fafc00aee80 2023-05-17T15:27:46.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0010a00 con 0x7fafc00aee80 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.649+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc00ae960 con 0x7fafc00aee80 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.650+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc00aecd0 con 0x7fafc00aee80 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.650+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 69) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fafb00133e0 con 0x7fafc00aee80 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.651+0000 7fafbcff9700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fafa005ee20 0x7fafa00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.651+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fafb0079860 con 0x7fafc00aee80 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.651+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fafa005ee20 0x7fafa00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.651+0000 7fafc4cf0700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fafa005ee20 0x7fafa00612e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fafb8001e90 tx=0x7fafb8015000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:46.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.655+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fafb004ad20 con 0x7fafc00aee80 2023-05-17T15:27:46.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:46.872+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fafc0158140 con 0x7fafc00aee80 2023-05-17T15:27:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.446+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 70) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fafb00776e0 con 0x7fafc00aee80 2023-05-17T15:27:47.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.447+0000 7fafbcff9700 1 -- 172.21.15.27:0/782298191 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v70) v1 ==== 92+0+0 (secure 0 0 0) 0x7fafb0072af0 con 0x7fafc00aee80 2023-05-17T15:27:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fafa005ee20 msgr2=0x7fafa00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fafa005ee20 0x7fafa00612e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fafb8001e90 tx=0x7fafb8015000).stop 2023-05-17T15:27:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 msgr2=0x7fafc0164c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 0x7fafc0164c50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7fafb000e8e0 tx=0x7fafb0009040).stop 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 shutdown_connections 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fafa005ee20 0x7fafa00612e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc00afb90 0x7fafc00afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafac003910 0x7fafc01564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 --2- 172.21.15.27:0/782298191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafc00aee80 0x7fafc0164c50 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 >> 172.21.15.27:0/782298191 conn(0x7fafc00cb7f0 msgr2=0x7fafc01547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 shutdown_connections 2023-05-17T15:27:47.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.449+0000 7fafc6f54700 1 -- 172.21.15.27:0/782298191 wait complete. 2023-05-17T15:27:47.466 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:27:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.585+0000 7fe6ddd0c700 1 Processor -- start 2023-05-17T15:27:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.585+0000 7fe6ddd0c700 1 -- start start 2023-05-17T15:27:47.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6ddd0c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6d80c3ae0 0x7fe6d8153930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6ddd0c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6d8069930 0x7fe6d80c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6ddd0c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80c40c0 con 0x7fe6d8069550 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6ddd0c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d81548d0 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6ddd0c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d80c2fa0 con 0x7fe6d8069930 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6d6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6d80c3ae0 0x7fe6d8153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6d77fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe6d8069550 0x7fe6d8153220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45052/0 (socket says 172.21.15.27:45052) 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6d77fe700 1 -- 172.21.15.27:0/2683484247 learned_addr learned my addr 172.21.15.27:0/2683484247 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.586+0000 7fe6d7fff700 1 --2- 172.21.15.27:0/2683484247 >> v2:172.21.15.40:3300/0 conn(0x7fe6d8069930 0x7fe6d80c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d6ffd700 1 -- 172.21.15.27:0/2683484247 >> v2:172.21.15.40:3300/0 conn(0x7fe6d8069930 msgr2=0x7fe6d80c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d6ffd700 1 --2- 172.21.15.27:0/2683484247 >> v2:172.21.15.40:3300/0 conn(0x7fe6d8069930 0x7fe6d80c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d6ffd700 1 -- 172.21.15.27:0/2683484247 >> v1:172.21.15.27:6789/0 conn(0x7fe6d8069550 legacy=0x7fe6d8153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d67fc700 1 -- 172.21.15.27:0/2683484247 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823721899 0 0) 0x7fe6d80c40c0 con 0x7fe6d8069550 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d6ffd700 1 -- 172.21.15.27:0/2683484247 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80bc720 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d6ffd700 1 --2- 172.21.15.27:0/2683484247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d8153930 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fe6d8063e50 tx=0x7fe6c8009060).ready entity=mon.0 client_cookie=beb5005abf837c1d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d67fc700 1 -- 172.21.15.27:0/2683484247 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800f510 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d67fc700 1 -- 172.21.15.27:0/2683484247 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800f670 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6d67fc700 1 -- 172.21.15.27:0/2683484247 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800f9f0 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/2683484247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 msgr2=0x7fe6d8153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/2683484247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d8153930 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fe6d8063e50 tx=0x7fe6c8009060).stop 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/2683484247 shutdown_connections 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/2683484247 >> v2:172.21.15.40:3300/0 conn(0x7fe6d8069930 0x7fe6d80c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/2683484247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d8153930 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.587+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/2683484247 >> 172.21.15.27:0/2683484247 conn(0x7fe6d805dd50 msgr2=0x7fe6d805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.588+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/2683484247 shutdown_connections 2023-05-17T15:27:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.588+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/2683484247 wait complete. 2023-05-17T15:27:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.589+0000 7fe6ddd0c700 1 Processor -- start 2023-05-17T15:27:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.589+0000 7fe6ddd0c700 1 -- start start 2023-05-17T15:27:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d8069550 0x7fe6d80a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8069930 0x7fe6d80c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d81474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c0250 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81641c0 con 0x7fe6d8069930 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c76a0 con 0x7fe6d8069550 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d81474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d81474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45500/0 (socket says 172.21.15.27:45500) 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 -- 172.21.15.27:0/3705807945 learned_addr learned my addr 172.21.15.27:0/3705807945 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d6ffd700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8069930 0x7fe6d80c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d77fe700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d8069550 0x7fe6d80a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 -- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d8069550 msgr2=0x7fe6d80a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d8069550 0x7fe6d80a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 -- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8069930 msgr2=0x7fe6d80c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8069930 0x7fe6d80c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 -- 172.21.15.27:0/3705807945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c80092a0 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6d7fff700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d81474e0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fe6d0009e90 tx=0x7fe6d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000caa0 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000f040 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d80c5520 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.590+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000ce10 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.591+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d80bf9b0 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.591+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d806bdf0 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.592+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 70) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fe6d0013610 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.592+0000 7fe6cf7fe700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6b805ee70 0x7fe6b8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.592+0000 7fe6d77fe700 1 -- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6b805ee70 msgr2=0x7fe6b8061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.592+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fe6d007a680 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.592+0000 7fe6d77fe700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6b805ee70 0x7fe6b8061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:27:47.601 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:47.592+0000 7f0495461680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:27:47.601 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:47.593+0000 7f230bc5a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:27:47.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.597+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6d004bc20 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.661 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:47.657+0000 7f0495461680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:27:47.663 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:47.659+0000 7f230bc5a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:27:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.772+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe6d8066e20 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.777+0000 7fe6cf7fe700 1 -- 172.21.15.27:0/3705807945 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe6d004f240 con 0x7fe6d80c3ae0 2023-05-17T15:27:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6b805ee70 msgr2=0x7fe6b8061330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:27:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6b805ee70 0x7fe6b8061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 msgr2=0x7fe6d81474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d81474e0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fe6d0009e90 tx=0x7fe6d000b040).stop 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 shutdown_connections 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe6b805ee70 0x7fe6b8061330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6d80c3ae0 0x7fe6d81474e0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d8069550 0x7fe6d80a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 --2- 172.21.15.27:0/3705807945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d8069930 0x7fe6d80c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 >> 172.21.15.27:0/3705807945 conn(0x7fe6d805dd50 msgr2=0x7fe6d805e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 shutdown_connections 2023-05-17T15:27:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.779+0000 7fe6ddd0c700 1 -- 172.21.15.27:0/3705807945 wait complete. 2023-05-17T15:27:47.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:47.796 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:27:47.816 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-17T15:27:47.946 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:47.941+0000 7f0495461680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:27:47.954 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:47.950+0000 7f230bc5a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:27:47.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.975+0000 7f632e253700 1 Processor -- start 2023-05-17T15:27:47.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.975+0000 7f632e253700 1 -- start start 2023-05-17T15:27:47.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.975+0000 7f632e253700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f63280c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.975+0000 7f632e253700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6328156960 con 0x7f63280c3e90 2023-05-17T15:27:47.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f632e253700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63280c4320 con 0x7f6328151d70 2023-05-17T15:27:47.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f632e253700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63281525b0 con 0x7f6328152150 2023-05-17T15:27:47.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6327fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f63280c3e90 0x7f63280bdf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45088/0 (socket says 172.21.15.27:45088) 2023-05-17T15:27:47.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6327fff700 1 -- 172.21.15.27:0/639214796 learned_addr learned my addr 172.21.15.27:0/639214796 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6326ffd700 1 --2- 172.21.15.27:0/639214796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f63280c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548579747 0 0) 0x7f6328156960 con 0x7f63280c3e90 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63100033f0 con 0x7f63280c3e90 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188991965 0 0) 0x7f63280c4320 con 0x7f6328151d70 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6328156960 con 0x7f6328151d70 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6326ffd700 1 -- 172.21.15.27:0/639214796 >> v1:172.21.15.40:6789/0 conn(0x7f6328151d70 legacy=0x7f63280a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6326ffd700 1 -- 172.21.15.27:0/639214796 >> v1:172.21.15.27:6789/0 conn(0x7f63280c3e90 legacy=0x7f63280bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6326ffd700 1 -- 172.21.15.27:0/639214796 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280c5f00 con 0x7f6328152150 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f6326ffd700 1 --2- 172.21.15.27:0/639214796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f63280c39a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f631c009790 tx=0x7f631c009060).ready entity=mon.2 client_cookie=dac16bbab60d45ef server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.976+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0090d0 con 0x7f6328152150 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00f510 con 0x7f6328152150 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f63267fc700 1 -- 172.21.15.27:0/639214796 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00f890 con 0x7f6328152150 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 -- 172.21.15.27:0/639214796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 msgr2=0x7f63280c39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 --2- 172.21.15.27:0/639214796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f63280c39a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f631c009790 tx=0x7f631c009060).stop 2023-05-17T15:27:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 -- 172.21.15.27:0/639214796 shutdown_connections 2023-05-17T15:27:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 --2- 172.21.15.27:0/639214796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f63280c39a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 -- 172.21.15.27:0/639214796 >> 172.21.15.27:0/639214796 conn(0x7f6328062280 msgr2=0x7f6328062690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 -- 172.21.15.27:0/639214796 shutdown_connections 2023-05-17T15:27:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.977+0000 7f632e253700 1 -- 172.21.15.27:0/639214796 wait complete. 2023-05-17T15:27:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.978+0000 7f632e253700 1 Processor -- start 2023-05-17T15:27:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 -- start start 2023-05-17T15:27:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 0x7f6328154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6328151d70 0x7f6328154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f6328168420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280a83f0 con 0x7f63280c3e90 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6328165840 con 0x7f6328151d70 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f632e253700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6328067cb0 con 0x7f6328152150 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f63277fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 0x7f6328154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f63277fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 0x7f6328154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45528/0 (socket says 172.21.15.27:45528) 2023-05-17T15:27:47.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.979+0000 7f63277fe700 1 -- 172.21.15.27:0/2850482210 learned_addr learned my addr 172.21.15.27:0/2850482210 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6328151d70 0x7f6328154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f6327fff700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f6328168420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f63277fe700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 msgr2=0x7f6328168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f63277fe700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f6328168420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f63277fe700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6328151d70 msgr2=0x7f6328154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f63277fe700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6328151d70 0x7f6328154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f63277fe700 1 -- 172.21.15.27:0/2850482210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0092a0 con 0x7f63280c3e90 2023-05-17T15:27:47.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f63277fe700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 0x7f6328154a70 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f631800c490 tx=0x7f6318007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800ce40 con 0x7f63280c3e90 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800f470 con 0x7f63280c3e90 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6328164c50 con 0x7f63280c3e90 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800f810 con 0x7f63280c3e90 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.980+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63281651f0 con 0x7f63280c3e90 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.981+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632806bdf0 con 0x7f63280c3e90 2023-05-17T15:27:47.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.982+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 70) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6318019030 con 0x7f63280c3e90 2023-05-17T15:27:47.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.982+0000 7f630f7fe700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:47.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.982+0000 7f6326ffd700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f6314061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:47.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.982+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f6318079050 con 0x7f63280c3e90 2023-05-17T15:27:47.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.982+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:27:47.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:47.990+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f631804a570 con 0x7f63280c3e90 2023-05-17T15:27:48.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:48.183+0000 7f6326ffd700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f6314061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:48.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:48.183+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:27:48.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:48.190+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6328155d50 con 0x7f631405ee70 2023-05-17T15:27:48.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:48.584+0000 7f6326ffd700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f6314061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:48.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:48.584+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:27:48.599 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:48.595+0000 7f0495461680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:27:48.618 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:48.614+0000 7f230bc5a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:27:48.666 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:48.662+0000 7f0495461680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:27:48.685 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:48.682+0000 7f230bc5a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:27:48.858 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:48.853+0000 7f0495461680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:27:48.878 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:48.874+0000 7f230bc5a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:27:49.290 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:49.286+0000 7f0495461680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:27:49.312 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:49.309+0000 7f230bc5a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:27:49.388 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:49.385+0000 7f6326ffd700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f6314061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:49.389 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:49.385+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:27:49.397 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:49.392+0000 7f0495461680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:49.419 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:49.416+0000 7f230bc5a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:49.554 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:49.550+0000 7f0495461680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:49.578 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:49.575+0000 7f230bc5a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:49.631 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:49.626+0000 7f0495461680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:27:49.655 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:49.652+0000 7f230bc5a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:27:49.700 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:49.695+0000 7f0495461680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:27:49.725 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:49.721+0000 7f230bc5a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:27:49.969 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:49.965+0000 7f0495461680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:27:49.995 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:49.991+0000 7f230bc5a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:27:50.158 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:50.153+0000 7f0495461680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:50.185 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:50.181+0000 7f230bc5a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:27:50.830 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:50.825+0000 7f0495461680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:27:50.863 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:50.859+0000 7f230bc5a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:27:50.900 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:50.895+0000 7f0495461680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:27:50.947 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:50.930+0000 7f230bc5a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:27:50.977 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:50.972+0000 7f0495461680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:27:50.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:50.986+0000 7f6326ffd700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f6314061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:27:50.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:50.986+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:27:51.010 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.007+0000 7f230bc5a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:27:51.128 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:51.123+0000 7f0495461680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:27:51.162 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.158+0000 7f230bc5a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:27:51.200 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:51.195+0000 7f0495461680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:27:51.235 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.231+0000 7f230bc5a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:27:51.320 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:51.315+0000 7f0495461680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:27:51.354 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.350+0000 7f230bc5a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:27:51.433 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:51.428+0000 7f0495461680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:51.465 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.462+0000 7f230bc5a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:27:51.731 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:51.727+0000 7f0495461680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:27:51.767 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.763+0000 7f230bc5a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:27:51.804 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:27:51.800+0000 7f0495461680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:27:51.841 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.837+0000 7f230bc5a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:27:51.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:51.872+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 71) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f6318010070 con 0x7f63280c3e90 2023-05-17T15:27:51.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:51.872+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f6314061330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:27:51.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:51.872+0000 7f630f7fe700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f6314061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:51.936 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f2287436700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.936 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f2287436700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f228a43c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f2287436700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f228a43c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f2287436700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f228a43c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f2287436700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.937 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f228a43c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:51.938 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:27:51.932+0000 7f228a43c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:27:52.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.893+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 72) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f6318077250 con 0x7f63280c3e90 2023-05-17T15:27:52.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.894+0000 7f630f7fe700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f63140612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:52.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.894+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6328155d50 con 0x7f631405ee70 2023-05-17T15:27:52.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.895+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f63140612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:52.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.896+0000 7f6326ffd700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f63140612b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f631c009fd0 tx=0x7f631c017000).ready entity=mgr.8718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:52.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.911+0000 7f630f7fe700 1 -- 172.21.15.27:0/2850482210 <== mgr.8718 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6328155d50 con 0x7f631405ee70 2023-05-17T15:27:52.915 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path snap_test_dir1 2023-05-17T15:27:52.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 msgr2=0x7f63140612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f63140612b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f631c009fd0 tx=0x7f631c017000).stop 2023-05-17T15:27:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 msgr2=0x7f6328154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 0x7f6328154a70 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f631800c490 tx=0x7f6318007c90).stop 2023-05-17T15:27:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 shutdown_connections 2023-05-17T15:27:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f631405ee70 0x7f63140612b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6328152150 0x7f6328168420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63280c3e90 0x7f6328154a70 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 --2- 172.21.15.27:0/2850482210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6328151d70 0x7f6328154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 >> 172.21.15.27:0/2850482210 conn(0x7f6328062280 msgr2=0x7f6328150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 shutdown_connections 2023-05-17T15:27:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:52.913+0000 7f632e253700 1 -- 172.21.15.27:0/2850482210 wait complete. 2023-05-17T15:27:52.932 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-17T15:27:52.932 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-05-17T15:27:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.056+0000 7fc1e4b5c700 1 Processor -- start 2023-05-17T15:27:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.056+0000 7fc1e4b5c700 1 -- start start 2023-05-17T15:27:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1e4b5c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1e0153f10 0x7fc1e0066360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1e4b5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0157c80 0x7fc1e01580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1e4b5c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e0065350 con 0x7fc1e01542f0 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1e4b5c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e0065ed0 con 0x7fc1e0153f10 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1e4b5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01585e0 con 0x7fc1e0157c80 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1e0153f10 0x7fc1e0066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1e0153f10 0x7fc1e0066360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45706/0 (socket says 172.21.15.27:45706) 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 -- 172.21.15.27:0/3867219129 learned_addr learned my addr 172.21.15.27:0/3867219129 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 -- 172.21.15.27:0/3867219129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0157c80 msgr2=0x7fc1e01580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 --2- 172.21.15.27:0/3867219129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0157c80 0x7fc1e01580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 -- 172.21.15.27:0/3867219129 >> v1:172.21.15.40:6789/0 conn(0x7fc1e01542f0 legacy=0x7fc1e00c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.057+0000 7fc1de59c700 1 -- 172.21.15.27:0/3867219129 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00655a0 con 0x7fc1e0153f10 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1de59c700 1 --2- 172.21.15.27:0/3867219129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e0153f10 0x7fc1e0066360 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fc1d0006fd0 tx=0x7fc1d00090f0).ready entity=mon.0 client_cookie=4b0ab9d4ae32c87f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1dd59a700 1 -- 172.21.15.27:0/3867219129 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000b600 con 0x7fc1e0153f10 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1dd59a700 1 -- 172.21.15.27:0/3867219129 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d000b760 con 0x7fc1e0153f10 2023-05-17T15:27:53.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1dd59a700 1 -- 172.21.15.27:0/3867219129 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000bae0 con 0x7fc1e0153f10 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3867219129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e0153f10 msgr2=0x7fc1e0066360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3867219129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e0153f10 0x7fc1e0066360 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fc1d0006fd0 tx=0x7fc1d00090f0).stop 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3867219129 shutdown_connections 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3867219129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0157c80 0x7fc1e01580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3867219129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e0153f10 0x7fc1e0066360 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3867219129 >> 172.21.15.27:0/3867219129 conn(0x7fc1e00c94b0 msgr2=0x7fc1e00c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3867219129 shutdown_connections 2023-05-17T15:27:53.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.058+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3867219129 wait complete. 2023-05-17T15:27:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.059+0000 7fc1e4b5c700 1 Processor -- start 2023-05-17T15:27:53.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.059+0000 7fc1e4b5c700 1 -- start start 2023-05-17T15:27:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1e4b5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0153f10 0x7fc1e014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1e4b5c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 0x7fc1e01547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1e4b5c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1e0157c80 0x7fc1e0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1e4b5c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0155dc0 con 0x7fc1e01542f0 2023-05-17T15:27:53.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1e4b5c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01551b0 con 0x7fc1e0157c80 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1e4b5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0155490 con 0x7fc1e0153f10 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1ddd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 0x7fc1e01547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1ddd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 0x7fc1e01547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45714/0 (socket says 172.21.15.27:45714) 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1ddd9b700 1 -- 172.21.15.27:0/3650775469 learned_addr learned my addr 172.21.15.27:0/3650775469 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1de59c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0153f10 0x7fc1e014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.060+0000 7fc1ded9d700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1e0157c80 0x7fc1e0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ddd9b700 1 -- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0153f10 msgr2=0x7fc1e014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ddd9b700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0153f10 0x7fc1e014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ddd9b700 1 -- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1e0157c80 msgr2=0x7fc1e0067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ddd9b700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1e0157c80 0x7fc1e0067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ddd9b700 1 -- 172.21.15.27:0/3650775469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0009370 con 0x7fc1e01542f0 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ddd9b700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 0x7fc1e01547d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fc1d400c490 tx=0x7fc1d4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400f470 con 0x7fc1e01542f0 2023-05-17T15:27:53.071 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d400f5d0 con 0x7fc1e01542f0 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0155770 con 0x7fc1e01542f0 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400f990 con 0x7fc1e01542f0 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.061+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e014e0c0 con 0x7fc1e01542f0 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.062+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0155f70 con 0x7fc1e01542f0 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.062+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 72) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fc1d4019030 con 0x7fc1e01542f0 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.063+0000 7fc1ce7fc700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc1c005ed40 0x7fc1c0061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.063+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fc1d4078fe0 con 0x7fc1e01542f0 2023-05-17T15:27:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.063+0000 7fc1de59c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc1c005ed40 0x7fc1c0061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.063+0000 7fc1de59c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc1c005ed40 0x7fc1c0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc1d0009130 tx=0x7fc1d0017000).ready entity=mgr.8718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:53.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.067+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1d40488f0 con 0x7fc1e01542f0 2023-05-17T15:27:53.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.263+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e006bdf0 con 0x7fc1c005ed40 2023-05-17T15:27:53.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.268+0000 7fc1ce7fc700 1 -- 172.21.15.27:0/3650775469 <== mgr.8718 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fc1e006bdf0 con 0x7fc1c005ed40 2023-05-17T15:27:53.272 INFO:teuthology.orchestra.run.smithi027.stdout:Retention added to path snap_test_dir1 2023-05-17T15:27:53.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc1c005ed40 msgr2=0x7fc1c0061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc1c005ed40 0x7fc1c0061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc1d0009130 tx=0x7fc1d0017000).stop 2023-05-17T15:27:53.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 msgr2=0x7fc1e01547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 0x7fc1e01547d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fc1d400c490 tx=0x7fc1d4007db0).stop 2023-05-17T15:27:53.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 shutdown_connections 2023-05-17T15:27:53.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc1c005ed40 0x7fc1c0061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1e0157c80 0x7fc1e0067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1e0153f10 0x7fc1e014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 --2- 172.21.15.27:0/3650775469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e01542f0 0x7fc1e01547d0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.269+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 >> 172.21.15.27:0/3650775469 conn(0x7fc1e00c94b0 msgr2=0x7fc1e00c71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:53.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.270+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 shutdown_connections 2023-05-17T15:27:53.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.270+0000 7fc1e4b5c700 1 -- 172.21.15.27:0/3650775469 wait complete. 2023-05-17T15:27:53.286 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-05-17T15:27:53.286 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-17-15_28_00 in ~7s... 2023-05-17T15:27:53.286 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-05-17T15:27:53.287 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-17T15:27:53.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.402+0000 7fe2672ba700 1 Processor -- start 2023-05-17T15:27:53.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.402+0000 7fe2672ba700 1 -- start start 2023-05-17T15:27:53.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe2672ba700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe260153fa0 0x7fe2600c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe2672ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600aa130 0x7fe260081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe2672ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2600824c0 0x7fe260068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe2672ba700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600c1610 con 0x7fe260153fa0 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe2672ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe260082910 con 0x7fe2600824c0 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe2672ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600c0a00 con 0x7fe2600aa130 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe260153fa0 0x7fe2600c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe260153fa0 0x7fe2600c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45720/0 (socket says 172.21.15.27:45720) 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 -- 172.21.15.27:0/957692600 learned_addr learned my addr 172.21.15.27:0/957692600 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:53.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe264855700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600aa130 0x7fe260081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265857700 1 --2- 172.21.15.27:0/957692600 >> v2:172.21.15.40:3300/0 conn(0x7fe2600824c0 0x7fe260068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 -- 172.21.15.27:0/957692600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600aa130 msgr2=0x7fe260081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600aa130 0x7fe260081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 -- 172.21.15.27:0/957692600 >> v2:172.21.15.40:3300/0 conn(0x7fe2600824c0 msgr2=0x7fe260068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:27:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 --2- 172.21.15.27:0/957692600 >> v2:172.21.15.40:3300/0 conn(0x7fe2600824c0 0x7fe260068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 -- 172.21.15.27:0/957692600 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600c0ce0 con 0x7fe260153fa0 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265857700 1 --2- 172.21.15.27:0/957692600 >> v2:172.21.15.40:3300/0 conn(0x7fe2600824c0 0x7fe260068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe264855700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600aa130 0x7fe260081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.403+0000 7fe265056700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2600c0420 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fe2600c5010 tx=0x7fe258009840).ready entity=mon.0 client_cookie=79ed20561619202b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe25ffff700 1 -- 172.21.15.27:0/957692600 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800e070 con 0x7fe260153fa0 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe25ffff700 1 -- 172.21.15.27:0/957692600 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800ba50 con 0x7fe260153fa0 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe25ffff700 1 -- 172.21.15.27:0/957692600 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800bdd0 con 0x7fe260153fa0 2023-05-17T15:27:53.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 -- 172.21.15.27:0/957692600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 msgr2=0x7fe2600c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2600c0420 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fe2600c5010 tx=0x7fe258009840).stop 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 -- 172.21.15.27:0/957692600 shutdown_connections 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2600c0420 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 --2- 172.21.15.27:0/957692600 >> v2:172.21.15.40:3300/0 conn(0x7fe2600824c0 0x7fe260068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 --2- 172.21.15.27:0/957692600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600aa130 0x7fe260081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 -- 172.21.15.27:0/957692600 >> 172.21.15.27:0/957692600 conn(0x7fe26005e820 msgr2=0x7fe2600cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:53.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 -- 172.21.15.27:0/957692600 shutdown_connections 2023-05-17T15:27:53.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.404+0000 7fe2672ba700 1 -- 172.21.15.27:0/957692600 wait complete. 2023-05-17T15:27:53.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.405+0000 7fe2672ba700 1 Processor -- start 2023-05-17T15:27:53.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.405+0000 7fe2672ba700 1 -- start start 2023-05-17T15:27:53.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe2672ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600824c0 0x7fe26014aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe2672ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2600aa130 0x7fe26014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe2672ba700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2601497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe2672ba700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600ae070 con 0x7fe260153fa0 2023-05-17T15:27:53.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe2672ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600c31a0 con 0x7fe2600aa130 2023-05-17T15:27:53.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe2672ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26014af50 con 0x7fe2600824c0 2023-05-17T15:27:53.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe265857700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2601497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe265857700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2601497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45730/0 (socket says 172.21.15.27:45730) 2023-05-17T15:27:53.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe265857700 1 -- 172.21.15.27:0/2863317883 learned_addr learned my addr 172.21.15.27:0/2863317883 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe265056700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600824c0 0x7fe26014aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.406+0000 7fe264855700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2600aa130 0x7fe26014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe265857700 1 -- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600824c0 msgr2=0x7fe26014aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe265857700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600824c0 0x7fe26014aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe265857700 1 -- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2600aa130 msgr2=0x7fe26014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe265857700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2600aa130 0x7fe26014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe265857700 1 -- 172.21.15.27:0/2863317883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009ae0 con 0x7fe260153fa0 2023-05-17T15:27:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe265857700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2601497d0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7fe25000d860 tx=0x7fe250008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011590 con 0x7fe260153fa0 2023-05-17T15:27:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2500116f0 con 0x7fe260153fa0 2023-05-17T15:27:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011a90 con 0x7fe260153fa0 2023-05-17T15:27:53.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2600c3440 con 0x7fe260153fa0 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.407+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2600c3a00 con 0x7fe260153fa0 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.408+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260082d20 con 0x7fe260153fa0 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.408+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 72) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fe250012420 con 0x7fe260153fa0 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.409+0000 7fe25d7fa700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe24c05ed40 0x7fe24c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.409+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fe2500796d0 con 0x7fe260153fa0 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.409+0000 7fe265056700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe24c05ed40 0x7fe24c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.409+0000 7fe265056700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe24c05ed40 0x7fe24c061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe258009880 tx=0x7fe2600c1580).ready entity=mgr.8718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:27:53.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.413+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe25004ab50 con 0x7fe260153fa0 2023-05-17T15:27:53.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.610+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2600c0fc0 con 0x7fe24c05ed40 2023-05-17T15:27:53.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.612+0000 7fe25d7fa700 1 -- 172.21.15.27:0/2863317883 <== mgr.8718 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fe2600c0fc0 con 0x7fe24c05ed40 2023-05-17T15:27:53.616 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:27:53.616 INFO:teuthology.orchestra.run.smithi027.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-17T15:27:53.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe24c05ed40 msgr2=0x7fe24c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe24c05ed40 0x7fe24c061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe258009880 tx=0x7fe2600c1580).stop 2023-05-17T15:27:53.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 msgr2=0x7fe2601497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:27:53.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2601497d0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7fe25000d860 tx=0x7fe250008040).stop 2023-05-17T15:27:53.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 shutdown_connections 2023-05-17T15:27:53.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe24c05ed40 0x7fe24c061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe260153fa0 0x7fe2601497d0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2600824c0 0x7fe26014aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 --2- 172.21.15.27:0/2863317883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2600aa130 0x7fe26014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:27:53.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 >> 172.21.15.27:0/2863317883 conn(0x7fe26005e820 msgr2=0x7fe2600c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:27:53.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 shutdown_connections 2023-05-17T15:27:53.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:27:53.614+0000 7fe2672ba700 1 -- 172.21.15.27:0/2863317883 wait complete. 2023-05-17T15:27:53.630 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-17T15:27:53.630 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-05-17T15:27:53.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:53.631 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:27:54.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:54.648 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:27:55.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:55.669 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:27:56.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:56.690 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:27:57.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:57.712 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:27:58.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:58.733 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:27:59.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:27:59.754 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:00.276 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:28:00.272+0000 7f2279c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:28:00.276 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:28:00.272+0000 7f2279c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:28:00.276 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:28:00.272+0000 7f2279c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:28:00.277 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:28:00.272+0000 7f2279c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:28:00.277 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:28:00.272+0000 7f2279c1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:28:00.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:00.774 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:00.793 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:00.794 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-17-15_28_00_UTC'] 2023-05-17T15:28:00.795 DEBUG:tasks.cephfs.test_snap_schedules:exec=1684337273.2864287, now = 1684337280.7951438, timo = 7 2023-05-17T15:28:01.796 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-05-17-15_28_00 in ~67s... 2023-05-17T15:28:01.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:01.797 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:01.815 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:02.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:02.817 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:02.836 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:03.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:03.838 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:03.856 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:04.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:04.863 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:04.882 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:05.184 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:05.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:05.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:05.885 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:05.903 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:06.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:06.906 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:06.924 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:07.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:07.926 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:07.945 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:08.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:08.947 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:08.966 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:09.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:09.969 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:09.988 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:10.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:10.990 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:11.009 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:12.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:12.011 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:12.034 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:13.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:13.036 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:13.055 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:14.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:14.057 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:14.076 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:15.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:15.078 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:15.096 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:16.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:16.098 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:16.117 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:17.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:17.119 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:17.138 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:18.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:18.141 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:18.160 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:19.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:19.162 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:19.180 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:20.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:20.183 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:20.202 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:21.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:21.205 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:21.223 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:22.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:22.225 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:22.251 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:23.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:23.253 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:23.273 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:24.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:24.275 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:24.293 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:25.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:25.296 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:25.315 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:26.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:26.317 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:26.335 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:27.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:27.338 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:27.356 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:28.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:28.359 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:28.378 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:29.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:29.380 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:29.398 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:30.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:30.400 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:30.419 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:31.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:31.421 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:31.440 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:32.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:32.442 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:32.460 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:33.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:33.462 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:33.480 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:34.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:34.482 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:34.501 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:35.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:35.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:28:35.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:35.503 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:35.521 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:36.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:36.523 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:36.542 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:37.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:37.544 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:37.562 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:38.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:38.565 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:38.584 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:39.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:39.587 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:39.605 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:40.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:40.608 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:40.626 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:41.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:41.628 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:41.646 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:42.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:42.649 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:42.667 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:43.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:43.670 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:43.688 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:44.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:44.690 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:44.709 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:45.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:45.711 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:46.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:46.733 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:46.752 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:47.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:47.754 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:47.773 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:48.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:48.775 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:48.794 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:49.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:49.796 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:49.815 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:50.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:50.817 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:50.835 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:51.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:51.838 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:51.856 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:52.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:52.858 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:52.879 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:53.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:53.881 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:53.899 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:54.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:54.902 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:55.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:55.923 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:55.942 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:56.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:56.944 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:56.963 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:57.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:57.965 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:57.984 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:28:58.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:28:58.986 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:28:59.004 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:29:00.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:00.006 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:29:00.025 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_28_00_UTC 2023-05-17T15:29:01.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:01.027 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:29:01.045 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_29_00_UTC 2023-05-17T15:29:01.046 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-05-17-15_28_00_UTC'] 2023-05-17T15:29:01.046 DEBUG:tasks.cephfs.test_snap_schedules:exec=1684337273.2864287, now = 1684337341.0469172, timo = 67 2023-05-17T15:29:02.047 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-17T15:29:02.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.176+0000 7f54ade5b700 1 Processor -- start 2023-05-17T15:29:02.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.176+0000 7f54ade5b700 1 -- start start 2023-05-17T15:29:02.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54ade5b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a80c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54ade5b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54a80826e0 0x7f54a80aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54ade5b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a80c1610 con 0x7f54a80aa130 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54ade5b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80c0a00 con 0x7f54a80826e0 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54ade5b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c0ce0 con 0x7f54a8153fa0 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54a7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54a80826e0 0x7f54a80aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a80c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54a7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54a80826e0 0x7f54a80aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:35446/0 (socket says 172.21.15.27:35446) 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54a7fff700 1 -- 172.21.15.27:0/278221537 learned_addr learned my addr 172.21.15.27:0/278221537 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a80c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:46858/0 (socket says 172.21.15.27:46858) 2023-05-17T15:29:02.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.177+0000 7f54a6ffd700 1 --1- 172.21.15.27:0/278221537 >> v1:172.21.15.40:6789/0 conn(0x7f54a80aa130 0x7f54a8081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:51312/0 (socket says 172.21.15.27:51312) 2023-05-17T15:29:02.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a7fff700 1 -- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 msgr2=0x7f54a80c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:02.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a7fff700 1 --2- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a80c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a7fff700 1 -- 172.21.15.27:0/278221537 >> v1:172.21.15.40:6789/0 conn(0x7f54a80aa130 legacy=0x7f54a8081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a67fc700 1 -- 172.21.15.27:0/278221537 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471565012 0 0) 0x7f54a80c1610 con 0x7f54a80aa130 2023-05-17T15:29:02.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a7fff700 1 -- 172.21.15.27:0/278221537 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80c0fc0 con 0x7f54a80826e0 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a77fe700 1 --2- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a80c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a7fff700 1 --2- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80826e0 0x7f54a80aae50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f54a0009f20 tx=0x7f54a0009840).ready entity=mon.1 client_cookie=274153ddc6cd4217 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a67fc700 1 -- 172.21.15.27:0/278221537 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000e070 con 0x7f54a80826e0 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a67fc700 1 -- 172.21.15.27:0/278221537 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000b9d0 con 0x7f54a80826e0 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.178+0000 7f54a67fc700 1 -- 172.21.15.27:0/278221537 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000bd50 con 0x7f54a80826e0 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 -- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80826e0 msgr2=0x7f54a80aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 --2- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80826e0 0x7f54a80aae50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f54a0009f20 tx=0x7f54a0009840).stop 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 -- 172.21.15.27:0/278221537 shutdown_connections 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 --2- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80826e0 0x7f54a80aae50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 --2- 172.21.15.27:0/278221537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a80c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 -- 172.21.15.27:0/278221537 >> 172.21.15.27:0/278221537 conn(0x7f54a805e820 msgr2=0x7f54a80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 -- 172.21.15.27:0/278221537 shutdown_connections 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.179+0000 7f54ade5b700 1 -- 172.21.15.27:0/278221537 wait complete. 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.180+0000 7f54ade5b700 1 Processor -- start 2023-05-17T15:29:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.180+0000 7f54ade5b700 1 -- start start 2023-05-17T15:29:02.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54ade5b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 0x7f54a8164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54ade5b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80aa130 0x7f54a80af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54ade5b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54ade5b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c4af0 con 0x7f54a80826e0 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54ade5b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8165330 con 0x7f54a80aa130 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54ade5b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8167a10 con 0x7f54a8153fa0 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 0x7f54a8164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 0x7f54a8164e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45752/0 (socket says 172.21.15.27:45752) 2023-05-17T15:29:02.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 -- 172.21.15.27:0/1230186923 learned_addr learned my addr 172.21.15.27:0/1230186923 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a6ffd700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80aa130 0x7f54a80af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a7fff700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 -- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 msgr2=0x7f54a814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a814a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 -- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80aa130 msgr2=0x7f54a80af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80aa130 0x7f54a80af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 -- 172.21.15.27:0/1230186923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980092a0 con 0x7f54a80826e0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a7fff700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.181+0000 7f54a77fe700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 0x7f54a8164e40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f549800e980 tx=0x7f5498009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.182+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549800c850 con 0x7f54a80826e0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.182+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549800c9b0 con 0x7f54a80826e0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.182+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0009ae0 con 0x7f54a80826e0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.182+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549800cd30 con 0x7f54a80826e0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.182+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a8168050 con 0x7f54a80826e0 2023-05-17T15:29:02.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.182+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8168620 con 0x7f54a80826e0 2023-05-17T15:29:02.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.183+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 74) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f5498022070 con 0x7f54a80826e0 2023-05-17T15:29:02.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.183+0000 7f548f7fe700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f549405ef00 0x7f54940613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.183+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f549807a360 con 0x7f54a80826e0 2023-05-17T15:29:02.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.183+0000 7f54a6ffd700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f549405ef00 0x7f54940613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.184+0000 7f54a6ffd700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f549405ef00 0x7f54940613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f54a80caa90 tx=0x7f549c007180).ready entity=mgr.8718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:02.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.188+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f549804b5d0 con 0x7f54a80826e0 2023-05-17T15:29:02.394 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.390+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f54a806bdf0 con 0x7f549405ef00 2023-05-17T15:29:02.397 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.394+0000 7f548f7fe700 1 -- 172.21.15.27:0/1230186923 <== mgr.8718 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f54a806bdf0 con 0x7f549405ef00 2023-05-17T15:29:02.398 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path snap_test_dir1 2023-05-17T15:29:02.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f549405ef00 msgr2=0x7f54940613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f549405ef00 0x7f54940613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f54a80caa90 tx=0x7f549c007180).stop 2023-05-17T15:29:02.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 msgr2=0x7f54a8164e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 0x7f54a8164e40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f549800e980 tx=0x7f5498009060).stop 2023-05-17T15:29:02.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 shutdown_connections 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f549405ef00 0x7f54940613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54a8153fa0 0x7f54a814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54a80826e0 0x7f54a8164e40 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 --2- 172.21.15.27:0/1230186923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a80aa130 0x7f54a80af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 >> 172.21.15.27:0/1230186923 conn(0x7f54a805e820 msgr2=0x7f54a80c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 shutdown_connections 2023-05-17T15:29:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.396+0000 7f54ade5b700 1 -- 172.21.15.27:0/1230186923 wait complete. 2023-05-17T15:29:02.411 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-17T15:29:02.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:02.412 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:29:02.427 INFO:teuthology.orchestra.run.smithi027.stdout:scheduled-2023-05-17-15_29_00_UTC 2023-05-17T15:29:02.428 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-17-15_29_00_UTC 2023-05-17T15:29:02.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:02.428 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-17-15_29_00_UTC) 2023-05-17T15:29:02.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:02.490 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-17T15:29:02.547 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:29:02.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.700+0000 7fa66a283700 1 Processor -- start 2023-05-17T15:29:02.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.700+0000 7fa66a283700 1 -- start start 2023-05-17T15:29:02.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa66a283700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6640cafe0 0x7fa664157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa66a283700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa664158010 con 0x7fa6640cac00 2023-05-17T15:29:02.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa66a283700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6641582f0 con 0x7fa664153ef0 2023-05-17T15:29:02.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa66a283700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6641588b0 con 0x7fa6640cafe0 2023-05-17T15:29:02.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa669281700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa6640cac00 0x7fa6641537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45322/0 (socket says 172.21.15.27:45322) 2023-05-17T15:29:02.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa669281700 1 -- 172.21.15.27:0/1547030711 learned_addr learned my addr 172.21.15.27:0/1547030711 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:02.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588826232 0 0) 0x7fa664158010 con 0x7fa6640cac00 2023-05-17T15:29:02.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c0033f0 con 0x7fa6640cac00 2023-05-17T15:29:02.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa669a82700 1 --2- 172.21.15.27:0/1547030711 >> v2:172.21.15.40:3300/0 conn(0x7fa6640cafe0 0x7fa664157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.709 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907410377 0 0) 0x7fa64c0033f0 con 0x7fa6640cac00 2023-05-17T15:29:02.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 >> v2:172.21.15.40:3300/0 conn(0x7fa6640cafe0 msgr2=0x7fa664157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:02.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 --2- 172.21.15.27:0/1547030711 >> v2:172.21.15.40:3300/0 conn(0x7fa6640cafe0 0x7fa664157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 >> v1:172.21.15.40:6789/0 conn(0x7fa664153ef0 legacy=0x7fa6640c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.701+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6641585d0 con 0x7fa6640cac00 2023-05-17T15:29:02.710 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fa65c001470 con 0x7fa6640cac00 2023-05-17T15:29:02.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 >> v1:172.21.15.27:6789/0 conn(0x7fa6640cac00 legacy=0x7fa6641537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa64c0039b0 0x7fa64c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c004690 0x7fa64c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa64c005120 0x7fa64c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.711 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6641588b0 con 0x7fa64c0039b0 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c00c010 con 0x7fa64c005120 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c00c1d0 con 0x7fa64c004690 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa64c0039b0 0x7fa64c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669a82700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa64c005120 0x7fa64c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa668a80700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c004690 0x7fa64c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 -- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c004690 msgr2=0x7fa64c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:02.712 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c004690 0x7fa64c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 -- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa64c005120 msgr2=0x7fa64c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa64c005120 0x7fa64c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669a82700 1 -- 172.21.15.27:0/1547030711 reap_dead start 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 -- 172.21.15.27:0/1547030711 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0033f0 con 0x7fa64c0039b0 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa668a80700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c004690 0x7fa64c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa669281700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa64c0039b0 0x7fa64c003dd0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fa65c007f90 tx=0x7fa65c001d80).ready entity=mon.0 client_cookie=15852d4c5ead9557 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:02.713 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00c960 con 0x7fa64c0039b0 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00cac0 con 0x7fa64c0039b0 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.702+0000 7fa663fff700 1 -- 172.21.15.27:0/1547030711 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ce40 con 0x7fa64c0039b0 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 -- 172.21.15.27:0/1547030711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa64c0039b0 msgr2=0x7fa64c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa64c0039b0 0x7fa64c003dd0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fa65c007f90 tx=0x7fa65c001d80).stop 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 -- 172.21.15.27:0/1547030711 shutdown_connections 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 --2- 172.21.15.27:0/1547030711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa64c0039b0 0x7fa64c003dd0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 -- 172.21.15.27:0/1547030711 >> 172.21.15.27:0/1547030711 conn(0x7fa66405dd50 msgr2=0x7fa66405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:02.714 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 -- 172.21.15.27:0/1547030711 shutdown_connections 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.703+0000 7fa66a283700 1 -- 172.21.15.27:0/1547030711 wait complete. 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.704+0000 7fa66a283700 1 Processor -- start 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.704+0000 7fa66a283700 1 -- start start 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa66a283700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c0039b0 0x7fa66414d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa66a283700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 0x7fa6641556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa66a283700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa664154480 0x7fa664154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa66a283700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664164f30 con 0x7fa664155250 2023-05-17T15:29:02.715 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa66a283700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664154df0 con 0x7fa664154480 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa66a283700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa664155ca0 con 0x7fa64c0039b0 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 0x7fa6641556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 0x7fa6641556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45774/0 (socket says 172.21.15.27:45774) 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 -- 172.21.15.27:0/2260741350 learned_addr learned my addr 172.21.15.27:0/2260741350 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa669281700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c0039b0 0x7fa66414d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa669a82700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa664154480 0x7fa664154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.716 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 -- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c0039b0 msgr2=0x7fa66414d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c0039b0 0x7fa66414d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 -- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa664154480 msgr2=0x7fa664154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa664154480 0x7fa664154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 -- 172.21.15.27:0/2260741350 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6641648e0 con 0x7fa664155250 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa668a80700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 0x7fa6641556d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fa65800e790 tx=0x7fa658009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658010520 con 0x7fa664155250 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.705+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa658010680 con 0x7fa664155250 2023-05-17T15:29:02.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.706+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa664164bc0 con 0x7fa664155250 2023-05-17T15:29:02.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.706+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658010a00 con 0x7fa664155250 2023-05-17T15:29:02.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.706+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa664164560 con 0x7fa664155250 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.706+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa664047150 con 0x7fa664155250 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.707+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 74) v1 ==== 75419+0+0 (secure 0 0 0) 0x7fa65801b030 con 0x7fa664155250 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.707+0000 7fa6617fa700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa65005ef00 0x7fa6500613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.707+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fa658079c50 con 0x7fa664155250 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.707+0000 7fa669281700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa65005ef00 0x7fa6500613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.708+0000 7fa669281700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa65005ef00 0x7fa6500613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fa65c008fd0 tx=0x7fa65c015000).ready entity=mgr.8718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:02.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.711+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa65804af70 con 0x7fa664155250 2023-05-17T15:29:02.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:02.930+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa6640c63b0 con 0x7fa664155250 2023-05-17T15:29:03.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.050+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fa658077820 con 0x7fa664155250 2023-05-17T15:29:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.051+0000 7fa6617fa700 1 -- 172.21.15.27:0/2260741350 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v75) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa658073180 con 0x7fa664155250 2023-05-17T15:29:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa65005ef00 msgr2=0x7fa6500613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa65005ef00 0x7fa6500613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fa65c008fd0 tx=0x7fa65c015000).stop 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 msgr2=0x7fa6641556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 0x7fa6641556d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fa65800e790 tx=0x7fa658009040).stop 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 shutdown_connections 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa65005ef00 0x7fa6500613c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa664154480 0x7fa664154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa64c0039b0 0x7fa66414d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 --2- 172.21.15.27:0/2260741350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa664155250 0x7fa6641556d0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 >> 172.21.15.27:0/2260741350 conn(0x7fa66405dd50 msgr2=0x7fa6640a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:03.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 shutdown_connections 2023-05-17T15:29:03.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.053+0000 7fa66a283700 1 -- 172.21.15.27:0/2260741350 wait complete. 2023-05-17T15:29:03.069 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:29:03.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:29:03.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:29:03.128 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:29:03.129 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:29:03.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:03.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:29:03.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:29:03.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:03.177 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:29:03.200 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:03.196+0000 7fd1b02ba680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:29:03.203 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:03.199+0000 7f5017a14680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:29:03.214 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:03.266 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:03.262+0000 7fd1b02ba680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:29:03.268 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:03.264+0000 7f5017a14680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:29:03.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.369+0000 7fc18d6b2700 1 Processor -- start 2023-05-17T15:29:03.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.369+0000 7fc18d6b2700 1 -- start start 2023-05-17T15:29:03.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc18d6b2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1881571b0 0x7fc188157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc18d6b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880cb130 0x7fc1880c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc18d6b2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880c0120 con 0x7fc1880c5bf0 2023-05-17T15:29:03.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc18d6b2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880c6e20 con 0x7fc1881571b0 2023-05-17T15:29:03.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc18d6b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880aaa60 con 0x7fc1880cb130 2023-05-17T15:29:03.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1881571b0 0x7fc188157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1881571b0 0x7fc188157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45826/0 (socket says 172.21.15.27:45826) 2023-05-17T15:29:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 -- 172.21.15.27:0/39797691 learned_addr learned my addr 172.21.15.27:0/39797691 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc18ceb1700 1 --2- 172.21.15.27:0/39797691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880cb130 0x7fc1880c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 -- 172.21.15.27:0/39797691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880cb130 msgr2=0x7fc1880c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 --2- 172.21.15.27:0/39797691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880cb130 0x7fc1880c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 -- 172.21.15.27:0/39797691 >> v1:172.21.15.40:6789/0 conn(0x7fc1880c5bf0 legacy=0x7fc1880caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 -- 172.21.15.27:0/39797691 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188158880 con 0x7fc1881571b0 2023-05-17T15:29:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.370+0000 7fc187fff700 1 --2- 172.21.15.27:0/39797691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1881571b0 0x7fc188157970 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fc178006fd0 tx=0x7fc1780090f0).ready entity=mon.0 client_cookie=bd24f5d1967c53e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc186ffd700 1 -- 172.21.15.27:0/39797691 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800b580 con 0x7fc1881571b0 2023-05-17T15:29:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc186ffd700 1 -- 172.21.15.27:0/39797691 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800b6e0 con 0x7fc1881571b0 2023-05-17T15:29:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc186ffd700 1 -- 172.21.15.27:0/39797691 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800ba60 con 0x7fc1881571b0 2023-05-17T15:29:03.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 -- 172.21.15.27:0/39797691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1881571b0 msgr2=0x7fc188157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/39797691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1881571b0 0x7fc188157970 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fc178006fd0 tx=0x7fc1780090f0).stop 2023-05-17T15:29:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 -- 172.21.15.27:0/39797691 shutdown_connections 2023-05-17T15:29:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/39797691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880cb130 0x7fc1880c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/39797691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1881571b0 0x7fc188157970 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 -- 172.21.15.27:0/39797691 >> 172.21.15.27:0/39797691 conn(0x7fc18805dd50 msgr2=0x7fc18805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:03.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 -- 172.21.15.27:0/39797691 shutdown_connections 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.371+0000 7fc18d6b2700 1 -- 172.21.15.27:0/39797691 wait complete. 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.372+0000 7fc18d6b2700 1 Processor -- start 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 -- start start 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880c5bf0 0x7fc18814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 0x7fc1880ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1881571b0 0x7fc1880c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880aefa0 con 0x7fc1880cb130 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880c47d0 con 0x7fc1881571b0 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc18d6b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880c4ab0 con 0x7fc1880c5bf0 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc1877fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 0x7fc1880ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc1877fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 0x7fc1880ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45832/0 (socket says 172.21.15.27:45832) 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc187fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880c5bf0 0x7fc18814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.373+0000 7fc1877fe700 1 -- 172.21.15.27:0/2259739264 learned_addr learned my addr 172.21.15.27:0/2259739264 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:03.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc18ceb1700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1881571b0 0x7fc1880c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc1877fe700 1 -- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880c5bf0 msgr2=0x7fc18814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc1877fe700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880c5bf0 0x7fc18814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc1877fe700 1 -- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1881571b0 msgr2=0x7fc1880c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc1877fe700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1881571b0 0x7fc1880c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc1877fe700 1 -- 172.21.15.27:0/2259739264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178009370 con 0x7fc1880cb130 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc1877fe700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 0x7fc1880ae870 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fc17c00c4c0 tx=0x7fc17c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:03.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00ce70 con 0x7fc1880cb130 2023-05-17T15:29:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c001e90 con 0x7fc1880cb130 2023-05-17T15:29:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880c4d90 con 0x7fc1880cb130 2023-05-17T15:29:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c007250 con 0x7fc1880cb130 2023-05-17T15:29:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.374+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1880c4490 con 0x7fc1880cb130 2023-05-17T15:29:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.375+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1880aed60 con 0x7fc1880cb130 2023-05-17T15:29:03.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.376+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fc17c010070 con 0x7fc1880cb130 2023-05-17T15:29:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.376+0000 7fc16ffff700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 0x7fc174061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.376+0000 7fc187fff700 1 -- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 msgr2=0x7fc174061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:03.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.376+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fc17c079520 con 0x7fc1880cb130 2023-05-17T15:29:03.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.376+0000 7fc187fff700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 0x7fc174061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:03.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.380+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc17c04a8a0 con 0x7fc1880cb130 2023-05-17T15:29:03.553 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:03.548+0000 7f5017a14680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:29:03.558 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:03.554+0000 7fd1b02ba680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:29:03.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.577+0000 7fc187fff700 1 -- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 msgr2=0x7fc174061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:03.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.577+0000 7fc187fff700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 0x7fc174061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.599+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc18806bdf0 con 0x7fc1880cb130 2023-05-17T15:29:03.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.599+0000 7fc16ffff700 1 -- 172.21.15.27:0/2259739264 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fc17c04dec0 con 0x7fc1880cb130 2023-05-17T15:29:03.603 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:03.603 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":67,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:27:39.410260+0000","modified":"2023-05-17T15:27:42.418264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6833/3042009108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3042009108},{"type":"v1","addr":"172.21.15.40:6833","nonce":3042009108}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-17T15:29:03.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 msgr2=0x7fc174061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:03.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 0x7fc174061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:03.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 msgr2=0x7fc1880ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 0x7fc1880ae870 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fc17c00c4c0 tx=0x7fc17c007e00).stop 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 shutdown_connections 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc17405eeb0 0x7fc174061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1881571b0 0x7fc1880c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1880c5bf0 0x7fc18814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 --2- 172.21.15.27:0/2259739264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1880cb130 0x7fc1880ae870 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 >> 172.21.15.27:0/2259739264 conn(0x7fc18805dd50 msgr2=0x7fc1880ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:03.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 shutdown_connections 2023-05-17T15:29:03.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.601+0000 7fc18d6b2700 1 -- 172.21.15.27:0/2259739264 wait complete. 2023-05-17T15:29:03.607 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 67 2023-05-17T15:29:03.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:03.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.771+0000 7f40129cf700 1 Processor -- start 2023-05-17T15:29:03.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.771+0000 7f40129cf700 1 -- start start 2023-05-17T15:29:03.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f40129cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f400c0c5f30 0x7f400c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f40129cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c1543e0 0x7f400c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f40129cf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c0bfcd0 con 0x7f400c158880 2023-05-17T15:29:03.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f40129cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0c0290 con 0x7f400c0c5f30 2023-05-17T15:29:03.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f40129cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0aa1a0 con 0x7f400c1543e0 2023-05-17T15:29:03.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f400b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f400c158880 0x7f400c153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45424/0 (socket says 172.21.15.27:45424) 2023-05-17T15:29:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f400b7fe700 1 -- 172.21.15.27:0/780399581 learned_addr learned my addr 172.21.15.27:0/780399581 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f400bfff700 1 --2- 172.21.15.27:0/780399581 >> v2:172.21.15.40:3300/0 conn(0x7f400c0c5f30 0x7f400c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.772+0000 7f4010f6c700 1 --2- 172.21.15.27:0/780399581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c1543e0 0x7f400c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f400affd700 1 -- 172.21.15.27:0/780399581 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081582153 0 0) 0x7f400c0bfcd0 con 0x7f400c158880 2023-05-17T15:29:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f400affd700 1 -- 172.21.15.27:0/780399581 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff80033f0 con 0x7f400c158880 2023-05-17T15:29:03.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f4010f6c700 1 -- 172.21.15.27:0/780399581 >> v2:172.21.15.40:3300/0 conn(0x7f400c0c5f30 msgr2=0x7f400c0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:03.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f4010f6c700 1 --2- 172.21.15.27:0/780399581 >> v2:172.21.15.40:3300/0 conn(0x7f400c0c5f30 0x7f400c0c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f4010f6c700 1 -- 172.21.15.27:0/780399581 >> v1:172.21.15.27:6789/0 conn(0x7f400c158880 legacy=0x7f400c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f4010f6c700 1 -- 172.21.15.27:0/780399581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0aa480 con 0x7f400c1543e0 2023-05-17T15:29:03.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f400bfff700 1 --2- 172.21.15.27:0/780399581 >> v2:172.21.15.40:3300/0 conn(0x7f400c0c5f30 0x7f400c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:03.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f4010f6c700 1 --2- 172.21.15.27:0/780399581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c1543e0 0x7f400c0c0720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4004009e60 tx=0x7f4004009780).ready entity=mon.2 client_cookie=5e8bac074d68f83f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:03.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f400affd700 1 -- 172.21.15.27:0/780399581 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400e070 con 0x7f400c1543e0 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f400affd700 1 -- 172.21.15.27:0/780399581 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400400bab0 con 0x7f400c1543e0 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.773+0000 7f400affd700 1 -- 172.21.15.27:0/780399581 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400be30 con 0x7f400c1543e0 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 -- 172.21.15.27:0/780399581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c1543e0 msgr2=0x7f400c0c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 --2- 172.21.15.27:0/780399581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c1543e0 0x7f400c0c0720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4004009e60 tx=0x7f4004009780).stop 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 -- 172.21.15.27:0/780399581 shutdown_connections 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 --2- 172.21.15.27:0/780399581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c1543e0 0x7f400c0c0720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 --2- 172.21.15.27:0/780399581 >> v2:172.21.15.40:3300/0 conn(0x7f400c0c5f30 0x7f400c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 -- 172.21.15.27:0/780399581 >> 172.21.15.27:0/780399581 conn(0x7f400c069e70 msgr2=0x7f400c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:03.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 -- 172.21.15.27:0/780399581 shutdown_connections 2023-05-17T15:29:03.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.774+0000 7f40129cf700 1 -- 172.21.15.27:0/780399581 wait complete. 2023-05-17T15:29:03.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.775+0000 7f40129cf700 1 Processor -- start 2023-05-17T15:29:03.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.775+0000 7f40129cf700 1 -- start start 2023-05-17T15:29:03.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f40129cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f400c0c5f30 0x7f400c0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f40129cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 0x7f400c13aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f40129cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c158880 0x7f400c1677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f40129cf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0cb4c0 con 0x7f400c1543e0 2023-05-17T15:29:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f40129cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c13b3b0 con 0x7f400c0c5f30 2023-05-17T15:29:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f40129cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0ca940 con 0x7f400c158880 2023-05-17T15:29:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 0x7f400c13aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f400c0c5f30 0x7f400c0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 0x7f400c13aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45868/0 (socket says 172.21.15.27:45868) 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400b7fe700 1 -- 172.21.15.27:0/186334183 learned_addr learned my addr 172.21.15.27:0/186334183 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f4010f6c700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c158880 0x7f400c1677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 -- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c158880 msgr2=0x7f400c1677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c158880 0x7f400c1677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 -- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 msgr2=0x7f400c13aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 0x7f400c13aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 -- 172.21.15.27:0/186334183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0092a0 con 0x7f400c0c5f30 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400b7fe700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 0x7f400c13aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.776+0000 7f400bfff700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f400c0c5f30 0x7f400c0b0970 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f3ffc00e980 tx=0x7f3ffc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.777+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc012600 con 0x7f400c0c5f30 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.777+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc012760 con 0x7f400c0c5f30 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.777+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc012ae0 con 0x7f400c0c5f30 2023-05-17T15:29:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.777+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4004009a20 con 0x7f400c0c5f30 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.777+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c0caf00 con 0x7f400c0c5f30 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.778+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c05f4a0 con 0x7f400c0c5f30 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.778+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f3ffc022070 con 0x7f400c0c5f30 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.778+0000 7f4003fff700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3fec05eeb0 0x7f3fec061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.778+0000 7f400b7fe700 1 -- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3fec05eeb0 msgr2=0x7f3fec061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.778+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f3ffc07a090 con 0x7f400c0c5f30 2023-05-17T15:29:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.778+0000 7f400b7fe700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3fec05eeb0 0x7f3fec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:03.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.783+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ffc04b410 con 0x7f400c0c5f30 2023-05-17T15:29:03.962 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.958+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f400c06bdf0 con 0x7f400c0c5f30 2023-05-17T15:29:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.960+0000 7f4003fff700 1 -- 172.21.15.27:0/186334183 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+17568 (secure 0 0 0) 0x7f3ffc016090 con 0x7f400c0c5f30 2023-05-17T15:29:03.964 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:03.964 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":163,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:28:53.014563+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:27:37.958967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-17T15:27:38.376205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.25","mappings":[{"from":2,"to":0}]},{"pgid":"19.3c","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/339210960":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/2332544695":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/2037319850":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/1858055009":"2023-05-18T15:27:51.850935+0000","172.21.15.27:6837/122387":"2023-05-18T15:27:51.850935+0000","172.21.15.27:6836/122387":"2023-05-18T15:27:51.850935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3fec05eeb0 msgr2=0x7f3fec061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:03.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3fec05eeb0 0x7f3fec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:03.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f400c0c5f30 msgr2=0x7f400c0b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:03.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f400c0c5f30 0x7f400c0b0970 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f3ffc00e980 tx=0x7f3ffc009060).stop 2023-05-17T15:29:03.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 shutdown_connections 2023-05-17T15:29:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3fec05eeb0 0x7f3fec061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f400c158880 0x7f400c1677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f400c0c5f30 0x7f400c0b0970 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 --2- 172.21.15.27:0/186334183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f400c1543e0 0x7f400c13aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 >> 172.21.15.27:0/186334183 conn(0x7f400c069e70 msgr2=0x7f400c0ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 shutdown_connections 2023-05-17T15:29:03.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:03.962+0000 7f40129cf700 1 -- 172.21.15.27:0/186334183 wait complete. 2023-05-17T15:29:03.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:27:37.958967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:27:38.376205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:29:03.979 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:29:04.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.098+0000 7f3f5b3b5700 1 Processor -- start 2023-05-17T15:29:04.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.098+0000 7f3f5b3b5700 1 -- start start 2023-05-17T15:29:04.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5b3b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f541540a0 0x7f3f54154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5b3b5700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f540bbe60 0x7f3f54066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5b3b5700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f54154970 con 0x7f3f540667f0 2023-05-17T15:29:04.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5b3b5700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f54063340 con 0x7f3f540bbe60 2023-05-17T15:29:04.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5b3b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54066c60 con 0x7f3f541540a0 2023-05-17T15:29:04.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f59bb2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f540bbe60 0x7f3f54066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5abb4700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3f540667f0 0x7f3f54157bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45440/0 (socket says 172.21.15.27:45440) 2023-05-17T15:29:04.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5abb4700 1 -- 172.21.15.27:0/2587879986 learned_addr learned my addr 172.21.15.27:0/2587879986 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:04.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f5a3b3700 1 --2- 172.21.15.27:0/2587879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f541540a0 0x7f3f54154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f59bb2700 1 -- 172.21.15.27:0/2587879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f541540a0 msgr2=0x7f3f54154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:04.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f59bb2700 1 --2- 172.21.15.27:0/2587879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f541540a0 0x7f3f54154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.112 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f59bb2700 1 -- 172.21.15.27:0/2587879986 >> v1:172.21.15.27:6789/0 conn(0x7f3f540667f0 legacy=0x7f3f54157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f59bb2700 1 -- 172.21.15.27:0/2587879986 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54154ba0 con 0x7f3f540bbe60 2023-05-17T15:29:04.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f593b1700 1 -- 172.21.15.27:0/2587879986 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236783039 0 0) 0x7f3f54154970 con 0x7f3f540667f0 2023-05-17T15:29:04.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.099+0000 7f3f59bb2700 1 --2- 172.21.15.27:0/2587879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54066300 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f3f44009760 tx=0x7f3f44009060).ready entity=mon.0 client_cookie=34e0c8aa4fa9fa53 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:04.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f593b1700 1 -- 172.21.15.27:0/2587879986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400f510 con 0x7f3f540bbe60 2023-05-17T15:29:04.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f593b1700 1 -- 172.21.15.27:0/2587879986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400f670 con 0x7f3f540bbe60 2023-05-17T15:29:04.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f593b1700 1 -- 172.21.15.27:0/2587879986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400f9f0 con 0x7f3f540bbe60 2023-05-17T15:29:04.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/2587879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 msgr2=0x7f3f54066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/2587879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54066300 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f3f44009760 tx=0x7f3f44009060).stop 2023-05-17T15:29:04.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/2587879986 shutdown_connections 2023-05-17T15:29:04.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/2587879986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f541540a0 0x7f3f54154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/2587879986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54066300 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/2587879986 >> 172.21.15.27:0/2587879986 conn(0x7f3f54068780 msgr2=0x7f3f540c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:04.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/2587879986 shutdown_connections 2023-05-17T15:29:04.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.100+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/2587879986 wait complete. 2023-05-17T15:29:04.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.101+0000 7f3f5b3b5700 1 Processor -- start 2023-05-17T15:29:04.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.101+0000 7f3f5b3b5700 1 -- start start 2023-05-17T15:29:04.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5b3b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f540667f0 0x7f3f54164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5b3b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5b3b5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f541540a0 0x7f3f541503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5b3b5700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540a9fe0 con 0x7f3f540bbe60 2023-05-17T15:29:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5b3b5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54143250 con 0x7f3f541540a0 2023-05-17T15:29:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5b3b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54164870 con 0x7f3f540667f0 2023-05-17T15:29:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f59bb2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f59bb2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45882/0 (socket says 172.21.15.27:45882) 2023-05-17T15:29:04.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f59bb2700 1 -- 172.21.15.27:0/241371650 learned_addr learned my addr 172.21.15.27:0/241371650 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5a3b3700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f540667f0 0x7f3f54164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.102+0000 7f3f5abb4700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f541540a0 0x7f3f541503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f59bb2700 1 -- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f540667f0 msgr2=0x7f3f54164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f59bb2700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f540667f0 0x7f3f54164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f59bb2700 1 -- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f541540a0 msgr2=0x7f3f541503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f59bb2700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f541540a0 0x7f3f541503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.121 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f59bb2700 1 -- 172.21.15.27:0/241371650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440092a0 con 0x7f3f540bbe60 2023-05-17T15:29:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f59bb2700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54142d60 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f3f44011000 tx=0x7f3f44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400f7e0 con 0x7f3f540bbe60 2023-05-17T15:29:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400f940 con 0x7f3f540bbe60 2023-05-17T15:29:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f54164b50 con 0x7f3f540bbe60 2023-05-17T15:29:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4401b660 con 0x7f3f540bbe60 2023-05-17T15:29:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.103+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f54165110 con 0x7f3f540bbe60 2023-05-17T15:29:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.104+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f54047150 con 0x7f3f540bbe60 2023-05-17T15:29:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.104+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f3f4400f070 con 0x7f3f540bbe60 2023-05-17T15:29:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.105+0000 7f3f4a7fc700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 0x7f3f38061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.105+0000 7f3f5a3b3700 1 -- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 msgr2=0x7f3f38061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.105+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f3f4407b640 con 0x7f3f540bbe60 2023-05-17T15:29:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.105+0000 7f3f5a3b3700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 0x7f3f38061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.109+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f4404ca70 con 0x7f3f540bbe60 2023-05-17T15:29:04.211 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:04.206+0000 7f5017a14680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:29:04.227 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:04.219+0000 7fd1b02ba680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:29:04.279 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:04.274+0000 7f5017a14680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:29:04.293 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:04.289+0000 7fd1b02ba680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:29:04.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.306+0000 7f3f5a3b3700 1 -- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 msgr2=0x7f3f38061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:04.310 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.306+0000 7f3f5a3b3700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 0x7f3f38061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:04.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.327+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f540aa120 con 0x7f3f540bbe60 2023-05-17T15:29:04.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.328+0000 7f3f4a7fc700 1 -- 172.21.15.27:0/241371650 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v163) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3f44028020 con 0x7f3f540bbe60 2023-05-17T15:29:04.332 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:29:04.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 msgr2=0x7f3f38061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:04.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 0x7f3f38061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:04.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 msgr2=0x7f3f54142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54142d60 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f3f44011000 tx=0x7f3f44017000).stop 2023-05-17T15:29:04.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 shutdown_connections 2023-05-17T15:29:04.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f3f3805eeb0 0x7f3f38061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:04.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f541540a0 0x7f3f541503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f540667f0 0x7f3f54164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 --2- 172.21.15.27:0/241371650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f540bbe60 0x7f3f54142d60 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.329+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 >> 172.21.15.27:0/241371650 conn(0x7f3f54068780 msgr2=0x7f3f540c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:04.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.330+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 shutdown_connections 2023-05-17T15:29:04.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.330+0000 7f3f5b3b5700 1 -- 172.21.15.27:0/241371650 wait complete. 2023-05-17T15:29:04.347 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:29:04.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.465+0000 7fd6f27cf700 1 Processor -- start 2023-05-17T15:29:04.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.465+0000 7fd6f27cf700 1 -- start start 2023-05-17T15:29:04.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f27cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6ec1543d0 0x7fd6ec0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f27cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f27cf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec0c0c90 con 0x7fd6ec0691f0 2023-05-17T15:29:04.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f27cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0c1c50 con 0x7fd6ec1543d0 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f27cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec158790 con 0x7fd6ec0c60f0 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6ebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6ec1543d0 0x7fd6ec0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f0d6c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6ec0691f0 0x7fd6ec1547b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:51458/0 (socket says 172.21.15.27:51458) 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6f0d6c700 1 -- 172.21.15.27:0/1615071794 learned_addr learned my addr 172.21.15.27:0/1615071794 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6eaffd700 1 -- 172.21.15.27:0/1615071794 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552288394 0 0) 0x7fd6ec0c0c90 con 0x7fd6ec0691f0 2023-05-17T15:29:04.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6eaffd700 1 -- 172.21.15.27:0/1615071794 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80033f0 con 0x7fd6ec0691f0 2023-05-17T15:29:04.472 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:04.466+0000 7f5017a14680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:29:04.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6ebfff700 1 -- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 msgr2=0x7fd6ec068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6ebfff700 1 --2- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.466+0000 7fd6ebfff700 1 -- 172.21.15.27:0/1615071794 >> v1:172.21.15.40:6789/0 conn(0x7fd6ec0691f0 legacy=0x7fd6ec1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6ebfff700 1 -- 172.21.15.27:0/1615071794 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0c6570 con 0x7fd6ec1543d0 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6eb7fe700 1 --2- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6ebfff700 1 --2- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec0c5c00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd6dc009760 tx=0x7fd6dc009060).ready entity=mon.1 client_cookie=e639181c43db0a61 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6eaffd700 1 -- 172.21.15.27:0/1615071794 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00d4a0 con 0x7fd6ec1543d0 2023-05-17T15:29:04.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6eaffd700 1 -- 172.21.15.27:0/1615071794 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00d600 con 0x7fd6ec1543d0 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6eaffd700 1 -- 172.21.15.27:0/1615071794 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00d980 con 0x7fd6ec1543d0 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6f27cf700 1 -- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec1543d0 msgr2=0x7fd6ec0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec0c5c00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fd6dc009760 tx=0x7fd6dc009060).stop 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6f27cf700 1 -- 172.21.15.27:0/1615071794 shutdown_connections 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec0c5c00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/1615071794 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.467+0000 7fd6f27cf700 1 -- 172.21.15.27:0/1615071794 >> 172.21.15.27:0/1615071794 conn(0x7fd6ec0cb7f0 msgr2=0x7fd6ec0c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:04.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.468+0000 7fd6f27cf700 1 -- 172.21.15.27:0/1615071794 shutdown_connections 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.468+0000 7fd6f27cf700 1 -- 172.21.15.27:0/1615071794 wait complete. 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.469+0000 7fd6f27cf700 1 Processor -- start 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.469+0000 7fd6f27cf700 1 -- start start 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 0x7fd6ec147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec163ed0 con 0x7fd6ec1543d0 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec155190 con 0x7fd6ec0691f0 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1649b0 con 0x7fd6ec0c60f0 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 0x7fd6ec147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45900/0 (socket says 172.21.15.27:45900) 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:47008/0 (socket says 172.21.15.27:47008) 2023-05-17T15:29:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 -- 172.21.15.27:0/3683133403 learned_addr learned my addr 172.21.15.27:0/3683133403 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 0x7fd6ec147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:35594/0 (socket says 172.21.15.27:35594) 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 -- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 msgr2=0x7fd6ec1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 -- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 msgr2=0x7fd6ec147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 0x7fd6ec147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 -- 172.21.15.27:0/3683133403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40092a0 con 0x7fd6ec1543d0 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6ebfff700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 0x7fd6ec147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f0d6c700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec154ca0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fd6e4005ad0 tx=0x7fd6e4001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4005d30 con 0x7fd6ec1543d0 2023-05-17T15:29:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4005e90 con 0x7fd6ec1543d0 2023-05-17T15:29:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.470+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0092a0 con 0x7fd6ec1543d0 2023-05-17T15:29:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.471+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4007320 con 0x7fd6ec1543d0 2023-05-17T15:29:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.471+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec0b0c40 con 0x7fd6ec1543d0 2023-05-17T15:29:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.471+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec164b60 con 0x7fd6ec1543d0 2023-05-17T15:29:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.472+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fd6e4010030 con 0x7fd6ec1543d0 2023-05-17T15:29:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.473+0000 7fd6e3fff700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6cc05eeb0 0x7fd6cc061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.473+0000 7fd6ebfff700 1 -- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6cc05eeb0 msgr2=0x7fd6cc061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.473+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fd6e4079c40 con 0x7fd6ec1543d0 2023-05-17T15:29:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.473+0000 7fd6ebfff700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6cc05eeb0 0x7fd6cc061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.477+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6ec164b60 con 0x7fd6ec1543d0 2023-05-17T15:29:04.492 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:04.489+0000 7fd1b02ba680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:29:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.650+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6ec164b20 con 0x7fd6ec1543d0 2023-05-17T15:29:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.651+0000 7fd6e3fff700 1 -- 172.21.15.27:0/3683133403 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6e404aee0 con 0x7fd6ec1543d0 2023-05-17T15:29:04.655 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:29:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6cc05eeb0 msgr2=0x7fd6cc061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6cc05eeb0 0x7fd6cc061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 msgr2=0x7fd6ec154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec154ca0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fd6e4005ad0 tx=0x7fd6e4001650).stop 2023-05-17T15:29:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 shutdown_connections 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd6cc05eeb0 0x7fd6cc061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6ec1543d0 0x7fd6ec154ca0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ec0691f0 0x7fd6ec147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 --2- 172.21.15.27:0/3683133403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6ec0c60f0 0x7fd6ec1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 >> 172.21.15.27:0/3683133403 conn(0x7fd6ec0cb7f0 msgr2=0x7fd6ec153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 shutdown_connections 2023-05-17T15:29:04.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.653+0000 7fd6f27cf700 1 -- 172.21.15.27:0/3683133403 wait complete. 2023-05-17T15:29:04.669 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:29:04.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.787+0000 7fa0483a1700 1 Processor -- start 2023-05-17T15:29:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.787+0000 7fa0483a1700 1 -- start start 2023-05-17T15:29:04.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.788+0000 7fa0483a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa04005e2f0 0x7fa0401517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.788+0000 7fa0483a1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa040151ca0 0x7fa0400bd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.788+0000 7fa0483a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0400a7bf0 con 0x7fa04005df10 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.788+0000 7fa0483a1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04005e750 con 0x7fa040151ca0 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.788+0000 7fa0483a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040155970 con 0x7fa04005e2f0 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa040151ca0 0x7fa0400bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa040151ca0 0x7fa0400bd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45926/0 (socket says 172.21.15.27:45926) 2023-05-17T15:29:04.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 -- 172.21.15.27:0/784594440 learned_addr learned my addr 172.21.15.27:0/784594440 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:04.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04593c700 1 --2- 172.21.15.27:0/784594440 >> v2:172.21.15.40:3300/0 conn(0x7fa04005e2f0 0x7fa0401517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04513b700 1 -- 172.21.15.27:0/784594440 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188313645 0 0) 0x7fa0400a7bf0 con 0x7fa04005df10 2023-05-17T15:29:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 -- 172.21.15.27:0/784594440 >> v2:172.21.15.40:3300/0 conn(0x7fa04005e2f0 msgr2=0x7fa0401517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 --2- 172.21.15.27:0/784594440 >> v2:172.21.15.40:3300/0 conn(0x7fa04005e2f0 0x7fa0401517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 -- 172.21.15.27:0/784594440 >> v1:172.21.15.40:6789/0 conn(0x7fa04005df10 legacy=0x7fa040064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 -- 172.21.15.27:0/784594440 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040155c30 con 0x7fa040151ca0 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04693e700 1 --2- 172.21.15.27:0/784594440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400bd270 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fa0400c41a0 tx=0x7fa038009840).ready entity=mon.0 client_cookie=fb7cf3f022f6691f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04513b700 1 -- 172.21.15.27:0/784594440 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800e070 con 0x7fa040151ca0 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04513b700 1 -- 172.21.15.27:0/784594440 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800ba20 con 0x7fa040151ca0 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.789+0000 7fa04513b700 1 -- 172.21.15.27:0/784594440 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800bda0 con 0x7fa040151ca0 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 -- 172.21.15.27:0/784594440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 msgr2=0x7fa0400bd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 --2- 172.21.15.27:0/784594440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400bd270 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fa0400c41a0 tx=0x7fa038009840).stop 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 -- 172.21.15.27:0/784594440 shutdown_connections 2023-05-17T15:29:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 --2- 172.21.15.27:0/784594440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400bd270 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 --2- 172.21.15.27:0/784594440 >> v2:172.21.15.40:3300/0 conn(0x7fa04005e2f0 0x7fa0401517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 -- 172.21.15.27:0/784594440 >> 172.21.15.27:0/784594440 conn(0x7fa0400c7910 msgr2=0x7fa0400c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 -- 172.21.15.27:0/784594440 shutdown_connections 2023-05-17T15:29:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.790+0000 7fa0483a1700 1 -- 172.21.15.27:0/784594440 wait complete. 2023-05-17T15:29:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.791+0000 7fa0483a1700 1 Processor -- start 2023-05-17T15:29:04.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.791+0000 7fa0483a1700 1 -- start start 2023-05-17T15:29:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa0483a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa04005df10 0x7fa040163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa0483a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04005e2f0 0x7fa0400bf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa0483a1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa0483a1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400bffa0 con 0x7fa040151ca0 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa0483a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c0280 con 0x7fa04005e2f0 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa0483a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c0560 con 0x7fa04005df10 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45932/0 (socket says 172.21.15.27:45932) 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 -- 172.21.15.27:0/3927761846 learned_addr learned my addr 172.21.15.27:0/3927761846 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:04.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04593c700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04005e2f0 0x7fa0400bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04613d700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa04005df10 0x7fa040163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 -- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa04005df10 msgr2=0x7fa040163f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa04005df10 0x7fa040163f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 -- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04005e2f0 msgr2=0x7fa0400bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04005e2f0 0x7fa0400bf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.792+0000 7fa04693e700 1 -- 172.21.15.27:0/3927761846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038009ae0 con 0x7fa040151ca0 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.793+0000 7fa04693e700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400a8ca0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7fa0400c4150 tx=0x7fa040064cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:04.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.793+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800bda0 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.793+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0380092e0 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.793+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03801d6b0 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.793+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0400c0840 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.793+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa040168b20 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.794+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa040168d40 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.794+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fa038024030 con 0x7fa040151ca0 2023-05-17T15:29:04.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.794+0000 7fa0367fc700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa02405eeb0 0x7fa024061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.794+0000 7fa04613d700 1 -- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa02405eeb0 msgr2=0x7fa024061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.794+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fa03807b140 con 0x7fa040151ca0 2023-05-17T15:29:04.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.794+0000 7fa04613d700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa02405eeb0 0x7fa024061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:04.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.802+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa040168d40 con 0x7fa040151ca0 2023-05-17T15:29:04.906 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:04.901+0000 7f5017a14680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:29:04.940 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:04.936+0000 7fd1b02ba680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:29:04.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.982+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa040168d40 con 0x7fa040151ca0 2023-05-17T15:29:04.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.983+0000 7fa0367fc700 1 -- 172.21.15.27:0/3927761846 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa040168d40 con 0x7fa040151ca0 2023-05-17T15:29:04.987 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:29:04.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa02405eeb0 msgr2=0x7fa024061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:04.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa02405eeb0 0x7fa024061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:04.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 msgr2=0x7fa0400a8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:04.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400a8ca0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7fa0400c4150 tx=0x7fa040064cf0).stop 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 shutdown_connections 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa02405eeb0 0x7fa024061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa040151ca0 0x7fa0400a8ca0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa04005df10 0x7fa040163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 --2- 172.21.15.27:0/3927761846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa04005e2f0 0x7fa0400bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 >> 172.21.15.27:0/3927761846 conn(0x7fa0400c7910 msgr2=0x7fa040151580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:04.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 shutdown_connections 2023-05-17T15:29:04.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:04.985+0000 7fa0483a1700 1 -- 172.21.15.27:0/3927761846 wait complete. 2023-05-17T15:29:05.001 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:29:05.014 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:05.009+0000 7f5017a14680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:05.052 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:05.048+0000 7fd1b02ba680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:05.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.133+0000 7fa97d227700 1 Processor -- start 2023-05-17T15:29:05.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.133+0000 7fa97d227700 1 -- start start 2023-05-17T15:29:05.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97d227700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9780a9890 0x7fa9780a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97d227700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa9780bc830 0x7fa9780bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97d227700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780c5200 con 0x7fa978063340 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97d227700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780bd170 con 0x7fa9780bc830 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97d227700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780637d0 con 0x7fa9780a9890 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97759e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa9780bc830 0x7fa9780bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.134+0000 7fa97659c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa978063340 0x7fa978151d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45498/0 (socket says 172.21.15.27:45498) 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97659c700 1 -- 172.21.15.27:0/272603044 learned_addr learned my addr 172.21.15.27:0/272603044 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97759e700 1 --2- 172.21.15.27:0/272603044 >> v2:172.21.15.27:3300/0 conn(0x7fa9780bc830 0x7fa9780bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45936/0 (socket says 172.21.15.27:45936) 2023-05-17T15:29:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa976d9d700 1 --2- 172.21.15.27:0/272603044 >> v2:172.21.15.40:3300/0 conn(0x7fa9780a9890 0x7fa9780a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97759e700 1 -- 172.21.15.27:0/272603044 >> v2:172.21.15.40:3300/0 conn(0x7fa9780a9890 msgr2=0x7fa9780a9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97759e700 1 --2- 172.21.15.27:0/272603044 >> v2:172.21.15.40:3300/0 conn(0x7fa9780a9890 0x7fa9780a9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97759e700 1 -- 172.21.15.27:0/272603044 >> v1:172.21.15.27:6789/0 conn(0x7fa978063340 legacy=0x7fa978151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97759e700 1 -- 172.21.15.27:0/272603044 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780c2000 con 0x7fa9780bc830 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa975d9b700 1 -- 172.21.15.27:0/272603044 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732201835 0 0) 0x7fa9780c5200 con 0x7fa978063340 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa97759e700 1 --2- 172.21.15.27:0/272603044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780bc830 0x7fa9780bcc80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fa978069a60 tx=0x7fa970009780).ready entity=mon.0 client_cookie=99ecc8c42930ffbc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa975d9b700 1 -- 172.21.15.27:0/272603044 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e070 con 0x7fa9780bc830 2023-05-17T15:29:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa975d9b700 1 -- 172.21.15.27:0/272603044 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000bb60 con 0x7fa9780bc830 2023-05-17T15:29:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.135+0000 7fa975d9b700 1 -- 172.21.15.27:0/272603044 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970012410 con 0x7fa9780bc830 2023-05-17T15:29:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 -- 172.21.15.27:0/272603044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780bc830 msgr2=0x7fa9780bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 --2- 172.21.15.27:0/272603044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780bc830 0x7fa9780bcc80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fa978069a60 tx=0x7fa970009780).stop 2023-05-17T15:29:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 -- 172.21.15.27:0/272603044 shutdown_connections 2023-05-17T15:29:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 --2- 172.21.15.27:0/272603044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780bc830 0x7fa9780bcc80 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 --2- 172.21.15.27:0/272603044 >> v2:172.21.15.40:3300/0 conn(0x7fa9780a9890 0x7fa9780a9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 -- 172.21.15.27:0/272603044 >> 172.21.15.27:0/272603044 conn(0x7fa9780c83a0 msgr2=0x7fa9780c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 -- 172.21.15.27:0/272603044 shutdown_connections 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.136+0000 7fa97d227700 1 -- 172.21.15.27:0/272603044 wait complete. 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.137+0000 7fa97d227700 1 Processor -- start 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.137+0000 7fa97d227700 1 -- start start 2023-05-17T15:29:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97d227700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9780a9890 0x7fa978131f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97d227700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9780bc830 0x7fa978146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97d227700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 0x7fa978145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97d227700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978139b60 con 0x7fa9780c4770 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97d227700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c43e0 con 0x7fa9780bc830 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97d227700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97813c840 con 0x7fa9780a9890 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 0x7fa978145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97759e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 0x7fa978145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45944/0 (socket says 172.21.15.27:45944) 2023-05-17T15:29:05.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97759e700 1 -- 172.21.15.27:0/3492132379 learned_addr learned my addr 172.21.15.27:0/3492132379 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa976d9d700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9780a9890 0x7fa978131f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97659c700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9780bc830 0x7fa978146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97659c700 1 -- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9780a9890 msgr2=0x7fa978131f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.138+0000 7fa97659c700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9780a9890 0x7fa978131f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97659c700 1 -- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 msgr2=0x7fa978145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97659c700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 0x7fa978145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97659c700 1 -- 172.21.15.27:0/3492132379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009a20 con 0x7fa9780bc830 2023-05-17T15:29:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa976d9d700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9780a9890 0x7fa978131f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97759e700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 0x7fa978145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97659c700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9780bc830 0x7fa978146d40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa978066120 tx=0x7fa968007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680070d0 con 0x7fa9780bc830 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9781395c0 con 0x7fa9780bc830 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968007250 con 0x7fa9780bc830 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968007610 con 0x7fa9780bc830 2023-05-17T15:29:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.139+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97813c280 con 0x7fa9780bc830 2023-05-17T15:29:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.140+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97806bdf0 con 0x7fa9780bc830 2023-05-17T15:29:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.140+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fa968010070 con 0x7fa9780bc830 2023-05-17T15:29:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.141+0000 7fa96effd700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa95805eeb0 0x7fa958061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.141+0000 7fa976d9d700 1 -- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa95805eeb0 msgr2=0x7fa958061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:05.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.141+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7fa968079460 con 0x7fa9780bc830 2023-05-17T15:29:05.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.141+0000 7fa976d9d700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa95805eeb0 0x7fa958061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:05.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.151+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa96804a690 con 0x7fa9780bc830 2023-05-17T15:29:05.177 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:05.173+0000 7f5017a14680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:05.216 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:05.212+0000 7fd1b02ba680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:05.254 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:05.249+0000 7f5017a14680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:29:05.294 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:05.290+0000 7fd1b02ba680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:29:05.317 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:05.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:05.323 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:05.319+0000 7f5017a14680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:29:05.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.327+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa97806a3c0 con 0x7fa9780bc830 2023-05-17T15:29:05.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.327+0000 7fa96effd700 1 -- 172.21.15.27:0/3492132379 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa968007c40 con 0x7fa9780bc830 2023-05-17T15:29:05.331 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:29:05.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa95805eeb0 msgr2=0x7fa958061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:05.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa95805eeb0 0x7fa958061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9780bc830 msgr2=0x7fa978146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9780bc830 0x7fa978146d40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa978066120 tx=0x7fa968007bb0).stop 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 shutdown_connections 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa95805eeb0 0x7fa958061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa9780c4770 0x7fa978145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9780a9890 0x7fa978131f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 --2- 172.21.15.27:0/3492132379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9780bc830 0x7fa978146d40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 >> 172.21.15.27:0/3492132379 conn(0x7fa9780c83a0 msgr2=0x7fa978153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:05.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 shutdown_connections 2023-05-17T15:29:05.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.329+0000 7fa97d227700 1 -- 172.21.15.27:0/3492132379 wait complete. 2023-05-17T15:29:05.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:05.367 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:05.363+0000 7fd1b02ba680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:29:05.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.486+0000 7f25cef24700 1 Processor -- start 2023-05-17T15:29:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.486+0000 7f25cef24700 1 -- start start 2023-05-17T15:29:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.486+0000 7f25cef24700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f25c8065aa0 0x7f25c815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.486+0000 7f25cef24700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c8152f90 con 0x7f25c80bf340 2023-05-17T15:29:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.486+0000 7f25cef24700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c80c3fd0 con 0x7f25c80665f0 2023-05-17T15:29:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.486+0000 7f25cef24700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c8153420 con 0x7f25c8065aa0 2023-05-17T15:29:05.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f25c8065aa0 0x7f25c815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f25c8065aa0 0x7f25c815cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45952/0 (socket says 172.21.15.27:45952) 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cccc0700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f25c80bf340 0x7f25c80c38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45510/0 (socket says 172.21.15.27:45510) 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 -- 172.21.15.27:0/307017807 learned_addr learned my addr 172.21.15.27:0/307017807 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 -- 172.21.15.27:0/307017807 >> v1:172.21.15.40:6789/0 conn(0x7f25c80665f0 legacy=0x7f25c8065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 -- 172.21.15.27:0/307017807 >> v1:172.21.15.27:6789/0 conn(0x7f25c80bf340 legacy=0x7f25c80c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25c77fe700 1 -- 172.21.15.27:0/307017807 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032710979 0 0) 0x7f25c8152f90 con 0x7f25c80bf340 2023-05-17T15:29:05.492 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 -- 172.21.15.27:0/307017807 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8152660 con 0x7f25c8065aa0 2023-05-17T15:29:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25cd4c1700 1 --2- 172.21.15.27:0/307017807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c8065aa0 0x7f25c815cec0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f25c0009f20 tx=0x7f25c0009840).ready entity=mon.0 client_cookie=4f0ec3e86885f266 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25c77fe700 1 -- 172.21.15.27:0/307017807 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000e070 con 0x7f25c8065aa0 2023-05-17T15:29:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25c77fe700 1 -- 172.21.15.27:0/307017807 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000ba80 con 0x7f25c8065aa0 2023-05-17T15:29:05.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.487+0000 7f25c77fe700 1 -- 172.21.15.27:0/307017807 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000be00 con 0x7f25c8065aa0 2023-05-17T15:29:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 -- 172.21.15.27:0/307017807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c8065aa0 msgr2=0x7f25c815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 --2- 172.21.15.27:0/307017807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c8065aa0 0x7f25c815cec0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f25c0009f20 tx=0x7f25c0009840).stop 2023-05-17T15:29:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 -- 172.21.15.27:0/307017807 shutdown_connections 2023-05-17T15:29:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 --2- 172.21.15.27:0/307017807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c8065aa0 0x7f25c815cec0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 -- 172.21.15.27:0/307017807 >> 172.21.15.27:0/307017807 conn(0x7f25c80c94a0 msgr2=0x7f25c80c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 -- 172.21.15.27:0/307017807 shutdown_connections 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.488+0000 7f25cef24700 1 -- 172.21.15.27:0/307017807 wait complete. 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.489+0000 7f25cef24700 1 Processor -- start 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.489+0000 7f25cef24700 1 -- start start 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cef24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25c8065aa0 0x7f25c80acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cef24700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25c80665f0 0x7f25c8068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cef24700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 0x7f25c80adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cef24700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c814f2e0 con 0x7f25c80bf340 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cef24700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8165580 con 0x7f25c80665f0 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cef24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80ad410 con 0x7f25c8065aa0 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 0x7f25c80adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 0x7f25c80adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45958/0 (socket says 172.21.15.27:45958) 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 -- 172.21.15.27:0/4178484492 learned_addr learned my addr 172.21.15.27:0/4178484492 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cccc0700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25c8065aa0 0x7f25c80acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25c7fff700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25c80665f0 0x7f25c8068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 -- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25c8065aa0 msgr2=0x7f25c80acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25c8065aa0 0x7f25c80acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 -- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25c80665f0 msgr2=0x7f25c8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25c80665f0 0x7f25c8068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 -- 172.21.15.27:0/4178484492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009ae0 con 0x7f25c80bf340 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.490+0000 7f25cd4c1700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 0x7f25c80adab0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f25c806a8d0 tx=0x7f25c0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.491+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00092e0 con 0x7f25c80bf340 2023-05-17T15:29:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.491+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c001d410 con 0x7f25c80bf340 2023-05-17T15:29:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.491+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c001d7b0 con 0x7f25c80bf340 2023-05-17T15:29:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.491+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c8069c00 con 0x7f25c80bf340 2023-05-17T15:29:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.491+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c8164ce0 con 0x7f25c80bf340 2023-05-17T15:29:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.492+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c806bdf0 con 0x7f25c80bf340 2023-05-17T15:29:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.492+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f25c001b040 con 0x7f25c80bf340 2023-05-17T15:29:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.492+0000 7f25c4ff9700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 0x7f25ac061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.492+0000 7f25cccc0700 1 -- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 msgr2=0x7f25ac061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.492+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f25c007b840 con 0x7f25c80bf340 2023-05-17T15:29:05.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.492+0000 7f25cccc0700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 0x7f25ac061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:05.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.497+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f25c004cb80 con 0x7f25c80bf340 2023-05-17T15:29:05.597 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:05.592+0000 7f5017a14680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:29:05.649 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:05.646+0000 7fd1b02ba680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:29:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.693+0000 7f25cccc0700 1 -- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 msgr2=0x7f25ac061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.693+0000 7f25cccc0700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 0x7f25ac061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:05.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.714+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25c80a81d0 con 0x7f25c80bf340 2023-05-17T15:29:05.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.714+0000 7f25c4ff9700 1 -- 172.21.15.27:0/4178484492 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f25c00501a0 con 0x7f25c80bf340 2023-05-17T15:29:05.718 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:05.719 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":67,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:27:39.410260+0000","modified":"2023-05-17T15:27:42.418264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6833/3042009108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3042009108},{"type":"v1","addr":"172.21.15.40:6833","nonce":3042009108}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-17T15:29:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.716+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 msgr2=0x7f25ac061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.716+0000 7f25cef24700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 0x7f25ac061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.716+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 msgr2=0x7f25c80adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.716+0000 7f25cef24700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 0x7f25c80adab0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f25c806a8d0 tx=0x7f25c0009840).stop 2023-05-17T15:29:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 shutdown_connections 2023-05-17T15:29:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f25ac05eeb0 0x7f25ac061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:05.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25c80bf340 0x7f25c80adab0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25c8065aa0 0x7f25c80acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 --2- 172.21.15.27:0/4178484492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25c80665f0 0x7f25c8068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 >> 172.21.15.27:0/4178484492 conn(0x7f25c80c94a0 msgr2=0x7f25c8063d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 shutdown_connections 2023-05-17T15:29:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.717+0000 7f25cef24700 1 -- 172.21.15.27:0/4178484492 wait complete. 2023-05-17T15:29:05.722 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 67 2023-05-17T15:29:05.733 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:05.786 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:05.782+0000 7f5017a14680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:05.846 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:05.842+0000 7fd1b02ba680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.851+0000 7f7f93fff700 1 Processor -- start 2023-05-17T15:29:05.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.851+0000 7f7f93fff700 1 -- start start 2023-05-17T15:29:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f93fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7f941544f0 0x7f7f940a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f93fff700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f941549b0 con 0x7f7f940c1180 2023-05-17T15:29:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f93fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f94154c90 con 0x7f7f940aa070 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f93fff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f94154f70 con 0x7f7f941544f0 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f927fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7f941544f0 0x7f7f940a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f92ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7f940c1180 0x7f7f940c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45526/0 (socket says 172.21.15.27:45526) 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f92ffd700 1 -- 172.21.15.27:0/2690122873 learned_addr learned my addr 172.21.15.27:0/2690122873 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f927fc700 1 -- 172.21.15.27:0/2690122873 >> v1:172.21.15.40:6789/0 conn(0x7f7f940aa070 legacy=0x7f7f940c74a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f927fc700 1 -- 172.21.15.27:0/2690122873 >> v1:172.21.15.27:6789/0 conn(0x7f7f940c1180 legacy=0x7f7f940c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f927fc700 1 -- 172.21.15.27:0/2690122873 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94155250 con 0x7f7f941544f0 2023-05-17T15:29:05.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f91ffb700 1 -- 172.21.15.27:0/2690122873 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165254403 0 0) 0x7f7f941549b0 con 0x7f7f940c1180 2023-05-17T15:29:05.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f927fc700 1 --2- 172.21.15.27:0/2690122873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f941544f0 0x7f7f940a9b80 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f7f84009760 tx=0x7f7f84009060).ready entity=mon.0 client_cookie=22c2292867300483 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:05.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.852+0000 7f7f91ffb700 1 -- 172.21.15.27:0/2690122873 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840090d0 con 0x7f7f941544f0 2023-05-17T15:29:05.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f91ffb700 1 -- 172.21.15.27:0/2690122873 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8400b520 con 0x7f7f941544f0 2023-05-17T15:29:05.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f91ffb700 1 -- 172.21.15.27:0/2690122873 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400b8a0 con 0x7f7f941544f0 2023-05-17T15:29:05.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 -- 172.21.15.27:0/2690122873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f941544f0 msgr2=0x7f7f940a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 --2- 172.21.15.27:0/2690122873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f941544f0 0x7f7f940a9b80 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f7f84009760 tx=0x7f7f84009060).stop 2023-05-17T15:29:05.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 -- 172.21.15.27:0/2690122873 shutdown_connections 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 --2- 172.21.15.27:0/2690122873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f941544f0 0x7f7f940a9b80 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 -- 172.21.15.27:0/2690122873 >> 172.21.15.27:0/2690122873 conn(0x7f7f9405dd50 msgr2=0x7f7f9405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 -- 172.21.15.27:0/2690122873 shutdown_connections 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.853+0000 7f7f93fff700 1 -- 172.21.15.27:0/2690122873 wait complete. 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.854+0000 7f7f93fff700 1 Processor -- start 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.854+0000 7f7f93fff700 1 -- start start 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f940aa070 0x7f7f940c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 0x7f7f940c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f941544f0 0x7f7f941676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f93fff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c2d50 con 0x7f7f940c1180 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f93fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c4890 con 0x7f7f941544f0 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f93fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c20d0 con 0x7f7f940aa070 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f927fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 0x7f7f940c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f927fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 0x7f7f940c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45972/0 (socket says 172.21.15.27:45972) 2023-05-17T15:29:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f927fc700 1 -- 172.21.15.27:0/3476601963 learned_addr learned my addr 172.21.15.27:0/3476601963 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f92ffd700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f940aa070 0x7f7f940c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.855+0000 7f7f937fe700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f941544f0 0x7f7f941676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f927fc700 1 -- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f940aa070 msgr2=0x7f7f940c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f927fc700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f940aa070 0x7f7f940c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f927fc700 1 -- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f941544f0 msgr2=0x7f7f941676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f927fc700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f941544f0 0x7f7f941676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f927fc700 1 -- 172.21.15.27:0/3476601963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840092a0 con 0x7f7f940c1180 2023-05-17T15:29:05.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f927fc700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 0x7f7f940c43a0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f7f84009eb0 tx=0x7f7f84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:05.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840119d0 con 0x7f7f940c1180 2023-05-17T15:29:05.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84011b30 con 0x7f7f940c1180 2023-05-17T15:29:05.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f940c23b0 con 0x7f7f940c1180 2023-05-17T15:29:05.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8401b410 con 0x7f7f940c1180 2023-05-17T15:29:05.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.856+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f940c2970 con 0x7f7f940c1180 2023-05-17T15:29:05.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.857+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f940c2e90 con 0x7f7f940c1180 2023-05-17T15:29:05.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.857+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f7f8400f070 con 0x7f7f940c1180 2023-05-17T15:29:05.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.858+0000 7f7f7affd700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7f8005eeb0 0x7f7f80061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:05.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.858+0000 7f7f92ffd700 1 -- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7f8005eeb0 msgr2=0x7f7f80061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:05.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.858+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f7f8407b4d0 con 0x7f7f940c1180 2023-05-17T15:29:05.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.858+0000 7f7f92ffd700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7f8005eeb0 0x7f7f80061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:05.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:05.862+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f940c2e90 con 0x7f7f940c1180 2023-05-17T15:29:06.045 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.042+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f940c2e90 con 0x7f7f940c1180 2023-05-17T15:29:06.046 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.042+0000 7f7f7affd700 1 -- 172.21.15.27:0/3476601963 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+17680 (secure 0 0 0) 0x7f7f940c2e90 con 0x7f7f940c1180 2023-05-17T15:29:06.047 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:06.047 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":164,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:05.055273+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:27:37.958967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-17T15:27:38.376205+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.25","mappings":[{"from":2,"to":0}]},{"pgid":"19.3c","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/339210960":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/2332544695":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/2037319850":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/1858055009":"2023-05-18T15:27:51.850935+0000","172.21.15.27:6837/122387":"2023-05-18T15:27:51.850935+0000","172.21.15.27:6836/122387":"2023-05-18T15:27:51.850935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:06.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7f8005eeb0 msgr2=0x7f7f80061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7f8005eeb0 0x7f7f80061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 msgr2=0x7f7f940c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 0x7f7f940c43a0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f7f84009eb0 tx=0x7f7f84017000).stop 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 shutdown_connections 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7f8005eeb0 0x7f7f80061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f941544f0 0x7f7f941676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f940aa070 0x7f7f940c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 --2- 172.21.15.27:0/3476601963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f940c1180 0x7f7f940c43a0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 >> 172.21.15.27:0/3476601963 conn(0x7f7f9405dd50 msgr2=0x7f7f940ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:06.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 shutdown_connections 2023-05-17T15:29:06.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.044+0000 7f7f93fff700 1 -- 172.21.15.27:0/3476601963 wait complete. 2023-05-17T15:29:06.061 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:29:06.061 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:06.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.175+0000 7f371918a700 1 Processor -- start 2023-05-17T15:29:06.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.175+0000 7f371918a700 1 -- start start 2023-05-17T15:29:06.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371918a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37140c4620 0x7f3714065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371918a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3714069000 con 0x7f3714155410 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371918a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3714067f60 con 0x7f3714065550 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371918a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3714066850 con 0x7f37140c4620 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371259c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3714155410 0x7f3714153a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45554/0 (socket says 172.21.15.27:45554) 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371259c700 1 -- 172.21.15.27:0/3550928811 learned_addr learned my addr 172.21.15.27:0/3550928811 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371359e700 1 --2- 172.21.15.27:0/3550928811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37140c4620 0x7f3714065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526781328 0 0) 0x7f3714069000 con 0x7f3714155410 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc0033f0 con 0x7f3714155410 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974819142 0 0) 0x7f3714067f60 con 0x7f3714065550 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3714069000 con 0x7f3714065550 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2336606927 0 0) 0x7f36fc0033f0 con 0x7f3714155410 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371359e700 1 -- 172.21.15.27:0/3550928811 >> v1:172.21.15.40:6789/0 conn(0x7f3714065550 legacy=0x7f3714066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371359e700 1 -- 172.21.15.27:0/3550928811 >> v1:172.21.15.27:6789/0 conn(0x7f3714155410 legacy=0x7f3714153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.176+0000 7f371359e700 1 -- 172.21.15.27:0/3550928811 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714068240 con 0x7f37140c4620 2023-05-17T15:29:06.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371359e700 1 --2- 172.21.15.27:0/3550928811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37140c4620 0x7f3714065930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f370c009e90 tx=0x7f370c009780).ready entity=mon.2 client_cookie=7b92513897dd6c7a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:06.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c00e070 con 0x7f37140c4620 2023-05-17T15:29:06.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c00b7a0 con 0x7f37140c4620 2023-05-17T15:29:06.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f3711d9b700 1 -- 172.21.15.27:0/3550928811 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708001470 con 0x7f37140c4620 2023-05-17T15:29:06.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 -- 172.21.15.27:0/3550928811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37140c4620 msgr2=0x7f3714065930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 --2- 172.21.15.27:0/3550928811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37140c4620 0x7f3714065930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f370c009e90 tx=0x7f370c009780).stop 2023-05-17T15:29:06.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 -- 172.21.15.27:0/3550928811 shutdown_connections 2023-05-17T15:29:06.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 --2- 172.21.15.27:0/3550928811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37140c4620 0x7f3714065930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 -- 172.21.15.27:0/3550928811 >> 172.21.15.27:0/3550928811 conn(0x7f37140c94a0 msgr2=0x7f37140c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 -- 172.21.15.27:0/3550928811 shutdown_connections 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.177+0000 7f371918a700 1 -- 172.21.15.27:0/3550928811 wait complete. 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.178+0000 7f371918a700 1 Processor -- start 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 -- start start 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3714065550 0x7f37140a8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140c4620 0x7f371414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 0x7f37140a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140ad6a0 con 0x7f3714155410 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140a95c0 con 0x7f37140c4620 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371918a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37140ad050 con 0x7f3714065550 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 0x7f37140a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 0x7f37140a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46002/0 (socket says 172.21.15.27:46002) 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371359e700 1 -- 172.21.15.27:0/2229182512 learned_addr learned my addr 172.21.15.27:0/2229182512 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f371259c700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140c4620 0x7f371414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.179+0000 7f3712d9d700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3714065550 0x7f37140a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371359e700 1 -- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3714065550 msgr2=0x7f37140a8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371359e700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3714065550 0x7f37140a8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371359e700 1 -- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140c4620 msgr2=0x7f371414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371359e700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140c4620 0x7f371414cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371359e700 1 -- 172.21.15.27:0/2229182512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c009a20 con 0x7f3714155410 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371259c700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140c4620 0x7f371414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371359e700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 0x7f37140a8d70 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f3714067a70 tx=0x7f370c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:06.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c012e10 con 0x7f3714155410 2023-05-17T15:29:06.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c01e440 con 0x7f3714155410 2023-05-17T15:29:06.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c01e7e0 con 0x7f3714155410 2023-05-17T15:29:06.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140ad330 con 0x7f3714155410 2023-05-17T15:29:06.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.180+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371414d0e0 con 0x7f3714155410 2023-05-17T15:29:06.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.181+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371406bdf0 con 0x7f3714155410 2023-05-17T15:29:06.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.181+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f370c025030 con 0x7f3714155410 2023-05-17T15:29:06.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.182+0000 7f36faffd700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 0x7f3700061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.182+0000 7f3712d9d700 1 -- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 msgr2=0x7f3700061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:06.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.182+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f370c07b6d0 con 0x7f3714155410 2023-05-17T15:29:06.190 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.182+0000 7f3712d9d700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 0x7f3700061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:06.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.186+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f370c04ca10 con 0x7f3714155410 2023-05-17T15:29:06.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.383+0000 7f3712d9d700 1 -- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 msgr2=0x7f3700061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:06.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.383+0000 7f3712d9d700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 0x7f3700061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:06.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.401+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37140ad4c0 con 0x7f3714155410 2023-05-17T15:29:06.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.402+0000 7f36faffd700 1 -- 172.21.15.27:0/2229182512 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f370c023020 con 0x7f3714155410 2023-05-17T15:29:06.406 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:06.406 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":67,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:27:39.410260+0000","modified":"2023-05-17T15:27:42.418264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6833/3042009108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3042009108},{"type":"v1","addr":"172.21.15.40:6833","nonce":3042009108}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-17T15:29:06.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 msgr2=0x7f3700061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:06.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 0x7f3700061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:06.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 msgr2=0x7f37140a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 0x7f37140a8d70 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f3714067a70 tx=0x7f370c009780).stop 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 shutdown_connections 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f370005eeb0 0x7f3700061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3714155410 0x7f37140a8d70 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3714065550 0x7f37140a8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 --2- 172.21.15.27:0/2229182512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140c4620 0x7f371414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 >> 172.21.15.27:0/2229182512 conn(0x7f37140c94a0 msgr2=0x7f37140bee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 shutdown_connections 2023-05-17T15:29:06.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.404+0000 7f371918a700 1 -- 172.21.15.27:0/2229182512 wait complete. 2023-05-17T15:29:06.410 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 67 2023-05-17T15:29:06.421 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:06.470 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:06.465+0000 7f5017a14680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:29:06.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.536+0000 7fbaa1685700 1 Processor -- start 2023-05-17T15:29:06.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.536+0000 7fbaa1685700 1 -- start start 2023-05-17T15:29:06.541 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:06.536+0000 7f5017a14680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:29:06.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fbaa1685700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba9c154c40 0x7fba9c0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fbaa1685700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba9c155730 0x7fba9c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fbaa1685700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c0c3190 con 0x7fba9c0bdc90 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fbaa1685700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c0c1cd0 con 0x7fba9c155730 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fbaa1685700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c063d10 con 0x7fba9c154c40 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fba9b7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba9c155730 0x7fba9c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fba9a7fc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fba9c0bdc90 0x7fba9c155020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45570/0 (socket says 172.21.15.27:45570) 2023-05-17T15:29:06.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.537+0000 7fba9a7fc700 1 -- 172.21.15.27:0/1054934978 learned_addr learned my addr 172.21.15.27:0/1054934978 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba9affd700 1 --2- 172.21.15.27:0/1054934978 >> v2:172.21.15.40:3300/0 conn(0x7fba9c154c40 0x7fba9c0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba9b7fe700 1 -- 172.21.15.27:0/1054934978 >> v2:172.21.15.40:3300/0 conn(0x7fba9c154c40 msgr2=0x7fba9c0aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba9b7fe700 1 --2- 172.21.15.27:0/1054934978 >> v2:172.21.15.40:3300/0 conn(0x7fba9c154c40 0x7fba9c0aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba9b7fe700 1 -- 172.21.15.27:0/1054934978 >> v1:172.21.15.27:6789/0 conn(0x7fba9c0bdc90 legacy=0x7fba9c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba99ffb700 1 -- 172.21.15.27:0/1054934978 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415176433 0 0) 0x7fba9c0c3190 con 0x7fba9c0bdc90 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba9b7fe700 1 -- 172.21.15.27:0/1054934978 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0c19f0 con 0x7fba9c155730 2023-05-17T15:29:06.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba9b7fe700 1 --2- 172.21.15.27:0/1054934978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c155730 0x7fba9c1508f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fba9c0c4ea0 tx=0x7fba94009780).ready entity=mon.0 client_cookie=458d50a96b215b70 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba99ffb700 1 -- 172.21.15.27:0/1054934978 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400de40 con 0x7fba9c155730 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba99ffb700 1 -- 172.21.15.27:0/1054934978 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94011480 con 0x7fba9c155730 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.538+0000 7fba99ffb700 1 -- 172.21.15.27:0/1054934978 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011800 con 0x7fba9c155730 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 -- 172.21.15.27:0/1054934978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c155730 msgr2=0x7fba9c1508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 --2- 172.21.15.27:0/1054934978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c155730 0x7fba9c1508f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fba9c0c4ea0 tx=0x7fba94009780).stop 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 -- 172.21.15.27:0/1054934978 shutdown_connections 2023-05-17T15:29:06.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 --2- 172.21.15.27:0/1054934978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c155730 0x7fba9c1508f0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 --2- 172.21.15.27:0/1054934978 >> v2:172.21.15.40:3300/0 conn(0x7fba9c154c40 0x7fba9c0aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 -- 172.21.15.27:0/1054934978 >> 172.21.15.27:0/1054934978 conn(0x7fba9c068750 msgr2=0x7fba9c0c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:06.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 -- 172.21.15.27:0/1054934978 shutdown_connections 2023-05-17T15:29:06.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.539+0000 7fbaa1685700 1 -- 172.21.15.27:0/1054934978 wait complete. 2023-05-17T15:29:06.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.540+0000 7fbaa1685700 1 Processor -- start 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.540+0000 7fbaa1685700 1 -- start start 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fbaa1685700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0bdc90 0x7fba9c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fbaa1685700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 0x7fba9c13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fbaa1685700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c155730 0x7fba9c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fbaa1685700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c14f0e0 con 0x7fba9c154c40 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fbaa1685700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1480e0 con 0x7fba9c155730 2023-05-17T15:29:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fbaa1685700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c13db10 con 0x7fba9c0bdc90 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 0x7fba9c13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 0x7fba9c13d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46016/0 (socket says 172.21.15.27:46016) 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 -- 172.21.15.27:0/3558945276 learned_addr learned my addr 172.21.15.27:0/3558945276 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9affd700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0bdc90 0x7fba9c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9b7fe700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c155730 0x7fba9c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 -- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0bdc90 msgr2=0x7fba9c147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0bdc90 0x7fba9c147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 -- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c155730 msgr2=0x7fba9c14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c155730 0x7fba9c14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 -- 172.21.15.27:0/3558945276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba94009a20 con 0x7fba9c154c40 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba9a7fc700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 0x7fba9c13d620 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fba8c00c4a0 tx=0x7fba8c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00ce50 con 0x7fba9c154c40 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.541+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c0072e0 con 0x7fba9c154c40 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.542+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c14e4d0 con 0x7fba9c154c40 2023-05-17T15:29:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.542+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c007660 con 0x7fba9c154c40 2023-05-17T15:29:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.542+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c14ea90 con 0x7fba9c154c40 2023-05-17T15:29:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.542+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c06bdf0 con 0x7fba9c154c40 2023-05-17T15:29:06.551 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:06.543+0000 7fd1b02ba680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:29:06.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.544+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fba8c010070 con 0x7fba9c154c40 2023-05-17T15:29:06.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.544+0000 7fba92ffd700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 0x7fba7c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.544+0000 7fba9affd700 1 -- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 msgr2=0x7fba7c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:06.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.544+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7fba8c0799e0 con 0x7fba9c154c40 2023-05-17T15:29:06.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.544+0000 7fba9affd700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 0x7fba7c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:06.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.547+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba8c04ada0 con 0x7fba9c154c40 2023-05-17T15:29:06.618 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:06.613+0000 7f5017a14680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:29:06.619 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:06.616+0000 7fd1b02ba680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:29:06.698 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:06.694+0000 7fd1b02ba680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:29:06.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.745+0000 7fba9affd700 1 -- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 msgr2=0x7fba7c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:06.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.745+0000 7fba9affd700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 0x7fba7c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.764+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba9c062860 con 0x7fba9c154c40 2023-05-17T15:29:06.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.765+0000 7fba92ffd700 1 -- 172.21.15.27:0/3558945276 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fba8c04e3c0 con 0x7fba9c154c40 2023-05-17T15:29:06.769 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:06.769 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":67,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:27:39.410260+0000","modified":"2023-05-17T15:27:42.418264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6833/3042009108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3042009108},{"type":"v1","addr":"172.21.15.40:6833","nonce":3042009108}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-17T15:29:06.769 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:06.764+0000 7f5017a14680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:29:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 msgr2=0x7fba7c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 0x7fba7c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 msgr2=0x7fba9c13d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 0x7fba9c13d620 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fba8c00c4a0 tx=0x7fba8c007c30).stop 2023-05-17T15:29:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 shutdown_connections 2023-05-17T15:29:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba7c05eeb0 0x7fba7c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9c155730 0x7fba9c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba9c0bdc90 0x7fba9c147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 --2- 172.21.15.27:0/3558945276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba9c154c40 0x7fba9c13d620 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 >> 172.21.15.27:0/3558945276 conn(0x7fba9c068750 msgr2=0x7fba9c0c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 shutdown_connections 2023-05-17T15:29:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.767+0000 7fbaa1685700 1 -- 172.21.15.27:0/3558945276 wait complete. 2023-05-17T15:29:06.773 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 67 2023-05-17T15:29:06.783 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:06.841 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:06.837+0000 7f5017a14680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:29:06.855 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:06.851+0000 7fd1b02ba680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:29:06.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.896+0000 7fdb875d7700 1 Processor -- start 2023-05-17T15:29:06.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.896+0000 7fdb875d7700 1 -- start start 2023-05-17T15:29:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb875d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80153f80 0x7fdb80154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb875d7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb800bd120 0x7fdb800c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb875d7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800bd5a0 con 0x7fdb80066350 2023-05-17T15:29:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb875d7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800c2430 con 0x7fdb800bd120 2023-05-17T15:29:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb875d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800c36c0 con 0x7fdb80153f80 2023-05-17T15:29:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb84b72700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb800bd120 0x7fdb800c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb84b72700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb800bd120 0x7fdb800c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46024/0 (socket says 172.21.15.27:46024) 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.897+0000 7fdb84b72700 1 -- 172.21.15.27:0/2091726372 learned_addr learned my addr 172.21.15.27:0/2091726372 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb85373700 1 --2- 172.21.15.27:0/2091726372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80153f80 0x7fdb80154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb84b72700 1 -- 172.21.15.27:0/2091726372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80153f80 msgr2=0x7fdb80154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb84b72700 1 --2- 172.21.15.27:0/2091726372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80153f80 0x7fdb80154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb84b72700 1 -- 172.21.15.27:0/2091726372 >> v1:172.21.15.40:6789/0 conn(0x7fdb80066350 legacy=0x7fdb80157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb84b72700 1 -- 172.21.15.27:0/2091726372 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800c3230 con 0x7fdb800bd120 2023-05-17T15:29:06.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb84b72700 1 --2- 172.21.15.27:0/2091726372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb800bd120 0x7fdb800c1f40 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fdb7c009830 tx=0x7fdb7c0090f0).ready entity=mon.0 client_cookie=6a55320bd53e0f23 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:06.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb77fff700 1 -- 172.21.15.27:0/2091726372 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00b580 con 0x7fdb800bd120 2023-05-17T15:29:06.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb77fff700 1 -- 172.21.15.27:0/2091726372 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c00b6e0 con 0x7fdb800bd120 2023-05-17T15:29:06.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.898+0000 7fdb77fff700 1 -- 172.21.15.27:0/2091726372 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00ba60 con 0x7fdb800bd120 2023-05-17T15:29:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 -- 172.21.15.27:0/2091726372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb800bd120 msgr2=0x7fdb800c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 --2- 172.21.15.27:0/2091726372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb800bd120 0x7fdb800c1f40 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fdb7c009830 tx=0x7fdb7c0090f0).stop 2023-05-17T15:29:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 -- 172.21.15.27:0/2091726372 shutdown_connections 2023-05-17T15:29:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 --2- 172.21.15.27:0/2091726372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80153f80 0x7fdb80154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 --2- 172.21.15.27:0/2091726372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb800bd120 0x7fdb800c1f40 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 -- 172.21.15.27:0/2091726372 >> 172.21.15.27:0/2091726372 conn(0x7fdb80068750 msgr2=0x7fdb800c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 -- 172.21.15.27:0/2091726372 shutdown_connections 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.899+0000 7fdb875d7700 1 -- 172.21.15.27:0/2091726372 wait complete. 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.900+0000 7fdb875d7700 1 Processor -- start 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.900+0000 7fdb875d7700 1 -- start start 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb875d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80066350 0x7fdb801643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb875d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb800bd120 0x7fdb801515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb875d7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb80153f80 0x7fdb80151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.907 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb875d7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800bfa10 con 0x7fdb80153f80 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb875d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80151f80 con 0x7fdb800bd120 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb875d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800a5150 con 0x7fdb80066350 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85b74700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb80153f80 0x7fdb80151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80066350 0x7fdb801643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85b74700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb80153f80 0x7fdb80151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46032/0 (socket says 172.21.15.27:46032) 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85b74700 1 -- 172.21.15.27:0/1509368996 learned_addr learned my addr 172.21.15.27:0/1509368996 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:06.908 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb84b72700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb800bd120 0x7fdb801515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 -- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb800bd120 msgr2=0x7fdb801515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb800bd120 0x7fdb801515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 -- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb80153f80 msgr2=0x7fdb80151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb80153f80 0x7fdb80151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 -- 172.21.15.27:0/1509368996 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c009370 con 0x7fdb80066350 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.901+0000 7fdb85373700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80066350 0x7fdb801643d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fdb7000e6f0 tx=0x7fdb70009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.902+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70012600 con 0x7fdb80066350 2023-05-17T15:29:06.909 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.902+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70012760 con 0x7fdb80066350 2023-05-17T15:29:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.902+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb80164a20 con 0x7fdb80066350 2023-05-17T15:29:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.902+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70012ae0 con 0x7fdb80066350 2023-05-17T15:29:06.910 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.902+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb80164fe0 con 0x7fdb80066350 2023-05-17T15:29:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.903+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8006bdf0 con 0x7fdb80066350 2023-05-17T15:29:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.903+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fdb70022070 con 0x7fdb80066350 2023-05-17T15:29:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.903+0000 7fdb757fa700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb6405eeb0 0x7fdb64061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.903+0000 7fdb84b72700 1 -- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb6405eeb0 msgr2=0x7fdb64061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.903+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7fdb70079ef0 con 0x7fdb80066350 2023-05-17T15:29:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.903+0000 7fdb84b72700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb6405eeb0 0x7fdb64061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:06.916 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:06.912+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb7004b230 con 0x7fdb80066350 2023-05-17T15:29:06.931 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:06.927+0000 7fd1b02ba680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:29:06.965 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:06.961+0000 7f5017a14680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:29:07.055 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:07.051+0000 7fd1b02ba680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:29:07.080 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:07.077+0000 7f5017a14680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:07.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.090+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb800644e0 con 0x7fdb80066350 2023-05-17T15:29:07.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.092+0000 7fdb757fa700 1 -- 172.21.15.27:0/1509368996 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+17680 (secure 0 0 0) 0x7fdb7004e850 con 0x7fdb80066350 2023-05-17T15:29:07.096 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:07.096 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":164,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:05.055273+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:27:37.958967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-17T15:27:38.376205+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.25","mappings":[{"from":2,"to":0}]},{"pgid":"19.3c","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/339210960":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/2332544695":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/2037319850":"2023-05-18T15:27:51.850935+0000","172.21.15.27:0/1858055009":"2023-05-18T15:27:51.850935+0000","172.21.15.27:6837/122387":"2023-05-18T15:27:51.850935+0000","172.21.15.27:6836/122387":"2023-05-18T15:27:51.850935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:07.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb6405eeb0 msgr2=0x7fdb64061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:07.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb6405eeb0 0x7fdb64061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:07.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80066350 msgr2=0x7fdb801643d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:07.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80066350 0x7fdb801643d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fdb7000e6f0 tx=0x7fdb70009060).stop 2023-05-17T15:29:07.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 shutdown_connections 2023-05-17T15:29:07.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb6405eeb0 0x7fdb64061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb80153f80 0x7fdb80151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb80066350 0x7fdb801643d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 --2- 172.21.15.27:0/1509368996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb800bd120 0x7fdb801515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 >> 172.21.15.27:0/1509368996 conn(0x7fdb80068750 msgr2=0x7fdb80150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 shutdown_connections 2023-05-17T15:29:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.094+0000 7fdb875d7700 1 -- 172.21.15.27:0/1509368996 wait complete. 2023-05-17T15:29:07.110 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:29:07.172 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:07.169+0000 7fd1b02ba680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.225+0000 7f63c9acf700 1 Processor -- start 2023-05-17T15:29:07.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.225+0000 7f63c9acf700 1 -- start start 2023-05-17T15:29:07.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.226+0000 7f63c9acf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c41542f0 0x7f63c4066360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:07.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.226+0000 7f63c9acf700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c4065350 con 0x7f63c4153f10 2023-05-17T15:29:07.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.226+0000 7f63c9acf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c4065ed0 con 0x7f63c4157c80 2023-05-17T15:29:07.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.226+0000 7f63c9acf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40655a0 con 0x7f63c41542f0 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.226+0000 7f63c37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f63c4153f10 0x7f63c40c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45598/0 (socket says 172.21.15.27:45598) 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.226+0000 7f63c37fe700 1 -- 172.21.15.27:0/951059408 learned_addr learned my addr 172.21.15.27:0/951059408 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63baffd700 1 --2- 172.21.15.27:0/951059408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c41542f0 0x7f63c4066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071670035 0 0) 0x7f63c4065350 con 0x7f63c4153f10 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b00033f0 con 0x7f63c4153f10 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290749163 0 0) 0x7f63c4065ed0 con 0x7f63c4157c80 2023-05-17T15:29:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c4065350 con 0x7f63c4157c80 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63baffd700 1 -- 172.21.15.27:0/951059408 >> v1:172.21.15.40:6789/0 conn(0x7f63c4157c80 legacy=0x7f63c40bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63baffd700 1 -- 172.21.15.27:0/951059408 >> v1:172.21.15.27:6789/0 conn(0x7f63c4153f10 legacy=0x7f63c40c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63baffd700 1 -- 172.21.15.27:0/951059408 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4065880 con 0x7f63c41542f0 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63baffd700 1 --2- 172.21.15.27:0/951059408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c41542f0 0x7f63c4066360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f63ac009790 tx=0x7f63ac009060).ready entity=mon.2 client_cookie=9c7c23e6c24401d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00f510 con 0x7f63c41542f0 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac00f670 con 0x7f63c41542f0 2023-05-17T15:29:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.227+0000 7f63c2ffd700 1 -- 172.21.15.27:0/951059408 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00f9f0 con 0x7f63c41542f0 2023-05-17T15:29:07.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 -- 172.21.15.27:0/951059408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c41542f0 msgr2=0x7f63c4066360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:07.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 --2- 172.21.15.27:0/951059408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c41542f0 0x7f63c4066360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f63ac009790 tx=0x7f63ac009060).stop 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 -- 172.21.15.27:0/951059408 shutdown_connections 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 --2- 172.21.15.27:0/951059408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c41542f0 0x7f63c4066360 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 -- 172.21.15.27:0/951059408 >> 172.21.15.27:0/951059408 conn(0x7f63c40c94b0 msgr2=0x7f63c40c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 -- 172.21.15.27:0/951059408 shutdown_connections 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.228+0000 7f63c9acf700 1 -- 172.21.15.27:0/951059408 wait complete. 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.229+0000 7f63c9acf700 1 Processor -- start 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.229+0000 7f63c9acf700 1 -- start start 2023-05-17T15:29:07.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c9acf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 0x7f63c4150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c9acf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63c41542f0 0x7f63c40c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c9acf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c4157c80 0x7f63c40c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c9acf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40c71a0 con 0x7f63c4153f10 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c9acf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4165800 con 0x7f63c41542f0 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c9acf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4164950 con 0x7f63c4157c80 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 0x7f63c4150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 0x7f63c4150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46042/0 (socket says 172.21.15.27:46042) 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 -- 172.21.15.27:0/1782375036 learned_addr learned my addr 172.21.15.27:0/1782375036 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63baffd700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63c41542f0 0x7f63c40c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c3fff700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c4157c80 0x7f63c40c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c4157c80 msgr2=0x7f63c40c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c4157c80 0x7f63c40c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63c41542f0 msgr2=0x7f63c40c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.230+0000 7f63c37fe700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63c41542f0 0x7f63c40c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:07.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63c37fe700 1 -- 172.21.15.27:0/1782375036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0092a0 con 0x7f63c4153f10 2023-05-17T15:29:07.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63c37fe700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 0x7f63c4150050 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f63b400c490 tx=0x7f63b4007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:07.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b40070d0 con 0x7f63c4153f10 2023-05-17T15:29:07.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b4007230 con 0x7f63c4153f10 2023-05-17T15:29:07.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c4150540 con 0x7f63c4153f10 2023-05-17T15:29:07.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b40075b0 con 0x7f63c4153f10 2023-05-17T15:29:07.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.231+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c4164ed0 con 0x7f63c4153f10 2023-05-17T15:29:07.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.232+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f63b401a060 con 0x7f63c4153f10 2023-05-17T15:29:07.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.232+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4151ac0 con 0x7f63c4153f10 2023-05-17T15:29:07.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.233+0000 7f63bbfff700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 0x7f63a4061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:07.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.233+0000 7f63baffd700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 msgr2=0x7f63a4061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:07.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.233+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f63b4079450 con 0x7f63c4153f10 2023-05-17T15:29:07.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.233+0000 7f63baffd700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 0x7f63a4061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:07.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.237+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63b404a790 con 0x7f63c4153f10 2023-05-17T15:29:07.381 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:07.377+0000 7f5017a14680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:29:07.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.434+0000 7f63baffd700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 msgr2=0x7f63a4061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:07.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.434+0000 7f63baffd700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 0x7f63a4061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:07.455 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:07.452+0000 7f5017a14680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:29:07.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.458+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f63c4069ca0 con 0x7f63c4153f10 2023-05-17T15:29:07.478 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:07.475+0000 7fd1b02ba680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:29:07.553 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:07.549+0000 7fd1b02ba680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:29:07.571 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-05-17T15:29:07.568+0000 7f8b7c065700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:07.571 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-05-17T15:29:07.568+0000 7f8b7c065700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:07.572 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-05-17T15:29:07.568+0000 7f8b7c065700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:29:07.586 INFO:tasks.ceph.mds.b.smithi040.stderr: -6> 2023-05-17T15:29:07.568+0000 7f8b7c065700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:07.586 INFO:tasks.ceph.mds.b.smithi040.stderr: -4> 2023-05-17T15:29:07.568+0000 7f8b7c065700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:07.587 INFO:tasks.ceph.mds.b.smithi040.stderr: -2> 2023-05-17T15:29:07.568+0000 7f8b7c065700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:29:07.605 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:29:07.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.835+0000 7f63baffd700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 msgr2=0x7f63a4061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:07.839 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:07.835+0000 7f63baffd700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 0x7f63a4061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:29:08.067 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:29:08.063+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:29:08.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.066+0000 7f63bbfff700 1 -- 172.21.15.27:0/1782375036 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7f63b4018020 con 0x7f63c4153f10 2023-05-17T15:29:08.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 msgr2=0x7f63a4061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:08.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 0x7f63a4061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:08.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 msgr2=0x7f63c4150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 0x7f63c4150050 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f63b400c490 tx=0x7f63b4007d20).stop 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 shutdown_connections 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f63a405ee80 0x7f63a4061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63c4157c80 0x7f63c40c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63c4153f10 0x7f63c4150050 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 --2- 172.21.15.27:0/1782375036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63c41542f0 0x7f63c40c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 >> 172.21.15.27:0/1782375036 conn(0x7f63c40c94b0 msgr2=0x7f63c40c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:08.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 shutdown_connections 2023-05-17T15:29:08.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.068+0000 7f63c9acf700 1 -- 172.21.15.27:0/1782375036 wait complete. 2023-05-17T15:29:08.074 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:29:08.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:29:08.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.202+0000 7fc44d266700 1 Processor -- start 2023-05-17T15:29:08.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.202+0000 7fc44d266700 1 -- start start 2023-05-17T15:29:08.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc44d266700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:08.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc44d266700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc448155590 0x7fc4480667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:08.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc44d266700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480a7730 con 0x7fc4480c7a30 2023-05-17T15:29:08.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc44d266700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc448064da0 con 0x7fc448155590 2023-05-17T15:29:08.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc44d266700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc448066ce0 con 0x7fc4481551b0 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc448155590 0x7fc4480667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc448155590 0x7fc4480667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46060/0 (socket says 172.21.15.27:46060) 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 -- 172.21.15.27:0/2408721241 learned_addr learned my addr 172.21.15.27:0/2408721241 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc447fff700 1 --2- 172.21.15.27:0/2408721241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 -- 172.21.15.27:0/2408721241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 msgr2=0x7fc448066300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 --2- 172.21.15.27:0/2408721241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448066300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 -- 172.21.15.27:0/2408721241 >> v1:172.21.15.40:6789/0 conn(0x7fc4480c7a30 legacy=0x7fc448063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 -- 172.21.15.27:0/2408721241 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480a7120 con 0x7fc448155590 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc4477fe700 1 --2- 172.21.15.27:0/2408721241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc448155590 0x7fc4480667f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fc438006fd0 tx=0x7fc4380090f0).ready entity=mon.0 client_cookie=d65c15bf95c2b439 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc446ffd700 1 -- 172.21.15.27:0/2408721241 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800b600 con 0x7fc448155590 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc446ffd700 1 -- 172.21.15.27:0/2408721241 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800b760 con 0x7fc448155590 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.203+0000 7fc446ffd700 1 -- 172.21.15.27:0/2408721241 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800bae0 con 0x7fc448155590 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 -- 172.21.15.27:0/2408721241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc448155590 msgr2=0x7fc4480667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 --2- 172.21.15.27:0/2408721241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc448155590 0x7fc4480667f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fc438006fd0 tx=0x7fc4380090f0).stop 2023-05-17T15:29:08.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 -- 172.21.15.27:0/2408721241 shutdown_connections 2023-05-17T15:29:08.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 --2- 172.21.15.27:0/2408721241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448066300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 --2- 172.21.15.27:0/2408721241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc448155590 0x7fc4480667f0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 -- 172.21.15.27:0/2408721241 >> 172.21.15.27:0/2408721241 conn(0x7fc448068780 msgr2=0x7fc4480c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:08.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 -- 172.21.15.27:0/2408721241 shutdown_connections 2023-05-17T15:29:08.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.204+0000 7fc44d266700 1 -- 172.21.15.27:0/2408721241 wait complete. 2023-05-17T15:29:08.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.205+0000 7fc44d266700 1 Processor -- start 2023-05-17T15:29:08.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.205+0000 7fc44d266700 1 -- start start 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44d266700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 0x7fc4481544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44d266700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44d266700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc448155590 0x7fc448150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44d266700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4481533f0 con 0x7fc4480c7a30 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44d266700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4481527e0 con 0x7fc448155590 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44d266700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc448152ac0 con 0x7fc4481551b0 2023-05-17T15:29:08.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 0x7fc4481544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 0x7fc4481544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46068/0 (socket says 172.21.15.27:46068) 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 -- 172.21.15.27:0/2398759244 learned_addr learned my addr 172.21.15.27:0/2398759244 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44ca65700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc448155590 0x7fc448150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc4477fe700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 -- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 msgr2=0x7fc448146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 -- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc448155590 msgr2=0x7fc448150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:08.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc448155590 0x7fc448150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc447fff700 1 -- 172.21.15.27:0/2398759244 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009370 con 0x7fc4480c7a30 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc44ca65700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc448155590 0x7fc448150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.206+0000 7fc4477fe700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.207+0000 7fc447fff700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 0x7fc4481544d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fc43c00d890 tx=0x7fc43c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.207+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0125f0 con 0x7fc4480c7a30 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.207+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c012750 con 0x7fc4480c7a30 2023-05-17T15:29:08.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.207+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc448152da0 con 0x7fc4480c7a30 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.207+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c012ad0 con 0x7fc4480c7a30 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.207+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4481549c0 con 0x7fc4480c7a30 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.208+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc448047150 con 0x7fc4480c7a30 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.208+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 75) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fc43c013480 con 0x7fc4480c7a30 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.208+0000 7fc42ffff700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 0x7fc4340613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.208+0000 7fc4477fe700 1 -- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 msgr2=0x7fc4340613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.208+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6909+0+0 (secure 0 0 0) 0x7fc43c079ea0 con 0x7fc4480c7a30 2023-05-17T15:29:08.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.208+0000 7fc4477fe700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 0x7fc4340613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:08.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.212+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc43c04b050 con 0x7fc4480c7a30 2023-05-17T15:29:08.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.409+0000 7fc4477fe700 1 -- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 msgr2=0x7fc4340613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.409+0000 7fc4477fe700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 0x7fc4340613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:08.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.429+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc4480695f0 con 0x7fc4480c7a30 2023-05-17T15:29:08.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.468+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 76) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fc43c077a10 con 0x7fc4480c7a30 2023-05-17T15:29:08.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.468+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 msgr2=0x7fc4340613a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:08.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:08.468+0000 7fc42ffff700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 0x7fc4340613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:08.517 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd132aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd132aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd132aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd132aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd132aa4700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd13029f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd13029f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.519 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd13029f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.519 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd13029f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:08.519 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:08.514+0000 7fd13029f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:09.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.081+0000 7fc42ffff700 1 -- 172.21.15.27:0/2398759244 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc43c06e860 con 0x7fc4480c7a30 2023-05-17T15:29:09.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 msgr2=0x7fc4481544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:09.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 0x7fc4481544d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fc43c00d890 tx=0x7fc43c008040).stop 2023-05-17T15:29:09.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 shutdown_connections 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc43405eee0 0x7fc4340613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc448155590 0x7fc448150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc4480c7a30 0x7fc4481544d0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 --2- 172.21.15.27:0/2398759244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4481551b0 0x7fc448146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 >> 172.21.15.27:0/2398759244 conn(0x7fc448068780 msgr2=0x7fc448063340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 shutdown_connections 2023-05-17T15:29:09.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.083+0000 7fc44d266700 1 -- 172.21.15.27:0/2398759244 wait complete. 2023-05-17T15:29:09.100 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:29:09.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.217+0000 7f949674c700 1 Processor -- start 2023-05-17T15:29:09.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.217+0000 7f949674c700 1 -- start start 2023-05-17T15:29:09.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f949674c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900c5310 0x7f94900be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:09.223 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f949674c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94900bea40 0x7f94900c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f949674c700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9490069c20 con 0x7f94900a7fa0 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f949674c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9490154570 con 0x7f94900bea40 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f949674c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900beed0 con 0x7f94900c5310 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f948ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f94900a7fa0 0x7f9490068730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45698/0 (socket says 172.21.15.27:45698) 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.218+0000 7f948ffff700 1 -- 172.21.15.27:0/3790146233 learned_addr learned my addr 172.21.15.27:0/3790146233 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3790146233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900c5310 0x7f94900be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:09.224 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f9494ce9700 1 --2- 172.21.15.27:0/3790146233 >> v2:172.21.15.40:3300/0 conn(0x7f94900bea40 0x7f94900c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948effd700 1 -- 172.21.15.27:0/3790146233 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518592537 0 0) 0x7f9490069c20 con 0x7f94900a7fa0 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948effd700 1 -- 172.21.15.27:0/3790146233 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f947c0033f0 con 0x7f94900a7fa0 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948effd700 1 -- 172.21.15.27:0/3790146233 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927046291 0 0) 0x7f947c0033f0 con 0x7f94900a7fa0 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948f7fe700 1 -- 172.21.15.27:0/3790146233 >> v2:172.21.15.40:3300/0 conn(0x7f94900bea40 msgr2=0x7f94900c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3790146233 >> v2:172.21.15.40:3300/0 conn(0x7f94900bea40 0x7f94900c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948f7fe700 1 -- 172.21.15.27:0/3790146233 >> v1:172.21.15.27:6789/0 conn(0x7f94900a7fa0 legacy=0x7f9490068730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948f7fe700 1 -- 172.21.15.27:0/3790146233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900a8380 con 0x7f94900c5310 2023-05-17T15:29:09.225 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f9494ce9700 1 --2- 172.21.15.27:0/3790146233 >> v2:172.21.15.40:3300/0 conn(0x7f94900bea40 0x7f94900c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3790146233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900c5310 0x7f94900be550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9480009760 tx=0x7f9480009060).ready entity=mon.2 client_cookie=628d43d1c68b7c64 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948effd700 1 -- 172.21.15.27:0/3790146233 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478001470 con 0x7f94900c5310 2023-05-17T15:29:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948effd700 1 -- 172.21.15.27:0/3790146233 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480011400 con 0x7f94900c5310 2023-05-17T15:29:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.219+0000 7f948effd700 1 -- 172.21.15.27:0/3790146233 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480011780 con 0x7f94900c5310 2023-05-17T15:29:09.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 -- 172.21.15.27:0/3790146233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900c5310 msgr2=0x7f94900be550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:09.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 --2- 172.21.15.27:0/3790146233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900c5310 0x7f94900be550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9480009760 tx=0x7f9480009060).stop 2023-05-17T15:29:09.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 -- 172.21.15.27:0/3790146233 shutdown_connections 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 --2- 172.21.15.27:0/3790146233 >> v2:172.21.15.40:3300/0 conn(0x7f94900bea40 0x7f94900c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 --2- 172.21.15.27:0/3790146233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900c5310 0x7f94900be550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 -- 172.21.15.27:0/3790146233 >> 172.21.15.27:0/3790146233 conn(0x7f9490092160 msgr2=0x7f9490062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 -- 172.21.15.27:0/3790146233 shutdown_connections 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.220+0000 7f949674c700 1 -- 172.21.15.27:0/3790146233 wait complete. 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.221+0000 7f949674c700 1 Processor -- start 2023-05-17T15:29:09.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.221+0000 7f949674c700 1 -- start start 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f949674c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 0x7f9490151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f949674c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900bea40 0x7f94900a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f949674c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94900a6260 0x7f9490064750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f949674c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c7430 con 0x7f94900a7fa0 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f949674c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900aa550 con 0x7f94900a6260 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f949674c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900aa830 con 0x7f94900bea40 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 0x7f9490151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:09.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 0x7f9490151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46142/0 (socket says 172.21.15.27:46142) 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 -- 172.21.15.27:0/3285296057 learned_addr learned my addr 172.21.15.27:0/3285296057 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900bea40 0x7f94900a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 -- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900bea40 msgr2=0x7f94900a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900bea40 0x7f94900a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f9494ce9700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94900a6260 0x7f9490064750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 -- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94900a6260 msgr2=0x7f9490064750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:09.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94900a6260 0x7f9490064750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 -- 172.21.15.27:0/3285296057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009a20 con 0x7f94900a7fa0 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900bea40 0x7f94900a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.222+0000 7f948ffff700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 0x7f9490151c50 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f947800c810 tx=0x7f9478001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.223+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478007170 con 0x7f94900a7fa0 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.223+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94780072d0 con 0x7f94900a7fa0 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.223+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94800092a0 con 0x7f94900a7fa0 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.223+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780048c0 con 0x7f94900a7fa0 2023-05-17T15:29:09.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.223+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94900a66c0 con 0x7f94900a7fa0 2023-05-17T15:29:09.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.224+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949006bdf0 con 0x7f94900a7fa0 2023-05-17T15:29:09.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.224+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 76) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f947801b060 con 0x7f94900a7fa0 2023-05-17T15:29:09.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.224+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6909+0+0 (secure 0 0 0) 0x7f9478079810 con 0x7f94900a7fa0 2023-05-17T15:29:09.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.228+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f947804ab40 con 0x7f94900a7fa0 2023-05-17T15:29:09.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.400+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9490082f10 con 0x7f94900a7fa0 2023-05-17T15:29:09.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.471+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 77) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f9478010070 con 0x7f94900a7fa0 2023-05-17T15:29:09.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.471+0000 7f9487fff700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94700301b0 0x7f9470067b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:09.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.471+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94700301b0 0x7f9470067b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:09.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:09.473+0000 7f948f7fe700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94700301b0 0x7f9470067b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9490066890 tx=0x7f9480016000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:10.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.084+0000 7f9487fff700 1 -- 172.21.15.27:0/3285296057 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v167) v1 ==== 181+0+0 (secure 0 0 0) 0x7f94780718b0 con 0x7f94900a7fa0 2023-05-17T15:29:10.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94700301b0 msgr2=0x7f9470067b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94700301b0 0x7f9470067b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9490066890 tx=0x7f9480016000).stop 2023-05-17T15:29:10.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 msgr2=0x7f9490151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 0x7f9490151c50 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f947800c810 tx=0x7f9478001a00).stop 2023-05-17T15:29:10.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 shutdown_connections 2023-05-17T15:29:10.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94700301b0 0x7f9470067b60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94900a6260 0x7f9490064750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94900a7fa0 0x7f9490151c50 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 --2- 172.21.15.27:0/3285296057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94900bea40 0x7f94900a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 >> 172.21.15.27:0/3285296057 conn(0x7f9490092160 msgr2=0x7f94900a7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:10.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 shutdown_connections 2023-05-17T15:29:10.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.087+0000 7f949674c700 1 -- 172.21.15.27:0/3285296057 wait complete. 2023-05-17T15:29:10.093 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:29:10.104 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:29:10.226 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.223+0000 7fb2c53a8700 1 Processor -- start 2023-05-17T15:29:10.227 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.223+0000 7fb2c53a8700 1 -- start start 2023-05-17T15:29:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.223+0000 7fb2c53a8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2c00c40f0 0x7fb2c00a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.223+0000 7fb2c53a8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c0153780 con 0x7fb2c00a7f10 2023-05-17T15:29:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.223+0000 7fb2c53a8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c00be2b0 con 0x7fb2c014c510 2023-05-17T15:29:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.223+0000 7fb2c53a8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00be010 con 0x7fb2c00c40f0 2023-05-17T15:29:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bf7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb2c00a7f10 0x7fb2c00be740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45734/0 (socket says 172.21.15.27:45734) 2023-05-17T15:29:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bf7fe700 1 -- 172.21.15.27:0/2349690969 learned_addr learned my addr 172.21.15.27:0/2349690969 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2be7fc700 1 --2- 172.21.15.27:0/2349690969 >> v2:172.21.15.40:3300/0 conn(0x7fb2c00c40f0 0x7fb2c00a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830101588 0 0) 0x7fb2c0153780 con 0x7fb2c00a7f10 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ac0033f0 con 0x7fb2c00a7f10 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132250318 0 0) 0x7fb2c00be2b0 con 0x7fb2c014c510 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c0153780 con 0x7fb2c014c510 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3675259744 0 0) 0x7fb2ac0033f0 con 0x7fb2c00a7f10 2023-05-17T15:29:10.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 >> v2:172.21.15.40:3300/0 conn(0x7fb2c00c40f0 msgr2=0x7fb2c00a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 --2- 172.21.15.27:0/2349690969 >> v2:172.21.15.40:3300/0 conn(0x7fb2c00c40f0 0x7fb2c00a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 >> v1:172.21.15.40:6789/0 conn(0x7fb2c014c510 legacy=0x7fb2c01525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00a8340 con 0x7fb2c00a7f10 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fb2b00017f0 con 0x7fb2c00a7f10 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 >> v1:172.21.15.27:6789/0 conn(0x7fb2c00a7f10 legacy=0x7fb2c00be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ac003ac0 0x7fb2ac003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2ac004690 0x7fb2ac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2ac00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00be010 con 0x7fb2ac005000 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac00bf60 con 0x7fb2ac003ac0 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac00c120 con 0x7fb2ac004690 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2bf7fe700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2ac00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.224+0000 7fb2beffd700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ac003ac0 0x7fb2ac003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2be7fc700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2ac004690 0x7fb2ac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 -- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2ac004690 msgr2=0x7fb2ac004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2ac004690 0x7fb2ac004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 -- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ac003ac0 msgr2=0x7fb2ac003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ac003ac0 0x7fb2ac003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 -- 172.21.15.27:0/2349690969 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0033f0 con 0x7fb2ac005000 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 -- 172.21.15.27:0/2349690969 reap_dead start 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bf7fe700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2ac00b8e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fb2b000c410 tx=0x7fb2b0007f40).ready entity=mon.0 client_cookie=215d1e2c4b5d6c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000cce0 con 0x7fb2ac005000 2023-05-17T15:29:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000ce40 con 0x7fb2ac005000 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2bdffb700 1 -- 172.21.15.27:0/2349690969 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0005d70 con 0x7fb2ac005000 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 -- 172.21.15.27:0/2349690969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 msgr2=0x7fb2ac00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2ac00b8e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fb2b000c410 tx=0x7fb2b0007f40).stop 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 -- 172.21.15.27:0/2349690969 shutdown_connections 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/2349690969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2ac00b8e0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 -- 172.21.15.27:0/2349690969 >> 172.21.15.27:0/2349690969 conn(0x7fb2c00c8ad0 msgr2=0x7fb2c00c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:10.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 -- 172.21.15.27:0/2349690969 shutdown_connections 2023-05-17T15:29:10.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.225+0000 7fb2c53a8700 1 -- 172.21.15.27:0/2349690969 wait complete. 2023-05-17T15:29:10.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 Processor -- start 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 -- start start 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2c00a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c01629c0 0x7fb2c00abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c00ac3b0 0x7fb2c00ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00aa1a0 con 0x7fb2ac005000 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00acd20 con 0x7fb2c01629c0 2023-05-17T15:29:10.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.227+0000 7fb2c53a8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00a9310 con 0x7fb2c00ac3b0 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2c00a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2c00a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46182/0 (socket says 172.21.15.27:46182) 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 -- 172.21.15.27:0/3148239679 learned_addr learned my addr 172.21.15.27:0/3148239679 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2be7fc700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c01629c0 0x7fb2c00abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2bf7fe700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c00ac3b0 0x7fb2c00ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 -- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c00ac3b0 msgr2=0x7fb2c00ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c00ac3b0 0x7fb2c00ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 -- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c01629c0 msgr2=0x7fb2c00abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c01629c0 0x7fb2c00abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 -- 172.21.15.27:0/3148239679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00a9590 con 0x7fb2ac005000 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2beffd700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2c00a8e20 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fb2b8002a00 tx=0x7fb2b8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800f720 con 0x7fb2ac005000 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b800f880 con 0x7fb2ac005000 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c00a9870 con 0x7fb2ac005000 2023-05-17T15:29:10.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800fc00 con 0x7fb2ac005000 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.228+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c00a9e30 con 0x7fb2ac005000 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.229+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c006bdf0 con 0x7fb2ac005000 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.229+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 77) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fb2b801b030 con 0x7fb2ac005000 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.230+0000 7fb2b6ffd700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb2a005ecf0 0x7fb2a00611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.230+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fb2b8079890 con 0x7fb2ac005000 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.230+0000 7fb2be7fc700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb2a005ecf0 0x7fb2a00611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:10.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.230+0000 7fb2be7fc700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb2a005ecf0 0x7fb2a00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb2c00aeca0 tx=0x7fb2a8008040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:10.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.234+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2b804ae60 con 0x7fb2ac005000 2023-05-17T15:29:10.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.407+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb2c00637d0 con 0x7fb2ac005000 2023-05-17T15:29:10.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:10.475+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb2b8077710 con 0x7fb2ac005000 2023-05-17T15:29:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.088+0000 7fb2b6ffd700 1 -- 172.21.15.27:0/3148239679 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v168) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb2b8072fd0 con 0x7fb2ac005000 2023-05-17T15:29:11.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb2a005ecf0 msgr2=0x7fb2a00611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb2a005ecf0 0x7fb2a00611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb2c00aeca0 tx=0x7fb2a8008040).stop 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 msgr2=0x7fb2c00a8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2c00a8e20 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fb2b8002a00 tx=0x7fb2b8007bb0).stop 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 shutdown_connections 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb2a005ecf0 0x7fb2a00611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2c00ac3b0 0x7fb2c00ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2ac005000 0x7fb2c00a8e20 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 --2- 172.21.15.27:0/3148239679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2c01629c0 0x7fb2c00abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 >> 172.21.15.27:0/3148239679 conn(0x7fb2c00c8ad0 msgr2=0x7fb2c00c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:11.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 shutdown_connections 2023-05-17T15:29:11.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.090+0000 7fb2c53a8700 1 -- 172.21.15.27:0/3148239679 wait complete. 2023-05-17T15:29:11.096 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:29:11.108 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:29:11.228 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.224+0000 7ff0e5089700 1 Processor -- start 2023-05-17T15:29:11.229 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.224+0000 7ff0e5089700 1 -- start start 2023-05-17T15:29:11.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0e5089700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0e01543d0 0x7ff0e00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0e5089700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0e5089700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e0158790 con 0x7ff0e00c60f0 2023-05-17T15:29:11.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0e5089700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e00c1c50 con 0x7ff0e01543d0 2023-05-17T15:29:11.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0e5089700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c6570 con 0x7ff0e0069410 2023-05-17T15:29:11.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0ded9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0e01543d0 0x7ff0e00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0de59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff0e00c60f0 0x7ff0e0068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45752/0 (socket says 172.21.15.27:45752) 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0de59c700 1 -- 172.21.15.27:0/933657213 learned_addr learned my addr 172.21.15.27:0/933657213 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.225+0000 7ff0df59e700 1 --2- 172.21.15.27:0/933657213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ded9d700 1 -- 172.21.15.27:0/933657213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 msgr2=0x7ff0e00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ded9d700 1 --2- 172.21.15.27:0/933657213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e00bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ded9d700 1 -- 172.21.15.27:0/933657213 >> v1:172.21.15.27:6789/0 conn(0x7ff0e00c60f0 legacy=0x7ff0e0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ddd9b700 1 -- 172.21.15.27:0/933657213 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093778374 0 0) 0x7ff0e0158790 con 0x7ff0e00c60f0 2023-05-17T15:29:11.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ded9d700 1 -- 172.21.15.27:0/933657213 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0157e60 con 0x7ff0e01543d0 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ded9d700 1 --2- 172.21.15.27:0/933657213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00c5c00 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7ff0d8009760 tx=0x7ff0d8009060).ready entity=mon.0 client_cookie=33d91f5e17d0e3a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ddd9b700 1 -- 172.21.15.27:0/933657213 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800b580 con 0x7ff0e01543d0 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ddd9b700 1 -- 172.21.15.27:0/933657213 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800b6e0 con 0x7ff0e01543d0 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0ddd9b700 1 -- 172.21.15.27:0/933657213 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800ba60 con 0x7ff0e01543d0 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 -- 172.21.15.27:0/933657213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 msgr2=0x7ff0e00c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 --2- 172.21.15.27:0/933657213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00c5c00 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7ff0d8009760 tx=0x7ff0d8009060).stop 2023-05-17T15:29:11.233 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 -- 172.21.15.27:0/933657213 shutdown_connections 2023-05-17T15:29:11.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 --2- 172.21.15.27:0/933657213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e00bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 --2- 172.21.15.27:0/933657213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00c5c00 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 -- 172.21.15.27:0/933657213 >> 172.21.15.27:0/933657213 conn(0x7ff0e00cb7f0 msgr2=0x7ff0e00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:11.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 -- 172.21.15.27:0/933657213 shutdown_connections 2023-05-17T15:29:11.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.226+0000 7ff0e5089700 1 -- 172.21.15.27:0/933657213 wait complete. 2023-05-17T15:29:11.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 Processor -- start 2023-05-17T15:29:11.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 -- start start 2023-05-17T15:29:11.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e0164b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0e00c60f0 0x7ff0e00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c1dc0 con 0x7ff0e01543d0 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c2c20 con 0x7ff0e00c60f0 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.228+0000 7ff0e5089700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0165070 con 0x7ff0e0069410 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46200/0 (socket says 172.21.15.27:46200) 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 -- 172.21.15.27:0/2060176649 learned_addr learned my addr 172.21.15.27:0/2060176649 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0ded9d700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e0164b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0de59c700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0e00c60f0 0x7ff0e00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 -- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 msgr2=0x7ff0e0164b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e0164b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 -- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0e00c60f0 msgr2=0x7ff0e00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0e00c60f0 0x7ff0e00adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 -- 172.21.15.27:0/2060176649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80092a0 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0df59e700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00ae1c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7ff0d0009fa0 tx=0x7ff0d0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000ebc0 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000ed20 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e00c2010 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0014610 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.229+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e00c25d0 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.230+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e00c2d90 con 0x7ff0e01543d0 2023-05-17T15:29:11.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.230+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff0d001b030 con 0x7ff0e01543d0 2023-05-17T15:29:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.231+0000 7ff0d6ffd700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff0c005ed90 0x7ff0c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.231+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5999+0+0 (secure 0 0 0) 0x7ff0d0079df0 con 0x7ff0e01543d0 2023-05-17T15:29:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.231+0000 7ff0ded9d700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff0c005ed90 0x7ff0c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.231+0000 7ff0ded9d700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff0c005ed90 0x7ff0c0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff0d800b340 tx=0x7ff0d8017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.235+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0d004b3b0 con 0x7ff0e01543d0 2023-05-17T15:29:11.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.416+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff0e0158140 con 0x7ff0e01543d0 2023-05-17T15:29:11.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.419+0000 7ff0d6ffd700 1 -- 172.21.15.27:0/2060176649 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff0d004e9d0 con 0x7ff0e01543d0 2023-05-17T15:29:11.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff0c005ed90 msgr2=0x7ff0c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.425 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff0c005ed90 0x7ff0c0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff0d800b340 tx=0x7ff0d8017000).stop 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 msgr2=0x7ff0e00ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00ae1c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7ff0d0009fa0 tx=0x7ff0d0009900).stop 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 shutdown_connections 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff0c005ed90 0x7ff0c0061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0e01543d0 0x7ff0e00ae1c0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0e0069410 0x7ff0e0164b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 --2- 172.21.15.27:0/2060176649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0e00c60f0 0x7ff0e00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 >> 172.21.15.27:0/2060176649 conn(0x7ff0e00cb7f0 msgr2=0x7ff0e0153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 shutdown_connections 2023-05-17T15:29:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.421+0000 7ff0e5089700 1 -- 172.21.15.27:0/2060176649 wait complete. 2023-05-17T15:29:11.437 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:29:11.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 Processor -- start 2023-05-17T15:29:11.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 -- start start 2023-05-17T15:29:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1590069410 0x7f15900bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1590158790 con 0x7f15900c60f0 2023-05-17T15:29:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15900c1c50 con 0x7f1590069410 2023-05-17T15:29:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.552+0000 7f1595d23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c6570 con 0x7f15901543d0 2023-05-17T15:29:11.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158effd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f15900c60f0 0x7f1590068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45770/0 (socket says 172.21.15.27:45770) 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158effd700 1 -- 172.21.15.27:0/1860004984 learned_addr learned my addr 172.21.15.27:0/1860004984 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158ffff700 1 --2- 172.21.15.27:0/1860004984 >> v2:172.21.15.40:3300/0 conn(0x7f1590069410 0x7f15900bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158f7fe700 1 --2- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158e7fc700 1 -- 172.21.15.27:0/1860004984 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868846544 0 0) 0x7f1590158790 con 0x7f15900c60f0 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158e7fc700 1 -- 172.21.15.27:0/1860004984 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15780033f0 con 0x7f15900c60f0 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158ffff700 1 -- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 msgr2=0x7f15900c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:11.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158ffff700 1 --2- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158ffff700 1 -- 172.21.15.27:0/1860004984 >> v1:172.21.15.27:6789/0 conn(0x7f15900c60f0 legacy=0x7f1590068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158ffff700 1 -- 172.21.15.27:0/1860004984 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590157e60 con 0x7f1590069410 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158ffff700 1 --2- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900bfc80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f1588009760 tx=0x7f1588009060).ready entity=mon.1 client_cookie=f54d3af96d848660 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158e7fc700 1 -- 172.21.15.27:0/1860004984 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800d4a0 con 0x7f1590069410 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158e7fc700 1 -- 172.21.15.27:0/1860004984 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800d600 con 0x7f1590069410 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.553+0000 7f158e7fc700 1 -- 172.21.15.27:0/1860004984 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800d980 con 0x7f1590069410 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 -- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 msgr2=0x7f15900bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 --2- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900bfc80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f1588009760 tx=0x7f1588009060).stop 2023-05-17T15:29:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 -- 172.21.15.27:0/1860004984 shutdown_connections 2023-05-17T15:29:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 --2- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900bfc80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 --2- 172.21.15.27:0/1860004984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 -- 172.21.15.27:0/1860004984 >> 172.21.15.27:0/1860004984 conn(0x7f15900cb7f0 msgr2=0x7f15900c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 -- 172.21.15.27:0/1860004984 shutdown_connections 2023-05-17T15:29:11.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.554+0000 7f1595d23700 1 -- 172.21.15.27:0/1860004984 wait complete. 2023-05-17T15:29:11.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.555+0000 7f1595d23700 1 Processor -- start 2023-05-17T15:29:11.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.555+0000 7f1595d23700 1 -- start start 2023-05-17T15:29:11.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f1595d23700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f1595d23700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 0x7f1590147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f1595d23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f1595d23700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c2d00 con 0x7f15900c60f0 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f1595d23700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c1dc0 con 0x7f1590069410 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f1595d23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c2080 con 0x7f15901543d0 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 0x7f1590147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 0x7f1590147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46212/0 (socket says 172.21.15.27:46212) 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 -- 172.21.15.27:0/4145610611 learned_addr learned my addr 172.21.15.27:0/4145610611 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158f7fe700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158ffff700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 -- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 msgr2=0x7f15900ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 -- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 msgr2=0x7f15900c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 -- 172.21.15.27:0/4145610611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880092a0 con 0x7f15900c60f0 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.556+0000 7f158effd700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 0x7f1590147920 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f158400c4c0 tx=0x7f1584007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.557+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840072e0 con 0x7f15900c60f0 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.557+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584007440 con 0x7f15900c60f0 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.557+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15900c2360 con 0x7f15900c60f0 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.557+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840057a0 con 0x7f15900c60f0 2023-05-17T15:29:11.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.557+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15900c2920 con 0x7f15900c60f0 2023-05-17T15:29:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.558+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15900c2e40 con 0x7f15900c60f0 2023-05-17T15:29:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.558+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1584010070 con 0x7f15900c60f0 2023-05-17T15:29:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.558+0000 7f15777fe700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f157c05edc0 0x7f157c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.559+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5999+0+0 (secure 0 0 0) 0x7f1584079170 con 0x7f15900c60f0 2023-05-17T15:29:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.559+0000 7f158f7fe700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f157c05edc0 0x7f157c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.559+0000 7f158f7fe700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f157c05edc0 0x7f157c061280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1580007620 tx=0x7f158000b040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.562+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15900c2e40 con 0x7f15900c60f0 2023-05-17T15:29:11.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.737+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f15900c2e40 con 0x7f15900c60f0 2023-05-17T15:29:11.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.743+0000 7f15777fe700 1 -- 172.21.15.27:0/4145610611 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15900c2e40 con 0x7f15900c60f0 2023-05-17T15:29:11.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f157c05edc0 msgr2=0x7f157c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f157c05edc0 0x7f157c061280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1580007620 tx=0x7f158000b040).stop 2023-05-17T15:29:11.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 msgr2=0x7f1590147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 0x7f1590147920 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f158400c4c0 tx=0x7f1584007c50).stop 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 shutdown_connections 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f157c05edc0 0x7f157c061280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15901543d0 0x7f15900ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1590069410 0x7f15900c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 --2- 172.21.15.27:0/4145610611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15900c60f0 0x7f1590147920 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 >> 172.21.15.27:0/4145610611 conn(0x7f15900cb7f0 msgr2=0x7f15900accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:11.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 shutdown_connections 2023-05-17T15:29:11.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.745+0000 7f1595d23700 1 -- 172.21.15.27:0/4145610611 wait complete. 2023-05-17T15:29:11.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-05-17T15:29:11.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.872+0000 7efec979f700 1 Processor -- start 2023-05-17T15:29:11.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.872+0000 7efec979f700 1 -- start start 2023-05-17T15:29:11.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec979f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efec4066a60 0x7efec4154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec979f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efec40bd120 0x7efec40c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec979f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec40c3230 con 0x7efec4153f80 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec979f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40c2430 con 0x7efec40bd120 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec979f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40c36c0 con 0x7efec4066a60 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efec40bd120 0x7efec40c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efec40bd120 0x7efec40c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46220/0 (socket says 172.21.15.27:46220) 2023-05-17T15:29:11.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 -- 172.21.15.27:0/744632727 learned_addr learned my addr 172.21.15.27:0/744632727 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec27fc700 1 --2- 172.21.15.27:0/744632727 >> v2:172.21.15.40:3300/0 conn(0x7efec4066a60 0x7efec4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 -- 172.21.15.27:0/744632727 >> v2:172.21.15.40:3300/0 conn(0x7efec4066a60 msgr2=0x7efec4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 --2- 172.21.15.27:0/744632727 >> v2:172.21.15.40:3300/0 conn(0x7efec4066a60 0x7efec4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 -- 172.21.15.27:0/744632727 >> v1:172.21.15.40:6789/0 conn(0x7efec4153f80 legacy=0x7efec4066350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.873+0000 7efec37fe700 1 -- 172.21.15.27:0/744632727 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40bd560 con 0x7efec40bd120 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec37fe700 1 --2- 172.21.15.27:0/744632727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec40bd120 0x7efec40c1f40 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7efec40c79e0 tx=0x7efeb40090f0).ready entity=mon.0 client_cookie=926d5df4cab3e990 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec1ffb700 1 -- 172.21.15.27:0/744632727 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400b600 con 0x7efec40bd120 2023-05-17T15:29:11.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec1ffb700 1 -- 172.21.15.27:0/744632727 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400b760 con 0x7efec40bd120 2023-05-17T15:29:11.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec1ffb700 1 -- 172.21.15.27:0/744632727 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400bae0 con 0x7efec40bd120 2023-05-17T15:29:11.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 -- 172.21.15.27:0/744632727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec40bd120 msgr2=0x7efec40c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 --2- 172.21.15.27:0/744632727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec40bd120 0x7efec40c1f40 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7efec40c79e0 tx=0x7efeb40090f0).stop 2023-05-17T15:29:11.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 -- 172.21.15.27:0/744632727 shutdown_connections 2023-05-17T15:29:11.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 --2- 172.21.15.27:0/744632727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec40bd120 0x7efec40c1f40 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 --2- 172.21.15.27:0/744632727 >> v2:172.21.15.40:3300/0 conn(0x7efec4066a60 0x7efec4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 -- 172.21.15.27:0/744632727 >> 172.21.15.27:0/744632727 conn(0x7efec4068750 msgr2=0x7efec40c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 -- 172.21.15.27:0/744632727 shutdown_connections 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.874+0000 7efec979f700 1 -- 172.21.15.27:0/744632727 wait complete. 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.875+0000 7efec979f700 1 Processor -- start 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.875+0000 7efec979f700 1 -- start start 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec979f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 0x7efec40c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec979f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40bd120 0x7efec4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec979f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4153f80 0x7efec40c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec979f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec41687b0 con 0x7efec4066a60 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec979f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec41681f0 con 0x7efec4153f80 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec979f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec41684d0 con 0x7efec40bd120 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 0x7efec40c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec2ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 0x7efec40c0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46226/0 (socket says 172.21.15.27:46226) 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec2ffd700 1 -- 172.21.15.27:0/98243086 learned_addr learned my addr 172.21.15.27:0/98243086 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec37fe700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4153f80 0x7efec40c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.876+0000 7efec27fc700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40bd120 0x7efec4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec2ffd700 1 -- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40bd120 msgr2=0x7efec4156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec2ffd700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40bd120 0x7efec4156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec2ffd700 1 -- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4153f80 msgr2=0x7efec40c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec2ffd700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4153f80 0x7efec40c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec2ffd700 1 -- 172.21.15.27:0/98243086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4009370 con 0x7efec4066a60 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec2ffd700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 0x7efec40c0d20 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7efebc00c7c0 tx=0x7efebc0015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc006a20 con 0x7efec4066a60 2023-05-17T15:29:11.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc006b80 con 0x7efec4066a60 2023-05-17T15:29:11.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc007020 con 0x7efec4066a60 2023-05-17T15:29:11.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40c02e0 con 0x7efec4066a60 2023-05-17T15:29:11.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.877+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec40c08a0 con 0x7efec4066a60 2023-05-17T15:29:11.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.878+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40c0140 con 0x7efec4066a60 2023-05-17T15:29:11.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.878+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efebc010070 con 0x7efec4066a60 2023-05-17T15:29:11.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.879+0000 7efeaaffd700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7efeb005ed90 0x7efeb0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:11.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.879+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5999+0+0 (secure 0 0 0) 0x7efebc079030 con 0x7efec4066a60 2023-05-17T15:29:11.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.879+0000 7efec27fc700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7efeb005ed90 0x7efeb0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:11.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.879+0000 7efec27fc700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7efeb005ed90 0x7efeb0061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efec40c5bc0 tx=0x7efeb8008040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:11.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:11.883+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efebc0478f0 con 0x7efec4066a60 2023-05-17T15:29:12.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:12.124+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7efec40c7a10 con 0x7efec4066a60 2023-05-17T15:29:13.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.102+0000 7efeaaffd700 1 -- 172.21.15.27:0/98243086 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1232) v1 ==== 163+0+0 (secure 0 0 0) 0x7efec40c0140 con 0x7efec4066a60 2023-05-17T15:29:13.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7efeb005ed90 msgr2=0x7efeb0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7efeb005ed90 0x7efeb0061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efec40c5bc0 tx=0x7efeb8008040).stop 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 msgr2=0x7efec40c0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 0x7efec40c0d20 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7efebc00c7c0 tx=0x7efebc0015c0).stop 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 shutdown_connections 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7efeb005ed90 0x7efeb0061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4153f80 0x7efec40c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efec4066a60 0x7efec40c0d20 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 --2- 172.21.15.27:0/98243086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40bd120 0x7efec4156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 >> 172.21.15.27:0/98243086 conn(0x7efec4068750 msgr2=0x7efec4147d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 shutdown_connections 2023-05-17T15:29:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.104+0000 7efec979f700 1 -- 172.21.15.27:0/98243086 wait complete. 2023-05-17T15:29:13.123 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-05-17T15:29:13.124 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-05-17T15:29:13.124 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-05-17T15:29:13.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-05-17T15:29:13.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.242+0000 7f7b4c5d3700 1 Processor -- start 2023-05-17T15:29:13.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.242+0000 7f7b4c5d3700 1 -- start start 2023-05-17T15:29:13.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.243+0000 7f7b4c5d3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b440c60c0 0x7f7b440c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:13.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.243+0000 7f7b4c5d3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4405e7e0 con 0x7f7b440aa3b0 2023-05-17T15:29:13.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.243+0000 7f7b4c5d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4405eac0 con 0x7f7b440a9f70 2023-05-17T15:29:13.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.243+0000 7f7b4c5d3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440bfd70 con 0x7f7b440c60c0 2023-05-17T15:29:13.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.243+0000 7f7b4a36f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b440c60c0 0x7f7b440c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:13.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4ab70700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7b440aa3b0 0x7f7b440c0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45794/0 (socket says 172.21.15.27:45794) 2023-05-17T15:29:13.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4ab70700 1 -- 172.21.15.27:0/2212517489 learned_addr learned my addr 172.21.15.27:0/2212517489 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:13.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4a36f700 1 -- 172.21.15.27:0/2212517489 >> v1:172.21.15.40:6789/0 conn(0x7f7b440a9f70 legacy=0x7f7b44153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4a36f700 1 -- 172.21.15.27:0/2212517489 >> v1:172.21.15.27:6789/0 conn(0x7f7b440aa3b0 legacy=0x7f7b440c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4a36f700 1 -- 172.21.15.27:0/2212517489 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440c0050 con 0x7f7b440c60c0 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4a36f700 1 --2- 172.21.15.27:0/2212517489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440c60c0 0x7f7b440c64a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f7b3c009e60 tx=0x7f7b3c009780).ready entity=mon.0 client_cookie=ce4cefd380f9f1bd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4936d700 1 -- 172.21.15.27:0/2212517489 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00e070 con 0x7f7b440c60c0 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4936d700 1 -- 172.21.15.27:0/2212517489 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00bc30 con 0x7f7b440c60c0 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.244+0000 7f7b4936d700 1 -- 172.21.15.27:0/2212517489 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c012410 con 0x7f7b440c60c0 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/2212517489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440c60c0 msgr2=0x7f7b440c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/2212517489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440c60c0 0x7f7b440c64a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f7b3c009e60 tx=0x7f7b3c009780).stop 2023-05-17T15:29:13.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/2212517489 shutdown_connections 2023-05-17T15:29:13.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/2212517489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440c60c0 0x7f7b440c64a0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/2212517489 >> 172.21.15.27:0/2212517489 conn(0x7f7b44069e70 msgr2=0x7f7b4405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:13.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/2212517489 shutdown_connections 2023-05-17T15:29:13.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.245+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/2212517489 wait complete. 2023-05-17T15:29:13.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.246+0000 7f7b4c5d3700 1 Processor -- start 2023-05-17T15:29:13.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.246+0000 7f7b4c5d3700 1 -- start start 2023-05-17T15:29:13.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 0x7f7b4413ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b440aa3b0 0x7f7b44153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b440c60c0 0x7f7b44154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44154520 con 0x7f7b440a9f70 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440cbb50 con 0x7f7b440c60c0 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44155da0 con 0x7f7b440aa3b0 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 0x7f7b4413ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 0x7f7b4413ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46234/0 (socket says 172.21.15.27:46234) 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 -- 172.21.15.27:0/3873869497 learned_addr learned my addr 172.21.15.27:0/3873869497 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4ab70700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b440c60c0 0x7f7b44154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b49b6e700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b440aa3b0 0x7f7b44153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 -- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b440aa3b0 msgr2=0x7f7b44153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b440aa3b0 0x7f7b44153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 -- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b440c60c0 msgr2=0x7f7b44154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b440c60c0 0x7f7b44154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:13.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 -- 172.21.15.27:0/3873869497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009a20 con 0x7f7b440a9f70 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b49b6e700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b440aa3b0 0x7f7b44153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4a36f700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 0x7f7b4413ea40 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f7b3c013fd0 tx=0x7f7b3c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c006320 con 0x7f7b440a9f70 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c006480 con 0x7f7b440a9f70 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b440cb030 con 0x7f7b440a9f70 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c006820 con 0x7f7b440a9f70 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.247+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b440cb870 con 0x7f7b440a9f70 2023-05-17T15:29:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.248+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4405f4a0 con 0x7f7b440a9f70 2023-05-17T15:29:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.249+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7b3c027460 con 0x7f7b440a9f70 2023-05-17T15:29:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.249+0000 7f7b427fc700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7b3005ed90 0x7f7b30061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.249+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5999+0+0 (secure 0 0 0) 0x7f7b3c07bfe0 con 0x7f7b440a9f70 2023-05-17T15:29:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.249+0000 7f7b49b6e700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7b3005ed90 0x7f7b30061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.250+0000 7f7b49b6e700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7b3005ed90 0x7f7b30061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7b4414fdd0 tx=0x7f7b38009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.253+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b3c04d5a0 con 0x7f7b440a9f70 2023-05-17T15:29:13.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:13.491+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f7b440c0330 con 0x7f7b440a9f70 2023-05-17T15:29:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.103+0000 7f7b427fc700 1 -- 172.21.15.27:0/3873869497 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1233) v1 ==== 158+0+0 (secure 0 0 0) 0x7f7b3c050bc0 con 0x7f7b440a9f70 2023-05-17T15:29:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7b3005ed90 msgr2=0x7f7b30061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7b3005ed90 0x7f7b30061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7b4414fdd0 tx=0x7f7b38009040).stop 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 msgr2=0x7f7b4413ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 0x7f7b4413ea40 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f7b3c013fd0 tx=0x7f7b3c009780).stop 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 shutdown_connections 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7b3005ed90 0x7f7b30061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b440c60c0 0x7f7b44154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b440a9f70 0x7f7b4413ea40 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 --2- 172.21.15.27:0/3873869497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b440aa3b0 0x7f7b44153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 >> 172.21.15.27:0/3873869497 conn(0x7f7b44069e70 msgr2=0x7f7b440b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 shutdown_connections 2023-05-17T15:29:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.105+0000 7f7b4c5d3700 1 -- 172.21.15.27:0/3873869497 wait complete. 2023-05-17T15:29:14.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T15:29:14.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.242+0000 7f9f7ffff700 1 Processor -- start 2023-05-17T15:29:14.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.242+0000 7f9f7ffff700 1 -- start start 2023-05-17T15:29:14.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f8014e2d0 0x7f9f8014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f800a9b00 0x7f9f800a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7ffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f80154900 con 0x7f9f800c73e0 2023-05-17T15:29:14.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7ffff700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8014eba0 con 0x7f9f800a9b00 2023-05-17T15:29:14.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f80154be0 con 0x7f9f8014e2d0 2023-05-17T15:29:14.249 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7e7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f800a9b00 0x7f9f800a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7e7fc700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9f800a9b00 0x7f9f800a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46246/0 (socket says 172.21.15.27:46246) 2023-05-17T15:29:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7e7fc700 1 -- 172.21.15.27:0/1267232922 learned_addr learned my addr 172.21.15.27:0/1267232922 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.243+0000 7f9f7effd700 1 --2- 172.21.15.27:0/1267232922 >> v2:172.21.15.40:3300/0 conn(0x7f9f8014e2d0 0x7f9f8014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7e7fc700 1 -- 172.21.15.27:0/1267232922 >> v2:172.21.15.40:3300/0 conn(0x7f9f8014e2d0 msgr2=0x7f9f8014e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7e7fc700 1 --2- 172.21.15.27:0/1267232922 >> v2:172.21.15.40:3300/0 conn(0x7f9f8014e2d0 0x7f9f8014e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7e7fc700 1 -- 172.21.15.27:0/1267232922 >> v1:172.21.15.40:6789/0 conn(0x7f9f800c73e0 legacy=0x7f9f800c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7e7fc700 1 -- 172.21.15.27:0/1267232922 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80154ec0 con 0x7f9f800a9b00 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7e7fc700 1 --2- 172.21.15.27:0/1267232922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f800a9b00 0x7f9f800a9f90 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f9f80083a00 tx=0x7f9f68009840).ready entity=mon.0 client_cookie=9bc8dcfed128ca0d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7dffb700 1 -- 172.21.15.27:0/1267232922 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800e070 con 0x7f9f800a9b00 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7dffb700 1 -- 172.21.15.27:0/1267232922 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800ba20 con 0x7f9f800a9b00 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7dffb700 1 -- 172.21.15.27:0/1267232922 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800bda0 con 0x7f9f800a9b00 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 -- 172.21.15.27:0/1267232922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f800a9b00 msgr2=0x7f9f800a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/1267232922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f800a9b00 0x7f9f800a9f90 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f9f80083a00 tx=0x7f9f68009840).stop 2023-05-17T15:29:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 -- 172.21.15.27:0/1267232922 shutdown_connections 2023-05-17T15:29:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/1267232922 >> v2:172.21.15.40:3300/0 conn(0x7f9f8014e2d0 0x7f9f8014e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/1267232922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f800a9b00 0x7f9f800a9f90 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 -- 172.21.15.27:0/1267232922 >> 172.21.15.27:0/1267232922 conn(0x7f9f8005dd50 msgr2=0x7f9f8005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 -- 172.21.15.27:0/1267232922 shutdown_connections 2023-05-17T15:29:14.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.244+0000 7f9f7ffff700 1 -- 172.21.15.27:0/1267232922 wait complete. 2023-05-17T15:29:14.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 Processor -- start 2023-05-17T15:29:14.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 -- start start 2023-05-17T15:29:14.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f800a9b00 0x7f9f80148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f800c73e0 0x7f9f80136bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 0x7f9f800af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f801370a0 con 0x7f9f8014e2d0 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800afc40 con 0x7f9f800c73e0 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800aff20 con 0x7f9f800a9b00 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.246+0000 7f9f7f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 0x7f9f800af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 0x7f9f800af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46252/0 (socket says 172.21.15.27:46252) 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 -- 172.21.15.27:0/2031855499 learned_addr learned my addr 172.21.15.27:0/2031855499 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7e7fc700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f800c73e0 0x7f9f80136bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7effd700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f800a9b00 0x7f9f80148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 -- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f800a9b00 msgr2=0x7f9f80148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f800a9b00 0x7f9f80148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 -- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f800c73e0 msgr2=0x7f9f80136bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f800c73e0 0x7f9f80136bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 -- 172.21.15.27:0/2031855499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f68009ae0 con 0x7f9f8014e2d0 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7f7fe700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 0x7f9f800af3e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f9f7000c440 tx=0x7f9f70007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:14.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700123f0 con 0x7f9f8014e2d0 2023-05-17T15:29:14.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70001e90 con 0x7f9f8014e2d0 2023-05-17T15:29:14.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f800b0200 con 0x7f9f8014e2d0 2023-05-17T15:29:14.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70012760 con 0x7f9f8014e2d0 2023-05-17T15:29:14.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.247+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f800c8e60 con 0x7f9f8014e2d0 2023-05-17T15:29:14.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.248+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f80047150 con 0x7f9f8014e2d0 2023-05-17T15:29:14.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.248+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9f70010070 con 0x7f9f8014e2d0 2023-05-17T15:29:14.258 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.249+0000 7f9f76ffd700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9f6005ed90 0x7f9f60061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.249+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5999+0+0 (secure 0 0 0) 0x7f9f70078c10 con 0x7f9f8014e2d0 2023-05-17T15:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.249+0000 7f9f7effd700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9f6005ed90 0x7f9f60061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.249+0000 7f9f7effd700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9f6005ed90 0x7f9f60061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9f78009b90 tx=0x7f9f78009060).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.253+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f700478f0 con 0x7f9f8014e2d0 2023-05-17T15:29:14.429 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.425+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9f800685e0 con 0x7f9f8014e2d0 2023-05-17T15:29:14.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.429+0000 7f9f76ffd700 1 -- 172.21.15.27:0/2031855499 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9f7004a230 con 0x7f9f8014e2d0 2023-05-17T15:29:14.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9f6005ed90 msgr2=0x7f9f60061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9f6005ed90 0x7f9f60061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9f78009b90 tx=0x7f9f78009060).stop 2023-05-17T15:29:14.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 msgr2=0x7f9f800af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 0x7f9f800af3e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f9f7000c440 tx=0x7f9f70007d70).stop 2023-05-17T15:29:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 shutdown_connections 2023-05-17T15:29:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9f6005ed90 0x7f9f60061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f8014e2d0 0x7f9f800af3e0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f800a9b00 0x7f9f80148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 --2- 172.21.15.27:0/2031855499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f800c73e0 0x7f9f80136bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 >> 172.21.15.27:0/2031855499 conn(0x7f9f8005dd50 msgr2=0x7f9f800aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:14.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 shutdown_connections 2023-05-17T15:29:14.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.431+0000 7f9f7ffff700 1 -- 172.21.15.27:0/2031855499 wait complete. 2023-05-17T15:29:14.447 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:29:14.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:29:14.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:29:14.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:29:14.516 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T15:29:14.517 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:14.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.636+0000 7f4e417d0700 1 Processor -- start 2023-05-17T15:29:14.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.636+0000 7f4e417d0700 1 -- start start 2023-05-17T15:29:14.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e417d0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4e3c0c60c0 0x7f4e3c0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e417d0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c05e7e0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e417d0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c05eac0 con 0x7f4e3c0a9f70 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e417d0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c0bfd70 con 0x7f4e3c0c60c0 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e3affd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4e3c0c60c0 0x7f4e3c0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e3b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4e3c0aa3b0 0x7f4e3c0c0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45820/0 (socket says 172.21.15.27:45820) 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.637+0000 7f4e3b7fe700 1 -- 172.21.15.27:0/3305875899 learned_addr learned my addr 172.21.15.27:0/3305875899 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:14.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e3affd700 1 -- 172.21.15.27:0/3305875899 >> v1:172.21.15.40:6789/0 conn(0x7f4e3c0a9f70 legacy=0x7f4e3c153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:14.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e3affd700 1 -- 172.21.15.27:0/3305875899 >> v1:172.21.15.27:6789/0 conn(0x7f4e3c0aa3b0 legacy=0x7f4e3c0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e3affd700 1 -- 172.21.15.27:0/3305875899 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0c0050 con 0x7f4e3c0c60c0 2023-05-17T15:29:14.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e39ffb700 1 -- 172.21.15.27:0/3305875899 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643136401 0 0) 0x7f4e3c05e7e0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e3affd700 1 --2- 172.21.15.27:0/3305875899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0c60c0 0x7f4e3c0c64a0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f4e34009760 tx=0x7f4e34009060).ready entity=mon.0 client_cookie=1d4f49060b49cf19 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:14.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e39ffb700 1 -- 172.21.15.27:0/3305875899 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3400b520 con 0x7f4e3c0c60c0 2023-05-17T15:29:14.644 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e39ffb700 1 -- 172.21.15.27:0/3305875899 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3400b680 con 0x7f4e3c0c60c0 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e39ffb700 1 -- 172.21.15.27:0/3305875899 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3400ba00 con 0x7f4e3c0c60c0 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e417d0700 1 -- 172.21.15.27:0/3305875899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0c60c0 msgr2=0x7f4e3c0c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e417d0700 1 --2- 172.21.15.27:0/3305875899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0c60c0 0x7f4e3c0c64a0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f4e34009760 tx=0x7f4e34009060).stop 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e417d0700 1 -- 172.21.15.27:0/3305875899 shutdown_connections 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e417d0700 1 --2- 172.21.15.27:0/3305875899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0c60c0 0x7f4e3c0c64a0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.638+0000 7f4e417d0700 1 -- 172.21.15.27:0/3305875899 >> 172.21.15.27:0/3305875899 conn(0x7f4e3c069e70 msgr2=0x7f4e3c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:14.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.639+0000 7f4e417d0700 1 -- 172.21.15.27:0/3305875899 shutdown_connections 2023-05-17T15:29:14.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.639+0000 7f4e417d0700 1 -- 172.21.15.27:0/3305875899 wait complete. 2023-05-17T15:29:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.640+0000 7f4e417d0700 1 Processor -- start 2023-05-17T15:29:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.640+0000 7f4e417d0700 1 -- start start 2023-05-17T15:29:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.640+0000 7f4e417d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e3c0a9f70 0x7f4e3c165f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.640+0000 7f4e417d0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 0x7f4e3c167860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.648 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e417d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e3c0c60c0 0x7f4e3c167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e417d0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1673d0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e417d0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1667c0 con 0x7f4e3c0a9f70 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e417d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c166aa0 con 0x7f4e3c0c60c0 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 0x7f4e3c167860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 0x7f4e3c167860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46264/0 (socket says 172.21.15.27:46264) 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 -- 172.21.15.27:0/4179417211 learned_addr learned my addr 172.21.15.27:0/4179417211 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:14.649 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3affd700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e3c0a9f70 0x7f4e3c165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3b7fe700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e3c0c60c0 0x7f4e3c167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 -- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e3c0c60c0 msgr2=0x7f4e3c167d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e3c0c60c0 0x7f4e3c167d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 -- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e3c0a9f70 msgr2=0x7f4e3c165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e3c0a9f70 0x7f4e3c165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 -- 172.21.15.27:0/4179417211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340092a0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3b7fe700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e3c0c60c0 0x7f4e3c167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e3a7fc700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 0x7f4e3c167860 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f4e2400c440 tx=0x7f4e24007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400cea0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400f470 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400f810 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c166d80 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.641+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c166460 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.642+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c05f4a0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.643+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4e24019030 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.643+0000 7f4e32ffd700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4e1c05ed90 0x7f4e1c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:14.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.643+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5999+0+0 (secure 0 0 0) 0x7f4e24078de0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.643+0000 7f4e3affd700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4e1c05ed90 0x7f4e1c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:14.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.643+0000 7f4e3affd700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4e1c05ed90 0x7f4e1c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4e34009760 tx=0x7f4e34017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:14.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.647+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e240488f0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.863+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e3c06bdf0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.863+0000 7f4e32ffd700 1 -- 172.21.15.27:0/4179417211 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f4e2404a4b0 con 0x7f4e3c0aa3b0 2023-05-17T15:29:14.868 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:14.868 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/330109223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":330109223},{"type":"v1","addr":"172.21.15.40:6835","nonce":330109223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1992799356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1992799356},{"type":"v1","addr":"172.21.15.40:6833","nonce":1992799356}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2348540389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2348540389},{"type":"v1","addr":"172.21.15.27:6834","nonce":2348540389}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2719778326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2719778326},{"type":"v1","addr":"172.21.15.27:6835","nonce":2719778326}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-05-17T15:29:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4e1c05ed90 msgr2=0x7f4e1c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4e1c05ed90 0x7f4e1c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4e34009760 tx=0x7f4e34017000).stop 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 msgr2=0x7f4e3c167860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 0x7f4e3c167860 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f4e2400c440 tx=0x7f4e24007de0).stop 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 shutdown_connections 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4e1c05ed90 0x7f4e1c061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e3c0c60c0 0x7f4e3c167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e3c0a9f70 0x7f4e3c165f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 --2- 172.21.15.27:0/4179417211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e3c0aa3b0 0x7f4e3c167860 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:14.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 >> 172.21.15.27:0/4179417211 conn(0x7f4e3c069e70 msgr2=0x7f4e3c14fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:14.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.865+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 shutdown_connections 2023-05-17T15:29:14.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:14.866+0000 7f4e417d0700 1 -- 172.21.15.27:0/4179417211 wait complete. 2023-05-17T15:29:14.871 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 69 2023-05-17T15:29:14.881 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T15:29:14.882 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T15:29:14.882 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:29:14.882 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:29:14.883 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T15:29:14.883 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T15:29:14.883 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:29:14.883 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:29:14.883 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T15:29:14.884 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T15:29:14.884 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:29:14.884 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:29:14.884 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T15:29:14.885 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T15:29:14.885 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:29:14.885 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:29:14.890 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:29:14.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T15:29:14.891 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:29:14.892 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T15:29:14.895 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:29:14.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T15:29:14.896 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:29:14.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T15:29:14.933 INFO:tasks.ceph.mds.a:Started 2023-05-17T15:29:14.933 DEBUG:teuthology.parallel:result is None 2023-05-17T15:29:14.934 INFO:tasks.ceph.mds.c:Started 2023-05-17T15:29:14.934 DEBUG:teuthology.parallel:result is None 2023-05-17T15:29:14.938 INFO:tasks.ceph.mds.b:Started 2023-05-17T15:29:14.938 DEBUG:teuthology.parallel:result is None 2023-05-17T15:29:14.939 INFO:tasks.ceph.mds.d:Started 2023-05-17T15:29:14.939 DEBUG:teuthology.parallel:result is None 2023-05-17T15:29:14.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T15:29:15.007 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2023-05-17T15:29:15.007 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:29:15.022 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-05-17T15:29:15.023 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-05-17T15:29:15.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.060+0000 7f15fc3bf700 1 Processor -- start 2023-05-17T15:29:15.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.060+0000 7f15fc3bf700 1 -- start start 2023-05-17T15:29:15.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fc3bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15f4153dc0 0x7f15f40626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:15.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fc3bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f41541a0 0x7f15f4066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:15.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fc3bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40bc050 con 0x7f15f40bcd80 2023-05-17T15:29:15.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fc3bf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40695d0 con 0x7f15f4153dc0 2023-05-17T15:29:15.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fc3bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40673c0 con 0x7f15f41541a0 2023-05-17T15:29:15.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fa15b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15f4153dc0 0x7f15f40626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:15.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f995a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f41541a0 0x7f15f4066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:15.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fa95c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f15f40bcd80 0x7f15f40c3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:51860/0 (socket says 172.21.15.27:51860) 2023-05-17T15:29:15.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fa95c700 1 -- 172.21.15.27:0/773131186 learned_addr learned my addr 172.21.15.27:0/773131186 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:15.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f995a700 1 -- 172.21.15.27:0/773131186 >> v2:172.21.15.40:3300/0 conn(0x7f15f4153dc0 msgr2=0x7f15f40626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:15.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f995a700 1 --2- 172.21.15.27:0/773131186 >> v2:172.21.15.40:3300/0 conn(0x7f15f4153dc0 0x7f15f40626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f995a700 1 -- 172.21.15.27:0/773131186 >> v1:172.21.15.40:6789/0 conn(0x7f15f40bcd80 legacy=0x7f15f40c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f995a700 1 -- 172.21.15.27:0/773131186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4067610 con 0x7f15f41541a0 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f9159700 1 -- 172.21.15.27:0/773131186 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767673637 0 0) 0x7f15f40bc050 con 0x7f15f40bcd80 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15fa15b700 1 --2- 172.21.15.27:0/773131186 >> v2:172.21.15.40:3300/0 conn(0x7f15f4153dc0 0x7f15f40626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.061+0000 7f15f995a700 1 --2- 172.21.15.27:0/773131186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f41541a0 0x7f15f4066ed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f15e4009760 tx=0x7f15e4009060).ready entity=mon.2 client_cookie=3b1d1ec47d2a323c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15f9159700 1 -- 172.21.15.27:0/773131186 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400f510 con 0x7f15f41541a0 2023-05-17T15:29:15.068 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15f9159700 1 -- 172.21.15.27:0/773131186 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400f670 con 0x7f15f41541a0 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15f9159700 1 -- 172.21.15.27:0/773131186 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400f9f0 con 0x7f15f41541a0 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 -- 172.21.15.27:0/773131186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f41541a0 msgr2=0x7f15f4066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/773131186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f41541a0 0x7f15f4066ed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f15e4009760 tx=0x7f15e4009060).stop 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 -- 172.21.15.27:0/773131186 shutdown_connections 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/773131186 >> v2:172.21.15.40:3300/0 conn(0x7f15f4153dc0 0x7f15f40626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/773131186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f41541a0 0x7f15f4066ed0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 -- 172.21.15.27:0/773131186 >> 172.21.15.27:0/773131186 conn(0x7f15f4063dd0 msgr2=0x7f15f4067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:15.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 -- 172.21.15.27:0/773131186 shutdown_connections 2023-05-17T15:29:15.070 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.062+0000 7f15fc3bf700 1 -- 172.21.15.27:0/773131186 wait complete. 2023-05-17T15:29:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.063+0000 7f15fc3bf700 1 Processor -- start 2023-05-17T15:29:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.063+0000 7f15fc3bf700 1 -- start start 2023-05-17T15:29:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fc3bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40bcd80 0x7f15f40a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fc3bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f4153dc0 0x7f15f40a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fc3bf700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 0x7f15f4150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fc3bf700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40a8050 con 0x7f15f41541a0 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fc3bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40a8e50 con 0x7f15f40bcd80 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fc3bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40a8240 con 0x7f15f4153dc0 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fa95c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 0x7f15f4150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fa95c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 0x7f15f4150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46304/0 (socket says 172.21.15.27:46304) 2023-05-17T15:29:15.073 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fa95c700 1 -- 172.21.15.27:0/302693920 learned_addr learned my addr 172.21.15.27:0/302693920 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15fa15b700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40bcd80 0x7f15f40a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.064+0000 7f15f995a700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f4153dc0 0x7f15f40a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fa95c700 1 -- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f4153dc0 msgr2=0x7f15f40a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fa95c700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f4153dc0 0x7f15f40a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fa95c700 1 -- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40bcd80 msgr2=0x7f15f40a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fa95c700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40bcd80 0x7f15f40a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:15.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fa95c700 1 -- 172.21.15.27:0/302693920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00092a0 con 0x7f15f41541a0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fa95c700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 0x7f15f4150210 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f15ec00c760 tx=0x7f15ec001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec005d30 con 0x7f15f41541a0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec005e90 con 0x7f15f41541a0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40092a0 con 0x7f15f41541a0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec007300 con 0x7f15f41541a0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.065+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f40a8800 con 0x7f15f41541a0 2023-05-17T15:29:15.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.066+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f4065180 con 0x7f15f41541a0 2023-05-17T15:29:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.066+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f15ec010070 con 0x7f15f41541a0 2023-05-17T15:29:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.066+0000 7f15ea7fc700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15d805ed90 0x7f15d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.067+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5999+0+0 (secure 0 0 0) 0x7f15ec079420 con 0x7f15f41541a0 2023-05-17T15:29:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.067+0000 7f15fa15b700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15d805ed90 0x7f15d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:15.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.067+0000 7f15fa15b700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15d805ed90 0x7f15d8061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f15f0009dc0 tx=0x7f15f0009060).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:15.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.071+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15ec04a930 con 0x7f15f41541a0 2023-05-17T15:29:15.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:15.263+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f15f40bc2a0 con 0x7f15f41541a0 2023-05-17T15:29:16.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.111+0000 7f15ea7fc700 1 -- 172.21.15.27:0/302693920 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v173) v1 ==== 97+0+0 (secure 0 0 0) 0x7f15ec04df50 con 0x7f15f41541a0 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15d805ed90 msgr2=0x7f15d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15d805ed90 0x7f15d8061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f15f0009dc0 tx=0x7f15f0009060).stop 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 msgr2=0x7f15f4150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 0x7f15f4150210 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f15ec00c760 tx=0x7f15ec001520).stop 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 shutdown_connections 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15d805ed90 0x7f15d8061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f41541a0 0x7f15f4150210 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40bcd80 0x7f15f40a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 --2- 172.21.15.27:0/302693920 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15f4153dc0 0x7f15f40a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 >> 172.21.15.27:0/302693920 conn(0x7f15f4063dd0 msgr2=0x7f15f4152530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:16.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 shutdown_connections 2023-05-17T15:29:16.119 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.114+0000 7f15fc3bf700 1 -- 172.21.15.27:0/302693920 wait complete. 2023-05-17T15:29:16.120 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2023-05-17T15:29:16.132 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T15:29:16.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.251+0000 7f16109ec700 1 Processor -- start 2023-05-17T15:29:16.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.251+0000 7f16109ec700 1 -- start start 2023-05-17T15:29:16.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f16109ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f160c1571b0 0x7f160c157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f16109ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 0x7f160c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f16109ec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c0c0120 con 0x7f160c0caf10 2023-05-17T15:29:16.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f16109ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0c6e20 con 0x7f160c1571b0 2023-05-17T15:29:16.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f16109ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0aaa60 con 0x7f160c0c5bf0 2023-05-17T15:29:16.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f160c0caf10 0x7f160c0c74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45878/0 (socket says 172.21.15.27:45878) 2023-05-17T15:29:16.257 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160bfff700 1 -- 172.21.15.27:0/1779397035 learned_addr learned my addr 172.21.15.27:0/1779397035 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127716613 0 0) 0x7f160c0c0120 con 0x7f160c0caf10 2023-05-17T15:29:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160b7fe700 1 --2- 172.21.15.27:0/1779397035 >> v2:172.21.15.40:3300/0 conn(0x7f160c1571b0 0x7f160c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160affd700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 0x7f160c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f40033f0 con 0x7f160c0caf10 2023-05-17T15:29:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.252+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046974470 0 0) 0x7f15f40033f0 con 0x7f160c0caf10 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 msgr2=0x7f160c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 0x7f160c0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 >> v2:172.21.15.40:3300/0 conn(0x7f160c1571b0 msgr2=0x7f160c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 --2- 172.21.15.27:0/1779397035 >> v2:172.21.15.40:3300/0 conn(0x7f160c1571b0 0x7f160c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0cb3a0 con 0x7f160c0caf10 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f16040017f0 con 0x7f160c0caf10 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 >> v1:172.21.15.27:6789/0 conn(0x7f160c0caf10 legacy=0x7f160c0c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f40038e0 0x7f15f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f4004690 0x7f15f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 0x7f15f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c6e20 con 0x7f15f40038e0 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0aaa60 con 0x7f15f4004690 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f400b8e0 con 0x7f160c0c5bf0 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f40038e0 0x7f15f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160bfff700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 0x7f15f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160affd700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f4004690 0x7f15f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 -- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 msgr2=0x7f15f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0c5bf0 0x7f15f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 -- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f4004690 msgr2=0x7f15f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f4004690 0x7f15f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 -- 172.21.15.27:0/1779397035 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40033f0 con 0x7f15f40038e0 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160affd700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f4004690 0x7f15f4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160b7fe700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f40038e0 0x7f15f4003d00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f15fc009a80 tx=0x7f15fc009060).ready entity=mon.0 client_cookie=9f656fc2fb858669 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc009430 con 0x7f15f40038e0 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc00e640 con 0x7f15f40038e0 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.253+0000 7f160a7fc700 1 -- 172.21.15.27:0/1779397035 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00e9c0 con 0x7f15f40038e0 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f16109ec700 1 -- 172.21.15.27:0/1779397035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f40038e0 msgr2=0x7f15f4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f16109ec700 1 --2- 172.21.15.27:0/1779397035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15f40038e0 0x7f15f4003d00 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f15fc009a80 tx=0x7f15fc009060).stop 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f160bfff700 1 -- 172.21.15.27:0/1779397035 reap_dead start 2023-05-17T15:29:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f16109ec700 1 -- 172.21.15.27:0/1779397035 shutdown_connections 2023-05-17T15:29:16.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f16109ec700 1 -- 172.21.15.27:0/1779397035 >> 172.21.15.27:0/1779397035 conn(0x7f160c05dd50 msgr2=0x7f160c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:16.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f16109ec700 1 -- 172.21.15.27:0/1779397035 shutdown_connections 2023-05-17T15:29:16.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.254+0000 7f16109ec700 1 -- 172.21.15.27:0/1779397035 wait complete. 2023-05-17T15:29:16.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.255+0000 7f16109ec700 1 Processor -- start 2023-05-17T15:29:16.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.255+0000 7f16109ec700 1 -- start start 2023-05-17T15:29:16.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f16109ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40038e0 0x7f160c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f16109ec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 0x7f160c0ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f16109ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0adf10 0x7f160c0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f16109ec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c1c50 con 0x7f160c1562f0 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f16109ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c1f30 con 0x7f15f40038e0 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f16109ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c2210 con 0x7f160c0adf10 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 0x7f160c0ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 0x7f160c0ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46326/0 (socket says 172.21.15.27:46326) 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 -- 172.21.15.27:0/2932576413 learned_addr learned my addr 172.21.15.27:0/2932576413 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160b7fe700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40038e0 0x7f160c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160bfff700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0adf10 0x7f160c0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 -- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0adf10 msgr2=0x7f160c0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0adf10 0x7f160c0c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 -- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40038e0 msgr2=0x7f160c151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40038e0 0x7f160c151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 -- 172.21.15.27:0/2932576413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0c24f0 con 0x7f160c1562f0 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160b7fe700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40038e0 0x7f160c151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160bfff700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0adf10 0x7f160c0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:16.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.256+0000 7f160affd700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 0x7f160c0ada20 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f1600011960 tx=0x7f1600008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.257+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000f6d0 con 0x7f160c1562f0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.257+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000f830 con 0x7f160c1562f0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.257+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c0c27d0 con 0x7f160c1562f0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.257+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000fbb0 con 0x7f160c1562f0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.257+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c0c4580 con 0x7f160c1562f0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.258+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c0c29c0 con 0x7f160c1562f0 2023-05-17T15:29:16.269 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.258+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1600025070 con 0x7f160c1562f0 2023-05-17T15:29:16.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.258+0000 7f15f37fe700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15f805edc0 0x7f15f8061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.258+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f160007a050 con 0x7f160c1562f0 2023-05-17T15:29:16.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.258+0000 7f160b7fe700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15f805edc0 0x7f15f8061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.259+0000 7f160b7fe700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15f805edc0 0x7f15f8061280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f160c0ad560 tx=0x7f15fc01a000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.270 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.263+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f160004b8c0 con 0x7f160c1562f0 2023-05-17T15:29:16.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.500+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f160c06bdf0 con 0x7f160c1562f0 2023-05-17T15:29:16.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.501+0000 7f15f37fe700 1 -- 172.21.15.27:0/2932576413 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f160004eee0 con 0x7f160c1562f0 2023-05-17T15:29:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:16.505 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2023-05-17T15:29:16.505 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkum+rEhAAwwFjBl2e/JwOU4NQttPiVA==", 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:29:16.506 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2023-05-17T15:29:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkgYjOHRAAjQTxnkloYQ+k45qduZomyw==", 2023-05-17T15:29:16.507 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.508 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkJP9jGRAAKxsTBPilN5C8ebgnI1e2MQ==", 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkcJ6zJBAAonipxf3S30Q0rYm5nkFr6Q==", 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.510 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:29:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:29:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.511 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBR6mRklTLOHhAA/CHLI69tOFV56DWeqJCa+Q==", 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.512 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBU6mRkDMmXHRAAelV6dyDAgMotYdzBYD4DOw==", 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.513 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBX6mRkqg+9GxAAISBMTaPVCmAqRp8InEVsYg==", 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.514 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBa6mRkObFBGhAAChcsYy0ut4D88GER1S3IFQ==", 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.515 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBf6mRkmF8lORAAUARuzAhSw49gYn1rWULO3g==", 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.516 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2023-05-17T15:29:16.517 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBj6mRkQ04XABAAXr8fzJDXsWUJ1yuc7LPnAA==", 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.518 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBm6mRkb9f9ABAA2z1YokY7iQEFnjUqTbcSnw==", 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2023-05-17T15:29:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBo6mRkHluQOxAAqVI564qBMWRJzXEEgAsjHg==", 2023-05-17T15:29:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2023-05-17T15:29:16.520 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk+lh9KBAAXgC8aFT+18Rvhd1/Q6Nm8Q==", 2023-05-17T15:29:16.521 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow r", 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rw pool=cephfs_data" 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.522 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk2QrpMBAA7fOUfK00z6m+YdqUW0A3GQ==", 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkbJHTLRAAqnrqdTEDfP6j5rbtIBMYNw==", 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:29:16.524 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkydVPNhAA9rRiPjMEBSxM9iMqaJog3w==", 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.525 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2023-05-17T15:29:16.526 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBN6mRk1EydMxAA0PSjKXLh723qlzPARps2vA==", 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRk8wenDxAABPGYayh66DooCnP99G5Hsg==", 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQBO6mRkAEw7DBAAP0AjByVviD92feDZZMPP0A==", 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2023-05-17T15:29:16.529 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2023-05-17T15:29:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2023-05-17T15:29:16.530 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:16.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15f805edc0 msgr2=0x7f15f8061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15f805edc0 0x7f15f8061280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f160c0ad560 tx=0x7f15fc01a000).stop 2023-05-17T15:29:16.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 msgr2=0x7f160c0ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 0x7f160c0ada20 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f1600011960 tx=0x7f1600008040).stop 2023-05-17T15:29:16.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 shutdown_connections 2023-05-17T15:29:16.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f15f805edc0 0x7f15f8061280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f160c0adf10 0x7f160c0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f40038e0 0x7f160c151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 --2- 172.21.15.27:0/2932576413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f160c1562f0 0x7f160c0ada20 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.502+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 >> 172.21.15.27:0/2932576413 conn(0x7f160c05dd50 msgr2=0x7f160c0c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:16.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.503+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 shutdown_connections 2023-05-17T15:29:16.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.503+0000 7f16109ec700 1 -- 172.21.15.27:0/2932576413 wait complete. 2023-05-17T15:29:16.534 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.646+0000 7f9e9da67700 1 Processor -- start 2023-05-17T15:29:16.650 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.646+0000 7f9e9da67700 1 -- start start 2023-05-17T15:29:16.651 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e9da67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98153fa0 0x7f9e980c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e9da67700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9e98069770 0x7f9e980c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e9da67700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e980c07a0 con 0x7f9e980aae70 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e9da67700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e98069d70 con 0x7f9e98069770 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e9da67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980c6760 con 0x7f9e98153fa0 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e97fff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9e98069770 0x7f9e980c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e96ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9e980aae70 0x7f9e98069060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45896/0 (socket says 172.21.15.27:45896) 2023-05-17T15:29:16.652 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e96ffd700 1 -- 172.21.15.27:0/2628418448 learned_addr learned my addr 172.21.15.27:0/2628418448 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e977fe700 1 --2- 172.21.15.27:0/2628418448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98153fa0 0x7f9e980c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e97fff700 1 -- 172.21.15.27:0/2628418448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98153fa0 msgr2=0x7f9e980c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e97fff700 1 --2- 172.21.15.27:0/2628418448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98153fa0 0x7f9e980c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.647+0000 7f9e97fff700 1 -- 172.21.15.27:0/2628418448 >> v1:172.21.15.27:6789/0 conn(0x7f9e980aae70 legacy=0x7f9e98069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e967fc700 1 -- 172.21.15.27:0/2628418448 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533112111 0 0) 0x7f9e980c07a0 con 0x7f9e980aae70 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e97fff700 1 -- 172.21.15.27:0/2628418448 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980c1c40 con 0x7f9e98069770 2023-05-17T15:29:16.653 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e97fff700 1 --2- 172.21.15.27:0/2628418448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e98069770 0x7f9e980c6270 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f9e90009e60 tx=0x7f9e90009780).ready entity=mon.0 client_cookie=9ef709b3dd6258a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e967fc700 1 -- 172.21.15.27:0/2628418448 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000e070 con 0x7f9e98069770 2023-05-17T15:29:16.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e967fc700 1 -- 172.21.15.27:0/2628418448 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000bb60 con 0x7f9e98069770 2023-05-17T15:29:16.654 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e967fc700 1 -- 172.21.15.27:0/2628418448 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90012410 con 0x7f9e98069770 2023-05-17T15:29:16.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 -- 172.21.15.27:0/2628418448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e98069770 msgr2=0x7f9e980c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2628418448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e98069770 0x7f9e980c6270 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f9e90009e60 tx=0x7f9e90009780).stop 2023-05-17T15:29:16.656 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 -- 172.21.15.27:0/2628418448 shutdown_connections 2023-05-17T15:29:16.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2628418448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e98069770 0x7f9e980c6270 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2628418448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98153fa0 0x7f9e980c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 -- 172.21.15.27:0/2628418448 >> 172.21.15.27:0/2628418448 conn(0x7f9e980cb810 msgr2=0x7f9e980c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:16.657 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 -- 172.21.15.27:0/2628418448 shutdown_connections 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.648+0000 7f9e9da67700 1 -- 172.21.15.27:0/2628418448 wait complete. 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 Processor -- start 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 -- start start 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98069770 0x7f9e980a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 0x7f9e980c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e98153fa0 0x7f9e9814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.658 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980c2900 con 0x7f9e980aae70 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980c2300 con 0x7f9e98153fa0 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.650+0000 7f9e9da67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980c2b50 con 0x7f9e98069770 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 0x7f9e980c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 0x7f9e980c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46340/0 (socket says 172.21.15.27:46340) 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 -- 172.21.15.27:0/2519153818 learned_addr learned my addr 172.21.15.27:0/2519153818 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e97fff700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e98153fa0 0x7f9e9814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.659 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e977fe700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98069770 0x7f9e980a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 -- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98069770 msgr2=0x7f9e980a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98069770 0x7f9e980a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 -- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e98153fa0 msgr2=0x7f9e9814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e98153fa0 0x7f9e9814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 -- 172.21.15.27:0/2519153818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90009a20 con 0x7f9e980aae70 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e96ffd700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 0x7f9e980c1e10 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f9e8c00c440 tx=0x7f9e8c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0070d0 con 0x7f9e980aae70 2023-05-17T15:29:16.660 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c007230 con 0x7f9e980aae70 2023-05-17T15:29:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e980c2e30 con 0x7f9e980aae70 2023-05-17T15:29:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c005670 con 0x7f9e980aae70 2023-05-17T15:29:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.651+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9814ce00 con 0x7f9e980aae70 2023-05-17T15:29:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.652+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e98151960 con 0x7f9e980aae70 2023-05-17T15:29:16.661 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.652+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9e8c010070 con 0x7f9e980aae70 2023-05-17T15:29:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.653+0000 7f9e7f7fe700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9e8405ed90 0x7f9e84061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.653+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f9e8c078d50 con 0x7f9e980aae70 2023-05-17T15:29:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.653+0000 7f9e977fe700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9e8405ed90 0x7f9e84061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.653+0000 7f9e977fe700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9e8405ed90 0x7f9e84061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9e88009c30 tx=0x7f9e88009060).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.662 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.657+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e98151960 con 0x7f9e980aae70 2023-05-17T15:29:16.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.833+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e9806bdf0 con 0x7f9e980aae70 2023-05-17T15:29:16.837 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.834+0000 7f9e7f7fe700 1 -- 172.21.15.27:0/2519153818 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+13927 (secure 0 0 0) 0x7f9e8c04a5c0 con 0x7f9e980aae70 2023-05-17T15:29:16.838 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:16.838 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":173,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:16.105167+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:16.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9e8405ed90 msgr2=0x7f9e84061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9e8405ed90 0x7f9e84061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9e88009c30 tx=0x7f9e88009060).stop 2023-05-17T15:29:16.840 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 msgr2=0x7f9e980c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 0x7f9e980c1e10 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f9e8c00c440 tx=0x7f9e8c007a40).stop 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 shutdown_connections 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f9e8405ed90 0x7f9e84061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e98153fa0 0x7f9e9814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e98069770 0x7f9e980a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 --2- 172.21.15.27:0/2519153818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e980aae70 0x7f9e980c1e10 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 >> 172.21.15.27:0/2519153818 conn(0x7f9e980cb810 msgr2=0x7f9e980abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:16.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 shutdown_connections 2023-05-17T15:29:16.842 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.836+0000 7f9e9da67700 1 -- 172.21.15.27:0/2519153818 wait complete. 2023-05-17T15:29:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-17T15:29:16.853 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:29:16.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.968+0000 7f90ae88e700 1 Processor -- start 2023-05-17T15:29:16.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.968+0000 7f90ae88e700 1 -- start start 2023-05-17T15:29:16.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ae88e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ae88e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a8158010 con 0x7f90a80cac00 2023-05-17T15:29:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ae88e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a81582f0 con 0x7f90a8157980 2023-05-17T15:29:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ae88e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81588b0 con 0x7f90a8153ef0 2023-05-17T15:29:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad88c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f90a80cac00 0x7f90a81537e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45908/0 (socket says 172.21.15.27:45908) 2023-05-17T15:29:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad88c700 1 -- 172.21.15.27:0/427148674 learned_addr learned my addr 172.21.15.27:0/427148674 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:16.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad08b700 1 --2- 172.21.15.27:0/427148674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304696023 0 0) 0x7f90a8158010 con 0x7f90a80cac00 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90900033f0 con 0x7f90a80cac00 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561553476 0 0) 0x7f90a81582f0 con 0x7f90a8157980 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a8158010 con 0x7f90a8157980 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad08b700 1 -- 172.21.15.27:0/427148674 >> v1:172.21.15.40:6789/0 conn(0x7f90a8157980 legacy=0x7f90a80c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad08b700 1 -- 172.21.15.27:0/427148674 >> v1:172.21.15.27:6789/0 conn(0x7f90a80cac00 legacy=0x7f90a81537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad08b700 1 -- 172.21.15.27:0/427148674 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a81585d0 con 0x7f90a8153ef0 2023-05-17T15:29:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.969+0000 7f90ad08b700 1 --2- 172.21.15.27:0/427148674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80cafe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f909c0097c0 tx=0x7f909c009060).ready entity=mon.2 client_cookie=5679a4a53e6ba7a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c00d4a0 con 0x7f90a8153ef0 2023-05-17T15:29:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c00d600 con 0x7f90a8153ef0 2023-05-17T15:29:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ac88a700 1 -- 172.21.15.27:0/427148674 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c00d980 con 0x7f90a8153ef0 2023-05-17T15:29:16.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 -- 172.21.15.27:0/427148674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 msgr2=0x7f90a80cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 --2- 172.21.15.27:0/427148674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80cafe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f909c0097c0 tx=0x7f909c009060).stop 2023-05-17T15:29:16.978 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 -- 172.21.15.27:0/427148674 shutdown_connections 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 --2- 172.21.15.27:0/427148674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80cafe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 -- 172.21.15.27:0/427148674 >> 172.21.15.27:0/427148674 conn(0x7f90a805dd50 msgr2=0x7f90a805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 -- 172.21.15.27:0/427148674 shutdown_connections 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.970+0000 7f90ae88e700 1 -- 172.21.15.27:0/427148674 wait complete. 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.971+0000 7f90ae88e700 1 Processor -- start 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.971+0000 7f90ae88e700 1 -- start start 2023-05-17T15:29:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae88e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a80cac00 0x7f90a80c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae88e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae88e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 0x7f90a8155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae88e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8155660 con 0x7f90a8157980 2023-05-17T15:29:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae88e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8154740 con 0x7f90a80cac00 2023-05-17T15:29:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae88e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80adee0 con 0x7f90a8153ef0 2023-05-17T15:29:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae08d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 0x7f90a8155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae08d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 0x7f90a8155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46356/0 (socket says 172.21.15.27:46356) 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ae08d700 1 -- 172.21.15.27:0/1749442949 learned_addr learned my addr 172.21.15.27:0/1749442949 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ad88c700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a80cac00 0x7f90a80c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.972+0000 7f90ad08b700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae08d700 1 -- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 msgr2=0x7f90a80aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae08d700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae08d700 1 -- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a80cac00 msgr2=0x7f90a80c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae08d700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a80cac00 0x7f90a80c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae08d700 1 -- 172.21.15.27:0/1749442949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0092a0 con 0x7f90a8157980 2023-05-17T15:29:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae08d700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 0x7f90a8155a80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f909800c790 tx=0x7f9098007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800e4a0 con 0x7f90a8157980 2023-05-17T15:29:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800e600 con 0x7f90a8157980 2023-05-17T15:29:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a80c4310 con 0x7f90a8157980 2023-05-17T15:29:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800e980 con 0x7f90a8157980 2023-05-17T15:29:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.973+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a8154a90 con 0x7f90a8157980 2023-05-17T15:29:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.974+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a80c4e30 con 0x7f90a8157980 2023-05-17T15:29:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.974+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9098019030 con 0x7f90a8157980 2023-05-17T15:29:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.975+0000 7f90a5ffb700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f909405ed60 0x7f9094061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.975+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f9098078e00 con 0x7f90a8157980 2023-05-17T15:29:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.975+0000 7f90ad88c700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f909405ed60 0x7f9094061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.975+0000 7f90ad88c700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f909405ed60 0x7f9094061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f90a0005750 tx=0x7f90a0009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:16.979+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90980488f0 con 0x7f90a8157980 2023-05-17T15:29:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.151+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f90a8047150 con 0x7f90a8157980 2023-05-17T15:29:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.151+0000 7f90a5ffb700 1 -- 172.21.15.27:0/1749442949 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v173) v1 ==== 110+0+10 (secure 0 0 0) 0x7f909804a610 con 0x7f90a8157980 2023-05-17T15:29:17.155 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:29:17.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f909405ed60 msgr2=0x7f9094061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f909405ed60 0x7f9094061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f90a0005750 tx=0x7f90a0009040).stop 2023-05-17T15:29:17.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 msgr2=0x7f90a8155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 0x7f90a8155a80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f909800c790 tx=0x7f9098007f40).stop 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 shutdown_connections 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f909405ed60 0x7f9094061220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90a8157980 0x7f90a8155a80 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a80cac00 0x7f90a80c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 --2- 172.21.15.27:0/1749442949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90a8153ef0 0x7f90a80aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 >> 172.21.15.27:0/1749442949 conn(0x7f90a805dd50 msgr2=0x7f90a814fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 shutdown_connections 2023-05-17T15:29:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.153+0000 7f90ae88e700 1 -- 172.21.15.27:0/1749442949 wait complete. 2023-05-17T15:29:17.169 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:29:17.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.283+0000 7f437ef32700 1 Processor -- start 2023-05-17T15:29:17.288 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.283+0000 7f437ef32700 1 -- start start 2023-05-17T15:29:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437ef32700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f43781543d0 0x7f43780c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437ef32700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4378069410 0x7f43780bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437ef32700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4378158790 con 0x7f43780c60f0 2023-05-17T15:29:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437ef32700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43780c1c50 con 0x7f4378069410 2023-05-17T15:29:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437ef32700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43780c6570 con 0x7f43781543d0 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437d4cf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4378069410 0x7f43780bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437d4cf700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4378069410 0x7f43780bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46360/0 (socket says 172.21.15.27:46360) 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437d4cf700 1 -- 172.21.15.27:0/3851689239 learned_addr learned my addr 172.21.15.27:0/3851689239 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.284+0000 7f437ccce700 1 --2- 172.21.15.27:0/3851689239 >> v2:172.21.15.40:3300/0 conn(0x7f43781543d0 0x7f43780c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437d4cf700 1 -- 172.21.15.27:0/3851689239 >> v2:172.21.15.40:3300/0 conn(0x7f43781543d0 msgr2=0x7f43780c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437d4cf700 1 --2- 172.21.15.27:0/3851689239 >> v2:172.21.15.40:3300/0 conn(0x7f43781543d0 0x7f43780c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437d4cf700 1 -- 172.21.15.27:0/3851689239 >> v1:172.21.15.40:6789/0 conn(0x7f43780c60f0 legacy=0x7f4378068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437d4cf700 1 -- 172.21.15.27:0/3851689239 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378157e60 con 0x7f4378069410 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437d4cf700 1 --2- 172.21.15.27:0/3851689239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4378069410 0x7f43780bfc80 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f4378155970 tx=0x7f43680090f0).ready entity=mon.0 client_cookie=a3042755bf56d39e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f43777fe700 1 -- 172.21.15.27:0/3851689239 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800b5a0 con 0x7f4378069410 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f43777fe700 1 -- 172.21.15.27:0/3851689239 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436800b700 con 0x7f4378069410 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f43777fe700 1 -- 172.21.15.27:0/3851689239 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800ba80 con 0x7f4378069410 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 -- 172.21.15.27:0/3851689239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4378069410 msgr2=0x7f43780bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 --2- 172.21.15.27:0/3851689239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4378069410 0x7f43780bfc80 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f4378155970 tx=0x7f43680090f0).stop 2023-05-17T15:29:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 -- 172.21.15.27:0/3851689239 shutdown_connections 2023-05-17T15:29:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 --2- 172.21.15.27:0/3851689239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4378069410 0x7f43780bfc80 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 --2- 172.21.15.27:0/3851689239 >> v2:172.21.15.40:3300/0 conn(0x7f43781543d0 0x7f43780c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 -- 172.21.15.27:0/3851689239 >> 172.21.15.27:0/3851689239 conn(0x7f43780cb7f0 msgr2=0x7f43780c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 -- 172.21.15.27:0/3851689239 shutdown_connections 2023-05-17T15:29:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.285+0000 7f437ef32700 1 -- 172.21.15.27:0/3851689239 wait complete. 2023-05-17T15:29:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.286+0000 7f437ef32700 1 Processor -- start 2023-05-17T15:29:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 -- start start 2023-05-17T15:29:17.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4378069410 0x7f43780a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 0x7f43781521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43781543d0 0x7f43781547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43780b0e60 con 0x7f43780c60f0 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43780c3a60 con 0x7f43781543d0 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f437ef32700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43780b0b80 con 0x7f4378069410 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f4377fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 0x7f43781521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.287+0000 7f4377fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 0x7f43781521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46368/0 (socket says 172.21.15.27:46368) 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 -- 172.21.15.27:0/2352906591 learned_addr learned my addr 172.21.15.27:0/2352906591 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f437d4cf700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43781543d0 0x7f43781547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f437ccce700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4378069410 0x7f43780a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 -- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4378069410 msgr2=0x7f43780a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4378069410 0x7f43780a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 -- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43781543d0 msgr2=0x7f43781547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43781543d0 0x7f43781547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 -- 172.21.15.27:0/2352906591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009370 con 0x7f43780c60f0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4377fff700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 0x7f43781521f0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f436000c470 tx=0x7f4360007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360012400 con 0x7f43780c60f0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360012580 con 0x7f43780c60f0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4378167a20 con 0x7f43780c60f0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360012940 con 0x7f43780c60f0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.288+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4378167fe0 con 0x7f43780c60f0 2023-05-17T15:29:17.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.289+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437806bdf0 con 0x7f43780c60f0 2023-05-17T15:29:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.289+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4360019030 con 0x7f43780c60f0 2023-05-17T15:29:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.290+0000 7f4374ff9700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f435805ed90 0x7f4358061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.290+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f4360078cf0 con 0x7f43780c60f0 2023-05-17T15:29:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.290+0000 7f437ccce700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f435805ed90 0x7f4358061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.290+0000 7f437ccce700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f435805ed90 0x7f4358061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f43700075a0 tx=0x7f43700097e0).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.294+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43600488f0 con 0x7f43780c60f0 2023-05-17T15:29:17.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.467+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4378158140 con 0x7f43780c60f0 2023-05-17T15:29:17.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.467+0000 7f4374ff9700 1 -- 172.21.15.27:0/2352906591 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v173) v1 ==== 92+0+10 (secure 0 0 0) 0x7f436004a610 con 0x7f43780c60f0 2023-05-17T15:29:17.471 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:29:17.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f435805ed90 msgr2=0x7f4358061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f435805ed90 0x7f4358061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f43700075a0 tx=0x7f43700097e0).stop 2023-05-17T15:29:17.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 msgr2=0x7f43781521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 0x7f43781521f0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f436000c470 tx=0x7f4360007de0).stop 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 shutdown_connections 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f435805ed90 0x7f4358061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43781543d0 0x7f43781547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4378069410 0x7f43780a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 --2- 172.21.15.27:0/2352906591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43780c60f0 0x7f43781521f0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 >> 172.21.15.27:0/2352906591 conn(0x7f43780cb7f0 msgr2=0x7f43780accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:17.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 shutdown_connections 2023-05-17T15:29:17.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.469+0000 7f437ef32700 1 -- 172.21.15.27:0/2352906591 wait complete. 2023-05-17T15:29:17.485 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T15:29:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.597+0000 7fb5685c2700 1 Processor -- start 2023-05-17T15:29:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.597+0000 7fb5685c2700 1 -- start start 2023-05-17T15:29:17.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb5685c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c6310 0x7fb560153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb5685c2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600bfcd0 con 0x7fb5600c5f30 2023-05-17T15:29:17.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb5685c2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600c0290 con 0x7fb5601541c0 2023-05-17T15:29:17.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb5685c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600aa1a0 con 0x7fb5600c6310 2023-05-17T15:29:17.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb56635e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb5600c5f30 0x7fb560158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45936/0 (socket says 172.21.15.27:45936) 2023-05-17T15:29:17.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb56635e700 1 -- 172.21.15.27:0/1601658648 learned_addr learned my addr 172.21.15.27:0/1601658648 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:17.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb565b5d700 1 --2- 172.21.15.27:0/1601658648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c6310 0x7fb560153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973891837 0 0) 0x7fb5600bfcd0 con 0x7fb5600c5f30 2023-05-17T15:29:17.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.598+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5480033f0 con 0x7fb5600c5f30 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142821075 0 0) 0x7fb5600c0290 con 0x7fb5601541c0 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5600bfcd0 con 0x7fb5601541c0 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572411104 0 0) 0x7fb5480033f0 con 0x7fb5600c5f30 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb565b5d700 1 -- 172.21.15.27:0/1601658648 >> v1:172.21.15.40:6789/0 conn(0x7fb5601541c0 legacy=0x7fb5600c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb565b5d700 1 -- 172.21.15.27:0/1601658648 >> v1:172.21.15.27:6789/0 conn(0x7fb5600c5f30 legacy=0x7fb560158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb565b5d700 1 -- 172.21.15.27:0/1601658648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600aa480 con 0x7fb5600c6310 2023-05-17T15:29:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb565b5d700 1 --2- 172.21.15.27:0/1601658648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c6310 0x7fb560153cd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb554009790 tx=0x7fb554009060).ready entity=mon.2 client_cookie=26b110934aaaae7a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558001470 con 0x7fb5600c6310 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554011400 con 0x7fb5600c6310 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.599+0000 7fb56535c700 1 -- 172.21.15.27:0/1601658648 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011780 con 0x7fb5600c6310 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 -- 172.21.15.27:0/1601658648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c6310 msgr2=0x7fb560153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 --2- 172.21.15.27:0/1601658648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c6310 0x7fb560153cd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb554009790 tx=0x7fb554009060).stop 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 -- 172.21.15.27:0/1601658648 shutdown_connections 2023-05-17T15:29:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 --2- 172.21.15.27:0/1601658648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c6310 0x7fb560153cd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 -- 172.21.15.27:0/1601658648 >> 172.21.15.27:0/1601658648 conn(0x7fb560069e70 msgr2=0x7fb56005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 -- 172.21.15.27:0/1601658648 shutdown_connections 2023-05-17T15:29:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.600+0000 7fb5685c2700 1 -- 172.21.15.27:0/1601658648 wait complete. 2023-05-17T15:29:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 Processor -- start 2023-05-17T15:29:17.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 -- start start 2023-05-17T15:29:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c5f30 0x7fb5600c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5600c6310 0x7fb5601679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 0x7fb560155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601558f0 con 0x7fb5601541c0 2023-05-17T15:29:17.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c2870 con 0x7fb5600c6310 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.601+0000 7fb5685c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c1f40 con 0x7fb5600c5f30 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 0x7fb560155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 0x7fb560155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46384/0 (socket says 172.21.15.27:46384) 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 -- 172.21.15.27:0/4147492229 learned_addr learned my addr 172.21.15.27:0/4147492229 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb565b5d700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5600c6310 0x7fb5601679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb56635e700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c5f30 0x7fb5600c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 -- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c5f30 msgr2=0x7fb5600c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c5f30 0x7fb5600c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 -- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5600c6310 msgr2=0x7fb5601679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5600c6310 0x7fb5601679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 -- 172.21.15.27:0/4147492229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540092a0 con 0x7fb5601541c0 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb566b5f700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 0x7fb560155060 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fb55000c710 tx=0x7fb55000ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e4a0 con 0x7fb5601541c0 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000e600 con 0x7fb5601541c0 2023-05-17T15:29:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600c2220 con 0x7fb5601541c0 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e980 con 0x7fb5601541c0 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.602+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb560155550 con 0x7fb5601541c0 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.603+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56005f4a0 con 0x7fb5601541c0 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.604+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb550019030 con 0x7fb5601541c0 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.604+0000 7fb55e7fc700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb54c05ed90 0x7fb54c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.604+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5397+0+0 (secure 0 0 0) 0x7fb550078d80 con 0x7fb5601541c0 2023-05-17T15:29:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.604+0000 7fb56635e700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb54c05ed90 0x7fb54c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.604+0000 7fb56635e700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb54c05ed90 0x7fb54c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb558001660 tx=0x7fb5580018f0).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.608+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5500488f0 con 0x7fb5601541c0 2023-05-17T15:29:17.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.785+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb56006bdf0 con 0x7fb5601541c0 2023-05-17T15:29:17.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.785+0000 7fb55e7fc700 1 -- 172.21.15.27:0/4147492229 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v173) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb55007a070 con 0x7fb5601541c0 2023-05-17T15:29:17.789 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "device_health_metrics" 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:17.790 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 2, 2023-05-17T15:29:17.791 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": "rbd" 2023-05-17T15:29:17.791 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:17.791 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:29:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb54c05ed90 msgr2=0x7fb54c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb54c05ed90 0x7fb54c061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb558001660 tx=0x7fb5580018f0).stop 2023-05-17T15:29:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 msgr2=0x7fb560155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 0x7fb560155060 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fb55000c710 tx=0x7fb55000ca20).stop 2023-05-17T15:29:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 shutdown_connections 2023-05-17T15:29:17.792 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb54c05ed90 0x7fb54c061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5601541c0 0x7fb560155060 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5600c5f30 0x7fb5600c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 --2- 172.21.15.27:0/4147492229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5600c6310 0x7fb5601679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 >> 172.21.15.27:0/4147492229 conn(0x7fb560069e70 msgr2=0x7fb5600c0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:17.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 shutdown_connections 2023-05-17T15:29:17.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.787+0000 7fb5685c2700 1 -- 172.21.15.27:0/4147492229 wait complete. 2023-05-17T15:29:17.803 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T15:29:17.803 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-17T15:29:17.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.920+0000 7f7edd1b6700 1 Processor -- start 2023-05-17T15:29:17.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.920+0000 7f7edd1b6700 1 -- start start 2023-05-17T15:29:17.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7edd1b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ed8152070 0x7f7ed8154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7edd1b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed8081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7edd1b6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed8158010 con 0x7f7ed8151c90 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7edd1b6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed8154f60 con 0x7f7ed8152070 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7edd1b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8155240 con 0x7f7ed80c0520 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed8081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ed8152070 0x7f7ed8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed6d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ed8151c90 0x7f7ed80c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:51952/0 (socket says 172.21.15.27:51952) 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed6d9d700 1 -- 172.21.15.27:0/100469778 learned_addr learned my addr 172.21.15.27:0/100469778 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed5d9b700 1 -- 172.21.15.27:0/100469778 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608709007 0 0) 0x7f7ed8158010 con 0x7f7ed8151c90 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed5d9b700 1 -- 172.21.15.27:0/100469778 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec40033f0 con 0x7f7ed8151c90 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed759e700 1 -- 172.21.15.27:0/100469778 >> v2:172.21.15.40:3300/0 conn(0x7f7ed8152070 msgr2=0x7f7ed8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed759e700 1 --2- 172.21.15.27:0/100469778 >> v2:172.21.15.40:3300/0 conn(0x7f7ed8152070 0x7f7ed8154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed759e700 1 -- 172.21.15.27:0/100469778 >> v1:172.21.15.40:6789/0 conn(0x7f7ed8151c90 legacy=0x7f7ed80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed759e700 1 -- 172.21.15.27:0/100469778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8155520 con 0x7f7ed80c0520 2023-05-17T15:29:17.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed659c700 1 --2- 172.21.15.27:0/100469778 >> v2:172.21.15.40:3300/0 conn(0x7f7ed8152070 0x7f7ed8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:17.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.921+0000 7f7ed759e700 1 --2- 172.21.15.27:0/100469778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed8081fd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f7ed0009760 tx=0x7f7ed0009060).ready entity=mon.2 client_cookie=bac8b13fb0b9c949 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7ed5d9b700 1 -- 172.21.15.27:0/100469778 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000d4a0 con 0x7f7ed80c0520 2023-05-17T15:29:17.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7ed5d9b700 1 -- 172.21.15.27:0/100469778 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed000d600 con 0x7f7ed80c0520 2023-05-17T15:29:17.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7ed5d9b700 1 -- 172.21.15.27:0/100469778 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000d980 con 0x7f7ed80c0520 2023-05-17T15:29:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 -- 172.21.15.27:0/100469778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 msgr2=0x7f7ed8081fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/100469778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed8081fd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f7ed0009760 tx=0x7f7ed0009060).stop 2023-05-17T15:29:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 -- 172.21.15.27:0/100469778 shutdown_connections 2023-05-17T15:29:17.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/100469778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed8081fd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/100469778 >> v2:172.21.15.40:3300/0 conn(0x7f7ed8152070 0x7f7ed8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 -- 172.21.15.27:0/100469778 >> 172.21.15.27:0/100469778 conn(0x7f7ed80cae10 msgr2=0x7f7ed80cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 -- 172.21.15.27:0/100469778 shutdown_connections 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.922+0000 7f7edd1b6700 1 -- 172.21.15.27:0/100469778 wait complete. 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.923+0000 7f7edd1b6700 1 Processor -- start 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.923+0000 7f7edd1b6700 1 -- start start 2023-05-17T15:29:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7edd1b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed80c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7edd1b6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 0x7f7ed8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7edd1b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed8152070 0x7f7ed8153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7edd1b6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8164480 con 0x7f7ed8151c90 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7edd1b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8164720 con 0x7f7ed8152070 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7edd1b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8164a00 con 0x7f7ed80c0520 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7ed659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 0x7f7ed8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7ed659c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 0x7f7ed8150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46396/0 (socket says 172.21.15.27:46396) 2023-05-17T15:29:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7ed659c700 1 -- 172.21.15.27:0/854868051 learned_addr learned my addr 172.21.15.27:0/854868051 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7ed6d9d700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed80c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.924+0000 7f7ed759e700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed8152070 0x7f7ed8153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed659c700 1 -- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 msgr2=0x7f7ed80c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed659c700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed80c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed659c700 1 -- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed8152070 msgr2=0x7f7ed8153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed659c700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed8152070 0x7f7ed8153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed659c700 1 -- 172.21.15.27:0/854868051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0009a20 con 0x7f7ed8151c90 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed6d9d700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed80c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7ed659c700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 0x7f7ed8150b70 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f7ec000c170 tx=0x7f7ec000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000ccb0 con 0x7f7ed8151c90 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000f040 con 0x7f7ed8151c90 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed00092a0 con 0x7f7ed8151c90 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0013400 con 0x7f7ed8151c90 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.925+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8151060 con 0x7f7ed8151c90 2023-05-17T15:29:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.926+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8164ea0 con 0x7f7ed8151c90 2023-05-17T15:29:17.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.926+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ec00137b0 con 0x7f7ed8151c90 2023-05-17T15:29:17.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.927+0000 7f7eceffd700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7eb805ed60 0x7f7eb8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:17.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.927+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f7ec007a300 con 0x7f7ed8151c90 2023-05-17T15:29:17.935 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.927+0000 7f7ed6d9d700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7eb805ed60 0x7f7eb8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:17.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.927+0000 7f7ed6d9d700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7eb805ed60 0x7f7eb8061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7ec8007fd0 tx=0x7f7ec8009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:17.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:17.931+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ec004bb70 con 0x7f7ed8151c90 2023-05-17T15:29:18.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.107+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f7ed8165050 con 0x7f7ed8151c90 2023-05-17T15:29:18.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.198+0000 7f7eceffd700 1 -- 172.21.15.27:0/854868051 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v174) v1 ==== 152+0+0 (secure 0 0 0) 0x7f7ec004f190 con 0x7f7ed8151c90 2023-05-17T15:29:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7eb805ed60 msgr2=0x7f7eb8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7eb805ed60 0x7f7eb8061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7ec8007fd0 tx=0x7f7ec8009040).stop 2023-05-17T15:29:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 msgr2=0x7f7ed8150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 0x7f7ed8150b70 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f7ec000c170 tx=0x7f7ec000b040).stop 2023-05-17T15:29:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 shutdown_connections 2023-05-17T15:29:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f7eb805ed60 0x7f7eb8061220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed8152070 0x7f7ed8153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ed80c0520 0x7f7ed80c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 --2- 172.21.15.27:0/854868051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ed8151c90 0x7f7ed8150b70 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 >> 172.21.15.27:0/854868051 conn(0x7f7ed80cae10 msgr2=0x7f7ed8081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.201+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 shutdown_connections 2023-05-17T15:29:18.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.202+0000 7f7edd1b6700 1 -- 172.21.15.27:0/854868051 wait complete. 2023-05-17T15:29:18.207 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2023-05-17T15:29:18.221 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T15:29:18.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.340+0000 7f9505dc1700 1 Processor -- start 2023-05-17T15:29:18.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.340+0000 7f9505dc1700 1 -- start start 2023-05-17T15:29:18.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f9505dc1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95001543d0 0x7f95000c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f9505dc1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f9505dc1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95000691f0 0x7f95001547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f9505dc1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000c1c50 con 0x7f95001543d0 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f9505dc1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9500158790 con 0x7f95000691f0 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f9505dc1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c6570 con 0x7f95000c60f0 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f94ff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95001543d0 0x7f95000c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f94ff7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f95001543d0 0x7f95000c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46402/0 (socket says 172.21.15.27:46402) 2023-05-17T15:29:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f94ff7fe700 1 -- 172.21.15.27:0/1688772113 learned_addr learned my addr 172.21.15.27:0/1688772113 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.341+0000 7f94fffff700 1 --2- 172.21.15.27:0/1688772113 >> v2:172.21.15.40:3300/0 conn(0x7f95000691f0 0x7f95001547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94f7fff700 1 --2- 172.21.15.27:0/1688772113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94ff7fe700 1 -- 172.21.15.27:0/1688772113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 msgr2=0x7f9500068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94ff7fe700 1 --2- 172.21.15.27:0/1688772113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94ff7fe700 1 -- 172.21.15.27:0/1688772113 >> v2:172.21.15.40:3300/0 conn(0x7f95000691f0 msgr2=0x7f95001547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94ff7fe700 1 --2- 172.21.15.27:0/1688772113 >> v2:172.21.15.40:3300/0 conn(0x7f95000691f0 0x7f95001547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94ff7fe700 1 -- 172.21.15.27:0/1688772113 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500157e60 con 0x7f95001543d0 2023-05-17T15:29:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94ff7fe700 1 --2- 172.21.15.27:0/1688772113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f95000c5c00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7f95000838e0 tx=0x7f94f00090f0).ready entity=mon.0 client_cookie=2d698aa12273276b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94feffd700 1 -- 172.21.15.27:0/1688772113 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000b520 con 0x7f95001543d0 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94feffd700 1 -- 172.21.15.27:0/1688772113 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f000b680 con 0x7f95001543d0 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f94feffd700 1 -- 172.21.15.27:0/1688772113 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000ba00 con 0x7f95001543d0 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f9505dc1700 1 -- 172.21.15.27:0/1688772113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 msgr2=0x7f95000c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.342+0000 7f9505dc1700 1 --2- 172.21.15.27:0/1688772113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f95000c5c00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7f95000838e0 tx=0x7f94f00090f0).stop 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 -- 172.21.15.27:0/1688772113 shutdown_connections 2023-05-17T15:29:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 --2- 172.21.15.27:0/1688772113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f95000c5c00 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 --2- 172.21.15.27:0/1688772113 >> v2:172.21.15.40:3300/0 conn(0x7f95000691f0 0x7f95001547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 --2- 172.21.15.27:0/1688772113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 -- 172.21.15.27:0/1688772113 >> 172.21.15.27:0/1688772113 conn(0x7f95000cb7f0 msgr2=0x7f95000c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:18.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 -- 172.21.15.27:0/1688772113 shutdown_connections 2023-05-17T15:29:18.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.343+0000 7f9505dc1700 1 -- 172.21.15.27:0/1688772113 wait complete. 2023-05-17T15:29:18.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.344+0000 7f9505dc1700 1 Processor -- start 2023-05-17T15:29:18.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.344+0000 7f9505dc1700 1 -- start start 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.344+0000 7f9505dc1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 0x7f95000c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.344+0000 7f9505dc1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.344+0000 7f9505dc1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f9500152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f9505dc1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c3d10 con 0x7f95001543d0 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f9505dc1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c3190 con 0x7f95000691f0 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f9505dc1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c3470 con 0x7f95000c60f0 2023-05-17T15:29:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f9500152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94ff7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 0x7f95000c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f9500152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46408/0 (socket says 172.21.15.27:46408) 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94ff7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 0x7f95000c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.27:36102/0 (socket says 172.21.15.27:36102) 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 -- 172.21.15.27:0/3869221673 learned_addr learned my addr 172.21.15.27:0/3869221673 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94f7fff700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 -- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 msgr2=0x7f9500156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 -- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 msgr2=0x7f95000c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 0x7f95000c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 -- 172.21.15.27:0/3869221673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f0009370 con 0x7f95001543d0 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94ff7fe700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 0x7f95000c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94fffff700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f9500152c50 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f94f8009e90 tx=0x7f94f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800caa0 con 0x7f95001543d0 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f800f040 con 0x7f95001543d0 2023-05-17T15:29:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800ce10 con 0x7f95001543d0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95000c3750 con 0x7f95001543d0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.345+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95000c2d90 con 0x7f95001543d0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.346+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950006bdf0 con 0x7f95001543d0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.347+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f94f8013610 con 0x7f95001543d0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.347+0000 7f94f77fe700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94e005ed90 0x7f94e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.347+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94f807aeb0 con 0x7f95001543d0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.347+0000 7f94ff7fe700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94e005ed90 0x7f94e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:18.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.348+0000 7f94ff7fe700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94e005ed90 0x7f94e0061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f94f0009130 tx=0x7f94f0017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:18.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.351+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94f804c520 con 0x7f95001543d0 2023-05-17T15:29:18.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:18.522+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f95000c8150 con 0x7f95001543d0 2023-05-17T15:29:19.208 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.204+0000 7f94f77fe700 1 -- 172.21.15.27:0/3869221673 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v175) v1 ==== 170+0+0 (secure 0 0 0) 0x7f94f804fb40 con 0x7f95001543d0 2023-05-17T15:29:19.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94e005ed90 msgr2=0x7f94e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94e005ed90 0x7f94e0061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f94f0009130 tx=0x7f94f0017000).stop 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 msgr2=0x7f9500152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f9500152c50 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f94f8009e90 tx=0x7f94f800b040).stop 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 shutdown_connections 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f94e005ed90 0x7f94e0061250 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7f94f0009130 tx=0x7f94f0017000).stop 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95001543d0 0x7f9500152c50 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95000691f0 0x7f95000c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 --2- 172.21.15.27:0/3869221673 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000c60f0 0x7f9500156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.208+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 >> 172.21.15.27:0/3869221673 conn(0x7f95000cb7f0 msgr2=0x7f9500157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:19.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.210+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 shutdown_connections 2023-05-17T15:29:19.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.210+0000 7f9505dc1700 1 -- 172.21.15.27:0/3869221673 wait complete. 2023-05-17T15:29:19.222 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2023-05-17T15:29:19.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T15:29:19.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.355+0000 7fd3278b7700 1 Processor -- start 2023-05-17T15:29:19.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.355+0000 7fd3278b7700 1 -- start start 2023-05-17T15:29:19.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd3278b7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3201543d0 0x7fd3200c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd3278b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3200c60f0 0x7fd320068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd3278b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3200691f0 0x7fd3201547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd3278b7700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200c1c50 con 0x7fd3201543d0 2023-05-17T15:29:19.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd3278b7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd320158790 con 0x7fd3200c60f0 2023-05-17T15:29:19.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd3278b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200c6570 con 0x7fd3200691f0 2023-05-17T15:29:19.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3201543d0 0x7fd3200c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3201543d0 0x7fd3200c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46412/0 (socket says 172.21.15.27:46412) 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 -- 172.21.15.27:0/2601665449 learned_addr learned my addr 172.21.15.27:0/2601665449 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd324e52700 1 --2- 172.21.15.27:0/2601665449 >> v2:172.21.15.40:3300/0 conn(0x7fd3200c60f0 0x7fd320068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325e54700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3200691f0 0x7fd3201547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 -- 172.21.15.27:0/2601665449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3200691f0 msgr2=0x7fd3201547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3200691f0 0x7fd3201547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 -- 172.21.15.27:0/2601665449 >> v2:172.21.15.40:3300/0 conn(0x7fd3200c60f0 msgr2=0x7fd320068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 --2- 172.21.15.27:0/2601665449 >> v2:172.21.15.40:3300/0 conn(0x7fd3200c60f0 0x7fd320068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325653700 1 -- 172.21.15.27:0/2601665449 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320157e60 con 0x7fd3201543d0 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd324e52700 1 --2- 172.21.15.27:0/2601665449 >> v2:172.21.15.40:3300/0 conn(0x7fd3200c60f0 0x7fd320068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.356+0000 7fd325e54700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3200691f0 0x7fd3201547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd325653700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3201543d0 0x7fd3200c5c00 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fd3200c5620 tx=0x7fd3180090f0).ready entity=mon.0 client_cookie=96d826b8b64e42c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd31ffff700 1 -- 172.21.15.27:0/2601665449 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800b600 con 0x7fd3201543d0 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd31ffff700 1 -- 172.21.15.27:0/2601665449 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31800b760 con 0x7fd3201543d0 2023-05-17T15:29:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd31ffff700 1 -- 172.21.15.27:0/2601665449 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800bae0 con 0x7fd3201543d0 2023-05-17T15:29:19.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 -- 172.21.15.27:0/2601665449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3201543d0 msgr2=0x7fd3200c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3201543d0 0x7fd3200c5c00 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fd3200c5620 tx=0x7fd3180090f0).stop 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 -- 172.21.15.27:0/2601665449 shutdown_connections 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3201543d0 0x7fd3200c5c00 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 --2- 172.21.15.27:0/2601665449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3200691f0 0x7fd3201547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 --2- 172.21.15.27:0/2601665449 >> v2:172.21.15.40:3300/0 conn(0x7fd3200c60f0 0x7fd320068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 -- 172.21.15.27:0/2601665449 >> 172.21.15.27:0/2601665449 conn(0x7fd3200cb7f0 msgr2=0x7fd3200c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 -- 172.21.15.27:0/2601665449 shutdown_connections 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.357+0000 7fd3278b7700 1 -- 172.21.15.27:0/2601665449 wait complete. 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.358+0000 7fd3278b7700 1 Processor -- start 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.358+0000 7fd3278b7700 1 -- start start 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd3278b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3200691f0 0x7fd320147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd3278b7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 0x7fd3200c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd3278b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3201543d0 0x7fd3200c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd3278b7700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200aeca0 con 0x7fd3200c60f0 2023-05-17T15:29:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd3278b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200aef80 con 0x7fd3200691f0 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd3278b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200af260 con 0x7fd3201543d0 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd324e52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 0x7fd3200c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd324e52700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 0x7fd3200c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46418/0 (socket says 172.21.15.27:46418) 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.359+0000 7fd324e52700 1 -- 172.21.15.27:0/3450466055 learned_addr learned my addr 172.21.15.27:0/3450466055 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd325653700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3200691f0 0x7fd320147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd325e54700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3201543d0 0x7fd3200c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd324e52700 1 -- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3201543d0 msgr2=0x7fd3200c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd324e52700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3201543d0 0x7fd3200c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd324e52700 1 -- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3200691f0 msgr2=0x7fd320147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd324e52700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3200691f0 0x7fd320147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd324e52700 1 -- 172.21.15.27:0/3450466055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009370 con 0x7fd3200c60f0 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd324e52700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 0x7fd3200c27d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fd31400c880 tx=0x7fd314008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314010580 con 0x7fd3200c60f0 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3140106e0 con 0x7fd3200c60f0 2023-05-17T15:29:19.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3200af540 con 0x7fd3200c60f0 2023-05-17T15:29:19.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314010a60 con 0x7fd3200c60f0 2023-05-17T15:29:19.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.360+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd320153190 con 0x7fd3200c60f0 2023-05-17T15:29:19.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.361+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32006bdf0 con 0x7fd3200c60f0 2023-05-17T15:29:19.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.362+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd31401b460 con 0x7fd3200c60f0 2023-05-17T15:29:19.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.362+0000 7fd31d7fa700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd30c05ed90 0x7fd30c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.362+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd314079be0 con 0x7fd3200c60f0 2023-05-17T15:29:19.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.362+0000 7fd325653700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd30c05ed90 0x7fd30c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.363+0000 7fd325653700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd30c05ed90 0x7fd30c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd318009130 tx=0x7fd318017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:19.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.367+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd31404b100 con 0x7fd3200c60f0 2023-05-17T15:29:19.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.583+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd320158140 con 0x7fd3200c60f0 2023-05-17T15:29:19.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.589+0000 7fd31d7fa700 1 -- 172.21.15.27:0/3450466055 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v71) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd31404e720 con 0x7fd3200c60f0 2023-05-17T15:29:19.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.592+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd30c05ed90 msgr2=0x7fd30c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.592+0000 7fd3278b7700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd30c05ed90 0x7fd30c061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd318009130 tx=0x7fd318017000).stop 2023-05-17T15:29:19.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.592+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 msgr2=0x7fd3200c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.592+0000 7fd3278b7700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 0x7fd3200c27d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fd31400c880 tx=0x7fd314008040).stop 2023-05-17T15:29:19.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 shutdown_connections 2023-05-17T15:29:19.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd30c05ed90 0x7fd30c061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3201543d0 0x7fd3200c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3200691f0 0x7fd320147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 --2- 172.21.15.27:0/3450466055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3200c60f0 0x7fd3200c27d0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 >> 172.21.15.27:0/3450466055 conn(0x7fd3200cb7f0 msgr2=0x7fd3201559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:19.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.593+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 shutdown_connections 2023-05-17T15:29:19.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.594+0000 7fd3278b7700 1 -- 172.21.15.27:0/3450466055 wait complete. 2023-05-17T15:29:19.601 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 21 and data pool 22 2023-05-17T15:29:19.620 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.731+0000 7fbe8b7e3700 1 Processor -- start 2023-05-17T15:29:19.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.732+0000 7fbe8b7e3700 1 -- start start 2023-05-17T15:29:19.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.732+0000 7fbe8b7e3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe841376a0 0x7fbe840c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.732+0000 7fbe8b7e3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840c34a0 con 0x7fbe841372c0 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.732+0000 7fbe8b7e3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840c2890 con 0x7fbe840c22d0 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.732+0000 7fbe8b7e3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe84064be0 con 0x7fbe841376a0 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe8957f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbe841372c0 0x7fbe840650d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46004/0 (socket says 172.21.15.27:46004) 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe8957f700 1 -- 172.21.15.27:0/3993168329 learned_addr learned my addr 172.21.15.27:0/3993168329 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010012180 0 0) 0x7fbe840c34a0 con 0x7fbe841372c0 2023-05-17T15:29:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c0033f0 con 0x7fbe841372c0 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3993168329 >> v2:172.21.15.40:3300/0 conn(0x7fbe841376a0 0x7fbe840c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236127494 0 0) 0x7fbe6c0033f0 con 0x7fbe841372c0 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 >> v2:172.21.15.40:3300/0 conn(0x7fbe841376a0 msgr2=0x7fbe840c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 --2- 172.21.15.27:0/3993168329 >> v2:172.21.15.40:3300/0 conn(0x7fbe841376a0 0x7fbe840c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 >> v1:172.21.15.40:6789/0 conn(0x7fbe840c22d0 legacy=0x7fbe841548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840c2b70 con 0x7fbe841372c0 2023-05-17T15:29:19.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fbe7c0017f0 con 0x7fbe841372c0 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 >> v1:172.21.15.27:6789/0 conn(0x7fbe841372c0 legacy=0x7fbe840650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe6c003930 0x7fbe6c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe6c004690 0x7fbe6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c005000 0x7fbe6c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84064be0 con 0x7fbe6c004690 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c00bf30 con 0x7fbe6c003930 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c00c0f0 con 0x7fbe6c005000 2023-05-17T15:29:19.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe6c004690 0x7fbe6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe8957f700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe6c003930 0x7fbe6c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.733+0000 7fbe89d80700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c005000 0x7fbe6c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c005000 msgr2=0x7fbe6c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c005000 0x7fbe6c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe6c003930 msgr2=0x7fbe6c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe6c003930 0x7fbe6c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3993168329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0033f0 con 0x7fbe6c004690 2023-05-17T15:29:19.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe89d80700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c005000 0x7fbe6c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe89d80700 1 -- 172.21.15.27:0/3993168329 reap_dead start 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe6c004690 0x7fbe6c004b10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fbe84152360 tx=0x7fbe78009060).ready entity=mon.0 client_cookie=e677253b9681f43c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78009e90 con 0x7fbe6c004690 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78009430 con 0x7fbe6c004690 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe83fff700 1 -- 172.21.15.27:0/3993168329 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800e850 con 0x7fbe6c004690 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3993168329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe6c004690 msgr2=0x7fbe6c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe6c004690 0x7fbe6c004b10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fbe84152360 tx=0x7fbe78009060).stop 2023-05-17T15:29:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3993168329 shutdown_connections 2023-05-17T15:29:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3993168329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe6c004690 0x7fbe6c004b10 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.734+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3993168329 >> 172.21.15.27:0/3993168329 conn(0x7fbe840c8400 msgr2=0x7fbe840c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.735+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3993168329 shutdown_connections 2023-05-17T15:29:19.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.735+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3993168329 wait complete. 2023-05-17T15:29:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.736+0000 7fbe8b7e3700 1 Processor -- start 2023-05-17T15:29:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.736+0000 7fbe8b7e3700 1 -- start start 2023-05-17T15:29:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.736+0000 7fbe8b7e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c004690 0x7fbe840be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.736+0000 7fbe8b7e3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 0x7fbe840ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.736+0000 7fbe8b7e3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84139f20 0x7fbe8413a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.736+0000 7fbe8b7e3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840c26b0 con 0x7fbe84165f90 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe8b7e3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840ac620 con 0x7fbe84139f20 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe8b7e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840beec0 con 0x7fbe6c004690 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 0x7fbe840ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 0x7fbe840ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46456/0 (socket says 172.21.15.27:46456) 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3519343993 learned_addr learned my addr 172.21.15.27:0/3519343993 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:19.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe89d80700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84139f20 0x7fbe8413a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe8957f700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c004690 0x7fbe840be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c004690 msgr2=0x7fbe840be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c004690 0x7fbe840be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84139f20 msgr2=0x7fbe8413a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84139f20 0x7fbe8413a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 -- 172.21.15.27:0/3519343993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe84134ff0 con 0x7fbe84165f90 2023-05-17T15:29:19.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe89d80700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84139f20 0x7fbe8413a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe88d7e700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 0x7fbe840ab1a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fbe7800e4b0 tx=0x7fbe7801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7801caa0 con 0x7fbe84165f90 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7801cc20 con 0x7fbe84165f90 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe840ab9a0 con 0x7fbe84165f90 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780243f0 con 0x7fbe84165f90 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.737+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe840abf60 con 0x7fbe84165f90 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.738+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe840ac760 con 0x7fbe84165f90 2023-05-17T15:29:19.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.739+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbe7802b030 con 0x7fbe84165f90 2023-05-17T15:29:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.739+0000 7fbe817fa700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbe7005ed90 0x7fbe70061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.739+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fbe7807afc0 con 0x7fbe84165f90 2023-05-17T15:29:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.739+0000 7fbe8957f700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbe7005ed90 0x7fbe70061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.739+0000 7fbe8957f700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbe7005ed90 0x7fbe70061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbe7c001190 tx=0x7fbe7c009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.743+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe840ac760 con 0x7fbe84165f90 2023-05-17T15:29:19.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.919+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe840ac760 con 0x7fbe84165f90 2023-05-17T15:29:19.924 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.920+0000 7fbe817fa700 1 -- 172.21.15.27:0/3519343993 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+17160 (secure 0 0 0) 0x7fbe840ac760 con 0x7fbe84165f90 2023-05-17T15:29:19.925 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:19.925 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":176,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:19.585000+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:29:18.145777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-17T15:29:18.560834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:19.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbe7005ed90 msgr2=0x7fbe70061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbe7005ed90 0x7fbe70061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbe7c001190 tx=0x7fbe7c009040).stop 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 msgr2=0x7fbe840ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 0x7fbe840ab1a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fbe7800e4b0 tx=0x7fbe7801a000).stop 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 shutdown_connections 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbe7005ed90 0x7fbe70061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84139f20 0x7fbe8413a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe6c004690 0x7fbe840be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 --2- 172.21.15.27:0/3519343993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84165f90 0x7fbe840ab1a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:19.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 >> 172.21.15.27:0/3519343993 conn(0x7fbe840c8400 msgr2=0x7fbe84150320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:19.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.923+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 shutdown_connections 2023-05-17T15:29:19.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:19.924+0000 7fbe8b7e3700 1 -- 172.21.15.27:0/3519343993 wait complete. 2023-05-17T15:29:19.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:20.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.051+0000 7f38cc64a700 1 Processor -- start 2023-05-17T15:29:20.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.051+0000 7f38cc64a700 1 -- start start 2023-05-17T15:29:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.052+0000 7f38cc64a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f38c4153fa0 0x7f38c40c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.052+0000 7f38cc64a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c4069770 0x7f38c40c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.052+0000 7f38cc64a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c40c07a0 con 0x7f38c40aae70 2023-05-17T15:29:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.052+0000 7f38cc64a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c4069d70 con 0x7f38c4153fa0 2023-05-17T15:29:20.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.052+0000 7f38cc64a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c6760 con 0x7f38c4069770 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f38c4153fa0 0x7f38c40c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f38c4153fa0 0x7f38c40c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46462/0 (socket says 172.21.15.27:46462) 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 -- 172.21.15.27:0/477400743 learned_addr learned my addr 172.21.15.27:0/477400743 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38cabe7700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c4069770 0x7f38c40c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 -- 172.21.15.27:0/477400743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c4069770 msgr2=0x7f38c40c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c4069770 0x7f38c40c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.058 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 -- 172.21.15.27:0/477400743 >> v1:172.21.15.40:6789/0 conn(0x7f38c40aae70 legacy=0x7f38c4069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 -- 172.21.15.27:0/477400743 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40c1c40 con 0x7f38c4153fa0 2023-05-17T15:29:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38cabe7700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c4069770 0x7f38c40c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38ca3e6700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c40c5d80 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f38c0006fd0 tx=0x7f38c00090f0).ready entity=mon.0 client_cookie=480c1fcf07c96f56 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38c93e4700 1 -- 172.21.15.27:0/477400743 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000b600 con 0x7f38c4153fa0 2023-05-17T15:29:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38c93e4700 1 -- 172.21.15.27:0/477400743 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000b760 con 0x7f38c4153fa0 2023-05-17T15:29:20.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.053+0000 7f38c93e4700 1 -- 172.21.15.27:0/477400743 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000bae0 con 0x7f38c4153fa0 2023-05-17T15:29:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 -- 172.21.15.27:0/477400743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 msgr2=0x7f38c40c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c40c5d80 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f38c0006fd0 tx=0x7f38c00090f0).stop 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 -- 172.21.15.27:0/477400743 shutdown_connections 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c4069770 0x7f38c40c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 --2- 172.21.15.27:0/477400743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c40c5d80 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 -- 172.21.15.27:0/477400743 >> 172.21.15.27:0/477400743 conn(0x7f38c40cb810 msgr2=0x7f38c40c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 -- 172.21.15.27:0/477400743 shutdown_connections 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.054+0000 7f38cc64a700 1 -- 172.21.15.27:0/477400743 wait complete. 2023-05-17T15:29:20.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.055+0000 7f38cc64a700 1 Processor -- start 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.055+0000 7f38cc64a700 1 -- start start 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c4069770 0x7f38c4164200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c40aae70 0x7f38c4168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c4168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4168af0 con 0x7f38c4153fa0 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c48b0 con 0x7f38c4069770 2023-05-17T15:29:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4150460 con 0x7f38c40aae70 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c4168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c4168600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46470/0 (socket says 172.21.15.27:46470) 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 -- 172.21.15.27:0/1545012724 learned_addr learned my addr 172.21.15.27:0/1545012724 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38ca3e6700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c4069770 0x7f38c4164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38c9be5700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c40aae70 0x7f38c4168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 -- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c40aae70 msgr2=0x7f38c4168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c40aae70 0x7f38c4168110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 -- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c4069770 msgr2=0x7f38c4164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c4069770 0x7f38c4164200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 -- 172.21.15.27:0/1545012724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009370 con 0x7f38c4153fa0 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cabe7700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c4168600 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f38bc00a380 tx=0x7f38bc007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00ae10 con 0x7f38c4153fa0 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00d650 con 0x7f38c4153fa0 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c40c4010 con 0x7f38c4153fa0 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00d9d0 con 0x7f38c4153fa0 2023-05-17T15:29:20.065 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.056+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c41646f0 con 0x7f38c4153fa0 2023-05-17T15:29:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.057+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c40c4400 con 0x7f38c4153fa0 2023-05-17T15:29:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.058+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f38bc0203f0 con 0x7f38c4153fa0 2023-05-17T15:29:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.058+0000 7f38ba7fc700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f38a805ed90 0x7f38a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.058+0000 7f38ca3e6700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f38a805ed90 0x7f38a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.058+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f38bc07aac0 con 0x7f38c4153fa0 2023-05-17T15:29:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.059+0000 7f38ca3e6700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f38a805ed90 0x7f38a8061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f38c0009130 tx=0x7f38c0017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.063+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38bc04bf80 con 0x7f38c4153fa0 2023-05-17T15:29:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.236+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c41649d0 con 0x7f38c4153fa0 2023-05-17T15:29:20.241 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.237+0000 7f38ba7fc700 1 -- 172.21.15.27:0/1545012724 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+17160 (secure 0 0 0) 0x7f38bc04f5a0 con 0x7f38c4153fa0 2023-05-17T15:29:20.241 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:20.242 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":176,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:19.585000+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:29:18.145777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-17T15:29:18.560834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:20.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f38a805ed90 msgr2=0x7f38a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f38a805ed90 0x7f38a8061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f38c0009130 tx=0x7f38c0017000).stop 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 msgr2=0x7f38c4168600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c4168600 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f38bc00a380 tx=0x7f38bc007900).stop 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 shutdown_connections 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f38a805ed90 0x7f38a8061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38c4153fa0 0x7f38c4168600 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c4069770 0x7f38c4164200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 --2- 172.21.15.27:0/1545012724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38c40aae70 0x7f38c4168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 >> 172.21.15.27:0/1545012724 conn(0x7f38c40cb810 msgr2=0x7f38c40ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 shutdown_connections 2023-05-17T15:29:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.239+0000 7f38cc64a700 1 -- 172.21.15.27:0/1545012724 wait complete. 2023-05-17T15:29:20.255 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T15:29:20.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.370+0000 7f3289c12700 1 Processor -- start 2023-05-17T15:29:20.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.370+0000 7f3289c12700 1 -- start start 2023-05-17T15:29:20.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f3289c12700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f32841543d0 0x7f32840c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.375 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f3289c12700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3284158790 con 0x7f32840c60f0 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f3289c12700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840c6570 con 0x7f3284069410 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f3289c12700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840c1c50 con 0x7f32841543d0 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32837fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f32841543d0 0x7f32840c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f3282ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f32840c60f0 0x7f3284068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46036/0 (socket says 172.21.15.27:46036) 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f3282ffd700 1 -- 172.21.15.27:0/2626121033 learned_addr learned my addr 172.21.15.27:0/2626121033 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32837fe700 1 -- 172.21.15.27:0/2626121033 >> v1:172.21.15.40:6789/0 conn(0x7f3284069410 legacy=0x7f32840bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32837fe700 1 -- 172.21.15.27:0/2626121033 >> v1:172.21.15.27:6789/0 conn(0x7f32840c60f0 legacy=0x7f3284068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32827fc700 1 -- 172.21.15.27:0/2626121033 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238181709 0 0) 0x7f3284158790 con 0x7f32840c60f0 2023-05-17T15:29:20.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32837fe700 1 -- 172.21.15.27:0/2626121033 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284157e60 con 0x7f32841543d0 2023-05-17T15:29:20.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32837fe700 1 --2- 172.21.15.27:0/2626121033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f32840c5c00 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f3274009760 tx=0x7f3274009060).ready entity=mon.0 client_cookie=c754a267ed958704 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:20.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32827fc700 1 -- 172.21.15.27:0/2626121033 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400b520 con 0x7f32841543d0 2023-05-17T15:29:20.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32827fc700 1 -- 172.21.15.27:0/2626121033 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400b680 con 0x7f32841543d0 2023-05-17T15:29:20.377 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.371+0000 7f32827fc700 1 -- 172.21.15.27:0/2626121033 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ba00 con 0x7f32841543d0 2023-05-17T15:29:20.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 -- 172.21.15.27:0/2626121033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 msgr2=0x7f32840c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 --2- 172.21.15.27:0/2626121033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f32840c5c00 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f3274009760 tx=0x7f3274009060).stop 2023-05-17T15:29:20.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 -- 172.21.15.27:0/2626121033 shutdown_connections 2023-05-17T15:29:20.379 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 --2- 172.21.15.27:0/2626121033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f32840c5c00 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 -- 172.21.15.27:0/2626121033 >> 172.21.15.27:0/2626121033 conn(0x7f32840cb7f0 msgr2=0x7f32840c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 -- 172.21.15.27:0/2626121033 shutdown_connections 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.372+0000 7f3289c12700 1 -- 172.21.15.27:0/2626121033 wait complete. 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.373+0000 7f3289c12700 1 Processor -- start 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.373+0000 7f3289c12700 1 -- start start 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3289c12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3284069410 0x7f32840c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.380 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3289c12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32840c60f0 0x7f32840b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3289c12700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f3284152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3289c12700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c2ed0 con 0x7f32841543d0 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3289c12700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c22c0 con 0x7f3284069410 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3289c12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c25a0 con 0x7f32840c60f0 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f3284152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f3284152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46482/0 (socket says 172.21.15.27:46482) 2023-05-17T15:29:20.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 -- 172.21.15.27:0/3617745391 learned_addr learned my addr 172.21.15.27:0/3617745391 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f32837fe700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3284069410 0x7f32840c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3282ffd700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32840c60f0 0x7f32840b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 -- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32840c60f0 msgr2=0x7f32840b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32840c60f0 0x7f32840b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 -- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3284069410 msgr2=0x7f32840c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3284069410 0x7f32840c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 -- 172.21.15.27:0/3617745391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740092a0 con 0x7f32841543d0 2023-05-17T15:29:20.382 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f32837fe700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3284069410 0x7f32840c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.374+0000 7f3283fff700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f3284152d30 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f327c00c810 tx=0x7f327c002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.375+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c010510 con 0x7f32841543d0 2023-05-17T15:29:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.375+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c0106b0 con 0x7f32841543d0 2023-05-17T15:29:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.375+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c010a70 con 0x7f32841543d0 2023-05-17T15:29:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.375+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840c2880 con 0x7f32841543d0 2023-05-17T15:29:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.375+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840c3850 con 0x7f32841543d0 2023-05-17T15:29:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.376+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32840c3080 con 0x7f32841543d0 2023-05-17T15:29:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.376+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f327c010070 con 0x7f32841543d0 2023-05-17T15:29:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.376+0000 7f326b7fe700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f327005ed90 0x7f3270061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.377+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f327c079950 con 0x7f32841543d0 2023-05-17T15:29:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.377+0000 7f32837fe700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f327005ed90 0x7f3270061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:20.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.377+0000 7f32837fe700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f327005ed90 0x7f3270061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f327400b2e0 tx=0x7f3274017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:20.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.381+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f327c04ae70 con 0x7f32841543d0 2023-05-17T15:29:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:20.600+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3284158140 con 0x7f32841543d0 2023-05-17T15:29:20.931 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:20.928+0000 7f99a38ca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:29:21.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.591+0000 7f326b7fe700 1 -- 172.21.15.27:0/3617745391 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f327c010e60 con 0x7f32841543d0 2023-05-17T15:29:21.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f327005ed90 msgr2=0x7f3270061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f327005ed90 0x7f3270061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f327400b2e0 tx=0x7f3274017000).stop 2023-05-17T15:29:21.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 msgr2=0x7f3284152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f3284152d30 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f327c00c810 tx=0x7f327c002560).stop 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 shutdown_connections 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f327005ed90 0x7f3270061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32841543d0 0x7f3284152d30 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3284069410 0x7f32840c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 --2- 172.21.15.27:0/3617745391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32840c60f0 0x7f32840b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 >> 172.21.15.27:0/3617745391 conn(0x7f32840cb7f0 msgr2=0x7f3284155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 shutdown_connections 2023-05-17T15:29:21.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.593+0000 7f3289c12700 1 -- 172.21.15.27:0/3617745391 wait complete. 2023-05-17T15:29:21.612 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T15:29:21.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.733+0000 7f49bfc75700 1 Processor -- start 2023-05-17T15:29:21.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.734+0000 7f49bfc75700 1 -- start start 2023-05-17T15:29:21.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.734+0000 7f49bfc75700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 0x7f49b80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.738 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bfc75700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b81589e0 con 0x7f49b8154200 2023-05-17T15:29:21.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bfc75700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b8157dd0 con 0x7f49b80c7d70 2023-05-17T15:29:21.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bfc75700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81580b0 con 0x7f49b8153e20 2023-05-17T15:29:21.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bd210700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f49b8154200 0x7f49b80c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46050/0 (socket says 172.21.15.27:46050) 2023-05-17T15:29:21.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bd210700 1 -- 172.21.15.27:0/2692118248 learned_addr learned my addr 172.21.15.27:0/2692118248 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:21.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589010100 0 0) 0x7f49b81589e0 con 0x7f49b8154200 2023-05-17T15:29:21.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a00033f0 con 0x7f49b8154200 2023-05-17T15:29:21.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bda11700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 0x7f49b80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1068193854 0 0) 0x7f49a00033f0 con 0x7f49b8154200 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 msgr2=0x7f49b80c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 0x7f49b80c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 >> v1:172.21.15.40:6789/0 conn(0x7f49b80c7d70 legacy=0x7f49b80c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8158390 con 0x7f49b8154200 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f49ac001470 con 0x7f49b8154200 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 >> v1:172.21.15.27:6789/0 conn(0x7f49b8154200 legacy=0x7f49b80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a0003910 0x7f49a0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 0x7f49a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49a0004b80 0x7f49a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81580b0 con 0x7f49a0004b80 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a000b910 con 0x7f49a0003910 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a000bad0 con 0x7f49b8153e20 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.735+0000 7f49be212700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49a0004b80 0x7f49a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bda11700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a0003910 0x7f49a0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bd210700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 0x7f49a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 -- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 msgr2=0x7f49a0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8153e20 0x7f49a0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 -- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a0003910 msgr2=0x7f49a0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a0003910 0x7f49a0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 -- 172.21.15.27:0/2692118248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00033f0 con 0x7f49a0004b80 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49a0004b80 0x7f49a0005000 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f49a8001780 tx=0x7f49a8007c00).ready entity=mon.0 client_cookie=5d5d1e1623519c5f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:21.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8001ea0 con 0x7f49a0004b80 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a8007020 con 0x7f49a0004b80 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bca0f700 1 -- 172.21.15.27:0/2692118248 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a80073c0 con 0x7f49a0004b80 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bfc75700 1 -- 172.21.15.27:0/2692118248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49a0004b80 msgr2=0x7f49a0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bfc75700 1 --2- 172.21.15.27:0/2692118248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49a0004b80 0x7f49a0005000 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f49a8001780 tx=0x7f49a8007c00).stop 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49be212700 1 -- 172.21.15.27:0/2692118248 reap_dead start 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bfc75700 1 -- 172.21.15.27:0/2692118248 shutdown_connections 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.736+0000 7f49bfc75700 1 -- 172.21.15.27:0/2692118248 >> 172.21.15.27:0/2692118248 conn(0x7f49b805dd50 msgr2=0x7f49b805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:21.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.737+0000 7f49bfc75700 1 -- 172.21.15.27:0/2692118248 shutdown_connections 2023-05-17T15:29:21.746 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.737+0000 7f49bfc75700 1 -- 172.21.15.27:0/2692118248 wait complete. 2023-05-17T15:29:21.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 Processor -- start 2023-05-17T15:29:21.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 -- start start 2023-05-17T15:29:21.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 0x7f49b8155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49b80c37f0 0x7f49b8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8157090 0x7f49b8164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8154ec0 con 0x7f49b80c3410 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.738+0000 7f49bfc75700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8157510 con 0x7f49b80c37f0 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bfc75700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81652e0 con 0x7f49b8157090 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 0x7f49b8155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 0x7f49b8155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46498/0 (socket says 172.21.15.27:46498) 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 -- 172.21.15.27:0/3984677002 learned_addr learned my addr 172.21.15.27:0/3984677002 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bd210700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49b80c37f0 0x7f49b8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49be212700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8157090 0x7f49b8164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 -- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8157090 msgr2=0x7f49b8164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8157090 0x7f49b8164540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 -- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49b80c37f0 msgr2=0x7f49b8156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49b80c37f0 0x7f49b8156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 -- 172.21.15.27:0/3984677002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8154870 con 0x7f49b80c3410 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49be212700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8157090 0x7f49b8164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bda11700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 0x7f49b8155350 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f49b0011f30 tx=0x7f49b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000e040 con 0x7f49b80c3410 2023-05-17T15:29:21.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000f040 con 0x7f49b80c3410 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0015450 con 0x7f49b80c3410 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b8154b50 con 0x7f49b80c3410 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.739+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8164bf0 con 0x7f49b80c3410 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.740+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b81546d0 con 0x7f49b80c3410 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.741+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f49b0015840 con 0x7f49b80c3410 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.741+0000 7f49b5ffb700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f49a405ed90 0x7f49a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.741+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f49b007ad20 con 0x7f49b80c3410 2023-05-17T15:29:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.741+0000 7f49bd210700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f49a405ed90 0x7f49a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.741+0000 7f49bd210700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f49a405ed90 0x7f49a4061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f49b80c3c70 tx=0x7f49ac001e50).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.745+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49b81546d0 con 0x7f49b80c3410 2023-05-17T15:29:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:21.964+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49b81546d0 con 0x7f49b80c3410 2023-05-17T15:29:22.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.594+0000 7f49b5ffb700 1 -- 172.21.15.27:0/3984677002 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49b81546d0 con 0x7f49b80c3410 2023-05-17T15:29:22.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f49a405ed90 msgr2=0x7f49a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f49a405ed90 0x7f49a4061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f49b80c3c70 tx=0x7f49ac001e50).stop 2023-05-17T15:29:22.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 msgr2=0x7f49b8155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 0x7f49b8155350 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f49b0011f30 tx=0x7f49b000b040).stop 2023-05-17T15:29:22.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 shutdown_connections 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f49a405ed90 0x7f49a4061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49b8157090 0x7f49b8164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49b80c3410 0x7f49b8155350 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 --2- 172.21.15.27:0/3984677002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49b80c37f0 0x7f49b8156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 >> 172.21.15.27:0/3984677002 conn(0x7f49b805dd50 msgr2=0x7f49b80c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 shutdown_connections 2023-05-17T15:29:22.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.597+0000 7f49bfc75700 1 -- 172.21.15.27:0/3984677002 wait complete. 2023-05-17T15:29:22.614 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.728+0000 7f69863ec700 1 Processor -- start 2023-05-17T15:29:22.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.728+0000 7f69863ec700 1 -- start start 2023-05-17T15:29:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f69863ec700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6980065550 0x7f6980065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f69863ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6980155410 0x7f6980066140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f69863ec700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6980154600 con 0x7f6980153a60 2023-05-17T15:29:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f69863ec700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6980069000 con 0x7f6980065550 2023-05-17T15:29:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f69863ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6980067f60 con 0x7f6980155410 2023-05-17T15:29:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6980065550 0x7f6980065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f6984989700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6980153a60 0x7f6980153ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46072/0 (socket says 172.21.15.27:46072) 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f6984989700 1 -- 172.21.15.27:0/228350187 learned_addr learned my addr 172.21.15.27:0/228350187 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697f7fe700 1 --2- 172.21.15.27:0/228350187 >> v2:172.21.15.40:3300/0 conn(0x7f6980155410 0x7f6980066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697ffff700 1 -- 172.21.15.27:0/228350187 >> v2:172.21.15.40:3300/0 conn(0x7f6980155410 msgr2=0x7f6980066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697ffff700 1 --2- 172.21.15.27:0/228350187 >> v2:172.21.15.40:3300/0 conn(0x7f6980155410 0x7f6980066140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697ffff700 1 -- 172.21.15.27:0/228350187 >> v1:172.21.15.27:6789/0 conn(0x7f6980153a60 legacy=0x7f6980153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697effd700 1 -- 172.21.15.27:0/228350187 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612484593 0 0) 0x7f6978001490 con 0x7f6980153a60 2023-05-17T15:29:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697ffff700 1 -- 172.21.15.27:0/228350187 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6980068240 con 0x7f6980065550 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697ffff700 1 --2- 172.21.15.27:0/228350187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980065550 0x7f6980065930 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f6980069d20 tx=0x7f6970009060).ready entity=mon.0 client_cookie=e83200b734d59a35 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697effd700 1 -- 172.21.15.27:0/228350187 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000b580 con 0x7f6980065550 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697effd700 1 -- 172.21.15.27:0/228350187 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000b6e0 con 0x7f6980065550 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.729+0000 7f697effd700 1 -- 172.21.15.27:0/228350187 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000ba60 con 0x7f6980065550 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 -- 172.21.15.27:0/228350187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980065550 msgr2=0x7f6980065930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 --2- 172.21.15.27:0/228350187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980065550 0x7f6980065930 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f6980069d20 tx=0x7f6970009060).stop 2023-05-17T15:29:22.736 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 -- 172.21.15.27:0/228350187 shutdown_connections 2023-05-17T15:29:22.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 --2- 172.21.15.27:0/228350187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980065550 0x7f6980065930 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 --2- 172.21.15.27:0/228350187 >> v2:172.21.15.40:3300/0 conn(0x7f6980155410 0x7f6980066140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 -- 172.21.15.27:0/228350187 >> 172.21.15.27:0/228350187 conn(0x7f69800c94a0 msgr2=0x7f69800c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:22.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 -- 172.21.15.27:0/228350187 shutdown_connections 2023-05-17T15:29:22.737 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.730+0000 7f69863ec700 1 -- 172.21.15.27:0/228350187 wait complete. 2023-05-17T15:29:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.731+0000 7f69863ec700 1 Processor -- start 2023-05-17T15:29:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.731+0000 7f69863ec700 1 -- start start 2023-05-17T15:29:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f69863ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6980065550 0x7f69800a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f69863ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6980153a60 0x7f69800c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f69863ec700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 0x7f69800c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f69863ec700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800c5130 con 0x7f6980155410 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f69863ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800a9bc0 con 0x7f6980153a60 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f69863ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800ac6a0 con 0x7f6980065550 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 0x7f69800c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 0x7f69800c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46516/0 (socket says 172.21.15.27:46516) 2023-05-17T15:29:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 -- 172.21.15.27:0/188547251 learned_addr learned my addr 172.21.15.27:0/188547251 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f697f7fe700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6980153a60 0x7f69800c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f697ffff700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6980065550 0x7f69800a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 -- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6980065550 msgr2=0x7f69800a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6980065550 0x7f69800a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 -- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6980153a60 msgr2=0x7f69800c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6980153a60 0x7f69800c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 -- 172.21.15.27:0/188547251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700092a0 con 0x7f6980155410 2023-05-17T15:29:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.732+0000 7f6984989700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 0x7f69800c4c40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f697800c7e0 tx=0x7f6978007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.733+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978005d30 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.733+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978005e90 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.733+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69800ac980 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.733+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978007320 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.733+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800acf40 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.734+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698006bdf0 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.734+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6978010030 con 0x7f6980155410 2023-05-17T15:29:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.734+0000 7f6967fff700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f696c05ed90 0x7f696c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.735+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f69780798a0 con 0x7f6980155410 2023-05-17T15:29:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.735+0000 7f697ffff700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f696c05ed90 0x7f696c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.735+0000 7f697ffff700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f696c05ed90 0x7f696c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6980158d50 tx=0x7f6970017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.739+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f697804adc0 con 0x7f6980155410 2023-05-17T15:29:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.956+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6980154600 con 0x7f6980155410 2023-05-17T15:29:22.961 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.957+0000 7f6967fff700 1 -- 172.21.15.27:0/188547251 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f6980154600 con 0x7f6980155410 2023-05-17T15:29:22.961 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:22.961 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:29:19.585435+0000","modified":"2023-05-17T15:29:22.589859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8988":{"gid":8988,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3491718569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3491718569},{"type":"v1","addr":"172.21.15.27:6835","nonce":3491718569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-17T15:29:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f696c05ed90 msgr2=0x7f696c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f696c05ed90 0x7f696c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6980158d50 tx=0x7f6970017000).stop 2023-05-17T15:29:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 msgr2=0x7f69800c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 0x7f69800c4c40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f697800c7e0 tx=0x7f6978007dd0).stop 2023-05-17T15:29:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 shutdown_connections 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f696c05ed90 0x7f696c061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6980155410 0x7f69800c4c40 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6980065550 0x7f69800a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 --2- 172.21.15.27:0/188547251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6980153a60 0x7f69800c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 >> 172.21.15.27:0/188547251 conn(0x7f69800c94a0 msgr2=0x7f6980153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 shutdown_connections 2023-05-17T15:29:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:22.959+0000 7f69863ec700 1 -- 172.21.15.27:0/188547251 wait complete. 2023-05-17T15:29:22.965 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 74 2023-05-17T15:29:22.975 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:23.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.087+0000 7f13cbcf0700 1 Processor -- start 2023-05-17T15:29:23.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.087+0000 7f13cbcf0700 1 -- start start 2023-05-17T15:29:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13cbcf0700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f13c4151ca0 0x7f13c4152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13cbcf0700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40c4430 con 0x7f13c4065a60 2023-05-17T15:29:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13cbcf0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40c3e70 con 0x7f13c40663a0 2023-05-17T15:29:23.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13cbcf0700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c40c4150 con 0x7f13c4151ca0 2023-05-17T15:29:23.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13c9a8c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f13c4151ca0 0x7f13c4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13ca28d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f13c4065a60 0x7f13c40be2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46086/0 (socket says 172.21.15.27:46086) 2023-05-17T15:29:23.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.088+0000 7f13ca28d700 1 -- 172.21.15.27:0/3074812714 learned_addr learned my addr 172.21.15.27:0/3074812714 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:23.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c9a8c700 1 -- 172.21.15.27:0/3074812714 >> v1:172.21.15.40:6789/0 conn(0x7f13c40663a0 legacy=0x7f13c4065350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c9a8c700 1 -- 172.21.15.27:0/3074812714 >> v1:172.21.15.27:6789/0 conn(0x7f13c4065a60 legacy=0x7f13c40be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c9a8c700 1 -- 172.21.15.27:0/3074812714 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c40bdad0 con 0x7f13c4151ca0 2023-05-17T15:29:23.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c8a8a700 1 -- 172.21.15.27:0/3074812714 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559252737 0 0) 0x7f13c40c4430 con 0x7f13c4065a60 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c9a8c700 1 --2- 172.21.15.27:0/3074812714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c4152080 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f13bc009e60 tx=0x7f13bc009780).ready entity=mon.0 client_cookie=8467724d3566c49d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c8a8a700 1 -- 172.21.15.27:0/3074812714 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00e070 con 0x7f13c4151ca0 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c8a8a700 1 -- 172.21.15.27:0/3074812714 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00bc30 con 0x7f13c4151ca0 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13c8a8a700 1 -- 172.21.15.27:0/3074812714 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc012410 con 0x7f13c4151ca0 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13cbcf0700 1 -- 172.21.15.27:0/3074812714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 msgr2=0x7f13c4152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/3074812714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c4152080 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f13bc009e60 tx=0x7f13bc009780).stop 2023-05-17T15:29:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13cbcf0700 1 -- 172.21.15.27:0/3074812714 shutdown_connections 2023-05-17T15:29:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.089+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/3074812714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c4152080 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.090+0000 7f13cbcf0700 1 -- 172.21.15.27:0/3074812714 >> 172.21.15.27:0/3074812714 conn(0x7f13c40c94d0 msgr2=0x7f13c40c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.090+0000 7f13cbcf0700 1 -- 172.21.15.27:0/3074812714 shutdown_connections 2023-05-17T15:29:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.090+0000 7f13cbcf0700 1 -- 172.21.15.27:0/3074812714 wait complete. 2023-05-17T15:29:23.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.091+0000 7f13cbcf0700 1 Processor -- start 2023-05-17T15:29:23.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.091+0000 7f13cbcf0700 1 -- start start 2023-05-17T15:29:23.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.091+0000 7f13cbcf0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13c4065a60 0x7f13c41396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.091+0000 7f13cbcf0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13c40663a0 0x7f13c414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.091+0000 7f13cbcf0700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13cbcf0700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c414e980 con 0x7f13c4151ca0 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13cbcf0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4139bd0 con 0x7f13c40663a0 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13cbcf0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4151140 con 0x7f13c4065a60 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46530/0 (socket says 172.21.15.27:46530) 2023-05-17T15:29:23.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 -- 172.21.15.27:0/824828475 learned_addr learned my addr 172.21.15.27:0/824828475 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13c9a8c700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13c4065a60 0x7f13c41396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13c928b700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13c40663a0 0x7f13c414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 -- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13c4065a60 msgr2=0x7f13c41396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13c4065a60 0x7f13c41396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 -- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13c40663a0 msgr2=0x7f13c414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13c40663a0 0x7f13c414dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 -- 172.21.15.27:0/824828475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009a20 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13ca28d700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c414e490 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f13b400c420 tx=0x7f13b4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40072e0 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b4007440 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c4151420 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.092+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40057a0 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.093+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c40c0e30 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.093+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c406bdf0 con 0x7f13c4151ca0 2023-05-17T15:29:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.094+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f13b401a060 con 0x7f13c4151ca0 2023-05-17T15:29:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.094+0000 7f13c1ffb700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13b005ed90 0x7f13b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.094+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f13b4079330 con 0x7f13c4151ca0 2023-05-17T15:29:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.094+0000 7f13c9a8c700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13b005ed90 0x7f13b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.094+0000 7f13c9a8c700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13b005ed90 0x7f13b0061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f13bc009e60 tx=0x7f13bc009780).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.098+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13b404a850 con 0x7f13c4151ca0 2023-05-17T15:29:23.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.271+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13c40c1470 con 0x7f13c4151ca0 2023-05-17T15:29:23.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.272+0000 7f13c1ffb700 1 -- 172.21.15.27:0/824828475 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+17147 (secure 0 0 0) 0x7f13c40c1470 con 0x7f13c4151ca0 2023-05-17T15:29:23.276 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:23.277 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":177,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:20.586693+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:29:18.145777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-17T15:29:18.560834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:23.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13b005ed90 msgr2=0x7f13b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13b005ed90 0x7f13b0061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f13bc009e60 tx=0x7f13bc009780).stop 2023-05-17T15:29:23.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 msgr2=0x7f13c414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.278 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c414e490 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f13b400c420 tx=0x7f13b4007bb0).stop 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 shutdown_connections 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13b005ed90 0x7f13b0061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13c4151ca0 0x7f13c414e490 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13c4065a60 0x7f13c41396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 --2- 172.21.15.27:0/824828475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13c40663a0 0x7f13c414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 >> 172.21.15.27:0/824828475 conn(0x7f13c40c94d0 msgr2=0x7f13c40aa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 shutdown_connections 2023-05-17T15:29:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.274+0000 7f13cbcf0700 1 -- 172.21.15.27:0/824828475 wait complete. 2023-05-17T15:29:23.290 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T15:29:23.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:23.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.402+0000 7fbee3440700 1 Processor -- start 2023-05-17T15:29:23.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.402+0000 7fbee3440700 1 -- start start 2023-05-17T15:29:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee3440700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbedc154160 0x7fbedc0653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee3440700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc05dd50 0x7fbedc05e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee3440700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc064f20 con 0x7fbedc153d80 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee3440700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc05e6d0 con 0x7fbedc154160 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee3440700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc064310 con 0x7fbedc05dd50 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee11dc700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbedc153d80 0x7fbedc0bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46096/0 (socket says 172.21.15.27:46096) 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee11dc700 1 -- 172.21.15.27:0/3417222092 learned_addr learned my addr 172.21.15.27:0/3417222092 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee09db700 1 --2- 172.21.15.27:0/3417222092 >> v2:172.21.15.27:3300/0 conn(0x7fbedc154160 0x7fbedc0653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbed3fff700 1 -- 172.21.15.27:0/3417222092 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273414703 0 0) 0x7fbedc064f20 con 0x7fbedc153d80 2023-05-17T15:29:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbed3fff700 1 -- 172.21.15.27:0/3417222092 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec80033f0 con 0x7fbedc153d80 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee19dd700 1 --2- 172.21.15.27:0/3417222092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc05dd50 0x7fbedc05e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee09db700 1 -- 172.21.15.27:0/3417222092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc05dd50 msgr2=0x7fbedc05e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee09db700 1 --2- 172.21.15.27:0/3417222092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc05dd50 0x7fbedc05e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee09db700 1 -- 172.21.15.27:0/3417222092 >> v1:172.21.15.27:6789/0 conn(0x7fbedc153d80 legacy=0x7fbedc0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee09db700 1 -- 172.21.15.27:0/3417222092 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0645f0 con 0x7fbedc154160 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbee09db700 1 --2- 172.21.15.27:0/3417222092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc154160 0x7fbedc0653b0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fbecc009760 tx=0x7fbecc009060).ready entity=mon.0 client_cookie=341a2c2f742dccf9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbed3fff700 1 -- 172.21.15.27:0/3417222092 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00f510 con 0x7fbedc154160 2023-05-17T15:29:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbed3fff700 1 -- 172.21.15.27:0/3417222092 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00f670 con 0x7fbedc154160 2023-05-17T15:29:23.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.403+0000 7fbed3fff700 1 -- 172.21.15.27:0/3417222092 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00f9f0 con 0x7fbedc154160 2023-05-17T15:29:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 -- 172.21.15.27:0/3417222092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc154160 msgr2=0x7fbedc0653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 --2- 172.21.15.27:0/3417222092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc154160 0x7fbedc0653b0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fbecc009760 tx=0x7fbecc009060).stop 2023-05-17T15:29:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 -- 172.21.15.27:0/3417222092 shutdown_connections 2023-05-17T15:29:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 --2- 172.21.15.27:0/3417222092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc05dd50 0x7fbedc05e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 --2- 172.21.15.27:0/3417222092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc154160 0x7fbedc0653b0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 -- 172.21.15.27:0/3417222092 >> 172.21.15.27:0/3417222092 conn(0x7fbedc0c8400 msgr2=0x7fbedc0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 -- 172.21.15.27:0/3417222092 shutdown_connections 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.404+0000 7fbee3440700 1 -- 172.21.15.27:0/3417222092 wait complete. 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.405+0000 7fbee3440700 1 Processor -- start 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.405+0000 7fbee3440700 1 -- start start 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee3440700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 0x7fbedc0bfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee3440700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc153d80 0x7fbedc0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee3440700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbedc154160 0x7fbedc14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee3440700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc1645a0 con 0x7fbedc05dd50 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee3440700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc167ff0 con 0x7fbedc154160 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee3440700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc1682d0 con 0x7fbedc153d80 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 0x7fbedc0bfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 0x7fbedc0bfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46540/0 (socket says 172.21.15.27:46540) 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 -- 172.21.15.27:0/3277031986 learned_addr learned my addr 172.21.15.27:0/3277031986 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee19dd700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbedc154160 0x7fbedc14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee09db700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc153d80 0x7fbedc0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 -- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc153d80 msgr2=0x7fbedc0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc153d80 0x7fbedc0abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 -- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbedc154160 msgr2=0x7fbedc14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbedc154160 0x7fbedc14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee11dc700 1 -- 172.21.15.27:0/3277031986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0092a0 con 0x7fbedc05dd50 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.406+0000 7fbee19dd700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbedc154160 0x7fbedc14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:23.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.407+0000 7fbee11dc700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 0x7fbedc0bfe10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7fbed400c820 tx=0x7fbed4001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.407+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4005d30 con 0x7fbedc05dd50 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.407+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4005e90 con 0x7fbedc05dd50 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.407+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc1685b0 con 0x7fbedc05dd50 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.407+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4007320 con 0x7fbedc05dd50 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.407+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc0c1a20 con 0x7fbedc05dd50 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.408+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc066860 con 0x7fbedc05dd50 2023-05-17T15:29:23.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.408+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbed4010030 con 0x7fbedc05dd50 2023-05-17T15:29:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.408+0000 7fbed17fa700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ed90 0x7fbec0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.409+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fbed4079be0 con 0x7fbedc05dd50 2023-05-17T15:29:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.409+0000 7fbee09db700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ed90 0x7fbec0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.409+0000 7fbee09db700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ed90 0x7fbec0061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fbecc009fd0 tx=0x7fbecc017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.413+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbed404b100 con 0x7fbedc05dd50 2023-05-17T15:29:23.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.580+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbedc06bdf0 con 0x7fbec005ed90 2023-05-17T15:29:23.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.590+0000 7fbed17fa700 1 -- 172.21.15.27:0/3277031986 <== mgr.8802 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358854 (secure 0 0 0) 0x7fbedc06bdf0 con 0x7fbec005ed90 2023-05-17T15:29:23.597 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:23.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.593+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ed90 msgr2=0x7fbec0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ed90 0x7fbec0061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fbecc009fd0 tx=0x7fbecc017000).stop 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 msgr2=0x7fbedc0bfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 0x7fbedc0bfe10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7fbed400c820 tx=0x7fbed4001650).stop 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 shutdown_connections 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbec005ed90 0x7fbec0061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbedc154160 0x7fbedc14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbedc05dd50 0x7fbedc0bfe10 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 --2- 172.21.15.27:0/3277031986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbedc153d80 0x7fbedc0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 >> 172.21.15.27:0/3277031986 conn(0x7fbedc0c8400 msgr2=0x7fbedc0c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:23.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 shutdown_connections 2023-05-17T15:29:23.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.594+0000 7fbee3440700 1 -- 172.21.15.27:0/3277031986 wait complete. 2023-05-17T15:29:23.601 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:29:22.476572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":180900,"kb_used_data":16996,"kb_used_omap":0,"kb_used_meta":163840,"kb_avail":754793820,"statfs":{"total":773094113280,"available":772908871680,"internally_reserved":0,"allocated":17403904,"data_stored":8865141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":167772160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27326,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-74,"num_write_kb":-56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.607630"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210640+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.229081+0000","last_change":"2023-05-17T15:29:19.229081+0000","last_active":"2023-05-17T15:29:19.229081+0000","last_peered":"2023-05-17T15:29:19.229081+0000","last_clean":"2023-05-17T15:29:19.229081+0000","last_became_active":"2023-05-17T15:29:19.228777+0000","last_became_peered":"2023-05-17T15:29:19.228777+0000","last_unstale":"2023-05-17T15:29:19.229081+0000","last_undegraded":"2023-05-17T15:29:19.229081+0000","last_fullsized":"2023-05-17T15:29:19.229081+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216789+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216438+0000","last_change":"2023-05-17T15:29:19.216438+0000","last_active":"2023-05-17T15:29:19.216438+0000","last_peered":"2023-05-17T15:29:19.216438+0000","last_clean":"2023-05-17T15:29:19.216438+0000","last_became_active":"2023-05-17T15:29:19.216102+0000","last_became_peered":"2023-05-17T15:29:19.216102+0000","last_unstale":"2023-05-17T15:29:19.216438+0000","last_undegraded":"2023-05-17T15:29:19.216438+0000","last_fullsized":"2023-05-17T15:29:19.216438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218298+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.217921+0000","last_change":"2023-05-17T15:29:19.217921+0000","last_active":"2023-05-17T15:29:19.217921+0000","last_peered":"2023-05-17T15:29:19.217921+0000","last_clean":"2023-05-17T15:29:19.217921+0000","last_became_active":"2023-05-17T15:29:19.217620+0000","last_became_peered":"2023-05-17T15:29:19.217620+0000","last_unstale":"2023-05-17T15:29:19.217921+0000","last_undegraded":"2023-05-17T15:29:19.217921+0000","last_fullsized":"2023-05-17T15:29:19.217921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220325+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227841+0000","last_change":"2023-05-17T15:29:19.227841+0000","last_active":"2023-05-17T15:29:19.227841+0000","last_peered":"2023-05-17T15:29:19.227841+0000","last_clean":"2023-05-17T15:29:19.227841+0000","last_became_active":"2023-05-17T15:29:19.226953+0000","last_became_peered":"2023-05-17T15:29:19.226953+0000","last_unstale":"2023-05-17T15:29:19.227841+0000","last_undegraded":"2023-05-17T15:29:19.227841+0000","last_fullsized":"2023-05-17T15:29:19.227841+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215112+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235472+0000","last_change":"2023-05-17T15:29:19.235472+0000","last_active":"2023-05-17T15:29:19.235472+0000","last_peered":"2023-05-17T15:29:19.235472+0000","last_clean":"2023-05-17T15:29:19.235472+0000","last_became_active":"2023-05-17T15:29:19.235161+0000","last_became_peered":"2023-05-17T15:29:19.235161+0000","last_unstale":"2023-05-17T15:29:19.235472+0000","last_undegraded":"2023-05-17T15:29:19.235472+0000","last_fullsized":"2023-05-17T15:29:19.235472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215187+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226407+0000","last_change":"2023-05-17T15:29:19.226407+0000","last_active":"2023-05-17T15:29:19.226407+0000","last_peered":"2023-05-17T15:29:19.226407+0000","last_clean":"2023-05-17T15:29:19.226407+0000","last_became_active":"2023-05-17T15:29:19.226135+0000","last_became_peered":"2023-05-17T15:29:19.226135+0000","last_unstale":"2023-05-17T15:29:19.226407+0000","last_undegraded":"2023-05-17T15:29:19.226407+0000","last_fullsized":"2023-05-17T15:29:19.226407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211818+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228189+0000","last_change":"2023-05-17T15:29:19.228189+0000","last_active":"2023-05-17T15:29:19.228189+0000","last_peered":"2023-05-17T15:29:19.228189+0000","last_clean":"2023-05-17T15:29:19.228189+0000","last_became_active":"2023-05-17T15:29:19.227924+0000","last_became_peered":"2023-05-17T15:29:19.227924+0000","last_unstale":"2023-05-17T15:29:19.228189+0000","last_undegraded":"2023-05-17T15:29:19.228189+0000","last_fullsized":"2023-05-17T15:29:19.228189+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214669+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224680+0000","last_change":"2023-05-17T15:29:19.224680+0000","last_active":"2023-05-17T15:29:19.224680+0000","last_peered":"2023-05-17T15:29:19.224680+0000","last_clean":"2023-05-17T15:29:19.224680+0000","last_became_active":"2023-05-17T15:29:19.224445+0000","last_became_peered":"2023-05-17T15:29:19.224445+0000","last_unstale":"2023-05-17T15:29:19.224680+0000","last_undegraded":"2023-05-17T15:29:19.224680+0000","last_fullsized":"2023-05-17T15:29:19.224680+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211554+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227068+0000","last_change":"2023-05-17T15:29:19.227068+0000","last_active":"2023-05-17T15:29:19.227068+0000","last_peered":"2023-05-17T15:29:19.227068+0000","last_clean":"2023-05-17T15:29:19.227068+0000","last_became_active":"2023-05-17T15:29:19.226527+0000","last_became_peered":"2023-05-17T15:29:19.226527+0000","last_unstale":"2023-05-17T15:29:19.227068+0000","last_undegraded":"2023-05-17T15:29:19.227068+0000","last_fullsized":"2023-05-17T15:29:19.227068+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208007+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.234553+0000","last_change":"2023-05-17T15:29:19.234553+0000","last_active":"2023-05-17T15:29:19.234553+0000","last_peered":"2023-05-17T15:29:19.234553+0000","last_clean":"2023-05-17T15:29:19.234553+0000","last_became_active":"2023-05-17T15:29:19.231624+0000","last_became_peered":"2023-05-17T15:29:19.231624+0000","last_unstale":"2023-05-17T15:29:19.234553+0000","last_undegraded":"2023-05-17T15:29:19.234553+0000","last_fullsized":"2023-05-17T15:29:19.234553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209912+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225402+0000","last_change":"2023-05-17T15:29:19.225402+0000","last_active":"2023-05-17T15:29:19.225402+0000","last_peered":"2023-05-17T15:29:19.225402+0000","last_clean":"2023-05-17T15:29:19.225402+0000","last_became_active":"2023-05-17T15:29:19.225133+0000","last_became_peered":"2023-05-17T15:29:19.225133+0000","last_unstale":"2023-05-17T15:29:19.225402+0000","last_undegraded":"2023-05-17T15:29:19.225402+0000","last_fullsized":"2023-05-17T15:29:19.225402+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214813+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235126+0000","last_change":"2023-05-17T15:29:19.235126+0000","last_active":"2023-05-17T15:29:19.235126+0000","last_peered":"2023-05-17T15:29:19.235126+0000","last_clean":"2023-05-17T15:29:19.235126+0000","last_became_active":"2023-05-17T15:29:19.234828+0000","last_became_peered":"2023-05-17T15:29:19.234828+0000","last_unstale":"2023-05-17T15:29:19.235126+0000","last_undegraded":"2023-05-17T15:29:19.235126+0000","last_fullsized":"2023-05-17T15:29:19.235126+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209939+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233128+0000","last_change":"2023-05-17T15:29:19.233128+0000","last_active":"2023-05-17T15:29:19.233128+0000","last_peered":"2023-05-17T15:29:19.233128+0000","last_clean":"2023-05-17T15:29:19.233128+0000","last_became_active":"2023-05-17T15:29:19.232840+0000","last_became_peered":"2023-05-17T15:29:19.232840+0000","last_unstale":"2023-05-17T15:29:19.233128+0000","last_undegraded":"2023-05-17T15:29:19.233128+0000","last_fullsized":"2023-05-17T15:29:19.233128+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214146+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232632+0000","last_change":"2023-05-17T15:29:19.232632+0000","last_active":"2023-05-17T15:29:19.232632+0000","last_peered":"2023-05-17T15:29:19.232632+0000","last_clean":"2023-05-17T15:29:19.232632+0000","last_became_active":"2023-05-17T15:29:19.232325+0000","last_became_peered":"2023-05-17T15:29:19.232325+0000","last_unstale":"2023-05-17T15:29:19.232632+0000","last_undegraded":"2023-05-17T15:29:19.232632+0000","last_fullsized":"2023-05-17T15:29:19.232632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209702+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233692+0000","last_change":"2023-05-17T15:29:19.233692+0000","last_active":"2023-05-17T15:29:19.233692+0000","last_peered":"2023-05-17T15:29:19.233692+0000","last_clean":"2023-05-17T15:29:19.233692+0000","last_became_active":"2023-05-17T15:29:19.233389+0000","last_became_peered":"2023-05-17T15:29:19.233389+0000","last_unstale":"2023-05-17T15:29:19.233692+0000","last_undegraded":"2023-05-17T15:29:19.233692+0000","last_fullsized":"2023-05-17T15:29:19.233692+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211542+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223496+0000","last_change":"2023-05-17T15:29:19.223496+0000","last_active":"2023-05-17T15:29:19.223496+0000","last_peered":"2023-05-17T15:29:19.223496+0000","last_clean":"2023-05-17T15:29:19.223496+0000","last_became_active":"2023-05-17T15:29:19.222935+0000","last_became_peered":"2023-05-17T15:29:19.222935+0000","last_unstale":"2023-05-17T15:29:19.223496+0000","last_undegraded":"2023-05-17T15:29:19.223496+0000","last_fullsized":"2023-05-17T15:29:19.223496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208051+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235837+0000","last_change":"2023-05-17T15:29:19.235837+0000","last_active":"2023-05-17T15:29:19.235837+0000","last_peered":"2023-05-17T15:29:19.235837+0000","last_clean":"2023-05-17T15:29:19.235837+0000","last_became_active":"2023-05-17T15:29:19.235271+0000","last_became_peered":"2023-05-17T15:29:19.235271+0000","last_unstale":"2023-05-17T15:29:19.235837+0000","last_undegraded":"2023-05-17T15:29:19.235837+0000","last_fullsized":"2023-05-17T15:29:19.235837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219225+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218502+0000","last_change":"2023-05-17T15:29:19.218502+0000","last_active":"2023-05-17T15:29:19.218502+0000","last_peered":"2023-05-17T15:29:19.218502+0000","last_clean":"2023-05-17T15:29:19.218502+0000","last_became_active":"2023-05-17T15:29:19.218216+0000","last_became_peered":"2023-05-17T15:29:19.218216+0000","last_unstale":"2023-05-17T15:29:19.218502+0000","last_undegraded":"2023-05-17T15:29:19.218502+0000","last_fullsized":"2023-05-17T15:29:19.218502+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211265+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223022+0000","last_change":"2023-05-17T15:29:19.223022+0000","last_active":"2023-05-17T15:29:19.223022+0000","last_peered":"2023-05-17T15:29:19.223022+0000","last_clean":"2023-05-17T15:29:19.223022+0000","last_became_active":"2023-05-17T15:29:19.222747+0000","last_became_peered":"2023-05-17T15:29:19.222747+0000","last_unstale":"2023-05-17T15:29:19.223022+0000","last_undegraded":"2023-05-17T15:29:19.223022+0000","last_fullsized":"2023-05-17T15:29:19.223022+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210321+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218399+0000","last_change":"2023-05-17T15:29:19.218399+0000","last_active":"2023-05-17T15:29:19.218399+0000","last_peered":"2023-05-17T15:29:19.218399+0000","last_clean":"2023-05-17T15:29:19.218399+0000","last_became_active":"2023-05-17T15:29:19.218004+0000","last_became_peered":"2023-05-17T15:29:19.218004+0000","last_unstale":"2023-05-17T15:29:19.218399+0000","last_undegraded":"2023-05-17T15:29:19.218399+0000","last_fullsized":"2023-05-17T15:29:19.218399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209004+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231041+0000","last_change":"2023-05-17T15:29:19.231041+0000","last_active":"2023-05-17T15:29:19.231041+0000","last_peered":"2023-05-17T15:29:19.231041+0000","last_clean":"2023-05-17T15:29:19.231041+0000","last_became_active":"2023-05-17T15:29:19.230710+0000","last_became_peered":"2023-05-17T15:29:19.230710+0000","last_unstale":"2023-05-17T15:29:19.231041+0000","last_undegraded":"2023-05-17T15:29:19.231041+0000","last_fullsized":"2023-05-17T15:29:19.231041+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219713+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226559+0000","last_change":"2023-05-17T15:29:19.226559+0000","last_active":"2023-05-17T15:29:19.226559+0000","last_peered":"2023-05-17T15:29:19.226559+0000","last_clean":"2023-05-17T15:29:19.226559+0000","last_became_active":"2023-05-17T15:29:19.225699+0000","last_became_peered":"2023-05-17T15:29:19.225699+0000","last_unstale":"2023-05-17T15:29:19.226559+0000","last_undegraded":"2023-05-17T15:29:19.226559+0000","last_fullsized":"2023-05-17T15:29:19.226559+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216511+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223102+0000","last_change":"2023-05-17T15:29:19.223102+0000","last_active":"2023-05-17T15:29:19.223102+0000","last_peered":"2023-05-17T15:29:19.223102+0000","last_clean":"2023-05-17T15:29:19.223102+0000","last_became_active":"2023-05-17T15:29:19.222837+0000","last_became_peered":"2023-05-17T15:29:19.222837+0000","last_unstale":"2023-05-17T15:29:19.223102+0000","last_undegraded":"2023-05-17T15:29:19.223102+0000","last_fullsized":"2023-05-17T15:29:19.223102+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210471+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236154+0000","last_change":"2023-05-17T15:29:19.236154+0000","last_active":"2023-05-17T15:29:19.236154+0000","last_peered":"2023-05-17T15:29:19.236154+0000","last_clean":"2023-05-17T15:29:19.236154+0000","last_became_active":"2023-05-17T15:29:19.235132+0000","last_became_peered":"2023-05-17T15:29:19.235132+0000","last_unstale":"2023-05-17T15:29:19.236154+0000","last_undegraded":"2023-05-17T15:29:19.236154+0000","last_fullsized":"2023-05-17T15:29:19.236154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208957+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225105+0000","last_change":"2023-05-17T15:29:19.225105+0000","last_active":"2023-05-17T15:29:19.225105+0000","last_peered":"2023-05-17T15:29:19.225105+0000","last_clean":"2023-05-17T15:29:19.225105+0000","last_became_active":"2023-05-17T15:29:19.224787+0000","last_became_peered":"2023-05-17T15:29:19.224787+0000","last_unstale":"2023-05-17T15:29:19.225105+0000","last_undegraded":"2023-05-17T15:29:19.225105+0000","last_fullsized":"2023-05-17T15:29:19.225105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209947+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224828+0000","last_change":"2023-05-17T15:29:19.224828+0000","last_active":"2023-05-17T15:29:19.224828+0000","last_peered":"2023-05-17T15:29:19.224828+0000","last_clean":"2023-05-17T15:29:19.224828+0000","last_became_active":"2023-05-17T15:29:19.224459+0000","last_became_peered":"2023-05-17T15:29:19.224459+0000","last_unstale":"2023-05-17T15:29:19.224828+0000","last_undegraded":"2023-05-17T15:29:19.224828+0000","last_fullsized":"2023-05-17T15:29:19.224828+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.221275+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.219162+0000","last_change":"2023-05-17T15:29:19.219162+0000","last_active":"2023-05-17T15:29:19.219162+0000","last_peered":"2023-05-17T15:29:19.219162+0000","last_clean":"2023-05-17T15:29:19.219162+0000","last_became_active":"2023-05-17T15:29:19.217976+0000","last_became_peered":"2023-05-17T15:29:19.217976+0000","last_unstale":"2023-05-17T15:29:19.219162+0000","last_undegraded":"2023-05-17T15:29:19.219162+0000","last_fullsized":"2023-05-17T15:29:19.219162+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217845+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226882+0000","last_change":"2023-05-17T15:29:19.226882+0000","last_active":"2023-05-17T15:29:19.226882+0000","last_peered":"2023-05-17T15:29:19.226882+0000","last_clean":"2023-05-17T15:29:19.226882+0000","last_became_active":"2023-05-17T15:29:19.226602+0000","last_became_peered":"2023-05-17T15:29:19.226602+0000","last_unstale":"2023-05-17T15:29:19.226882+0000","last_undegraded":"2023-05-17T15:29:19.226882+0000","last_fullsized":"2023-05-17T15:29:19.226882+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217088+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227477+0000","last_change":"2023-05-17T15:29:19.227477+0000","last_active":"2023-05-17T15:29:19.227477+0000","last_peered":"2023-05-17T15:29:19.227477+0000","last_clean":"2023-05-17T15:29:19.227477+0000","last_became_active":"2023-05-17T15:29:19.227181+0000","last_became_peered":"2023-05-17T15:29:19.227181+0000","last_unstale":"2023-05-17T15:29:19.227477+0000","last_undegraded":"2023-05-17T15:29:19.227477+0000","last_fullsized":"2023-05-17T15:29:19.227477+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208391+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226062+0000","last_change":"2023-05-17T15:29:19.226062+0000","last_active":"2023-05-17T15:29:19.226062+0000","last_peered":"2023-05-17T15:29:19.226062+0000","last_clean":"2023-05-17T15:29:19.226062+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226062+0000","last_undegraded":"2023-05-17T15:29:19.226062+0000","last_fullsized":"2023-05-17T15:29:19.226062+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208882+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223810+0000","last_change":"2023-05-17T15:29:19.223810+0000","last_active":"2023-05-17T15:29:19.223810+0000","last_peered":"2023-05-17T15:29:19.223810+0000","last_clean":"2023-05-17T15:29:19.223810+0000","last_became_active":"2023-05-17T15:29:19.223511+0000","last_became_peered":"2023-05-17T15:29:19.223511+0000","last_unstale":"2023-05-17T15:29:19.223810+0000","last_undegraded":"2023-05-17T15:29:19.223810+0000","last_fullsized":"2023-05-17T15:29:19.223810+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217649+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227154+0000","last_change":"2023-05-17T15:29:19.227154+0000","last_active":"2023-05-17T15:29:19.227154+0000","last_peered":"2023-05-17T15:29:19.227154+0000","last_clean":"2023-05-17T15:29:19.227154+0000","last_became_active":"2023-05-17T15:29:19.226876+0000","last_became_peered":"2023-05-17T15:29:19.226876+0000","last_unstale":"2023-05-17T15:29:19.227154+0000","last_undegraded":"2023-05-17T15:29:19.227154+0000","last_fullsized":"2023-05-17T15:29:19.227154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217501+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216411+0000","last_change":"2023-05-17T15:29:19.216411+0000","last_active":"2023-05-17T15:29:19.216411+0000","last_peered":"2023-05-17T15:29:19.216411+0000","last_clean":"2023-05-17T15:29:19.216411+0000","last_became_active":"2023-05-17T15:29:19.216065+0000","last_became_peered":"2023-05-17T15:29:19.216065+0000","last_unstale":"2023-05-17T15:29:19.216411+0000","last_undegraded":"2023-05-17T15:29:19.216411+0000","last_fullsized":"2023-05-17T15:29:19.216411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216413+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236893+0000","last_change":"2023-05-17T15:29:19.236893+0000","last_active":"2023-05-17T15:29:19.236893+0000","last_peered":"2023-05-17T15:29:19.236893+0000","last_clean":"2023-05-17T15:29:19.236893+0000","last_became_active":"2023-05-17T15:29:19.236609+0000","last_became_peered":"2023-05-17T15:29:19.236609+0000","last_unstale":"2023-05-17T15:29:19.236893+0000","last_undegraded":"2023-05-17T15:29:19.236893+0000","last_fullsized":"2023-05-17T15:29:19.236893+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214211+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236874+0000","last_change":"2023-05-17T15:29:19.236874+0000","last_active":"2023-05-17T15:29:19.236874+0000","last_peered":"2023-05-17T15:29:19.236874+0000","last_clean":"2023-05-17T15:29:19.236874+0000","last_became_active":"2023-05-17T15:29:19.236507+0000","last_became_peered":"2023-05-17T15:29:19.236507+0000","last_unstale":"2023-05-17T15:29:19.236874+0000","last_undegraded":"2023-05-17T15:29:19.236874+0000","last_fullsized":"2023-05-17T15:29:19.236874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.222536+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228664+0000","last_change":"2023-05-17T15:29:19.228664+0000","last_active":"2023-05-17T15:29:19.228664+0000","last_peered":"2023-05-17T15:29:19.228664+0000","last_clean":"2023-05-17T15:29:19.228664+0000","last_became_active":"2023-05-17T15:29:19.228391+0000","last_became_peered":"2023-05-17T15:29:19.228391+0000","last_unstale":"2023-05-17T15:29:19.228664+0000","last_undegraded":"2023-05-17T15:29:19.228664+0000","last_fullsized":"2023-05-17T15:29:19.228664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.207484+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232621+0000","last_change":"2023-05-17T15:29:19.232621+0000","last_active":"2023-05-17T15:29:19.232621+0000","last_peered":"2023-05-17T15:29:19.232621+0000","last_clean":"2023-05-17T15:29:19.232621+0000","last_became_active":"2023-05-17T15:29:19.232307+0000","last_became_peered":"2023-05-17T15:29:19.232307+0000","last_unstale":"2023-05-17T15:29:19.232621+0000","last_undegraded":"2023-05-17T15:29:19.232621+0000","last_fullsized":"2023-05-17T15:29:19.232621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212329+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228906+0000","last_change":"2023-05-17T15:29:19.228906+0000","last_active":"2023-05-17T15:29:19.228906+0000","last_peered":"2023-05-17T15:29:19.228906+0000","last_clean":"2023-05-17T15:29:19.228906+0000","last_became_active":"2023-05-17T15:29:19.228614+0000","last_became_peered":"2023-05-17T15:29:19.228614+0000","last_unstale":"2023-05-17T15:29:19.228906+0000","last_undegraded":"2023-05-17T15:29:19.228906+0000","last_fullsized":"2023-05-17T15:29:19.228906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214530+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227011+0000","last_change":"2023-05-17T15:29:19.227011+0000","last_active":"2023-05-17T15:29:19.227011+0000","last_peered":"2023-05-17T15:29:19.227011+0000","last_clean":"2023-05-17T15:29:19.227011+0000","last_became_active":"2023-05-17T15:29:19.225640+0000","last_became_peered":"2023-05-17T15:29:19.225640+0000","last_unstale":"2023-05-17T15:29:19.227011+0000","last_undegraded":"2023-05-17T15:29:19.227011+0000","last_fullsized":"2023-05-17T15:29:19.227011+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218161+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224151+0000","last_change":"2023-05-17T15:29:19.224151+0000","last_active":"2023-05-17T15:29:19.224151+0000","last_peered":"2023-05-17T15:29:19.224151+0000","last_clean":"2023-05-17T15:29:19.224151+0000","last_became_active":"2023-05-17T15:29:19.223868+0000","last_became_peered":"2023-05-17T15:29:19.223868+0000","last_unstale":"2023-05-17T15:29:19.224151+0000","last_undegraded":"2023-05-17T15:29:19.224151+0000","last_fullsized":"2023-05-17T15:29:19.224151+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220066+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227419+0000","last_change":"2023-05-17T15:29:19.227419+0000","last_active":"2023-05-17T15:29:19.227419+0000","last_peered":"2023-05-17T15:29:19.227419+0000","last_clean":"2023-05-17T15:29:19.227419+0000","last_became_active":"2023-05-17T15:29:19.227004+0000","last_became_peered":"2023-05-17T15:29:19.227004+0000","last_unstale":"2023-05-17T15:29:19.227419+0000","last_undegraded":"2023-05-17T15:29:19.227419+0000","last_fullsized":"2023-05-17T15:29:19.227419+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.224798+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227367+0000","last_change":"2023-05-17T15:29:19.227367+0000","last_active":"2023-05-17T15:29:19.227367+0000","last_peered":"2023-05-17T15:29:19.227367+0000","last_clean":"2023-05-17T15:29:19.227367+0000","last_became_active":"2023-05-17T15:29:19.227029+0000","last_became_peered":"2023-05-17T15:29:19.227029+0000","last_unstale":"2023-05-17T15:29:19.227367+0000","last_undegraded":"2023-05-17T15:29:19.227367+0000","last_fullsized":"2023-05-17T15:29:19.227367+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217807+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226649+0000","last_change":"2023-05-17T15:29:19.226649+0000","last_active":"2023-05-17T15:29:19.226649+0000","last_peered":"2023-05-17T15:29:19.226649+0000","last_clean":"2023-05-17T15:29:19.226649+0000","last_became_active":"2023-05-17T15:29:19.225847+0000","last_became_peered":"2023-05-17T15:29:19.225847+0000","last_unstale":"2023-05-17T15:29:19.226649+0000","last_undegraded":"2023-05-17T15:29:19.226649+0000","last_fullsized":"2023-05-17T15:29:19.226649+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217408+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225240+0000","last_change":"2023-05-17T15:29:19.225240+0000","last_active":"2023-05-17T15:29:19.225240+0000","last_peered":"2023-05-17T15:29:19.225240+0000","last_clean":"2023-05-17T15:29:19.225240+0000","last_became_active":"2023-05-17T15:29:19.224910+0000","last_became_peered":"2023-05-17T15:29:19.224910+0000","last_unstale":"2023-05-17T15:29:19.225240+0000","last_undegraded":"2023-05-17T15:29:19.225240+0000","last_fullsized":"2023-05-17T15:29:19.225240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.226366+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225479+0000","last_change":"2023-05-17T15:29:19.225479+0000","last_active":"2023-05-17T15:29:19.225479+0000","last_peered":"2023-05-17T15:29:19.225479+0000","last_clean":"2023-05-17T15:29:19.225479+0000","last_became_active":"2023-05-17T15:29:19.225162+0000","last_became_peered":"2023-05-17T15:29:19.225162+0000","last_unstale":"2023-05-17T15:29:19.225479+0000","last_undegraded":"2023-05-17T15:29:19.225479+0000","last_fullsized":"2023-05-17T15:29:19.225479+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.213255+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225875+0000","last_change":"2023-05-17T15:29:19.225875+0000","last_active":"2023-05-17T15:29:19.225875+0000","last_peered":"2023-05-17T15:29:19.225875+0000","last_clean":"2023-05-17T15:29:19.225875+0000","last_became_active":"2023-05-17T15:29:19.225389+0000","last_became_peered":"2023-05-17T15:29:19.225389+0000","last_unstale":"2023-05-17T15:29:19.225875+0000","last_undegraded":"2023-05-17T15:29:19.225875+0000","last_fullsized":"2023-05-17T15:29:19.225875+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.223039+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228139+0000","last_change":"2023-05-17T15:29:19.228139+0000","last_active":"2023-05-17T15:29:19.228139+0000","last_peered":"2023-05-17T15:29:19.228139+0000","last_clean":"2023-05-17T15:29:19.228139+0000","last_became_active":"2023-05-17T15:29:19.227706+0000","last_became_peered":"2023-05-17T15:29:19.227706+0000","last_unstale":"2023-05-17T15:29:19.228139+0000","last_undegraded":"2023-05-17T15:29:19.228139+0000","last_fullsized":"2023-05-17T15:29:19.228139+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216578+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224407+0000","last_change":"2023-05-17T15:29:19.224407+0000","last_active":"2023-05-17T15:29:19.224407+0000","last_peered":"2023-05-17T15:29:19.224407+0000","last_clean":"2023-05-17T15:29:19.224407+0000","last_became_active":"2023-05-17T15:29:19.224060+0000","last_became_peered":"2023-05-17T15:29:19.224060+0000","last_unstale":"2023-05-17T15:29:19.224407+0000","last_undegraded":"2023-05-17T15:29:19.224407+0000","last_fullsized":"2023-05-17T15:29:19.224407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214424+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223726+0000","last_change":"2023-05-17T15:29:19.223726+0000","last_active":"2023-05-17T15:29:19.223726+0000","last_peered":"2023-05-17T15:29:19.223726+0000","last_clean":"2023-05-17T15:29:19.223726+0000","last_became_active":"2023-05-17T15:29:19.223436+0000","last_became_peered":"2023-05-17T15:29:19.223436+0000","last_unstale":"2023-05-17T15:29:19.223726+0000","last_undegraded":"2023-05-17T15:29:19.223726+0000","last_fullsized":"2023-05-17T15:29:19.223726+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209903+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231442+0000","last_change":"2023-05-17T15:29:19.231442+0000","last_active":"2023-05-17T15:29:19.231442+0000","last_peered":"2023-05-17T15:29:19.231442+0000","last_clean":"2023-05-17T15:29:19.231442+0000","last_became_active":"2023-05-17T15:29:19.231112+0000","last_became_peered":"2023-05-17T15:29:19.231112+0000","last_unstale":"2023-05-17T15:29:19.231442+0000","last_undegraded":"2023-05-17T15:29:19.231442+0000","last_fullsized":"2023-05-17T15:29:19.231442+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216606+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.229267+0000","last_change":"2023-05-17T15:29:19.229267+0000","last_active":"2023-05-17T15:29:19.229267+0000","last_peered":"2023-05-17T15:29:19.229267+0000","last_clean":"2023-05-17T15:29:19.229267+0000","last_became_active":"2023-05-17T15:29:19.228233+0000","last_became_peered":"2023-05-17T15:29:19.228233+0000","last_unstale":"2023-05-17T15:29:19.229267+0000","last_undegraded":"2023-05-17T15:29:19.229267+0000","last_fullsized":"2023-05-17T15:29:19.229267+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212505+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225497+0000","last_change":"2023-05-17T15:29:19.225497+0000","last_active":"2023-05-17T15:29:19.225497+0000","last_peered":"2023-05-17T15:29:19.225497+0000","last_clean":"2023-05-17T15:29:19.225497+0000","last_became_active":"2023-05-17T15:29:19.225214+0000","last_became_peered":"2023-05-17T15:29:19.225214+0000","last_unstale":"2023-05-17T15:29:19.225497+0000","last_undegraded":"2023-05-17T15:29:19.225497+0000","last_fullsized":"2023-05-17T15:29:19.225497+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218487+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228812+0000","last_change":"2023-05-17T15:29:19.228812+0000","last_active":"2023-05-17T15:29:19.228812+0000","last_peered":"2023-05-17T15:29:19.228812+0000","last_clean":"2023-05-17T15:29:19.228812+0000","last_became_active":"2023-05-17T15:29:19.228540+0000","last_became_peered":"2023-05-17T15:29:19.228540+0000","last_unstale":"2023-05-17T15:29:19.228812+0000","last_undegraded":"2023-05-17T15:29:19.228812+0000","last_fullsized":"2023-05-17T15:29:19.228812+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211806+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.230855+0000","last_change":"2023-05-17T15:29:19.230855+0000","last_active":"2023-05-17T15:29:19.230855+0000","last_peered":"2023-05-17T15:29:19.230855+0000","last_clean":"2023-05-17T15:29:19.230855+0000","last_became_active":"2023-05-17T15:29:19.228960+0000","last_became_peered":"2023-05-17T15:29:19.228960+0000","last_unstale":"2023-05-17T15:29:19.230855+0000","last_undegraded":"2023-05-17T15:29:19.230855+0000","last_fullsized":"2023-05-17T15:29:19.230855+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214153+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.221496+0000","last_change":"2023-05-17T15:29:19.221496+0000","last_active":"2023-05-17T15:29:19.221496+0000","last_peered":"2023-05-17T15:29:19.221496+0000","last_clean":"2023-05-17T15:29:19.221496+0000","last_became_active":"2023-05-17T15:29:19.221198+0000","last_became_peered":"2023-05-17T15:29:19.221198+0000","last_unstale":"2023-05-17T15:29:19.221496+0000","last_undegraded":"2023-05-17T15:29:19.221496+0000","last_fullsized":"2023-05-17T15:29:19.221496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217242+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235317+0000","last_change":"2023-05-17T15:29:19.235317+0000","last_active":"2023-05-17T15:29:19.235317+0000","last_peered":"2023-05-17T15:29:19.235317+0000","last_clean":"2023-05-17T15:29:19.235317+0000","last_became_active":"2023-05-17T15:29:19.235022+0000","last_became_peered":"2023-05-17T15:29:19.235022+0000","last_unstale":"2023-05-17T15:29:19.235317+0000","last_undegraded":"2023-05-17T15:29:19.235317+0000","last_fullsized":"2023-05-17T15:29:19.235317+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216672+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216276+0000","last_change":"2023-05-17T15:29:19.216276+0000","last_active":"2023-05-17T15:29:19.216276+0000","last_peered":"2023-05-17T15:29:19.216276+0000","last_clean":"2023-05-17T15:29:19.216276+0000","last_became_active":"2023-05-17T15:29:19.215939+0000","last_became_peered":"2023-05-17T15:29:19.215939+0000","last_unstale":"2023-05-17T15:29:19.216276+0000","last_undegraded":"2023-05-17T15:29:19.216276+0000","last_fullsized":"2023-05-17T15:29:19.216276+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.204451+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:18.204451+0000","last_peered":"2023-05-17T15:29:18.204451+0000","last_clean":"2023-05-17T15:29:18.204451+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:18.204451+0000","last_undegraded":"2023-05-17T15:29:18.204451+0000","last_fullsized":"2023-05-17T15:29:18.204451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210897+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213012+0000","last_change":"2023-05-17T15:29:19.213012+0000","last_active":"2023-05-17T15:29:19.213012+0000","last_peered":"2023-05-17T15:29:19.213012+0000","last_clean":"2023-05-17T15:29:19.213012+0000","last_became_active":"2023-05-17T15:29:19.212738+0000","last_became_peered":"2023-05-17T15:29:19.212738+0000","last_unstale":"2023-05-17T15:29:19.213012+0000","last_undegraded":"2023-05-17T15:29:19.213012+0000","last_fullsized":"2023-05-17T15:29:19.213012+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213738+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:18.213738+0000","last_peered":"2023-05-17T15:29:18.213738+0000","last_clean":"2023-05-17T15:29:18.213738+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:18.213738+0000","last_undegraded":"2023-05-17T15:29:18.213738+0000","last_fullsized":"2023-05-17T15:29:18.213738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208563+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225010+0000","last_change":"2023-05-17T15:29:19.225010+0000","last_active":"2023-05-17T15:29:19.225010+0000","last_peered":"2023-05-17T15:29:19.225010+0000","last_clean":"2023-05-17T15:29:19.225010+0000","last_became_active":"2023-05-17T15:29:19.224310+0000","last_became_peered":"2023-05-17T15:29:19.224310+0000","last_unstale":"2023-05-17T15:29:19.225010+0000","last_undegraded":"2023-05-17T15:29:19.225010+0000","last_fullsized":"2023-05-17T15:29:19.225010+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.199202+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:18.199202+0000","last_peered":"2023-05-17T15:29:18.199202+0000","last_clean":"2023-05-17T15:29:18.199202+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:18.199202+0000","last_undegraded":"2023-05-17T15:29:18.199202+0000","last_fullsized":"2023-05-17T15:29:18.199202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215097+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226296+0000","last_change":"2023-05-17T15:29:19.226296+0000","last_active":"2023-05-17T15:29:19.226296+0000","last_peered":"2023-05-17T15:29:19.226296+0000","last_clean":"2023-05-17T15:29:19.226296+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226296+0000","last_undegraded":"2023-05-17T15:29:19.226296+0000","last_fullsized":"2023-05-17T15:29:19.226296+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213984+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:18.213984+0000","last_peered":"2023-05-17T15:29:18.213984+0000","last_clean":"2023-05-17T15:29:18.213984+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:18.213984+0000","last_undegraded":"2023-05-17T15:29:18.213984+0000","last_fullsized":"2023-05-17T15:29:18.213984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207635+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:18.207635+0000","last_peered":"2023-05-17T15:29:18.207635+0000","last_clean":"2023-05-17T15:29:18.207635+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:18.207635+0000","last_undegraded":"2023-05-17T15:29:18.207635+0000","last_fullsized":"2023-05-17T15:29:18.207635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216482+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235573+0000","last_change":"2023-05-17T15:29:19.235573+0000","last_active":"2023-05-17T15:29:19.235573+0000","last_peered":"2023-05-17T15:29:19.235573+0000","last_clean":"2023-05-17T15:29:19.235573+0000","last_became_active":"2023-05-17T15:29:19.231571+0000","last_became_peered":"2023-05-17T15:29:19.231571+0000","last_unstale":"2023-05-17T15:29:19.235573+0000","last_undegraded":"2023-05-17T15:29:19.235573+0000","last_fullsized":"2023-05-17T15:29:19.235573+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207654+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:18.207654+0000","last_peered":"2023-05-17T15:29:18.207654+0000","last_clean":"2023-05-17T15:29:18.207654+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:18.207654+0000","last_undegraded":"2023-05-17T15:29:18.207654+0000","last_fullsized":"2023-05-17T15:29:18.207654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.213738+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228646+0000","last_change":"2023-05-17T15:29:19.228646+0000","last_active":"2023-05-17T15:29:19.228646+0000","last_peered":"2023-05-17T15:29:19.228646+0000","last_clean":"2023-05-17T15:29:19.228646+0000","last_became_active":"2023-05-17T15:29:19.228343+0000","last_became_peered":"2023-05-17T15:29:19.228343+0000","last_unstale":"2023-05-17T15:29:19.228646+0000","last_undegraded":"2023-05-17T15:29:19.228646+0000","last_fullsized":"2023-05-17T15:29:19.228646+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207933+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:18.207933+0000","last_peered":"2023-05-17T15:29:18.207933+0000","last_clean":"2023-05-17T15:29:18.207933+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:18.207933+0000","last_undegraded":"2023-05-17T15:29:18.207933+0000","last_fullsized":"2023-05-17T15:29:18.207933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209236+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213501+0000","last_change":"2023-05-17T15:29:19.213501+0000","last_active":"2023-05-17T15:29:19.213501+0000","last_peered":"2023-05-17T15:29:19.213501+0000","last_clean":"2023-05-17T15:29:19.213501+0000","last_became_active":"2023-05-17T15:29:19.213181+0000","last_became_peered":"2023-05-17T15:29:19.213181+0000","last_unstale":"2023-05-17T15:29:19.213501+0000","last_undegraded":"2023-05-17T15:29:19.213501+0000","last_fullsized":"2023-05-17T15:29:19.213501+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.204044+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:18.204044+0000","last_peered":"2023-05-17T15:29:18.204044+0000","last_clean":"2023-05-17T15:29:18.204044+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:18.204044+0000","last_undegraded":"2023-05-17T15:29:18.204044+0000","last_fullsized":"2023-05-17T15:29:18.204044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215267+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231397+0000","last_change":"2023-05-17T15:29:19.231397+0000","last_active":"2023-05-17T15:29:19.231397+0000","last_peered":"2023-05-17T15:29:19.231397+0000","last_clean":"2023-05-17T15:29:19.231397+0000","last_became_active":"2023-05-17T15:29:19.231080+0000","last_became_peered":"2023-05-17T15:29:19.231080+0000","last_unstale":"2023-05-17T15:29:19.231397+0000","last_undegraded":"2023-05-17T15:29:19.231397+0000","last_fullsized":"2023-05-17T15:29:19.231397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.206290+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:18.206290+0000","last_peered":"2023-05-17T15:29:18.206290+0000","last_clean":"2023-05-17T15:29:18.206290+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:18.206290+0000","last_undegraded":"2023-05-17T15:29:18.206290+0000","last_fullsized":"2023-05-17T15:29:18.206290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20816,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351024,"statfs":{"total":96636764160,"available":96615448576,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.498}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.439},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.40100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575268,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20060,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94351780,"statfs":{"total":96636764160,"available":96616222720,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.374},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.40500000000000003}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575268,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.318},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.39600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575267,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21724,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":19584,"kb_avail":94350116,"statfs":{"total":96636764160,"available":96614518784,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20054016},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.628,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61799999999999999,"5min":1.254,"15min":1.254},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.28699999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.433},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70799999999999996,"5min":1.04,"15min":1.04},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94499999999999995,"5min":1.0700000000000001,"15min":1.125},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90800000000000003,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.21},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575268,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":26432,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27066368},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.25900000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.313},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.495},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.43099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20624,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351216,"statfs":{"total":96636764160,"available":96615645184,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.501},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.66500000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834575267,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":25856,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26476544},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.378}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.436}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:23.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:23.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.762+0000 7f0fc5ec9700 1 Processor -- start 2023-05-17T15:29:23.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.762+0000 7f0fc5ec9700 1 -- start start 2023-05-17T15:29:23.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fc5ec9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fc00c5f30 0x7f0fc00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fc5ec9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fc0158880 0x7f0fc0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fc5ec9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc01541c0 0x7f0fc00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fc5ec9700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00bfcd0 con 0x7f0fc00c5f30 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fc5ec9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00c0290 con 0x7f0fc0158880 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fc5ec9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00aa1a0 con 0x7f0fc01541c0 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fbf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fc00c5f30 0x7f0fc00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fbf7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0fc00c5f30 0x7f0fc00c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46548/0 (socket says 172.21.15.27:46548) 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fbf7fe700 1 -- 172.21.15.27:0/3371670994 learned_addr learned my addr 172.21.15.27:0/3371670994 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:23.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fbeffd700 1 --2- 172.21.15.27:0/3371670994 >> v2:172.21.15.40:3300/0 conn(0x7f0fc0158880 0x7f0fc0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.763+0000 7f0fbffff700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc01541c0 0x7f0fc00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbf7fe700 1 -- 172.21.15.27:0/3371670994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc01541c0 msgr2=0x7f0fc00c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:23.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbf7fe700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc01541c0 0x7f0fc00c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbf7fe700 1 -- 172.21.15.27:0/3371670994 >> v2:172.21.15.40:3300/0 conn(0x7f0fc0158880 msgr2=0x7f0fc0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:23.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbf7fe700 1 --2- 172.21.15.27:0/3371670994 >> v2:172.21.15.40:3300/0 conn(0x7f0fc0158880 0x7f0fc0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbf7fe700 1 -- 172.21.15.27:0/3371670994 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00aa480 con 0x7f0fc00c5f30 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbffff700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc01541c0 0x7f0fc00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbf7fe700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc00c5f30 0x7f0fc00c6310 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f0fc00c57b0 tx=0x7f0fb00090f0).ready entity=mon.0 client_cookie=395e4dc85710d39a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbe7fc700 1 -- 172.21.15.27:0/3371670994 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000b520 con 0x7f0fc00c5f30 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbe7fc700 1 -- 172.21.15.27:0/3371670994 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000b680 con 0x7f0fc00c5f30 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fbe7fc700 1 -- 172.21.15.27:0/3371670994 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ba00 con 0x7f0fc00c5f30 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3371670994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc00c5f30 msgr2=0x7f0fc00c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.764+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc00c5f30 0x7f0fc00c6310 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f0fc00c57b0 tx=0x7f0fb00090f0).stop 2023-05-17T15:29:23.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3371670994 shutdown_connections 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc00c5f30 0x7f0fc00c6310 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3371670994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc01541c0 0x7f0fc00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3371670994 >> v2:172.21.15.40:3300/0 conn(0x7f0fc0158880 0x7f0fc0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3371670994 >> 172.21.15.27:0/3371670994 conn(0x7f0fc0069e70 msgr2=0x7f0fc005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3371670994 shutdown_connections 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.765+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3371670994 wait complete. 2023-05-17T15:29:23.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.766+0000 7f0fc5ec9700 1 Processor -- start 2023-05-17T15:29:23.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.766+0000 7f0fc5ec9700 1 -- start start 2023-05-17T15:29:23.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc00c5f30 0x7f0fc0165110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc01541c0 0x7f0fc0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 0x7f0fc0158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01659d0 con 0x7f0fc0158880 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0165600 con 0x7f0fc01541c0 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0152a30 con 0x7f0fc00c5f30 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 0x7f0fc0158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 0x7f0fc0158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46558/0 (socket says 172.21.15.27:46558) 2023-05-17T15:29:23.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 -- 172.21.15.27:0/3103885681 learned_addr learned my addr 172.21.15.27:0/3103885681 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbeffd700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc01541c0 0x7f0fc0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbf7fe700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc00c5f30 0x7f0fc0165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 -- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc00c5f30 msgr2=0x7f0fc0165110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc00c5f30 0x7f0fc0165110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 -- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc01541c0 msgr2=0x7f0fc0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc01541c0 0x7f0fc0157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 -- 172.21.15.27:0/3103885681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009370 con 0x7f0fc0158880 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fbffff700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 0x7f0fc0158060 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f0fb800d180 tx=0x7f0fb8009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800dcc0 con 0x7f0fc0158880 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb800f040 con 0x7f0fc0158880 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0152190 con 0x7f0fc0158880 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8013600 con 0x7f0fc0158880 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.767+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc0152750 con 0x7f0fc0158880 2023-05-17T15:29:23.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.768+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc0165b40 con 0x7f0fc0158880 2023-05-17T15:29:23.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.769+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0fb80139f0 con 0x7f0fc0158880 2023-05-17T15:29:23.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.769+0000 7f0fa77fe700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0fac05ed90 0x7f0fac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:23.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.769+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f0fb807a360 con 0x7f0fc0158880 2023-05-17T15:29:23.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.769+0000 7f0fbf7fe700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0fac05ed90 0x7f0fac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:23.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.769+0000 7f0fbf7fe700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0fac05ed90 0x7f0fac061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0fb0009130 tx=0x7f0fb0017000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:23.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.773+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fc0165b40 con 0x7f0fc0158880 2023-05-17T15:29:23.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.940+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fc0165b10 con 0x7f0fac05ed90 2023-05-17T15:29:23.953 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.950+0000 7f0fa77fe700 1 -- 172.21.15.27:0/3103885681 <== mgr.8802 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358854 (secure 0 0 0) 0x7f0fc0165b10 con 0x7f0fac05ed90 2023-05-17T15:29:23.957 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0fac05ed90 msgr2=0x7f0fac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0fac05ed90 0x7f0fac061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0fb0009130 tx=0x7f0fb0017000).stop 2023-05-17T15:29:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 msgr2=0x7f0fc0158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 0x7f0fc0158060 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f0fb800d180 tx=0x7f0fb8009a50).stop 2023-05-17T15:29:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 shutdown_connections 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0fac05ed90 0x7f0fac061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0fc0158880 0x7f0fc0158060 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fc00c5f30 0x7f0fc0165110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 --2- 172.21.15.27:0/3103885681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc01541c0 0x7f0fc0157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 >> 172.21.15.27:0/3103885681 conn(0x7f0fc0069e70 msgr2=0x7f0fc00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 shutdown_connections 2023-05-17T15:29:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:23.953+0000 7f0fc5ec9700 1 -- 172.21.15.27:0/3103885681 wait complete. 2023-05-17T15:29:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:23.969 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:29:22.476572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":180900,"kb_used_data":16996,"kb_used_omap":0,"kb_used_meta":163840,"kb_avail":754793820,"statfs":{"total":773094113280,"available":772908871680,"internally_reserved":0,"allocated":17403904,"data_stored":8865141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":167772160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27326,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-74,"num_write_kb":-56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.607630"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210640+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.229081+0000","last_change":"2023-05-17T15:29:19.229081+0000","last_active":"2023-05-17T15:29:19.229081+0000","last_peered":"2023-05-17T15:29:19.229081+0000","last_clean":"2023-05-17T15:29:19.229081+0000","last_became_active":"2023-05-17T15:29:19.228777+0000","last_became_peered":"2023-05-17T15:29:19.228777+0000","last_unstale":"2023-05-17T15:29:19.229081+0000","last_undegraded":"2023-05-17T15:29:19.229081+0000","last_fullsized":"2023-05-17T15:29:19.229081+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216789+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216438+0000","last_change":"2023-05-17T15:29:19.216438+0000","last_active":"2023-05-17T15:29:19.216438+0000","last_peered":"2023-05-17T15:29:19.216438+0000","last_clean":"2023-05-17T15:29:19.216438+0000","last_became_active":"2023-05-17T15:29:19.216102+0000","last_became_peered":"2023-05-17T15:29:19.216102+0000","last_unstale":"2023-05-17T15:29:19.216438+0000","last_undegraded":"2023-05-17T15:29:19.216438+0000","last_fullsized":"2023-05-17T15:29:19.216438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218298+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.217921+0000","last_change":"2023-05-17T15:29:19.217921+0000","last_active":"2023-05-17T15:29:19.217921+0000","last_peered":"2023-05-17T15:29:19.217921+0000","last_clean":"2023-05-17T15:29:19.217921+0000","last_became_active":"2023-05-17T15:29:19.217620+0000","last_became_peered":"2023-05-17T15:29:19.217620+0000","last_unstale":"2023-05-17T15:29:19.217921+0000","last_undegraded":"2023-05-17T15:29:19.217921+0000","last_fullsized":"2023-05-17T15:29:19.217921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220325+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227841+0000","last_change":"2023-05-17T15:29:19.227841+0000","last_active":"2023-05-17T15:29:19.227841+0000","last_peered":"2023-05-17T15:29:19.227841+0000","last_clean":"2023-05-17T15:29:19.227841+0000","last_became_active":"2023-05-17T15:29:19.226953+0000","last_became_peered":"2023-05-17T15:29:19.226953+0000","last_unstale":"2023-05-17T15:29:19.227841+0000","last_undegraded":"2023-05-17T15:29:19.227841+0000","last_fullsized":"2023-05-17T15:29:19.227841+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215112+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235472+0000","last_change":"2023-05-17T15:29:19.235472+0000","last_active":"2023-05-17T15:29:19.235472+0000","last_peered":"2023-05-17T15:29:19.235472+0000","last_clean":"2023-05-17T15:29:19.235472+0000","last_became_active":"2023-05-17T15:29:19.235161+0000","last_became_peered":"2023-05-17T15:29:19.235161+0000","last_unstale":"2023-05-17T15:29:19.235472+0000","last_undegraded":"2023-05-17T15:29:19.235472+0000","last_fullsized":"2023-05-17T15:29:19.235472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215187+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226407+0000","last_change":"2023-05-17T15:29:19.226407+0000","last_active":"2023-05-17T15:29:19.226407+0000","last_peered":"2023-05-17T15:29:19.226407+0000","last_clean":"2023-05-17T15:29:19.226407+0000","last_became_active":"2023-05-17T15:29:19.226135+0000","last_became_peered":"2023-05-17T15:29:19.226135+0000","last_unstale":"2023-05-17T15:29:19.226407+0000","last_undegraded":"2023-05-17T15:29:19.226407+0000","last_fullsized":"2023-05-17T15:29:19.226407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211818+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228189+0000","last_change":"2023-05-17T15:29:19.228189+0000","last_active":"2023-05-17T15:29:19.228189+0000","last_peered":"2023-05-17T15:29:19.228189+0000","last_clean":"2023-05-17T15:29:19.228189+0000","last_became_active":"2023-05-17T15:29:19.227924+0000","last_became_peered":"2023-05-17T15:29:19.227924+0000","last_unstale":"2023-05-17T15:29:19.228189+0000","last_undegraded":"2023-05-17T15:29:19.228189+0000","last_fullsized":"2023-05-17T15:29:19.228189+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214669+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224680+0000","last_change":"2023-05-17T15:29:19.224680+0000","last_active":"2023-05-17T15:29:19.224680+0000","last_peered":"2023-05-17T15:29:19.224680+0000","last_clean":"2023-05-17T15:29:19.224680+0000","last_became_active":"2023-05-17T15:29:19.224445+0000","last_became_peered":"2023-05-17T15:29:19.224445+0000","last_unstale":"2023-05-17T15:29:19.224680+0000","last_undegraded":"2023-05-17T15:29:19.224680+0000","last_fullsized":"2023-05-17T15:29:19.224680+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211554+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227068+0000","last_change":"2023-05-17T15:29:19.227068+0000","last_active":"2023-05-17T15:29:19.227068+0000","last_peered":"2023-05-17T15:29:19.227068+0000","last_clean":"2023-05-17T15:29:19.227068+0000","last_became_active":"2023-05-17T15:29:19.226527+0000","last_became_peered":"2023-05-17T15:29:19.226527+0000","last_unstale":"2023-05-17T15:29:19.227068+0000","last_undegraded":"2023-05-17T15:29:19.227068+0000","last_fullsized":"2023-05-17T15:29:19.227068+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208007+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.234553+0000","last_change":"2023-05-17T15:29:19.234553+0000","last_active":"2023-05-17T15:29:19.234553+0000","last_peered":"2023-05-17T15:29:19.234553+0000","last_clean":"2023-05-17T15:29:19.234553+0000","last_became_active":"2023-05-17T15:29:19.231624+0000","last_became_peered":"2023-05-17T15:29:19.231624+0000","last_unstale":"2023-05-17T15:29:19.234553+0000","last_undegraded":"2023-05-17T15:29:19.234553+0000","last_fullsized":"2023-05-17T15:29:19.234553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209912+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225402+0000","last_change":"2023-05-17T15:29:19.225402+0000","last_active":"2023-05-17T15:29:19.225402+0000","last_peered":"2023-05-17T15:29:19.225402+0000","last_clean":"2023-05-17T15:29:19.225402+0000","last_became_active":"2023-05-17T15:29:19.225133+0000","last_became_peered":"2023-05-17T15:29:19.225133+0000","last_unstale":"2023-05-17T15:29:19.225402+0000","last_undegraded":"2023-05-17T15:29:19.225402+0000","last_fullsized":"2023-05-17T15:29:19.225402+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214813+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235126+0000","last_change":"2023-05-17T15:29:19.235126+0000","last_active":"2023-05-17T15:29:19.235126+0000","last_peered":"2023-05-17T15:29:19.235126+0000","last_clean":"2023-05-17T15:29:19.235126+0000","last_became_active":"2023-05-17T15:29:19.234828+0000","last_became_peered":"2023-05-17T15:29:19.234828+0000","last_unstale":"2023-05-17T15:29:19.235126+0000","last_undegraded":"2023-05-17T15:29:19.235126+0000","last_fullsized":"2023-05-17T15:29:19.235126+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209939+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233128+0000","last_change":"2023-05-17T15:29:19.233128+0000","last_active":"2023-05-17T15:29:19.233128+0000","last_peered":"2023-05-17T15:29:19.233128+0000","last_clean":"2023-05-17T15:29:19.233128+0000","last_became_active":"2023-05-17T15:29:19.232840+0000","last_became_peered":"2023-05-17T15:29:19.232840+0000","last_unstale":"2023-05-17T15:29:19.233128+0000","last_undegraded":"2023-05-17T15:29:19.233128+0000","last_fullsized":"2023-05-17T15:29:19.233128+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214146+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232632+0000","last_change":"2023-05-17T15:29:19.232632+0000","last_active":"2023-05-17T15:29:19.232632+0000","last_peered":"2023-05-17T15:29:19.232632+0000","last_clean":"2023-05-17T15:29:19.232632+0000","last_became_active":"2023-05-17T15:29:19.232325+0000","last_became_peered":"2023-05-17T15:29:19.232325+0000","last_unstale":"2023-05-17T15:29:19.232632+0000","last_undegraded":"2023-05-17T15:29:19.232632+0000","last_fullsized":"2023-05-17T15:29:19.232632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209702+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233692+0000","last_change":"2023-05-17T15:29:19.233692+0000","last_active":"2023-05-17T15:29:19.233692+0000","last_peered":"2023-05-17T15:29:19.233692+0000","last_clean":"2023-05-17T15:29:19.233692+0000","last_became_active":"2023-05-17T15:29:19.233389+0000","last_became_peered":"2023-05-17T15:29:19.233389+0000","last_unstale":"2023-05-17T15:29:19.233692+0000","last_undegraded":"2023-05-17T15:29:19.233692+0000","last_fullsized":"2023-05-17T15:29:19.233692+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211542+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223496+0000","last_change":"2023-05-17T15:29:19.223496+0000","last_active":"2023-05-17T15:29:19.223496+0000","last_peered":"2023-05-17T15:29:19.223496+0000","last_clean":"2023-05-17T15:29:19.223496+0000","last_became_active":"2023-05-17T15:29:19.222935+0000","last_became_peered":"2023-05-17T15:29:19.222935+0000","last_unstale":"2023-05-17T15:29:19.223496+0000","last_undegraded":"2023-05-17T15:29:19.223496+0000","last_fullsized":"2023-05-17T15:29:19.223496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208051+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235837+0000","last_change":"2023-05-17T15:29:19.235837+0000","last_active":"2023-05-17T15:29:19.235837+0000","last_peered":"2023-05-17T15:29:19.235837+0000","last_clean":"2023-05-17T15:29:19.235837+0000","last_became_active":"2023-05-17T15:29:19.235271+0000","last_became_peered":"2023-05-17T15:29:19.235271+0000","last_unstale":"2023-05-17T15:29:19.235837+0000","last_undegraded":"2023-05-17T15:29:19.235837+0000","last_fullsized":"2023-05-17T15:29:19.235837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219225+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218502+0000","last_change":"2023-05-17T15:29:19.218502+0000","last_active":"2023-05-17T15:29:19.218502+0000","last_peered":"2023-05-17T15:29:19.218502+0000","last_clean":"2023-05-17T15:29:19.218502+0000","last_became_active":"2023-05-17T15:29:19.218216+0000","last_became_peered":"2023-05-17T15:29:19.218216+0000","last_unstale":"2023-05-17T15:29:19.218502+0000","last_undegraded":"2023-05-17T15:29:19.218502+0000","last_fullsized":"2023-05-17T15:29:19.218502+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211265+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223022+0000","last_change":"2023-05-17T15:29:19.223022+0000","last_active":"2023-05-17T15:29:19.223022+0000","last_peered":"2023-05-17T15:29:19.223022+0000","last_clean":"2023-05-17T15:29:19.223022+0000","last_became_active":"2023-05-17T15:29:19.222747+0000","last_became_peered":"2023-05-17T15:29:19.222747+0000","last_unstale":"2023-05-17T15:29:19.223022+0000","last_undegraded":"2023-05-17T15:29:19.223022+0000","last_fullsized":"2023-05-17T15:29:19.223022+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210321+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218399+0000","last_change":"2023-05-17T15:29:19.218399+0000","last_active":"2023-05-17T15:29:19.218399+0000","last_peered":"2023-05-17T15:29:19.218399+0000","last_clean":"2023-05-17T15:29:19.218399+0000","last_became_active":"2023-05-17T15:29:19.218004+0000","last_became_peered":"2023-05-17T15:29:19.218004+0000","last_unstale":"2023-05-17T15:29:19.218399+0000","last_undegraded":"2023-05-17T15:29:19.218399+0000","last_fullsized":"2023-05-17T15:29:19.218399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209004+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231041+0000","last_change":"2023-05-17T15:29:19.231041+0000","last_active":"2023-05-17T15:29:19.231041+0000","last_peered":"2023-05-17T15:29:19.231041+0000","last_clean":"2023-05-17T15:29:19.231041+0000","last_became_active":"2023-05-17T15:29:19.230710+0000","last_became_peered":"2023-05-17T15:29:19.230710+0000","last_unstale":"2023-05-17T15:29:19.231041+0000","last_undegraded":"2023-05-17T15:29:19.231041+0000","last_fullsized":"2023-05-17T15:29:19.231041+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219713+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226559+0000","last_change":"2023-05-17T15:29:19.226559+0000","last_active":"2023-05-17T15:29:19.226559+0000","last_peered":"2023-05-17T15:29:19.226559+0000","last_clean":"2023-05-17T15:29:19.226559+0000","last_became_active":"2023-05-17T15:29:19.225699+0000","last_became_peered":"2023-05-17T15:29:19.225699+0000","last_unstale":"2023-05-17T15:29:19.226559+0000","last_undegraded":"2023-05-17T15:29:19.226559+0000","last_fullsized":"2023-05-17T15:29:19.226559+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216511+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223102+0000","last_change":"2023-05-17T15:29:19.223102+0000","last_active":"2023-05-17T15:29:19.223102+0000","last_peered":"2023-05-17T15:29:19.223102+0000","last_clean":"2023-05-17T15:29:19.223102+0000","last_became_active":"2023-05-17T15:29:19.222837+0000","last_became_peered":"2023-05-17T15:29:19.222837+0000","last_unstale":"2023-05-17T15:29:19.223102+0000","last_undegraded":"2023-05-17T15:29:19.223102+0000","last_fullsized":"2023-05-17T15:29:19.223102+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210471+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236154+0000","last_change":"2023-05-17T15:29:19.236154+0000","last_active":"2023-05-17T15:29:19.236154+0000","last_peered":"2023-05-17T15:29:19.236154+0000","last_clean":"2023-05-17T15:29:19.236154+0000","last_became_active":"2023-05-17T15:29:19.235132+0000","last_became_peered":"2023-05-17T15:29:19.235132+0000","last_unstale":"2023-05-17T15:29:19.236154+0000","last_undegraded":"2023-05-17T15:29:19.236154+0000","last_fullsized":"2023-05-17T15:29:19.236154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208957+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225105+0000","last_change":"2023-05-17T15:29:19.225105+0000","last_active":"2023-05-17T15:29:19.225105+0000","last_peered":"2023-05-17T15:29:19.225105+0000","last_clean":"2023-05-17T15:29:19.225105+0000","last_became_active":"2023-05-17T15:29:19.224787+0000","last_became_peered":"2023-05-17T15:29:19.224787+0000","last_unstale":"2023-05-17T15:29:19.225105+0000","last_undegraded":"2023-05-17T15:29:19.225105+0000","last_fullsized":"2023-05-17T15:29:19.225105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209947+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224828+0000","last_change":"2023-05-17T15:29:19.224828+0000","last_active":"2023-05-17T15:29:19.224828+0000","last_peered":"2023-05-17T15:29:19.224828+0000","last_clean":"2023-05-17T15:29:19.224828+0000","last_became_active":"2023-05-17T15:29:19.224459+0000","last_became_peered":"2023-05-17T15:29:19.224459+0000","last_unstale":"2023-05-17T15:29:19.224828+0000","last_undegraded":"2023-05-17T15:29:19.224828+0000","last_fullsized":"2023-05-17T15:29:19.224828+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.221275+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.219162+0000","last_change":"2023-05-17T15:29:19.219162+0000","last_active":"2023-05-17T15:29:19.219162+0000","last_peered":"2023-05-17T15:29:19.219162+0000","last_clean":"2023-05-17T15:29:19.219162+0000","last_became_active":"2023-05-17T15:29:19.217976+0000","last_became_peered":"2023-05-17T15:29:19.217976+0000","last_unstale":"2023-05-17T15:29:19.219162+0000","last_undegraded":"2023-05-17T15:29:19.219162+0000","last_fullsized":"2023-05-17T15:29:19.219162+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217845+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226882+0000","last_change":"2023-05-17T15:29:19.226882+0000","last_active":"2023-05-17T15:29:19.226882+0000","last_peered":"2023-05-17T15:29:19.226882+0000","last_clean":"2023-05-17T15:29:19.226882+0000","last_became_active":"2023-05-17T15:29:19.226602+0000","last_became_peered":"2023-05-17T15:29:19.226602+0000","last_unstale":"2023-05-17T15:29:19.226882+0000","last_undegraded":"2023-05-17T15:29:19.226882+0000","last_fullsized":"2023-05-17T15:29:19.226882+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217088+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227477+0000","last_change":"2023-05-17T15:29:19.227477+0000","last_active":"2023-05-17T15:29:19.227477+0000","last_peered":"2023-05-17T15:29:19.227477+0000","last_clean":"2023-05-17T15:29:19.227477+0000","last_became_active":"2023-05-17T15:29:19.227181+0000","last_became_peered":"2023-05-17T15:29:19.227181+0000","last_unstale":"2023-05-17T15:29:19.227477+0000","last_undegraded":"2023-05-17T15:29:19.227477+0000","last_fullsized":"2023-05-17T15:29:19.227477+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208391+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226062+0000","last_change":"2023-05-17T15:29:19.226062+0000","last_active":"2023-05-17T15:29:19.226062+0000","last_peered":"2023-05-17T15:29:19.226062+0000","last_clean":"2023-05-17T15:29:19.226062+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226062+0000","last_undegraded":"2023-05-17T15:29:19.226062+0000","last_fullsized":"2023-05-17T15:29:19.226062+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208882+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223810+0000","last_change":"2023-05-17T15:29:19.223810+0000","last_active":"2023-05-17T15:29:19.223810+0000","last_peered":"2023-05-17T15:29:19.223810+0000","last_clean":"2023-05-17T15:29:19.223810+0000","last_became_active":"2023-05-17T15:29:19.223511+0000","last_became_peered":"2023-05-17T15:29:19.223511+0000","last_unstale":"2023-05-17T15:29:19.223810+0000","last_undegraded":"2023-05-17T15:29:19.223810+0000","last_fullsized":"2023-05-17T15:29:19.223810+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217649+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227154+0000","last_change":"2023-05-17T15:29:19.227154+0000","last_active":"2023-05-17T15:29:19.227154+0000","last_peered":"2023-05-17T15:29:19.227154+0000","last_clean":"2023-05-17T15:29:19.227154+0000","last_became_active":"2023-05-17T15:29:19.226876+0000","last_became_peered":"2023-05-17T15:29:19.226876+0000","last_unstale":"2023-05-17T15:29:19.227154+0000","last_undegraded":"2023-05-17T15:29:19.227154+0000","last_fullsized":"2023-05-17T15:29:19.227154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217501+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216411+0000","last_change":"2023-05-17T15:29:19.216411+0000","last_active":"2023-05-17T15:29:19.216411+0000","last_peered":"2023-05-17T15:29:19.216411+0000","last_clean":"2023-05-17T15:29:19.216411+0000","last_became_active":"2023-05-17T15:29:19.216065+0000","last_became_peered":"2023-05-17T15:29:19.216065+0000","last_unstale":"2023-05-17T15:29:19.216411+0000","last_undegraded":"2023-05-17T15:29:19.216411+0000","last_fullsized":"2023-05-17T15:29:19.216411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216413+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236893+0000","last_change":"2023-05-17T15:29:19.236893+0000","last_active":"2023-05-17T15:29:19.236893+0000","last_peered":"2023-05-17T15:29:19.236893+0000","last_clean":"2023-05-17T15:29:19.236893+0000","last_became_active":"2023-05-17T15:29:19.236609+0000","last_became_peered":"2023-05-17T15:29:19.236609+0000","last_unstale":"2023-05-17T15:29:19.236893+0000","last_undegraded":"2023-05-17T15:29:19.236893+0000","last_fullsized":"2023-05-17T15:29:19.236893+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214211+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236874+0000","last_change":"2023-05-17T15:29:19.236874+0000","last_active":"2023-05-17T15:29:19.236874+0000","last_peered":"2023-05-17T15:29:19.236874+0000","last_clean":"2023-05-17T15:29:19.236874+0000","last_became_active":"2023-05-17T15:29:19.236507+0000","last_became_peered":"2023-05-17T15:29:19.236507+0000","last_unstale":"2023-05-17T15:29:19.236874+0000","last_undegraded":"2023-05-17T15:29:19.236874+0000","last_fullsized":"2023-05-17T15:29:19.236874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.222536+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228664+0000","last_change":"2023-05-17T15:29:19.228664+0000","last_active":"2023-05-17T15:29:19.228664+0000","last_peered":"2023-05-17T15:29:19.228664+0000","last_clean":"2023-05-17T15:29:19.228664+0000","last_became_active":"2023-05-17T15:29:19.228391+0000","last_became_peered":"2023-05-17T15:29:19.228391+0000","last_unstale":"2023-05-17T15:29:19.228664+0000","last_undegraded":"2023-05-17T15:29:19.228664+0000","last_fullsized":"2023-05-17T15:29:19.228664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.207484+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232621+0000","last_change":"2023-05-17T15:29:19.232621+0000","last_active":"2023-05-17T15:29:19.232621+0000","last_peered":"2023-05-17T15:29:19.232621+0000","last_clean":"2023-05-17T15:29:19.232621+0000","last_became_active":"2023-05-17T15:29:19.232307+0000","last_became_peered":"2023-05-17T15:29:19.232307+0000","last_unstale":"2023-05-17T15:29:19.232621+0000","last_undegraded":"2023-05-17T15:29:19.232621+0000","last_fullsized":"2023-05-17T15:29:19.232621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212329+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228906+0000","last_change":"2023-05-17T15:29:19.228906+0000","last_active":"2023-05-17T15:29:19.228906+0000","last_peered":"2023-05-17T15:29:19.228906+0000","last_clean":"2023-05-17T15:29:19.228906+0000","last_became_active":"2023-05-17T15:29:19.228614+0000","last_became_peered":"2023-05-17T15:29:19.228614+0000","last_unstale":"2023-05-17T15:29:19.228906+0000","last_undegraded":"2023-05-17T15:29:19.228906+0000","last_fullsized":"2023-05-17T15:29:19.228906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214530+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227011+0000","last_change":"2023-05-17T15:29:19.227011+0000","last_active":"2023-05-17T15:29:19.227011+0000","last_peered":"2023-05-17T15:29:19.227011+0000","last_clean":"2023-05-17T15:29:19.227011+0000","last_became_active":"2023-05-17T15:29:19.225640+0000","last_became_peered":"2023-05-17T15:29:19.225640+0000","last_unstale":"2023-05-17T15:29:19.227011+0000","last_undegraded":"2023-05-17T15:29:19.227011+0000","last_fullsized":"2023-05-17T15:29:19.227011+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218161+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224151+0000","last_change":"2023-05-17T15:29:19.224151+0000","last_active":"2023-05-17T15:29:19.224151+0000","last_peered":"2023-05-17T15:29:19.224151+0000","last_clean":"2023-05-17T15:29:19.224151+0000","last_became_active":"2023-05-17T15:29:19.223868+0000","last_became_peered":"2023-05-17T15:29:19.223868+0000","last_unstale":"2023-05-17T15:29:19.224151+0000","last_undegraded":"2023-05-17T15:29:19.224151+0000","last_fullsized":"2023-05-17T15:29:19.224151+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220066+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227419+0000","last_change":"2023-05-17T15:29:19.227419+0000","last_active":"2023-05-17T15:29:19.227419+0000","last_peered":"2023-05-17T15:29:19.227419+0000","last_clean":"2023-05-17T15:29:19.227419+0000","last_became_active":"2023-05-17T15:29:19.227004+0000","last_became_peered":"2023-05-17T15:29:19.227004+0000","last_unstale":"2023-05-17T15:29:19.227419+0000","last_undegraded":"2023-05-17T15:29:19.227419+0000","last_fullsized":"2023-05-17T15:29:19.227419+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.224798+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227367+0000","last_change":"2023-05-17T15:29:19.227367+0000","last_active":"2023-05-17T15:29:19.227367+0000","last_peered":"2023-05-17T15:29:19.227367+0000","last_clean":"2023-05-17T15:29:19.227367+0000","last_became_active":"2023-05-17T15:29:19.227029+0000","last_became_peered":"2023-05-17T15:29:19.227029+0000","last_unstale":"2023-05-17T15:29:19.227367+0000","last_undegraded":"2023-05-17T15:29:19.227367+0000","last_fullsized":"2023-05-17T15:29:19.227367+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217807+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226649+0000","last_change":"2023-05-17T15:29:19.226649+0000","last_active":"2023-05-17T15:29:19.226649+0000","last_peered":"2023-05-17T15:29:19.226649+0000","last_clean":"2023-05-17T15:29:19.226649+0000","last_became_active":"2023-05-17T15:29:19.225847+0000","last_became_peered":"2023-05-17T15:29:19.225847+0000","last_unstale":"2023-05-17T15:29:19.226649+0000","last_undegraded":"2023-05-17T15:29:19.226649+0000","last_fullsized":"2023-05-17T15:29:19.226649+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217408+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225240+0000","last_change":"2023-05-17T15:29:19.225240+0000","last_active":"2023-05-17T15:29:19.225240+0000","last_peered":"2023-05-17T15:29:19.225240+0000","last_clean":"2023-05-17T15:29:19.225240+0000","last_became_active":"2023-05-17T15:29:19.224910+0000","last_became_peered":"2023-05-17T15:29:19.224910+0000","last_unstale":"2023-05-17T15:29:19.225240+0000","last_undegraded":"2023-05-17T15:29:19.225240+0000","last_fullsized":"2023-05-17T15:29:19.225240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.226366+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225479+0000","last_change":"2023-05-17T15:29:19.225479+0000","last_active":"2023-05-17T15:29:19.225479+0000","last_peered":"2023-05-17T15:29:19.225479+0000","last_clean":"2023-05-17T15:29:19.225479+0000","last_became_active":"2023-05-17T15:29:19.225162+0000","last_became_peered":"2023-05-17T15:29:19.225162+0000","last_unstale":"2023-05-17T15:29:19.225479+0000","last_undegraded":"2023-05-17T15:29:19.225479+0000","last_fullsized":"2023-05-17T15:29:19.225479+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.213255+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225875+0000","last_change":"2023-05-17T15:29:19.225875+0000","last_active":"2023-05-17T15:29:19.225875+0000","last_peered":"2023-05-17T15:29:19.225875+0000","last_clean":"2023-05-17T15:29:19.225875+0000","last_became_active":"2023-05-17T15:29:19.225389+0000","last_became_peered":"2023-05-17T15:29:19.225389+0000","last_unstale":"2023-05-17T15:29:19.225875+0000","last_undegraded":"2023-05-17T15:29:19.225875+0000","last_fullsized":"2023-05-17T15:29:19.225875+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.223039+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228139+0000","last_change":"2023-05-17T15:29:19.228139+0000","last_active":"2023-05-17T15:29:19.228139+0000","last_peered":"2023-05-17T15:29:19.228139+0000","last_clean":"2023-05-17T15:29:19.228139+0000","last_became_active":"2023-05-17T15:29:19.227706+0000","last_became_peered":"2023-05-17T15:29:19.227706+0000","last_unstale":"2023-05-17T15:29:19.228139+0000","last_undegraded":"2023-05-17T15:29:19.228139+0000","last_fullsized":"2023-05-17T15:29:19.228139+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216578+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224407+0000","last_change":"2023-05-17T15:29:19.224407+0000","last_active":"2023-05-17T15:29:19.224407+0000","last_peered":"2023-05-17T15:29:19.224407+0000","last_clean":"2023-05-17T15:29:19.224407+0000","last_became_active":"2023-05-17T15:29:19.224060+0000","last_became_peered":"2023-05-17T15:29:19.224060+0000","last_unstale":"2023-05-17T15:29:19.224407+0000","last_undegraded":"2023-05-17T15:29:19.224407+0000","last_fullsized":"2023-05-17T15:29:19.224407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214424+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223726+0000","last_change":"2023-05-17T15:29:19.223726+0000","last_active":"2023-05-17T15:29:19.223726+0000","last_peered":"2023-05-17T15:29:19.223726+0000","last_clean":"2023-05-17T15:29:19.223726+0000","last_became_active":"2023-05-17T15:29:19.223436+0000","last_became_peered":"2023-05-17T15:29:19.223436+0000","last_unstale":"2023-05-17T15:29:19.223726+0000","last_undegraded":"2023-05-17T15:29:19.223726+0000","last_fullsized":"2023-05-17T15:29:19.223726+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209903+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231442+0000","last_change":"2023-05-17T15:29:19.231442+0000","last_active":"2023-05-17T15:29:19.231442+0000","last_peered":"2023-05-17T15:29:19.231442+0000","last_clean":"2023-05-17T15:29:19.231442+0000","last_became_active":"2023-05-17T15:29:19.231112+0000","last_became_peered":"2023-05-17T15:29:19.231112+0000","last_unstale":"2023-05-17T15:29:19.231442+0000","last_undegraded":"2023-05-17T15:29:19.231442+0000","last_fullsized":"2023-05-17T15:29:19.231442+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216606+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.229267+0000","last_change":"2023-05-17T15:29:19.229267+0000","last_active":"2023-05-17T15:29:19.229267+0000","last_peered":"2023-05-17T15:29:19.229267+0000","last_clean":"2023-05-17T15:29:19.229267+0000","last_became_active":"2023-05-17T15:29:19.228233+0000","last_became_peered":"2023-05-17T15:29:19.228233+0000","last_unstale":"2023-05-17T15:29:19.229267+0000","last_undegraded":"2023-05-17T15:29:19.229267+0000","last_fullsized":"2023-05-17T15:29:19.229267+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212505+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225497+0000","last_change":"2023-05-17T15:29:19.225497+0000","last_active":"2023-05-17T15:29:19.225497+0000","last_peered":"2023-05-17T15:29:19.225497+0000","last_clean":"2023-05-17T15:29:19.225497+0000","last_became_active":"2023-05-17T15:29:19.225214+0000","last_became_peered":"2023-05-17T15:29:19.225214+0000","last_unstale":"2023-05-17T15:29:19.225497+0000","last_undegraded":"2023-05-17T15:29:19.225497+0000","last_fullsized":"2023-05-17T15:29:19.225497+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218487+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228812+0000","last_change":"2023-05-17T15:29:19.228812+0000","last_active":"2023-05-17T15:29:19.228812+0000","last_peered":"2023-05-17T15:29:19.228812+0000","last_clean":"2023-05-17T15:29:19.228812+0000","last_became_active":"2023-05-17T15:29:19.228540+0000","last_became_peered":"2023-05-17T15:29:19.228540+0000","last_unstale":"2023-05-17T15:29:19.228812+0000","last_undegraded":"2023-05-17T15:29:19.228812+0000","last_fullsized":"2023-05-17T15:29:19.228812+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211806+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.230855+0000","last_change":"2023-05-17T15:29:19.230855+0000","last_active":"2023-05-17T15:29:19.230855+0000","last_peered":"2023-05-17T15:29:19.230855+0000","last_clean":"2023-05-17T15:29:19.230855+0000","last_became_active":"2023-05-17T15:29:19.228960+0000","last_became_peered":"2023-05-17T15:29:19.228960+0000","last_unstale":"2023-05-17T15:29:19.230855+0000","last_undegraded":"2023-05-17T15:29:19.230855+0000","last_fullsized":"2023-05-17T15:29:19.230855+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214153+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.221496+0000","last_change":"2023-05-17T15:29:19.221496+0000","last_active":"2023-05-17T15:29:19.221496+0000","last_peered":"2023-05-17T15:29:19.221496+0000","last_clean":"2023-05-17T15:29:19.221496+0000","last_became_active":"2023-05-17T15:29:19.221198+0000","last_became_peered":"2023-05-17T15:29:19.221198+0000","last_unstale":"2023-05-17T15:29:19.221496+0000","last_undegraded":"2023-05-17T15:29:19.221496+0000","last_fullsized":"2023-05-17T15:29:19.221496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217242+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235317+0000","last_change":"2023-05-17T15:29:19.235317+0000","last_active":"2023-05-17T15:29:19.235317+0000","last_peered":"2023-05-17T15:29:19.235317+0000","last_clean":"2023-05-17T15:29:19.235317+0000","last_became_active":"2023-05-17T15:29:19.235022+0000","last_became_peered":"2023-05-17T15:29:19.235022+0000","last_unstale":"2023-05-17T15:29:19.235317+0000","last_undegraded":"2023-05-17T15:29:19.235317+0000","last_fullsized":"2023-05-17T15:29:19.235317+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216672+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216276+0000","last_change":"2023-05-17T15:29:19.216276+0000","last_active":"2023-05-17T15:29:19.216276+0000","last_peered":"2023-05-17T15:29:19.216276+0000","last_clean":"2023-05-17T15:29:19.216276+0000","last_became_active":"2023-05-17T15:29:19.215939+0000","last_became_peered":"2023-05-17T15:29:19.215939+0000","last_unstale":"2023-05-17T15:29:19.216276+0000","last_undegraded":"2023-05-17T15:29:19.216276+0000","last_fullsized":"2023-05-17T15:29:19.216276+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.204451+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:18.204451+0000","last_peered":"2023-05-17T15:29:18.204451+0000","last_clean":"2023-05-17T15:29:18.204451+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:18.204451+0000","last_undegraded":"2023-05-17T15:29:18.204451+0000","last_fullsized":"2023-05-17T15:29:18.204451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210897+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213012+0000","last_change":"2023-05-17T15:29:19.213012+0000","last_active":"2023-05-17T15:29:19.213012+0000","last_peered":"2023-05-17T15:29:19.213012+0000","last_clean":"2023-05-17T15:29:19.213012+0000","last_became_active":"2023-05-17T15:29:19.212738+0000","last_became_peered":"2023-05-17T15:29:19.212738+0000","last_unstale":"2023-05-17T15:29:19.213012+0000","last_undegraded":"2023-05-17T15:29:19.213012+0000","last_fullsized":"2023-05-17T15:29:19.213012+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213738+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:18.213738+0000","last_peered":"2023-05-17T15:29:18.213738+0000","last_clean":"2023-05-17T15:29:18.213738+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:18.213738+0000","last_undegraded":"2023-05-17T15:29:18.213738+0000","last_fullsized":"2023-05-17T15:29:18.213738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208563+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225010+0000","last_change":"2023-05-17T15:29:19.225010+0000","last_active":"2023-05-17T15:29:19.225010+0000","last_peered":"2023-05-17T15:29:19.225010+0000","last_clean":"2023-05-17T15:29:19.225010+0000","last_became_active":"2023-05-17T15:29:19.224310+0000","last_became_peered":"2023-05-17T15:29:19.224310+0000","last_unstale":"2023-05-17T15:29:19.225010+0000","last_undegraded":"2023-05-17T15:29:19.225010+0000","last_fullsized":"2023-05-17T15:29:19.225010+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.199202+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:18.199202+0000","last_peered":"2023-05-17T15:29:18.199202+0000","last_clean":"2023-05-17T15:29:18.199202+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:18.199202+0000","last_undegraded":"2023-05-17T15:29:18.199202+0000","last_fullsized":"2023-05-17T15:29:18.199202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215097+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226296+0000","last_change":"2023-05-17T15:29:19.226296+0000","last_active":"2023-05-17T15:29:19.226296+0000","last_peered":"2023-05-17T15:29:19.226296+0000","last_clean":"2023-05-17T15:29:19.226296+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226296+0000","last_undegraded":"2023-05-17T15:29:19.226296+0000","last_fullsized":"2023-05-17T15:29:19.226296+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213984+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:18.213984+0000","last_peered":"2023-05-17T15:29:18.213984+0000","last_clean":"2023-05-17T15:29:18.213984+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:18.213984+0000","last_undegraded":"2023-05-17T15:29:18.213984+0000","last_fullsized":"2023-05-17T15:29:18.213984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207635+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:18.207635+0000","last_peered":"2023-05-17T15:29:18.207635+0000","last_clean":"2023-05-17T15:29:18.207635+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:18.207635+0000","last_undegraded":"2023-05-17T15:29:18.207635+0000","last_fullsized":"2023-05-17T15:29:18.207635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216482+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235573+0000","last_change":"2023-05-17T15:29:19.235573+0000","last_active":"2023-05-17T15:29:19.235573+0000","last_peered":"2023-05-17T15:29:19.235573+0000","last_clean":"2023-05-17T15:29:19.235573+0000","last_became_active":"2023-05-17T15:29:19.231571+0000","last_became_peered":"2023-05-17T15:29:19.231571+0000","last_unstale":"2023-05-17T15:29:19.235573+0000","last_undegraded":"2023-05-17T15:29:19.235573+0000","last_fullsized":"2023-05-17T15:29:19.235573+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207654+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:18.207654+0000","last_peered":"2023-05-17T15:29:18.207654+0000","last_clean":"2023-05-17T15:29:18.207654+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:18.207654+0000","last_undegraded":"2023-05-17T15:29:18.207654+0000","last_fullsized":"2023-05-17T15:29:18.207654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.213738+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228646+0000","last_change":"2023-05-17T15:29:19.228646+0000","last_active":"2023-05-17T15:29:19.228646+0000","last_peered":"2023-05-17T15:29:19.228646+0000","last_clean":"2023-05-17T15:29:19.228646+0000","last_became_active":"2023-05-17T15:29:19.228343+0000","last_became_peered":"2023-05-17T15:29:19.228343+0000","last_unstale":"2023-05-17T15:29:19.228646+0000","last_undegraded":"2023-05-17T15:29:19.228646+0000","last_fullsized":"2023-05-17T15:29:19.228646+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207933+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:18.207933+0000","last_peered":"2023-05-17T15:29:18.207933+0000","last_clean":"2023-05-17T15:29:18.207933+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:18.207933+0000","last_undegraded":"2023-05-17T15:29:18.207933+0000","last_fullsized":"2023-05-17T15:29:18.207933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209236+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213501+0000","last_change":"2023-05-17T15:29:19.213501+0000","last_active":"2023-05-17T15:29:19.213501+0000","last_peered":"2023-05-17T15:29:19.213501+0000","last_clean":"2023-05-17T15:29:19.213501+0000","last_became_active":"2023-05-17T15:29:19.213181+0000","last_became_peered":"2023-05-17T15:29:19.213181+0000","last_unstale":"2023-05-17T15:29:19.213501+0000","last_undegraded":"2023-05-17T15:29:19.213501+0000","last_fullsized":"2023-05-17T15:29:19.213501+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.204044+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:18.204044+0000","last_peered":"2023-05-17T15:29:18.204044+0000","last_clean":"2023-05-17T15:29:18.204044+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:18.204044+0000","last_undegraded":"2023-05-17T15:29:18.204044+0000","last_fullsized":"2023-05-17T15:29:18.204044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215267+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231397+0000","last_change":"2023-05-17T15:29:19.231397+0000","last_active":"2023-05-17T15:29:19.231397+0000","last_peered":"2023-05-17T15:29:19.231397+0000","last_clean":"2023-05-17T15:29:19.231397+0000","last_became_active":"2023-05-17T15:29:19.231080+0000","last_became_peered":"2023-05-17T15:29:19.231080+0000","last_unstale":"2023-05-17T15:29:19.231397+0000","last_undegraded":"2023-05-17T15:29:19.231397+0000","last_fullsized":"2023-05-17T15:29:19.231397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.206290+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:18.206290+0000","last_peered":"2023-05-17T15:29:18.206290+0000","last_clean":"2023-05-17T15:29:18.206290+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:18.206290+0000","last_undegraded":"2023-05-17T15:29:18.206290+0000","last_fullsized":"2023-05-17T15:29:18.206290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20816,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351024,"statfs":{"total":96636764160,"available":96615448576,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.498}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.439},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.40100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575268,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20060,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94351780,"statfs":{"total":96636764160,"available":96616222720,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.374},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.40500000000000003}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575268,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.318},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.39600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575267,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21724,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":19584,"kb_avail":94350116,"statfs":{"total":96636764160,"available":96614518784,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20054016},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.628,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61799999999999999,"5min":1.254,"15min":1.254},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.28699999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.433},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70799999999999996,"5min":1.04,"15min":1.04},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94499999999999995,"5min":1.0700000000000001,"15min":1.125},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90800000000000003,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.21},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575268,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":26432,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27066368},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.25900000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.313},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.495},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.43099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20624,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351216,"statfs":{"total":96636764160,"available":96615645184,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.501},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.66500000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834575267,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":25856,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26476544},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.378}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.436}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:23.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:24.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.121+0000 7f979541b700 1 Processor -- start 2023-05-17T15:29:24.125 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.121+0000 7f979541b700 1 -- start start 2023-05-17T15:29:24.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f979541b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97900c6310 0x7f9790153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f979541b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97901541c0 0x7f97900c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f979541b700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97900bfcd0 con 0x7f97900c5f30 2023-05-17T15:29:24.126 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f979541b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900c0290 con 0x7f97900c6310 2023-05-17T15:29:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f979541b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900aa1a0 con 0x7f97901541c0 2023-05-17T15:29:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f978effd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f97900c5f30 0x7f9790158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46124/0 (socket says 172.21.15.27:46124) 2023-05-17T15:29:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.122+0000 7f978effd700 1 -- 172.21.15.27:0/2214247592 learned_addr learned my addr 172.21.15.27:0/2214247592 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:24.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978e7fc700 1 --2- 172.21.15.27:0/2214247592 >> v2:172.21.15.40:3300/0 conn(0x7f97900c6310 0x7f9790153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.128 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978f7fe700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97901541c0 0x7f97900c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978dffb700 1 -- 172.21.15.27:0/2214247592 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485936554 0 0) 0x7f97900bfcd0 con 0x7f97900c5f30 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978dffb700 1 -- 172.21.15.27:0/2214247592 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f977c0033f0 con 0x7f97900c5f30 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978e7fc700 1 -- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97901541c0 msgr2=0x7f97900c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978e7fc700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97901541c0 0x7f97900c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978e7fc700 1 -- 172.21.15.27:0/2214247592 >> v1:172.21.15.27:6789/0 conn(0x7f97900c5f30 legacy=0x7f9790158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978e7fc700 1 -- 172.21.15.27:0/2214247592 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900aa480 con 0x7f97900c6310 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978f7fe700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97901541c0 0x7f97900c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978e7fc700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900c6310 0x7f9790153cd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f9778009760 tx=0x7f9778009060).ready entity=mon.1 client_cookie=733085fd2098f088 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978dffb700 1 -- 172.21.15.27:0/2214247592 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800d4a0 con 0x7f97900c6310 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978dffb700 1 -- 172.21.15.27:0/2214247592 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800d600 con 0x7f97900c6310 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.123+0000 7f978dffb700 1 -- 172.21.15.27:0/2214247592 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800d980 con 0x7f97900c6310 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 -- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900c6310 msgr2=0x7f9790153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900c6310 0x7f9790153cd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f9778009760 tx=0x7f9778009060).stop 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 -- 172.21.15.27:0/2214247592 shutdown_connections 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97901541c0 0x7f97900c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.130 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 --2- 172.21.15.27:0/2214247592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900c6310 0x7f9790153cd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 -- 172.21.15.27:0/2214247592 >> 172.21.15.27:0/2214247592 conn(0x7f9790069e70 msgr2=0x7f979005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 -- 172.21.15.27:0/2214247592 shutdown_connections 2023-05-17T15:29:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.124+0000 7f979541b700 1 -- 172.21.15.27:0/2214247592 wait complete. 2023-05-17T15:29:24.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.125+0000 7f979541b700 1 Processor -- start 2023-05-17T15:29:24.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.125+0000 7f979541b700 1 -- start start 2023-05-17T15:29:24.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f979541b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 0x7f97900c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f979541b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900c6310 0x7f9790158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.133 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f979541b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97901541c0 0x7f979014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f979541b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979013e2c0 con 0x7f97900c5f30 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f979541b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900c2e00 con 0x7f97901541c0 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f979541b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900c3380 con 0x7f97900c6310 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 0x7f97900c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 0x7f97900c27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46568/0 (socket says 172.21.15.27:46568) 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 -- 172.21.15.27:0/1372466564 learned_addr learned my addr 172.21.15.27:0/1372466564 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978e7fc700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900c6310 0x7f9790158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978f7fe700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97901541c0 0x7f979014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 -- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900c6310 msgr2=0x7f9790158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900c6310 0x7f9790158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 -- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97901541c0 msgr2=0x7f979014f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97901541c0 0x7f979014f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 -- 172.21.15.27:0/1372466564 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009a20 con 0x7f97900c5f30 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978f7fe700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97901541c0 0x7f979014f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:24.135 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.126+0000 7f978effd700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 0x7f97900c27e0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f9788001ed0 tx=0x7f9788007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.127+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880072e0 con 0x7f97900c5f30 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.127+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788007440 con 0x7f97900c5f30 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.127+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97780092a0 con 0x7f97900c5f30 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.127+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880057a0 con 0x7f97900c5f30 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.127+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97900c3940 con 0x7f97900c5f30 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.128+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97900c3b60 con 0x7f97900c5f30 2023-05-17T15:29:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.128+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9788010070 con 0x7f97900c5f30 2023-05-17T15:29:24.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.128+0000 7f9786ffd700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f977005ed90 0x7f9770061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.128+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f9788079170 con 0x7f97900c5f30 2023-05-17T15:29:24.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.129+0000 7f978e7fc700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f977005ed90 0x7f9770061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.129+0000 7f978e7fc700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f977005ed90 0x7f9770061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f977800d260 tx=0x7f9778016000).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.137 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.132+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f978804a690 con 0x7f97900c5f30 2023-05-17T15:29:24.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.301+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f979005f4a0 con 0x7f977005ed90 2023-05-17T15:29:24.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.311+0000 7f9786ffd700 1 -- 172.21.15.27:0/1372466564 <== mgr.8802 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358854 (secure 0 0 0) 0x7f979005f4a0 con 0x7f977005ed90 2023-05-17T15:29:24.318 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:24.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f977005ed90 msgr2=0x7f9770061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f977005ed90 0x7f9770061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f977800d260 tx=0x7f9778016000).stop 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 msgr2=0x7f97900c27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 0x7f97900c27e0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f9788001ed0 tx=0x7f9788007c70).stop 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 shutdown_connections 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f977005ed90 0x7f9770061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97901541c0 0x7f979014f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97900c5f30 0x7f97900c27e0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 --2- 172.21.15.27:0/1372466564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900c6310 0x7f9790158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 >> 172.21.15.27:0/1372466564 conn(0x7f9790069e70 msgr2=0x7f97900add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:24.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 shutdown_connections 2023-05-17T15:29:24.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.315+0000 7f979541b700 1 -- 172.21.15.27:0/1372466564 wait complete. 2023-05-17T15:29:24.322 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:24.330 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:29:22.476572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":180900,"kb_used_data":16996,"kb_used_omap":0,"kb_used_meta":163840,"kb_avail":754793820,"statfs":{"total":773094113280,"available":772908871680,"internally_reserved":0,"allocated":17403904,"data_stored":8865141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":167772160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27326,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-74,"num_write_kb":-56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.607630"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210640+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.229081+0000","last_change":"2023-05-17T15:29:19.229081+0000","last_active":"2023-05-17T15:29:19.229081+0000","last_peered":"2023-05-17T15:29:19.229081+0000","last_clean":"2023-05-17T15:29:19.229081+0000","last_became_active":"2023-05-17T15:29:19.228777+0000","last_became_peered":"2023-05-17T15:29:19.228777+0000","last_unstale":"2023-05-17T15:29:19.229081+0000","last_undegraded":"2023-05-17T15:29:19.229081+0000","last_fullsized":"2023-05-17T15:29:19.229081+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216789+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216438+0000","last_change":"2023-05-17T15:29:19.216438+0000","last_active":"2023-05-17T15:29:19.216438+0000","last_peered":"2023-05-17T15:29:19.216438+0000","last_clean":"2023-05-17T15:29:19.216438+0000","last_became_active":"2023-05-17T15:29:19.216102+0000","last_became_peered":"2023-05-17T15:29:19.216102+0000","last_unstale":"2023-05-17T15:29:19.216438+0000","last_undegraded":"2023-05-17T15:29:19.216438+0000","last_fullsized":"2023-05-17T15:29:19.216438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218298+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.217921+0000","last_change":"2023-05-17T15:29:19.217921+0000","last_active":"2023-05-17T15:29:19.217921+0000","last_peered":"2023-05-17T15:29:19.217921+0000","last_clean":"2023-05-17T15:29:19.217921+0000","last_became_active":"2023-05-17T15:29:19.217620+0000","last_became_peered":"2023-05-17T15:29:19.217620+0000","last_unstale":"2023-05-17T15:29:19.217921+0000","last_undegraded":"2023-05-17T15:29:19.217921+0000","last_fullsized":"2023-05-17T15:29:19.217921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220325+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227841+0000","last_change":"2023-05-17T15:29:19.227841+0000","last_active":"2023-05-17T15:29:19.227841+0000","last_peered":"2023-05-17T15:29:19.227841+0000","last_clean":"2023-05-17T15:29:19.227841+0000","last_became_active":"2023-05-17T15:29:19.226953+0000","last_became_peered":"2023-05-17T15:29:19.226953+0000","last_unstale":"2023-05-17T15:29:19.227841+0000","last_undegraded":"2023-05-17T15:29:19.227841+0000","last_fullsized":"2023-05-17T15:29:19.227841+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215112+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235472+0000","last_change":"2023-05-17T15:29:19.235472+0000","last_active":"2023-05-17T15:29:19.235472+0000","last_peered":"2023-05-17T15:29:19.235472+0000","last_clean":"2023-05-17T15:29:19.235472+0000","last_became_active":"2023-05-17T15:29:19.235161+0000","last_became_peered":"2023-05-17T15:29:19.235161+0000","last_unstale":"2023-05-17T15:29:19.235472+0000","last_undegraded":"2023-05-17T15:29:19.235472+0000","last_fullsized":"2023-05-17T15:29:19.235472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215187+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226407+0000","last_change":"2023-05-17T15:29:19.226407+0000","last_active":"2023-05-17T15:29:19.226407+0000","last_peered":"2023-05-17T15:29:19.226407+0000","last_clean":"2023-05-17T15:29:19.226407+0000","last_became_active":"2023-05-17T15:29:19.226135+0000","last_became_peered":"2023-05-17T15:29:19.226135+0000","last_unstale":"2023-05-17T15:29:19.226407+0000","last_undegraded":"2023-05-17T15:29:19.226407+0000","last_fullsized":"2023-05-17T15:29:19.226407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211818+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228189+0000","last_change":"2023-05-17T15:29:19.228189+0000","last_active":"2023-05-17T15:29:19.228189+0000","last_peered":"2023-05-17T15:29:19.228189+0000","last_clean":"2023-05-17T15:29:19.228189+0000","last_became_active":"2023-05-17T15:29:19.227924+0000","last_became_peered":"2023-05-17T15:29:19.227924+0000","last_unstale":"2023-05-17T15:29:19.228189+0000","last_undegraded":"2023-05-17T15:29:19.228189+0000","last_fullsized":"2023-05-17T15:29:19.228189+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214669+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224680+0000","last_change":"2023-05-17T15:29:19.224680+0000","last_active":"2023-05-17T15:29:19.224680+0000","last_peered":"2023-05-17T15:29:19.224680+0000","last_clean":"2023-05-17T15:29:19.224680+0000","last_became_active":"2023-05-17T15:29:19.224445+0000","last_became_peered":"2023-05-17T15:29:19.224445+0000","last_unstale":"2023-05-17T15:29:19.224680+0000","last_undegraded":"2023-05-17T15:29:19.224680+0000","last_fullsized":"2023-05-17T15:29:19.224680+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211554+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227068+0000","last_change":"2023-05-17T15:29:19.227068+0000","last_active":"2023-05-17T15:29:19.227068+0000","last_peered":"2023-05-17T15:29:19.227068+0000","last_clean":"2023-05-17T15:29:19.227068+0000","last_became_active":"2023-05-17T15:29:19.226527+0000","last_became_peered":"2023-05-17T15:29:19.226527+0000","last_unstale":"2023-05-17T15:29:19.227068+0000","last_undegraded":"2023-05-17T15:29:19.227068+0000","last_fullsized":"2023-05-17T15:29:19.227068+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208007+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.234553+0000","last_change":"2023-05-17T15:29:19.234553+0000","last_active":"2023-05-17T15:29:19.234553+0000","last_peered":"2023-05-17T15:29:19.234553+0000","last_clean":"2023-05-17T15:29:19.234553+0000","last_became_active":"2023-05-17T15:29:19.231624+0000","last_became_peered":"2023-05-17T15:29:19.231624+0000","last_unstale":"2023-05-17T15:29:19.234553+0000","last_undegraded":"2023-05-17T15:29:19.234553+0000","last_fullsized":"2023-05-17T15:29:19.234553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209912+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225402+0000","last_change":"2023-05-17T15:29:19.225402+0000","last_active":"2023-05-17T15:29:19.225402+0000","last_peered":"2023-05-17T15:29:19.225402+0000","last_clean":"2023-05-17T15:29:19.225402+0000","last_became_active":"2023-05-17T15:29:19.225133+0000","last_became_peered":"2023-05-17T15:29:19.225133+0000","last_unstale":"2023-05-17T15:29:19.225402+0000","last_undegraded":"2023-05-17T15:29:19.225402+0000","last_fullsized":"2023-05-17T15:29:19.225402+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214813+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235126+0000","last_change":"2023-05-17T15:29:19.235126+0000","last_active":"2023-05-17T15:29:19.235126+0000","last_peered":"2023-05-17T15:29:19.235126+0000","last_clean":"2023-05-17T15:29:19.235126+0000","last_became_active":"2023-05-17T15:29:19.234828+0000","last_became_peered":"2023-05-17T15:29:19.234828+0000","last_unstale":"2023-05-17T15:29:19.235126+0000","last_undegraded":"2023-05-17T15:29:19.235126+0000","last_fullsized":"2023-05-17T15:29:19.235126+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209939+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233128+0000","last_change":"2023-05-17T15:29:19.233128+0000","last_active":"2023-05-17T15:29:19.233128+0000","last_peered":"2023-05-17T15:29:19.233128+0000","last_clean":"2023-05-17T15:29:19.233128+0000","last_became_active":"2023-05-17T15:29:19.232840+0000","last_became_peered":"2023-05-17T15:29:19.232840+0000","last_unstale":"2023-05-17T15:29:19.233128+0000","last_undegraded":"2023-05-17T15:29:19.233128+0000","last_fullsized":"2023-05-17T15:29:19.233128+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214146+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232632+0000","last_change":"2023-05-17T15:29:19.232632+0000","last_active":"2023-05-17T15:29:19.232632+0000","last_peered":"2023-05-17T15:29:19.232632+0000","last_clean":"2023-05-17T15:29:19.232632+0000","last_became_active":"2023-05-17T15:29:19.232325+0000","last_became_peered":"2023-05-17T15:29:19.232325+0000","last_unstale":"2023-05-17T15:29:19.232632+0000","last_undegraded":"2023-05-17T15:29:19.232632+0000","last_fullsized":"2023-05-17T15:29:19.232632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209702+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233692+0000","last_change":"2023-05-17T15:29:19.233692+0000","last_active":"2023-05-17T15:29:19.233692+0000","last_peered":"2023-05-17T15:29:19.233692+0000","last_clean":"2023-05-17T15:29:19.233692+0000","last_became_active":"2023-05-17T15:29:19.233389+0000","last_became_peered":"2023-05-17T15:29:19.233389+0000","last_unstale":"2023-05-17T15:29:19.233692+0000","last_undegraded":"2023-05-17T15:29:19.233692+0000","last_fullsized":"2023-05-17T15:29:19.233692+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211542+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223496+0000","last_change":"2023-05-17T15:29:19.223496+0000","last_active":"2023-05-17T15:29:19.223496+0000","last_peered":"2023-05-17T15:29:19.223496+0000","last_clean":"2023-05-17T15:29:19.223496+0000","last_became_active":"2023-05-17T15:29:19.222935+0000","last_became_peered":"2023-05-17T15:29:19.222935+0000","last_unstale":"2023-05-17T15:29:19.223496+0000","last_undegraded":"2023-05-17T15:29:19.223496+0000","last_fullsized":"2023-05-17T15:29:19.223496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208051+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235837+0000","last_change":"2023-05-17T15:29:19.235837+0000","last_active":"2023-05-17T15:29:19.235837+0000","last_peered":"2023-05-17T15:29:19.235837+0000","last_clean":"2023-05-17T15:29:19.235837+0000","last_became_active":"2023-05-17T15:29:19.235271+0000","last_became_peered":"2023-05-17T15:29:19.235271+0000","last_unstale":"2023-05-17T15:29:19.235837+0000","last_undegraded":"2023-05-17T15:29:19.235837+0000","last_fullsized":"2023-05-17T15:29:19.235837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219225+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218502+0000","last_change":"2023-05-17T15:29:19.218502+0000","last_active":"2023-05-17T15:29:19.218502+0000","last_peered":"2023-05-17T15:29:19.218502+0000","last_clean":"2023-05-17T15:29:19.218502+0000","last_became_active":"2023-05-17T15:29:19.218216+0000","last_became_peered":"2023-05-17T15:29:19.218216+0000","last_unstale":"2023-05-17T15:29:19.218502+0000","last_undegraded":"2023-05-17T15:29:19.218502+0000","last_fullsized":"2023-05-17T15:29:19.218502+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211265+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223022+0000","last_change":"2023-05-17T15:29:19.223022+0000","last_active":"2023-05-17T15:29:19.223022+0000","last_peered":"2023-05-17T15:29:19.223022+0000","last_clean":"2023-05-17T15:29:19.223022+0000","last_became_active":"2023-05-17T15:29:19.222747+0000","last_became_peered":"2023-05-17T15:29:19.222747+0000","last_unstale":"2023-05-17T15:29:19.223022+0000","last_undegraded":"2023-05-17T15:29:19.223022+0000","last_fullsized":"2023-05-17T15:29:19.223022+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210321+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218399+0000","last_change":"2023-05-17T15:29:19.218399+0000","last_active":"2023-05-17T15:29:19.218399+0000","last_peered":"2023-05-17T15:29:19.218399+0000","last_clean":"2023-05-17T15:29:19.218399+0000","last_became_active":"2023-05-17T15:29:19.218004+0000","last_became_peered":"2023-05-17T15:29:19.218004+0000","last_unstale":"2023-05-17T15:29:19.218399+0000","last_undegraded":"2023-05-17T15:29:19.218399+0000","last_fullsized":"2023-05-17T15:29:19.218399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209004+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231041+0000","last_change":"2023-05-17T15:29:19.231041+0000","last_active":"2023-05-17T15:29:19.231041+0000","last_peered":"2023-05-17T15:29:19.231041+0000","last_clean":"2023-05-17T15:29:19.231041+0000","last_became_active":"2023-05-17T15:29:19.230710+0000","last_became_peered":"2023-05-17T15:29:19.230710+0000","last_unstale":"2023-05-17T15:29:19.231041+0000","last_undegraded":"2023-05-17T15:29:19.231041+0000","last_fullsized":"2023-05-17T15:29:19.231041+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219713+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226559+0000","last_change":"2023-05-17T15:29:19.226559+0000","last_active":"2023-05-17T15:29:19.226559+0000","last_peered":"2023-05-17T15:29:19.226559+0000","last_clean":"2023-05-17T15:29:19.226559+0000","last_became_active":"2023-05-17T15:29:19.225699+0000","last_became_peered":"2023-05-17T15:29:19.225699+0000","last_unstale":"2023-05-17T15:29:19.226559+0000","last_undegraded":"2023-05-17T15:29:19.226559+0000","last_fullsized":"2023-05-17T15:29:19.226559+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216511+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223102+0000","last_change":"2023-05-17T15:29:19.223102+0000","last_active":"2023-05-17T15:29:19.223102+0000","last_peered":"2023-05-17T15:29:19.223102+0000","last_clean":"2023-05-17T15:29:19.223102+0000","last_became_active":"2023-05-17T15:29:19.222837+0000","last_became_peered":"2023-05-17T15:29:19.222837+0000","last_unstale":"2023-05-17T15:29:19.223102+0000","last_undegraded":"2023-05-17T15:29:19.223102+0000","last_fullsized":"2023-05-17T15:29:19.223102+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210471+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236154+0000","last_change":"2023-05-17T15:29:19.236154+0000","last_active":"2023-05-17T15:29:19.236154+0000","last_peered":"2023-05-17T15:29:19.236154+0000","last_clean":"2023-05-17T15:29:19.236154+0000","last_became_active":"2023-05-17T15:29:19.235132+0000","last_became_peered":"2023-05-17T15:29:19.235132+0000","last_unstale":"2023-05-17T15:29:19.236154+0000","last_undegraded":"2023-05-17T15:29:19.236154+0000","last_fullsized":"2023-05-17T15:29:19.236154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208957+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225105+0000","last_change":"2023-05-17T15:29:19.225105+0000","last_active":"2023-05-17T15:29:19.225105+0000","last_peered":"2023-05-17T15:29:19.225105+0000","last_clean":"2023-05-17T15:29:19.225105+0000","last_became_active":"2023-05-17T15:29:19.224787+0000","last_became_peered":"2023-05-17T15:29:19.224787+0000","last_unstale":"2023-05-17T15:29:19.225105+0000","last_undegraded":"2023-05-17T15:29:19.225105+0000","last_fullsized":"2023-05-17T15:29:19.225105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209947+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224828+0000","last_change":"2023-05-17T15:29:19.224828+0000","last_active":"2023-05-17T15:29:19.224828+0000","last_peered":"2023-05-17T15:29:19.224828+0000","last_clean":"2023-05-17T15:29:19.224828+0000","last_became_active":"2023-05-17T15:29:19.224459+0000","last_became_peered":"2023-05-17T15:29:19.224459+0000","last_unstale":"2023-05-17T15:29:19.224828+0000","last_undegraded":"2023-05-17T15:29:19.224828+0000","last_fullsized":"2023-05-17T15:29:19.224828+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.221275+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.219162+0000","last_change":"2023-05-17T15:29:19.219162+0000","last_active":"2023-05-17T15:29:19.219162+0000","last_peered":"2023-05-17T15:29:19.219162+0000","last_clean":"2023-05-17T15:29:19.219162+0000","last_became_active":"2023-05-17T15:29:19.217976+0000","last_became_peered":"2023-05-17T15:29:19.217976+0000","last_unstale":"2023-05-17T15:29:19.219162+0000","last_undegraded":"2023-05-17T15:29:19.219162+0000","last_fullsized":"2023-05-17T15:29:19.219162+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217845+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226882+0000","last_change":"2023-05-17T15:29:19.226882+0000","last_active":"2023-05-17T15:29:19.226882+0000","last_peered":"2023-05-17T15:29:19.226882+0000","last_clean":"2023-05-17T15:29:19.226882+0000","last_became_active":"2023-05-17T15:29:19.226602+0000","last_became_peered":"2023-05-17T15:29:19.226602+0000","last_unstale":"2023-05-17T15:29:19.226882+0000","last_undegraded":"2023-05-17T15:29:19.226882+0000","last_fullsized":"2023-05-17T15:29:19.226882+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217088+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227477+0000","last_change":"2023-05-17T15:29:19.227477+0000","last_active":"2023-05-17T15:29:19.227477+0000","last_peered":"2023-05-17T15:29:19.227477+0000","last_clean":"2023-05-17T15:29:19.227477+0000","last_became_active":"2023-05-17T15:29:19.227181+0000","last_became_peered":"2023-05-17T15:29:19.227181+0000","last_unstale":"2023-05-17T15:29:19.227477+0000","last_undegraded":"2023-05-17T15:29:19.227477+0000","last_fullsized":"2023-05-17T15:29:19.227477+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208391+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226062+0000","last_change":"2023-05-17T15:29:19.226062+0000","last_active":"2023-05-17T15:29:19.226062+0000","last_peered":"2023-05-17T15:29:19.226062+0000","last_clean":"2023-05-17T15:29:19.226062+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226062+0000","last_undegraded":"2023-05-17T15:29:19.226062+0000","last_fullsized":"2023-05-17T15:29:19.226062+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208882+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223810+0000","last_change":"2023-05-17T15:29:19.223810+0000","last_active":"2023-05-17T15:29:19.223810+0000","last_peered":"2023-05-17T15:29:19.223810+0000","last_clean":"2023-05-17T15:29:19.223810+0000","last_became_active":"2023-05-17T15:29:19.223511+0000","last_became_peered":"2023-05-17T15:29:19.223511+0000","last_unstale":"2023-05-17T15:29:19.223810+0000","last_undegraded":"2023-05-17T15:29:19.223810+0000","last_fullsized":"2023-05-17T15:29:19.223810+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217649+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227154+0000","last_change":"2023-05-17T15:29:19.227154+0000","last_active":"2023-05-17T15:29:19.227154+0000","last_peered":"2023-05-17T15:29:19.227154+0000","last_clean":"2023-05-17T15:29:19.227154+0000","last_became_active":"2023-05-17T15:29:19.226876+0000","last_became_peered":"2023-05-17T15:29:19.226876+0000","last_unstale":"2023-05-17T15:29:19.227154+0000","last_undegraded":"2023-05-17T15:29:19.227154+0000","last_fullsized":"2023-05-17T15:29:19.227154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217501+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216411+0000","last_change":"2023-05-17T15:29:19.216411+0000","last_active":"2023-05-17T15:29:19.216411+0000","last_peered":"2023-05-17T15:29:19.216411+0000","last_clean":"2023-05-17T15:29:19.216411+0000","last_became_active":"2023-05-17T15:29:19.216065+0000","last_became_peered":"2023-05-17T15:29:19.216065+0000","last_unstale":"2023-05-17T15:29:19.216411+0000","last_undegraded":"2023-05-17T15:29:19.216411+0000","last_fullsized":"2023-05-17T15:29:19.216411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216413+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236893+0000","last_change":"2023-05-17T15:29:19.236893+0000","last_active":"2023-05-17T15:29:19.236893+0000","last_peered":"2023-05-17T15:29:19.236893+0000","last_clean":"2023-05-17T15:29:19.236893+0000","last_became_active":"2023-05-17T15:29:19.236609+0000","last_became_peered":"2023-05-17T15:29:19.236609+0000","last_unstale":"2023-05-17T15:29:19.236893+0000","last_undegraded":"2023-05-17T15:29:19.236893+0000","last_fullsized":"2023-05-17T15:29:19.236893+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214211+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236874+0000","last_change":"2023-05-17T15:29:19.236874+0000","last_active":"2023-05-17T15:29:19.236874+0000","last_peered":"2023-05-17T15:29:19.236874+0000","last_clean":"2023-05-17T15:29:19.236874+0000","last_became_active":"2023-05-17T15:29:19.236507+0000","last_became_peered":"2023-05-17T15:29:19.236507+0000","last_unstale":"2023-05-17T15:29:19.236874+0000","last_undegraded":"2023-05-17T15:29:19.236874+0000","last_fullsized":"2023-05-17T15:29:19.236874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.222536+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228664+0000","last_change":"2023-05-17T15:29:19.228664+0000","last_active":"2023-05-17T15:29:19.228664+0000","last_peered":"2023-05-17T15:29:19.228664+0000","last_clean":"2023-05-17T15:29:19.228664+0000","last_became_active":"2023-05-17T15:29:19.228391+0000","last_became_peered":"2023-05-17T15:29:19.228391+0000","last_unstale":"2023-05-17T15:29:19.228664+0000","last_undegraded":"2023-05-17T15:29:19.228664+0000","last_fullsized":"2023-05-17T15:29:19.228664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.207484+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232621+0000","last_change":"2023-05-17T15:29:19.232621+0000","last_active":"2023-05-17T15:29:19.232621+0000","last_peered":"2023-05-17T15:29:19.232621+0000","last_clean":"2023-05-17T15:29:19.232621+0000","last_became_active":"2023-05-17T15:29:19.232307+0000","last_became_peered":"2023-05-17T15:29:19.232307+0000","last_unstale":"2023-05-17T15:29:19.232621+0000","last_undegraded":"2023-05-17T15:29:19.232621+0000","last_fullsized":"2023-05-17T15:29:19.232621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212329+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228906+0000","last_change":"2023-05-17T15:29:19.228906+0000","last_active":"2023-05-17T15:29:19.228906+0000","last_peered":"2023-05-17T15:29:19.228906+0000","last_clean":"2023-05-17T15:29:19.228906+0000","last_became_active":"2023-05-17T15:29:19.228614+0000","last_became_peered":"2023-05-17T15:29:19.228614+0000","last_unstale":"2023-05-17T15:29:19.228906+0000","last_undegraded":"2023-05-17T15:29:19.228906+0000","last_fullsized":"2023-05-17T15:29:19.228906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214530+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227011+0000","last_change":"2023-05-17T15:29:19.227011+0000","last_active":"2023-05-17T15:29:19.227011+0000","last_peered":"2023-05-17T15:29:19.227011+0000","last_clean":"2023-05-17T15:29:19.227011+0000","last_became_active":"2023-05-17T15:29:19.225640+0000","last_became_peered":"2023-05-17T15:29:19.225640+0000","last_unstale":"2023-05-17T15:29:19.227011+0000","last_undegraded":"2023-05-17T15:29:19.227011+0000","last_fullsized":"2023-05-17T15:29:19.227011+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218161+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224151+0000","last_change":"2023-05-17T15:29:19.224151+0000","last_active":"2023-05-17T15:29:19.224151+0000","last_peered":"2023-05-17T15:29:19.224151+0000","last_clean":"2023-05-17T15:29:19.224151+0000","last_became_active":"2023-05-17T15:29:19.223868+0000","last_became_peered":"2023-05-17T15:29:19.223868+0000","last_unstale":"2023-05-17T15:29:19.224151+0000","last_undegraded":"2023-05-17T15:29:19.224151+0000","last_fullsized":"2023-05-17T15:29:19.224151+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220066+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227419+0000","last_change":"2023-05-17T15:29:19.227419+0000","last_active":"2023-05-17T15:29:19.227419+0000","last_peered":"2023-05-17T15:29:19.227419+0000","last_clean":"2023-05-17T15:29:19.227419+0000","last_became_active":"2023-05-17T15:29:19.227004+0000","last_became_peered":"2023-05-17T15:29:19.227004+0000","last_unstale":"2023-05-17T15:29:19.227419+0000","last_undegraded":"2023-05-17T15:29:19.227419+0000","last_fullsized":"2023-05-17T15:29:19.227419+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.224798+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227367+0000","last_change":"2023-05-17T15:29:19.227367+0000","last_active":"2023-05-17T15:29:19.227367+0000","last_peered":"2023-05-17T15:29:19.227367+0000","last_clean":"2023-05-17T15:29:19.227367+0000","last_became_active":"2023-05-17T15:29:19.227029+0000","last_became_peered":"2023-05-17T15:29:19.227029+0000","last_unstale":"2023-05-17T15:29:19.227367+0000","last_undegraded":"2023-05-17T15:29:19.227367+0000","last_fullsized":"2023-05-17T15:29:19.227367+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217807+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226649+0000","last_change":"2023-05-17T15:29:19.226649+0000","last_active":"2023-05-17T15:29:19.226649+0000","last_peered":"2023-05-17T15:29:19.226649+0000","last_clean":"2023-05-17T15:29:19.226649+0000","last_became_active":"2023-05-17T15:29:19.225847+0000","last_became_peered":"2023-05-17T15:29:19.225847+0000","last_unstale":"2023-05-17T15:29:19.226649+0000","last_undegraded":"2023-05-17T15:29:19.226649+0000","last_fullsized":"2023-05-17T15:29:19.226649+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217408+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225240+0000","last_change":"2023-05-17T15:29:19.225240+0000","last_active":"2023-05-17T15:29:19.225240+0000","last_peered":"2023-05-17T15:29:19.225240+0000","last_clean":"2023-05-17T15:29:19.225240+0000","last_became_active":"2023-05-17T15:29:19.224910+0000","last_became_peered":"2023-05-17T15:29:19.224910+0000","last_unstale":"2023-05-17T15:29:19.225240+0000","last_undegraded":"2023-05-17T15:29:19.225240+0000","last_fullsized":"2023-05-17T15:29:19.225240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.226366+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225479+0000","last_change":"2023-05-17T15:29:19.225479+0000","last_active":"2023-05-17T15:29:19.225479+0000","last_peered":"2023-05-17T15:29:19.225479+0000","last_clean":"2023-05-17T15:29:19.225479+0000","last_became_active":"2023-05-17T15:29:19.225162+0000","last_became_peered":"2023-05-17T15:29:19.225162+0000","last_unstale":"2023-05-17T15:29:19.225479+0000","last_undegraded":"2023-05-17T15:29:19.225479+0000","last_fullsized":"2023-05-17T15:29:19.225479+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.213255+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225875+0000","last_change":"2023-05-17T15:29:19.225875+0000","last_active":"2023-05-17T15:29:19.225875+0000","last_peered":"2023-05-17T15:29:19.225875+0000","last_clean":"2023-05-17T15:29:19.225875+0000","last_became_active":"2023-05-17T15:29:19.225389+0000","last_became_peered":"2023-05-17T15:29:19.225389+0000","last_unstale":"2023-05-17T15:29:19.225875+0000","last_undegraded":"2023-05-17T15:29:19.225875+0000","last_fullsized":"2023-05-17T15:29:19.225875+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.223039+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228139+0000","last_change":"2023-05-17T15:29:19.228139+0000","last_active":"2023-05-17T15:29:19.228139+0000","last_peered":"2023-05-17T15:29:19.228139+0000","last_clean":"2023-05-17T15:29:19.228139+0000","last_became_active":"2023-05-17T15:29:19.227706+0000","last_became_peered":"2023-05-17T15:29:19.227706+0000","last_unstale":"2023-05-17T15:29:19.228139+0000","last_undegraded":"2023-05-17T15:29:19.228139+0000","last_fullsized":"2023-05-17T15:29:19.228139+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216578+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224407+0000","last_change":"2023-05-17T15:29:19.224407+0000","last_active":"2023-05-17T15:29:19.224407+0000","last_peered":"2023-05-17T15:29:19.224407+0000","last_clean":"2023-05-17T15:29:19.224407+0000","last_became_active":"2023-05-17T15:29:19.224060+0000","last_became_peered":"2023-05-17T15:29:19.224060+0000","last_unstale":"2023-05-17T15:29:19.224407+0000","last_undegraded":"2023-05-17T15:29:19.224407+0000","last_fullsized":"2023-05-17T15:29:19.224407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214424+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223726+0000","last_change":"2023-05-17T15:29:19.223726+0000","last_active":"2023-05-17T15:29:19.223726+0000","last_peered":"2023-05-17T15:29:19.223726+0000","last_clean":"2023-05-17T15:29:19.223726+0000","last_became_active":"2023-05-17T15:29:19.223436+0000","last_became_peered":"2023-05-17T15:29:19.223436+0000","last_unstale":"2023-05-17T15:29:19.223726+0000","last_undegraded":"2023-05-17T15:29:19.223726+0000","last_fullsized":"2023-05-17T15:29:19.223726+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209903+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231442+0000","last_change":"2023-05-17T15:29:19.231442+0000","last_active":"2023-05-17T15:29:19.231442+0000","last_peered":"2023-05-17T15:29:19.231442+0000","last_clean":"2023-05-17T15:29:19.231442+0000","last_became_active":"2023-05-17T15:29:19.231112+0000","last_became_peered":"2023-05-17T15:29:19.231112+0000","last_unstale":"2023-05-17T15:29:19.231442+0000","last_undegraded":"2023-05-17T15:29:19.231442+0000","last_fullsized":"2023-05-17T15:29:19.231442+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216606+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.229267+0000","last_change":"2023-05-17T15:29:19.229267+0000","last_active":"2023-05-17T15:29:19.229267+0000","last_peered":"2023-05-17T15:29:19.229267+0000","last_clean":"2023-05-17T15:29:19.229267+0000","last_became_active":"2023-05-17T15:29:19.228233+0000","last_became_peered":"2023-05-17T15:29:19.228233+0000","last_unstale":"2023-05-17T15:29:19.229267+0000","last_undegraded":"2023-05-17T15:29:19.229267+0000","last_fullsized":"2023-05-17T15:29:19.229267+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212505+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225497+0000","last_change":"2023-05-17T15:29:19.225497+0000","last_active":"2023-05-17T15:29:19.225497+0000","last_peered":"2023-05-17T15:29:19.225497+0000","last_clean":"2023-05-17T15:29:19.225497+0000","last_became_active":"2023-05-17T15:29:19.225214+0000","last_became_peered":"2023-05-17T15:29:19.225214+0000","last_unstale":"2023-05-17T15:29:19.225497+0000","last_undegraded":"2023-05-17T15:29:19.225497+0000","last_fullsized":"2023-05-17T15:29:19.225497+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218487+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228812+0000","last_change":"2023-05-17T15:29:19.228812+0000","last_active":"2023-05-17T15:29:19.228812+0000","last_peered":"2023-05-17T15:29:19.228812+0000","last_clean":"2023-05-17T15:29:19.228812+0000","last_became_active":"2023-05-17T15:29:19.228540+0000","last_became_peered":"2023-05-17T15:29:19.228540+0000","last_unstale":"2023-05-17T15:29:19.228812+0000","last_undegraded":"2023-05-17T15:29:19.228812+0000","last_fullsized":"2023-05-17T15:29:19.228812+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211806+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.230855+0000","last_change":"2023-05-17T15:29:19.230855+0000","last_active":"2023-05-17T15:29:19.230855+0000","last_peered":"2023-05-17T15:29:19.230855+0000","last_clean":"2023-05-17T15:29:19.230855+0000","last_became_active":"2023-05-17T15:29:19.228960+0000","last_became_peered":"2023-05-17T15:29:19.228960+0000","last_unstale":"2023-05-17T15:29:19.230855+0000","last_undegraded":"2023-05-17T15:29:19.230855+0000","last_fullsized":"2023-05-17T15:29:19.230855+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214153+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.221496+0000","last_change":"2023-05-17T15:29:19.221496+0000","last_active":"2023-05-17T15:29:19.221496+0000","last_peered":"2023-05-17T15:29:19.221496+0000","last_clean":"2023-05-17T15:29:19.221496+0000","last_became_active":"2023-05-17T15:29:19.221198+0000","last_became_peered":"2023-05-17T15:29:19.221198+0000","last_unstale":"2023-05-17T15:29:19.221496+0000","last_undegraded":"2023-05-17T15:29:19.221496+0000","last_fullsized":"2023-05-17T15:29:19.221496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217242+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235317+0000","last_change":"2023-05-17T15:29:19.235317+0000","last_active":"2023-05-17T15:29:19.235317+0000","last_peered":"2023-05-17T15:29:19.235317+0000","last_clean":"2023-05-17T15:29:19.235317+0000","last_became_active":"2023-05-17T15:29:19.235022+0000","last_became_peered":"2023-05-17T15:29:19.235022+0000","last_unstale":"2023-05-17T15:29:19.235317+0000","last_undegraded":"2023-05-17T15:29:19.235317+0000","last_fullsized":"2023-05-17T15:29:19.235317+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216672+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.216276+0000","last_change":"2023-05-17T15:29:19.216276+0000","last_active":"2023-05-17T15:29:19.216276+0000","last_peered":"2023-05-17T15:29:19.216276+0000","last_clean":"2023-05-17T15:29:19.216276+0000","last_became_active":"2023-05-17T15:29:19.215939+0000","last_became_peered":"2023-05-17T15:29:19.215939+0000","last_unstale":"2023-05-17T15:29:19.216276+0000","last_undegraded":"2023-05-17T15:29:19.216276+0000","last_fullsized":"2023-05-17T15:29:19.216276+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.204451+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:18.204451+0000","last_peered":"2023-05-17T15:29:18.204451+0000","last_clean":"2023-05-17T15:29:18.204451+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:18.204451+0000","last_undegraded":"2023-05-17T15:29:18.204451+0000","last_fullsized":"2023-05-17T15:29:18.204451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210897+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213012+0000","last_change":"2023-05-17T15:29:19.213012+0000","last_active":"2023-05-17T15:29:19.213012+0000","last_peered":"2023-05-17T15:29:19.213012+0000","last_clean":"2023-05-17T15:29:19.213012+0000","last_became_active":"2023-05-17T15:29:19.212738+0000","last_became_peered":"2023-05-17T15:29:19.212738+0000","last_unstale":"2023-05-17T15:29:19.213012+0000","last_undegraded":"2023-05-17T15:29:19.213012+0000","last_fullsized":"2023-05-17T15:29:19.213012+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213738+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:18.213738+0000","last_peered":"2023-05-17T15:29:18.213738+0000","last_clean":"2023-05-17T15:29:18.213738+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:18.213738+0000","last_undegraded":"2023-05-17T15:29:18.213738+0000","last_fullsized":"2023-05-17T15:29:18.213738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.208563+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225010+0000","last_change":"2023-05-17T15:29:19.225010+0000","last_active":"2023-05-17T15:29:19.225010+0000","last_peered":"2023-05-17T15:29:19.225010+0000","last_clean":"2023-05-17T15:29:19.225010+0000","last_became_active":"2023-05-17T15:29:19.224310+0000","last_became_peered":"2023-05-17T15:29:19.224310+0000","last_unstale":"2023-05-17T15:29:19.225010+0000","last_undegraded":"2023-05-17T15:29:19.225010+0000","last_fullsized":"2023-05-17T15:29:19.225010+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.199202+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:18.199202+0000","last_peered":"2023-05-17T15:29:18.199202+0000","last_clean":"2023-05-17T15:29:18.199202+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:18.199202+0000","last_undegraded":"2023-05-17T15:29:18.199202+0000","last_fullsized":"2023-05-17T15:29:18.199202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215097+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226296+0000","last_change":"2023-05-17T15:29:19.226296+0000","last_active":"2023-05-17T15:29:19.226296+0000","last_peered":"2023-05-17T15:29:19.226296+0000","last_clean":"2023-05-17T15:29:19.226296+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226296+0000","last_undegraded":"2023-05-17T15:29:19.226296+0000","last_fullsized":"2023-05-17T15:29:19.226296+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213984+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:18.213984+0000","last_peered":"2023-05-17T15:29:18.213984+0000","last_clean":"2023-05-17T15:29:18.213984+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:18.213984+0000","last_undegraded":"2023-05-17T15:29:18.213984+0000","last_fullsized":"2023-05-17T15:29:18.213984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207635+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:18.207635+0000","last_peered":"2023-05-17T15:29:18.207635+0000","last_clean":"2023-05-17T15:29:18.207635+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:18.207635+0000","last_undegraded":"2023-05-17T15:29:18.207635+0000","last_fullsized":"2023-05-17T15:29:18.207635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216482+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235573+0000","last_change":"2023-05-17T15:29:19.235573+0000","last_active":"2023-05-17T15:29:19.235573+0000","last_peered":"2023-05-17T15:29:19.235573+0000","last_clean":"2023-05-17T15:29:19.235573+0000","last_became_active":"2023-05-17T15:29:19.231571+0000","last_became_peered":"2023-05-17T15:29:19.231571+0000","last_unstale":"2023-05-17T15:29:19.235573+0000","last_undegraded":"2023-05-17T15:29:19.235573+0000","last_fullsized":"2023-05-17T15:29:19.235573+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207654+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:18.207654+0000","last_peered":"2023-05-17T15:29:18.207654+0000","last_clean":"2023-05-17T15:29:18.207654+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:18.207654+0000","last_undegraded":"2023-05-17T15:29:18.207654+0000","last_fullsized":"2023-05-17T15:29:18.207654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.213738+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228646+0000","last_change":"2023-05-17T15:29:19.228646+0000","last_active":"2023-05-17T15:29:19.228646+0000","last_peered":"2023-05-17T15:29:19.228646+0000","last_clean":"2023-05-17T15:29:19.228646+0000","last_became_active":"2023-05-17T15:29:19.228343+0000","last_became_peered":"2023-05-17T15:29:19.228343+0000","last_unstale":"2023-05-17T15:29:19.228646+0000","last_undegraded":"2023-05-17T15:29:19.228646+0000","last_fullsized":"2023-05-17T15:29:19.228646+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207933+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:18.207933+0000","last_peered":"2023-05-17T15:29:18.207933+0000","last_clean":"2023-05-17T15:29:18.207933+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:18.207933+0000","last_undegraded":"2023-05-17T15:29:18.207933+0000","last_fullsized":"2023-05-17T15:29:18.207933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209236+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213501+0000","last_change":"2023-05-17T15:29:19.213501+0000","last_active":"2023-05-17T15:29:19.213501+0000","last_peered":"2023-05-17T15:29:19.213501+0000","last_clean":"2023-05-17T15:29:19.213501+0000","last_became_active":"2023-05-17T15:29:19.213181+0000","last_became_peered":"2023-05-17T15:29:19.213181+0000","last_unstale":"2023-05-17T15:29:19.213501+0000","last_undegraded":"2023-05-17T15:29:19.213501+0000","last_fullsized":"2023-05-17T15:29:19.213501+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.204044+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:18.204044+0000","last_peered":"2023-05-17T15:29:18.204044+0000","last_clean":"2023-05-17T15:29:18.204044+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:18.204044+0000","last_undegraded":"2023-05-17T15:29:18.204044+0000","last_fullsized":"2023-05-17T15:29:18.204044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215267+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231397+0000","last_change":"2023-05-17T15:29:19.231397+0000","last_active":"2023-05-17T15:29:19.231397+0000","last_peered":"2023-05-17T15:29:19.231397+0000","last_clean":"2023-05-17T15:29:19.231397+0000","last_became_active":"2023-05-17T15:29:19.231080+0000","last_became_peered":"2023-05-17T15:29:19.231080+0000","last_unstale":"2023-05-17T15:29:19.231397+0000","last_undegraded":"2023-05-17T15:29:19.231397+0000","last_fullsized":"2023-05-17T15:29:19.231397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.206290+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:18.206290+0000","last_peered":"2023-05-17T15:29:18.206290+0000","last_clean":"2023-05-17T15:29:18.206290+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:18.206290+0000","last_undegraded":"2023-05-17T15:29:18.206290+0000","last_fullsized":"2023-05-17T15:29:18.206290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20816,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351024,"statfs":{"total":96636764160,"available":96615448576,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.498}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.439},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.40100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575268,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20060,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94351780,"statfs":{"total":96636764160,"available":96616222720,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.374},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.40500000000000003}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575268,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.318},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.39600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575267,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21724,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":19584,"kb_avail":94350116,"statfs":{"total":96636764160,"available":96614518784,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20054016},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.628,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61799999999999999,"5min":1.254,"15min":1.254},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.28699999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.433},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70799999999999996,"5min":1.04,"15min":1.04},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94499999999999995,"5min":1.0700000000000001,"15min":1.125},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90800000000000003,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.21},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575268,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":26432,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27066368},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.25900000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.313},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.495},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.43099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20624,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351216,"statfs":{"total":96636764160,"available":96615645184,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.501},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.66500000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834575267,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":25856,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26476544},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.378}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.436}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:24.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-05-17T15:29:24.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.210640+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-05-17T15:29:24.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216789+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-05-17T15:29:24.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.218298+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-05-17T15:29:24.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.220325+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-05-17T15:29:24.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.215112+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-05-17T15:29:24.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.215187+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-05-17T15:29:24.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.211818+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-05-17T15:29:24.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214669+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-05-17T15:29:24.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.211554+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-05-17T15:29:24.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.208007+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-05-17T15:29:24.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209912+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-05-17T15:29:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214813+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-05-17T15:29:24.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209939+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-05-17T15:29:24.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214146+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-05-17T15:29:24.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209702+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-05-17T15:29:24.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.211542+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-05-17T15:29:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.208051+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:29:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-05-17T15:29:24.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.219225+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:29:24.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-05-17T15:29:24.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.211265+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-05-17T15:29:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.210321+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-05-17T15:29:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209004+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-05-17T15:29:24.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.219713+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-05-17T15:29:24.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216511+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-05-17T15:29:24.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.210471+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-05-17T15:29:24.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.208957+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-05-17T15:29:24.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209947+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-05-17T15:29:24.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.221275+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-05-17T15:29:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217845+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-05-17T15:29:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217088+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-05-17T15:29:24.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.208391+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-05-17T15:29:24.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.208882+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-05-17T15:29:24.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217649+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-05-17T15:29:24.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217501+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-05-17T15:29:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216413+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-05-17T15:29:24.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214211+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-05-17T15:29:24.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.222536+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:29:24.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-05-17T15:29:24.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.207484+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-17T15:29:24.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-05-17T15:29:24.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.212329+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-05-17T15:29:24.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214530+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-05-17T15:29:24.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.218161+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-05-17T15:29:24.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.220066+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:29:24.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-05-17T15:29:24.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.224798+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:29:24.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-05-17T15:29:24.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217807+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-05-17T15:29:24.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217408+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-05-17T15:29:24.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.226366+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:29:24.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-05-17T15:29:24.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.213255+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-05-17T15:29:24.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.223039+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-17T15:29:24.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-05-17T15:29:24.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216578+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-05-17T15:29:24.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214424+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-05-17T15:29:24.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209903+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-05-17T15:29:24.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216606+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-17T15:29:24.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-05-17T15:29:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.212505+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-05-17T15:29:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.218487+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-05-17T15:29:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.211806+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-17T15:29:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-05-17T15:29:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.214153+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-05-17T15:29:24.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.217242+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-05-17T15:29:24.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216672+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-05-17T15:29:24.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.210897+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-05-17T15:29:24.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.208563+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-17T15:29:24.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-05-17T15:29:24.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.215097+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-05-17T15:29:24.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.216482+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-17T15:29:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-05-17T15:29:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.213738+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-05-17T15:29:24.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.209236+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-17T15:29:24.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-05-17T15:29:24.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-17T15:29:19.198069+0000', 'last_change': '2023-05-17T15:29:19.215267+0000', 'last_active': '2023-05-17T15:29:19.198069+0000', 'last_peered': '2023-05-17T15:29:19.198069+0000', 'last_clean': '2023-05-17T15:29:19.198069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-17T15:29:19.198069+0000', 'last_undegraded': '2023-05-17T15:29:19.198069+0000', 'last_fullsized': '2023-05-17T15:29:19.198069+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'last_clean_scrub_stamp': '2023-05-17T15:29:19.198069+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-17T15:29:24.380 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-17T15:29:24.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.491+0000 7f331b051700 1 Processor -- start 2023-05-17T15:29:24.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.491+0000 7f331b051700 1 -- start start 2023-05-17T15:29:24.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f331b051700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f33140c60c0 0x7f33140c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f331b051700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140a9f70 0x7f3314153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f331b051700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331405e7e0 con 0x7f33140aa3b0 2023-05-17T15:29:24.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f331b051700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331405eac0 con 0x7f33140c60c0 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f331b051700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140bfd70 con 0x7f33140a9f70 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f3318ded700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f33140c60c0 0x7f33140c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f3318ded700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f33140c60c0 0x7f33140c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46576/0 (socket says 172.21.15.27:46576) 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.492+0000 7f3318ded700 1 -- 172.21.15.27:0/3033266087 learned_addr learned my addr 172.21.15.27:0/3033266087 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f3318ded700 1 -- 172.21.15.27:0/3033266087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140a9f70 msgr2=0x7f3314153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f3313fff700 1 --2- 172.21.15.27:0/3033266087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140a9f70 0x7f3314153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f3318ded700 1 --2- 172.21.15.27:0/3033266087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140a9f70 0x7f3314153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f3318ded700 1 -- 172.21.15.27:0/3033266087 >> v1:172.21.15.40:6789/0 conn(0x7f33140aa3b0 legacy=0x7f3314157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f3318ded700 1 -- 172.21.15.27:0/3033266087 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140c0050 con 0x7f33140c60c0 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f3318ded700 1 --2- 172.21.15.27:0/3033266087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140c60c0 0x7f33140c64a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f3308006fd0 tx=0x7f33080090f0).ready entity=mon.0 client_cookie=f40861f75491c47f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f33137fe700 1 -- 172.21.15.27:0/3033266087 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800b600 con 0x7f33140c60c0 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f33137fe700 1 -- 172.21.15.27:0/3033266087 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800b760 con 0x7f33140c60c0 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f33137fe700 1 -- 172.21.15.27:0/3033266087 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800bae0 con 0x7f33140c60c0 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f331b051700 1 -- 172.21.15.27:0/3033266087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140c60c0 msgr2=0x7f33140c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.493+0000 7f331b051700 1 --2- 172.21.15.27:0/3033266087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140c60c0 0x7f33140c64a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f3308006fd0 tx=0x7f33080090f0).stop 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.494+0000 7f331b051700 1 -- 172.21.15.27:0/3033266087 shutdown_connections 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.494+0000 7f331b051700 1 --2- 172.21.15.27:0/3033266087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140c60c0 0x7f33140c64a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.494+0000 7f331b051700 1 --2- 172.21.15.27:0/3033266087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140a9f70 0x7f3314153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.494+0000 7f331b051700 1 -- 172.21.15.27:0/3033266087 >> 172.21.15.27:0/3033266087 conn(0x7f3314069e70 msgr2=0x7f331405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.494+0000 7f331b051700 1 -- 172.21.15.27:0/3033266087 shutdown_connections 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.494+0000 7f331b051700 1 -- 172.21.15.27:0/3033266087 wait complete. 2023-05-17T15:29:24.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.495+0000 7f331b051700 1 Processor -- start 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.495+0000 7f331b051700 1 -- start start 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 0x7f331413c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140aa3b0 0x7f3314156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33140c60c0 0x7f3314157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314157910 con 0x7f33140a9f70 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314156690 con 0x7f33140c60c0 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3314155b10 con 0x7f33140aa3b0 2023-05-17T15:29:24.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 0x7f331413c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 0x7f331413c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46582/0 (socket says 172.21.15.27:46582) 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 -- 172.21.15.27:0/3038366097 learned_addr learned my addr 172.21.15.27:0/3038366097 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f33195ee700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33140c60c0 0x7f3314157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3313fff700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140aa3b0 0x7f3314156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 -- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140aa3b0 msgr2=0x7f3314156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140aa3b0 0x7f3314156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.510 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 -- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33140c60c0 msgr2=0x7f3314157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33140c60c0 0x7f3314157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 -- 172.21.15.27:0/3038366097 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308009370 con 0x7f33140a9f70 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f33195ee700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33140c60c0 0x7f3314157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3313fff700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140aa3b0 0x7f3314156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3318ded700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 0x7f331413c4f0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f3308009f50 tx=0x7f3308017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800bae0 con 0x7f33140a9f70 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308000c90 con 0x7f33140a9f70 2023-05-17T15:29:24.511 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3314155df0 con 0x7f33140a9f70 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330801b640 con 0x7f33140a9f70 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.496+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33141563b0 con 0x7f33140a9f70 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.497+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33140c2450 con 0x7f33140a9f70 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.498+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f330800f070 con 0x7f33140a9f70 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.498+0000 7f3310ff9700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f32f805ed90 0x7f32f8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.498+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f330807b560 con 0x7f33140a9f70 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.498+0000 7f3313fff700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f32f805ed90 0x7f32f8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.512 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.499+0000 7f3313fff700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f32f805ed90 0x7f32f8061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f33140c7360 tx=0x7f3300008040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.513 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.502+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f330804c9f0 con 0x7f33140a9f70 2023-05-17T15:29:24.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.746+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f331405f4a0 con 0x7f33140a9f70 2023-05-17T15:29:24.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.746+0000 7f3310ff9700 1 -- 172.21.15.27:0/3038366097 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1042 (secure 0 0 0) 0x7f3308050010 con 0x7f33140a9f70 2023-05-17T15:29:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:24.751 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2150,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":177,"num_osds":8,"num_up_osds":8,"osd_up_since":1684335223,"num_in_osds":8,"osd_in_since":1684335217,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105},{"state_name":"creating+peering","count":32}],"num_pgs":137,"num_pools":4,"num_objects":13,"data_bytes":1414,"bytes_used":185864192,"bytes_avail":772908249088,"bytes_total":773094113280,"inactive_pgs_ratio":0.23357664048671722},"fsmap":{"epoch":74,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":8988}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-05-17T15:28:53.897073+0000","services":{}},"progress_events":{}} 2023-05-17T15:29:24.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f32f805ed90 msgr2=0x7f32f8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f32f805ed90 0x7f32f8061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f33140c7360 tx=0x7f3300008040).stop 2023-05-17T15:29:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 msgr2=0x7f331413c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 0x7f331413c4f0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f3308009f50 tx=0x7f3308017000).stop 2023-05-17T15:29:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 shutdown_connections 2023-05-17T15:29:24.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f32f805ed90 0x7f32f8061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33140c60c0 0x7f3314157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33140a9f70 0x7f331413c4f0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 --2- 172.21.15.27:0/3038366097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33140aa3b0 0x7f3314156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 >> 172.21.15.27:0/3038366097 conn(0x7f3314069e70 msgr2=0x7f33140aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:24.754 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 shutdown_connections 2023-05-17T15:29:24.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.748+0000 7f331b051700 1 -- 172.21.15.27:0/3038366097 wait complete. 2023-05-17T15:29:24.764 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-17T15:29:24.765 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:24.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.880+0000 7f03b3591700 1 Processor -- start 2023-05-17T15:29:24.885 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.880+0000 7f03b3591700 1 -- start start 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b3591700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b3591700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03ac05dd50 0x7f03ac05e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b3591700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac064f20 con 0x7f03ac153d80 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b3591700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac05e6d0 con 0x7f03ac05dd50 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b3591700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac064310 con 0x7f03ac154160 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b1b2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03ac05dd50 0x7f03ac05e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b1b2e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03ac05dd50 0x7f03ac05e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46592/0 (socket says 172.21.15.27:46592) 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.881+0000 7f03b1b2e700 1 -- 172.21.15.27:0/3166996650 learned_addr learned my addr 172.21.15.27:0/3166996650 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03b0b2c700 1 --2- 172.21.15.27:0/3166996650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03b1b2e700 1 -- 172.21.15.27:0/3166996650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 msgr2=0x7f03ac0653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03b1b2e700 1 --2- 172.21.15.27:0/3166996650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03b1b2e700 1 -- 172.21.15.27:0/3166996650 >> v1:172.21.15.40:6789/0 conn(0x7f03ac153d80 legacy=0x7f03ac0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03b1b2e700 1 -- 172.21.15.27:0/3166996650 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0645f0 con 0x7f03ac05dd50 2023-05-17T15:29:24.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03b1b2e700 1 --2- 172.21.15.27:0/3166996650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac05e1e0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f039c009f20 tx=0x7f039c009840).ready entity=mon.0 client_cookie=c0bf25b807916563 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03abfff700 1 -- 172.21.15.27:0/3166996650 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00e070 con 0x7f03ac05dd50 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03abfff700 1 -- 172.21.15.27:0/3166996650 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c00b9d0 con 0x7f03ac05dd50 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.882+0000 7f03abfff700 1 -- 172.21.15.27:0/3166996650 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00bd50 con 0x7f03ac05dd50 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 -- 172.21.15.27:0/3166996650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 msgr2=0x7f03ac05e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 --2- 172.21.15.27:0/3166996650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac05e1e0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f039c009f20 tx=0x7f039c009840).stop 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 -- 172.21.15.27:0/3166996650 shutdown_connections 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 --2- 172.21.15.27:0/3166996650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac05e1e0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 --2- 172.21.15.27:0/3166996650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 -- 172.21.15.27:0/3166996650 >> 172.21.15.27:0/3166996650 conn(0x7f03ac0c8400 msgr2=0x7f03ac0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:24.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 -- 172.21.15.27:0/3166996650 shutdown_connections 2023-05-17T15:29:24.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.883+0000 7f03b3591700 1 -- 172.21.15.27:0/3166996650 wait complete. 2023-05-17T15:29:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.884+0000 7f03b3591700 1 Processor -- start 2023-05-17T15:29:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.884+0000 7f03b3591700 1 -- start start 2023-05-17T15:29:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac0a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03ac153d80 0x7f03ac0a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac153690 con 0x7f03ac05dd50 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0ac9b0 con 0x7f03ac153d80 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0ad530 con 0x7f03ac154160 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac0a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac0a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46596/0 (socket says 172.21.15.27:46596) 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 -- 172.21.15.27:0/1818972151 learned_addr learned my addr 172.21.15.27:0/1818972151 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b0b2c700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03ac153d80 0x7f03ac0a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b1b2e700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 -- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 msgr2=0x7f03ac0a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0a8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 -- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03ac153d80 msgr2=0x7f03ac0a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03ac153d80 0x7f03ac0a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 -- 172.21.15.27:0/1818972151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c009ae0 con 0x7f03ac05dd50 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b1b2e700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b132d700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac0a9bf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f03a400c470 tx=0x7f03a4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400ce90 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a400f470 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac0acc00 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.885+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400f810 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.886+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac0ad1c0 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.886+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac06bdf0 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.888+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f03a4019030 con 0x7f03ac05dd50 2023-05-17T15:29:24.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.888+0000 7f03a97fa700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f039805ed90 0x7f0398061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.888+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f03a4079210 con 0x7f03ac05dd50 2023-05-17T15:29:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.888+0000 7f03b0b2c700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f039805ed90 0x7f0398061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.888+0000 7f03b0b2c700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f039805ed90 0x7f0398061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f03ac0c1f30 tx=0x7f03a0009060).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:24.891+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f03a404a860 con 0x7f03ac05dd50 2023-05-17T15:29:25.067 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.063+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03ac0ad670 con 0x7f039805ed90 2023-05-17T15:29:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.073+0000 7f03a97fa700 1 -- 172.21.15.27:0/1818972151 <== mgr.8802 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360333 (secure 0 0 0) 0x7f03a00097d0 con 0x7f039805ed90 2023-05-17T15:29:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:25.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f039805ed90 msgr2=0x7f0398061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f039805ed90 0x7f0398061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f03ac0c1f30 tx=0x7f03a0009060).stop 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 msgr2=0x7f03ac0a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac0a9bf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f03a400c470 tx=0x7f03a4007dc0).stop 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 shutdown_connections 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f039805ed90 0x7f0398061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03ac154160 0x7f03ac0a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03ac05dd50 0x7f03ac0a9bf0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 --2- 172.21.15.27:0/1818972151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03ac153d80 0x7f03ac0a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.076+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 >> 172.21.15.27:0/1818972151 conn(0x7f03ac0c8400 msgr2=0x7f03ac0c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.077+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 shutdown_connections 2023-05-17T15:29:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:25.077+0000 7f03b3591700 1 -- 172.21.15.27:0/1818972151 wait complete. 2023-05-17T15:29:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:25.092 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-17T15:29:24.476832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1414,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":181508,"kb_used_data":17156,"kb_used_omap":0,"kb_used_meta":164288,"kb_avail":754793212,"statfs":{"total":773094113280,"available":772908249088,"internally_reserved":0,"allocated":17567744,"data_stored":8936919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":168230912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27326,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-74,"num_write_kb":-56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.607630"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210640+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616625+0000","last_change":"2023-05-17T15:29:19.229081+0000","last_active":"2023-05-17T15:29:19.616625+0000","last_peered":"2023-05-17T15:29:19.616625+0000","last_clean":"2023-05-17T15:29:19.616625+0000","last_became_active":"2023-05-17T15:29:19.228777+0000","last_became_peered":"2023-05-17T15:29:19.228777+0000","last_unstale":"2023-05-17T15:29:19.616625+0000","last_undegraded":"2023-05-17T15:29:19.616625+0000","last_fullsized":"2023-05-17T15:29:19.616625+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.620008+0000","last_change":"2023-05-17T15:29:19.619428+0000","last_active":"2023-05-17T15:29:19.620008+0000","last_peered":"2023-05-17T15:29:19.620008+0000","last_clean":"2023-05-17T15:29:19.620008+0000","last_became_active":"2023-05-17T15:29:19.619096+0000","last_became_peered":"2023-05-17T15:29:19.619096+0000","last_unstale":"2023-05-17T15:29:19.620008+0000","last_undegraded":"2023-05-17T15:29:19.620008+0000","last_fullsized":"2023-05-17T15:29:19.620008+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592049+0000","last_change":"2023-05-17T15:29:19.216438+0000","last_active":"2023-05-17T15:29:19.592049+0000","last_peered":"2023-05-17T15:29:19.592049+0000","last_clean":"2023-05-17T15:29:19.592049+0000","last_became_active":"2023-05-17T15:29:19.216102+0000","last_became_peered":"2023-05-17T15:29:19.216102+0000","last_unstale":"2023-05-17T15:29:19.592049+0000","last_undegraded":"2023-05-17T15:29:19.592049+0000","last_fullsized":"2023-05-17T15:29:19.592049+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614034+0000","last_change":"2023-05-17T15:29:19.610360+0000","last_active":"2023-05-17T15:29:19.614034+0000","last_peered":"2023-05-17T15:29:19.614034+0000","last_clean":"2023-05-17T15:29:19.614034+0000","last_became_active":"2023-05-17T15:29:19.610053+0000","last_became_peered":"2023-05-17T15:29:19.610053+0000","last_unstale":"2023-05-17T15:29:19.614034+0000","last_undegraded":"2023-05-17T15:29:19.614034+0000","last_fullsized":"2023-05-17T15:29:19.614034+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.217921+0000","last_change":"2023-05-17T15:29:19.217921+0000","last_active":"2023-05-17T15:29:19.217921+0000","last_peered":"2023-05-17T15:29:19.217921+0000","last_clean":"2023-05-17T15:29:19.217921+0000","last_became_active":"2023-05-17T15:29:19.217620+0000","last_became_peered":"2023-05-17T15:29:19.217620+0000","last_unstale":"2023-05-17T15:29:19.217921+0000","last_undegraded":"2023-05-17T15:29:19.217921+0000","last_fullsized":"2023-05-17T15:29:19.217921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220325+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227841+0000","last_change":"2023-05-17T15:29:19.227841+0000","last_active":"2023-05-17T15:29:19.227841+0000","last_peered":"2023-05-17T15:29:19.227841+0000","last_clean":"2023-05-17T15:29:19.227841+0000","last_became_active":"2023-05-17T15:29:19.226953+0000","last_became_peered":"2023-05-17T15:29:19.226953+0000","last_unstale":"2023-05-17T15:29:19.227841+0000","last_undegraded":"2023-05-17T15:29:19.227841+0000","last_fullsized":"2023-05-17T15:29:19.227841+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215112+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235472+0000","last_change":"2023-05-17T15:29:19.235472+0000","last_active":"2023-05-17T15:29:19.235472+0000","last_peered":"2023-05-17T15:29:19.235472+0000","last_clean":"2023-05-17T15:29:19.235472+0000","last_became_active":"2023-05-17T15:29:19.235161+0000","last_became_peered":"2023-05-17T15:29:19.235161+0000","last_unstale":"2023-05-17T15:29:19.235472+0000","last_undegraded":"2023-05-17T15:29:19.235472+0000","last_fullsized":"2023-05-17T15:29:19.235472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215187+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613361+0000","last_change":"2023-05-17T15:29:19.226407+0000","last_active":"2023-05-17T15:29:19.613361+0000","last_peered":"2023-05-17T15:29:19.613361+0000","last_clean":"2023-05-17T15:29:19.613361+0000","last_became_active":"2023-05-17T15:29:19.226135+0000","last_became_peered":"2023-05-17T15:29:19.226135+0000","last_unstale":"2023-05-17T15:29:19.613361+0000","last_undegraded":"2023-05-17T15:29:19.613361+0000","last_fullsized":"2023-05-17T15:29:19.613361+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613832+0000","last_change":"2023-05-17T15:29:19.606332+0000","last_active":"2023-05-17T15:29:19.613832+0000","last_peered":"2023-05-17T15:29:19.613832+0000","last_clean":"2023-05-17T15:29:19.613832+0000","last_became_active":"2023-05-17T15:29:19.605682+0000","last_became_peered":"2023-05-17T15:29:19.605682+0000","last_unstale":"2023-05-17T15:29:19.613832+0000","last_undegraded":"2023-05-17T15:29:19.613832+0000","last_fullsized":"2023-05-17T15:29:19.613832+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593193+0000","last_change":"2023-05-17T15:29:19.228189+0000","last_active":"2023-05-17T15:29:19.593193+0000","last_peered":"2023-05-17T15:29:19.593193+0000","last_clean":"2023-05-17T15:29:19.593193+0000","last_became_active":"2023-05-17T15:29:19.227924+0000","last_became_peered":"2023-05-17T15:29:19.227924+0000","last_unstale":"2023-05-17T15:29:19.593193+0000","last_undegraded":"2023-05-17T15:29:19.593193+0000","last_fullsized":"2023-05-17T15:29:19.593193+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618066+0000","last_change":"2023-05-17T15:29:19.617367+0000","last_active":"2023-05-17T15:29:19.618066+0000","last_peered":"2023-05-17T15:29:19.618066+0000","last_clean":"2023-05-17T15:29:19.618066+0000","last_became_active":"2023-05-17T15:29:19.617056+0000","last_became_peered":"2023-05-17T15:29:19.617056+0000","last_unstale":"2023-05-17T15:29:19.618066+0000","last_undegraded":"2023-05-17T15:29:19.618066+0000","last_fullsized":"2023-05-17T15:29:19.618066+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.591620+0000","last_change":"2023-05-17T15:29:19.224680+0000","last_active":"2023-05-17T15:29:19.591620+0000","last_peered":"2023-05-17T15:29:19.591620+0000","last_clean":"2023-05-17T15:29:19.591620+0000","last_became_active":"2023-05-17T15:29:19.224445+0000","last_became_peered":"2023-05-17T15:29:19.224445+0000","last_unstale":"2023-05-17T15:29:19.591620+0000","last_undegraded":"2023-05-17T15:29:19.591620+0000","last_fullsized":"2023-05-17T15:29:19.591620+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211554+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594748+0000","last_change":"2023-05-17T15:29:19.227068+0000","last_active":"2023-05-17T15:29:19.594748+0000","last_peered":"2023-05-17T15:29:19.594748+0000","last_clean":"2023-05-17T15:29:19.594748+0000","last_became_active":"2023-05-17T15:29:19.226527+0000","last_became_peered":"2023-05-17T15:29:19.226527+0000","last_unstale":"2023-05-17T15:29:19.594748+0000","last_undegraded":"2023-05-17T15:29:19.594748+0000","last_fullsized":"2023-05-17T15:29:19.594748+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.609569+0000","last_change":"2023-05-17T15:29:19.606095+0000","last_active":"2023-05-17T15:29:19.609569+0000","last_peered":"2023-05-17T15:29:19.609569+0000","last_clean":"2023-05-17T15:29:19.609569+0000","last_became_active":"2023-05-17T15:29:19.605533+0000","last_became_peered":"2023-05-17T15:29:19.605533+0000","last_unstale":"2023-05-17T15:29:19.609569+0000","last_undegraded":"2023-05-17T15:29:19.609569+0000","last_fullsized":"2023-05-17T15:29:19.609569+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.234553+0000","last_change":"2023-05-17T15:29:19.234553+0000","last_active":"2023-05-17T15:29:19.234553+0000","last_peered":"2023-05-17T15:29:19.234553+0000","last_clean":"2023-05-17T15:29:19.234553+0000","last_became_active":"2023-05-17T15:29:19.231624+0000","last_became_peered":"2023-05-17T15:29:19.231624+0000","last_unstale":"2023-05-17T15:29:19.234553+0000","last_undegraded":"2023-05-17T15:29:19.234553+0000","last_fullsized":"2023-05-17T15:29:19.234553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614209+0000","last_change":"2023-05-17T15:29:19.607259+0000","last_active":"2023-05-17T15:29:19.614209+0000","last_peered":"2023-05-17T15:29:19.614209+0000","last_clean":"2023-05-17T15:29:19.614209+0000","last_became_active":"2023-05-17T15:29:19.606988+0000","last_became_peered":"2023-05-17T15:29:19.606988+0000","last_unstale":"2023-05-17T15:29:19.614209+0000","last_undegraded":"2023-05-17T15:29:19.614209+0000","last_fullsized":"2023-05-17T15:29:19.614209+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592599+0000","last_change":"2023-05-17T15:29:19.225402+0000","last_active":"2023-05-17T15:29:19.592599+0000","last_peered":"2023-05-17T15:29:19.592599+0000","last_clean":"2023-05-17T15:29:19.592599+0000","last_became_active":"2023-05-17T15:29:19.225133+0000","last_became_peered":"2023-05-17T15:29:19.225133+0000","last_unstale":"2023-05-17T15:29:19.592599+0000","last_undegraded":"2023-05-17T15:29:19.592599+0000","last_fullsized":"2023-05-17T15:29:19.592599+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618026+0000","last_change":"2023-05-17T15:29:19.616630+0000","last_active":"2023-05-17T15:29:19.618026+0000","last_peered":"2023-05-17T15:29:19.618026+0000","last_clean":"2023-05-17T15:29:19.618026+0000","last_became_active":"2023-05-17T15:29:19.616398+0000","last_became_peered":"2023-05-17T15:29:19.616398+0000","last_unstale":"2023-05-17T15:29:19.618026+0000","last_undegraded":"2023-05-17T15:29:19.618026+0000","last_fullsized":"2023-05-17T15:29:19.618026+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235126+0000","last_change":"2023-05-17T15:29:19.235126+0000","last_active":"2023-05-17T15:29:19.235126+0000","last_peered":"2023-05-17T15:29:19.235126+0000","last_clean":"2023-05-17T15:29:19.235126+0000","last_became_active":"2023-05-17T15:29:19.234828+0000","last_became_peered":"2023-05-17T15:29:19.234828+0000","last_unstale":"2023-05-17T15:29:19.235126+0000","last_undegraded":"2023-05-17T15:29:19.235126+0000","last_fullsized":"2023-05-17T15:29:19.235126+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.612498+0000","last_change":"2023-05-17T15:29:19.608637+0000","last_active":"2023-05-17T15:29:19.612498+0000","last_peered":"2023-05-17T15:29:19.612498+0000","last_clean":"2023-05-17T15:29:19.612498+0000","last_became_active":"2023-05-17T15:29:19.607477+0000","last_became_peered":"2023-05-17T15:29:19.607477+0000","last_unstale":"2023-05-17T15:29:19.612498+0000","last_undegraded":"2023-05-17T15:29:19.612498+0000","last_fullsized":"2023-05-17T15:29:19.612498+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233128+0000","last_change":"2023-05-17T15:29:19.233128+0000","last_active":"2023-05-17T15:29:19.233128+0000","last_peered":"2023-05-17T15:29:19.233128+0000","last_clean":"2023-05-17T15:29:19.233128+0000","last_became_active":"2023-05-17T15:29:19.232840+0000","last_became_peered":"2023-05-17T15:29:19.232840+0000","last_unstale":"2023-05-17T15:29:19.233128+0000","last_undegraded":"2023-05-17T15:29:19.233128+0000","last_fullsized":"2023-05-17T15:29:19.233128+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.603880+0000","last_change":"2023-05-17T15:29:19.600600+0000","last_active":"2023-05-17T15:29:19.603880+0000","last_peered":"2023-05-17T15:29:19.603880+0000","last_clean":"2023-05-17T15:29:19.603880+0000","last_became_active":"2023-05-17T15:29:19.600022+0000","last_became_peered":"2023-05-17T15:29:19.600022+0000","last_unstale":"2023-05-17T15:29:19.603880+0000","last_undegraded":"2023-05-17T15:29:19.603880+0000","last_fullsized":"2023-05-17T15:29:19.603880+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232632+0000","last_change":"2023-05-17T15:29:19.232632+0000","last_active":"2023-05-17T15:29:19.232632+0000","last_peered":"2023-05-17T15:29:19.232632+0000","last_clean":"2023-05-17T15:29:19.232632+0000","last_became_active":"2023-05-17T15:29:19.232325+0000","last_became_peered":"2023-05-17T15:29:19.232325+0000","last_unstale":"2023-05-17T15:29:19.232632+0000","last_undegraded":"2023-05-17T15:29:19.232632+0000","last_fullsized":"2023-05-17T15:29:19.232632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209702+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.233692+0000","last_change":"2023-05-17T15:29:19.233692+0000","last_active":"2023-05-17T15:29:19.233692+0000","last_peered":"2023-05-17T15:29:19.233692+0000","last_clean":"2023-05-17T15:29:19.233692+0000","last_became_active":"2023-05-17T15:29:19.233389+0000","last_became_peered":"2023-05-17T15:29:19.233389+0000","last_unstale":"2023-05-17T15:29:19.233692+0000","last_undegraded":"2023-05-17T15:29:19.233692+0000","last_fullsized":"2023-05-17T15:29:19.233692+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615481+0000","last_change":"2023-05-17T15:29:19.612017+0000","last_active":"2023-05-17T15:29:19.615481+0000","last_peered":"2023-05-17T15:29:19.615481+0000","last_clean":"2023-05-17T15:29:19.615481+0000","last_became_active":"2023-05-17T15:29:19.610996+0000","last_became_peered":"2023-05-17T15:29:19.610996+0000","last_unstale":"2023-05-17T15:29:19.615481+0000","last_undegraded":"2023-05-17T15:29:19.615481+0000","last_fullsized":"2023-05-17T15:29:19.615481+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610599+0000","last_change":"2023-05-17T15:29:19.223496+0000","last_active":"2023-05-17T15:29:19.610599+0000","last_peered":"2023-05-17T15:29:19.610599+0000","last_clean":"2023-05-17T15:29:19.610599+0000","last_became_active":"2023-05-17T15:29:19.222935+0000","last_became_peered":"2023-05-17T15:29:19.222935+0000","last_unstale":"2023-05-17T15:29:19.610599+0000","last_undegraded":"2023-05-17T15:29:19.610599+0000","last_fullsized":"2023-05-17T15:29:19.610599+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608469+0000","last_change":"2023-05-17T15:29:19.605127+0000","last_active":"2023-05-17T15:29:19.608469+0000","last_peered":"2023-05-17T15:29:19.608469+0000","last_clean":"2023-05-17T15:29:19.608469+0000","last_became_active":"2023-05-17T15:29:19.604879+0000","last_became_peered":"2023-05-17T15:29:19.604879+0000","last_unstale":"2023-05-17T15:29:19.608469+0000","last_undegraded":"2023-05-17T15:29:19.608469+0000","last_fullsized":"2023-05-17T15:29:19.608469+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235837+0000","last_change":"2023-05-17T15:29:19.235837+0000","last_active":"2023-05-17T15:29:19.235837+0000","last_peered":"2023-05-17T15:29:19.235837+0000","last_clean":"2023-05-17T15:29:19.235837+0000","last_became_active":"2023-05-17T15:29:19.235271+0000","last_became_peered":"2023-05-17T15:29:19.235271+0000","last_unstale":"2023-05-17T15:29:19.235837+0000","last_undegraded":"2023-05-17T15:29:19.235837+0000","last_fullsized":"2023-05-17T15:29:19.235837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219225+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.218502+0000","last_change":"2023-05-17T15:29:19.218502+0000","last_active":"2023-05-17T15:29:19.218502+0000","last_peered":"2023-05-17T15:29:19.218502+0000","last_clean":"2023-05-17T15:29:19.218502+0000","last_became_active":"2023-05-17T15:29:19.218216+0000","last_became_peered":"2023-05-17T15:29:19.218216+0000","last_unstale":"2023-05-17T15:29:19.218502+0000","last_undegraded":"2023-05-17T15:29:19.218502+0000","last_fullsized":"2023-05-17T15:29:19.218502+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618201+0000","last_change":"2023-05-17T15:29:19.617058+0000","last_active":"2023-05-17T15:29:19.618201+0000","last_peered":"2023-05-17T15:29:19.618201+0000","last_clean":"2023-05-17T15:29:19.618201+0000","last_became_active":"2023-05-17T15:29:19.616755+0000","last_became_peered":"2023-05-17T15:29:19.616755+0000","last_unstale":"2023-05-17T15:29:19.618201+0000","last_undegraded":"2023-05-17T15:29:19.618201+0000","last_fullsized":"2023-05-17T15:29:19.618201+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.606433+0000","last_change":"2023-05-17T15:29:19.223022+0000","last_active":"2023-05-17T15:29:19.606433+0000","last_peered":"2023-05-17T15:29:19.606433+0000","last_clean":"2023-05-17T15:29:19.606433+0000","last_became_active":"2023-05-17T15:29:19.222747+0000","last_became_peered":"2023-05-17T15:29:19.222747+0000","last_unstale":"2023-05-17T15:29:19.606433+0000","last_undegraded":"2023-05-17T15:29:19.606433+0000","last_fullsized":"2023-05-17T15:29:19.606433+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.210321+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593846+0000","last_change":"2023-05-17T15:29:19.218399+0000","last_active":"2023-05-17T15:29:19.593846+0000","last_peered":"2023-05-17T15:29:19.593846+0000","last_clean":"2023-05-17T15:29:19.593846+0000","last_became_active":"2023-05-17T15:29:19.218004+0000","last_became_peered":"2023-05-17T15:29:19.218004+0000","last_unstale":"2023-05-17T15:29:19.593846+0000","last_undegraded":"2023-05-17T15:29:19.593846+0000","last_fullsized":"2023-05-17T15:29:19.593846+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616147+0000","last_change":"2023-05-17T15:29:19.614544+0000","last_active":"2023-05-17T15:29:19.616147+0000","last_peered":"2023-05-17T15:29:19.616147+0000","last_clean":"2023-05-17T15:29:19.616147+0000","last_became_active":"2023-05-17T15:29:19.614219+0000","last_became_peered":"2023-05-17T15:29:19.614219+0000","last_unstale":"2023-05-17T15:29:19.616147+0000","last_undegraded":"2023-05-17T15:29:19.616147+0000","last_fullsized":"2023-05-17T15:29:19.616147+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231041+0000","last_change":"2023-05-17T15:29:19.231041+0000","last_active":"2023-05-17T15:29:19.231041+0000","last_peered":"2023-05-17T15:29:19.231041+0000","last_clean":"2023-05-17T15:29:19.231041+0000","last_became_active":"2023-05-17T15:29:19.230710+0000","last_became_peered":"2023-05-17T15:29:19.230710+0000","last_unstale":"2023-05-17T15:29:19.231041+0000","last_undegraded":"2023-05-17T15:29:19.231041+0000","last_fullsized":"2023-05-17T15:29:19.231041+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.219713+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226559+0000","last_change":"2023-05-17T15:29:19.226559+0000","last_active":"2023-05-17T15:29:19.226559+0000","last_peered":"2023-05-17T15:29:19.226559+0000","last_clean":"2023-05-17T15:29:19.226559+0000","last_became_active":"2023-05-17T15:29:19.225699+0000","last_became_peered":"2023-05-17T15:29:19.225699+0000","last_unstale":"2023-05-17T15:29:19.226559+0000","last_undegraded":"2023-05-17T15:29:19.226559+0000","last_fullsized":"2023-05-17T15:29:19.226559+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216511+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223102+0000","last_change":"2023-05-17T15:29:19.223102+0000","last_active":"2023-05-17T15:29:19.223102+0000","last_peered":"2023-05-17T15:29:19.223102+0000","last_clean":"2023-05-17T15:29:19.223102+0000","last_became_active":"2023-05-17T15:29:19.222837+0000","last_became_peered":"2023-05-17T15:29:19.222837+0000","last_unstale":"2023-05-17T15:29:19.223102+0000","last_undegraded":"2023-05-17T15:29:19.223102+0000","last_fullsized":"2023-05-17T15:29:19.223102+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615536+0000","last_change":"2023-05-17T15:29:19.612491+0000","last_active":"2023-05-17T15:29:19.615536+0000","last_peered":"2023-05-17T15:29:19.615536+0000","last_clean":"2023-05-17T15:29:19.615536+0000","last_became_active":"2023-05-17T15:29:19.611358+0000","last_became_peered":"2023-05-17T15:29:19.611358+0000","last_unstale":"2023-05-17T15:29:19.615536+0000","last_undegraded":"2023-05-17T15:29:19.615536+0000","last_fullsized":"2023-05-17T15:29:19.615536+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236154+0000","last_change":"2023-05-17T15:29:19.236154+0000","last_active":"2023-05-17T15:29:19.236154+0000","last_peered":"2023-05-17T15:29:19.236154+0000","last_clean":"2023-05-17T15:29:19.236154+0000","last_became_active":"2023-05-17T15:29:19.235132+0000","last_became_peered":"2023-05-17T15:29:19.235132+0000","last_unstale":"2023-05-17T15:29:19.236154+0000","last_undegraded":"2023-05-17T15:29:19.236154+0000","last_fullsized":"2023-05-17T15:29:19.236154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611605+0000","last_change":"2023-05-17T15:29:19.608974+0000","last_active":"2023-05-17T15:29:19.611605+0000","last_peered":"2023-05-17T15:29:19.611605+0000","last_clean":"2023-05-17T15:29:19.611605+0000","last_became_active":"2023-05-17T15:29:19.608651+0000","last_became_peered":"2023-05-17T15:29:19.608651+0000","last_unstale":"2023-05-17T15:29:19.611605+0000","last_undegraded":"2023-05-17T15:29:19.611605+0000","last_fullsized":"2023-05-17T15:29:19.611605+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.591551+0000","last_change":"2023-05-17T15:29:19.225105+0000","last_active":"2023-05-17T15:29:19.591551+0000","last_peered":"2023-05-17T15:29:19.591551+0000","last_clean":"2023-05-17T15:29:19.591551+0000","last_became_active":"2023-05-17T15:29:19.224787+0000","last_became_peered":"2023-05-17T15:29:19.224787+0000","last_unstale":"2023-05-17T15:29:19.591551+0000","last_undegraded":"2023-05-17T15:29:19.591551+0000","last_fullsized":"2023-05-17T15:29:19.591551+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621368+0000","last_change":"2023-05-17T15:29:19.619338+0000","last_active":"2023-05-17T15:29:19.621368+0000","last_peered":"2023-05-17T15:29:19.621368+0000","last_clean":"2023-05-17T15:29:19.621368+0000","last_became_active":"2023-05-17T15:29:19.619067+0000","last_became_peered":"2023-05-17T15:29:19.619067+0000","last_unstale":"2023-05-17T15:29:19.621368+0000","last_undegraded":"2023-05-17T15:29:19.621368+0000","last_fullsized":"2023-05-17T15:29:19.621368+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:20.008901+0000","last_change":"2023-05-17T15:29:19.224828+0000","last_active":"2023-05-17T15:29:20.008901+0000","last_peered":"2023-05-17T15:29:20.008901+0000","last_clean":"2023-05-17T15:29:20.008901+0000","last_became_active":"2023-05-17T15:29:19.224459+0000","last_became_peered":"2023-05-17T15:29:19.224459+0000","last_unstale":"2023-05-17T15:29:20.008901+0000","last_undegraded":"2023-05-17T15:29:20.008901+0000","last_fullsized":"2023-05-17T15:29:20.008901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.221275+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594928+0000","last_change":"2023-05-17T15:29:19.219162+0000","last_active":"2023-05-17T15:29:19.594928+0000","last_peered":"2023-05-17T15:29:19.594928+0000","last_clean":"2023-05-17T15:29:19.594928+0000","last_became_active":"2023-05-17T15:29:19.217976+0000","last_became_peered":"2023-05-17T15:29:19.217976+0000","last_unstale":"2023-05-17T15:29:19.594928+0000","last_undegraded":"2023-05-17T15:29:19.594928+0000","last_fullsized":"2023-05-17T15:29:19.594928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217845+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594193+0000","last_change":"2023-05-17T15:29:19.226882+0000","last_active":"2023-05-17T15:29:19.594193+0000","last_peered":"2023-05-17T15:29:19.594193+0000","last_clean":"2023-05-17T15:29:19.594193+0000","last_became_active":"2023-05-17T15:29:19.226602+0000","last_became_peered":"2023-05-17T15:29:19.226602+0000","last_unstale":"2023-05-17T15:29:19.594193+0000","last_undegraded":"2023-05-17T15:29:19.594193+0000","last_fullsized":"2023-05-17T15:29:19.594193+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217088+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592269+0000","last_change":"2023-05-17T15:29:19.227477+0000","last_active":"2023-05-17T15:29:19.592269+0000","last_peered":"2023-05-17T15:29:19.592269+0000","last_clean":"2023-05-17T15:29:19.592269+0000","last_became_active":"2023-05-17T15:29:19.227181+0000","last_became_peered":"2023-05-17T15:29:19.227181+0000","last_unstale":"2023-05-17T15:29:19.592269+0000","last_undegraded":"2023-05-17T15:29:19.592269+0000","last_fullsized":"2023-05-17T15:29:19.592269+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614635+0000","last_change":"2023-05-17T15:29:19.609756+0000","last_active":"2023-05-17T15:29:19.614635+0000","last_peered":"2023-05-17T15:29:19.614635+0000","last_clean":"2023-05-17T15:29:19.614635+0000","last_became_active":"2023-05-17T15:29:19.607402+0000","last_became_peered":"2023-05-17T15:29:19.607402+0000","last_unstale":"2023-05-17T15:29:19.614635+0000","last_undegraded":"2023-05-17T15:29:19.614635+0000","last_fullsized":"2023-05-17T15:29:19.614635+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.226062+0000","last_change":"2023-05-17T15:29:19.226062+0000","last_active":"2023-05-17T15:29:19.226062+0000","last_peered":"2023-05-17T15:29:19.226062+0000","last_clean":"2023-05-17T15:29:19.226062+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.226062+0000","last_undegraded":"2023-05-17T15:29:19.226062+0000","last_fullsized":"2023-05-17T15:29:19.226062+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615677+0000","last_change":"2023-05-17T15:29:19.613036+0000","last_active":"2023-05-17T15:29:19.615677+0000","last_peered":"2023-05-17T15:29:19.615677+0000","last_clean":"2023-05-17T15:29:19.615677+0000","last_became_active":"2023-05-17T15:29:19.612715+0000","last_became_peered":"2023-05-17T15:29:19.612715+0000","last_unstale":"2023-05-17T15:29:19.615677+0000","last_undegraded":"2023-05-17T15:29:19.615677+0000","last_fullsized":"2023-05-17T15:29:19.615677+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599108+0000","last_change":"2023-05-17T15:29:19.223810+0000","last_active":"2023-05-17T15:29:19.599108+0000","last_peered":"2023-05-17T15:29:19.599108+0000","last_clean":"2023-05-17T15:29:19.599108+0000","last_became_active":"2023-05-17T15:29:19.223511+0000","last_became_peered":"2023-05-17T15:29:19.223511+0000","last_unstale":"2023-05-17T15:29:19.599108+0000","last_undegraded":"2023-05-17T15:29:19.599108+0000","last_fullsized":"2023-05-17T15:29:19.599108+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217649+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.591818+0000","last_change":"2023-05-17T15:29:19.227154+0000","last_active":"2023-05-17T15:29:19.591818+0000","last_peered":"2023-05-17T15:29:19.591818+0000","last_clean":"2023-05-17T15:29:19.591818+0000","last_became_active":"2023-05-17T15:29:19.226876+0000","last_became_peered":"2023-05-17T15:29:19.226876+0000","last_unstale":"2023-05-17T15:29:19.591818+0000","last_undegraded":"2023-05-17T15:29:19.591818+0000","last_fullsized":"2023-05-17T15:29:19.591818+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614085+0000","last_change":"2023-05-17T15:29:19.611070+0000","last_active":"2023-05-17T15:29:19.614085+0000","last_peered":"2023-05-17T15:29:19.614085+0000","last_clean":"2023-05-17T15:29:19.614085+0000","last_became_active":"2023-05-17T15:29:19.610809+0000","last_became_peered":"2023-05-17T15:29:19.610809+0000","last_unstale":"2023-05-17T15:29:19.614085+0000","last_undegraded":"2023-05-17T15:29:19.614085+0000","last_fullsized":"2023-05-17T15:29:19.614085+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.607461+0000","last_change":"2023-05-17T15:29:19.216411+0000","last_active":"2023-05-17T15:29:19.607461+0000","last_peered":"2023-05-17T15:29:19.607461+0000","last_clean":"2023-05-17T15:29:19.607461+0000","last_became_active":"2023-05-17T15:29:19.216065+0000","last_became_peered":"2023-05-17T15:29:19.216065+0000","last_unstale":"2023-05-17T15:29:19.607461+0000","last_undegraded":"2023-05-17T15:29:19.607461+0000","last_fullsized":"2023-05-17T15:29:19.607461+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613208+0000","last_change":"2023-05-17T15:29:19.610598+0000","last_active":"2023-05-17T15:29:19.613208+0000","last_peered":"2023-05-17T15:29:19.613208+0000","last_clean":"2023-05-17T15:29:19.613208+0000","last_became_active":"2023-05-17T15:29:19.610295+0000","last_became_peered":"2023-05-17T15:29:19.610295+0000","last_unstale":"2023-05-17T15:29:19.613208+0000","last_undegraded":"2023-05-17T15:29:19.613208+0000","last_fullsized":"2023-05-17T15:29:19.613208+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236893+0000","last_change":"2023-05-17T15:29:19.236893+0000","last_active":"2023-05-17T15:29:19.236893+0000","last_peered":"2023-05-17T15:29:19.236893+0000","last_clean":"2023-05-17T15:29:19.236893+0000","last_became_active":"2023-05-17T15:29:19.236609+0000","last_became_peered":"2023-05-17T15:29:19.236609+0000","last_unstale":"2023-05-17T15:29:19.236893+0000","last_undegraded":"2023-05-17T15:29:19.236893+0000","last_fullsized":"2023-05-17T15:29:19.236893+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.214211+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.236874+0000","last_change":"2023-05-17T15:29:19.236874+0000","last_active":"2023-05-17T15:29:19.236874+0000","last_peered":"2023-05-17T15:29:19.236874+0000","last_clean":"2023-05-17T15:29:19.236874+0000","last_became_active":"2023-05-17T15:29:19.236507+0000","last_became_peered":"2023-05-17T15:29:19.236507+0000","last_unstale":"2023-05-17T15:29:19.236874+0000","last_undegraded":"2023-05-17T15:29:19.236874+0000","last_fullsized":"2023-05-17T15:29:19.236874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.222536+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592721+0000","last_change":"2023-05-17T15:29:19.228664+0000","last_active":"2023-05-17T15:29:19.592721+0000","last_peered":"2023-05-17T15:29:19.592721+0000","last_clean":"2023-05-17T15:29:19.592721+0000","last_became_active":"2023-05-17T15:29:19.228391+0000","last_became_peered":"2023-05-17T15:29:19.228391+0000","last_unstale":"2023-05-17T15:29:19.592721+0000","last_undegraded":"2023-05-17T15:29:19.592721+0000","last_fullsized":"2023-05-17T15:29:19.592721+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614022+0000","last_change":"2023-05-17T15:29:19.610413+0000","last_active":"2023-05-17T15:29:19.614022+0000","last_peered":"2023-05-17T15:29:19.614022+0000","last_clean":"2023-05-17T15:29:19.614022+0000","last_became_active":"2023-05-17T15:29:19.610136+0000","last_became_peered":"2023-05-17T15:29:19.610136+0000","last_unstale":"2023-05-17T15:29:19.614022+0000","last_undegraded":"2023-05-17T15:29:19.614022+0000","last_fullsized":"2023-05-17T15:29:19.614022+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.232621+0000","last_change":"2023-05-17T15:29:19.232621+0000","last_active":"2023-05-17T15:29:19.232621+0000","last_peered":"2023-05-17T15:29:19.232621+0000","last_clean":"2023-05-17T15:29:19.232621+0000","last_became_active":"2023-05-17T15:29:19.232307+0000","last_became_peered":"2023-05-17T15:29:19.232307+0000","last_unstale":"2023-05-17T15:29:19.232621+0000","last_undegraded":"2023-05-17T15:29:19.232621+0000","last_fullsized":"2023-05-17T15:29:19.232621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.212329+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592906+0000","last_change":"2023-05-17T15:29:19.228906+0000","last_active":"2023-05-17T15:29:19.592906+0000","last_peered":"2023-05-17T15:29:19.592906+0000","last_clean":"2023-05-17T15:29:19.592906+0000","last_became_active":"2023-05-17T15:29:19.228614+0000","last_became_peered":"2023-05-17T15:29:19.228614+0000","last_unstale":"2023-05-17T15:29:19.592906+0000","last_undegraded":"2023-05-17T15:29:19.592906+0000","last_fullsized":"2023-05-17T15:29:19.592906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.609509+0000","last_change":"2023-05-17T15:29:19.605329+0000","last_active":"2023-05-17T15:29:19.609509+0000","last_peered":"2023-05-17T15:29:19.609509+0000","last_clean":"2023-05-17T15:29:19.609509+0000","last_became_active":"2023-05-17T15:29:19.605078+0000","last_became_peered":"2023-05-17T15:29:19.605078+0000","last_unstale":"2023-05-17T15:29:19.609509+0000","last_undegraded":"2023-05-17T15:29:19.609509+0000","last_fullsized":"2023-05-17T15:29:19.609509+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227011+0000","last_change":"2023-05-17T15:29:19.227011+0000","last_active":"2023-05-17T15:29:19.227011+0000","last_peered":"2023-05-17T15:29:19.227011+0000","last_clean":"2023-05-17T15:29:19.227011+0000","last_became_active":"2023-05-17T15:29:19.225640+0000","last_became_peered":"2023-05-17T15:29:19.225640+0000","last_unstale":"2023-05-17T15:29:19.227011+0000","last_undegraded":"2023-05-17T15:29:19.227011+0000","last_fullsized":"2023-05-17T15:29:19.227011+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218161+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599354+0000","last_change":"2023-05-17T15:29:19.224151+0000","last_active":"2023-05-17T15:29:19.599354+0000","last_peered":"2023-05-17T15:29:19.599354+0000","last_clean":"2023-05-17T15:29:19.599354+0000","last_became_active":"2023-05-17T15:29:19.223868+0000","last_became_peered":"2023-05-17T15:29:19.223868+0000","last_unstale":"2023-05-17T15:29:19.599354+0000","last_undegraded":"2023-05-17T15:29:19.599354+0000","last_fullsized":"2023-05-17T15:29:19.599354+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.220066+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616393+0000","last_change":"2023-05-17T15:29:19.227419+0000","last_active":"2023-05-17T15:29:19.616393+0000","last_peered":"2023-05-17T15:29:19.616393+0000","last_clean":"2023-05-17T15:29:19.616393+0000","last_became_active":"2023-05-17T15:29:19.227004+0000","last_became_peered":"2023-05-17T15:29:19.227004+0000","last_unstale":"2023-05-17T15:29:19.616393+0000","last_undegraded":"2023-05-17T15:29:19.616393+0000","last_fullsized":"2023-05-17T15:29:19.616393+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.224798+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.227367+0000","last_change":"2023-05-17T15:29:19.227367+0000","last_active":"2023-05-17T15:29:19.227367+0000","last_peered":"2023-05-17T15:29:19.227367+0000","last_clean":"2023-05-17T15:29:19.227367+0000","last_became_active":"2023-05-17T15:29:19.227029+0000","last_became_peered":"2023-05-17T15:29:19.227029+0000","last_unstale":"2023-05-17T15:29:19.227367+0000","last_undegraded":"2023-05-17T15:29:19.227367+0000","last_fullsized":"2023-05-17T15:29:19.227367+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217807+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592834+0000","last_change":"2023-05-17T15:29:19.226649+0000","last_active":"2023-05-17T15:29:19.592834+0000","last_peered":"2023-05-17T15:29:19.592834+0000","last_clean":"2023-05-17T15:29:19.592834+0000","last_became_active":"2023-05-17T15:29:19.225847+0000","last_became_peered":"2023-05-17T15:29:19.225847+0000","last_unstale":"2023-05-17T15:29:19.592834+0000","last_undegraded":"2023-05-17T15:29:19.592834+0000","last_fullsized":"2023-05-17T15:29:19.592834+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217408+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225240+0000","last_change":"2023-05-17T15:29:19.225240+0000","last_active":"2023-05-17T15:29:19.225240+0000","last_peered":"2023-05-17T15:29:19.225240+0000","last_clean":"2023-05-17T15:29:19.225240+0000","last_became_active":"2023-05-17T15:29:19.224910+0000","last_became_peered":"2023-05-17T15:29:19.224910+0000","last_unstale":"2023-05-17T15:29:19.225240+0000","last_undegraded":"2023-05-17T15:29:19.225240+0000","last_fullsized":"2023-05-17T15:29:19.225240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.226366+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.606950+0000","last_change":"2023-05-17T15:29:19.225479+0000","last_active":"2023-05-17T15:29:19.606950+0000","last_peered":"2023-05-17T15:29:19.606950+0000","last_clean":"2023-05-17T15:29:19.606950+0000","last_became_active":"2023-05-17T15:29:19.225162+0000","last_became_peered":"2023-05-17T15:29:19.225162+0000","last_unstale":"2023-05-17T15:29:19.606950+0000","last_undegraded":"2023-05-17T15:29:19.606950+0000","last_fullsized":"2023-05-17T15:29:19.606950+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.603901+0000","last_change":"2023-05-17T15:29:19.601732+0000","last_active":"2023-05-17T15:29:19.603901+0000","last_peered":"2023-05-17T15:29:19.603901+0000","last_clean":"2023-05-17T15:29:19.603901+0000","last_became_active":"2023-05-17T15:29:19.601468+0000","last_became_peered":"2023-05-17T15:29:19.601468+0000","last_unstale":"2023-05-17T15:29:19.603901+0000","last_undegraded":"2023-05-17T15:29:19.603901+0000","last_fullsized":"2023-05-17T15:29:19.603901+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225875+0000","last_change":"2023-05-17T15:29:19.225875+0000","last_active":"2023-05-17T15:29:19.225875+0000","last_peered":"2023-05-17T15:29:19.225875+0000","last_clean":"2023-05-17T15:29:19.225875+0000","last_became_active":"2023-05-17T15:29:19.225389+0000","last_became_peered":"2023-05-17T15:29:19.225389+0000","last_unstale":"2023-05-17T15:29:19.225875+0000","last_undegraded":"2023-05-17T15:29:19.225875+0000","last_fullsized":"2023-05-17T15:29:19.225875+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.223039+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593292+0000","last_change":"2023-05-17T15:29:19.228139+0000","last_active":"2023-05-17T15:29:19.593292+0000","last_peered":"2023-05-17T15:29:19.593292+0000","last_clean":"2023-05-17T15:29:19.593292+0000","last_became_active":"2023-05-17T15:29:19.227706+0000","last_became_peered":"2023-05-17T15:29:19.227706+0000","last_unstale":"2023-05-17T15:29:19.593292+0000","last_undegraded":"2023-05-17T15:29:19.593292+0000","last_fullsized":"2023-05-17T15:29:19.593292+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.604435+0000","last_change":"2023-05-17T15:29:19.601075+0000","last_active":"2023-05-17T15:29:19.604435+0000","last_peered":"2023-05-17T15:29:19.604435+0000","last_clean":"2023-05-17T15:29:19.604435+0000","last_became_active":"2023-05-17T15:29:19.600811+0000","last_became_peered":"2023-05-17T15:29:19.600811+0000","last_unstale":"2023-05-17T15:29:19.604435+0000","last_undegraded":"2023-05-17T15:29:19.604435+0000","last_fullsized":"2023-05-17T15:29:19.604435+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.224407+0000","last_change":"2023-05-17T15:29:19.224407+0000","last_active":"2023-05-17T15:29:19.224407+0000","last_peered":"2023-05-17T15:29:19.224407+0000","last_clean":"2023-05-17T15:29:19.224407+0000","last_became_active":"2023-05-17T15:29:19.224060+0000","last_became_peered":"2023-05-17T15:29:19.224060+0000","last_unstale":"2023-05-17T15:29:19.224407+0000","last_undegraded":"2023-05-17T15:29:19.224407+0000","last_fullsized":"2023-05-17T15:29:19.224407+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.617782+0000","last_change":"2023-05-17T15:29:19.614510+0000","last_active":"2023-05-17T15:29:19.617782+0000","last_peered":"2023-05-17T15:29:19.617782+0000","last_clean":"2023-05-17T15:29:19.617782+0000","last_became_active":"2023-05-17T15:29:19.614199+0000","last_became_peered":"2023-05-17T15:29:19.614199+0000","last_unstale":"2023-05-17T15:29:19.617782+0000","last_undegraded":"2023-05-17T15:29:19.617782+0000","last_fullsized":"2023-05-17T15:29:19.617782+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.223726+0000","last_change":"2023-05-17T15:29:19.223726+0000","last_active":"2023-05-17T15:29:19.223726+0000","last_peered":"2023-05-17T15:29:19.223726+0000","last_clean":"2023-05-17T15:29:19.223726+0000","last_became_active":"2023-05-17T15:29:19.223436+0000","last_became_peered":"2023-05-17T15:29:19.223436+0000","last_unstale":"2023-05-17T15:29:19.223726+0000","last_undegraded":"2023-05-17T15:29:19.223726+0000","last_fullsized":"2023-05-17T15:29:19.223726+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.209903+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231442+0000","last_change":"2023-05-17T15:29:19.231442+0000","last_active":"2023-05-17T15:29:19.231442+0000","last_peered":"2023-05-17T15:29:19.231442+0000","last_clean":"2023-05-17T15:29:19.231442+0000","last_became_active":"2023-05-17T15:29:19.231112+0000","last_became_peered":"2023-05-17T15:29:19.231112+0000","last_unstale":"2023-05-17T15:29:19.231442+0000","last_undegraded":"2023-05-17T15:29:19.231442+0000","last_fullsized":"2023-05-17T15:29:19.231442+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216606+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592935+0000","last_change":"2023-05-17T15:29:19.229267+0000","last_active":"2023-05-17T15:29:19.592935+0000","last_peered":"2023-05-17T15:29:19.592935+0000","last_clean":"2023-05-17T15:29:19.592935+0000","last_became_active":"2023-05-17T15:29:19.228233+0000","last_became_peered":"2023-05-17T15:29:19.228233+0000","last_unstale":"2023-05-17T15:29:19.592935+0000","last_undegraded":"2023-05-17T15:29:19.592935+0000","last_fullsized":"2023-05-17T15:29:19.592935+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615731+0000","last_change":"2023-05-17T15:29:19.613734+0000","last_active":"2023-05-17T15:29:19.615731+0000","last_peered":"2023-05-17T15:29:19.615731+0000","last_clean":"2023-05-17T15:29:19.615731+0000","last_became_active":"2023-05-17T15:29:19.611614+0000","last_became_peered":"2023-05-17T15:29:19.611614+0000","last_unstale":"2023-05-17T15:29:19.615731+0000","last_undegraded":"2023-05-17T15:29:19.615731+0000","last_fullsized":"2023-05-17T15:29:19.615731+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599844+0000","last_change":"2023-05-17T15:29:19.225497+0000","last_active":"2023-05-17T15:29:19.599844+0000","last_peered":"2023-05-17T15:29:19.599844+0000","last_clean":"2023-05-17T15:29:19.599844+0000","last_became_active":"2023-05-17T15:29:19.225214+0000","last_became_peered":"2023-05-17T15:29:19.225214+0000","last_unstale":"2023-05-17T15:29:19.599844+0000","last_undegraded":"2023-05-17T15:29:19.599844+0000","last_fullsized":"2023-05-17T15:29:19.599844+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.218487+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228812+0000","last_change":"2023-05-17T15:29:19.228812+0000","last_active":"2023-05-17T15:29:19.228812+0000","last_peered":"2023-05-17T15:29:19.228812+0000","last_clean":"2023-05-17T15:29:19.228812+0000","last_became_active":"2023-05-17T15:29:19.228540+0000","last_became_peered":"2023-05-17T15:29:19.228540+0000","last_unstale":"2023-05-17T15:29:19.228812+0000","last_undegraded":"2023-05-17T15:29:19.228812+0000","last_fullsized":"2023-05-17T15:29:19.228812+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.211806+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594217+0000","last_change":"2023-05-17T15:29:19.230855+0000","last_active":"2023-05-17T15:29:19.594217+0000","last_peered":"2023-05-17T15:29:19.594217+0000","last_clean":"2023-05-17T15:29:19.594217+0000","last_became_active":"2023-05-17T15:29:19.228960+0000","last_became_peered":"2023-05-17T15:29:19.228960+0000","last_unstale":"2023-05-17T15:29:19.594217+0000","last_undegraded":"2023-05-17T15:29:19.594217+0000","last_fullsized":"2023-05-17T15:29:19.594217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608305+0000","last_change":"2023-05-17T15:29:19.604180+0000","last_active":"2023-05-17T15:29:19.608305+0000","last_peered":"2023-05-17T15:29:19.608305+0000","last_clean":"2023-05-17T15:29:19.608305+0000","last_became_active":"2023-05-17T15:29:19.603916+0000","last_became_peered":"2023-05-17T15:29:19.603916+0000","last_unstale":"2023-05-17T15:29:19.608305+0000","last_undegraded":"2023-05-17T15:29:19.608305+0000","last_fullsized":"2023-05-17T15:29:19.608305+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.221496+0000","last_change":"2023-05-17T15:29:19.221496+0000","last_active":"2023-05-17T15:29:19.221496+0000","last_peered":"2023-05-17T15:29:19.221496+0000","last_clean":"2023-05-17T15:29:19.221496+0000","last_became_active":"2023-05-17T15:29:19.221198+0000","last_became_peered":"2023-05-17T15:29:19.221198+0000","last_unstale":"2023-05-17T15:29:19.221496+0000","last_undegraded":"2023-05-17T15:29:19.221496+0000","last_fullsized":"2023-05-17T15:29:19.221496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.217242+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235317+0000","last_change":"2023-05-17T15:29:19.235317+0000","last_active":"2023-05-17T15:29:19.235317+0000","last_peered":"2023-05-17T15:29:19.235317+0000","last_clean":"2023-05-17T15:29:19.235317+0000","last_became_active":"2023-05-17T15:29:19.235022+0000","last_became_peered":"2023-05-17T15:29:19.235022+0000","last_unstale":"2023-05-17T15:29:19.235317+0000","last_undegraded":"2023-05-17T15:29:19.235317+0000","last_fullsized":"2023-05-17T15:29:19.235317+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216672+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610098+0000","last_change":"2023-05-17T15:29:19.216276+0000","last_active":"2023-05-17T15:29:19.610098+0000","last_peered":"2023-05-17T15:29:19.610098+0000","last_clean":"2023-05-17T15:29:19.610098+0000","last_became_active":"2023-05-17T15:29:19.215939+0000","last_became_peered":"2023-05-17T15:29:19.215939+0000","last_unstale":"2023-05-17T15:29:19.610098+0000","last_undegraded":"2023-05-17T15:29:19.610098+0000","last_fullsized":"2023-05-17T15:29:19.610098+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592762+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:19.592762+0000","last_peered":"2023-05-17T15:29:19.592762+0000","last_clean":"2023-05-17T15:29:19.592762+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:19.592762+0000","last_undegraded":"2023-05-17T15:29:19.592762+0000","last_fullsized":"2023-05-17T15:29:19.592762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618222+0000","last_change":"2023-05-17T15:29:19.617119+0000","last_active":"2023-05-17T15:29:19.618222+0000","last_peered":"2023-05-17T15:29:19.618222+0000","last_clean":"2023-05-17T15:29:19.618222+0000","last_became_active":"2023-05-17T15:29:19.616650+0000","last_became_peered":"2023-05-17T15:29:19.616650+0000","last_unstale":"2023-05-17T15:29:19.618222+0000","last_undegraded":"2023-05-17T15:29:19.618222+0000","last_fullsized":"2023-05-17T15:29:19.618222+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608683+0000","last_change":"2023-05-17T15:29:19.213012+0000","last_active":"2023-05-17T15:29:19.608683+0000","last_peered":"2023-05-17T15:29:19.608683+0000","last_clean":"2023-05-17T15:29:19.608683+0000","last_became_active":"2023-05-17T15:29:19.212738+0000","last_became_peered":"2023-05-17T15:29:19.212738+0000","last_unstale":"2023-05-17T15:29:19.608683+0000","last_undegraded":"2023-05-17T15:29:19.608683+0000","last_fullsized":"2023-05-17T15:29:19.608683+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213738+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:18.213738+0000","last_peered":"2023-05-17T15:29:18.213738+0000","last_clean":"2023-05-17T15:29:18.213738+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:18.213738+0000","last_undegraded":"2023-05-17T15:29:18.213738+0000","last_fullsized":"2023-05-17T15:29:18.213738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621482+0000","last_change":"2023-05-17T15:29:19.618654+0000","last_active":"2023-05-17T15:29:19.621482+0000","last_peered":"2023-05-17T15:29:19.621482+0000","last_clean":"2023-05-17T15:29:19.621482+0000","last_became_active":"2023-05-17T15:29:19.618440+0000","last_became_peered":"2023-05-17T15:29:19.618440+0000","last_unstale":"2023-05-17T15:29:19.621482+0000","last_undegraded":"2023-05-17T15:29:19.621482+0000","last_fullsized":"2023-05-17T15:29:19.621482+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.225010+0000","last_change":"2023-05-17T15:29:19.225010+0000","last_active":"2023-05-17T15:29:19.225010+0000","last_peered":"2023-05-17T15:29:19.225010+0000","last_clean":"2023-05-17T15:29:19.225010+0000","last_became_active":"2023-05-17T15:29:19.224310+0000","last_became_peered":"2023-05-17T15:29:19.224310+0000","last_unstale":"2023-05-17T15:29:19.225010+0000","last_undegraded":"2023-05-17T15:29:19.225010+0000","last_fullsized":"2023-05-17T15:29:19.225010+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592186+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:19.592186+0000","last_peered":"2023-05-17T15:29:19.592186+0000","last_clean":"2023-05-17T15:29:19.592186+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:19.592186+0000","last_undegraded":"2023-05-17T15:29:19.592186+0000","last_fullsized":"2023-05-17T15:29:19.592186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.215097+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.607270+0000","last_change":"2023-05-17T15:29:19.226296+0000","last_active":"2023-05-17T15:29:19.607270+0000","last_peered":"2023-05-17T15:29:19.607270+0000","last_clean":"2023-05-17T15:29:19.607270+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.607270+0000","last_undegraded":"2023-05-17T15:29:19.607270+0000","last_fullsized":"2023-05-17T15:29:19.607270+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.213984+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:18.213984+0000","last_peered":"2023-05-17T15:29:18.213984+0000","last_clean":"2023-05-17T15:29:18.213984+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:18.213984+0000","last_undegraded":"2023-05-17T15:29:18.213984+0000","last_fullsized":"2023-05-17T15:29:18.213984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207635+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:18.207635+0000","last_peered":"2023-05-17T15:29:18.207635+0000","last_clean":"2023-05-17T15:29:18.207635+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:18.207635+0000","last_undegraded":"2023-05-17T15:29:18.207635+0000","last_fullsized":"2023-05-17T15:29:18.207635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-17T15:29:19.198069+0000","last_change":"2023-05-17T15:29:19.216482+0000","last_active":"2023-05-17T15:29:19.198069+0000","last_peered":"2023-05-17T15:29:19.198069+0000","last_clean":"2023-05-17T15:29:19.198069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-17T15:29:19.198069+0000","last_undegraded":"2023-05-17T15:29:19.198069+0000","last_fullsized":"2023-05-17T15:29:19.198069+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.235573+0000","last_change":"2023-05-17T15:29:19.235573+0000","last_active":"2023-05-17T15:29:19.235573+0000","last_peered":"2023-05-17T15:29:19.235573+0000","last_clean":"2023-05-17T15:29:19.235573+0000","last_became_active":"2023-05-17T15:29:19.231571+0000","last_became_peered":"2023-05-17T15:29:19.231571+0000","last_unstale":"2023-05-17T15:29:19.235573+0000","last_undegraded":"2023-05-17T15:29:19.235573+0000","last_fullsized":"2023-05-17T15:29:19.235573+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207654+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:18.207654+0000","last_peered":"2023-05-17T15:29:18.207654+0000","last_clean":"2023-05-17T15:29:18.207654+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:18.207654+0000","last_undegraded":"2023-05-17T15:29:18.207654+0000","last_fullsized":"2023-05-17T15:29:18.207654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615038+0000","last_change":"2023-05-17T15:29:19.613036+0000","last_active":"2023-05-17T15:29:19.615038+0000","last_peered":"2023-05-17T15:29:19.615038+0000","last_clean":"2023-05-17T15:29:19.615038+0000","last_became_active":"2023-05-17T15:29:19.612762+0000","last_became_peered":"2023-05-17T15:29:19.612762+0000","last_unstale":"2023-05-17T15:29:19.615038+0000","last_undegraded":"2023-05-17T15:29:19.615038+0000","last_fullsized":"2023-05-17T15:29:19.615038+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.228646+0000","last_change":"2023-05-17T15:29:19.228646+0000","last_active":"2023-05-17T15:29:19.228646+0000","last_peered":"2023-05-17T15:29:19.228646+0000","last_clean":"2023-05-17T15:29:19.228646+0000","last_became_active":"2023-05-17T15:29:19.228343+0000","last_became_peered":"2023-05-17T15:29:19.228343+0000","last_unstale":"2023-05-17T15:29:19.228646+0000","last_undegraded":"2023-05-17T15:29:19.228646+0000","last_fullsized":"2023-05-17T15:29:19.228646+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.207933+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:18.207933+0000","last_peered":"2023-05-17T15:29:18.207933+0000","last_clean":"2023-05-17T15:29:18.207933+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:18.207933+0000","last_undegraded":"2023-05-17T15:29:18.207933+0000","last_fullsized":"2023-05-17T15:29:18.207933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613852+0000","last_change":"2023-05-17T15:29:19.606496+0000","last_active":"2023-05-17T15:29:19.613852+0000","last_peered":"2023-05-17T15:29:19.613852+0000","last_clean":"2023-05-17T15:29:19.613852+0000","last_became_active":"2023-05-17T15:29:19.606053+0000","last_became_peered":"2023-05-17T15:29:19.606053+0000","last_unstale":"2023-05-17T15:29:19.613852+0000","last_undegraded":"2023-05-17T15:29:19.613852+0000","last_fullsized":"2023-05-17T15:29:19.613852+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.213501+0000","last_change":"2023-05-17T15:29:19.213501+0000","last_active":"2023-05-17T15:29:19.213501+0000","last_peered":"2023-05-17T15:29:19.213501+0000","last_clean":"2023-05-17T15:29:19.213501+0000","last_became_active":"2023-05-17T15:29:19.213181+0000","last_became_peered":"2023-05-17T15:29:19.213181+0000","last_unstale":"2023-05-17T15:29:19.213501+0000","last_undegraded":"2023-05-17T15:29:19.213501+0000","last_fullsized":"2023-05-17T15:29:19.213501+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593254+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:19.593254+0000","last_peered":"2023-05-17T15:29:19.593254+0000","last_clean":"2023-05-17T15:29:19.593254+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:19.593254+0000","last_undegraded":"2023-05-17T15:29:19.593254+0000","last_fullsized":"2023-05-17T15:29:19.593254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610169+0000","last_change":"2023-05-17T15:29:19.606762+0000","last_active":"2023-05-17T15:29:19.610169+0000","last_peered":"2023-05-17T15:29:19.610169+0000","last_clean":"2023-05-17T15:29:19.610169+0000","last_became_active":"2023-05-17T15:29:19.606500+0000","last_became_peered":"2023-05-17T15:29:19.606500+0000","last_unstale":"2023-05-17T15:29:19.610169+0000","last_undegraded":"2023-05-17T15:29:19.610169+0000","last_fullsized":"2023-05-17T15:29:19.610169+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.231397+0000","last_change":"2023-05-17T15:29:19.231397+0000","last_active":"2023-05-17T15:29:19.231397+0000","last_peered":"2023-05-17T15:29:19.231397+0000","last_clean":"2023-05-17T15:29:19.231397+0000","last_became_active":"2023-05-17T15:29:19.231080+0000","last_became_peered":"2023-05-17T15:29:19.231080+0000","last_unstale":"2023-05-17T15:29:19.231397+0000","last_undegraded":"2023-05-17T15:29:19.231397+0000","last_fullsized":"2023-05-17T15:29:19.231397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-17T15:29:18.206290+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:18.206290+0000","last_peered":"2023-05-17T15:29:18.206290+0000","last_clean":"2023-05-17T15:29:18.206290+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:18.206290+0000","last_undegraded":"2023-05-17T15:29:18.206290+0000","last_fullsized":"2023-05-17T15:29:18.206290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":1414,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20816,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351024,"statfs":{"total":96636764160,"available":96615448576,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.45000000000000001}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20560,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351280,"statfs":{"total":96636764160,"available":96615710720,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.498}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.439},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.40100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575269,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20156,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":17984,"kb_avail":94351684,"statfs":{"total":96636764160,"available":96616124416,"internally_reserved":0,"allocated":2215936,"data_stored":1127160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18415616},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.254},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.29099999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575269,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20740,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":18560,"kb_avail":94351100,"statfs":{"total":96636764160,"available":96615526400,"internally_reserved":0,"allocated":2224128,"data_stored":1127304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19005440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.436}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.377},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.37}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.501},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.505},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575268,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21824,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":19648,"kb_avail":94350016,"statfs":{"total":96636764160,"available":96614416384,"internally_reserved":0,"allocated":2220032,"data_stored":1126718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20119552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.628,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.314}]},{"osd":1,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61799999999999999,"5min":1.254,"15min":1.254},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70799999999999996,"5min":1.04,"15min":1.04},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94499999999999995,"5min":1.0700000000000001,"15min":1.125},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90800000000000003,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.21},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575269,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28792,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":26624,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":2211840,"data_stored":1126570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27262976},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.33500000000000002}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45800000000000002}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.65500000000000003}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.627},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20624,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351216,"statfs":{"total":96636764160,"available":96615645184,"internally_reserved":0,"allocated":2170880,"data_stored":1105590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.501},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.66500000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834575267,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":25856,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":2183168,"data_stored":1112397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26476544},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.378}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.436}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:28.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:28.230 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 Processor -- start 2023-05-17T15:29:28.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 -- start start 2023-05-17T15:29:28.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4174065aa0 0x7f4174155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.231 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4174067ec0 0x7f41740c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4174069020 con 0x7f41741540d0 2023-05-17T15:29:28.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4174155700 con 0x7f4174067ec0 2023-05-17T15:29:28.232 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.227+0000 7f4179d93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41740c3610 con 0x7f4174065aa0 2023-05-17T15:29:28.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4173fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4174067ec0 0x7f41740c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.234 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4172ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4174065aa0 0x7f4174155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f41737fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f41741540d0 0x7f4174065390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:52168/0 (socket says 172.21.15.27:52168) 2023-05-17T15:29:28.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f41737fe700 1 -- 172.21.15.27:0/969022128 learned_addr learned my addr 172.21.15.27:0/969022128 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:28.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f41727fc700 1 -- 172.21.15.27:0/969022128 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463122100 0 0) 0x7f4174069020 con 0x7f41741540d0 2023-05-17T15:29:28.235 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f41727fc700 1 -- 172.21.15.27:0/969022128 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415c0033f0 con 0x7f41741540d0 2023-05-17T15:29:28.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4173fff700 1 -- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4174065aa0 msgr2=0x7f4174155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:28.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4173fff700 1 --2- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4174065aa0 0x7f4174155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4173fff700 1 -- 172.21.15.27:0/969022128 >> v1:172.21.15.40:6789/0 conn(0x7f41741540d0 legacy=0x7f4174065390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.236 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4173fff700 1 -- 172.21.15.27:0/969022128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174068410 con 0x7f4174067ec0 2023-05-17T15:29:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4172ffd700 1 --2- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4174065aa0 0x7f4174155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.228+0000 7f4173fff700 1 --2- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c3ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f416c009e60 tx=0x7f416c009780).ready entity=mon.1 client_cookie=3af8d9eee3750be0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f41727fc700 1 -- 172.21.15.27:0/969022128 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00e070 con 0x7f4174067ec0 2023-05-17T15:29:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f41727fc700 1 -- 172.21.15.27:0/969022128 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00bab0 con 0x7f4174067ec0 2023-05-17T15:29:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f41727fc700 1 -- 172.21.15.27:0/969022128 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00be30 con 0x7f4174067ec0 2023-05-17T15:29:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 -- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 msgr2=0x7f41740c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 --2- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c3ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f416c009e60 tx=0x7f416c009780).stop 2023-05-17T15:29:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 -- 172.21.15.27:0/969022128 shutdown_connections 2023-05-17T15:29:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 --2- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c3ad0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 --2- 172.21.15.27:0/969022128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4174065aa0 0x7f4174155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 -- 172.21.15.27:0/969022128 >> 172.21.15.27:0/969022128 conn(0x7f41740c94a0 msgr2=0x7f41740c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:28.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 -- 172.21.15.27:0/969022128 shutdown_connections 2023-05-17T15:29:28.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.229+0000 7f4179d93700 1 -- 172.21.15.27:0/969022128 wait complete. 2023-05-17T15:29:28.239 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 Processor -- start 2023-05-17T15:29:28.240 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 -- start start 2023-05-17T15:29:28.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 0x7f417414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41741540d0 0x7f41740c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41740c5480 con 0x7f4174065aa0 2023-05-17T15:29:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174164b20 con 0x7f4174067ec0 2023-05-17T15:29:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.231+0000 7f4179d93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417414e3d0 con 0x7f41741540d0 2023-05-17T15:29:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 0x7f417414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 0x7f417414dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46612/0 (socket says 172.21.15.27:46612) 2023-05-17T15:29:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 -- 172.21.15.27:0/3715889936 learned_addr learned my addr 172.21.15.27:0/3715889936 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f4172ffd700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f4173fff700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41741540d0 0x7f41740c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 -- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41741540d0 msgr2=0x7f41740c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41741540d0 0x7f41740c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 -- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 msgr2=0x7f41740c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 -- 172.21.15.27:0/3715889936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680092a0 con 0x7f4174065aa0 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f4172ffd700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f41737fe700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 0x7f417414dee0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f416400c5c0 tx=0x7f4164007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164007e40 con 0x7f4174065aa0 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41640072e0 con 0x7f4174065aa0 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c009a20 con 0x7f4174065aa0 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41640057a0 con 0x7f4174065aa0 2023-05-17T15:29:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.232+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41741644d0 con 0x7f4174065aa0 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.233+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4174164e00 con 0x7f4174065aa0 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.234+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4164010070 con 0x7f4174065aa0 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.234+0000 7f415b7fe700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f416005ed90 0x7f4160061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.234+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f4164079300 con 0x7f4174065aa0 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.234+0000 7f4172ffd700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f416005ed90 0x7f4160061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.234+0000 7f4172ffd700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f416005ed90 0x7f4160061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4168009270 tx=0x7f4168008040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.238+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f416404a820 con 0x7f4174065aa0 2023-05-17T15:29:28.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.409+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f417406bdf0 con 0x7f416005ed90 2023-05-17T15:29:28.423 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.419+0000 7f415b7fe700 1 -- 172.21.15.27:0/3715889936 <== mgr.8802 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361906 (secure 0 0 0) 0x7f417406bdf0 con 0x7f416005ed90 2023-05-17T15:29:28.428 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:28.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f416005ed90 msgr2=0x7f4160061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f416005ed90 0x7f4160061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4168009270 tx=0x7f4168008040).stop 2023-05-17T15:29:28.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 msgr2=0x7f417414dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 0x7f417414dee0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f416400c5c0 tx=0x7f4164007c80).stop 2023-05-17T15:29:28.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 shutdown_connections 2023-05-17T15:29:28.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f416005ed90 0x7f4160061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41741540d0 0x7f41740c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4174065aa0 0x7f417414dee0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 --2- 172.21.15.27:0/3715889936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4174067ec0 0x7f41740c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 >> 172.21.15.27:0/3715889936 conn(0x7f41740c94a0 msgr2=0x7f41740bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:28.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 shutdown_connections 2023-05-17T15:29:28.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.423+0000 7f4179d93700 1 -- 172.21.15.27:0/3715889936 wait complete. 2023-05-17T15:29:28.433 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:28.439 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-17T15:29:26.477273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":182432,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":165056,"kb_avail":754792288,"statfs":{"total":773094113280,"available":772907302912,"internally_reserved":0,"allocated":17727488,"data_stored":9016900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":169017344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26434,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.608071"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.612925+0000","last_change":"2023-05-17T15:29:19.606948+0000","last_active":"2023-05-17T15:29:19.612925+0000","last_peered":"2023-05-17T15:29:19.612925+0000","last_clean":"2023-05-17T15:29:19.612925+0000","last_became_active":"2023-05-17T15:29:19.606660+0000","last_became_peered":"2023-05-17T15:29:19.606660+0000","last_unstale":"2023-05-17T15:29:19.612925+0000","last_undegraded":"2023-05-17T15:29:19.612925+0000","last_fullsized":"2023-05-17T15:29:19.612925+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616625+0000","last_change":"2023-05-17T15:29:19.229081+0000","last_active":"2023-05-17T15:29:19.616625+0000","last_peered":"2023-05-17T15:29:19.616625+0000","last_clean":"2023-05-17T15:29:19.616625+0000","last_became_active":"2023-05-17T15:29:19.228777+0000","last_became_peered":"2023-05-17T15:29:19.228777+0000","last_unstale":"2023-05-17T15:29:19.616625+0000","last_undegraded":"2023-05-17T15:29:19.616625+0000","last_fullsized":"2023-05-17T15:29:19.616625+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.620008+0000","last_change":"2023-05-17T15:29:19.619428+0000","last_active":"2023-05-17T15:29:19.620008+0000","last_peered":"2023-05-17T15:29:19.620008+0000","last_clean":"2023-05-17T15:29:19.620008+0000","last_became_active":"2023-05-17T15:29:19.619096+0000","last_became_peered":"2023-05-17T15:29:19.619096+0000","last_unstale":"2023-05-17T15:29:19.620008+0000","last_undegraded":"2023-05-17T15:29:19.620008+0000","last_fullsized":"2023-05-17T15:29:19.620008+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592049+0000","last_change":"2023-05-17T15:29:19.216438+0000","last_active":"2023-05-17T15:29:19.592049+0000","last_peered":"2023-05-17T15:29:19.592049+0000","last_clean":"2023-05-17T15:29:19.592049+0000","last_became_active":"2023-05-17T15:29:19.216102+0000","last_became_peered":"2023-05-17T15:29:19.216102+0000","last_unstale":"2023-05-17T15:29:19.592049+0000","last_undegraded":"2023-05-17T15:29:19.592049+0000","last_fullsized":"2023-05-17T15:29:19.592049+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614034+0000","last_change":"2023-05-17T15:29:19.610360+0000","last_active":"2023-05-17T15:29:19.614034+0000","last_peered":"2023-05-17T15:29:19.614034+0000","last_clean":"2023-05-17T15:29:19.614034+0000","last_became_active":"2023-05-17T15:29:19.610053+0000","last_became_peered":"2023-05-17T15:29:19.610053+0000","last_unstale":"2023-05-17T15:29:19.614034+0000","last_undegraded":"2023-05-17T15:29:19.614034+0000","last_fullsized":"2023-05-17T15:29:19.614034+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.596684+0000","last_change":"2023-05-17T15:29:19.217921+0000","last_active":"2023-05-17T15:29:19.596684+0000","last_peered":"2023-05-17T15:29:19.596684+0000","last_clean":"2023-05-17T15:29:19.596684+0000","last_became_active":"2023-05-17T15:29:19.217620+0000","last_became_peered":"2023-05-17T15:29:19.217620+0000","last_unstale":"2023-05-17T15:29:19.596684+0000","last_undegraded":"2023-05-17T15:29:19.596684+0000","last_fullsized":"2023-05-17T15:29:19.596684+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618627+0000","last_change":"2023-05-17T15:29:19.611689+0000","last_active":"2023-05-17T15:29:19.618627+0000","last_peered":"2023-05-17T15:29:19.618627+0000","last_clean":"2023-05-17T15:29:19.618627+0000","last_became_active":"2023-05-17T15:29:19.611162+0000","last_became_peered":"2023-05-17T15:29:19.611162+0000","last_unstale":"2023-05-17T15:29:19.618627+0000","last_undegraded":"2023-05-17T15:29:19.618627+0000","last_fullsized":"2023-05-17T15:29:19.618627+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613315+0000","last_change":"2023-05-17T15:29:19.227841+0000","last_active":"2023-05-17T15:29:19.613315+0000","last_peered":"2023-05-17T15:29:19.613315+0000","last_clean":"2023-05-17T15:29:19.613315+0000","last_became_active":"2023-05-17T15:29:19.226953+0000","last_became_peered":"2023-05-17T15:29:19.226953+0000","last_unstale":"2023-05-17T15:29:19.613315+0000","last_undegraded":"2023-05-17T15:29:19.613315+0000","last_fullsized":"2023-05-17T15:29:19.613315+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615899+0000","last_change":"2023-05-17T15:29:19.612066+0000","last_active":"2023-05-17T15:29:19.615899+0000","last_peered":"2023-05-17T15:29:19.615899+0000","last_clean":"2023-05-17T15:29:19.615899+0000","last_became_active":"2023-05-17T15:29:19.611508+0000","last_became_peered":"2023-05-17T15:29:19.611508+0000","last_unstale":"2023-05-17T15:29:19.615899+0000","last_undegraded":"2023-05-17T15:29:19.615899+0000","last_fullsized":"2023-05-17T15:29:19.615899+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.617772+0000","last_change":"2023-05-17T15:29:19.235472+0000","last_active":"2023-05-17T15:29:19.617772+0000","last_peered":"2023-05-17T15:29:19.617772+0000","last_clean":"2023-05-17T15:29:19.617772+0000","last_became_active":"2023-05-17T15:29:19.235161+0000","last_became_peered":"2023-05-17T15:29:19.235161+0000","last_unstale":"2023-05-17T15:29:19.617772+0000","last_undegraded":"2023-05-17T15:29:19.617772+0000","last_fullsized":"2023-05-17T15:29:19.617772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621240+0000","last_change":"2023-05-17T15:29:19.618005+0000","last_active":"2023-05-17T15:29:19.621240+0000","last_peered":"2023-05-17T15:29:19.621240+0000","last_clean":"2023-05-17T15:29:19.621240+0000","last_became_active":"2023-05-17T15:29:19.617685+0000","last_became_peered":"2023-05-17T15:29:19.617685+0000","last_unstale":"2023-05-17T15:29:19.621240+0000","last_undegraded":"2023-05-17T15:29:19.621240+0000","last_fullsized":"2023-05-17T15:29:19.621240+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613361+0000","last_change":"2023-05-17T15:29:19.226407+0000","last_active":"2023-05-17T15:29:19.613361+0000","last_peered":"2023-05-17T15:29:19.613361+0000","last_clean":"2023-05-17T15:29:19.613361+0000","last_became_active":"2023-05-17T15:29:19.226135+0000","last_became_peered":"2023-05-17T15:29:19.226135+0000","last_unstale":"2023-05-17T15:29:19.613361+0000","last_undegraded":"2023-05-17T15:29:19.613361+0000","last_fullsized":"2023-05-17T15:29:19.613361+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613832+0000","last_change":"2023-05-17T15:29:19.606332+0000","last_active":"2023-05-17T15:29:19.613832+0000","last_peered":"2023-05-17T15:29:19.613832+0000","last_clean":"2023-05-17T15:29:19.613832+0000","last_became_active":"2023-05-17T15:29:19.605682+0000","last_became_peered":"2023-05-17T15:29:19.605682+0000","last_unstale":"2023-05-17T15:29:19.613832+0000","last_undegraded":"2023-05-17T15:29:19.613832+0000","last_fullsized":"2023-05-17T15:29:19.613832+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593193+0000","last_change":"2023-05-17T15:29:19.228189+0000","last_active":"2023-05-17T15:29:19.593193+0000","last_peered":"2023-05-17T15:29:19.593193+0000","last_clean":"2023-05-17T15:29:19.593193+0000","last_became_active":"2023-05-17T15:29:19.227924+0000","last_became_peered":"2023-05-17T15:29:19.227924+0000","last_unstale":"2023-05-17T15:29:19.593193+0000","last_undegraded":"2023-05-17T15:29:19.593193+0000","last_fullsized":"2023-05-17T15:29:19.593193+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618066+0000","last_change":"2023-05-17T15:29:19.617367+0000","last_active":"2023-05-17T15:29:19.618066+0000","last_peered":"2023-05-17T15:29:19.618066+0000","last_clean":"2023-05-17T15:29:19.618066+0000","last_became_active":"2023-05-17T15:29:19.617056+0000","last_became_peered":"2023-05-17T15:29:19.617056+0000","last_unstale":"2023-05-17T15:29:19.618066+0000","last_undegraded":"2023-05-17T15:29:19.618066+0000","last_fullsized":"2023-05-17T15:29:19.618066+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.591620+0000","last_change":"2023-05-17T15:29:19.224680+0000","last_active":"2023-05-17T15:29:19.591620+0000","last_peered":"2023-05-17T15:29:19.591620+0000","last_clean":"2023-05-17T15:29:19.591620+0000","last_became_active":"2023-05-17T15:29:19.224445+0000","last_became_peered":"2023-05-17T15:29:19.224445+0000","last_unstale":"2023-05-17T15:29:19.591620+0000","last_undegraded":"2023-05-17T15:29:19.591620+0000","last_fullsized":"2023-05-17T15:29:19.591620+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.612956+0000","last_change":"2023-05-17T15:29:19.608501+0000","last_active":"2023-05-17T15:29:19.612956+0000","last_peered":"2023-05-17T15:29:19.612956+0000","last_clean":"2023-05-17T15:29:19.612956+0000","last_became_active":"2023-05-17T15:29:19.608238+0000","last_became_peered":"2023-05-17T15:29:19.608238+0000","last_unstale":"2023-05-17T15:29:19.612956+0000","last_undegraded":"2023-05-17T15:29:19.612956+0000","last_fullsized":"2023-05-17T15:29:19.612956+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594748+0000","last_change":"2023-05-17T15:29:19.227068+0000","last_active":"2023-05-17T15:29:19.594748+0000","last_peered":"2023-05-17T15:29:19.594748+0000","last_clean":"2023-05-17T15:29:19.594748+0000","last_became_active":"2023-05-17T15:29:19.226527+0000","last_became_peered":"2023-05-17T15:29:19.226527+0000","last_unstale":"2023-05-17T15:29:19.594748+0000","last_undegraded":"2023-05-17T15:29:19.594748+0000","last_fullsized":"2023-05-17T15:29:19.594748+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.609569+0000","last_change":"2023-05-17T15:29:19.606095+0000","last_active":"2023-05-17T15:29:19.609569+0000","last_peered":"2023-05-17T15:29:19.609569+0000","last_clean":"2023-05-17T15:29:19.609569+0000","last_became_active":"2023-05-17T15:29:19.605533+0000","last_became_peered":"2023-05-17T15:29:19.605533+0000","last_unstale":"2023-05-17T15:29:19.609569+0000","last_undegraded":"2023-05-17T15:29:19.609569+0000","last_fullsized":"2023-05-17T15:29:19.609569+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610081+0000","last_change":"2023-05-17T15:29:19.234553+0000","last_active":"2023-05-17T15:29:19.610081+0000","last_peered":"2023-05-17T15:29:19.610081+0000","last_clean":"2023-05-17T15:29:19.610081+0000","last_became_active":"2023-05-17T15:29:19.231624+0000","last_became_peered":"2023-05-17T15:29:19.231624+0000","last_unstale":"2023-05-17T15:29:19.610081+0000","last_undegraded":"2023-05-17T15:29:19.610081+0000","last_fullsized":"2023-05-17T15:29:19.610081+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614209+0000","last_change":"2023-05-17T15:29:19.607259+0000","last_active":"2023-05-17T15:29:19.614209+0000","last_peered":"2023-05-17T15:29:19.614209+0000","last_clean":"2023-05-17T15:29:19.614209+0000","last_became_active":"2023-05-17T15:29:19.606988+0000","last_became_peered":"2023-05-17T15:29:19.606988+0000","last_unstale":"2023-05-17T15:29:19.614209+0000","last_undegraded":"2023-05-17T15:29:19.614209+0000","last_fullsized":"2023-05-17T15:29:19.614209+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592599+0000","last_change":"2023-05-17T15:29:19.225402+0000","last_active":"2023-05-17T15:29:19.592599+0000","last_peered":"2023-05-17T15:29:19.592599+0000","last_clean":"2023-05-17T15:29:19.592599+0000","last_became_active":"2023-05-17T15:29:19.225133+0000","last_became_peered":"2023-05-17T15:29:19.225133+0000","last_unstale":"2023-05-17T15:29:19.592599+0000","last_undegraded":"2023-05-17T15:29:19.592599+0000","last_fullsized":"2023-05-17T15:29:19.592599+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618026+0000","last_change":"2023-05-17T15:29:19.616630+0000","last_active":"2023-05-17T15:29:19.618026+0000","last_peered":"2023-05-17T15:29:19.618026+0000","last_clean":"2023-05-17T15:29:19.618026+0000","last_became_active":"2023-05-17T15:29:19.616398+0000","last_became_peered":"2023-05-17T15:29:19.616398+0000","last_unstale":"2023-05-17T15:29:19.618026+0000","last_undegraded":"2023-05-17T15:29:19.618026+0000","last_fullsized":"2023-05-17T15:29:19.618026+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.624427+0000","last_change":"2023-05-17T15:29:19.235126+0000","last_active":"2023-05-17T15:29:19.624427+0000","last_peered":"2023-05-17T15:29:19.624427+0000","last_clean":"2023-05-17T15:29:19.624427+0000","last_became_active":"2023-05-17T15:29:19.234828+0000","last_became_peered":"2023-05-17T15:29:19.234828+0000","last_unstale":"2023-05-17T15:29:19.624427+0000","last_undegraded":"2023-05-17T15:29:19.624427+0000","last_fullsized":"2023-05-17T15:29:19.624427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.612498+0000","last_change":"2023-05-17T15:29:19.608637+0000","last_active":"2023-05-17T15:29:19.612498+0000","last_peered":"2023-05-17T15:29:19.612498+0000","last_clean":"2023-05-17T15:29:19.612498+0000","last_became_active":"2023-05-17T15:29:19.607477+0000","last_became_peered":"2023-05-17T15:29:19.607477+0000","last_unstale":"2023-05-17T15:29:19.612498+0000","last_undegraded":"2023-05-17T15:29:19.612498+0000","last_fullsized":"2023-05-17T15:29:19.612498+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.617903+0000","last_change":"2023-05-17T15:29:19.233128+0000","last_active":"2023-05-17T15:29:19.617903+0000","last_peered":"2023-05-17T15:29:19.617903+0000","last_clean":"2023-05-17T15:29:19.617903+0000","last_became_active":"2023-05-17T15:29:19.232840+0000","last_became_peered":"2023-05-17T15:29:19.232840+0000","last_unstale":"2023-05-17T15:29:19.617903+0000","last_undegraded":"2023-05-17T15:29:19.617903+0000","last_fullsized":"2023-05-17T15:29:19.617903+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.603880+0000","last_change":"2023-05-17T15:29:19.600600+0000","last_active":"2023-05-17T15:29:19.603880+0000","last_peered":"2023-05-17T15:29:19.603880+0000","last_clean":"2023-05-17T15:29:19.603880+0000","last_became_active":"2023-05-17T15:29:19.600022+0000","last_became_peered":"2023-05-17T15:29:19.600022+0000","last_unstale":"2023-05-17T15:29:19.603880+0000","last_undegraded":"2023-05-17T15:29:19.603880+0000","last_fullsized":"2023-05-17T15:29:19.603880+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.596953+0000","last_change":"2023-05-17T15:29:19.232632+0000","last_active":"2023-05-17T15:29:19.596953+0000","last_peered":"2023-05-17T15:29:19.596953+0000","last_clean":"2023-05-17T15:29:19.596953+0000","last_became_active":"2023-05-17T15:29:19.232325+0000","last_became_peered":"2023-05-17T15:29:19.232325+0000","last_unstale":"2023-05-17T15:29:19.596953+0000","last_undegraded":"2023-05-17T15:29:19.596953+0000","last_fullsized":"2023-05-17T15:29:19.596953+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611399+0000","last_change":"2023-05-17T15:29:19.608456+0000","last_active":"2023-05-17T15:29:19.611399+0000","last_peered":"2023-05-17T15:29:19.611399+0000","last_clean":"2023-05-17T15:29:19.611399+0000","last_became_active":"2023-05-17T15:29:19.608105+0000","last_became_peered":"2023-05-17T15:29:19.608105+0000","last_unstale":"2023-05-17T15:29:19.611399+0000","last_undegraded":"2023-05-17T15:29:19.611399+0000","last_fullsized":"2023-05-17T15:29:19.611399+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.606037+0000","last_change":"2023-05-17T15:29:19.233692+0000","last_active":"2023-05-17T15:29:19.606037+0000","last_peered":"2023-05-17T15:29:19.606037+0000","last_clean":"2023-05-17T15:29:19.606037+0000","last_became_active":"2023-05-17T15:29:19.233389+0000","last_became_peered":"2023-05-17T15:29:19.233389+0000","last_unstale":"2023-05-17T15:29:19.606037+0000","last_undegraded":"2023-05-17T15:29:19.606037+0000","last_fullsized":"2023-05-17T15:29:19.606037+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615481+0000","last_change":"2023-05-17T15:29:19.612017+0000","last_active":"2023-05-17T15:29:19.615481+0000","last_peered":"2023-05-17T15:29:19.615481+0000","last_clean":"2023-05-17T15:29:19.615481+0000","last_became_active":"2023-05-17T15:29:19.610996+0000","last_became_peered":"2023-05-17T15:29:19.610996+0000","last_unstale":"2023-05-17T15:29:19.615481+0000","last_undegraded":"2023-05-17T15:29:19.615481+0000","last_fullsized":"2023-05-17T15:29:19.615481+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610599+0000","last_change":"2023-05-17T15:29:19.223496+0000","last_active":"2023-05-17T15:29:19.610599+0000","last_peered":"2023-05-17T15:29:19.610599+0000","last_clean":"2023-05-17T15:29:19.610599+0000","last_became_active":"2023-05-17T15:29:19.222935+0000","last_became_peered":"2023-05-17T15:29:19.222935+0000","last_unstale":"2023-05-17T15:29:19.610599+0000","last_undegraded":"2023-05-17T15:29:19.610599+0000","last_fullsized":"2023-05-17T15:29:19.610599+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608469+0000","last_change":"2023-05-17T15:29:19.605127+0000","last_active":"2023-05-17T15:29:19.608469+0000","last_peered":"2023-05-17T15:29:19.608469+0000","last_clean":"2023-05-17T15:29:19.608469+0000","last_became_active":"2023-05-17T15:29:19.604879+0000","last_became_peered":"2023-05-17T15:29:19.604879+0000","last_unstale":"2023-05-17T15:29:19.608469+0000","last_undegraded":"2023-05-17T15:29:19.608469+0000","last_fullsized":"2023-05-17T15:29:19.608469+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610373+0000","last_change":"2023-05-17T15:29:19.235837+0000","last_active":"2023-05-17T15:29:19.610373+0000","last_peered":"2023-05-17T15:29:19.610373+0000","last_clean":"2023-05-17T15:29:19.610373+0000","last_became_active":"2023-05-17T15:29:19.235271+0000","last_became_peered":"2023-05-17T15:29:19.235271+0000","last_unstale":"2023-05-17T15:29:19.610373+0000","last_undegraded":"2023-05-17T15:29:19.610373+0000","last_fullsized":"2023-05-17T15:29:19.610373+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.623642+0000","last_change":"2023-05-17T15:29:19.618905+0000","last_active":"2023-05-17T15:29:19.623642+0000","last_peered":"2023-05-17T15:29:19.623642+0000","last_clean":"2023-05-17T15:29:19.623642+0000","last_became_active":"2023-05-17T15:29:19.618438+0000","last_became_peered":"2023-05-17T15:29:19.618438+0000","last_unstale":"2023-05-17T15:29:19.623642+0000","last_undegraded":"2023-05-17T15:29:19.623642+0000","last_fullsized":"2023-05-17T15:29:19.623642+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.595841+0000","last_change":"2023-05-17T15:29:19.218502+0000","last_active":"2023-05-17T15:29:19.595841+0000","last_peered":"2023-05-17T15:29:19.595841+0000","last_clean":"2023-05-17T15:29:19.595841+0000","last_became_active":"2023-05-17T15:29:19.218216+0000","last_became_peered":"2023-05-17T15:29:19.218216+0000","last_unstale":"2023-05-17T15:29:19.595841+0000","last_undegraded":"2023-05-17T15:29:19.595841+0000","last_fullsized":"2023-05-17T15:29:19.595841+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618201+0000","last_change":"2023-05-17T15:29:19.617058+0000","last_active":"2023-05-17T15:29:19.618201+0000","last_peered":"2023-05-17T15:29:19.618201+0000","last_clean":"2023-05-17T15:29:19.618201+0000","last_became_active":"2023-05-17T15:29:19.616755+0000","last_became_peered":"2023-05-17T15:29:19.616755+0000","last_unstale":"2023-05-17T15:29:19.618201+0000","last_undegraded":"2023-05-17T15:29:19.618201+0000","last_fullsized":"2023-05-17T15:29:19.618201+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.606433+0000","last_change":"2023-05-17T15:29:19.223022+0000","last_active":"2023-05-17T15:29:19.606433+0000","last_peered":"2023-05-17T15:29:19.606433+0000","last_clean":"2023-05-17T15:29:19.606433+0000","last_became_active":"2023-05-17T15:29:19.222747+0000","last_became_peered":"2023-05-17T15:29:19.222747+0000","last_unstale":"2023-05-17T15:29:19.606433+0000","last_undegraded":"2023-05-17T15:29:19.606433+0000","last_fullsized":"2023-05-17T15:29:19.606433+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.612308+0000","last_change":"2023-05-17T15:29:19.610562+0000","last_active":"2023-05-17T15:29:19.612308+0000","last_peered":"2023-05-17T15:29:19.612308+0000","last_clean":"2023-05-17T15:29:19.612308+0000","last_became_active":"2023-05-17T15:29:19.610252+0000","last_became_peered":"2023-05-17T15:29:19.610252+0000","last_unstale":"2023-05-17T15:29:19.612308+0000","last_undegraded":"2023-05-17T15:29:19.612308+0000","last_fullsized":"2023-05-17T15:29:19.612308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593846+0000","last_change":"2023-05-17T15:29:19.218399+0000","last_active":"2023-05-17T15:29:19.593846+0000","last_peered":"2023-05-17T15:29:19.593846+0000","last_clean":"2023-05-17T15:29:19.593846+0000","last_became_active":"2023-05-17T15:29:19.218004+0000","last_became_peered":"2023-05-17T15:29:19.218004+0000","last_unstale":"2023-05-17T15:29:19.593846+0000","last_undegraded":"2023-05-17T15:29:19.593846+0000","last_fullsized":"2023-05-17T15:29:19.593846+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616147+0000","last_change":"2023-05-17T15:29:19.614544+0000","last_active":"2023-05-17T15:29:19.616147+0000","last_peered":"2023-05-17T15:29:19.616147+0000","last_clean":"2023-05-17T15:29:19.616147+0000","last_became_active":"2023-05-17T15:29:19.614219+0000","last_became_peered":"2023-05-17T15:29:19.614219+0000","last_unstale":"2023-05-17T15:29:19.616147+0000","last_undegraded":"2023-05-17T15:29:19.616147+0000","last_fullsized":"2023-05-17T15:29:19.616147+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616297+0000","last_change":"2023-05-17T15:29:19.231041+0000","last_active":"2023-05-17T15:29:19.616297+0000","last_peered":"2023-05-17T15:29:19.616297+0000","last_clean":"2023-05-17T15:29:19.616297+0000","last_became_active":"2023-05-17T15:29:19.230710+0000","last_became_peered":"2023-05-17T15:29:19.230710+0000","last_unstale":"2023-05-17T15:29:19.616297+0000","last_undegraded":"2023-05-17T15:29:19.616297+0000","last_fullsized":"2023-05-17T15:29:19.616297+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615853+0000","last_change":"2023-05-17T15:29:19.613629+0000","last_active":"2023-05-17T15:29:19.615853+0000","last_peered":"2023-05-17T15:29:19.615853+0000","last_clean":"2023-05-17T15:29:19.615853+0000","last_became_active":"2023-05-17T15:29:19.612947+0000","last_became_peered":"2023-05-17T15:29:19.612947+0000","last_unstale":"2023-05-17T15:29:19.615853+0000","last_undegraded":"2023-05-17T15:29:19.615853+0000","last_fullsized":"2023-05-17T15:29:19.615853+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.597034+0000","last_change":"2023-05-17T15:29:19.226559+0000","last_active":"2023-05-17T15:29:19.597034+0000","last_peered":"2023-05-17T15:29:19.597034+0000","last_clean":"2023-05-17T15:29:19.597034+0000","last_became_active":"2023-05-17T15:29:19.225699+0000","last_became_peered":"2023-05-17T15:29:19.225699+0000","last_unstale":"2023-05-17T15:29:19.597034+0000","last_undegraded":"2023-05-17T15:29:19.597034+0000","last_fullsized":"2023-05-17T15:29:19.597034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621131+0000","last_change":"2023-05-17T15:29:19.617120+0000","last_active":"2023-05-17T15:29:19.621131+0000","last_peered":"2023-05-17T15:29:19.621131+0000","last_clean":"2023-05-17T15:29:19.621131+0000","last_became_active":"2023-05-17T15:29:19.616828+0000","last_became_peered":"2023-05-17T15:29:19.616828+0000","last_unstale":"2023-05-17T15:29:19.621131+0000","last_undegraded":"2023-05-17T15:29:19.621131+0000","last_fullsized":"2023-05-17T15:29:19.621131+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.596461+0000","last_change":"2023-05-17T15:29:19.223102+0000","last_active":"2023-05-17T15:29:19.596461+0000","last_peered":"2023-05-17T15:29:19.596461+0000","last_clean":"2023-05-17T15:29:19.596461+0000","last_became_active":"2023-05-17T15:29:19.222837+0000","last_became_peered":"2023-05-17T15:29:19.222837+0000","last_unstale":"2023-05-17T15:29:19.596461+0000","last_undegraded":"2023-05-17T15:29:19.596461+0000","last_fullsized":"2023-05-17T15:29:19.596461+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615536+0000","last_change":"2023-05-17T15:29:19.612491+0000","last_active":"2023-05-17T15:29:19.615536+0000","last_peered":"2023-05-17T15:29:19.615536+0000","last_clean":"2023-05-17T15:29:19.615536+0000","last_became_active":"2023-05-17T15:29:19.611358+0000","last_became_peered":"2023-05-17T15:29:19.611358+0000","last_unstale":"2023-05-17T15:29:19.615536+0000","last_undegraded":"2023-05-17T15:29:19.615536+0000","last_fullsized":"2023-05-17T15:29:19.615536+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608263+0000","last_change":"2023-05-17T15:29:19.236154+0000","last_active":"2023-05-17T15:29:19.608263+0000","last_peered":"2023-05-17T15:29:19.608263+0000","last_clean":"2023-05-17T15:29:19.608263+0000","last_became_active":"2023-05-17T15:29:19.235132+0000","last_became_peered":"2023-05-17T15:29:19.235132+0000","last_unstale":"2023-05-17T15:29:19.608263+0000","last_undegraded":"2023-05-17T15:29:19.608263+0000","last_fullsized":"2023-05-17T15:29:19.608263+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611605+0000","last_change":"2023-05-17T15:29:19.608974+0000","last_active":"2023-05-17T15:29:19.611605+0000","last_peered":"2023-05-17T15:29:19.611605+0000","last_clean":"2023-05-17T15:29:19.611605+0000","last_became_active":"2023-05-17T15:29:19.608651+0000","last_became_peered":"2023-05-17T15:29:19.608651+0000","last_unstale":"2023-05-17T15:29:19.611605+0000","last_undegraded":"2023-05-17T15:29:19.611605+0000","last_fullsized":"2023-05-17T15:29:19.611605+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.591551+0000","last_change":"2023-05-17T15:29:19.225105+0000","last_active":"2023-05-17T15:29:19.591551+0000","last_peered":"2023-05-17T15:29:19.591551+0000","last_clean":"2023-05-17T15:29:19.591551+0000","last_became_active":"2023-05-17T15:29:19.224787+0000","last_became_peered":"2023-05-17T15:29:19.224787+0000","last_unstale":"2023-05-17T15:29:19.591551+0000","last_undegraded":"2023-05-17T15:29:19.591551+0000","last_fullsized":"2023-05-17T15:29:19.591551+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621368+0000","last_change":"2023-05-17T15:29:19.619338+0000","last_active":"2023-05-17T15:29:19.621368+0000","last_peered":"2023-05-17T15:29:19.621368+0000","last_clean":"2023-05-17T15:29:19.621368+0000","last_became_active":"2023-05-17T15:29:19.619067+0000","last_became_peered":"2023-05-17T15:29:19.619067+0000","last_unstale":"2023-05-17T15:29:19.621368+0000","last_undegraded":"2023-05-17T15:29:19.621368+0000","last_fullsized":"2023-05-17T15:29:19.621368+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:20.008901+0000","last_change":"2023-05-17T15:29:19.224828+0000","last_active":"2023-05-17T15:29:20.008901+0000","last_peered":"2023-05-17T15:29:20.008901+0000","last_clean":"2023-05-17T15:29:20.008901+0000","last_became_active":"2023-05-17T15:29:19.224459+0000","last_became_peered":"2023-05-17T15:29:19.224459+0000","last_unstale":"2023-05-17T15:29:20.008901+0000","last_undegraded":"2023-05-17T15:29:20.008901+0000","last_fullsized":"2023-05-17T15:29:20.008901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621072+0000","last_change":"2023-05-17T15:29:19.614864+0000","last_active":"2023-05-17T15:29:19.621072+0000","last_peered":"2023-05-17T15:29:19.621072+0000","last_clean":"2023-05-17T15:29:19.621072+0000","last_became_active":"2023-05-17T15:29:19.614351+0000","last_became_peered":"2023-05-17T15:29:19.614351+0000","last_unstale":"2023-05-17T15:29:19.621072+0000","last_undegraded":"2023-05-17T15:29:19.621072+0000","last_fullsized":"2023-05-17T15:29:19.621072+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594928+0000","last_change":"2023-05-17T15:29:19.219162+0000","last_active":"2023-05-17T15:29:19.594928+0000","last_peered":"2023-05-17T15:29:19.594928+0000","last_clean":"2023-05-17T15:29:19.594928+0000","last_became_active":"2023-05-17T15:29:19.217976+0000","last_became_peered":"2023-05-17T15:29:19.217976+0000","last_unstale":"2023-05-17T15:29:19.594928+0000","last_undegraded":"2023-05-17T15:29:19.594928+0000","last_fullsized":"2023-05-17T15:29:19.594928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618662+0000","last_change":"2023-05-17T15:29:19.612789+0000","last_active":"2023-05-17T15:29:19.618662+0000","last_peered":"2023-05-17T15:29:19.618662+0000","last_clean":"2023-05-17T15:29:19.618662+0000","last_became_active":"2023-05-17T15:29:19.611471+0000","last_became_peered":"2023-05-17T15:29:19.611471+0000","last_unstale":"2023-05-17T15:29:19.618662+0000","last_undegraded":"2023-05-17T15:29:19.618662+0000","last_fullsized":"2023-05-17T15:29:19.618662+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594193+0000","last_change":"2023-05-17T15:29:19.226882+0000","last_active":"2023-05-17T15:29:19.594193+0000","last_peered":"2023-05-17T15:29:19.594193+0000","last_clean":"2023-05-17T15:29:19.594193+0000","last_became_active":"2023-05-17T15:29:19.226602+0000","last_became_peered":"2023-05-17T15:29:19.226602+0000","last_unstale":"2023-05-17T15:29:19.594193+0000","last_undegraded":"2023-05-17T15:29:19.594193+0000","last_fullsized":"2023-05-17T15:29:19.594193+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613532+0000","last_change":"2023-05-17T15:29:19.611661+0000","last_active":"2023-05-17T15:29:19.613532+0000","last_peered":"2023-05-17T15:29:19.613532+0000","last_clean":"2023-05-17T15:29:19.613532+0000","last_became_active":"2023-05-17T15:29:19.611217+0000","last_became_peered":"2023-05-17T15:29:19.611217+0000","last_unstale":"2023-05-17T15:29:19.613532+0000","last_undegraded":"2023-05-17T15:29:19.613532+0000","last_fullsized":"2023-05-17T15:29:19.613532+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592269+0000","last_change":"2023-05-17T15:29:19.227477+0000","last_active":"2023-05-17T15:29:19.592269+0000","last_peered":"2023-05-17T15:29:19.592269+0000","last_clean":"2023-05-17T15:29:19.592269+0000","last_became_active":"2023-05-17T15:29:19.227181+0000","last_became_peered":"2023-05-17T15:29:19.227181+0000","last_unstale":"2023-05-17T15:29:19.592269+0000","last_undegraded":"2023-05-17T15:29:19.592269+0000","last_fullsized":"2023-05-17T15:29:19.592269+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614635+0000","last_change":"2023-05-17T15:29:19.609756+0000","last_active":"2023-05-17T15:29:19.614635+0000","last_peered":"2023-05-17T15:29:19.614635+0000","last_clean":"2023-05-17T15:29:19.614635+0000","last_became_active":"2023-05-17T15:29:19.607402+0000","last_became_peered":"2023-05-17T15:29:19.607402+0000","last_unstale":"2023-05-17T15:29:19.614635+0000","last_undegraded":"2023-05-17T15:29:19.614635+0000","last_fullsized":"2023-05-17T15:29:19.614635+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.597052+0000","last_change":"2023-05-17T15:29:19.226062+0000","last_active":"2023-05-17T15:29:19.597052+0000","last_peered":"2023-05-17T15:29:19.597052+0000","last_clean":"2023-05-17T15:29:19.597052+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.597052+0000","last_undegraded":"2023-05-17T15:29:19.597052+0000","last_fullsized":"2023-05-17T15:29:19.597052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615677+0000","last_change":"2023-05-17T15:29:19.613036+0000","last_active":"2023-05-17T15:29:19.615677+0000","last_peered":"2023-05-17T15:29:19.615677+0000","last_clean":"2023-05-17T15:29:19.615677+0000","last_became_active":"2023-05-17T15:29:19.612715+0000","last_became_peered":"2023-05-17T15:29:19.612715+0000","last_unstale":"2023-05-17T15:29:19.615677+0000","last_undegraded":"2023-05-17T15:29:19.615677+0000","last_fullsized":"2023-05-17T15:29:19.615677+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599108+0000","last_change":"2023-05-17T15:29:19.223810+0000","last_active":"2023-05-17T15:29:19.599108+0000","last_peered":"2023-05-17T15:29:19.599108+0000","last_clean":"2023-05-17T15:29:19.599108+0000","last_became_active":"2023-05-17T15:29:19.223511+0000","last_became_peered":"2023-05-17T15:29:19.223511+0000","last_unstale":"2023-05-17T15:29:19.599108+0000","last_undegraded":"2023-05-17T15:29:19.599108+0000","last_fullsized":"2023-05-17T15:29:19.599108+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613530+0000","last_change":"2023-05-17T15:29:19.608988+0000","last_active":"2023-05-17T15:29:19.613530+0000","last_peered":"2023-05-17T15:29:19.613530+0000","last_clean":"2023-05-17T15:29:19.613530+0000","last_became_active":"2023-05-17T15:29:19.608496+0000","last_became_peered":"2023-05-17T15:29:19.608496+0000","last_unstale":"2023-05-17T15:29:19.613530+0000","last_undegraded":"2023-05-17T15:29:19.613530+0000","last_fullsized":"2023-05-17T15:29:19.613530+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.591818+0000","last_change":"2023-05-17T15:29:19.227154+0000","last_active":"2023-05-17T15:29:19.591818+0000","last_peered":"2023-05-17T15:29:19.591818+0000","last_clean":"2023-05-17T15:29:19.591818+0000","last_became_active":"2023-05-17T15:29:19.226876+0000","last_became_peered":"2023-05-17T15:29:19.226876+0000","last_unstale":"2023-05-17T15:29:19.591818+0000","last_undegraded":"2023-05-17T15:29:19.591818+0000","last_fullsized":"2023-05-17T15:29:19.591818+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614085+0000","last_change":"2023-05-17T15:29:19.611070+0000","last_active":"2023-05-17T15:29:19.614085+0000","last_peered":"2023-05-17T15:29:19.614085+0000","last_clean":"2023-05-17T15:29:19.614085+0000","last_became_active":"2023-05-17T15:29:19.610809+0000","last_became_peered":"2023-05-17T15:29:19.610809+0000","last_unstale":"2023-05-17T15:29:19.614085+0000","last_undegraded":"2023-05-17T15:29:19.614085+0000","last_fullsized":"2023-05-17T15:29:19.614085+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.607461+0000","last_change":"2023-05-17T15:29:19.216411+0000","last_active":"2023-05-17T15:29:19.607461+0000","last_peered":"2023-05-17T15:29:19.607461+0000","last_clean":"2023-05-17T15:29:19.607461+0000","last_became_active":"2023-05-17T15:29:19.216065+0000","last_became_peered":"2023-05-17T15:29:19.216065+0000","last_unstale":"2023-05-17T15:29:19.607461+0000","last_undegraded":"2023-05-17T15:29:19.607461+0000","last_fullsized":"2023-05-17T15:29:19.607461+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613208+0000","last_change":"2023-05-17T15:29:19.610598+0000","last_active":"2023-05-17T15:29:19.613208+0000","last_peered":"2023-05-17T15:29:19.613208+0000","last_clean":"2023-05-17T15:29:19.613208+0000","last_became_active":"2023-05-17T15:29:19.610295+0000","last_became_peered":"2023-05-17T15:29:19.610295+0000","last_unstale":"2023-05-17T15:29:19.613208+0000","last_undegraded":"2023-05-17T15:29:19.613208+0000","last_fullsized":"2023-05-17T15:29:19.613208+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621410+0000","last_change":"2023-05-17T15:29:19.236893+0000","last_active":"2023-05-17T15:29:19.621410+0000","last_peered":"2023-05-17T15:29:19.621410+0000","last_clean":"2023-05-17T15:29:19.621410+0000","last_became_active":"2023-05-17T15:29:19.236609+0000","last_became_peered":"2023-05-17T15:29:19.236609+0000","last_unstale":"2023-05-17T15:29:19.621410+0000","last_undegraded":"2023-05-17T15:29:19.621410+0000","last_fullsized":"2023-05-17T15:29:19.621410+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615093+0000","last_change":"2023-05-17T15:29:19.612544+0000","last_active":"2023-05-17T15:29:19.615093+0000","last_peered":"2023-05-17T15:29:19.615093+0000","last_clean":"2023-05-17T15:29:19.615093+0000","last_became_active":"2023-05-17T15:29:19.612253+0000","last_became_peered":"2023-05-17T15:29:19.612253+0000","last_unstale":"2023-05-17T15:29:19.615093+0000","last_undegraded":"2023-05-17T15:29:19.615093+0000","last_fullsized":"2023-05-17T15:29:19.615093+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.620462+0000","last_change":"2023-05-17T15:29:19.236874+0000","last_active":"2023-05-17T15:29:19.620462+0000","last_peered":"2023-05-17T15:29:19.620462+0000","last_clean":"2023-05-17T15:29:19.620462+0000","last_became_active":"2023-05-17T15:29:19.236507+0000","last_became_peered":"2023-05-17T15:29:19.236507+0000","last_unstale":"2023-05-17T15:29:19.620462+0000","last_undegraded":"2023-05-17T15:29:19.620462+0000","last_fullsized":"2023-05-17T15:29:19.620462+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.624067+0000","last_change":"2023-05-17T15:29:19.620933+0000","last_active":"2023-05-17T15:29:19.624067+0000","last_peered":"2023-05-17T15:29:19.624067+0000","last_clean":"2023-05-17T15:29:19.624067+0000","last_became_active":"2023-05-17T15:29:19.620604+0000","last_became_peered":"2023-05-17T15:29:19.620604+0000","last_unstale":"2023-05-17T15:29:19.624067+0000","last_undegraded":"2023-05-17T15:29:19.624067+0000","last_fullsized":"2023-05-17T15:29:19.624067+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592721+0000","last_change":"2023-05-17T15:29:19.228664+0000","last_active":"2023-05-17T15:29:19.592721+0000","last_peered":"2023-05-17T15:29:19.592721+0000","last_clean":"2023-05-17T15:29:19.592721+0000","last_became_active":"2023-05-17T15:29:19.228391+0000","last_became_peered":"2023-05-17T15:29:19.228391+0000","last_unstale":"2023-05-17T15:29:19.592721+0000","last_undegraded":"2023-05-17T15:29:19.592721+0000","last_fullsized":"2023-05-17T15:29:19.592721+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614022+0000","last_change":"2023-05-17T15:29:19.610413+0000","last_active":"2023-05-17T15:29:19.614022+0000","last_peered":"2023-05-17T15:29:19.614022+0000","last_clean":"2023-05-17T15:29:19.614022+0000","last_became_active":"2023-05-17T15:29:19.610136+0000","last_became_peered":"2023-05-17T15:29:19.610136+0000","last_unstale":"2023-05-17T15:29:19.614022+0000","last_undegraded":"2023-05-17T15:29:19.614022+0000","last_fullsized":"2023-05-17T15:29:19.614022+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.596913+0000","last_change":"2023-05-17T15:29:19.232621+0000","last_active":"2023-05-17T15:29:19.596913+0000","last_peered":"2023-05-17T15:29:19.596913+0000","last_clean":"2023-05-17T15:29:19.596913+0000","last_became_active":"2023-05-17T15:29:19.232307+0000","last_became_peered":"2023-05-17T15:29:19.232307+0000","last_unstale":"2023-05-17T15:29:19.596913+0000","last_undegraded":"2023-05-17T15:29:19.596913+0000","last_fullsized":"2023-05-17T15:29:19.596913+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611648+0000","last_change":"2023-05-17T15:29:19.604164+0000","last_active":"2023-05-17T15:29:19.611648+0000","last_peered":"2023-05-17T15:29:19.611648+0000","last_clean":"2023-05-17T15:29:19.611648+0000","last_became_active":"2023-05-17T15:29:19.603875+0000","last_became_peered":"2023-05-17T15:29:19.603875+0000","last_unstale":"2023-05-17T15:29:19.611648+0000","last_undegraded":"2023-05-17T15:29:19.611648+0000","last_fullsized":"2023-05-17T15:29:19.611648+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592906+0000","last_change":"2023-05-17T15:29:19.228906+0000","last_active":"2023-05-17T15:29:19.592906+0000","last_peered":"2023-05-17T15:29:19.592906+0000","last_clean":"2023-05-17T15:29:19.592906+0000","last_became_active":"2023-05-17T15:29:19.228614+0000","last_became_peered":"2023-05-17T15:29:19.228614+0000","last_unstale":"2023-05-17T15:29:19.592906+0000","last_undegraded":"2023-05-17T15:29:19.592906+0000","last_fullsized":"2023-05-17T15:29:19.592906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.609509+0000","last_change":"2023-05-17T15:29:19.605329+0000","last_active":"2023-05-17T15:29:19.609509+0000","last_peered":"2023-05-17T15:29:19.609509+0000","last_clean":"2023-05-17T15:29:19.609509+0000","last_became_active":"2023-05-17T15:29:19.605078+0000","last_became_peered":"2023-05-17T15:29:19.605078+0000","last_unstale":"2023-05-17T15:29:19.609509+0000","last_undegraded":"2023-05-17T15:29:19.609509+0000","last_fullsized":"2023-05-17T15:29:19.609509+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.600903+0000","last_change":"2023-05-17T15:29:19.227011+0000","last_active":"2023-05-17T15:29:19.600903+0000","last_peered":"2023-05-17T15:29:19.600903+0000","last_clean":"2023-05-17T15:29:19.600903+0000","last_became_active":"2023-05-17T15:29:19.225640+0000","last_became_peered":"2023-05-17T15:29:19.225640+0000","last_unstale":"2023-05-17T15:29:19.600903+0000","last_undegraded":"2023-05-17T15:29:19.600903+0000","last_fullsized":"2023-05-17T15:29:19.600903+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621150+0000","last_change":"2023-05-17T15:29:19.616827+0000","last_active":"2023-05-17T15:29:19.621150+0000","last_peered":"2023-05-17T15:29:19.621150+0000","last_clean":"2023-05-17T15:29:19.621150+0000","last_became_active":"2023-05-17T15:29:19.616563+0000","last_became_peered":"2023-05-17T15:29:19.616563+0000","last_unstale":"2023-05-17T15:29:19.621150+0000","last_undegraded":"2023-05-17T15:29:19.621150+0000","last_fullsized":"2023-05-17T15:29:19.621150+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599354+0000","last_change":"2023-05-17T15:29:19.224151+0000","last_active":"2023-05-17T15:29:19.599354+0000","last_peered":"2023-05-17T15:29:19.599354+0000","last_clean":"2023-05-17T15:29:19.599354+0000","last_became_active":"2023-05-17T15:29:19.223868+0000","last_became_peered":"2023-05-17T15:29:19.223868+0000","last_unstale":"2023-05-17T15:29:19.599354+0000","last_undegraded":"2023-05-17T15:29:19.599354+0000","last_fullsized":"2023-05-17T15:29:19.599354+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.623524+0000","last_change":"2023-05-17T15:29:19.616909+0000","last_active":"2023-05-17T15:29:19.623524+0000","last_peered":"2023-05-17T15:29:19.623524+0000","last_clean":"2023-05-17T15:29:19.623524+0000","last_became_active":"2023-05-17T15:29:19.616626+0000","last_became_peered":"2023-05-17T15:29:19.616626+0000","last_unstale":"2023-05-17T15:29:19.623524+0000","last_undegraded":"2023-05-17T15:29:19.623524+0000","last_fullsized":"2023-05-17T15:29:19.623524+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.616393+0000","last_change":"2023-05-17T15:29:19.227419+0000","last_active":"2023-05-17T15:29:19.616393+0000","last_peered":"2023-05-17T15:29:19.616393+0000","last_clean":"2023-05-17T15:29:19.616393+0000","last_became_active":"2023-05-17T15:29:19.227004+0000","last_became_peered":"2023-05-17T15:29:19.227004+0000","last_unstale":"2023-05-17T15:29:19.616393+0000","last_undegraded":"2023-05-17T15:29:19.616393+0000","last_fullsized":"2023-05-17T15:29:19.616393+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.623624+0000","last_change":"2023-05-17T15:29:19.618703+0000","last_active":"2023-05-17T15:29:19.623624+0000","last_peered":"2023-05-17T15:29:19.623624+0000","last_clean":"2023-05-17T15:29:19.623624+0000","last_became_active":"2023-05-17T15:29:19.618141+0000","last_became_peered":"2023-05-17T15:29:19.618141+0000","last_unstale":"2023-05-17T15:29:19.623624+0000","last_undegraded":"2023-05-17T15:29:19.623624+0000","last_fullsized":"2023-05-17T15:29:19.623624+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.619491+0000","last_change":"2023-05-17T15:29:19.227367+0000","last_active":"2023-05-17T15:29:19.619491+0000","last_peered":"2023-05-17T15:29:19.619491+0000","last_clean":"2023-05-17T15:29:19.619491+0000","last_became_active":"2023-05-17T15:29:19.227029+0000","last_became_peered":"2023-05-17T15:29:19.227029+0000","last_unstale":"2023-05-17T15:29:19.619491+0000","last_undegraded":"2023-05-17T15:29:19.619491+0000","last_fullsized":"2023-05-17T15:29:19.619491+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614572+0000","last_change":"2023-05-17T15:29:19.607952+0000","last_active":"2023-05-17T15:29:19.614572+0000","last_peered":"2023-05-17T15:29:19.614572+0000","last_clean":"2023-05-17T15:29:19.614572+0000","last_became_active":"2023-05-17T15:29:19.607702+0000","last_became_peered":"2023-05-17T15:29:19.607702+0000","last_unstale":"2023-05-17T15:29:19.614572+0000","last_undegraded":"2023-05-17T15:29:19.614572+0000","last_fullsized":"2023-05-17T15:29:19.614572+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592834+0000","last_change":"2023-05-17T15:29:19.226649+0000","last_active":"2023-05-17T15:29:19.592834+0000","last_peered":"2023-05-17T15:29:19.592834+0000","last_clean":"2023-05-17T15:29:19.592834+0000","last_became_active":"2023-05-17T15:29:19.225847+0000","last_became_peered":"2023-05-17T15:29:19.225847+0000","last_unstale":"2023-05-17T15:29:19.592834+0000","last_undegraded":"2023-05-17T15:29:19.592834+0000","last_fullsized":"2023-05-17T15:29:19.592834+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621002+0000","last_change":"2023-05-17T15:29:19.613816+0000","last_active":"2023-05-17T15:29:19.621002+0000","last_peered":"2023-05-17T15:29:19.621002+0000","last_clean":"2023-05-17T15:29:19.621002+0000","last_became_active":"2023-05-17T15:29:19.613488+0000","last_became_peered":"2023-05-17T15:29:19.613488+0000","last_unstale":"2023-05-17T15:29:19.621002+0000","last_undegraded":"2023-05-17T15:29:19.621002+0000","last_fullsized":"2023-05-17T15:29:19.621002+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.596210+0000","last_change":"2023-05-17T15:29:19.225240+0000","last_active":"2023-05-17T15:29:19.596210+0000","last_peered":"2023-05-17T15:29:19.596210+0000","last_clean":"2023-05-17T15:29:19.596210+0000","last_became_active":"2023-05-17T15:29:19.224910+0000","last_became_peered":"2023-05-17T15:29:19.224910+0000","last_unstale":"2023-05-17T15:29:19.596210+0000","last_undegraded":"2023-05-17T15:29:19.596210+0000","last_fullsized":"2023-05-17T15:29:19.596210+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.623606+0000","last_change":"2023-05-17T15:29:19.618550+0000","last_active":"2023-05-17T15:29:19.623606+0000","last_peered":"2023-05-17T15:29:19.623606+0000","last_clean":"2023-05-17T15:29:19.623606+0000","last_became_active":"2023-05-17T15:29:19.617193+0000","last_became_peered":"2023-05-17T15:29:19.617193+0000","last_unstale":"2023-05-17T15:29:19.623606+0000","last_undegraded":"2023-05-17T15:29:19.623606+0000","last_fullsized":"2023-05-17T15:29:19.623606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.606950+0000","last_change":"2023-05-17T15:29:19.225479+0000","last_active":"2023-05-17T15:29:19.606950+0000","last_peered":"2023-05-17T15:29:19.606950+0000","last_clean":"2023-05-17T15:29:19.606950+0000","last_became_active":"2023-05-17T15:29:19.225162+0000","last_became_peered":"2023-05-17T15:29:19.225162+0000","last_unstale":"2023-05-17T15:29:19.606950+0000","last_undegraded":"2023-05-17T15:29:19.606950+0000","last_fullsized":"2023-05-17T15:29:19.606950+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.603901+0000","last_change":"2023-05-17T15:29:19.601732+0000","last_active":"2023-05-17T15:29:19.603901+0000","last_peered":"2023-05-17T15:29:19.603901+0000","last_clean":"2023-05-17T15:29:19.603901+0000","last_became_active":"2023-05-17T15:29:19.601468+0000","last_became_peered":"2023-05-17T15:29:19.601468+0000","last_unstale":"2023-05-17T15:29:19.603901+0000","last_undegraded":"2023-05-17T15:29:19.603901+0000","last_fullsized":"2023-05-17T15:29:19.603901+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.597154+0000","last_change":"2023-05-17T15:29:19.225875+0000","last_active":"2023-05-17T15:29:19.597154+0000","last_peered":"2023-05-17T15:29:19.597154+0000","last_clean":"2023-05-17T15:29:19.597154+0000","last_became_active":"2023-05-17T15:29:19.225389+0000","last_became_peered":"2023-05-17T15:29:19.225389+0000","last_unstale":"2023-05-17T15:29:19.597154+0000","last_undegraded":"2023-05-17T15:29:19.597154+0000","last_fullsized":"2023-05-17T15:29:19.597154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.619844+0000","last_change":"2023-05-17T15:29:19.615623+0000","last_active":"2023-05-17T15:29:19.619844+0000","last_peered":"2023-05-17T15:29:19.619844+0000","last_clean":"2023-05-17T15:29:19.619844+0000","last_became_active":"2023-05-17T15:29:19.615365+0000","last_became_peered":"2023-05-17T15:29:19.615365+0000","last_unstale":"2023-05-17T15:29:19.619844+0000","last_undegraded":"2023-05-17T15:29:19.619844+0000","last_fullsized":"2023-05-17T15:29:19.619844+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593292+0000","last_change":"2023-05-17T15:29:19.228139+0000","last_active":"2023-05-17T15:29:19.593292+0000","last_peered":"2023-05-17T15:29:19.593292+0000","last_clean":"2023-05-17T15:29:19.593292+0000","last_became_active":"2023-05-17T15:29:19.227706+0000","last_became_peered":"2023-05-17T15:29:19.227706+0000","last_unstale":"2023-05-17T15:29:19.593292+0000","last_undegraded":"2023-05-17T15:29:19.593292+0000","last_fullsized":"2023-05-17T15:29:19.593292+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.604435+0000","last_change":"2023-05-17T15:29:19.601075+0000","last_active":"2023-05-17T15:29:19.604435+0000","last_peered":"2023-05-17T15:29:19.604435+0000","last_clean":"2023-05-17T15:29:19.604435+0000","last_became_active":"2023-05-17T15:29:19.600811+0000","last_became_peered":"2023-05-17T15:29:19.600811+0000","last_unstale":"2023-05-17T15:29:19.604435+0000","last_undegraded":"2023-05-17T15:29:19.604435+0000","last_fullsized":"2023-05-17T15:29:19.604435+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599069+0000","last_change":"2023-05-17T15:29:19.224407+0000","last_active":"2023-05-17T15:29:19.599069+0000","last_peered":"2023-05-17T15:29:19.599069+0000","last_clean":"2023-05-17T15:29:19.599069+0000","last_became_active":"2023-05-17T15:29:19.224060+0000","last_became_peered":"2023-05-17T15:29:19.224060+0000","last_unstale":"2023-05-17T15:29:19.599069+0000","last_undegraded":"2023-05-17T15:29:19.599069+0000","last_fullsized":"2023-05-17T15:29:19.599069+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.617782+0000","last_change":"2023-05-17T15:29:19.614510+0000","last_active":"2023-05-17T15:29:19.617782+0000","last_peered":"2023-05-17T15:29:19.617782+0000","last_clean":"2023-05-17T15:29:19.617782+0000","last_became_active":"2023-05-17T15:29:19.614199+0000","last_became_peered":"2023-05-17T15:29:19.614199+0000","last_unstale":"2023-05-17T15:29:19.617782+0000","last_undegraded":"2023-05-17T15:29:19.617782+0000","last_fullsized":"2023-05-17T15:29:19.617782+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611480+0000","last_change":"2023-05-17T15:29:19.223726+0000","last_active":"2023-05-17T15:29:19.611480+0000","last_peered":"2023-05-17T15:29:19.611480+0000","last_clean":"2023-05-17T15:29:19.611480+0000","last_became_active":"2023-05-17T15:29:19.223436+0000","last_became_peered":"2023-05-17T15:29:19.223436+0000","last_unstale":"2023-05-17T15:29:19.611480+0000","last_undegraded":"2023-05-17T15:29:19.611480+0000","last_fullsized":"2023-05-17T15:29:19.611480+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611425+0000","last_change":"2023-05-17T15:29:19.608663+0000","last_active":"2023-05-17T15:29:19.611425+0000","last_peered":"2023-05-17T15:29:19.611425+0000","last_clean":"2023-05-17T15:29:19.611425+0000","last_became_active":"2023-05-17T15:29:19.608354+0000","last_became_peered":"2023-05-17T15:29:19.608354+0000","last_unstale":"2023-05-17T15:29:19.611425+0000","last_undegraded":"2023-05-17T15:29:19.611425+0000","last_fullsized":"2023-05-17T15:29:19.611425+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.602280+0000","last_change":"2023-05-17T15:29:19.231442+0000","last_active":"2023-05-17T15:29:19.602280+0000","last_peered":"2023-05-17T15:29:19.602280+0000","last_clean":"2023-05-17T15:29:19.602280+0000","last_became_active":"2023-05-17T15:29:19.231112+0000","last_became_peered":"2023-05-17T15:29:19.231112+0000","last_unstale":"2023-05-17T15:29:19.602280+0000","last_undegraded":"2023-05-17T15:29:19.602280+0000","last_fullsized":"2023-05-17T15:29:19.602280+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.614593+0000","last_change":"2023-05-17T15:29:19.609411+0000","last_active":"2023-05-17T15:29:19.614593+0000","last_peered":"2023-05-17T15:29:19.614593+0000","last_clean":"2023-05-17T15:29:19.614593+0000","last_became_active":"2023-05-17T15:29:19.609146+0000","last_became_peered":"2023-05-17T15:29:19.609146+0000","last_unstale":"2023-05-17T15:29:19.614593+0000","last_undegraded":"2023-05-17T15:29:19.614593+0000","last_fullsized":"2023-05-17T15:29:19.614593+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592935+0000","last_change":"2023-05-17T15:29:19.229267+0000","last_active":"2023-05-17T15:29:19.592935+0000","last_peered":"2023-05-17T15:29:19.592935+0000","last_clean":"2023-05-17T15:29:19.592935+0000","last_became_active":"2023-05-17T15:29:19.228233+0000","last_became_peered":"2023-05-17T15:29:19.228233+0000","last_unstale":"2023-05-17T15:29:19.592935+0000","last_undegraded":"2023-05-17T15:29:19.592935+0000","last_fullsized":"2023-05-17T15:29:19.592935+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615731+0000","last_change":"2023-05-17T15:29:19.613734+0000","last_active":"2023-05-17T15:29:19.615731+0000","last_peered":"2023-05-17T15:29:19.615731+0000","last_clean":"2023-05-17T15:29:19.615731+0000","last_became_active":"2023-05-17T15:29:19.611614+0000","last_became_peered":"2023-05-17T15:29:19.611614+0000","last_unstale":"2023-05-17T15:29:19.615731+0000","last_undegraded":"2023-05-17T15:29:19.615731+0000","last_fullsized":"2023-05-17T15:29:19.615731+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.599844+0000","last_change":"2023-05-17T15:29:19.225497+0000","last_active":"2023-05-17T15:29:19.599844+0000","last_peered":"2023-05-17T15:29:19.599844+0000","last_clean":"2023-05-17T15:29:19.599844+0000","last_became_active":"2023-05-17T15:29:19.225214+0000","last_became_peered":"2023-05-17T15:29:19.225214+0000","last_unstale":"2023-05-17T15:29:19.599844+0000","last_undegraded":"2023-05-17T15:29:19.599844+0000","last_fullsized":"2023-05-17T15:29:19.599844+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613514+0000","last_change":"2023-05-17T15:29:19.608432+0000","last_active":"2023-05-17T15:29:19.613514+0000","last_peered":"2023-05-17T15:29:19.613514+0000","last_clean":"2023-05-17T15:29:19.613514+0000","last_became_active":"2023-05-17T15:29:19.607942+0000","last_became_peered":"2023-05-17T15:29:19.607942+0000","last_unstale":"2023-05-17T15:29:19.613514+0000","last_undegraded":"2023-05-17T15:29:19.613514+0000","last_fullsized":"2023-05-17T15:29:19.613514+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.602890+0000","last_change":"2023-05-17T15:29:19.228812+0000","last_active":"2023-05-17T15:29:19.602890+0000","last_peered":"2023-05-17T15:29:19.602890+0000","last_clean":"2023-05-17T15:29:19.602890+0000","last_became_active":"2023-05-17T15:29:19.228540+0000","last_became_peered":"2023-05-17T15:29:19.228540+0000","last_unstale":"2023-05-17T15:29:19.602890+0000","last_undegraded":"2023-05-17T15:29:19.602890+0000","last_fullsized":"2023-05-17T15:29:19.602890+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.611668+0000","last_change":"2023-05-17T15:29:19.609244+0000","last_active":"2023-05-17T15:29:19.611668+0000","last_peered":"2023-05-17T15:29:19.611668+0000","last_clean":"2023-05-17T15:29:19.611668+0000","last_became_active":"2023-05-17T15:29:19.609020+0000","last_became_peered":"2023-05-17T15:29:19.609020+0000","last_unstale":"2023-05-17T15:29:19.611668+0000","last_undegraded":"2023-05-17T15:29:19.611668+0000","last_fullsized":"2023-05-17T15:29:19.611668+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.594217+0000","last_change":"2023-05-17T15:29:19.230855+0000","last_active":"2023-05-17T15:29:19.594217+0000","last_peered":"2023-05-17T15:29:19.594217+0000","last_clean":"2023-05-17T15:29:19.594217+0000","last_became_active":"2023-05-17T15:29:19.228960+0000","last_became_peered":"2023-05-17T15:29:19.228960+0000","last_unstale":"2023-05-17T15:29:19.594217+0000","last_undegraded":"2023-05-17T15:29:19.594217+0000","last_fullsized":"2023-05-17T15:29:19.594217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608305+0000","last_change":"2023-05-17T15:29:19.604180+0000","last_active":"2023-05-17T15:29:19.608305+0000","last_peered":"2023-05-17T15:29:19.608305+0000","last_clean":"2023-05-17T15:29:19.608305+0000","last_became_active":"2023-05-17T15:29:19.603916+0000","last_became_peered":"2023-05-17T15:29:19.603916+0000","last_unstale":"2023-05-17T15:29:19.608305+0000","last_undegraded":"2023-05-17T15:29:19.608305+0000","last_fullsized":"2023-05-17T15:29:19.608305+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.601019+0000","last_change":"2023-05-17T15:29:19.221496+0000","last_active":"2023-05-17T15:29:19.601019+0000","last_peered":"2023-05-17T15:29:19.601019+0000","last_clean":"2023-05-17T15:29:19.601019+0000","last_became_active":"2023-05-17T15:29:19.221198+0000","last_became_peered":"2023-05-17T15:29:19.221198+0000","last_unstale":"2023-05-17T15:29:19.601019+0000","last_undegraded":"2023-05-17T15:29:19.601019+0000","last_fullsized":"2023-05-17T15:29:19.601019+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613512+0000","last_change":"2023-05-17T15:29:19.608783+0000","last_active":"2023-05-17T15:29:19.613512+0000","last_peered":"2023-05-17T15:29:19.613512+0000","last_clean":"2023-05-17T15:29:19.613512+0000","last_became_active":"2023-05-17T15:29:19.608078+0000","last_became_peered":"2023-05-17T15:29:19.608078+0000","last_unstale":"2023-05-17T15:29:19.613512+0000","last_undegraded":"2023-05-17T15:29:19.613512+0000","last_fullsized":"2023-05-17T15:29:19.613512+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608388+0000","last_change":"2023-05-17T15:29:19.235317+0000","last_active":"2023-05-17T15:29:19.608388+0000","last_peered":"2023-05-17T15:29:19.608388+0000","last_clean":"2023-05-17T15:29:19.608388+0000","last_became_active":"2023-05-17T15:29:19.235022+0000","last_became_peered":"2023-05-17T15:29:19.235022+0000","last_unstale":"2023-05-17T15:29:19.608388+0000","last_undegraded":"2023-05-17T15:29:19.608388+0000","last_fullsized":"2023-05-17T15:29:19.608388+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615920+0000","last_change":"2023-05-17T15:29:19.614483+0000","last_active":"2023-05-17T15:29:19.615920+0000","last_peered":"2023-05-17T15:29:19.615920+0000","last_clean":"2023-05-17T15:29:19.615920+0000","last_became_active":"2023-05-17T15:29:19.614206+0000","last_became_peered":"2023-05-17T15:29:19.614206+0000","last_unstale":"2023-05-17T15:29:19.615920+0000","last_undegraded":"2023-05-17T15:29:19.615920+0000","last_fullsized":"2023-05-17T15:29:19.615920+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610098+0000","last_change":"2023-05-17T15:29:19.216276+0000","last_active":"2023-05-17T15:29:19.610098+0000","last_peered":"2023-05-17T15:29:19.610098+0000","last_clean":"2023-05-17T15:29:19.610098+0000","last_became_active":"2023-05-17T15:29:19.215939+0000","last_became_peered":"2023-05-17T15:29:19.215939+0000","last_unstale":"2023-05-17T15:29:19.610098+0000","last_undegraded":"2023-05-17T15:29:19.610098+0000","last_fullsized":"2023-05-17T15:29:19.610098+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592762+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:19.592762+0000","last_peered":"2023-05-17T15:29:19.592762+0000","last_clean":"2023-05-17T15:29:19.592762+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:19.592762+0000","last_undegraded":"2023-05-17T15:29:19.592762+0000","last_fullsized":"2023-05-17T15:29:19.592762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.618222+0000","last_change":"2023-05-17T15:29:19.617119+0000","last_active":"2023-05-17T15:29:19.618222+0000","last_peered":"2023-05-17T15:29:19.618222+0000","last_clean":"2023-05-17T15:29:19.618222+0000","last_became_active":"2023-05-17T15:29:19.616650+0000","last_became_peered":"2023-05-17T15:29:19.616650+0000","last_unstale":"2023-05-17T15:29:19.618222+0000","last_undegraded":"2023-05-17T15:29:19.618222+0000","last_fullsized":"2023-05-17T15:29:19.618222+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608683+0000","last_change":"2023-05-17T15:29:19.213012+0000","last_active":"2023-05-17T15:29:19.608683+0000","last_peered":"2023-05-17T15:29:19.608683+0000","last_clean":"2023-05-17T15:29:19.608683+0000","last_became_active":"2023-05-17T15:29:19.212738+0000","last_became_peered":"2023-05-17T15:29:19.212738+0000","last_unstale":"2023-05-17T15:29:19.608683+0000","last_undegraded":"2023-05-17T15:29:19.608683+0000","last_fullsized":"2023-05-17T15:29:19.608683+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":168,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.601149+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:19.601149+0000","last_peered":"2023-05-17T15:29:19.601149+0000","last_clean":"2023-05-17T15:29:19.601149+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:19.601149+0000","last_undegraded":"2023-05-17T15:29:19.601149+0000","last_fullsized":"2023-05-17T15:29:19.601149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.621482+0000","last_change":"2023-05-17T15:29:19.618654+0000","last_active":"2023-05-17T15:29:19.621482+0000","last_peered":"2023-05-17T15:29:19.621482+0000","last_clean":"2023-05-17T15:29:19.621482+0000","last_became_active":"2023-05-17T15:29:19.618440+0000","last_became_peered":"2023-05-17T15:29:19.618440+0000","last_unstale":"2023-05-17T15:29:19.621482+0000","last_undegraded":"2023-05-17T15:29:19.621482+0000","last_fullsized":"2023-05-17T15:29:19.621482+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.602394+0000","last_change":"2023-05-17T15:29:19.225010+0000","last_active":"2023-05-17T15:29:19.602394+0000","last_peered":"2023-05-17T15:29:19.602394+0000","last_clean":"2023-05-17T15:29:19.602394+0000","last_became_active":"2023-05-17T15:29:19.224310+0000","last_became_peered":"2023-05-17T15:29:19.224310+0000","last_unstale":"2023-05-17T15:29:19.602394+0000","last_undegraded":"2023-05-17T15:29:19.602394+0000","last_fullsized":"2023-05-17T15:29:19.602394+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.592186+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:19.592186+0000","last_peered":"2023-05-17T15:29:19.592186+0000","last_clean":"2023-05-17T15:29:19.592186+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:19.592186+0000","last_undegraded":"2023-05-17T15:29:19.592186+0000","last_fullsized":"2023-05-17T15:29:19.592186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.606506+0000","last_change":"2023-05-17T15:29:19.604387+0000","last_active":"2023-05-17T15:29:19.606506+0000","last_peered":"2023-05-17T15:29:19.606506+0000","last_clean":"2023-05-17T15:29:19.606506+0000","last_became_active":"2023-05-17T15:29:19.604060+0000","last_became_peered":"2023-05-17T15:29:19.604060+0000","last_unstale":"2023-05-17T15:29:19.606506+0000","last_undegraded":"2023-05-17T15:29:19.606506+0000","last_fullsized":"2023-05-17T15:29:19.606506+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.607270+0000","last_change":"2023-05-17T15:29:19.226296+0000","last_active":"2023-05-17T15:29:19.607270+0000","last_peered":"2023-05-17T15:29:19.607270+0000","last_clean":"2023-05-17T15:29:19.607270+0000","last_became_active":"2023-05-17T15:29:19.225506+0000","last_became_peered":"2023-05-17T15:29:19.225506+0000","last_unstale":"2023-05-17T15:29:19.607270+0000","last_undegraded":"2023-05-17T15:29:19.607270+0000","last_fullsized":"2023-05-17T15:29:19.607270+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.602901+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:19.602901+0000","last_peered":"2023-05-17T15:29:19.602901+0000","last_clean":"2023-05-17T15:29:19.602901+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:19.602901+0000","last_undegraded":"2023-05-17T15:29:19.602901+0000","last_fullsized":"2023-05-17T15:29:19.602901+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.608478+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:19.608478+0000","last_peered":"2023-05-17T15:29:19.608478+0000","last_clean":"2023-05-17T15:29:19.608478+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:19.608478+0000","last_undegraded":"2023-05-17T15:29:19.608478+0000","last_fullsized":"2023-05-17T15:29:19.608478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613446+0000","last_change":"2023-05-17T15:29:19.609943+0000","last_active":"2023-05-17T15:29:19.613446+0000","last_peered":"2023-05-17T15:29:19.613446+0000","last_clean":"2023-05-17T15:29:19.613446+0000","last_became_active":"2023-05-17T15:29:19.609389+0000","last_became_peered":"2023-05-17T15:29:19.609389+0000","last_unstale":"2023-05-17T15:29:19.613446+0000","last_undegraded":"2023-05-17T15:29:19.613446+0000","last_fullsized":"2023-05-17T15:29:19.613446+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610520+0000","last_change":"2023-05-17T15:29:19.235573+0000","last_active":"2023-05-17T15:29:19.610520+0000","last_peered":"2023-05-17T15:29:19.610520+0000","last_clean":"2023-05-17T15:29:19.610520+0000","last_became_active":"2023-05-17T15:29:19.231571+0000","last_became_peered":"2023-05-17T15:29:19.231571+0000","last_unstale":"2023-05-17T15:29:19.610520+0000","last_undegraded":"2023-05-17T15:29:19.610520+0000","last_fullsized":"2023-05-17T15:29:19.610520+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.609335+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:19.609335+0000","last_peered":"2023-05-17T15:29:19.609335+0000","last_clean":"2023-05-17T15:29:19.609335+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:19.609335+0000","last_undegraded":"2023-05-17T15:29:19.609335+0000","last_fullsized":"2023-05-17T15:29:19.609335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.615038+0000","last_change":"2023-05-17T15:29:19.613036+0000","last_active":"2023-05-17T15:29:19.615038+0000","last_peered":"2023-05-17T15:29:19.615038+0000","last_clean":"2023-05-17T15:29:19.615038+0000","last_became_active":"2023-05-17T15:29:19.612762+0000","last_became_peered":"2023-05-17T15:29:19.612762+0000","last_unstale":"2023-05-17T15:29:19.615038+0000","last_undegraded":"2023-05-17T15:29:19.615038+0000","last_fullsized":"2023-05-17T15:29:19.615038+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.598513+0000","last_change":"2023-05-17T15:29:19.228646+0000","last_active":"2023-05-17T15:29:19.598513+0000","last_peered":"2023-05-17T15:29:19.598513+0000","last_clean":"2023-05-17T15:29:19.598513+0000","last_became_active":"2023-05-17T15:29:19.228343+0000","last_became_peered":"2023-05-17T15:29:19.228343+0000","last_unstale":"2023-05-17T15:29:19.598513+0000","last_undegraded":"2023-05-17T15:29:19.598513+0000","last_fullsized":"2023-05-17T15:29:19.598513+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.617826+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:19.617826+0000","last_peered":"2023-05-17T15:29:19.617826+0000","last_clean":"2023-05-17T15:29:19.617826+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:19.617826+0000","last_undegraded":"2023-05-17T15:29:19.617826+0000","last_fullsized":"2023-05-17T15:29:19.617826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.613852+0000","last_change":"2023-05-17T15:29:19.606496+0000","last_active":"2023-05-17T15:29:19.613852+0000","last_peered":"2023-05-17T15:29:19.613852+0000","last_clean":"2023-05-17T15:29:19.613852+0000","last_became_active":"2023-05-17T15:29:19.606053+0000","last_became_peered":"2023-05-17T15:29:19.606053+0000","last_unstale":"2023-05-17T15:29:19.613852+0000","last_undegraded":"2023-05-17T15:29:19.613852+0000","last_fullsized":"2023-05-17T15:29:19.613852+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.595495+0000","last_change":"2023-05-17T15:29:19.213501+0000","last_active":"2023-05-17T15:29:19.595495+0000","last_peered":"2023-05-17T15:29:19.595495+0000","last_clean":"2023-05-17T15:29:19.595495+0000","last_became_active":"2023-05-17T15:29:19.213181+0000","last_became_peered":"2023-05-17T15:29:19.213181+0000","last_unstale":"2023-05-17T15:29:19.595495+0000","last_undegraded":"2023-05-17T15:29:19.595495+0000","last_fullsized":"2023-05-17T15:29:19.595495+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.593254+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:19.593254+0000","last_peered":"2023-05-17T15:29:19.593254+0000","last_clean":"2023-05-17T15:29:19.593254+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:19.593254+0000","last_undegraded":"2023-05-17T15:29:19.593254+0000","last_fullsized":"2023-05-17T15:29:19.593254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.610169+0000","last_change":"2023-05-17T15:29:19.606762+0000","last_active":"2023-05-17T15:29:19.610169+0000","last_peered":"2023-05-17T15:29:19.610169+0000","last_clean":"2023-05-17T15:29:19.610169+0000","last_became_active":"2023-05-17T15:29:19.606500+0000","last_became_peered":"2023-05-17T15:29:19.606500+0000","last_unstale":"2023-05-17T15:29:19.610169+0000","last_undegraded":"2023-05-17T15:29:19.610169+0000","last_fullsized":"2023-05-17T15:29:19.610169+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:19.198069+0000","last_clean_scrub_stamp":"2023-05-17T15:29:19.198069+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.619871+0000","last_change":"2023-05-17T15:29:19.231397+0000","last_active":"2023-05-17T15:29:19.619871+0000","last_peered":"2023-05-17T15:29:19.619871+0000","last_clean":"2023-05-17T15:29:19.619871+0000","last_became_active":"2023-05-17T15:29:19.231080+0000","last_became_peered":"2023-05-17T15:29:19.231080+0000","last_unstale":"2023-05-17T15:29:19.619871+0000","last_undegraded":"2023-05-17T15:29:19.619871+0000","last_fullsized":"2023-05-17T15:29:19.619871+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:18.195981+0000","last_clean_scrub_stamp":"2023-05-17T15:29:18.195981+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-05-17T15:29:19.596179+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:19.596179+0000","last_peered":"2023-05-17T15:29:19.596179+0000","last_clean":"2023-05-17T15:29:19.596179+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:19.596179+0000","last_undegraded":"2023-05-17T15:29:19.596179+0000","last_fullsized":"2023-05-17T15:29:19.596179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575268,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21120,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":18944,"kb_avail":94350720,"statfs":{"total":96636764160,"available":96615137280,"internally_reserved":0,"allocated":2220032,"data_stored":1128004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19398656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79100000000000004}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.94899999999999995}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575269,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20788,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351052,"statfs":{"total":96636764160,"available":96615477248,"internally_reserved":0,"allocated":2207744,"data_stored":1126536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.623},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.53200000000000003}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70099999999999996}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.434}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.58099999999999996}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71699999999999997}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.79600000000000004}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575269,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20156,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":17984,"kb_avail":94351684,"statfs":{"total":96636764160,"available":96616124416,"internally_reserved":0,"allocated":2215936,"data_stored":1127160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18415616},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.254},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.29099999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575269,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20740,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":18560,"kb_avail":94351100,"statfs":{"total":96636764160,"available":96615526400,"internally_reserved":0,"allocated":2224128,"data_stored":1127304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19005440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.436}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.377},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.37}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.501},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.505},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575268,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21824,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":19648,"kb_avail":94350016,"statfs":{"total":96636764160,"available":96614416384,"internally_reserved":0,"allocated":2220032,"data_stored":1126718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20119552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.24099999999999999},"max":{"1min":0.628,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.314}]},{"osd":1,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61799999999999999,"5min":1.254,"15min":1.254},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45200000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70799999999999996,"5min":1.04,"15min":1.04},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94499999999999995,"5min":1.0700000000000001,"15min":1.125},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90800000000000003,"5min":0.96099999999999997,"15min":0.98799999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99399999999999999,"5min":1.0249999999999999,"15min":1.1890000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Wed May 17 15:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.21},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575269,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28792,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":26624,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":2211840,"data_stored":1126570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27262976},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.33500000000000002}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45800000000000002}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.65500000000000003}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.627},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575268,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20860,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350980,"statfs":{"total":96636764160,"available":96615403520,"internally_reserved":0,"allocated":2215936,"data_stored":1127180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.47299999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.501}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575268,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":25984,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":2211840,"data_stored":1127428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26607616},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.81399999999999995}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.77400000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68500000000000005}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:28.447 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T15:29:28.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-17T15:29:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.597+0000 7fd6b9454700 1 Processor -- start 2023-05-17T15:29:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b9454700 1 -- start start 2023-05-17T15:29:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b9454700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6b40c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b9454700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b4066440 con 0x7fd6b4065970 2023-05-17T15:29:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b9454700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b40c3c50 con 0x7fd6b4153e90 2023-05-17T15:29:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b9454700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40c3f30 con 0x7fd6b4154270 2023-05-17T15:29:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd6b4065970 0x7fd6b4067cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46182/0 (socket says 172.21.15.27:46182) 2023-05-17T15:29:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.598+0000 7fd6b37fe700 1 -- 172.21.15.27:0/322534070 learned_addr learned my addr 172.21.15.27:0/322534070 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b27fc700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6b40c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610558716 0 0) 0x7fd6b4066440 con 0x7fd6b4065970 2023-05-17T15:29:28.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a00033f0 con 0x7fd6b4065970 2023-05-17T15:29:28.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2216866941 0 0) 0x7fd6a00033f0 con 0x7fd6b4065970 2023-05-17T15:29:28.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 msgr2=0x7fd6b40c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:28.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6b40c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 >> v1:172.21.15.40:6789/0 conn(0x7fd6b4153e90 legacy=0x7fd6b4065260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40c4210 con 0x7fd6b4065970 2023-05-17T15:29:28.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fd6a4001470 con 0x7fd6b4065970 2023-05-17T15:29:28.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 >> v1:172.21.15.27:6789/0 conn(0x7fd6b4065970 legacy=0x7fd6b4067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a0003910 0x7fd6a0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a0004b80 0x7fd6a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40c3f30 con 0x7fd6a0004b80 2023-05-17T15:29:28.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a000b8e0 con 0x7fd6a0003910 2023-05-17T15:29:28.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a000ba50 con 0x7fd6b4154270 2023-05-17T15:29:28.611 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b37fe700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a0004b80 0x7fd6a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b27fc700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.599+0000 7fd6b2ffd700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a0003910 0x7fd6a0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 -- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 msgr2=0x7fd6a0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6a0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 -- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a0003910 msgr2=0x7fd6a0003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a0003910 0x7fd6a0003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 -- 172.21.15.27:0/322534070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00033f0 con 0x7fd6a0004b80 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b27fc700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4154270 0x7fd6a0004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b2ffd700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a0003910 0x7fd6a0003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a0004b80 0x7fd6a0005000 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fd6a400c160 tx=0x7fd6a4001e70).ready entity=mon.0 client_cookie=fb6100d04d78c1c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4007a40 con 0x7fd6a0004b80 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a400ca30 con 0x7fd6a0004b80 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b1ffb700 1 -- 172.21.15.27:0/322534070 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400cdb0 con 0x7fd6a0004b80 2023-05-17T15:29:28.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b9454700 1 -- 172.21.15.27:0/322534070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a0004b80 msgr2=0x7fd6a0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b9454700 1 --2- 172.21.15.27:0/322534070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a0004b80 0x7fd6a0005000 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fd6a400c160 tx=0x7fd6a4001e70).stop 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b37fe700 1 -- 172.21.15.27:0/322534070 reap_dead start 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b9454700 1 -- 172.21.15.27:0/322534070 shutdown_connections 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b9454700 1 -- 172.21.15.27:0/322534070 >> 172.21.15.27:0/322534070 conn(0x7fd6b40c9310 msgr2=0x7fd6b40c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b9454700 1 -- 172.21.15.27:0/322534070 shutdown_connections 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.600+0000 7fd6b9454700 1 -- 172.21.15.27:0/322534070 wait complete. 2023-05-17T15:29:28.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 Processor -- start 2023-05-17T15:29:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 -- start start 2023-05-17T15:29:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b414d6d0 0x7fd6b40ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 0x7fd6b40ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b40ab960 0x7fd6b40abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4151550 con 0x7fd6b414dab0 2023-05-17T15:29:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4151ad0 con 0x7fd6b40ab960 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.602+0000 7fd6b9454700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40ac2b0 con 0x7fd6b414d6d0 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 0x7fd6b40ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 0x7fd6b40ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46632/0 (socket says 172.21.15.27:46632) 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 -- 172.21.15.27:0/1319434223 learned_addr learned my addr 172.21.15.27:0/1319434223 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b2ffd700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b414d6d0 0x7fd6b40ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b37fe700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b40ab960 0x7fd6b40abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 -- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b414d6d0 msgr2=0x7fd6b40ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b414d6d0 0x7fd6b40ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 -- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b40ab960 msgr2=0x7fd6b40abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b40ab960 0x7fd6b40abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 -- 172.21.15.27:0/1319434223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40ae440 con 0x7fd6b414dab0 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b37fe700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b40ab960 0x7fd6b40abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b2ffd700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b414d6d0 0x7fd6b40ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b27fc700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 0x7fd6b40ade70 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fd69c011760 tx=0x7fd69c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c015690 con 0x7fd6b414dab0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c0157f0 con 0x7fd6b414dab0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c015b70 con 0x7fd6b414dab0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b40ae720 con 0x7fd6b414dab0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.603+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b40a8370 con 0x7fd6b414dab0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.604+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b405e140 con 0x7fd6b414dab0 2023-05-17T15:29:28.620 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.605+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd69c025070 con 0x7fd6b414dab0 2023-05-17T15:29:28.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.605+0000 7fd6aaffd700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd69405ed90 0x7fd694061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.606+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fd69c07a510 con 0x7fd6b414dab0 2023-05-17T15:29:28.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.606+0000 7fd6b2ffd700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd69405ed90 0x7fd694061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.606+0000 7fd6b2ffd700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd69405ed90 0x7fd694061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd6ac004270 tx=0x7fd6ac009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.611+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd69c04b920 con 0x7fd6b414dab0 2023-05-17T15:29:28.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.854+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fd6b40637d0 con 0x7fd6b414dab0 2023-05-17T15:29:28.861 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.857+0000 7fd6aaffd700 1 -- 172.21.15.27:0/1319434223 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd69c0190e0 con 0x7fd6b414dab0 2023-05-17T15:29:28.863 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd69405ed90 msgr2=0x7fd694061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd69405ed90 0x7fd694061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd6ac004270 tx=0x7fd6ac009040).stop 2023-05-17T15:29:28.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 msgr2=0x7fd6b40ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 0x7fd6b40ade70 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fd69c011760 tx=0x7fd69c008040).stop 2023-05-17T15:29:28.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 shutdown_connections 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd69405ed90 0x7fd694061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b40ab960 0x7fd6b40abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b414d6d0 0x7fd6b40ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 --2- 172.21.15.27:0/1319434223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6b414dab0 0x7fd6b40ade70 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 >> 172.21.15.27:0/1319434223 conn(0x7fd6b40c9310 msgr2=0x7fd6b4069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 shutdown_connections 2023-05-17T15:29:28.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.859+0000 7fd6b9454700 1 -- 172.21.15.27:0/1319434223 wait complete. 2023-05-17T15:29:28.866 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2023-05-17T15:29:28.875 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:28.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.986+0000 7f06deb7b700 1 Processor -- start 2023-05-17T15:29:28.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.986+0000 7f06deb7b700 1 -- start start 2023-05-17T15:29:28.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06deb7b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06d80c60c0 0x7f06d80c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06deb7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 0x7f06d80c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06deb7b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d805e7e0 con 0x7f06d80a9f70 2023-05-17T15:29:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06deb7b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d805eac0 con 0x7f06d80c60c0 2023-05-17T15:29:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06deb7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80bfd70 con 0x7f06d80aa3b0 2023-05-17T15:29:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06dd118700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 0x7f06d80c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06dc917700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06d80c60c0 0x7f06d80c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.987+0000 7f06dd118700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 0x7f06d80c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.27:47752/0 (socket says 172.21.15.27:47752) 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06dd118700 1 -- 172.21.15.27:0/581432189 learned_addr learned my addr 172.21.15.27:0/581432189 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06d77fe700 1 -- 172.21.15.27:0/581432189 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895910374 0 0) 0x7f06d805e7e0 con 0x7f06d80a9f70 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06dd118700 1 -- 172.21.15.27:0/581432189 >> v2:172.21.15.40:3300/0 conn(0x7f06d80c60c0 msgr2=0x7f06d80c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06dd118700 1 --2- 172.21.15.27:0/581432189 >> v2:172.21.15.40:3300/0 conn(0x7f06d80c60c0 0x7f06d80c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06dd118700 1 -- 172.21.15.27:0/581432189 >> v1:172.21.15.40:6789/0 conn(0x7f06d80a9f70 legacy=0x7f06d8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06dd118700 1 -- 172.21.15.27:0/581432189 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80c0050 con 0x7f06d80aa3b0 2023-05-17T15:29:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06dd118700 1 --2- 172.21.15.27:0/581432189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 0x7f06d80c0850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f06c8006fd0 tx=0x7f06c80090f0).ready entity=mon.2 client_cookie=3a45a9d17e0a0a21 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06d77fe700 1 -- 172.21.15.27:0/581432189 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800b580 con 0x7f06d80aa3b0 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06d77fe700 1 -- 172.21.15.27:0/581432189 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c800b6e0 con 0x7f06d80aa3b0 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.988+0000 7f06d77fe700 1 -- 172.21.15.27:0/581432189 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800ba60 con 0x7f06d80aa3b0 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 -- 172.21.15.27:0/581432189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 msgr2=0x7f06d80c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 --2- 172.21.15.27:0/581432189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 0x7f06d80c0850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f06c8006fd0 tx=0x7f06c80090f0).stop 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 -- 172.21.15.27:0/581432189 shutdown_connections 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 --2- 172.21.15.27:0/581432189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80aa3b0 0x7f06d80c0850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.996 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 --2- 172.21.15.27:0/581432189 >> v2:172.21.15.40:3300/0 conn(0x7f06d80c60c0 0x7f06d80c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 -- 172.21.15.27:0/581432189 >> 172.21.15.27:0/581432189 conn(0x7f06d8069e70 msgr2=0x7f06d805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 -- 172.21.15.27:0/581432189 shutdown_connections 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.989+0000 7f06deb7b700 1 -- 172.21.15.27:0/581432189 wait complete. 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.990+0000 7f06deb7b700 1 Processor -- start 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.990+0000 7f06deb7b700 1 -- start start 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 0x7f06d8147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d80aa3b0 0x7f06d80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80c60c0 0x7f06d8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8147630 con 0x7f06d80a9f70 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80caf90 con 0x7f06d80aa3b0 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80ca610 con 0x7f06d80c60c0 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 0x7f06d8147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 0x7f06d8147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46644/0 (socket says 172.21.15.27:46644) 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 -- 172.21.15.27:0/1166669906 learned_addr learned my addr 172.21.15.27:0/1166669906 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06d7fff700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d80aa3b0 0x7f06d80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dd118700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80c60c0 0x7f06d8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 -- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80c60c0 msgr2=0x7f06d8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80c60c0 0x7f06d8155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 -- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d80aa3b0 msgr2=0x7f06d80caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d80aa3b0 0x7f06d80caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 -- 172.21.15.27:0/1166669906 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8009370 con 0x7f06d80a9f70 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06dc917700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 0x7f06d8147140 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f06d0009e50 tx=0x7f06d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:28.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000cbc0 con 0x7f06d80a9f70 2023-05-17T15:29:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000f040 con 0x7f06d80a9f70 2023-05-17T15:29:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d8155620 con 0x7f06d80a9f70 2023-05-17T15:29:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0013400 con 0x7f06d80a9f70 2023-05-17T15:29:29.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.991+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d80c9ab0 con 0x7f06d80a9f70 2023-05-17T15:29:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.992+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d805f4a0 con 0x7f06d80a9f70 2023-05-17T15:29:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.993+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f06d0013770 con 0x7f06d80a9f70 2023-05-17T15:29:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.993+0000 7f06d4ff9700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f06c405ed90 0x7f06c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.993+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f06d007a530 con 0x7f06d80a9f70 2023-05-17T15:29:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.993+0000 7f06d7fff700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f06c405ed90 0x7f06c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.994+0000 7f06d7fff700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f06c405ed90 0x7f06c4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f06cc0011e0 tx=0x7f06cc009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:28.997+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06d004ba50 con 0x7f06d80a9f70 2023-05-17T15:29:29.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.213+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06d806bdf0 con 0x7f06d80a9f70 2023-05-17T15:29:29.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.214+0000 7f06d4ff9700 1 -- 172.21.15.27:0/1166669906 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f06d004f070 con 0x7f06d80a9f70 2023-05-17T15:29:29.218 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:29.218 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:29:19.585435+0000","modified":"2023-05-17T15:29:22.589859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8988":{"gid":8988,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3491718569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3491718569},{"type":"v1","addr":"172.21.15.27:6835","nonce":3491718569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-17T15:29:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f06c405ed90 msgr2=0x7f06c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f06c405ed90 0x7f06c4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f06cc0011e0 tx=0x7f06cc009040).stop 2023-05-17T15:29:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 msgr2=0x7f06d8147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 0x7f06d8147140 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f06d0009e50 tx=0x7f06d000b040).stop 2023-05-17T15:29:29.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 shutdown_connections 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f06c405ed90 0x7f06c4061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d80c60c0 0x7f06d8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06d80a9f70 0x7f06d8147140 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 --2- 172.21.15.27:0/1166669906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d80aa3b0 0x7f06d80caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 >> 172.21.15.27:0/1166669906 conn(0x7f06d8069e70 msgr2=0x7f06d814e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 shutdown_connections 2023-05-17T15:29:29.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.216+0000 7f06deb7b700 1 -- 172.21.15.27:0/1166669906 wait complete. 2023-05-17T15:29:29.222 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 74 2023-05-17T15:29:29.633 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T15:29:19.585435+0000', 'modified': '2023-05-17T15:29:22.589859+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8988}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8988': {'gid': 8988, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/3491718569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 3491718569}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 3491718569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-17T15:29:29.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T15:29:29.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-17T15:29:29.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.750+0000 7fdf2fe89700 1 Processor -- start 2023-05-17T15:29:29.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.750+0000 7fdf2fe89700 1 -- start start 2023-05-17T15:29:29.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2fe89700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdf28154090 0x7fdf28154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2fe89700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf280c5a50 con 0x7fdf280cb450 2023-05-17T15:29:29.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2fe89700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf280c04e0 con 0x7fdf28069610 2023-05-17T15:29:29.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2fe89700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf28069fa0 con 0x7fdf28154090 2023-05-17T15:29:29.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2dc25700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdf28154090 0x7fdf28154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.757 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2d424700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdf280cb450 0x7fdf28068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46216/0 (socket says 172.21.15.27:46216) 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.751+0000 7fdf2d424700 1 -- 172.21.15.27:0/4057528508 learned_addr learned my addr 172.21.15.27:0/4057528508 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2dc25700 1 -- 172.21.15.27:0/4057528508 >> v1:172.21.15.40:6789/0 conn(0x7fdf28069610 legacy=0x7fdf280c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2dc25700 1 -- 172.21.15.27:0/4057528508 >> v1:172.21.15.27:6789/0 conn(0x7fdf280cb450 legacy=0x7fdf28068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2cc23700 1 -- 172.21.15.27:0/4057528508 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331972803 0 0) 0x7fdf280c5a50 con 0x7fdf280cb450 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2dc25700 1 -- 172.21.15.27:0/4057528508 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280c0760 con 0x7fdf28154090 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/4057528508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28154090 0x7fdf28154470 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7fdf20009760 tx=0x7fdf20009060).ready entity=mon.0 client_cookie=8c1f24c070d17c6b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2cc23700 1 -- 172.21.15.27:0/4057528508 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000b520 con 0x7fdf28154090 2023-05-17T15:29:29.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2cc23700 1 -- 172.21.15.27:0/4057528508 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000b680 con 0x7fdf28154090 2023-05-17T15:29:29.759 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2cc23700 1 -- 172.21.15.27:0/4057528508 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000ba00 con 0x7fdf28154090 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2fe89700 1 -- 172.21.15.27:0/4057528508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28154090 msgr2=0x7fdf28154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.752+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/4057528508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28154090 0x7fdf28154470 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7fdf20009760 tx=0x7fdf20009060).stop 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.753+0000 7fdf2fe89700 1 -- 172.21.15.27:0/4057528508 shutdown_connections 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.753+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/4057528508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28154090 0x7fdf28154470 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.753+0000 7fdf2fe89700 1 -- 172.21.15.27:0/4057528508 >> 172.21.15.27:0/4057528508 conn(0x7fdf2805e7e0 msgr2=0x7fdf280cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.753+0000 7fdf2fe89700 1 -- 172.21.15.27:0/4057528508 shutdown_connections 2023-05-17T15:29:29.761 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.753+0000 7fdf2fe89700 1 -- 172.21.15.27:0/4057528508 wait complete. 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 Processor -- start 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 -- start start 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 0x7fdf28156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf280cb450 0x7fdf2814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28154090 0x7fdf28153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280b0050 con 0x7fdf28069610 2023-05-17T15:29:29.762 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281555d0 con 0x7fdf28154090 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.754+0000 7fdf2fe89700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281558b0 con 0x7fdf280cb450 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 0x7fdf28156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 0x7fdf28156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46658/0 (socket says 172.21.15.27:46658) 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 -- 172.21.15.27:0/673526470 learned_addr learned my addr 172.21.15.27:0/673526470 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2e426700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28154090 0x7fdf28153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2d424700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf280cb450 0x7fdf2814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 -- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf280cb450 msgr2=0x7fdf2814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf280cb450 0x7fdf2814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 -- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28154090 msgr2=0x7fdf28153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28154090 0x7fdf28153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 -- 172.21.15.27:0/673526470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200092a0 con 0x7fdf28069610 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2d424700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf280cb450 0x7fdf2814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 0x7fdf28156670 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7fdf20009eb0 tx=0x7fdf20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf25ffb700 1 -- 172.21.15.27:0/673526470 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000b7f0 con 0x7fdf28069610 2023-05-17T15:29:29.764 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf25ffb700 1 -- 172.21.15.27:0/673526470 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000b950 con 0x7fdf28069610 2023-05-17T15:29:29.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf28155b90 con 0x7fdf28069610 2023-05-17T15:29:29.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf25ffb700 1 -- 172.21.15.27:0/673526470 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2001b670 con 0x7fdf28069610 2023-05-17T15:29:29.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.755+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf28156150 con 0x7fdf28069610 2023-05-17T15:29:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.757+0000 7fdf25ffb700 1 -- 172.21.15.27:0/673526470 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdf2002a070 con 0x7fdf28069610 2023-05-17T15:29:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.757+0000 7fdf25ffb700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdf1405ed60 0x7fdf14061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.757+0000 7fdf25ffb700 1 -- 172.21.15.27:0/673526470 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fdf2007b350 con 0x7fdf28069610 2023-05-17T15:29:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.757+0000 7fdf2d424700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdf1405ed60 0x7fdf14061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.758+0000 7fdf2d424700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdf1405ed60 0x7fdf14061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdf28157e20 tx=0x7fdf1c009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.759+0000 7fdf4181bb80 1 Processor -- start 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.759+0000 7fdf4181bb80 1 -- start start 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c26bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c288940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c23e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c2095e0 con 0x563d9c288560 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c1808a0 con 0x563d9c28d480 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d9c195900 con 0x563d9c244300 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c26bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c26bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46666/0 (socket says 172.21.15.27:46666) 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 -- 172.21.15.27:0/139247467 learned_addr learned my addr 172.21.15.27:0/139247467 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2d424700 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c288940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 -- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 msgr2=0x563d9c23e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c23e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 -- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 msgr2=0x563d9c288940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c288940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 -- 172.21.15.27:0/139247467 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d9c209450 con 0x563d9c288560 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c26bc50 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fdf200500f0 tx=0x7fdf2000e000).ready entity=mon.0 client_cookie=52e6dcd699bef523 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf0effd700 1 -- 172.21.15.27:0/139247467 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2004e8d0 con 0x563d9c288560 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf0effd700 1 -- 172.21.15.27:0/139247467 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200791d0 con 0x563d9c288560 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.760+0000 7fdf0effd700 1 -- 172.21.15.27:0/139247467 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20079340 con 0x563d9c288560 2023-05-17T15:29:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 -- 172.21.15.27:0/139247467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 msgr2=0x563d9c26bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c26bc50 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fdf200500f0 tx=0x7fdf2000e000).stop 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 -- 172.21.15.27:0/139247467 shutdown_connections 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c23e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c26bc50 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/139247467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c288940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 -- 172.21.15.27:0/139247467 >> 172.21.15.27:0/139247467 conn(0x563d9c000e40 msgr2=0x563d9c28c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 -- 172.21.15.27:0/139247467 shutdown_connections 2023-05-17T15:29:29.771 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.761+0000 7fdf4181bb80 1 -- 172.21.15.27:0/139247467 wait complete. 2023-05-17T15:29:29.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.762+0000 7fdf4181bb80 1 -- start start 2023-05-17T15:29:29.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.762+0000 7fdf4181bb80 1 Processor -- start 2023-05-17T15:29:29.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c298ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c23f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c26ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c15ced0 con 0x563d9c288560 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c2854a0 con 0x563d9c244300 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d9c23e270 con 0x563d9c28d480 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 10 client.0 ll_register_callbacks cb 0x563d9c2031f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c23f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c23f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46674/0 (socket says 172.21.15.27:46674) 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 -- 172.21.15.27:0/836124152 learned_addr learned my addr 172.21.15.27:0/836124152 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c298ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 -- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 msgr2=0x563d9c26ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c26ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 -- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 msgr2=0x563d9c298ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c298ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 -- 172.21.15.27:0/836124152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf28156150 con 0x563d9c288560 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c298ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf2d424700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c23f560 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fdf1c005b20 tx=0x7fdf1c007000).ready entity=mon.0 client_cookie=578e1aed86dcb18f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf07fff700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf07fff700 1 -- 172.21.15.27:0/836124152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c01b070 con 0x563d9c288560 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf07fff700 1 -- 172.21.15.27:0/836124152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fdf1c00dbd0 con 0x563d9c288560 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d9c237460 con 0x563d9c288560 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf07fff700 1 -- 172.21.15.27:0/836124152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf1c00dd90 con 0x563d9c288560 2023-05-17T15:29:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.763+0000 7fdf4181bb80 10 client.9159 fetch_fsmap learned FSMap version 74 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x563d9c038310 con 0x563d9c288560 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf07fff700 1 -- 172.21.15.27:0/836124152 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d9c237460 con 0x563d9c288560 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf07fff700 1 -- 172.21.15.27:0/836124152 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf1c015470 con 0x563d9c288560 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 10 client.9159 fetch_fsmap finished waiting for FSMap version 74 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 10 client.9159 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 20 client.9159 populate_metadata read hostname 'smithi027' 2023-05-17T15:29:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c284ea0 0x563d9c29ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 4 client.9159 mds_command: new command op to 8988 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 --> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d9bffcca0 con 0x563d9c284ea0 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c284ea0 0x563d9c29ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf07fff700 10 client.9159 ms_handle_connect on v2:172.21.15.27:6833/3491718569 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.764+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c284ea0 0x563d9c29ba70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2f7a45284abc6b35 server_cookie=6fa0b9498347e67e in_seq=0 out_seq=0 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf07fff700 1 -- 172.21.15.27:0/836124152 <== mds.0 v2:172.21.15.27:6833/3491718569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x563d9bffcca0 con 0x563d9c284ea0 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf07fff700 10 client.9159 handle_command_reply: tid=0 2023-05-17T15:29:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 client.9159 shutdown 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 msgr2=0x563d9c23f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c23f560 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fdf1c005b20 tx=0x7fdf1c007000).stop 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 shutdown_connections 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c284ea0 0x563d9c29ba70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c26ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf07fff700 0 client.9159 ms_handle_reset on v2:172.21.15.27:6833/3491718569 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c298ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/836124152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c23f560 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 >> 172.21.15.27:0/836124152 conn(0x563d9c000e40 msgr2=0x563d9c28c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 shutdown_connections 2023-05-17T15:29:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 1 -- 172.21.15.27:0/836124152 wait complete. 2023-05-17T15:29:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.765+0000 7fdf4181bb80 20 client.9159 trim_cache size 0 max 16384 2023-05-17T15:29:29.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 Processor -- start 2023-05-17T15:29:29.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 -- start start 2023-05-17T15:29:29.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c243870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.788 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c297da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c23ac90 con 0x563d9c288560 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c298290 con 0x563d9c244300 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.782+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d9c28d0e0 con 0x563d9c28d480 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46684/0 (socket says 172.21.15.27:46684) 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 -- 172.21.15.27:0/2099748697 learned_addr learned my addr 172.21.15.27:0/2099748697 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2e426700 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c297da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.789 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c243870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 -- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 msgr2=0x563d9c297da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c297da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 -- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 msgr2=0x563d9c243870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c243870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 -- 172.21.15.27:0/2099748697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d9c18e880 con 0x563d9c288560 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c243870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:29.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf2d424700 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2978b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7fdf1c009010 tx=0x7fdf1c012000).ready entity=mon.0 client_cookie=a69eca46eb6b85a0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf0f7fe700 1 -- 172.21.15.27:0/2099748697 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c015470 con 0x563d9c288560 2023-05-17T15:29:29.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf0f7fe700 1 -- 172.21.15.27:0/2099748697 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0155d0 con 0x563d9c288560 2023-05-17T15:29:29.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.783+0000 7fdf0f7fe700 1 -- 172.21.15.27:0/2099748697 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c015c60 con 0x563d9c288560 2023-05-17T15:29:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 -- 172.21.15.27:0/2099748697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 msgr2=0x563d9c2978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2978b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7fdf1c009010 tx=0x7fdf1c012000).stop 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 -- 172.21.15.27:0/2099748697 shutdown_connections 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c28d480 0x563d9c297da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c244300 0x563d9c243870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/2099748697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2978b0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 -- 172.21.15.27:0/2099748697 >> 172.21.15.27:0/2099748697 conn(0x563d9c000e40 msgr2=0x563d9c283f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 -- 172.21.15.27:0/2099748697 shutdown_connections 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 -- 172.21.15.27:0/2099748697 wait complete. 2023-05-17T15:29:29.795 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 -- start start 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.784+0000 7fdf4181bb80 1 Processor -- start 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c2ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2a1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c2a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c2aaef0 con 0x563d9c288560 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9c2a1ff0 con 0x563d9c28d480 2023-05-17T15:29:29.796 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d9c2aa720 con 0x563d9c244300 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf4181bb80 10 client.0 ll_register_callbacks cb 0x563d9c2031f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf2d424700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf2d424700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46688/0 (socket says 172.21.15.27:46688) 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.785+0000 7fdf2d424700 1 -- 172.21.15.27:0/4213771512 learned_addr learned my addr 172.21.15.27:0/4213771512 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2e426700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c2a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c2ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2d424700 1 -- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 msgr2=0x563d9c2ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.797 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2d424700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c2ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2d424700 1 -- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 msgr2=0x563d9c2a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2d424700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c2a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2d424700 1 -- 172.21.15.27:0/4213771512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d9c038310 con 0x563d9c288560 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c2ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf2d424700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2a1610 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fdf1c015fd0 tx=0x7fdf1c02d070).ready entity=mon.0 client_cookie=fedd2e655ab13167 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf07fff700 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf07fff700 1 -- 172.21.15.27:0/4213771512 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c039030 con 0x563d9c288560 2023-05-17T15:29:29.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf07fff700 1 -- 172.21.15.27:0/4213771512 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fdf1c03a070 con 0x563d9c288560 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d9c033ca0 con 0x563d9c288560 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf07fff700 1 -- 172.21.15.27:0/4213771512 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf1c015c10 con 0x563d9c288560 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 10 client.9165 fetch_fsmap learned FSMap version 74 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x563d9c18a070 con 0x563d9c288560 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf07fff700 1 -- 172.21.15.27:0/4213771512 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d9c033ca0 con 0x563d9c288560 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf07fff700 1 -- 172.21.15.27:0/4213771512 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf1c00dad0 con 0x563d9c288560 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 10 client.9165 fetch_fsmap finished waiting for FSMap version 74 2023-05-17T15:29:29.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 10 client.9165 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 20 client.9165 populate_metadata read hostname 'smithi027' 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c26b980 0x563d9c26bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.786+0000 7fdf4181bb80 4 client.9165 mds_command: new command op to 8988 tid=0[{"prefix": "status"}] 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 --> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563d9c062540 con 0x563d9c26b980 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c26b980 0x563d9c26bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf2dc25700 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c26b980 0x563d9c26bd60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=49a6d6f62a3b5741 server_cookie=37182a974ac8921b in_seq=0 out_seq=0 2023-05-17T15:29:29.800 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf07fff700 10 client.9165 ms_handle_connect on v2:172.21.15.27:6833/3491718569 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf07fff700 1 -- 172.21.15.27:0/4213771512 <== mds.0 v2:172.21.15.27:6833/3491718569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563d9c062540 con 0x563d9c26b980 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf07fff700 10 client.9165 handle_command_reply: tid=0 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 client.9165 shutdown 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 msgr2=0x563d9c2a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2a1610 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fdf1c015fd0 tx=0x7fdf1c02d070).stop 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 shutdown_connections 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:6833/3491718569,v1:172.21.15.27:6835/3491718569] conn(0x563d9c26b980 0x563d9c26bd60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d9c28d480 0x563d9c2a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x563d9c244300 0x563d9c2ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf07fff700 0 client.9165 ms_handle_reset on v2:172.21.15.27:6833/3491718569 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 --2- 172.21.15.27:0/4213771512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563d9c288560 0x563d9c2a1610 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 >> 172.21.15.27:0/4213771512 conn(0x563d9c000e40 msgr2=0x563d9c26c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 shutdown_connections 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 1 -- 172.21.15.27:0/4213771512 wait complete. 2023-05-17T15:29:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.787+0000 7fdf4181bb80 20 client.9165 trim_cache size 0 max 16384 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "0a45f698-dd9a-4c4e-b210-088283caeba3", 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 8988, 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2023-05-17T15:29:29.803 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2023-05-17T15:29:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 10.202112762000001, 2023-05-17T15:29:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 74, 2023-05-17T15:29:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 177, 2023-05-17T15:29:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 177, 2023-05-17T15:29:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 14.783656018 2023-05-17T15:29:29.804 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdf1405ed60 msgr2=0x7fdf14061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdf1405ed60 0x7fdf14061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdf28157e20 tx=0x7fdf1c009040).stop 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 msgr2=0x7fdf28156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 0x7fdf28156670 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7fdf20009eb0 tx=0x7fdf20017000).stop 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 shutdown_connections 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdf1405ed60 0x7fdf14061220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28154090 0x7fdf28153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf28069610 0x7fdf28156670 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 --2- 172.21.15.27:0/673526470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf280cb450 0x7fdf2814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 >> 172.21.15.27:0/673526470 conn(0x7fdf2805e7e0 msgr2=0x7fdf2814fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 shutdown_connections 2023-05-17T15:29:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.788+0000 7fdf2fe89700 1 -- 172.21.15.27:0/673526470 wait complete. 2023-05-17T15:29:29.807 DEBUG:teuthology.orchestra.run.smithi027:> ceph fs ls 2023-05-17T15:29:29.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.906+0000 7f4eec6ef700 1 Processor -- start 2023-05-17T15:29:29.911 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.906+0000 7f4eec6ef700 1 -- start start 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4eec6ef700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ee4069b80 0x7f4ee4068c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4eec6ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee40bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4eec6ef700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee40bd1e0 con 0x7f4ee40697a0 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4eec6ef700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee40c7440 con 0x7f4ee4069b80 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4eec6ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee41543d0 con 0x7f4ee40bc860 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4ee9c8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ee4069b80 0x7f4ee4068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.913 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4ee9c8a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ee4069b80 0x7f4ee4068c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46698/0 (socket says 172.21.15.27:46698) 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.907+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/2857724730 learned_addr learned my addr 172.21.15.27:0/2857724730 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eeac8c700 1 --2- 172.21.15.27:0/2857724730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee40bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/2857724730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 msgr2=0x7f4ee40bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9c8a700 1 --2- 172.21.15.27:0/2857724730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee40bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/2857724730 >> v1:172.21.15.40:6789/0 conn(0x7f4ee40697a0 legacy=0x7f4ee40c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/2857724730 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4154690 con 0x7f4ee4069b80 2023-05-17T15:29:29.914 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9c8a700 1 --2- 172.21.15.27:0/2857724730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee4068c30 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f4ed8006fd0 tx=0x7f4ed80090f0).ready entity=mon.0 client_cookie=829ec0a6fe7b76cd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9489700 1 -- 172.21.15.27:0/2857724730 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800b600 con 0x7f4ee4069b80 2023-05-17T15:29:29.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9489700 1 -- 172.21.15.27:0/2857724730 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b760 con 0x7f4ee4069b80 2023-05-17T15:29:29.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4ee9489700 1 -- 172.21.15.27:0/2857724730 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bae0 con 0x7f4ee4069b80 2023-05-17T15:29:29.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 -- 172.21.15.27:0/2857724730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 msgr2=0x7f4ee4068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/2857724730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee4068c30 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f4ed8006fd0 tx=0x7f4ed80090f0).stop 2023-05-17T15:29:29.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 -- 172.21.15.27:0/2857724730 shutdown_connections 2023-05-17T15:29:29.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/2857724730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee40bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/2857724730 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee4068c30 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.917 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 -- 172.21.15.27:0/2857724730 >> 172.21.15.27:0/2857724730 conn(0x7f4ee40c7900 msgr2=0x7f4ee40c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.908+0000 7f4eec6ef700 1 -- 172.21.15.27:0/2857724730 shutdown_connections 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.909+0000 7f4eec6ef700 1 -- 172.21.15.27:0/2857724730 wait complete. 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 Processor -- start 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 -- start start 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee40697a0 0x7f4ee4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee40a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee4146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4150bf0 con 0x7f4ee4069b80 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4167d90 con 0x7f4ee40697a0 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4eec6ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4167460 con 0x7f4ee40bc860 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4ee9c8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee40a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4ee9c8a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee40a9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46702/0 (socket says 172.21.15.27:46702) 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.910+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/47855621 learned_addr learned my addr 172.21.15.27:0/47855621 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4eea48b700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee40697a0 0x7f4ee4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4eeac8c700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee4146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 msgr2=0x7f4ee4146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee9c8a700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee4146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee40697a0 msgr2=0x7f4ee4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee9c8a700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee40697a0 0x7f4ee4150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee9c8a700 1 -- 172.21.15.27:0/47855621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009370 con 0x7f4ee4069b80 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee9c8a700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee40a9bc0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f4ed8011000 tx=0x7f4ed8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bea0 con 0x7f4ee4069b80 2023-05-17T15:29:29.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b8d0 con 0x7f4ee4069b80 2023-05-17T15:29:29.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee4167740 con 0x7f4ee4069b80 2023-05-17T15:29:29.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed801c670 con 0x7f4ee4069b80 2023-05-17T15:29:29.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.911+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee4167ad0 con 0x7f4ee4069b80 2023-05-17T15:29:29.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.912+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee40aa1d0 con 0x7f4ee4069b80 2023-05-17T15:29:29.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.912+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ed800f070 con 0x7f4ee4069b80 2023-05-17T15:29:29.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.913+0000 7f4ee27fc700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4ed005edc0 0x7f4ed0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:29.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.913+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f4ed807b1d0 con 0x7f4ee4069b80 2023-05-17T15:29:29.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.913+0000 7f4eea48b700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4ed005edc0 0x7f4ed0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:29.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.913+0000 7f4eea48b700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4ed005edc0 0x7f4ed0061280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4ee4069450 tx=0x7f4edc009040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:29.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:29.917+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ee40aa1d0 con 0x7f4ee4069b80 2023-05-17T15:29:30.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.133+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ee40aa1d0 con 0x7f4ee4069b80 2023-05-17T15:29:30.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.133+0000 7f4ee27fc700 1 -- 172.21.15.27:0/47855621 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ee40aa1d0 con 0x7f4ee4069b80 2023-05-17T15:29:30.139 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T15:29:30.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4ed005edc0 msgr2=0x7f4ed0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4ed005edc0 0x7f4ed0061280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4ee4069450 tx=0x7f4edc009040).stop 2023-05-17T15:29:30.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 msgr2=0x7f4ee40a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee40a9bc0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f4ed8011000 tx=0x7f4ed8017000).stop 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 shutdown_connections 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f4ed005edc0 0x7f4ed0061280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee40bc860 0x7f4ee4146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee40697a0 0x7f4ee4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 --2- 172.21.15.27:0/47855621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4069b80 0x7f4ee40a9bc0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 >> 172.21.15.27:0/47855621 conn(0x7f4ee40c7900 msgr2=0x7f4ee4151410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:30.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 shutdown_connections 2023-05-17T15:29:30.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.135+0000 7f4eec6ef700 1 -- 172.21.15.27:0/47855621 wait complete. 2023-05-17T15:29:30.151 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T15:29:30.151 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T15:29:30.151 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-05-17T15:29:30.151 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T15:29:30.152 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T15:29:30.152 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T15:29:30.152 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-17T15:29:30.153 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T15:29:30.153 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:29:30.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.154 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-05-17T15:29:30.168 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T15:29:30.168 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T15:29:30.169 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 40142sec preferred_lft 40142sec 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-05-17T15:29:30.170 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::4c2d:54ff:fe97:94e2/64 scope link 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.171 INFO:teuthology.orchestra.run.smithi027.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c2:a2:b2:80:95:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c0a2:b2ff:fe80:95e6/64 scope link 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5a:99:de:36:ff:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5899:deff:fe36:ff3f/64 scope link 2023-05-17T15:29:30.172 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-05-17T15:29:30.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.173 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T15:29:30.231 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-05-17T15:29:30.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.233 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-05-17T15:29:30.288 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-05-17T15:29:30.288 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T15:29:30.288 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-17T15:29:30.288 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-17T15:29:30.288 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T15:29:30.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.289 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-05-17T15:29:30.289 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-05-17T15:29:30.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-17T15:29:30.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-17T15:29:30.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-17T15:29:30.291 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-05-17T15:29:30.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.388 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:29:30.402 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:29:30.402 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:29:30.402 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T15:29:30.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.403 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-05-17T15:29:30.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.467 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-17T15:29:30.520 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-17T15:29:30.521 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:29:30.599 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:29:30.599 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:29:30.642 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-17T15:29:30.642 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-17T15:29:30.644 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-17T15:29:30.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:30.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T15:29:30.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-17T15:29:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.861+0000 7f35a1df8700 1 Processor -- start 2023-05-17T15:29:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.861+0000 7f35a1df8700 1 -- start start 2023-05-17T15:29:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f35a1df8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f359c065400 0x7f359c0bd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f35a1df8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c0c3870 con 0x7f359c067fa0 2023-05-17T15:29:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f35a1df8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c068cd0 con 0x7f359c0657e0 2023-05-17T15:29:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f35a1df8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c069290 con 0x7f359c065400 2023-05-17T15:29:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f359bfff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f359c067fa0 0x7f359c068410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46280/0 (socket says 172.21.15.27:46280) 2023-05-17T15:29:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f359bfff700 1 -- 172.21.15.27:0/864436757 learned_addr learned my addr 172.21.15.27:0/864436757 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f359b7fe700 1 --2- 172.21.15.27:0/864436757 >> v2:172.21.15.40:3300/0 conn(0x7f359c065400 0x7f359c0bd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222131199 0 0) 0x7f359c0c3870 con 0x7f359c067fa0 2023-05-17T15:29:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.862+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35840033f0 con 0x7f359c067fa0 2023-05-17T15:29:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 114572463 0 0) 0x7f35840033f0 con 0x7f359c067fa0 2023-05-17T15:29:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 >> v2:172.21.15.40:3300/0 conn(0x7f359c065400 msgr2=0x7f359c0bd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 --2- 172.21.15.27:0/864436757 >> v2:172.21.15.40:3300/0 conn(0x7f359c065400 0x7f359c0bd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 >> v1:172.21.15.40:6789/0 conn(0x7f359c0657e0 legacy=0x7f359c065c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c068fb0 con 0x7f359c067fa0 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f35940017f0 con 0x7f359c067fa0 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 >> v1:172.21.15.27:6789/0 conn(0x7f359c067fa0 legacy=0x7f359c068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35840038e0 0x7f3584003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3584004690 0x7f3584004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3584005000 0x7f358400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c069290 con 0x7f3584004690 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358400bf60 con 0x7f3584005000 2023-05-17T15:29:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358400c0f0 con 0x7f35840038e0 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3584004690 0x7f3584004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359b7fe700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35840038e0 0x7f3584003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359bfff700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3584005000 0x7f358400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 -- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35840038e0 msgr2=0x7f3584003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35840038e0 0x7f3584003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 -- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3584005000 msgr2=0x7f358400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3584005000 0x7f358400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 -- 172.21.15.27:0/864436757 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840033f0 con 0x7f3584004690 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359b7fe700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35840038e0 0x7f3584003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359bfff700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3584005000 0x7f358400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359bfff700 1 -- 172.21.15.27:0/864436757 reap_dead start 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359affd700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3584004690 0x7f3584004b10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f3590001730 tx=0x7f3590007bb0).ready entity=mon.0 client_cookie=2bdc69bef7d3fe80 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.863+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590007020 con 0x7f3584004690 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590007180 con 0x7f3584004690 2023-05-17T15:29:30.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f359a7fc700 1 -- 172.21.15.27:0/864436757 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590007520 con 0x7f3584004690 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 -- 172.21.15.27:0/864436757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3584004690 msgr2=0x7f3584004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3584004690 0x7f3584004b10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f3590001730 tx=0x7f3590007bb0).stop 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 -- 172.21.15.27:0/864436757 shutdown_connections 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 --2- 172.21.15.27:0/864436757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3584004690 0x7f3584004b10 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 -- 172.21.15.27:0/864436757 >> 172.21.15.27:0/864436757 conn(0x7f359c0c94e0 msgr2=0x7f359c0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 -- 172.21.15.27:0/864436757 shutdown_connections 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.864+0000 7f35a1df8700 1 -- 172.21.15.27:0/864436757 wait complete. 2023-05-17T15:29:30.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.865+0000 7f35a1df8700 1 Processor -- start 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.865+0000 7f35a1df8700 1 -- start start 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f35a1df8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3584004690 0x7f359c0c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f35a1df8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 0x7f359c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f35a1df8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f359c1559c0 0x7f359c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f35a1df8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c157b30 con 0x7f359c1596a0 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f35a1df8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0c27a0 con 0x7f359c1559c0 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f35a1df8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0bfb50 con 0x7f3584004690 2023-05-17T15:29:30.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 0x7f359c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 0x7f359c1522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46728/0 (socket says 172.21.15.27:46728) 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 -- 172.21.15.27:0/3724083307 learned_addr learned my addr 172.21.15.27:0/3724083307 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359b7fe700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3584004690 0x7f359c0c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359bfff700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f359c1559c0 0x7f359c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 -- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3584004690 msgr2=0x7f359c0c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3584004690 0x7f359c0c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 -- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f359c1559c0 msgr2=0x7f359c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f359c1559c0 0x7f359c155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359affd700 1 -- 172.21.15.27:0/3724083307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0bfe30 con 0x7f359c1596a0 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359b7fe700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3584004690 0x7f359c0c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.866+0000 7f359bfff700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f359c1559c0 0x7f359c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.867+0000 7f359affd700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 0x7f359c1522e0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f3584005640 tx=0x7f3590015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.867+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590006ff0 con 0x7f359c1596a0 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.867+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590013670 con 0x7f359c1596a0 2023-05-17T15:29:30.879 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.867+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c157b30 con 0x7f359c1596a0 2023-05-17T15:29:30.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.867+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590013a30 con 0x7f359c1596a0 2023-05-17T15:29:30.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.867+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c1527d0 con 0x7f359c1596a0 2023-05-17T15:29:30.880 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.868+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c063970 con 0x7f359c1596a0 2023-05-17T15:29:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.868+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3590010030 con 0x7f359c1596a0 2023-05-17T15:29:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.868+0000 7f35837fe700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f358805ed90 0x7f3588061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.868+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f359007a4e0 con 0x7f359c1596a0 2023-05-17T15:29:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.868+0000 7f359b7fe700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f358805ed90 0x7f3588061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.869+0000 7f359b7fe700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f358805ed90 0x7f3588061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f358c006d80 tx=0x7f358c008040).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:30.873+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f359004ba00 con 0x7f359c1596a0 2023-05-17T15:29:31.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.073+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f359c06c350 con 0x7f358805ed90 2023-05-17T15:29:31.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.075+0000 7f35837fe700 1 -- 172.21.15.27:0/3724083307 <== mgr.8802 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f359c06c350 con 0x7f358805ed90 2023-05-17T15:29:31.079 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2023-05-17T15:29:31.080 INFO:teuthology.orchestra.run.smithi027.stdout: { 2023-05-17T15:29:31.080 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2023-05-17T15:29:31.080 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-05-17T15:29:31.080 INFO:teuthology.orchestra.run.smithi027.stdout:] 2023-05-17T15:29:31.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f358805ed90 msgr2=0x7f3588061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f358805ed90 0x7f3588061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f358c006d80 tx=0x7f358c008040).stop 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 msgr2=0x7f359c1522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 0x7f359c1522e0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f3584005640 tx=0x7f3590015000).stop 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 shutdown_connections 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f358805ed90 0x7f3588061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f359c1559c0 0x7f359c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3584004690 0x7f359c0c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.076+0000 7f35a1df8700 1 --2- 172.21.15.27:0/3724083307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f359c1596a0 0x7f359c1522e0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.077+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 >> 172.21.15.27:0/3724083307 conn(0x7f359c0c94e0 msgr2=0x7f359c15a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:31.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.077+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 shutdown_connections 2023-05-17T15:29:31.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.077+0000 7f35a1df8700 1 -- 172.21.15.27:0/3724083307 wait complete. 2023-05-17T15:29:31.093 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-17T15:29:31.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.205+0000 7f57f79aa700 1 Processor -- start 2023-05-17T15:29:31.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.206+0000 7f57f79aa700 1 -- start start 2023-05-17T15:29:31.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.206+0000 7f57f79aa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f57f005e460 0x7f57f00c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:31.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.206+0000 7f57f79aa700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00c2b80 con 0x7f57f00644d0 2023-05-17T15:29:31.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.206+0000 7f57f79aa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00be580 con 0x7f57f0153fb0 2023-05-17T15:29:31.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.206+0000 7f57f79aa700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f00c2530 con 0x7f57f005e460 2023-05-17T15:29:31.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f5f47700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f57f005e460 0x7f57f00c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:31.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f4f45700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f57f00644d0 0x7f57f005dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46298/0 (socket says 172.21.15.27:46298) 2023-05-17T15:29:31.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f4f45700 1 -- 172.21.15.27:0/2180505980 learned_addr learned my addr 172.21.15.27:0/2180505980 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f5f47700 1 -- 172.21.15.27:0/2180505980 >> v1:172.21.15.40:6789/0 conn(0x7f57f0153fb0 legacy=0x7f57f0063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f5f47700 1 -- 172.21.15.27:0/2180505980 >> v1:172.21.15.27:6789/0 conn(0x7f57f00644d0 legacy=0x7f57f005dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f5f47700 1 -- 172.21.15.27:0/2180505980 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00c2810 con 0x7f57f005e460 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57effff700 1 -- 172.21.15.27:0/2180505980 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878274665 0 0) 0x7f57f00c2b80 con 0x7f57f00644d0 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57f5f47700 1 --2- 172.21.15.27:0/2180505980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f005e460 0x7f57f00c3010 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f57e0009760 tx=0x7f57e0009060).ready entity=mon.0 client_cookie=85d112e1ab1b2e7d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57effff700 1 -- 172.21.15.27:0/2180505980 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e000b520 con 0x7f57f005e460 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57effff700 1 -- 172.21.15.27:0/2180505980 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e000b680 con 0x7f57f005e460 2023-05-17T15:29:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.207+0000 7f57effff700 1 -- 172.21.15.27:0/2180505980 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e000ba00 con 0x7f57f005e460 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 -- 172.21.15.27:0/2180505980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f005e460 msgr2=0x7f57f00c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 --2- 172.21.15.27:0/2180505980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f005e460 0x7f57f00c3010 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f57e0009760 tx=0x7f57e0009060).stop 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 -- 172.21.15.27:0/2180505980 shutdown_connections 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 --2- 172.21.15.27:0/2180505980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f005e460 0x7f57f00c3010 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 -- 172.21.15.27:0/2180505980 >> 172.21.15.27:0/2180505980 conn(0x7f57f00c7910 msgr2=0x7f57f00c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 -- 172.21.15.27:0/2180505980 shutdown_connections 2023-05-17T15:29:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.208+0000 7f57f79aa700 1 -- 172.21.15.27:0/2180505980 wait complete. 2023-05-17T15:29:31.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.209+0000 7f57f79aa700 1 Processor -- start 2023-05-17T15:29:31.216 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.209+0000 7f57f79aa700 1 -- start start 2023-05-17T15:29:31.217 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f79aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57f005e460 0x7f57f0139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f79aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57f00644d0 0x7f57f014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f79aa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 0x7f57f014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f79aa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f014d660 con 0x7f57f0153fb0 2023-05-17T15:29:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f79aa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f013a600 con 0x7f57f005e460 2023-05-17T15:29:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f79aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0139a60 con 0x7f57f00644d0 2023-05-17T15:29:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 0x7f57f014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 0x7f57f014d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46744/0 (socket says 172.21.15.27:46744) 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 -- 172.21.15.27:0/1431455454 learned_addr learned my addr 172.21.15.27:0/1431455454 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5746700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57f005e460 0x7f57f0139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f4f45700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57f00644d0 0x7f57f014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 -- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57f00644d0 msgr2=0x7f57f014cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57f00644d0 0x7f57f014cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 -- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57f005e460 msgr2=0x7f57f0139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.219 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57f005e460 0x7f57f0139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 -- 172.21.15.27:0/1431455454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00092a0 con 0x7f57f0153fb0 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57f5f47700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 0x7f57f014d170 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f57e0006dd0 tx=0x7f57e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.210+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e000ba00 con 0x7f57f0153fb0 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.211+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e001b410 con 0x7f57f0153fb0 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.211+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f0139cd0 con 0x7f57f0153fb0 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.211+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e001b790 con 0x7f57f0153fb0 2023-05-17T15:29:31.220 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.211+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f013a290 con 0x7f57f0153fb0 2023-05-17T15:29:31.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.211+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f013a7b0 con 0x7f57f0153fb0 2023-05-17T15:29:31.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.212+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 78) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f57e000f070 con 0x7f57f0153fb0 2023-05-17T15:29:31.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.212+0000 7f57ed7fa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f57dc05edc0 0x7f57dc061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:31.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.212+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f57e007b7a0 con 0x7f57f0153fb0 2023-05-17T15:29:31.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.212+0000 7f57f5746700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f57dc05edc0 0x7f57dc061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:31.221 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.213+0000 7f57f5746700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f57dc05edc0 0x7f57dc061280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f57e8006fd0 tx=0x7f57e8009250).ready entity=mgr.8802 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:31.222 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.216+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57e004ccc0 con 0x7f57f0153fb0 2023-05-17T15:29:31.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.437+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f57f0154390 con 0x7f57f0153fb0 2023-05-17T15:29:31.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.933+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 79) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f57e0079620 con 0x7f57f0153fb0 2023-05-17T15:29:31.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.934+0000 7f57ed7fa700 1 -- 172.21.15.27:0/1431455454 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v79) v1 ==== 92+0+0 (secure 0 0 0) 0x7f57e00435b0 con 0x7f57f0153fb0 2023-05-17T15:29:31.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f57dc05edc0 msgr2=0x7f57dc061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.941 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f57dc05edc0 0x7f57dc061280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f57e8006fd0 tx=0x7f57e8009250).stop 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 msgr2=0x7f57f014d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 0x7f57f014d170 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f57e0006dd0 tx=0x7f57e0017000).stop 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 shutdown_connections 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f57dc05edc0 0x7f57dc061280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0153fb0 0x7f57f014d170 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57f005e460 0x7f57f0139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 --2- 172.21.15.27:0/1431455454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57f00644d0 0x7f57f014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 >> 172.21.15.27:0/1431455454 conn(0x7f57f00c7910 msgr2=0x7f57f014b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:31.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 shutdown_connections 2023-05-17T15:29:31.943 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:31.936+0000 7f57f79aa700 1 -- 172.21.15.27:0/1431455454 wait complete. 2023-05-17T15:29:31.955 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-17T15:29:32.078 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 Processor -- start 2023-05-17T15:29:32.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 -- start start 2023-05-17T15:29:32.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdce81543d0 0x7fdce80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdce80c60f0 0x7fdce8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80691f0 0x7fdce81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80c1c50 con 0x7fdce81543d0 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce8158790 con 0x7fdce80c60f0 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.074+0000 7fdced868700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c6570 con 0x7fdce80691f0 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdce81543d0 0x7fdce80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdce81543d0 0x7fdce80c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46776/0 (socket says 172.21.15.27:46776) 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 -- 172.21.15.27:0/228142501 learned_addr learned my addr 172.21.15.27:0/228142501 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce67fc700 1 --2- 172.21.15.27:0/228142501 >> v2:172.21.15.40:3300/0 conn(0x7fdce80c60f0 0x7fdce8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce77fe700 1 --2- 172.21.15.27:0/228142501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80691f0 0x7fdce81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 -- 172.21.15.27:0/228142501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80691f0 msgr2=0x7fdce81547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 --2- 172.21.15.27:0/228142501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80691f0 0x7fdce81547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 -- 172.21.15.27:0/228142501 >> v2:172.21.15.40:3300/0 conn(0x7fdce80c60f0 msgr2=0x7fdce8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 --2- 172.21.15.27:0/228142501 >> v2:172.21.15.40:3300/0 conn(0x7fdce80c60f0 0x7fdce8068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 -- 172.21.15.27:0/228142501 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8157e60 con 0x7fdce81543d0 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce6ffd700 1 --2- 172.21.15.27:0/228142501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80c5c00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fdce80c5620 tx=0x7fdcd00090f0).ready entity=mon.0 client_cookie=7b3cbef33547938b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce5ffb700 1 -- 172.21.15.27:0/228142501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000f510 con 0x7fdce81543d0 2023-05-17T15:29:32.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce5ffb700 1 -- 172.21.15.27:0/228142501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f670 con 0x7fdce81543d0 2023-05-17T15:29:32.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.075+0000 7fdce5ffb700 1 -- 172.21.15.27:0/228142501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000f9f0 con 0x7fdce81543d0 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 -- 172.21.15.27:0/228142501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 msgr2=0x7fdce80c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 --2- 172.21.15.27:0/228142501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80c5c00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fdce80c5620 tx=0x7fdcd00090f0).stop 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 -- 172.21.15.27:0/228142501 shutdown_connections 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 --2- 172.21.15.27:0/228142501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80c5c00 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 --2- 172.21.15.27:0/228142501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80691f0 0x7fdce81547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 --2- 172.21.15.27:0/228142501 >> v2:172.21.15.40:3300/0 conn(0x7fdce80c60f0 0x7fdce8068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 -- 172.21.15.27:0/228142501 >> 172.21.15.27:0/228142501 conn(0x7fdce80cb7f0 msgr2=0x7fdce80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 -- 172.21.15.27:0/228142501 shutdown_connections 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.076+0000 7fdced868700 1 -- 172.21.15.27:0/228142501 wait complete. 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.077+0000 7fdced868700 1 Processor -- start 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.077+0000 7fdced868700 1 -- start start 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdced868700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce80691f0 0x7fdce8147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdced868700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80c60f0 0x7fdce80af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.086 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdced868700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdced868700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b01f0 con 0x7fdce81543d0 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdced868700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c2110 con 0x7fdce80691f0 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdced868700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c1dc0 con 0x7fdce80c60f0 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46786/0 (socket says 172.21.15.27:46786) 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce80691f0 0x7fdce8147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 -- 172.21.15.27:0/2617525660 learned_addr learned my addr 172.21.15.27:0/2617525660 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce67fc700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80c60f0 0x7fdce80af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 -- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80c60f0 msgr2=0x7fdce80af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80c60f0 0x7fdce80af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 -- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce80691f0 msgr2=0x7fdce8147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.078+0000 7fdce77fe700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce80691f0 0x7fdce8147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdce77fe700 1 -- 172.21.15.27:0/2617525660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009370 con 0x7fdce81543d0 2023-05-17T15:29:32.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdce6ffd700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce80691f0 0x7fdce8147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdce77fe700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80afd00 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fdce0009e90 tx=0x7fdce000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000caa0 con 0x7fdce81543d0 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80ae9e0 con 0x7fdce81543d0 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000f040 con 0x7fdce81543d0 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000ce10 con 0x7fdce81543d0 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.079+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce80aefa0 con 0x7fdce81543d0 2023-05-17T15:29:32.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.080+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce806bdf0 con 0x7fdce81543d0 2023-05-17T15:29:32.090 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:32.082+0000 7f53579ea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:29:32.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.080+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 79) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fdce0013610 con 0x7fdce81543d0 2023-05-17T15:29:32.090 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:32.080+0000 7f42a1d58680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:29:32.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.081+0000 7fdcdeffd700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdcc805ede0 0x7fdcc80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.081+0000 7fdce6ffd700 1 -- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdcc805ede0 msgr2=0x7fdcc80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:32.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.081+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fdce007a630 con 0x7fdce81543d0 2023-05-17T15:29:32.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.081+0000 7fdce6ffd700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdcc805ede0 0x7fdcc80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:32.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.085+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdce004bbd0 con 0x7fdce81543d0 2023-05-17T15:29:32.151 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:32.148+0000 7f53579ea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:29:32.152 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:32.147+0000 7f42a1d58680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:29:32.265 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.260+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fdce8158140 con 0x7fdce81543d0 2023-05-17T15:29:32.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.266+0000 7fdcdeffd700 1 -- 172.21.15.27:0/2617525660 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdce004f1f0 con 0x7fdce81543d0 2023-05-17T15:29:32.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdcc805ede0 msgr2=0x7fdcc80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdcc805ede0 0x7fdcc80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 msgr2=0x7fdce80afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80afd00 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fdce0009e90 tx=0x7fdce000b040).stop 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 shutdown_connections 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdcc805ede0 0x7fdcc80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdce81543d0 0x7fdce80afd00 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce80691f0 0x7fdce8147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 --2- 172.21.15.27:0/2617525660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdce80c60f0 0x7fdce80af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.268+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 >> 172.21.15.27:0/2617525660 conn(0x7fdce80cb7f0 msgr2=0x7fdce80accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:32.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.269+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 shutdown_connections 2023-05-17T15:29:32.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.269+0000 7fdced868700 1 -- 172.21.15.27:0/2617525660 wait complete. 2023-05-17T15:29:32.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:32.286 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-17T15:29:32.306 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-17T15:29:32.437 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:32.433+0000 7f53579ea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:29:32.441 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:32.436+0000 7f42a1d58680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:29:32.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.463+0000 7f5a1b16d700 1 Processor -- start 2023-05-17T15:29:32.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.463+0000 7f5a1b16d700 1 -- start start 2023-05-17T15:29:32.469 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a1b16d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a140826e0 0x7f5a1415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a1b16d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a140c1610 con 0x7f5a140c0420 2023-05-17T15:29:32.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a1b16d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a140abe60 con 0x7f5a14153fa0 2023-05-17T15:29:32.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a1b16d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140c0a00 con 0x7f5a140826e0 2023-05-17T15:29:32.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a13fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5a140c0420 0x7f5a14081fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46372/0 (socket says 172.21.15.27:46372) 2023-05-17T15:29:32.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a13fff700 1 -- 172.21.15.27:0/3581694625 learned_addr learned my addr 172.21.15.27:0/3581694625 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:32.470 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.464+0000 7f5a1970a700 1 --2- 172.21.15.27:0/3581694625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a140826e0 0x7f5a1415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216990139 0 0) 0x7f5a140c1610 con 0x7f5a140c0420 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a040033f0 con 0x7f5a140c0420 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627044212 0 0) 0x7f5a140abe60 con 0x7f5a14153fa0 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a140c1610 con 0x7f5a14153fa0 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a1970a700 1 -- 172.21.15.27:0/3581694625 >> v1:172.21.15.40:6789/0 conn(0x7f5a14153fa0 legacy=0x7f5a140aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a1970a700 1 -- 172.21.15.27:0/3581694625 >> v1:172.21.15.27:6789/0 conn(0x7f5a140c0420 legacy=0x7f5a14081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.471 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a1970a700 1 -- 172.21.15.27:0/3581694625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140c0ce0 con 0x7f5a140826e0 2023-05-17T15:29:32.472 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a1970a700 1 --2- 172.21.15.27:0/3581694625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a140826e0 0x7f5a1415ecb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5a0c009e90 tx=0x7f5a0c009780).ready entity=mon.2 client_cookie=b1d63eb88a094e70 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00e070 con 0x7f5a140826e0 2023-05-17T15:29:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c00bab0 con 0x7f5a140826e0 2023-05-17T15:29:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.465+0000 7f5a137fe700 1 -- 172.21.15.27:0/3581694625 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00be30 con 0x7f5a140826e0 2023-05-17T15:29:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 -- 172.21.15.27:0/3581694625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a140826e0 msgr2=0x7f5a1415ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/3581694625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a140826e0 0x7f5a1415ecb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5a0c009e90 tx=0x7f5a0c009780).stop 2023-05-17T15:29:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 -- 172.21.15.27:0/3581694625 shutdown_connections 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/3581694625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a140826e0 0x7f5a1415ecb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 -- 172.21.15.27:0/3581694625 >> 172.21.15.27:0/3581694625 conn(0x7f5a1405e820 msgr2=0x7f5a140cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 -- 172.21.15.27:0/3581694625 shutdown_connections 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.466+0000 7f5a1b16d700 1 -- 172.21.15.27:0/3581694625 wait complete. 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.467+0000 7f5a1b16d700 1 Processor -- start 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.467+0000 7f5a1b16d700 1 -- start start 2023-05-17T15:29:32.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1b16d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a140826e0 0x7f5a1414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1b16d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 0x7f5a140ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1b16d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a14153fa0 0x7f5a140aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1b16d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140aefc0 con 0x7f5a140c0420 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1b16d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1414b690 con 0x7f5a140826e0 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1b16d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140af1c0 con 0x7f5a14153fa0 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 0x7f5a140ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 0x7f5a140ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46818/0 (socket says 172.21.15.27:46818) 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 -- 172.21.15.27:0/2324653494 learned_addr learned my addr 172.21.15.27:0/2324653494 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a140826e0 0x7f5a1414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a1970a700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a14153fa0 0x7f5a140aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a14153fa0 msgr2=0x7f5a140aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a14153fa0 0x7f5a140aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a140826e0 msgr2=0x7f5a1414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a140826e0 0x7f5a1414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 -- 172.21.15.27:0/2324653494 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009a20 con 0x7f5a140c0420 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a140826e0 0x7f5a1414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.468+0000 7f5a13fff700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 0x7f5a140ae5e0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f5a0000c590 tx=0x7f5a00007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.469+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000ce60 con 0x7f5a140c0420 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.469+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a000072e0 con 0x7f5a140c0420 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.469+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a140af4a0 con 0x7f5a140c0420 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.469+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00007660 con 0x7f5a140c0420 2023-05-17T15:29:32.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.469+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a140afa60 con 0x7f5a140c0420 2023-05-17T15:29:32.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.470+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1406bdf0 con 0x7f5a140c0420 2023-05-17T15:29:32.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.470+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 79) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f5a00010070 con 0x7f5a140c0420 2023-05-17T15:29:32.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.470+0000 7f5a10ff9700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:32.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.470+0000 7f5a18f09700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:32.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.470+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f5a000790d0 con 0x7f5a140c0420 2023-05-17T15:29:32.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.470+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:32.480 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.474+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a0004a5f0 con 0x7f5a140c0420 2023-05-17T15:29:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.671+0000 7f5a18f09700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:32.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.671+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:32.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:32.674+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a140acb20 con 0x7f59f805ede0 2023-05-17T15:29:33.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:33.072+0000 7f5a18f09700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:33.077 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:33.072+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:29:33.094 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:33.091+0000 7f53579ea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:29:33.100 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:33.095+0000 7f42a1d58680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:29:33.163 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:33.159+0000 7f53579ea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:29:33.168 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:33.163+0000 7f42a1d58680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:29:33.357 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:33.353+0000 7f53579ea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:29:33.361 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:33.356+0000 7f42a1d58680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:29:33.792 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:33.788+0000 7f53579ea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:29:33.795 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:33.790+0000 7f42a1d58680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:29:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:33.873+0000 7f5a18f09700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:33.873+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-17T15:29:33.900 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:33.896+0000 7f53579ea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:33.903 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:33.898+0000 7f42a1d58680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:34.058 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:34.055+0000 7f53579ea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:34.062 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:34.057+0000 7f42a1d58680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:34.136 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:34.132+0000 7f53579ea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:29:34.139 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:34.135+0000 7f42a1d58680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:29:34.206 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:34.202+0000 7f53579ea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:29:34.209 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:34.204+0000 7f42a1d58680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:29:34.476 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:34.472+0000 7f53579ea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:29:34.478 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:34.474+0000 7f42a1d58680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:29:34.666 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:34.662+0000 7f53579ea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:34.669 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:34.665+0000 7f42a1d58680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:35.346 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.343+0000 7f53579ea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:29:35.349 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.345+0000 7f42a1d58680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:29:35.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:35.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:29:35.419 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.415+0000 7f53579ea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:29:35.422 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.417+0000 7f42a1d58680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:29:35.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:35.474+0000 7f5a18f09700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:35.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:35.474+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-17T15:29:35.497 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.493+0000 7f53579ea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:29:35.500 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.495+0000 7f42a1d58680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:29:35.651 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.648+0000 7f53579ea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:29:35.653 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.649+0000 7f42a1d58680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:29:35.724 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.721+0000 7f53579ea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:29:35.727 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.722+0000 7f42a1d58680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:29:35.844 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.841+0000 7f53579ea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:29:35.846 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.841+0000 7f42a1d58680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:29:35.956 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:35.952+0000 7f53579ea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:35.958 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:35.953+0000 7f42a1d58680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:36.256 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:36.252+0000 7f53579ea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:29:36.260 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.255+0000 7f42a1d58680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:29:36.330 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:36.326+0000 7f53579ea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:29:36.333 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.329+0000 7f42a1d58680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:29:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:36.394+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 80) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f5a00010d90 con 0x7f5a140c0420 2023-05-17T15:29:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:36.394+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:36.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:36.394+0000 7f5a10ff9700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:36.460 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421d534700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.460 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421d534700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.460 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421d534700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.460 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421d534700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.461 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421d534700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.461 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421fd39700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.461 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421fd39700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.461 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421fd39700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.461 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421fd39700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:36.461 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:36.455+0000 7f421fd39700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:37.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.408+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mgrmap(e 81) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f5a000772d0 con 0x7f5a140c0420 2023-05-17T15:29:37.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.408+0000 7f5a10ff9700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.408+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a140acb20 con 0x7f59f805ede0 2023-05-17T15:29:37.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.408+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.410+0000 7f5a18f09700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f8061220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5a08007e90 tx=0x7f5a08007bd0).ready entity=mgr.9201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.428+0000 7f5a10ff9700 1 -- 172.21.15.27:0/2324653494 <== mgr.9201 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5a140acb20 con 0x7f59f805ede0 2023-05-17T15:29:37.432 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule set for path snap_test_dir1 2023-05-17T15:29:37.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 msgr2=0x7f59f8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f8061220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5a08007e90 tx=0x7f5a08007bd0).stop 2023-05-17T15:29:37.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 msgr2=0x7f5a140ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 0x7f5a140ae5e0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f5a0000c590 tx=0x7f5a00007d00).stop 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 shutdown_connections 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f59f805ede0 0x7f59f8061220 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a14153fa0 0x7f5a140aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a140826e0 0x7f5a1414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 --2- 172.21.15.27:0/2324653494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5a140c0420 0x7f5a140ae5e0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 >> 172.21.15.27:0/2324653494 conn(0x7f5a1405e820 msgr2=0x7f5a14153040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:37.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 shutdown_connections 2023-05-17T15:29:37.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.430+0000 7f5a1b16d700 1 -- 172.21.15.27:0/2324653494 wait complete. 2023-05-17T15:29:37.448 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-17T15:29:37.449 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-05-17T15:29:37.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.612+0000 7f5cbdcda700 1 Processor -- start 2023-05-17T15:29:37.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.612+0000 7f5cbdcda700 1 -- start start 2023-05-17T15:29:37.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cbdcda700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5cb80c6310 0x7f5cb8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cbdcda700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb8158790 con 0x7f5cb81543d0 2023-05-17T15:29:37.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cbdcda700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb8157e60 con 0x7f5cb80691f0 2023-05-17T15:29:37.617 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cbdcda700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb80c1c50 con 0x7f5cb80c6310 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb6ffd700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5cb80c6310 0x7f5cb8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb77fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5cb81543d0 0x7f5cb80c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46558/0 (socket says 172.21.15.27:46558) 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb77fe700 1 -- 172.21.15.27:0/2652216446 learned_addr learned my addr 172.21.15.27:0/2652216446 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/2652216446 >> v1:172.21.15.40:6789/0 conn(0x7f5cb80691f0 legacy=0x7f5cb80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/2652216446 >> v1:172.21.15.27:6789/0 conn(0x7f5cb81543d0 legacy=0x7f5cb80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/2652216446 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8158140 con 0x7f5cb80c6310 2023-05-17T15:29:37.618 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb67fc700 1 -- 172.21.15.27:0/2652216446 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986454683 0 0) 0x7f5cb8158790 con 0x7f5cb81543d0 2023-05-17T15:29:37.619 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.613+0000 7f5cb6ffd700 1 --2- 172.21.15.27:0/2652216446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8068d00 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f5cac009760 tx=0x7f5cac009060).ready entity=mon.0 client_cookie=f84646d53a938b05 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cb67fc700 1 -- 172.21.15.27:0/2652216446 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00b520 con 0x7f5cb80c6310 2023-05-17T15:29:37.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cb67fc700 1 -- 172.21.15.27:0/2652216446 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac00b680 con 0x7f5cb80c6310 2023-05-17T15:29:37.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cb67fc700 1 -- 172.21.15.27:0/2652216446 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00ba00 con 0x7f5cb80c6310 2023-05-17T15:29:37.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 -- 172.21.15.27:0/2652216446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 msgr2=0x7f5cb8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/2652216446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8068d00 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f5cac009760 tx=0x7f5cac009060).stop 2023-05-17T15:29:37.621 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 -- 172.21.15.27:0/2652216446 shutdown_connections 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/2652216446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8068d00 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 -- 172.21.15.27:0/2652216446 >> 172.21.15.27:0/2652216446 conn(0x7f5cb80cb7f0 msgr2=0x7f5cb80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 -- 172.21.15.27:0/2652216446 shutdown_connections 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.614+0000 7f5cbdcda700 1 -- 172.21.15.27:0/2652216446 wait complete. 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.615+0000 7f5cbdcda700 1 Processor -- start 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.615+0000 7f5cbdcda700 1 -- start start 2023-05-17T15:29:37.622 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cbdcda700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cb80691f0 0x7f5cb80af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cbdcda700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cbdcda700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb81543d0 0x7f5cb81449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cbdcda700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80c46e0 con 0x7f5cb80c6310 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cbdcda700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80aedc0 con 0x7f5cb80691f0 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cbdcda700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80ae1b0 con 0x7f5cb81543d0 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cb6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cb6ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8164f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47000/0 (socket says 172.21.15.27:47000) 2023-05-17T15:29:37.623 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/3649831646 learned_addr learned my addr 172.21.15.27:0/3649831646 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cb77fe700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cb80691f0 0x7f5cb80af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.616+0000 7f5cb7fff700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb81543d0 0x7f5cb81449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb81543d0 msgr2=0x7f5cb81449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cb6ffd700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb81543d0 0x7f5cb81449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cb80691f0 msgr2=0x7f5cb80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cb6ffd700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cb80691f0 0x7f5cb80af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.624 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cb6ffd700 1 -- 172.21.15.27:0/3649831646 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0092a0 con 0x7f5cb80c6310 2023-05-17T15:29:37.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cb6ffd700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8164f40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f5cac011000 tx=0x7f5cac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00b7f0 con 0x7f5cb80c6310 2023-05-17T15:29:37.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac00b950 con 0x7f5cb80c6310 2023-05-17T15:29:37.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac01b620 con 0x7f5cb80c6310 2023-05-17T15:29:37.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb80ae490 con 0x7f5cb80c6310 2023-05-17T15:29:37.625 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.617+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb80aea50 con 0x7f5cb80c6310 2023-05-17T15:29:37.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.618+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb80aef30 con 0x7f5cb80c6310 2023-05-17T15:29:37.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.618+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 81) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f5cac02a070 con 0x7f5cb80c6310 2023-05-17T15:29:37.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.619+0000 7f5c9f7fe700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5ca405ed40 0x7f5ca4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.626 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.619+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f5cac07b510 con 0x7f5cb80c6310 2023-05-17T15:29:37.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.619+0000 7f5cb77fe700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5ca405ed40 0x7f5ca4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.619+0000 7f5cb77fe700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5ca405ed40 0x7f5ca4061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5ca8007fd0 tx=0x7f5ca8007dd0).ready entity=mgr.9201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.627 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.623+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5cac04ca20 con 0x7f5cb80c6310 2023-05-17T15:29:37.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.819+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb806bdf0 con 0x7f5ca405ed40 2023-05-17T15:29:37.828 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.824+0000 7f5c9f7fe700 1 -- 172.21.15.27:0/3649831646 <== mgr.9201 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f5cb806bdf0 con 0x7f5ca405ed40 2023-05-17T15:29:37.828 INFO:teuthology.orchestra.run.smithi027.stdout:Retention added to path snap_test_dir1 2023-05-17T15:29:37.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5ca405ed40 msgr2=0x7f5ca4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5ca405ed40 0x7f5ca4061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5ca8007fd0 tx=0x7f5ca8007dd0).stop 2023-05-17T15:29:37.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 msgr2=0x7f5cb8164f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8164f40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f5cac011000 tx=0x7f5cac017000).stop 2023-05-17T15:29:37.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 shutdown_connections 2023-05-17T15:29:37.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f5ca405ed40 0x7f5ca4061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cb81543d0 0x7f5cb81449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cb80691f0 0x7f5cb80af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 --2- 172.21.15.27:0/3649831646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cb80c6310 0x7f5cb8164f40 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 >> 172.21.15.27:0/3649831646 conn(0x7f5cb80cb7f0 msgr2=0x7f5cb8157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:37.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 shutdown_connections 2023-05-17T15:29:37.831 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.826+0000 7f5cbdcda700 1 -- 172.21.15.27:0/3649831646 wait complete. 2023-05-17T15:29:37.841 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-05-17T15:29:37.846 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-17-15_30_00 in ~23s... 2023-05-17T15:29:37.846 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-05-17T15:29:37.846 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-17T15:29:37.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.961+0000 7ff91f4f2700 1 Processor -- start 2023-05-17T15:29:37.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.961+0000 7ff91f4f2700 1 -- start start 2023-05-17T15:29:37.966 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91f4f2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff918152070 0x7ff918154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91f4f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91f4f2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff918158010 con 0x7ff918151c90 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91f4f2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918154f60 con 0x7ff918152070 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91f4f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918155240 con 0x7ff9180c0520 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91ca8d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff918152070 0x7ff918154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91ca8d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff918152070 0x7ff918154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47012/0 (socket says 172.21.15.27:47012) 2023-05-17T15:29:37.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91ca8d700 1 -- 172.21.15.27:0/203424627 learned_addr learned my addr 172.21.15.27:0/203424627 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91da8f700 1 --2- 172.21.15.27:0/203424627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91ca8d700 1 -- 172.21.15.27:0/203424627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 msgr2=0x7ff918081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.962+0000 7ff91ca8d700 1 --2- 172.21.15.27:0/203424627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91ca8d700 1 -- 172.21.15.27:0/203424627 >> v1:172.21.15.40:6789/0 conn(0x7ff918151c90 legacy=0x7ff9180c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91ca8d700 1 -- 172.21.15.27:0/203424627 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918155520 con 0x7ff918152070 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91ca8d700 1 --2- 172.21.15.27:0/203424627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918152070 0x7ff918154980 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7ff90c006fd0 tx=0x7ff90c0090f0).ready entity=mon.0 client_cookie=4810835ac7fe982d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff917fff700 1 -- 172.21.15.27:0/203424627 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00b600 con 0x7ff918152070 2023-05-17T15:29:37.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff917fff700 1 -- 172.21.15.27:0/203424627 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00b760 con 0x7ff918152070 2023-05-17T15:29:37.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff917fff700 1 -- 172.21.15.27:0/203424627 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00bae0 con 0x7ff918152070 2023-05-17T15:29:37.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 -- 172.21.15.27:0/203424627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918152070 msgr2=0x7ff918154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/203424627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918152070 0x7ff918154980 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7ff90c006fd0 tx=0x7ff90c0090f0).stop 2023-05-17T15:29:37.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 -- 172.21.15.27:0/203424627 shutdown_connections 2023-05-17T15:29:37.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/203424627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/203424627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918152070 0x7ff918154980 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 -- 172.21.15.27:0/203424627 >> 172.21.15.27:0/203424627 conn(0x7ff9180cae10 msgr2=0x7ff9180cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 -- 172.21.15.27:0/203424627 shutdown_connections 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.963+0000 7ff91f4f2700 1 -- 172.21.15.27:0/203424627 wait complete. 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.964+0000 7ff91f4f2700 1 Processor -- start 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.964+0000 7ff91f4f2700 1 -- start start 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91f4f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91f4f2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 0x7ff918153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91f4f2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff918152070 0x7ff918153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91f4f2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918153e40 con 0x7ff918151c90 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91f4f2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918165b20 con 0x7ff918152070 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91f4f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918164f10 con 0x7ff9180c0520 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91ca8d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 0x7ff918153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.965+0000 7ff91ca8d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 0x7ff918153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47016/0 (socket says 172.21.15.27:47016) 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 -- 172.21.15.27:0/581294274 learned_addr learned my addr 172.21.15.27:0/581294274 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:37.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91da8f700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff918152070 0x7ff918153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91d28e700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 -- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 msgr2=0x7ff918150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 -- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff918152070 msgr2=0x7ff918153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff918152070 0x7ff918153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 -- 172.21.15.27:0/581294274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c009370 con 0x7ff918151c90 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91d28e700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:37.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91ca8d700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 0x7ff918153460 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7ff918062d90 tx=0x7ff90c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00b8d0 con 0x7ff918151c90 2023-05-17T15:29:37.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00ba30 con 0x7ff918151c90 2023-05-17T15:29:37.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9181651f0 con 0x7ff918151c90 2023-05-17T15:29:37.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c01d680 con 0x7ff918151c90 2023-05-17T15:29:37.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.966+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9181657b0 con 0x7ff918151c90 2023-05-17T15:29:37.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.967+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91806bdf0 con 0x7ff918151c90 2023-05-17T15:29:37.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.967+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 81) v1 ==== 75179+0+0 (secure 0 0 0) 0x7ff90c02d070 con 0x7ff918151c90 2023-05-17T15:29:37.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.968+0000 7ff9157fa700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff90405ed40 0x7ff904061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:37.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.968+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7ff90c07bdb0 con 0x7ff918151c90 2023-05-17T15:29:37.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.968+0000 7ff91d28e700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff90405ed40 0x7ff904061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:37.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.968+0000 7ff91d28e700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff90405ed40 0x7ff904061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff910001730 tx=0x7ff910009040).ready entity=mgr.9201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:37.977 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:37.972+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff90c04d2c0 con 0x7ff918151c90 2023-05-17T15:29:38.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.171+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9180bff90 con 0x7ff90405ed40 2023-05-17T15:29:38.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.174+0000 7ff9157fa700 1 -- 172.21.15.27:0/581294274 <== mgr.9201 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7ff9180bff90 con 0x7ff90405ed40 2023-05-17T15:29:38.178 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:38.178 INFO:teuthology.orchestra.run.smithi027.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-17T15:29:38.179 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.175+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff90405ed40 msgr2=0x7ff904061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.175+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff90405ed40 0x7ff904061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff910001730 tx=0x7ff910009040).stop 2023-05-17T15:29:38.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 msgr2=0x7ff918153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 0x7ff918153460 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7ff918062d90 tx=0x7ff90c017000).stop 2023-05-17T15:29:38.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 shutdown_connections 2023-05-17T15:29:38.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff90405ed40 0x7ff904061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff918152070 0x7ff918153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9180c0520 0x7ff918150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 --2- 172.21.15.27:0/581294274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff918151c90 0x7ff918153460 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 >> 172.21.15.27:0/581294274 conn(0x7ff9180cae10 msgr2=0x7ff918081fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:38.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 shutdown_connections 2023-05-17T15:29:38.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.176+0000 7ff91f4f2700 1 -- 172.21.15.27:0/581294274 wait complete. 2023-05-17T15:29:38.191 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-17T15:29:38.192 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-05-17T15:29:38.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-17T15:29:38.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.308+0000 7f1d7d102700 1 Processor -- start 2023-05-17T15:29:38.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.308+0000 7f1d7d102700 1 -- start start 2023-05-17T15:29:38.314 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d7d102700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 0x7f1d780a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d7d102700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d78154a50 con 0x7f1d78154520 2023-05-17T15:29:38.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d7d102700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d78154d30 con 0x7f1d780c1080 2023-05-17T15:29:38.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d7d102700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78155010 con 0x7f1d780c1460 2023-05-17T15:29:38.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d777fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1d78154520 0x7f1d780c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46586/0 (socket says 172.21.15.27:46586) 2023-05-17T15:29:38.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d777fe700 1 -- 172.21.15.27:0/2075111445 learned_addr learned my addr 172.21.15.27:0/2075111445 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:38.315 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d7c901700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 0x7f1d780a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107764384 0 0) 0x7f1d78154a50 con 0x7f1d78154520 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d600033f0 con 0x7f1d78154520 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268185618 0 0) 0x7f1d600033f0 con 0x7f1d78154520 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 msgr2=0x7f1d780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 0x7f1d780a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 >> v1:172.21.15.40:6789/0 conn(0x7f1d780c1080 legacy=0x7f1d780c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d781552f0 con 0x7f1d78154520 2023-05-17T15:29:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f1d6c001470 con 0x7f1d78154520 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 >> v1:172.21.15.27:6789/0 conn(0x7f1d78154520 legacy=0x7f1d780c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.309+0000 7f1d76ffd700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 0x7f1d60003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d60003e00 0x7f1d60004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d60004b80 0x7f1d60005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78155010 con 0x7f1d60004b80 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6000b8e0 con 0x7f1d60003e00 2023-05-17T15:29:38.317 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6000baa0 con 0x7f1d780c1460 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d60004b80 0x7f1d60005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d777fe700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d60003e00 0x7f1d60004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d77fff700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 0x7f1d60003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 -- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 msgr2=0x7f1d60003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d780c1460 0x7f1d60003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 -- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d60003e00 msgr2=0x7f1d60004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d60003e00 0x7f1d60004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.318 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 -- 172.21.15.27:0/2075111445 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d600033f0 con 0x7f1d60004b80 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d7c901700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d60004b80 0x7f1d60005000 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f1d7000e210 tx=0x7f1d7000b040).ready entity=mon.0 client_cookie=cc4af21f67937da6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70009ac0 con 0x7f1d60004b80 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000f040 con 0x7f1d60004b80 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.310+0000 7f1d76ffd700 1 -- 172.21.15.27:0/2075111445 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000ecd0 con 0x7f1d60004b80 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7d102700 1 -- 172.21.15.27:0/2075111445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d60004b80 msgr2=0x7f1d60005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7d102700 1 --2- 172.21.15.27:0/2075111445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d60004b80 0x7f1d60005000 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f1d7000e210 tx=0x7f1d7000b040).stop 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7c901700 1 -- 172.21.15.27:0/2075111445 reap_dead start 2023-05-17T15:29:38.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7d102700 1 -- 172.21.15.27:0/2075111445 shutdown_connections 2023-05-17T15:29:38.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7d102700 1 -- 172.21.15.27:0/2075111445 >> 172.21.15.27:0/2075111445 conn(0x7f1d7805dd50 msgr2=0x7f1d7805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:38.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7d102700 1 -- 172.21.15.27:0/2075111445 shutdown_connections 2023-05-17T15:29:38.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.311+0000 7f1d7d102700 1 -- 172.21.15.27:0/2075111445 wait complete. 2023-05-17T15:29:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.312+0000 7f1d7d102700 1 Processor -- start 2023-05-17T15:29:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.312+0000 7f1d7d102700 1 -- start start 2023-05-17T15:29:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d781569c0 0x7f1d780c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 0x7f1d780c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d780c3c60 0x7f1d781452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780c4d80 con 0x7f1d78156da0 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780c4170 con 0x7f1d780c3c60 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780c4450 con 0x7f1d781569c0 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 0x7f1d780c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 0x7f1d780c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47036/0 (socket says 172.21.15.27:47036) 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 -- 172.21.15.27:0/883370550 learned_addr learned my addr 172.21.15.27:0/883370550 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d77fff700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d781569c0 0x7f1d780c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7c901700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d780c3c60 0x7f1d781452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 -- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d781569c0 msgr2=0x7f1d780c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d781569c0 0x7f1d780c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 -- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d780c3c60 msgr2=0x7f1d781452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d780c3c60 0x7f1d781452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 -- 172.21.15.27:0/883370550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780c4730 con 0x7f1d78156da0 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7c901700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d780c3c60 0x7f1d781452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d77fff700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d781569c0 0x7f1d780c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d777fe700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 0x7f1d780c3770 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f1d6c004ad0 tx=0x7f1d6c001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c000fb0 con 0x7f1d78156da0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00f8d0 con 0x7f1d78156da0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780c4a10 con 0x7f1d78156da0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.313+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00fc50 con 0x7f1d78156da0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.314+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d78145970 con 0x7f1d78156da0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.315+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d78047150 con 0x7f1d78156da0 2023-05-17T15:29:38.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.315+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 81) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f1d6c01b030 con 0x7f1d78156da0 2023-05-17T15:29:38.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.315+0000 7f1d5ffff700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1d6405ed40 0x7f1d64061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.315+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f1d6c0795f0 con 0x7f1d78156da0 2023-05-17T15:29:38.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.315+0000 7f1d77fff700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1d6405ed40 0x7f1d64061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.315+0000 7f1d77fff700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1d6405ed40 0x7f1d64061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1d680010e0 tx=0x7f1d68009040).ready entity=mgr.9201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:38.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.319+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d6c04ab00 con 0x7f1d78156da0 2023-05-17T15:29:38.427 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.424+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 82) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f1d6c077460 con 0x7f1d78156da0 2023-05-17T15:29:38.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.520+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d78157220 con 0x7f1d6405ed40 2023-05-17T15:29:38.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.524+0000 7f1d5ffff700 1 -- 172.21.15.27:0/883370550 <== mgr.9201 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1d78157220 con 0x7f1d6405ed40 2023-05-17T15:29:38.528 INFO:teuthology.orchestra.run.smithi027.stdout:Schedule removed for path snap_test_dir1 2023-05-17T15:29:38.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1d6405ed40 msgr2=0x7f1d64061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1d6405ed40 0x7f1d64061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1d680010e0 tx=0x7f1d68009040).stop 2023-05-17T15:29:38.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 msgr2=0x7f1d780c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 0x7f1d780c3770 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f1d6c004ad0 tx=0x7f1d6c001e70).stop 2023-05-17T15:29:38.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 shutdown_connections 2023-05-17T15:29:38.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1d6405ed40 0x7f1d64061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d780c3c60 0x7f1d781452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d781569c0 0x7f1d780c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 --2- 172.21.15.27:0/883370550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d78156da0 0x7f1d780c3770 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 >> 172.21.15.27:0/883370550 conn(0x7f1d7805dd50 msgr2=0x7f1d7805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:38.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.526+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 shutdown_connections 2023-05-17T15:29:38.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.527+0000 7f1d7d102700 1 -- 172.21.15.27:0/883370550 wait complete. 2023-05-17T15:29:38.542 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-17T15:29:38.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:38.543 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-17T15:29:38.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:38.558 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-17T15:29:38.614 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-17T15:29:38.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.769+0000 7f1b06db8700 1 Processor -- start 2023-05-17T15:29:38.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.769+0000 7f1b06db8700 1 -- start start 2023-05-17T15:29:38.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b06db8700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b00069410 0x7f1b0015f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b06db8700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b000c0c90 con 0x7f1b000c6310 2023-05-17T15:29:38.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b06db8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b00158790 con 0x7f1b001543d0 2023-05-17T15:29:38.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b06db8700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000c1c50 con 0x7f1b00069410 2023-05-17T15:29:38.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b05355700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b00069410 0x7f1b0015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1afffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1b000c6310 0x7f1b00068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46604/0 (socket says 172.21.15.27:46604) 2023-05-17T15:29:38.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1afffff700 1 -- 172.21.15.27:0/1486987039 learned_addr learned my addr 172.21.15.27:0/1486987039 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:38.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b05355700 1 -- 172.21.15.27:0/1486987039 >> v1:172.21.15.40:6789/0 conn(0x7f1b001543d0 legacy=0x7f1b000c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:38.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b05355700 1 -- 172.21.15.27:0/1486987039 >> v1:172.21.15.27:6789/0 conn(0x7f1b000c6310 legacy=0x7f1b00068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b05355700 1 -- 172.21.15.27:0/1486987039 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00157e60 con 0x7f1b00069410 2023-05-17T15:29:38.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1aff7fe700 1 -- 172.21.15.27:0/1486987039 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915976886 0 0) 0x7f1b000c0c90 con 0x7f1b000c6310 2023-05-17T15:29:38.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1b05355700 1 --2- 172.21.15.27:0/1486987039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00069410 0x7f1b0015f160 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f1ae8009760 tx=0x7f1ae8009060).ready entity=mon.0 client_cookie=143cacb765ec29f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:38.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1aff7fe700 1 -- 172.21.15.27:0/1486987039 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800b520 con 0x7f1b00069410 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1aff7fe700 1 -- 172.21.15.27:0/1486987039 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae800b680 con 0x7f1b00069410 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.770+0000 7f1aff7fe700 1 -- 172.21.15.27:0/1486987039 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800ba00 con 0x7f1b00069410 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 -- 172.21.15.27:0/1486987039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00069410 msgr2=0x7f1b0015f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 --2- 172.21.15.27:0/1486987039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00069410 0x7f1b0015f160 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f1ae8009760 tx=0x7f1ae8009060).stop 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 -- 172.21.15.27:0/1486987039 shutdown_connections 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 --2- 172.21.15.27:0/1486987039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00069410 0x7f1b0015f160 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 -- 172.21.15.27:0/1486987039 >> 172.21.15.27:0/1486987039 conn(0x7f1b000cb7f0 msgr2=0x7f1b000c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:38.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 -- 172.21.15.27:0/1486987039 shutdown_connections 2023-05-17T15:29:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.771+0000 7f1b06db8700 1 -- 172.21.15.27:0/1486987039 wait complete. 2023-05-17T15:29:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.772+0000 7f1b06db8700 1 Processor -- start 2023-05-17T15:29:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.772+0000 7f1b06db8700 1 -- start start 2023-05-17T15:29:38.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b06db8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b00069410 0x7f1b00147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b06db8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 0x7f1b000ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b06db8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b001543d0 0x7f1b000aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b06db8700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000c1dc0 con 0x7f1b000c6310 2023-05-17T15:29:38.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b06db8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000af180 con 0x7f1b00069410 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b06db8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000af460 con 0x7f1b001543d0 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 0x7f1b000ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 0x7f1b000ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47048/0 (socket says 172.21.15.27:47048) 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 -- 172.21.15.27:0/937628895 learned_addr learned my addr 172.21.15.27:0/937628895 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b04b54700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b00069410 0x7f1b00147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b05355700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b001543d0 0x7f1b000aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 -- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b001543d0 msgr2=0x7f1b000aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b001543d0 0x7f1b000aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 -- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b00069410 msgr2=0x7f1b00147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b00069410 0x7f1b00147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 -- 172.21.15.27:0/937628895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80092a0 con 0x7f1b000c6310 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1b04b54700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b00069410 0x7f1b00147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.773+0000 7f1afffff700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 0x7f1b000ae6a0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f1af000c840 tx=0x7f1af0001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.774+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0005d30 con 0x7f1b000c6310 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.774+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0005e90 con 0x7f1b000c6310 2023-05-17T15:29:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.774+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b000c2010 con 0x7f1b000c6310 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.774+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0007320 con 0x7f1b000c6310 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.774+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b000afaf0 con 0x7f1b000c6310 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.774+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b000c2510 con 0x7f1b000c6310 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.775+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 82) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f1af0010030 con 0x7f1b000c6310 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.775+0000 7f1afcff9700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1ae005ee30 0x7f1ae00612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.775+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f1af0079e20 con 0x7f1b000c6310 2023-05-17T15:29:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.775+0000 7f1b04b54700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1ae005ee30 0x7f1ae00612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:38.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.776+0000 7f1b04b54700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1ae005ee30 0x7f1ae00612f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1af800b890 tx=0x7f1af8008040).ready entity=mgr.9201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:38.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.780+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1af004b1e0 con 0x7f1b000c6310 2023-05-17T15:29:39.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:38.996+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1b00069d00 con 0x7f1b000c6310 2023-05-17T15:29:39.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.429+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1af0077ba0 con 0x7f1b000c6310 2023-05-17T15:29:39.434 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.430+0000 7f1afcff9700 1 -- 172.21.15.27:0/937628895 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v83) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1af0073870 con 0x7f1b000c6310 2023-05-17T15:29:39.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1ae005ee30 msgr2=0x7f1ae00612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1ae005ee30 0x7f1ae00612f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1af800b890 tx=0x7f1af8008040).stop 2023-05-17T15:29:39.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 msgr2=0x7f1b000ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 0x7f1b000ae6a0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f1af000c840 tx=0x7f1af0001630).stop 2023-05-17T15:29:39.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 shutdown_connections 2023-05-17T15:29:39.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1ae005ee30 0x7f1ae00612f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b001543d0 0x7f1b000aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b00069410 0x7f1b00147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 --2- 172.21.15.27:0/937628895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b000c6310 0x7f1b000ae6a0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.432+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 >> 172.21.15.27:0/937628895 conn(0x7f1b000cb7f0 msgr2=0x7f1b000accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.433+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 shutdown_connections 2023-05-17T15:29:39.438 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.433+0000 7f1b06db8700 1 -- 172.21.15.27:0/937628895 wait complete. 2023-05-17T15:29:39.450 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T15:29:39.450 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:29:39.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T15:29:39.510 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T15:29:39.511 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-17T15:29:39.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-17T15:29:39.511 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-17T15:29:39.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:29:39.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:39.566 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T15:29:39.579 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:39.575+0000 7fe9618e2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:29:39.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:39.582 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:39.579+0000 7f0727748680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T15:29:39.648 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:39.644+0000 7fe9618e2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:29:39.648 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:39.645+0000 7f0727748680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T15:29:39.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.735+0000 7f115e13f700 1 Processor -- start 2023-05-17T15:29:39.739 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.735+0000 7f115e13f700 1 -- start start 2023-05-17T15:29:39.741 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f115e13f700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1158153cf0 0x7f1158063d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f115e13f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f11580c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f115e13f700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11580bd6a0 con 0x7f11581540d0 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f115e13f700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580c31b0 con 0x7f1158153cf0 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f115e13f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580c3490 con 0x7f115805e460 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f11577fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1158153cf0 0x7f1158063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f1156ffd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f11581540d0 0x7f115805dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46658/0 (socket says 172.21.15.27:46658) 2023-05-17T15:29:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f1156ffd700 1 -- 172.21.15.27:0/2553088474 learned_addr learned my addr 172.21.15.27:0/2553088474 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f11577fe700 1 --2- 172.21.15.27:0/2553088474 >> v2:172.21.15.27:3300/0 conn(0x7f1158153cf0 0x7f1158063d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47096/0 (socket says 172.21.15.27:47096) 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.736+0000 7f1157fff700 1 --2- 172.21.15.27:0/2553088474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f11580c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11567fc700 1 -- 172.21.15.27:0/2553088474 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347176470 0 0) 0x7f11580bd6a0 con 0x7f11581540d0 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11567fc700 1 -- 172.21.15.27:0/2553088474 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11400033f0 con 0x7f11581540d0 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11577fe700 1 -- 172.21.15.27:0/2553088474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 msgr2=0x7f11580c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11577fe700 1 --2- 172.21.15.27:0/2553088474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f11580c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11577fe700 1 -- 172.21.15.27:0/2553088474 >> v1:172.21.15.27:6789/0 conn(0x7f11581540d0 legacy=0x7f115805dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11577fe700 1 -- 172.21.15.27:0/2553088474 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580c3770 con 0x7f1158153cf0 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11577fe700 1 --2- 172.21.15.27:0/2553088474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f1158063d20 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f1148009760 tx=0x7f1148009060).ready entity=mon.0 client_cookie=2b247d4da4ab9074 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11567fc700 1 -- 172.21.15.27:0/2553088474 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800d4a0 con 0x7f1158153cf0 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11567fc700 1 -- 172.21.15.27:0/2553088474 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800d600 con 0x7f1158153cf0 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f11567fc700 1 -- 172.21.15.27:0/2553088474 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800d980 con 0x7f1158153cf0 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f115e13f700 1 -- 172.21.15.27:0/2553088474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 msgr2=0x7f1158063d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f115e13f700 1 --2- 172.21.15.27:0/2553088474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f1158063d20 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f1148009760 tx=0x7f1148009060).stop 2023-05-17T15:29:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f115e13f700 1 -- 172.21.15.27:0/2553088474 shutdown_connections 2023-05-17T15:29:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.737+0000 7f115e13f700 1 --2- 172.21.15.27:0/2553088474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f11580c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.738+0000 7f115e13f700 1 --2- 172.21.15.27:0/2553088474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f1158063d20 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.738+0000 7f115e13f700 1 -- 172.21.15.27:0/2553088474 >> 172.21.15.27:0/2553088474 conn(0x7f11580c7920 msgr2=0x7f11580c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.738+0000 7f115e13f700 1 -- 172.21.15.27:0/2553088474 shutdown_connections 2023-05-17T15:29:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.738+0000 7f115e13f700 1 -- 172.21.15.27:0/2553088474 wait complete. 2023-05-17T15:29:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.739+0000 7f115e13f700 1 Processor -- start 2023-05-17T15:29:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.739+0000 7f115e13f700 1 -- start start 2023-05-17T15:29:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f1158152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f11580a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11581540d0 0x7f11580a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158152760 con 0x7f1158153cf0 2023-05-17T15:29:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11580ac840 con 0x7f11581540d0 2023-05-17T15:29:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580ad360 con 0x7f115805e460 2023-05-17T15:29:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f11580a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f11580a62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47104/0 (socket says 172.21.15.27:47104) 2023-05-17T15:29:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f11577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f1158152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 -- 172.21.15.27:0/2344291353 learned_addr learned my addr 172.21.15.27:0/2344291353 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1157fff700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11581540d0 0x7f11580a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 -- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 msgr2=0x7f1158152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f1158152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 -- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11581540d0 msgr2=0x7f11580a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11581540d0 0x7f11580a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 -- 172.21.15.27:0/2344291353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480092a0 con 0x7f1158153cf0 2023-05-17T15:29:39.750 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f11577fe700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f1158152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f1156ffd700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f11580a62a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f114c00c450 tx=0x7f114c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0070d0 con 0x7f1158153cf0 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c007230 con 0x7f1158153cf0 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11580ad640 con 0x7f1158153cf0 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0075b0 con 0x7f1158153cf0 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.740+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11580a6790 con 0x7f1158153cf0 2023-05-17T15:29:39.751 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.741+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115806bdf0 con 0x7f1158153cf0 2023-05-17T15:29:39.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.743+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f114c010070 con 0x7f1158153cf0 2023-05-17T15:29:39.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.743+0000 7f113f7fe700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 0x7f11440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:39.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.743+0000 7f11577fe700 1 -- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 msgr2=0x7f11440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:39.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.743+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f114c079690 con 0x7f1158153cf0 2023-05-17T15:29:39.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.743+0000 7f11577fe700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 0x7f11440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:39.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.746+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f114c04aab0 con 0x7f1158153cf0 2023-05-17T15:29:39.933 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:39.930+0000 7f0727748680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:29:39.945 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:39.941+0000 7fe9618e2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T15:29:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.944+0000 7f11577fe700 1 -- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 msgr2=0x7f11440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.944+0000 7f11577fe700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 0x7f11440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:39.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.966+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11580bd070 con 0x7f1158153cf0 2023-05-17T15:29:39.971 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.967+0000 7f113f7fe700 1 -- 172.21.15.27:0/2344291353 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f114c04e0d0 con 0x7f1158153cf0 2023-05-17T15:29:39.971 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:39.971 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:29:19.585435+0000","modified":"2023-05-17T15:29:22.589859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8988":{"gid":8988,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3491718569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3491718569},{"type":"v1","addr":"172.21.15.27:6835","nonce":3491718569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-17T15:29:39.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 msgr2=0x7f11440612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:39.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 0x7f11440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:39.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 msgr2=0x7f11580a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f11580a62a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f114c00c450 tx=0x7f114c007c80).stop 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 shutdown_connections 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f114405ede0 0x7f11440612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11581540d0 0x7f11580a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f115805e460 0x7f1158152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 --2- 172.21.15.27:0/2344291353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1158153cf0 0x7f11580a62a0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 >> 172.21.15.27:0/2344291353 conn(0x7f11580c7920 msgr2=0x7f11580c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 shutdown_connections 2023-05-17T15:29:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:39.969+0000 7f115e13f700 1 -- 172.21.15.27:0/2344291353 wait complete. 2023-05-17T15:29:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 74 2023-05-17T15:29:39.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:40.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.140+0000 7f6a31028700 1 Processor -- start 2023-05-17T15:29:40.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.140+0000 7f6a31028700 1 -- start start 2023-05-17T15:29:40.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a31028700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a31028700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6a2c0a9f70 0x7f6a2c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a31028700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0aa3b0 0x7f6a2c154260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a31028700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c154750 con 0x7f6a2c0a9f70 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a31028700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c05e7e0 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a31028700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c05eac0 con 0x7f6a2c0c60c0 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6a2c0a9f70 0x7f6a2c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6a2c0a9f70 0x7f6a2c153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47128/0 (socket says 172.21.15.27:47128) 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 -- 172.21.15.27:0/2306441939 learned_addr learned my addr 172.21.15.27:0/2306441939 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2ad9d700 1 --2- 172.21.15.27:0/2306441939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2b59e700 1 --2- 172.21.15.27:0/2306441939 >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0aa3b0 0x7f6a2c154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 -- 172.21.15.27:0/2306441939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 msgr2=0x7f6a2c0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 --2- 172.21.15.27:0/2306441939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 -- 172.21.15.27:0/2306441939 >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0aa3b0 msgr2=0x7f6a2c154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:40.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 --2- 172.21.15.27:0/2306441939 >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0aa3b0 0x7f6a2c154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 -- 172.21.15.27:0/2306441939 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0bfd70 con 0x7f6a2c0a9f70 2023-05-17T15:29:40.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.141+0000 7f6a2a59c700 1 --2- 172.21.15.27:0/2306441939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c153d70 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f6a2c0841a0 tx=0x7f6a1c0090f0).ready entity=mon.0 client_cookie=a7e3f326ad53b608 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:40.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a29d9b700 1 -- 172.21.15.27:0/2306441939 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00f510 con 0x7f6a2c0a9f70 2023-05-17T15:29:40.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a29d9b700 1 -- 172.21.15.27:0/2306441939 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00f670 con 0x7f6a2c0a9f70 2023-05-17T15:29:40.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a29d9b700 1 -- 172.21.15.27:0/2306441939 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00f9f0 con 0x7f6a2c0a9f70 2023-05-17T15:29:40.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 -- 172.21.15.27:0/2306441939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0a9f70 msgr2=0x7f6a2c153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 --2- 172.21.15.27:0/2306441939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c153d70 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f6a2c0841a0 tx=0x7f6a1c0090f0).stop 2023-05-17T15:29:40.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 -- 172.21.15.27:0/2306441939 shutdown_connections 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 --2- 172.21.15.27:0/2306441939 >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0aa3b0 0x7f6a2c154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 --2- 172.21.15.27:0/2306441939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 --2- 172.21.15.27:0/2306441939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c153d70 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 -- 172.21.15.27:0/2306441939 >> 172.21.15.27:0/2306441939 conn(0x7f6a2c069e70 msgr2=0x7f6a2c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 -- 172.21.15.27:0/2306441939 shutdown_connections 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.142+0000 7f6a31028700 1 -- 172.21.15.27:0/2306441939 wait complete. 2023-05-17T15:29:40.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.143+0000 7f6a31028700 1 Processor -- start 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.143+0000 7f6a31028700 1 -- start start 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a31028700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a31028700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 0x7f6a2c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a31028700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a31028700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0cb9f0 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a31028700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c14b280 con 0x7f6a2c0a9f70 2023-05-17T15:29:40.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a31028700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c14f8c0 con 0x7f6a2c0c60c0 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a2a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 0x7f6a2c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a2a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 0x7f6a2c0cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47132/0 (socket says 172.21.15.27:47132) 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a2a59c700 1 -- 172.21.15.27:0/1999353513 learned_addr learned my addr 172.21.15.27:0/1999353513 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a2ad9d700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.144+0000 7f6a2b59e700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a2a59c700 1 -- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 msgr2=0x7f6a2c0cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a2a59c700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a2a59c700 1 -- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0a9f70 msgr2=0x7f6a2c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a2a59c700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a2a59c700 1 -- 172.21.15.27:0/1999353513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009370 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a2a59c700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 0x7f6a2c0cb010 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f6a1c011000 tx=0x7f6a1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00f7e0 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00f940 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0ca3a0 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c01c670 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.145+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c0c9a70 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.146+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c05f4a0 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.146+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f6a1c02c070 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.147+0000 7f6a22ffd700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6a0c05ede0 0x7f6a0c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.155 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.147+0000 7f6a2ad9d700 1 -- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6a0c05ede0 msgr2=0x7f6a0c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:40.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.147+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f6a1c07b770 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.156 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.147+0000 7f6a2ad9d700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6a0c05ede0 0x7f6a0c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:40.158 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.155+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6a1c04cb10 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.328+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a2c06bdf0 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.330+0000 7f6a22ffd700 1 -- 172.21.15.27:0/1999353513 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+17392 (secure 0 0 0) 0x7f6a1c020090 con 0x7f6a2c0aa3b0 2023-05-17T15:29:40.334 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:40.334 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":178,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:36.343528+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:29:18.145777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-17T15:29:18.560834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2744476591":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6837/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6836/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:0/2976443407":"2023-05-18T15:29:36.343483+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:40.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6a0c05ede0 msgr2=0x7f6a0c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:40.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6a0c05ede0 0x7f6a0c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 msgr2=0x7f6a2c0cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 0x7f6a2c0cb010 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f6a1c011000 tx=0x7f6a1c017000).stop 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 shutdown_connections 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f6a0c05ede0 0x7f6a0c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2c0c60c0 0x7f6a2c0cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0a9f70 0x7f6a2c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.331+0000 7f6a31028700 1 --2- 172.21.15.27:0/1999353513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a2c0aa3b0 0x7f6a2c0cb010 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.332+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 >> 172.21.15.27:0/1999353513 conn(0x7f6a2c069e70 msgr2=0x7f6a2c0ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:40.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.332+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 shutdown_connections 2023-05-17T15:29:40.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.332+0000 7f6a31028700 1 -- 172.21.15.27:0/1999353513 wait complete. 2023-05-17T15:29:40.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-17T14:53:43.630293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T14:53:45.925243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T15:29:18.145777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T15:29:18.560834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T15:29:40.349 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-17T15:29:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.469+0000 7f71d73e6700 1 Processor -- start 2023-05-17T15:29:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.469+0000 7f71d73e6700 1 -- start start 2023-05-17T15:29:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d73e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d73e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71d00691f0 0x7f71d00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d73e6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d0158790 con 0x7f71d01543d0 2023-05-17T15:29:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d73e6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00c1c50 con 0x7f71d00691f0 2023-05-17T15:29:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d73e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0157e60 con 0x7f71d00c6310 2023-05-17T15:29:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5182700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f71d01543d0 0x7f71d00c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46700/0 (socket says 172.21.15.27:46700) 2023-05-17T15:29:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5182700 1 -- 172.21.15.27:0/574547031 learned_addr learned my addr 172.21.15.27:0/574547031 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5983700 1 --2- 172.21.15.27:0/574547031 >> v2:172.21.15.40:3300/0 conn(0x7f71d00691f0 0x7f71d00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d4981700 1 --2- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71c7fff700 1 -- 172.21.15.27:0/574547031 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799806062 0 0) 0x7f71d0158790 con 0x7f71d01543d0 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71c7fff700 1 -- 172.21.15.27:0/574547031 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71bc0033f0 con 0x7f71d01543d0 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5983700 1 -- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 msgr2=0x7f71d0068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5983700 1 --2- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d0068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5983700 1 -- 172.21.15.27:0/574547031 >> v1:172.21.15.27:6789/0 conn(0x7f71d01543d0 legacy=0x7f71d00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5983700 1 -- 172.21.15.27:0/574547031 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0158140 con 0x7f71d00691f0 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.470+0000 7f71d5983700 1 --2- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d00bfc80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f71c8009e60 tx=0x7f71c8009780).ready entity=mon.1 client_cookie=7c06dd7add53be05 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71c7fff700 1 -- 172.21.15.27:0/574547031 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800e070 con 0x7f71d00691f0 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71c7fff700 1 -- 172.21.15.27:0/574547031 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800bab0 con 0x7f71d00691f0 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71c7fff700 1 -- 172.21.15.27:0/574547031 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800be30 con 0x7f71d00691f0 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 -- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 msgr2=0x7f71d00bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 --2- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d00bfc80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f71c8009e60 tx=0x7f71c8009780).stop 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 -- 172.21.15.27:0/574547031 shutdown_connections 2023-05-17T15:29:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 --2- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d00bfc80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 --2- 172.21.15.27:0/574547031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d0068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 -- 172.21.15.27:0/574547031 >> 172.21.15.27:0/574547031 conn(0x7f71d00cb7f0 msgr2=0x7f71d00c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:40.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 -- 172.21.15.27:0/574547031 shutdown_connections 2023-05-17T15:29:40.479 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.471+0000 7f71d73e6700 1 -- 172.21.15.27:0/574547031 wait complete. 2023-05-17T15:29:40.481 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.472+0000 7f71d73e6700 1 Processor -- start 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.472+0000 7f71d73e6700 1 -- start start 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d73e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d01655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d73e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d00c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d73e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 0x7f71d01643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d73e6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00ae0a0 con 0x7f71d01543d0 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d73e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00add70 con 0x7f71d00691f0 2023-05-17T15:29:40.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d73e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0164d60 con 0x7f71d00c6310 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d5983700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 0x7f71d01643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d5983700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 0x7f71d01643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47148/0 (socket says 172.21.15.27:47148) 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.473+0000 7f71d5983700 1 -- 172.21.15.27:0/4120809654 learned_addr learned my addr 172.21.15.27:0/4120809654 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d4981700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d00c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5182700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d01655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5983700 1 -- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 msgr2=0x7f71d00c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5983700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d00c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5983700 1 -- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 msgr2=0x7f71d01655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5983700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d01655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5983700 1 -- 172.21.15.27:0/4120809654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009a20 con 0x7f71d01543d0 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d5983700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 0x7f71d01643c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f71c800b610 tx=0x7f71c8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8013e50 con 0x7f71d01543d0 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c801d630 con 0x7f71d01543d0 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d0165040 con 0x7f71d01543d0 2023-05-17T15:29:40.484 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c801d9f0 con 0x7f71d01543d0 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.474+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d00c4a70 con 0x7f71d01543d0 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.475+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d00ae210 con 0x7f71d01543d0 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.476+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f71c801dd60 con 0x7f71d01543d0 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.476+0000 7f71c57fa700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 0x7f71b40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.476+0000 7f71d5182700 1 -- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 msgr2=0x7f71b40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.476+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f71c807bf10 con 0x7f71d01543d0 2023-05-17T15:29:40.485 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.476+0000 7f71d5182700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 0x7f71b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.481+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71c804d2b0 con 0x7f71d01543d0 2023-05-17T15:29:40.601 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:40.597+0000 7f0727748680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:29:40.617 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:40.613+0000 7fe9618e2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T15:29:40.670 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:40.665+0000 7f0727748680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:29:40.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.677+0000 7f71d5182700 1 -- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 msgr2=0x7f71b40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:40.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.677+0000 7f71d5182700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 0x7f71b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:40.687 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:40.683+0000 7fe9618e2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T15:29:40.703 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.699+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f71d006bdf0 con 0x7f71d01543d0 2023-05-17T15:29:40.704 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.699+0000 7f71c57fa700 1 -- 172.21.15.27:0/4120809654 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v178) v1 ==== 110+0+10 (secure 0 0 0) 0x7f71c80508d0 con 0x7f71d01543d0 2023-05-17T15:29:40.704 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2023-05-17T15:29:40.705 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 msgr2=0x7f71b40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:40.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 0x7f71b40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:40.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 msgr2=0x7f71d01643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.706 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 0x7f71d01643c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f71c800b610 tx=0x7f71c8009780).stop 2023-05-17T15:29:40.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 shutdown_connections 2023-05-17T15:29:40.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f71b405ede0 0x7f71b40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:40.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71d01543d0 0x7f71d01643c0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.707 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d00691f0 0x7f71d01655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 --2- 172.21.15.27:0/4120809654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d00c6310 0x7f71d00c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 >> 172.21.15.27:0/4120809654 conn(0x7f71d00cb7f0 msgr2=0x7f71d01539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:40.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 shutdown_connections 2023-05-17T15:29:40.708 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.701+0000 7f71d73e6700 1 -- 172.21.15.27:0/4120809654 wait complete. 2023-05-17T15:29:40.718 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T15:29:40.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.836+0000 7f95cdcde700 1 Processor -- start 2023-05-17T15:29:40.841 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.836+0000 7f95cdcde700 1 -- start start 2023-05-17T15:29:40.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95cdcde700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95cdcde700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c8158790 con 0x7f95c8069410 2023-05-17T15:29:40.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95cdcde700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80c6570 con 0x7f95c80c60f0 2023-05-17T15:29:40.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95cdcde700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80c1c50 con 0x7f95c81543d0 2023-05-17T15:29:40.843 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c7fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f95c8069410 0x7f95c80bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46720/0 (socket says 172.21.15.27:46720) 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c7fff700 1 -- 172.21.15.27:0/1139953507 learned_addr learned my addr 172.21.15.27:0/1139953507 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c77fe700 1 --2- 172.21.15.27:0/1139953507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559145042 0 0) 0x7f95c8158790 con 0x7f95c8069410 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b40033f0 con 0x7f95c8069410 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783394414 0 0) 0x7f95c80c6570 con 0x7f95c80c60f0 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c8158790 con 0x7f95c80c60f0 2023-05-17T15:29:40.844 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c77fe700 1 -- 172.21.15.27:0/1139953507 >> v1:172.21.15.40:6789/0 conn(0x7f95c80c60f0 legacy=0x7f95c8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c77fe700 1 -- 172.21.15.27:0/1139953507 >> v1:172.21.15.27:6789/0 conn(0x7f95c8069410 legacy=0x7f95c80bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.838+0000 7f95c77fe700 1 -- 172.21.15.27:0/1139953507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8157e60 con 0x7f95c81543d0 2023-05-17T15:29:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.839+0000 7f95c77fe700 1 --2- 172.21.15.27:0/1139953507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80c5c00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f95b0009790 tx=0x7f95b0009060).ready entity=mon.2 client_cookie=3471d48ae8ab4a46 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.839+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000f510 con 0x7f95c81543d0 2023-05-17T15:29:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.839+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000f670 con 0x7f95c81543d0 2023-05-17T15:29:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.839+0000 7f95c67fc700 1 -- 172.21.15.27:0/1139953507 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000f9f0 con 0x7f95c81543d0 2023-05-17T15:29:40.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.839+0000 7f95cdcde700 1 -- 172.21.15.27:0/1139953507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 msgr2=0x7f95c80c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.839+0000 7f95cdcde700 1 --2- 172.21.15.27:0/1139953507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80c5c00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f95b0009790 tx=0x7f95b0009060).stop 2023-05-17T15:29:40.846 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.840+0000 7f95cdcde700 1 -- 172.21.15.27:0/1139953507 shutdown_connections 2023-05-17T15:29:40.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.840+0000 7f95cdcde700 1 --2- 172.21.15.27:0/1139953507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80c5c00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.840+0000 7f95cdcde700 1 -- 172.21.15.27:0/1139953507 >> 172.21.15.27:0/1139953507 conn(0x7f95c80cb7f0 msgr2=0x7f95c80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:40.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.840+0000 7f95cdcde700 1 -- 172.21.15.27:0/1139953507 shutdown_connections 2023-05-17T15:29:40.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.840+0000 7f95cdcde700 1 -- 172.21.15.27:0/1139953507 wait complete. 2023-05-17T15:29:40.847 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.842+0000 7f95cdcde700 1 Processor -- start 2023-05-17T15:29:40.848 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.842+0000 7f95cdcde700 1 -- start start 2023-05-17T15:29:40.849 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95cdcde700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 0x7f95c8152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95cdcde700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c80c60f0 0x7f95c80a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95cdcde700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95cdcde700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80a9c50 con 0x7f95c8069410 2023-05-17T15:29:40.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95cdcde700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80aeed0 con 0x7f95c80c60f0 2023-05-17T15:29:40.850 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95cdcde700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80c2cb0 con 0x7f95c81543d0 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 0x7f95c8152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 0x7f95c8152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47160/0 (socket says 172.21.15.27:47160) 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 -- 172.21.15.27:0/3028942223 learned_addr learned my addr 172.21.15.27:0/3028942223 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c7fff700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c6ffd700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c80c60f0 0x7f95c80a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 -- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 msgr2=0x7f95c80a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 -- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c80c60f0 msgr2=0x7f95c80a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c80c60f0 0x7f95c80a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 -- 172.21.15.27:0/3028942223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00092a0 con 0x7f95c8069410 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.843+0000 7f95c77fe700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 0x7f95c8152e70 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f95c8083d00 tx=0x7f95b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.844+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0000be0 con 0x7f95c8069410 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.844+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000f7e0 con 0x7f95c8069410 2023-05-17T15:29:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.844+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c80c2f90 con 0x7f95c8069410 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.844+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b001b640 con 0x7f95c8069410 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.844+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c8153360 con 0x7f95c8069410 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.845+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c80c34b0 con 0x7f95c8069410 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.845+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f95b000f070 con 0x7f95c8069410 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.846+0000 7f95bf7fe700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f95a805ede0 0x7f95a80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.846+0000 7f95c6ffd700 1 -- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f95a805ede0 msgr2=0x7f95a80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.846+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f95b007b350 con 0x7f95c8069410 2023-05-17T15:29:40.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.846+0000 7f95c6ffd700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f95a805ede0 0x7f95a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:40.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:40.853+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95c80c34b0 con 0x7f95c8069410 2023-05-17T15:29:40.862 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:40.859+0000 7f0727748680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:29:40.891 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:40.887+0000 7fe9618e2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T15:29:41.034 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.030+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f95c80c34b0 con 0x7f95c8069410 2023-05-17T15:29:41.035 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.031+0000 7f95bf7fe700 1 -- 172.21.15.27:0/3028942223 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v178) v1 ==== 92+0+10 (secure 0 0 0) 0x7f95c80c34b0 con 0x7f95c8069410 2023-05-17T15:29:41.035 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 8 2023-05-17T15:29:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f95a805ede0 msgr2=0x7f95a80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f95a805ede0 0x7f95a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 msgr2=0x7f95c8152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 0x7f95c8152e70 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f95c8083d00 tx=0x7f95b0017000).stop 2023-05-17T15:29:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 shutdown_connections 2023-05-17T15:29:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f95a805ede0 0x7f95a80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:41.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95c81543d0 0x7f95c80a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c8069410 0x7f95c8152e70 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 --2- 172.21.15.27:0/3028942223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c80c60f0 0x7f95c80a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 >> 172.21.15.27:0/3028942223 conn(0x7f95c80cb7f0 msgr2=0x7f95c81559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:41.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 shutdown_connections 2023-05-17T15:29:41.038 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.033+0000 7f95cdcde700 1 -- 172.21.15.27:0/3028942223 wait complete. 2023-05-17T15:29:41.049 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T15:29:41.171 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.167+0000 7ff7b048c700 1 Processor -- start 2023-05-17T15:29:41.172 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.167+0000 7ff7b048c700 1 -- start start 2023-05-17T15:29:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.168+0000 7ff7b048c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7a81543d0 0x7ff7a80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.168+0000 7ff7b048c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7a80c60f0 0x7ff7a8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.168+0000 7ff7b048c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a80691f0 0x7ff7a81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.168+0000 7ff7b048c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80c1c50 con 0x7ff7a81543d0 2023-05-17T15:29:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.168+0000 7ff7b048c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a8158790 con 0x7ff7a80c60f0 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.168+0000 7ff7b048c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80c6570 con 0x7ff7a80691f0 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7a81543d0 0x7ff7a80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7a81543d0 0x7ff7a80c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47182/0 (socket says 172.21.15.27:47182) 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 -- 172.21.15.27:0/2864504345 learned_addr learned my addr 172.21.15.27:0/2864504345 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7aea29700 1 --2- 172.21.15.27:0/2864504345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a80691f0 0x7ff7a81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ada27700 1 --2- 172.21.15.27:0/2864504345 >> v2:172.21.15.40:3300/0 conn(0x7ff7a80c60f0 0x7ff7a8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 -- 172.21.15.27:0/2864504345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a80691f0 msgr2=0x7ff7a81547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 --2- 172.21.15.27:0/2864504345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a80691f0 0x7ff7a81547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 -- 172.21.15.27:0/2864504345 >> v2:172.21.15.40:3300/0 conn(0x7ff7a80c60f0 msgr2=0x7ff7a8068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 --2- 172.21.15.27:0/2864504345 >> v2:172.21.15.40:3300/0 conn(0x7ff7a80c60f0 0x7ff7a8068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 -- 172.21.15.27:0/2864504345 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8157e60 con 0x7ff7a81543d0 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ada27700 1 --2- 172.21.15.27:0/2864504345 >> v2:172.21.15.40:3300/0 conn(0x7ff7a80c60f0 0x7ff7a8068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ae228700 1 --2- 172.21.15.27:0/2864504345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a81543d0 0x7ff7a80c5c00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7ff7a80c5620 tx=0x7ff7a40090f0).ready entity=mon.0 client_cookie=2dc40bf40cca02c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ad226700 1 -- 172.21.15.27:0/2864504345 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400b600 con 0x7ff7a81543d0 2023-05-17T15:29:41.176 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ad226700 1 -- 172.21.15.27:0/2864504345 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400b760 con 0x7ff7a81543d0 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.169+0000 7ff7ad226700 1 -- 172.21.15.27:0/2864504345 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400bae0 con 0x7ff7a81543d0 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 -- 172.21.15.27:0/2864504345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a81543d0 msgr2=0x7ff7a80c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 --2- 172.21.15.27:0/2864504345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a81543d0 0x7ff7a80c5c00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7ff7a80c5620 tx=0x7ff7a40090f0).stop 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 -- 172.21.15.27:0/2864504345 shutdown_connections 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 --2- 172.21.15.27:0/2864504345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a81543d0 0x7ff7a80c5c00 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 --2- 172.21.15.27:0/2864504345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a80691f0 0x7ff7a81547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 --2- 172.21.15.27:0/2864504345 >> v2:172.21.15.40:3300/0 conn(0x7ff7a80c60f0 0x7ff7a8068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 -- 172.21.15.27:0/2864504345 >> 172.21.15.27:0/2864504345 conn(0x7ff7a80cb7f0 msgr2=0x7ff7a80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:41.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 -- 172.21.15.27:0/2864504345 shutdown_connections 2023-05-17T15:29:41.178 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.170+0000 7ff7b048c700 1 -- 172.21.15.27:0/2864504345 wait complete. 2023-05-17T15:29:41.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.171+0000 7ff7b048c700 1 Processor -- start 2023-05-17T15:29:41.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.171+0000 7ff7b048c700 1 -- start start 2023-05-17T15:29:41.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80691f0 0x7ff7a8147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 0x7ff7a80c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a81543d0 0x7ff7a80c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.180 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8145330 con 0x7ff7a80c60f0 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80adcd0 con 0x7ff7a80691f0 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80adfb0 con 0x7ff7a81543d0 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 0x7ff7a80c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 0x7ff7a80c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47190/0 (socket says 172.21.15.27:47190) 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 -- 172.21.15.27:0/426743201 learned_addr learned my addr 172.21.15.27:0/426743201 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ae228700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80691f0 0x7ff7a8147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7aea29700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a81543d0 0x7ff7a80c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 -- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a81543d0 msgr2=0x7ff7a80c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a81543d0 0x7ff7a80c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 -- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80691f0 msgr2=0x7ff7a8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80691f0 0x7ff7a8147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 -- 172.21.15.27:0/426743201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a4009370 con 0x7ff7a80c60f0 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7aea29700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a81543d0 0x7ff7a80c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7ada27700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 0x7ff7a80c2d90 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7ff79800d890 tx=0x7ff798008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:41.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798011590 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7980116f0 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798011a70 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.172+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a80c3830 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.173+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a80c3df0 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.173+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a80c50a0 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.174+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff798012420 con 0x7ff7a80c60f0 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.174+0000 7ff79e7fc700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff78c05ede0 0x7ff78c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.174+0000 7ff7ae228700 1 -- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff78c05ede0 msgr2=0x7ff78c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:41.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.174+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7ff7980799a0 con 0x7ff7a80c60f0 2023-05-17T15:29:41.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.175+0000 7ff7ae228700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff78c05ede0 0x7ff78c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:41.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.178+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff79804ace0 con 0x7ff7a80c60f0 2023-05-17T15:29:41.298 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:41.294+0000 7f0727748680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:29:41.334 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:41.331+0000 7fe9618e2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T15:29:41.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.354+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7a8158140 con 0x7ff7a80c60f0 2023-05-17T15:29:41.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.354+0000 7ff79e7fc700 1 -- 172.21.15.27:0/426743201 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff79804e300 con 0x7ff7a80c60f0 2023-05-17T15:29:41.359 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:29:41.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff78c05ede0 msgr2=0x7ff78c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:41.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff78c05ede0 0x7ff78c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 msgr2=0x7ff7a80c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 0x7ff7a80c2d90 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7ff79800d890 tx=0x7ff798008040).stop 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 shutdown_connections 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff78c05ede0 0x7ff78c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7a81543d0 0x7ff7a80c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80691f0 0x7ff7a8147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 --2- 172.21.15.27:0/426743201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7a80c60f0 0x7ff7a80c2d90 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 >> 172.21.15.27:0/426743201 conn(0x7ff7a80cb7f0 msgr2=0x7ff7a81559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:41.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 shutdown_connections 2023-05-17T15:29:41.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.356+0000 7ff7b048c700 1 -- 172.21.15.27:0/426743201 wait complete. 2023-05-17T15:29:41.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T15:29:41.406 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:41.403+0000 7f0727748680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:41.447 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:41.443+0000 7fe9618e2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:41.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.489+0000 7fbb41084700 1 Processor -- start 2023-05-17T15:29:41.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.489+0000 7fbb41084700 1 -- start start 2023-05-17T15:29:41.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb41084700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb3c0a7e90 0x7fbb3c0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb41084700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c156830 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb41084700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c065e90 con 0x7fbb3c156170 2023-05-17T15:29:41.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb41084700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0bdab0 con 0x7fbb3c0a7e90 2023-05-17T15:29:41.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb3ad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb3c0a7e90 0x7fbb3c0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb3a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbb3c0c3f20 0x7fbb3c155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46760/0 (socket says 172.21.15.27:46760) 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.490+0000 7fbb3a59c700 1 -- 172.21.15.27:0/3376467248 learned_addr learned my addr 172.21.15.27:0/3376467248 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb3ad9d700 1 -- 172.21.15.27:0/3376467248 >> v1:172.21.15.40:6789/0 conn(0x7fbb3c156170 legacy=0x7fbb3c0bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb3ad9d700 1 -- 172.21.15.27:0/3376467248 >> v1:172.21.15.27:6789/0 conn(0x7fbb3c0c3f20 legacy=0x7fbb3c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb39d9b700 1 -- 172.21.15.27:0/3376467248 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866716570 0 0) 0x7fbb3c156830 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb3ad9d700 1 -- 172.21.15.27:0/3376467248 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c066170 con 0x7fbb3c0a7e90 2023-05-17T15:29:41.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb3ad9d700 1 --2- 172.21.15.27:0/3376467248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0a7e90 0x7fbb3c0c3a30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fbb2c009760 tx=0x7fbb2c009060).ready entity=mon.0 client_cookie=e2cdf73bf510e620 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:41.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb39d9b700 1 -- 172.21.15.27:0/3376467248 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00b580 con 0x7fbb3c0a7e90 2023-05-17T15:29:41.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb39d9b700 1 -- 172.21.15.27:0/3376467248 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00b6e0 con 0x7fbb3c0a7e90 2023-05-17T15:29:41.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.491+0000 7fbb39d9b700 1 -- 172.21.15.27:0/3376467248 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00ba60 con 0x7fbb3c0a7e90 2023-05-17T15:29:41.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 -- 172.21.15.27:0/3376467248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0a7e90 msgr2=0x7fbb3c0c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 --2- 172.21.15.27:0/3376467248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0a7e90 0x7fbb3c0c3a30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fbb2c009760 tx=0x7fbb2c009060).stop 2023-05-17T15:29:41.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 -- 172.21.15.27:0/3376467248 shutdown_connections 2023-05-17T15:29:41.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 --2- 172.21.15.27:0/3376467248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0a7e90 0x7fbb3c0c3a30 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 -- 172.21.15.27:0/3376467248 >> 172.21.15.27:0/3376467248 conn(0x7fbb3c0c94b0 msgr2=0x7fbb3c0c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:41.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 -- 172.21.15.27:0/3376467248 shutdown_connections 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.492+0000 7fbb41084700 1 -- 172.21.15.27:0/3376467248 wait complete. 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.493+0000 7fbb41084700 1 Processor -- start 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.493+0000 7fbb41084700 1 -- start start 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb41084700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb3c0a7e90 0x7fbb3c1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb41084700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 0x7fbb3c14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb41084700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3c156170 0x7fbb3c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb41084700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0ac710 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb41084700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0abb00 con 0x7fbb3c156170 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb41084700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0abde0 con 0x7fbb3c0a7e90 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 0x7fbb3c14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 0x7fbb3c14da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47204/0 (socket says 172.21.15.27:47204) 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 -- 172.21.15.27:0/1157925747 learned_addr learned my addr 172.21.15.27:0/1157925747 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3ad9d700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb3c0a7e90 0x7fbb3c1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3b59e700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3c156170 0x7fbb3c0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 -- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb3c0a7e90 msgr2=0x7fbb3c1500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb3c0a7e90 0x7fbb3c1500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 -- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3c156170 msgr2=0x7fbb3c0c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3c156170 0x7fbb3c0c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 -- 172.21.15.27:0/1157925747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0092a0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.494+0000 7fbb3a59c700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 0x7fbb3c14da10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fbb2400c490 tx=0x7fbb24007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.495+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240070d0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.495+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24007230 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.495+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0ac0c0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.495+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240075f0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.495+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c1505d0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.496+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c06bdf0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.496+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fbb24010070 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.496+0000 7fbb32ffd700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbb1c05edb0 0x7fbb1c061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.496+0000 7fbb3ad9d700 1 -- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbb1c05edb0 msgr2=0x7fbb1c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.496+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fbb24079480 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.496+0000 7fbb3ad9d700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbb1c05edb0 0x7fbb1c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.500+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb2404a820 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.565 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:41.561+0000 7f0727748680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:41.608 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:41.604+0000 7fe9618e2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:41.642 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:41.639+0000 7f0727748680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:29:41.682 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.678+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb3c0c1dd0 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.683 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.679+0000 7fbb32ffd700 1 -- 172.21.15.27:0/1157925747 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb2404de40 con 0x7fbb3c0c3f20 2023-05-17T15:29:41.683 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2023-05-17T15:29:41.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbb1c05edb0 msgr2=0x7fbb1c061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:41.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbb1c05edb0 0x7fbb1c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:41.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 msgr2=0x7fbb3c14da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 0x7fbb3c14da10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fbb2400c490 tx=0x7fbb24007e40).stop 2023-05-17T15:29:41.685 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 shutdown_connections 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbb1c05edb0 0x7fbb1c061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3c156170 0x7fbb3c0c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb3c0a7e90 0x7fbb3c1500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 --2- 172.21.15.27:0/1157925747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c0c3f20 0x7fbb3c14da10 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 >> 172.21.15.27:0/1157925747 conn(0x7fbb3c0c94b0 msgr2=0x7fbb3c153640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 shutdown_connections 2023-05-17T15:29:41.686 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.681+0000 7fbb41084700 1 -- 172.21.15.27:0/1157925747 wait complete. 2023-05-17T15:29:41.687 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:41.683+0000 7fe9618e2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T15:29:41.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:41.712 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:41.708+0000 7f0727748680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:29:41.759 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:41.755+0000 7fe9618e2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T15:29:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.810+0000 7fe51b06b700 1 Processor -- start 2023-05-17T15:29:41.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.810+0000 7fe51b06b700 1 -- start start 2023-05-17T15:29:41.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51b06b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5140c6fe0 0x7fe5140c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51b06b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe51414ff10 0x7fe514150390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51b06b700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5140c25b0 0x7fe5140c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51b06b700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5140a6a90 con 0x7fe5140c25b0 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51b06b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5140c3370 con 0x7fe5140c6fe0 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51b06b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140c3650 con 0x7fe51414ff10 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5140c25b0 0x7fe5140c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5140c25b0 0x7fe5140c2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47214/0 (socket says 172.21.15.27:47214) 2023-05-17T15:29:41.817 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 -- 172.21.15.27:0/2859078620 learned_addr learned my addr 172.21.15.27:0/2859078620 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a069700 1 --2- 172.21.15.27:0/2859078620 >> v2:172.21.15.40:3300/0 conn(0x7fe5140c6fe0 0x7fe5140c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe519868700 1 --2- 172.21.15.27:0/2859078620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe51414ff10 0x7fe514150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 -- 172.21.15.27:0/2859078620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe51414ff10 msgr2=0x7fe514150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 --2- 172.21.15.27:0/2859078620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe51414ff10 0x7fe514150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 -- 172.21.15.27:0/2859078620 >> v2:172.21.15.40:3300/0 conn(0x7fe5140c6fe0 msgr2=0x7fe5140c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 --2- 172.21.15.27:0/2859078620 >> v2:172.21.15.40:3300/0 conn(0x7fe5140c6fe0 0x7fe5140c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 -- 172.21.15.27:0/2859078620 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140bbee0 con 0x7fe5140c25b0 2023-05-17T15:29:41.818 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.812+0000 7fe51a86a700 1 --2- 172.21.15.27:0/2859078620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5140c25b0 0x7fe5140c2a40 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fe5140c6df0 tx=0x7fe50c00a950).ready entity=mon.0 client_cookie=699d3211f81163c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:41.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe519067700 1 -- 172.21.15.27:0/2859078620 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00f070 con 0x7fe5140c25b0 2023-05-17T15:29:41.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe519067700 1 -- 172.21.15.27:0/2859078620 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c00a2e0 con 0x7fe5140c25b0 2023-05-17T15:29:41.819 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe519067700 1 -- 172.21.15.27:0/2859078620 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00cc60 con 0x7fe5140c25b0 2023-05-17T15:29:41.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 -- 172.21.15.27:0/2859078620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5140c25b0 msgr2=0x7fe5140c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 --2- 172.21.15.27:0/2859078620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5140c25b0 0x7fe5140c2a40 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fe5140c6df0 tx=0x7fe50c00a950).stop 2023-05-17T15:29:41.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 -- 172.21.15.27:0/2859078620 shutdown_connections 2023-05-17T15:29:41.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 --2- 172.21.15.27:0/2859078620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5140c25b0 0x7fe5140c2a40 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.821 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 --2- 172.21.15.27:0/2859078620 >> v2:172.21.15.40:3300/0 conn(0x7fe5140c6fe0 0x7fe5140c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 --2- 172.21.15.27:0/2859078620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe51414ff10 0x7fe514150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.813+0000 7fe51b06b700 1 -- 172.21.15.27:0/2859078620 >> 172.21.15.27:0/2859078620 conn(0x7fe514067cb0 msgr2=0x7fe5140680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.814+0000 7fe51b06b700 1 -- 172.21.15.27:0/2859078620 shutdown_connections 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.814+0000 7fe51b06b700 1 -- 172.21.15.27:0/2859078620 wait complete. 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 Processor -- start 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 -- start start 2023-05-17T15:29:41.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5140c25b0 0x7fe51414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5140c6fe0 0x7fe51414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 0x7fe5140aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51414d270 con 0x7fe51414ff10 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51414c0a0 con 0x7fe5140c6fe0 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51b06b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140ac250 con 0x7fe5140c25b0 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51a86a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 0x7fe5140aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51a86a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 0x7fe5140aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47220/0 (socket says 172.21.15.27:47220) 2023-05-17T15:29:41.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.815+0000 7fe51a86a700 1 -- 172.21.15.27:0/3343189056 learned_addr learned my addr 172.21.15.27:0/3343189056 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a069700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5140c25b0 0x7fe51414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe519868700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5140c6fe0 0x7fe51414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a86a700 1 -- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5140c25b0 msgr2=0x7fe51414cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a86a700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5140c25b0 0x7fe51414cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a86a700 1 -- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5140c6fe0 msgr2=0x7fe51414bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a86a700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5140c6fe0 0x7fe51414bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a86a700 1 -- 172.21.15.27:0/3343189056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c00abf0 con 0x7fe51414ff10 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51a86a700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 0x7fe5140aaed0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fe50c00c690 tx=0x7fe50c00a950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00c6c0 con 0x7fe51414ff10 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c00a450 con 0x7fe51414ff10 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5140ab6d0 con 0x7fe51414ff10 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c01b880 con 0x7fe51414ff10 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.816+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5140abc90 con 0x7fe51414ff10 2023-05-17T15:29:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.817+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5140be0b0 con 0x7fe51414ff10 2023-05-17T15:29:41.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.818+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe50c02a020 con 0x7fe51414ff10 2023-05-17T15:29:41.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.818+0000 7fe50a7fc700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 0x7fe4f80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:41.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.818+0000 7fe51a069700 1 -- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 msgr2=0x7fe4f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:41.826 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.818+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fe50c07df50 con 0x7fe51414ff10 2023-05-17T15:29:41.827 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.818+0000 7fe51a069700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 0x7fe4f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:41.830 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:41.826+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe50c04f260 con 0x7fe51414ff10 2023-05-17T15:29:41.983 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:41.979+0000 7f0727748680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:29:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.019+0000 7fe51a069700 1 -- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 msgr2=0x7fe4f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:42.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.019+0000 7fe51a069700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 0x7fe4f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:42.038 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:42.034+0000 7fe9618e2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T15:29:42.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.045+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe51406bdf0 con 0x7fe51414ff10 2023-05-17T15:29:42.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.046+0000 7fe50a7fc700 1 -- 172.21.15.27:0/3343189056 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4490 (secure 0 0 0) 0x7fe50c052880 con 0x7fe51414ff10 2023-05-17T15:29:42.049 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:42.050 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:29:19.585435+0000","modified":"2023-05-17T15:29:22.589859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8988":{"gid":8988,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3491718569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3491718569},{"type":"v1","addr":"172.21.15.27:6835","nonce":3491718569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-17T15:29:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 msgr2=0x7fe4f80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 0x7fe4f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 msgr2=0x7fe5140aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 0x7fe5140aaed0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fe50c00c690 tx=0x7fe50c00a950).stop 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 shutdown_connections 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fe4f805ede0 0x7fe4f80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe51414ff10 0x7fe5140aaed0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5140c25b0 0x7fe51414cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 --2- 172.21.15.27:0/3343189056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5140c6fe0 0x7fe51414bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.047+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 >> 172.21.15.27:0/3343189056 conn(0x7fe514067cb0 msgr2=0x7fe514066a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:42.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.048+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 shutdown_connections 2023-05-17T15:29:42.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.048+0000 7fe51b06b700 1 -- 172.21.15.27:0/3343189056 wait complete. 2023-05-17T15:29:42.053 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 74 2023-05-17T15:29:42.063 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:42.176 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:42.172+0000 7f0727748680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:42.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.181+0000 7fc69ae5e700 1 Processor -- start 2023-05-17T15:29:42.185 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.181+0000 7fc69ae5e700 1 -- start start 2023-05-17T15:29:42.186 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc69ae5e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6940c60c0 0x7fc6940c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc69ae5e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6940aa3b0 0x7fc6940c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc69ae5e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69405e7e0 con 0x7fc6940a9f70 2023-05-17T15:29:42.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc69ae5e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69405eac0 con 0x7fc6940c60c0 2023-05-17T15:29:42.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc69ae5e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6940bfd70 con 0x7fc6940aa3b0 2023-05-17T15:29:42.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc698bfa700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6940c60c0 0x7fc6940c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.187 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc693fff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc6940a9f70 0x7fc694153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46788/0 (socket says 172.21.15.27:46788) 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc693fff700 1 -- 172.21.15.27:0/540185321 learned_addr learned my addr 172.21.15.27:0/540185321 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.182+0000 7fc6993fb700 1 --2- 172.21.15.27:0/540185321 >> v2:172.21.15.40:3300/0 conn(0x7fc6940aa3b0 0x7fc6940c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc698bfa700 1 -- 172.21.15.27:0/540185321 >> v2:172.21.15.40:3300/0 conn(0x7fc6940aa3b0 msgr2=0x7fc6940c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc698bfa700 1 --2- 172.21.15.27:0/540185321 >> v2:172.21.15.40:3300/0 conn(0x7fc6940aa3b0 0x7fc6940c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc698bfa700 1 -- 172.21.15.27:0/540185321 >> v1:172.21.15.27:6789/0 conn(0x7fc6940a9f70 legacy=0x7fc694153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc6937fe700 1 -- 172.21.15.27:0/540185321 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840459081 0 0) 0x7fc69405e7e0 con 0x7fc6940a9f70 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc698bfa700 1 -- 172.21.15.27:0/540185321 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940c0050 con 0x7fc6940c60c0 2023-05-17T15:29:42.188 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc698bfa700 1 --2- 172.21.15.27:0/540185321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940c60c0 0x7fc6940c64a0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fc69405fcf0 tx=0x7fc688009060).ready entity=mon.0 client_cookie=564fe70d56561189 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:42.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc6937fe700 1 -- 172.21.15.27:0/540185321 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800f510 con 0x7fc6940c60c0 2023-05-17T15:29:42.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc6937fe700 1 -- 172.21.15.27:0/540185321 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800f670 con 0x7fc6940c60c0 2023-05-17T15:29:42.189 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc6937fe700 1 -- 172.21.15.27:0/540185321 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800f9f0 con 0x7fc6940c60c0 2023-05-17T15:29:42.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.183+0000 7fc69ae5e700 1 -- 172.21.15.27:0/540185321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940c60c0 msgr2=0x7fc6940c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/540185321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940c60c0 0x7fc6940c64a0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fc69405fcf0 tx=0x7fc688009060).stop 2023-05-17T15:29:42.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 -- 172.21.15.27:0/540185321 shutdown_connections 2023-05-17T15:29:42.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/540185321 >> v2:172.21.15.40:3300/0 conn(0x7fc6940aa3b0 0x7fc6940c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.191 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/540185321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940c60c0 0x7fc6940c64a0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 -- 172.21.15.27:0/540185321 >> 172.21.15.27:0/540185321 conn(0x7fc694069e70 msgr2=0x7fc69405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 -- 172.21.15.27:0/540185321 shutdown_connections 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.184+0000 7fc69ae5e700 1 -- 172.21.15.27:0/540185321 wait complete. 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.185+0000 7fc69ae5e700 1 Processor -- start 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.185+0000 7fc69ae5e700 1 -- start start 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc69ae5e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 0x7fc69414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.192 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc69ae5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6940aa3b0 0x7fc6940ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc69ae5e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6940c60c0 0x7fc6940ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc69ae5e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940acb80 con 0x7fc6940a9f70 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc69ae5e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940c2e60 con 0x7fc6940c60c0 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc69ae5e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940c3700 con 0x7fc6940aa3b0 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 0x7fc69414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 0x7fc69414c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47232/0 (socket says 172.21.15.27:47232) 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 -- 172.21.15.27:0/1639876768 learned_addr learned my addr 172.21.15.27:0/1639876768 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:42.193 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc6993fb700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6940c60c0 0x7fc6940ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc693fff700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6940aa3b0 0x7fc6940ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 -- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6940aa3b0 msgr2=0x7fc6940ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6940aa3b0 0x7fc6940ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 -- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6940c60c0 msgr2=0x7fc6940ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6940c60c0 0x7fc6940ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 -- 172.21.15.27:0/1639876768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880092a0 con 0x7fc6940a9f70 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc6993fb700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6940c60c0 0x7fc6940ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:42.194 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.186+0000 7fc698bfa700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 0x7fc69414c890 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7fc688006df0 tx=0x7fc688017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:42.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.187+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800f7e0 con 0x7fc6940a9f70 2023-05-17T15:29:42.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.187+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800f940 con 0x7fc6940a9f70 2023-05-17T15:29:42.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.187+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69414cd80 con 0x7fc6940a9f70 2023-05-17T15:29:42.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.187+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68801b690 con 0x7fc6940a9f70 2023-05-17T15:29:42.195 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.187+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6940c30b0 con 0x7fc6940a9f70 2023-05-17T15:29:42.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.188+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc68802a070 con 0x7fc6940a9f70 2023-05-17T15:29:42.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.188+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc694067cb0 con 0x7fc6940a9f70 2023-05-17T15:29:42.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.189+0000 7fc690ff9700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc67805ede0 0x7fc6780612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.189+0000 7fc693fff700 1 -- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc67805ede0 msgr2=0x7fc6780612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:42.196 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.189+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fc68807b230 con 0x7fc6940a9f70 2023-05-17T15:29:42.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.189+0000 7fc693fff700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc67805ede0 0x7fc6780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:42.197 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.193+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc694067cb0 con 0x7fc6940a9f70 2023-05-17T15:29:42.236 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:42.233+0000 7fe9618e2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T15:29:42.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.377+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc694067cb0 con 0x7fc6940a9f70 2023-05-17T15:29:42.381 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.378+0000 7fc690ff9700 1 -- 172.21.15.27:0/1639876768 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+17392 (secure 0 0 0) 0x7fc694067cb0 con 0x7fc6940a9f70 2023-05-17T15:29:42.382 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:42.382 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":178,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:36.343528+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:29:18.145777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-17T15:29:18.560834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2744476591":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6837/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6836/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:0/2976443407":"2023-05-18T15:29:36.343483+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc67805ede0 msgr2=0x7fc6780612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc67805ede0 0x7fc6780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 msgr2=0x7fc69414c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 0x7fc69414c890 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7fc688006df0 tx=0x7fc688017000).stop 2023-05-17T15:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 shutdown_connections 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc67805ede0 0x7fc6780612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6940c60c0 0x7fc6940ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6940a9f70 0x7fc69414c890 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 --2- 172.21.15.27:0/1639876768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6940aa3b0 0x7fc6940ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 >> 172.21.15.27:0/1639876768 conn(0x7fc694069e70 msgr2=0x7fc6940cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 shutdown_connections 2023-05-17T15:29:42.385 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.380+0000 7fc69ae5e700 1 -- 172.21.15.27:0/1639876768 wait complete. 2023-05-17T15:29:42.396 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:29:42.396 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.512+0000 7fae2d4b2700 1 Processor -- start 2023-05-17T15:29:42.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.512+0000 7fae2d4b2700 1 -- start start 2023-05-17T15:29:42.516 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae2d4b2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae281544f0 0x7fae280a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae2d4b2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae281549b0 con 0x7fae280aa070 2023-05-17T15:29:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae2d4b2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae28154c90 con 0x7fae280c1180 2023-05-17T15:29:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae2d4b2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae28154f70 con 0x7fae281544f0 2023-05-17T15:29:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae277fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae281544f0 0x7fae280a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae2ccb1700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fae280aa070 0x7fae280c74a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46820/0 (socket says 172.21.15.27:46820) 2023-05-17T15:29:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae2ccb1700 1 -- 172.21.15.27:0/3278714551 learned_addr learned my addr 172.21.15.27:0/3278714551 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:42.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae277fe700 1 -- 172.21.15.27:0/3278714551 >> v1:172.21.15.40:6789/0 conn(0x7fae280c1180 legacy=0x7fae280c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae277fe700 1 -- 172.21.15.27:0/3278714551 >> v1:172.21.15.27:6789/0 conn(0x7fae280aa070 legacy=0x7fae280c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae277fe700 1 -- 172.21.15.27:0/3278714551 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28155250 con 0x7fae281544f0 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae26ffd700 1 -- 172.21.15.27:0/3278714551 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106823154 0 0) 0x7fae281549b0 con 0x7fae280aa070 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae277fe700 1 --2- 172.21.15.27:0/3278714551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280a9b80 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fae10009760 tx=0x7fae10009060).ready entity=mon.0 client_cookie=be505952a0f21b66 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae26ffd700 1 -- 172.21.15.27:0/3278714551 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10009120 con 0x7fae281544f0 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae26ffd700 1 -- 172.21.15.27:0/3278714551 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1000b580 con 0x7fae281544f0 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.513+0000 7fae26ffd700 1 -- 172.21.15.27:0/3278714551 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000b900 con 0x7fae281544f0 2023-05-17T15:29:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 -- 172.21.15.27:0/3278714551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 msgr2=0x7fae280a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/3278714551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280a9b80 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fae10009760 tx=0x7fae10009060).stop 2023-05-17T15:29:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 -- 172.21.15.27:0/3278714551 shutdown_connections 2023-05-17T15:29:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/3278714551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280a9b80 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 -- 172.21.15.27:0/3278714551 >> 172.21.15.27:0/3278714551 conn(0x7fae2805dd50 msgr2=0x7fae2805e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 -- 172.21.15.27:0/3278714551 shutdown_connections 2023-05-17T15:29:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.514+0000 7fae2d4b2700 1 -- 172.21.15.27:0/3278714551 wait complete. 2023-05-17T15:29:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.515+0000 7fae2d4b2700 1 Processor -- start 2023-05-17T15:29:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.515+0000 7fae2d4b2700 1 -- start start 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2d4b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae280aa070 0x7fae28153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2d4b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae280c1180 0x7fae280c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2d4b2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2d4b2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae280c4d00 con 0x7fae281544f0 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2d4b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae281591e0 con 0x7fae280aa070 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2d4b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae28159d60 con 0x7fae280c1180 2023-05-17T15:29:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47264/0 (socket says 172.21.15.27:47264) 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 -- 172.21.15.27:0/2968338149 learned_addr learned my addr 172.21.15.27:0/2968338149 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae277fe700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae280c1180 0x7fae280c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae27fff700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae280aa070 0x7fae28153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 -- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae280c1180 msgr2=0x7fae280c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae280c1180 0x7fae280c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 -- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae280aa070 msgr2=0x7fae28153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae280aa070 0x7fae28153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.516+0000 7fae2ccb1700 1 -- 172.21.15.27:0/2968338149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100092a0 con 0x7fae281544f0 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.517+0000 7fae2ccb1700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280c4810 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7fae2000c7e0 tx=0x7fae20007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.517+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20005d30 con 0x7fae281544f0 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.517+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20005e90 con 0x7fae281544f0 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.517+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae280a9b90 con 0x7fae281544f0 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.517+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20007320 con 0x7fae281544f0 2023-05-17T15:29:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.517+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae28159710 con 0x7fae281544f0 2023-05-17T15:29:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.518+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae28159ed0 con 0x7fae281544f0 2023-05-17T15:29:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.518+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fae20010030 con 0x7fae281544f0 2023-05-17T15:29:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.518+0000 7fae1ffff700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 0x7fae080612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.519+0000 7fae27fff700 1 -- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 msgr2=0x7fae080612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.519+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fae20079b90 con 0x7fae281544f0 2023-05-17T15:29:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.519+0000 7fae27fff700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 0x7fae080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:42.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.523+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae2004af30 con 0x7fae281544f0 2023-05-17T15:29:42.723 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.720+0000 7fae27fff700 1 -- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 msgr2=0x7fae080612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:42.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.720+0000 7fae27fff700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 0x7fae080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:42.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.740+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae2806bdf0 con 0x7fae281544f0 2023-05-17T15:29:42.744 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.741+0000 7fae1ffff700 1 -- 172.21.15.27:0/2968338149 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4490 (secure 0 0 0) 0x7fae2004e550 con 0x7fae281544f0 2023-05-17T15:29:42.745 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:42.745 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:29:19.585435+0000","modified":"2023-05-17T15:29:22.589859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8988":{"gid":8988,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3491718569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3491718569},{"type":"v1","addr":"172.21.15.27:6835","nonce":3491718569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-17T15:29:42.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 msgr2=0x7fae080612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:42.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 0x7fae080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:42.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 msgr2=0x7fae280c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.747 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280c4810 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7fae2000c7e0 tx=0x7fae20007f90).stop 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 shutdown_connections 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fae0805ede0 0x7fae080612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae281544f0 0x7fae280c4810 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae280aa070 0x7fae28153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 --2- 172.21.15.27:0/2968338149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae280c1180 0x7fae280c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 >> 172.21.15.27:0/2968338149 conn(0x7fae2805dd50 msgr2=0x7fae28157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:42.748 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 shutdown_connections 2023-05-17T15:29:42.749 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.743+0000 7fae2d4b2700 1 -- 172.21.15.27:0/2968338149 wait complete. 2023-05-17T15:29:42.749 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 74 2023-05-17T15:29:42.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:29:42.854 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:42.851+0000 7f0727748680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:29:42.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.877+0000 7f0e97146700 1 Processor -- start 2023-05-17T15:29:42.881 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.877+0000 7f0e97146700 1 -- start start 2023-05-17T15:29:42.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e97146700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e90153cf0 0x7f0e90063d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e97146700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900bd6a0 con 0x7f0e901540d0 2023-05-17T15:29:42.882 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e97146700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900c31b0 con 0x7f0e9005e460 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e97146700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900c3490 con 0x7f0e90153cf0 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e8ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0e901540d0 0x7f0e9005dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46832/0 (socket says 172.21.15.27:46832) 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e8ffff700 1 -- 172.21.15.27:0/3251252600 learned_addr learned my addr 172.21.15.27:0/3251252600 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e94ee2700 1 --2- 172.21.15.27:0/3251252600 >> v2:172.21.15.40:3300/0 conn(0x7f0e90153cf0 0x7f0e90063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e8f7fe700 1 -- 172.21.15.27:0/3251252600 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246490274 0 0) 0x7f0e900bd6a0 con 0x7f0e901540d0 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e8f7fe700 1 -- 172.21.15.27:0/3251252600 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e800033f0 con 0x7f0e901540d0 2023-05-17T15:29:42.883 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e94ee2700 1 -- 172.21.15.27:0/3251252600 >> v1:172.21.15.40:6789/0 conn(0x7f0e9005e460 legacy=0x7f0e900c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.878+0000 7f0e8f7fe700 1 -- 172.21.15.27:0/3251252600 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412377584 0 0) 0x7f0e900c31b0 con 0x7f0e9005e460 2023-05-17T15:29:42.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e94ee2700 1 -- 172.21.15.27:0/3251252600 >> v1:172.21.15.27:6789/0 conn(0x7f0e901540d0 legacy=0x7f0e9005dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.884 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e94ee2700 1 -- 172.21.15.27:0/3251252600 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e900c3770 con 0x7f0e90153cf0 2023-05-17T15:29:42.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e94ee2700 1 --2- 172.21.15.27:0/3251252600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e90153cf0 0x7f0e90063d20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f0e84009760 tx=0x7f0e84009060).ready entity=mon.1 client_cookie=8d787478886db0fd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:42.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e8f7fe700 1 -- 172.21.15.27:0/3251252600 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400f510 con 0x7f0e90153cf0 2023-05-17T15:29:42.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e8f7fe700 1 -- 172.21.15.27:0/3251252600 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400f670 con 0x7f0e90153cf0 2023-05-17T15:29:42.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e8f7fe700 1 -- 172.21.15.27:0/3251252600 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400f9f0 con 0x7f0e90153cf0 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e97146700 1 -- 172.21.15.27:0/3251252600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e90153cf0 msgr2=0x7f0e90063d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e97146700 1 --2- 172.21.15.27:0/3251252600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e90153cf0 0x7f0e90063d20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f0e84009760 tx=0x7f0e84009060).stop 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e97146700 1 -- 172.21.15.27:0/3251252600 shutdown_connections 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e97146700 1 --2- 172.21.15.27:0/3251252600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e90153cf0 0x7f0e90063d20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.879+0000 7f0e97146700 1 -- 172.21.15.27:0/3251252600 >> 172.21.15.27:0/3251252600 conn(0x7f0e900c7920 msgr2=0x7f0e900c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.880+0000 7f0e97146700 1 -- 172.21.15.27:0/3251252600 shutdown_connections 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.880+0000 7f0e97146700 1 -- 172.21.15.27:0/3251252600 wait complete. 2023-05-17T15:29:42.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.881+0000 7f0e97146700 1 Processor -- start 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.881+0000 7f0e97146700 1 -- start start 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.881+0000 7f0e97146700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 0x7f0e900a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.881+0000 7f0e97146700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e90153cf0 0x7f0e901463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e97146700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e901540d0 0x7f0e900c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e97146700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900a3950 con 0x7f0e9005e460 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e97146700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900a3c30 con 0x7f0e901540d0 2023-05-17T15:29:42.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e97146700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900a3f10 con 0x7f0e90153cf0 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 0x7f0e900a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 0x7f0e900a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47274/0 (socket says 172.21.15.27:47274) 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 -- 172.21.15.27:0/629589853 learned_addr learned my addr 172.21.15.27:0/629589853 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e956e3700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e901540d0 0x7f0e900c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e8ffff700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e90153cf0 0x7f0e901463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 -- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e90153cf0 msgr2=0x7f0e901463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e90153cf0 0x7f0e901463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 -- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e901540d0 msgr2=0x7f0e900c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e901540d0 0x7f0e900c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 -- 172.21.15.27:0/629589853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e840092a0 con 0x7f0e9005e460 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e94ee2700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 0x7f0e900a4710 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f0e84009e00 tx=0x7f0e84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400f7e0 con 0x7f0e9005e460 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400f940 con 0x7f0e9005e460 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900a41f0 con 0x7f0e9005e460 2023-05-17T15:29:42.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8401b660 con 0x7f0e9005e460 2023-05-17T15:29:42.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.882+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e900c0ba0 con 0x7f0e9005e460 2023-05-17T15:29:42.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.883+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e900a3a90 con 0x7f0e9005e460 2023-05-17T15:29:42.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.884+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f0e8402c070 con 0x7f0e9005e460 2023-05-17T15:29:42.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.884+0000 7f0e8cff9700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 0x7f0e740612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:42.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.884+0000 7f0e8ffff700 1 -- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 msgr2=0x7f0e740612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:42.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.884+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f0e8407b820 con 0x7f0e9005e460 2023-05-17T15:29:42.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.884+0000 7f0e8ffff700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 0x7f0e740612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:42.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:42.888+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e900a3a90 con 0x7f0e9005e460 2023-05-17T15:29:42.925 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:42.921+0000 7f0727748680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:29:42.932 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:42.929+0000 7fe9618e2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T15:29:43.003 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:42.999+0000 7f0727748680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:29:43.004 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.001+0000 7fe9618e2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T15:29:43.083 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.080+0000 7fe9618e2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T15:29:43.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.085+0000 7f0e8ffff700 1 -- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 msgr2=0x7f0e740612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:43.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.085+0000 7f0e8ffff700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 0x7f0e740612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:43.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.106+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e9006bdf0 con 0x7f0e9005e460 2023-05-17T15:29:43.111 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.107+0000 7f0e8cff9700 1 -- 172.21.15.27:0/629589853 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f0e8404cb30 con 0x7f0e9005e460 2023-05-17T15:29:43.111 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:43.111 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":74,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T15:29:19.585435+0000","modified":"2023-05-17T15:29:22.589859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8988":{"gid":8988,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3491718569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3491718569},{"type":"v1","addr":"172.21.15.27:6835","nonce":3491718569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-17T15:29:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 msgr2=0x7f0e740612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 0x7f0e740612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 msgr2=0x7f0e900a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 0x7f0e900a4710 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f0e84009e00 tx=0x7f0e84017000).stop 2023-05-17T15:29:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 shutdown_connections 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f0e7405ede0 0x7f0e740612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e901540d0 0x7f0e900c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e9005e460 0x7f0e900a4710 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 --2- 172.21.15.27:0/629589853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e90153cf0 0x7f0e901463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 >> 172.21.15.27:0/629589853 conn(0x7f0e900c7920 msgr2=0x7f0e90152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 shutdown_connections 2023-05-17T15:29:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.109+0000 7f0e97146700 1 -- 172.21.15.27:0/629589853 wait complete. 2023-05-17T15:29:43.115 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 74 2023-05-17T15:29:43.125 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:43.155 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:43.151+0000 7f0727748680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:29:43.228 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:43.224+0000 7f0727748680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:29:43.243 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.240+0000 7fe9618e2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T15:29:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.240+0000 7f4092854700 1 Processor -- start 2023-05-17T15:29:43.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.240+0000 7f4092854700 1 -- start start 2023-05-17T15:29:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f4092854700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f408c0c5f30 0x7f408c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f4092854700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f4092854700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0bfcd0 con 0x7f408c158880 2023-05-17T15:29:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f4092854700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0c0290 con 0x7f408c0c5f30 2023-05-17T15:29:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f4092854700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0aa1a0 con 0x7f408c1543e0 2023-05-17T15:29:43.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f408b7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f408c158880 0x7f408c153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46846/0 (socket says 172.21.15.27:46846) 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f408b7fe700 1 -- 172.21.15.27:0/1123576246 learned_addr learned my addr 172.21.15.27:0/1123576246 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f4090df1700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.241+0000 7f408bfff700 1 --2- 172.21.15.27:0/1123576246 >> v2:172.21.15.40:3300/0 conn(0x7f408c0c5f30 0x7f408c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408affd700 1 -- 172.21.15.27:0/1123576246 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155195596 0 0) 0x7f408c0bfcd0 con 0x7f408c158880 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408affd700 1 -- 172.21.15.27:0/1123576246 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40740033f0 con 0x7f408c158880 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408bfff700 1 -- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 msgr2=0x7f408c0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408bfff700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408bfff700 1 -- 172.21.15.27:0/1123576246 >> v1:172.21.15.27:6789/0 conn(0x7f408c158880 legacy=0x7f408c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408bfff700 1 -- 172.21.15.27:0/1123576246 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0aa480 con 0x7f408c0c5f30 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f4090df1700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408bfff700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c0c6310 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f4080009760 tx=0x7f4080009060).ready entity=mon.1 client_cookie=ee1729572cdd3e81 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408affd700 1 -- 172.21.15.27:0/1123576246 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000d4a0 con 0x7f408c0c5f30 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408affd700 1 -- 172.21.15.27:0/1123576246 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000d600 con 0x7f408c0c5f30 2023-05-17T15:29:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.242+0000 7f408affd700 1 -- 172.21.15.27:0/1123576246 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000d980 con 0x7f408c0c5f30 2023-05-17T15:29:43.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 -- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 msgr2=0x7f408c0c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c0c6310 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f4080009760 tx=0x7f4080009060).stop 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 -- 172.21.15.27:0/1123576246 shutdown_connections 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 --2- 172.21.15.27:0/1123576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c0c6310 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 -- 172.21.15.27:0/1123576246 >> 172.21.15.27:0/1123576246 conn(0x7f408c069e70 msgr2=0x7f408c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 -- 172.21.15.27:0/1123576246 shutdown_connections 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.243+0000 7f4092854700 1 -- 172.21.15.27:0/1123576246 wait complete. 2023-05-17T15:29:43.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.244+0000 7f4092854700 1 Processor -- start 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.244+0000 7f4092854700 1 -- start start 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4092854700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c165270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4092854700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4092854700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 0x7f408c0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4092854700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c4360 con 0x7f408c158880 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4092854700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1686b0 con 0x7f408c0c5f30 2023-05-17T15:29:43.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4092854700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c40e0 con 0x7f408c1543e0 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 0x7f408c0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 0x7f408c0ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47294/0 (socket says 172.21.15.27:47294) 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 -- 172.21.15.27:0/124247764 learned_addr learned my addr 172.21.15.27:0/124247764 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f408bfff700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c165270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f408b7fe700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 -- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 msgr2=0x7f408c0c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 -- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 msgr2=0x7f408c165270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c165270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 -- 172.21.15.27:0/124247764 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084009a20 con 0x7f408c158880 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f408bfff700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c165270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4090df1700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 0x7f408c0ac7a0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f408400c0f0 tx=0x7f408400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.245+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400cc30 con 0x7f408c158880 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.246+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400f040 con 0x7f408c158880 2023-05-17T15:29:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.246+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800092a0 con 0x7f408c158880 2023-05-17T15:29:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.246+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084013400 con 0x7f408c158880 2023-05-17T15:29:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.246+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c167d80 con 0x7f408c158880 2023-05-17T15:29:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.246+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c168860 con 0x7f408c158880 2023-05-17T15:29:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.247+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f40840137f0 con 0x7f408c158880 2023-05-17T15:29:43.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.247+0000 7f4073fff700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f407805ede0 0x7f40780612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.247+0000 7f408bfff700 1 -- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f407805ede0 msgr2=0x7f40780612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:43.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.248+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f408407a840 con 0x7f408c158880 2023-05-17T15:29:43.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.248+0000 7f408bfff700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f407805ede0 0x7f40780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:43.256 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.252+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f408c168860 con 0x7f408c158880 2023-05-17T15:29:43.320 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.316+0000 7fe9618e2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T15:29:43.349 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:43.345+0000 7f0727748680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:29:43.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.428+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f408c168860 con 0x7f408c158880 2023-05-17T15:29:43.432 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.429+0000 7f4073fff700 1 -- 172.21.15.27:0/124247764 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+17392 (secure 0 0 0) 0x7f408c168860 con 0x7f408c158880 2023-05-17T15:29:43.433 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:43.433 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":178,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:36.343528+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-17T15:29:18.145777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-17T15:29:18.560834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2744476591":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6837/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6836/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:0/2976443407":"2023-05-18T15:29:36.343483+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f407805ede0 msgr2=0x7f40780612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f407805ede0 0x7f40780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 msgr2=0x7f408c0ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 0x7f408c0ac7a0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f408400c0f0 tx=0x7f408400b040).stop 2023-05-17T15:29:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 shutdown_connections 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f407805ede0 0x7f40780612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f408c158880 0x7f408c0ac7a0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f408c0c5f30 0x7f408c165270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 --2- 172.21.15.27:0/124247764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f408c1543e0 0x7f408c0c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 >> 172.21.15.27:0/124247764 conn(0x7f408c069e70 msgr2=0x7f408c0c1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 shutdown_connections 2023-05-17T15:29:43.436 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.431+0000 7f4092854700 1 -- 172.21.15.27:0/124247764 wait complete. 2023-05-17T15:29:43.442 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.438+0000 7fe9618e2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T15:29:43.447 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T15:29:43.461 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:43.458+0000 7f0727748680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:43.559 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.555+0000 7fe9618e2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T15:29:43.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.562+0000 7fc155d39700 1 Processor -- start 2023-05-17T15:29:43.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.562+0000 7fc155d39700 1 -- start start 2023-05-17T15:29:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc155d39700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc150153dc0 0x7fc1500626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc155d39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1501541a0 0x7fc150066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc155d39700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500bc050 con 0x7fc1500bcd80 2023-05-17T15:29:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc155d39700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1500695d0 con 0x7fc150153dc0 2023-05-17T15:29:43.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc155d39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500673c0 con 0x7fc1501541a0 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc14f7fe700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc150153dc0 0x7fc1500626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc14ffff700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc1500bcd80 0x7fc1500c3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46864/0 (socket says 172.21.15.27:46864) 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc14ffff700 1 -- 172.21.15.27:0/3110013650 learned_addr learned my addr 172.21.15.27:0/3110013650 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.563+0000 7fc14effd700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1501541a0 0x7fc150066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14f7fe700 1 -- 172.21.15.27:0/3110013650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1501541a0 msgr2=0x7fc150066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14f7fe700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1501541a0 0x7fc150066ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14f7fe700 1 -- 172.21.15.27:0/3110013650 >> v1:172.21.15.27:6789/0 conn(0x7fc1500bcd80 legacy=0x7fc1500c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14f7fe700 1 -- 172.21.15.27:0/3110013650 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150067610 con 0x7fc150153dc0 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14e7fc700 1 -- 172.21.15.27:0/3110013650 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661339859 0 0) 0x7fc1500bc050 con 0x7fc1500bcd80 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14effd700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1501541a0 0x7fc150066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14f7fe700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500626c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7fc140009e60 tx=0x7fc140009780).ready entity=mon.0 client_cookie=3222b73ec1ceebf0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14e7fc700 1 -- 172.21.15.27:0/3110013650 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000e070 con 0x7fc150153dc0 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14e7fc700 1 -- 172.21.15.27:0/3110013650 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14000bc30 con 0x7fc150153dc0 2023-05-17T15:29:43.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc14e7fc700 1 -- 172.21.15.27:0/3110013650 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140012410 con 0x7fc150153dc0 2023-05-17T15:29:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 -- 172.21.15.27:0/3110013650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 msgr2=0x7fc1500626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500626c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7fc140009e60 tx=0x7fc140009780).stop 2023-05-17T15:29:43.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 -- 172.21.15.27:0/3110013650 shutdown_connections 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500626c0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 --2- 172.21.15.27:0/3110013650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1501541a0 0x7fc150066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 -- 172.21.15.27:0/3110013650 >> 172.21.15.27:0/3110013650 conn(0x7fc150063dd0 msgr2=0x7fc150067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.564+0000 7fc155d39700 1 -- 172.21.15.27:0/3110013650 shutdown_connections 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.565+0000 7fc155d39700 1 -- 172.21.15.27:0/3110013650 wait complete. 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.566+0000 7fc155d39700 1 Processor -- start 2023-05-17T15:29:43.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.566+0000 7fc155d39700 1 -- start start 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.566+0000 7fc155d39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1500bcd80 0x7fc1500acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.566+0000 7fc155d39700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.566+0000 7fc155d39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1501541a0 0x7fc1500aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.566+0000 7fc155d39700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500a7180 con 0x7fc150153dc0 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc155d39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500a7460 con 0x7fc1501541a0 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc155d39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500a7740 con 0x7fc1500bcd80 2023-05-17T15:29:43.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500a8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47306/0 (socket says 172.21.15.27:47306) 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 -- 172.21.15.27:0/1562386170 learned_addr learned my addr 172.21.15.27:0/1562386170 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14f7fe700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1500bcd80 0x7fc1500acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14ffff700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1501541a0 0x7fc1500aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1500bcd80 msgr2=0x7fc1500acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1500bcd80 0x7fc1500acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1501541a0 msgr2=0x7fc1500aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1501541a0 0x7fc1500aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 -- 172.21.15.27:0/1562386170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009a20 con 0x7fc150153dc0 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc14effd700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500a8220 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fc14800d860 tx=0x7fc148008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800f520 con 0x7fc150153dc0 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14800f680 con 0x7fc150153dc0 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1500a7a20 con 0x7fc150153dc0 2023-05-17T15:29:43.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800fa00 con 0x7fc150153dc0 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.567+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1500ac080 con 0x7fc150153dc0 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.568+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1500a7ec0 con 0x7fc150153dc0 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.569+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fc14801a030 con 0x7fc150153dc0 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.569+0000 7fc1377fe700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 0x7fc13c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.569+0000 7fc14f7fe700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 msgr2=0x7fc13c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.569+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fc1480798d0 con 0x7fc150153dc0 2023-05-17T15:29:43.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.569+0000 7fc14f7fe700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 0x7fc13c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.573+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc14804ac10 con 0x7fc150153dc0 2023-05-17T15:29:43.761 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:43.757+0000 7f0727748680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:29:43.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.770+0000 7fc14f7fe700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 msgr2=0x7fc13c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:43.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.770+0000 7fc14f7fe700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 0x7fc13c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:43.799 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:43.795+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1500bc2a0 con 0x7fc150153dc0 2023-05-17T15:29:43.836 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-05-17T15:29:43.832+0000 7f0727748680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:29:43.867 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.863+0000 7fe9618e2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T15:29:43.942 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:43.938+0000 7fe9618e2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T15:29:43.963 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.963 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.964 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.964 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.964 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-05-17T15:29:43.964 INFO:tasks.ceph.mds.a.smithi027.stderr:2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:29:43.966 INFO:tasks.ceph.mds.a.smithi027.stderr: -2546> 2023-05-17T15:29:20.928+0000 7f99a38ca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T15:29:43.970 INFO:tasks.ceph.mds.a.smithi027.stderr: -7> 2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.970 INFO:tasks.ceph.mds.a.smithi027.stderr: -6> 2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.970 INFO:tasks.ceph.mds.a.smithi027.stderr: -5> 2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.970 INFO:tasks.ceph.mds.a.smithi027.stderr: -4> 2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-17T15:29:43.970 INFO:tasks.ceph.mds.a.smithi027.stderr: -3> 2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-05-17T15:29:43.970 INFO:tasks.ceph.mds.a.smithi027.stderr: -1> 2023-05-17T15:29:43.959+0000 7f99a00c3700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-17T15:29:43.988 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2023-05-17T15:29:44.174 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.171+0000 7fc14f7fe700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 msgr2=0x7fc13c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:44.175 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.171+0000 7fc14f7fe700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 0x7fc13c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-17T15:29:44.434 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-05-17T15:29:44.430+0000 7f45ceb01700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T15:29:44.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.440+0000 7fc1377fe700 1 -- 172.21.15.27:0/1562386170 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc14804e230 con 0x7fc150153dc0 2023-05-17T15:29:44.445 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 msgr2=0x7fc13c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:44.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 0x7fc13c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:44.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 msgr2=0x7fc1500a8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:44.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500a8220 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fc14800d860 tx=0x7fc148008040).stop 2023-05-17T15:29:44.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 shutdown_connections 2023-05-17T15:29:44.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc13c05ede0 0x7fc13c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:44.446 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1501541a0 0x7fc1500aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1500bcd80 0x7fc1500acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 --2- 172.21.15.27:0/1562386170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc150153dc0 0x7fc1500a8220 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 >> 172.21.15.27:0/1562386170 conn(0x7fc150063dd0 msgr2=0x7fc150150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 shutdown_connections 2023-05-17T15:29:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.442+0000 7fc155d39700 1 -- 172.21.15.27:0/1562386170 wait complete. 2023-05-17T15:29:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T15:29:44.458 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T15:29:44.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.574+0000 7f085f54a700 1 Processor -- start 2023-05-17T15:29:44.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.574+0000 7f085f54a700 1 -- start start 2023-05-17T15:29:44.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085f54a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08581543d0 0x7f08580c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085f54a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f08580c60f0 0x7f0858068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085f54a700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08580691f0 0x7f08581547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085f54a700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580c1c50 con 0x7f08580691f0 2023-05-17T15:29:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085f54a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858158790 con 0x7f08580c60f0 2023-05-17T15:29:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085f54a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c6570 con 0x7f08581543d0 2023-05-17T15:29:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08580691f0 0x7f08581547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08580691f0 0x7f08581547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47340/0 (socket says 172.21.15.27:47340) 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 -- 172.21.15.27:0/228090630 learned_addr learned my addr 172.21.15.27:0/228090630 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085d2e6700 1 --2- 172.21.15.27:0/228090630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08581543d0 0x7f08580c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085cae5700 1 --2- 172.21.15.27:0/228090630 >> v2:172.21.15.40:3300/0 conn(0x7f08580c60f0 0x7f0858068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 -- 172.21.15.27:0/228090630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08581543d0 msgr2=0x7f08580c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 --2- 172.21.15.27:0/228090630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08581543d0 0x7f08580c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 -- 172.21.15.27:0/228090630 >> v2:172.21.15.40:3300/0 conn(0x7f08580c60f0 msgr2=0x7f0858068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 --2- 172.21.15.27:0/228090630 >> v2:172.21.15.40:3300/0 conn(0x7f08580c60f0 0x7f0858068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085dae7700 1 -- 172.21.15.27:0/228090630 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858157e60 con 0x7f08580691f0 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.575+0000 7f085cae5700 1 --2- 172.21.15.27:0/228090630 >> v2:172.21.15.40:3300/0 conn(0x7f08580c60f0 0x7f0858068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085dae7700 1 --2- 172.21.15.27:0/228090630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08581547b0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f0858062c40 tx=0x7f0848009840).ready entity=mon.0 client_cookie=ccc6c36e67796bfb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f0857fff700 1 -- 172.21.15.27:0/228090630 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800e070 con 0x7f08580691f0 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f0857fff700 1 -- 172.21.15.27:0/228090630 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800ba20 con 0x7f08580691f0 2023-05-17T15:29:44.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f0857fff700 1 -- 172.21.15.27:0/228090630 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800bda0 con 0x7f08580691f0 2023-05-17T15:29:44.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 -- 172.21.15.27:0/228090630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 msgr2=0x7f08581547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:44.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 --2- 172.21.15.27:0/228090630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08581547b0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f0858062c40 tx=0x7f0848009840).stop 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 -- 172.21.15.27:0/228090630 shutdown_connections 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 --2- 172.21.15.27:0/228090630 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08581547b0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 --2- 172.21.15.27:0/228090630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08581543d0 0x7f08580c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 --2- 172.21.15.27:0/228090630 >> v2:172.21.15.40:3300/0 conn(0x7f08580c60f0 0x7f0858068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 -- 172.21.15.27:0/228090630 >> 172.21.15.27:0/228090630 conn(0x7f08580cb7f0 msgr2=0x7f08580c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 -- 172.21.15.27:0/228090630 shutdown_connections 2023-05-17T15:29:44.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.576+0000 7f085f54a700 1 -- 172.21.15.27:0/228090630 wait complete. 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.577+0000 7f085f54a700 1 Processor -- start 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 -- start start 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08580aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08580c60f0 0x7f08580b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08581543d0 0x7f0858147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c1dc0 con 0x7f08580691f0 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580b0e30 con 0x7f08581543d0 2023-05-17T15:29:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.578+0000 7f085f54a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580af2f0 con 0x7f08580c60f0 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08580aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08580aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47342/0 (socket says 172.21.15.27:47342) 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 -- 172.21.15.27:0/3134483178 learned_addr learned my addr 172.21.15.27:0/3134483178 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085cae5700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08580c60f0 0x7f08580b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085dae7700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08581543d0 0x7f0858147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 -- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08580c60f0 msgr2=0x7f08580b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08580c60f0 0x7f08580b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 -- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08581543d0 msgr2=0x7f0858147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08581543d0 0x7f0858147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 -- 172.21.15.27:0/3134483178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009ae0 con 0x7f08580691f0 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085d2e6700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08580aeca0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f085000e930 tx=0x7f0850009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850012600 con 0x7f08580691f0 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850012760 con 0x7f08580691f0 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580af5d0 con 0x7f08580691f0 2023-05-17T15:29:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850012ae0 con 0x7f08580691f0 2023-05-17T15:29:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.579+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08580afb90 con 0x7f08580691f0 2023-05-17T15:29:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.580+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085806bdf0 con 0x7f08580691f0 2023-05-17T15:29:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.581+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 83) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f0850022070 con 0x7f08580691f0 2023-05-17T15:29:44.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.581+0000 7f08557fa700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 0x7f08440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:44.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.581+0000 7f085cae5700 1 -- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 msgr2=0x7f08440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:44.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.581+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f085007a120 con 0x7f08580691f0 2023-05-17T15:29:44.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.581+0000 7f085cae5700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 0x7f08440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-17T15:29:44.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.585+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f085004b390 con 0x7f08580691f0 2023-05-17T15:29:44.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.782+0000 7f085cae5700 1 -- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 msgr2=0x7f08440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6836/122387 2023-05-17T15:29:44.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.782+0000 7f085cae5700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 0x7f08440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-17T15:29:44.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.800+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0858069d00 con 0x7f08580691f0 2023-05-17T15:29:44.808 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.805+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 84) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f0850077cf0 con 0x7f08580691f0 2023-05-17T15:29:44.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.805+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 msgr2=0x7f08440612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T15:29:44.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:44.805+0000 7f08557fa700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 0x7f08440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:44.857 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e48cd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.857 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e48cd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.857 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e48cd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.857 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e48cd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e48cd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e10c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e10c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e10c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e10c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:44.858 INFO:tasks.ceph.mgr.y.smithi027.stderr:2023-05-17T15:29:44.853+0000 7fe8e10c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-17T15:29:45.447 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.443+0000 7f08557fa700 1 -- 172.21.15.27:0/3134483178 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f085006ca50 con 0x7f08580691f0 2023-05-17T15:29:45.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 msgr2=0x7f08580aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:45.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08580aeca0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f085000e930 tx=0x7f0850009060).stop 2023-05-17T15:29:45.449 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 shutdown_connections 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f084405ede0 0x7f08440612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08581543d0 0x7f0858147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08580691f0 0x7f08580aeca0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 --2- 172.21.15.27:0/3134483178 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f08580c60f0 0x7f08580b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 >> 172.21.15.27:0/3134483178 conn(0x7f08580cb7f0 msgr2=0x7f0858156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 shutdown_connections 2023-05-17T15:29:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.445+0000 7f085f54a700 1 -- 172.21.15.27:0/3134483178 wait complete. 2023-05-17T15:29:45.462 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T15:29:45.584 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 Processor -- start 2023-05-17T15:29:45.585 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 -- start start 2023-05-17T15:29:45.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68063f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:45.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbf68154480 0x7fbf680643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:45.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680be830 con 0x7fbf681540a0 2023-05-17T15:29:45.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680648e0 con 0x7fbf68154480 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.581+0000 7fbf6e0d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680beae0 con 0x7fbf68067db0 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf677fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbf681540a0 0x7fbf680be120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:46976/0 (socket says 172.21.15.27:46976) 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf677fe700 1 -- 172.21.15.27:0/2762900740 learned_addr learned my addr 172.21.15.27:0/2762900740 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf67fff700 1 --2- 172.21.15.27:0/2762900740 >> v2:172.21.15.27:3300/0 conn(0x7fbf68154480 0x7fbf680643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf66ffd700 1 --2- 172.21.15.27:0/2762900740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf667fc700 1 -- 172.21.15.27:0/2762900740 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751056220 0 0) 0x7fbf680be830 con 0x7fbf681540a0 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf667fc700 1 -- 172.21.15.27:0/2762900740 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf500033f0 con 0x7fbf681540a0 2023-05-17T15:29:45.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf67fff700 1 -- 172.21.15.27:0/2762900740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 msgr2=0x7fbf68063f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf67fff700 1 --2- 172.21.15.27:0/2762900740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68063f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf67fff700 1 -- 172.21.15.27:0/2762900740 >> v1:172.21.15.27:6789/0 conn(0x7fbf681540a0 legacy=0x7fbf680be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf67fff700 1 -- 172.21.15.27:0/2762900740 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680bedc0 con 0x7fbf68154480 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf67fff700 1 --2- 172.21.15.27:0/2762900740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf68154480 0x7fbf680643f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fbf60009e60 tx=0x7fbf60009780).ready entity=mon.0 client_cookie=bb0fd603ad1ab63a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf667fc700 1 -- 172.21.15.27:0/2762900740 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6000e070 con 0x7fbf68154480 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf667fc700 1 -- 172.21.15.27:0/2762900740 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6000bab0 con 0x7fbf68154480 2023-05-17T15:29:45.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.582+0000 7fbf667fc700 1 -- 172.21.15.27:0/2762900740 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6000be30 con 0x7fbf68154480 2023-05-17T15:29:45.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/2762900740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf68154480 msgr2=0x7fbf680643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/2762900740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf68154480 0x7fbf680643f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fbf60009e60 tx=0x7fbf60009780).stop 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/2762900740 shutdown_connections 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/2762900740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf68154480 0x7fbf680643f0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/2762900740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68063f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/2762900740 >> 172.21.15.27:0/2762900740 conn(0x7fbf680c8ad0 msgr2=0x7fbf680c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/2762900740 shutdown_connections 2023-05-17T15:29:45.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.583+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/2762900740 wait complete. 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.584+0000 7fbf6e0d2700 1 Processor -- start 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.584+0000 7fbf6e0d2700 1 -- start start 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf6e0d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf6e0d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf681540a0 0x7fbf680ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf6e0d2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 0x7fbf680aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf6e0d2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680ae930 con 0x7fbf6813dc50 2023-05-17T15:29:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf6e0d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68155ba0 con 0x7fbf681540a0 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf6e0d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68154f90 con 0x7fbf68067db0 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 0x7fbf680aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 0x7fbf680aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47424/0 (socket says 172.21.15.27:47424) 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 -- 172.21.15.27:0/3379666305 learned_addr learned my addr 172.21.15.27:0/3379666305 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 -- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 msgr2=0x7fbf68154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 -- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf681540a0 msgr2=0x7fbf680ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:45.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf66ffd700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf681540a0 0x7fbf680ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf681540a0 0x7fbf680ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 -- 172.21.15.27:0/3379666305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60009a20 con 0x7fbf6813dc50 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf67fff700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 0x7fbf680aa5c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fbf680676f0 tx=0x7fbf68069ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.585+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6001d630 con 0x7fbf6813dc50 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.586+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6001d790 con 0x7fbf6813dc50 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.586+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf68155270 con 0x7fbf6813dc50 2023-05-17T15:29:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.586+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6001db50 con 0x7fbf6813dc50 2023-05-17T15:29:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.586+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf68155830 con 0x7fbf6813dc50 2023-05-17T15:29:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.587+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6806bdf0 con 0x7fbf6813dc50 2023-05-17T15:29:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.587+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 84) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fbf60027460 con 0x7fbf6813dc50 2023-05-17T15:29:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.587+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6722+0+0 (secure 0 0 0) 0x7fbf6007bea0 con 0x7fbf6813dc50 2023-05-17T15:29:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.592+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf6004d220 con 0x7fbf6813dc50 2023-05-17T15:29:45.765 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.761+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf6805e430 con 0x7fbf6813dc50 2023-05-17T15:29:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.809+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 85) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fbf60079be0 con 0x7fbf6813dc50 2023-05-17T15:29:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.809+0000 7fbf4f7fe700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbf540301b0 0x7fbf54067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.810+0000 7fbf677fe700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbf540301b0 0x7fbf54067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:45.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:45.811+0000 7fbf677fe700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbf540301b0 0x7fbf54067970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbf58005750 tx=0x7fbf58007850).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:46.448 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.444+0000 7fbf4f7fe700 1 -- 172.21.15.27:0/3379666305 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v181) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbf60054cf0 con 0x7fbf6813dc50 2023-05-17T15:29:46.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbf540301b0 msgr2=0x7fbf54067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:46.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbf540301b0 0x7fbf54067970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbf58005750 tx=0x7fbf58007850).stop 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 msgr2=0x7fbf680aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 0x7fbf680aa5c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fbf680676f0 tx=0x7fbf68069ae0).stop 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 shutdown_connections 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fbf540301b0 0x7fbf54067970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf6813dc50 0x7fbf680aa5c0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf68067db0 0x7fbf68154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:46.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 --2- 172.21.15.27:0/3379666305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf681540a0 0x7fbf680ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.448+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 >> 172.21.15.27:0/3379666305 conn(0x7fbf680c8ad0 msgr2=0x7fbf680c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.449+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 shutdown_connections 2023-05-17T15:29:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.449+0000 7fbf6e0d2700 1 -- 172.21.15.27:0/3379666305 wait complete. 2023-05-17T15:29:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2023-05-17T15:29:46.466 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T15:29:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.584+0000 7f465239e700 1 Processor -- start 2023-05-17T15:29:46.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.584+0000 7f465239e700 1 -- start start 2023-05-17T15:29:46.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465239e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f464c0c1080 0x7f464c0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465239e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f464c0c5d60 0x7f464c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465239e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c154a50 con 0x7f464c154520 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465239e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c154d30 con 0x7f464c0c1080 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465239e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c155010 con 0x7f464c0c5d60 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f464c0c1080 0x7f464c0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f464c0c1080 0x7f464c0c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47448/0 (socket says 172.21.15.27:47448) 2023-05-17T15:29:46.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 -- 172.21.15.27:0/507693639 learned_addr learned my addr 172.21.15.27:0/507693639 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 -- 172.21.15.27:0/507693639 >> v2:172.21.15.40:3300/0 conn(0x7f464c0c5d60 msgr2=0x7f464c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f4651b9d700 1 --2- 172.21.15.27:0/507693639 >> v2:172.21.15.40:3300/0 conn(0x7f464c0c5d60 0x7f464c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 --2- 172.21.15.27:0/507693639 >> v2:172.21.15.40:3300/0 conn(0x7f464c0c5d60 0x7f464c0c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 -- 172.21.15.27:0/507693639 >> v1:172.21.15.40:6789/0 conn(0x7f464c154520 legacy=0x7f464c0c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.585+0000 7f465139c700 1 -- 172.21.15.27:0/507693639 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c1552f0 con 0x7f464c0c1080 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465139c700 1 --2- 172.21.15.27:0/507693639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0c1460 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f464c0c09f0 tx=0x7f4644009840).ready entity=mon.0 client_cookie=60b53a473136d8f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f4643fff700 1 -- 172.21.15.27:0/507693639 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400e070 con 0x7f464c0c1080 2023-05-17T15:29:46.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f4643fff700 1 -- 172.21.15.27:0/507693639 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464400ba10 con 0x7f464c0c1080 2023-05-17T15:29:46.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f4643fff700 1 -- 172.21.15.27:0/507693639 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400bd90 con 0x7f464c0c1080 2023-05-17T15:29:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 -- 172.21.15.27:0/507693639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 msgr2=0x7f464c0c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 --2- 172.21.15.27:0/507693639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0c1460 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f464c0c09f0 tx=0x7f4644009840).stop 2023-05-17T15:29:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 -- 172.21.15.27:0/507693639 shutdown_connections 2023-05-17T15:29:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 --2- 172.21.15.27:0/507693639 >> v2:172.21.15.40:3300/0 conn(0x7f464c0c5d60 0x7f464c0c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 --2- 172.21.15.27:0/507693639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0c1460 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 -- 172.21.15.27:0/507693639 >> 172.21.15.27:0/507693639 conn(0x7f464c05dd50 msgr2=0x7f464c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 -- 172.21.15.27:0/507693639 shutdown_connections 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.586+0000 7f465239e700 1 -- 172.21.15.27:0/507693639 wait complete. 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.587+0000 7f465239e700 1 Processor -- start 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.587+0000 7f465239e700 1 -- start start 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465239e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465239e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464c0c5d60 0x7f464c14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:46.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465239e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c154520 0x7f464c0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465239e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0cae00 con 0x7f464c0c1080 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465239e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0ca1f0 con 0x7f464c154520 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465239e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0ca4d0 con 0x7f464c0c5d60 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465139c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465139c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47454/0 (socket says 172.21.15.27:47454) 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.588+0000 7f465139c700 1 -- 172.21.15.27:0/1921863171 learned_addr learned my addr 172.21.15.27:0/1921863171 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:46.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f4651b9d700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c154520 0x7f464c0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465139c700 1 -- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464c0c5d60 msgr2=0x7f464c14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465139c700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464c0c5d60 0x7f464c14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465139c700 1 -- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c154520 msgr2=0x7f464c0ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465139c700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c154520 0x7f464c0ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465139c700 1 -- 172.21.15.27:0/1921863171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009ae0 con 0x7f464c0c1080 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465139c700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0cb290 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f464c05f170 tx=0x7f4644009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:46.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644013d50 con 0x7f464c0c1080 2023-05-17T15:29:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464401d410 con 0x7f464c0c1080 2023-05-17T15:29:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0ca7b0 con 0x7f464c0c1080 2023-05-17T15:29:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464401d7d0 con 0x7f464c0c1080 2023-05-17T15:29:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.589+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c14fd30 con 0x7f464c0c1080 2023-05-17T15:29:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.590+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0cb0e0 con 0x7f464c0c1080 2023-05-17T15:29:46.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.590+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 85) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f464401b040 con 0x7f464c0c1080 2023-05-17T15:29:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.591+0000 7f46417fa700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f463005ecf0 0x7f46300611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.591+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f464407b600 con 0x7f464c0c1080 2023-05-17T15:29:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.591+0000 7f4650b9b700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f463005ecf0 0x7f46300611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.591+0000 7f4650b9b700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f463005ecf0 0x7f46300611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f464c0c4e20 tx=0x7f463c006ae0).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:46.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.595+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f464404cba0 con 0x7f464c0c1080 2023-05-17T15:29:46.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.769+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f464c0cb0e0 con 0x7f464c0c1080 2023-05-17T15:29:46.816 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:46.813+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4644079500 con 0x7f464c0c1080 2023-05-17T15:29:47.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.453+0000 7f46417fa700 1 -- 172.21.15.27:0/1921863171 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v182) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4644043270 con 0x7f464c0c1080 2023-05-17T15:29:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f463005ecf0 msgr2=0x7f46300611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f463005ecf0 0x7f46300611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f464c0c4e20 tx=0x7f463c006ae0).stop 2023-05-17T15:29:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 msgr2=0x7f464c0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0cb290 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f464c05f170 tx=0x7f4644009840).stop 2023-05-17T15:29:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 shutdown_connections 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f463005ecf0 0x7f46300611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c154520 0x7f464c0ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f464c0c1080 0x7f464c0cb290 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 --2- 172.21.15.27:0/1921863171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464c0c5d60 0x7f464c14f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 >> 172.21.15.27:0/1921863171 conn(0x7f464c05dd50 msgr2=0x7f464c155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 shutdown_connections 2023-05-17T15:29:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.456+0000 7f465239e700 1 -- 172.21.15.27:0/1921863171 wait complete. 2023-05-17T15:29:47.462 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2023-05-17T15:29:47.473 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-17T15:29:47.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.588+0000 7fef96cb6700 1 Processor -- start 2023-05-17T15:29:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.588+0000 7fef96cb6700 1 -- start start 2023-05-17T15:29:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef96cb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 0x7fef90157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef96cb6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef90158010 con 0x7fef90153ef0 2023-05-17T15:29:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef96cb6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef901582f0 con 0x7fef900cac00 2023-05-17T15:29:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef96cb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef901588b0 con 0x7fef900cafe0 2023-05-17T15:29:47.595 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef954b3700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fef90153ef0 0x7fef900c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47026/0 (socket says 172.21.15.27:47026) 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef954b3700 1 -- 172.21.15.27:0/2814145968 learned_addr learned my addr 172.21.15.27:0/2814145968 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996989787 0 0) 0x7fef90158010 con 0x7fef90153ef0 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef964b5700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 0x7fef90157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef7c0033f0 con 0x7fef90153ef0 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340975148 0 0) 0x7fef7c0033f0 con 0x7fef90153ef0 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 msgr2=0x7fef90157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:47.596 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 0x7fef90157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 >> v1:172.21.15.40:6789/0 conn(0x7fef900cac00 legacy=0x7fef901537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef901585d0 con 0x7fef90153ef0 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.589+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fef80001470 con 0x7fef90153ef0 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 >> v1:172.21.15.27:6789/0 conn(0x7fef90153ef0 legacy=0x7fef900c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef7c003910 0x7fef7c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c004690 0x7fef7c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 0x7fef7c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef901588b0 con 0x7fef7c003910 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c00b910 con 0x7fef7c004690 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c00bad0 con 0x7fef900cafe0 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef7c003910 0x7fef7c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef954b3700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c004690 0x7fef7c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef964b5700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 0x7fef7c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.598 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 -- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 msgr2=0x7fef7c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef900cafe0 0x7fef7c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 -- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c004690 msgr2=0x7fef7c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c004690 0x7fef7c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 -- 172.21.15.27:0/2814145968 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0033f0 con 0x7fef7c003910 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef954b3700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c004690 0x7fef7c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef95cb4700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef7c003910 0x7fef7c003d30 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fef8c001730 tx=0x7fef8c007bb0).ready entity=mon.0 client_cookie=7159fbddcfe724b0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007020 con 0x7fef7c003910 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c007180 con 0x7fef7c003910 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.590+0000 7fef94cb2700 1 -- 172.21.15.27:0/2814145968 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007500 con 0x7fef7c003910 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef96cb6700 1 -- 172.21.15.27:0/2814145968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef7c003910 msgr2=0x7fef7c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef96cb6700 1 --2- 172.21.15.27:0/2814145968 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef7c003910 0x7fef7c003d30 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fef8c001730 tx=0x7fef8c007bb0).stop 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef964b5700 1 -- 172.21.15.27:0/2814145968 reap_dead start 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef96cb6700 1 -- 172.21.15.27:0/2814145968 shutdown_connections 2023-05-17T15:29:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef96cb6700 1 -- 172.21.15.27:0/2814145968 >> 172.21.15.27:0/2814145968 conn(0x7fef9005dd50 msgr2=0x7fef9005e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:47.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef96cb6700 1 -- 172.21.15.27:0/2814145968 shutdown_connections 2023-05-17T15:29:47.601 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.591+0000 7fef96cb6700 1 -- 172.21.15.27:0/2814145968 wait complete. 2023-05-17T15:29:47.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.592+0000 7fef96cb6700 1 Processor -- start 2023-05-17T15:29:47.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.592+0000 7fef96cb6700 1 -- start start 2023-05-17T15:29:47.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c003910 0x7fef901652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.603 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef90165900 0x7fef900a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 0x7fef900c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900cb440 con 0x7fef900c0f20 2023-05-17T15:29:47.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90166070 con 0x7fef7c003910 2023-05-17T15:29:47.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef90166350 con 0x7fef90165900 2023-05-17T15:29:47.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 0x7fef900c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 0x7fef900c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47478/0 (socket says 172.21.15.27:47478) 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 -- 172.21.15.27:0/737194685 learned_addr learned my addr 172.21.15.27:0/737194685 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef954b3700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef90165900 0x7fef900a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef95cb4700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c003910 0x7fef901652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 -- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef90165900 msgr2=0x7fef900a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef90165900 0x7fef900a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 -- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c003910 msgr2=0x7fef901652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c003910 0x7fef901652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 -- 172.21.15.27:0/737194685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90166630 con 0x7fef900c0f20 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef964b5700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 0x7fef900c1380 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fef900c50b0 tx=0x7fef8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800e070 con 0x7fef900c0f20 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef88011b80 con 0x7fef900c0f20 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88016450 con 0x7fef900c0f20 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.593+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90166910 con 0x7fef900c0f20 2023-05-17T15:29:47.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.594+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90165d80 con 0x7fef900c0f20 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.594+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef90166e30 con 0x7fef900c0f20 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.595+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fef8801d030 con 0x7fef900c0f20 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.595+0000 7fef85ffb700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fef7405ed90 0x7fef74061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.595+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fef88079bf0 con 0x7fef900c0f20 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.595+0000 7fef95cb4700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fef7405ed90 0x7fef74061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.596+0000 7fef95cb4700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fef7405ed90 0x7fef74061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fef8c001010 tx=0x7fef8c015000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:47.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.599+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef90166e30 con 0x7fef900c0f20 2023-05-17T15:29:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.771+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fef90166e30 con 0x7fef900c0f20 2023-05-17T15:29:47.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.775+0000 7fef85ffb700 1 -- 172.21.15.27:0/737194685 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v36) v1 ==== 120+0+0 (secure 0 0 0) 0x7fef90166e30 con 0x7fef900c0f20 2023-05-17T15:29:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fef7405ed90 msgr2=0x7fef74061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fef7405ed90 0x7fef74061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fef8c001010 tx=0x7fef8c015000).stop 2023-05-17T15:29:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 msgr2=0x7fef900c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 0x7fef900c1380 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fef900c50b0 tx=0x7fef8800b040).stop 2023-05-17T15:29:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 shutdown_connections 2023-05-17T15:29:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fef7405ed90 0x7fef74061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef900c0f20 0x7fef900c1380 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c003910 0x7fef901652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 --2- 172.21.15.27:0/737194685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef90165900 0x7fef900a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 >> 172.21.15.27:0/737194685 conn(0x7fef9005dd50 msgr2=0x7fef900afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 shutdown_connections 2023-05-17T15:29:47.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.777+0000 7fef96cb6700 1 -- 172.21.15.27:0/737194685 wait complete. 2023-05-17T15:29:47.793 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-17T15:29:47.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.911+0000 7f728f152700 1 Processor -- start 2023-05-17T15:29:47.915 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.911+0000 7f728f152700 1 -- start start 2023-05-17T15:29:47.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728f152700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 0x7f728815f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728f152700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72880c0c90 con 0x7f72881543d0 2023-05-17T15:29:47.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728f152700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7288158790 con 0x7f72880c6310 2023-05-17T15:29:47.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728f152700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c1c50 con 0x7f7288069410 2023-05-17T15:29:47.918 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728ceee700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f72881543d0 0x7f72880c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47044/0 (socket says 172.21.15.27:47044) 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728ceee700 1 -- 172.21.15.27:0/536234919 learned_addr learned my addr 172.21.15.27:0/536234919 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f728d6ef700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 0x7f728815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997002925 0 0) 0x7f72880c0c90 con 0x7f72881543d0 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.912+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72740033f0 con 0x7f72881543d0 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256423217 0 0) 0x7f72740033f0 con 0x7f72881543d0 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 msgr2=0x7f728815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:47.919 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 0x7f728815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 >> v1:172.21.15.40:6789/0 conn(0x7f72880c6310 legacy=0x7f7288068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288157e60 con 0x7f72881543d0 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f7280001470 con 0x7f72881543d0 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 >> v1:172.21.15.27:6789/0 conn(0x7f72881543d0 legacy=0x7f72880c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7274003910 0x7f7274003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f7274004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 0x7f7274005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.920 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727400b8e0 con 0x7f7274004690 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727400ba20 con 0x7f7274003910 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727400bbe0 con 0x7f7288069410 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f7274004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f728d6ef700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 0x7f7274005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f728ceee700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7274003910 0x7f7274003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 -- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 msgr2=0x7f7274005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7288069410 0x7f7274005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 -- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7274003910 msgr2=0x7f7274003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7274003910 0x7f7274003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 -- 172.21.15.27:0/536234919 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740033f0 con 0x7f7274004690 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.913+0000 7f7287fff700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f7274004b10 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f72700017b0 tx=0x7f7270007b90).ready entity=mon.0 client_cookie=c4738ca8ea643c34 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270007ea0 con 0x7f7274004690 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270013410 con 0x7f7274004690 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f72877fe700 1 -- 172.21.15.27:0/536234919 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72700137b0 con 0x7f7274004690 2023-05-17T15:29:47.922 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728f152700 1 -- 172.21.15.27:0/536234919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 msgr2=0x7f7274004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728f152700 1 --2- 172.21.15.27:0/536234919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f7274004b10 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f72700017b0 tx=0x7f7270007b90).stop 2023-05-17T15:29:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728d6ef700 1 -- 172.21.15.27:0/536234919 reap_dead start 2023-05-17T15:29:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728f152700 1 -- 172.21.15.27:0/536234919 shutdown_connections 2023-05-17T15:29:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728f152700 1 -- 172.21.15.27:0/536234919 >> 172.21.15.27:0/536234919 conn(0x7f72880cb7f0 msgr2=0x7f72880c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728f152700 1 -- 172.21.15.27:0/536234919 shutdown_connections 2023-05-17T15:29:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.914+0000 7f728f152700 1 -- 172.21.15.27:0/536234919 wait complete. 2023-05-17T15:29:47.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.915+0000 7f728f152700 1 Processor -- start 2023-05-17T15:29:47.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.915+0000 7f728f152700 1 -- start start 2023-05-17T15:29:47.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728f152700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f72881448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728f152700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72880c3920 0x7f72880c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728f152700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72880c22b0 0x7f7288156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728f152700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c3490 con 0x7f7274004690 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728f152700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c2880 con 0x7f72880c22b0 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728f152700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c2b60 con 0x7f72880c3920 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728ceee700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f72881448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728ceee700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f72881448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47496/0 (socket says 172.21.15.27:47496) 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728ceee700 1 -- 172.21.15.27:0/2549426721 learned_addr learned my addr 172.21.15.27:0/2549426721 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f7287fff700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72880c3920 0x7f72880c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728d6ef700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72880c22b0 0x7f7288156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728ceee700 1 -- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72880c3920 msgr2=0x7f72880c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.916+0000 7f728ceee700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72880c3920 0x7f72880c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728ceee700 1 -- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72880c22b0 msgr2=0x7f7288156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728ceee700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72880c22b0 0x7f7288156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:47.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728ceee700 1 -- 172.21.15.27:0/2549426721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880c2e40 con 0x7f7274004690 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f7287fff700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72880c3920 0x7f72880c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728d6ef700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72880c22b0 0x7f7288156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728ceee700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f72881448d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f7280001120 tx=0x7f7280001da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280011590 con 0x7f7274004690 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800116f0 con 0x7f7274004690 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72880c3120 con 0x7f7274004690 2023-05-17T15:29:47.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280011a70 con 0x7f7274004690 2023-05-17T15:29:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.917+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7288144dc0 con 0x7f7274004690 2023-05-17T15:29:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.918+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72880c3770 con 0x7f7274004690 2023-05-17T15:29:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.919+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f728001b030 con 0x7f7274004690 2023-05-17T15:29:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.920+0000 7f7284ff9700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f726805ed90 0x7f7268061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.920+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f7280079600 con 0x7f7274004690 2023-05-17T15:29:47.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.926+0000 7f7287fff700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f726805ed90 0x7f7268061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:47.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.926+0000 7f7287fff700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f726805ed90 0x7f7268061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f72881579e0 tx=0x7f7270016000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:47.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:47.927+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f728004add0 con 0x7f7274004690 2023-05-17T15:29:48.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.106+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f728806bdf0 con 0x7f7274004690 2023-05-17T15:29:48.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.109+0000 7f7284ff9700 1 -- 172.21.15.27:0/2549426721 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7280019070 con 0x7f7274004690 2023-05-17T15:29:48.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f726805ed90 msgr2=0x7f7268061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:48.115 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f726805ed90 0x7f7268061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f72881579e0 tx=0x7f7270016000).stop 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 msgr2=0x7f72881448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f72881448d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f7280001120 tx=0x7f7280001da0).stop 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 shutdown_connections 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f726805ed90 0x7f7268061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72880c22b0 0x7f7288156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7274004690 0x7f72881448d0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.116 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 --2- 172.21.15.27:0/2549426721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72880c3920 0x7f72880c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.111+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 >> 172.21.15.27:0/2549426721 conn(0x7f72880cb7f0 msgr2=0x7f72880acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:48.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.112+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 shutdown_connections 2023-05-17T15:29:48.117 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.112+0000 7f728f152700 1 -- 172.21.15.27:0/2549426721 wait complete. 2023-05-17T15:29:48.127 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-05-17T15:29:48.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.238+0000 7fba4a2fa700 1 Processor -- start 2023-05-17T15:29:48.242 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.238+0000 7fba4a2fa700 1 -- start start 2023-05-17T15:29:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.239+0000 7fba4a2fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba441544f0 0x7fba440a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.239+0000 7fba4a2fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440aa070 0x7fba440c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.239+0000 7fba4a2fa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba441549b0 con 0x7fba440c1180 2023-05-17T15:29:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.239+0000 7fba4a2fa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba44154c90 con 0x7fba441544f0 2023-05-17T15:29:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.239+0000 7fba4a2fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44154f70 con 0x7fba440aa070 2023-05-17T15:29:48.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba48af7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba441544f0 0x7fba440a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:48.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba49af9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440aa070 0x7fba440c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:48.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba492f8700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fba440c1180 0x7fba440c02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:53066/0 (socket says 172.21.15.27:53066) 2023-05-17T15:29:48.245 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba492f8700 1 -- 172.21.15.27:0/3319329090 learned_addr learned my addr 172.21.15.27:0/3319329090 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba48af7700 1 -- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440aa070 msgr2=0x7fba440c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba48af7700 1 --2- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440aa070 0x7fba440c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba48af7700 1 -- 172.21.15.27:0/3319329090 >> v1:172.21.15.40:6789/0 conn(0x7fba440c1180 legacy=0x7fba440c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba48af7700 1 -- 172.21.15.27:0/3319329090 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44155250 con 0x7fba441544f0 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba43fff700 1 -- 172.21.15.27:0/3319329090 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013273664 0 0) 0x7fba441549b0 con 0x7fba440c1180 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba49af9700 1 --2- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440aa070 0x7fba440c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:48.246 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba48af7700 1 --2- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba441544f0 0x7fba440a9b80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fba38009760 tx=0x7fba38009060).ready entity=mon.1 client_cookie=88452995c847dd09 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba43fff700 1 -- 172.21.15.27:0/3319329090 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380090d0 con 0x7fba441544f0 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba43fff700 1 -- 172.21.15.27:0/3319329090 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800f510 con 0x7fba441544f0 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.240+0000 7fba43fff700 1 -- 172.21.15.27:0/3319329090 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800f890 con 0x7fba441544f0 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 -- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba441544f0 msgr2=0x7fba440a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba441544f0 0x7fba440a9b80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fba38009760 tx=0x7fba38009060).stop 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 -- 172.21.15.27:0/3319329090 shutdown_connections 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440aa070 0x7fba440c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.247 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/3319329090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba441544f0 0x7fba440a9b80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 -- 172.21.15.27:0/3319329090 >> 172.21.15.27:0/3319329090 conn(0x7fba4405dd50 msgr2=0x7fba4405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:48.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 -- 172.21.15.27:0/3319329090 shutdown_connections 2023-05-17T15:29:48.248 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.241+0000 7fba4a2fa700 1 -- 172.21.15.27:0/3319329090 wait complete. 2023-05-17T15:29:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.242+0000 7fba4a2fa700 1 Processor -- start 2023-05-17T15:29:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.242+0000 7fba4a2fa700 1 -- start start 2023-05-17T15:29:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba4a2fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba440aa070 0x7fba440c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba4a2fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440c1180 0x7fba440c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba4a2fa700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 0x7fba440c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba4a2fa700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c97c0 con 0x7fba441544f0 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba4a2fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44159920 con 0x7fba440aa070 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba4a2fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44158ff0 con 0x7fba440c1180 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba49af9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 0x7fba440c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba49af9700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 0x7fba440c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47512/0 (socket says 172.21.15.27:47512) 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba49af9700 1 -- 172.21.15.27:0/449120230 learned_addr learned my addr 172.21.15.27:0/449120230 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba48af7700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440c1180 0x7fba440c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:48.251 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.243+0000 7fba492f8700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba440aa070 0x7fba440c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba49af9700 1 -- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440c1180 msgr2=0x7fba440c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba49af9700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440c1180 0x7fba440c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba49af9700 1 -- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba440aa070 msgr2=0x7fba440c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba49af9700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba440aa070 0x7fba440c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba49af9700 1 -- 172.21.15.27:0/449120230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34009a20 con 0x7fba441544f0 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba492f8700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba440aa070 0x7fba440c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:48.252 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba48af7700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440c1180 0x7fba440c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba49af9700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 0x7fba440c8fe0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fba34009fc0 tx=0x7fba3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400cd30 con 0x7fba441544f0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3400f040 con 0x7fba441544f0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba380092a0 con 0x7fba441544f0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34013610 con 0x7fba441544f0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.244+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba441595b0 con 0x7fba441544f0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.245+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44159ab0 con 0x7fba441544f0 2023-05-17T15:29:48.253 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.245+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fba34013a00 con 0x7fba441544f0 2023-05-17T15:29:48.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.246+0000 7fba417fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba3005ed90 0x7fba30061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:48.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.246+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fba3407a5e0 con 0x7fba441544f0 2023-05-17T15:29:48.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.246+0000 7fba492f8700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba3005ed90 0x7fba30061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:48.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.246+0000 7fba492f8700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba3005ed90 0x7fba30061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fba3c007fd0 tx=0x7fba3c009040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:48.254 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.250+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba3404bc80 con 0x7fba441544f0 2023-05-17T15:29:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:48.489+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fba4406bdf0 con 0x7fba441544f0 2023-05-17T15:29:49.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.460+0000 7fba417fa700 1 -- 172.21.15.27:0/449120230 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1263) v1 ==== 155+0+0 (secure 0 0 0) 0x7fba3404f2a0 con 0x7fba441544f0 2023-05-17T15:29:49.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba3005ed90 msgr2=0x7fba30061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:49.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba3005ed90 0x7fba30061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fba3c007fd0 tx=0x7fba3c009040).stop 2023-05-17T15:29:49.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 msgr2=0x7fba440c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:49.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 0x7fba440c8fe0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fba34009fc0 tx=0x7fba3400b040).stop 2023-05-17T15:29:49.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 shutdown_connections 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fba3005ed90 0x7fba30061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba441544f0 0x7fba440c8fe0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba440aa070 0x7fba440c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 --2- 172.21.15.27:0/449120230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba440c1180 0x7fba440c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 >> 172.21.15.27:0/449120230 conn(0x7fba4405dd50 msgr2=0x7fba440ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 shutdown_connections 2023-05-17T15:29:49.468 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:49.463+0000 7fba4a2fa700 1 -- 172.21.15.27:0/449120230 wait complete. 2023-05-17T15:29:49.481 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-05-17T15:29:49.482 INFO:tasks.cephfs_test_runner: 2023-05-17T15:29:49.482 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-05-17T15:29:49.482 INFO:tasks.cephfs_test_runner:Ran 9 tests in 2127.100s 2023-05-17T15:29:49.483 INFO:tasks.cephfs_test_runner: 2023-05-17T15:29:49.483 INFO:tasks.cephfs_test_runner:OK 2023-05-17T15:29:49.483 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-05-17T15:29:49.492 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-05-17T15:29:49.614 INFO:tasks.kclient:Unmounting kernel clients... 2023-05-17T15:29:49.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.615 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:29:49.633 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T15:29:49.633 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T15:29:49.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T15:29:49.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T15:29:49.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-05-17T15:29:49.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.884 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-05-17T15:29:49.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.900 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-05-17T15:29:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-05-17T15:29:49.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T15:29:49.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.971 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-17T15:29:49.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-05-17T15:29:49.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-17T15:29:49.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:49.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-17T15:29:50.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:50.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T15:29:50.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:50.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-05-17T15:29:50.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:50.234 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-17T15:29:50.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T15:29:50.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-05-17T15:29:50.320 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-05-17T15:29:50.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T15:29:50.322 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-05-17T15:29:50.331 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-05-17T15:29:50.331 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:50.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.448+0000 7f8940dad700 1 Processor -- start 2023-05-17T15:29:50.452 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.448+0000 7f8940dad700 1 -- start start 2023-05-17T15:29:50.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f8940dad700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f893c151bc0 0x7f893c05dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f8940dad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c05e240 0x7f893c0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f8940dad700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c063dc0 con 0x7f893c0c2850 2023-05-17T15:29:50.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f8940dad700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0c8710 con 0x7f893c151bc0 2023-05-17T15:29:50.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f8940dad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c151fa0 con 0x7f893c05e240 2023-05-17T15:29:50.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f893a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f893c151bc0 0x7f893c05dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f893ad9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f893c0c2850 0x7f893c157aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47082/0 (socket says 172.21.15.27:47082) 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f893a59c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f893c151bc0 0x7f893c05dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47516/0 (socket says 172.21.15.27:47516) 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f893ad9d700 1 -- 172.21.15.27:0/278380966 learned_addr learned my addr 172.21.15.27:0/278380966 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.449+0000 7f8939d9b700 1 --2- 172.21.15.27:0/278380966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c05e240 0x7f893c0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893a59c700 1 -- 172.21.15.27:0/278380966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c05e240 msgr2=0x7f893c0c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893a59c700 1 --2- 172.21.15.27:0/278380966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c05e240 0x7f893c0c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893a59c700 1 -- 172.21.15.27:0/278380966 >> v1:172.21.15.27:6789/0 conn(0x7f893c0c2850 legacy=0x7f893c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893959a700 1 -- 172.21.15.27:0/278380966 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459099494 0 0) 0x7f893c063dc0 con 0x7f893c0c2850 2023-05-17T15:29:50.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893a59c700 1 -- 172.21.15.27:0/278380966 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c064080 con 0x7f893c151bc0 2023-05-17T15:29:50.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893a59c700 1 --2- 172.21.15.27:0/278380966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c151bc0 0x7f893c05dd50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f8934009e90 tx=0x7f8934009780).ready entity=mon.0 client_cookie=c0482655807c2af0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:50.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893959a700 1 -- 172.21.15.27:0/278380966 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400e070 con 0x7f893c151bc0 2023-05-17T15:29:50.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893959a700 1 -- 172.21.15.27:0/278380966 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400bb20 con 0x7f893c151bc0 2023-05-17T15:29:50.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f893959a700 1 -- 172.21.15.27:0/278380966 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400bea0 con 0x7f893c151bc0 2023-05-17T15:29:50.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f8940dad700 1 -- 172.21.15.27:0/278380966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c151bc0 msgr2=0x7f893c05dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f8940dad700 1 --2- 172.21.15.27:0/278380966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c151bc0 0x7f893c05dd50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f8934009e90 tx=0x7f8934009780).stop 2023-05-17T15:29:50.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f8940dad700 1 -- 172.21.15.27:0/278380966 shutdown_connections 2023-05-17T15:29:50.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f8940dad700 1 --2- 172.21.15.27:0/278380966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c151bc0 0x7f893c05dd50 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.450+0000 7f8940dad700 1 --2- 172.21.15.27:0/278380966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c05e240 0x7f893c0c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.451+0000 7f8940dad700 1 -- 172.21.15.27:0/278380966 >> 172.21.15.27:0/278380966 conn(0x7f893c068740 msgr2=0x7f893c0c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.451+0000 7f8940dad700 1 -- 172.21.15.27:0/278380966 shutdown_connections 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.451+0000 7f8940dad700 1 -- 172.21.15.27:0/278380966 wait complete. 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.452+0000 7f8940dad700 1 Processor -- start 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.452+0000 7f8940dad700 1 -- start start 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.452+0000 7f8940dad700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 0x7f893c0a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.452+0000 7f8940dad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c0c2850 0x7f893c164670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.452+0000 7f8940dad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c151bc0 0x7f893c0a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f8940dad700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c165640 con 0x7f893c05e240 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f8940dad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c0bee20 con 0x7f893c151bc0 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f8940dad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c165080 con 0x7f893c0c2850 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 0x7f893c0a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 0x7f893c0a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47522/0 (socket says 172.21.15.27:47522) 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 -- 172.21.15.27:0/1614455166 learned_addr learned my addr 172.21.15.27:0/1614455166 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f8939d9b700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c0c2850 0x7f893c164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893ad9d700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c151bc0 0x7f893c0a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 -- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c0c2850 msgr2=0x7f893c164670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c0c2850 0x7f893c164670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 -- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c151bc0 msgr2=0x7f893c0a8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c151bc0 0x7f893c0a8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 -- 172.21.15.27:0/1614455166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934009a20 con 0x7f893c05e240 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893ad9d700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c151bc0 0x7f893c0a8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f893a59c700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 0x7f893c0a60b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f893400b7f0 tx=0x7f8934009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400be60 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893401d630 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c165360 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893401d9f0 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.453+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c0a65a0 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.454+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c06bdf0 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.455+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8934026410 con 0x7f893c05e240 2023-05-17T15:29:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.455+0000 7f89327fc700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f891c05ed90 0x7f891c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.455+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f893407ba30 con 0x7f893c05e240 2023-05-17T15:29:50.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.455+0000 7f8939d9b700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f891c05ed90 0x7f891c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.455+0000 7f8939d9b700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f891c05ed90 0x7f891c061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f893c0c1b50 tx=0x7f8924009060).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:50.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.459+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f893404d070 con 0x7f893c05e240 2023-05-17T15:29:50.637 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.633+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f893c0a6c20 con 0x7f893c05e240 2023-05-17T15:29:50.638 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.634+0000 7f89327fc700 1 -- 172.21.15.27:0/1614455166 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+14611 (secure 0 0 0) 0x7f8934050690 con 0x7f893c05e240 2023-05-17T15:29:50.638 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:50.638 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":182,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:47.444327+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2198942677":"2023-05-18T15:29:43.952612+0000","172.21.15.27:0/172742611":"2023-05-18T15:29:43.952612+0000","172.21.15.27:0/3823210708":"2023-05-18T15:29:43.952612+0000","172.21.15.27:0/1940509477":"2023-05-18T15:29:43.952612+0000","172.21.15.27:6835/3491718569":"2023-05-18T15:29:43.796857+0000","172.21.15.27:0/3890893237":"2023-05-18T15:29:43.952612+0000","172.21.15.27:6833/3491718569":"2023-05-18T15:29:43.796857+0000","172.21.15.27:0/2744476591":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6837/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6836/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:0/2976443407":"2023-05-18T15:29:36.343483+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:50.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f891c05ed90 msgr2=0x7f891c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f891c05ed90 0x7f891c061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f893c0c1b50 tx=0x7f8924009060).stop 2023-05-17T15:29:50.640 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 msgr2=0x7f893c0a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 0x7f893c0a60b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f893400b7f0 tx=0x7f8934009780).stop 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 shutdown_connections 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f891c05ed90 0x7f891c061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c151bc0 0x7f893c0a8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f893c05e240 0x7f893c0a60b0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 --2- 172.21.15.27:0/1614455166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c0c2850 0x7f893c164670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.641 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 >> 172.21.15.27:0/1614455166 conn(0x7f893c068740 msgr2=0x7f893c1520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 shutdown_connections 2023-05-17T15:29:50.642 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.636+0000 7f8940dad700 1 -- 172.21.15.27:0/1614455166 wait complete. 2023-05-17T15:29:50.652 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-17T15:29:50.652 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:50.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.764+0000 7f5730809700 1 Processor -- start 2023-05-17T15:29:50.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.764+0000 7f5730809700 1 -- start start 2023-05-17T15:29:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f5730809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 0x7f572c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f5730809700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f572c1541c0 0x7f572c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f5730809700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0bfcd0 con 0x7f572c0c5f30 2023-05-17T15:29:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f5730809700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0c0290 con 0x7f572c1541c0 2023-05-17T15:29:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f5730809700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0aa1a0 con 0x7f572c0c6310 2023-05-17T15:29:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f572a59c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f572c0c5f30 0x7f572c158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47092/0 (socket says 172.21.15.27:47092) 2023-05-17T15:29:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.765+0000 7f572a59c700 1 -- 172.21.15.27:0/1918389472 learned_addr learned my addr 172.21.15.27:0/1918389472 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:50.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031853885 0 0) 0x7f572c0bfcd0 con 0x7f572c0c5f30 2023-05-17T15:29:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57180033f0 con 0x7f572c0c5f30 2023-05-17T15:29:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572ad9d700 1 --2- 172.21.15.27:0/1918389472 >> v2:172.21.15.40:3300/0 conn(0x7f572c1541c0 0x7f572c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 0x7f572c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2727683536 0 0) 0x7f57180033f0 con 0x7f572c0c5f30 2023-05-17T15:29:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 msgr2=0x7f572c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 0x7f572c153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 >> v2:172.21.15.40:3300/0 conn(0x7f572c1541c0 msgr2=0x7f572c0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 --2- 172.21.15.27:0/1918389472 >> v2:172.21.15.40:3300/0 conn(0x7f572c1541c0 0x7f572c0c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0aa480 con 0x7f572c0c5f30 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f57240017f0 con 0x7f572c0c5f30 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 >> v1:172.21.15.27:6789/0 conn(0x7f572c0c5f30 legacy=0x7f572c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 0x7f57180038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5718003e10 0x7f5718004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5718004b80 0x7f5718005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0c0290 con 0x7f5718003e10 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0aa1a0 con 0x7f5718004b80 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571800b8e0 con 0x7f572c0c6310 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5718003e10 0x7f5718004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572a59c700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 0x7f57180038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572ad9d700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5718004b80 0x7f5718005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 -- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 msgr2=0x7f57180038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f572c0c6310 0x7f57180038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 -- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5718004b80 msgr2=0x7f5718005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5718004b80 0x7f5718005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f5729d9b700 1 -- 172.21.15.27:0/1918389472 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180033f0 con 0x7f5718003e10 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.766+0000 7f572ad9d700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5718004b80 0x7f5718005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5729d9b700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5718003e10 0x7f5718004690 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f5714009a90 tx=0x7f5714009060).ready entity=mon.0 client_cookie=3333c85a4c81406 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714009430 con 0x7f5718003e10 2023-05-17T15:29:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571400e640 con 0x7f5718003e10 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f572959a700 1 -- 172.21.15.27:0/1918389472 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571400e9c0 con 0x7f5718003e10 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5730809700 1 -- 172.21.15.27:0/1918389472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5718003e10 msgr2=0x7f5718004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5730809700 1 --2- 172.21.15.27:0/1918389472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5718003e10 0x7f5718004690 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f5714009a90 tx=0x7f5714009060).stop 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f572ad9d700 1 -- 172.21.15.27:0/1918389472 reap_dead start 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5730809700 1 -- 172.21.15.27:0/1918389472 shutdown_connections 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5730809700 1 -- 172.21.15.27:0/1918389472 >> 172.21.15.27:0/1918389472 conn(0x7f572c069e70 msgr2=0x7f572c05dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5730809700 1 -- 172.21.15.27:0/1918389472 shutdown_connections 2023-05-17T15:29:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.767+0000 7f5730809700 1 -- 172.21.15.27:0/1918389472 wait complete. 2023-05-17T15:29:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.768+0000 7f5730809700 1 Processor -- start 2023-05-17T15:29:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.768+0000 7f5730809700 1 -- start start 2023-05-17T15:29:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5730809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5718003e10 0x7f572c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5730809700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572c154f50 0x7f572c1653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5730809700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 0x7f572c0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5730809700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c158560 con 0x7f572c0af580 2023-05-17T15:29:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5730809700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c164f50 con 0x7f572c154f50 2023-05-17T15:29:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5730809700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c158d30 con 0x7f5718003e10 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 0x7f572c0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 0x7f572c0af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47546/0 (socket says 172.21.15.27:47546) 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 -- 172.21.15.27:0/3906924964 learned_addr learned my addr 172.21.15.27:0/3906924964 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572a59c700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5718003e10 0x7f572c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f5729d9b700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572c154f50 0x7f572c1653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 -- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5718003e10 msgr2=0x7f572c14f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5718003e10 0x7f572c14f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 -- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572c154f50 msgr2=0x7f572c1653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.769+0000 7f572ad9d700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572c154f50 0x7f572c1653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f572ad9d700 1 -- 172.21.15.27:0/3906924964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0afed0 con 0x7f572c0af580 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f5729d9b700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572c154f50 0x7f572c1653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f572ad9d700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 0x7f572c0af9e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f572c0826a0 tx=0x7f571c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0145f0 con 0x7f572c0af580 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c014750 con 0x7f572c0af580 2023-05-17T15:29:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c158770 con 0x7f572c0af580 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c014ad0 con 0x7f572c0af580 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.770+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c164be0 con 0x7f572c0af580 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.771+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c164a20 con 0x7f572c0af580 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.771+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f571c012040 con 0x7f572c0af580 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.772+0000 7f57227fc700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f570c05ed90 0x7f570c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.772+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f571c079f40 con 0x7f572c0af580 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.772+0000 7f572a59c700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f570c05ed90 0x7f570c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.772+0000 7f572a59c700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f570c05ed90 0x7f570c061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5724007e50 tx=0x7f5724009040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.776+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f571c04b4d0 con 0x7f572c0af580 2023-05-17T15:29:50.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.945+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f572c05f4a0 con 0x7f570c05ed90 2023-05-17T15:29:50.952 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.948+0000 7f57227fc700 1 -- 172.21.15.27:0/3906924964 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71194 (secure 0 0 0) 0x7f572c05f4a0 con 0x7f570c05ed90 2023-05-17T15:29:50.953 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:50.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f570c05ed90 msgr2=0x7f570c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.954 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f570c05ed90 0x7f570c061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5724007e50 tx=0x7f5724009040).stop 2023-05-17T15:29:50.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 msgr2=0x7f572c0af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:50.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 0x7f572c0af9e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f572c0826a0 tx=0x7f571c008040).stop 2023-05-17T15:29:50.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 shutdown_connections 2023-05-17T15:29:50.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f570c05ed90 0x7f570c061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f572c0af580 0x7f572c0af9e0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.955 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5718003e10 0x7f572c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 --2- 172.21.15.27:0/3906924964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572c154f50 0x7f572c1653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:50.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 >> 172.21.15.27:0/3906924964 conn(0x7f572c069e70 msgr2=0x7f572c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:50.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 shutdown_connections 2023-05-17T15:29:50.956 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:50.950+0000 7f5730809700 1 -- 172.21.15.27:0/3906924964 wait complete. 2023-05-17T15:29:50.956 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:50.966 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-05-17T15:29:50.811752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":183156,"kb_used_data":17652,"kb_used_omap":0,"kb_used_meta":165440,"kb_avail":754791564,"statfs":{"total":773094113280,"available":772906561536,"internally_reserved":0,"allocated":18075648,"data_stored":9216099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":169410560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11962,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.628758"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.847510+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:43.847510+0000","last_peered":"2023-05-17T15:29:43.847510+0000","last_clean":"2023-05-17T15:29:43.847510+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:43.847510+0000","last_undegraded":"2023-05-17T15:29:43.847510+0000","last_fullsized":"2023-05-17T15:29:43.847510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.804851+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:43.804851+0000","last_peered":"2023-05-17T15:29:43.804851+0000","last_clean":"2023-05-17T15:29:43.804851+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:43.804851+0000","last_undegraded":"2023-05-17T15:29:43.804851+0000","last_fullsized":"2023-05-17T15:29:43.804851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.446698+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:46.446698+0000","last_peered":"2023-05-17T15:29:46.446698+0000","last_clean":"2023-05-17T15:29:46.446698+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:46.446698+0000","last_undegraded":"2023-05-17T15:29:46.446698+0000","last_fullsized":"2023-05-17T15:29:46.446698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.805067+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:43.805067+0000","last_peered":"2023-05-17T15:29:43.805067+0000","last_clean":"2023-05-17T15:29:43.805067+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:43.805067+0000","last_undegraded":"2023-05-17T15:29:43.805067+0000","last_fullsized":"2023-05-17T15:29:43.805067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444262+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:36.444262+0000","last_peered":"2023-05-17T15:29:36.444262+0000","last_clean":"2023-05-17T15:29:36.444262+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:36.444262+0000","last_undegraded":"2023-05-17T15:29:36.444262+0000","last_fullsized":"2023-05-17T15:29:36.444262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444314+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:36.444314+0000","last_peered":"2023-05-17T15:29:36.444314+0000","last_clean":"2023-05-17T15:29:36.444314+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:36.444314+0000","last_undegraded":"2023-05-17T15:29:36.444314+0000","last_fullsized":"2023-05-17T15:29:36.444314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444629+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:36.444629+0000","last_peered":"2023-05-17T15:29:36.444629+0000","last_clean":"2023-05-17T15:29:36.444629+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:36.444629+0000","last_undegraded":"2023-05-17T15:29:36.444629+0000","last_fullsized":"2023-05-17T15:29:36.444629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.847719+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:43.847719+0000","last_peered":"2023-05-17T15:29:43.847719+0000","last_clean":"2023-05-17T15:29:43.847719+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:43.847719+0000","last_undegraded":"2023-05-17T15:29:43.847719+0000","last_fullsized":"2023-05-17T15:29:43.847719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.803505+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:43.803505+0000","last_peered":"2023-05-17T15:29:43.803505+0000","last_clean":"2023-05-17T15:29:43.803505+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:43.803505+0000","last_undegraded":"2023-05-17T15:29:43.803505+0000","last_fullsized":"2023-05-17T15:29:43.803505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21232,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94350608,"statfs":{"total":96636764160,"available":96615022592,"internally_reserved":0,"allocated":2269184,"data_stored":1158344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.372},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.42699999999999999}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20828,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351012,"statfs":{"total":96636764160,"available":96615436288,"internally_reserved":0,"allocated":2248704,"data_stored":1147422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20256,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":18048,"kb_avail":94351584,"statfs":{"total":96636764160,"available":96616022016,"internally_reserved":0,"allocated":2252800,"data_stored":1147945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18481152},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.438},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834575272,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20844,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94350996,"statfs":{"total":96636764160,"available":96615419904,"internally_reserved":0,"allocated":2265088,"data_stored":1148812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.878}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.72599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.51300000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45600000000000002,"5min":1.254,"15min":1.254},"last":0.378},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.443}]},{"osd":3,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.63400000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":1.04,"15min":1.04},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.96599999999999997,"15min":1.006},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84799999999999998,"5min":1.0700000000000001,"15min":1.0760000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":1.018,"15min":1.018},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.21,"15min":1.21},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28832,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":26624,"kb_avail":94343008,"statfs":{"total":96636764160,"available":96607240192,"internally_reserved":0,"allocated":2252800,"data_stored":1147456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27262976},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.499},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575271,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20896,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350944,"statfs":{"total":96636764160,"available":96615366656,"internally_reserved":0,"allocated":2252800,"data_stored":1147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.66000000000000003}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.373},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.27400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.33100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.34399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575271,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":26048,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":2256896,"data_stored":1157045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26673152},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.434}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.317},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.375}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:50.968 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:51.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.084+0000 7fa77b4b3700 1 Processor -- start 2023-05-17T15:29:51.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.084+0000 7fa77b4b3700 1 -- start start 2023-05-17T15:29:51.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa77b4b3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa7740c60c0 0x7fa7740c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa77b4b3700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7740aa3b0 0x7fa7740c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa77b4b3700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77405e7e0 con 0x7fa7740a9f70 2023-05-17T15:29:51.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa77b4b3700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77405eac0 con 0x7fa7740aa3b0 2023-05-17T15:29:51.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa77b4b3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7740bfd70 con 0x7fa7740c60c0 2023-05-17T15:29:51.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa779a50700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7740aa3b0 0x7fa7740c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa778a4e700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa7740a9f70 0x7fa774153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47114/0 (socket says 172.21.15.27:47114) 2023-05-17T15:29:51.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa779a50700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa7740aa3b0 0x7fa7740c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47554/0 (socket says 172.21.15.27:47554) 2023-05-17T15:29:51.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa778a4e700 1 -- 172.21.15.27:0/3716511705 learned_addr learned my addr 172.21.15.27:0/3716511705 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:51.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa77924f700 1 --2- 172.21.15.27:0/3716511705 >> v2:172.21.15.40:3300/0 conn(0x7fa7740c60c0 0x7fa7740c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.092 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa779a50700 1 -- 172.21.15.27:0/3716511705 >> v2:172.21.15.40:3300/0 conn(0x7fa7740c60c0 msgr2=0x7fa7740c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:51.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa779a50700 1 --2- 172.21.15.27:0/3716511705 >> v2:172.21.15.40:3300/0 conn(0x7fa7740c60c0 0x7fa7740c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa779a50700 1 -- 172.21.15.27:0/3716511705 >> v1:172.21.15.27:6789/0 conn(0x7fa7740a9f70 legacy=0x7fa774153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa773fff700 1 -- 172.21.15.27:0/3716511705 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122927919 0 0) 0x7fa77405e7e0 con 0x7fa7740a9f70 2023-05-17T15:29:51.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.085+0000 7fa779a50700 1 -- 172.21.15.27:0/3716511705 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740c0050 con 0x7fa7740aa3b0 2023-05-17T15:29:51.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa779a50700 1 --2- 172.21.15.27:0/3716511705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740aa3b0 0x7fa7740c0850 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fa77405eff0 tx=0x7fa764009780).ready entity=mon.0 client_cookie=131fa51738a11490 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa773fff700 1 -- 172.21.15.27:0/3716511705 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400e070 con 0x7fa7740aa3b0 2023-05-17T15:29:51.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa773fff700 1 -- 172.21.15.27:0/3716511705 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400bb60 con 0x7fa7740aa3b0 2023-05-17T15:29:51.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa773fff700 1 -- 172.21.15.27:0/3716511705 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764012410 con 0x7fa7740aa3b0 2023-05-17T15:29:51.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 -- 172.21.15.27:0/3716511705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740aa3b0 msgr2=0x7fa7740c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/3716511705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740aa3b0 0x7fa7740c0850 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fa77405eff0 tx=0x7fa764009780).stop 2023-05-17T15:29:51.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 -- 172.21.15.27:0/3716511705 shutdown_connections 2023-05-17T15:29:51.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/3716511705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740aa3b0 0x7fa7740c0850 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/3716511705 >> v2:172.21.15.40:3300/0 conn(0x7fa7740c60c0 0x7fa7740c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 -- 172.21.15.27:0/3716511705 >> 172.21.15.27:0/3716511705 conn(0x7fa774069e70 msgr2=0x7fa77405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:51.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 -- 172.21.15.27:0/3716511705 shutdown_connections 2023-05-17T15:29:51.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.086+0000 7fa77b4b3700 1 -- 172.21.15.27:0/3716511705 wait complete. 2023-05-17T15:29:51.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.087+0000 7fa77b4b3700 1 Processor -- start 2023-05-17T15:29:51.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.087+0000 7fa77b4b3700 1 -- start start 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa77b4b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7740a9f70 0x7fa7740b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa77b4b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7740aa3b0 0x7fa774143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa77b4b3700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 0x7fa774167c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa77b4b3700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740addb0 con 0x7fa7740c60c0 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa77b4b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740cae40 con 0x7fa7740a9f70 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa77b4b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740cb120 con 0x7fa7740aa3b0 2023-05-17T15:29:51.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa779a50700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 0x7fa774167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa779a50700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 0x7fa774167c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47560/0 (socket says 172.21.15.27:47560) 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.088+0000 7fa779a50700 1 -- 172.21.15.27:0/1593613394 learned_addr learned my addr 172.21.15.27:0/1593613394 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa77924f700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7740a9f70 0x7fa7740b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa778a4e700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7740aa3b0 0x7fa774143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa779a50700 1 -- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7740aa3b0 msgr2=0x7fa774143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa779a50700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7740aa3b0 0x7fa774143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa779a50700 1 -- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7740a9f70 msgr2=0x7fa7740b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa779a50700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7740a9f70 0x7fa7740b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa779a50700 1 -- 172.21.15.27:0/1593613394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009a20 con 0x7fa7740c60c0 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa77924f700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7740a9f70 0x7fa7740b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa779a50700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 0x7fa774167c60 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fa76400b6c0 tx=0x7fa764009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76401d630 con 0x7fa7740c60c0 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76401d790 con 0x7fa7740c60c0 2023-05-17T15:29:51.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7740cb400 con 0x7fa7740c60c0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76401db10 con 0x7fa7740c60c0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.089+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7740c9d50 con 0x7fa7740c60c0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.090+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa774067cb0 con 0x7fa7740c60c0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.090+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa764026410 con 0x7fa7740c60c0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.091+0000 7fa7717fa700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa76005ed90 0x7fa760061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.091+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fa76407ba90 con 0x7fa7740c60c0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.091+0000 7fa77924f700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa76005ed90 0x7fa760061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.091+0000 7fa77924f700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa76005ed90 0x7fa760061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa76c009b60 tx=0x7fa76c008040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.095+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa774067cb0 con 0x7fa7740c60c0 2023-05-17T15:29:51.268 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.264+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa774067cb0 con 0x7fa76005ed90 2023-05-17T15:29:51.271 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.267+0000 7fa7717fa700 1 -- 172.21.15.27:0/1593613394 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71194 (secure 0 0 0) 0x7fa774067cb0 con 0x7fa76005ed90 2023-05-17T15:29:51.272 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:51.273 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa76005ed90 msgr2=0x7fa760061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa76005ed90 0x7fa760061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa76c009b60 tx=0x7fa76c008040).stop 2023-05-17T15:29:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 msgr2=0x7fa774167c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 0x7fa774167c60 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fa76400b6c0 tx=0x7fa764009780).stop 2023-05-17T15:29:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 shutdown_connections 2023-05-17T15:29:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fa76005ed90 0x7fa760061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7740c60c0 0x7fa774167c60 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7740a9f70 0x7fa7740b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 --2- 172.21.15.27:0/1593613394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7740aa3b0 0x7fa774143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 >> 172.21.15.27:0/1593613394 conn(0x7fa774069e70 msgr2=0x7fa7740ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:51.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.269+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 shutdown_connections 2023-05-17T15:29:51.275 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.270+0000 7fa77b4b3700 1 -- 172.21.15.27:0/1593613394 wait complete. 2023-05-17T15:29:51.275 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:51.285 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-05-17T15:29:50.811752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":183156,"kb_used_data":17652,"kb_used_omap":0,"kb_used_meta":165440,"kb_avail":754791564,"statfs":{"total":773094113280,"available":772906561536,"internally_reserved":0,"allocated":18075648,"data_stored":9216099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":169410560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11962,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.628758"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.847510+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:43.847510+0000","last_peered":"2023-05-17T15:29:43.847510+0000","last_clean":"2023-05-17T15:29:43.847510+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:43.847510+0000","last_undegraded":"2023-05-17T15:29:43.847510+0000","last_fullsized":"2023-05-17T15:29:43.847510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.804851+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:43.804851+0000","last_peered":"2023-05-17T15:29:43.804851+0000","last_clean":"2023-05-17T15:29:43.804851+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:43.804851+0000","last_undegraded":"2023-05-17T15:29:43.804851+0000","last_fullsized":"2023-05-17T15:29:43.804851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.446698+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:46.446698+0000","last_peered":"2023-05-17T15:29:46.446698+0000","last_clean":"2023-05-17T15:29:46.446698+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:46.446698+0000","last_undegraded":"2023-05-17T15:29:46.446698+0000","last_fullsized":"2023-05-17T15:29:46.446698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.805067+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:43.805067+0000","last_peered":"2023-05-17T15:29:43.805067+0000","last_clean":"2023-05-17T15:29:43.805067+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:43.805067+0000","last_undegraded":"2023-05-17T15:29:43.805067+0000","last_fullsized":"2023-05-17T15:29:43.805067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444262+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:36.444262+0000","last_peered":"2023-05-17T15:29:36.444262+0000","last_clean":"2023-05-17T15:29:36.444262+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:36.444262+0000","last_undegraded":"2023-05-17T15:29:36.444262+0000","last_fullsized":"2023-05-17T15:29:36.444262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444314+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:36.444314+0000","last_peered":"2023-05-17T15:29:36.444314+0000","last_clean":"2023-05-17T15:29:36.444314+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:36.444314+0000","last_undegraded":"2023-05-17T15:29:36.444314+0000","last_fullsized":"2023-05-17T15:29:36.444314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444629+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:36.444629+0000","last_peered":"2023-05-17T15:29:36.444629+0000","last_clean":"2023-05-17T15:29:36.444629+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:36.444629+0000","last_undegraded":"2023-05-17T15:29:36.444629+0000","last_fullsized":"2023-05-17T15:29:36.444629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.847719+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:43.847719+0000","last_peered":"2023-05-17T15:29:43.847719+0000","last_clean":"2023-05-17T15:29:43.847719+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:43.847719+0000","last_undegraded":"2023-05-17T15:29:43.847719+0000","last_fullsized":"2023-05-17T15:29:43.847719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.803505+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:43.803505+0000","last_peered":"2023-05-17T15:29:43.803505+0000","last_clean":"2023-05-17T15:29:43.803505+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:43.803505+0000","last_undegraded":"2023-05-17T15:29:43.803505+0000","last_fullsized":"2023-05-17T15:29:43.803505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21232,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94350608,"statfs":{"total":96636764160,"available":96615022592,"internally_reserved":0,"allocated":2269184,"data_stored":1158344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.372},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.42699999999999999}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20828,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351012,"statfs":{"total":96636764160,"available":96615436288,"internally_reserved":0,"allocated":2248704,"data_stored":1147422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20256,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":18048,"kb_avail":94351584,"statfs":{"total":96636764160,"available":96616022016,"internally_reserved":0,"allocated":2252800,"data_stored":1147945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18481152},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.438},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834575272,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20844,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94350996,"statfs":{"total":96636764160,"available":96615419904,"internally_reserved":0,"allocated":2265088,"data_stored":1148812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.878}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.72599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.51300000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45600000000000002,"5min":1.254,"15min":1.254},"last":0.378},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.443}]},{"osd":3,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.63400000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":1.04,"15min":1.04},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.96599999999999997,"15min":1.006},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84799999999999998,"5min":1.0700000000000001,"15min":1.0760000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":1.018,"15min":1.018},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.21,"15min":1.21},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28832,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":26624,"kb_avail":94343008,"statfs":{"total":96636764160,"available":96607240192,"internally_reserved":0,"allocated":2252800,"data_stored":1147456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27262976},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.499},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575271,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20896,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350944,"statfs":{"total":96636764160,"available":96615366656,"internally_reserved":0,"allocated":2252800,"data_stored":1147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.66000000000000003}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.373},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.27400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.33100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.34399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575271,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":26048,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":2256896,"data_stored":1157045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26673152},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.434}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.317},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.375}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:51.287 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-17T15:29:51.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.400+0000 7ff18b478700 1 Processor -- start 2023-05-17T15:29:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.400+0000 7ff18b478700 1 -- start start 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff18b478700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff1840c5f30 0x7ff1840c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff18b478700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff184158880 0x7ff184153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff18b478700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1840bfcd0 con 0x7ff1841541c0 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff18b478700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840c0290 con 0x7ff1840c5f30 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff18b478700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840aa1a0 con 0x7ff184158880 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff189214700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff1840c5f30 0x7ff1840c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff189a15700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff1841541c0 0x7ff1840c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47130/0 (socket says 172.21.15.27:47130) 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.401+0000 7ff189a15700 1 -- 172.21.15.27:0/78929400 learned_addr learned my addr 172.21.15.27:0/78929400 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff188a13700 1 --2- 172.21.15.27:0/78929400 >> v2:172.21.15.40:3300/0 conn(0x7ff184158880 0x7ff184153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff189214700 1 -- 172.21.15.27:0/78929400 >> v2:172.21.15.40:3300/0 conn(0x7ff184158880 msgr2=0x7ff184153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff189214700 1 --2- 172.21.15.27:0/78929400 >> v2:172.21.15.40:3300/0 conn(0x7ff184158880 0x7ff184153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff189214700 1 -- 172.21.15.27:0/78929400 >> v1:172.21.15.27:6789/0 conn(0x7ff1841541c0 legacy=0x7ff1840c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff183fff700 1 -- 172.21.15.27:0/78929400 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769992785 0 0) 0x7ff1840bfcd0 con 0x7ff1841541c0 2023-05-17T15:29:51.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff189214700 1 -- 172.21.15.27:0/78929400 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1840aa480 con 0x7ff1840c5f30 2023-05-17T15:29:51.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff189214700 1 --2- 172.21.15.27:0/78929400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1840c5f30 0x7ff1840c6310 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7ff1840c57b0 tx=0x7ff17c009780).ready entity=mon.0 client_cookie=dc6293de262d0c5e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff183fff700 1 -- 172.21.15.27:0/78929400 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00e070 con 0x7ff1840c5f30 2023-05-17T15:29:51.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff183fff700 1 -- 172.21.15.27:0/78929400 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c00bc30 con 0x7ff1840c5f30 2023-05-17T15:29:51.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff183fff700 1 -- 172.21.15.27:0/78929400 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c012410 con 0x7ff1840c5f30 2023-05-17T15:29:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 -- 172.21.15.27:0/78929400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1840c5f30 msgr2=0x7ff1840c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 --2- 172.21.15.27:0/78929400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1840c5f30 0x7ff1840c6310 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7ff1840c57b0 tx=0x7ff17c009780).stop 2023-05-17T15:29:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 -- 172.21.15.27:0/78929400 shutdown_connections 2023-05-17T15:29:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 --2- 172.21.15.27:0/78929400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1840c5f30 0x7ff1840c6310 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.410 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 --2- 172.21.15.27:0/78929400 >> v2:172.21.15.40:3300/0 conn(0x7ff184158880 0x7ff184153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 -- 172.21.15.27:0/78929400 >> 172.21.15.27:0/78929400 conn(0x7ff184069e70 msgr2=0x7ff18405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.402+0000 7ff18b478700 1 -- 172.21.15.27:0/78929400 shutdown_connections 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.403+0000 7ff18b478700 1 -- 172.21.15.27:0/78929400 wait complete. 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 Processor -- start 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 -- start start 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1840c5f30 0x7ff184164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 0x7ff1841670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.411 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff184158880 0x7ff18414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18414d470 con 0x7ff1841541c0 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18414f050 con 0x7ff184158880 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.404+0000 7ff18b478700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18414f330 con 0x7ff1840c5f30 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 0x7ff1841670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 0x7ff1841670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47572/0 (socket says 172.21.15.27:47572) 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff189214700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1840c5f30 0x7ff184164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.412 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 -- 172.21.15.27:0/205764545 learned_addr learned my addr 172.21.15.27:0/205764545 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff189a15700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff184158880 0x7ff18414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 -- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1840c5f30 msgr2=0x7ff184164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1840c5f30 0x7ff184164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 -- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff184158880 msgr2=0x7ff18414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff184158880 0x7ff18414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 -- 172.21.15.27:0/205764545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009a20 con 0x7ff1841541c0 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff188a13700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 0x7ff1841670b0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7ff17800c850 tx=0x7ff178008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.413 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178010580 con 0x7ff1841541c0 2023-05-17T15:29:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780106e0 con 0x7ff1841541c0 2023-05-17T15:29:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18414f610 con 0x7ff1841541c0 2023-05-17T15:29:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178010a60 con 0x7ff1841541c0 2023-05-17T15:29:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.405+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff184164920 con 0x7ff1841541c0 2023-05-17T15:29:51.414 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.406+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18405f4a0 con 0x7ff1841541c0 2023-05-17T15:29:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.407+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff17801b460 con 0x7ff1841541c0 2023-05-17T15:29:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.407+0000 7ff1817fa700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff17005ed60 0x7ff170061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.407+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7ff178079a00 con 0x7ff1841541c0 2023-05-17T15:29:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.407+0000 7ff189214700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff17005ed60 0x7ff170061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.415 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.407+0000 7ff189214700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff17005ed60 0x7ff170061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff17c009f90 tx=0x7ff17c009780).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.416 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.411+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff17804b0a0 con 0x7ff1841541c0 2023-05-17T15:29:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.580+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff18414d200 con 0x7ff17005ed60 2023-05-17T15:29:51.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.583+0000 7ff1817fa700 1 -- 172.21.15.27:0/205764545 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71194 (secure 0 0 0) 0x7ff18414d200 con 0x7ff17005ed60 2023-05-17T15:29:51.587 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff17005ed60 msgr2=0x7ff170061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff17005ed60 0x7ff170061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff17c009f90 tx=0x7ff17c009780).stop 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 msgr2=0x7ff1841670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 0x7ff1841670b0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7ff17800c850 tx=0x7ff178008040).stop 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 shutdown_connections 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff17005ed60 0x7ff170061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff184158880 0x7ff18414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1840c5f30 0x7ff184164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 --2- 172.21.15.27:0/205764545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff1841541c0 0x7ff1841670b0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.584+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 >> 172.21.15.27:0/205764545 conn(0x7ff184069e70 msgr2=0x7ff1840ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.585+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 shutdown_connections 2023-05-17T15:29:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.585+0000 7ff18b478700 1 -- 172.21.15.27:0/205764545 wait complete. 2023-05-17T15:29:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:51.600 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-05-17T15:29:50.811752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":183156,"kb_used_data":17652,"kb_used_omap":0,"kb_used_meta":165440,"kb_avail":754791564,"statfs":{"total":773094113280,"available":772906561536,"internally_reserved":0,"allocated":18075648,"data_stored":9216099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":169410560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11962,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.628758"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.847510+0000","last_change":"2023-05-17T14:53:48.215051+0000","last_active":"2023-05-17T15:29:43.847510+0000","last_peered":"2023-05-17T15:29:43.847510+0000","last_clean":"2023-05-17T15:29:43.847510+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:43.847510+0000","last_undegraded":"2023-05-17T15:29:43.847510+0000","last_fullsized":"2023-05-17T15:29:43.847510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.804851+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:43.804851+0000","last_peered":"2023-05-17T15:29:43.804851+0000","last_clean":"2023-05-17T15:29:43.804851+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:43.804851+0000","last_undegraded":"2023-05-17T15:29:43.804851+0000","last_fullsized":"2023-05-17T15:29:43.804851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.446698+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:46.446698+0000","last_peered":"2023-05-17T15:29:46.446698+0000","last_clean":"2023-05-17T15:29:46.446698+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:46.446698+0000","last_undegraded":"2023-05-17T15:29:46.446698+0000","last_fullsized":"2023-05-17T15:29:46.446698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.805067+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:43.805067+0000","last_peered":"2023-05-17T15:29:43.805067+0000","last_clean":"2023-05-17T15:29:43.805067+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:43.805067+0000","last_undegraded":"2023-05-17T15:29:43.805067+0000","last_fullsized":"2023-05-17T15:29:43.805067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444262+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:36.444262+0000","last_peered":"2023-05-17T15:29:36.444262+0000","last_clean":"2023-05-17T15:29:36.444262+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:36.444262+0000","last_undegraded":"2023-05-17T15:29:36.444262+0000","last_fullsized":"2023-05-17T15:29:36.444262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444314+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:36.444314+0000","last_peered":"2023-05-17T15:29:36.444314+0000","last_clean":"2023-05-17T15:29:36.444314+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:36.444314+0000","last_undegraded":"2023-05-17T15:29:36.444314+0000","last_fullsized":"2023-05-17T15:29:36.444314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-17T15:29:36.444629+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:36.444629+0000","last_peered":"2023-05-17T15:29:36.444629+0000","last_clean":"2023-05-17T15:29:36.444629+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:36.444629+0000","last_undegraded":"2023-05-17T15:29:36.444629+0000","last_fullsized":"2023-05-17T15:29:36.444629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.847719+0000","last_change":"2023-05-17T14:53:47.623435+0000","last_active":"2023-05-17T15:29:43.847719+0000","last_peered":"2023-05-17T15:29:43.847719+0000","last_clean":"2023-05-17T15:29:43.847719+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:43.847719+0000","last_undegraded":"2023-05-17T15:29:43.847719+0000","last_fullsized":"2023-05-17T15:29:43.847719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-05-17T15:29:43.803505+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:43.803505+0000","last_peered":"2023-05-17T15:29:43.803505+0000","last_clean":"2023-05-17T15:29:43.803505+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:43.803505+0000","last_undegraded":"2023-05-17T15:29:43.803505+0000","last_fullsized":"2023-05-17T15:29:43.803505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21232,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94350608,"statfs":{"total":96636764160,"available":96615022592,"internally_reserved":0,"allocated":2269184,"data_stored":1158344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.372},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.42699999999999999}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20828,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351012,"statfs":{"total":96636764160,"available":96615436288,"internally_reserved":0,"allocated":2248704,"data_stored":1147422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20256,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":18048,"kb_avail":94351584,"statfs":{"total":96636764160,"available":96616022016,"internally_reserved":0,"allocated":2252800,"data_stored":1147945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18481152},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.438},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834575272,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20844,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94350996,"statfs":{"total":96636764160,"available":96615419904,"internally_reserved":0,"allocated":2265088,"data_stored":1148812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.878}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.72599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.51300000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45600000000000002,"5min":1.254,"15min":1.254},"last":0.378},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.443}]},{"osd":3,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.63400000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":1.04,"15min":1.04},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.96599999999999997,"15min":1.006},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84799999999999998,"5min":1.0700000000000001,"15min":1.0760000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":1.018,"15min":1.018},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.21,"15min":1.21},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28832,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":26624,"kb_avail":94343008,"statfs":{"total":96636764160,"available":96607240192,"internally_reserved":0,"allocated":2252800,"data_stored":1147456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27262976},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.47999999999999998,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.59599999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.51300000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.499},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.434,"15min":0.442},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.72099999999999997,"15min":0.77500000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49399999999999999},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.30399999999999999},"max":{"1min":0.57499999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":1.3799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.91200000000000003,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":0.84599999999999997,"5min":0.96599999999999997,"15min":1.036},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.90700000000000003,"5min":1.022,"15min":1.0820000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81299999999999994,"5min":0.96999999999999997,"15min":1.079},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 17 15:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":0.79800000000000004,"5min":0.98499999999999999,"15min":1.036},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.441},"max":{"1min":0.879,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575271,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20896,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350944,"statfs":{"total":96636764160,"available":96615366656,"internally_reserved":0,"allocated":2252800,"data_stored":1147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.91200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.66000000000000003}]},{"osd":1,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.98499999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81399999999999995,"15min":0.96299999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.38,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.90700000000000003,"15min":0.97699999999999998},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.92400000000000004,"15min":0.98499999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":1.004},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.32500000000000001},"max":{"1min":0.73699999999999999,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.373},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.27400000000000002}]},{"osd":6,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.33100000000000002}]},{"osd":7,"last update":"Wed May 17 15:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.82299999999999995,"5min":1.01,"15min":1.01},"last":0.34399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575271,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":26048,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":2256896,"data_stored":1157045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26673152},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.434}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.317},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.375}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:51.602 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T15:29:51.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.713+0000 7fc5ca709700 1 Processor -- start 2023-05-17T15:29:51.717 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.713+0000 7fc5ca709700 1 -- start start 2023-05-17T15:29:51.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5ca709700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5c40c1860 0x7fc5c415f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5ca709700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40aa680 con 0x7fc5c40c64a0 2023-05-17T15:29:51.718 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5ca709700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c405e7e0 con 0x7fc5c40c60c0 2023-05-17T15:29:51.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5ca709700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40c68e0 con 0x7fc5c40c1860 2023-05-17T15:29:51.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5c8ca6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5c40c1860 0x7fc5c415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5c37fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc5c40c64a0 0x7fc5c4153d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47142/0 (socket says 172.21.15.27:47142) 2023-05-17T15:29:51.719 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.714+0000 7fc5c37fe700 1 -- 172.21.15.27:0/4152186785 learned_addr learned my addr 172.21.15.27:0/4152186785 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:51.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c8ca6700 1 -- 172.21.15.27:0/4152186785 >> v1:172.21.15.40:6789/0 conn(0x7fc5c40c60c0 legacy=0x7fc5c40a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:51.720 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c8ca6700 1 -- 172.21.15.27:0/4152186785 >> v1:172.21.15.27:6789/0 conn(0x7fc5c40c64a0 legacy=0x7fc5c4153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c2ffd700 1 -- 172.21.15.27:0/4152186785 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124142163 0 0) 0x7fc5c40aa680 con 0x7fc5c40c64a0 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c8ca6700 1 -- 172.21.15.27:0/4152186785 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c405eac0 con 0x7fc5c40c1860 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c8ca6700 1 --2- 172.21.15.27:0/4152186785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c1860 0x7fc5c415f200 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fc5bc009e60 tx=0x7fc5bc009780).ready entity=mon.0 client_cookie=e16c8f3d36b157ff server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c2ffd700 1 -- 172.21.15.27:0/4152186785 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00e070 con 0x7fc5c40c1860 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c2ffd700 1 -- 172.21.15.27:0/4152186785 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00bbf0 con 0x7fc5c40c1860 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5c2ffd700 1 -- 172.21.15.27:0/4152186785 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc012410 con 0x7fc5c40c1860 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5ca709700 1 -- 172.21.15.27:0/4152186785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c1860 msgr2=0x7fc5c415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.721 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5ca709700 1 --2- 172.21.15.27:0/4152186785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c1860 0x7fc5c415f200 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fc5bc009e60 tx=0x7fc5bc009780).stop 2023-05-17T15:29:51.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5ca709700 1 -- 172.21.15.27:0/4152186785 shutdown_connections 2023-05-17T15:29:51.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5ca709700 1 --2- 172.21.15.27:0/4152186785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c1860 0x7fc5c415f200 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.715+0000 7fc5ca709700 1 -- 172.21.15.27:0/4152186785 >> 172.21.15.27:0/4152186785 conn(0x7fc5c4069e70 msgr2=0x7fc5c405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:51.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.716+0000 7fc5ca709700 1 -- 172.21.15.27:0/4152186785 shutdown_connections 2023-05-17T15:29:51.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.716+0000 7fc5ca709700 1 -- 172.21.15.27:0/4152186785 wait complete. 2023-05-17T15:29:51.722 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.717+0000 7fc5ca709700 1 Processor -- start 2023-05-17T15:29:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.717+0000 7fc5ca709700 1 -- start start 2023-05-17T15:29:51.724 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.717+0000 7fc5ca709700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c40c1860 0x7fc5c414c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.717+0000 7fc5ca709700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 0x7fc5c4154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5ca709700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c40c64a0 0x7fc5c41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5ca709700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c1e10 con 0x7fc5c40c60c0 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5ca709700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c2060 con 0x7fc5c40c1860 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5ca709700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c2340 con 0x7fc5c40c64a0 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 0x7fc5c4154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.725 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 0x7fc5c4154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47586/0 (socket says 172.21.15.27:47586) 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 -- 172.21.15.27:0/2635108886 learned_addr learned my addr 172.21.15.27:0/2635108886 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c3fff700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c40c1860 0x7fc5c414c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c8ca6700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c40c64a0 0x7fc5c41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 -- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c40c64a0 msgr2=0x7fc5c41525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c40c64a0 0x7fc5c41525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 -- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c40c1860 msgr2=0x7fc5c414c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.726 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c40c1860 0x7fc5c414c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 -- 172.21.15.27:0/2635108886 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009a20 con 0x7fc5c40c60c0 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c8ca6700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c40c64a0 0x7fc5c41525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5c37fe700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 0x7fc5c4154550 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fc5b8001eb0 tx=0x7fc5b8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800ce90 con 0x7fc5c40c60c0 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b80072e0 con 0x7fc5c40c60c0 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8007680 con 0x7fc5c40c60c0 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40c2620 con 0x7fc5c40c60c0 2023-05-17T15:29:51.727 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.718+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c40c2be0 con 0x7fc5c40c60c0 2023-05-17T15:29:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.719+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c405f4a0 con 0x7fc5c40c60c0 2023-05-17T15:29:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.720+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc5b8010070 con 0x7fc5c40c60c0 2023-05-17T15:29:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.720+0000 7fc5abfff700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc5b005ed90 0x7fc5b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.720+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fc5b8078fe0 con 0x7fc5c40c60c0 2023-05-17T15:29:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.720+0000 7fc5c3fff700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc5b005ed90 0x7fc5b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:51.728 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.720+0000 7fc5c3fff700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc5b005ed90 0x7fc5b0061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc5b40038b0 tx=0x7fc5b4007d20).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:51.729 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.724+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5b804a730 con 0x7fc5c40c60c0 2023-05-17T15:29:51.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.898+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5c406bdf0 con 0x7fc5c40c60c0 2023-05-17T15:29:51.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.899+0000 7fc5abfff700 1 -- 172.21.15.27:0/2635108886 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+14611 (secure 0 0 0) 0x7fc5b804dd50 con 0x7fc5c40c60c0 2023-05-17T15:29:51.903 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:51.903 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":182,"fsid":"0a45f698-dd9a-4c4e-b210-088283caeba3","created":"2023-05-17T14:53:34.698410+0000","modified":"2023-05-17T15:29:47.444327+0000","last_up_change":"2023-05-17T14:53:43.580362+0000","last_in_change":"2023-05-17T14:53:37.159842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-17T14:53:43.630293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T14:53:45.925243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a73ff312-9ee8-41f2-91d5-a05aaa14077c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":86564},{"type":"v1","addr":"172.21.15.27:6817","nonce":86564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":86564},{"type":"v1","addr":"172.21.15.27:6819","nonce":86564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":86564},{"type":"v1","addr":"172.21.15.27:6823","nonce":86564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":86564},{"type":"v1","addr":"172.21.15.27:6821","nonce":86564}]},"public_addr":"172.21.15.27:6817/86564","cluster_addr":"172.21.15.27:6819/86564","heartbeat_back_addr":"172.21.15.27:6823/86564","heartbeat_front_addr":"172.21.15.27:6821/86564","state":["exists","up"]},{"osd":1,"uuid":"b7108df1-1da0-4140-a5e0-310084574d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":86561},{"type":"v1","addr":"172.21.15.27:6809","nonce":86561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":86561},{"type":"v1","addr":"172.21.15.27:6811","nonce":86561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":86561},{"type":"v1","addr":"172.21.15.27:6815","nonce":86561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":86561},{"type":"v1","addr":"172.21.15.27:6813","nonce":86561}]},"public_addr":"172.21.15.27:6809/86561","cluster_addr":"172.21.15.27:6811/86561","heartbeat_back_addr":"172.21.15.27:6815/86561","heartbeat_front_addr":"172.21.15.27:6813/86561","state":["exists","up"]},{"osd":2,"uuid":"c8205f3c-f822-4e55-ad59-48c45ab8b4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":86562},{"type":"v1","addr":"172.21.15.27:6801","nonce":86562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":86562},{"type":"v1","addr":"172.21.15.27:6803","nonce":86562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":86562},{"type":"v1","addr":"172.21.15.27:6807","nonce":86562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":86562},{"type":"v1","addr":"172.21.15.27:6805","nonce":86562}]},"public_addr":"172.21.15.27:6801/86562","cluster_addr":"172.21.15.27:6803/86562","heartbeat_back_addr":"172.21.15.27:6807/86562","heartbeat_front_addr":"172.21.15.27:6805/86562","state":["exists","up"]},{"osd":3,"uuid":"15915cf4-29a7-4ead-9cda-27c32f712e8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":86590},{"type":"v1","addr":"172.21.15.27:6825","nonce":86590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":86590},{"type":"v1","addr":"172.21.15.27:6827","nonce":86590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":86590},{"type":"v1","addr":"172.21.15.27:6831","nonce":86590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":86590},{"type":"v1","addr":"172.21.15.27:6829","nonce":86590}]},"public_addr":"172.21.15.27:6825/86590","cluster_addr":"172.21.15.27:6827/86590","heartbeat_back_addr":"172.21.15.27:6831/86590","heartbeat_front_addr":"172.21.15.27:6829/86590","state":["exists","up"]},{"osd":4,"uuid":"e1a17304-7ade-4f10-a09b-b13d0f180398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":116762},{"type":"v1","addr":"172.21.15.40:6801","nonce":116762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":116762},{"type":"v1","addr":"172.21.15.40:6803","nonce":116762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":116762},{"type":"v1","addr":"172.21.15.40:6807","nonce":116762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":116762},{"type":"v1","addr":"172.21.15.40:6805","nonce":116762}]},"public_addr":"172.21.15.40:6801/116762","cluster_addr":"172.21.15.40:6803/116762","heartbeat_back_addr":"172.21.15.40:6807/116762","heartbeat_front_addr":"172.21.15.40:6805/116762","state":["exists","up"]},{"osd":5,"uuid":"0ab596f6-0383-48d5-a80a-a1bc8a2d1a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":116763},{"type":"v1","addr":"172.21.15.40:6809","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":116763},{"type":"v1","addr":"172.21.15.40:6811","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":116763},{"type":"v1","addr":"172.21.15.40:6815","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":116763},{"type":"v1","addr":"172.21.15.40:6813","nonce":116763}]},"public_addr":"172.21.15.40:6809/116763","cluster_addr":"172.21.15.40:6811/116763","heartbeat_back_addr":"172.21.15.40:6815/116763","heartbeat_front_addr":"172.21.15.40:6813/116763","state":["exists","up"]},{"osd":6,"uuid":"390d8e98-9315-42f1-9ab4-2cf8157d2b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":116764},{"type":"v1","addr":"172.21.15.40:6817","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":116764},{"type":"v1","addr":"172.21.15.40:6819","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":116764},{"type":"v1","addr":"172.21.15.40:6823","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":116764},{"type":"v1","addr":"172.21.15.40:6821","nonce":116764}]},"public_addr":"172.21.15.40:6817/116764","cluster_addr":"172.21.15.40:6819/116764","heartbeat_back_addr":"172.21.15.40:6823/116764","heartbeat_front_addr":"172.21.15.40:6821/116764","state":["exists","up"]},{"osd":7,"uuid":"5eabc50d-2b84-4513-add1-55bd86a3b98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":116807},{"type":"v1","addr":"172.21.15.40:6825","nonce":116807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":116807},{"type":"v1","addr":"172.21.15.40:6827","nonce":116807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":116807},{"type":"v1","addr":"172.21.15.40:6831","nonce":116807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":116807},{"type":"v1","addr":"172.21.15.40:6829","nonce":116807}]},"public_addr":"172.21.15.40:6825/116807","cluster_addr":"172.21.15.40:6827/116807","heartbeat_back_addr":"172.21.15.40:6831/116807","heartbeat_front_addr":"172.21.15.40:6829/116807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.272130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.311058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.253922+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.292112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.343271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.355383+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.389638+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T14:53:42.419787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2198942677":"2023-05-18T15:29:43.952612+0000","172.21.15.27:0/172742611":"2023-05-18T15:29:43.952612+0000","172.21.15.27:0/3823210708":"2023-05-18T15:29:43.952612+0000","172.21.15.27:0/1940509477":"2023-05-18T15:29:43.952612+0000","172.21.15.27:6835/3491718569":"2023-05-18T15:29:43.796857+0000","172.21.15.27:0/3890893237":"2023-05-18T15:29:43.952612+0000","172.21.15.27:6833/3491718569":"2023-05-18T15:29:43.796857+0000","172.21.15.27:0/2744476591":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6837/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:6836/122387":"2023-05-18T15:29:36.343483+0000","172.21.15.27:0/2976443407":"2023-05-18T15:29:36.343483+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":14,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc5b005ed90 msgr2=0x7fc5b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc5b005ed90 0x7fc5b0061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc5b40038b0 tx=0x7fc5b4007d20).stop 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 msgr2=0x7fc5c4154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 0x7fc5c4154550 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fc5b8001eb0 tx=0x7fc5b8007e90).stop 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 shutdown_connections 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc5b005ed90 0x7fc5b0061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.905 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c40c64a0 0x7fc5c41525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c40c1860 0x7fc5c414c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 --2- 172.21.15.27:0/2635108886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c40c60c0 0x7fc5c4154550 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:51.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 >> 172.21.15.27:0/2635108886 conn(0x7fc5c4069e70 msgr2=0x7fc5c414d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:51.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 shutdown_connections 2023-05-17T15:29:51.906 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:51.901+0000 7fc5ca709700 1 -- 172.21.15.27:0/2635108886 wait complete. 2023-05-17T15:29:52.917 INFO:tasks.ceph:Scrubbing osd.0 2023-05-17T15:29:52.918 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:53.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.047+0000 7fb789016700 1 Processor -- start 2023-05-17T15:29:53.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.047+0000 7fb789016700 1 -- start start 2023-05-17T15:29:53.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb789016700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784152070 0x7fb784154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb789016700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7840c0520 0x7fb784081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.053 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb789016700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb784158010 con 0x7fb784151c90 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb789016700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb784154f60 con 0x7fb7840c0520 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb789016700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb784155240 con 0x7fb784152070 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb782d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb784151c90 0x7fb7840c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47154/0 (socket says 172.21.15.27:47154) 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb782d9d700 1 -- 172.21.15.27:0/3320781711 learned_addr learned my addr 172.21.15.27:0/3320781711 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78259c700 1 --2- 172.21.15.27:0/3320781711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784152070 0x7fb784154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78359e700 1 --2- 172.21.15.27:0/3320781711 >> v2:172.21.15.40:3300/0 conn(0x7fb7840c0520 0x7fb784081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb781d9b700 1 -- 172.21.15.27:0/3320781711 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263316548 0 0) 0x7fb784158010 con 0x7fb784151c90 2023-05-17T15:29:53.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb781d9b700 1 -- 172.21.15.27:0/3320781711 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7700033f0 con 0x7fb784151c90 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78259c700 1 -- 172.21.15.27:0/3320781711 >> v2:172.21.15.40:3300/0 conn(0x7fb7840c0520 msgr2=0x7fb784081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78259c700 1 --2- 172.21.15.27:0/3320781711 >> v2:172.21.15.40:3300/0 conn(0x7fb7840c0520 0x7fb784081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78259c700 1 -- 172.21.15.27:0/3320781711 >> v1:172.21.15.27:6789/0 conn(0x7fb784151c90 legacy=0x7fb7840c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78259c700 1 -- 172.21.15.27:0/3320781711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784155520 con 0x7fb784152070 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78359e700 1 --2- 172.21.15.27:0/3320781711 >> v2:172.21.15.40:3300/0 conn(0x7fb7840c0520 0x7fb784081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.048+0000 7fb78259c700 1 --2- 172.21.15.27:0/3320781711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784152070 0x7fb784154980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb76c009760 tx=0x7fb76c009060).ready entity=mon.2 client_cookie=27194924bdbd7d74 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb781d9b700 1 -- 172.21.15.27:0/3320781711 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00d4a0 con 0x7fb784152070 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb781d9b700 1 -- 172.21.15.27:0/3320781711 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00d600 con 0x7fb784152070 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb781d9b700 1 -- 172.21.15.27:0/3320781711 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00d980 con 0x7fb784152070 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 -- 172.21.15.27:0/3320781711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784152070 msgr2=0x7fb784154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 --2- 172.21.15.27:0/3320781711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784152070 0x7fb784154980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb76c009760 tx=0x7fb76c009060).stop 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 -- 172.21.15.27:0/3320781711 shutdown_connections 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 --2- 172.21.15.27:0/3320781711 >> v2:172.21.15.40:3300/0 conn(0x7fb7840c0520 0x7fb784081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 --2- 172.21.15.27:0/3320781711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784152070 0x7fb784154980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 -- 172.21.15.27:0/3320781711 >> 172.21.15.27:0/3320781711 conn(0x7fb7840cae10 msgr2=0x7fb7840cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 -- 172.21.15.27:0/3320781711 shutdown_connections 2023-05-17T15:29:53.057 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.049+0000 7fb789016700 1 -- 172.21.15.27:0/3320781711 wait complete. 2023-05-17T15:29:53.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.050+0000 7fb789016700 1 Processor -- start 2023-05-17T15:29:53.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.050+0000 7fb789016700 1 -- start start 2023-05-17T15:29:53.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb789016700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7840c0520 0x7fb7840c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.059 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb789016700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784151c90 0x7fb784150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb789016700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb784152070 0x7fb7840ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb789016700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840c3290 con 0x7fb784152070 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb789016700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840c26a0 con 0x7fb7840c0520 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb789016700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840c2960 con 0x7fb784151c90 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb78359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb784152070 0x7fb7840ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb78359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb784152070 0x7fb7840ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47602/0 (socket says 172.21.15.27:47602) 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb78359e700 1 -- 172.21.15.27:0/2412645262 learned_addr learned my addr 172.21.15.27:0/2412645262 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.060 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb78259c700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784151c90 0x7fb784150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.051+0000 7fb782d9d700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7840c0520 0x7fb7840c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb78359e700 1 -- 172.21.15.27:0/2412645262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784151c90 msgr2=0x7fb784150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb78359e700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb784151c90 0x7fb784150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb78359e700 1 -- 172.21.15.27:0/2412645262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7840c0520 msgr2=0x7fb7840c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb78359e700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7840c0520 0x7fb7840c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb78359e700 1 -- 172.21.15.27:0/2412645262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740092a0 con 0x7fb784152070 2023-05-17T15:29:53.061 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb78359e700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb784152070 0x7fb7840ac110 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7fb77400e980 tx=0x7fb774009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740095a0 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400c610 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c0092a0 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400c9b0 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.052+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7840c2f20 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.053+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb78406bdf0 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.053+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb774022070 con 0x7fb784152070 2023-05-17T15:29:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb77affd700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb76405ed90 0x7fb764061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fb774079ec0 con 0x7fb784152070 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb782d9d700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb76405ed90 0x7fb764061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb77affd700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7fb764065780 0x7fb764067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 --> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7640682a0 con 0x7fb764065780 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb77407c420 con 0x7fb784152070 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb78259c700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7fb764065780 0x7fb764067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb782d9d700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb76405ed90 0x7fb764061250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb77c005ad0 tx=0x7fb77c009040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.054+0000 7fb78259c700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7fb764065780 0x7fb764067c20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.064 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.055+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== osd.0 v2:172.21.15.27:6816/86564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fb7640682a0 con 0x7fb764065780 2023-05-17T15:29:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.068+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 --> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb784155800 con 0x7fb764065780 2023-05-17T15:29:53.072 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.068+0000 7fb77affd700 1 -- 172.21.15.27:0/2412645262 <== osd.0 v2:172.21.15.27:6816/86564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb784155800 con 0x7fb764065780 2023-05-17T15:29:53.073 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:53.073 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:53.073 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7fb764065780 msgr2=0x7fb764067c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6816/86564,v1:172.21.15.27:6817/86564] conn(0x7fb764065780 0x7fb764067c20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb76405ed90 msgr2=0x7fb764061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb76405ed90 0x7fb764061250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb77c005ad0 tx=0x7fb77c009040).stop 2023-05-17T15:29:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb784152070 msgr2=0x7fb7840ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 --2- 172.21.15.27:0/2412645262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb784152070 0x7fb7840ac110 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7fb77400e980 tx=0x7fb774009060).stop 2023-05-17T15:29:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb78359e700 1 -- 172.21.15.27:0/2412645262 reap_dead start 2023-05-17T15:29:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 shutdown_connections 2023-05-17T15:29:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 >> 172.21.15.27:0/2412645262 conn(0x7fb7840cae10 msgr2=0x7fb784157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 shutdown_connections 2023-05-17T15:29:53.075 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.069+0000 7fb789016700 1 -- 172.21.15.27:0/2412645262 wait complete. 2023-05-17T15:29:53.084 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-05-17T15:29:53.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.197+0000 7f2a7bd0e700 1 Processor -- start 2023-05-17T15:29:53.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.197+0000 7f2a7bd0e700 1 -- start start 2023-05-17T15:29:53.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7bd0e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a740cb920 0x7f2a740c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7bd0e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a740c61a0 0x7f2a740c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7bd0e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a740c01c0 con 0x7f2a74153f10 2023-05-17T15:29:53.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7bd0e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a740c6630 con 0x7f2a740c61a0 2023-05-17T15:29:53.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7bd0e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a740698b0 con 0x7f2a740cb920 2023-05-17T15:29:53.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7a2ab700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a740c61a0 0x7f2a740c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7a2ab700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a740c61a0 0x7f2a740c0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47612/0 (socket says 172.21.15.27:47612) 2023-05-17T15:29:53.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/3158902457 learned_addr learned my addr 172.21.15.27:0/3158902457 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.203 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.198+0000 7f2a792a9700 1 --2- 172.21.15.27:0/3158902457 >> v2:172.21.15.40:3300/0 conn(0x7f2a740cb920 0x7f2a740c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.204 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/3158902457 >> v2:172.21.15.40:3300/0 conn(0x7f2a740cb920 msgr2=0x7f2a740c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7a2ab700 1 --2- 172.21.15.27:0/3158902457 >> v2:172.21.15.40:3300/0 conn(0x7f2a740cb920 0x7f2a740c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/3158902457 >> v1:172.21.15.40:6789/0 conn(0x7f2a74153f10 legacy=0x7f2a74069060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/3158902457 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74069b90 con 0x7f2a740c61a0 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7a2ab700 1 --2- 172.21.15.27:0/3158902457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a740c61a0 0x7f2a740c0650 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f2a74084280 tx=0x7f2a64009840).ready entity=mon.0 client_cookie=766e19c393043ebc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a78aa8700 1 -- 172.21.15.27:0/3158902457 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400e070 con 0x7f2a740c61a0 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a78aa8700 1 -- 172.21.15.27:0/3158902457 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6400ba20 con 0x7f2a740c61a0 2023-05-17T15:29:53.205 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a78aa8700 1 -- 172.21.15.27:0/3158902457 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400bda0 con 0x7f2a740c61a0 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/3158902457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a740c61a0 msgr2=0x7f2a740c0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/3158902457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a740c61a0 0x7f2a740c0650 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f2a74084280 tx=0x7f2a64009840).stop 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/3158902457 shutdown_connections 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/3158902457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a740c61a0 0x7f2a740c0650 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/3158902457 >> v2:172.21.15.40:3300/0 conn(0x7f2a740cb920 0x7f2a740c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.199+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/3158902457 >> 172.21.15.27:0/3158902457 conn(0x7f2a7405e820 msgr2=0x7f2a740cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.206 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.200+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/3158902457 shutdown_connections 2023-05-17T15:29:53.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.200+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/3158902457 wait complete. 2023-05-17T15:29:53.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 Processor -- start 2023-05-17T15:29:53.207 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 -- start start 2023-05-17T15:29:53.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a740c61a0 0x7f2a740b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a740cb920 0x7f2a7414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 0x7f2a74151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74168860 con 0x7f2a74153f10 2023-05-17T15:29:53.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74167c50 con 0x7f2a740c61a0 2023-05-17T15:29:53.209 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7bd0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74167f30 con 0x7f2a740cb920 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.201+0000 7f2a7a2ab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 0x7f2a74151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 0x7f2a74151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47618/0 (socket says 172.21.15.27:47618) 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/1009504716 learned_addr learned my addr 172.21.15.27:0/1009504716 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a79aaa700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a740c61a0 0x7f2a740b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a792a9700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a740cb920 0x7f2a7414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a740cb920 msgr2=0x7f2a7414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a740cb920 0x7f2a7414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a740c61a0 msgr2=0x7f2a740b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a740c61a0 0x7f2a740b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 -- 172.21.15.27:0/1009504716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64009ae0 con 0x7f2a74153f10 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7a2ab700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 0x7f2a74151550 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f2a740c8900 tx=0x7f2a740c0130).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640092e0 con 0x7f2a74153f10 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6401e470 con 0x7f2a74153f10 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6401e830 con 0x7f2a74153f10 2023-05-17T15:29:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a74168210 con 0x7f2a74153f10 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.202+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a740b0c20 con 0x7f2a74153f10 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.203+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a741689d0 con 0x7f2a74153f10 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.204+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2a64025030 con 0x7f2a74153f10 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.204+0000 7f2a71ffb700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a6005ed90 0x7f2a60061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.204+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f2a6407b020 con 0x7f2a74153f10 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.204+0000 7f2a79aaa700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a6005ed90 0x7f2a60061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.212 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.204+0000 7f2a79aaa700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a6005ed90 0x7f2a60061250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2a6c003860 tx=0x7f2a6c007d40).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.213 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.208+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a6404c770 con 0x7f2a74153f10 2023-05-17T15:29:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.380+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a740bfe50 con 0x7f2a6005ed90 2023-05-17T15:29:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.380+0000 7f2a71ffb700 1 -- 172.21.15.27:0/1009504716 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a740bfe50 con 0x7f2a6005ed90 2023-05-17T15:29:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a6005ed90 msgr2=0x7f2a60061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a6005ed90 0x7f2a60061250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2a6c003860 tx=0x7f2a6c007d40).stop 2023-05-17T15:29:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 msgr2=0x7f2a74151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 0x7f2a74151550 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f2a740c8900 tx=0x7f2a740c0130).stop 2023-05-17T15:29:53.386 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 shutdown_connections 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2a6005ed90 0x7f2a60061250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a74153f10 0x7f2a74151550 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a740c61a0 0x7f2a740b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 --2- 172.21.15.27:0/1009504716 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a740cb920 0x7f2a7414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 >> 172.21.15.27:0/1009504716 conn(0x7f2a7405e820 msgr2=0x7f2a740abda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 shutdown_connections 2023-05-17T15:29:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.382+0000 7f2a7bd0e700 1 -- 172.21.15.27:0/1009504716 wait complete. 2023-05-17T15:29:53.388 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 0 to deep-scrub 2023-05-17T15:29:53.397 INFO:tasks.ceph:Scrubbing osd.1 2023-05-17T15:29:53.398 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:53.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.514+0000 7f141b59e700 1 Processor -- start 2023-05-17T15:29:53.518 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.514+0000 7f141b59e700 1 -- start start 2023-05-17T15:29:53.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f141c14bee0 0x7f141c0bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.519 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141b59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f141c14c2c0 0x7f141c063c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141b59e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c0bef70 con 0x7f141c0bddf0 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141b59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0c3b90 con 0x7f141c14c2c0 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0be360 con 0x7f141c14bee0 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f1419d9b700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f141c0bddf0 0x7f141c152b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47186/0 (socket says 172.21.15.27:47186) 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f1419d9b700 1 -- 172.21.15.27:0/1591215296 learned_addr learned my addr 172.21.15.27:0/1591215296 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141a59c700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f141c14bee0 0x7f141c0bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.520 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.515+0000 7f141ad9d700 1 --2- 172.21.15.27:0/1591215296 >> v2:172.21.15.40:3300/0 conn(0x7f141c14c2c0 0x7f141c063c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827428548 0 0) 0x7f141c0bef70 con 0x7f141c0bddf0 2023-05-17T15:29:53.521 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14040033f0 con 0x7f141c0bddf0 2023-05-17T15:29:53.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743683241 0 0) 0x7f14040033f0 con 0x7f141c0bddf0 2023-05-17T15:29:53.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f141c14bee0 msgr2=0x7f141c0bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f141c14bee0 0x7f141c0bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.524 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 >> v2:172.21.15.40:3300/0 conn(0x7f141c14c2c0 msgr2=0x7f141c063c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 --2- 172.21.15.27:0/1591215296 >> v2:172.21.15.40:3300/0 conn(0x7f141c14c2c0 0x7f141c063c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0be640 con 0x7f141c0bddf0 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f1410001470 con 0x7f141c0bddf0 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 >> v1:172.21.15.27:6789/0 conn(0x7f141c0bddf0 legacy=0x7f141c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14040038e0 0x7f1404003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1404004690 0x7f1404004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1404005000 0x7f140400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.525 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0c3b90 con 0x7f14040038e0 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0be360 con 0x7f1404004690 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140400bdd0 con 0x7f1404005000 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141ad9d700 1 --2- 172.21.15.27:0/1591215296 >> v2:172.21.15.40:3300/0 conn(0x7f141c14c2c0 0x7f141c063c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141a59c700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f141c14bee0 0x7f141c0bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141a59c700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14040038e0 0x7f1404003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f1419d9b700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1404004690 0x7f1404004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.526 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141ad9d700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1404005000 0x7f140400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141a59c700 1 -- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1404005000 msgr2=0x7f140400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.516+0000 7f141a59c700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1404005000 0x7f140400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141a59c700 1 -- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1404004690 msgr2=0x7f1404004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141a59c700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1404004690 0x7f1404004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141a59c700 1 -- 172.21.15.27:0/1591215296 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040033f0 con 0x7f14040038e0 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141ad9d700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1404005000 0x7f140400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:53.527 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141a59c700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14040038e0 0x7f1404003d00 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f1414009ad0 tx=0x7f1414009060).ready entity=mon.0 client_cookie=bfdb8d17ceace2ed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140094d0 con 0x7f14040038e0 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141400e640 con 0x7f14040038e0 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141959a700 1 -- 172.21.15.27:0/1591215296 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400ea00 con 0x7f14040038e0 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141b59e700 1 -- 172.21.15.27:0/1591215296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14040038e0 msgr2=0x7f1404003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141b59e700 1 --2- 172.21.15.27:0/1591215296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14040038e0 0x7f1404003d00 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f1414009ad0 tx=0x7f1414009060).stop 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141ad9d700 1 -- 172.21.15.27:0/1591215296 reap_dead start 2023-05-17T15:29:53.528 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141b59e700 1 -- 172.21.15.27:0/1591215296 shutdown_connections 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141b59e700 1 -- 172.21.15.27:0/1591215296 >> 172.21.15.27:0/1591215296 conn(0x7f141c0c8870 msgr2=0x7f141c0c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141b59e700 1 -- 172.21.15.27:0/1591215296 shutdown_connections 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.517+0000 7f141b59e700 1 -- 172.21.15.27:0/1591215296 wait complete. 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.518+0000 7f141b59e700 1 Processor -- start 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 -- start start 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f14040038e0 0x7f141c165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f141c157c30 0x7f141c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.529 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f141c0a9850 0x7f141c0a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c163150 con 0x7f141c0a9850 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c1585a0 con 0x7f141c157c30 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0aa1c0 con 0x7f14040038e0 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f141c0a9850 0x7f141c0a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f141c0a9850 0x7f141c0a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47638/0 (socket says 172.21.15.27:47638) 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.519+0000 7f141ad9d700 1 -- 172.21.15.27:0/3821673527 learned_addr learned my addr 172.21.15.27:0/3821673527 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.530 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141a59c700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f14040038e0 0x7f141c165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141ad9d700 1 -- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f14040038e0 msgr2=0x7f141c165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141ad9d700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f14040038e0 0x7f141c165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f1419d9b700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f141c157c30 0x7f141c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141ad9d700 1 -- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f141c157c30 msgr2=0x7f141c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141ad9d700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f141c157c30 0x7f141c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141ad9d700 1 -- 172.21.15.27:0/3821673527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c162580 con 0x7f141c0a9850 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141a59c700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f14040038e0 0x7f141c165100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:53.531 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f1419d9b700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f141c157c30 0x7f141c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141ad9d700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f141c0a9850 0x7f141c0a9cd0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f141c063470 tx=0x7f140c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e070 con 0x7f141c0a9850 2023-05-17T15:29:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c011de0 con 0x7f141c0a9850 2023-05-17T15:29:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c162820 con 0x7f141c0a9850 2023-05-17T15:29:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c016660 con 0x7f141c0a9850 2023-05-17T15:29:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.520+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c162de0 con 0x7f141c0a9850 2023-05-17T15:29:53.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.521+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f141c154f00 con 0x7f141c0a9850 2023-05-17T15:29:53.533 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.521+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f140c027070 con 0x7f141c0a9850 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f140a7fc700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13fc05ed90 0x7f13fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f140c07ab90 con 0x7f141c0a9850 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f141a59c700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13fc05ed90 0x7f13fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f140a7fc700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7f13fc065800 0x7f13fc067ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 --> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13fc068320 con 0x7f13fc065800 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7f140c07aec0 con 0x7f141c0a9850 2023-05-17T15:29:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f1419d9b700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7f13fc065800 0x7f13fc067ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f141a59c700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13fc05ed90 0x7f13fc061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1414006a10 tx=0x7f1414019000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.522+0000 7f1419d9b700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7f13fc065800 0x7f13fc067ca0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.523+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== osd.1 v2:172.21.15.27:6808/86561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f13fc068320 con 0x7f13fc065800 2023-05-17T15:29:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.536+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 --> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f141c163300 con 0x7f13fc065800 2023-05-17T15:29:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.536+0000 7f140a7fc700 1 -- 172.21.15.27:0/3821673527 <== osd.1 v2:172.21.15.27:6808/86561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f141c163300 con 0x7f13fc065800 2023-05-17T15:29:53.541 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:53.541 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:53.541 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7f13fc065800 msgr2=0x7f13fc067ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6808/86561,v1:172.21.15.27:6809/86561] conn(0x7f13fc065800 0x7f13fc067ca0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13fc05ed90 msgr2=0x7f13fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f13fc05ed90 0x7f13fc061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1414006a10 tx=0x7f1414019000).stop 2023-05-17T15:29:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f141c0a9850 msgr2=0x7f141c0a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 --2- 172.21.15.27:0/3821673527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f141c0a9850 0x7f141c0a9cd0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f141c063470 tx=0x7f140c00b040).stop 2023-05-17T15:29:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141ad9d700 1 -- 172.21.15.27:0/3821673527 reap_dead start 2023-05-17T15:29:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 shutdown_connections 2023-05-17T15:29:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 >> 172.21.15.27:0/3821673527 conn(0x7f141c0c8870 msgr2=0x7f141c1509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 shutdown_connections 2023-05-17T15:29:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.537+0000 7f141b59e700 1 -- 172.21.15.27:0/3821673527 wait complete. 2023-05-17T15:29:53.552 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-05-17T15:29:53.669 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.665+0000 7feb872ea700 1 Processor -- start 2023-05-17T15:29:53.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.666+0000 7feb872ea700 1 -- start start 2023-05-17T15:29:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.666+0000 7feb872ea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb80153f00 0x7feb801542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.666+0000 7feb872ea700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb800958a0 0x7feb80069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.666+0000 7feb872ea700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb800bf020 con 0x7feb800bdd10 2023-05-17T15:29:53.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.666+0000 7feb872ea700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb80069cf0 con 0x7feb800958a0 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.666+0000 7feb872ea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800be190 con 0x7feb80153f00 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb800958a0 0x7feb80069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb800958a0 0x7feb80069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47646/0 (socket says 172.21.15.27:47646) 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 -- 172.21.15.27:0/1545748018 learned_addr learned my addr 172.21.15.27:0/1545748018 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85086700 1 --2- 172.21.15.27:0/1545748018 >> v2:172.21.15.40:3300/0 conn(0x7feb80153f00 0x7feb801542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 -- 172.21.15.27:0/1545748018 >> v2:172.21.15.40:3300/0 conn(0x7feb80153f00 msgr2=0x7feb801542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 --2- 172.21.15.27:0/1545748018 >> v2:172.21.15.40:3300/0 conn(0x7feb80153f00 0x7feb801542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 -- 172.21.15.27:0/1545748018 >> v1:172.21.15.40:6789/0 conn(0x7feb800bdd10 legacy=0x7feb80095190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 -- 172.21.15.27:0/1545748018 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800be410 con 0x7feb800958a0 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85086700 1 --2- 172.21.15.27:0/1545748018 >> v2:172.21.15.40:3300/0 conn(0x7feb80153f00 0x7feb801542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb85887700 1 --2- 172.21.15.27:0/1545748018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb800958a0 0x7feb80069800 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7feb800c6570 tx=0x7feb700090f0).ready entity=mon.0 client_cookie=bedf581876a6d18f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb7ffff700 1 -- 172.21.15.27:0/1545748018 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000b600 con 0x7feb800958a0 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb7ffff700 1 -- 172.21.15.27:0/1545748018 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000b760 con 0x7feb800958a0 2023-05-17T15:29:53.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.667+0000 7feb7ffff700 1 -- 172.21.15.27:0/1545748018 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000bae0 con 0x7feb800958a0 2023-05-17T15:29:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 -- 172.21.15.27:0/1545748018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb800958a0 msgr2=0x7feb80069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 --2- 172.21.15.27:0/1545748018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb800958a0 0x7feb80069800 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7feb800c6570 tx=0x7feb700090f0).stop 2023-05-17T15:29:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 -- 172.21.15.27:0/1545748018 shutdown_connections 2023-05-17T15:29:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 --2- 172.21.15.27:0/1545748018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb800958a0 0x7feb80069800 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 --2- 172.21.15.27:0/1545748018 >> v2:172.21.15.40:3300/0 conn(0x7feb80153f00 0x7feb801542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 -- 172.21.15.27:0/1545748018 >> 172.21.15.27:0/1545748018 conn(0x7feb800c8a00 msgr2=0x7feb800c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 -- 172.21.15.27:0/1545748018 shutdown_connections 2023-05-17T15:29:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.668+0000 7feb872ea700 1 -- 172.21.15.27:0/1545748018 wait complete. 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.669+0000 7feb872ea700 1 Processor -- start 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.669+0000 7feb872ea700 1 -- start start 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb872ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb800958a0 0x7feb800ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb872ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb800bdd10 0x7feb800ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb872ea700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 0x7feb80151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb872ea700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80167ba0 con 0x7feb80153f00 2023-05-17T15:29:53.677 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb872ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80167870 con 0x7feb800bdd10 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb872ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb800ad1d0 con 0x7feb800958a0 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 0x7feb80151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 0x7feb80151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47652/0 (socket says 172.21.15.27:47652) 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 -- 172.21.15.27:0/471719587 learned_addr learned my addr 172.21.15.27:0/471719587 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85086700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb800958a0 0x7feb800ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb84885700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb800bdd10 0x7feb800ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 -- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb800958a0 msgr2=0x7feb800ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.678 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb800958a0 0x7feb800ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 -- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb800bdd10 msgr2=0x7feb800ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb800bdd10 0x7feb800ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 -- 172.21.15.27:0/471719587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70009370 con 0x7feb80153f00 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85086700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb800958a0 0x7feb800ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb85887700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 0x7feb80151c50 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7feb70011000 tx=0x7feb70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000bae0 con 0x7feb80153f00 2023-05-17T15:29:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.670+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000bea0 con 0x7feb80153f00 2023-05-17T15:29:53.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.671+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb800ad4b0 con 0x7feb80153f00 2023-05-17T15:29:53.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.671+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7001b660 con 0x7feb80153f00 2023-05-17T15:29:53.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.671+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800ace70 con 0x7feb80153f00 2023-05-17T15:29:53.680 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.671+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb800be6f0 con 0x7feb80153f00 2023-05-17T15:29:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.672+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feb70021030 con 0x7feb80153f00 2023-05-17T15:29:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.672+0000 7feb7d7fa700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feb6c05ed90 0x7feb6c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.672+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7feb7007b8a0 con 0x7feb80153f00 2023-05-17T15:29:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.672+0000 7feb85086700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feb6c05ed90 0x7feb6c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.673+0000 7feb85086700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feb6c05ed90 0x7feb6c061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7feb780094d0 tx=0x7feb7800b040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.677+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb7004cfc0 con 0x7feb80153f00 2023-05-17T15:29:53.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.849+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7feb8006c350 con 0x7feb6c05ed90 2023-05-17T15:29:53.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.849+0000 7feb7d7fa700 1 -- 172.21.15.27:0/471719587 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb8006c350 con 0x7feb6c05ed90 2023-05-17T15:29:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feb6c05ed90 msgr2=0x7feb6c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feb6c05ed90 0x7feb6c061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7feb780094d0 tx=0x7feb7800b040).stop 2023-05-17T15:29:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 msgr2=0x7feb80151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 0x7feb80151c50 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7feb70011000 tx=0x7feb70017000).stop 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 shutdown_connections 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7feb6c05ed90 0x7feb6c061250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb80153f00 0x7feb80151c50 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb800958a0 0x7feb800ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 --2- 172.21.15.27:0/471719587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb800bdd10 0x7feb800ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 >> 172.21.15.27:0/471719587 conn(0x7feb800c8a00 msgr2=0x7feb801529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 shutdown_connections 2023-05-17T15:29:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.851+0000 7feb872ea700 1 -- 172.21.15.27:0/471719587 wait complete. 2023-05-17T15:29:53.857 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 1 to deep-scrub 2023-05-17T15:29:53.867 INFO:tasks.ceph:Scrubbing osd.2 2023-05-17T15:29:53.867 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:53.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.982+0000 7fd63065a700 1 Processor -- start 2023-05-17T15:29:53.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.982+0000 7fd63065a700 1 -- start start 2023-05-17T15:29:53.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd63065a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 0x7fd628081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd63065a700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6280c1610 con 0x7fd628153fa0 2023-05-17T15:29:53.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd63065a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd628082910 con 0x7fd6280824c0 2023-05-17T15:29:53.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd63065a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280c0a00 con 0x7fd6280c0420 2023-05-17T15:29:53.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd62e3f6700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd628153fa0 0x7fd6280aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47218/0 (socket says 172.21.15.27:47218) 2023-05-17T15:29:53.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd62e3f6700 1 -- 172.21.15.27:0/2885661228 learned_addr learned my addr 172.21.15.27:0/2885661228 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:53.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.983+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 0x7fd628081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279148384 0 0) 0x7fd6280c1610 con 0x7fd628153fa0 2023-05-17T15:29:53.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6100033f0 con 0x7fd628153fa0 2023-05-17T15:29:53.990 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726131689 0 0) 0x7fd6100033f0 con 0x7fd628153fa0 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 msgr2=0x7fd628081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 0x7fd628081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 >> v1:172.21.15.40:6789/0 conn(0x7fd6280824c0 legacy=0x7fd6280aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280c0ce0 con 0x7fd628153fa0 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fd620001470 con 0x7fd628153fa0 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 >> v1:172.21.15.27:6789/0 conn(0x7fd628153fa0 legacy=0x7fd6280aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd610003910 0x7fd610003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd610004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 0x7fd610005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280c0a00 con 0x7fd610004690 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61000b8e0 con 0x7fd610003910 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61000ba70 con 0x7fd6280c0420 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd610004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62e3f6700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd610003910 0x7fd610003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.992 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62ebf7700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 0x7fd610005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 -- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 msgr2=0x7fd610005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280c0420 0x7fd610005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 -- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd610003910 msgr2=0x7fd610003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd610003910 0x7fd610003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 -- 172.21.15.27:0/2885661228 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6100033f0 con 0x7fd610004690 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62e3f6700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd610003910 0x7fd610003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.984+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd610004b10 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fd61c009a60 tx=0x7fd61c009060).ready entity=mon.0 client_cookie=504e0af6262c6614 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c009ea0 con 0x7fd610004690 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c009430 con 0x7fd610004690 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd62d3f4700 1 -- 172.21.15.27:0/2885661228 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00e870 con 0x7fd610004690 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd63065a700 1 -- 172.21.15.27:0/2885661228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 msgr2=0x7fd610004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd63065a700 1 --2- 172.21.15.27:0/2885661228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd610004b10 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fd61c009a60 tx=0x7fd61c009060).stop 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd62ebf7700 1 -- 172.21.15.27:0/2885661228 reap_dead start 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd63065a700 1 -- 172.21.15.27:0/2885661228 shutdown_connections 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd63065a700 1 -- 172.21.15.27:0/2885661228 >> 172.21.15.27:0/2885661228 conn(0x7fd62805e820 msgr2=0x7fd6280cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:53.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd63065a700 1 -- 172.21.15.27:0/2885661228 shutdown_connections 2023-05-17T15:29:53.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.985+0000 7fd63065a700 1 -- 172.21.15.27:0/2885661228 wait complete. 2023-05-17T15:29:53.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.986+0000 7fd63065a700 1 Processor -- start 2023-05-17T15:29:53.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.986+0000 7fd63065a700 1 -- start start 2023-05-17T15:29:53.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd63065a700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd628164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd63065a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280adde0 0x7fd6281436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd63065a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd628143bd0 0x7fd6280ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:53.997 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd63065a700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628164c70 con 0x7fd610004690 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd63065a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628164f50 con 0x7fd628143bd0 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd63065a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd628165230 con 0x7fd6280adde0 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd62e3f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd628164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd62e3f6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd628164390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47668/0 (socket says 172.21.15.27:47668) 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd62e3f6700 1 -- 172.21.15.27:0/2947640385 learned_addr learned my addr 172.21.15.27:0/2947640385 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280adde0 0x7fd6281436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.987+0000 7fd62ebf7700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd628143bd0 0x7fd6280ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62e3f6700 1 -- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280adde0 msgr2=0x7fd6281436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62e3f6700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6280adde0 0x7fd6281436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62e3f6700 1 -- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd628143bd0 msgr2=0x7fd6280ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62e3f6700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd628143bd0 0x7fd6280ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62e3f6700 1 -- 172.21.15.27:0/2947640385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280c33a0 con 0x7fd610004690 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62ebf7700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd628143bd0 0x7fd6280ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd62e3f6700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd628164390 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fd62000e830 tx=0x7fd628082aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:53.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620010520 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620010680 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6280c3680 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620010a20 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.988+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6280abd90 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.989+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6281650c0 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.989+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd620014430 con 0x7fd610004690 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.989+0000 7fd6267fc700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd61405edc0 0x7fd614061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fd6200795e0 con 0x7fd610004690 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd61405edc0 0x7fd614061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd6267fc700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fd6140657b0 0x7fd614067c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 --> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6140682d0 con 0x7fd6140657b0 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd62007bc50 con 0x7fd610004690 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd62ebf7700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fd6140657b0 0x7fd614067c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd62dbf5700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd61405edc0 0x7fd614061280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd6280acf90 tx=0x7fd61c01a000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.990+0000 7fd62ebf7700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fd6140657b0 0x7fd614067c50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:53.991+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== osd.2 v2:172.21.15.27:6800/86562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd6140682d0 con 0x7fd6140657b0 2023-05-17T15:29:54.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.004+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 --> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6280c38c0 con 0x7fd6140657b0 2023-05-17T15:29:54.008 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.004+0000 7fd6267fc700 1 -- 172.21.15.27:0/2947640385 <== osd.2 v2:172.21.15.27:6800/86562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd6280c38c0 con 0x7fd6140657b0 2023-05-17T15:29:54.008 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:54.009 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:54.009 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:54.009 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.004+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fd6140657b0 msgr2=0x7fd614067c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6800/86562,v1:172.21.15.27:6801/86562] conn(0x7fd6140657b0 0x7fd614067c50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd61405edc0 msgr2=0x7fd614061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fd61405edc0 0x7fd614061280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd6280acf90 tx=0x7fd61c01a000).stop 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 msgr2=0x7fd628164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 --2- 172.21.15.27:0/2947640385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd610004690 0x7fd628164390 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fd62000e830 tx=0x7fd628082aa0).stop 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd62ebf7700 1 -- 172.21.15.27:0/2947640385 reap_dead start 2023-05-17T15:29:54.010 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 shutdown_connections 2023-05-17T15:29:54.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 >> 172.21.15.27:0/2947640385 conn(0x7fd62805e820 msgr2=0x7fd628152750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 shutdown_connections 2023-05-17T15:29:54.011 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.005+0000 7fd63065a700 1 -- 172.21.15.27:0/2947640385 wait complete. 2023-05-17T15:29:54.020 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-05-17T15:29:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.132+0000 7ff7c83f1700 1 Processor -- start 2023-05-17T15:29:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.132+0000 7ff7c83f1700 1 -- start start 2023-05-17T15:29:54.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.133+0000 7ff7c83f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.133+0000 7ff7c83f1700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7c0069610 0x7ff7c00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.133+0000 7ff7c83f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c00c5a50 con 0x7ff7c00cb450 2023-05-17T15:29:54.138 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.133+0000 7ff7c83f1700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c0069fa0 con 0x7ff7c0069610 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.133+0000 7ff7c83f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00c04e0 con 0x7ff7c0154090 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7c0069610 0x7ff7c00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff7c0069610 0x7ff7c00cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47680/0 (socket says 172.21.15.27:47680) 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c598c700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff7c00cb450 0x7ff7c0068f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47242/0 (socket says 172.21.15.27:47242) 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 -- 172.21.15.27:0/336113709 learned_addr learned my addr 172.21.15.27:0/336113709 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c618d700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 -- 172.21.15.27:0/336113709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 msgr2=0x7ff7c0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:54.139 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c0154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 -- 172.21.15.27:0/336113709 >> v1:172.21.15.27:6789/0 conn(0x7ff7c00cb450 legacy=0x7ff7c0068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 -- 172.21.15.27:0/336113709 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c00c0760 con 0x7ff7c0069610 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c518b700 1 -- 172.21.15.27:0/336113709 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679388326 0 0) 0x7ff7c00c5a50 con 0x7ff7c00cb450 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c618d700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c0154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c698e700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c0069610 0x7ff7c00cb8d0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7ff7b0006fd0 tx=0x7ff7b00090f0).ready entity=mon.0 client_cookie=3e3cf11d2d008e2b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c518b700 1 -- 172.21.15.27:0/336113709 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000b600 con 0x7ff7c0069610 2023-05-17T15:29:54.140 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c518b700 1 -- 172.21.15.27:0/336113709 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b000b760 con 0x7ff7c0069610 2023-05-17T15:29:54.141 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.134+0000 7ff7c518b700 1 -- 172.21.15.27:0/336113709 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000bae0 con 0x7ff7c0069610 2023-05-17T15:29:54.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 -- 172.21.15.27:0/336113709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c0069610 msgr2=0x7ff7c00cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c0069610 0x7ff7c00cb8d0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7ff7b0006fd0 tx=0x7ff7b00090f0).stop 2023-05-17T15:29:54.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 -- 172.21.15.27:0/336113709 shutdown_connections 2023-05-17T15:29:54.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c0069610 0x7ff7c00cb8d0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/336113709 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c0154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 -- 172.21.15.27:0/336113709 >> 172.21.15.27:0/336113709 conn(0x7ff7c005e7e0 msgr2=0x7ff7c00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 -- 172.21.15.27:0/336113709 shutdown_connections 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.135+0000 7ff7c83f1700 1 -- 172.21.15.27:0/336113709 wait complete. 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.136+0000 7ff7c83f1700 1 Processor -- start 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.136+0000 7ff7c83f1700 1 -- start start 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c0069610 0x7ff7c0164580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 0x7ff7c014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c014e2d0 con 0x7ff7c00cb450 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00aebc0 con 0x7ff7c0069610 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00af0b0 con 0x7ff7c0154090 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 0x7ff7c014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 0x7ff7c014dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47686/0 (socket says 172.21.15.27:47686) 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 -- 172.21.15.27:0/3398746661 learned_addr learned my addr 172.21.15.27:0/3398746661 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:54.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c698e700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c618d700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c0069610 0x7ff7c0164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 -- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 msgr2=0x7ff7c00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c00c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 -- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c0069610 msgr2=0x7ff7c0164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c0069610 0x7ff7c0164580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 -- 172.21.15.27:0/3398746661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009370 con 0x7ff7c00cb450 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c598c700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 0x7ff7c014dde0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7ff7b400c4e0 tx=0x7ff7b4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40072e0 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4007440 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c00af390 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40058f0 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.137+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00af950 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.138+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c00afb40 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.139+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff7b401a060 con 0x7ff7c00cb450 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.139+0000 7ff7be7fc700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff7ac05ed90 0x7ff7ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.139+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7ff7b4079220 con 0x7ff7c00cb450 2023-05-17T15:29:54.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.139+0000 7ff7c618d700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff7ac05ed90 0x7ff7ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.139+0000 7ff7c618d700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff7ac05ed90 0x7ff7ac061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff7b8007600 tx=0x7ff7b8009850).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.148 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.143+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7b404a8c0 con 0x7ff7c00cb450 2023-05-17T15:29:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.316+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7c0158ab0 con 0x7ff7ac05ed90 2023-05-17T15:29:54.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.316+0000 7ff7be7fc700 1 -- 172.21.15.27:0/3398746661 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff7c0158ab0 con 0x7ff7ac05ed90 2023-05-17T15:29:54.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff7ac05ed90 msgr2=0x7ff7ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff7ac05ed90 0x7ff7ac061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff7b8007600 tx=0x7ff7b8009850).stop 2023-05-17T15:29:54.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 msgr2=0x7ff7c014dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 0x7ff7c014dde0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7ff7b400c4e0 tx=0x7ff7b4007c60).stop 2023-05-17T15:29:54.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 shutdown_connections 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7ff7ac05ed90 0x7ff7ac061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7c0154090 0x7ff7c00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c0069610 0x7ff7c0164580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 --2- 172.21.15.27:0/3398746661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c00cb450 0x7ff7c014dde0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 >> 172.21.15.27:0/3398746661 conn(0x7ff7c005e7e0 msgr2=0x7ff7c00aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 shutdown_connections 2023-05-17T15:29:54.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.318+0000 7ff7c83f1700 1 -- 172.21.15.27:0/3398746661 wait complete. 2023-05-17T15:29:54.324 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 2 to deep-scrub 2023-05-17T15:29:54.333 INFO:tasks.ceph:Scrubbing osd.3 2023-05-17T15:29:54.334 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:54.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.449+0000 7f05f3d74700 1 Processor -- start 2023-05-17T15:29:54.453 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.449+0000 7f05f3d74700 1 -- start start 2023-05-17T15:29:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f3d74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f3d74700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05ec0aa130 0x7f05ec081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.454 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f3d74700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0c1610 con 0x7f05ec0824c0 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f3d74700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec082930 con 0x7f05ec0aa130 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f3d74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0abe60 con 0x7f05ec153fa0 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f2311700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f05ec0824c0 0x7f05ec068de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47258/0 (socket says 172.21.15.27:47258) 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f2311700 1 -- 172.21.15.27:0/2473184256 learned_addr learned my addr 172.21.15.27:0/2473184256 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f130f700 1 --2- 172.21.15.27:0/2473184256 >> v2:172.21.15.40:3300/0 conn(0x7f05ec0aa130 0x7f05ec081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.450+0000 7f05f1b10700 1 --2- 172.21.15.27:0/2473184256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f0b0e700 1 -- 172.21.15.27:0/2473184256 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944533459 0 0) 0x7f05ec0c1610 con 0x7f05ec0824c0 2023-05-17T15:29:54.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f0b0e700 1 -- 172.21.15.27:0/2473184256 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d40033f0 con 0x7f05ec0824c0 2023-05-17T15:29:54.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f1b10700 1 -- 172.21.15.27:0/2473184256 >> v2:172.21.15.40:3300/0 conn(0x7f05ec0aa130 msgr2=0x7f05ec081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:54.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f1b10700 1 --2- 172.21.15.27:0/2473184256 >> v2:172.21.15.40:3300/0 conn(0x7f05ec0aa130 0x7f05ec081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f1b10700 1 -- 172.21.15.27:0/2473184256 >> v1:172.21.15.27:6789/0 conn(0x7f05ec0824c0 legacy=0x7f05ec068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f0b0e700 1 -- 172.21.15.27:0/2473184256 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305046768 0 0) 0x7f05d40033f0 con 0x7f05ec0824c0 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f1b10700 1 -- 172.21.15.27:0/2473184256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0c0a00 con 0x7f05ec153fa0 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f130f700 1 --2- 172.21.15.27:0/2473184256 >> v2:172.21.15.40:3300/0 conn(0x7f05ec0aa130 0x7f05ec081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f1b10700 1 --2- 172.21.15.27:0/2473184256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c0420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f05e4009760 tx=0x7f05e4009060).ready entity=mon.2 client_cookie=e46c569177a13700 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f0b0e700 1 -- 172.21.15.27:0/2473184256 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0017f0 con 0x7f05ec153fa0 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f0b0e700 1 -- 172.21.15.27:0/2473184256 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e4011400 con 0x7f05ec153fa0 2023-05-17T15:29:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.451+0000 7f05f0b0e700 1 -- 172.21.15.27:0/2473184256 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4011780 con 0x7f05ec153fa0 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 -- 172.21.15.27:0/2473184256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 msgr2=0x7f05ec0c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 --2- 172.21.15.27:0/2473184256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c0420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f05e4009760 tx=0x7f05e4009060).stop 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 -- 172.21.15.27:0/2473184256 shutdown_connections 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 --2- 172.21.15.27:0/2473184256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c0420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 --2- 172.21.15.27:0/2473184256 >> v2:172.21.15.40:3300/0 conn(0x7f05ec0aa130 0x7f05ec081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 -- 172.21.15.27:0/2473184256 >> 172.21.15.27:0/2473184256 conn(0x7f05ec05e820 msgr2=0x7f05ec0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 -- 172.21.15.27:0/2473184256 shutdown_connections 2023-05-17T15:29:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.452+0000 7f05f3d74700 1 -- 172.21.15.27:0/2473184256 wait complete. 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 Processor -- start 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 -- start start 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05ec0824c0 0x7f05ec0c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05ec0aa130 0x7f05ec14a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1593a0 con 0x7f05ec0824c0 2023-05-17T15:29:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec152930 con 0x7f05ec0aa130 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.453+0000 7f05f3d74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec152000 con 0x7f05ec153fa0 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05ec0824c0 0x7f05ec0c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05ec0824c0 0x7f05ec0c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47698/0 (socket says 172.21.15.27:47698) 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 -- 172.21.15.27:0/1760832413 learned_addr learned my addr 172.21.15.27:0/1760832413 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f130f700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05ec0aa130 0x7f05ec14a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f2311700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 -- 172.21.15.27:0/1760832413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 msgr2=0x7f05ec0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05ec153fa0 0x7f05ec0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 -- 172.21.15.27:0/1760832413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05ec0aa130 msgr2=0x7f05ec14a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05ec0aa130 0x7f05ec14a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 -- 172.21.15.27:0/1760832413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00092a0 con 0x7f05ec0824c0 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f1b10700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05ec0824c0 0x7f05ec0c2dd0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f05e4009d50 tx=0x7f05e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4010770 con 0x7f05ec0824c0 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e40108d0 con 0x7f05ec0824c0 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e40092a0 con 0x7f05ec0824c0 2023-05-17T15:29:54.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.454+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4010c50 con 0x7f05ec0824c0 2023-05-17T15:29:54.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.455+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec1525c0 con 0x7f05ec0824c0 2023-05-17T15:29:54.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.455+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05ec06bdf0 con 0x7f05ec0824c0 2023-05-17T15:29:54.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f05e400f070 con 0x7f05ec0824c0 2023-05-17T15:29:54.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05e9ffb700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f05d805ed60 0x7f05d8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f05e407ad40 con 0x7f05ec0824c0 2023-05-17T15:29:54.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05f130f700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f05d805ed60 0x7f05d8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05e9ffb700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f05d8065750 0x7f05d8067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 --> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05d8068270 con 0x7f05d8065750 2023-05-17T15:29:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05e407d3b0 con 0x7f05ec0824c0 2023-05-17T15:29:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.456+0000 7f05f2311700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f05d8065750 0x7f05d8067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.457+0000 7f05f130f700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f05d805ed60 0x7f05d8061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f05ec0ad5c0 tx=0x7f05e0009060).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.457+0000 7f05f2311700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f05d8065750 0x7f05d8067bf0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.457+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== osd.3 v2:172.21.15.27:6824/86590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f05d8068270 con 0x7f05d8065750 2023-05-17T15:29:54.474 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 --> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f05ec0c0ce0 con 0x7f05d8065750 2023-05-17T15:29:54.475 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05e9ffb700 1 -- 172.21.15.27:0/1760832413 <== osd.3 v2:172.21.15.27:6824/86590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f05ec0c0ce0 con 0x7f05d8065750 2023-05-17T15:29:54.475 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:54.475 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:54.475 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f05d8065750 msgr2=0x7f05d8067bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6824/86590,v1:172.21.15.27:6825/86590] conn(0x7f05d8065750 0x7f05d8067bf0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f05d805ed60 msgr2=0x7f05d8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f05d805ed60 0x7f05d8061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f05ec0ad5c0 tx=0x7f05e0009060).stop 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05ec0824c0 msgr2=0x7f05ec0c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 --2- 172.21.15.27:0/1760832413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05ec0824c0 0x7f05ec0c2dd0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f05e4009d50 tx=0x7f05e4016000).stop 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f2311700 1 -- 172.21.15.27:0/1760832413 reap_dead start 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 shutdown_connections 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 >> 172.21.15.27:0/1760832413 conn(0x7f05ec05e820 msgr2=0x7f05ec157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 shutdown_connections 2023-05-17T15:29:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.471+0000 7f05f3d74700 1 -- 172.21.15.27:0/1760832413 wait complete. 2023-05-17T15:29:54.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-05-17T15:29:54.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.600+0000 7f8a7ab3e700 1 Processor -- start 2023-05-17T15:29:54.604 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.601+0000 7f8a7ab3e700 1 -- start start 2023-05-17T15:29:54.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.601+0000 7f8a7ab3e700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a74153d30 0x7f8a740bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.605 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.601+0000 7f8a7ab3e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a74155220 0x7f8a74154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.601+0000 7f8a7ab3e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a740c6120 con 0x7f8a740c5c90 2023-05-17T15:29:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.601+0000 7f8a7ab3e700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740c63e0 con 0x7f8a74153d30 2023-05-17T15:29:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.601+0000 7f8a7ab3e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740c66c0 con 0x7f8a74155220 2023-05-17T15:29:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a788da700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8a74153d30 0x7f8a740bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a790db700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8a740c5c90 0x7f8a740c7780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47274/0 (socket says 172.21.15.27:47274) 2023-05-17T15:29:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a790db700 1 -- 172.21.15.27:0/1157361034 learned_addr learned my addr 172.21.15.27:0/1157361034 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:54.607 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a788da700 1 -- 172.21.15.27:0/1157361034 >> v2:172.21.15.40:3300/0 conn(0x7f8a74155220 msgr2=0x7f8a74154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:54.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a788da700 1 --2- 172.21.15.27:0/1157361034 >> v2:172.21.15.40:3300/0 conn(0x7f8a74155220 0x7f8a74154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:54.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a788da700 1 -- 172.21.15.27:0/1157361034 >> v1:172.21.15.27:6789/0 conn(0x7f8a740c5c90 legacy=0x7f8a740c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a788da700 1 -- 172.21.15.27:0/1157361034 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74154740 con 0x7f8a74153d30 2023-05-17T15:29:54.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a737fe700 1 -- 172.21.15.27:0/1157361034 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181557524 0 0) 0x7f8a740c6120 con 0x7f8a740c5c90 2023-05-17T15:29:54.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a788da700 1 --2- 172.21.15.27:0/1157361034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74153d30 0x7f8a740bfdd0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f8a740842d0 tx=0x7f8a6c009060).ready entity=mon.0 client_cookie=7faaa0c5b799966f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.608 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a737fe700 1 -- 172.21.15.27:0/1157361034 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00b580 con 0x7f8a74153d30 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a737fe700 1 -- 172.21.15.27:0/1157361034 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00b6e0 con 0x7f8a74153d30 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.602+0000 7f8a737fe700 1 -- 172.21.15.27:0/1157361034 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00ba60 con 0x7f8a74153d30 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/1157361034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74153d30 msgr2=0x7f8a740bfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/1157361034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74153d30 0x7f8a740bfdd0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f8a740842d0 tx=0x7f8a6c009060).stop 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/1157361034 shutdown_connections 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/1157361034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74153d30 0x7f8a740bfdd0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/1157361034 >> v2:172.21.15.40:3300/0 conn(0x7f8a74155220 0x7f8a74154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-17T15:29:54.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/1157361034 >> 172.21.15.27:0/1157361034 conn(0x7f8a7405dd50 msgr2=0x7f8a7405e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/1157361034 shutdown_connections 2023-05-17T15:29:54.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.603+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/1157361034 wait complete. 2023-05-17T15:29:54.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.604+0000 7f8a7ab3e700 1 Processor -- start 2023-05-17T15:29:54.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.604+0000 7f8a7ab3e700 1 -- start start 2023-05-17T15:29:54.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a740c5c90 0x7f8a741561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a74153d30 0x7f8a7414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 0x7f8a740c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74155780 con 0x7f8a74155220 2023-05-17T15:29:54.612 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740c41c0 con 0x7f8a740c5c90 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a741559f0 con 0x7f8a74153d30 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 0x7f8a740c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 0x7f8a740c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47718/0 (socket says 172.21.15.27:47718) 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 -- 172.21.15.27:0/506680487 learned_addr learned my addr 172.21.15.27:0/506680487 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a788da700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a740c5c90 0x7f8a741561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a73fff700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a74153d30 0x7f8a7414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 -- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a74153d30 msgr2=0x7f8a7414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.613 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a74153d30 0x7f8a7414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 -- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a740c5c90 msgr2=0x7f8a741561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a740c5c90 0x7f8a741561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 -- 172.21.15.27:0/506680487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0092a0 con 0x7f8a74155220 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a790db700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 0x7f8a740c3790 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f8a6400c7e0 tx=0x7f8a64007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64005d30 con 0x7f8a74155220 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64005e90 con 0x7f8a74155220 2023-05-17T15:29:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a74155cd0 con 0x7f8a74155220 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64007320 con 0x7f8a74155220 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.605+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7414da20 con 0x7f8a74155220 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.606+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a74155ec0 con 0x7f8a74155220 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.607+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8a64010030 con 0x7f8a74155220 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.607+0000 7f8a70ff9700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f8a5405ed90 0x7f8a54061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.607+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f8a64079800 con 0x7f8a74155220 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.607+0000 7f8a788da700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f8a5405ed90 0x7f8a54061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.608+0000 7f8a788da700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f8a5405ed90 0x7f8a54061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8a6c00b340 tx=0x7f8a6c017000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.616 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.611+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a6404aef0 con 0x7f8a74155220 2023-05-17T15:29:54.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.787+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a740ad180 con 0x7f8a5405ed90 2023-05-17T15:29:54.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.787+0000 7f8a70ff9700 1 -- 172.21.15.27:0/506680487 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a740ad180 con 0x7f8a5405ed90 2023-05-17T15:29:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f8a5405ed90 msgr2=0x7f8a54061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f8a5405ed90 0x7f8a54061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8a6c00b340 tx=0x7f8a6c017000).stop 2023-05-17T15:29:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 msgr2=0x7f8a740c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 0x7f8a740c3790 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f8a6400c7e0 tx=0x7f8a64007f90).stop 2023-05-17T15:29:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 shutdown_connections 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f8a5405ed90 0x7f8a54061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a74155220 0x7f8a740c3790 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a740c5c90 0x7f8a741561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 --2- 172.21.15.27:0/506680487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a74153d30 0x7f8a7414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 >> 172.21.15.27:0/506680487 conn(0x7f8a7405dd50 msgr2=0x7f8a740ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 shutdown_connections 2023-05-17T15:29:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.789+0000 7f8a7ab3e700 1 -- 172.21.15.27:0/506680487 wait complete. 2023-05-17T15:29:54.795 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 3 to deep-scrub 2023-05-17T15:29:54.804 INFO:tasks.ceph:Scrubbing osd.4 2023-05-17T15:29:54.805 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:54.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.921+0000 7fdb817f1700 1 Processor -- start 2023-05-17T15:29:54.925 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.921+0000 7fdb817f1700 1 -- start start 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb817f1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb7c0c0380 0x7fdb7c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb817f1700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c1550b0 con 0x7fdb7c14e100 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb817f1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c154500 con 0x7fdb7c0aa130 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb817f1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c7f80 con 0x7fdb7c0c0380 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb7affd700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdb7c14e100 0x7fdb7c0a9a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47284/0 (socket says 172.21.15.27:47284) 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb7affd700 1 -- 172.21.15.27:0/3616001985 learned_addr learned my addr 172.21.15.27:0/3616001985 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:54.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb7b7fe700 1 --2- 172.21.15.27:0/3616001985 >> v2:172.21.15.40:3300/0 conn(0x7fdb7c0c0380 0x7fdb7c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321193785 0 0) 0x7fdb7c1550b0 con 0x7fdb7c14e100 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb680033f0 con 0x7fdb7c14e100 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1077383318 0 0) 0x7fdb680033f0 con 0x7fdb7c14e100 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 >> v2:172.21.15.40:3300/0 conn(0x7fdb7c0c0380 msgr2=0x7fdb7c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 --2- 172.21.15.27:0/3616001985 >> v2:172.21.15.40:3300/0 conn(0x7fdb7c0c0380 0x7fdb7c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 >> v1:172.21.15.40:6789/0 conn(0x7fdb7c0aa130 legacy=0x7fdb7c0c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c154780 con 0x7fdb7c14e100 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7fdb74001470 con 0x7fdb7c14e100 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 >> v1:172.21.15.27:6789/0 conn(0x7fdb7c14e100 legacy=0x7fdb7c0a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb680038e0 0x7fdb68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.922+0000 7fdb79ffb700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb68004690 0x7fdb68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb68005000 0x7fdb6800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c7f80 con 0x7fdb680038e0 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6800beb0 con 0x7fdb68004690 2023-05-17T15:29:54.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6800c070 con 0x7fdb68005000 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb680038e0 0x7fdb68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7a7fc700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb68004690 0x7fdb68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7b7fe700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb68005000 0x7fdb6800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 -- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb68005000 msgr2=0x7fdb6800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb68005000 0x7fdb6800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 -- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb68004690 msgr2=0x7fdb68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:54.931 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb68004690 0x7fdb68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 -- 172.21.15.27:0/3616001985 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680033f0 con 0x7fdb680038e0 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7a7fc700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb68004690 0x7fdb68004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7b7fe700 1 -- 172.21.15.27:0/3616001985 reap_dead start 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb7affd700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb680038e0 0x7fdb68003d00 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7fdb7400c190 tx=0x7fdb74001e50).ready entity=mon.0 client_cookie=3588492a36d69fff server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74007a20 con 0x7fdb680038e0 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400cac0 con 0x7fdb680038e0 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.923+0000 7fdb79ffb700 1 -- 172.21.15.27:0/3616001985 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400ce40 con 0x7fdb680038e0 2023-05-17T15:29:54.932 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 -- 172.21.15.27:0/3616001985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb680038e0 msgr2=0x7fdb68003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb680038e0 0x7fdb68003d00 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7fdb7400c190 tx=0x7fdb74001e50).stop 2023-05-17T15:29:54.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 -- 172.21.15.27:0/3616001985 shutdown_connections 2023-05-17T15:29:54.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 --2- 172.21.15.27:0/3616001985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb680038e0 0x7fdb68003d00 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 -- 172.21.15.27:0/3616001985 >> 172.21.15.27:0/3616001985 conn(0x7fdb7c05dd50 msgr2=0x7fdb7c05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 -- 172.21.15.27:0/3616001985 shutdown_connections 2023-05-17T15:29:54.933 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.924+0000 7fdb817f1700 1 -- 172.21.15.27:0/3616001985 wait complete. 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.925+0000 7fdb817f1700 1 Processor -- start 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.925+0000 7fdb817f1700 1 -- start start 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680038e0 0x7fdb7c153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c0b00e0 0x7fdb7c0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7c0c3050 0x7fdb7c0c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c3f40 con 0x7fdb7c0c3050 2023-05-17T15:29:54.936 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c39c0 con 0x7fdb7c0b00e0 2023-05-17T15:29:54.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c153970 con 0x7fdb680038e0 2023-05-17T15:29:54.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7c0c3050 0x7fdb7c0c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7c0c3050 0x7fdb7c0c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47738/0 (socket says 172.21.15.27:47738) 2023-05-17T15:29:54.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 -- 172.21.15.27:0/1432347427 learned_addr learned my addr 172.21.15.27:0/1432347427 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:54.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7affd700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680038e0 0x7fdb7c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.937 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7a7fc700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c0b00e0 0x7fdb7c0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 -- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680038e0 msgr2=0x7fdb7c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb680038e0 0x7fdb7c153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 -- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c0b00e0 msgr2=0x7fdb7c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c0b00e0 0x7fdb7c0b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 -- 172.21.15.27:0/1432347427 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0af040 con 0x7fdb7c0c3050 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb7b7fe700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7c0c3050 0x7fdb7c0c34d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7fdb7c0b0c40 tx=0x7fdb6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c015440 con 0x7fdb7c0c3050 2023-05-17T15:29:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0155a0 con 0x7fdb7c0c3050 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c0af320 con 0x7fdb7c0c3050 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c015920 con 0x7fdb7c0c3050 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.926+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0af8e0 con 0x7fdb7c0c3050 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.927+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb7c05f540 con 0x7fdb7c0c3050 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdb6c01d030 con 0x7fdb7c0c3050 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb72ffd700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb5c05ed90 0x7fdb5c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.939 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fdb6c079b40 con 0x7fdb7c0c3050 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb7affd700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb5c05ed90 0x7fdb5c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb72ffd700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7fdb5c065780 0x7fdb5c067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 --> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb5c0682a0 con 0x7fdb5c065780 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.928+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb6c079f40 con 0x7fdb7c0c3050 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.929+0000 7fdb7affd700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb5c05ed90 0x7fdb5c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdb74001ed0 tx=0x7fdb74015000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.929+0000 7fdb7a7fc700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7fdb5c065780 0x7fdb5c067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.929+0000 7fdb7a7fc700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7fdb5c065780 0x7fdb5c067c20 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.930+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== osd.4 v2:172.21.15.40:6800/116762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fdb5c0682a0 con 0x7fdb5c065780 2023-05-17T15:29:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.943+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 --> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdb7c047150 con 0x7fdb5c065780 2023-05-17T15:29:54.948 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb72ffd700 1 -- 172.21.15.27:0/1432347427 <== osd.4 v2:172.21.15.40:6800/116762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdb7c047150 con 0x7fdb5c065780 2023-05-17T15:29:54.948 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:54.948 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:54.948 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:54.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7fdb5c065780 msgr2=0x7fdb5c067c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.40:6800/116762,v1:172.21.15.40:6801/116762] conn(0x7fdb5c065780 0x7fdb5c067c20 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:54.949 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb5c05ed90 msgr2=0x7fdb5c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fdb5c05ed90 0x7fdb5c061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdb74001ed0 tx=0x7fdb74015000).stop 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7c0c3050 msgr2=0x7fdb7c0c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 --2- 172.21.15.27:0/1432347427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7c0c3050 0x7fdb7c0c34d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7fdb7c0b0c40 tx=0x7fdb6c008040).stop 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb7b7fe700 1 -- 172.21.15.27:0/1432347427 reap_dead start 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 shutdown_connections 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.944+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 >> 172.21.15.27:0/1432347427 conn(0x7fdb7c05dd50 msgr2=0x7fdb7c0c0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:54.950 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.945+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 shutdown_connections 2023-05-17T15:29:54.951 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:54.945+0000 7fdb817f1700 1 -- 172.21.15.27:0/1432347427 wait complete. 2023-05-17T15:29:54.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-05-17T15:29:55.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.072+0000 7f1c42da2700 1 Processor -- start 2023-05-17T15:29:55.076 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.072+0000 7f1c42da2700 1 -- start start 2023-05-17T15:29:55.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c42da2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c3c150b60 0x7f1c3c064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c42da2700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0c28e0 con 0x7f1c3c0683c0 2023-05-17T15:29:55.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c42da2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c065390 con 0x7f1c3c150f40 2023-05-17T15:29:55.079 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c42da2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c2d70 con 0x7f1c3c150b60 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c4133f700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1c3c0683c0 0x7f1c3c1548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47310/0 (socket says 172.21.15.27:47310) 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c4133f700 1 -- 172.21.15.27:0/2037718766 learned_addr learned my addr 172.21.15.27:0/2037718766 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.073+0000 7f1c40b3e700 1 --2- 172.21.15.27:0/2037718766 >> v2:172.21.15.40:3300/0 conn(0x7f1c3c150b60 0x7f1c3c064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295987391 0 0) 0x7f1c3c0c28e0 con 0x7f1c3c0683c0 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c280033f0 con 0x7f1c3c0683c0 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424545460 0 0) 0x7f1c3c065390 con 0x7f1c3c150f40 2023-05-17T15:29:55.080 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c3c0c28e0 con 0x7f1c3c150f40 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403349114 0 0) 0x7f1c280033f0 con 0x7f1c3c0683c0 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 >> v2:172.21.15.40:3300/0 conn(0x7f1c3c150b60 msgr2=0x7f1c3c064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 --2- 172.21.15.27:0/2037718766 >> v2:172.21.15.40:3300/0 conn(0x7f1c3c150b60 0x7f1c3c064ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 >> v1:172.21.15.40:6789/0 conn(0x7f1c3c150f40 legacy=0x7f1c3c067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c065610 con 0x7f1c3c0683c0 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f1c24001470 con 0x7f1c3c0683c0 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 >> v1:172.21.15.27:6789/0 conn(0x7f1c3c0683c0 legacy=0x7f1c3c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28003a70 0x7f1c28003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c28004690 0x7f1c28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c28005000 0x7f1c2800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c2d70 con 0x7f1c28004690 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2800be80 con 0x7f1c28003a70 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2800c040 con 0x7f1c28005000 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c28004690 0x7f1c28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c40b3e700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28003a70 0x7f1c28003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c4133f700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c28005000 0x7f1c2800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3bfff700 1 -- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c28005000 msgr2=0x7f1c2800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c28005000 0x7f1c2800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3bfff700 1 -- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28003a70 msgr2=0x7f1c28003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28003a70 0x7f1c28003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c3bfff700 1 -- 172.21.15.27:0/2037718766 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280033f0 con 0x7f1c28004690 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.074+0000 7f1c4133f700 1 -- 172.21.15.27:0/2037718766 reap_dead start 2023-05-17T15:29:55.083 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c28004690 0x7f1c28004b10 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f1c2c001f60 tx=0x7f1c2c007f30).ready entity=mon.0 client_cookie=2fdde822e3efb784 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c002060 con 0x7f1c28004690 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c006a20 con 0x7f1c28004690 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c3b7fe700 1 -- 172.21.15.27:0/2037718766 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c006dc0 con 0x7f1c28004690 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 -- 172.21.15.27:0/2037718766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c28004690 msgr2=0x7f1c28004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c28004690 0x7f1c28004b10 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f1c2c001f60 tx=0x7f1c2c007f30).stop 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 -- 172.21.15.27:0/2037718766 shutdown_connections 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 --2- 172.21.15.27:0/2037718766 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c28004690 0x7f1c28004b10 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 -- 172.21.15.27:0/2037718766 >> 172.21.15.27:0/2037718766 conn(0x7f1c3c0c7910 msgr2=0x7f1c3c0c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 -- 172.21.15.27:0/2037718766 shutdown_connections 2023-05-17T15:29:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.075+0000 7f1c42da2700 1 -- 172.21.15.27:0/2037718766 wait complete. 2023-05-17T15:29:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.076+0000 7f1c42da2700 1 Processor -- start 2023-05-17T15:29:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 -- start start 2023-05-17T15:29:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28004690 0x7f1c3c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 0x7f1c3c163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3c163c00 0x7f1c3c0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.087 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c1632c0 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c1d80 con 0x7f1c28004690 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c42da2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c154b50 con 0x7f1c3c163c00 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c3bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 0x7f1c3c163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.077+0000 7f1c3bfff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 0x7f1c3c163710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47758/0 (socket says 172.21.15.27:47758) 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 -- 172.21.15.27:0/4265874884 learned_addr learned my addr 172.21.15.27:0/4265874884 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c40b3e700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28004690 0x7f1c3c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.088 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c4133f700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3c163c00 0x7f1c3c0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 -- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3c163c00 msgr2=0x7f1c3c0c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3c163c00 0x7f1c3c0c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 -- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28004690 msgr2=0x7f1c3c149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28004690 0x7f1c3c149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 -- 172.21.15.27:0/4265874884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c155640 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c40b3e700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28004690 0x7f1c3c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:55.089 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c4133f700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3c163c00 0x7f1c3c0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c3bfff700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 0x7f1c3c163710 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f1c2c000f80 tx=0x7f1c2c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c004160 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c007230 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c007610 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c154da0 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.078+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c155360 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.079+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c163430 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.090 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.079+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1c2c024020 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.080+0000 7f1c38ff9700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1c1c05ed90 0x7f1c1c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.080+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f1c2c07aa00 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.080+0000 7f1c40b3e700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1c1c05ed90 0x7f1c1c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.080+0000 7f1c40b3e700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1c1c05ed90 0x7f1c1c061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1c34006c40 tx=0x7f1c34008040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.091 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.084+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c3c163430 con 0x7f1c3c0a9b70 2023-05-17T15:29:55.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.260+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3c163fe0 con 0x7f1c1c05ed90 2023-05-17T15:29:55.264 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.260+0000 7f1c38ff9700 1 -- 172.21.15.27:0/4265874884 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c3c163fe0 con 0x7f1c1c05ed90 2023-05-17T15:29:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1c1c05ed90 msgr2=0x7f1c1c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1c1c05ed90 0x7f1c1c061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1c34006c40 tx=0x7f1c34008040).stop 2023-05-17T15:29:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 msgr2=0x7f1c3c163710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 0x7f1c3c163710 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f1c2c000f80 tx=0x7f1c2c016000).stop 2023-05-17T15:29:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 shutdown_connections 2023-05-17T15:29:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1c1c05ed90 0x7f1c1c061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3c163c00 0x7f1c3c0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c28004690 0x7f1c3c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 --2- 172.21.15.27:0/4265874884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c0a9b70 0x7f1c3c163710 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 >> 172.21.15.27:0/4265874884 conn(0x7f1c3c0c7910 msgr2=0x7f1c3c0aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 shutdown_connections 2023-05-17T15:29:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.262+0000 7f1c42da2700 1 -- 172.21.15.27:0/4265874884 wait complete. 2023-05-17T15:29:55.268 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 4 to deep-scrub 2023-05-17T15:29:55.277 INFO:tasks.ceph:Scrubbing osd.5 2023-05-17T15:29:55.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:55.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.392+0000 7f5843f2d700 1 Processor -- start 2023-05-17T15:29:55.396 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.392+0000 7f5843f2d700 1 -- start start 2023-05-17T15:29:55.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.393+0000 7f5843f2d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f583c153fa0 0x7f583c0c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.393+0000 7f5843f2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c0aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.393+0000 7f5843f2d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0c1610 con 0x7f583c0aa130 2023-05-17T15:29:55.398 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.393+0000 7f5843f2d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c0c0a00 con 0x7f583c153fa0 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.393+0000 7f5843f2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c0ce0 con 0x7f583c0826e0 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.393+0000 7f5841cc9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f583c153fa0 0x7f583c0c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f583c153fa0 0x7f583c0c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47764/0 (socket says 172.21.15.27:47764) 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 -- 172.21.15.27:0/952629355 learned_addr learned my addr 172.21.15.27:0/952629355 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f58424ca700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c0aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 -- 172.21.15.27:0/952629355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 msgr2=0x7f583c0aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c0aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.399 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 -- 172.21.15.27:0/952629355 >> v1:172.21.15.40:6789/0 conn(0x7f583c0aa130 legacy=0x7f583c081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 -- 172.21.15.27:0/952629355 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c0c0fc0 con 0x7f583c153fa0 2023-05-17T15:29:55.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f58424ca700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c0aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:29:55.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5841cc9700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c153fa0 0x7f583c0c0420 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f5834006fd0 tx=0x7f58340090f0).ready entity=mon.0 client_cookie=96ac604dc31e26a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5840cc7700 1 -- 172.21.15.27:0/952629355 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400b600 con 0x7f583c153fa0 2023-05-17T15:29:55.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5840cc7700 1 -- 172.21.15.27:0/952629355 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583400b760 con 0x7f583c153fa0 2023-05-17T15:29:55.400 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.394+0000 7f5840cc7700 1 -- 172.21.15.27:0/952629355 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400bae0 con 0x7f583c153fa0 2023-05-17T15:29:55.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 -- 172.21.15.27:0/952629355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c153fa0 msgr2=0x7f583c0c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.403 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c153fa0 0x7f583c0c0420 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f5834006fd0 tx=0x7f58340090f0).stop 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 -- 172.21.15.27:0/952629355 shutdown_connections 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c0aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 --2- 172.21.15.27:0/952629355 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c153fa0 0x7f583c0c0420 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 -- 172.21.15.27:0/952629355 >> 172.21.15.27:0/952629355 conn(0x7f583c05e820 msgr2=0x7f583c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 -- 172.21.15.27:0/952629355 shutdown_connections 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.395+0000 7f5843f2d700 1 -- 172.21.15.27:0/952629355 wait complete. 2023-05-17T15:29:55.404 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.396+0000 7f5843f2d700 1 Processor -- start 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.396+0000 7f5843f2d700 1 -- start start 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.396+0000 7f5843f2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.396+0000 7f5843f2d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c0aa130 0x7f583c0c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.396+0000 7f5843f2d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c153fa0 0x7f583c0c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.396+0000 7f5843f2d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1684d0 con 0x7f583c0aa130 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5843f2d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c167ba0 con 0x7f583c153fa0 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5843f2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c167e80 con 0x7f583c0826e0 2023-05-17T15:29:55.405 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c0aa130 0x7f583c0c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c0aa130 0x7f583c0c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47772/0 (socket says 172.21.15.27:47772) 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 -- 172.21.15.27:0/1750440873 learned_addr learned my addr 172.21.15.27:0/1750440873 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5841cc9700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58424ca700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c153fa0 0x7f583c0c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 -- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 msgr2=0x7f583c1497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f583c0826e0 0x7f583c1497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.406 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 -- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c153fa0 msgr2=0x7f583c0c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c153fa0 0x7f583c0c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 -- 172.21.15.27:0/1750440873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009370 con 0x7f583c0aa130 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f58414c8700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c0aa130 0x7f583c0c3ce0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f583000c440 tx=0x7f5830007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830012400 con 0x7f583c0aa130 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830012580 con 0x7f583c0aa130 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c168160 con 0x7f583c0aa130 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830012940 con 0x7f583c0aa130 2023-05-17T15:29:55.407 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.397+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c149cc0 con 0x7f583c0aa130 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.398+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f583c06bdf0 con 0x7f583c0aa130 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5830019030 con 0x7f583c0aa130 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5839ffb700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f582805ed90 0x7f5828061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f5830078d00 con 0x7f583c0aa130 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5841cc9700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f582805ed90 0x7f5828061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5839ffb700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f5828065780 0x7f5828067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.408 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 --> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58280682a0 con 0x7f5828065780 2023-05-17T15:29:55.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7f583007b370 con 0x7f583c0aa130 2023-05-17T15:29:55.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.399+0000 7f5841cc9700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f582805ed90 0x7f5828061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5834009130 tx=0x7f5834017000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.400+0000 7f58424ca700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f5828065780 0x7f5828067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.400+0000 7f58424ca700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f5828065780 0x7f5828067c20 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.409 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.401+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== osd.5 v2:172.21.15.40:6808/116763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f58280682a0 con 0x7f5828065780 2023-05-17T15:29:55.417 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.414+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 --> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f583c168610 con 0x7f5828065780 2023-05-17T15:29:55.418 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.414+0000 7f5839ffb700 1 -- 172.21.15.27:0/1750440873 <== osd.5 v2:172.21.15.40:6808/116763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f583c168610 con 0x7f5828065780 2023-05-17T15:29:55.418 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:55.418 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:55.419 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:55.419 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.414+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f5828065780 msgr2=0x7f5828067c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.414+0000 7f5843f2d700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.40:6808/116763,v1:172.21.15.40:6809/116763] conn(0x7f5828065780 0x7f5828067c20 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f582805ed90 msgr2=0x7f5828061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f582805ed90 0x7f5828061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5834009130 tx=0x7f5834017000).stop 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c0aa130 msgr2=0x7f583c0c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 --2- 172.21.15.27:0/1750440873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f583c0aa130 0x7f583c0c3ce0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f583000c440 tx=0x7f5830007de0).stop 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f58424ca700 1 -- 172.21.15.27:0/1750440873 reap_dead start 2023-05-17T15:29:55.420 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 shutdown_connections 2023-05-17T15:29:55.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 >> 172.21.15.27:0/1750440873 conn(0x7f583c05e820 msgr2=0x7f583c0c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 shutdown_connections 2023-05-17T15:29:55.421 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.415+0000 7f5843f2d700 1 -- 172.21.15.27:0/1750440873 wait complete. 2023-05-17T15:29:55.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-05-17T15:29:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.543+0000 7fcc7b788700 1 Processor -- start 2023-05-17T15:29:55.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.543+0000 7fcc7b788700 1 -- start start 2023-05-17T15:29:55.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc7b788700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcc7414f7a0 0x7fcc74063fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc7b788700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc7414fb80 0x7fcc740633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc7b788700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc740645b0 con 0x7fcc74152d10 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc7b788700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc74064b70 con 0x7fcc7414f7a0 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc7b788700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc74064890 con 0x7fcc7414fb80 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcc7414f7a0 0x7fcc74063fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcc7414f7a0 0x7fcc74063fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47780/0 (socket says 172.21.15.27:47780) 2023-05-17T15:29:55.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 -- 172.21.15.27:0/470334112 learned_addr learned my addr 172.21.15.27:0/470334112 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc78d23700 1 --2- 172.21.15.27:0/470334112 >> v2:172.21.15.40:3300/0 conn(0x7fcc7414fb80 0x7fcc740633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 -- 172.21.15.27:0/470334112 >> v2:172.21.15.40:3300/0 conn(0x7fcc7414fb80 msgr2=0x7fcc740633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 --2- 172.21.15.27:0/470334112 >> v2:172.21.15.40:3300/0 conn(0x7fcc7414fb80 0x7fcc740633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 -- 172.21.15.27:0/470334112 >> v1:172.21.15.40:6789/0 conn(0x7fcc74152d10 legacy=0x7fcc7405dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.544+0000 7fcc79524700 1 -- 172.21.15.27:0/470334112 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74152510 con 0x7fcc7414f7a0 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc79524700 1 --2- 172.21.15.27:0/470334112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc74063fd0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fcc74066ac0 tx=0x7fcc6c0090f0).ready entity=mon.0 client_cookie=4c3f3839640d01ee server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc73fff700 1 -- 172.21.15.27:0/470334112 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00b600 con 0x7fcc7414f7a0 2023-05-17T15:29:55.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc73fff700 1 -- 172.21.15.27:0/470334112 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00b760 con 0x7fcc7414f7a0 2023-05-17T15:29:55.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc73fff700 1 -- 172.21.15.27:0/470334112 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00bae0 con 0x7fcc7414f7a0 2023-05-17T15:29:55.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 -- 172.21.15.27:0/470334112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 msgr2=0x7fcc74063fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 --2- 172.21.15.27:0/470334112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc74063fd0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fcc74066ac0 tx=0x7fcc6c0090f0).stop 2023-05-17T15:29:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 -- 172.21.15.27:0/470334112 shutdown_connections 2023-05-17T15:29:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 --2- 172.21.15.27:0/470334112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc74063fd0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 --2- 172.21.15.27:0/470334112 >> v2:172.21.15.40:3300/0 conn(0x7fcc7414fb80 0x7fcc740633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 -- 172.21.15.27:0/470334112 >> 172.21.15.27:0/470334112 conn(0x7fcc740c8390 msgr2=0x7fcc740c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 -- 172.21.15.27:0/470334112 shutdown_connections 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.545+0000 7fcc7b788700 1 -- 172.21.15.27:0/470334112 wait complete. 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.546+0000 7fcc7b788700 1 Processor -- start 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.546+0000 7fcc7b788700 1 -- start start 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc7b788700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc740be960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc7b788700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7414fb80 0x7fcc740c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc7b788700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc74152d10 0x7fcc74136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc7b788700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740acc40 con 0x7fcc7414f7a0 2023-05-17T15:29:55.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc7b788700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740bef40 con 0x7fcc7414fb80 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc7b788700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740ac310 con 0x7fcc74152d10 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc79524700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc740be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc79524700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc740be960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47784/0 (socket says 172.21.15.27:47784) 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.547+0000 7fcc79524700 1 -- 172.21.15.27:0/675045096 learned_addr learned my addr 172.21.15.27:0/675045096 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc78d23700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7414fb80 0x7fcc740c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79d25700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc74152d10 0x7fcc74136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79524700 1 -- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc74152d10 msgr2=0x7fcc74136a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79524700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc74152d10 0x7fcc74136a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79524700 1 -- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7414fb80 msgr2=0x7fcc740c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79524700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7414fb80 0x7fcc740c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79524700 1 -- 172.21.15.27:0/675045096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c009370 con 0x7fcc7414f7a0 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc79524700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc740be960 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fcc6c009130 tx=0x7fcc6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00b8d0 con 0x7fcc7414f7a0 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00ba30 con 0x7fcc7414f7a0 2023-05-17T15:29:55.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc740ac5f0 con 0x7fcc7414f7a0 2023-05-17T15:29:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c01c670 con 0x7fcc7414f7a0 2023-05-17T15:29:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.548+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc740c1b60 con 0x7fcc7414f7a0 2023-05-17T15:29:55.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.549+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc74068cc0 con 0x7fcc7414f7a0 2023-05-17T15:29:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.549+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc6c02c070 con 0x7fcc7414f7a0 2023-05-17T15:29:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.550+0000 7fcc717fa700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fcc6005ed90 0x7fcc60061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.550+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fcc6c07b620 con 0x7fcc7414f7a0 2023-05-17T15:29:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.550+0000 7fcc78d23700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fcc6005ed90 0x7fcc60061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.550+0000 7fcc78d23700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fcc6005ed90 0x7fcc60061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcc74166cf0 tx=0x7fcc68009850).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.554+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc6c04cd40 con 0x7fcc7414f7a0 2023-05-17T15:29:55.731 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.728+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc740acd80 con 0x7fcc6005ed90 2023-05-17T15:29:55.732 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.728+0000 7fcc717fa700 1 -- 172.21.15.27:0/675045096 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcc68015420 con 0x7fcc6005ed90 2023-05-17T15:29:55.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fcc6005ed90 msgr2=0x7fcc60061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fcc6005ed90 0x7fcc60061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcc74166cf0 tx=0x7fcc68009850).stop 2023-05-17T15:29:55.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 msgr2=0x7fcc740be960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc740be960 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fcc6c009130 tx=0x7fcc6c017000).stop 2023-05-17T15:29:55.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 shutdown_connections 2023-05-17T15:29:55.734 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fcc6005ed90 0x7fcc60061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc74152d10 0x7fcc74136a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc7414f7a0 0x7fcc740be960 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 --2- 172.21.15.27:0/675045096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7414fb80 0x7fcc740c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 >> 172.21.15.27:0/675045096 conn(0x7fcc740c8390 msgr2=0x7fcc7405dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 shutdown_connections 2023-05-17T15:29:55.735 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.730+0000 7fcc7b788700 1 -- 172.21.15.27:0/675045096 wait complete. 2023-05-17T15:29:55.736 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 5 to deep-scrub 2023-05-17T15:29:55.745 INFO:tasks.ceph:Scrubbing osd.6 2023-05-17T15:29:55.746 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:55.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.861+0000 7f2cc9965700 1 Processor -- start 2023-05-17T15:29:55.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.861+0000 7f2cc9965700 1 -- start start 2023-05-17T15:29:55.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc9965700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cc4151c90 0x7f2cc4152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc9965700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc40c0520 0x7f2cc4081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc9965700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc4158010 con 0x7f2cc4154980 2023-05-17T15:29:55.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc9965700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc4154f60 con 0x7f2cc4151c90 2023-05-17T15:29:55.866 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc9965700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4155240 con 0x7f2cc40c0520 2023-05-17T15:29:55.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cc4151c90 0x7f2cc4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc40c0520 0x7f2cc4081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.868 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc27fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2cc4154980 0x7f2cc40c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.27:53356/0 (socket says 172.21.15.27:53356) 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.862+0000 7f2cc27fc700 1 -- 172.21.15.27:0/3018303454 learned_addr learned my addr 172.21.15.27:0/3018303454 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc1ffb700 1 -- 172.21.15.27:0/3018303454 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756023518 0 0) 0x7f2cc4158010 con 0x7f2cc4154980 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc1ffb700 1 -- 172.21.15.27:0/3018303454 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb00033f0 con 0x7f2cc4154980 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc2ffd700 1 -- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc40c0520 msgr2=0x7f2cc4081fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc2ffd700 1 --2- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc40c0520 0x7f2cc4081fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc2ffd700 1 -- 172.21.15.27:0/3018303454 >> v1:172.21.15.40:6789/0 conn(0x7f2cc4154980 legacy=0x7f2cc40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc2ffd700 1 -- 172.21.15.27:0/3018303454 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4155520 con 0x7f2cc4151c90 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc37fe700 1 --2- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc40c0520 0x7f2cc4081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc2ffd700 1 --2- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc4151c90 0x7f2cc4152070 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f2cbc009e60 tx=0x7f2cbc009780).ready entity=mon.1 client_cookie=b02468610bf290e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc1ffb700 1 -- 172.21.15.27:0/3018303454 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00e070 con 0x7f2cc4151c90 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc1ffb700 1 -- 172.21.15.27:0/3018303454 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00bab0 con 0x7f2cc4151c90 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.863+0000 7f2cc1ffb700 1 -- 172.21.15.27:0/3018303454 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00be30 con 0x7f2cc4151c90 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 -- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc4151c90 msgr2=0x7f2cc4152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 --2- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc4151c90 0x7f2cc4152070 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f2cbc009e60 tx=0x7f2cbc009780).stop 2023-05-17T15:29:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 -- 172.21.15.27:0/3018303454 shutdown_connections 2023-05-17T15:29:55.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 --2- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc40c0520 0x7f2cc4081fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 --2- 172.21.15.27:0/3018303454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc4151c90 0x7f2cc4152070 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 -- 172.21.15.27:0/3018303454 >> 172.21.15.27:0/3018303454 conn(0x7f2cc40cae10 msgr2=0x7f2cc40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 -- 172.21.15.27:0/3018303454 shutdown_connections 2023-05-17T15:29:55.871 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.864+0000 7f2cc9965700 1 -- 172.21.15.27:0/3018303454 wait complete. 2023-05-17T15:29:55.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.865+0000 7f2cc9965700 1 Processor -- start 2023-05-17T15:29:55.873 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.865+0000 7f2cc9965700 1 -- start start 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc9965700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc40c0520 0x7f2cc40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc9965700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc4151c90 0x7f2cc413c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc9965700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc4154980 0x7f2cc4150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc9965700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4168670 con 0x7f2cc4154980 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc9965700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4168950 con 0x7f2cc40c0520 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc9965700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4168c30 con 0x7f2cc4151c90 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc4154980 0x7f2cc4150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.874 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc4154980 0x7f2cc4150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47802/0 (socket says 172.21.15.27:47802) 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 -- 172.21.15.27:0/910768041 learned_addr learned my addr 172.21.15.27:0/910768041 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc27fc700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc4151c90 0x7f2cc413c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc2ffd700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc40c0520 0x7f2cc40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 -- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc4151c90 msgr2=0x7f2cc413c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc4151c90 0x7f2cc413c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 -- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc40c0520 msgr2=0x7f2cc40c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.875 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc40c0520 0x7f2cc40c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 -- 172.21.15.27:0/910768041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40092a0 con 0x7f2cc4154980 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.866+0000 7f2cc37fe700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc4154980 0x7f2cc4150550 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f2cb400e900 tx=0x7f2cb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.867+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4012600 con 0x7f2cc4154980 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.867+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4012760 con 0x7f2cc4154980 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.867+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4012b00 con 0x7f2cc4154980 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.867+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc009a20 con 0x7f2cc4154980 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.867+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc41584a0 con 0x7f2cc4154980 2023-05-17T15:29:55.876 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.867+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2cc406bdf0 con 0x7f2cc4154980 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.868+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2cb4022070 con 0x7f2cc4154980 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.868+0000 7f2cbaffd700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2ca405ed90 0x7f2ca4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.868+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f2cb407a410 con 0x7f2cc4154980 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cc2ffd700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2ca405ed90 0x7f2ca4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cbaffd700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f2ca4065780 0x7f2ca4067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 --> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ca40682a0 con 0x7f2ca4065780 2023-05-17T15:29:55.877 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cb407a810 con 0x7f2cc4154980 2023-05-17T15:29:55.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cc2ffd700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2ca405ed90 0x7f2ca4061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2cbc009e60 tx=0x7f2cbc009780).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cc27fc700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f2ca4065780 0x7f2ca4067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:55.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.869+0000 7f2cc27fc700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f2ca4065780 0x7f2ca4067c20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:55.878 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.870+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== osd.6 v2:172.21.15.40:6816/116764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2ca40682a0 con 0x7f2ca4065780 2023-05-17T15:29:55.887 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.883+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 --> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2cc41586c0 con 0x7f2ca4065780 2023-05-17T15:29:55.888 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.884+0000 7f2cbaffd700 1 -- 172.21.15.27:0/910768041 <== osd.6 v2:172.21.15.40:6816/116764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2cc41586c0 con 0x7f2ca4065780 2023-05-17T15:29:55.888 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:55.888 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:55.888 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:55.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.884+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f2ca4065780 msgr2=0x7f2ca4067c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.889 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.884+0000 7f2cc9965700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.40:6816/116764,v1:172.21.15.40:6817/116764] conn(0x7f2ca4065780 0x7f2ca4067c20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.884+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2ca405ed90 msgr2=0x7f2ca4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f2ca405ed90 0x7f2ca4061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2cbc009e60 tx=0x7f2cbc009780).stop 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc4154980 msgr2=0x7f2cc4150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 --2- 172.21.15.27:0/910768041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2cc4154980 0x7f2cc4150550 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f2cb400e900 tx=0x7f2cb4009060).stop 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc37fe700 1 -- 172.21.15.27:0/910768041 reap_dead start 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 shutdown_connections 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 >> 172.21.15.27:0/910768041 conn(0x7f2cc40cae10 msgr2=0x7f2cc40c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 shutdown_connections 2023-05-17T15:29:55.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:55.885+0000 7f2cc9965700 1 -- 172.21.15.27:0/910768041 wait complete. 2023-05-17T15:29:55.900 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-05-17T15:29:56.016 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.013+0000 7faf3359e700 1 Processor -- start 2023-05-17T15:29:56.017 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.013+0000 7faf3359e700 1 -- start start 2023-05-17T15:29:56.019 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 0x7faf340cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf34157980 0x7faf340c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3359e700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340c60d0 con 0x7faf341537e0 2023-05-17T15:29:56.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf341588b0 con 0x7faf34157980 2023-05-17T15:29:56.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34157e00 con 0x7faf340cac00 2023-05-17T15:29:56.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf32d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faf341537e0 0x7faf34153c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47374/0 (socket says 172.21.15.27:47374) 2023-05-17T15:29:56.020 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf32d9d700 1 -- 172.21.15.27:0/1394112171 learned_addr learned my addr 172.21.15.27:0/1394112171 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3259c700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 0x7faf340cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf31d9b700 1 --2- 172.21.15.27:0/1394112171 >> v2:172.21.15.40:3300/0 conn(0x7faf34157980 0x7faf340c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670594248 0 0) 0x7faf340c60d0 con 0x7faf341537e0 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf200033f0 con 0x7faf341537e0 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892617579 0 0) 0x7faf200033f0 con 0x7faf341537e0 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 msgr2=0x7faf340cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 0x7faf340cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.021 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 >> v2:172.21.15.40:3300/0 conn(0x7faf34157980 msgr2=0x7faf340c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 --2- 172.21.15.27:0/1394112171 >> v2:172.21.15.40:3300/0 conn(0x7faf34157980 0x7faf340c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34158010 con 0x7faf341537e0 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7faf240017f0 con 0x7faf341537e0 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 >> v1:172.21.15.27:6789/0 conn(0x7faf341537e0 legacy=0x7faf34153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf200038e0 0x7faf20003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 0x7faf20004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf20004b80 0x7faf20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.022 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf341588b0 con 0x7faf200038e0 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34157e00 con 0x7faf20004b80 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.014+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2000b8e0 con 0x7faf340cac00 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf200038e0 0x7faf20003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf31d9b700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 0x7faf20004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf32d9d700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf20004b80 0x7faf20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 -- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 msgr2=0x7faf20004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.023 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf340cac00 0x7faf20004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 -- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf20004b80 msgr2=0x7faf20005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf20004b80 0x7faf20005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 -- 172.21.15.27:0/1394112171 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200033f0 con 0x7faf200038e0 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3259c700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf200038e0 0x7faf20003d00 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7faf2c009a60 tx=0x7faf2c009060).ready entity=mon.0 client_cookie=fc86024b11ed217d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c009ea0 con 0x7faf200038e0 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c009430 con 0x7faf200038e0 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3159a700 1 -- 172.21.15.27:0/1394112171 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00e870 con 0x7faf200038e0 2023-05-17T15:29:56.024 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3359e700 1 -- 172.21.15.27:0/1394112171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf200038e0 msgr2=0x7faf20003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.015+0000 7faf3359e700 1 --2- 172.21.15.27:0/1394112171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf200038e0 0x7faf20003d00 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7faf2c009a60 tx=0x7faf2c009060).stop 2023-05-17T15:29:56.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.016+0000 7faf32d9d700 1 -- 172.21.15.27:0/1394112171 reap_dead start 2023-05-17T15:29:56.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.016+0000 7faf3359e700 1 -- 172.21.15.27:0/1394112171 shutdown_connections 2023-05-17T15:29:56.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.016+0000 7faf3359e700 1 -- 172.21.15.27:0/1394112171 >> 172.21.15.27:0/1394112171 conn(0x7faf3405dd50 msgr2=0x7faf3405e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.016+0000 7faf3359e700 1 -- 172.21.15.27:0/1394112171 shutdown_connections 2023-05-17T15:29:56.025 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.016+0000 7faf3359e700 1 -- 172.21.15.27:0/1394112171 wait complete. 2023-05-17T15:29:56.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.017+0000 7faf3359e700 1 Processor -- start 2023-05-17T15:29:56.027 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.017+0000 7faf3359e700 1 -- start start 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.017+0000 7faf3359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf200038e0 0x7faf340a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 0x7faf340af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf34156ef0 0x7faf34157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340aa390 con 0x7faf340aee70 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34147e00 con 0x7faf200038e0 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34152da0 con 0x7faf34156ef0 2023-05-17T15:29:56.028 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 0x7faf340af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 0x7faf340af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47822/0 (socket says 172.21.15.27:47822) 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 -- 172.21.15.27:0/1263620271 learned_addr learned my addr 172.21.15.27:0/1263620271 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf32d9d700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf34156ef0 0x7faf34157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3259c700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf200038e0 0x7faf340a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 -- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf34156ef0 msgr2=0x7faf34157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf34156ef0 0x7faf34157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 -- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf200038e0 msgr2=0x7faf340a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.029 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf200038e0 0x7faf340a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 -- 172.21.15.27:0/1263620271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340ae9e0 con 0x7faf340aee70 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf31d9b700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 0x7faf340af2f0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7faf1c011760 tx=0x7faf1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0145f0 con 0x7faf340aee70 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c014750 con 0x7faf340aee70 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340addd0 con 0x7faf340aee70 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c014ad0 con 0x7faf340aee70 2023-05-17T15:29:56.030 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.018+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340ae390 con 0x7faf340aee70 2023-05-17T15:29:56.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.019+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf340aeb70 con 0x7faf340aee70 2023-05-17T15:29:56.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.020+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faf1c012040 con 0x7faf340aee70 2023-05-17T15:29:56.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.020+0000 7faf2a7fc700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7faf1405ed90 0x7faf14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.020+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7faf1c079ea0 con 0x7faf340aee70 2023-05-17T15:29:56.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.020+0000 7faf3259c700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7faf1405ed90 0x7faf14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.031 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.020+0000 7faf3259c700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7faf1405ed90 0x7faf14061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faf2c006d50 tx=0x7faf2c01a000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.032 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.024+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf1c04b540 con 0x7faf340aee70 2023-05-17T15:29:56.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.195+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faf341582f0 con 0x7faf1405ed90 2023-05-17T15:29:56.199 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.195+0000 7faf2a7fc700 1 -- 172.21.15.27:0/1263620271 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf341582f0 con 0x7faf1405ed90 2023-05-17T15:29:56.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7faf1405ed90 msgr2=0x7faf14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7faf1405ed90 0x7faf14061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faf2c006d50 tx=0x7faf2c01a000).stop 2023-05-17T15:29:56.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 msgr2=0x7faf340af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 0x7faf340af2f0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7faf1c011760 tx=0x7faf1c008040).stop 2023-05-17T15:29:56.201 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 shutdown_connections 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7faf1405ed90 0x7faf14061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf34156ef0 0x7faf34157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf200038e0 0x7faf340a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 --2- 172.21.15.27:0/1263620271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf340aee70 0x7faf340af2f0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 >> 172.21.15.27:0/1263620271 conn(0x7faf3405dd50 msgr2=0x7faf340ac720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 shutdown_connections 2023-05-17T15:29:56.202 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.197+0000 7faf3359e700 1 -- 172.21.15.27:0/1263620271 wait complete. 2023-05-17T15:29:56.203 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 6 to deep-scrub 2023-05-17T15:29:56.213 INFO:tasks.ceph:Scrubbing osd.7 2023-05-17T15:29:56.213 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-05-17T15:29:56.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.328+0000 7fc8711be700 1 Processor -- start 2023-05-17T15:29:56.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.328+0000 7fc8711be700 1 -- start start 2023-05-17T15:29:56.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc8711be700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc86c155180 0x7fc86c064020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc8711be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155560 0x7fc86c064510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc8711be700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc86c05dd50 0x7fc86c05e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc8711be700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c0bd300 con 0x7fc86c155180 2023-05-17T15:29:56.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc8711be700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c05e6a0 con 0x7fc86c05dd50 2023-05-17T15:29:56.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc8711be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c064ae0 con 0x7fc86c155560 2023-05-17T15:29:56.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc86ad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc86c155180 0x7fc86c064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc86ad9d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc86c155180 0x7fc86c064020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47828/0 (socket says 172.21.15.27:47828) 2023-05-17T15:29:56.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.329+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4105731024 learned_addr learned my addr 172.21.15.27:0/4105731024 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:56.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86a59c700 1 --2- 172.21.15.27:0/4105731024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155560 0x7fc86c064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86b59e700 1 --2- 172.21.15.27:0/4105731024 >> v2:172.21.15.40:3300/0 conn(0x7fc86c05dd50 0x7fc86c05e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4105731024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155560 msgr2=0x7fc86c064510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/4105731024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155560 0x7fc86c064510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4105731024 >> v2:172.21.15.40:3300/0 conn(0x7fc86c05dd50 msgr2=0x7fc86c05e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/4105731024 >> v2:172.21.15.40:3300/0 conn(0x7fc86c05dd50 0x7fc86c05e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86ad9d700 1 -- 172.21.15.27:0/4105731024 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0bc9d0 con 0x7fc86c155180 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/4105731024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c155180 0x7fc86c064020 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fc86c0693f0 tx=0x7fc8640090f0).ready entity=mon.0 client_cookie=d6358c76525ea9f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc869d9b700 1 -- 172.21.15.27:0/4105731024 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86400b600 con 0x7fc86c155180 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc869d9b700 1 -- 172.21.15.27:0/4105731024 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86400b760 con 0x7fc86c155180 2023-05-17T15:29:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc869d9b700 1 -- 172.21.15.27:0/4105731024 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86400bae0 con 0x7fc86c155180 2023-05-17T15:29:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 -- 172.21.15.27:0/4105731024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c155180 msgr2=0x7fc86c064020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 --2- 172.21.15.27:0/4105731024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c155180 0x7fc86c064020 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fc86c0693f0 tx=0x7fc8640090f0).stop 2023-05-17T15:29:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 -- 172.21.15.27:0/4105731024 shutdown_connections 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 --2- 172.21.15.27:0/4105731024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c155180 0x7fc86c064020 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 --2- 172.21.15.27:0/4105731024 >> v2:172.21.15.40:3300/0 conn(0x7fc86c05dd50 0x7fc86c05e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 --2- 172.21.15.27:0/4105731024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155560 0x7fc86c064510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 -- 172.21.15.27:0/4105731024 >> 172.21.15.27:0/4105731024 conn(0x7fc86c0c84a0 msgr2=0x7fc86c0c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.330+0000 7fc8711be700 1 -- 172.21.15.27:0/4105731024 shutdown_connections 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.331+0000 7fc8711be700 1 -- 172.21.15.27:0/4105731024 wait complete. 2023-05-17T15:29:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 Processor -- start 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 -- start start 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c05dd50 0x7fc86c14a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155180 0x7fc86c146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c155560 0x7fc86c0c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c149c40 con 0x7fc86c05dd50 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c149030 con 0x7fc86c155560 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.332+0000 7fc8711be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c149310 con 0x7fc86c155180 2023-05-17T15:29:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c05dd50 0x7fc86c14a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c05dd50 0x7fc86c14a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47834/0 (socket says 172.21.15.27:47834) 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 -- 172.21.15.27:0/1992074982 learned_addr learned my addr 172.21.15.27:0/1992074982 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86a59c700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155180 0x7fc86c146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86b59e700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c155560 0x7fc86c0c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 -- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155180 msgr2=0x7fc86c146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc86c155180 0x7fc86c146910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 -- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c155560 msgr2=0x7fc86c0c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc86c155560 0x7fc86c0c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 -- 172.21.15.27:0/1992074982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864009370 con 0x7fc86c05dd50 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc86ad9d700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c05dd50 0x7fc86c14a0d0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fc864009130 tx=0x7fc864017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86400bea0 con 0x7fc86c05dd50 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86400b8d0 con 0x7fc86c05dd50 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86401c650 con 0x7fc86c05dd50 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c1495f0 con 0x7fc86c05dd50 2023-05-17T15:29:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.333+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c146e00 con 0x7fc86c05dd50 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.334+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc86c06bdf0 con 0x7fc86c05dd50 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.334+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc86402c070 con 0x7fc86c05dd50 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc862ffd700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc84c05ed90 0x7fc84c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fc86407b490 con 0x7fc86c05dd50 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc86a59c700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc84c05ed90 0x7fc84c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc862ffd700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7fc84c065780 0x7fc84c067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 --> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc84c0682a0 con 0x7fc84c065780 2023-05-17T15:29:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=182) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc86407db00 con 0x7fc86c05dd50 2023-05-17T15:29:56.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc86a59c700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc84c05ed90 0x7fc84c061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc86c0bd7b0 tx=0x7fc854008040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.335+0000 7fc86b59e700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7fc84c065780 0x7fc84c067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.336+0000 7fc86b59e700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7fc84c065780 0x7fc84c067c20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.336+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== osd.7 v2:172.21.15.40:6824/116807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc84c0682a0 con 0x7fc84c065780 2023-05-17T15:29:56.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 --> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc86c149d80 con 0x7fc84c065780 2023-05-17T15:29:56.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc862ffd700 1 -- 172.21.15.27:0/1992074982 <== osd.7 v2:172.21.15.40:6824/116807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc85c007640 con 0x7fc84c065780 2023-05-17T15:29:56.354 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-05-17T15:29:56.354 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-17T15:29:56.354 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-05-17T15:29:56.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7fc84c065780 msgr2=0x7fc84c067c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.40:6824/116807,v1:172.21.15.40:6825/116807] conn(0x7fc84c065780 0x7fc84c067c20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc84c05ed90 msgr2=0x7fc84c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fc84c05ed90 0x7fc84c061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc86c0bd7b0 tx=0x7fc854008040).stop 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c05dd50 msgr2=0x7fc86c14a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 --2- 172.21.15.27:0/1992074982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc86c05dd50 0x7fc86c14a0d0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fc864009130 tx=0x7fc864017000).stop 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc86b59e700 1 -- 172.21.15.27:0/1992074982 reap_dead start 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 shutdown_connections 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 >> 172.21.15.27:0/1992074982 conn(0x7fc86c0c84a0 msgr2=0x7fc86c0bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 shutdown_connections 2023-05-17T15:29:56.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.350+0000 7fc8711be700 1 -- 172.21.15.27:0/1992074982 wait complete. 2023-05-17T15:29:56.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-05-17T15:29:56.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.478+0000 7f0524fd6700 1 Processor -- start 2023-05-17T15:29:56.482 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.478+0000 7f0524fd6700 1 -- start start 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f0524fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f05200cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f0524fd6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0520069060 0x7f05200c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f0524fd6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200c6650 con 0x7f05200c61a0 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f0524fd6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05200c01c0 con 0x7f0520069060 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f0524fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200698b0 con 0x7f0520153f10 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051ed9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f05200c61a0 0x7f0520157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47406/0 (socket says 172.21.15.27:47406) 2023-05-17T15:29:56.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051ed9d700 1 -- 172.21.15.27:0/190307536 learned_addr learned my addr 172.21.15.27:0/190307536 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:29:56.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051dd9b700 1 --2- 172.21.15.27:0/190307536 >> v2:172.21.15.40:3300/0 conn(0x7f0520069060 0x7f05200c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051e59c700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f05200cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927225091 0 0) 0x7f0510001490 con 0x7f05200c61a0 2023-05-17T15:29:56.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0033f0 con 0x7f05200c61a0 2023-05-17T15:29:56.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3531231083 0 0) 0x7f050c0033f0 con 0x7f05200c61a0 2023-05-17T15:29:56.486 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 msgr2=0x7f05200cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f05200cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 >> v2:172.21.15.40:3300/0 conn(0x7f0520069060 msgr2=0x7f05200c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.479+0000 7f051d59a700 1 --2- 172.21.15.27:0/190307536 >> v2:172.21.15.40:3300/0 conn(0x7f0520069060 0x7f05200c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520069b90 con 0x7f05200c61a0 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f0510001980 con 0x7f05200c61a0 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 >> v1:172.21.15.27:6789/0 conn(0x7f05200c61a0 legacy=0x7f0520157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f050c0038e0 0x7f050c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.487 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c004690 0x7f050c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f050c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200c01c0 con 0x7f050c0038e0 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200698b0 con 0x7f050c004690 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c00b8e0 con 0x7f0520153f10 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f050c0038e0 0x7f050c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051dd9b700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c004690 0x7f050c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051ed9d700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f050c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 -- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 msgr2=0x7f050c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f050c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 -- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c004690 msgr2=0x7f050c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c004690 0x7f050c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 -- 172.21.15.27:0/190307536 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0033f0 con 0x7f050c0038e0 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051dd9b700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c004690 0x7f050c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051ed9d700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0520153f10 0x7f050c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051e59c700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f050c0038e0 0x7f050c003d00 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f0518009a80 tx=0x7f0518009060).ready entity=mon.0 client_cookie=ae316a8a23d029c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518009430 con 0x7f050c0038e0 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051800e640 con 0x7f050c0038e0 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.480+0000 7f051d59a700 1 -- 172.21.15.27:0/190307536 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051800e9c0 con 0x7f050c0038e0 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f0524fd6700 1 -- 172.21.15.27:0/190307536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f050c0038e0 msgr2=0x7f050c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f0524fd6700 1 --2- 172.21.15.27:0/190307536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f050c0038e0 0x7f050c003d00 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f0518009a80 tx=0x7f0518009060).stop 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f051ed9d700 1 -- 172.21.15.27:0/190307536 reap_dead start 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f0524fd6700 1 -- 172.21.15.27:0/190307536 shutdown_connections 2023-05-17T15:29:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f0524fd6700 1 -- 172.21.15.27:0/190307536 >> 172.21.15.27:0/190307536 conn(0x7f052005e820 msgr2=0x7f05200cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f0524fd6700 1 -- 172.21.15.27:0/190307536 shutdown_connections 2023-05-17T15:29:56.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.481+0000 7f0524fd6700 1 -- 172.21.15.27:0/190307536 wait complete. 2023-05-17T15:29:56.491 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.482+0000 7f0524fd6700 1 Processor -- start 2023-05-17T15:29:56.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.482+0000 7f0524fd6700 1 -- start start 2023-05-17T15:29:56.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f0524fd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c0038e0 0x7f05201542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f0524fd6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 0x7f05200add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f0524fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05200ae1f0 0x7f05200c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f0524fd6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200ae670 con 0x7f052013f790 2023-05-17T15:29:56.493 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f0524fd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200af850 con 0x7f050c0038e0 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f0524fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200afe10 con 0x7f05200ae1f0 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 0x7f05200add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 0x7f05200add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47856/0 (socket says 172.21.15.27:47856) 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 -- 172.21.15.27:0/2646888910 learned_addr learned my addr 172.21.15.27:0/2646888910 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051e59c700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c0038e0 0x7f05201542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051ed9d700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05200ae1f0 0x7f05200c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 -- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05200ae1f0 msgr2=0x7f05200c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05200ae1f0 0x7f05200c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 -- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c0038e0 msgr2=0x7f05201542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c0038e0 0x7f05201542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 -- 172.21.15.27:0/2646888910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05201578f0 con 0x7f052013f790 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.483+0000 7f051dd9b700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 0x7f05200add00 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f0508011790 tx=0x7f0508008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.484+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508013620 con 0x7f052013f790 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.484+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508013780 con 0x7f052013f790 2023-05-17T15:29:56.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.484+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05200ae8a0 con 0x7f052013f790 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.484+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508013b00 con 0x7f052013f790 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.484+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05200afaa0 con 0x7f052013f790 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.485+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200832c0 con 0x7f052013f790 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.485+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0508012040 con 0x7f052013f790 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.486+0000 7f05167fc700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f050005ed90 0x7f0500061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.486+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f0508079ed0 con 0x7f052013f790 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.486+0000 7f051e59c700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f050005ed90 0x7f0500061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.486+0000 7f051e59c700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f050005ed90 0x7f0500061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0518006d50 tx=0x7f051801a000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.490+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f050804b570 con 0x7f052013f790 2023-05-17T15:29:56.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.668+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f05200aff50 con 0x7f050005ed90 2023-05-17T15:29:56.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.669+0000 7f05167fc700 1 -- 172.21.15.27:0/2646888910 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05200aff50 con 0x7f050005ed90 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f050005ed90 msgr2=0x7f0500061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f050005ed90 0x7f0500061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0518006d50 tx=0x7f051801a000).stop 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 msgr2=0x7f05200add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 0x7f05200add00 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f0508011790 tx=0x7f0508008040).stop 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 shutdown_connections 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f050005ed90 0x7f0500061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05200ae1f0 0x7f05200c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f050c0038e0 0x7f05201542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 --2- 172.21.15.27:0/2646888910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f052013f790 0x7f05200add00 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 >> 172.21.15.27:0/2646888910 conn(0x7f052005e820 msgr2=0x7f05200aa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 shutdown_connections 2023-05-17T15:29:56.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.671+0000 7f0524fd6700 1 -- 172.21.15.27:0/2646888910 wait complete. 2023-05-17T15:29:56.677 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 7 to deep-scrub 2023-05-17T15:29:56.687 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:29:56.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.798+0000 7f1b3826c700 1 Processor -- start 2023-05-17T15:29:56.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.798+0000 7f1b3826c700 1 -- start start 2023-05-17T15:29:56.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b3826c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b300c60c0 0x7f1b300c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.803 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b3826c700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b300a9f70 0x7f1b30153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b3826c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b30154260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b3826c700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b30154750 con 0x7f1b300a9f70 2023-05-17T15:29:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b3826c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3005e7e0 con 0x7f1b300c60c0 2023-05-17T15:29:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b3826c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3005eac0 con 0x7f1b300aa3b0 2023-05-17T15:29:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b35807700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b300a9f70 0x7f1b30153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.804 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b35807700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1b300a9f70 0x7f1b30153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47862/0 (socket says 172.21.15.27:47862) 2023-05-17T15:29:56.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b35807700 1 -- 172.21.15.27:0/2081053562 learned_addr learned my addr 172.21.15.27:0/2081053562 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:56.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b36008700 1 --2- 172.21.15.27:0/2081053562 >> v2:172.21.15.40:3300/0 conn(0x7f1b300c60c0 0x7f1b300c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b36809700 1 --2- 172.21.15.27:0/2081053562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b30154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.805 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b35807700 1 -- 172.21.15.27:0/2081053562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 msgr2=0x7f1b30154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.799+0000 7f1b35807700 1 --2- 172.21.15.27:0/2081053562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b30154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35807700 1 -- 172.21.15.27:0/2081053562 >> v2:172.21.15.40:3300/0 conn(0x7f1b300c60c0 msgr2=0x7f1b300c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:29:56.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35807700 1 --2- 172.21.15.27:0/2081053562 >> v2:172.21.15.40:3300/0 conn(0x7f1b300c60c0 0x7f1b300c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35807700 1 -- 172.21.15.27:0/2081053562 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300bfd70 con 0x7f1b300a9f70 2023-05-17T15:29:56.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b36008700 1 --2- 172.21.15.27:0/2081053562 >> v2:172.21.15.40:3300/0 conn(0x7f1b300c60c0 0x7f1b300c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:29:56.806 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35807700 1 --2- 172.21.15.27:0/2081053562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b30153d70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f1b3005eff0 tx=0x7f1b240090f0).ready entity=mon.0 client_cookie=8400855a6c65ecf5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35006700 1 -- 172.21.15.27:0/2081053562 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400b600 con 0x7f1b300a9f70 2023-05-17T15:29:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35006700 1 -- 172.21.15.27:0/2081053562 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400b760 con 0x7f1b300a9f70 2023-05-17T15:29:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b35006700 1 -- 172.21.15.27:0/2081053562 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400bae0 con 0x7f1b300a9f70 2023-05-17T15:29:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 -- 172.21.15.27:0/2081053562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 msgr2=0x7f1b30153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 --2- 172.21.15.27:0/2081053562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b30153d70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f1b3005eff0 tx=0x7f1b240090f0).stop 2023-05-17T15:29:56.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 -- 172.21.15.27:0/2081053562 shutdown_connections 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 --2- 172.21.15.27:0/2081053562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b30154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 --2- 172.21.15.27:0/2081053562 >> v2:172.21.15.40:3300/0 conn(0x7f1b300c60c0 0x7f1b300c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 --2- 172.21.15.27:0/2081053562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b30153d70 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 -- 172.21.15.27:0/2081053562 >> 172.21.15.27:0/2081053562 conn(0x7f1b30069e70 msgr2=0x7f1b3005dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 -- 172.21.15.27:0/2081053562 shutdown_connections 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.800+0000 7f1b3826c700 1 -- 172.21.15.27:0/2081053562 wait complete. 2023-05-17T15:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.801+0000 7f1b3826c700 1 Processor -- start 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 -- start start 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b300af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b300add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b300c60c0 0x7f1b300caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300aeef0 con 0x7f1b300a9f70 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300ca3e0 con 0x7f1b300c60c0 2023-05-17T15:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b3826c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300ae2e0 con 0x7f1b300aa3b0 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b36008700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b300af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b36008700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b300af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47868/0 (socket says 172.21.15.27:47868) 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.802+0000 7f1b36008700 1 -- 172.21.15.27:0/3525431663 learned_addr learned my addr 172.21.15.27:0/3525431663 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b35807700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b300add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36809700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b300c60c0 0x7f1b300caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36008700 1 -- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 msgr2=0x7f1b300add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36008700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b300add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36008700 1 -- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b300c60c0 msgr2=0x7f1b300caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36008700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b300c60c0 0x7f1b300caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36008700 1 -- 172.21.15.27:0/3525431663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009370 con 0x7f1b300a9f70 2023-05-17T15:29:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b36008700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b300af380 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f1b2800d890 tx=0x7f1b28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280125f0 con 0x7f1b300a9f70 2023-05-17T15:29:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28012750 con 0x7f1b300a9f70 2023-05-17T15:29:56.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b300ae5c0 con 0x7f1b300a9f70 2023-05-17T15:29:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28012ad0 con 0x7f1b300a9f70 2023-05-17T15:29:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.803+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b300aeb80 con 0x7f1b300a9f70 2023-05-17T15:29:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.804+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3005f4a0 con 0x7f1b300a9f70 2023-05-17T15:29:56.814 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.804+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1b28013480 con 0x7f1b300a9f70 2023-05-17T15:29:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.805+0000 7f1b2e7fc700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1b1c05ed90 0x7f1b1c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:29:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.805+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f1b28079d10 con 0x7f1b300a9f70 2023-05-17T15:29:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.805+0000 7f1b35807700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1b1c05ed90 0x7f1b1c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:29:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.805+0000 7f1b35807700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1b1c05ed90 0x7f1b1c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1b24009130 tx=0x7f1b24017000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:29:56.815 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.809+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b2804b350 con 0x7f1b300a9f70 2023-05-17T15:29:56.982 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.979+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b300af030 con 0x7f1b1c05ed90 2023-05-17T15:29:56.985 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.981+0000 7f1b2e7fc700 1 -- 172.21.15.27:0/3525431663 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71134 (secure 0 0 0) 0x7f1b24000bc0 con 0x7f1b1c05ed90 2023-05-17T15:29:56.986 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:29:56.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1b1c05ed90 msgr2=0x7f1b1c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1b1c05ed90 0x7f1b1c061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1b24009130 tx=0x7f1b24017000).stop 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 msgr2=0x7f1b300af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b300af380 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f1b2800d890 tx=0x7f1b28008040).stop 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 shutdown_connections 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f1b1c05ed90 0x7f1b1c061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b300c60c0 0x7f1b300caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b300a9f70 0x7f1b300af380 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 --2- 172.21.15.27:0/3525431663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b300aa3b0 0x7f1b300add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:29:56.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 >> 172.21.15.27:0/3525431663 conn(0x7f1b30069e70 msgr2=0x7f1b3014e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:29:56.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.983+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 shutdown_connections 2023-05-17T15:29:56.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:29:56.984+0000 7f1b3826c700 1 -- 172.21.15.27:0/3525431663 wait complete. 2023-05-17T15:29:56.989 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:29:56.999 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-05-17T15:29:56.812853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":183872,"kb_used_data":17792,"kb_used_omap":0,"kb_used_meta":166016,"kb_avail":754790848,"statfs":{"total":773094113280,"available":772905828352,"internally_reserved":0,"allocated":18219008,"data_stored":9288880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":170000384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11962,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.628758"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:29:54.529148+0000","last_change":"2023-05-17T15:29:54.529148+0000","last_active":"2023-05-17T15:29:54.529148+0000","last_peered":"2023-05-17T15:29:54.529148+0000","last_clean":"2023-05-17T15:29:54.529148+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:54.529148+0000","last_undegraded":"2023-05-17T15:29:54.529148+0000","last_fullsized":"2023-05-17T15:29:54.529148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:54.528993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:54.528993+0000","last_clean_scrub_stamp":"2023-05-17T15:29:54.528993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.451488+0000","last_change":"2023-05-17T14:53:47.618695+0000","last_active":"2023-05-17T15:29:46.451488+0000","last_peered":"2023-05-17T15:29:46.451488+0000","last_clean":"2023-05-17T15:29:46.451488+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:46.451488+0000","last_undegraded":"2023-05-17T15:29:46.451488+0000","last_fullsized":"2023-05-17T15:29:46.451488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.446698+0000","last_change":"2023-05-17T14:53:47.615642+0000","last_active":"2023-05-17T15:29:46.446698+0000","last_peered":"2023-05-17T15:29:46.446698+0000","last_clean":"2023-05-17T15:29:46.446698+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:29:46.446698+0000","last_undegraded":"2023-05-17T15:29:46.446698+0000","last_fullsized":"2023-05-17T15:29:46.446698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.455122+0000","last_change":"2023-05-17T14:53:47.617695+0000","last_active":"2023-05-17T15:29:46.455122+0000","last_peered":"2023-05-17T15:29:46.455122+0000","last_clean":"2023-05-17T15:29:46.455122+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:29:46.455122+0000","last_undegraded":"2023-05-17T15:29:46.455122+0000","last_fullsized":"2023-05-17T15:29:46.455122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":147,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.820496+0000","last_change":"2023-05-17T14:53:46.229020+0000","last_active":"2023-05-17T15:29:46.820496+0000","last_peered":"2023-05-17T15:29:46.820496+0000","last_clean":"2023-05-17T15:29:46.820496+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:46.820496+0000","last_undegraded":"2023-05-17T15:29:46.820496+0000","last_fullsized":"2023-05-17T15:29:46.820496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:44.587209+0000","last_clean_scrub_stamp":"2023-05-17T14:53:44.587209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.820588+0000","last_change":"2023-05-17T14:53:47.618176+0000","last_active":"2023-05-17T15:29:46.820588+0000","last_peered":"2023-05-17T15:29:46.820588+0000","last_clean":"2023-05-17T15:29:46.820588+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:29:46.820588+0000","last_undegraded":"2023-05-17T15:29:46.820588+0000","last_fullsized":"2023-05-17T15:29:46.820588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.821599+0000","last_change":"2023-05-17T14:53:48.215418+0000","last_active":"2023-05-17T15:29:46.821599+0000","last_peered":"2023-05-17T15:29:46.821599+0000","last_clean":"2023-05-17T15:29:46.821599+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:29:46.821599+0000","last_undegraded":"2023-05-17T15:29:46.821599+0000","last_fullsized":"2023-05-17T15:29:46.821599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":147,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:29:55.530127+0000","last_change":"2023-05-17T15:29:55.530127+0000","last_active":"2023-05-17T15:29:55.530127+0000","last_peered":"2023-05-17T15:29:55.530127+0000","last_clean":"2023-05-17T15:29:55.530127+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:55.530127+0000","last_undegraded":"2023-05-17T15:29:55.530127+0000","last_fullsized":"2023-05-17T15:29:55.530127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:55.530037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:55.530037+0000","last_clean_scrub_stamp":"2023-05-17T15:29:55.530037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-05-17T15:29:46.824084+0000","last_change":"2023-05-17T14:53:47.623502+0000","last_active":"2023-05-17T15:29:46.824084+0000","last_peered":"2023-05-17T15:29:46.824084+0000","last_clean":"2023-05-17T15:29:46.824084+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:29:46.824084+0000","last_undegraded":"2023-05-17T15:29:46.824084+0000","last_fullsized":"2023-05-17T15:29:46.824084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T14:53:46.596156+0000","last_clean_scrub_stamp":"2023-05-17T14:53:46.596156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575273,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21304,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19072,"kb_avail":94350536,"statfs":{"total":96636764160,"available":96614948864,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19529728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.86299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.29399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.86899999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.90000000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70499999999999996}]},{"osd":2,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.88},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.89000000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.872},"last":0.58799999999999997}]},{"osd":4,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.65900000000000003,"5min":0.71699999999999997,"15min":0.78700000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69799999999999995,"5min":0.77100000000000002,"15min":0.84999999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.81000000000000005,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":0.81399999999999995,"15min":0.876},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed May 17 15:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72399999999999998,"5min":0.86199999999999999,"15min":0.86399999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.86899999999999999},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575274,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20984,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18752,"kb_avail":94350856,"statfs":{"total":96636764160,"available":96615276544,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19202048},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.54700000000000004,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65100000000000002}]},{"osd":2,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":0.876},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.91200000000000003},"last":0.81699999999999995}]},{"osd":4,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.504,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.88700000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed May 17 15:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.88600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575274,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20344,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18112,"kb_avail":94351496,"statfs":{"total":96636764160,"available":96615931904,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18546688},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.307},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.63,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.83799999999999997},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.26400000000000001},"max":{"1min":0.61299999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.438},"min":{"1min":0.31900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59099999999999997,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.33400000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.47799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.91200000000000003,"15min":1.0349999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.006,"15min":1.006},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66000000000000003,"15min":0.67300000000000004},"min":{"1min":0.50700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.499,"5min":0.377,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.95099999999999996,"15min":1.0409999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed May 17 15:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575274,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20920,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350920,"statfs":{"total":96636764160,"available":96615342080,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.25},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.26600000000000001}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.60199999999999998}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.54500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575273,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.51300000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.375},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.26700000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45600000000000002,"5min":1.254,"15min":1.254},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.63400000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":1.04,"15min":1.04},"last":0.34300000000000003}]},{"osd":4,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.96599999999999997,"15min":1.006},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84799999999999998,"5min":1.0700000000000001,"15min":1.0760000000000001},"last":0.73299999999999998}]},{"osd":5,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":1.018,"15min":1.018},"last":0.72099999999999997}]},{"osd":6,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.21,"15min":1.21},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575274,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":26688,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27328512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34799999999999998,"15min":0.36099999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.50700000000000001,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.24099999999999999},"max":{"1min":0.58799999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.437,"15min":0.45300000000000001},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54800000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.376}]},{"osd":2,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.77500000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.46600000000000003,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30399999999999999},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66500000000000004,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.3799999999999999},"last":0.504},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66600000000000004,"15min":0.70199999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90300000000000002,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.623,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":1.002,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.036},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.022,"15min":1.0820000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67300000000000004,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.079},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64600000000000002,"15min":0.68500000000000005},"min":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81399999999999995,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.43099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":21048,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94350792,"statfs":{"total":96636764160,"available":96615211008,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.91200000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98499999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71299999999999997,"5min":0.80900000000000005,"15min":0.96299999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.97699999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.622},"min":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73799999999999999,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.89400000000000002,"15min":1.004},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.49199999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.623},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76900000000000002,"5min":0.87,"15min":0.87},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.70999999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.63300000000000001,"15min":0.59899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.754,"5min":1.01,"15min":1.01},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575273,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":26112,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26738688},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":1.101,"15min":1.101},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.504,"5min":0.438,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.82999999999999996}]},{"osd":1,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.748,"5min":1.012,"15min":1.012},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47099999999999997,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.995,"15min":0.995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71699999999999997,"5min":0.878,"15min":0.88400000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":0.85499999999999998,"15min":0.89700000000000002},"last":0.64100000000000001}]},{"osd":4,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.32700000000000001,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60099999999999998}]},{"osd":6,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80000000000000004,"15min":0.88},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed May 17 15:29:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.83699999999999997,"15min":0.88100000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:29:57.005 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-05-17T14:53:46.596156+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.005 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-05-17T14:53:46.596156+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.006 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-05-17T14:53:46.596156+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.006 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-05-17T14:53:44.587209+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=44, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.007 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-05-17T14:53:46.596156+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.007 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-05-17T14:53:46.596156+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.008 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-05-17T14:53:46.596156+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=14, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=17, tm_hour=15, tm_min=29, tm_sec=51, tm_wday=2, tm_yday=137, tm_isdst=0) 2023-05-17T15:29:57.008 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-17T15:30:05.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:05.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:17.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T15:30:17.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.138+0000 7f20df56d700 1 Processor -- start 2023-05-17T15:30:17.142 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.138+0000 7f20df56d700 1 -- start start 2023-05-17T15:30:17.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20df56d700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20d80c6310 0x7f20d8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20df56d700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80bfcd0 con 0x7f20d80c5f30 2023-05-17T15:30:17.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20df56d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80c0290 con 0x7f20d81541c0 2023-05-17T15:30:17.143 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20df56d700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80aa1a0 con 0x7f20d80c6310 2023-05-17T15:30:17.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20dcb08700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20d80c6310 0x7f20d8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20dd309700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f20d80c5f30 0x7f20d8158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47438/0 (socket says 172.21.15.27:47438) 2023-05-17T15:30:17.144 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.139+0000 7f20dd309700 1 -- 172.21.15.27:0/3853120389 learned_addr learned my addr 172.21.15.27:0/3853120389 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:30:17.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20dcb08700 1 -- 172.21.15.27:0/3853120389 >> v1:172.21.15.40:6789/0 conn(0x7f20d81541c0 legacy=0x7f20d80c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:30:17.145 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20dcb08700 1 -- 172.21.15.27:0/3853120389 >> v1:172.21.15.27:6789/0 conn(0x7f20d80c5f30 legacy=0x7f20d8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20cffff700 1 -- 172.21.15.27:0/3853120389 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885504551 0 0) 0x7f20d80bfcd0 con 0x7f20d80c5f30 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20dcb08700 1 -- 172.21.15.27:0/3853120389 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80aa480 con 0x7f20d80c6310 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20dcb08700 1 --2- 172.21.15.27:0/3853120389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c6310 0x7f20d8153cd0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f20c8009760 tx=0x7f20c8009060).ready entity=mon.0 client_cookie=a2cbb9ebcf09f4c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20cffff700 1 -- 172.21.15.27:0/3853120389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800b520 con 0x7f20d80c6310 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20cffff700 1 -- 172.21.15.27:0/3853120389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c800b680 con 0x7f20d80c6310 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20cffff700 1 -- 172.21.15.27:0/3853120389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800ba00 con 0x7f20d80c6310 2023-05-17T15:30:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20df56d700 1 -- 172.21.15.27:0/3853120389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c6310 msgr2=0x7f20d8153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20df56d700 1 --2- 172.21.15.27:0/3853120389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c6310 0x7f20d8153cd0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f20c8009760 tx=0x7f20c8009060).stop 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20df56d700 1 -- 172.21.15.27:0/3853120389 shutdown_connections 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20df56d700 1 --2- 172.21.15.27:0/3853120389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c6310 0x7f20d8153cd0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.140+0000 7f20df56d700 1 -- 172.21.15.27:0/3853120389 >> 172.21.15.27:0/3853120389 conn(0x7f20d8069e70 msgr2=0x7f20d805dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.141+0000 7f20df56d700 1 -- 172.21.15.27:0/3853120389 shutdown_connections 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.141+0000 7f20df56d700 1 -- 172.21.15.27:0/3853120389 wait complete. 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.142+0000 7f20df56d700 1 Processor -- start 2023-05-17T15:30:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.142+0000 7f20df56d700 1 -- start start 2023-05-17T15:30:17.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 0x7f20d80c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d80c6310 0x7f20d814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d81541c0 0x7f20d80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d814f1d0 con 0x7f20d80c5f30 2023-05-17T15:30:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81684d0 con 0x7f20d80c6310 2023-05-17T15:30:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8169330 con 0x7f20d81541c0 2023-05-17T15:30:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 0x7f20d80c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 0x7f20d80c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47882/0 (socket says 172.21.15.27:47882) 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 -- 172.21.15.27:0/3333666784 learned_addr learned my addr 172.21.15.27:0/3333666784 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dcb08700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d80c6310 0x7f20d814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 -- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d81541c0 msgr2=0x7f20d80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20ddb0a700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d81541c0 0x7f20d80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d81541c0 0x7f20d80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 -- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d80c6310 msgr2=0x7f20d814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d80c6310 0x7f20d814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 -- 172.21.15.27:0/3333666784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80092a0 con 0x7f20d80c5f30 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20ddb0a700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d81541c0 0x7f20d80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dcb08700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d80c6310 0x7f20d814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20dd309700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 0x7f20d80c1e10 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f20d000c510 tx=0x7f20d0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00072e0 con 0x7f20d80c5f30 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0007440 con 0x7f20d80c5f30 2023-05-17T15:30:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d8168720 con 0x7f20d80c5f30 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00057a0 con 0x7f20d80c5f30 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.143+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d8168ce0 con 0x7f20d80c5f30 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.144+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d8084230 con 0x7f20d80c5f30 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.145+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f20d0010070 con 0x7f20d80c5f30 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.145+0000 7f20cd7fa700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f20bc05ed60 0x7f20bc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.145+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f20d0079160 con 0x7f20d80c5f30 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.145+0000 7f20dcb08700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f20bc05ed60 0x7f20bc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.146+0000 7f20dcb08700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f20bc05ed60 0x7f20bc061220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f20d8150440 tx=0x7f20c8017000).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.149+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20d004a800 con 0x7f20d80c5f30 2023-05-17T15:30:17.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.317+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 --> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20d805f4a0 con 0x7f20bc05ed60 2023-05-17T15:30:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.320+0000 7f20cd7fa700 1 -- 172.21.15.27:0/3333666784 <== mgr.9285 v2:172.21.15.27:6836/122387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71112 (secure 0 0 0) 0x7f20d805f4a0 con 0x7f20bc05ed60 2023-05-17T15:30:17.325 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:30:17.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f20bc05ed60 msgr2=0x7f20bc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f20bc05ed60 0x7f20bc061220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f20d8150440 tx=0x7f20c8017000).stop 2023-05-17T15:30:17.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 msgr2=0x7f20d80c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 0x7f20d80c1e10 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f20d000c510 tx=0x7f20d0007c70).stop 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 shutdown_connections 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f20bc05ed60 0x7f20bc061220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d81541c0 0x7f20d80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20d80c5f30 0x7f20d80c1e10 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 --2- 172.21.15.27:0/3333666784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d80c6310 0x7f20d814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 >> 172.21.15.27:0/3333666784 conn(0x7f20d8069e70 msgr2=0x7f20d80ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:30:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 shutdown_connections 2023-05-17T15:30:17.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.322+0000 7f20df56d700 1 -- 172.21.15.27:0/3333666784 wait complete. 2023-05-17T15:30:17.328 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-05-17T15:30:17.338 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-17T15:30:16.816691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":183872,"kb_used_data":17792,"kb_used_omap":0,"kb_used_meta":166016,"kb_avail":754790848,"statfs":{"total":773094113280,"available":772905828352,"internally_reserved":0,"allocated":18219008,"data_stored":9288880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":170000384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11962,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.628758"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:29:54.529148+0000","last_change":"2023-05-17T15:29:54.529148+0000","last_active":"2023-05-17T15:29:54.529148+0000","last_peered":"2023-05-17T15:29:54.529148+0000","last_clean":"2023-05-17T15:29:54.529148+0000","last_became_active":"2023-05-17T14:53:48.214743+0000","last_became_peered":"2023-05-17T14:53:48.214743+0000","last_unstale":"2023-05-17T15:29:54.529148+0000","last_undegraded":"2023-05-17T15:29:54.529148+0000","last_fullsized":"2023-05-17T15:29:54.529148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:54.528993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:54.528993+0000","last_clean_scrub_stamp":"2023-05-17T15:29:54.528993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:29:57.349635+0000","last_change":"2023-05-17T15:29:57.349635+0000","last_active":"2023-05-17T15:29:57.349635+0000","last_peered":"2023-05-17T15:29:57.349635+0000","last_clean":"2023-05-17T15:29:57.349635+0000","last_became_active":"2023-05-17T14:53:47.618409+0000","last_became_peered":"2023-05-17T14:53:47.618409+0000","last_unstale":"2023-05-17T15:29:57.349635+0000","last_undegraded":"2023-05-17T15:29:57.349635+0000","last_fullsized":"2023-05-17T15:29:57.349635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:57.349506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:57.349506+0000","last_clean_scrub_stamp":"2023-05-17T15:29:57.349506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":149,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:30:00.283181+0000","last_change":"2023-05-17T15:30:00.283181+0000","last_active":"2023-05-17T15:30:00.283181+0000","last_peered":"2023-05-17T15:30:00.283181+0000","last_clean":"2023-05-17T15:30:00.283181+0000","last_became_active":"2023-05-17T14:53:47.615324+0000","last_became_peered":"2023-05-17T14:53:47.615324+0000","last_unstale":"2023-05-17T15:30:00.283181+0000","last_undegraded":"2023-05-17T15:30:00.283181+0000","last_fullsized":"2023-05-17T15:30:00.283181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:30:00.283071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:30:00.283071+0000","last_clean_scrub_stamp":"2023-05-17T15:30:00.283071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:30:04.369428+0000","last_change":"2023-05-17T15:30:04.369428+0000","last_active":"2023-05-17T15:30:04.369428+0000","last_peered":"2023-05-17T15:30:04.369428+0000","last_clean":"2023-05-17T15:30:04.369428+0000","last_became_active":"2023-05-17T14:53:47.617380+0000","last_became_peered":"2023-05-17T14:53:47.617380+0000","last_unstale":"2023-05-17T15:30:04.369428+0000","last_undegraded":"2023-05-17T15:30:04.369428+0000","last_fullsized":"2023-05-17T15:30:04.369428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:30:04.369305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:30:04.369305+0000","last_clean_scrub_stamp":"2023-05-17T15:30:04.369305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":152,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:29:59.816558+0000","last_change":"2023-05-17T15:29:59.816558+0000","last_active":"2023-05-17T15:29:59.816558+0000","last_peered":"2023-05-17T15:29:59.816558+0000","last_clean":"2023-05-17T15:29:59.816558+0000","last_became_active":"2023-05-17T14:53:46.228672+0000","last_became_peered":"2023-05-17T14:53:46.228672+0000","last_unstale":"2023-05-17T15:29:59.816558+0000","last_undegraded":"2023-05-17T15:29:59.816558+0000","last_fullsized":"2023-05-17T15:29:59.816558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:59.816421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:59.816421+0000","last_clean_scrub_stamp":"2023-05-17T15:29:59.816421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:30:02.725933+0000","last_change":"2023-05-17T15:30:02.725933+0000","last_active":"2023-05-17T15:30:02.725933+0000","last_peered":"2023-05-17T15:30:02.725933+0000","last_clean":"2023-05-17T15:30:02.725933+0000","last_became_active":"2023-05-17T14:53:47.617874+0000","last_became_peered":"2023-05-17T14:53:47.617874+0000","last_unstale":"2023-05-17T15:30:02.725933+0000","last_undegraded":"2023-05-17T15:30:02.725933+0000","last_fullsized":"2023-05-17T15:30:02.725933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:30:02.725813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:30:02.725813+0000","last_clean_scrub_stamp":"2023-05-17T15:30:02.725813+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:30:05.700304+0000","last_change":"2023-05-17T15:30:05.700304+0000","last_active":"2023-05-17T15:30:05.700304+0000","last_peered":"2023-05-17T15:30:05.700304+0000","last_clean":"2023-05-17T15:30:05.700304+0000","last_became_active":"2023-05-17T14:53:48.214996+0000","last_became_peered":"2023-05-17T14:53:48.214996+0000","last_unstale":"2023-05-17T15:30:05.700304+0000","last_undegraded":"2023-05-17T15:30:05.700304+0000","last_fullsized":"2023-05-17T15:30:05.700304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:30:05.700191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:30:05.700191+0000","last_clean_scrub_stamp":"2023-05-17T15:30:05.700191+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":147,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:29:55.530127+0000","last_change":"2023-05-17T15:29:55.530127+0000","last_active":"2023-05-17T15:29:55.530127+0000","last_peered":"2023-05-17T15:29:55.530127+0000","last_clean":"2023-05-17T15:29:55.530127+0000","last_became_active":"2023-05-17T14:53:47.623178+0000","last_became_peered":"2023-05-17T14:53:47.623178+0000","last_unstale":"2023-05-17T15:29:55.530127+0000","last_undegraded":"2023-05-17T15:29:55.530127+0000","last_fullsized":"2023-05-17T15:29:55.530127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:29:55.530037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:29:55.530037+0000","last_clean_scrub_stamp":"2023-05-17T15:29:55.530037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":158,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-05-17T15:30:01.039148+0000","last_change":"2023-05-17T15:30:01.039148+0000","last_active":"2023-05-17T15:30:01.039148+0000","last_peered":"2023-05-17T15:30:01.039148+0000","last_clean":"2023-05-17T15:30:01.039148+0000","last_became_active":"2023-05-17T14:53:47.623243+0000","last_became_peered":"2023-05-17T14:53:47.623243+0000","last_unstale":"2023-05-17T15:30:01.039148+0000","last_undegraded":"2023-05-17T15:30:01.039148+0000","last_fullsized":"2023-05-17T15:30:01.039148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T15:30:01.039025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T15:30:01.039025+0000","last_clean_scrub_stamp":"2023-05-17T15:30:01.039025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575277,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21304,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19072,"kb_avail":94350536,"statfs":{"total":96636764160,"available":96614948864,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19529728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.86299999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.29399999999999998},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.84199999999999997},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.90000000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.89500000000000002},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.71199999999999997,"5min":0.81599999999999995,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.89000000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.36099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.86299999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.872},"last":0.628}]},{"osd":4,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.438},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.33400000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20984,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18752,"kb_avail":94350856,"statfs":{"total":96636764160,"available":96615276544,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19202048},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55900000000000005,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.748,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.627}]},{"osd":1,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.63600000000000001},"min":{"1min":0.41699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.79600000000000004,"5min":0.88200000000000001,"15min":0.94799999999999995},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.47299999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75800000000000001,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.85499999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"max":{"1min":0.64000000000000001,"5min":0.82399999999999995,"15min":0.88700000000000001},"last":0.66000000000000003}]},{"osd":3,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":0.86299999999999999,"15min":0.876},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.91200000000000003},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.86499999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.749}]},{"osd":5,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.88700000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35499999999999998},"max":{"1min":0.79600000000000004,"5min":0.85499999999999998,"15min":0.90600000000000003},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 17 15:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84399999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575278,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20344,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18112,"kb_avail":94351496,"statfs":{"total":96636764160,"available":96615931904,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18546688},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38500000000000001,"15min":0.39600000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52400000000000002,"5min":0.58399999999999996,"15min":0.65000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.315,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.67800000000000005,"15min":0.92800000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.38500000000000001,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.46600000000000003,"5min":0.621,"15min":0.83799999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.65800000000000003,"5min":0.69299999999999995,"15min":0.78700000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.47699999999999998},"min":{"1min":0.313,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.27700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.73999999999999999,"15min":0.81999999999999995},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":1.0169999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":1.0349999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65300000000000002,"15min":0.65600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45000000000000001,"15min":0.42099999999999999},"max":{"1min":0.89100000000000001,"5min":1.006,"15min":1.006},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91000000000000003,"5min":0.96799999999999997,"15min":0.98499999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0409999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.51500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.91700000000000004,"15min":1.0669999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 17 15:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.98799999999999999,"15min":1.079},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575278,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20920,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350920,"statfs":{"total":96636764160,"available":96615342080,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1910000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.437},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":1.0980000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.26600000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":1.056},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.44800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55800000000000005,"5min":0.67200000000000004,"15min":1.669},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.72599999999999998,"15min":1.01},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.86199999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.81699999999999995,"5min":0.94199999999999995,"15min":1.222},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.1220000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.41799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.768},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.88800000000000001,"5min":0.91400000000000003,"15min":1.1799999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.93799999999999994,"15min":1.3839999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.286},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed May 17 15:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":0.97299999999999998,"15min":1.2749999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.42299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93700000000000006,"15min":1.4299999999999999},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575277,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22008,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94349832,"statfs":{"total":96636764160,"available":96614227968,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.223},"max":{"1min":0.51300000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.377}]},{"osd":1,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40000000000000002,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45600000000000002,"5min":1.254,"15min":1.254},"last":0.308},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.63400000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":1.04,"15min":1.04},"last":0.46300000000000002}]},{"osd":4,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.96599999999999997,"15min":1.006},"last":0.746},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84799999999999998,"5min":1.0700000000000001,"15min":1.0760000000000001},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78300000000000003,"5min":1.018,"15min":1.018},"last":0.63500000000000001}]},{"osd":6,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0209999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Wed May 17 15:29:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.21,"15min":1.21},"last":0.65000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575278,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":26688,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27328512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34799999999999998,"15min":0.36099999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.50700000000000001,"5min":0.66200000000000003,"15min":0.77500000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.24099999999999999},"max":{"1min":0.58799999999999997,"5min":0.65900000000000003,"15min":0.76900000000000002},"last":0.27200000000000002}]},{"osd":1,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.437,"15min":0.45300000000000001},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54800000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.77500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.441,"5min":0.46600000000000003,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.30399999999999999},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45200000000000001}]},{"osd":4,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66500000000000004,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.3799999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66600000000000004,"15min":0.70199999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90300000000000002,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.623,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.38900000000000001},"max":{"1min":1.002,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.036},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.022,"15min":1.0820000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67300000000000004,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.079},"last":0.96799999999999997}]},{"osd":7,"last update":"Wed May 17 15:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64600000000000002,"15min":0.68500000000000005},"min":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.41499999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81399999999999995,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.73799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575277,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":21048,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94350792,"statfs":{"total":96636764160,"available":96615211008,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.91200000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58999999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.93000000000000005},"last":0.72099999999999997}]},{"osd":1,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":1.0169999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98499999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71299999999999997,"5min":0.80900000000000005,"15min":0.96299999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.97699999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.622},"min":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73799999999999999,"5min":0.83099999999999996,"15min":0.98499999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.89400000000000002,"15min":1.004},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.49199999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":0.88200000000000001,"15min":0.92300000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76900000000000002,"5min":0.87,"15min":0.87},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.70999999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.66800000000000004}]},{"osd":7,"last update":"Wed May 17 15:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.91000000000000003,"15min":0.97799999999999998},"last":0.437},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.63300000000000001,"15min":0.59899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.754,"5min":1.01,"15min":1.01},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575277,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":26112,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":2277376,"data_stored":1161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26738688},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":0.86499999999999999,"5min":1.101,"15min":1.101},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.64600000000000002},"min":{"1min":0.45500000000000002,"5min":0.438,"15min":0.371},"max":{"1min":0.82999999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64300000000000002}]},{"osd":1,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76600000000000001,"5min":1.012,"15min":1.012},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":0.995,"15min":0.995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":0.88400000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":0.90900000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89700000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.309,"15min":0.29199999999999998},"max":{"1min":0.72499999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79200000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.753}]},{"osd":7,"last update":"Wed May 17 15:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36499999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":0.83699999999999997,"15min":0.86699999999999999},"last":0.495},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T15:30:17.340 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-05-17T15:30:17.455 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.451+0000 7fb3363e6700 1 Processor -- start 2023-05-17T15:30:17.456 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb3363e6700 1 -- start start 2023-05-17T15:30:17.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb3363e6700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3301543d0 0x7fb3300c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb3363e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb330069410 0x7fb3300bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb3363e6700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb330158790 con 0x7fb3300c60f0 2023-05-17T15:30:17.457 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb3363e6700 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300c1c50 con 0x7fb3301543d0 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb3363e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300c6570 con 0x7fb330069410 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.452+0000 7fb32ffff700 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3301543d0 0x7fb3300c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32f7fe700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb3300c60f0 0x7fb330068d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47452/0 (socket says 172.21.15.27:47452) 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32f7fe700 1 -- 172.21.15.27:0/2021645492 learned_addr learned my addr 172.21.15.27:0/2021645492 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb334983700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb330069410 0x7fb3300bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32ffff700 1 -- 172.21.15.27:0/2021645492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb330069410 msgr2=0x7fb3300bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:30:17.458 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32ffff700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb330069410 0x7fb3300bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32ffff700 1 -- 172.21.15.27:0/2021645492 >> v1:172.21.15.27:6789/0 conn(0x7fb3300c60f0 legacy=0x7fb330068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32ffff700 1 -- 172.21.15.27:0/2021645492 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb330157e60 con 0x7fb3301543d0 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb334983700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb330069410 0x7fb3300bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32ffff700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3301543d0 0x7fb3300c5c00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fb320009760 tx=0x7fb320009060).ready entity=mon.0 client_cookie=ec448be8df6c70d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32effd700 1 -- 172.21.15.27:0/2021645492 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000f510 con 0x7fb3301543d0 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32effd700 1 -- 172.21.15.27:0/2021645492 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32000f670 con 0x7fb3301543d0 2023-05-17T15:30:17.459 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.453+0000 7fb32effd700 1 -- 172.21.15.27:0/2021645492 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000f9f0 con 0x7fb3301543d0 2023-05-17T15:30:17.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 -- 172.21.15.27:0/2021645492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3301543d0 msgr2=0x7fb3300c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3301543d0 0x7fb3300c5c00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fb320009760 tx=0x7fb320009060).stop 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 -- 172.21.15.27:0/2021645492 shutdown_connections 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb330069410 0x7fb3300bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 --2- 172.21.15.27:0/2021645492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3301543d0 0x7fb3300c5c00 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 -- 172.21.15.27:0/2021645492 >> 172.21.15.27:0/2021645492 conn(0x7fb3300cb7f0 msgr2=0x7fb3300c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 -- 172.21.15.27:0/2021645492 shutdown_connections 2023-05-17T15:30:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.454+0000 7fb3363e6700 1 -- 172.21.15.27:0/2021645492 wait complete. 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.455+0000 7fb3363e6700 1 Processor -- start 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.455+0000 7fb3363e6700 1 -- start start 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 0x7fb3300a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3300c60f0 0x7fb3300c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3301543d0 0x7fb3300c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300ade00 con 0x7fb330069410 2023-05-17T15:30:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300ae0e0 con 0x7fb3301543d0 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300ae3c0 con 0x7fb3300c60f0 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 0x7fb3300a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 0x7fb3300a9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47896/0 (socket says 172.21.15.27:47896) 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 -- 172.21.15.27:0/1794406895 learned_addr learned my addr 172.21.15.27:0/1794406895 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32f7fe700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3300c60f0 0x7fb3300c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb334983700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3301543d0 0x7fb3300c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 -- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3300c60f0 msgr2=0x7fb3300c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.464 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3300c60f0 0x7fb3300c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 -- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3301543d0 msgr2=0x7fb3300c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3301543d0 0x7fb3300c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 -- 172.21.15.27:0/1794406895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200092a0 con 0x7fb330069410 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb32ffff700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 0x7fb3300a9460 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7fb320009eb0 tx=0x7fb320017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000f7e0 con 0x7fb330069410 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32000f940 con 0x7fb330069410 2023-05-17T15:30:17.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3300ae6a0 con 0x7fb330069410 2023-05-17T15:30:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32001b660 con 0x7fb330069410 2023-05-17T15:30:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.456+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb330168990 con 0x7fb330069410 2023-05-17T15:30:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.457+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3300aebc0 con 0x7fb330069410 2023-05-17T15:30:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.458+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb32000f070 con 0x7fb330069410 2023-05-17T15:30:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.458+0000 7fb317fff700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb31c05ed90 0x7fb31c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.458+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7fb32007b0c0 con 0x7fb330069410 2023-05-17T15:30:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.458+0000 7fb32f7fe700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb31c05ed90 0x7fb31c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.458+0000 7fb32f7fe700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb31c05ed90 0x7fb31c061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb3300c3bc0 tx=0x7fb324009040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.462+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3300aebc0 con 0x7fb330069410 2023-05-17T15:30:17.639 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.635+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb330158140 con 0x7fb330069410 2023-05-17T15:30:17.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.638+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb32004c810 con 0x7fb330069410 2023-05-17T15:30:17.643 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.639+0000 7fb317fff700 1 -- 172.21.15.27:0/1794406895 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v38)=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb320050240 con 0x7fb330069410 2023-05-17T15:30:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb31c05ed90 msgr2=0x7fb31c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb31c05ed90 0x7fb31c061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb3300c3bc0 tx=0x7fb324009040).stop 2023-05-17T15:30:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 msgr2=0x7fb3300a9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 0x7fb3300a9460 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7fb320009eb0 tx=0x7fb320017000).stop 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 shutdown_connections 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7fb31c05ed90 0x7fb31c061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3301543d0 0x7fb3300c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb330069410 0x7fb3300a9460 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 --2- 172.21.15.27:0/1794406895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3300c60f0 0x7fb3300c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 >> 172.21.15.27:0/1794406895 conn(0x7fb3300cb7f0 msgr2=0x7fb3300accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:30:17.646 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 shutdown_connections 2023-05-17T15:30:17.647 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.641+0000 7fb3363e6700 1 -- 172.21.15.27:0/1794406895 wait complete. 2023-05-17T15:30:17.657 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T15:30:17.657 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T15:30:17.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.768+0000 7f542ca67700 1 Processor -- start 2023-05-17T15:30:17.772 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.768+0000 7f542ca67700 1 -- start start 2023-05-17T15:30:17.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542ca67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54280c5ef0 0x7f54280c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542ca67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 0x7f54280a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542ca67700 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280c05f0 con 0x7f5428153bf0 2023-05-17T15:30:17.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542ca67700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280aa240 con 0x7f54280c5ef0 2023-05-17T15:30:17.773 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542ca67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280aa510 con 0x7f54280cb470 2023-05-17T15:30:17.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f5426d9d700 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5428153bf0 0x7f5428154080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:47470/0 (socket says 172.21.15.27:47470) 2023-05-17T15:30:17.774 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f5426d9d700 1 -- 172.21.15.27:0/2772517722 learned_addr learned my addr 172.21.15.27:0/2772517722 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-05-17T15:30:17.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 0x7f54280a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742751958 0 0) 0x7f54280c05f0 con 0x7f5428153bf0 2023-05-17T15:30:17.776 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54140033f0 con 0x7f5428153bf0 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.769+0000 7f542659c700 1 --2- 172.21.15.27:0/2772517722 >> v2:172.21.15.40:3300/0 conn(0x7f54280c5ef0 0x7f54280c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484517934 0 0) 0x7f54140033f0 con 0x7f5428153bf0 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 msgr2=0x7f54280a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 0x7f54280a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 >> v2:172.21.15.40:3300/0 conn(0x7f54280c5ef0 msgr2=0x7f54280c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 --2- 172.21.15.27:0/2772517722 >> v2:172.21.15.40:3300/0 conn(0x7f54280c5ef0 0x7f54280c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.777 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280bfcc0 con 0x7f5428153bf0 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1108805275 0 0) 0x7f5418001470 con 0x7f5428153bf0 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 >> v1:172.21.15.27:6789/0 conn(0x7f5428153bf0 legacy=0x7f5428154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54140038e0 0x7f5414003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5414004690 0x7f5414004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 0x7f5414005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280aa240 con 0x7f5414004690 2023-05-17T15:30:17.778 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280aa510 con 0x7f54140038e0 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541400b8e0 con 0x7f54280cb470 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5414004690 0x7f5414004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5426d9d700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 0x7f5414005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542659c700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54140038e0 0x7f5414003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 -- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 msgr2=0x7f5414005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54280cb470 0x7f5414005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 -- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54140038e0 msgr2=0x7f5414003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T15:30:17.779 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54140038e0 0x7f5414003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 -- 172.21.15.27:0/2772517722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140033f0 con 0x7f5414004690 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542659c700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54140038e0 0x7f5414003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5414004690 0x7f5414004b10 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f54280cb8d0 tx=0x7f5410009060).ready entity=mon.0 client_cookie=107908b9b273c4ab server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.770+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410009e90 con 0x7f5414004690 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5410009430 con 0x7f5414004690 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542559a700 1 -- 172.21.15.27:0/2772517722 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541000e870 con 0x7f5414004690 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542ca67700 1 -- 172.21.15.27:0/2772517722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5414004690 msgr2=0x7f5414004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.780 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542ca67700 1 --2- 172.21.15.27:0/2772517722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5414004690 0x7f5414004b10 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f54280cb8d0 tx=0x7f5410009060).stop 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f5426d9d700 1 -- 172.21.15.27:0/2772517722 reap_dead start 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542ca67700 1 -- 172.21.15.27:0/2772517722 shutdown_connections 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542ca67700 1 -- 172.21.15.27:0/2772517722 >> 172.21.15.27:0/2772517722 conn(0x7f542805e810 msgr2=0x7f54280cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542ca67700 1 -- 172.21.15.27:0/2772517722 shutdown_connections 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.771+0000 7f542ca67700 1 -- 172.21.15.27:0/2772517722 wait complete. 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.772+0000 7f542ca67700 1 Processor -- start 2023-05-17T15:30:17.781 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.772+0000 7f542ca67700 1 -- start start 2023-05-17T15:30:17.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f542ca67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004690 0x7f5428153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f542ca67700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 0x7f5428141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.783 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f542ca67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5428150280 0x7f54280c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f542ca67700 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428150bf0 con 0x7f54280c2b60 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f542ca67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428152620 con 0x7f5414004690 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f542ca67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5428152900 con 0x7f5428150280 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 0x7f5428141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 0x7f5428141760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47918/0 (socket says 172.21.15.27:47918) 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 -- 172.21.15.27:0/2243637346 learned_addr learned my addr 172.21.15.27:0/2243637346 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-05-17T15:30:17.784 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 -- 172.21.15.27:0/2243637346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5428150280 msgr2=0x7f54280c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5428150280 0x7f54280c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 -- 172.21.15.27:0/2243637346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004690 msgr2=0x7f5428153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004690 0x7f5428153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 -- 172.21.15.27:0/2243637346 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428152be0 con 0x7f54280c2b60 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.773+0000 7f5425d9b700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 0x7f5428141760 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f5414004480 tx=0x7f5410009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.774+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541001e8b0 con 0x7f54280c2b60 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.774+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f541001ea30 con 0x7f54280c2b60 2023-05-17T15:30:17.785 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.774+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54281535f0 con 0x7f54280c2b60 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.774+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541001ee10 con 0x7f54280c2b60 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.774+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5428141c50 con 0x7f54280c2b60 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.775+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428152d70 con 0x7f54280c2b60 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.775+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 86) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f541002e070 con 0x7f54280c2b60 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.775+0000 7f541e7fc700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f540805ed90 0x7f5408061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.776+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5870+0+0 (secure 0 0 0) 0x7f541007b070 con 0x7f54280c2b60 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.776+0000 7f542659c700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f540805ed90 0x7f5408061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-17T15:30:17.786 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.776+0000 7f542659c700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f540805ed90 0x7f5408061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5420007660 tx=0x7f542000b040).ready entity=mgr.9285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T15:30:17.787 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.780+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54100a98f0 con 0x7f54280c2b60 2023-05-17T15:30:17.999 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.995+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f542805f4a0 con 0x7f54280c2b60 2023-05-17T15:30:18.000 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.996+0000 7f541e7fc700 1 -- 172.21.15.27:0/2243637346 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f541002c020 con 0x7f54280c2b60 2023-05-17T15:30:18.000 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-05-17T15:30:18.000 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/815829553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":815829553},{"type":"v1","addr":"172.21.15.40:6834","nonce":815829553}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2642727645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2642727645},{"type":"v1","addr":"172.21.15.27:6834","nonce":2642727645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3779317083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":3779317083},{"type":"v1","addr":"172.21.15.40:6835","nonce":3779317083}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":9378,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/177854322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":177854322},{"type":"v1","addr":"172.21.15.27:6835","nonce":177854322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[]} 2023-05-17T15:30:18.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f540805ed90 msgr2=0x7f5408061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:18.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f540805ed90 0x7f5408061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5420007660 tx=0x7f542000b040).stop 2023-05-17T15:30:18.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 msgr2=0x7f5428141760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T15:30:18.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 0x7f5428141760 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f5414004480 tx=0x7f5410009060).stop 2023-05-17T15:30:18.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 shutdown_connections 2023-05-17T15:30:18.002 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:6836/122387,v1:172.21.15.27:6837/122387] conn(0x7f540805ed90 0x7f5408061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:18.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5428150280 0x7f54280c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:30:18.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5414004690 0x7f5428153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-17T15:30:18.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 --2- 172.21.15.27:0/2243637346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54280c2b60 0x7f5428141760 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-17T15:30:18.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 >> 172.21.15.27:0/2243637346 conn(0x7f542805e810 msgr2=0x7f54280c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T15:30:18.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 shutdown_connections 2023-05-17T15:30:18.003 INFO:teuthology.orchestra.run.smithi027.stderr:2023-05-17T15:30:17.998+0000 7f542ca67700 1 -- 172.21.15.27:0/2243637346 wait complete. 2023-05-17T15:30:18.004 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 76 2023-05-17T15:30:18.013 DEBUG:tasks.cephfs.filesystem:already dead... 2023-05-17T15:30:18.014 INFO:teuthology.misc:Shutting down mds daemons... 2023-05-17T15:30:18.014 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T15:30:18.014 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.022 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T15:30:18.022 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T15:30:18.023 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.071 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T15:30:18.071 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T15:30:18.071 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.082 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T15:30:18.082 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T15:30:18.082 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.132 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T15:30:18.132 INFO:teuthology.misc:Shutting down osd daemons... 2023-05-17T15:30:18.133 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-05-17T15:30:18.133 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.171 INFO:tasks.ceph.osd.0:Stopped 2023-05-17T15:30:18.171 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-05-17T15:30:18.171 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.242 INFO:tasks.ceph.osd.1:Stopped 2023-05-17T15:30:18.242 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-05-17T15:30:18.242 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.313 INFO:tasks.ceph.osd.2:Stopped 2023-05-17T15:30:18.313 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-05-17T15:30:18.314 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.385 INFO:tasks.ceph.osd.3:Stopped 2023-05-17T15:30:18.385 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-05-17T15:30:18.385 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.426 INFO:tasks.ceph.osd.4:Stopped 2023-05-17T15:30:18.426 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-05-17T15:30:18.427 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.469 INFO:tasks.ceph.osd.5:Stopped 2023-05-17T15:30:18.469 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-05-17T15:30:18.470 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.502 INFO:tasks.ceph.osd.6:Stopped 2023-05-17T15:30:18.502 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-05-17T15:30:18.503 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.580 INFO:tasks.ceph.osd.7:Stopped 2023-05-17T15:30:18.580 INFO:teuthology.misc:Shutting down mgr daemons... 2023-05-17T15:30:18.581 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-05-17T15:30:18.581 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.607 INFO:tasks.ceph.mgr.y:Stopped 2023-05-17T15:30:18.607 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-05-17T15:30:18.607 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.646 INFO:tasks.ceph.mgr.x:Stopped 2023-05-17T15:30:18.646 INFO:teuthology.misc:Shutting down mon daemons... 2023-05-17T15:30:18.646 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-05-17T15:30:18.647 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.661 INFO:tasks.ceph.mon.a:Stopped 2023-05-17T15:30:18.661 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-05-17T15:30:18.662 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.699 INFO:tasks.ceph.mon.b:Stopped 2023-05-17T15:30:18.700 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-05-17T15:30:18.700 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T15:30:18.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-05-17T15:30:18.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-05-17T15:30:18.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-05-17T15:30:18.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-05-17T15:30:18.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-05-17T15:30:18.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-05-17T15:30:18.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-05-17T15:30:18.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-05-17T15:30:18.754 INFO:tasks.ceph.mon.c:Stopped 2023-05-17T15:30:18.754 INFO:tasks.ceph:Checking cluster log for badness... 2023-05-17T15:30:18.755 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-17T15:30:18.783 INFO:teuthology.orchestra.run.smithi027.stdout:2023-05-17T15:07:12.721468+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-05-17T15:30:18.784 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-05-17T15:30:18.784 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-17T15:30:18.853 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-17T15:30:18.922 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-17T15:30:18.990 INFO:teuthology.orchestra.run.smithi027.stdout:2023-05-17T15:07:12.721468+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-05-17T15:30:18.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:30:18.991 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-05-17T15:30:19.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:30:19.298 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-05-17T15:30:19.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:30:19.419 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-05-17T15:30:19.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:30:19.486 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-05-17T15:30:19.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T15:30:19.555 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-05-17T15:30:19.702 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T15:30:19.702 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-05-17T15:30:19.795 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T15:30:19.795 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-05-17T15:30:19.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T15:30:19.870 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-05-17T15:30:19.935 INFO:tasks.ceph:Archiving mon data... 2023-05-17T15:30:19.937 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/data/mon.a.tgz 2023-05-17T15:30:19.937 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-05-17T15:30:19.952 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.BkzMeWvQ7r 2023-05-17T15:30:19.952 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BkzMeWvQ7r 2023-05-17T15:30:20.431 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.BkzMeWvQ7r 2023-05-17T15:30:20.511 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.BkzMeWvQ7r is 2MB 2023-05-17T15:30:20.626 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.BkzMeWvQ7r 2023-05-17T15:30:20.640 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/data/mon.b.tgz 2023-05-17T15:30:20.641 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-05-17T15:30:20.658 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.DVrDQYl9FT 2023-05-17T15:30:20.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DVrDQYl9FT 2023-05-17T15:30:21.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.DVrDQYl9FT 2023-05-17T15:30:21.236 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.DVrDQYl9FT is 2MB 2023-05-17T15:30:21.321 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.DVrDQYl9FT 2023-05-17T15:30:21.335 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/data/mon.c.tgz 2023-05-17T15:30:21.335 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-05-17T15:30:21.388 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.NZtPlU85Wv 2023-05-17T15:30:21.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NZtPlU85Wv 2023-05-17T15:30:21.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.NZtPlU85Wv 2023-05-17T15:30:21.948 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.NZtPlU85Wv is 2MB 2023-05-17T15:30:22.065 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.NZtPlU85Wv 2023-05-17T15:30:22.079 INFO:tasks.ceph:Cleaning ceph cluster... 2023-05-17T15:30:22.079 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-17T15:30:22.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-17T15:30:22.142 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-05-17T15:30:22.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-17T15:30:22.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-17T15:30:22.178 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-17T15:30:22.207 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-17T15:30:22.213 INFO:tasks.ceph:Archiving crash dumps... 2023-05-17T15:30:22.214 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/remote/smithi027/crash 2023-05-17T15:30:22.215 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-17T15:30:22.251 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/remote/smithi040/crash 2023-05-17T15:30:22.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-17T15:30:22.275 INFO:tasks.ceph:Shutting down logrotate 2023-05-17T15:30:22.276 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:22.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:22.368 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:22.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-17T15:30:22.417 INFO:tasks.ceph:Compressing logs... 2023-05-17T15:30:22.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-17T15:30:22.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-17T15:30:23.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-05-17T15:30:23.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-05-17T15:30:23.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-05-17T15:30:23.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-05-17T15:30:23.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-05-17T15:30:23.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-05-17T15:30:23.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-05-17T15:30:23.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-05-17T15:30:31.092 INFO:tasks.ceph:Archiving logs... 2023-05-17T15:30:31.092 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/remote/smithi027/log 2023-05-17T15:30:31.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-17T15:30:32.225 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/remote/smithi040/log 2023-05-17T15:30:32.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-17T15:30:32.840 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-05-17T15:30:32.849 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-05-17T15:30:32.849 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-05-17T15:30:32.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-05-17T15:30:32.950 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-05-17T15:30:32.959 INFO:teuthology.task.clock:Checking final clock skew... 2023-05-17T15:30:32.959 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T15:30:32.961 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T15:30:32.975 INFO:teuthology.orchestra.run.smithi027.stderr:bash: ntpq: command not found 2023-05-17T15:30:32.977 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-05-17T15:30:32.979 INFO:teuthology.orchestra.run.smithi027.stdout:210 Number of sources = 4 2023-05-17T15:30:32.979 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-17T15:30:32.979 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-05-17T15:30:32.979 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv01.front.sepia.ceph.com 2 6 377 45 -1971us[-1975us] +/- 74ms 2023-05-17T15:30:32.979 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -2351us[-2354us] +/- 79ms 2023-05-17T15:30:32.980 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +3901us[+3897us] +/- 70ms 2023-05-17T15:30:32.980 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T15:30:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:210 Number of sources = 4 2023-05-17T15:30:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-17T15:30:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-05-17T15:30:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv01.front.sepia.ceph.com 2 6 377 50 -1963us[-1977us] +/- 74ms 2023-05-17T15:30:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -2372us[-2372us] +/- 79ms 2023-05-17T15:30:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +3895us[+3895us] +/- 70ms 2023-05-17T15:30:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T15:30:32.982 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-05-17T15:30:32.991 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-05-17T15:30:32.992 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-05-17T15:30:33.005 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-05-17T15:30:33.141 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-05-17T15:30:33.241 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-17T15:30:33.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T15:30:33.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-17T15:30:33.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T15:30:33.304 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-05-17T15:30:33.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-05-17T15:30:33.328 INFO:teuthology.task.internal:Duration was 3091.366253 seconds 2023-05-17T15:30:33.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-05-17T15:30:33.339 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-05-17T15:30:33.339 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-17T15:30:33.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-17T15:30:33.384 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-17T15:30:33.390 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-17T15:30:33.698 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-05-17T15:30:33.698 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2023-05-17T15:30:33.698 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-17T15:30:33.717 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-05-17T15:30:33.717 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-17T15:30:33.738 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-05-17T15:30:33.738 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-17T15:30:33.759 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-17T15:30:33.820 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-05-17T15:30:33.820 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-17T15:30:33.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-17T15:30:33.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-05-17T15:30:33.945 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-05-17T15:30:33.945 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-17T15:30:33.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-17T15:30:33.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-05-17T15:30:34.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-17T15:30:34.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-17T15:30:34.034 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2023-05-17T15:30:34.057 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-05-17T15:30:34.071 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-17T15:30:34.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T15:30:34.101 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-17T15:30:34.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T15:30:34.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-05-17T15:30:34.135 INFO:teuthology.task.internal:Transferring archived files... 2023-05-17T15:30:34.136 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/remote/smithi027 2023-05-17T15:30:34.136 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-17T15:30:34.176 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695/remote/smithi040 2023-05-17T15:30:34.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-17T15:30:34.208 INFO:teuthology.task.internal:Removing archive directory... 2023-05-17T15:30:34.208 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-17T15:30:34.212 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-17T15:30:34.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-05-17T15:30:34.268 INFO:teuthology.task.internal:Not uploading archives. 2023-05-17T15:30:34.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-05-17T15:30:34.278 INFO:teuthology.task.internal:Tidying up after the test... 2023-05-17T15:30:34.278 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-17T15:30:34.280 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-17T15:30:34.292 INFO:teuthology.orchestra.run.smithi027.stdout: 262168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 17 15:30 /home/ubuntu/cephtest 2023-05-17T15:30:34.311 INFO:teuthology.orchestra.run.smithi040.stdout: 262168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 17 15:30 /home/ubuntu/cephtest 2023-05-17T15:30:34.312 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-05-17T15:30:34.323 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-05-17T15:30:34.342 INFO:teuthology.nuke:Checking targets against current locks 2023-05-17T15:30:34.371 DEBUG:teuthology.nuke:shortname: smithi027 2023-05-17T15:30:34.371 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-17T15:30:34.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 14:32:57.572157', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0tAqdKL6Wfx3pAYpzzDfQvjo9ohcyjoizmIK3bWRG+SdJilcHa7Yr3ggmMRvSnk78lgfTOgPRWluy1i+ShrLlgymGZxyXA70+iJQLWycrYtKuTF+YsP/zRTk0ENQ7whwgG5gn8ykqjVmIertNi/KXQf+vsIAEt8HA6tHcALYA4bVnTjNOpaf02WkYxoPrdUbUZ+2MI0JyCDYw1YaqpxPiGFGd7ERukBIxEFRELItzbOIn+77ilfTV2+QNNtEeXo7gWaQ6f6MluI0Vm+V9SVaXLKOTU0qYR8JRFinN90e76TMiFgt25YBVwZ58iYK585ABg4IDLMYbHHxmz2LRt1LV2hrzAq3zQoh4xJUGVWJAhWvUOWhMtWyq3bQZkNmsu3UM4cXwliRshSLAdSezx6x/hBEEIseygeNTzCdU7CJKzd9xen67UQ//VFA1T0lQZVNcQnZgTSSAG5wdTbZO3khcOypavRPNb/YONv68Zv7sc/JHAKlbxNarfY1RV9K2ZKc='} 2023-05-17T15:30:34.398 DEBUG:teuthology.nuke:shortname: smithi040 2023-05-17T15:30:34.399 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-17T15:30:34.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/7276695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 14:32:57.574043', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIT6pm1GwEydSKlMy0dpeZlbS/axNoEY8ugWQRCpIjOMricwmwmD8UY9KHYVLjjOCdBjgbBJTmCcjPrXkxeNQlsZsNiDTjD/tHPJutz6f5MQTCus8tYQ4HSkInoMZkbF+//9MZS6dtLgr5boq8MJQPu9gwKErT4RbXXvYa4+Iz7ERI2216tWftcqb1+97lkvxX+vRU65p2c9CwBB5JdVSOI8ZNodEIOaI9ny6EsccOsYT+/gvEnV6vvANh6Pn92GlZBxB459BxbhshzTs4VRoiV4trIRwzhdM2tXthEvVtwqQWZ3Ckp6LHkGyIsmR0oOm1MnBsDp4o4we+PDsOQjvtv1CrH/e/A/rMoPvWeCVh9NxXG6RS9OrxZBjNEPMOdUU7EZDEhZd2wAUCm6UxTcqgV7hQ3wYLMkl1hRCPcUHgqst9etXO9ne7/t8HsMukBjAU1WZHzIkIrl3YOakHGGQc6O8L4BoPdCVoPFpfmgiPZwZbFHCBL3ujtba8bXQkw0k='} 2023-05-17T15:30:34.452 INFO:teuthology.orchestra.console:Power off smithi027 2023-05-17T15:30:34.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-17T15:30:34.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-17T15:30:34.496 INFO:teuthology.orchestra.console:Power off smithi040 2023-05-17T15:30:34.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-17T15:30:34.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-17T15:30:38.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-17T15:30:38.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-17T15:30:42.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-17T15:30:42.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-17T15:30:42.831 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2023-05-17T15:30:42.860 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-05-17T15:30:42.964 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3091.366253376007 failure_reason: '"2023-05-17T15:07:12.721468+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-05-17T15:30:42.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-17T15:30:43.056 INFO:teuthology.run:FAIL